2024-06-06T03:03:20.111 INFO:root:teuthology version: 0.0.1.dev303+g861a8dc 2024-06-06T03:03:20.111 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/iogen}} --archive /home/teuthworker/archive/teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi/7743011 --owner scheduled_teuthology@teuthology -- /home/teuthworker/archive/teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi/7743011/orig.config.yaml 2024-06-06T03:03:20.186 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-06T03:03:20.278 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi/7743011 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/iogen}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7743011' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - slow metadata IO - SLOW_OPS - slow request sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt dry_run: true install: ceph: flavor: default sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 3d746ca5346f34eef7e826a1eb71e59e02b682ae owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 5050 sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba sleep_before_teardown: 0 subset: 416/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_3d746ca5346f34eef7e826a1eb71e59e02b682ae/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 3d746ca5346f34eef7e826a1eb71e59e02b682ae syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi050.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNhQUBBdlmURgTmV2/rNzMg/Rf1naXejCSs4yTRLdEIvDGSaNk1WiD8fLeCEPHBgIGUpfrs5SLM+tPk2bDPMwsI= smithi079.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBV36OhtubycZerdsnTGsUGBcQ3ep/h5amzDqZvARgWlx8sXeGOH7Zbo9/IG0VI7qtM//hEWWXqjskfoqTBb5V4= smithi122.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHTordCDcakEl3FXMfC32ZWtxiq3tIDXlPkixrE3aHZ+b5uglyGbL16pf2UEr2bJOeZyIOeknaKsem1Em1S496o= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/iogen.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 861a8dcf7aa816a26e13f039336f7ed0a9aec0fa timestamp: 2024-06-05_21:24:16 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-06-06T03:03:20.278 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_3d746ca5346f34eef7e826a1eb71e59e02b682ae/qa; will attempt to use it 2024-06-06T03:03:20.279 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_3d746ca5346f34eef7e826a1eb71e59e02b682ae/qa/tasks 2024-06-06T03:03:20.279 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-06-06T03:03:20.281 INFO:teuthology.task.internal:Checking packages... 2024-06-06T03:03:20.302 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3d89accfe3201286f000e065a1faea2a88c7a6ba' 2024-06-06T03:03:20.302 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-06-06T03:03:20.302 INFO:teuthology.packaging:ref: None 2024-06-06T03:03:20.302 INFO:teuthology.packaging:tag: None 2024-06-06T03:03:20.302 INFO:teuthology.packaging:branch: squid 2024-06-06T03:03:20.302 INFO:teuthology.packaging:sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-06T03:03:20.302 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-06-06T03:03:20.508 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2960.g3d746ca5 2024-06-06T03:03:20.509 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-06-06T03:03:20.518 INFO:teuthology.task.internal:no buildpackages task found 2024-06-06T03:03:20.518 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-06-06T03:03:20.526 INFO:teuthology.task.internal:Saving configuration 2024-06-06T03:03:20.544 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-06-06T03:03:20.553 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-06-06T03:03:20.578 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi/7743011', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-06 02:58:25.970687', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNhQUBBdlmURgTmV2/rNzMg/Rf1naXejCSs4yTRLdEIvDGSaNk1WiD8fLeCEPHBgIGUpfrs5SLM+tPk2bDPMwsI='} 2024-06-06T03:03:20.601 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi/7743011', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-06 02:58:25.966970', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBV36OhtubycZerdsnTGsUGBcQ3ep/h5amzDqZvARgWlx8sXeGOH7Zbo9/IG0VI7qtM//hEWWXqjskfoqTBb5V4='} 2024-06-06T03:03:20.626 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi122.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi/7743011', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-06 02:58:25.968940', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHTordCDcakEl3FXMfC32ZWtxiq3tIDXlPkixrE3aHZ+b5uglyGbL16pf2UEr2bJOeZyIOeknaKsem1Em1S496o='} 2024-06-06T03:03:20.626 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-06-06T03:03:20.633 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-06-06T03:03:20.633 INFO:teuthology.task.internal:roles: ubuntu@smithi079.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-06-06T03:03:20.633 INFO:teuthology.task.internal:roles: ubuntu@smithi122.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-06-06T03:03:20.633 INFO:teuthology.run_tasks:Running task console_log... 2024-06-06T03:03:20.722 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fad4d183be0>, signals=[15]) 2024-06-06T03:03:20.722 INFO:teuthology.run_tasks:Running task internal.connect... 2024-06-06T03:03:20.730 INFO:teuthology.task.internal:Opening connections... 2024-06-06T03:03:20.730 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi050.front.sepia.ceph.com 2024-06-06T03:03:20.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T03:03:20.806 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi079.front.sepia.ceph.com 2024-06-06T03:03:20.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T03:03:20.898 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi122.front.sepia.ceph.com 2024-06-06T03:03:20.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T03:03:20.972 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-06-06T03:03:21.050 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2024-06-06T03:03:21.069 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2024-06-06T03:03:21.070 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2024-06-06T03:03:21.127 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream" 2024-06-06T03:03:21.127 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="9" 2024-06-06T03:03:21.128 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos" 2024-06-06T03:03:21.128 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora" 2024-06-06T03:03:21.128 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="9" 2024-06-06T03:03:21.128 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el9" 2024-06-06T03:03:21.128 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-06T03:03:21.128 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2024-06-06T03:03:21.128 INFO:teuthology.orchestra.run.smithi050.stdout:LOGO="fedora-logo-icon" 2024-06-06T03:03:21.128 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-06T03:03:21.128 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/" 2024-06-06T03:03:21.128 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-06T03:03:21.128 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-06T03:03:21.128 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-06T03:03:21.129 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2024-06-06T03:03:21.149 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2024-06-06T03:03:21.166 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2024-06-06T03:03:21.166 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2024-06-06T03:03:21.224 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream" 2024-06-06T03:03:21.224 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="9" 2024-06-06T03:03:21.224 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2024-06-06T03:03:21.224 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2024-06-06T03:03:21.224 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="9" 2024-06-06T03:03:21.224 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el9" 2024-06-06T03:03:21.224 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-06T03:03:21.224 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2024-06-06T03:03:21.224 INFO:teuthology.orchestra.run.smithi079.stdout:LOGO="fedora-logo-icon" 2024-06-06T03:03:21.224 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-06T03:03:21.224 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/" 2024-06-06T03:03:21.225 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-06T03:03:21.225 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-06T03:03:21.225 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-06T03:03:21.225 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2024-06-06T03:03:21.249 DEBUG:teuthology.orchestra.run.smithi122:> uname -m 2024-06-06T03:03:21.267 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64 2024-06-06T03:03:21.267 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release 2024-06-06T03:03:21.323 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="CentOS Stream" 2024-06-06T03:03:21.324 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="9" 2024-06-06T03:03:21.324 INFO:teuthology.orchestra.run.smithi122.stdout:ID="centos" 2024-06-06T03:03:21.324 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="rhel fedora" 2024-06-06T03:03:21.324 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="9" 2024-06-06T03:03:21.324 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el9" 2024-06-06T03:03:21.324 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-06T03:03:21.324 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31" 2024-06-06T03:03:21.324 INFO:teuthology.orchestra.run.smithi122.stdout:LOGO="fedora-logo-icon" 2024-06-06T03:03:21.324 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-06T03:03:21.324 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://centos.org/" 2024-06-06T03:03:21.324 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-06T03:03:21.324 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-06T03:03:21.325 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-06T03:03:21.325 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2024-06-06T03:03:21.348 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-06-06T03:03:21.361 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-06-06T03:03:21.367 INFO:teuthology.task.internal:Checking for old test directory... 2024-06-06T03:03:21.367 DEBUG:teuthology.orchestra.run.smithi050:> test '!' -e /home/ubuntu/cephtest 2024-06-06T03:03:21.370 DEBUG:teuthology.orchestra.run.smithi079:> test '!' -e /home/ubuntu/cephtest 2024-06-06T03:03:21.372 DEBUG:teuthology.orchestra.run.smithi122:> test '!' -e /home/ubuntu/cephtest 2024-06-06T03:03:21.388 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-06-06T03:03:21.397 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-06-06T03:03:21.397 DEBUG:teuthology.orchestra.run.smithi050:> test -z $(ls -A /var/lib/ceph) 2024-06-06T03:03:21.427 DEBUG:teuthology.orchestra.run.smithi079:> test -z $(ls -A /var/lib/ceph) 2024-06-06T03:03:21.429 DEBUG:teuthology.orchestra.run.smithi122:> test -z $(ls -A /var/lib/ceph) 2024-06-06T03:03:21.531 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-06-06T03:03:21.607 INFO:teuthology.run_tasks:Running task kernel... 2024-06-06T03:03:21.624 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-06-06T03:03:21.624 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-06-06T03:03:21.625 DEBUG:teuthology.orchestra.run.smithi050:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-06T03:03:21.626 DEBUG:teuthology.orchestra.run.smithi079:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-06T03:03:21.626 DEBUG:teuthology.orchestra.run.smithi122:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-06T03:03:21.646 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T03:03:21.647 DEBUG:teuthology.orchestra.run.smithi122:> uname -r 2024-06-06T03:03:21.648 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T03:03:21.648 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T03:03:21.648 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2024-06-06T03:03:21.649 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2024-06-06T03:03:21.704 INFO:teuthology.orchestra.run.smithi122.stdout:5.14.0-437.el9.x86_64 2024-06-06T03:03:21.704 INFO:teuthology.task.kernel:Running kernel on smithi122: 5.14.0-437.el9.x86_64 2024-06-06T03:03:21.704 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum install -y kernel 2024-06-06T03:03:21.705 INFO:teuthology.orchestra.run.smithi079.stdout:5.14.0-437.el9.x86_64 2024-06-06T03:03:21.705 INFO:teuthology.task.kernel:Running kernel on smithi079: 5.14.0-437.el9.x86_64 2024-06-06T03:03:21.705 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum install -y kernel 2024-06-06T03:03:21.706 INFO:teuthology.orchestra.run.smithi050.stdout:5.14.0-437.el9.x86_64 2024-06-06T03:03:21.707 INFO:teuthology.task.kernel:Running kernel on smithi050: 5.14.0-437.el9.x86_64 2024-06-06T03:03:21.707 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum install -y kernel 2024-06-06T03:03:23.957 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.1 MB 00:00 2024-06-06T03:03:24.130 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.1 MB 00:00 2024-06-06T03:03:24.189 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - BaseOS 9.1 MB/s | 8.1 MB 00:00 2024-06-06T03:03:25.842 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-06-06T03:03:26.165 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-06-06T03:03:26.210 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:00 2024-06-06T03:03:30.150 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-06-06T03:03:30.516 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - CRB 8.7 MB/s | 6.2 MB 00:00 2024-06-06T03:03:30.552 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - CRB 9.0 MB/s | 6.2 MB 00:00 2024-06-06T03:03:31.759 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 17 kB 00:00 2024-06-06T03:03:31.975 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 17 kB 00:00 2024-06-06T03:03:31.985 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 17 kB 00:00 2024-06-06T03:03:34.254 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 9.0 MB/s | 21 MB 00:02 2024-06-06T03:03:34.453 INFO:teuthology.orchestra.run.smithi122.stdout:Extra Packages for Enterprise Linux 9.1 MB/s | 21 MB 00:02 2024-06-06T03:03:34.470 INFO:teuthology.orchestra.run.smithi079.stdout:Extra Packages for Enterprise Linux 9.0 MB/s | 21 MB 00:02 2024-06-06T03:03:39.567 INFO:teuthology.orchestra.run.smithi122.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-06-06T03:03:39.635 INFO:teuthology.orchestra.run.smithi079.stdout:lab-extras 20 kB/s | 1.7 kB 00:00 2024-06-06T03:03:39.642 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 47 kB/s | 1.7 kB 00:00 2024-06-06T03:03:41.565 INFO:teuthology.orchestra.run.smithi122.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-06-06T03:03:41.566 INFO:teuthology.orchestra.run.smithi122.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-06-06T03:03:41.649 INFO:teuthology.orchestra.run.smithi079.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-06-06T03:03:41.649 INFO:teuthology.orchestra.run.smithi079.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-06-06T03:03:41.665 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-06-06T03:03:41.670 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-06-06T03:03:41.670 INFO:teuthology.orchestra.run.smithi122.stdout: Package Architecture Version Repository Size 2024-06-06T03:03:41.670 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-06-06T03:03:41.670 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-06-06T03:03:41.670 INFO:teuthology.orchestra.run.smithi122.stdout: kernel x86_64 5.14.0-452.el9 baseos 893 k 2024-06-06T03:03:41.670 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-06-06T03:03:41.670 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-core x86_64 5.14.0-452.el9 baseos 16 M 2024-06-06T03:03:41.670 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-modules x86_64 5.14.0-452.el9 baseos 35 M 2024-06-06T03:03:41.670 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-modules-core x86_64 5.14.0-452.el9 baseos 29 M 2024-06-06T03:03:41.671 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-06-06T03:03:41.671 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-06-06T03:03:41.671 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-06-06T03:03:41.671 INFO:teuthology.orchestra.run.smithi122.stdout:Install 4 Packages 2024-06-06T03:03:41.671 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-06-06T03:03:41.671 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 80 M 2024-06-06T03:03:41.671 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 124 M 2024-06-06T03:03:41.672 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-06-06T03:03:41.745 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-06-06T03:03:41.756 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-06-06T03:03:41.756 INFO:teuthology.orchestra.run.smithi079.stdout: Package Architecture Version Repository Size 2024-06-06T03:03:41.756 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-06-06T03:03:41.756 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-06-06T03:03:41.756 INFO:teuthology.orchestra.run.smithi079.stdout: kernel x86_64 5.14.0-452.el9 baseos 893 k 2024-06-06T03:03:41.756 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2024-06-06T03:03:41.756 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-core x86_64 5.14.0-452.el9 baseos 16 M 2024-06-06T03:03:41.757 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-modules x86_64 5.14.0-452.el9 baseos 35 M 2024-06-06T03:03:41.757 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-modules-core x86_64 5.14.0-452.el9 baseos 29 M 2024-06-06T03:03:41.757 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-06T03:03:41.757 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-06-06T03:03:41.757 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-06-06T03:03:41.757 INFO:teuthology.orchestra.run.smithi079.stdout:Install 4 Packages 2024-06-06T03:03:41.757 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-06T03:03:41.757 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 80 M 2024-06-06T03:03:41.757 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 124 M 2024-06-06T03:03:41.757 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-06-06T03:03:41.766 INFO:teuthology.orchestra.run.smithi050.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-06-06T03:03:41.766 INFO:teuthology.orchestra.run.smithi050.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-06-06T03:03:41.835 INFO:teuthology.orchestra.run.smithi122.stdout:[MIRROR] kernel-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T03:03:41.837 INFO:teuthology.orchestra.run.smithi122.stdout:[MIRROR] kernel-core-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T03:03:41.841 INFO:teuthology.orchestra.run.smithi122.stdout:[MIRROR] kernel-modules-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T03:03:41.854 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-06-06T03:03:41.861 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-06-06T03:03:41.862 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2024-06-06T03:03:41.862 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-06-06T03:03:41.862 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2024-06-06T03:03:41.862 INFO:teuthology.orchestra.run.smithi050.stdout: kernel x86_64 5.14.0-452.el9 baseos 893 k 2024-06-06T03:03:41.863 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2024-06-06T03:03:41.863 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-core x86_64 5.14.0-452.el9 baseos 16 M 2024-06-06T03:03:41.863 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules x86_64 5.14.0-452.el9 baseos 35 M 2024-06-06T03:03:41.863 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules-core x86_64 5.14.0-452.el9 baseos 29 M 2024-06-06T03:03:41.863 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:03:41.864 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-06-06T03:03:41.864 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-06-06T03:03:41.864 INFO:teuthology.orchestra.run.smithi050.stdout:Install 4 Packages 2024-06-06T03:03:41.864 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:03:41.865 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 80 M 2024-06-06T03:03:41.865 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 124 M 2024-06-06T03:03:41.866 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2024-06-06T03:03:41.977 INFO:teuthology.orchestra.run.smithi122.stdout:(1/4): kernel-5.14.0-452.el9.x86_64.rpm 3.9 MB/s | 893 kB 00:00 2024-06-06T03:03:42.009 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] kernel-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T03:03:42.015 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] kernel-core-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T03:03:42.034 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] kernel-modules-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T03:03:42.211 INFO:teuthology.orchestra.run.smithi079.stdout:(1/4): kernel-5.14.0-452.el9.x86_64.rpm 3.0 MB/s | 893 kB 00:00 2024-06-06T03:03:42.250 INFO:teuthology.orchestra.run.smithi050.stdout:[MIRROR] kernel-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T03:03:42.256 INFO:teuthology.orchestra.run.smithi050.stdout:[MIRROR] kernel-core-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T03:03:42.267 INFO:teuthology.orchestra.run.smithi050.stdout:[MIRROR] kernel-modules-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T03:03:42.269 INFO:teuthology.orchestra.run.smithi122.stdout:(2/4): kernel-core-5.14.0-452.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-06-06T03:03:42.486 INFO:teuthology.orchestra.run.smithi050.stdout:(1/4): kernel-5.14.0-452.el9.x86_64.rpm 2.7 MB/s | 893 kB 00:00 2024-06-06T03:03:42.503 INFO:teuthology.orchestra.run.smithi079.stdout:(2/4): kernel-core-5.14.0-452.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-06-06T03:03:42.719 INFO:teuthology.orchestra.run.smithi122.stdout:(3/4): kernel-modules-5.14.0-452.el9.x86_64.rpm 36 MB/s | 35 MB 00:00 2024-06-06T03:03:42.828 INFO:teuthology.orchestra.run.smithi050.stdout:(2/4): kernel-core-5.14.0-452.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-06-06T03:03:42.978 INFO:teuthology.orchestra.run.smithi079.stdout:(3/4): kernel-modules-core-5.14.0-452.el9.x86_6 38 MB/s | 29 MB 00:00 2024-06-06T03:03:43.020 INFO:teuthology.orchestra.run.smithi122.stdout:(4/4): kernel-modules-core-5.14.0-452.el9.x86_6 28 MB/s | 29 MB 00:01 2024-06-06T03:03:43.022 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-06-06T03:03:43.022 INFO:teuthology.orchestra.run.smithi122.stdout:Total 59 MB/s | 80 MB 00:01 2024-06-06T03:03:43.253 INFO:teuthology.orchestra.run.smithi050.stdout:(3/4): kernel-modules-5.14.0-452.el9.x86_64.rpm 32 MB/s | 35 MB 00:01 2024-06-06T03:03:43.303 INFO:teuthology.orchestra.run.smithi079.stdout:(4/4): kernel-modules-5.14.0-452.el9.x86_64.rpm 25 MB/s | 35 MB 00:01 2024-06-06T03:03:43.305 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-06-06T03:03:43.306 INFO:teuthology.orchestra.run.smithi079.stdout:Total 52 MB/s | 80 MB 00:01 2024-06-06T03:03:43.570 INFO:teuthology.orchestra.run.smithi050.stdout:(4/4): kernel-modules-core-5.14.0-452.el9.x86_6 27 MB/s | 29 MB 00:01 2024-06-06T03:03:43.572 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-06-06T03:03:43.573 INFO:teuthology.orchestra.run.smithi050.stdout:Total 47 MB/s | 80 MB 00:01 2024-06-06T03:03:43.723 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-06-06T03:03:44.002 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-06-06T03:03:44.062 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-06-06T03:03:44.062 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-06-06T03:03:44.298 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2024-06-06T03:03:44.338 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-06-06T03:03:44.338 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-06-06T03:03:44.711 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2024-06-06T03:03:44.712 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2024-06-06T03:03:45.038 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-06-06T03:03:45.039 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-06-06T03:03:45.288 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-06-06T03:03:45.289 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-06-06T03:03:45.701 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2024-06-06T03:03:45.702 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2024-06-06T03:03:47.449 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-06-06T03:03:47.698 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-06-06T03:03:48.101 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : kernel-modules-core-5.14.0-452.el9.x86_64 1/4 2024-06-06T03:03:48.189 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-06T03:03:48.227 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2024-06-06T03:03:48.382 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : kernel-modules-core-5.14.0-452.el9.x86_64 1/4 2024-06-06T03:03:48.478 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-06T03:03:48.908 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-modules-core-5.14.0-452.el9.x86_64 1/4 2024-06-06T03:03:48.996 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-06T03:03:50.849 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-06T03:03:51.001 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-06T03:03:51.169 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-06T03:03:51.313 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-06T03:03:51.805 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-06T03:03:51.951 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-06T03:03:55.723 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-06T03:03:55.773 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : kernel-5.14.0-452.el9.x86_64 4/4 2024-06-06T03:03:56.041 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-06T03:03:56.176 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : kernel-5.14.0-452.el9.x86_64 4/4 2024-06-06T03:03:57.044 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-06T03:03:57.098 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-5.14.0-452.el9.x86_64 4/4 2024-06-06T03:04:00.515 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-06T03:04:00.917 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-06T03:04:02.212 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-06T03:04:29.858 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 4/4 2024-06-06T03:04:29.899 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 4/4 2024-06-06T03:04:30.211 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 4/4 2024-06-06T03:04:30.252 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 4/4 2024-06-06T03:04:30.265 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-5.14.0-452.el9.x86_64 4/4 2024-06-06T03:04:30.265 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : kernel-5.14.0-452.el9.x86_64 1/4 2024-06-06T03:04:30.266 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-06T03:04:30.266 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-06T03:04:30.572 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-5.14.0-452.el9.x86_64 4/4 2024-06-06T03:04:30.572 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : kernel-5.14.0-452.el9.x86_64 1/4 2024-06-06T03:04:30.572 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-06T03:04:30.572 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-06T03:04:31.145 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-06T03:04:31.145 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-06-06T03:04:31.145 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-06-06T03:04:31.145 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-5.14.0-452.el9.x86_64 2024-06-06T03:04:31.145 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-core-5.14.0-452.el9.x86_64 2024-06-06T03:04:31.145 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-modules-5.14.0-452.el9.x86_64 2024-06-06T03:04:31.145 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-modules-core-5.14.0-452.el9.x86_64 2024-06-06T03:04:31.145 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-06-06T03:04:31.145 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-06-06T03:04:31.370 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-06T03:04:31.370 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-06T03:04:31.371 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-06-06T03:04:31.371 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-5.14.0-452.el9.x86_64 2024-06-06T03:04:31.371 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-core-5.14.0-452.el9.x86_64 2024-06-06T03:04:31.371 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-modules-5.14.0-452.el9.x86_64 2024-06-06T03:04:31.371 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-modules-core-5.14.0-452.el9.x86_64 2024-06-06T03:04:31.371 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-06T03:04:31.372 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-06-06T03:04:31.562 DEBUG:teuthology.orchestra.run.smithi122:> rpm -q kernel | sort -rV | head -n 1 2024-06-06T03:04:31.640 INFO:teuthology.orchestra.run.smithi122.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-06T03:04:31.640 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-06T03:04:31.641 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-452.el9.x86_64 2024-06-06T03:04:31.641 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-06-06T03:04:31.641 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-06-06T03:04:31.641 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-06-06T03:04:31.641 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi122.front.sepia.ceph.com, path=None, version=distro) 2024-06-06T03:04:31.641 DEBUG:teuthology.orchestra.run.smithi122:> rpm -q kernel | sort -rV | head -n 1 2024-06-06T03:04:31.695 INFO:teuthology.orchestra.run.smithi122.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-06T03:04:31.695 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-06T03:04:31.695 DEBUG:teuthology.orchestra.run.smithi122:> sudo rpm -qi grub2-tools 2024-06-06T03:04:31.725 INFO:teuthology.orchestra.run.smithi122.stdout:Name : grub2-tools 2024-06-06T03:04:31.726 INFO:teuthology.orchestra.run.smithi122.stdout:Epoch : 1 2024-06-06T03:04:31.726 INFO:teuthology.orchestra.run.smithi122.stdout:Version : 2.06 2024-06-06T03:04:31.726 INFO:teuthology.orchestra.run.smithi122.stdout:Release : 68.el9 2024-06-06T03:04:31.726 INFO:teuthology.orchestra.run.smithi122.stdout:Architecture: x86_64 2024-06-06T03:04:31.726 INFO:teuthology.orchestra.run.smithi122.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-06-06T03:04:31.726 INFO:teuthology.orchestra.run.smithi122.stdout:Group : Unspecified 2024-06-06T03:04:31.726 INFO:teuthology.orchestra.run.smithi122.stdout:Size : 8264254 2024-06-06T03:04:31.726 INFO:teuthology.orchestra.run.smithi122.stdout:License : GPLv3+ 2024-06-06T03:04:31.726 INFO:teuthology.orchestra.run.smithi122.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-06-06T03:04:31.727 INFO:teuthology.orchestra.run.smithi122.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-06-06T03:04:31.727 INFO:teuthology.orchestra.run.smithi122.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-06-06T03:04:31.727 INFO:teuthology.orchestra.run.smithi122.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-06-06T03:04:31.727 INFO:teuthology.orchestra.run.smithi122.stdout:Packager : builder@centos.org 2024-06-06T03:04:31.727 INFO:teuthology.orchestra.run.smithi122.stdout:Vendor : CentOS 2024-06-06T03:04:31.727 INFO:teuthology.orchestra.run.smithi122.stdout:URL : http://www.gnu.org/software/grub/ 2024-06-06T03:04:31.727 INFO:teuthology.orchestra.run.smithi122.stdout:Summary : Support tools for GRUB. 2024-06-06T03:04:31.727 INFO:teuthology.orchestra.run.smithi122.stdout:Description : 2024-06-06T03:04:31.727 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-06-06T03:04:31.727 INFO:teuthology.orchestra.run.smithi122.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-06-06T03:04:31.727 INFO:teuthology.orchestra.run.smithi122.stdout:customizable bootloader with modular architecture. It supports a rich 2024-06-06T03:04:31.728 INFO:teuthology.orchestra.run.smithi122.stdout:variety of kernel formats, file systems, computer architectures and 2024-06-06T03:04:31.728 INFO:teuthology.orchestra.run.smithi122.stdout:hardware devices. 2024-06-06T03:04:31.728 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-06-06T03:04:31.728 INFO:teuthology.orchestra.run.smithi122.stdout:This subpackage provides tools for support of all platforms. 2024-06-06T03:04:31.729 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-06-06T03:04:31.729 INFO:teuthology.task.kernel:Updating grub on smithi122 to boot 5.14.0-452.el9.x86_64 2024-06-06T03:04:31.729 DEBUG:teuthology.orchestra.run.smithi122:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-06-06T03:04:31.741 DEBUG:teuthology.orchestra.run.smithi079:> rpm -q kernel | sort -rV | head -n 1 2024-06-06T03:04:31.840 INFO:teuthology.orchestra.run.smithi079.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-06T03:04:31.840 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-06T03:04:31.841 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-452.el9.x86_64 2024-06-06T03:04:31.841 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-06-06T03:04:31.841 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-06-06T03:04:31.841 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-06-06T03:04:31.841 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi079.front.sepia.ceph.com, path=None, version=distro) 2024-06-06T03:04:31.842 DEBUG:teuthology.orchestra.run.smithi079:> rpm -q kernel | sort -rV | head -n 1 2024-06-06T03:04:31.895 INFO:teuthology.orchestra.run.smithi079.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-06T03:04:31.895 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-06T03:04:31.895 DEBUG:teuthology.orchestra.run.smithi079:> sudo rpm -qi grub2-tools 2024-06-06T03:04:31.934 INFO:teuthology.orchestra.run.smithi079.stdout:Name : grub2-tools 2024-06-06T03:04:31.935 INFO:teuthology.orchestra.run.smithi079.stdout:Epoch : 1 2024-06-06T03:04:31.935 INFO:teuthology.orchestra.run.smithi079.stdout:Version : 2.06 2024-06-06T03:04:31.935 INFO:teuthology.orchestra.run.smithi079.stdout:Release : 68.el9 2024-06-06T03:04:31.935 INFO:teuthology.orchestra.run.smithi079.stdout:Architecture: x86_64 2024-06-06T03:04:31.935 INFO:teuthology.orchestra.run.smithi079.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-06-06T03:04:31.935 INFO:teuthology.orchestra.run.smithi079.stdout:Group : Unspecified 2024-06-06T03:04:31.935 INFO:teuthology.orchestra.run.smithi079.stdout:Size : 8264254 2024-06-06T03:04:31.935 INFO:teuthology.orchestra.run.smithi079.stdout:License : GPLv3+ 2024-06-06T03:04:31.935 INFO:teuthology.orchestra.run.smithi079.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-06-06T03:04:31.935 INFO:teuthology.orchestra.run.smithi079.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-06-06T03:04:31.935 INFO:teuthology.orchestra.run.smithi079.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-06-06T03:04:31.936 INFO:teuthology.orchestra.run.smithi079.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-06-06T03:04:31.936 INFO:teuthology.orchestra.run.smithi079.stdout:Packager : builder@centos.org 2024-06-06T03:04:31.936 INFO:teuthology.orchestra.run.smithi079.stdout:Vendor : CentOS 2024-06-06T03:04:31.936 INFO:teuthology.orchestra.run.smithi079.stdout:URL : http://www.gnu.org/software/grub/ 2024-06-06T03:04:31.936 INFO:teuthology.orchestra.run.smithi079.stdout:Summary : Support tools for GRUB. 2024-06-06T03:04:31.936 INFO:teuthology.orchestra.run.smithi079.stdout:Description : 2024-06-06T03:04:31.936 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-06T03:04:31.936 INFO:teuthology.orchestra.run.smithi079.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-06-06T03:04:31.936 INFO:teuthology.orchestra.run.smithi079.stdout:customizable bootloader with modular architecture. It supports a rich 2024-06-06T03:04:31.936 INFO:teuthology.orchestra.run.smithi079.stdout:variety of kernel formats, file systems, computer architectures and 2024-06-06T03:04:31.936 INFO:teuthology.orchestra.run.smithi079.stdout:hardware devices. 2024-06-06T03:04:31.936 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-06T03:04:31.936 INFO:teuthology.orchestra.run.smithi079.stdout:This subpackage provides tools for support of all platforms. 2024-06-06T03:04:31.937 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-06-06T03:04:31.937 INFO:teuthology.task.kernel:Updating grub on smithi079 to boot 5.14.0-452.el9.x86_64 2024-06-06T03:04:31.938 DEBUG:teuthology.orchestra.run.smithi079:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-06-06T03:04:32.322 INFO:teuthology.orchestra.run.smithi122.stderr:Generating grub configuration file ... 2024-06-06T03:04:32.619 INFO:teuthology.orchestra.run.smithi079.stderr:Generating grub configuration file ... 2024-06-06T03:04:33.129 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 4/4 2024-06-06T03:04:33.172 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 4/4 2024-06-06T03:04:33.520 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-5.14.0-452.el9.x86_64 4/4 2024-06-06T03:04:33.520 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-5.14.0-452.el9.x86_64 1/4 2024-06-06T03:04:33.520 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-06T03:04:33.520 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-06T03:04:33.711 INFO:teuthology.orchestra.run.smithi122.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-06-06T03:04:33.740 INFO:teuthology.orchestra.run.smithi122.stderr:done 2024-06-06T03:04:33.743 DEBUG:teuthology.orchestra.run.smithi122:> mktemp 2024-06-06T03:04:33.759 INFO:teuthology.orchestra.run.smithi122.stdout:/tmp/tmp.D8RZvZblZw 2024-06-06T03:04:33.759 DEBUG:teuthology.orchestra.run.smithi122:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.D8RZvZblZw 2024-06-06T03:04:33.824 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0666 /tmp/tmp.D8RZvZblZw 2024-06-06T03:04:33.923 INFO:teuthology.orchestra.run.smithi079.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-06-06T03:04:33.958 INFO:teuthology.orchestra.run.smithi079.stderr:done 2024-06-06T03:04:33.961 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2024-06-06T03:04:33.965 DEBUG:teuthology.orchestra.remote:smithi122:/tmp/tmp.D8RZvZblZw is 6KB 2024-06-06T03:04:33.975 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.BDe4sVnfOD 2024-06-06T03:04:33.976 DEBUG:teuthology.orchestra.run.smithi079:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.BDe4sVnfOD 2024-06-06T03:04:34.014 DEBUG:teuthology.orchestra.run.smithi122:> rm -fr /tmp/tmp.D8RZvZblZw 2024-06-06T03:04:34.028 DEBUG:teuthology.orchestra.run.smithi122:> sudo /bin/ls /boot/loader/entries || true 2024-06-06T03:04:34.046 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.BDe4sVnfOD 2024-06-06T03:04:34.089 INFO:teuthology.orchestra.run.smithi122.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-06-06T03:04:34.089 INFO:teuthology.orchestra.run.smithi122.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-06-06T03:04:34.089 INFO:teuthology.orchestra.run.smithi122.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-06-06T03:04:34.089 INFO:teuthology.orchestra.run.smithi122.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64.conf 2024-06-06T03:04:34.090 DEBUG:teuthology.orchestra.run.smithi122:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64 2024-06-06T03:04:34.203 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.BDe4sVnfOD is 6KB 2024-06-06T03:04:34.238 DEBUG:teuthology.orchestra.run.smithi122:> sudo shutdown -r now 2024-06-06T03:04:34.251 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.BDe4sVnfOD 2024-06-06T03:04:34.265 DEBUG:teuthology.orchestra.run.smithi079:> sudo /bin/ls /boot/loader/entries || true 2024-06-06T03:04:34.295 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-06T03:04:34.295 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:04:34.295 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2024-06-06T03:04:34.295 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-5.14.0-452.el9.x86_64 2024-06-06T03:04:34.295 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-core-5.14.0-452.el9.x86_64 2024-06-06T03:04:34.296 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules-5.14.0-452.el9.x86_64 2024-06-06T03:04:34.296 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules-core-5.14.0-452.el9.x86_64 2024-06-06T03:04:34.296 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:04:34.296 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-06-06T03:04:34.326 INFO:teuthology.orchestra.run.smithi079.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-06-06T03:04:34.326 INFO:teuthology.orchestra.run.smithi079.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-06-06T03:04:34.326 INFO:teuthology.orchestra.run.smithi079.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-06-06T03:04:34.326 INFO:teuthology.orchestra.run.smithi079.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64.conf 2024-06-06T03:04:34.327 DEBUG:teuthology.orchestra.run.smithi079:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64 2024-06-06T03:04:34.466 DEBUG:teuthology.orchestra.run.smithi079:> sudo shutdown -r now 2024-06-06T03:04:34.646 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q kernel | sort -rV | head -n 1 2024-06-06T03:04:34.720 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-06T03:04:34.720 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-06T03:04:34.720 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-452.el9.x86_64 2024-06-06T03:04:34.720 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-06-06T03:04:34.720 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-06-06T03:04:34.720 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-06-06T03:04:34.720 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi050.front.sepia.ceph.com, path=None, version=distro) 2024-06-06T03:04:34.721 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q kernel | sort -rV | head -n 1 2024-06-06T03:04:34.775 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-06T03:04:34.775 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-06T03:04:34.775 DEBUG:teuthology.orchestra.run.smithi050:> sudo rpm -qi grub2-tools 2024-06-06T03:04:34.806 INFO:teuthology.orchestra.run.smithi050.stdout:Name : grub2-tools 2024-06-06T03:04:34.807 INFO:teuthology.orchestra.run.smithi050.stdout:Epoch : 1 2024-06-06T03:04:34.807 INFO:teuthology.orchestra.run.smithi050.stdout:Version : 2.06 2024-06-06T03:04:34.807 INFO:teuthology.orchestra.run.smithi050.stdout:Release : 68.el9 2024-06-06T03:04:34.807 INFO:teuthology.orchestra.run.smithi050.stdout:Architecture: x86_64 2024-06-06T03:04:34.807 INFO:teuthology.orchestra.run.smithi050.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-06-06T03:04:34.807 INFO:teuthology.orchestra.run.smithi050.stdout:Group : Unspecified 2024-06-06T03:04:34.807 INFO:teuthology.orchestra.run.smithi050.stdout:Size : 8264254 2024-06-06T03:04:34.807 INFO:teuthology.orchestra.run.smithi050.stdout:License : GPLv3+ 2024-06-06T03:04:34.807 INFO:teuthology.orchestra.run.smithi050.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-06-06T03:04:34.807 INFO:teuthology.orchestra.run.smithi050.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-06-06T03:04:34.807 INFO:teuthology.orchestra.run.smithi050.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-06-06T03:04:34.807 INFO:teuthology.orchestra.run.smithi050.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-06-06T03:04:34.808 INFO:teuthology.orchestra.run.smithi050.stdout:Packager : builder@centos.org 2024-06-06T03:04:34.808 INFO:teuthology.orchestra.run.smithi050.stdout:Vendor : CentOS 2024-06-06T03:04:34.808 INFO:teuthology.orchestra.run.smithi050.stdout:URL : http://www.gnu.org/software/grub/ 2024-06-06T03:04:34.808 INFO:teuthology.orchestra.run.smithi050.stdout:Summary : Support tools for GRUB. 2024-06-06T03:04:34.808 INFO:teuthology.orchestra.run.smithi050.stdout:Description : 2024-06-06T03:04:34.808 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:04:34.808 INFO:teuthology.orchestra.run.smithi050.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-06-06T03:04:34.808 INFO:teuthology.orchestra.run.smithi050.stdout:customizable bootloader with modular architecture. It supports a rich 2024-06-06T03:04:34.808 INFO:teuthology.orchestra.run.smithi050.stdout:variety of kernel formats, file systems, computer architectures and 2024-06-06T03:04:34.808 INFO:teuthology.orchestra.run.smithi050.stdout:hardware devices. 2024-06-06T03:04:34.808 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:04:34.808 INFO:teuthology.orchestra.run.smithi050.stdout:This subpackage provides tools for support of all platforms. 2024-06-06T03:04:34.809 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-06-06T03:04:34.810 INFO:teuthology.task.kernel:Updating grub on smithi050 to boot 5.14.0-452.el9.x86_64 2024-06-06T03:04:34.810 DEBUG:teuthology.orchestra.run.smithi050:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-06-06T03:04:35.458 INFO:teuthology.orchestra.run.smithi050.stderr:Generating grub configuration file ... 2024-06-06T03:04:36.916 INFO:teuthology.orchestra.run.smithi050.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-06-06T03:04:36.943 INFO:teuthology.orchestra.run.smithi050.stderr:done 2024-06-06T03:04:36.946 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2024-06-06T03:04:36.964 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.2M0nLPBSPD 2024-06-06T03:04:36.964 DEBUG:teuthology.orchestra.run.smithi050:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.2M0nLPBSPD 2024-06-06T03:04:37.039 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.2M0nLPBSPD 2024-06-06T03:04:37.192 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.2M0nLPBSPD is 6KB 2024-06-06T03:04:37.240 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.2M0nLPBSPD 2024-06-06T03:04:37.255 DEBUG:teuthology.orchestra.run.smithi050:> sudo /bin/ls /boot/loader/entries || true 2024-06-06T03:04:37.318 INFO:teuthology.orchestra.run.smithi050.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-06-06T03:04:37.318 INFO:teuthology.orchestra.run.smithi050.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-06-06T03:04:37.318 INFO:teuthology.orchestra.run.smithi050.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-06-06T03:04:37.318 INFO:teuthology.orchestra.run.smithi050.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64.conf 2024-06-06T03:04:37.320 DEBUG:teuthology.orchestra.run.smithi050:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64 2024-06-06T03:04:37.476 DEBUG:teuthology.orchestra.run.smithi050:> sudo shutdown -r now 2024-06-06T03:05:04.269 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-06-06T03:05:04.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-06-06T03:05:04.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T03:05:04.470 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-06-06T03:05:04.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-06-06T03:05:04.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T03:05:07.479 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-06-06T03:05:07.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-06-06T03:05:07.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T03:05:22.719 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-06-06T03:05:22.974 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-06-06T03:05:26.050 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.50 2024-06-06T03:05:31.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-06-06T03:05:31.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T03:05:31.975 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-06-06T03:05:31.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T03:05:34.782 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-06-06T03:05:35.038 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-06-06T03:05:35.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-06-06T03:05:35.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T03:05:38.110 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.50 2024-06-06T03:05:46.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-06-06T03:05:46.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T03:05:47.039 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-06-06T03:05:47.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T03:05:50.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-06-06T03:05:50.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T03:06:18.958 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-06-06T03:06:19.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-06-06T03:06:19.376 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-452.el9.x86_64"... 2024-06-06T03:06:19.376 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2024-06-06T03:06:19.391 INFO:teuthology.orchestra.run.smithi079.stdout:5.14.0-452.el9.x86_64 2024-06-06T03:06:19.391 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-452.el9.x86_64 vs 5.14.0-452.el9.x86_64 2024-06-06T03:06:19.391 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-06-06T03:06:19.392 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-06-06T03:06:20.393 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-06-06T03:06:20.393 DEBUG:teuthology.orchestra.run.smithi079:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-06-06T03:06:20.474 INFO:teuthology.orchestra.run.smithi079.stdout:ttyS1 2024-06-06T03:06:20.514 DEBUG:teuthology.parallel:result is None 2024-06-06T03:06:21.908 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-06-06T03:06:22.290 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-06-06T03:06:22.290 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-452.el9.x86_64"... 2024-06-06T03:06:22.290 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2024-06-06T03:06:22.307 INFO:teuthology.orchestra.run.smithi050.stdout:5.14.0-452.el9.x86_64 2024-06-06T03:06:22.307 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-452.el9.x86_64 vs 5.14.0-452.el9.x86_64 2024-06-06T03:06:22.308 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-06-06T03:06:22.308 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-06-06T03:06:23.309 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-06-06T03:06:23.309 DEBUG:teuthology.orchestra.run.smithi050:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-06-06T03:06:23.392 INFO:teuthology.orchestra.run.smithi050.stdout:ttyS1 2024-06-06T03:06:23.426 DEBUG:teuthology.parallel:result is None 2024-06-06T03:06:46.796 DEBUG:teuthology.orchestra.remote:timed out 2024-06-06T03:07:01.797 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-06-06T03:07:01.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T03:07:02.195 DEBUG:teuthology.orchestra.run.smithi122:> true 2024-06-06T03:07:02.573 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-06-06T03:07:02.574 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-452.el9.x86_64"... 2024-06-06T03:07:02.574 DEBUG:teuthology.orchestra.run.smithi122:> uname -r 2024-06-06T03:07:02.591 INFO:teuthology.orchestra.run.smithi122.stdout:5.14.0-452.el9.x86_64 2024-06-06T03:07:02.591 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-452.el9.x86_64 vs 5.14.0-452.el9.x86_64 2024-06-06T03:07:02.591 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-06-06T03:07:02.591 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-06-06T03:07:03.592 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-06-06T03:07:03.592 DEBUG:teuthology.orchestra.run.smithi122:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-06-06T03:07:03.654 INFO:teuthology.orchestra.run.smithi122.stdout:ttyS1 2024-06-06T03:07:03.686 DEBUG:teuthology.parallel:result is None 2024-06-06T03:07:03.687 INFO:teuthology.run_tasks:Running task internal.base... 2024-06-06T03:07:03.698 INFO:teuthology.task.internal:Creating test directory... 2024-06-06T03:07:03.698 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-06T03:07:03.701 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-06T03:07:03.704 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-06T03:07:03.722 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-06-06T03:07:03.730 INFO:teuthology.run_tasks:Running task internal.archive... 2024-06-06T03:07:03.748 INFO:teuthology.task.internal:Creating archive directory... 2024-06-06T03:07:03.749 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-06T03:07:03.761 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-06T03:07:03.764 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-06T03:07:03.822 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-06-06T03:07:03.830 INFO:teuthology.task.internal:Enabling coredump saving... 2024-06-06T03:07:03.831 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-06T03:07:03.835 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-06T03:07:03.837 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-06T03:07:03.866 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-06T03:07:03.873 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-06T03:07:03.878 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-06T03:07:03.878 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-06T03:07:03.885 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-06T03:07:03.890 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-06T03:07:03.892 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-06-06T03:07:03.899 INFO:teuthology.task.internal:Configuring sudo... 2024-06-06T03:07:03.899 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-06T03:07:03.922 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-06T03:07:03.935 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-06T03:07:03.963 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-06-06T03:07:04.198 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-06-06T03:07:04.199 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-06T03:07:04.201 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-06T03:07:04.203 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-06T03:07:04.220 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-06T03:07:04.299 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-06T03:07:04.354 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-06T03:07:04.437 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-06T03:07:04.484 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-06-06T03:07:04.484 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-06T03:07:04.552 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-06T03:07:04.598 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-06T03:07:04.649 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-06T03:07:04.734 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-06T03:07:04.776 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-06T03:07:04.776 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-06T03:07:04.842 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-06T03:07:04.887 DEBUG:teuthology.orchestra.run.smithi122:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-06T03:07:04.952 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-06T03:07:04.995 DEBUG:teuthology.orchestra.run.smithi122:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-06T03:07:05.035 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-06-06T03:07:05.035 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-06T03:07:05.101 DEBUG:teuthology.orchestra.run.smithi050:> sudo service rsyslog restart 2024-06-06T03:07:05.104 DEBUG:teuthology.orchestra.run.smithi079:> sudo service rsyslog restart 2024-06-06T03:07:05.106 DEBUG:teuthology.orchestra.run.smithi122:> sudo service rsyslog restart 2024-06-06T03:07:05.147 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-06T03:07:05.149 INFO:teuthology.orchestra.run.smithi079.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-06T03:07:05.180 INFO:teuthology.orchestra.run.smithi122.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-06T03:07:05.722 INFO:teuthology.run_tasks:Running task internal.timer... 2024-06-06T03:07:05.732 INFO:teuthology.task.internal:Starting timer... 2024-06-06T03:07:05.733 INFO:teuthology.run_tasks:Running task pcp... 2024-06-06T03:07:05.763 INFO:teuthology.run_tasks:Running task selinux... 2024-06-06T03:07:05.778 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-06-06T03:07:05.778 DEBUG:teuthology.orchestra.run.smithi050:> sudo service auditd rotate 2024-06-06T03:07:05.839 INFO:teuthology.orchestra.run.smithi050.stdout:Rotating logs: 2024-06-06T03:07:05.841 DEBUG:teuthology.orchestra.run.smithi079:> sudo service auditd rotate 2024-06-06T03:07:05.892 INFO:teuthology.orchestra.run.smithi079.stdout:Rotating logs: 2024-06-06T03:07:05.894 DEBUG:teuthology.orchestra.run.smithi122:> sudo service auditd rotate 2024-06-06T03:07:05.938 INFO:teuthology.orchestra.run.smithi122.stdout:Rotating logs: 2024-06-06T03:07:05.940 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-06-06T03:07:05.940 DEBUG:teuthology.orchestra.run.smithi050:> /usr/sbin/getenforce 2024-06-06T03:07:05.972 INFO:teuthology.orchestra.run.smithi050.stdout:Permissive 2024-06-06T03:07:05.973 DEBUG:teuthology.orchestra.run.smithi079:> /usr/sbin/getenforce 2024-06-06T03:07:06.032 INFO:teuthology.orchestra.run.smithi079.stdout:Permissive 2024-06-06T03:07:06.033 DEBUG:teuthology.orchestra.run.smithi122:> /usr/sbin/getenforce 2024-06-06T03:07:06.064 INFO:teuthology.orchestra.run.smithi122.stdout:Permissive 2024-06-06T03:07:06.064 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi050.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi079.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi122.front.sepia.ceph.com': 'permissive'} 2024-06-06T03:07:06.065 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-06T03:07:06.095 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T03:07:06.096 DEBUG:teuthology.orchestra.run.smithi079:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-06T03:07:06.125 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T03:07:06.125 DEBUG:teuthology.orchestra.run.smithi122:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-06T03:07:06.153 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T03:07:06.154 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-06-06T03:07:06.154 DEBUG:teuthology.orchestra.run.smithi050:> sudo /usr/sbin/setenforce permissive 2024-06-06T03:07:06.191 DEBUG:teuthology.orchestra.run.smithi079:> sudo /usr/sbin/setenforce permissive 2024-06-06T03:07:06.219 DEBUG:teuthology.orchestra.run.smithi122:> sudo /usr/sbin/setenforce permissive 2024-06-06T03:07:06.258 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-06-06T03:07:06.550 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-06-06T03:07:06.553 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-06-06T03:07:06.687 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-06-06T03:07:06.697 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-06-06T03:07:06.698 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi050.front.sepia.ceph.com,smithi079.front.sepia.ceph.com,smithi122.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-06-06T03:11:29.972 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi050.front.sepia.ceph.com'), Remote(name='ubuntu@smithi079.front.sepia.ceph.com'), Remote(name='ubuntu@smithi122.front.sepia.ceph.com')] 2024-06-06T03:11:29.973 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-06-06T03:11:29.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T03:11:30.052 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-06-06T03:11:30.138 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-06-06T03:11:30.139 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-06-06T03:11:30.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T03:11:30.215 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-06-06T03:11:30.293 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-06-06T03:11:30.294 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-06-06T03:11:30.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T03:11:30.368 DEBUG:teuthology.orchestra.run.smithi122:> true 2024-06-06T03:11:30.458 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-06-06T03:11:30.458 INFO:teuthology.run_tasks:Running task clock... 2024-06-06T03:11:30.634 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-06-06T03:11:30.635 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-06T03:11:30.635 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-06T03:11:30.637 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-06T03:11:30.638 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-06T03:11:30.640 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-06T03:11:30.640 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-06T03:11:30.669 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-06T03:11:30.670 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-06T03:11:30.671 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-06T03:11:30.684 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-06T03:11:30.686 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-06T03:11:30.686 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-06T03:11:30.709 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: ntpd: command not found 2024-06-06T03:11:30.711 INFO:teuthology.orchestra.run.smithi122.stderr:sudo: ntpd: command not found 2024-06-06T03:11:30.714 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: ntpd: command not found 2024-06-06T03:11:30.720 INFO:teuthology.orchestra.run.smithi079.stdout:506 Cannot talk to daemon 2024-06-06T03:11:30.722 INFO:teuthology.orchestra.run.smithi122.stdout:506 Cannot talk to daemon 2024-06-06T03:11:30.726 INFO:teuthology.orchestra.run.smithi050.stdout:506 Cannot talk to daemon 2024-06-06T03:11:30.734 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-06T03:11:30.736 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-06T03:11:30.742 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-06T03:11:30.748 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-06T03:11:30.750 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-06T03:11:30.757 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-06T03:11:30.805 INFO:teuthology.orchestra.run.smithi079.stderr:bash: line 1: ntpq: command not found 2024-06-06T03:11:30.806 INFO:teuthology.orchestra.run.smithi122.stderr:bash: line 1: ntpq: command not found 2024-06-06T03:11:30.809 INFO:teuthology.orchestra.run.smithi079.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-06T03:11:30.809 INFO:teuthology.orchestra.run.smithi079.stdout:=============================================================================== 2024-06-06T03:11:30.809 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T03:11:30.809 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T03:11:30.809 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T03:11:30.809 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T03:11:30.810 INFO:teuthology.orchestra.run.smithi122.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-06T03:11:30.810 INFO:teuthology.orchestra.run.smithi122.stdout:=============================================================================== 2024-06-06T03:11:30.810 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T03:11:30.810 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T03:11:30.810 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T03:11:30.811 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T03:11:30.816 INFO:teuthology.orchestra.run.smithi050.stderr:bash: line 1: ntpq: command not found 2024-06-06T03:11:30.820 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-06T03:11:30.820 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2024-06-06T03:11:30.820 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T03:11:30.820 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T03:11:30.820 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T03:11:30.820 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T03:11:30.821 INFO:teuthology.run_tasks:Running task install... 2024-06-06T03:11:30.835 DEBUG:teuthology.task.install:project ceph 2024-06-06T03:11:30.835 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'}} 2024-06-06T03:11:30.836 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'} 2024-06-06T03:11:30.836 INFO:teuthology.task.install:Using flavor: default 2024-06-06T03:11:30.841 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-06-06T03:11:30.841 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-06-06T03:11:30.841 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'tag': None, 'wait_for_package': False} 2024-06-06T03:11:30.842 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-06T03:11:30.844 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'tag': None, 'wait_for_package': False} 2024-06-06T03:11:30.844 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-06T03:11:30.845 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'tag': None, 'wait_for_package': False} 2024-06-06T03:11:30.845 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-06T03:11:30.993 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/ 2024-06-06T03:11:30.994 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2946.g3d89accf 2024-06-06T03:11:31.063 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/ 2024-06-06T03:11:31.064 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2946.g3d89accf 2024-06-06T03:11:31.072 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/ 2024-06-06T03:11:31.072 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2946.g3d89accf 2024-06-06T03:11:31.168 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-06T03:11:31.168 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-06T03:11:31.168 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-06T03:11:31.194 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-06T03:11:31.195 DEBUG:teuthology.orchestra.run.smithi079:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d89accfe3201286f000e065a1faea2a88c7a6ba/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-06T03:11:31.232 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-06T03:11:31.232 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-06-06T03:11:31.232 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-06T03:11:31.243 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-06T03:11:31.243 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-06-06T03:11:31.243 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-06T03:11:31.260 DEBUG:teuthology.orchestra.run.smithi079:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-06T03:11:31.261 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-06T03:11:31.261 DEBUG:teuthology.orchestra.run.smithi050:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d89accfe3201286f000e065a1faea2a88c7a6ba/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-06T03:11:31.269 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-06T03:11:31.269 DEBUG:teuthology.orchestra.run.smithi122:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d89accfe3201286f000e065a1faea2a88c7a6ba/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-06T03:11:31.330 DEBUG:teuthology.orchestra.run.smithi050:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-06T03:11:31.334 DEBUG:teuthology.orchestra.run.smithi122:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-06T03:11:31.336 DEBUG:teuthology.orchestra.run.smithi079:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-06T03:11:31.399 INFO:teuthology.orchestra.run.smithi079.stdout:check_obsoletes = 1 2024-06-06T03:11:31.401 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum clean all 2024-06-06T03:11:31.409 DEBUG:teuthology.orchestra.run.smithi122:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-06T03:11:31.409 DEBUG:teuthology.orchestra.run.smithi050:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-06T03:11:31.473 INFO:teuthology.orchestra.run.smithi122.stdout:check_obsoletes = 1 2024-06-06T03:11:31.475 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum clean all 2024-06-06T03:11:31.475 INFO:teuthology.orchestra.run.smithi050.stdout:check_obsoletes = 1 2024-06-06T03:11:31.476 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum clean all 2024-06-06T03:11:31.637 INFO:teuthology.orchestra.run.smithi079.stdout:45 files removed 2024-06-06T03:11:31.666 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-06T03:11:31.702 INFO:teuthology.orchestra.run.smithi122.stdout:45 files removed 2024-06-06T03:11:31.715 INFO:teuthology.orchestra.run.smithi050.stdout:45 files removed 2024-06-06T03:11:31.728 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-06T03:11:31.742 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-06T03:11:32.258 INFO:teuthology.orchestra.run.smithi079.stdout:ceph packages for x86_64 262 kB/s | 83 kB 00:00 2024-06-06T03:11:32.340 INFO:teuthology.orchestra.run.smithi050.stdout:ceph packages for x86_64 272 kB/s | 83 kB 00:00 2024-06-06T03:11:32.463 INFO:teuthology.orchestra.run.smithi122.stdout:ceph packages for x86_64 180 kB/s | 83 kB 00:00 2024-06-06T03:11:32.609 INFO:teuthology.orchestra.run.smithi079.stdout:ceph noarch packages 39 kB/s | 11 kB 00:00 2024-06-06T03:11:32.724 INFO:teuthology.orchestra.run.smithi050.stdout:ceph noarch packages 35 kB/s | 11 kB 00:00 2024-06-06T03:11:32.839 INFO:teuthology.orchestra.run.smithi122.stdout:ceph noarch packages 36 kB/s | 11 kB 00:00 2024-06-06T03:11:33.026 INFO:teuthology.orchestra.run.smithi079.stdout:ceph source packages 5.1 kB/s | 1.9 kB 00:00 2024-06-06T03:11:33.150 INFO:teuthology.orchestra.run.smithi050.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-06-06T03:11:33.173 INFO:teuthology.orchestra.run.smithi122.stdout:ceph source packages 6.5 kB/s | 1.9 kB 00:00 2024-06-06T03:11:33.736 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.1 MB 00:00 2024-06-06T03:11:33.742 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.1 MB 00:00 2024-06-06T03:11:33.902 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.1 MB 00:00 2024-06-06T03:11:35.810 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - AppStream 20 MB/s | 19 MB 00:00 2024-06-06T03:11:35.970 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-06-06T03:11:39.995 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-06-06T03:11:40.262 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-06-06T03:11:41.419 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 17 kB 00:00 2024-06-06T03:11:41.804 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - Extras packages 49 kB/s | 17 kB 00:00 2024-06-06T03:11:42.907 INFO:teuthology.orchestra.run.smithi122.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-06-06T03:11:43.032 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 20 MB/s | 21 MB 00:01 2024-06-06T03:11:43.328 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - AppStream 2.2 MB/s | 19 MB 00:08 2024-06-06T03:11:47.536 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - CRB 9.7 MB/s | 6.2 MB 00:00 2024-06-06T03:11:47.979 INFO:teuthology.orchestra.run.smithi122.stdout:lab-extras 22 kB/s | 1.7 kB 00:00 2024-06-06T03:11:48.355 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-06-06T03:11:49.095 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 17 kB 00:00 2024-06-06T03:11:50.364 INFO:teuthology.orchestra.run.smithi122.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-06T03:11:50.365 INFO:teuthology.orchestra.run.smithi122.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-06T03:11:50.376 INFO:teuthology.orchestra.run.smithi122.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-06-06T03:11:50.377 INFO:teuthology.orchestra.run.smithi122.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-06-06T03:11:50.377 INFO:teuthology.orchestra.run.smithi122.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-06-06T03:11:50.378 INFO:teuthology.orchestra.run.smithi122.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-06T03:11:50.380 INFO:teuthology.orchestra.run.smithi122.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-06-06T03:11:50.382 INFO:teuthology.orchestra.run.smithi122.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-06-06T03:11:50.383 INFO:teuthology.orchestra.run.smithi122.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-06-06T03:11:50.444 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-06-06T03:11:50.470 INFO:teuthology.orchestra.run.smithi122.stdout:======================================================================================= 2024-06-06T03:11:50.470 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-06-06T03:11:50.471 INFO:teuthology.orchestra.run.smithi122.stdout:======================================================================================= 2024-06-06T03:11:50.471 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-06-06T03:11:50.471 INFO:teuthology.orchestra.run.smithi122.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-06T03:11:50.471 INFO:teuthology.orchestra.run.smithi122.stdout: ceph x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 6.6 k 2024-06-06T03:11:50.471 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-base x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.4 M 2024-06-06T03:11:50.471 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 890 k 2024-06-06T03:11:50.471 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 145 k 2024-06-06T03:11:50.471 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 1.5 M 2024-06-06T03:11:50.471 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 142 k 2024-06-06T03:11:50.471 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 3.5 M 2024-06-06T03:11:50.471 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 7.4 M 2024-06-06T03:11:50.472 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-rook noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 49 k 2024-06-06T03:11:50.472 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-radosgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 10 M 2024-06-06T03:11:50.472 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-test x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 48 M 2024-06-06T03:11:50.472 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-volume noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 264 k 2024-06-06T03:11:50.472 INFO:teuthology.orchestra.run.smithi122.stdout: cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 763 k 2024-06-06T03:11:50.472 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 221 k 2024-06-06T03:11:50.472 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-shell x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 27 k 2024-06-06T03:11:50.472 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-top noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 18 k 2024-06-06T03:11:50.472 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-06T03:11:50.472 INFO:teuthology.orchestra.run.smithi122.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-06T03:11:50.472 INFO:teuthology.orchestra.run.smithi122.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-06T03:11:50.472 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 32 k 2024-06-06T03:11:50.472 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 747 k 2024-06-06T03:11:50.473 INFO:teuthology.orchestra.run.smithi122.stdout: librados-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 127 k 2024-06-06T03:11:50.473 INFO:teuthology.orchestra.run.smithi122.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-06T03:11:50.473 INFO:teuthology.orchestra.run.smithi122.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-06T03:11:50.473 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-06-06T03:11:50.473 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-06-06T03:11:50.473 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-06-06T03:11:50.473 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-06-06T03:11:50.473 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cephfs x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 162 k 2024-06-06T03:11:50.473 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rados x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 321 k 2024-06-06T03:11:50.473 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 300 k 2024-06-06T03:11:50.473 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 99 k 2024-06-06T03:11:50.473 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 85 k 2024-06-06T03:11:50.473 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-06T03:11:50.474 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-nbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 171 k 2024-06-06T03:11:50.474 INFO:teuthology.orchestra.run.smithi122.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-06-06T03:11:50.474 INFO:teuthology.orchestra.run.smithi122.stdout:Upgrading: 2024-06-06T03:11:50.474 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-06-06T03:11:50.474 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-06-06T03:11:50.474 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-06-06T03:11:50.474 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-06-06T03:11:50.474 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-06T03:11:50.474 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-06T03:11:50.474 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-06T03:11:50.475 INFO:teuthology.orchestra.run.smithi122.stdout: librados2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.4 M 2024-06-06T03:11:50.475 INFO:teuthology.orchestra.run.smithi122.stdout: librbd1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-06T03:11:50.475 INFO:teuthology.orchestra.run.smithi122.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-06-06T03:11:50.475 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-06-06T03:11:50.475 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-06-06T03:11:50.475 INFO:teuthology.orchestra.run.smithi122.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-06T03:11:50.475 INFO:teuthology.orchestra.run.smithi122.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-06T03:11:50.475 INFO:teuthology.orchestra.run.smithi122.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-06T03:11:50.475 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 21 M 2024-06-06T03:11:50.475 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 32 k 2024-06-06T03:11:50.475 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mds x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 2.4 M 2024-06-06T03:11:50.475 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 249 k 2024-06-06T03:11:50.475 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mon x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 4.7 M 2024-06-06T03:11:50.476 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-osd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 17 M 2024-06-06T03:11:50.476 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 16 k 2024-06-06T03:11:50.476 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-selinux x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 25 k 2024-06-06T03:11:50.476 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-06T03:11:50.476 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-06T03:11:50.476 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-06T03:11:50.476 INFO:teuthology.orchestra.run.smithi122.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-06T03:11:50.476 INFO:teuthology.orchestra.run.smithi122.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-06T03:11:50.476 INFO:teuthology.orchestra.run.smithi122.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-06T03:11:50.476 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-06T03:11:50.476 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-06T03:11:50.476 INFO:teuthology.orchestra.run.smithi122.stdout: libcephsqlite x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 163 k 2024-06-06T03:11:50.476 INFO:teuthology.orchestra.run.smithi122.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-06T03:11:50.476 INFO:teuthology.orchestra.run.smithi122.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-06T03:11:50.477 INFO:teuthology.orchestra.run.smithi122.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-06T03:11:50.477 INFO:teuthology.orchestra.run.smithi122.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-06T03:11:50.477 INFO:teuthology.orchestra.run.smithi122.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-06T03:11:50.477 INFO:teuthology.orchestra.run.smithi122.stdout: libradosstriper1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 501 k 2024-06-06T03:11:50.477 INFO:teuthology.orchestra.run.smithi122.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-06T03:11:50.477 INFO:teuthology.orchestra.run.smithi122.stdout: librgw2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.3 M 2024-06-06T03:11:50.477 INFO:teuthology.orchestra.run.smithi122.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-06T03:11:50.477 INFO:teuthology.orchestra.run.smithi122.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-06T03:11:50.477 INFO:teuthology.orchestra.run.smithi122.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-06T03:11:50.477 INFO:teuthology.orchestra.run.smithi122.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-06T03:11:50.477 INFO:teuthology.orchestra.run.smithi122.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-06T03:11:50.477 INFO:teuthology.orchestra.run.smithi122.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-06T03:11:50.477 INFO:teuthology.orchestra.run.smithi122.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-06T03:11:50.478 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-06T03:11:50.478 INFO:teuthology.orchestra.run.smithi122.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-06T03:11:50.478 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-06-06T03:11:50.478 INFO:teuthology.orchestra.run.smithi122.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-06T03:11:50.478 INFO:teuthology.orchestra.run.smithi122.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-06T03:11:50.478 INFO:teuthology.orchestra.run.smithi122.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-06T03:11:50.478 INFO:teuthology.orchestra.run.smithi122.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-06-06T03:11:50.478 INFO:teuthology.orchestra.run.smithi122.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-06T03:11:50.478 INFO:teuthology.orchestra.run.smithi122.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-06T03:11:50.478 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-06T03:11:50.478 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-argparse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 45 k 2024-06-06T03:11:50.478 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 135 k 2024-06-06T03:11:50.478 INFO:teuthology.orchestra.run.smithi122.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-06T03:11:50.479 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-06T03:11:50.479 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-06T03:11:50.479 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-06T03:11:50.479 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-06-06T03:11:50.479 INFO:teuthology.orchestra.run.smithi122.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-06-06T03:11:50.479 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-06T03:11:50.479 INFO:teuthology.orchestra.run.smithi122.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-06T03:11:50.479 INFO:teuthology.orchestra.run.smithi122.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-06-06T03:11:50.479 INFO:teuthology.orchestra.run.smithi122.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-06T03:11:50.479 INFO:teuthology.orchestra.run.smithi122.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-06T03:11:50.479 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-06T03:11:50.479 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-06T03:11:50.479 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-06T03:11:50.479 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-06T03:11:50.480 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-06T03:11:50.480 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-06T03:11:50.480 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-06T03:11:50.480 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-06T03:11:50.480 INFO:teuthology.orchestra.run.smithi122.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-06T03:11:50.480 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-06T03:11:50.480 INFO:teuthology.orchestra.run.smithi122.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-06T03:11:50.480 INFO:teuthology.orchestra.run.smithi122.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-06T03:11:50.480 INFO:teuthology.orchestra.run.smithi122.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-06T03:11:50.480 INFO:teuthology.orchestra.run.smithi122.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-06T03:11:50.480 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-06T03:11:50.480 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-06T03:11:50.481 INFO:teuthology.orchestra.run.smithi122.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-06T03:11:50.481 INFO:teuthology.orchestra.run.smithi122.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-06T03:11:50.481 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-06T03:11:50.481 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-06T03:11:50.481 INFO:teuthology.orchestra.run.smithi122.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-06T03:11:50.481 INFO:teuthology.orchestra.run.smithi122.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-06T03:11:50.481 INFO:teuthology.orchestra.run.smithi122.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-06T03:11:50.481 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-06T03:11:50.481 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-06T03:11:50.481 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-06T03:11:50.481 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-06T03:11:50.481 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-06-06T03:11:50.481 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-06T03:11:50.481 INFO:teuthology.orchestra.run.smithi122.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-06T03:11:50.482 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-06T03:11:50.482 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-06T03:11:50.482 INFO:teuthology.orchestra.run.smithi122.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-06T03:11:50.482 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-06T03:11:50.482 INFO:teuthology.orchestra.run.smithi122.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-06T03:11:50.482 INFO:teuthology.orchestra.run.smithi122.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-06T03:11:50.482 INFO:teuthology.orchestra.run.smithi122.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-06T03:11:50.482 INFO:teuthology.orchestra.run.smithi122.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-06T03:11:50.482 INFO:teuthology.orchestra.run.smithi122.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-06T03:11:50.482 INFO:teuthology.orchestra.run.smithi122.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-06-06T03:11:50.483 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-06T03:11:50.483 INFO:teuthology.orchestra.run.smithi122.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-06T03:11:50.483 INFO:teuthology.orchestra.run.smithi122.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-06T03:11:50.483 INFO:teuthology.orchestra.run.smithi122.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-06T03:11:50.483 INFO:teuthology.orchestra.run.smithi122.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-06T03:11:50.483 INFO:teuthology.orchestra.run.smithi122.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-06T03:11:50.483 INFO:teuthology.orchestra.run.smithi122.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-06T03:11:50.483 INFO:teuthology.orchestra.run.smithi122.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-06-06T03:11:50.483 INFO:teuthology.orchestra.run.smithi122.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-06T03:11:50.483 INFO:teuthology.orchestra.run.smithi122.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-06-06T03:11:50.483 INFO:teuthology.orchestra.run.smithi122.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-06T03:11:50.483 INFO:teuthology.orchestra.run.smithi122.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-06T03:11:50.483 INFO:teuthology.orchestra.run.smithi122.stdout:Installing weak dependencies: 2024-06-06T03:11:50.484 INFO:teuthology.orchestra.run.smithi122.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-06T03:11:50.484 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-06-06T03:11:50.484 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-06-06T03:11:50.484 INFO:teuthology.orchestra.run.smithi122.stdout:======================================================================================= 2024-06-06T03:11:50.484 INFO:teuthology.orchestra.run.smithi122.stdout:Install 148 Packages 2024-06-06T03:11:50.484 INFO:teuthology.orchestra.run.smithi122.stdout:Upgrade 11 Packages 2024-06-06T03:11:50.484 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-06-06T03:11:50.485 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 225 M 2024-06-06T03:11:50.485 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-06-06T03:11:50.722 INFO:teuthology.orchestra.run.smithi079.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-06-06T03:11:50.782 INFO:teuthology.orchestra.run.smithi050.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-06T03:11:50.782 INFO:teuthology.orchestra.run.smithi050.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-06T03:11:50.794 INFO:teuthology.orchestra.run.smithi050.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-06-06T03:11:50.794 INFO:teuthology.orchestra.run.smithi050.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-06-06T03:11:50.795 INFO:teuthology.orchestra.run.smithi050.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-06-06T03:11:50.796 INFO:teuthology.orchestra.run.smithi050.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-06T03:11:50.798 INFO:teuthology.orchestra.run.smithi050.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-06-06T03:11:50.800 INFO:teuthology.orchestra.run.smithi050.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-06-06T03:11:50.801 INFO:teuthology.orchestra.run.smithi050.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-06-06T03:11:50.869 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-06-06T03:11:50.892 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================= 2024-06-06T03:11:50.892 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2024-06-06T03:11:50.892 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================= 2024-06-06T03:11:50.892 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2024-06-06T03:11:50.892 INFO:teuthology.orchestra.run.smithi050.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-06T03:11:50.892 INFO:teuthology.orchestra.run.smithi050.stdout: ceph x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 6.6 k 2024-06-06T03:11:50.892 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.4 M 2024-06-06T03:11:50.892 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 890 k 2024-06-06T03:11:50.892 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 145 k 2024-06-06T03:11:50.892 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 1.5 M 2024-06-06T03:11:50.893 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 142 k 2024-06-06T03:11:50.893 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 3.5 M 2024-06-06T03:11:50.893 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 7.4 M 2024-06-06T03:11:50.893 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 49 k 2024-06-06T03:11:50.893 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 10 M 2024-06-06T03:11:50.893 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 48 M 2024-06-06T03:11:50.893 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 264 k 2024-06-06T03:11:50.893 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 763 k 2024-06-06T03:11:50.893 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 221 k 2024-06-06T03:11:50.893 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-shell x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 27 k 2024-06-06T03:11:50.893 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-top noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 18 k 2024-06-06T03:11:50.893 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-06T03:11:50.893 INFO:teuthology.orchestra.run.smithi050.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-06T03:11:50.894 INFO:teuthology.orchestra.run.smithi050.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-06T03:11:50.894 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 32 k 2024-06-06T03:11:50.894 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 747 k 2024-06-06T03:11:50.894 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 127 k 2024-06-06T03:11:50.894 INFO:teuthology.orchestra.run.smithi050.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-06T03:11:50.894 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-06T03:11:50.894 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-06-06T03:11:50.894 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-06-06T03:11:50.894 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-06-06T03:11:50.894 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-06-06T03:11:50.894 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 162 k 2024-06-06T03:11:50.894 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 321 k 2024-06-06T03:11:50.894 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 300 k 2024-06-06T03:11:50.895 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 99 k 2024-06-06T03:11:50.895 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 85 k 2024-06-06T03:11:50.895 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-06T03:11:50.895 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 171 k 2024-06-06T03:11:50.895 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-06-06T03:11:50.895 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrading: 2024-06-06T03:11:50.895 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-06-06T03:11:50.895 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-06-06T03:11:50.895 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-06-06T03:11:50.895 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-06-06T03:11:50.895 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-06T03:11:50.895 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-06T03:11:50.895 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-06T03:11:50.895 INFO:teuthology.orchestra.run.smithi050.stdout: librados2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.4 M 2024-06-06T03:11:50.896 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-06T03:11:50.896 INFO:teuthology.orchestra.run.smithi050.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-06-06T03:11:50.896 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-06-06T03:11:50.896 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2024-06-06T03:11:50.896 INFO:teuthology.orchestra.run.smithi050.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-06T03:11:50.896 INFO:teuthology.orchestra.run.smithi050.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-06T03:11:50.896 INFO:teuthology.orchestra.run.smithi050.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-06T03:11:50.896 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 21 M 2024-06-06T03:11:50.896 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 32 k 2024-06-06T03:11:50.896 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 2.4 M 2024-06-06T03:11:50.896 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 249 k 2024-06-06T03:11:50.896 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 4.7 M 2024-06-06T03:11:50.896 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 17 M 2024-06-06T03:11:50.896 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 16 k 2024-06-06T03:11:50.897 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 25 k 2024-06-06T03:11:50.897 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-06T03:11:50.897 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-06T03:11:50.897 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-06T03:11:50.897 INFO:teuthology.orchestra.run.smithi050.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-06T03:11:50.897 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-06T03:11:50.897 INFO:teuthology.orchestra.run.smithi050.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-06T03:11:50.897 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-06T03:11:50.897 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-06T03:11:50.897 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 163 k 2024-06-06T03:11:50.897 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-06T03:11:50.897 INFO:teuthology.orchestra.run.smithi050.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-06T03:11:50.897 INFO:teuthology.orchestra.run.smithi050.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-06T03:11:50.897 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-06T03:11:50.898 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-06T03:11:50.898 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 501 k 2024-06-06T03:11:50.898 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-06T03:11:50.898 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.3 M 2024-06-06T03:11:50.898 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-06T03:11:50.898 INFO:teuthology.orchestra.run.smithi050.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-06T03:11:50.898 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-06T03:11:50.898 INFO:teuthology.orchestra.run.smithi050.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-06T03:11:50.898 INFO:teuthology.orchestra.run.smithi050.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-06T03:11:50.898 INFO:teuthology.orchestra.run.smithi050.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-06T03:11:50.898 INFO:teuthology.orchestra.run.smithi050.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-06T03:11:50.898 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-06T03:11:50.898 INFO:teuthology.orchestra.run.smithi050.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-06T03:11:50.899 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-06-06T03:11:50.901 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-06T03:11:50.902 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-06T03:11:50.902 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-06T03:11:50.902 INFO:teuthology.orchestra.run.smithi050.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-06-06T03:11:50.902 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-06T03:11:50.902 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-06T03:11:50.902 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-06T03:11:50.902 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 45 k 2024-06-06T03:11:50.902 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 135 k 2024-06-06T03:11:50.902 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-06T03:11:50.902 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-06T03:11:50.903 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-06T03:11:50.903 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-06T03:11:50.903 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-06-06T03:11:50.903 INFO:teuthology.orchestra.run.smithi050.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-06-06T03:11:50.903 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-06T03:11:50.903 INFO:teuthology.orchestra.run.smithi050.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-06T03:11:50.903 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-06-06T03:11:50.903 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-06T03:11:50.903 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-06T03:11:50.903 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-06T03:11:50.903 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-06T03:11:50.903 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-06T03:11:50.903 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-06T03:11:50.904 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-06T03:11:50.904 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-06T03:11:50.904 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-06T03:11:50.904 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-06T03:11:50.904 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-06T03:11:50.904 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-06T03:11:50.904 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-06T03:11:50.904 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-06T03:11:50.904 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-06T03:11:50.904 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-06T03:11:50.904 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-06T03:11:50.904 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-06T03:11:50.904 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-06T03:11:50.905 INFO:teuthology.orchestra.run.smithi050.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-06T03:11:50.905 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-06T03:11:50.905 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-06T03:11:50.905 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-06T03:11:50.905 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-06T03:11:50.905 INFO:teuthology.orchestra.run.smithi050.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-06T03:11:50.905 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-06T03:11:50.905 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-06T03:11:50.905 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-06T03:11:50.905 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-06T03:11:50.905 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-06-06T03:11:50.905 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-06T03:11:50.906 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-06T03:11:50.906 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-06T03:11:50.906 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-06T03:11:50.906 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-06T03:11:50.906 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-06T03:11:50.906 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-06T03:11:50.906 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-06T03:11:50.906 INFO:teuthology.orchestra.run.smithi050.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-06T03:11:50.906 INFO:teuthology.orchestra.run.smithi050.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-06T03:11:50.906 INFO:teuthology.orchestra.run.smithi050.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-06T03:11:50.906 INFO:teuthology.orchestra.run.smithi050.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-06-06T03:11:50.906 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-06T03:11:50.906 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-06T03:11:50.907 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-06T03:11:50.907 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-06T03:11:50.907 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-06T03:11:50.907 INFO:teuthology.orchestra.run.smithi050.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-06T03:11:50.907 INFO:teuthology.orchestra.run.smithi050.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-06T03:11:50.907 INFO:teuthology.orchestra.run.smithi050.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-06-06T03:11:50.907 INFO:teuthology.orchestra.run.smithi050.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-06T03:11:50.907 INFO:teuthology.orchestra.run.smithi050.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-06-06T03:11:50.907 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-06T03:11:50.907 INFO:teuthology.orchestra.run.smithi050.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-06T03:11:50.907 INFO:teuthology.orchestra.run.smithi050.stdout:Installing weak dependencies: 2024-06-06T03:11:50.907 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-06T03:11:50.907 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:11:50.907 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-06-06T03:11:50.908 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================= 2024-06-06T03:11:50.908 INFO:teuthology.orchestra.run.smithi050.stdout:Install 148 Packages 2024-06-06T03:11:50.908 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrade 11 Packages 2024-06-06T03:11:50.908 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:11:50.908 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 225 M 2024-06-06T03:11:50.908 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2024-06-06T03:11:51.339 INFO:teuthology.orchestra.run.smithi122.stdout:(1/159): ceph-19.0.0-2946.g3d89accf.el9.x86_64. 27 kB/s | 6.6 kB 00:00 2024-06-06T03:11:51.764 INFO:teuthology.orchestra.run.smithi122.stdout:(2/159): ceph-base-19.0.0-2946.g3d89accf.el9.x8 8.0 MB/s | 5.4 MB 00:00 2024-06-06T03:11:51.823 INFO:teuthology.orchestra.run.smithi122.stdout:(3/159): ceph-immutable-object-cache-19.0.0-294 2.4 MB/s | 145 kB 00:00 2024-06-06T03:11:51.839 INFO:teuthology.orchestra.run.smithi050.stdout:(1/159): ceph-19.0.0-2946.g3d89accf.el9.x86_64. 28 kB/s | 6.6 kB 00:00 2024-06-06T03:11:52.082 INFO:teuthology.orchestra.run.smithi122.stdout:(4/159): ceph-mds-19.0.0-2946.g3d89accf.el9.x86 9.1 MB/s | 2.4 MB 00:00 2024-06-06T03:11:52.224 INFO:teuthology.orchestra.run.smithi122.stdout:(5/159): ceph-fuse-19.0.0-2946.g3d89accf.el9.x8 1.0 MB/s | 890 kB 00:00 2024-06-06T03:11:52.274 INFO:teuthology.orchestra.run.smithi122.stdout:(6/159): ceph-mgr-19.0.0-2946.g3d89accf.el9.x86 7.8 MB/s | 1.5 MB 00:00 2024-06-06T03:11:52.690 INFO:teuthology.orchestra.run.smithi050.stdout:(2/159): ceph-fuse-19.0.0-2946.g3d89accf.el9.x8 1.0 MB/s | 890 kB 00:00 2024-06-06T03:11:52.773 INFO:teuthology.orchestra.run.smithi050.stdout:(3/159): ceph-immutable-object-cache-19.0.0-294 1.7 MB/s | 145 kB 00:00 2024-06-06T03:11:52.883 INFO:teuthology.orchestra.run.smithi122.stdout:(7/159): ceph-common-19.0.0-2946.g3d89accf.el9. 12 MB/s | 21 MB 00:01 2024-06-06T03:11:53.999 INFO:teuthology.orchestra.run.smithi050.stdout:(4/159): ceph-mds-19.0.0-2946.g3d89accf.el9.x86 1.9 MB/s | 2.4 MB 00:01 2024-06-06T03:11:53.999 INFO:teuthology.orchestra.run.smithi122.stdout:(8/159): ceph-radosgw-19.0.0-2946.g3d89accf.el9 9.2 MB/s | 10 MB 00:01 2024-06-06T03:11:54.058 INFO:teuthology.orchestra.run.smithi122.stdout:(9/159): ceph-selinux-19.0.0-2946.g3d89accf.el9 432 kB/s | 25 kB 00:00 2024-06-06T03:11:54.091 INFO:teuthology.orchestra.run.smithi050.stdout:(5/159): ceph-base-19.0.0-2946.g3d89accf.el9.x8 2.2 MB/s | 5.4 MB 00:02 2024-06-06T03:11:54.192 INFO:teuthology.orchestra.run.smithi122.stdout:(10/159): ceph-mon-19.0.0-2946.g3d89accf.el9.x8 2.4 MB/s | 4.7 MB 00:01 2024-06-06T03:11:54.359 INFO:teuthology.orchestra.run.smithi122.stdout:(11/159): ceph-osd-19.0.0-2946.g3d89accf.el9.x8 8.0 MB/s | 17 MB 00:02 2024-06-06T03:11:54.376 INFO:teuthology.orchestra.run.smithi122.stdout:(12/159): cephfs-mirror-19.0.0-2946.g3d89accf.e 1.2 MB/s | 221 kB 00:00 2024-06-06T03:11:54.426 INFO:teuthology.orchestra.run.smithi122.stdout:(13/159): cephfs-shell-19.0.0-2946.g3d89accf.el 405 kB/s | 27 kB 00:00 2024-06-06T03:11:54.460 INFO:teuthology.orchestra.run.smithi122.stdout:(14/159): libcephfs-devel-19.0.0-2946.g3d89accf 378 kB/s | 32 kB 00:00 2024-06-06T03:11:54.577 INFO:teuthology.orchestra.run.smithi122.stdout:(15/159): libcephsqlite-19.0.0-2946.g3d89accf.e 1.4 MB/s | 163 kB 00:00 2024-06-06T03:11:54.611 INFO:teuthology.orchestra.run.smithi122.stdout:(16/159): libcephfs2-19.0.0-2946.g3d89accf.el9. 4.0 MB/s | 747 kB 00:00 2024-06-06T03:11:54.669 INFO:teuthology.orchestra.run.smithi122.stdout:(17/159): librados-devel-19.0.0-2946.g3d89accf. 1.3 MB/s | 127 kB 00:00 2024-06-06T03:11:54.674 INFO:teuthology.orchestra.run.smithi050.stdout:(6/159): ceph-mgr-19.0.0-2946.g3d89accf.el9.x86 2.2 MB/s | 1.5 MB 00:00 2024-06-06T03:11:54.770 INFO:teuthology.orchestra.run.smithi122.stdout:(18/159): libradosstriper1-19.0.0-2946.g3d89acc 3.1 MB/s | 501 kB 00:00 2024-06-06T03:11:54.775 INFO:teuthology.orchestra.run.smithi050.stdout:(7/159): ceph-mon-19.0.0-2946.g3d89accf.el9.x86 6.9 MB/s | 4.7 MB 00:00 2024-06-06T03:11:54.828 INFO:teuthology.orchestra.run.smithi122.stdout:(19/159): python3-ceph-argparse-19.0.0-2946.g3d 774 kB/s | 45 kB 00:00 2024-06-06T03:11:54.937 INFO:teuthology.orchestra.run.smithi122.stdout:(20/159): python3-ceph-common-19.0.0-2946.g3d89 1.2 MB/s | 135 kB 00:00 2024-06-06T03:11:55.037 INFO:teuthology.orchestra.run.smithi122.stdout:(21/159): python3-cephfs-19.0.0-2946.g3d89accf. 1.6 MB/s | 162 kB 00:00 2024-06-06T03:11:55.654 INFO:teuthology.orchestra.run.smithi122.stdout:(22/159): python3-rados-19.0.0-2946.g3d89accf.e 521 kB/s | 321 kB 00:00 2024-06-06T03:11:55.804 INFO:teuthology.orchestra.run.smithi122.stdout:(23/159): librgw2-19.0.0-2946.g3d89accf.el9.x86 4.7 MB/s | 5.3 MB 00:01 2024-06-06T03:11:55.895 INFO:teuthology.orchestra.run.smithi079.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-06-06T03:11:55.896 INFO:teuthology.orchestra.run.smithi122.stdout:(24/159): python3-rgw-19.0.0-2946.g3d89accf.el9 1.1 MB/s | 99 kB 00:00 2024-06-06T03:11:55.988 INFO:teuthology.orchestra.run.smithi122.stdout:(25/159): rbd-fuse-19.0.0-2946.g3d89accf.el9.x8 930 kB/s | 85 kB 00:00 2024-06-06T03:11:56.039 INFO:teuthology.orchestra.run.smithi122.stdout:(26/159): python3-rbd-19.0.0-2946.g3d89accf.el9 780 kB/s | 300 kB 00:00 2024-06-06T03:11:56.116 INFO:teuthology.orchestra.run.smithi050.stdout:(8/159): ceph-radosgw-19.0.0-2946.g3d89accf.el9 7.6 MB/s | 10 MB 00:01 2024-06-06T03:11:56.192 INFO:teuthology.orchestra.run.smithi050.stdout:(9/159): ceph-selinux-19.0.0-2946.g3d89accf.el9 336 kB/s | 25 kB 00:00 2024-06-06T03:11:56.197 INFO:teuthology.orchestra.run.smithi122.stdout:(27/159): rbd-nbd-19.0.0-2946.g3d89accf.el9.x86 1.1 MB/s | 171 kB 00:00 2024-06-06T03:11:56.298 INFO:teuthology.orchestra.run.smithi122.stdout:(28/159): ceph-grafana-dashboards-19.0.0-2946.g 317 kB/s | 32 kB 00:00 2024-06-06T03:11:56.440 INFO:teuthology.orchestra.run.smithi122.stdout:(29/159): rbd-mirror-19.0.0-2946.g3d89accf.el9. 6.9 MB/s | 3.1 MB 00:00 2024-06-06T03:11:56.465 INFO:teuthology.orchestra.run.smithi122.stdout:(30/159): ceph-mgr-cephadm-19.0.0-2946.g3d89acc 852 kB/s | 142 kB 00:00 2024-06-06T03:11:56.966 INFO:teuthology.orchestra.run.smithi122.stdout:(31/159): ceph-mgr-dashboard-19.0.0-2946.g3d89a 6.7 MB/s | 3.5 MB 00:00 2024-06-06T03:11:57.066 INFO:teuthology.orchestra.run.smithi122.stdout:(32/159): ceph-mgr-modules-core-19.0.0-2946.g3d 2.4 MB/s | 249 kB 00:00 2024-06-06T03:11:57.158 INFO:teuthology.orchestra.run.smithi122.stdout:(33/159): ceph-mgr-rook-19.0.0-2946.g3d89accf.e 538 kB/s | 49 kB 00:00 2024-06-06T03:11:57.242 INFO:teuthology.orchestra.run.smithi122.stdout:(34/159): ceph-prometheus-alerts-19.0.0-2946.g3 198 kB/s | 16 kB 00:00 2024-06-06T03:11:57.317 INFO:teuthology.orchestra.run.smithi122.stdout:(35/159): ceph-volume-19.0.0-2946.g3d89accf.el9 3.4 MB/s | 264 kB 00:00 2024-06-06T03:11:57.384 INFO:teuthology.orchestra.run.smithi050.stdout:(10/159): ceph-common-19.0.0-2946.g3d89accf.el9 3.6 MB/s | 21 MB 00:05 2024-06-06T03:11:57.459 INFO:teuthology.orchestra.run.smithi122.stdout:(36/159): cephadm-19.0.0-2946.g3d89accf.el9.noa 5.3 MB/s | 763 kB 00:00 2024-06-06T03:11:57.492 INFO:teuthology.orchestra.run.smithi050.stdout:(11/159): cephfs-mirror-19.0.0-2946.g3d89accf.e 2.0 MB/s | 221 kB 00:00 2024-06-06T03:11:57.591 INFO:teuthology.orchestra.run.smithi050.stdout:(12/159): cephfs-shell-19.0.0-2946.g3d89accf.el 408 kB/s | 27 kB 00:00 2024-06-06T03:11:57.591 INFO:teuthology.orchestra.run.smithi122.stdout:(37/159): cephfs-top-19.0.0-2946.g3d89accf.el9. 219 kB/s | 18 kB 00:00 2024-06-06T03:11:57.591 INFO:teuthology.orchestra.run.smithi122.stdout:[MIRROR] fuse-2.9.9-15.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/fuse-2.9.9-15.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T03:11:57.618 INFO:teuthology.orchestra.run.smithi050.stdout:(13/159): libcephfs-devel-19.0.0-2946.g3d89accf 544 kB/s | 32 kB 00:00 2024-06-06T03:11:57.685 INFO:teuthology.orchestra.run.smithi122.stdout:(38/159): fuse-2.9.9-15.el9.x86_64.rpm 566 kB/s | 80 kB 00:00 2024-06-06T03:11:57.688 INFO:teuthology.orchestra.run.smithi122.stdout:[MIRROR] libgfortran-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T03:11:57.768 INFO:teuthology.orchestra.run.smithi122.stdout:(39/159): libgfortran-11.4.1-3.el9.x86_64.rpm 9.4 MB/s | 803 kB 00:00 2024-06-06T03:11:57.771 INFO:teuthology.orchestra.run.smithi122.stdout:[MIRROR] libquadmath-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T03:11:57.811 INFO:teuthology.orchestra.run.smithi122.stdout:(40/159): libquadmath-11.4.1-3.el9.x86_64.rpm 4.6 MB/s | 195 kB 00:00 2024-06-06T03:11:57.818 INFO:teuthology.orchestra.run.smithi050.stdout:(14/159): libcephfs2-19.0.0-2946.g3d89accf.el9. 3.6 MB/s | 747 kB 00:00 2024-06-06T03:11:57.852 INFO:teuthology.orchestra.run.smithi122.stdout:(41/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.9 MB/s | 253 kB 00:00 2024-06-06T03:11:57.885 INFO:teuthology.orchestra.run.smithi050.stdout:(15/159): libcephsqlite-19.0.0-2946.g3d89accf.e 2.4 MB/s | 163 kB 00:00 2024-06-06T03:11:57.919 INFO:teuthology.orchestra.run.smithi122.stdout:(42/159): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-06-06T03:11:57.952 INFO:teuthology.orchestra.run.smithi050.stdout:(16/159): librados-devel-19.0.0-2946.g3d89accf. 1.9 MB/s | 127 kB 00:00 2024-06-06T03:11:57.961 INFO:teuthology.orchestra.run.smithi122.stdout:(43/159): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-06-06T03:11:58.003 INFO:teuthology.orchestra.run.smithi122.stdout:(44/159): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-06-06T03:11:58.045 INFO:teuthology.orchestra.run.smithi122.stdout:(45/159): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-06-06T03:11:58.088 INFO:teuthology.orchestra.run.smithi122.stdout:(46/159): python3-urllib3-1.26.5-5.el9.noarch.r 5.0 MB/s | 215 kB 00:00 2024-06-06T03:11:58.091 INFO:teuthology.orchestra.run.smithi122.stdout:[MIRROR] automake-1.16.2-8.el9.noarch.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/automake-1.16.2-8.el9.noarch.rpm (IP: 8.43.85.72) 2024-06-06T03:11:58.110 INFO:teuthology.orchestra.run.smithi050.stdout:(17/159): libradosstriper1-19.0.0-2946.g3d89acc 3.1 MB/s | 501 kB 00:00 2024-06-06T03:11:58.138 INFO:teuthology.orchestra.run.smithi122.stdout:(47/159): automake-1.16.2-8.el9.noarch.rpm 14 MB/s | 689 kB 00:00 2024-06-06T03:11:58.141 INFO:teuthology.orchestra.run.smithi122.stdout:[MIRROR] bison-3.7.4-5.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/bison-3.7.4-5.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T03:11:58.196 INFO:teuthology.orchestra.run.smithi122.stdout:(48/159): bison-3.7.4-5.el9.x86_64.rpm 16 MB/s | 943 kB 00:00 2024-06-06T03:11:58.200 INFO:teuthology.orchestra.run.smithi122.stdout:[MIRROR] boost-program-options-1.75.0-8.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/boost-program-options-1.75.0-8.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T03:11:58.229 INFO:teuthology.orchestra.run.smithi079.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-06T03:11:58.230 INFO:teuthology.orchestra.run.smithi079.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-06T03:11:58.238 INFO:teuthology.orchestra.run.smithi122.stdout:(49/159): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-06-06T03:11:58.241 INFO:teuthology.orchestra.run.smithi079.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-06-06T03:11:58.241 INFO:teuthology.orchestra.run.smithi079.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-06-06T03:11:58.242 INFO:teuthology.orchestra.run.smithi079.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-06-06T03:11:58.243 INFO:teuthology.orchestra.run.smithi079.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-06T03:11:58.245 INFO:teuthology.orchestra.run.smithi079.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-06-06T03:11:58.247 INFO:teuthology.orchestra.run.smithi079.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-06-06T03:11:58.248 INFO:teuthology.orchestra.run.smithi079.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-06-06T03:11:58.272 INFO:teuthology.orchestra.run.smithi122.stdout:(50/159): elfutils-libelf-devel-0.191-4.el9.x86 647 kB/s | 22 kB 00:00 2024-06-06T03:11:58.310 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-06-06T03:11:58.314 INFO:teuthology.orchestra.run.smithi122.stdout:(51/159): flex-2.6.4-9.el9.x86_64.rpm 7.4 MB/s | 313 kB 00:00 2024-06-06T03:11:58.332 INFO:teuthology.orchestra.run.smithi079.stdout:======================================================================================= 2024-06-06T03:11:58.333 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2024-06-06T03:11:58.333 INFO:teuthology.orchestra.run.smithi079.stdout:======================================================================================= 2024-06-06T03:11:58.333 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-06-06T03:11:58.333 INFO:teuthology.orchestra.run.smithi079.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-06T03:11:58.333 INFO:teuthology.orchestra.run.smithi079.stdout: ceph x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 6.6 k 2024-06-06T03:11:58.333 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.4 M 2024-06-06T03:11:58.333 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 890 k 2024-06-06T03:11:58.333 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 145 k 2024-06-06T03:11:58.333 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 1.5 M 2024-06-06T03:11:58.333 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 142 k 2024-06-06T03:11:58.333 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 3.5 M 2024-06-06T03:11:58.334 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 7.4 M 2024-06-06T03:11:58.334 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-rook noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 49 k 2024-06-06T03:11:58.334 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-radosgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 10 M 2024-06-06T03:11:58.334 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-test x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 48 M 2024-06-06T03:11:58.334 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-volume noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 264 k 2024-06-06T03:11:58.334 INFO:teuthology.orchestra.run.smithi079.stdout: cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 763 k 2024-06-06T03:11:58.334 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 221 k 2024-06-06T03:11:58.334 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-shell x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 27 k 2024-06-06T03:11:58.334 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-top noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 18 k 2024-06-06T03:11:58.334 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-06T03:11:58.334 INFO:teuthology.orchestra.run.smithi079.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-06T03:11:58.335 INFO:teuthology.orchestra.run.smithi079.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-06T03:11:58.335 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 32 k 2024-06-06T03:11:58.335 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 747 k 2024-06-06T03:11:58.335 INFO:teuthology.orchestra.run.smithi079.stdout: librados-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 127 k 2024-06-06T03:11:58.335 INFO:teuthology.orchestra.run.smithi079.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-06T03:11:58.335 INFO:teuthology.orchestra.run.smithi079.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-06T03:11:58.335 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-06-06T03:11:58.335 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-06-06T03:11:58.335 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-06-06T03:11:58.335 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-06-06T03:11:58.335 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cephfs x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 162 k 2024-06-06T03:11:58.335 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rados x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 321 k 2024-06-06T03:11:58.335 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 300 k 2024-06-06T03:11:58.336 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 99 k 2024-06-06T03:11:58.336 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 85 k 2024-06-06T03:11:58.336 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-06T03:11:58.336 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-nbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 171 k 2024-06-06T03:11:58.336 INFO:teuthology.orchestra.run.smithi079.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-06-06T03:11:58.336 INFO:teuthology.orchestra.run.smithi079.stdout:Upgrading: 2024-06-06T03:11:58.336 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-06-06T03:11:58.336 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-06-06T03:11:58.336 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-06-06T03:11:58.336 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-06-06T03:11:58.336 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-06T03:11:58.336 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-06T03:11:58.336 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-06T03:11:58.337 INFO:teuthology.orchestra.run.smithi079.stdout: librados2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.4 M 2024-06-06T03:11:58.337 INFO:teuthology.orchestra.run.smithi079.stdout: librbd1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-06T03:11:58.337 INFO:teuthology.orchestra.run.smithi079.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-06-06T03:11:58.337 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-06-06T03:11:58.337 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2024-06-06T03:11:58.337 INFO:teuthology.orchestra.run.smithi079.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-06T03:11:58.337 INFO:teuthology.orchestra.run.smithi079.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-06T03:11:58.337 INFO:teuthology.orchestra.run.smithi079.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-06T03:11:58.337 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 21 M 2024-06-06T03:11:58.337 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 32 k 2024-06-06T03:11:58.337 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mds x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 2.4 M 2024-06-06T03:11:58.337 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 249 k 2024-06-06T03:11:58.338 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mon x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 4.7 M 2024-06-06T03:11:58.338 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-osd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 17 M 2024-06-06T03:11:58.338 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 16 k 2024-06-06T03:11:58.338 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-selinux x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 25 k 2024-06-06T03:11:58.338 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-06T03:11:58.338 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-06T03:11:58.338 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-06T03:11:58.338 INFO:teuthology.orchestra.run.smithi079.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-06T03:11:58.338 INFO:teuthology.orchestra.run.smithi079.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-06T03:11:58.338 INFO:teuthology.orchestra.run.smithi079.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-06T03:11:58.338 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-06T03:11:58.338 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-06T03:11:58.339 INFO:teuthology.orchestra.run.smithi079.stdout: libcephsqlite x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 163 k 2024-06-06T03:11:58.339 INFO:teuthology.orchestra.run.smithi079.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-06T03:11:58.339 INFO:teuthology.orchestra.run.smithi079.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-06T03:11:58.339 INFO:teuthology.orchestra.run.smithi079.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-06T03:11:58.339 INFO:teuthology.orchestra.run.smithi079.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-06T03:11:58.339 INFO:teuthology.orchestra.run.smithi079.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-06T03:11:58.339 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 501 k 2024-06-06T03:11:58.339 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-06T03:11:58.339 INFO:teuthology.orchestra.run.smithi079.stdout: librgw2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.3 M 2024-06-06T03:11:58.339 INFO:teuthology.orchestra.run.smithi079.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-06T03:11:58.339 INFO:teuthology.orchestra.run.smithi079.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-06T03:11:58.339 INFO:teuthology.orchestra.run.smithi079.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-06T03:11:58.339 INFO:teuthology.orchestra.run.smithi079.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-06T03:11:58.339 INFO:teuthology.orchestra.run.smithi079.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-06T03:11:58.340 INFO:teuthology.orchestra.run.smithi079.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-06T03:11:58.340 INFO:teuthology.orchestra.run.smithi079.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-06T03:11:58.340 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-06T03:11:58.340 INFO:teuthology.orchestra.run.smithi079.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-06T03:11:58.340 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-06-06T03:11:58.340 INFO:teuthology.orchestra.run.smithi079.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-06T03:11:58.340 INFO:teuthology.orchestra.run.smithi079.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-06T03:11:58.340 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-06T03:11:58.340 INFO:teuthology.orchestra.run.smithi079.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-06-06T03:11:58.340 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-06T03:11:58.340 INFO:teuthology.orchestra.run.smithi079.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-06T03:11:58.340 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-06T03:11:58.340 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 45 k 2024-06-06T03:11:58.341 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 135 k 2024-06-06T03:11:58.341 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-06T03:11:58.341 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-06T03:11:58.341 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-06T03:11:58.341 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-06T03:11:58.341 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-06-06T03:11:58.341 INFO:teuthology.orchestra.run.smithi079.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-06-06T03:11:58.341 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-06T03:11:58.341 INFO:teuthology.orchestra.run.smithi079.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-06T03:11:58.341 INFO:teuthology.orchestra.run.smithi079.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-06-06T03:11:58.341 INFO:teuthology.orchestra.run.smithi079.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-06T03:11:58.341 INFO:teuthology.orchestra.run.smithi079.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-06T03:11:58.341 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-06T03:11:58.342 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-06T03:11:58.342 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-06T03:11:58.342 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-06T03:11:58.342 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-06T03:11:58.342 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-06T03:11:58.342 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-06T03:11:58.342 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-06T03:11:58.342 INFO:teuthology.orchestra.run.smithi079.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-06T03:11:58.342 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-06T03:11:58.342 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-06T03:11:58.342 INFO:teuthology.orchestra.run.smithi079.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-06T03:11:58.342 INFO:teuthology.orchestra.run.smithi079.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-06T03:11:58.342 INFO:teuthology.orchestra.run.smithi079.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-06T03:11:58.343 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-06T03:11:58.343 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-06T03:11:58.343 INFO:teuthology.orchestra.run.smithi079.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-06T03:11:58.343 INFO:teuthology.orchestra.run.smithi079.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-06T03:11:58.343 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-06T03:11:58.343 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-06T03:11:58.343 INFO:teuthology.orchestra.run.smithi079.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-06T03:11:58.343 INFO:teuthology.orchestra.run.smithi079.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-06T03:11:58.343 INFO:teuthology.orchestra.run.smithi079.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-06T03:11:58.343 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-06T03:11:58.343 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-06T03:11:58.343 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-06T03:11:58.344 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-06T03:11:58.344 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-06-06T03:11:58.344 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-06T03:11:58.344 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-06T03:11:58.344 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-06T03:11:58.344 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-06T03:11:58.344 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-06T03:11:58.344 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-06T03:11:58.344 INFO:teuthology.orchestra.run.smithi079.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-06T03:11:58.344 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-06T03:11:58.344 INFO:teuthology.orchestra.run.smithi079.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-06T03:11:58.344 INFO:teuthology.orchestra.run.smithi079.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-06T03:11:58.344 INFO:teuthology.orchestra.run.smithi079.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-06T03:11:58.345 INFO:teuthology.orchestra.run.smithi079.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-06-06T03:11:58.345 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-06T03:11:58.345 INFO:teuthology.orchestra.run.smithi079.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-06T03:11:58.345 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-06T03:11:58.345 INFO:teuthology.orchestra.run.smithi079.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-06T03:11:58.345 INFO:teuthology.orchestra.run.smithi079.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-06T03:11:58.345 INFO:teuthology.orchestra.run.smithi079.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-06T03:11:58.345 INFO:teuthology.orchestra.run.smithi079.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-06T03:11:58.345 INFO:teuthology.orchestra.run.smithi079.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-06-06T03:11:58.345 INFO:teuthology.orchestra.run.smithi079.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-06T03:11:58.345 INFO:teuthology.orchestra.run.smithi079.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-06-06T03:11:58.345 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-06T03:11:58.345 INFO:teuthology.orchestra.run.smithi079.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-06T03:11:58.345 INFO:teuthology.orchestra.run.smithi079.stdout:Installing weak dependencies: 2024-06-06T03:11:58.346 INFO:teuthology.orchestra.run.smithi079.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-06T03:11:58.346 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-06T03:11:58.346 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-06-06T03:11:58.346 INFO:teuthology.orchestra.run.smithi079.stdout:======================================================================================= 2024-06-06T03:11:58.346 INFO:teuthology.orchestra.run.smithi079.stdout:Install 148 Packages 2024-06-06T03:11:58.346 INFO:teuthology.orchestra.run.smithi079.stdout:Upgrade 11 Packages 2024-06-06T03:11:58.346 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-06T03:11:58.347 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 225 M 2024-06-06T03:11:58.347 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-06-06T03:11:58.348 INFO:teuthology.orchestra.run.smithi122.stdout:(52/159): flexiblas-3.0.4-8.el9.x86_64.rpm 980 kB/s | 33 kB 00:00 2024-06-06T03:11:58.440 INFO:teuthology.orchestra.run.smithi122.stdout:(53/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 33 MB/s | 3.0 MB 00:00 2024-06-06T03:11:58.473 INFO:teuthology.orchestra.run.smithi122.stdout:(54/159): flexiblas-openblas-openmp-3.0.4-8.el9 550 kB/s | 18 kB 00:00 2024-06-06T03:11:58.499 INFO:teuthology.orchestra.run.smithi122.stdout:(55/159): libaio-devel-0.3.111-13.el9.x86_64.rp 442 kB/s | 11 kB 00:00 2024-06-06T03:11:58.541 INFO:teuthology.orchestra.run.smithi122.stdout:(56/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 160 kB 00:00 2024-06-06T03:11:58.575 INFO:teuthology.orchestra.run.smithi122.stdout:(57/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-06-06T03:11:58.625 INFO:teuthology.orchestra.run.smithi122.stdout:(58/159): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2024-06-06T03:11:58.670 INFO:teuthology.orchestra.run.smithi122.stdout:(59/159): libtool-2.4.6-45.el9.x86_64.rpm 14 MB/s | 582 kB 00:00 2024-06-06T03:11:58.734 INFO:teuthology.orchestra.run.smithi122.stdout:(60/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 381 kB/s | 25 kB 00:00 2024-06-06T03:11:58.776 INFO:teuthology.orchestra.run.smithi122.stdout:(61/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-06-06T03:11:58.827 INFO:teuthology.orchestra.run.smithi122.stdout:(62/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-06-06T03:11:58.868 INFO:teuthology.orchestra.run.smithi122.stdout:(63/159): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 188 kB 00:00 2024-06-06T03:11:58.894 INFO:teuthology.orchestra.run.smithi122.stdout:(64/159): openblas-0.3.21-2.el9.x86_64.rpm 1.4 MB/s | 35 kB 00:00 2024-06-06T03:11:59.011 INFO:teuthology.orchestra.run.smithi122.stdout:(65/159): openblas-openmp-0.3.21-2.el9.x86_64.r 41 MB/s | 4.7 MB 00:00 2024-06-06T03:11:59.079 INFO:teuthology.orchestra.run.smithi079.stdout:(1/159): ceph-19.0.0-2946.g3d89accf.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-06-06T03:11:59.194 INFO:teuthology.orchestra.run.smithi050.stdout:(18/159): librgw2-19.0.0-2946.g3d89accf.el9.x86 4.9 MB/s | 5.3 MB 00:01 2024-06-06T03:11:59.269 INFO:teuthology.orchestra.run.smithi050.stdout:(19/159): python3-ceph-argparse-19.0.0-2946.g3d 603 kB/s | 45 kB 00:00 2024-06-06T03:11:59.370 INFO:teuthology.orchestra.run.smithi050.stdout:(20/159): python3-ceph-common-19.0.0-2946.g3d89 1.3 MB/s | 135 kB 00:00 2024-06-06T03:11:59.437 INFO:teuthology.orchestra.run.smithi122.stdout:(66/159): ceph-test-19.0.0-2946.g3d89accf.el9.x 9.0 MB/s | 48 MB 00:05 2024-06-06T03:11:59.470 INFO:teuthology.orchestra.run.smithi050.stdout:(21/159): python3-cephfs-19.0.0-2946.g3d89accf. 1.6 MB/s | 162 kB 00:00 2024-06-06T03:11:59.528 INFO:teuthology.orchestra.run.smithi122.stdout:(67/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 8.6 MB/s | 4.4 MB 00:00 2024-06-06T03:11:59.587 INFO:teuthology.orchestra.run.smithi122.stdout:(68/159): postgresql-contrib-13.14-1.el9.x86_64 15 MB/s | 911 kB 00:00 2024-06-06T03:11:59.629 INFO:teuthology.orchestra.run.smithi122.stdout:(69/159): postgresql-private-libs-13.14-1.el9.x 3.1 MB/s | 133 kB 00:00 2024-06-06T03:11:59.671 INFO:teuthology.orchestra.run.smithi122.stdout:(70/159): postgresql-13.14-1.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2024-06-06T03:11:59.721 INFO:teuthology.orchestra.run.smithi050.stdout:(22/159): python3-rados-19.0.0-2946.g3d89accf.e 1.3 MB/s | 321 kB 00:00 2024-06-06T03:11:59.721 INFO:teuthology.orchestra.run.smithi122.stdout:(71/159): protobuf-3.14.0-13.el9.x86_64.rpm 20 MB/s | 1.0 MB 00:00 2024-06-06T03:11:59.729 INFO:teuthology.orchestra.run.smithi079.stdout:(2/159): ceph-base-19.0.0-2946.g3d89accf.el9.x8 5.5 MB/s | 5.4 MB 00:00 2024-06-06T03:11:59.755 INFO:teuthology.orchestra.run.smithi122.stdout:(72/159): python3-attrs-20.3.0-7.el9.noarch.rpm 2.6 MB/s | 87 kB 00:00 2024-06-06T03:11:59.804 INFO:teuthology.orchestra.run.smithi079.stdout:(3/159): ceph-immutable-object-cache-19.0.0-294 1.9 MB/s | 145 kB 00:00 2024-06-06T03:11:59.846 INFO:teuthology.orchestra.run.smithi050.stdout:(23/159): python3-rbd-19.0.0-2946.g3d89accf.el9 2.3 MB/s | 300 kB 00:00 2024-06-06T03:11:59.882 INFO:teuthology.orchestra.run.smithi122.stdout:(73/159): postgresql-server-13.14-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-06-06T03:11:59.904 INFO:teuthology.orchestra.run.smithi079.stdout:(4/159): ceph-fuse-19.0.0-2946.g3d89accf.el9.x8 1.1 MB/s | 890 kB 00:00 2024-06-06T03:11:59.921 INFO:teuthology.orchestra.run.smithi050.stdout:(24/159): python3-rgw-19.0.0-2946.g3d89accf.el9 1.3 MB/s | 99 kB 00:00 2024-06-06T03:11:59.972 INFO:teuthology.orchestra.run.smithi122.stdout:(74/159): python3-babel-2.9.1-2.el9.noarch.rpm 27 MB/s | 6.0 MB 00:00 2024-06-06T03:11:59.997 INFO:teuthology.orchestra.run.smithi050.stdout:(25/159): rbd-fuse-19.0.0-2946.g3d89accf.el9.x8 1.1 MB/s | 85 kB 00:00 2024-06-06T03:11:59.998 INFO:teuthology.orchestra.run.smithi122.stdout:(75/159): python3-colorama-0.4.6-3.el9.noarch.r 531 kB/s | 61 kB 00:00 2024-06-06T03:12:00.023 INFO:teuthology.orchestra.run.smithi122.stdout:(76/159): python3-devel-3.9.18-3.el9.x86_64.rpm 4.7 MB/s | 244 kB 00:00 2024-06-06T03:12:00.048 INFO:teuthology.orchestra.run.smithi122.stdout:(77/159): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-06-06T03:12:00.074 INFO:teuthology.orchestra.run.smithi122.stdout:(78/159): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-06-06T03:12:00.101 INFO:teuthology.orchestra.run.smithi122.stdout:(79/159): python3-jsonpointer-2.0-4.el9.noarch. 380 kB/s | 19 kB 00:00 2024-06-06T03:12:00.125 INFO:teuthology.orchestra.run.smithi122.stdout:(80/159): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-06-06T03:12:00.150 INFO:teuthology.orchestra.run.smithi122.stdout:(81/159): python3-markupsafe-1.1.1-12.el9.x86_6 690 kB/s | 35 kB 00:00 2024-06-06T03:12:00.192 INFO:teuthology.orchestra.run.smithi122.stdout:(82/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.9 MB/s | 250 kB 00:00 2024-06-06T03:12:00.246 INFO:teuthology.orchestra.run.smithi079.stdout:(5/159): ceph-mds-19.0.0-2946.g3d89accf.el9.x86 5.3 MB/s | 2.4 MB 00:00 2024-06-06T03:12:00.267 INFO:teuthology.orchestra.run.smithi122.stdout:(83/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 5.1 MB 00:00 2024-06-06T03:12:00.292 INFO:teuthology.orchestra.run.smithi122.stdout:(84/159): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-06-06T03:12:00.326 INFO:teuthology.orchestra.run.smithi122.stdout:(85/159): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-06-06T03:12:00.352 INFO:teuthology.orchestra.run.smithi122.stdout:(86/159): python3-prettytable-0.7.2-27.el9.noar 717 kB/s | 42 kB 00:00 2024-06-06T03:12:00.372 INFO:teuthology.orchestra.run.smithi050.stdout:(26/159): ceph-osd-19.0.0-2946.g3d89accf.el9.x8 2.9 MB/s | 17 MB 00:05 2024-06-06T03:12:00.377 INFO:teuthology.orchestra.run.smithi122.stdout:(87/159): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-06-06T03:12:00.394 INFO:teuthology.orchestra.run.smithi122.stdout:(88/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.7 MB/s | 159 kB 00:00 2024-06-06T03:12:00.419 INFO:teuthology.orchestra.run.smithi122.stdout:(89/159): python3-pyasn1-modules-0.4.8-6.el9.no 6.5 MB/s | 279 kB 00:00 2024-06-06T03:12:00.436 INFO:teuthology.orchestra.run.smithi122.stdout:(90/159): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-06-06T03:12:00.453 INFO:teuthology.orchestra.run.smithi122.stdout:(91/159): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-06-06T03:12:00.487 INFO:teuthology.orchestra.run.smithi122.stdout:(92/159): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 42 kB 00:00 2024-06-06T03:12:00.514 INFO:teuthology.orchestra.run.smithi050.stdout:(27/159): rbd-nbd-19.0.0-2946.g3d89accf.el9.x86 1.2 MB/s | 171 kB 00:00 2024-06-06T03:12:00.521 INFO:teuthology.orchestra.run.smithi122.stdout:(93/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-06-06T03:12:00.563 INFO:teuthology.orchestra.run.smithi122.stdout:(94/159): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 221 kB 00:00 2024-06-06T03:12:00.596 INFO:teuthology.orchestra.run.smithi122.stdout:(95/159): qatlib-service-24.02.0-1.el9.x86_64.r 1.1 MB/s | 36 kB 00:00 2024-06-06T03:12:00.605 INFO:teuthology.orchestra.run.smithi050.stdout:(28/159): ceph-grafana-dashboards-19.0.0-2946.g 346 kB/s | 32 kB 00:00 2024-06-06T03:12:00.613 INFO:teuthology.orchestra.run.smithi079.stdout:(6/159): ceph-mgr-19.0.0-2946.g3d89accf.el9.x86 2.1 MB/s | 1.5 MB 00:00 2024-06-06T03:12:00.673 INFO:teuthology.orchestra.run.smithi050.stdout:(29/159): ceph-mgr-cephadm-19.0.0-2946.g3d89acc 2.1 MB/s | 142 kB 00:00 2024-06-06T03:12:00.780 INFO:teuthology.orchestra.run.smithi122.stdout:(96/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 47 MB/s | 16 MB 00:00 2024-06-06T03:12:00.806 INFO:teuthology.orchestra.run.smithi122.stdout:(97/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 227 kB/s | 47 kB 00:00 2024-06-06T03:12:00.831 INFO:teuthology.orchestra.run.smithi122.stdout:(98/159): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 305 kB 00:00 2024-06-06T03:12:00.856 INFO:teuthology.orchestra.run.smithi122.stdout:(99/159): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-06-06T03:12:00.881 INFO:teuthology.orchestra.run.smithi122.stdout:(100/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.8 MB/s | 94 kB 00:00 2024-06-06T03:12:00.907 INFO:teuthology.orchestra.run.smithi122.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-06-06T03:12:00.932 INFO:teuthology.orchestra.run.smithi122.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 891 kB/s | 45 kB 00:00 2024-06-06T03:12:00.932 INFO:teuthology.orchestra.run.smithi122.stdout:[MIRROR] lua-devel-5.4.4-4.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/lua-devel-5.4.4-4.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T03:12:00.933 INFO:teuthology.orchestra.run.smithi122.stdout:[MIRROR] protobuf-compiler-3.14.0-13.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/protobuf-compiler-3.14.0-13.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T03:12:01.016 INFO:teuthology.orchestra.run.smithi122.stdout:(103/159): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-06-06T03:12:01.049 INFO:teuthology.orchestra.run.smithi122.stdout:(104/159): abseil-cpp-20211102.0-3.el9.x86_64.r 16 MB/s | 548 kB 00:00 2024-06-06T03:12:01.072 INFO:teuthology.orchestra.run.smithi079.stdout:(7/159): ceph-mon-19.0.0-2946.g3d89accf.el9.x86 5.7 MB/s | 4.7 MB 00:00 2024-06-06T03:12:01.081 INFO:teuthology.orchestra.run.smithi050.stdout:(30/159): rbd-mirror-19.0.0-2946.g3d89accf.el9. 2.9 MB/s | 3.1 MB 00:01 2024-06-06T03:12:01.083 INFO:teuthology.orchestra.run.smithi122.stdout:(105/159): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-06-06T03:12:01.108 INFO:teuthology.orchestra.run.smithi122.stdout:(106/159): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-06-06T03:12:01.167 INFO:teuthology.orchestra.run.smithi122.stdout:(107/159): protobuf-compiler-3.14.0-13.el9.x86_ 3.6 MB/s | 863 kB 00:00 2024-06-06T03:12:01.234 INFO:teuthology.orchestra.run.smithi122.stdout:(108/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 391 kB/s | 26 kB 00:00 2024-06-06T03:12:01.268 INFO:teuthology.orchestra.run.smithi122.stdout:(109/159): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-06-06T03:12:01.293 INFO:teuthology.orchestra.run.smithi122.stdout:(110/159): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-06-06T03:12:01.360 INFO:teuthology.orchestra.run.smithi122.stdout:(111/159): libarrow-9.0.0-11.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-06-06T03:12:01.385 INFO:teuthology.orchestra.run.smithi122.stdout:(112/159): luarocks-3.9.2-5.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-06-06T03:12:01.419 INFO:teuthology.orchestra.run.smithi122.stdout:(113/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-06-06T03:12:01.444 INFO:teuthology.orchestra.run.smithi122.stdout:(114/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-06-06T03:12:01.470 INFO:teuthology.orchestra.run.smithi122.stdout:(115/159): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-06-06T03:12:01.503 INFO:teuthology.orchestra.run.smithi122.stdout:(116/159): python3-asyncssh-2.13.2-5.el9.noarch 4.6 MB/s | 548 kB 00:00 2024-06-06T03:12:01.529 INFO:teuthology.orchestra.run.smithi122.stdout:(117/159): python3-certifi-2021.10.8-2.el9.noar 255 kB/s | 15 kB 00:00 2024-06-06T03:12:01.554 INFO:teuthology.orchestra.run.smithi122.stdout:(118/159): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-06-06T03:12:01.579 INFO:teuthology.orchestra.run.smithi122.stdout:(119/159): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-06-06T03:12:01.605 INFO:teuthology.orchestra.run.smithi122.stdout:(120/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-06-06T03:12:01.647 INFO:teuthology.orchestra.run.smithi079.stdout:(8/159): ceph-common-19.0.0-2946.g3d89accf.el9. 7.2 MB/s | 21 MB 00:02 2024-06-06T03:12:01.697 INFO:teuthology.orchestra.run.smithi122.stdout:(121/159): ceph-mgr-diskprediction-local-19.0.0 1.4 MB/s | 7.4 MB 00:05 2024-06-06T03:12:01.722 INFO:teuthology.orchestra.run.smithi122.stdout:(122/159): python3-google-auth-2.29.0-1.el9.noa 1.4 MB/s | 206 kB 00:00 2024-06-06T03:12:01.731 INFO:teuthology.orchestra.run.smithi079.stdout:(9/159): ceph-selinux-19.0.0-2946.g3d89accf.el9 301 kB/s | 25 kB 00:00 2024-06-06T03:12:01.764 INFO:teuthology.orchestra.run.smithi122.stdout:(123/159): python3-jaraco-8.2.1-3.el9.noarch.rp 688 kB/s | 11 kB 00:00 2024-06-06T03:12:01.798 INFO:teuthology.orchestra.run.smithi122.stdout:(124/159): python3-jaraco-classes-3.2.1-5.el9.n 571 kB/s | 18 kB 00:00 2024-06-06T03:12:01.814 INFO:teuthology.orchestra.run.smithi122.stdout:(125/159): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-06-06T03:12:01.840 INFO:teuthology.orchestra.run.smithi122.stdout:(126/159): python3-grpcio-tools-1.46.7-10.el9.x 1.0 MB/s | 144 kB 00:00 2024-06-06T03:12:01.857 INFO:teuthology.orchestra.run.smithi122.stdout:(127/159): python3-jaraco-functools-3.5.0-2.el9 461 kB/s | 19 kB 00:00 2024-06-06T03:12:01.874 INFO:teuthology.orchestra.run.smithi122.stdout:(128/159): python3-jaraco-text-3.2.0-6.el9.noar 590 kB/s | 20 kB 00:00 2024-06-06T03:12:01.910 INFO:teuthology.orchestra.run.smithi122.stdout:(129/159): python3-logutils-0.3.5-21.el9.noarch 1.3 MB/s | 46 kB 00:00 2024-06-06T03:12:01.958 INFO:teuthology.orchestra.run.smithi122.stdout:(130/159): python3-grpcio-1.46.7-10.el9.x86_64. 5.8 MB/s | 2.0 MB 00:00 2024-06-06T03:12:01.983 INFO:teuthology.orchestra.run.smithi122.stdout:(131/159): python3-more-itertools-8.12.0-2.el9. 1.1 MB/s | 79 kB 00:00 2024-06-06T03:12:02.000 INFO:teuthology.orchestra.run.smithi122.stdout:(132/159): python3-natsort-7.1.1-5.el9.noarch.r 1.3 MB/s | 58 kB 00:00 2024-06-06T03:12:02.034 INFO:teuthology.orchestra.run.smithi122.stdout:(133/159): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-06-06T03:12:02.051 INFO:teuthology.orchestra.run.smithi122.stdout:(134/159): python3-portend-3.1.0-2.el9.noarch.r 326 kB/s | 16 kB 00:00 2024-06-06T03:12:02.068 INFO:teuthology.orchestra.run.smithi122.stdout:(135/159): python3-pyperclip-1.8.2-2.el9.noarch 1.7 MB/s | 28 kB 00:00 2024-06-06T03:12:02.093 INFO:teuthology.orchestra.run.smithi122.stdout:(136/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-06-06T03:12:02.119 INFO:teuthology.orchestra.run.smithi122.stdout:(137/159): python3-repoze-lru-0.7-16.el9.noarch 609 kB/s | 31 kB 00:00 2024-06-06T03:12:02.132 INFO:teuthology.orchestra.run.smithi050.stdout:(31/159): ceph-mgr-dashboard-19.0.0-2946.g3d89a 2.4 MB/s | 3.5 MB 00:01 2024-06-06T03:12:02.146 INFO:teuthology.orchestra.run.smithi122.stdout:(138/159): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-06-06T03:12:02.161 INFO:teuthology.orchestra.run.smithi122.stdout:(139/159): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-06-06T03:12:02.178 INFO:teuthology.orchestra.run.smithi122.stdout:(140/159): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-06-06T03:12:02.204 INFO:teuthology.orchestra.run.smithi122.stdout:(141/159): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-06-06T03:12:02.229 INFO:teuthology.orchestra.run.smithi122.stdout:(142/159): python3-typing-extensions-4.4.0-2.el 758 kB/s | 51 kB 00:00 2024-06-06T03:12:02.254 INFO:teuthology.orchestra.run.smithi122.stdout:(143/159): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-06-06T03:12:02.279 INFO:teuthology.orchestra.run.smithi122.stdout:(144/159): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-06-06T03:12:02.297 INFO:teuthology.orchestra.run.smithi122.stdout:(145/159): python3-zc-lockfile-2.0-10.el9.noarc 476 kB/s | 20 kB 00:00 2024-06-06T03:12:02.315 INFO:teuthology.orchestra.run.smithi050.stdout:(32/159): ceph-mgr-modules-core-19.0.0-2946.g3d 1.3 MB/s | 249 kB 00:00 2024-06-06T03:12:02.322 INFO:teuthology.orchestra.run.smithi122.stdout:(146/159): python3-werkzeug-2.0.3-3.el9.1.noarc 4.5 MB/s | 427 kB 00:00 2024-06-06T03:12:02.347 INFO:teuthology.orchestra.run.smithi122.stdout:(147/159): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-06-06T03:12:02.397 INFO:teuthology.orchestra.run.smithi122.stdout:(148/159): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-06-06T03:12:02.399 INFO:teuthology.orchestra.run.smithi050.stdout:(33/159): ceph-mgr-rook-19.0.0-2946.g3d89accf.e 591 kB/s | 49 kB 00:00 2024-06-06T03:12:02.482 INFO:teuthology.orchestra.run.smithi050.stdout:(34/159): ceph-prometheus-alerts-19.0.0-2946.g3 198 kB/s | 16 kB 00:00 2024-06-06T03:12:02.523 INFO:teuthology.orchestra.run.smithi122.stdout:(149/159): NetworkManager-1.47.91-1.el9.x86_64. 18 MB/s | 2.3 MB 00:00 2024-06-06T03:12:02.589 INFO:teuthology.orchestra.run.smithi122.stdout:(150/159): NetworkManager-libnm-1.47.91-1.el9.x 27 MB/s | 1.8 MB 00:00 2024-06-06T03:12:02.623 INFO:teuthology.orchestra.run.smithi122.stdout:(151/159): NetworkManager-team-1.47.91-1.el9.x8 1.2 MB/s | 41 kB 00:00 2024-06-06T03:12:02.633 INFO:teuthology.orchestra.run.smithi050.stdout:(35/159): ceph-volume-19.0.0-2946.g3d89accf.el9 1.7 MB/s | 264 kB 00:00 2024-06-06T03:12:02.665 INFO:teuthology.orchestra.run.smithi079.stdout:(10/159): ceph-radosgw-19.0.0-2946.g3d89accf.el 6.4 MB/s | 10 MB 00:01 2024-06-06T03:12:02.665 INFO:teuthology.orchestra.run.smithi122.stdout:(152/159): NetworkManager-tui-1.47.91-1.el9.x86 5.9 MB/s | 248 kB 00:00 2024-06-06T03:12:02.707 INFO:teuthology.orchestra.run.smithi122.stdout:(153/159): elfutils-debuginfod-client-0.191-4.e 880 kB/s | 37 kB 00:00 2024-06-06T03:12:02.748 INFO:teuthology.orchestra.run.smithi079.stdout:(11/159): cephfs-mirror-19.0.0-2946.g3d89accf.e 2.6 MB/s | 221 kB 00:00 2024-06-06T03:12:02.749 INFO:teuthology.orchestra.run.smithi122.stdout:(154/159): elfutils-libelf-0.191-4.el9.x86_64.r 4.8 MB/s | 207 kB 00:00 2024-06-06T03:12:02.791 INFO:teuthology.orchestra.run.smithi122.stdout:(155/159): elfutils-libs-0.191-4.el9.x86_64.rpm 6.1 MB/s | 260 kB 00:00 2024-06-06T03:12:02.823 INFO:teuthology.orchestra.run.smithi079.stdout:(12/159): cephfs-shell-19.0.0-2946.g3d89accf.el 360 kB/s | 27 kB 00:00 2024-06-06T03:12:02.841 INFO:teuthology.orchestra.run.smithi122.stdout:(156/159): openssl-3.2.1-1.el9.x86_64.rpm 27 MB/s | 1.3 MB 00:00 2024-06-06T03:12:02.907 INFO:teuthology.orchestra.run.smithi079.stdout:(13/159): libcephfs-devel-19.0.0-2946.g3d89accf 381 kB/s | 32 kB 00:00 2024-06-06T03:12:02.916 INFO:teuthology.orchestra.run.smithi122.stdout:(157/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 32 MB/s | 2.4 MB 00:00 2024-06-06T03:12:03.065 INFO:teuthology.orchestra.run.smithi079.stdout:(14/159): libcephfs2-19.0.0-2946.g3d89accf.el9. 4.6 MB/s | 747 kB 00:00 2024-06-06T03:12:03.157 INFO:teuthology.orchestra.run.smithi079.stdout:(15/159): libcephsqlite-19.0.0-2946.g3d89accf.e 1.7 MB/s | 163 kB 00:00 2024-06-06T03:12:03.192 INFO:teuthology.orchestra.run.smithi122.stdout:(158/159): librados2-19.0.0-2946.g3d89accf.el9. 3.9 MB/s | 3.4 MB 00:00 2024-06-06T03:12:03.215 INFO:teuthology.orchestra.run.smithi079.stdout:(16/159): librados-devel-19.0.0-2946.g3d89accf. 2.1 MB/s | 127 kB 00:00 2024-06-06T03:12:03.299 INFO:teuthology.orchestra.run.smithi079.stdout:(17/159): libradosstriper1-19.0.0-2946.g3d89acc 5.9 MB/s | 501 kB 00:00 2024-06-06T03:12:03.358 INFO:teuthology.orchestra.run.smithi050.stdout:(36/159): ceph-test-19.0.0-2946.g3d89accf.el9.x 6.7 MB/s | 48 MB 00:07 2024-06-06T03:12:03.383 INFO:teuthology.orchestra.run.smithi050.stdout:(37/159): cephadm-19.0.0-2946.g3d89accf.el9.noa 1.0 MB/s | 763 kB 00:00 2024-06-06T03:12:03.442 INFO:teuthology.orchestra.run.smithi050.stdout:(38/159): cephfs-top-19.0.0-2946.g3d89accf.el9. 219 kB/s | 18 kB 00:00 2024-06-06T03:12:03.448 INFO:teuthology.orchestra.run.smithi050.stdout:[MIRROR] fuse-2.9.9-15.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/fuse-2.9.9-15.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T03:12:03.485 INFO:teuthology.orchestra.run.smithi050.stdout:[MIRROR] libgfortran-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T03:12:03.592 INFO:teuthology.orchestra.run.smithi050.stdout:(39/159): fuse-2.9.9-15.el9.x86_64.rpm 386 kB/s | 80 kB 00:00 2024-06-06T03:12:03.594 INFO:teuthology.orchestra.run.smithi050.stdout:[MIRROR] libquadmath-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T03:12:03.668 INFO:teuthology.orchestra.run.smithi050.stdout:(40/159): libquadmath-11.4.1-3.el9.x86_64.rpm 2.5 MB/s | 195 kB 00:00 2024-06-06T03:12:03.693 INFO:teuthology.orchestra.run.smithi050.stdout:(41/159): libgfortran-11.4.1-3.el9.x86_64.rpm 3.2 MB/s | 803 kB 00:00 2024-06-06T03:12:03.785 INFO:teuthology.orchestra.run.smithi050.stdout:(42/159): ceph-mgr-diskprediction-local-19.0.0- 2.7 MB/s | 7.4 MB 00:02 2024-06-06T03:12:03.810 INFO:teuthology.orchestra.run.smithi050.stdout:(43/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-06-06T03:12:03.852 INFO:teuthology.orchestra.run.smithi050.stdout:(44/159): python3-cryptography-36.0.1-4.el9.x86 7.7 MB/s | 1.2 MB 00:00 2024-06-06T03:12:03.877 INFO:teuthology.orchestra.run.smithi050.stdout:(45/159): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-06-06T03:12:03.894 INFO:teuthology.orchestra.run.smithi050.stdout:(46/159): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-06-06T03:12:03.897 INFO:teuthology.orchestra.run.smithi050.stdout:[MIRROR] automake-1.16.2-8.el9.noarch.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/automake-1.16.2-8.el9.noarch.rpm (IP: 8.43.85.72) 2024-06-06T03:12:03.925 INFO:teuthology.orchestra.run.smithi079.stdout:(18/159): librgw2-19.0.0-2946.g3d89accf.el9.x86 8.5 MB/s | 5.3 MB 00:00 2024-06-06T03:12:03.928 INFO:teuthology.orchestra.run.smithi050.stdout:(47/159): python3-urllib3-1.26.5-5.el9.noarch.r 4.1 MB/s | 215 kB 00:00 2024-06-06T03:12:03.953 INFO:teuthology.orchestra.run.smithi050.stdout:(48/159): python3-ply-3.11-14.el9.noarch.rpm 633 kB/s | 106 kB 00:00 2024-06-06T03:12:03.954 INFO:teuthology.orchestra.run.smithi050.stdout:[MIRROR] bison-3.7.4-5.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/bison-3.7.4-5.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T03:12:03.954 INFO:teuthology.orchestra.run.smithi050.stdout:[MIRROR] boost-program-options-1.75.0-8.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/boost-program-options-1.75.0-8.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T03:12:03.990 INFO:teuthology.orchestra.run.smithi050.stdout:(49/159): automake-1.16.2-8.el9.noarch.rpm 7.3 MB/s | 689 kB 00:00 2024-06-06T03:12:04.017 INFO:teuthology.orchestra.run.smithi122.stdout:(159/159): librbd1-19.0.0-2946.g3d89accf.el9.x8 1.9 MB/s | 3.1 MB 00:01 2024-06-06T03:12:04.023 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-06-06T03:12:04.024 INFO:teuthology.orchestra.run.smithi122.stdout:Total 17 MB/s | 225 MB 00:13 2024-06-06T03:12:04.037 INFO:teuthology.orchestra.run.smithi050.stdout:(50/159): bison-3.7.4-5.el9.x86_64.rpm 8.5 MB/s | 943 kB 00:00 2024-06-06T03:12:04.063 INFO:teuthology.orchestra.run.smithi050.stdout:(51/159): elfutils-libelf-devel-0.191-4.el9.x86 289 kB/s | 22 kB 00:00 2024-06-06T03:12:04.088 INFO:teuthology.orchestra.run.smithi050.stdout:(52/159): boost-program-options-1.75.0-8.el9.x8 797 kB/s | 107 kB 00:00 2024-06-06T03:12:04.100 INFO:teuthology.orchestra.run.smithi079.stdout:(19/159): ceph-osd-19.0.0-2946.g3d89accf.el9.x8 4.8 MB/s | 17 MB 00:03 2024-06-06T03:12:04.113 INFO:teuthology.orchestra.run.smithi050.stdout:(53/159): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-06-06T03:12:04.125 INFO:teuthology.orchestra.run.smithi079.stdout:(20/159): python3-ceph-argparse-19.0.0-2946.g3d 225 kB/s | 45 kB 00:00 2024-06-06T03:12:04.167 INFO:teuthology.orchestra.run.smithi079.stdout:(21/159): python3-ceph-common-19.0.0-2946.g3d89 2.0 MB/s | 135 kB 00:00 2024-06-06T03:12:04.180 INFO:teuthology.orchestra.run.smithi050.stdout:(54/159): flexiblas-openblas-openmp-3.0.4-8.el9 272 kB/s | 18 kB 00:00 2024-06-06T03:12:04.194 INFO:teuthology.orchestra.run.smithi079.stdout:(22/159): python3-cephfs-19.0.0-2946.g3d89accf. 2.4 MB/s | 162 kB 00:00 2024-06-06T03:12:04.214 INFO:teuthology.orchestra.run.smithi050.stdout:(55/159): flexiblas-3.0.4-8.el9.x86_64.rpm 217 kB/s | 33 kB 00:00 2024-06-06T03:12:04.243 INFO:teuthology.orchestra.run.smithi079.stdout:(23/159): python3-rados-19.0.0-2946.g3d89accf.e 4.2 MB/s | 321 kB 00:00 2024-06-06T03:12:04.256 INFO:teuthology.orchestra.run.smithi050.stdout:(56/159): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-06-06T03:12:04.281 INFO:teuthology.orchestra.run.smithi050.stdout:(57/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-06-06T03:12:04.285 INFO:teuthology.orchestra.run.smithi079.stdout:(24/159): python3-rbd-19.0.0-2946.g3d89accf.el9 3.2 MB/s | 300 kB 00:00 2024-06-06T03:12:04.306 INFO:teuthology.orchestra.run.smithi050.stdout:(58/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 897 kB/s | 45 kB 00:00 2024-06-06T03:12:04.310 INFO:teuthology.orchestra.run.smithi079.stdout:(25/159): python3-rgw-19.0.0-2946.g3d89accf.el9 1.5 MB/s | 99 kB 00:00 2024-06-06T03:12:04.335 INFO:teuthology.orchestra.run.smithi079.stdout:(26/159): rbd-fuse-19.0.0-2946.g3d89accf.el9.x8 1.7 MB/s | 85 kB 00:00 2024-06-06T03:12:04.365 INFO:teuthology.orchestra.run.smithi050.stdout:(59/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-06-06T03:12:04.401 INFO:teuthology.orchestra.run.smithi050.stdout:(60/159): librdkafka-1.6.1-102.el9.x86_64.rpm 5.4 MB/s | 662 kB 00:00 2024-06-06T03:12:04.402 INFO:teuthology.orchestra.run.smithi079.stdout:(27/159): rbd-nbd-19.0.0-2946.g3d89accf.el9.x86 2.5 MB/s | 171 kB 00:00 2024-06-06T03:12:04.424 INFO:teuthology.orchestra.run.smithi050.stdout:(61/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 434 kB/s | 25 kB 00:00 2024-06-06T03:12:04.450 INFO:teuthology.orchestra.run.smithi050.stdout:(62/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 986 kB/s | 47 kB 00:00 2024-06-06T03:12:04.460 INFO:teuthology.orchestra.run.smithi079.stdout:(28/159): ceph-grafana-dashboards-19.0.0-2946.g 544 kB/s | 32 kB 00:00 2024-06-06T03:12:04.474 INFO:teuthology.orchestra.run.smithi050.stdout:(63/159): libtool-2.4.6-45.el9.x86_64.rpm 3.4 MB/s | 582 kB 00:00 2024-06-06T03:12:04.500 INFO:teuthology.orchestra.run.smithi050.stdout:(64/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-06-06T03:12:04.525 INFO:teuthology.orchestra.run.smithi050.stdout:(65/159): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-06-06T03:12:04.536 INFO:teuthology.orchestra.run.smithi079.stdout:(29/159): ceph-mgr-cephadm-19.0.0-2946.g3d89acc 1.8 MB/s | 142 kB 00:00 2024-06-06T03:12:04.550 INFO:teuthology.orchestra.run.smithi050.stdout:(66/159): openblas-0.3.21-2.el9.x86_64.rpm 467 kB/s | 35 kB 00:00 2024-06-06T03:12:04.668 INFO:teuthology.orchestra.run.smithi050.stdout:(67/159): openblas-openmp-0.3.21-2.el9.x86_64.r 33 MB/s | 4.7 MB 00:00 2024-06-06T03:12:04.701 INFO:teuthology.orchestra.run.smithi050.stdout:(68/159): postgresql-13.14-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-06-06T03:12:04.761 INFO:teuthology.orchestra.run.smithi079.stdout:(30/159): rbd-mirror-19.0.0-2946.g3d89accf.el9. 6.9 MB/s | 3.1 MB 00:00 2024-06-06T03:12:04.768 INFO:teuthology.orchestra.run.smithi050.stdout:(69/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-06-06T03:12:04.802 INFO:teuthology.orchestra.run.smithi050.stdout:(70/159): postgresql-private-libs-13.14-1.el9.x 1.3 MB/s | 133 kB 00:00 2024-06-06T03:12:04.887 INFO:teuthology.orchestra.run.smithi079.stdout:(31/159): ceph-mgr-dashboard-19.0.0-2946.g3d89a 10 MB/s | 3.5 MB 00:00 2024-06-06T03:12:04.910 INFO:teuthology.orchestra.run.smithi050.stdout:(71/159): postgresql-contrib-13.14-1.el9.x86_64 3.7 MB/s | 911 kB 00:00 2024-06-06T03:12:04.937 INFO:teuthology.orchestra.run.smithi079.stdout:(32/159): ceph-mgr-modules-core-19.0.0-2946.g3d 4.9 MB/s | 249 kB 00:00 2024-06-06T03:12:04.952 INFO:teuthology.orchestra.run.smithi050.stdout:(72/159): python3-attrs-20.3.0-7.el9.noarch.rpm 2.1 MB/s | 87 kB 00:00 2024-06-06T03:12:04.986 INFO:teuthology.orchestra.run.smithi050.stdout:(73/159): protobuf-3.14.0-13.el9.x86_64.rpm 5.5 MB/s | 1.0 MB 00:00 2024-06-06T03:12:04.987 INFO:teuthology.orchestra.run.smithi079.stdout:(33/159): ceph-mgr-rook-19.0.0-2946.g3d89accf.e 985 kB/s | 49 kB 00:00 2024-06-06T03:12:05.037 INFO:teuthology.orchestra.run.smithi079.stdout:(34/159): ceph-prometheus-alerts-19.0.0-2946.g3 330 kB/s | 16 kB 00:00 2024-06-06T03:12:05.061 INFO:teuthology.orchestra.run.smithi050.stdout:(74/159): postgresql-server-13.14-1.el9.x86_64. 20 MB/s | 5.8 MB 00:00 2024-06-06T03:12:05.087 INFO:teuthology.orchestra.run.smithi050.stdout:(75/159): python3-colorama-0.4.6-3.el9.noarch.r 608 kB/s | 61 kB 00:00 2024-06-06T03:12:05.104 INFO:teuthology.orchestra.run.smithi079.stdout:(35/159): ceph-volume-19.0.0-2946.g3d89accf.el9 3.9 MB/s | 264 kB 00:00 2024-06-06T03:12:05.112 INFO:teuthology.orchestra.run.smithi050.stdout:(76/159): python3-devel-3.9.18-3.el9.x86_64.rpm 4.7 MB/s | 244 kB 00:00 2024-06-06T03:12:05.137 INFO:teuthology.orchestra.run.smithi050.stdout:(77/159): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-06-06T03:12:05.221 INFO:teuthology.orchestra.run.smithi079.stdout:(36/159): cephadm-19.0.0-2946.g3d89accf.el9.noa 6.4 MB/s | 763 kB 00:00 2024-06-06T03:12:05.229 INFO:teuthology.orchestra.run.smithi050.stdout:(78/159): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 6.0 MB 00:00 2024-06-06T03:12:05.246 INFO:teuthology.orchestra.run.smithi050.stdout:(79/159): python3-jsonpatch-1.21-16.el9.noarch. 191 kB/s | 26 kB 00:00 2024-06-06T03:12:05.261 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-06-06T03:12:05.263 INFO:teuthology.orchestra.run.smithi050.stdout:(80/159): python3-jsonpointer-2.0-4.el9.noarch. 153 kB/s | 19 kB 00:00 2024-06-06T03:12:05.288 INFO:teuthology.orchestra.run.smithi079.stdout:(37/159): cephfs-top-19.0.0-2946.g3d89accf.el9. 272 kB/s | 18 kB 00:00 2024-06-06T03:12:05.289 INFO:teuthology.orchestra.run.smithi050.stdout:(81/159): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-06-06T03:12:05.328 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] fuse-2.9.9-15.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/fuse-2.9.9-15.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T03:12:05.364 INFO:teuthology.orchestra.run.smithi050.stdout:(82/159): python3-markupsafe-1.1.1-12.el9.x86_6 346 kB/s | 35 kB 00:00 2024-06-06T03:12:05.405 INFO:teuthology.orchestra.run.smithi079.stdout:(38/159): fuse-2.9.9-15.el9.x86_64.rpm 689 kB/s | 80 kB 00:00 2024-06-06T03:12:05.408 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] libgfortran-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T03:12:05.414 INFO:teuthology.orchestra.run.smithi050.stdout:(83/159): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-06-06T03:12:05.417 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-06-06T03:12:05.417 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-06-06T03:12:05.473 INFO:teuthology.orchestra.run.smithi050.stdout:(84/159): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-06-06T03:12:05.506 INFO:teuthology.orchestra.run.smithi079.stdout:(39/159): libgfortran-11.4.1-3.el9.x86_64.rpm 7.8 MB/s | 803 kB 00:00 2024-06-06T03:12:05.509 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] libquadmath-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T03:12:05.514 INFO:teuthology.orchestra.run.smithi050.stdout:(85/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.1 MB/s | 250 kB 00:00 2024-06-06T03:12:05.540 INFO:teuthology.orchestra.run.smithi050.stdout:(86/159): python3-prettytable-0.7.2-27.el9.noar 630 kB/s | 42 kB 00:00 2024-06-06T03:12:05.548 INFO:teuthology.orchestra.run.smithi079.stdout:(40/159): libquadmath-11.4.1-3.el9.x86_64.rpm 4.6 MB/s | 195 kB 00:00 2024-06-06T03:12:05.590 INFO:teuthology.orchestra.run.smithi079.stdout:(41/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.9 MB/s | 253 kB 00:00 2024-06-06T03:12:05.590 INFO:teuthology.orchestra.run.smithi050.stdout:(87/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-06-06T03:12:05.641 INFO:teuthology.orchestra.run.smithi050.stdout:(88/159): python3-pyasn1-modules-0.4.8-6.el9.no 5.5 MB/s | 279 kB 00:00 2024-06-06T03:12:05.682 INFO:teuthology.orchestra.run.smithi079.stdout:(42/159): ceph-mgr-diskprediction-local-19.0.0- 8.0 MB/s | 7.4 MB 00:00 2024-06-06T03:12:05.682 INFO:teuthology.orchestra.run.smithi050.stdout:(89/159): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-06-06T03:12:05.716 INFO:teuthology.orchestra.run.smithi079.stdout:(43/159): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.2 MB 00:00 2024-06-06T03:12:05.733 INFO:teuthology.orchestra.run.smithi050.stdout:(90/159): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-06-06T03:12:05.757 INFO:teuthology.orchestra.run.smithi079.stdout:(44/159): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-06-06T03:12:05.766 INFO:teuthology.orchestra.run.smithi050.stdout:(91/159): python3-protobuf-3.14.0-13.el9.noarch 1.0 MB/s | 269 kB 00:00 2024-06-06T03:12:05.799 INFO:teuthology.orchestra.run.smithi079.stdout:(45/159): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-06-06T03:12:05.825 INFO:teuthology.orchestra.run.smithi079.stdout:(46/159): python3-ply-3.11-14.el9.noarch.rpm 748 kB/s | 106 kB 00:00 2024-06-06T03:12:05.825 INFO:teuthology.orchestra.run.smithi050.stdout:(92/159): python3-toml-0.10.2-6.el9.noarch.rpm 712 kB/s | 42 kB 00:00 2024-06-06T03:12:05.850 INFO:teuthology.orchestra.run.smithi079.stdout:(47/159): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-06-06T03:12:05.850 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] automake-1.16.2-8.el9.noarch.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/automake-1.16.2-8.el9.noarch.rpm (IP: 8.43.85.72) 2024-06-06T03:12:05.853 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] bison-3.7.4-5.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/bison-3.7.4-5.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T03:12:05.892 INFO:teuthology.orchestra.run.smithi079.stdout:(48/159): automake-1.16.2-8.el9.noarch.rpm 10 MB/s | 689 kB 00:00 2024-06-06T03:12:05.895 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] boost-program-options-1.75.0-8.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/boost-program-options-1.75.0-8.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T03:12:05.900 INFO:teuthology.orchestra.run.smithi050.stdout:(93/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.0 MB/s | 5.1 MB 00:00 2024-06-06T03:12:05.925 INFO:teuthology.orchestra.run.smithi050.stdout:(94/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 441 kB/s | 44 kB 00:00 2024-06-06T03:12:05.934 INFO:teuthology.orchestra.run.smithi079.stdout:(49/159): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-06-06T03:12:05.951 INFO:teuthology.orchestra.run.smithi050.stdout:(95/159): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-06-06T03:12:05.967 INFO:teuthology.orchestra.run.smithi079.stdout:(50/159): bison-3.7.4-5.el9.x86_64.rpm 7.9 MB/s | 943 kB 00:00 2024-06-06T03:12:05.976 INFO:teuthology.orchestra.run.smithi050.stdout:(96/159): qatlib-service-24.02.0-1.el9.x86_64.r 717 kB/s | 36 kB 00:00 2024-06-06T03:12:05.984 INFO:teuthology.orchestra.run.smithi079.stdout:(51/159): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-06-06T03:12:06.001 INFO:teuthology.orchestra.run.smithi050.stdout:(97/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-06-06T03:12:06.009 INFO:teuthology.orchestra.run.smithi079.stdout:(52/159): flex-2.6.4-9.el9.x86_64.rpm 7.3 MB/s | 313 kB 00:00 2024-06-06T03:12:06.043 INFO:teuthology.orchestra.run.smithi050.stdout:(98/159): socat-1.7.4.1-5.el9.x86_64.rpm 4.4 MB/s | 305 kB 00:00 2024-06-06T03:12:06.068 INFO:teuthology.orchestra.run.smithi079.stdout:(53/159): flexiblas-3.0.4-8.el9.x86_64.rpm 391 kB/s | 33 kB 00:00 2024-06-06T03:12:06.068 INFO:teuthology.orchestra.run.smithi050.stdout:(99/159): uuid-1.6.2-55.el9.x86_64.rpm 862 kB/s | 58 kB 00:00 2024-06-06T03:12:06.086 INFO:teuthology.orchestra.run.smithi050.stdout:(100/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 2.2 MB/s | 94 kB 00:00 2024-06-06T03:12:06.102 INFO:teuthology.orchestra.run.smithi079.stdout:(54/159): flexiblas-openblas-openmp-3.0.4-8.el9 544 kB/s | 18 kB 00:00 2024-06-06T03:12:06.111 INFO:teuthology.orchestra.run.smithi050.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-06-06T03:12:06.114 INFO:teuthology.orchestra.run.smithi050.stdout:[MIRROR] lua-devel-5.4.4-4.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/lua-devel-5.4.4-4.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T03:12:06.152 INFO:teuthology.orchestra.run.smithi079.stdout:(55/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 21 MB/s | 3.0 MB 00:00 2024-06-06T03:12:06.153 INFO:teuthology.orchestra.run.smithi050.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 669 kB/s | 45 kB 00:00 2024-06-06T03:12:06.178 INFO:teuthology.orchestra.run.smithi079.stdout:(56/159): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-06-06T03:12:06.178 INFO:teuthology.orchestra.run.smithi050.stdout:(103/159): lua-devel-5.4.4-4.el9.x86_64.rpm 333 kB/s | 22 kB 00:00 2024-06-06T03:12:06.179 INFO:teuthology.orchestra.run.smithi050.stdout:[MIRROR] protobuf-compiler-3.14.0-13.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/protobuf-compiler-3.14.0-13.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T03:12:06.203 INFO:teuthology.orchestra.run.smithi079.stdout:(57/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-06-06T03:12:06.228 INFO:teuthology.orchestra.run.smithi079.stdout:(58/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-06-06T03:12:06.371 INFO:teuthology.orchestra.run.smithi050.stdout:(104/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-06-06T03:12:06.413 INFO:teuthology.orchestra.run.smithi050.stdout:(105/159): abseil-cpp-20211102.0-3.el9.x86_64.r 2.3 MB/s | 548 kB 00:00 2024-06-06T03:12:06.454 INFO:teuthology.orchestra.run.smithi050.stdout:(106/159): protobuf-compiler-3.14.0-13.el9.x86_ 2.8 MB/s | 863 kB 00:00 2024-06-06T03:12:06.480 INFO:teuthology.orchestra.run.smithi050.stdout:(107/159): grpc-data-1.46.7-10.el9.noarch.rpm 291 kB/s | 19 kB 00:00 2024-06-06T03:12:06.538 INFO:teuthology.orchestra.run.smithi050.stdout:(108/159): gperftools-libs-2.9.1-2.el9.x86_64.r 1.8 MB/s | 309 kB 00:00 2024-06-06T03:12:06.563 INFO:teuthology.orchestra.run.smithi050.stdout:(109/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 473 kB/s | 26 kB 00:00 2024-06-06T03:12:06.597 INFO:teuthology.orchestra.run.smithi050.stdout:(110/159): liboath-2.6.7-2.el9.x86_64.rpm 866 kB/s | 49 kB 00:00 2024-06-06T03:12:06.622 INFO:teuthology.orchestra.run.smithi050.stdout:(111/159): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-06-06T03:12:06.656 INFO:teuthology.orchestra.run.smithi050.stdout:(112/159): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-06-06T03:12:06.662 INFO:teuthology.orchestra.run.smithi079.stdout:(59/159): ceph-test-19.0.0-2946.g3d89accf.el9.x 9.8 MB/s | 48 MB 00:04 2024-06-06T03:12:06.687 INFO:teuthology.orchestra.run.smithi079.stdout:(60/159): librdkafka-1.6.1-102.el9.x86_64.rpm 1.3 MB/s | 662 kB 00:00 2024-06-06T03:12:06.720 INFO:teuthology.orchestra.run.smithi079.stdout:(61/159): libtool-2.4.6-45.el9.x86_64.rpm 1.2 MB/s | 582 kB 00:00 2024-06-06T03:12:06.739 INFO:teuthology.orchestra.run.smithi050.stdout:(113/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-06-06T03:12:06.745 INFO:teuthology.orchestra.run.smithi079.stdout:(62/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 305 kB/s | 25 kB 00:00 2024-06-06T03:12:06.771 INFO:teuthology.orchestra.run.smithi079.stdout:(63/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 565 kB/s | 47 kB 00:00 2024-06-06T03:12:06.773 INFO:teuthology.orchestra.run.smithi050.stdout:(114/159): python3-asyncssh-2.13.2-5.el9.noarch 4.6 MB/s | 548 kB 00:00 2024-06-06T03:12:06.796 INFO:teuthology.orchestra.run.smithi079.stdout:(64/159): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-06-06T03:12:06.799 INFO:teuthology.orchestra.run.smithi050.stdout:(115/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 738 kB/s | 43 kB 00:00 2024-06-06T03:12:06.822 INFO:teuthology.orchestra.run.smithi079.stdout:(65/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-06-06T03:12:06.824 INFO:teuthology.orchestra.run.smithi050.stdout:(116/159): python3-cachetools-4.2.4-1.el9.noarc 640 kB/s | 32 kB 00:00 2024-06-06T03:12:06.841 INFO:teuthology.orchestra.run.smithi050.stdout:(117/159): python3-certifi-2021.10.8-2.el9.noar 358 kB/s | 15 kB 00:00 2024-06-06T03:12:06.847 INFO:teuthology.orchestra.run.smithi079.stdout:(66/159): openblas-0.3.21-2.el9.x86_64.rpm 465 kB/s | 35 kB 00:00 2024-06-06T03:12:06.875 INFO:teuthology.orchestra.run.smithi050.stdout:(118/159): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-06-06T03:12:06.900 INFO:teuthology.orchestra.run.smithi050.stdout:(119/159): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-06-06T03:12:06.933 INFO:teuthology.orchestra.run.smithi050.stdout:(120/159): python3-google-auth-2.29.0-1.el9.noa 6.0 MB/s | 206 kB 00:00 2024-06-06T03:12:06.959 INFO:teuthology.orchestra.run.smithi050.stdout:(121/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.5 MB/s | 303 kB 00:00 2024-06-06T03:12:06.964 INFO:teuthology.orchestra.run.smithi079.stdout:(67/159): openblas-openmp-0.3.21-2.el9.x86_64.r 28 MB/s | 4.7 MB 00:00 2024-06-06T03:12:06.992 INFO:teuthology.orchestra.run.smithi050.stdout:(122/159): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-06-06T03:12:07.018 INFO:teuthology.orchestra.run.smithi050.stdout:(123/159): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-06-06T03:12:07.076 INFO:teuthology.orchestra.run.smithi050.stdout:(124/159): libarrow-9.0.0-11.el9.x86_64.rpm 7.1 MB/s | 4.4 MB 00:00 2024-06-06T03:12:07.089 INFO:teuthology.orchestra.run.smithi079.stdout:(68/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-06-06T03:12:07.101 INFO:teuthology.orchestra.run.smithi050.stdout:(125/159): python3-jaraco-classes-3.2.1-5.el9.n 211 kB/s | 18 kB 00:00 2024-06-06T03:12:07.127 INFO:teuthology.orchestra.run.smithi050.stdout:(126/159): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-06-06T03:12:07.131 INFO:teuthology.orchestra.run.smithi079.stdout:(69/159): postgresql-contrib-13.14-1.el9.x86_64 5.3 MB/s | 911 kB 00:00 2024-06-06T03:12:07.152 INFO:teuthology.orchestra.run.smithi050.stdout:(127/159): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-06-06T03:12:07.157 INFO:teuthology.orchestra.run.smithi079.stdout:(70/159): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 133 kB 00:00 2024-06-06T03:12:07.177 INFO:teuthology.orchestra.run.smithi050.stdout:(128/159): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-06-06T03:12:07.211 INFO:teuthology.orchestra.run.smithi050.stdout:(129/159): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-06-06T03:12:07.215 INFO:teuthology.orchestra.run.smithi079.stdout:(71/159): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-06-06T03:12:07.253 INFO:teuthology.orchestra.run.smithi050.stdout:(130/159): python3-grpcio-1.46.7-10.el9.x86_64. 6.4 MB/s | 2.0 MB 00:00 2024-06-06T03:12:07.257 INFO:teuthology.orchestra.run.smithi079.stdout:(72/159): postgresql-13.14-1.el9.x86_64.rpm 3.9 MB/s | 1.6 MB 00:00 2024-06-06T03:12:07.279 INFO:teuthology.orchestra.run.smithi050.stdout:(131/159): python3-more-itertools-8.12.0-2.el9. 1.1 MB/s | 79 kB 00:00 2024-06-06T03:12:07.282 INFO:teuthology.orchestra.run.smithi079.stdout:(73/159): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-06-06T03:12:07.358 INFO:teuthology.orchestra.run.smithi079.stdout:(74/159): postgresql-server-13.14-1.el9.x86_64. 26 MB/s | 5.8 MB 00:00 2024-06-06T03:12:07.383 INFO:teuthology.orchestra.run.smithi079.stdout:(75/159): python3-colorama-0.4.6-3.el9.noarch.r 610 kB/s | 61 kB 00:00 2024-06-06T03:12:07.396 INFO:teuthology.orchestra.run.smithi050.stdout:(132/159): python3-natsort-7.1.1-5.el9.noarch.r 405 kB/s | 58 kB 00:00 2024-06-06T03:12:07.408 INFO:teuthology.orchestra.run.smithi079.stdout:(76/159): python3-devel-3.9.18-3.el9.x86_64.rpm 4.8 MB/s | 244 kB 00:00 2024-06-06T03:12:07.421 INFO:teuthology.orchestra.run.smithi050.stdout:(133/159): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-06-06T03:12:07.433 INFO:teuthology.orchestra.run.smithi079.stdout:(77/159): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-06-06T03:12:07.446 INFO:teuthology.orchestra.run.smithi050.stdout:(134/159): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-06-06T03:12:07.459 INFO:teuthology.orchestra.run.smithi079.stdout:(78/159): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-06-06T03:12:07.480 INFO:teuthology.orchestra.run.smithi050.stdout:(135/159): python3-kubernetes-26.1.0-2.el9.noar 3.1 MB/s | 1.0 MB 00:00 2024-06-06T03:12:07.485 INFO:teuthology.orchestra.run.smithi079.stdout:(79/159): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-06-06T03:12:07.505 INFO:teuthology.orchestra.run.smithi050.stdout:(136/159): python3-pyperclip-1.8.2-2.el9.noarch 482 kB/s | 28 kB 00:00 2024-06-06T03:12:07.509 INFO:teuthology.orchestra.run.smithi079.stdout:(80/159): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-06-06T03:12:07.530 INFO:teuthology.orchestra.run.smithi050.stdout:(137/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-06-06T03:12:07.535 INFO:teuthology.orchestra.run.smithi079.stdout:(81/159): python3-markupsafe-1.1.1-12.el9.x86_6 703 kB/s | 35 kB 00:00 2024-06-06T03:12:07.556 INFO:teuthology.orchestra.run.smithi050.stdout:(138/159): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-06-06T03:12:07.577 INFO:teuthology.orchestra.run.smithi079.stdout:(82/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.9 MB/s | 250 kB 00:00 2024-06-06T03:12:07.581 INFO:teuthology.orchestra.run.smithi050.stdout:(139/159): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-06-06T03:12:07.607 INFO:teuthology.orchestra.run.smithi050.stdout:(140/159): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-06-06T03:12:07.607 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-06-06T03:12:07.608 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-06-06T03:12:07.632 INFO:teuthology.orchestra.run.smithi050.stdout:(141/159): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-06-06T03:12:07.649 INFO:teuthology.orchestra.run.smithi050.stdout:(142/159): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-06-06T03:12:07.661 INFO:teuthology.orchestra.run.smithi079.stdout:(83/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 5.1 MB 00:00 2024-06-06T03:12:07.674 INFO:teuthology.orchestra.run.smithi050.stdout:(143/159): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-06-06T03:12:07.686 INFO:teuthology.orchestra.run.smithi079.stdout:(84/159): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-06-06T03:12:07.699 INFO:teuthology.orchestra.run.smithi050.stdout:(144/159): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-06-06T03:12:07.711 INFO:teuthology.orchestra.run.smithi079.stdout:(85/159): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-06-06T03:12:07.724 INFO:teuthology.orchestra.run.smithi050.stdout:(145/159): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-06-06T03:12:07.736 INFO:teuthology.orchestra.run.smithi079.stdout:(86/159): python3-prettytable-0.7.2-27.el9.noar 842 kB/s | 42 kB 00:00 2024-06-06T03:12:07.750 INFO:teuthology.orchestra.run.smithi050.stdout:(146/159): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-06-06T03:12:07.761 INFO:teuthology.orchestra.run.smithi079.stdout:(87/159): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-06-06T03:12:07.775 INFO:teuthology.orchestra.run.smithi050.stdout:(147/159): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-06-06T03:12:07.787 INFO:teuthology.orchestra.run.smithi079.stdout:(88/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-06-06T03:12:07.820 INFO:teuthology.orchestra.run.smithi079.stdout:(89/159): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-06-06T03:12:07.833 INFO:teuthology.orchestra.run.smithi050.stdout:(148/159): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-06-06T03:12:07.846 INFO:teuthology.orchestra.run.smithi079.stdout:(90/159): python3-pytz-2021.1-5.el9.noarch.rpm 871 kB/s | 51 kB 00:00 2024-06-06T03:12:07.921 INFO:teuthology.orchestra.run.smithi079.stdout:(91/159): python3-babel-2.9.1-2.el9.noarch.rpm 9.0 MB/s | 6.0 MB 00:00 2024-06-06T03:12:07.946 INFO:teuthology.orchestra.run.smithi079.stdout:(92/159): python3-requests-oauthlib-1.3.0-12.el 427 kB/s | 54 kB 00:00 2024-06-06T03:12:07.980 INFO:teuthology.orchestra.run.smithi079.stdout:(93/159): python3-toml-0.10.2-6.el9.noarch.rpm 710 kB/s | 42 kB 00:00 2024-06-06T03:12:08.005 INFO:teuthology.orchestra.run.smithi079.stdout:(94/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 752 kB/s | 44 kB 00:00 2024-06-06T03:12:08.031 INFO:teuthology.orchestra.run.smithi079.stdout:(95/159): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-06-06T03:12:08.042 INFO:teuthology.orchestra.run.smithi050.stdout:(149/159): NetworkManager-1.47.91-1.el9.x86_64. 11 MB/s | 2.3 MB 00:00 2024-06-06T03:12:08.048 INFO:teuthology.orchestra.run.smithi079.stdout:(96/159): qatlib-service-24.02.0-1.el9.x86_64.r 857 kB/s | 36 kB 00:00 2024-06-06T03:12:08.064 INFO:teuthology.orchestra.run.smithi079.stdout:(97/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-06-06T03:12:08.090 INFO:teuthology.orchestra.run.smithi079.stdout:(98/159): socat-1.7.4.1-5.el9.x86_64.rpm 7.1 MB/s | 305 kB 00:00 2024-06-06T03:12:08.107 INFO:teuthology.orchestra.run.smithi079.stdout:(99/159): uuid-1.6.2-55.el9.x86_64.rpm 1.3 MB/s | 58 kB 00:00 2024-06-06T03:12:08.132 INFO:teuthology.orchestra.run.smithi079.stdout:(100/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 2.2 MB/s | 94 kB 00:00 2024-06-06T03:12:08.149 INFO:teuthology.orchestra.run.smithi079.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-06-06T03:12:08.166 INFO:teuthology.orchestra.run.smithi079.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-06-06T03:12:08.167 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] lua-devel-5.4.4-4.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/lua-devel-5.4.4-4.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T03:12:08.169 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] protobuf-compiler-3.14.0-13.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/protobuf-compiler-3.14.0-13.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T03:12:08.176 INFO:teuthology.orchestra.run.smithi050.stdout:(150/159): librbd1-19.0.0-2946.g3d89accf.el9.x8 7.8 MB/s | 3.1 MB 00:00 2024-06-06T03:12:08.250 INFO:teuthology.orchestra.run.smithi079.stdout:(103/159): lua-devel-5.4.4-4.el9.x86_64.rpm 222 kB/s | 22 kB 00:00 2024-06-06T03:12:08.293 INFO:teuthology.orchestra.run.smithi050.stdout:(151/159): NetworkManager-libnm-1.47.91-1.el9.x 7.2 MB/s | 1.8 MB 00:00 2024-06-06T03:12:08.368 INFO:teuthology.orchestra.run.smithi050.stdout:(152/159): librados2-19.0.0-2946.g3d89accf.el9. 5.5 MB/s | 3.4 MB 00:00 2024-06-06T03:12:08.393 INFO:teuthology.orchestra.run.smithi050.stdout:(153/159): NetworkManager-tui-1.47.91-1.el9.x86 2.4 MB/s | 248 kB 00:00 2024-06-06T03:12:08.418 INFO:teuthology.orchestra.run.smithi050.stdout:(154/159): NetworkManager-team-1.47.91-1.el9.x8 171 kB/s | 41 kB 00:00 2024-06-06T03:12:08.433 INFO:teuthology.orchestra.run.smithi079.stdout:(104/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-06-06T03:12:08.435 INFO:teuthology.orchestra.run.smithi050.stdout:(155/159): elfutils-debuginfod-client-0.191-4.e 547 kB/s | 37 kB 00:00 2024-06-06T03:12:08.461 INFO:teuthology.orchestra.run.smithi050.stdout:(156/159): elfutils-libelf-0.191-4.el9.x86_64.r 3.0 MB/s | 207 kB 00:00 2024-06-06T03:12:08.492 INFO:teuthology.orchestra.run.smithi079.stdout:(105/159): abseil-cpp-20211102.0-3.el9.x86_64.r 2.2 MB/s | 548 kB 00:00 2024-06-06T03:12:08.517 INFO:teuthology.orchestra.run.smithi079.stdout:(106/159): grpc-data-1.46.7-10.el9.noarch.rpm 865 kB/s | 19 kB 00:00 2024-06-06T03:12:08.528 INFO:teuthology.orchestra.run.smithi050.stdout:(157/159): elfutils-libs-0.191-4.el9.x86_64.rpm 2.3 MB/s | 260 kB 00:00 2024-06-06T03:12:08.542 INFO:teuthology.orchestra.run.smithi079.stdout:(107/159): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-06-06T03:12:08.595 INFO:teuthology.orchestra.run.smithi050.stdout:(158/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 18 MB/s | 2.4 MB 00:00 2024-06-06T03:12:08.601 INFO:teuthology.orchestra.run.smithi079.stdout:(108/159): gperftools-libs-2.9.1-2.el9.x86_64.r 1.8 MB/s | 309 kB 00:00 2024-06-06T03:12:08.626 INFO:teuthology.orchestra.run.smithi079.stdout:(109/159): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-06-06T03:12:08.636 INFO:teuthology.orchestra.run.smithi050.stdout:(159/159): openssl-3.2.1-1.el9.x86_64.rpm 6.7 MB/s | 1.3 MB 00:00 2024-06-06T03:12:08.643 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-06-06T03:12:08.643 INFO:teuthology.orchestra.run.smithi050.stdout:Total 13 MB/s | 225 MB 00:17 2024-06-06T03:12:08.651 INFO:teuthology.orchestra.run.smithi079.stdout:(110/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 239 kB/s | 26 kB 00:00 2024-06-06T03:12:08.677 INFO:teuthology.orchestra.run.smithi079.stdout:(111/159): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-06-06T03:12:08.710 INFO:teuthology.orchestra.run.smithi079.stdout:(112/159): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-06-06T03:12:08.752 INFO:teuthology.orchestra.run.smithi079.stdout:(113/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-06-06T03:12:08.777 INFO:teuthology.orchestra.run.smithi079.stdout:(114/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-06-06T03:12:08.803 INFO:teuthology.orchestra.run.smithi079.stdout:(115/159): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-06-06T03:12:08.828 INFO:teuthology.orchestra.run.smithi079.stdout:(116/159): python3-certifi-2021.10.8-2.el9.noar 602 kB/s | 15 kB 00:00 2024-06-06T03:12:08.853 INFO:teuthology.orchestra.run.smithi079.stdout:(117/159): python3-asyncssh-2.13.2-5.el9.noarch 3.8 MB/s | 548 kB 00:00 2024-06-06T03:12:08.879 INFO:teuthology.orchestra.run.smithi079.stdout:(118/159): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-06-06T03:12:08.921 INFO:teuthology.orchestra.run.smithi079.stdout:(119/159): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-06-06T03:12:08.954 INFO:teuthology.orchestra.run.smithi079.stdout:(120/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-06-06T03:12:08.988 INFO:teuthology.orchestra.run.smithi079.stdout:(121/159): python3-google-auth-2.29.0-1.el9.noa 3.0 MB/s | 206 kB 00:00 2024-06-06T03:12:09.055 INFO:teuthology.orchestra.run.smithi079.stdout:(122/159): libarrow-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 4.4 MB 00:00 2024-06-06T03:12:09.080 INFO:teuthology.orchestra.run.smithi079.stdout:(123/159): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-06-06T03:12:09.106 INFO:teuthology.orchestra.run.smithi079.stdout:(124/159): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-06-06T03:12:09.131 INFO:teuthology.orchestra.run.smithi079.stdout:(125/159): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-06-06T03:12:09.156 INFO:teuthology.orchestra.run.smithi079.stdout:(126/159): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-06-06T03:12:09.182 INFO:teuthology.orchestra.run.smithi079.stdout:(127/159): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-06-06T03:12:09.207 INFO:teuthology.orchestra.run.smithi079.stdout:(128/159): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-06-06T03:12:09.232 INFO:teuthology.orchestra.run.smithi079.stdout:(129/159): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-06-06T03:12:09.257 INFO:teuthology.orchestra.run.smithi079.stdout:(130/159): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-06-06T03:12:09.283 INFO:teuthology.orchestra.run.smithi079.stdout:(131/159): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-06-06T03:12:09.316 INFO:teuthology.orchestra.run.smithi079.stdout:(132/159): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-06-06T03:12:09.350 INFO:teuthology.orchestra.run.smithi079.stdout:(133/159): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-06-06T03:12:09.375 INFO:teuthology.orchestra.run.smithi079.stdout:(134/159): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-06-06T03:12:09.400 INFO:teuthology.orchestra.run.smithi079.stdout:(135/159): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-06-06T03:12:09.426 INFO:teuthology.orchestra.run.smithi079.stdout:(136/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-06-06T03:12:09.451 INFO:teuthology.orchestra.run.smithi079.stdout:(137/159): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-06-06T03:12:09.476 INFO:teuthology.orchestra.run.smithi079.stdout:(138/159): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-06-06T03:12:09.493 INFO:teuthology.orchestra.run.smithi079.stdout:(139/159): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-06-06T03:12:09.510 INFO:teuthology.orchestra.run.smithi079.stdout:(140/159): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-06-06T03:12:09.527 INFO:teuthology.orchestra.run.smithi079.stdout:(141/159): python3-typing-extensions-4.4.0-2.el 1.5 MB/s | 51 kB 00:00 2024-06-06T03:12:09.569 INFO:teuthology.orchestra.run.smithi079.stdout:(142/159): python3-grpcio-1.46.7-10.el9.x86_64. 3.3 MB/s | 2.0 MB 00:00 2024-06-06T03:12:09.595 INFO:teuthology.orchestra.run.smithi079.stdout:(143/159): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-06-06T03:12:09.620 INFO:teuthology.orchestra.run.smithi079.stdout:(144/159): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-06-06T03:12:09.645 INFO:teuthology.orchestra.run.smithi079.stdout:(145/159): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-06-06T03:12:09.670 INFO:teuthology.orchestra.run.smithi079.stdout:(146/159): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-06-06T03:12:09.696 INFO:teuthology.orchestra.run.smithi079.stdout:(147/159): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-06-06T03:12:09.746 INFO:teuthology.orchestra.run.smithi079.stdout:(148/159): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-06-06T03:12:09.873 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2024-06-06T03:12:09.890 INFO:teuthology.orchestra.run.smithi079.stdout:(149/159): NetworkManager-1.47.91-1.el9.x86_64. 16 MB/s | 2.3 MB 00:00 2024-06-06T03:12:09.955 INFO:teuthology.orchestra.run.smithi079.stdout:(150/159): NetworkManager-libnm-1.47.91-1.el9.x 27 MB/s | 1.8 MB 00:00 2024-06-06T03:12:10.005 INFO:teuthology.orchestra.run.smithi079.stdout:(151/159): NetworkManager-team-1.47.91-1.el9.x8 829 kB/s | 41 kB 00:00 2024-06-06T03:12:10.047 INFO:teuthology.orchestra.run.smithi079.stdout:(152/159): NetworkManager-tui-1.47.91-1.el9.x86 5.8 MB/s | 248 kB 00:00 2024-06-06T03:12:10.049 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2024-06-06T03:12:10.050 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2024-06-06T03:12:10.089 INFO:teuthology.orchestra.run.smithi079.stdout:(153/159): elfutils-debuginfod-client-0.191-4.e 886 kB/s | 37 kB 00:00 2024-06-06T03:12:10.140 INFO:teuthology.orchestra.run.smithi079.stdout:(154/159): librbd1-19.0.0-2946.g3d89accf.el9.x8 7.1 MB/s | 3.1 MB 00:00 2024-06-06T03:12:10.165 INFO:teuthology.orchestra.run.smithi079.stdout:(155/159): elfutils-libelf-0.191-4.el9.x86_64.r 2.7 MB/s | 207 kB 00:00 2024-06-06T03:12:10.223 INFO:teuthology.orchestra.run.smithi079.stdout:(156/159): openssl-3.2.1-1.el9.x86_64.rpm 23 MB/s | 1.3 MB 00:00 2024-06-06T03:12:10.265 INFO:teuthology.orchestra.run.smithi079.stdout:(157/159): elfutils-libs-0.191-4.el9.x86_64.rpm 2.0 MB/s | 260 kB 00:00 2024-06-06T03:12:10.316 INFO:teuthology.orchestra.run.smithi079.stdout:(158/159): librados2-19.0.0-2946.g3d89accf.el9. 5.3 MB/s | 3.4 MB 00:00 2024-06-06T03:12:10.366 INFO:teuthology.orchestra.run.smithi079.stdout:(159/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 17 MB/s | 2.4 MB 00:00 2024-06-06T03:12:10.372 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-06-06T03:12:10.372 INFO:teuthology.orchestra.run.smithi079.stdout:Total 19 MB/s | 225 MB 00:12 2024-06-06T03:12:11.615 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-06-06T03:12:11.772 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-06-06T03:12:11.773 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-06-06T03:12:12.273 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2024-06-06T03:12:12.273 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2024-06-06T03:12:13.871 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-06-06T03:12:13.914 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-06-06T03:12:13.914 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-06-06T03:12:13.950 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-06-06T03:12:13.988 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-06-06T03:12:14.058 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-06-06T03:12:14.101 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-06-06T03:12:14.127 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-06-06T03:12:14.173 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-06-06T03:12:14.521 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-06-06T03:12:14.637 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-06T03:12:14.758 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-06T03:12:14.788 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-06T03:12:14.879 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-06T03:12:14.910 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-06T03:12:14.948 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-06-06T03:12:15.129 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-06-06T03:12:15.183 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-06-06T03:12:15.211 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-06T03:12:15.299 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-06T03:12:15.329 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-06T03:12:15.391 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-06T03:12:15.413 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-06T03:12:15.437 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-06T03:12:15.631 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-06T03:12:15.807 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-06T03:12:15.969 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-06T03:12:16.013 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-06T03:12:16.116 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-06T03:12:16.190 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-06T03:12:16.388 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-06T03:12:16.498 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-06-06T03:12:16.589 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-06-06T03:12:16.637 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-06-06T03:12:16.680 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-06-06T03:12:16.744 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-06-06T03:12:16.780 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-06-06T03:12:16.823 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-06-06T03:12:16.856 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-06-06T03:12:16.884 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-06-06T03:12:16.952 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-06-06T03:12:17.006 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-06-06T03:12:17.037 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-06-06T03:12:17.080 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-06-06T03:12:17.156 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-06-06T03:12:17.192 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 34/170 2024-06-06T03:12:17.235 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 35/170 2024-06-06T03:12:17.263 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 36/170 2024-06-06T03:12:17.341 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-06-06T03:12:17.387 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-06-06T03:12:17.460 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-06-06T03:12:17.593 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-06-06T03:12:17.648 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-06-06T03:12:18.175 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-06-06T03:12:18.252 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-06-06T03:12:18.281 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-06-06T03:12:18.343 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-06-06T03:12:18.384 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-06-06T03:12:18.422 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 47/170 2024-06-06T03:12:18.463 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-06-06T03:12:18.622 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-06-06T03:12:18.675 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-06-06T03:12:18.729 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-06-06T03:12:18.802 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-06-06T03:12:18.836 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-06-06T03:12:18.872 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-06-06T03:12:18.916 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2024-06-06T03:12:18.919 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-06-06T03:12:18.955 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-06-06T03:12:18.992 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-06-06T03:12:18.998 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-06-06T03:12:19.030 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-06-06T03:12:19.048 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-06-06T03:12:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-06-06T03:12:19.126 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-06-06T03:12:19.151 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-06-06T03:12:19.184 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-06-06T03:12:19.209 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-06-06T03:12:19.225 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-06-06T03:12:19.266 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-06-06T03:12:19.360 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-06-06T03:12:19.552 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-06-06T03:12:19.570 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-06-06T03:12:19.610 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-06-06T03:12:19.641 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-06-06T03:12:19.652 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-06T03:12:19.666 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-06-06T03:12:19.757 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-06-06T03:12:19.786 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-06T03:12:19.884 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-06-06T03:12:19.928 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-06T03:12:19.931 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-06-06T03:12:19.959 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-06-06T03:12:19.993 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-06-06T03:12:20.024 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-06T03:12:20.032 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-06-06T03:12:20.050 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-06T03:12:20.072 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-06-06T03:12:20.089 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-06-06T03:12:20.102 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-06-06T03:12:20.128 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-06-06T03:12:20.162 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-06-06T03:12:20.203 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-06-06T03:12:20.238 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-06-06T03:12:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-06-06T03:12:20.286 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-06-06T03:12:20.323 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-06-06T03:12:20.348 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-06-06T03:12:20.353 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-06-06T03:12:20.371 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-06-06T03:12:20.375 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-06T03:12:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-06-06T03:12:20.407 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-06-06T03:12:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-06-06T03:12:20.454 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-06-06T03:12:20.481 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-06T03:12:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-06-06T03:12:20.509 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-06T03:12:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-06-06T03:12:20.560 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-06-06T03:12:20.560 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-06-06T03:12:20.572 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-06T03:12:20.594 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-06T03:12:20.608 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-06-06T03:12:20.620 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-06T03:12:20.840 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-06T03:12:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-06-06T03:12:21.016 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-06T03:12:21.046 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-06T03:12:21.158 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-06T03:12:21.169 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-06T03:12:21.197 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-06T03:12:21.218 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-06T03:12:21.289 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-06T03:12:21.319 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-06T03:12:21.325 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-06-06T03:12:21.326 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-06T03:12:21.359 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-06-06T03:12:21.373 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-06-06T03:12:21.394 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-06T03:12:21.407 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-06-06T03:12:21.504 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-06-06T03:12:21.553 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-06-06T03:12:21.557 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-06-06T03:12:21.598 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-06-06T03:12:21.604 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-06T03:12:21.609 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-06-06T03:12:21.636 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-06T03:12:21.684 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-06-06T03:12:21.726 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-06-06T03:12:21.741 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-06-06T03:12:21.742 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-06T03:12:21.764 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-06T03:12:21.827 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-06T03:12:21.842 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-06-06T03:12:21.848 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-06T03:12:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-06T03:12:21.876 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-06-06T03:12:21.906 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-06-06T03:12:21.911 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-06-06T03:12:21.932 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-06-06T03:12:21.987 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-06-06T03:12:22.015 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-06-06T03:12:22.026 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-06-06T03:12:22.057 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-06T03:12:22.070 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-06-06T03:12:22.103 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-06-06T03:12:22.130 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-06-06T03:12:22.230 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-06T03:12:22.290 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-06-06T03:12:22.387 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-06T03:12:22.447 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-06T03:12:22.533 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-06-06T03:12:22.544 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-06T03:12:22.566 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-06-06T03:12:22.610 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-06-06T03:12:22.624 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-06T03:12:22.650 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-06-06T03:12:22.689 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-06-06T03:12:22.721 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 34/170 2024-06-06T03:12:22.763 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-06-06T03:12:22.764 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 35/170 2024-06-06T03:12:22.792 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 36/170 2024-06-06T03:12:22.849 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-06T03:12:22.857 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-06-06T03:12:22.907 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-06-06T03:12:22.960 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-06-06T03:12:22.984 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-06-06T03:12:23.052 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-06-06T03:12:23.105 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-06-06T03:12:23.122 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-06-06T03:12:23.140 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-06-06T03:12:23.177 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-06-06T03:12:23.214 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-06-06T03:12:23.266 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-06-06T03:12:23.309 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-06-06T03:12:23.342 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-06-06T03:12:23.369 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-06-06T03:12:23.440 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-06-06T03:12:23.493 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-06-06T03:12:23.524 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-06-06T03:12:23.567 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-06-06T03:12:23.642 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-06-06T03:12:23.686 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 34/170 2024-06-06T03:12:23.729 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 35/170 2024-06-06T03:12:23.736 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-06-06T03:12:23.758 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 36/170 2024-06-06T03:12:23.829 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-06-06T03:12:23.834 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-06-06T03:12:23.867 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-06-06T03:12:23.914 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-06-06T03:12:23.939 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-06-06T03:12:23.957 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-06-06T03:12:23.992 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 47/170 2024-06-06T03:12:24.011 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-06-06T03:12:24.014 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-06-06T03:12:24.033 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-06-06T03:12:24.149 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-06-06T03:12:24.209 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-06-06T03:12:24.290 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-06-06T03:12:24.303 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-06-06T03:12:24.361 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-06-06T03:12:24.427 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-06-06T03:12:24.440 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-06-06T03:12:24.502 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-06-06T03:12:24.538 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-06-06T03:12:24.575 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-06-06T03:12:24.589 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-06-06T03:12:24.623 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-06-06T03:12:24.658 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-06-06T03:12:24.702 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-06-06T03:12:24.741 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-06-06T03:12:24.743 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-06-06T03:12:24.838 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-06-06T03:12:24.875 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-06-06T03:12:24.886 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-06-06T03:12:24.901 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-06-06T03:12:24.937 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-06-06T03:12:24.946 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-06-06T03:12:24.948 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-06T03:12:24.987 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-06-06T03:12:25.042 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-06T03:12:25.073 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 104/170 2024-06-06T03:12:25.086 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-06-06T03:12:25.109 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-06-06T03:12:25.120 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-06-06T03:12:25.167 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-06-06T03:12:25.174 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-06-06T03:12:25.193 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-06-06T03:12:25.218 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-06-06T03:12:25.309 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-06-06T03:12:25.349 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 47/170 2024-06-06T03:12:25.391 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-06-06T03:12:25.443 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-06-06T03:12:25.476 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-06-06T03:12:25.513 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-06-06T03:12:25.556 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-06-06T03:12:25.581 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-06-06T03:12:25.594 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-06-06T03:12:25.613 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-06T03:12:25.634 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-06-06T03:12:25.664 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-06-06T03:12:25.684 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-06T03:12:25.699 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-06-06T03:12:25.715 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 108/170 2024-06-06T03:12:25.732 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-06-06T03:12:25.769 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-06-06T03:12:25.774 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-06-06T03:12:25.808 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-06-06T03:12:25.818 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-06-06T03:12:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-06-06T03:12:25.899 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-06-06T03:12:25.947 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-06-06T03:12:25.956 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-06-06T03:12:25.985 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-06-06T03:12:25.986 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-06-06T03:12:26.021 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-06-06T03:12:26.034 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-06-06T03:12:26.068 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-06-06T03:12:26.104 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-06-06T03:12:26.147 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-06-06T03:12:26.147 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-06-06T03:12:26.198 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-06-06T03:12:26.199 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-06-06T03:12:26.334 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-06-06T03:12:26.374 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-06-06T03:12:26.416 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-06-06T03:12:26.510 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-06-06T03:12:26.574 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-06-06T03:12:26.625 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-06-06T03:12:26.656 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-06-06T03:12:26.681 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-06-06T03:12:26.777 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-06-06T03:12:26.907 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-06-06T03:12:26.947 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-06-06T03:12:26.960 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-06-06T03:12:26.974 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-06-06T03:12:27.011 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-06-06T03:12:27.018 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-06-06T03:12:27.044 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-06-06T03:12:27.056 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-06-06T03:12:27.088 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-06-06T03:12:27.118 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-06-06T03:12:27.148 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-06-06T03:12:27.152 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-06-06T03:12:27.186 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-06-06T03:12:27.201 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-06-06T03:12:27.227 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-06-06T03:12:27.245 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-06-06T03:12:27.262 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-06-06T03:12:27.337 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-06-06T03:12:27.349 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-06-06T03:12:27.372 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-06-06T03:12:27.395 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-06-06T03:12:27.432 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-06-06T03:12:27.498 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-06-06T03:12:27.549 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-06-06T03:12:27.578 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-06-06T03:12:27.611 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-06-06T03:12:27.663 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-06-06T03:12:27.684 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-06-06T03:12:27.987 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-06T03:12:28.028 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-06T03:12:28.357 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-06-06T03:12:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-06-06T03:12:28.464 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-06-06T03:12:28.481 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-06-06T03:12:28.498 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-06-06T03:12:28.572 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-06T03:12:28.599 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-06-06T03:12:28.606 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-06T03:12:28.645 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-06-06T03:12:28.690 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-06-06T03:12:28.699 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-06T03:12:28.699 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-06T03:12:28.699 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-06T03:12:28.699 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-06-06T03:12:28.732 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-06T03:12:28.779 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-06-06T03:12:28.817 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-06-06T03:12:28.996 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-06-06T03:12:29.032 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-06-06T03:12:29.115 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-06-06T03:12:29.783 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-06-06T03:12:29.819 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-06-06T03:12:29.900 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-06-06T03:12:29.906 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-06-06T03:12:29.930 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-06-06T03:12:29.963 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-06-06T03:12:30.297 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-06-06T03:12:30.342 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-06T03:12:30.435 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-06T03:12:30.464 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 104/170 2024-06-06T03:12:30.501 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-06-06T03:12:31.001 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-06-06T03:12:31.029 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-06T03:12:31.100 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-06T03:12:31.131 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 108/170 2024-06-06T03:12:31.170 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-06-06T03:12:31.270 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-06-06T03:12:31.297 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-06-06T03:12:31.330 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-06-06T03:12:31.647 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-06-06T03:12:31.693 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-06T03:12:31.784 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-06T03:12:31.815 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 104/170 2024-06-06T03:12:31.851 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-06-06T03:12:32.331 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-06-06T03:12:32.371 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-06T03:12:32.426 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-06T03:12:32.456 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 108/170 2024-06-06T03:12:33.520 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-06T03:12:33.553 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-06T03:12:34.133 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-06T03:12:34.173 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-06T03:12:34.265 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-06T03:12:34.265 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-06T03:12:34.265 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-06T03:12:34.265 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:12:34.299 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-06T03:12:34.761 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-06T03:12:34.803 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-06T03:12:35.363 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-06T03:12:35.406 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-06T03:12:35.511 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-06T03:12:35.511 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-06T03:12:35.511 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-06T03:12:35.511 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-06T03:12:35.557 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-06T03:12:40.577 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-06T03:12:40.578 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /sys 2024-06-06T03:12:40.578 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /proc 2024-06-06T03:12:40.578 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /mnt 2024-06-06T03:12:40.578 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /var/tmp 2024-06-06T03:12:40.578 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /home 2024-06-06T03:12:40.578 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /root 2024-06-06T03:12:40.578 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /tmp 2024-06-06T03:12:40.578 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-06-06T03:12:40.737 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-06T03:12:40.753 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-06T03:12:40.753 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T03:12:40.753 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-06T03:12:40.753 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-06-06T03:12:42.232 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-06T03:12:42.258 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-06T03:12:42.259 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T03:12:42.259 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-06T03:12:42.259 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-06T03:12:42.259 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-06T03:12:42.259 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-06-06T03:12:42.500 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-06T03:12:42.523 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-06T03:12:42.523 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T03:12:42.523 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-06T03:12:42.523 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-06T03:12:42.523 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-06T03:12:42.524 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-06-06T03:12:42.977 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-06T03:12:43.000 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-06T03:12:43.000 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T03:12:43.000 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-06T03:12:43.000 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-06T03:12:43.000 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-06T03:12:43.000 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-06-06T03:12:43.114 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-06-06T03:12:43.163 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-06-06T03:12:43.219 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-06-06T03:12:43.402 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-06-06T03:12:43.452 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-06-06T03:12:43.529 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-06-06T03:12:43.620 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-06-06T03:12:43.758 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-06-06T03:12:43.802 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-06-06T03:12:43.834 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-06-06T03:12:43.862 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-06-06T03:12:44.324 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-06T03:12:44.352 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-06T03:12:44.384 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 128/170 2024-06-06T03:12:44.446 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 129/170 2024-06-06T03:12:44.475 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-06T03:12:45.498 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-06T03:12:45.527 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-06T03:12:46.470 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-06T03:12:46.471 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /sys 2024-06-06T03:12:46.471 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /proc 2024-06-06T03:12:46.471 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /mnt 2024-06-06T03:12:46.471 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /var/tmp 2024-06-06T03:12:46.471 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /home 2024-06-06T03:12:46.471 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /root 2024-06-06T03:12:46.471 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /tmp 2024-06-06T03:12:46.471 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:12:46.494 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-06T03:12:46.519 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-06T03:12:46.620 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-06T03:12:46.641 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-06T03:12:46.657 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-06T03:12:46.657 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T03:12:46.657 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-06T03:12:46.657 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:12:46.798 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 133/170 2024-06-06T03:12:46.830 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-06T03:12:46.853 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-06T03:12:46.853 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T03:12:46.854 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-06T03:12:46.854 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-06T03:12:46.854 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-06T03:12:46.854 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-06-06T03:12:46.897 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-06T03:12:46.909 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-06T03:12:47.005 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 136/170 2024-06-06T03:12:47.055 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 137/170 2024-06-06T03:12:47.561 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-06T03:12:47.561 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /sys 2024-06-06T03:12:47.561 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /proc 2024-06-06T03:12:47.561 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /mnt 2024-06-06T03:12:47.561 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /var/tmp 2024-06-06T03:12:47.561 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /home 2024-06-06T03:12:47.561 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /root 2024-06-06T03:12:47.561 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /tmp 2024-06-06T03:12:47.561 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-06T03:12:47.721 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-06T03:12:47.737 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-06T03:12:47.737 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T03:12:47.737 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-06T03:12:47.737 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-06T03:12:47.949 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-06-06T03:12:47.991 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-06T03:12:48.013 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-06T03:12:48.014 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T03:12:48.014 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-06T03:12:48.014 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-06T03:12:48.014 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-06T03:12:48.014 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-06-06T03:12:48.058 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-06T03:12:48.081 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-06T03:12:48.081 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T03:12:48.081 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-06T03:12:48.081 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-06-06T03:12:48.134 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-06T03:12:48.157 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-06T03:12:48.157 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T03:12:48.157 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-06-06T03:12:48.157 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-06T03:12:48.157 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-06T03:12:48.157 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-06-06T03:12:48.202 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-06T03:12:48.229 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-06T03:12:48.230 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T03:12:48.230 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-06T03:12:48.230 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-06T03:12:48.230 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-06T03:12:48.230 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:12:48.459 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-06T03:12:48.461 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-06T03:12:48.482 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-06T03:12:48.482 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T03:12:48.483 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-06T03:12:48.483 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-06T03:12:48.483 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-06T03:12:48.483 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-06-06T03:12:48.486 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-06T03:12:48.486 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T03:12:48.486 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-06T03:12:48.486 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-06T03:12:48.486 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-06T03:12:48.486 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:12:48.954 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-06T03:12:48.978 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-06T03:12:48.978 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T03:12:48.978 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-06T03:12:48.978 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-06T03:12:48.978 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-06T03:12:48.979 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:12:49.093 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-06-06T03:12:49.151 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-06-06T03:12:49.216 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-06-06T03:12:49.233 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-06T03:12:49.260 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-06T03:12:49.260 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T03:12:49.260 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-06T03:12:49.260 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-06T03:12:49.260 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-06T03:12:49.261 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-06T03:12:49.412 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-06-06T03:12:49.464 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-06-06T03:12:49.484 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-06T03:12:49.507 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-06T03:12:49.507 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T03:12:49.507 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-06T03:12:49.507 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-06T03:12:49.507 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-06T03:12:49.507 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-06T03:12:49.545 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-06-06T03:12:49.643 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-06-06T03:12:49.787 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-06-06T03:12:49.840 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-06-06T03:12:49.871 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-06-06T03:12:49.898 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-06-06T03:12:49.951 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-06T03:12:49.974 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-06T03:12:49.975 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T03:12:49.975 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-06T03:12:49.975 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-06T03:12:49.975 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-06T03:12:49.975 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-06T03:12:50.090 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-06-06T03:12:50.147 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-06-06T03:12:50.203 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-06-06T03:12:50.263 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-06T03:12:50.289 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-06T03:12:50.321 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 128/170 2024-06-06T03:12:50.385 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 129/170 2024-06-06T03:12:50.388 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-06-06T03:12:50.412 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-06T03:12:50.435 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-06-06T03:12:50.514 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-06-06T03:12:50.603 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-06-06T03:12:50.743 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-06-06T03:12:50.785 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-06-06T03:12:50.817 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-06-06T03:12:50.845 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-06-06T03:12:51.291 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-06T03:12:51.319 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-06T03:12:51.350 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 128/170 2024-06-06T03:12:51.412 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 129/170 2024-06-06T03:12:51.442 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-06T03:12:51.501 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-06T03:12:51.530 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-06T03:12:52.475 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-06T03:12:52.510 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-06T03:12:52.550 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-06T03:12:52.573 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-06T03:12:52.679 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-06T03:12:52.860 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 133/170 2024-06-06T03:12:52.891 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-06T03:12:52.916 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-06T03:12:52.916 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T03:12:52.916 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-06T03:12:52.916 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-06T03:12:52.916 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-06T03:12:52.916 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:12:52.967 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-06T03:12:52.979 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-06T03:12:53.038 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 143/170 2024-06-06T03:12:53.079 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 144/170 2024-06-06T03:12:53.080 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 136/170 2024-06-06T03:12:53.120 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 145/170 2024-06-06T03:12:53.136 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 137/170 2024-06-06T03:12:53.152 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-06-06T03:12:53.179 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-06-06T03:12:53.365 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 148/170 2024-06-06T03:12:53.408 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-06-06T03:12:53.451 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 150/170 2024-06-06T03:12:53.472 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-06T03:12:53.482 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-06-06T03:12:53.502 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-06T03:12:53.512 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 152/170 2024-06-06T03:12:53.558 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 153/170 2024-06-06T03:12:53.604 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-06T03:12:53.765 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 133/170 2024-06-06T03:12:53.788 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-06T03:12:53.812 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-06T03:12:53.812 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T03:12:53.812 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-06T03:12:53.812 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-06T03:12:53.812 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-06T03:12:53.812 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-06T03:12:53.864 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-06T03:12:53.875 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-06T03:12:53.972 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 136/170 2024-06-06T03:12:54.024 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 137/170 2024-06-06T03:12:54.084 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-06-06T03:12:54.111 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-06T03:12:54.135 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-06T03:12:54.136 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T03:12:54.136 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-06T03:12:54.136 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-06T03:12:54.136 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-06T03:12:54.136 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:12:54.193 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-06T03:12:54.196 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-06T03:12:54.216 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-06T03:12:54.216 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T03:12:54.217 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-06T03:12:54.217 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:12:54.241 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-06T03:12:54.259 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-06T03:12:54.268 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-06T03:12:54.293 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-06T03:12:54.293 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T03:12:54.293 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-06-06T03:12:54.293 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-06T03:12:54.293 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-06T03:12:54.293 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:12:54.614 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-06T03:12:54.638 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-06T03:12:54.638 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T03:12:54.638 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-06T03:12:54.638 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-06T03:12:54.638 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-06T03:12:54.639 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:12:54.917 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-06-06T03:12:54.949 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-06T03:12:54.973 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-06T03:12:54.973 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T03:12:54.973 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-06T03:12:54.973 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-06T03:12:54.973 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-06T03:12:54.973 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-06T03:12:55.035 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-06T03:12:55.057 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-06T03:12:55.058 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T03:12:55.058 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-06T03:12:55.058 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-06T03:12:55.094 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 155/170 2024-06-06T03:12:55.103 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-06T03:12:55.126 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-06T03:12:55.126 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T03:12:55.126 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-06-06T03:12:55.126 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-06T03:12:55.126 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-06T03:12:55.126 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-06T03:12:55.196 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-06-06T03:12:55.243 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-06-06T03:12:55.333 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-06-06T03:12:55.364 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-06-06T03:12:55.388 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-06T03:12:55.423 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-06-06T03:12:55.441 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-06T03:12:55.449 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-06-06T03:12:55.449 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-06T03:12:55.465 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-06T03:12:55.465 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T03:12:55.465 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-06T03:12:55.465 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-06T03:12:55.465 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-06T03:12:55.465 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-06T03:12:55.534 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-06T03:12:55.575 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-06-06T03:12:55.575 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-06T03:12:55.659 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-06T03:12:55.684 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-06-06T03:12:55.690 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-06T03:12:55.690 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-06T03:12:55.869 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-06T03:12:55.870 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-06T03:12:55.954 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-06T03:12:55.978 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-06-06T03:12:56.044 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-06T03:12:59.434 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 143/170 2024-06-06T03:12:59.476 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 144/170 2024-06-06T03:12:59.517 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 145/170 2024-06-06T03:12:59.548 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-06-06T03:12:59.575 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-06-06T03:12:59.772 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 148/170 2024-06-06T03:12:59.830 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-06-06T03:12:59.865 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 150/170 2024-06-06T03:12:59.894 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-06-06T03:12:59.924 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 152/170 2024-06-06T03:12:59.978 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 153/170 2024-06-06T03:13:00.012 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 143/170 2024-06-06T03:13:00.054 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 144/170 2024-06-06T03:13:00.094 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 145/170 2024-06-06T03:13:00.126 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-06-06T03:13:00.154 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-06-06T03:13:00.340 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 148/170 2024-06-06T03:13:00.392 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-06-06T03:13:00.425 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 150/170 2024-06-06T03:13:00.466 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-06-06T03:13:00.496 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 152/170 2024-06-06T03:13:00.542 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 153/170 2024-06-06T03:13:00.674 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-06T03:13:00.710 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-06T03:13:00.732 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-06T03:13:01.180 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-06T03:13:01.224 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-06T03:13:01.245 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-06T03:13:01.650 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 155/170 2024-06-06T03:13:01.680 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-06T03:13:01.680 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 1/170 2024-06-06T03:13:01.680 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2/170 2024-06-06T03:13:01.681 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 3/170 2024-06-06T03:13:01.681 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 4/170 2024-06-06T03:13:01.681 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 5/170 2024-06-06T03:13:01.681 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 6/170 2024-06-06T03:13:01.681 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 7/170 2024-06-06T03:13:01.682 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-06T03:13:01.682 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-06T03:13:01.682 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-06T03:13:01.682 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 11/170 2024-06-06T03:13:01.682 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 12/170 2024-06-06T03:13:01.683 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 13/170 2024-06-06T03:13:01.683 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-06T03:13:01.683 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 15/170 2024-06-06T03:13:01.683 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 16/170 2024-06-06T03:13:01.683 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 17/170 2024-06-06T03:13:01.683 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 18/170 2024-06-06T03:13:01.684 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 19/170 2024-06-06T03:13:01.684 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 20/170 2024-06-06T03:13:01.684 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 21/170 2024-06-06T03:13:01.684 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 22/170 2024-06-06T03:13:01.684 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 23/170 2024-06-06T03:13:01.685 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 24/170 2024-06-06T03:13:01.685 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 25/170 2024-06-06T03:13:01.685 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 26/170 2024-06-06T03:13:01.685 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 27/170 2024-06-06T03:13:01.685 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 28/170 2024-06-06T03:13:01.686 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 29/170 2024-06-06T03:13:01.711 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 30/170 2024-06-06T03:13:01.712 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 31/170 2024-06-06T03:13:01.712 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 32/170 2024-06-06T03:13:01.712 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 33/170 2024-06-06T03:13:01.712 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 34/170 2024-06-06T03:13:01.712 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 35/170 2024-06-06T03:13:01.712 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 36/170 2024-06-06T03:13:01.713 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 37/170 2024-06-06T03:13:01.713 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 38/170 2024-06-06T03:13:01.713 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 39/170 2024-06-06T03:13:01.713 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-06-06T03:13:01.713 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-06-06T03:13:01.713 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-06-06T03:13:01.714 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-06-06T03:13:01.714 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-06-06T03:13:01.714 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-06-06T03:13:01.714 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-06-06T03:13:01.714 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-06-06T03:13:01.714 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-06-06T03:13:01.715 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-06-06T03:13:01.715 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-06-06T03:13:01.715 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-06-06T03:13:01.715 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-06-06T03:13:01.715 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-06-06T03:13:01.715 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-06-06T03:13:01.716 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-06-06T03:13:01.716 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-06-06T03:13:01.716 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-06-06T03:13:01.716 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-06-06T03:13:01.716 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-06-06T03:13:01.716 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-06-06T03:13:01.717 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-06-06T03:13:01.717 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-06-06T03:13:01.717 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-06-06T03:13:01.717 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-06-06T03:13:01.717 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-06-06T03:13:01.718 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-06-06T03:13:01.718 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-06-06T03:13:01.718 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-06-06T03:13:01.718 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-06-06T03:13:01.718 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-06-06T03:13:01.718 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-06-06T03:13:01.718 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-06-06T03:13:01.718 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-06-06T03:13:01.718 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-06-06T03:13:01.719 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-06-06T03:13:01.719 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-06-06T03:13:01.719 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-06-06T03:13:01.719 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-06-06T03:13:01.719 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-06-06T03:13:01.719 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-06-06T03:13:01.719 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-06-06T03:13:01.719 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-06-06T03:13:01.719 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-06-06T03:13:01.719 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-06-06T03:13:01.719 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-06-06T03:13:01.719 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-06-06T03:13:01.719 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-06-06T03:13:01.719 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-06-06T03:13:01.719 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-06-06T03:13:01.720 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-06-06T03:13:01.720 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-06-06T03:13:01.720 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-06-06T03:13:01.720 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-06-06T03:13:01.720 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-06-06T03:13:01.720 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-06-06T03:13:01.720 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-06-06T03:13:01.720 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-06-06T03:13:01.720 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-06-06T03:13:01.720 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-06-06T03:13:01.720 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-06-06T03:13:01.721 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-06-06T03:13:01.721 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-06-06T03:13:01.721 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-06-06T03:13:01.721 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-06-06T03:13:01.721 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-06-06T03:13:01.721 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-06-06T03:13:01.721 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-06-06T03:13:01.722 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-06-06T03:13:01.722 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-06-06T03:13:01.722 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-06-06T03:13:01.722 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-06-06T03:13:01.722 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-06-06T03:13:01.722 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-06-06T03:13:01.722 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-06-06T03:13:01.722 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-06-06T03:13:01.723 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-06-06T03:13:01.723 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-06-06T03:13:01.723 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-06-06T03:13:01.723 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-06-06T03:13:01.723 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-06-06T03:13:01.723 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-06-06T03:13:01.723 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-06-06T03:13:01.723 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-06-06T03:13:01.724 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-06-06T03:13:01.724 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-06-06T03:13:01.724 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-06-06T03:13:01.724 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-06-06T03:13:01.724 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-06-06T03:13:01.724 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-06-06T03:13:01.724 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-06-06T03:13:01.724 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-06-06T03:13:01.724 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-06-06T03:13:01.725 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-06-06T03:13:01.725 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-06-06T03:13:01.725 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-06-06T03:13:01.725 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-06-06T03:13:01.725 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-06-06T03:13:01.725 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-06-06T03:13:01.725 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-06-06T03:13:01.725 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-06-06T03:13:01.725 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-06-06T03:13:01.725 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-06-06T03:13:01.725 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-06-06T03:13:01.725 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-06-06T03:13:01.726 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-06-06T03:13:01.726 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-06-06T03:13:01.726 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-06-06T03:13:01.726 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-06-06T03:13:01.726 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 149/170 2024-06-06T03:13:01.726 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-06-06T03:13:01.726 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 151/170 2024-06-06T03:13:01.726 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-06-06T03:13:01.726 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/170 2024-06-06T03:13:01.726 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-06-06T03:13:01.726 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/170 2024-06-06T03:13:01.726 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-06-06T03:13:01.726 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/170 2024-06-06T03:13:01.726 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-06-06T03:13:01.727 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/170 2024-06-06T03:13:01.727 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-06T03:13:01.727 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-06-06T03:13:01.727 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-06-06T03:13:01.727 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-06-06T03:13:01.727 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-06-06T03:13:01.727 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-06-06T03:13:01.727 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-06-06T03:13:01.727 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-06-06T03:13:01.727 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-06-06T03:13:01.727 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-06-06T03:13:01.739 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-06-06T03:13:01.791 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-06-06T03:13:01.880 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-06-06T03:13:01.910 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-06-06T03:13:01.935 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-06T03:13:01.960 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-06-06T03:13:01.986 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-06-06T03:13:01.987 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-06T03:13:02.071 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-06T03:13:02.091 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 155/170 2024-06-06T03:13:02.112 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-06-06T03:13:02.112 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-06T03:13:02.181 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-06-06T03:13:02.205 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-06T03:13:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-06-06T03:13:02.230 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-06-06T03:13:02.236 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-06T03:13:02.236 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-06T03:13:02.307 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-06-06T03:13:02.335 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-06-06T03:13:02.360 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-06T03:13:02.385 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-06-06T03:13:02.420 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-06-06T03:13:02.420 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-06T03:13:02.423 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-06T03:13:02.423 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-06T03:13:02.508 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-06T03:13:02.513 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-06T03:13:02.533 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-06-06T03:13:02.546 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-06-06T03:13:02.546 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-06T03:13:02.601 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-06T03:13:02.623 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-06T03:13:02.647 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-06-06T03:13:02.653 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-06T03:13:02.654 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-06T03:13:02.842 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-06T03:13:02.842 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-06T03:13:02.926 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-06T03:13:02.959 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-06-06T03:13:03.025 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-06T03:13:04.396 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-06-06T03:13:04.396 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-06-06T03:13:04.396 INFO:teuthology.orchestra.run.smithi122.stdout:Upgraded: 2024-06-06T03:13:04.396 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-06-06T03:13:04.397 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-06-06T03:13:04.397 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-06-06T03:13:04.397 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-06-06T03:13:04.397 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-06T03:13:04.397 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-06T03:13:04.397 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-06T03:13:04.397 INFO:teuthology.orchestra.run.smithi122.stdout: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:04.397 INFO:teuthology.orchestra.run.smithi122.stdout: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:04.397 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-06-06T03:13:04.397 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-06-06T03:13:04.397 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-06-06T03:13:04.397 INFO:teuthology.orchestra.run.smithi122.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-06T03:13:04.397 INFO:teuthology.orchestra.run.smithi122.stdout: automake-1.16.2-8.el9.noarch 2024-06-06T03:13:04.397 INFO:teuthology.orchestra.run.smithi122.stdout: bison-3.7.4-5.el9.x86_64 2024-06-06T03:13:04.398 INFO:teuthology.orchestra.run.smithi122.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-06T03:13:04.398 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:04.398 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:04.398 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:04.398 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:04.398 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T03:13:04.398 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-immutable-object-cache-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:04.398 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:04.398 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:04.398 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T03:13:04.398 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T03:13:04.398 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T03:13:04.399 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T03:13:04.399 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T03:13:04.399 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:04.399 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:04.399 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T03:13:04.399 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:04.399 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:04.399 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:04.399 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T03:13:04.399 INFO:teuthology.orchestra.run.smithi122.stdout: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T03:13:04.399 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:04.399 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:04.399 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T03:13:04.400 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-06T03:13:04.400 INFO:teuthology.orchestra.run.smithi122.stdout: flex-2.6.4-9.el9.x86_64 2024-06-06T03:13:04.400 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-06T03:13:04.400 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-06T03:13:04.400 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-06T03:13:04.400 INFO:teuthology.orchestra.run.smithi122.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-06T03:13:04.400 INFO:teuthology.orchestra.run.smithi122.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-06T03:13:04.400 INFO:teuthology.orchestra.run.smithi122.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-06T03:13:04.400 INFO:teuthology.orchestra.run.smithi122.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-06T03:13:04.400 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-06T03:13:04.400 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-06T03:13:04.400 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:04.400 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:04.401 INFO:teuthology.orchestra.run.smithi122.stdout: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:04.401 INFO:teuthology.orchestra.run.smithi122.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-06T03:13:04.401 INFO:teuthology.orchestra.run.smithi122.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-06T03:13:04.401 INFO:teuthology.orchestra.run.smithi122.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-06T03:13:04.401 INFO:teuthology.orchestra.run.smithi122.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-06T03:13:04.401 INFO:teuthology.orchestra.run.smithi122.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-06T03:13:04.401 INFO:teuthology.orchestra.run.smithi122.stdout: librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:04.401 INFO:teuthology.orchestra.run.smithi122.stdout: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:04.401 INFO:teuthology.orchestra.run.smithi122.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-06T03:13:04.401 INFO:teuthology.orchestra.run.smithi122.stdout: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:04.401 INFO:teuthology.orchestra.run.smithi122.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-06T03:13:04.401 INFO:teuthology.orchestra.run.smithi122.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-06T03:13:04.401 INFO:teuthology.orchestra.run.smithi122.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-06T03:13:04.401 INFO:teuthology.orchestra.run.smithi122.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-06T03:13:04.402 INFO:teuthology.orchestra.run.smithi122.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-06T03:13:04.402 INFO:teuthology.orchestra.run.smithi122.stdout: lua-5.4.4-4.el9.x86_64 2024-06-06T03:13:04.402 INFO:teuthology.orchestra.run.smithi122.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-06T03:13:04.402 INFO:teuthology.orchestra.run.smithi122.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-06T03:13:04.402 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-06T03:13:04.402 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-06T03:13:04.402 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-06-06T03:13:04.402 INFO:teuthology.orchestra.run.smithi122.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-06T03:13:04.402 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-13.14-1.el9.x86_64 2024-06-06T03:13:04.402 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-06-06T03:13:04.402 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-06-06T03:13:04.402 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-server-13.14-1.el9.x86_64 2024-06-06T03:13:04.402 INFO:teuthology.orchestra.run.smithi122.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-06T03:13:04.403 INFO:teuthology.orchestra.run.smithi122.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-06T03:13:04.403 INFO:teuthology.orchestra.run.smithi122.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-06T03:13:04.403 INFO:teuthology.orchestra.run.smithi122.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-06-06T03:13:04.403 INFO:teuthology.orchestra.run.smithi122.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-06T03:13:04.403 INFO:teuthology.orchestra.run.smithi122.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-06T03:13:04.403 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-06T03:13:04.403 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:04.403 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:04.403 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:04.403 INFO:teuthology.orchestra.run.smithi122.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-06T03:13:04.403 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-06T03:13:04.403 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-06T03:13:04.403 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-06T03:13:04.403 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-06-06T03:13:04.404 INFO:teuthology.orchestra.run.smithi122.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-06-06T03:13:04.404 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-06T03:13:04.404 INFO:teuthology.orchestra.run.smithi122.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-06T03:13:04.404 INFO:teuthology.orchestra.run.smithi122.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-06-06T03:13:04.404 INFO:teuthology.orchestra.run.smithi122.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-06T03:13:04.404 INFO:teuthology.orchestra.run.smithi122.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-06T03:13:04.404 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-06T03:13:04.404 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-06T03:13:04.404 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-06T03:13:04.404 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-06T03:13:04.404 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-06T03:13:04.404 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-06T03:13:04.404 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-06T03:13:04.404 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-06T03:13:04.405 INFO:teuthology.orchestra.run.smithi122.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-06T03:13:04.405 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-06T03:13:04.405 INFO:teuthology.orchestra.run.smithi122.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-06T03:13:04.405 INFO:teuthology.orchestra.run.smithi122.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-06T03:13:04.405 INFO:teuthology.orchestra.run.smithi122.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-06T03:13:04.405 INFO:teuthology.orchestra.run.smithi122.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-06T03:13:04.405 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-06T03:13:04.405 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-06T03:13:04.405 INFO:teuthology.orchestra.run.smithi122.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-06T03:13:04.405 INFO:teuthology.orchestra.run.smithi122.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-06T03:13:04.405 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-06T03:13:04.405 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ply-3.11-14.el9.noarch 2024-06-06T03:13:04.405 INFO:teuthology.orchestra.run.smithi122.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-06T03:13:04.405 INFO:teuthology.orchestra.run.smithi122.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-06T03:13:04.405 INFO:teuthology.orchestra.run.smithi122.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-06T03:13:04.406 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-06T03:13:04.406 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-06T03:13:04.406 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-06T03:13:04.406 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-06T03:13:04.406 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-06-06T03:13:04.406 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-06T03:13:04.406 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:04.406 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:04.406 INFO:teuthology.orchestra.run.smithi122.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-06T03:13:04.406 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-06T03:13:04.406 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-06T03:13:04.406 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:04.407 INFO:teuthology.orchestra.run.smithi122.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-06T03:13:04.407 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-06T03:13:04.407 INFO:teuthology.orchestra.run.smithi122.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-06T03:13:04.407 INFO:teuthology.orchestra.run.smithi122.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-06T03:13:04.407 INFO:teuthology.orchestra.run.smithi122.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-06T03:13:04.407 INFO:teuthology.orchestra.run.smithi122.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-06T03:13:04.407 INFO:teuthology.orchestra.run.smithi122.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-06T03:13:04.407 INFO:teuthology.orchestra.run.smithi122.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-06-06T03:13:04.407 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-06T03:13:04.407 INFO:teuthology.orchestra.run.smithi122.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-06T03:13:04.407 INFO:teuthology.orchestra.run.smithi122.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-06T03:13:04.407 INFO:teuthology.orchestra.run.smithi122.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-06T03:13:04.407 INFO:teuthology.orchestra.run.smithi122.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-06T03:13:04.407 INFO:teuthology.orchestra.run.smithi122.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-06T03:13:04.407 INFO:teuthology.orchestra.run.smithi122.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-06T03:13:04.408 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:04.408 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:04.408 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:04.408 INFO:teuthology.orchestra.run.smithi122.stdout: re2-1:20211101-3.el9.x86_64 2024-06-06T03:13:04.408 INFO:teuthology.orchestra.run.smithi122.stdout: socat-1.7.4.1-5.el9.x86_64 2024-06-06T03:13:04.408 INFO:teuthology.orchestra.run.smithi122.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-06T03:13:04.408 INFO:teuthology.orchestra.run.smithi122.stdout: uuid-1.6.2-55.el9.x86_64 2024-06-06T03:13:04.408 INFO:teuthology.orchestra.run.smithi122.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-06-06T03:13:04.408 INFO:teuthology.orchestra.run.smithi122.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-06T03:13:04.408 INFO:teuthology.orchestra.run.smithi122.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-06T03:13:04.410 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-06-06T03:13:04.410 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-06-06T03:13:04.814 DEBUG:teuthology.parallel:result is None 2024-06-06T03:13:08.069 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-06T03:13:08.069 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 1/170 2024-06-06T03:13:08.069 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2/170 2024-06-06T03:13:08.069 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 3/170 2024-06-06T03:13:08.069 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 4/170 2024-06-06T03:13:08.069 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 5/170 2024-06-06T03:13:08.069 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 6/170 2024-06-06T03:13:08.070 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 7/170 2024-06-06T03:13:08.070 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-06T03:13:08.070 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-06T03:13:08.070 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-06T03:13:08.070 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 11/170 2024-06-06T03:13:08.070 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 12/170 2024-06-06T03:13:08.070 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 13/170 2024-06-06T03:13:08.070 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-06T03:13:08.070 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 15/170 2024-06-06T03:13:08.070 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 16/170 2024-06-06T03:13:08.070 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 17/170 2024-06-06T03:13:08.070 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 18/170 2024-06-06T03:13:08.071 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 19/170 2024-06-06T03:13:08.071 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 20/170 2024-06-06T03:13:08.071 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 21/170 2024-06-06T03:13:08.071 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 22/170 2024-06-06T03:13:08.071 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 23/170 2024-06-06T03:13:08.071 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 24/170 2024-06-06T03:13:08.071 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 25/170 2024-06-06T03:13:08.071 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 26/170 2024-06-06T03:13:08.071 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 27/170 2024-06-06T03:13:08.071 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 28/170 2024-06-06T03:13:08.071 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 29/170 2024-06-06T03:13:08.071 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 30/170 2024-06-06T03:13:08.071 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 31/170 2024-06-06T03:13:08.071 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 32/170 2024-06-06T03:13:08.072 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 33/170 2024-06-06T03:13:08.072 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 34/170 2024-06-06T03:13:08.072 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 35/170 2024-06-06T03:13:08.072 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 36/170 2024-06-06T03:13:08.072 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 37/170 2024-06-06T03:13:08.072 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 38/170 2024-06-06T03:13:08.072 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 39/170 2024-06-06T03:13:08.072 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-06-06T03:13:08.072 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-06-06T03:13:08.072 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-06-06T03:13:08.072 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-06-06T03:13:08.072 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-06-06T03:13:08.072 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-06-06T03:13:08.073 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-06-06T03:13:08.073 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-06-06T03:13:08.073 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-06-06T03:13:08.073 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-06-06T03:13:08.073 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-06-06T03:13:08.073 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-06-06T03:13:08.073 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-06-06T03:13:08.073 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-06-06T03:13:08.073 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-06-06T03:13:08.073 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-06-06T03:13:08.073 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-06-06T03:13:08.073 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-06-06T03:13:08.073 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-06-06T03:13:08.073 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-06-06T03:13:08.074 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-06-06T03:13:08.074 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-06-06T03:13:08.074 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-06-06T03:13:08.074 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-06-06T03:13:08.074 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-06-06T03:13:08.074 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-06-06T03:13:08.074 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-06-06T03:13:08.074 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-06-06T03:13:08.074 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-06-06T03:13:08.074 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-06-06T03:13:08.074 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-06-06T03:13:08.074 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-06-06T03:13:08.074 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-06-06T03:13:08.075 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-06-06T03:13:08.075 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-06-06T03:13:08.075 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-06-06T03:13:08.075 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-06-06T03:13:08.075 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-06-06T03:13:08.075 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-06-06T03:13:08.075 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-06-06T03:13:08.075 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-06-06T03:13:08.075 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-06-06T03:13:08.075 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-06-06T03:13:08.075 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-06-06T03:13:08.075 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-06-06T03:13:08.075 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-06-06T03:13:08.075 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-06-06T03:13:08.075 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-06-06T03:13:08.075 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-06-06T03:13:08.076 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-06-06T03:13:08.076 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-06-06T03:13:08.076 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-06-06T03:13:08.076 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-06-06T03:13:08.076 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-06-06T03:13:08.076 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-06-06T03:13:08.076 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-06-06T03:13:08.076 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-06-06T03:13:08.076 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-06-06T03:13:08.076 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-06-06T03:13:08.076 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-06-06T03:13:08.076 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-06-06T03:13:08.076 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-06-06T03:13:08.077 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-06-06T03:13:08.077 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-06-06T03:13:08.077 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-06-06T03:13:08.077 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-06-06T03:13:08.077 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-06-06T03:13:08.077 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-06-06T03:13:08.077 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-06-06T03:13:08.077 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-06-06T03:13:08.077 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-06-06T03:13:08.077 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-06-06T03:13:08.077 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-06-06T03:13:08.077 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-06-06T03:13:08.077 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-06-06T03:13:08.077 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-06-06T03:13:08.077 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-06-06T03:13:08.077 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-06-06T03:13:08.078 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-06-06T03:13:08.078 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-06-06T03:13:08.078 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-06-06T03:13:08.078 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-06-06T03:13:08.078 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-06-06T03:13:08.078 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-06-06T03:13:08.078 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-06-06T03:13:08.078 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-06-06T03:13:08.078 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-06-06T03:13:08.078 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-06-06T03:13:08.078 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-06-06T03:13:08.078 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-06-06T03:13:08.078 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-06-06T03:13:08.079 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-06-06T03:13:08.079 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-06-06T03:13:08.079 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-06-06T03:13:08.079 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-06-06T03:13:08.079 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-06-06T03:13:08.079 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-06-06T03:13:08.079 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-06-06T03:13:08.079 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-06-06T03:13:08.079 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-06-06T03:13:08.079 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-06-06T03:13:08.079 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-06-06T03:13:08.079 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-06-06T03:13:08.079 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-06-06T03:13:08.079 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-06-06T03:13:08.080 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-06-06T03:13:08.080 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-06-06T03:13:08.080 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-06-06T03:13:08.080 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-06-06T03:13:08.080 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 149/170 2024-06-06T03:13:08.080 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-06-06T03:13:08.080 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 151/170 2024-06-06T03:13:08.080 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-06-06T03:13:08.080 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/170 2024-06-06T03:13:08.080 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-06-06T03:13:08.080 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/170 2024-06-06T03:13:08.080 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-06-06T03:13:08.080 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/170 2024-06-06T03:13:08.080 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-06-06T03:13:08.080 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/170 2024-06-06T03:13:08.081 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-06T03:13:08.081 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-06-06T03:13:08.081 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-06-06T03:13:08.081 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-06-06T03:13:08.081 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-06-06T03:13:08.081 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-06-06T03:13:08.081 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-06-06T03:13:08.081 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-06-06T03:13:08.081 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-06-06T03:13:08.081 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-06-06T03:13:08.956 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-06T03:13:08.957 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 1/170 2024-06-06T03:13:08.957 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2/170 2024-06-06T03:13:08.957 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 3/170 2024-06-06T03:13:08.957 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 4/170 2024-06-06T03:13:08.957 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 5/170 2024-06-06T03:13:08.957 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 6/170 2024-06-06T03:13:08.957 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 7/170 2024-06-06T03:13:08.957 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-06T03:13:08.957 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-06T03:13:08.957 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-06T03:13:08.957 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 11/170 2024-06-06T03:13:08.957 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 12/170 2024-06-06T03:13:08.957 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 13/170 2024-06-06T03:13:08.958 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-06T03:13:08.958 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 15/170 2024-06-06T03:13:08.958 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 16/170 2024-06-06T03:13:08.958 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 17/170 2024-06-06T03:13:08.958 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 18/170 2024-06-06T03:13:08.958 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 19/170 2024-06-06T03:13:08.958 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 20/170 2024-06-06T03:13:08.958 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 21/170 2024-06-06T03:13:08.958 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 22/170 2024-06-06T03:13:08.958 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 23/170 2024-06-06T03:13:08.958 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 24/170 2024-06-06T03:13:08.958 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 25/170 2024-06-06T03:13:08.958 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 26/170 2024-06-06T03:13:08.959 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 27/170 2024-06-06T03:13:08.959 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 28/170 2024-06-06T03:13:08.971 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 29/170 2024-06-06T03:13:08.971 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 30/170 2024-06-06T03:13:08.971 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 31/170 2024-06-06T03:13:08.971 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 32/170 2024-06-06T03:13:08.971 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 33/170 2024-06-06T03:13:08.971 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 34/170 2024-06-06T03:13:08.971 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 35/170 2024-06-06T03:13:08.971 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 36/170 2024-06-06T03:13:08.971 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 37/170 2024-06-06T03:13:08.971 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 38/170 2024-06-06T03:13:08.971 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 39/170 2024-06-06T03:13:08.971 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-06-06T03:13:08.971 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-06-06T03:13:08.972 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-06-06T03:13:08.972 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-06-06T03:13:08.972 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-06-06T03:13:08.972 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-06-06T03:13:08.972 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-06-06T03:13:08.972 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-06-06T03:13:08.972 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-06-06T03:13:08.972 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-06-06T03:13:08.972 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-06-06T03:13:08.972 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-06-06T03:13:08.972 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-06-06T03:13:08.972 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-06-06T03:13:08.972 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-06-06T03:13:08.972 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-06-06T03:13:08.973 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-06-06T03:13:08.973 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-06-06T03:13:08.973 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-06-06T03:13:08.973 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-06-06T03:13:08.973 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-06-06T03:13:08.973 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-06-06T03:13:08.973 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-06-06T03:13:08.973 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-06-06T03:13:08.973 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-06-06T03:13:08.973 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-06-06T03:13:08.973 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-06-06T03:13:08.973 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-06-06T03:13:08.973 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-06-06T03:13:08.974 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-06-06T03:13:08.974 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-06-06T03:13:08.974 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-06-06T03:13:08.974 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-06-06T03:13:08.974 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-06-06T03:13:08.974 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-06-06T03:13:08.974 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-06-06T03:13:08.974 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-06-06T03:13:08.974 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-06-06T03:13:08.974 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-06-06T03:13:08.974 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-06-06T03:13:08.974 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-06-06T03:13:08.974 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-06-06T03:13:08.974 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-06-06T03:13:08.975 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-06-06T03:13:08.975 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-06-06T03:13:08.975 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-06-06T03:13:08.975 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-06-06T03:13:08.975 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-06-06T03:13:08.975 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-06-06T03:13:08.975 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-06-06T03:13:08.975 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-06-06T03:13:08.975 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-06-06T03:13:08.975 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-06-06T03:13:08.975 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-06-06T03:13:08.975 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-06-06T03:13:08.976 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-06-06T03:13:08.976 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-06-06T03:13:08.976 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-06-06T03:13:08.976 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-06-06T03:13:08.976 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-06-06T03:13:08.976 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-06-06T03:13:08.976 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-06-06T03:13:08.976 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-06-06T03:13:08.976 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-06-06T03:13:08.976 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-06-06T03:13:08.976 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-06-06T03:13:08.976 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-06-06T03:13:08.976 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-06-06T03:13:08.976 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-06-06T03:13:08.976 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-06-06T03:13:08.977 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-06-06T03:13:08.977 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-06-06T03:13:08.977 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-06-06T03:13:08.977 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-06-06T03:13:08.977 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-06-06T03:13:08.977 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-06-06T03:13:08.977 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-06-06T03:13:08.977 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-06-06T03:13:08.977 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-06-06T03:13:08.977 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-06-06T03:13:08.977 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-06-06T03:13:08.977 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-06-06T03:13:08.977 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-06-06T03:13:08.977 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-06-06T03:13:08.978 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-06-06T03:13:08.978 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-06-06T03:13:08.978 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-06-06T03:13:08.978 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-06-06T03:13:08.978 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-06-06T03:13:08.978 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-06-06T03:13:08.978 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-06-06T03:13:08.978 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-06-06T03:13:08.978 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-06-06T03:13:08.978 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-06-06T03:13:08.978 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-06-06T03:13:08.978 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-06-06T03:13:08.978 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-06-06T03:13:08.979 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-06-06T03:13:08.979 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-06-06T03:13:08.979 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-06-06T03:13:08.979 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-06-06T03:13:08.979 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-06-06T03:13:08.979 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-06-06T03:13:08.979 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-06-06T03:13:08.979 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-06-06T03:13:08.979 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-06-06T03:13:08.979 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-06-06T03:13:08.979 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-06-06T03:13:08.979 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-06-06T03:13:08.979 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 149/170 2024-06-06T03:13:08.979 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-06-06T03:13:08.980 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 151/170 2024-06-06T03:13:08.980 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-06-06T03:13:08.980 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/170 2024-06-06T03:13:08.980 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-06-06T03:13:08.980 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/170 2024-06-06T03:13:08.980 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-06-06T03:13:08.980 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/170 2024-06-06T03:13:08.980 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-06-06T03:13:08.980 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/170 2024-06-06T03:13:08.980 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-06T03:13:08.980 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-06-06T03:13:08.980 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-06-06T03:13:08.981 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-06-06T03:13:08.981 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-06-06T03:13:08.981 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-06-06T03:13:08.981 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-06-06T03:13:08.981 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-06-06T03:13:08.981 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-06-06T03:13:08.981 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-06-06T03:13:10.759 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-06-06T03:13:10.760 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:13:10.760 INFO:teuthology.orchestra.run.smithi050.stdout:Upgraded: 2024-06-06T03:13:10.760 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-06-06T03:13:10.760 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-06-06T03:13:10.760 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-06-06T03:13:10.760 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-06-06T03:13:10.760 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-06T03:13:10.760 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-06T03:13:10.760 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-06T03:13:10.760 INFO:teuthology.orchestra.run.smithi050.stdout: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:10.760 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:10.761 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-06-06T03:13:10.761 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-06-06T03:13:10.761 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2024-06-06T03:13:10.761 INFO:teuthology.orchestra.run.smithi050.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-06T03:13:10.761 INFO:teuthology.orchestra.run.smithi050.stdout: automake-1.16.2-8.el9.noarch 2024-06-06T03:13:10.761 INFO:teuthology.orchestra.run.smithi050.stdout: bison-3.7.4-5.el9.x86_64 2024-06-06T03:13:10.761 INFO:teuthology.orchestra.run.smithi050.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-06T03:13:10.761 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:10.761 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:10.761 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:10.761 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:10.761 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T03:13:10.761 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:10.762 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:10.762 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:10.762 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T03:13:10.762 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T03:13:10.762 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T03:13:10.762 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T03:13:10.762 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T03:13:10.762 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:10.762 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:10.762 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T03:13:10.762 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:10.762 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:10.763 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:10.763 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T03:13:10.763 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T03:13:10.763 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:10.763 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:10.763 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T03:13:10.763 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-06T03:13:10.763 INFO:teuthology.orchestra.run.smithi050.stdout: flex-2.6.4-9.el9.x86_64 2024-06-06T03:13:10.763 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-06T03:13:10.763 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-06T03:13:10.763 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-06T03:13:10.763 INFO:teuthology.orchestra.run.smithi050.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-06T03:13:10.763 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-06T03:13:10.764 INFO:teuthology.orchestra.run.smithi050.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-06T03:13:10.764 INFO:teuthology.orchestra.run.smithi050.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-06T03:13:10.764 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-06T03:13:10.764 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-06T03:13:10.764 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:10.764 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:10.764 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:10.764 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-06T03:13:10.764 INFO:teuthology.orchestra.run.smithi050.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-06T03:13:10.764 INFO:teuthology.orchestra.run.smithi050.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-06T03:13:10.764 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-06T03:13:10.764 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-06T03:13:10.764 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:10.764 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:10.765 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-06T03:13:10.765 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:10.765 INFO:teuthology.orchestra.run.smithi050.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-06T03:13:10.765 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-06T03:13:10.765 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-06T03:13:10.765 INFO:teuthology.orchestra.run.smithi050.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-06T03:13:10.765 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-06T03:13:10.765 INFO:teuthology.orchestra.run.smithi050.stdout: lua-5.4.4-4.el9.x86_64 2024-06-06T03:13:10.765 INFO:teuthology.orchestra.run.smithi050.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-06T03:13:10.765 INFO:teuthology.orchestra.run.smithi050.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-06T03:13:10.765 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-06T03:13:10.765 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-06T03:13:10.765 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-06-06T03:13:10.765 INFO:teuthology.orchestra.run.smithi050.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-06T03:13:10.766 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-13.14-1.el9.x86_64 2024-06-06T03:13:10.766 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-06-06T03:13:10.766 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-06-06T03:13:10.766 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-server-13.14-1.el9.x86_64 2024-06-06T03:13:10.766 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-06T03:13:10.766 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-06T03:13:10.766 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-06T03:13:10.766 INFO:teuthology.orchestra.run.smithi050.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-06-06T03:13:10.766 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-06T03:13:10.766 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-06T03:13:10.766 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-06T03:13:10.766 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:10.766 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:10.767 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:10.767 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-06T03:13:10.767 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-06T03:13:10.767 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-06T03:13:10.767 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-06T03:13:10.767 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-06-06T03:13:10.767 INFO:teuthology.orchestra.run.smithi050.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-06-06T03:13:10.767 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-06T03:13:10.767 INFO:teuthology.orchestra.run.smithi050.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-06T03:13:10.767 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-06-06T03:13:10.767 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-06T03:13:10.767 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-06T03:13:10.767 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-06T03:13:10.767 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-06T03:13:10.768 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-06T03:13:10.768 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-06T03:13:10.768 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-06T03:13:10.768 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-06T03:13:10.768 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-06T03:13:10.768 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-06T03:13:10.768 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-06T03:13:10.768 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-06T03:13:10.768 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-06T03:13:10.768 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-06T03:13:10.768 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-06T03:13:10.768 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-06T03:13:10.768 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-06T03:13:10.768 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-06T03:13:10.769 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-06T03:13:10.769 INFO:teuthology.orchestra.run.smithi050.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-06T03:13:10.769 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-06T03:13:10.769 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ply-3.11-14.el9.noarch 2024-06-06T03:13:10.769 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-06T03:13:10.769 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-06T03:13:10.769 INFO:teuthology.orchestra.run.smithi050.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-06T03:13:10.769 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-06T03:13:10.769 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-06T03:13:10.769 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-06T03:13:10.769 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-06T03:13:10.769 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-06-06T03:13:10.769 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-06T03:13:10.769 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:10.770 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:10.770 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-06T03:13:10.770 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-06T03:13:10.770 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-06T03:13:10.770 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:10.770 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-06T03:13:10.770 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-06T03:13:10.770 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-06T03:13:10.770 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-06T03:13:10.770 INFO:teuthology.orchestra.run.smithi050.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-06T03:13:10.770 INFO:teuthology.orchestra.run.smithi050.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-06T03:13:10.770 INFO:teuthology.orchestra.run.smithi050.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-06T03:13:10.771 INFO:teuthology.orchestra.run.smithi050.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-06-06T03:13:10.771 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-06T03:13:10.771 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-06T03:13:10.771 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-06T03:13:10.771 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-06T03:13:10.771 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-06T03:13:10.771 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-06T03:13:10.771 INFO:teuthology.orchestra.run.smithi050.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-06T03:13:10.771 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:10.771 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:10.771 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:10.771 INFO:teuthology.orchestra.run.smithi050.stdout: re2-1:20211101-3.el9.x86_64 2024-06-06T03:13:10.771 INFO:teuthology.orchestra.run.smithi050.stdout: socat-1.7.4.1-5.el9.x86_64 2024-06-06T03:13:10.771 INFO:teuthology.orchestra.run.smithi050.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-06T03:13:10.771 INFO:teuthology.orchestra.run.smithi050.stdout: uuid-1.6.2-55.el9.x86_64 2024-06-06T03:13:10.772 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-06-06T03:13:10.772 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-06T03:13:10.772 INFO:teuthology.orchestra.run.smithi050.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-06T03:13:10.772 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:13:10.772 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-06-06T03:13:11.161 DEBUG:teuthology.parallel:result is None 2024-06-06T03:13:11.737 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-06-06T03:13:11.738 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-06T03:13:11.738 INFO:teuthology.orchestra.run.smithi079.stdout:Upgraded: 2024-06-06T03:13:11.738 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-06-06T03:13:11.738 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-06-06T03:13:11.738 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-06-06T03:13:11.738 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-06-06T03:13:11.738 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-06T03:13:11.738 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-06T03:13:11.738 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-06T03:13:11.739 INFO:teuthology.orchestra.run.smithi079.stdout: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:11.739 INFO:teuthology.orchestra.run.smithi079.stdout: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:11.739 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-06-06T03:13:11.739 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-06-06T03:13:11.739 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-06-06T03:13:11.739 INFO:teuthology.orchestra.run.smithi079.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-06T03:13:11.739 INFO:teuthology.orchestra.run.smithi079.stdout: automake-1.16.2-8.el9.noarch 2024-06-06T03:13:11.739 INFO:teuthology.orchestra.run.smithi079.stdout: bison-3.7.4-5.el9.x86_64 2024-06-06T03:13:11.739 INFO:teuthology.orchestra.run.smithi079.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-06T03:13:11.739 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:11.739 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:11.739 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:11.739 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:11.740 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T03:13:11.740 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-immutable-object-cache-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:11.740 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:11.740 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:11.740 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T03:13:11.740 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T03:13:11.740 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T03:13:11.740 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T03:13:11.740 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T03:13:11.740 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:11.740 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:11.740 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T03:13:11.740 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:11.740 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:11.741 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:11.741 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T03:13:11.741 INFO:teuthology.orchestra.run.smithi079.stdout: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T03:13:11.741 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:11.741 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:11.741 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T03:13:11.741 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-06T03:13:11.741 INFO:teuthology.orchestra.run.smithi079.stdout: flex-2.6.4-9.el9.x86_64 2024-06-06T03:13:11.741 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-06T03:13:11.741 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-06T03:13:11.741 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-06T03:13:11.741 INFO:teuthology.orchestra.run.smithi079.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-06T03:13:11.741 INFO:teuthology.orchestra.run.smithi079.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-06T03:13:11.741 INFO:teuthology.orchestra.run.smithi079.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-06T03:13:11.741 INFO:teuthology.orchestra.run.smithi079.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-06T03:13:11.742 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-06T03:13:11.742 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-06T03:13:11.742 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:11.742 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:11.742 INFO:teuthology.orchestra.run.smithi079.stdout: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:11.742 INFO:teuthology.orchestra.run.smithi079.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-06T03:13:11.742 INFO:teuthology.orchestra.run.smithi079.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-06T03:13:11.742 INFO:teuthology.orchestra.run.smithi079.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-06T03:13:11.742 INFO:teuthology.orchestra.run.smithi079.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-06T03:13:11.742 INFO:teuthology.orchestra.run.smithi079.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-06T03:13:11.742 INFO:teuthology.orchestra.run.smithi079.stdout: librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:11.742 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:11.742 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-06T03:13:11.742 INFO:teuthology.orchestra.run.smithi079.stdout: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:11.743 INFO:teuthology.orchestra.run.smithi079.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-06T03:13:11.743 INFO:teuthology.orchestra.run.smithi079.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-06T03:13:11.743 INFO:teuthology.orchestra.run.smithi079.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-06T03:13:11.743 INFO:teuthology.orchestra.run.smithi079.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-06T03:13:11.743 INFO:teuthology.orchestra.run.smithi079.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-06T03:13:11.743 INFO:teuthology.orchestra.run.smithi079.stdout: lua-5.4.4-4.el9.x86_64 2024-06-06T03:13:11.743 INFO:teuthology.orchestra.run.smithi079.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-06T03:13:11.743 INFO:teuthology.orchestra.run.smithi079.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-06T03:13:11.743 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-06T03:13:11.743 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-06T03:13:11.743 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-06-06T03:13:11.743 INFO:teuthology.orchestra.run.smithi079.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-06T03:13:11.743 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-13.14-1.el9.x86_64 2024-06-06T03:13:11.743 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-06-06T03:13:11.744 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-06-06T03:13:11.744 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-server-13.14-1.el9.x86_64 2024-06-06T03:13:11.744 INFO:teuthology.orchestra.run.smithi079.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-06T03:13:11.744 INFO:teuthology.orchestra.run.smithi079.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-06T03:13:11.744 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-06T03:13:11.744 INFO:teuthology.orchestra.run.smithi079.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-06-06T03:13:11.744 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-06T03:13:11.744 INFO:teuthology.orchestra.run.smithi079.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-06T03:13:11.744 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-06T03:13:11.744 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:11.744 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:11.744 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:11.744 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-06T03:13:11.744 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-06T03:13:11.744 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-06T03:13:11.745 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-06T03:13:11.745 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-06-06T03:13:11.745 INFO:teuthology.orchestra.run.smithi079.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-06-06T03:13:11.745 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-06T03:13:11.745 INFO:teuthology.orchestra.run.smithi079.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-06T03:13:11.745 INFO:teuthology.orchestra.run.smithi079.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-06-06T03:13:11.745 INFO:teuthology.orchestra.run.smithi079.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-06T03:13:11.745 INFO:teuthology.orchestra.run.smithi079.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-06T03:13:11.745 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-06T03:13:11.745 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-06T03:13:11.745 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-06T03:13:11.745 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-06T03:13:11.745 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-06T03:13:11.745 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-06T03:13:11.745 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-06T03:13:11.746 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-06T03:13:11.746 INFO:teuthology.orchestra.run.smithi079.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-06T03:13:11.746 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-06T03:13:11.746 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-06T03:13:11.746 INFO:teuthology.orchestra.run.smithi079.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-06T03:13:11.746 INFO:teuthology.orchestra.run.smithi079.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-06T03:13:11.746 INFO:teuthology.orchestra.run.smithi079.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-06T03:13:11.746 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-06T03:13:11.746 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-06T03:13:11.746 INFO:teuthology.orchestra.run.smithi079.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-06T03:13:11.746 INFO:teuthology.orchestra.run.smithi079.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-06T03:13:11.746 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-06T03:13:11.746 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ply-3.11-14.el9.noarch 2024-06-06T03:13:11.746 INFO:teuthology.orchestra.run.smithi079.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-06T03:13:11.746 INFO:teuthology.orchestra.run.smithi079.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-06T03:13:11.747 INFO:teuthology.orchestra.run.smithi079.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-06T03:13:11.747 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-06T03:13:11.747 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-06T03:13:11.747 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-06T03:13:11.747 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-06T03:13:11.747 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-06-06T03:13:11.747 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-06T03:13:11.747 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:11.747 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:11.747 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-06T03:13:11.747 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-06T03:13:11.747 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-06T03:13:11.747 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:11.747 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-06T03:13:11.748 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-06T03:13:11.748 INFO:teuthology.orchestra.run.smithi079.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-06T03:13:11.748 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-06T03:13:11.748 INFO:teuthology.orchestra.run.smithi079.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-06T03:13:11.748 INFO:teuthology.orchestra.run.smithi079.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-06T03:13:11.748 INFO:teuthology.orchestra.run.smithi079.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-06T03:13:11.748 INFO:teuthology.orchestra.run.smithi079.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-06-06T03:13:11.748 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-06T03:13:11.748 INFO:teuthology.orchestra.run.smithi079.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-06T03:13:11.748 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-06T03:13:11.748 INFO:teuthology.orchestra.run.smithi079.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-06T03:13:11.748 INFO:teuthology.orchestra.run.smithi079.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-06T03:13:11.748 INFO:teuthology.orchestra.run.smithi079.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-06T03:13:11.748 INFO:teuthology.orchestra.run.smithi079.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-06T03:13:11.748 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:11.749 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:11.749 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T03:13:11.749 INFO:teuthology.orchestra.run.smithi079.stdout: re2-1:20211101-3.el9.x86_64 2024-06-06T03:13:11.749 INFO:teuthology.orchestra.run.smithi079.stdout: socat-1.7.4.1-5.el9.x86_64 2024-06-06T03:13:11.749 INFO:teuthology.orchestra.run.smithi079.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-06T03:13:11.749 INFO:teuthology.orchestra.run.smithi079.stdout: uuid-1.6.2-55.el9.x86_64 2024-06-06T03:13:11.749 INFO:teuthology.orchestra.run.smithi079.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-06-06T03:13:11.749 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-06T03:13:11.749 INFO:teuthology.orchestra.run.smithi079.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-06T03:13:11.749 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-06-06T03:13:11.749 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-06-06T03:13:12.199 DEBUG:teuthology.parallel:result is None 2024-06-06T03:13:12.200 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-06T03:13:12.446 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-06T03:13:12.474 INFO:teuthology.orchestra.run.smithi050.stdout:19.0.0-2946.g3d89accf.el9 2024-06-06T03:13:12.474 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2946.g3d89accf.el9 2024-06-06T03:13:12.474 INFO:teuthology.task.install:The correct ceph version 19.0.0-2946.g3d89accf is installed. 2024-06-06T03:13:12.476 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-06T03:13:12.618 DEBUG:teuthology.orchestra.run.smithi079:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-06T03:13:12.644 INFO:teuthology.orchestra.run.smithi079.stdout:19.0.0-2946.g3d89accf.el9 2024-06-06T03:13:12.644 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2946.g3d89accf.el9 2024-06-06T03:13:12.644 INFO:teuthology.task.install:The correct ceph version 19.0.0-2946.g3d89accf is installed. 2024-06-06T03:13:12.646 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-06T03:13:12.790 DEBUG:teuthology.orchestra.run.smithi122:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-06T03:13:12.817 INFO:teuthology.orchestra.run.smithi122.stdout:19.0.0-2946.g3d89accf.el9 2024-06-06T03:13:12.817 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2946.g3d89accf.el9 2024-06-06T03:13:12.817 INFO:teuthology.task.install:The correct ceph version 19.0.0-2946.g3d89accf is installed. 2024-06-06T03:13:12.819 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-06-06T03:13:12.819 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-06-06T03:13:12.819 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-06T03:13:12.852 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-06T03:13:12.853 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-06T03:13:12.885 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-06-06T03:13:12.886 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-06T03:13:12.916 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-06-06T03:13:12.917 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-06-06T03:13:12.917 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/daemon-helper 2024-06-06T03:13:12.947 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-06T03:13:13.017 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-06T03:13:13.017 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/daemon-helper 2024-06-06T03:13:13.047 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-06T03:13:13.116 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-06-06T03:13:13.116 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/daemon-helper 2024-06-06T03:13:13.147 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-06T03:13:13.217 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-06-06T03:13:13.217 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-06-06T03:13:13.217 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-06T03:13:13.248 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-06T03:13:13.318 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-06T03:13:13.318 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-06T03:13:13.348 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-06T03:13:13.417 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-06-06T03:13:13.417 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-06T03:13:13.442 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-06T03:13:13.507 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-06-06T03:13:13.508 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-06-06T03:13:13.508 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/stdin-killer 2024-06-06T03:13:13.537 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-06T03:13:13.607 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-06T03:13:13.607 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/stdin-killer 2024-06-06T03:13:13.636 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-06T03:13:13.706 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-06-06T03:13:13.706 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/stdin-killer 2024-06-06T03:13:13.731 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-06T03:13:13.796 INFO:teuthology.run_tasks:Running task cephadm... 2024-06-06T03:13:13.887 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-06-06T03:13:13.887 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-06T03:13:13.888 INFO:tasks.cephadm:Cluster fsid is b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:13:13.888 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-06-06T03:13:13.888 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.50', 'mon.b': '172.21.15.79', 'mon.c': '172.21.15.122'} 2024-06-06T03:13:13.888 INFO:tasks.cephadm:First mon is mon.a on smithi050 2024-06-06T03:13:13.889 INFO:tasks.cephadm:First mgr is x 2024-06-06T03:13:13.889 INFO:tasks.cephadm:Normalizing hostnames... 2024-06-06T03:13:13.889 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname $(hostname -s) 2024-06-06T03:13:13.920 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname $(hostname -s) 2024-06-06T03:13:13.950 DEBUG:teuthology.orchestra.run.smithi122:> sudo hostname $(hostname -s) 2024-06-06T03:13:13.975 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-06-06T03:13:13.976 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-06T03:13:14.197 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/55273/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-2946-g3d89accf', 'node_name': '172.21.2.14+braggi14', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-2946.g3d89accf'}, 'url': 'https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-05-30 17:04:17.570799', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-06-06T03:13:14.337 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref squid, sha1 3d89accfe3201286f000e065a1faea2a88c7a6ba from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-06T03:13:14.338 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/x86_64/flavors/default/cephadm 2024-06-06T03:13:14.339 DEBUG:teuthology.orchestra.run.smithi050:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-06-06T03:13:14.735 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r--. 1 ubuntu ubuntu 781907 Jun 6 03:13 /home/ubuntu/cephtest/cephadm 2024-06-06T03:13:14.735 DEBUG:teuthology.orchestra.run.smithi079:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-06-06T03:13:15.280 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r--. 1 ubuntu ubuntu 781907 Jun 6 03:13 /home/ubuntu/cephtest/cephadm 2024-06-06T03:13:15.280 DEBUG:teuthology.orchestra.run.smithi122:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-06-06T03:13:15.823 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r--. 1 ubuntu ubuntu 781907 Jun 6 03:13 /home/ubuntu/cephtest/cephadm 2024-06-06T03:13:15.823 DEBUG:teuthology.orchestra.run.smithi050:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-06-06T03:13:15.843 DEBUG:teuthology.orchestra.run.smithi079:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-06-06T03:13:15.863 DEBUG:teuthology.orchestra.run.smithi122:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-06-06T03:13:15.918 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba on all hosts... 2024-06-06T03:13:15.918 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba pull 2024-06-06T03:13:15.921 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba pull 2024-06-06T03:13:15.923 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba pull 2024-06-06T03:13:16.775 INFO:teuthology.orchestra.run.smithi079.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba... 2024-06-06T03:13:16.812 INFO:teuthology.orchestra.run.smithi050.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba... 2024-06-06T03:13:16.864 INFO:teuthology.orchestra.run.smithi122.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba... 2024-06-06T03:13:52.047 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:13:52.047 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-06T03:13:52.047 INFO:teuthology.orchestra.run.smithi050.stdout: "image_id": "b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1", 2024-06-06T03:13:52.047 INFO:teuthology.orchestra.run.smithi050.stdout: "repo_digests": [ 2024-06-06T03:13:52.047 INFO:teuthology.orchestra.run.smithi050.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9" 2024-06-06T03:13:52.047 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-06-06T03:13:52.048 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:14:03.500 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-06T03:14:03.500 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-06T03:14:03.500 INFO:teuthology.orchestra.run.smithi079.stdout: "image_id": "b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1", 2024-06-06T03:14:03.501 INFO:teuthology.orchestra.run.smithi079.stdout: "repo_digests": [ 2024-06-06T03:14:03.501 INFO:teuthology.orchestra.run.smithi079.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9" 2024-06-06T03:14:03.501 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-06-06T03:14:03.501 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-06T03:14:05.621 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-06-06T03:14:05.621 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-06T03:14:05.621 INFO:teuthology.orchestra.run.smithi122.stdout: "image_id": "b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1", 2024-06-06T03:14:05.621 INFO:teuthology.orchestra.run.smithi122.stdout: "repo_digests": [ 2024-06-06T03:14:05.621 INFO:teuthology.orchestra.run.smithi122.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9" 2024-06-06T03:14:05.621 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-06-06T03:14:05.622 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-06-06T03:14:05.645 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph 2024-06-06T03:14:05.681 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph 2024-06-06T03:14:05.715 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /etc/ceph 2024-06-06T03:14:05.743 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 777 /etc/ceph 2024-06-06T03:14:05.772 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 777 /etc/ceph 2024-06-06T03:14:05.800 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 777 /etc/ceph 2024-06-06T03:14:05.825 INFO:tasks.cephadm:Writing seed config... 2024-06-06T03:14:05.826 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-06-06T03:14:05.826 INFO:tasks.cephadm: override: [client] debug client = 20 2024-06-06T03:14:05.826 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-06-06T03:14:05.826 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-06-06T03:14:05.826 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-06-06T03:14:05.827 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-06-06T03:14:05.827 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-06-06T03:14:05.827 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-06-06T03:14:05.827 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-06-06T03:14:05.827 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-06-06T03:14:05.827 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-06-06T03:14:05.827 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-06-06T03:14:05.827 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-06-06T03:14:05.827 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-06-06T03:14:05.827 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-06-06T03:14:05.827 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-06-06T03:14:05.827 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-06-06T03:14:05.827 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-06-06T03:14:05.828 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-06-06T03:14:05.828 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-06-06T03:14:05.828 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-06-06T03:14:05.828 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-06-06T03:14:05.828 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-06-06T03:14:05.828 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-06-06T03:14:05.828 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-06-06T03:14:05.828 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-06-06T03:14:05.828 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-06-06T03:14:05.828 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-06-06T03:14:05.828 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-06-06T03:14:05.828 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-06-06T03:14:05.828 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-06-06T03:14:05.828 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-06-06T03:14:05.828 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-06-06T03:14:05.829 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-06-06T03:14:05.829 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-06-06T03:14:05.829 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-06-06T03:14:05.829 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-06-06T03:14:05.829 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-06-06T03:14:05.829 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-06-06T03:14:05.829 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-06-06T03:14:05.829 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-06-06T03:14:05.829 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-06-06T03:14:05.829 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-06-06T03:14:05.829 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-06-06T03:14:05.829 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-06-06T03:14:05.830 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-06-06T03:14:05.830 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-06-06T03:14:05.850 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = b6263b26-23b2-11ef-bc9b-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-06-06T03:14:05.850 DEBUG:teuthology.orchestra.run.smithi050:mon.a> sudo journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mon.a.service 2024-06-06T03:14:05.892 DEBUG:teuthology.orchestra.run.smithi050:mgr.x> sudo journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mgr.x.service 2024-06-06T03:14:05.936 INFO:tasks.cephadm:Bootstrapping... 2024-06-06T03:14:05.936 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba -v bootstrap --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.50 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-06-06T03:14:06.142 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-06-06T03:14:06.142 INFO:teuthology.orchestra.run.smithi050.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba', '-v', 'bootstrap', '--fsid', 'b6263b26-23b2-11ef-bc9b-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.50', '--skip-admin-label'] 2024-06-06T03:14:06.143 INFO:teuthology.orchestra.run.smithi050.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-06-06T03:14:06.143 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying podman|docker is present... 2024-06-06T03:14:06.168 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stdout 5.0.2 2024-06-06T03:14:06.168 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying lvm2 is present... 2024-06-06T03:14:06.168 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying time synchronization is in place... 2024-06-06T03:14:06.176 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-06-06T03:14:06.176 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-06-06T03:14:06.182 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-06-06T03:14:06.182 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2024-06-06T03:14:06.189 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout enabled 2024-06-06T03:14:06.196 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout active 2024-06-06T03:14:06.196 INFO:teuthology.orchestra.run.smithi050.stdout:Unit chronyd.service is enabled and running 2024-06-06T03:14:06.196 INFO:teuthology.orchestra.run.smithi050.stdout:Repeating the final host check... 2024-06-06T03:14:06.220 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stdout 5.0.2 2024-06-06T03:14:06.220 INFO:teuthology.orchestra.run.smithi050.stdout:podman (/bin/podman) version 5.0.2 is present 2024-06-06T03:14:06.221 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl is present 2024-06-06T03:14:06.221 INFO:teuthology.orchestra.run.smithi050.stdout:lvcreate is present 2024-06-06T03:14:06.227 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-06-06T03:14:06.227 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-06-06T03:14:06.234 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-06-06T03:14:06.234 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2024-06-06T03:14:06.241 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout enabled 2024-06-06T03:14:06.247 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout active 2024-06-06T03:14:06.248 INFO:teuthology.orchestra.run.smithi050.stdout:Unit chronyd.service is enabled and running 2024-06-06T03:14:06.248 INFO:teuthology.orchestra.run.smithi050.stdout:Host looks OK 2024-06-06T03:14:06.248 INFO:teuthology.orchestra.run.smithi050.stdout:Cluster fsid: b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:14:06.248 INFO:teuthology.orchestra.run.smithi050.stdout:Acquiring lock 139805538334080 on /run/cephadm/b6263b26-23b2-11ef-bc9b-c7b262605968.lock 2024-06-06T03:14:06.248 INFO:teuthology.orchestra.run.smithi050.stdout:Lock 139805538334080 acquired on /run/cephadm/b6263b26-23b2-11ef-bc9b-c7b262605968.lock 2024-06-06T03:14:06.249 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying IP 172.21.15.50 port 3300 ... 2024-06-06T03:14:06.249 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying IP 172.21.15.50 port 6789 ... 2024-06-06T03:14:06.249 INFO:teuthology.orchestra.run.smithi050.stdout:Base mon IP(s) is [172.21.15.50:3300, 172.21.15.50:6789], mon addrv is [v2:172.21.15.50:3300,v1:172.21.15.50:6789] 2024-06-06T03:14:06.252 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.50 metric 100 2024-06-06T03:14:06.252 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.50 metric 100 2024-06-06T03:14:06.255 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-06-06T03:14:06.255 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-06-06T03:14:06.255 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-06-06T03:14:06.258 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-06-06T03:14:06.258 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-06-06T03:14:06.258 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-06-06T03:14:06.258 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-06-06T03:14:06.258 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1584/64 scope link noprefixroute 2024-06-06T03:14:06.258 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-06-06T03:14:06.259 INFO:teuthology.orchestra.run.smithi050.stdout:Mon IP `172.21.15.50` is in CIDR network `172.21.0.0/20` 2024-06-06T03:14:06.259 INFO:teuthology.orchestra.run.smithi050.stdout:Mon IP `172.21.15.50` is in CIDR network `172.21.0.0/20` 2024-06-06T03:14:06.259 INFO:teuthology.orchestra.run.smithi050.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-06-06T03:14:06.259 INFO:teuthology.orchestra.run.smithi050.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-06-06T03:14:06.260 INFO:teuthology.orchestra.run.smithi050.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba... 2024-06-06T03:14:06.673 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stdout b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 2024-06-06T03:14:06.673 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba... 2024-06-06T03:14:06.673 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stderr Getting image source signatures 2024-06-06T03:14:06.673 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stderr Copying blob sha256:53b2d4191269e9d20972bfa652565296fad6514cf6a3d99f19db644875f67876 2024-06-06T03:14:06.674 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stderr Copying blob sha256:3ca969c7b6d79946c6f10490fffc00028babe7df67f50ed53c7bc209325e0612 2024-06-06T03:14:06.674 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stderr Copying config sha256:b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 2024-06-06T03:14:06.674 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stderr Writing manifest to image destination 2024-06-06T03:14:07.528 INFO:teuthology.orchestra.run.smithi050.stdout:ceph: stdout ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc) 2024-06-06T03:14:07.528 INFO:teuthology.orchestra.run.smithi050.stdout:Ceph version: ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc) 2024-06-06T03:14:07.528 INFO:teuthology.orchestra.run.smithi050.stdout:Extracting ceph user uid/gid from container image... 2024-06-06T03:14:08.493 INFO:teuthology.orchestra.run.smithi050.stdout:stat: stdout 167 167 2024-06-06T03:14:08.493 INFO:teuthology.orchestra.run.smithi050.stdout:Creating initial keys... 2024-06-06T03:14:09.315 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-authtool: stdout AQCAKWFmQjIHLxAAb8JyVEiz2WcZgF0Cjn5/Vw== 2024-06-06T03:14:10.229 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-authtool: stdout AQCBKWFmZkFvJxAA8Z0WekiXZX9l1nF+90/5pg== 2024-06-06T03:14:11.125 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-authtool: stdout AQCCKWFmz3KxHxAAT1LJ9zHdSPElXNFAOQ/Twg== 2024-06-06T03:14:11.126 INFO:teuthology.orchestra.run.smithi050.stdout:Creating initial monmap... 2024-06-06T03:14:16.718 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-06-06T03:14:16.718 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-06-06T03:14:16.718 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:14:16.718 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-06-06T03:14:16.718 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool for a [v2:172.21.15.50:3300,v1:172.21.15.50:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-06-06T03:14:16.718 INFO:teuthology.orchestra.run.smithi050.stdout:setting min_mon_release = quincy 2024-06-06T03:14:16.718 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/monmaptool: set fsid to b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:14:16.718 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-06-06T03:14:16.718 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:14:16.718 INFO:teuthology.orchestra.run.smithi050.stdout:Creating mon... 2024-06-06T03:14:17.573 INFO:teuthology.orchestra.run.smithi050.stdout:create mon.a on 2024-06-06T03:14:17.788 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-06-06T03:14:17.935 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-06-06T03:14:18.113 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-b6263b26-23b2-11ef-bc9b-c7b262605968.target → /etc/systemd/system/ceph-b6263b26-23b2-11ef-bc9b-c7b262605968.target. 2024-06-06T03:14:18.113 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-b6263b26-23b2-11ef-bc9b-c7b262605968.target → /etc/systemd/system/ceph-b6263b26-23b2-11ef-bc9b-c7b262605968.target. 2024-06-06T03:14:18.352 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mon.a 2024-06-06T03:14:18.352 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Failed to reset failed state of unit ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mon.a.service: Unit ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mon.a.service not loaded. 2024-06-06T03:14:18.598 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-b6263b26-23b2-11ef-bc9b-c7b262605968.target.wants/ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mon.a.service → /etc/systemd/system/ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@.service. 2024-06-06T03:14:19.090 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-06T03:14:19.090 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout disabled 2024-06-06T03:14:19.097 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-06T03:14:19.098 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2024-06-06T03:14:19.098 INFO:teuthology.orchestra.run.smithi050.stdout:firewalld.service is not enabled 2024-06-06T03:14:19.098 INFO:teuthology.orchestra.run.smithi050.stdout:Not possible to enable service . firewalld.service is not available 2024-06-06T03:14:19.098 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for mon to start... 2024-06-06T03:14:19.098 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for mon... 2024-06-06T03:14:20.291 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:20 smithi050 ceph-mon[32040]: from='client.? 172.21.15.50:0/1548567387' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-06-06T03:14:20.300 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout cluster: 2024-06-06T03:14:20.300 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout id: b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:14:20.300 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-06-06T03:14:20.300 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-06-06T03:14:20.300 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout services: 2024-06-06T03:14:20.300 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.622243s) 2024-06-06T03:14:20.300 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-06-06T03:14:20.300 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-06-06T03:14:20.300 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-06-06T03:14:20.300 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout data: 2024-06-06T03:14:20.301 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-06-06T03:14:20.301 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-06-06T03:14:20.301 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-06-06T03:14:20.301 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout pgs: 2024-06-06T03:14:20.301 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-06-06T03:14:20.301 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.600+0000 7fbc58a6d700 1 Processor -- start 2024-06-06T03:14:20.301 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.600+0000 7fbc58a6d700 1 -- start start 2024-06-06T03:14:20.301 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.601+0000 7fbc58a6d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc541087d0 0x7fbc5410abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:20.301 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.601+0000 7fbc58a6d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5407be60 con 0x7fbc541087d0 2024-06-06T03:14:20.301 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.601+0000 7fbc5259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc541087d0 0x7fbc5410abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:20.301 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.601+0000 7fbc5259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc541087d0 0x7fbc5410abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41224/0 (socket says 172.21.15.50:41224) 2024-06-06T03:14:20.301 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.601+0000 7fbc5259c700 1 -- 172.21.15.50:0/3401328263 learned_addr learned my addr 172.21.15.50:0/3401328263 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:20.302 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.601+0000 7fbc5259c700 1 -- 172.21.15.50:0/3401328263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc5410b100 con 0x7fbc541087d0 2024-06-06T03:14:20.302 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.602+0000 7fbc5259c700 1 --2- 172.21.15.50:0/3401328263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc541087d0 0x7fbc5410abc0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fbc440098a0 tx=0x7fbc44009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d462c1d3f14d4a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:20.302 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.602+0000 7fbc5159a700 1 -- 172.21.15.50:0/3401328263 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc44004160 con 0x7fbc541087d0 2024-06-06T03:14:20.302 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.602+0000 7fbc5159a700 1 -- 172.21.15.50:0/3401328263 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc44004300 con 0x7fbc541087d0 2024-06-06T03:14:20.302 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.602+0000 7fbc5159a700 1 -- 172.21.15.50:0/3401328263 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc440036a0 con 0x7fbc541087d0 2024-06-06T03:14:20.302 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.602+0000 7fbc58a6d700 1 -- 172.21.15.50:0/3401328263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc541087d0 msgr2=0x7fbc5410abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:20.302 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.602+0000 7fbc58a6d700 1 --2- 172.21.15.50:0/3401328263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc541087d0 0x7fbc5410abc0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fbc440098a0 tx=0x7fbc44009bb0 comp rx=0 tx=0).stop 2024-06-06T03:14:20.302 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.603+0000 7fbc58a6d700 1 -- 172.21.15.50:0/3401328263 shutdown_connections 2024-06-06T03:14:20.302 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.603+0000 7fbc58a6d700 1 --2- 172.21.15.50:0/3401328263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc541087d0 0x7fbc5410abc0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:20.302 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.603+0000 7fbc58a6d700 1 -- 172.21.15.50:0/3401328263 >> 172.21.15.50:0/3401328263 conn(0x7fbc541021e0 msgr2=0x7fbc54104600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:20.302 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.603+0000 7fbc58a6d700 1 -- 172.21.15.50:0/3401328263 shutdown_connections 2024-06-06T03:14:20.303 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.603+0000 7fbc58a6d700 1 -- 172.21.15.50:0/3401328263 wait complete. 2024-06-06T03:14:20.303 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.603+0000 7fbc58a6d700 1 Processor -- start 2024-06-06T03:14:20.303 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.603+0000 7fbc58a6d700 1 -- start start 2024-06-06T03:14:20.303 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.604+0000 7fbc58a6d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc541087d0 0x7fbc5419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:20.303 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.604+0000 7fbc58a6d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5410b570 con 0x7fbc541087d0 2024-06-06T03:14:20.303 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.604+0000 7fbc5259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc541087d0 0x7fbc5419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:20.303 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.604+0000 7fbc5259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc541087d0 0x7fbc5419d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41230/0 (socket says 172.21.15.50:41230) 2024-06-06T03:14:20.303 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.604+0000 7fbc5259c700 1 -- 172.21.15.50:0/1548567387 learned_addr learned my addr 172.21.15.50:0/1548567387 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:20.303 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.604+0000 7fbc5259c700 1 -- 172.21.15.50:0/1548567387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc5419dba0 con 0x7fbc541087d0 2024-06-06T03:14:20.303 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.604+0000 7fbc5259c700 1 --2- 172.21.15.50:0/1548567387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc541087d0 0x7fbc5419d660 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fbc44000c00 tx=0x7fbc44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:20.303 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.604+0000 7fbc437fe700 1 -- 172.21.15.50:0/1548567387 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc44003db0 con 0x7fbc541087d0 2024-06-06T03:14:20.303 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.604+0000 7fbc437fe700 1 -- 172.21.15.50:0/1548567387 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc44011630 con 0x7fbc541087d0 2024-06-06T03:14:20.303 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.604+0000 7fbc437fe700 1 -- 172.21.15.50:0/1548567387 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc44011950 con 0x7fbc541087d0 2024-06-06T03:14:20.303 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.604+0000 7fbc58a6d700 1 -- 172.21.15.50:0/1548567387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc5419de30 con 0x7fbc541087d0 2024-06-06T03:14:20.304 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.604+0000 7fbc58a6d700 1 -- 172.21.15.50:0/1548567387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc541a0b20 con 0x7fbc541087d0 2024-06-06T03:14:20.304 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.605+0000 7fbc437fe700 1 -- 172.21.15.50:0/1548567387 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbc44011af0 con 0x7fbc541087d0 2024-06-06T03:14:20.304 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.605+0000 7fbc437fe700 1 -- 172.21.15.50:0/1548567387 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbc4401c450 con 0x7fbc541087d0 2024-06-06T03:14:20.304 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.605+0000 7fbc58a6d700 1 -- 172.21.15.50:0/1548567387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc54063af0 con 0x7fbc541087d0 2024-06-06T03:14:20.304 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.608+0000 7fbc437fe700 1 -- 172.21.15.50:0/1548567387 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fbc44004260 con 0x7fbc541087d0 2024-06-06T03:14:20.304 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.682+0000 7fbc58a6d700 1 -- 172.21.15.50:0/1548567387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fbc5402de20 con 0x7fbc541087d0 2024-06-06T03:14:20.304 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.682+0000 7fbc437fe700 1 -- 172.21.15.50:0/1548567387 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fbc4401b450 con 0x7fbc541087d0 2024-06-06T03:14:20.304 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.683+0000 7fbc58a6d700 1 -- 172.21.15.50:0/1548567387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc541087d0 msgr2=0x7fbc5419d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:20.304 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.683+0000 7fbc58a6d700 1 --2- 172.21.15.50:0/1548567387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc541087d0 0x7fbc5419d660 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fbc44000c00 tx=0x7fbc44004750 comp rx=0 tx=0).stop 2024-06-06T03:14:20.304 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.683+0000 7fbc58a6d700 1 -- 172.21.15.50:0/1548567387 shutdown_connections 2024-06-06T03:14:20.304 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.683+0000 7fbc58a6d700 1 --2- 172.21.15.50:0/1548567387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc541087d0 0x7fbc5419d660 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:20.304 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.683+0000 7fbc58a6d700 1 -- 172.21.15.50:0/1548567387 >> 172.21.15.50:0/1548567387 conn(0x7fbc541021e0 msgr2=0x7fbc54103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:20.304 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.683+0000 7fbc58a6d700 1 -- 172.21.15.50:0/1548567387 shutdown_connections 2024-06-06T03:14:20.304 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:19.683+0000 7fbc58a6d700 1 -- 172.21.15.50:0/1548567387 wait complete. 2024-06-06T03:14:20.305 INFO:teuthology.orchestra.run.smithi050.stdout:mon is available 2024-06-06T03:14:20.305 INFO:teuthology.orchestra.run.smithi050.stdout:Assimilating anything we can from ceph.conf... 2024-06-06T03:14:21.154 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:21 smithi050 ceph-mon[32040]: from='client.? 172.21.15.50:0/3619771019' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-06-06T03:14:21.154 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:21 smithi050 ceph-mon[32040]: from='client.? 172.21.15.50:0/3619771019' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-06-06T03:14:21.417 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-06-06T03:14:21.424 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout [global] 2024-06-06T03:14:21.424 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout fsid = b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:14:21.424 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.50:3300,v1:172.21.15.50:6789] 2024-06-06T03:14:21.424 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-06-06T03:14:21.424 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-06-06T03:14:21.424 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-06-06T03:14:21.424 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-06-06T03:14:21.424 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-06-06T03:14:21.424 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout [mgr] 2024-06-06T03:14:21.424 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-06-06T03:14:21.424 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-06-06T03:14:21.424 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout [osd] 2024-06-06T03:14:21.425 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-06-06T03:14:21.425 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-06-06T03:14:21.425 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-06-06T03:14:21.425 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-06-06T03:14:21.425 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-06-06T03:14:21.425 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.753+0000 7f653124d700 1 Processor -- start 2024-06-06T03:14:21.425 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.754+0000 7f653124d700 1 -- start start 2024-06-06T03:14:21.425 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.754+0000 7f653124d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f652c108860 0x7f652c10ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:21.425 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.754+0000 7f653124d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f652c07be60 con 0x7f652c108860 2024-06-06T03:14:21.425 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.754+0000 7f652ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f652c108860 0x7f652c10ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:21.425 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.754+0000 7f652ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f652c108860 0x7f652c10ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41234/0 (socket says 172.21.15.50:41234) 2024-06-06T03:14:21.425 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.754+0000 7f652ad9d700 1 -- 172.21.15.50:0/8297327 learned_addr learned my addr 172.21.15.50:0/8297327 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:21.425 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.754+0000 7f652ad9d700 1 -- 172.21.15.50:0/8297327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652c10b190 con 0x7f652c108860 2024-06-06T03:14:21.426 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.755+0000 7f652ad9d700 1 --2- 172.21.15.50:0/8297327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f652c108860 0x7f652c10ac50 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f651c0098a0 tx=0x7f651c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=787f010dd2423be4 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:21.426 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.755+0000 7f6529d9b700 1 -- 172.21.15.50:0/8297327 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f651c004160 con 0x7f652c108860 2024-06-06T03:14:21.426 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.755+0000 7f6529d9b700 1 -- 172.21.15.50:0/8297327 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f651c004300 con 0x7f652c108860 2024-06-06T03:14:21.426 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.755+0000 7f6529d9b700 1 -- 172.21.15.50:0/8297327 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f651c0036a0 con 0x7f652c108860 2024-06-06T03:14:21.426 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.755+0000 7f653124d700 1 -- 172.21.15.50:0/8297327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f652c108860 msgr2=0x7f652c10ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:21.426 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.755+0000 7f653124d700 1 --2- 172.21.15.50:0/8297327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f652c108860 0x7f652c10ac50 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f651c0098a0 tx=0x7f651c009bb0 comp rx=0 tx=0).stop 2024-06-06T03:14:21.426 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.755+0000 7f653124d700 1 -- 172.21.15.50:0/8297327 shutdown_connections 2024-06-06T03:14:21.426 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.755+0000 7f653124d700 1 --2- 172.21.15.50:0/8297327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f652c108860 0x7f652c10ac50 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:21.426 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.755+0000 7f653124d700 1 -- 172.21.15.50:0/8297327 >> 172.21.15.50:0/8297327 conn(0x7f652c102290 msgr2=0x7f652c1046b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:21.426 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.755+0000 7f653124d700 1 -- 172.21.15.50:0/8297327 shutdown_connections 2024-06-06T03:14:21.426 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.755+0000 7f653124d700 1 -- 172.21.15.50:0/8297327 wait complete. 2024-06-06T03:14:21.426 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.756+0000 7f653124d700 1 Processor -- start 2024-06-06T03:14:21.426 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.756+0000 7f653124d700 1 -- start start 2024-06-06T03:14:21.427 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.756+0000 7f653124d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f652c108860 0x7f652c19b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:21.427 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.756+0000 7f653124d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f652c10b600 con 0x7f652c108860 2024-06-06T03:14:21.427 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.757+0000 7f652ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f652c108860 0x7f652c19b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:21.427 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.757+0000 7f652ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f652c108860 0x7f652c19b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41246/0 (socket says 172.21.15.50:41246) 2024-06-06T03:14:21.427 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.757+0000 7f652ad9d700 1 -- 172.21.15.50:0/3619771019 learned_addr learned my addr 172.21.15.50:0/3619771019 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:21.427 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.757+0000 7f652ad9d700 1 -- 172.21.15.50:0/3619771019 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652c19b9a0 con 0x7f652c108860 2024-06-06T03:14:21.427 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.757+0000 7f652ad9d700 1 --2- 172.21.15.50:0/3619771019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f652c108860 0x7f652c19b460 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f651c000c00 tx=0x7f651c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:21.427 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.757+0000 7f6523fff700 1 -- 172.21.15.50:0/3619771019 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f651c003db0 con 0x7f652c108860 2024-06-06T03:14:21.427 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.757+0000 7f6523fff700 1 -- 172.21.15.50:0/3619771019 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f651c011630 con 0x7f652c108860 2024-06-06T03:14:21.427 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.757+0000 7f6523fff700 1 -- 172.21.15.50:0/3619771019 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f651c011950 con 0x7f652c108860 2024-06-06T03:14:21.427 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.757+0000 7f653124d700 1 -- 172.21.15.50:0/3619771019 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f652c19bc30 con 0x7f652c108860 2024-06-06T03:14:21.427 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.757+0000 7f653124d700 1 -- 172.21.15.50:0/3619771019 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f652c19e920 con 0x7f652c108860 2024-06-06T03:14:21.427 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.757+0000 7f6523fff700 1 -- 172.21.15.50:0/3619771019 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f651c011af0 con 0x7f652c108860 2024-06-06T03:14:21.428 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.758+0000 7f6523fff700 1 -- 172.21.15.50:0/3619771019 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f651c01c450 con 0x7f652c108860 2024-06-06T03:14:21.428 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.758+0000 7f653124d700 1 -- 172.21.15.50:0/3619771019 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f652c063af0 con 0x7f652c108860 2024-06-06T03:14:21.428 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.761+0000 7f6523fff700 1 -- 172.21.15.50:0/3619771019 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f651c004260 con 0x7f652c108860 2024-06-06T03:14:21.428 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.831+0000 7f653124d700 1 -- 172.21.15.50:0/3619771019 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f652c02deb0 con 0x7f652c108860 2024-06-06T03:14:21.428 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.834+0000 7f6523fff700 1 -- 172.21.15.50:0/3619771019 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f651c01b450 con 0x7f652c108860 2024-06-06T03:14:21.428 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.835+0000 7f6523fff700 1 -- 172.21.15.50:0/3619771019 <== mon.0 v2:172.21.15.50:3300/0 8 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f651c01b630 con 0x7f652c108860 2024-06-06T03:14:21.428 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.836+0000 7f653124d700 1 -- 172.21.15.50:0/3619771019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f652c108860 msgr2=0x7f652c19b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:21.428 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.836+0000 7f653124d700 1 --2- 172.21.15.50:0/3619771019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f652c108860 0x7f652c19b460 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f651c000c00 tx=0x7f651c004750 comp rx=0 tx=0).stop 2024-06-06T03:14:21.428 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.836+0000 7f653124d700 1 -- 172.21.15.50:0/3619771019 shutdown_connections 2024-06-06T03:14:21.428 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.836+0000 7f653124d700 1 --2- 172.21.15.50:0/3619771019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f652c108860 0x7f652c19b460 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:21.428 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.836+0000 7f653124d700 1 -- 172.21.15.50:0/3619771019 >> 172.21.15.50:0/3619771019 conn(0x7f652c102290 msgr2=0x7f652c103100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:21.428 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.836+0000 7f653124d700 1 -- 172.21.15.50:0/3619771019 shutdown_connections 2024-06-06T03:14:21.428 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:20.836+0000 7f653124d700 1 -- 172.21.15.50:0/3619771019 wait complete. 2024-06-06T03:14:21.428 INFO:teuthology.orchestra.run.smithi050.stdout:Generating new minimal ceph.conf... 2024-06-06T03:14:22.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:22 smithi050 ceph-mon[32040]: from='client.? 172.21.15.50:0/775571657' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:14:22.970 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.283+0000 7f970f7fb700 1 Processor -- start 2024-06-06T03:14:22.970 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.284+0000 7f970f7fb700 1 -- start start 2024-06-06T03:14:22.970 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.284+0000 7f970f7fb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9708106c80 0x7f97081070a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:22.970 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.284+0000 7f970f7fb700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9708107670 con 0x7f9708106c80 2024-06-06T03:14:22.970 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.284+0000 7f970d597700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9708106c80 0x7f97081070a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:22.970 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.284+0000 7f970d597700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9708106c80 0x7f97081070a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41262/0 (socket says 172.21.15.50:41262) 2024-06-06T03:14:22.970 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.284+0000 7f970d597700 1 -- 172.21.15.50:0/1270442426 learned_addr learned my addr 172.21.15.50:0/1270442426 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:22.970 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.284+0000 7f970d597700 1 -- 172.21.15.50:0/1270442426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9708107e80 con 0x7f9708106c80 2024-06-06T03:14:22.971 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.285+0000 7f970d597700 1 --2- 172.21.15.50:0/1270442426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9708106c80 0x7f97081070a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f97040098a0 tx=0x7f9704009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3691d124642e25a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:22.971 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.285+0000 7f96fbfff700 1 -- 172.21.15.50:0/1270442426 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9704004160 con 0x7f9708106c80 2024-06-06T03:14:22.971 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.285+0000 7f96fbfff700 1 -- 172.21.15.50:0/1270442426 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f9704004300 con 0x7f9708106c80 2024-06-06T03:14:22.971 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.285+0000 7f96fbfff700 1 -- 172.21.15.50:0/1270442426 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9704011a80 con 0x7f9708106c80 2024-06-06T03:14:22.971 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.285+0000 7f970f7fb700 1 -- 172.21.15.50:0/1270442426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9708106c80 msgr2=0x7f97081070a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:22.971 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.285+0000 7f970f7fb700 1 --2- 172.21.15.50:0/1270442426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9708106c80 0x7f97081070a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f97040098a0 tx=0x7f9704009bb0 comp rx=0 tx=0).stop 2024-06-06T03:14:22.971 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.285+0000 7f970f7fb700 1 -- 172.21.15.50:0/1270442426 shutdown_connections 2024-06-06T03:14:22.971 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.285+0000 7f970f7fb700 1 --2- 172.21.15.50:0/1270442426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9708106c80 0x7f97081070a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:22.971 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.285+0000 7f970f7fb700 1 -- 172.21.15.50:0/1270442426 >> 172.21.15.50:0/1270442426 conn(0x7f9708102240 msgr2=0x7f9708104660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:22.971 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.286+0000 7f970f7fb700 1 -- 172.21.15.50:0/1270442426 shutdown_connections 2024-06-06T03:14:22.971 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.286+0000 7f970f7fb700 1 -- 172.21.15.50:0/1270442426 wait complete. 2024-06-06T03:14:22.971 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.286+0000 7f970f7fb700 1 Processor -- start 2024-06-06T03:14:22.972 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.286+0000 7f970f7fb700 1 -- start start 2024-06-06T03:14:22.972 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.286+0000 7f970f7fb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9708106c80 0x7f9708191df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:22.972 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.286+0000 7f970f7fb700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f970810b230 con 0x7f9708106c80 2024-06-06T03:14:22.972 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.286+0000 7f970d597700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9708106c80 0x7f9708191df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:22.972 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.286+0000 7f970d597700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9708106c80 0x7f9708191df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41266/0 (socket says 172.21.15.50:41266) 2024-06-06T03:14:22.972 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.286+0000 7f970d597700 1 -- 172.21.15.50:0/775571657 learned_addr learned my addr 172.21.15.50:0/775571657 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:22.972 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.287+0000 7f970d597700 1 -- 172.21.15.50:0/775571657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9708192330 con 0x7f9708106c80 2024-06-06T03:14:22.972 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.287+0000 7f970d597700 1 --2- 172.21.15.50:0/775571657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9708106c80 0x7f9708191df0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9704000c00 tx=0x7f9704011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:22.972 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.287+0000 7f96fa7fc700 1 -- 172.21.15.50:0/775571657 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97040039f0 con 0x7f9708106c80 2024-06-06T03:14:22.972 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.287+0000 7f96fa7fc700 1 -- 172.21.15.50:0/775571657 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f9704003b90 con 0x7f9708106c80 2024-06-06T03:14:22.972 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.287+0000 7f96fa7fc700 1 -- 172.21.15.50:0/775571657 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f970401a740 con 0x7f9708106c80 2024-06-06T03:14:22.972 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.287+0000 7f970f7fb700 1 -- 172.21.15.50:0/775571657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9708190520 con 0x7f9708106c80 2024-06-06T03:14:22.972 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.287+0000 7f970f7fb700 1 -- 172.21.15.50:0/775571657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9708190a60 con 0x7f9708106c80 2024-06-06T03:14:22.973 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.287+0000 7f96fa7fc700 1 -- 172.21.15.50:0/775571657 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f970402d3f0 con 0x7f9708106c80 2024-06-06T03:14:22.973 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.287+0000 7f96fa7fc700 1 -- 172.21.15.50:0/775571657 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9704019700 con 0x7f9708106c80 2024-06-06T03:14:22.973 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.288+0000 7f970f7fb700 1 -- 172.21.15.50:0/775571657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9708063af0 con 0x7f9708106c80 2024-06-06T03:14:22.973 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.290+0000 7f96fa7fc700 1 -- 172.21.15.50:0/775571657 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f9704024af0 con 0x7f9708106c80 2024-06-06T03:14:22.973 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.361+0000 7f970f7fb700 1 -- 172.21.15.50:0/775571657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f9708195700 con 0x7f9708106c80 2024-06-06T03:14:22.973 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.362+0000 7f96fa7fc700 1 -- 172.21.15.50:0/775571657 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f9704032030 con 0x7f9708106c80 2024-06-06T03:14:22.973 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.363+0000 7f970f7fb700 1 -- 172.21.15.50:0/775571657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9708106c80 msgr2=0x7f9708191df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:22.973 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.363+0000 7f970f7fb700 1 --2- 172.21.15.50:0/775571657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9708106c80 0x7f9708191df0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9704000c00 tx=0x7f9704011b00 comp rx=0 tx=0).stop 2024-06-06T03:14:22.973 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.363+0000 7f970f7fb700 1 -- 172.21.15.50:0/775571657 shutdown_connections 2024-06-06T03:14:22.973 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.363+0000 7f970f7fb700 1 --2- 172.21.15.50:0/775571657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9708106c80 0x7f9708191df0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:22.973 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.363+0000 7f970f7fb700 1 -- 172.21.15.50:0/775571657 >> 172.21.15.50:0/775571657 conn(0x7f9708102240 msgr2=0x7f97081030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:22.973 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.363+0000 7f970f7fb700 1 -- 172.21.15.50:0/775571657 shutdown_connections 2024-06-06T03:14:22.973 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:22.363+0000 7f970f7fb700 1 -- 172.21.15.50:0/775571657 wait complete. 2024-06-06T03:14:22.973 INFO:teuthology.orchestra.run.smithi050.stdout:Restarting the monitor... 2024-06-06T03:14:23.243 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:22 smithi050 systemd[1]: Stopping Ceph mon.a for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:14:23.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:23 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mon-a[32036]: 2024-06-06T03:14:23.242+0000 7f4840d7c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T03:14:23.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:23 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mon-a[32036]: 2024-06-06T03:14:23.242+0000 7f4840d7c700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-06-06T03:14:23.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:23 smithi050 podman[32296]: 2024-06-06 03:14:23.284426625 +0000 UTC m=+0.140889218 container died 9ce9f39b576eb781c29906b353d9fb00216426cc3a77fce7f2a9b24c0f183313 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mon-a, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-06-06T03:14:23.969 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:23 smithi050 podman[32296]: 2024-06-06 03:14:23.609477371 +0000 UTC m=+0.465939964 container cleanup 9ce9f39b576eb781c29906b353d9fb00216426cc3a77fce7f2a9b24c0f183313 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mon-a, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD) 2024-06-06T03:14:23.969 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:23 smithi050 bash[32296]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mon-a 2024-06-06T03:14:23.969 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:23 smithi050 podman[32308]: 2024-06-06 03:14:23.760206141 +0000 UTC m=+0.470813572 container remove 9ce9f39b576eb781c29906b353d9fb00216426cc3a77fce7f2a9b24c0f183313 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mon-a, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0) 2024-06-06T03:14:24.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:23 smithi050 systemd[1]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mon.a.service: Deactivated successfully. 2024-06-06T03:14:24.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:23 smithi050 systemd[1]: Stopped Ceph mon.a for b6263b26-23b2-11ef-bc9b-c7b262605968. 2024-06-06T03:14:24.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:23 smithi050 systemd[1]: Starting Ceph mon.a for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:14:24.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 podman[32402]: 2024-06-06 03:14:24.202891105 +0000 UTC m=+0.111982693 container create b4c44489782c836189abc33dbe7c8393ea4dec329aaec4e9e8b59e7a381bb9b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mon-a, ceph=True, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-06-06T03:14:24.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 podman[32402]: 2024-06-06 03:14:24.108596778 +0000 UTC m=+0.017688382 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-06T03:14:24.492 INFO:teuthology.orchestra.run.smithi050.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-06-06T03:14:24.614 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 podman[32402]: 2024-06-06 03:14:24.405592385 +0000 UTC m=+0.314683971 container init b4c44489782c836189abc33dbe7c8393ea4dec329aaec4e9e8b59e7a381bb9b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mon-a, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T03:14:24.614 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 podman[32402]: 2024-06-06 03:14:24.408784379 +0000 UTC m=+0.317875965 container start b4c44489782c836189abc33dbe7c8393ea4dec329aaec4e9e8b59e7a381bb9b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2) 2024-06-06T03:14:24.615 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: set uid:gid to 167:167 (ceph:ceph) 2024-06-06T03:14:24.615 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc), process ceph-mon, pid 2 2024-06-06T03:14:24.615 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: pidfile_write: ignore empty --pid-file 2024-06-06T03:14:24.615 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: load: jerasure load: lrc 2024-06-06T03:14:24.615 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: RocksDB version: 7.9.2 2024-06-06T03:14:24.615 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Git sha 0 2024-06-06T03:14:24.615 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Compile date 2024-05-30 15:42:47 2024-06-06T03:14:24.615 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: DB SUMMARY 2024-06-06T03:14:24.615 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: DB Session ID: WVMJZYXPCK2GFN0MF2ZA 2024-06-06T03:14:24.615 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: CURRENT file: CURRENT 2024-06-06T03:14:24.615 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: IDENTITY file: IDENTITY 2024-06-06T03:14:24.615 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-06-06T03:14:24.616 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-06-06T03:14:24.616 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 104316 ; 2024-06-06T03:14:24.616 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.error_if_exists: 0 2024-06-06T03:14:24.616 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.create_if_missing: 0 2024-06-06T03:14:24.616 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.paranoid_checks: 1 2024-06-06T03:14:24.616 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.flush_verify_memtable_count: 1 2024-06-06T03:14:24.616 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-06-06T03:14:24.616 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-06-06T03:14:24.616 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.env: 0x559321153c60 2024-06-06T03:14:24.617 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.fs: PosixFileSystem 2024-06-06T03:14:24.617 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.info_log: 0x559322f23b20 2024-06-06T03:14:24.617 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.max_file_opening_threads: 16 2024-06-06T03:14:24.617 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.statistics: (nil) 2024-06-06T03:14:24.617 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.use_fsync: 0 2024-06-06T03:14:24.617 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.max_log_file_size: 0 2024-06-06T03:14:24.617 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-06-06T03:14:24.617 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.log_file_time_to_roll: 0 2024-06-06T03:14:24.617 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.keep_log_file_num: 1000 2024-06-06T03:14:24.617 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.recycle_log_file_num: 0 2024-06-06T03:14:24.617 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.allow_fallocate: 1 2024-06-06T03:14:24.617 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.allow_mmap_reads: 0 2024-06-06T03:14:24.617 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.allow_mmap_writes: 0 2024-06-06T03:14:24.617 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.use_direct_reads: 0 2024-06-06T03:14:24.617 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-06-06T03:14:24.618 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.create_missing_column_families: 0 2024-06-06T03:14:24.618 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.db_log_dir: 2024-06-06T03:14:24.618 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.wal_dir: 2024-06-06T03:14:24.618 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.table_cache_numshardbits: 6 2024-06-06T03:14:24.618 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.WAL_ttl_seconds: 0 2024-06-06T03:14:24.618 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.WAL_size_limit_MB: 0 2024-06-06T03:14:24.618 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-06-06T03:14:24.618 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-06-06T03:14:24.618 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.is_fd_close_on_exec: 1 2024-06-06T03:14:24.618 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.advise_random_on_open: 1 2024-06-06T03:14:24.618 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.db_write_buffer_size: 0 2024-06-06T03:14:24.618 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.write_buffer_manager: 0x559322ef41e0 2024-06-06T03:14:24.618 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-06-06T03:14:24.619 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-06-06T03:14:24.619 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.use_adaptive_mutex: 0 2024-06-06T03:14:24.619 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.rate_limiter: (nil) 2024-06-06T03:14:24.619 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-06-06T03:14:24.619 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.wal_recovery_mode: 2 2024-06-06T03:14:24.619 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.enable_thread_tracking: 0 2024-06-06T03:14:24.619 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.enable_pipelined_write: 0 2024-06-06T03:14:24.619 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.unordered_write: 0 2024-06-06T03:14:24.619 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-06-06T03:14:24.619 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-06-06T03:14:24.619 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-06-06T03:14:24.619 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-06-06T03:14:24.619 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.row_cache: None 2024-06-06T03:14:24.619 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.wal_filter: None 2024-06-06T03:14:24.620 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-06-06T03:14:24.621 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.allow_ingest_behind: 0 2024-06-06T03:14:24.621 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.two_write_queues: 0 2024-06-06T03:14:24.621 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.manual_wal_flush: 0 2024-06-06T03:14:24.621 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.wal_compression: 0 2024-06-06T03:14:24.621 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.atomic_flush: 0 2024-06-06T03:14:24.621 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-06-06T03:14:24.621 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.persist_stats_to_disk: 0 2024-06-06T03:14:24.621 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.write_dbid_to_manifest: 0 2024-06-06T03:14:24.621 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.log_readahead_size: 0 2024-06-06T03:14:24.621 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-06-06T03:14:24.621 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.best_efforts_recovery: 0 2024-06-06T03:14:24.621 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-06-06T03:14:24.621 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-06-06T03:14:24.622 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.allow_data_in_errors: 0 2024-06-06T03:14:24.622 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.db_host_id: __hostname__ 2024-06-06T03:14:24.622 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.enforce_single_del_contracts: true 2024-06-06T03:14:24.622 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.max_background_jobs: 2 2024-06-06T03:14:24.622 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.max_background_compactions: -1 2024-06-06T03:14:24.622 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.max_subcompactions: 1 2024-06-06T03:14:24.622 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-06-06T03:14:24.622 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-06-06T03:14:24.622 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.delayed_write_rate : 16777216 2024-06-06T03:14:24.622 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.max_total_wal_size: 0 2024-06-06T03:14:24.622 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-06-06T03:14:24.623 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.stats_dump_period_sec: 600 2024-06-06T03:14:24.623 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.stats_persist_period_sec: 600 2024-06-06T03:14:24.623 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-06-06T03:14:24.623 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.max_open_files: -1 2024-06-06T03:14:24.623 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.bytes_per_sync: 0 2024-06-06T03:14:24.623 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.wal_bytes_per_sync: 0 2024-06-06T03:14:24.623 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.strict_bytes_per_sync: 0 2024-06-06T03:14:24.623 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.compaction_readahead_size: 0 2024-06-06T03:14:24.623 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.max_background_flushes: -1 2024-06-06T03:14:24.623 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Compression algorithms supported: 2024-06-06T03:14:24.623 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-06-06T03:14:24.624 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: kZSTD supported: 0 2024-06-06T03:14:24.624 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: kXpressCompression supported: 0 2024-06-06T03:14:24.624 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: kLZ4HCCompression supported: 1 2024-06-06T03:14:24.624 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: kZlibCompression supported: 1 2024-06-06T03:14:24.624 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: kSnappyCompression supported: 1 2024-06-06T03:14:24.624 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: kLZ4Compression supported: 1 2024-06-06T03:14:24.624 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: kBZip2Compression supported: 0 2024-06-06T03:14:24.624 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Fast CRC32 supported: Supported on x86 2024-06-06T03:14:24.624 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: DMutex implementation: pthread_mutex_t 2024-06-06T03:14:24.624 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-06-06T03:14:24.624 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-06-06T03:14:24.624 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-06-06T03:14:24.624 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.merge_operator: 2024-06-06T03:14:24.625 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.compaction_filter: None 2024-06-06T03:14:24.625 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.compaction_filter_factory: None 2024-06-06T03:14:24.625 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.sst_partitioner_factory: None 2024-06-06T03:14:24.625 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.memtable_factory: SkipListFactory 2024-06-06T03:14:24.625 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.table_factory: BlockBasedTable 2024-06-06T03:14:24.625 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559322f23c40) 2024-06-06T03:14:24.625 INFO:journalctl@ceph.mon.a.smithi050.stdout: cache_index_and_filter_blocks: 1 2024-06-06T03:14:24.625 INFO:journalctl@ceph.mon.a.smithi050.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-06-06T03:14:24.626 INFO:journalctl@ceph.mon.a.smithi050.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-06-06T03:14:24.626 INFO:journalctl@ceph.mon.a.smithi050.stdout: pin_top_level_index_and_filter: 1 2024-06-06T03:14:24.626 INFO:journalctl@ceph.mon.a.smithi050.stdout: index_type: 0 2024-06-06T03:14:24.626 INFO:journalctl@ceph.mon.a.smithi050.stdout: data_block_index_type: 0 2024-06-06T03:14:24.626 INFO:journalctl@ceph.mon.a.smithi050.stdout: index_shortening: 1 2024-06-06T03:14:24.626 INFO:journalctl@ceph.mon.a.smithi050.stdout: data_block_hash_table_util_ratio: 0.750000 2024-06-06T03:14:24.626 INFO:journalctl@ceph.mon.a.smithi050.stdout: checksum: 4 2024-06-06T03:14:24.626 INFO:journalctl@ceph.mon.a.smithi050.stdout: no_block_cache: 0 2024-06-06T03:14:24.626 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_cache: 0x559322f25090 2024-06-06T03:14:24.626 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_cache_name: BinnedLRUCache 2024-06-06T03:14:24.626 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_cache_options: 2024-06-06T03:14:24.626 INFO:journalctl@ceph.mon.a.smithi050.stdout: capacity : 536870912 2024-06-06T03:14:24.627 INFO:journalctl@ceph.mon.a.smithi050.stdout: num_shard_bits : 4 2024-06-06T03:14:24.627 INFO:journalctl@ceph.mon.a.smithi050.stdout: strict_capacity_limit : 0 2024-06-06T03:14:24.627 INFO:journalctl@ceph.mon.a.smithi050.stdout: high_pri_pool_ratio: 0.000 2024-06-06T03:14:24.627 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_cache_compressed: (nil) 2024-06-06T03:14:24.627 INFO:journalctl@ceph.mon.a.smithi050.stdout: persistent_cache: (nil) 2024-06-06T03:14:24.627 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_size: 4096 2024-06-06T03:14:24.627 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_size_deviation: 10 2024-06-06T03:14:24.627 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_restart_interval: 16 2024-06-06T03:14:24.627 INFO:journalctl@ceph.mon.a.smithi050.stdout: index_block_restart_interval: 1 2024-06-06T03:14:24.628 INFO:journalctl@ceph.mon.a.smithi050.stdout: metadata_block_size: 4096 2024-06-06T03:14:24.628 INFO:journalctl@ceph.mon.a.smithi050.stdout: partition_filters: 0 2024-06-06T03:14:24.628 INFO:journalctl@ceph.mon.a.smithi050.stdout: use_delta_encoding: 1 2024-06-06T03:14:24.628 INFO:journalctl@ceph.mon.a.smithi050.stdout: filter_policy: bloomfilter 2024-06-06T03:14:24.628 INFO:journalctl@ceph.mon.a.smithi050.stdout: whole_key_filtering: 1 2024-06-06T03:14:24.628 INFO:journalctl@ceph.mon.a.smithi050.stdout: verify_compression: 0 2024-06-06T03:14:24.628 INFO:journalctl@ceph.mon.a.smithi050.stdout: read_amp_bytes_per_bit: 0 2024-06-06T03:14:24.628 INFO:journalctl@ceph.mon.a.smithi050.stdout: format_version: 5 2024-06-06T03:14:24.628 INFO:journalctl@ceph.mon.a.smithi050.stdout: enable_index_compression: 1 2024-06-06T03:14:24.628 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_align: 0 2024-06-06T03:14:24.628 INFO:journalctl@ceph.mon.a.smithi050.stdout: max_auto_readahead_size: 262144 2024-06-06T03:14:24.628 INFO:journalctl@ceph.mon.a.smithi050.stdout: prepopulate_block_cache: 0 2024-06-06T03:14:24.628 INFO:journalctl@ceph.mon.a.smithi050.stdout: initial_auto_readahead_size: 8192 2024-06-06T03:14:24.629 INFO:journalctl@ceph.mon.a.smithi050.stdout: num_file_reads_for_auto_readahead: 2 2024-06-06T03:14:24.629 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.write_buffer_size: 33554432 2024-06-06T03:14:24.629 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.max_write_buffer_number: 2 2024-06-06T03:14:24.629 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.compression: NoCompression 2024-06-06T03:14:24.629 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.bottommost_compression: Disabled 2024-06-06T03:14:24.629 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.prefix_extractor: nullptr 2024-06-06T03:14:24.629 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-06-06T03:14:24.629 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.num_levels: 7 2024-06-06T03:14:24.629 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-06-06T03:14:24.629 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-06-06T03:14:24.629 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-06-06T03:14:24.630 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-06-06T03:14:24.630 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-06-06T03:14:24.630 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-06-06T03:14:24.630 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-06-06T03:14:24.630 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-06-06T03:14:24.630 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-06-06T03:14:24.630 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-06-06T03:14:24.630 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-06-06T03:14:24.630 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-06-06T03:14:24.630 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.compression_opts.window_bits: -14 2024-06-06T03:14:24.631 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.compression_opts.level: 32767 2024-06-06T03:14:24.631 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.compression_opts.strategy: 0 2024-06-06T03:14:24.631 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-06-06T03:14:24.631 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-06-06T03:14:24.631 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-06-06T03:14:24.631 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-06-06T03:14:24.631 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.compression_opts.enabled: false 2024-06-06T03:14:24.631 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-06-06T03:14:24.631 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-06-06T03:14:24.631 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-06-06T03:14:24.631 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-06-06T03:14:24.632 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.target_file_size_base: 67108864 2024-06-06T03:14:24.632 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.target_file_size_multiplier: 1 2024-06-06T03:14:24.632 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-06-06T03:14:24.632 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-06-06T03:14:24.632 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-06-06T03:14:24.632 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-06-06T03:14:24.632 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-06-06T03:14:24.632 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-06-06T03:14:24.632 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-06-06T03:14:24.632 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-06-06T03:14:24.633 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-06-06T03:14:24.633 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-06-06T03:14:24.633 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-06-06T03:14:24.633 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-06-06T03:14:24.633 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-06-06T03:14:24.633 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.arena_block_size: 1048576 2024-06-06T03:14:24.633 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-06-06T03:14:24.633 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-06-06T03:14:24.633 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.disable_auto_compactions: 0 2024-06-06T03:14:24.633 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-06-06T03:14:24.634 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-06-06T03:14:24.634 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-06-06T03:14:24.634 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-06-06T03:14:24.634 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-06-06T03:14:24.634 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-06-06T03:14:24.634 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-06-06T03:14:24.634 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-06-06T03:14:24.634 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-06-06T03:14:24.634 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-06-06T03:14:24.635 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.table_properties_collectors: 2024-06-06T03:14:24.635 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.inplace_update_support: 0 2024-06-06T03:14:24.635 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.inplace_update_num_locks: 10000 2024-06-06T03:14:24.635 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-06-06T03:14:24.635 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-06-06T03:14:24.635 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.memtable_huge_page_size: 0 2024-06-06T03:14:24.635 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.bloom_locality: 0 2024-06-06T03:14:24.635 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.max_successive_merges: 0 2024-06-06T03:14:24.635 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.optimize_filters_for_hits: 0 2024-06-06T03:14:24.636 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.paranoid_file_checks: 0 2024-06-06T03:14:24.636 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.force_consistency_checks: 1 2024-06-06T03:14:24.636 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.report_bg_io_stats: 0 2024-06-06T03:14:24.636 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.ttl: 2592000 2024-06-06T03:14:24.636 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.periodic_compaction_seconds: 0 2024-06-06T03:14:24.636 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-06-06T03:14:24.636 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-06-06T03:14:24.636 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.enable_blob_files: false 2024-06-06T03:14:24.636 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.min_blob_size: 0 2024-06-06T03:14:24.636 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.blob_file_size: 268435456 2024-06-06T03:14:24.636 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.blob_compression_type: NoCompression 2024-06-06T03:14:24.636 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.enable_blob_garbage_collection: false 2024-06-06T03:14:24.636 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-06-06T03:14:24.637 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-06-06T03:14:24.637 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-06-06T03:14:24.637 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.blob_file_starting_level: 0 2024-06-06T03:14:24.637 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-06-06T03:14:24.637 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-06-06T03:14:24.637 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-06-06T03:14:24.637 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a5c33d51-6147-4908-90fe-30e4dff2ae35 2024-06-06T03:14:24.637 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717643664438610, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-06-06T03:14:24.637 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-06-06T03:14:24.637 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717643664439750, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99485, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 324, "table_properties": {"data_size": 97393, "index_size": 310, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14052, "raw_average_key_size": 49, "raw_value_size": 89759, "raw_average_value_size": 317, "num_data_blocks": 12, "num_entries": 283, "num_filter_entries": 283, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1717643664, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a5c33d51-6147-4908-90fe-30e4dff2ae35", "db_session_id": "WVMJZYXPCK2GFN0MF2ZA", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-06-06T03:14:24.637 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717643664439836, "job": 1, "event": "recovery_finished"} 2024-06-06T03:14:24.637 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-06-06T03:14:24.637 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-06-06T03:14:24.638 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x559323014000 2024-06-06T03:14:24.638 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: DB pointer 0x559322ffe000 2024-06-06T03:14:24.638 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-06-06T03:14:24.638 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-06-06T03:14:24.638 INFO:journalctl@ceph.mon.a.smithi050.stdout: ** DB Stats ** 2024-06-06T03:14:24.638 INFO:journalctl@ceph.mon.a.smithi050.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-06T03:14:24.638 INFO:journalctl@ceph.mon.a.smithi050.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-06-06T03:14:24.638 INFO:journalctl@ceph.mon.a.smithi050.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-06T03:14:24.638 INFO:journalctl@ceph.mon.a.smithi050.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-06T03:14:24.638 INFO:journalctl@ceph.mon.a.smithi050.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-06-06T03:14:24.638 INFO:journalctl@ceph.mon.a.smithi050.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-06T03:14:24.638 INFO:journalctl@ceph.mon.a.smithi050.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-06T03:14:24.638 INFO:journalctl@ceph.mon.a.smithi050.stdout: 2024-06-06T03:14:24.639 INFO:journalctl@ceph.mon.a.smithi050.stdout: ** Compaction Stats [default] ** 2024-06-06T03:14:24.639 INFO:journalctl@ceph.mon.a.smithi050.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-06T03:14:24.639 INFO:journalctl@ceph.mon.a.smithi050.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-06-06T03:14:24.639 INFO:journalctl@ceph.mon.a.smithi050.stdout: L0 2/0 98.99 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 130.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-06T03:14:24.639 INFO:journalctl@ceph.mon.a.smithi050.stdout: Sum 2/0 98.99 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 130.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-06T03:14:24.639 INFO:journalctl@ceph.mon.a.smithi050.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 130.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-06T03:14:24.639 INFO:journalctl@ceph.mon.a.smithi050.stdout: 2024-06-06T03:14:24.639 INFO:journalctl@ceph.mon.a.smithi050.stdout: ** Compaction Stats [default] ** 2024-06-06T03:14:24.639 INFO:journalctl@ceph.mon.a.smithi050.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-06T03:14:24.639 INFO:journalctl@ceph.mon.a.smithi050.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-06T03:14:24.639 INFO:journalctl@ceph.mon.a.smithi050.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 130.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-06T03:14:24.639 INFO:journalctl@ceph.mon.a.smithi050.stdout: 2024-06-06T03:14:24.639 INFO:journalctl@ceph.mon.a.smithi050.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-06-06T03:14:24.639 INFO:journalctl@ceph.mon.a.smithi050.stdout: 2024-06-06T03:14:24.639 INFO:journalctl@ceph.mon.a.smithi050.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-06T03:14:24.640 INFO:journalctl@ceph.mon.a.smithi050.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-06-06T03:14:24.640 INFO:journalctl@ceph.mon.a.smithi050.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-06T03:14:24.640 INFO:journalctl@ceph.mon.a.smithi050.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-06T03:14:24.640 INFO:journalctl@ceph.mon.a.smithi050.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-06T03:14:24.640 INFO:journalctl@ceph.mon.a.smithi050.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-06T03:14:24.640 INFO:journalctl@ceph.mon.a.smithi050.stdout: Cumulative compaction: 0.00 GB write, 29.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-06T03:14:24.640 INFO:journalctl@ceph.mon.a.smithi050.stdout: Interval compaction: 0.00 GB write, 29.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-06T03:14:24.640 INFO:journalctl@ceph.mon.a.smithi050.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-06T03:14:24.640 INFO:journalctl@ceph.mon.a.smithi050.stdout: Block cache BinnedLRUCache@0x559322f25090#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-06-06T03:14:24.640 INFO:journalctl@ceph.mon.a.smithi050.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-06-06T03:14:24.640 INFO:journalctl@ceph.mon.a.smithi050.stdout: 2024-06-06T03:14:24.640 INFO:journalctl@ceph.mon.a.smithi050.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-06T03:14:24.640 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: starting mon.a rank 0 at public addrs [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] at bind addrs [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:14:24.641 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: mon.a@-1(???) e1 preinit fsid b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:14:24.641 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: mon.a@-1(???).mds e1 new map 2024-06-06T03:14:24.641 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: mon.a@-1(???).mds e1 print_map 2024-06-06T03:14:24.641 INFO:journalctl@ceph.mon.a.smithi050.stdout: e1 2024-06-06T03:14:24.641 INFO:journalctl@ceph.mon.a.smithi050.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-06T03:14:24.641 INFO:journalctl@ceph.mon.a.smithi050.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-06T03:14:24.641 INFO:journalctl@ceph.mon.a.smithi050.stdout: legacy client fscid: -1 2024-06-06T03:14:24.641 INFO:journalctl@ceph.mon.a.smithi050.stdout: 2024-06-06T03:14:24.641 INFO:journalctl@ceph.mon.a.smithi050.stdout: No filesystems configured 2024-06-06T03:14:24.641 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-06-06T03:14:24.641 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-06T03:14:24.641 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-06T03:14:24.641 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-06T03:14:24.641 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 ceph-mon[32421]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-06-06T03:14:24.641 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 bash[32402]: b4c44489782c836189abc33dbe7c8393ea4dec329aaec4e9e8b59e7a381bb9b4 2024-06-06T03:14:24.641 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:24 smithi050 systemd[1]: Started Ceph mon.a for b6263b26-23b2-11ef-bc9b-c7b262605968. 2024-06-06T03:14:25.620 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:25 smithi050 ceph-mon[32421]: mon.a is new leader, mons a in quorum (ranks 0) 2024-06-06T03:14:25.620 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:25 smithi050 ceph-mon[32421]: monmap epoch 1 2024-06-06T03:14:25.620 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:25 smithi050 ceph-mon[32421]: fsid b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:14:25.620 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:25 smithi050 ceph-mon[32421]: last_changed 2024-06-06T03:14:13.774178+0000 2024-06-06T03:14:25.620 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:25 smithi050 ceph-mon[32421]: created 2024-06-06T03:14:13.774178+0000 2024-06-06T03:14:25.620 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:25 smithi050 ceph-mon[32421]: min_mon_release 19 (squid) 2024-06-06T03:14:25.620 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:25 smithi050 ceph-mon[32421]: election_strategy: 1 2024-06-06T03:14:25.620 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:25 smithi050 ceph-mon[32421]: 0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-06-06T03:14:25.620 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:25 smithi050 ceph-mon[32421]: fsmap 2024-06-06T03:14:25.621 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:25 smithi050 ceph-mon[32421]: osdmap e1: 0 total, 0 up, 0 in 2024-06-06T03:14:25.621 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:25 smithi050 ceph-mon[32421]: mgrmap e1: no daemons active 2024-06-06T03:14:25.621 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:25 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3094409566' entity='client.admin' 2024-06-06T03:14:25.623 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.973+0000 7f4076c6e700 1 Processor -- start 2024-06-06T03:14:25.627 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.973+0000 7f4076c6e700 1 -- start start 2024-06-06T03:14:25.627 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.973+0000 7f4076c6e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f407007de80 0x7f407007c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:25.627 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.973+0000 7f4076c6e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f407007c900 con 0x7f407007de80 2024-06-06T03:14:25.627 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.973+0000 7f4074a0a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f407007de80 0x7f407007c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:25.628 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.973+0000 7f4074a0a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f407007de80 0x7f407007c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41280/0 (socket says 172.21.15.50:41280) 2024-06-06T03:14:25.628 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.974+0000 7f4074a0a700 1 -- 172.21.15.50:0/663295225 learned_addr learned my addr 172.21.15.50:0/663295225 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:25.628 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.974+0000 7f4074a0a700 1 -- 172.21.15.50:0/663295225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f407007ca80 con 0x7f407007de80 2024-06-06T03:14:25.628 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.974+0000 7f4074a0a700 1 --2- 172.21.15.50:0/663295225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f407007de80 0x7f407007c330 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f40640098a0 tx=0x7f4064009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc3114b383cae65 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:25.628 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.974+0000 7f406f7fe700 1 -- 172.21.15.50:0/663295225 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4064004160 con 0x7f407007de80 2024-06-06T03:14:25.628 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.974+0000 7f406f7fe700 1 -- 172.21.15.50:0/663295225 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f4064004300 con 0x7f407007de80 2024-06-06T03:14:25.628 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.974+0000 7f406f7fe700 1 -- 172.21.15.50:0/663295225 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4064011a80 con 0x7f407007de80 2024-06-06T03:14:25.628 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.975+0000 7f4076c6e700 1 -- 172.21.15.50:0/663295225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f407007de80 msgr2=0x7f407007c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:25.628 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.975+0000 7f4076c6e700 1 --2- 172.21.15.50:0/663295225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f407007de80 0x7f407007c330 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f40640098a0 tx=0x7f4064009bb0 comp rx=0 tx=0).stop 2024-06-06T03:14:25.628 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.975+0000 7f4076c6e700 1 -- 172.21.15.50:0/663295225 shutdown_connections 2024-06-06T03:14:25.628 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.975+0000 7f4076c6e700 1 --2- 172.21.15.50:0/663295225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f407007de80 0x7f407007c330 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:25.628 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.975+0000 7f4076c6e700 1 -- 172.21.15.50:0/663295225 >> 172.21.15.50:0/663295225 conn(0x7f4070103330 msgr2=0x7f4070105790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:25.628 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.975+0000 7f4076c6e700 1 -- 172.21.15.50:0/663295225 shutdown_connections 2024-06-06T03:14:25.629 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.975+0000 7f4076c6e700 1 -- 172.21.15.50:0/663295225 wait complete. 2024-06-06T03:14:25.629 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.976+0000 7f4076c6e700 1 Processor -- start 2024-06-06T03:14:25.629 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.976+0000 7f4076c6e700 1 -- start start 2024-06-06T03:14:25.629 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.976+0000 7f4076c6e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f407007de80 0x7f407019de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:25.629 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.976+0000 7f4076c6e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f407010e320 con 0x7f407007de80 2024-06-06T03:14:25.629 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.976+0000 7f4074a0a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f407007de80 0x7f407019de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:25.629 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.976+0000 7f4074a0a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f407007de80 0x7f407019de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41294/0 (socket says 172.21.15.50:41294) 2024-06-06T03:14:25.629 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.976+0000 7f4074a0a700 1 -- 172.21.15.50:0/3094409566 learned_addr learned my addr 172.21.15.50:0/3094409566 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:25.629 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.976+0000 7f4074a0a700 1 -- 172.21.15.50:0/3094409566 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f407019e380 con 0x7f407007de80 2024-06-06T03:14:25.629 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.976+0000 7f4074a0a700 1 --2- 172.21.15.50:0/3094409566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f407007de80 0x7f407019de40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4064006af0 tx=0x7f4064011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:25.629 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.977+0000 7f406dffb700 1 -- 172.21.15.50:0/3094409566 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40640039e0 con 0x7f407007de80 2024-06-06T03:14:25.629 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.977+0000 7f406dffb700 1 -- 172.21.15.50:0/3094409566 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f4064003b80 con 0x7f407007de80 2024-06-06T03:14:25.629 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.977+0000 7f4076c6e700 1 -- 172.21.15.50:0/3094409566 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f407019e610 con 0x7f407007de80 2024-06-06T03:14:25.629 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.977+0000 7f406dffb700 1 -- 172.21.15.50:0/3094409566 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40640196a0 con 0x7f407007de80 2024-06-06T03:14:25.630 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.977+0000 7f4076c6e700 1 -- 172.21.15.50:0/3094409566 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40701a1300 con 0x7f407007de80 2024-06-06T03:14:25.630 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.977+0000 7f406dffb700 1 -- 172.21.15.50:0/3094409566 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4064019ce0 con 0x7f407007de80 2024-06-06T03:14:25.630 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.977+0000 7f406dffb700 1 -- 172.21.15.50:0/3094409566 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4064024770 con 0x7f407007de80 2024-06-06T03:14:25.630 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.978+0000 7f4076c6e700 1 -- 172.21.15.50:0/3094409566 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4070063af0 con 0x7f407007de80 2024-06-06T03:14:25.630 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:24.980+0000 7f406dffb700 1 -- 172.21.15.50:0/3094409566 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f4064043dd0 con 0x7f407007de80 2024-06-06T03:14:25.630 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:25.050+0000 7f4076c6e700 1 -- 172.21.15.50:0/3094409566 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f40701a14d0 con 0x7f407007de80 2024-06-06T03:14:25.630 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:25.052+0000 7f406dffb700 1 -- 172.21.15.50:0/3094409566 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f4064032020 con 0x7f407007de80 2024-06-06T03:14:25.630 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:25.053+0000 7f4076c6e700 1 -- 172.21.15.50:0/3094409566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f407007de80 msgr2=0x7f407019de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:25.630 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:25.053+0000 7f4076c6e700 1 --2- 172.21.15.50:0/3094409566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f407007de80 0x7f407019de40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4064006af0 tx=0x7f4064011c40 comp rx=0 tx=0).stop 2024-06-06T03:14:25.630 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:25.053+0000 7f4076c6e700 1 -- 172.21.15.50:0/3094409566 shutdown_connections 2024-06-06T03:14:25.630 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:25.053+0000 7f4076c6e700 1 --2- 172.21.15.50:0/3094409566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f407007de80 0x7f407019de40 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:25.630 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:25.053+0000 7f4076c6e700 1 -- 172.21.15.50:0/3094409566 >> 172.21.15.50:0/3094409566 conn(0x7f4070103330 msgr2=0x7f4070103df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:25.630 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:25.053+0000 7f4076c6e700 1 -- 172.21.15.50:0/3094409566 shutdown_connections 2024-06-06T03:14:25.631 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:25.053+0000 7f4076c6e700 1 -- 172.21.15.50:0/3094409566 wait complete. 2024-06-06T03:14:25.631 INFO:teuthology.orchestra.run.smithi050.stdout:Wrote config to /etc/ceph/ceph.conf 2024-06-06T03:14:25.653 INFO:teuthology.orchestra.run.smithi050.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-06-06T03:14:25.653 INFO:teuthology.orchestra.run.smithi050.stdout:Creating mgr... 2024-06-06T03:14:25.653 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying port 0.0.0.0:9283 ... 2024-06-06T03:14:25.654 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying port 0.0.0.0:8765 ... 2024-06-06T03:14:25.917 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mgr.x 2024-06-06T03:14:25.917 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Failed to reset failed state of unit ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mgr.x.service: Unit ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mgr.x.service not loaded. 2024-06-06T03:14:26.074 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-b6263b26-23b2-11ef-bc9b-c7b262605968.target.wants/ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@.service. 2024-06-06T03:14:26.251 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:26 smithi050 systemd[1]: Starting Ceph mgr.x for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:14:26.633 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:26 smithi050 podman[32635]: 2024-06-06 03:14:26.21642639 +0000 UTC m=+0.017653754 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-06T03:14:26.633 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:26 smithi050 podman[32635]: 2024-06-06 03:14:26.348324757 +0000 UTC m=+0.149552110 container create aec415784ccd6096453ee33ed3facb6b31c2086e42bcdb4a78d0d46cd9727098 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528) 2024-06-06T03:14:26.634 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:26 smithi050 podman[32635]: 2024-06-06 03:14:26.550911056 +0000 UTC m=+0.352138406 container init aec415784ccd6096453ee33ed3facb6b31c2086e42bcdb4a78d0d46cd9727098 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5) 2024-06-06T03:14:26.634 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:26 smithi050 podman[32635]: 2024-06-06 03:14:26.553953567 +0000 UTC m=+0.355180923 container start aec415784ccd6096453ee33ed3facb6b31c2086e42bcdb4a78d0d46cd9727098 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, ceph=True) 2024-06-06T03:14:26.634 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:26 smithi050 bash[32635]: aec415784ccd6096453ee33ed3facb6b31c2086e42bcdb4a78d0d46cd9727098 2024-06-06T03:14:26.648 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-06T03:14:26.648 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout disabled 2024-06-06T03:14:26.656 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-06T03:14:26.657 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2024-06-06T03:14:26.657 INFO:teuthology.orchestra.run.smithi050.stdout:firewalld.service is not enabled 2024-06-06T03:14:26.657 INFO:teuthology.orchestra.run.smithi050.stdout:Not possible to enable service . firewalld.service is not available 2024-06-06T03:14:26.665 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-06T03:14:26.666 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout disabled 2024-06-06T03:14:26.673 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-06T03:14:26.674 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2024-06-06T03:14:26.674 INFO:teuthology.orchestra.run.smithi050.stdout:firewalld.service is not enabled 2024-06-06T03:14:26.674 INFO:teuthology.orchestra.run.smithi050.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-06-06T03:14:26.674 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for mgr to start... 2024-06-06T03:14:26.674 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for mgr... 2024-06-06T03:14:26.916 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:26 smithi050 systemd[1]: Started Ceph mgr.x for b6263b26-23b2-11ef-bc9b-c7b262605968. 2024-06-06T03:14:26.916 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:26 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:26.722+0000 7fac5bb09200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-06T03:14:27.239 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:26 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:26.922+0000 7fac5bb09200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-06T03:14:27.239 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:27 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:27.031+0000 7fac5bb09200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-06T03:14:27.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:27 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1573425293' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-06T03:14:27.501 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:27 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:27.370+0000 7fac5bb09200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-06T03:14:27.501 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:27 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:27.462+0000 7fac5bb09200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-06T03:14:27.812 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-06-06T03:14:27.812 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2024-06-06T03:14:27.813 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsid": "b6263b26-23b2-11ef-bc9b-c7b262605968", 2024-06-06T03:14:27.813 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "health": { 2024-06-06T03:14:27.813 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-06T03:14:27.813 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-06T03:14:27.813 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-06T03:14:27.813 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-06-06T03:14:27.813 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-06T03:14:27.813 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-06T03:14:27.813 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 0 2024-06-06T03:14:27.813 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-06-06T03:14:27.813 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-06T03:14:27.813 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "a" 2024-06-06T03:14:27.813 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-06-06T03:14:27.814 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-06-06T03:14:27.814 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-06T03:14:27.814 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T03:14:27.814 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-06-06T03:14:27.814 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-06T03:14:27.814 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-06-06T03:14:27.814 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-06T03:14:27.814 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T03:14:27.814 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-06T03:14:27.814 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-06T03:14:27.814 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-06T03:14:27.821 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-06T03:14:27.822 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-06T03:14:27.822 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-06T03:14:27.822 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-06-06T03:14:27.822 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-06T03:14:27.822 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-06T03:14:27.822 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-06T03:14:27.822 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-06T03:14:27.822 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-06T03:14:27.822 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-06T03:14:27.822 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-06T03:14:27.822 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-06T03:14:27.822 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-06T03:14:27.823 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-06-06T03:14:27.823 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-06T03:14:27.823 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T03:14:27.823 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-06T03:14:27.823 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-06T03:14:27.823 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-06-06T03:14:27.823 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-06T03:14:27.823 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "available": false, 2024-06-06T03:14:27.823 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-06T03:14:27.823 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-06T03:14:27.823 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-06T03:14:27.823 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-06T03:14:27.823 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "restful" 2024-06-06T03:14:27.823 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-06-06T03:14:27.824 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-06T03:14:27.824 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-06-06T03:14:27.824 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-06T03:14:27.824 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T03:14:27.824 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modified": "2024-06-06T03:14:19.063097+0000", 2024-06-06T03:14:27.824 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-06T03:14:27.824 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-06-06T03:14:27.824 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-06T03:14:27.824 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2024-06-06T03:14:27.824 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.157+0000 7ff869cd7700 1 Processor -- start 2024-06-06T03:14:27.824 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.157+0000 7ff869cd7700 1 -- start start 2024-06-06T03:14:27.824 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.158+0000 7ff869cd7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff864107dc0 0x7ff8641081e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:27.824 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.158+0000 7ff869cd7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff8641087b0 con 0x7ff864107dc0 2024-06-06T03:14:27.825 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.158+0000 7ff8637fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff864107dc0 0x7ff8641081e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:27.825 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.158+0000 7ff8637fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff864107dc0 0x7ff8641081e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41320/0 (socket says 172.21.15.50:41320) 2024-06-06T03:14:27.825 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.158+0000 7ff8637fe700 1 -- 172.21.15.50:0/3749787716 learned_addr learned my addr 172.21.15.50:0/3749787716 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:27.825 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.158+0000 7ff8637fe700 1 -- 172.21.15.50:0/3749787716 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff864108f20 con 0x7ff864107dc0 2024-06-06T03:14:27.825 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.158+0000 7ff8637fe700 1 --2- 172.21.15.50:0/3749787716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff864107dc0 0x7ff8641081e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff8540098a0 tx=0x7ff854009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f70a05fb8d4f2f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:27.825 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.159+0000 7ff8627fc700 1 -- 172.21.15.50:0/3749787716 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff854004160 con 0x7ff864107dc0 2024-06-06T03:14:27.825 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.159+0000 7ff8627fc700 1 -- 172.21.15.50:0/3749787716 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7ff854004300 con 0x7ff864107dc0 2024-06-06T03:14:27.825 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.159+0000 7ff8627fc700 1 -- 172.21.15.50:0/3749787716 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff854011a80 con 0x7ff864107dc0 2024-06-06T03:14:27.825 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.159+0000 7ff869cd7700 1 -- 172.21.15.50:0/3749787716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff864107dc0 msgr2=0x7ff8641081e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:27.825 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.159+0000 7ff869cd7700 1 --2- 172.21.15.50:0/3749787716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff864107dc0 0x7ff8641081e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff8540098a0 tx=0x7ff854009bb0 comp rx=0 tx=0).stop 2024-06-06T03:14:27.825 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.159+0000 7ff869cd7700 1 -- 172.21.15.50:0/3749787716 shutdown_connections 2024-06-06T03:14:27.825 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.159+0000 7ff869cd7700 1 --2- 172.21.15.50:0/3749787716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff864107dc0 0x7ff8641081e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:27.825 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.159+0000 7ff869cd7700 1 -- 172.21.15.50:0/3749787716 >> 172.21.15.50:0/3749787716 conn(0x7ff864103340 msgr2=0x7ff8641057a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:27.826 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.159+0000 7ff869cd7700 1 -- 172.21.15.50:0/3749787716 shutdown_connections 2024-06-06T03:14:27.826 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.159+0000 7ff869cd7700 1 -- 172.21.15.50:0/3749787716 wait complete. 2024-06-06T03:14:27.826 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.160+0000 7ff869cd7700 1 Processor -- start 2024-06-06T03:14:27.826 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.160+0000 7ff869cd7700 1 -- start start 2024-06-06T03:14:27.826 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.160+0000 7ff869cd7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff864107dc0 0x7ff86419bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:27.826 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.160+0000 7ff869cd7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff86410c2d0 con 0x7ff864107dc0 2024-06-06T03:14:27.826 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.161+0000 7ff8637fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff864107dc0 0x7ff86419bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:27.826 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.161+0000 7ff8637fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff864107dc0 0x7ff86419bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41324/0 (socket says 172.21.15.50:41324) 2024-06-06T03:14:27.826 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.161+0000 7ff8637fe700 1 -- 172.21.15.50:0/1573425293 learned_addr learned my addr 172.21.15.50:0/1573425293 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:27.826 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.161+0000 7ff8637fe700 1 -- 172.21.15.50:0/1573425293 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff86419c1f0 con 0x7ff864107dc0 2024-06-06T03:14:27.826 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.161+0000 7ff8637fe700 1 --2- 172.21.15.50:0/1573425293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff864107dc0 0x7ff86419bcb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff854000c00 tx=0x7ff854011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:27.826 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.161+0000 7ff860ff9700 1 -- 172.21.15.50:0/1573425293 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8540039f0 con 0x7ff864107dc0 2024-06-06T03:14:27.826 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.161+0000 7ff860ff9700 1 -- 172.21.15.50:0/1573425293 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7ff854003b90 con 0x7ff864107dc0 2024-06-06T03:14:27.827 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.161+0000 7ff869cd7700 1 -- 172.21.15.50:0/1573425293 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff86419c480 con 0x7ff864107dc0 2024-06-06T03:14:27.827 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.161+0000 7ff860ff9700 1 -- 172.21.15.50:0/1573425293 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff85401a740 con 0x7ff864107dc0 2024-06-06T03:14:27.827 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.161+0000 7ff869cd7700 1 -- 172.21.15.50:0/1573425293 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff86419f170 con 0x7ff864107dc0 2024-06-06T03:14:27.827 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.161+0000 7ff860ff9700 1 -- 172.21.15.50:0/1573425293 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff85402d3f0 con 0x7ff864107dc0 2024-06-06T03:14:27.827 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.162+0000 7ff860ff9700 1 -- 172.21.15.50:0/1573425293 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff854019700 con 0x7ff864107dc0 2024-06-06T03:14:27.827 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.162+0000 7ff869cd7700 1 -- 172.21.15.50:0/1573425293 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff864063af0 con 0x7ff864107dc0 2024-06-06T03:14:27.827 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.164+0000 7ff860ff9700 1 -- 172.21.15.50:0/1573425293 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7ff854024af0 con 0x7ff864107dc0 2024-06-06T03:14:27.827 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.239+0000 7ff869cd7700 1 -- 172.21.15.50:0/1573425293 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7ff86419f340 con 0x7ff864107dc0 2024-06-06T03:14:27.827 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.239+0000 7ff860ff9700 1 -- 172.21.15.50:0/1573425293 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7ff8540199a0 con 0x7ff864107dc0 2024-06-06T03:14:27.827 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.240+0000 7ff869cd7700 1 -- 172.21.15.50:0/1573425293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff864107dc0 msgr2=0x7ff86419bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:27.827 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.240+0000 7ff869cd7700 1 --2- 172.21.15.50:0/1573425293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff864107dc0 0x7ff86419bcb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff854000c00 tx=0x7ff854011b00 comp rx=0 tx=0).stop 2024-06-06T03:14:27.827 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.240+0000 7ff869cd7700 1 -- 172.21.15.50:0/1573425293 shutdown_connections 2024-06-06T03:14:27.827 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.240+0000 7ff869cd7700 1 --2- 172.21.15.50:0/1573425293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff864107dc0 0x7ff86419bcb0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:27.828 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.240+0000 7ff869cd7700 1 -- 172.21.15.50:0/1573425293 >> 172.21.15.50:0/1573425293 conn(0x7ff864103340 msgr2=0x7ff864103ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:27.828 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.240+0000 7ff869cd7700 1 -- 172.21.15.50:0/1573425293 shutdown_connections 2024-06-06T03:14:27.828 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:27.240+0000 7ff869cd7700 1 -- 172.21.15.50:0/1573425293 wait complete. 2024-06-06T03:14:27.828 INFO:teuthology.orchestra.run.smithi050.stdout:mgr not available, waiting (1/15)... 2024-06-06T03:14:29.001 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:28 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:28.739+0000 7fac5bb09200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-06T03:14:29.002 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:28 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:28.915+0000 7fac5bb09200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-06T03:14:29.391 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:29 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:29.092+0000 7fac5bb09200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-06T03:14:29.392 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:29 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:29.391+0000 7fac5bb09200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-06T03:14:29.711 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:29 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:29.489+0000 7fac5bb09200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-06T03:14:29.712 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:29 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:29.711+0000 7fac5bb09200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-06T03:14:30.001 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:29 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:29.914+0000 7fac5bb09200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-06T03:14:30.563 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:30 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1373017547' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-06T03:14:30.879 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:30 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:30.563+0000 7fac5bb09200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-06T03:14:30.885 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-06-06T03:14:30.885 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2024-06-06T03:14:30.886 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsid": "b6263b26-23b2-11ef-bc9b-c7b262605968", 2024-06-06T03:14:30.886 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "health": { 2024-06-06T03:14:30.886 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-06T03:14:30.886 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-06T03:14:30.886 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-06T03:14:30.886 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-06-06T03:14:30.886 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-06T03:14:30.887 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-06T03:14:30.887 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 0 2024-06-06T03:14:30.887 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-06-06T03:14:30.887 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-06T03:14:30.887 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "a" 2024-06-06T03:14:30.887 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-06-06T03:14:30.887 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-06-06T03:14:30.887 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-06T03:14:30.887 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T03:14:30.887 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-06-06T03:14:30.887 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-06T03:14:30.887 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-06-06T03:14:30.888 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-06T03:14:30.888 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T03:14:30.888 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-06T03:14:30.888 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-06T03:14:30.888 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-06T03:14:30.896 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-06T03:14:30.897 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-06T03:14:30.897 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-06T03:14:30.897 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-06-06T03:14:30.897 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-06T03:14:30.897 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-06T03:14:30.897 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-06T03:14:30.897 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-06T03:14:30.897 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-06T03:14:30.897 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-06T03:14:30.897 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-06T03:14:30.897 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-06T03:14:30.897 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-06T03:14:30.897 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-06-06T03:14:30.898 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-06T03:14:30.898 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T03:14:30.898 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-06T03:14:30.898 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-06T03:14:30.898 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-06-06T03:14:30.898 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-06T03:14:30.898 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "available": false, 2024-06-06T03:14:30.898 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-06T03:14:30.898 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-06T03:14:30.899 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-06T03:14:30.899 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-06T03:14:30.899 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "restful" 2024-06-06T03:14:30.899 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-06-06T03:14:30.899 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-06T03:14:30.899 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-06-06T03:14:30.899 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-06T03:14:30.899 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T03:14:30.899 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modified": "2024-06-06T03:14:19.063097+0000", 2024-06-06T03:14:30.899 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-06T03:14:30.899 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-06-06T03:14:30.899 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-06T03:14:30.900 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2024-06-06T03:14:30.900 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.203+0000 7f46167a8700 1 Processor -- start 2024-06-06T03:14:30.900 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.203+0000 7f46167a8700 1 -- start start 2024-06-06T03:14:30.900 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.204+0000 7f46167a8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4610106cb0 0x7f46101070d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:30.900 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.204+0000 7f46167a8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f46101076a0 con 0x7f4610106cb0 2024-06-06T03:14:30.900 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.204+0000 7f460ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4610106cb0 0x7f46101070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:30.900 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.204+0000 7f460ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4610106cb0 0x7f46101070d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49722/0 (socket says 172.21.15.50:49722) 2024-06-06T03:14:30.900 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.204+0000 7f460ffff700 1 -- 172.21.15.50:0/418647151 learned_addr learned my addr 172.21.15.50:0/418647151 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:30.900 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.204+0000 7f460ffff700 1 -- 172.21.15.50:0/418647151 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4610107eb0 con 0x7f4610106cb0 2024-06-06T03:14:30.900 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.204+0000 7f460ffff700 1 --2- 172.21.15.50:0/418647151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4610106cb0 0x7f46101070d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f46000098a0 tx=0x7f4600009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb47ca7c7fa8a8 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:30.900 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.204+0000 7f460effd700 1 -- 172.21.15.50:0/418647151 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4600004160 con 0x7f4610106cb0 2024-06-06T03:14:30.901 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.204+0000 7f460effd700 1 -- 172.21.15.50:0/418647151 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f4600004300 con 0x7f4610106cb0 2024-06-06T03:14:30.901 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.204+0000 7f460effd700 1 -- 172.21.15.50:0/418647151 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4600011a80 con 0x7f4610106cb0 2024-06-06T03:14:30.901 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.205+0000 7f46167a8700 1 -- 172.21.15.50:0/418647151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4610106cb0 msgr2=0x7f46101070d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:30.901 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.205+0000 7f46167a8700 1 --2- 172.21.15.50:0/418647151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4610106cb0 0x7f46101070d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f46000098a0 tx=0x7f4600009bb0 comp rx=0 tx=0).stop 2024-06-06T03:14:30.901 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.205+0000 7f46167a8700 1 -- 172.21.15.50:0/418647151 shutdown_connections 2024-06-06T03:14:30.901 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.205+0000 7f46167a8700 1 --2- 172.21.15.50:0/418647151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4610106cb0 0x7f46101070d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:30.901 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.205+0000 7f46167a8700 1 -- 172.21.15.50:0/418647151 >> 172.21.15.50:0/418647151 conn(0x7f4610102290 msgr2=0x7f46101046b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:30.901 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.205+0000 7f46167a8700 1 -- 172.21.15.50:0/418647151 shutdown_connections 2024-06-06T03:14:30.901 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.205+0000 7f46167a8700 1 -- 172.21.15.50:0/418647151 wait complete. 2024-06-06T03:14:30.901 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.206+0000 7f46167a8700 1 Processor -- start 2024-06-06T03:14:30.901 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.206+0000 7f46167a8700 1 -- start start 2024-06-06T03:14:30.901 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.206+0000 7f46167a8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4610106cb0 0x7f4610191da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:30.902 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.206+0000 7f46167a8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f461010b0e0 con 0x7f4610106cb0 2024-06-06T03:14:30.902 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.206+0000 7f460ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4610106cb0 0x7f4610191da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:30.902 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.206+0000 7f460ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4610106cb0 0x7f4610191da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49736/0 (socket says 172.21.15.50:49736) 2024-06-06T03:14:30.902 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.206+0000 7f460ffff700 1 -- 172.21.15.50:0/1373017547 learned_addr learned my addr 172.21.15.50:0/1373017547 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:30.902 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.207+0000 7f460ffff700 1 -- 172.21.15.50:0/1373017547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46101922e0 con 0x7f4610106cb0 2024-06-06T03:14:30.902 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.207+0000 7f460ffff700 1 --2- 172.21.15.50:0/1373017547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4610106cb0 0x7f4610191da0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4600000c00 tx=0x7f4600011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:30.902 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.207+0000 7f460d7fa700 1 -- 172.21.15.50:0/1373017547 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46000039f0 con 0x7f4610106cb0 2024-06-06T03:14:30.902 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.207+0000 7f460d7fa700 1 -- 172.21.15.50:0/1373017547 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f4600003b90 con 0x7f4610106cb0 2024-06-06T03:14:30.902 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.207+0000 7f46167a8700 1 -- 172.21.15.50:0/1373017547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46101904d0 con 0x7f4610106cb0 2024-06-06T03:14:30.902 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.207+0000 7f460d7fa700 1 -- 172.21.15.50:0/1373017547 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f460001a740 con 0x7f4610106cb0 2024-06-06T03:14:30.903 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.207+0000 7f460d7fa700 1 -- 172.21.15.50:0/1373017547 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f46000193c0 con 0x7f4610106cb0 2024-06-06T03:14:30.903 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.207+0000 7f46167a8700 1 -- 172.21.15.50:0/1373017547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4610190a10 con 0x7f4610106cb0 2024-06-06T03:14:30.903 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.208+0000 7f460d7fa700 1 -- 172.21.15.50:0/1373017547 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4600019bd0 con 0x7f4610106cb0 2024-06-06T03:14:30.903 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.208+0000 7f46167a8700 1 -- 172.21.15.50:0/1373017547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f461010b260 con 0x7f4610106cb0 2024-06-06T03:14:30.903 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.210+0000 7f460d7fa700 1 -- 172.21.15.50:0/1373017547 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f4600019dd0 con 0x7f4610106cb0 2024-06-06T03:14:30.903 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.285+0000 7f46167a8700 1 -- 172.21.15.50:0/1373017547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f46101956b0 con 0x7f4610106cb0 2024-06-06T03:14:30.903 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.285+0000 7f460d7fa700 1 -- 172.21.15.50:0/1373017547 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f4600024af0 con 0x7f4610106cb0 2024-06-06T03:14:30.903 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.287+0000 7f46167a8700 1 -- 172.21.15.50:0/1373017547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4610106cb0 msgr2=0x7f4610191da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:30.903 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.287+0000 7f46167a8700 1 --2- 172.21.15.50:0/1373017547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4610106cb0 0x7f4610191da0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4600000c00 tx=0x7f4600011b00 comp rx=0 tx=0).stop 2024-06-06T03:14:30.903 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.287+0000 7f46167a8700 1 -- 172.21.15.50:0/1373017547 shutdown_connections 2024-06-06T03:14:30.903 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.287+0000 7f46167a8700 1 --2- 172.21.15.50:0/1373017547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4610106cb0 0x7f4610191da0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:30.904 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.287+0000 7f46167a8700 1 -- 172.21.15.50:0/1373017547 >> 172.21.15.50:0/1373017547 conn(0x7f4610102290 msgr2=0x7f4610103140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:30.904 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.287+0000 7f46167a8700 1 -- 172.21.15.50:0/1373017547 shutdown_connections 2024-06-06T03:14:30.904 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:30.287+0000 7f46167a8700 1 -- 172.21.15.50:0/1373017547 wait complete. 2024-06-06T03:14:30.904 INFO:teuthology.orchestra.run.smithi050.stdout:mgr not available, waiting (2/15)... 2024-06-06T03:14:31.251 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:31 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:31.009+0000 7fac5bb09200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-06T03:14:31.251 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:31 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:31.110+0000 7fac5bb09200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-06T03:14:31.751 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:31 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:31.318+0000 7fac5bb09200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-06T03:14:32.173 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:31 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:31.890+0000 7fac5bb09200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-06T03:14:32.173 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:31 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:31.987+0000 7fac5bb09200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-06T03:14:32.488 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:32 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:32.249+0000 7fac5bb09200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-06T03:14:32.488 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:32 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:32.389+0000 7fac5bb09200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-06T03:14:32.488 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:32 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:32.487+0000 7fac5bb09200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-06T03:14:32.751 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:32 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:32.608+0000 7fac5bb09200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-06T03:14:33.240 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:32 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:32.929+0000 7fac5bb09200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-06T03:14:33.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:33 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3065825407' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-06T03:14:33.995 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:33 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:33.579+0000 7fac5bb09200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-06T03:14:33.995 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:33 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:33.806+0000 7fac5bb09200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-06T03:14:33.999 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-06-06T03:14:34.000 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2024-06-06T03:14:34.000 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsid": "b6263b26-23b2-11ef-bc9b-c7b262605968", 2024-06-06T03:14:34.000 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "health": { 2024-06-06T03:14:34.000 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-06T03:14:34.000 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-06T03:14:34.000 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-06T03:14:34.000 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-06-06T03:14:34.001 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-06T03:14:34.001 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-06T03:14:34.001 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 0 2024-06-06T03:14:34.001 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-06-06T03:14:34.001 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-06T03:14:34.001 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "a" 2024-06-06T03:14:34.001 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-06-06T03:14:34.001 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-06-06T03:14:34.001 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-06T03:14:34.001 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T03:14:34.001 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-06-06T03:14:34.001 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-06T03:14:34.002 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-06-06T03:14:34.002 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-06T03:14:34.002 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T03:14:34.002 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-06T03:14:34.002 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-06T03:14:34.002 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-06T03:14:34.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-06T03:14:34.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-06T03:14:34.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-06T03:14:34.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-06-06T03:14:34.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-06T03:14:34.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-06T03:14:34.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-06T03:14:34.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-06T03:14:34.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-06T03:14:34.011 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-06T03:14:34.011 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-06T03:14:34.011 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-06T03:14:34.011 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-06T03:14:34.011 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-06-06T03:14:34.011 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-06T03:14:34.011 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T03:14:34.011 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-06T03:14:34.011 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-06T03:14:34.011 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-06-06T03:14:34.011 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-06T03:14:34.012 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "available": false, 2024-06-06T03:14:34.012 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-06T03:14:34.012 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-06T03:14:34.012 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-06T03:14:34.012 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-06T03:14:34.012 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "restful" 2024-06-06T03:14:34.012 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-06-06T03:14:34.012 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-06T03:14:34.012 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-06-06T03:14:34.012 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-06T03:14:34.012 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T03:14:34.012 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modified": "2024-06-06T03:14:19.063097+0000", 2024-06-06T03:14:34.012 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-06T03:14:34.012 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-06-06T03:14:34.013 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-06T03:14:34.013 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2024-06-06T03:14:34.013 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.342+0000 7f0625b10700 1 Processor -- start 2024-06-06T03:14:34.013 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.342+0000 7f0625b10700 1 -- start start 2024-06-06T03:14:34.013 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.343+0000 7f0625b10700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0620108800 0x7f062010abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:34.013 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.343+0000 7f0625b10700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f062007be60 con 0x7f0620108800 2024-06-06T03:14:34.013 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.343+0000 7f061f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0620108800 0x7f062010abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:34.013 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.343+0000 7f061f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0620108800 0x7f062010abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49750/0 (socket says 172.21.15.50:49750) 2024-06-06T03:14:34.013 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.343+0000 7f061f7fe700 1 -- 172.21.15.50:0/969477359 learned_addr learned my addr 172.21.15.50:0/969477359 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:34.013 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.343+0000 7f061f7fe700 1 -- 172.21.15.50:0/969477359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f062010b130 con 0x7f0620108800 2024-06-06T03:14:34.013 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.343+0000 7f061f7fe700 1 --2- 172.21.15.50:0/969477359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0620108800 0x7f062010abf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f06100098a0 tx=0x7f0610009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d123289173347f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:34.014 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.343+0000 7f061effd700 1 -- 172.21.15.50:0/969477359 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0610004160 con 0x7f0620108800 2024-06-06T03:14:34.014 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.343+0000 7f061effd700 1 -- 172.21.15.50:0/969477359 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f0610004300 con 0x7f0620108800 2024-06-06T03:14:34.014 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.343+0000 7f061effd700 1 -- 172.21.15.50:0/969477359 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0610011a80 con 0x7f0620108800 2024-06-06T03:14:34.014 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.344+0000 7f0625b10700 1 -- 172.21.15.50:0/969477359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0620108800 msgr2=0x7f062010abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:34.014 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.344+0000 7f0625b10700 1 --2- 172.21.15.50:0/969477359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0620108800 0x7f062010abf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f06100098a0 tx=0x7f0610009bb0 comp rx=0 tx=0).stop 2024-06-06T03:14:34.014 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.344+0000 7f0625b10700 1 -- 172.21.15.50:0/969477359 shutdown_connections 2024-06-06T03:14:34.014 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.344+0000 7f0625b10700 1 --2- 172.21.15.50:0/969477359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0620108800 0x7f062010abf0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:34.014 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.344+0000 7f0625b10700 1 -- 172.21.15.50:0/969477359 >> 172.21.15.50:0/969477359 conn(0x7f06201021f0 msgr2=0x7f0620104630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:34.014 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.344+0000 7f0625b10700 1 -- 172.21.15.50:0/969477359 shutdown_connections 2024-06-06T03:14:34.014 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.344+0000 7f0625b10700 1 -- 172.21.15.50:0/969477359 wait complete. 2024-06-06T03:14:34.014 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.345+0000 7f0625b10700 1 Processor -- start 2024-06-06T03:14:34.014 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.345+0000 7f0625b10700 1 -- start start 2024-06-06T03:14:34.015 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.345+0000 7f0625b10700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0620108800 0x7f062019bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:34.015 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.345+0000 7f0625b10700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f062010c0f0 con 0x7f0620108800 2024-06-06T03:14:34.015 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.345+0000 7f061f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0620108800 0x7f062019bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:34.015 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.345+0000 7f061f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0620108800 0x7f062019bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49766/0 (socket says 172.21.15.50:49766) 2024-06-06T03:14:34.015 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.345+0000 7f061f7fe700 1 -- 172.21.15.50:0/3065825407 learned_addr learned my addr 172.21.15.50:0/3065825407 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:34.015 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.346+0000 7f061f7fe700 1 -- 172.21.15.50:0/3065825407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f062019c1c0 con 0x7f0620108800 2024-06-06T03:14:34.015 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.346+0000 7f061f7fe700 1 --2- 172.21.15.50:0/3065825407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0620108800 0x7f062019bc80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0610011a50 tx=0x7f0610011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:34.015 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.346+0000 7f061d7fa700 1 -- 172.21.15.50:0/3065825407 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0610003a80 con 0x7f0620108800 2024-06-06T03:14:34.015 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.346+0000 7f061d7fa700 1 -- 172.21.15.50:0/3065825407 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f0610003c20 con 0x7f0620108800 2024-06-06T03:14:34.015 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.346+0000 7f0625b10700 1 -- 172.21.15.50:0/3065825407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f062019c450 con 0x7f0620108800 2024-06-06T03:14:34.015 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.346+0000 7f061d7fa700 1 -- 172.21.15.50:0/3065825407 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f061001a650 con 0x7f0620108800 2024-06-06T03:14:34.015 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.346+0000 7f0625b10700 1 -- 172.21.15.50:0/3065825407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f062019f140 con 0x7f0620108800 2024-06-06T03:14:34.015 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.346+0000 7f061d7fa700 1 -- 172.21.15.50:0/3065825407 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f061001ad00 con 0x7f0620108800 2024-06-06T03:14:34.016 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.346+0000 7f061d7fa700 1 -- 172.21.15.50:0/3065825407 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0610019700 con 0x7f0620108800 2024-06-06T03:14:34.016 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.347+0000 7f0625b10700 1 -- 172.21.15.50:0/3065825407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0620063af0 con 0x7f0620108800 2024-06-06T03:14:34.016 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.349+0000 7f061d7fa700 1 -- 172.21.15.50:0/3065825407 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f0610024ad0 con 0x7f0620108800 2024-06-06T03:14:34.016 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.423+0000 7f0625b10700 1 -- 172.21.15.50:0/3065825407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f062019f310 con 0x7f0620108800 2024-06-06T03:14:34.016 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.423+0000 7f061d7fa700 1 -- 172.21.15.50:0/3065825407 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f06100199a0 con 0x7f0620108800 2024-06-06T03:14:34.016 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.424+0000 7f0625b10700 1 -- 172.21.15.50:0/3065825407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0620108800 msgr2=0x7f062019bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:34.016 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.424+0000 7f0625b10700 1 --2- 172.21.15.50:0/3065825407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0620108800 0x7f062019bc80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0610011a50 tx=0x7f0610011b30 comp rx=0 tx=0).stop 2024-06-06T03:14:34.016 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.424+0000 7f0625b10700 1 -- 172.21.15.50:0/3065825407 shutdown_connections 2024-06-06T03:14:34.016 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.424+0000 7f0625b10700 1 --2- 172.21.15.50:0/3065825407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0620108800 0x7f062019bc80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:34.016 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.424+0000 7f0625b10700 1 -- 172.21.15.50:0/3065825407 >> 172.21.15.50:0/3065825407 conn(0x7f06201021f0 msgr2=0x7f0620102d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:34.016 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.425+0000 7f0625b10700 1 -- 172.21.15.50:0/3065825407 shutdown_connections 2024-06-06T03:14:34.016 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:33.425+0000 7f0625b10700 1 -- 172.21.15.50:0/3065825407 wait complete. 2024-06-06T03:14:34.016 INFO:teuthology.orchestra.run.smithi050.stdout:mgr not available, waiting (3/15)... 2024-06-06T03:14:34.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:34 smithi050 ceph-mon[32421]: Activating manager daemon x 2024-06-06T03:14:34.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:34 smithi050 ceph-mon[32421]: mgrmap e2: x(active, starting, since 0.00326156s) 2024-06-06T03:14:34.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:34 smithi050 ceph-mon[32421]: from='mgr.14100 172.21.15.50:0/691947128' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-06T03:14:34.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:34 smithi050 ceph-mon[32421]: from='mgr.14100 172.21.15.50:0/691947128' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-06T03:14:34.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:34 smithi050 ceph-mon[32421]: from='mgr.14100 172.21.15.50:0/691947128' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-06T03:14:34.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:34 smithi050 ceph-mon[32421]: from='mgr.14100 172.21.15.50:0/691947128' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T03:14:34.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:34 smithi050 ceph-mon[32421]: from='mgr.14100 172.21.15.50:0/691947128' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-06T03:14:34.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:34 smithi050 ceph-mon[32421]: Manager daemon x is now available 2024-06-06T03:14:34.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:34 smithi050 ceph-mon[32421]: from='mgr.14100 172.21.15.50:0/691947128' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-06T03:14:34.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:34 smithi050 ceph-mon[32421]: from='mgr.14100 172.21.15.50:0/691947128' entity='mgr.x' 2024-06-06T03:14:34.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:34 smithi050 ceph-mon[32421]: from='mgr.14100 172.21.15.50:0/691947128' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-06T03:14:34.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:34 smithi050 ceph-mon[32421]: from='mgr.14100 172.21.15.50:0/691947128' entity='mgr.x' 2024-06-06T03:14:34.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:34 smithi050 ceph-mon[32421]: from='mgr.14100 172.21.15.50:0/691947128' entity='mgr.x' 2024-06-06T03:14:36.132 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:35 smithi050 ceph-mon[32421]: mgrmap e3: x(active, since 1.00723s) 2024-06-06T03:14:37.084 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:36 smithi050 ceph-mon[32421]: mgrmap e4: x(active, since 2s) 2024-06-06T03:14:37.084 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:36 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1054357655' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-06T03:14:37.424 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-06-06T03:14:37.424 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2024-06-06T03:14:37.424 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsid": "b6263b26-23b2-11ef-bc9b-c7b262605968", 2024-06-06T03:14:37.424 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "health": { 2024-06-06T03:14:37.424 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-06T03:14:37.425 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-06T03:14:37.425 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-06T03:14:37.425 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-06-06T03:14:37.425 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-06T03:14:37.425 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-06T03:14:37.425 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 0 2024-06-06T03:14:37.425 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-06-06T03:14:37.425 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-06T03:14:37.426 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "a" 2024-06-06T03:14:37.426 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-06-06T03:14:37.426 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-06-06T03:14:37.426 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-06T03:14:37.426 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T03:14:37.426 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-06-06T03:14:37.426 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-06T03:14:37.427 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-06-06T03:14:37.427 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-06T03:14:37.427 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T03:14:37.427 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-06T03:14:37.427 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-06T03:14:37.427 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-06T03:14:37.427 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-06T03:14:37.428 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-06T03:14:37.428 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-06T03:14:37.428 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-06-06T03:14:37.428 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-06T03:14:37.428 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-06T03:14:37.428 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-06T03:14:37.428 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-06T03:14:37.428 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-06T03:14:37.429 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-06T03:14:37.429 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-06T03:14:37.429 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-06T03:14:37.429 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-06T03:14:37.429 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-06-06T03:14:37.429 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-06T03:14:37.429 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T03:14:37.429 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-06T03:14:37.429 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-06T03:14:37.430 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-06-06T03:14:37.430 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-06T03:14:37.430 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "available": true, 2024-06-06T03:14:37.430 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-06T03:14:37.430 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-06T03:14:37.430 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-06T03:14:37.431 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-06T03:14:37.431 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "restful" 2024-06-06T03:14:37.431 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-06-06T03:14:37.431 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-06T03:14:37.431 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-06-06T03:14:37.431 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-06T03:14:37.432 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T03:14:37.432 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modified": "2024-06-06T03:14:19.063097+0000", 2024-06-06T03:14:37.432 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-06T03:14:37.432 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-06-06T03:14:37.432 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-06T03:14:37.432 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2024-06-06T03:14:37.432 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.477+0000 7ff3a37e6700 1 Processor -- start 2024-06-06T03:14:37.432 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.477+0000 7ff3a37e6700 1 -- start start 2024-06-06T03:14:37.433 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.478+0000 7ff3a37e6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff39c107db0 0x7ff39c1081d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:37.433 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.478+0000 7ff3a37e6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff39c1087a0 con 0x7ff39c107db0 2024-06-06T03:14:37.433 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.478+0000 7ff3a1582700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff39c107db0 0x7ff39c1081d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:37.433 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.478+0000 7ff3a1582700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff39c107db0 0x7ff39c1081d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49848/0 (socket says 172.21.15.50:49848) 2024-06-06T03:14:37.433 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.478+0000 7ff3a1582700 1 -- 172.21.15.50:0/1810843645 learned_addr learned my addr 172.21.15.50:0/1810843645 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:37.433 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.478+0000 7ff3a1582700 1 -- 172.21.15.50:0/1810843645 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39c108f60 con 0x7ff39c107db0 2024-06-06T03:14:37.433 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.478+0000 7ff3a1582700 1 --2- 172.21.15.50:0/1810843645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff39c107db0 0x7ff39c1081d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff3980098a0 tx=0x7ff398009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dccc3d2a5675d47 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:37.434 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.478+0000 7ff393fff700 1 -- 172.21.15.50:0/1810843645 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff398004160 con 0x7ff39c107db0 2024-06-06T03:14:37.434 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.478+0000 7ff393fff700 1 -- 172.21.15.50:0/1810843645 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7ff398004300 con 0x7ff39c107db0 2024-06-06T03:14:37.434 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.479+0000 7ff393fff700 1 -- 172.21.15.50:0/1810843645 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff398011a80 con 0x7ff39c107db0 2024-06-06T03:14:37.434 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.479+0000 7ff3a37e6700 1 -- 172.21.15.50:0/1810843645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff39c107db0 msgr2=0x7ff39c1081d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:37.434 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.479+0000 7ff3a37e6700 1 --2- 172.21.15.50:0/1810843645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff39c107db0 0x7ff39c1081d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff3980098a0 tx=0x7ff398009bb0 comp rx=0 tx=0).stop 2024-06-06T03:14:37.434 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.479+0000 7ff3a37e6700 1 -- 172.21.15.50:0/1810843645 shutdown_connections 2024-06-06T03:14:37.435 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.479+0000 7ff3a37e6700 1 --2- 172.21.15.50:0/1810843645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff39c107db0 0x7ff39c1081d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:37.435 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.479+0000 7ff3a37e6700 1 -- 172.21.15.50:0/1810843645 >> 172.21.15.50:0/1810843645 conn(0x7ff39c103330 msgr2=0x7ff39c105790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:37.435 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.479+0000 7ff3a37e6700 1 -- 172.21.15.50:0/1810843645 shutdown_connections 2024-06-06T03:14:37.435 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.479+0000 7ff3a37e6700 1 -- 172.21.15.50:0/1810843645 wait complete. 2024-06-06T03:14:37.435 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.480+0000 7ff3a37e6700 1 Processor -- start 2024-06-06T03:14:37.435 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.480+0000 7ff3a37e6700 1 -- start start 2024-06-06T03:14:37.435 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.480+0000 7ff3a37e6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff39c107db0 0x7ff39c19bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:37.435 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.480+0000 7ff3a37e6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff39c10c310 con 0x7ff39c107db0 2024-06-06T03:14:37.435 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.480+0000 7ff3a1582700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff39c107db0 0x7ff39c19bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:37.436 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.480+0000 7ff3a1582700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff39c107db0 0x7ff39c19bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49860/0 (socket says 172.21.15.50:49860) 2024-06-06T03:14:37.436 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.480+0000 7ff3a1582700 1 -- 172.21.15.50:0/1054357655 learned_addr learned my addr 172.21.15.50:0/1054357655 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:37.436 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.481+0000 7ff3a1582700 1 -- 172.21.15.50:0/1054357655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39c19c1f0 con 0x7ff39c107db0 2024-06-06T03:14:37.436 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.481+0000 7ff3a1582700 1 --2- 172.21.15.50:0/1054357655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff39c107db0 0x7ff39c19bcb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff398006af0 tx=0x7ff398011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:37.436 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.481+0000 7ff3927fc700 1 -- 172.21.15.50:0/1054357655 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3980039e0 con 0x7ff39c107db0 2024-06-06T03:14:37.436 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.481+0000 7ff3a37e6700 1 -- 172.21.15.50:0/1054357655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff39c19c480 con 0x7ff39c107db0 2024-06-06T03:14:37.436 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.481+0000 7ff3927fc700 1 -- 172.21.15.50:0/1054357655 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7ff398003b80 con 0x7ff39c107db0 2024-06-06T03:14:37.437 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.481+0000 7ff3927fc700 1 -- 172.21.15.50:0/1054357655 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3980196a0 con 0x7ff39c107db0 2024-06-06T03:14:37.437 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.481+0000 7ff3a37e6700 1 -- 172.21.15.50:0/1054357655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff39c19f170 con 0x7ff39c107db0 2024-06-06T03:14:37.437 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.482+0000 7ff3927fc700 1 -- 172.21.15.50:0/1054357655 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7ff3980199a0 con 0x7ff39c107db0 2024-06-06T03:14:37.437 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.482+0000 7ff3927fc700 1 --2- 172.21.15.50:0/1054357655 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7ff388038fb0 0x7ff38803b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:37.437 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.482+0000 7ff3927fc700 1 -- 172.21.15.50:0/1054357655 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff39804d570 con 0x7ff39c107db0 2024-06-06T03:14:37.437 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.482+0000 7ff3a37e6700 1 -- 172.21.15.50:0/1054357655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff39c063af0 con 0x7ff39c107db0 2024-06-06T03:14:37.437 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.482+0000 7ff3a0d81700 1 --2- 172.21.15.50:0/1054357655 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7ff388038fb0 0x7ff38803b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:37.437 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.483+0000 7ff3a0d81700 1 --2- 172.21.15.50:0/1054357655 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7ff388038fb0 0x7ff38803b470 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff38c006fd0 tx=0x7ff38c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:37.438 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.488+0000 7ff3927fc700 1 -- 172.21.15.50:0/1054357655 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff398016df0 con 0x7ff39c107db0 2024-06-06T03:14:37.438 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.782+0000 7ff3a37e6700 1 -- 172.21.15.50:0/1054357655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7ff39c19f6b0 con 0x7ff39c107db0 2024-06-06T03:14:37.438 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.782+0000 7ff3927fc700 1 -- 172.21.15.50:0/1054357655 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7ff39804cf90 con 0x7ff39c107db0 2024-06-06T03:14:37.438 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.784+0000 7ff3a37e6700 1 -- 172.21.15.50:0/1054357655 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7ff388038fb0 msgr2=0x7ff38803b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:37.438 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.784+0000 7ff3a37e6700 1 --2- 172.21.15.50:0/1054357655 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7ff388038fb0 0x7ff38803b470 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff38c006fd0 tx=0x7ff38c006e40 comp rx=0 tx=0).stop 2024-06-06T03:14:37.438 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.784+0000 7ff3a37e6700 1 -- 172.21.15.50:0/1054357655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff39c107db0 msgr2=0x7ff39c19bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:37.438 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.784+0000 7ff3a37e6700 1 --2- 172.21.15.50:0/1054357655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff39c107db0 0x7ff39c19bcb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff398006af0 tx=0x7ff398011c40 comp rx=0 tx=0).stop 2024-06-06T03:14:37.438 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.784+0000 7ff3a37e6700 1 -- 172.21.15.50:0/1054357655 shutdown_connections 2024-06-06T03:14:37.438 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.784+0000 7ff3a37e6700 1 --2- 172.21.15.50:0/1054357655 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7ff388038fb0 0x7ff38803b470 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:37.438 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.784+0000 7ff3a37e6700 1 --2- 172.21.15.50:0/1054357655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff39c107db0 0x7ff39c19bcb0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:37.439 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.784+0000 7ff3a37e6700 1 -- 172.21.15.50:0/1054357655 >> 172.21.15.50:0/1054357655 conn(0x7ff39c103330 msgr2=0x7ff39c103e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:37.439 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.785+0000 7ff3a37e6700 1 -- 172.21.15.50:0/1054357655 shutdown_connections 2024-06-06T03:14:37.439 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:36.785+0000 7ff3a37e6700 1 -- 172.21.15.50:0/1054357655 wait complete. 2024-06-06T03:14:37.439 INFO:teuthology.orchestra.run.smithi050.stdout:mgr is available 2024-06-06T03:14:38.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:38 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/2697433073' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-06-06T03:14:38.567 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-06-06T03:14:38.567 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout [global] 2024-06-06T03:14:38.567 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout fsid = b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:14:38.567 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-06-06T03:14:38.567 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-06-06T03:14:38.567 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-06-06T03:14:38.567 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-06-06T03:14:38.568 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-06-06T03:14:38.568 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout [mgr] 2024-06-06T03:14:38.568 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-06-06T03:14:38.568 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-06-06T03:14:38.568 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout [osd] 2024-06-06T03:14:38.568 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-06-06T03:14:38.568 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-06-06T03:14:38.568 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-06-06T03:14:38.568 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-06-06T03:14:38.568 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-06-06T03:14:38.568 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.837+0000 7f50bda44700 1 Processor -- start 2024-06-06T03:14:38.568 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.837+0000 7f50bda44700 1 -- start start 2024-06-06T03:14:38.568 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.837+0000 7f50bda44700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50b8108830 0x7f50b810ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:38.568 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.837+0000 7f50bda44700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f50b807be60 con 0x7f50b8108830 2024-06-06T03:14:38.569 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.838+0000 7f50b6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50b8108830 0x7f50b810ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:38.569 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.838+0000 7f50b6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50b8108830 0x7f50b810ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41088/0 (socket says 172.21.15.50:41088) 2024-06-06T03:14:38.569 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.838+0000 7f50b6ffd700 1 -- 172.21.15.50:0/399976345 learned_addr learned my addr 172.21.15.50:0/399976345 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:38.569 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.838+0000 7f50b6ffd700 1 -- 172.21.15.50:0/399976345 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50b810b160 con 0x7f50b8108830 2024-06-06T03:14:38.569 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.838+0000 7f50b6ffd700 1 --2- 172.21.15.50:0/399976345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50b8108830 0x7f50b810ac20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f50a80098a0 tx=0x7f50a8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ed00e4bdf7d9c0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:38.569 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.839+0000 7f50b67fc700 1 -- 172.21.15.50:0/399976345 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50a8004160 con 0x7f50b8108830 2024-06-06T03:14:38.569 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.839+0000 7f50b67fc700 1 -- 172.21.15.50:0/399976345 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f50a8004300 con 0x7f50b8108830 2024-06-06T03:14:38.569 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.839+0000 7f50b67fc700 1 -- 172.21.15.50:0/399976345 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50a8011a80 con 0x7f50b8108830 2024-06-06T03:14:38.569 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.839+0000 7f50bda44700 1 -- 172.21.15.50:0/399976345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50b8108830 msgr2=0x7f50b810ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:38.569 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.839+0000 7f50bda44700 1 --2- 172.21.15.50:0/399976345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50b8108830 0x7f50b810ac20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f50a80098a0 tx=0x7f50a8009bb0 comp rx=0 tx=0).stop 2024-06-06T03:14:38.569 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.839+0000 7f50bda44700 1 -- 172.21.15.50:0/399976345 shutdown_connections 2024-06-06T03:14:38.569 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.839+0000 7f50bda44700 1 --2- 172.21.15.50:0/399976345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50b8108830 0x7f50b810ac20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:38.569 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.839+0000 7f50bda44700 1 -- 172.21.15.50:0/399976345 >> 172.21.15.50:0/399976345 conn(0x7f50b8102240 msgr2=0x7f50b8104660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:38.570 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.839+0000 7f50bda44700 1 -- 172.21.15.50:0/399976345 shutdown_connections 2024-06-06T03:14:38.570 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.839+0000 7f50bda44700 1 -- 172.21.15.50:0/399976345 wait complete. 2024-06-06T03:14:38.570 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.840+0000 7f50bda44700 1 Processor -- start 2024-06-06T03:14:38.570 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.840+0000 7f50bda44700 1 -- start start 2024-06-06T03:14:38.570 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.840+0000 7f50bda44700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50b8108830 0x7f50b819bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:38.570 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.840+0000 7f50bda44700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f50b810c120 con 0x7f50b8108830 2024-06-06T03:14:38.570 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.841+0000 7f50b6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50b8108830 0x7f50b819bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:38.570 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.841+0000 7f50b6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50b8108830 0x7f50b819bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41104/0 (socket says 172.21.15.50:41104) 2024-06-06T03:14:38.570 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.841+0000 7f50b6ffd700 1 -- 172.21.15.50:0/2697433073 learned_addr learned my addr 172.21.15.50:0/2697433073 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:38.570 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.841+0000 7f50b6ffd700 1 -- 172.21.15.50:0/2697433073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50b819c1b0 con 0x7f50b8108830 2024-06-06T03:14:38.570 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.841+0000 7f50b6ffd700 1 --2- 172.21.15.50:0/2697433073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50b8108830 0x7f50b819bc70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f50a8006af0 tx=0x7f50a8011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:38.570 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.841+0000 7f50bca42700 1 -- 172.21.15.50:0/2697433073 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50a80039e0 con 0x7f50b8108830 2024-06-06T03:14:38.570 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.841+0000 7f50bda44700 1 -- 172.21.15.50:0/2697433073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50b819c440 con 0x7f50b8108830 2024-06-06T03:14:38.571 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.841+0000 7f50bca42700 1 -- 172.21.15.50:0/2697433073 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f50a8003b80 con 0x7f50b8108830 2024-06-06T03:14:38.571 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.841+0000 7f50bca42700 1 -- 172.21.15.50:0/2697433073 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50a80196a0 con 0x7f50b8108830 2024-06-06T03:14:38.571 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.841+0000 7f50bda44700 1 -- 172.21.15.50:0/2697433073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50b819f130 con 0x7f50b8108830 2024-06-06T03:14:38.571 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.842+0000 7f50bca42700 1 -- 172.21.15.50:0/2697433073 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f50a801a430 con 0x7f50b8108830 2024-06-06T03:14:38.571 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.842+0000 7f50bda44700 1 -- 172.21.15.50:0/2697433073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50b8063af0 con 0x7f50b8108830 2024-06-06T03:14:38.571 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.842+0000 7f50bca42700 1 --2- 172.21.15.50:0/2697433073 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f50a4039000 0x7f50a403b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:38.571 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.842+0000 7f50bca42700 1 -- 172.21.15.50:0/2697433073 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f50a804d540 con 0x7f50b8108830 2024-06-06T03:14:38.571 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.843+0000 7f50ae7fc700 1 --2- 172.21.15.50:0/2697433073 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f50a4039000 0x7f50a403b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:38.571 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.843+0000 7f50ae7fc700 1 --2- 172.21.15.50:0/2697433073 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f50a4039000 0x7f50a403b4c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f50a0006fd0 tx=0x7f50a0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:38.571 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:37.847+0000 7f50bca42700 1 -- 172.21.15.50:0/2697433073 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f50a8023e00 con 0x7f50b8108830 2024-06-06T03:14:38.571 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.052+0000 7f50bda44700 1 -- 172.21.15.50:0/2697433073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f50b819f300 con 0x7f50b8108830 2024-06-06T03:14:38.571 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.053+0000 7f50bca42700 1 -- 172.21.15.50:0/2697433073 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+373 (secure 0 0 0) 0x7f50b819f300 con 0x7f50b8108830 2024-06-06T03:14:38.571 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.056+0000 7f50bda44700 1 -- 172.21.15.50:0/2697433073 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f50a4039000 msgr2=0x7f50a403b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:38.571 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.056+0000 7f50bda44700 1 --2- 172.21.15.50:0/2697433073 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f50a4039000 0x7f50a403b4c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f50a0006fd0 tx=0x7f50a0006e40 comp rx=0 tx=0).stop 2024-06-06T03:14:38.572 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.056+0000 7f50bda44700 1 -- 172.21.15.50:0/2697433073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50b8108830 msgr2=0x7f50b819bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:38.572 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.056+0000 7f50bda44700 1 --2- 172.21.15.50:0/2697433073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50b8108830 0x7f50b819bc70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f50a8006af0 tx=0x7f50a8011c40 comp rx=0 tx=0).stop 2024-06-06T03:14:38.572 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.056+0000 7f50bda44700 1 -- 172.21.15.50:0/2697433073 shutdown_connections 2024-06-06T03:14:38.572 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.056+0000 7f50bda44700 1 --2- 172.21.15.50:0/2697433073 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f50a4039000 0x7f50a403b4c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:38.572 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.056+0000 7f50bda44700 1 --2- 172.21.15.50:0/2697433073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50b8108830 0x7f50b819bc70 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:38.572 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.056+0000 7f50bda44700 1 -- 172.21.15.50:0/2697433073 >> 172.21.15.50:0/2697433073 conn(0x7f50b8102240 msgr2=0x7f50b8102ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:38.572 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.056+0000 7f50bda44700 1 -- 172.21.15.50:0/2697433073 shutdown_connections 2024-06-06T03:14:38.572 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.056+0000 7f50bda44700 1 -- 172.21.15.50:0/2697433073 wait complete. 2024-06-06T03:14:38.572 INFO:teuthology.orchestra.run.smithi050.stdout:Enabling cephadm module... 2024-06-06T03:14:39.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:39 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3347295843' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-06-06T03:14:39.501 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:39 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: ignoring --setuser ceph since I am not root 2024-06-06T03:14:39.502 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:39 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: ignoring --setgroup ceph since I am not root 2024-06-06T03:14:39.502 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:39 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:39.453+0000 7f4a8e70b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-06T03:14:39.840 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:39 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:39.645+0000 7f4a8e70b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-06T03:14:39.840 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:39 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:39.751+0000 7f4a8e70b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-06T03:14:39.847 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.952+0000 7f8ea98ef700 1 Processor -- start 2024-06-06T03:14:39.847 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.952+0000 7f8ea98ef700 1 -- start start 2024-06-06T03:14:39.847 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.952+0000 7f8ea98ef700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ea4108860 0x7f8ea410ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:39.847 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.952+0000 7f8ea98ef700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea407be60 con 0x7f8ea4108860 2024-06-06T03:14:39.847 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.952+0000 7f8ea2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ea4108860 0x7f8ea410ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:39.847 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.952+0000 7f8ea2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ea4108860 0x7f8ea410ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41116/0 (socket says 172.21.15.50:41116) 2024-06-06T03:14:39.847 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.952+0000 7f8ea2ffd700 1 -- 172.21.15.50:0/2988813041 learned_addr learned my addr 172.21.15.50:0/2988813041 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:39.848 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.953+0000 7f8ea2ffd700 1 -- 172.21.15.50:0/2988813041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea410b190 con 0x7f8ea4108860 2024-06-06T03:14:39.848 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.953+0000 7f8ea2ffd700 1 --2- 172.21.15.50:0/2988813041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ea4108860 0x7f8ea410ac50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8e940098a0 tx=0x7f8e94009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3972dd5ae27a4b88 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:39.848 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.953+0000 7f8ea27fc700 1 -- 172.21.15.50:0/2988813041 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e94004160 con 0x7f8ea4108860 2024-06-06T03:14:39.848 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.953+0000 7f8ea27fc700 1 -- 172.21.15.50:0/2988813041 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f8e94004300 con 0x7f8ea4108860 2024-06-06T03:14:39.848 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.953+0000 7f8ea27fc700 1 -- 172.21.15.50:0/2988813041 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e94011a80 con 0x7f8ea4108860 2024-06-06T03:14:39.848 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.954+0000 7f8ea98ef700 1 -- 172.21.15.50:0/2988813041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ea4108860 msgr2=0x7f8ea410ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:39.848 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.954+0000 7f8ea98ef700 1 --2- 172.21.15.50:0/2988813041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ea4108860 0x7f8ea410ac50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8e940098a0 tx=0x7f8e94009bb0 comp rx=0 tx=0).stop 2024-06-06T03:14:39.848 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.954+0000 7f8ea98ef700 1 -- 172.21.15.50:0/2988813041 shutdown_connections 2024-06-06T03:14:39.848 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.954+0000 7f8ea98ef700 1 --2- 172.21.15.50:0/2988813041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ea4108860 0x7f8ea410ac50 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:39.848 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.954+0000 7f8ea98ef700 1 -- 172.21.15.50:0/2988813041 >> 172.21.15.50:0/2988813041 conn(0x7f8ea4102290 msgr2=0x7f8ea41046b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:39.848 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.954+0000 7f8ea98ef700 1 -- 172.21.15.50:0/2988813041 shutdown_connections 2024-06-06T03:14:39.848 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.954+0000 7f8ea98ef700 1 -- 172.21.15.50:0/2988813041 wait complete. 2024-06-06T03:14:39.848 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.954+0000 7f8ea98ef700 1 Processor -- start 2024-06-06T03:14:39.849 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.954+0000 7f8ea98ef700 1 -- start start 2024-06-06T03:14:39.849 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.955+0000 7f8ea98ef700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ea4108860 0x7f8ea41080e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:39.849 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.955+0000 7f8ea98ef700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea410c150 con 0x7f8ea4108860 2024-06-06T03:14:39.849 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.955+0000 7f8ea2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ea4108860 0x7f8ea41080e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:39.849 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.955+0000 7f8ea2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ea4108860 0x7f8ea41080e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41118/0 (socket says 172.21.15.50:41118) 2024-06-06T03:14:39.849 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.955+0000 7f8ea2ffd700 1 -- 172.21.15.50:0/3347295843 learned_addr learned my addr 172.21.15.50:0/3347295843 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:39.849 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.955+0000 7f8ea2ffd700 1 -- 172.21.15.50:0/3347295843 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea4108620 con 0x7f8ea4108860 2024-06-06T03:14:39.849 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.955+0000 7f8ea2ffd700 1 --2- 172.21.15.50:0/3347295843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ea4108860 0x7f8ea41080e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8e94006af0 tx=0x7f8e94011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:39.849 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.955+0000 7f8ea88ed700 1 -- 172.21.15.50:0/3347295843 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e940039e0 con 0x7f8ea4108860 2024-06-06T03:14:39.849 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.955+0000 7f8ea88ed700 1 -- 172.21.15.50:0/3347295843 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f8e94003b80 con 0x7f8ea4108860 2024-06-06T03:14:39.849 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.955+0000 7f8ea98ef700 1 -- 172.21.15.50:0/3347295843 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea4106810 con 0x7f8ea4108860 2024-06-06T03:14:39.849 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.955+0000 7f8ea88ed700 1 -- 172.21.15.50:0/3347295843 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e940196a0 con 0x7f8ea4108860 2024-06-06T03:14:39.849 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.956+0000 7f8ea98ef700 1 -- 172.21.15.50:0/3347295843 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ea4106d50 con 0x7f8ea4108860 2024-06-06T03:14:39.849 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.956+0000 7f8ea88ed700 1 -- 172.21.15.50:0/3347295843 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f8e940199a0 con 0x7f8ea4108860 2024-06-06T03:14:39.850 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.956+0000 7f8ea98ef700 1 -- 172.21.15.50:0/3347295843 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ea4063af0 con 0x7f8ea4108860 2024-06-06T03:14:39.850 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.957+0000 7f8ea88ed700 1 --2- 172.21.15.50:0/3347295843 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f8e90038fb0 0x7f8e9003b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:39.850 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.957+0000 7f8ea88ed700 1 -- 172.21.15.50:0/3347295843 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8e9404d5c0 con 0x7f8ea4108860 2024-06-06T03:14:39.850 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.957+0000 7f8e9a7fc700 1 --2- 172.21.15.50:0/3347295843 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f8e90038fb0 0x7f8e9003b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:39.850 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.957+0000 7f8e9a7fc700 1 --2- 172.21.15.50:0/3347295843 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f8e90038fb0 0x7f8e9003b470 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c006fd0 tx=0x7f8e8c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:39.850 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:38.962+0000 7f8ea88ed700 1 -- 172.21.15.50:0/3347295843 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8e9404cfe0 con 0x7f8ea4108860 2024-06-06T03:14:39.850 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:39.227+0000 7f8ea98ef700 1 -- 172.21.15.50:0/3347295843 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f8ea4106fd0 con 0x7f8ea4108860 2024-06-06T03:14:39.850 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:39.278+0000 7f8ea88ed700 1 -- 172.21.15.50:0/3347295843 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f8e94019d40 con 0x7f8ea4108860 2024-06-06T03:14:39.850 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:39.280+0000 7f8ea88ed700 1 -- 172.21.15.50:0/3347295843 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f8e9402d960 con 0x7f8ea4108860 2024-06-06T03:14:39.850 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:39.281+0000 7f8ea98ef700 1 -- 172.21.15.50:0/3347295843 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f8e90038fb0 msgr2=0x7f8e9003b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:39.850 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:39.281+0000 7f8ea98ef700 1 --2- 172.21.15.50:0/3347295843 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f8e90038fb0 0x7f8e9003b470 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c006fd0 tx=0x7f8e8c006e40 comp rx=0 tx=0).stop 2024-06-06T03:14:39.850 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:39.281+0000 7f8ea98ef700 1 -- 172.21.15.50:0/3347295843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ea4108860 msgr2=0x7f8ea41080e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:39.851 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:39.281+0000 7f8ea98ef700 1 --2- 172.21.15.50:0/3347295843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ea4108860 0x7f8ea41080e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8e94006af0 tx=0x7f8e94011c40 comp rx=0 tx=0).stop 2024-06-06T03:14:39.851 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:39.281+0000 7f8ea98ef700 1 -- 172.21.15.50:0/3347295843 shutdown_connections 2024-06-06T03:14:39.851 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:39.281+0000 7f8ea98ef700 1 --2- 172.21.15.50:0/3347295843 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f8e90038fb0 0x7f8e9003b470 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:39.851 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:39.281+0000 7f8ea98ef700 1 --2- 172.21.15.50:0/3347295843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ea4108860 0x7f8ea41080e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:39.851 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:39.281+0000 7f8ea98ef700 1 -- 172.21.15.50:0/3347295843 >> 172.21.15.50:0/3347295843 conn(0x7f8ea4102290 msgr2=0x7f8ea4102d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:39.851 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:39.281+0000 7f8ea98ef700 1 -- 172.21.15.50:0/3347295843 shutdown_connections 2024-06-06T03:14:39.851 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:39.281+0000 7f8ea98ef700 1 -- 172.21.15.50:0/3347295843 wait complete. 2024-06-06T03:14:40.100 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:40 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:40.077+0000 7f4a8e70b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-06T03:14:40.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:40 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3347295843' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-06-06T03:14:40.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:40 smithi050 ceph-mon[32421]: mgrmap e5: x(active, since 5s) 2024-06-06T03:14:40.501 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:40 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:40.169+0000 7f4a8e70b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-06T03:14:41.205 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2024-06-06T03:14:41.205 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-06-06T03:14:41.205 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "available": true, 2024-06-06T03:14:41.205 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-06-06T03:14:41.205 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-06-06T03:14:41.205 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2024-06-06T03:14:41.205 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.304+0000 7f724f5fc700 1 Processor -- start 2024-06-06T03:14:41.205 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.304+0000 7f724f5fc700 1 -- start start 2024-06-06T03:14:41.206 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.305+0000 7f724f5fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72481087f0 0x7f724810abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:41.206 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.305+0000 7f724f5fc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f724807be60 con 0x7f72481087f0 2024-06-06T03:14:41.206 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.305+0000 7f724d398700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72481087f0 0x7f724810abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:41.206 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.305+0000 7f724d398700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72481087f0 0x7f724810abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41144/0 (socket says 172.21.15.50:41144) 2024-06-06T03:14:41.206 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.305+0000 7f724d398700 1 -- 172.21.15.50:0/1597348410 learned_addr learned my addr 172.21.15.50:0/1597348410 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:41.206 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.305+0000 7f724d398700 1 -- 172.21.15.50:0/1597348410 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f724810b120 con 0x7f72481087f0 2024-06-06T03:14:41.206 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.305+0000 7f724d398700 1 --2- 172.21.15.50:0/1597348410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72481087f0 0x7f724810abe0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f72440098a0 tx=0x7f7244009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7773a0ef32c8d681 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:41.206 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.305+0000 7f723ffff700 1 -- 172.21.15.50:0/1597348410 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7244004160 con 0x7f72481087f0 2024-06-06T03:14:41.206 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.305+0000 7f723ffff700 1 -- 172.21.15.50:0/1597348410 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f7244004300 con 0x7f72481087f0 2024-06-06T03:14:41.206 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.305+0000 7f723ffff700 1 -- 172.21.15.50:0/1597348410 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7244011a80 con 0x7f72481087f0 2024-06-06T03:14:41.206 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.306+0000 7f724f5fc700 1 -- 172.21.15.50:0/1597348410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72481087f0 msgr2=0x7f724810abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:41.206 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.306+0000 7f724f5fc700 1 --2- 172.21.15.50:0/1597348410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72481087f0 0x7f724810abe0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f72440098a0 tx=0x7f7244009bb0 comp rx=0 tx=0).stop 2024-06-06T03:14:41.207 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.306+0000 7f724f5fc700 1 -- 172.21.15.50:0/1597348410 shutdown_connections 2024-06-06T03:14:41.207 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.306+0000 7f724f5fc700 1 --2- 172.21.15.50:0/1597348410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72481087f0 0x7f724810abe0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:41.207 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.306+0000 7f724f5fc700 1 -- 172.21.15.50:0/1597348410 >> 172.21.15.50:0/1597348410 conn(0x7f7248102200 msgr2=0x7f7248104620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:41.207 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.307+0000 7f724f5fc700 1 -- 172.21.15.50:0/1597348410 shutdown_connections 2024-06-06T03:14:41.207 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.307+0000 7f724f5fc700 1 -- 172.21.15.50:0/1597348410 wait complete. 2024-06-06T03:14:41.207 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.307+0000 7f724f5fc700 1 Processor -- start 2024-06-06T03:14:41.207 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.307+0000 7f724f5fc700 1 -- start start 2024-06-06T03:14:41.207 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.307+0000 7f724f5fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72481087f0 0x7f724819bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:41.207 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.307+0000 7f724f5fc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f724810c0e0 con 0x7f72481087f0 2024-06-06T03:14:41.207 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.308+0000 7f724d398700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72481087f0 0x7f724819bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:41.207 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.308+0000 7f724d398700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72481087f0 0x7f724819bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41160/0 (socket says 172.21.15.50:41160) 2024-06-06T03:14:41.207 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.308+0000 7f724d398700 1 -- 172.21.15.50:0/1040591973 learned_addr learned my addr 172.21.15.50:0/1040591973 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:41.207 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.308+0000 7f724d398700 1 -- 172.21.15.50:0/1040591973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f724819c1d0 con 0x7f72481087f0 2024-06-06T03:14:41.208 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.308+0000 7f724d398700 1 --2- 172.21.15.50:0/1040591973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72481087f0 0x7f724819bc90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7244011a50 tx=0x7f7244011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:41.208 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.308+0000 7f723e7fc700 1 -- 172.21.15.50:0/1040591973 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7244003a80 con 0x7f72481087f0 2024-06-06T03:14:41.208 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.308+0000 7f723e7fc700 1 -- 172.21.15.50:0/1040591973 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f7244003c20 con 0x7f72481087f0 2024-06-06T03:14:41.208 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.308+0000 7f724f5fc700 1 -- 172.21.15.50:0/1040591973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f724819c460 con 0x7f72481087f0 2024-06-06T03:14:41.208 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.308+0000 7f723e7fc700 1 -- 172.21.15.50:0/1040591973 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f724401a650 con 0x7f72481087f0 2024-06-06T03:14:41.208 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.308+0000 7f724f5fc700 1 -- 172.21.15.50:0/1040591973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f724819f150 con 0x7f72481087f0 2024-06-06T03:14:41.208 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.309+0000 7f723e7fc700 1 -- 172.21.15.50:0/1040591973 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f724401a900 con 0x7f72481087f0 2024-06-06T03:14:41.208 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.309+0000 7f724f5fc700 1 -- 172.21.15.50:0/1040591973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7248063af0 con 0x7f72481087f0 2024-06-06T03:14:41.208 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.310+0000 7f723e7fc700 1 --2- 172.21.15.50:0/1040591973 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f72340390a0 0x7f723403b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:41.208 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.310+0000 7f723e7fc700 1 -- 172.21.15.50:0/1040591973 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f724404d4b0 con 0x7f72481087f0 2024-06-06T03:14:41.208 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.310+0000 7f724cb97700 1 -- 172.21.15.50:0/1040591973 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f72340390a0 msgr2=0x7f723403b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/2617801068 2024-06-06T03:14:41.208 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.310+0000 7f724cb97700 1 --2- 172.21.15.50:0/1040591973 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f72340390a0 0x7f723403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-06T03:14:41.208 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.315+0000 7f723e7fc700 1 -- 172.21.15.50:0/1040591973 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7244019c70 con 0x7f72481087f0 2024-06-06T03:14:41.209 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.511+0000 7f724cb97700 1 -- 172.21.15.50:0/1040591973 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f72340390a0 msgr2=0x7f723403b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/2617801068 2024-06-06T03:14:41.209 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.511+0000 7f724cb97700 1 --2- 172.21.15.50:0/1040591973 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f72340390a0 0x7f723403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-06T03:14:41.209 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.618+0000 7f724f5fc700 1 -- 172.21.15.50:0/1040591973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f724819f320 con 0x7f72481087f0 2024-06-06T03:14:41.209 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.618+0000 7f723e7fc700 1 -- 172.21.15.50:0/1040591973 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f724819f320 con 0x7f72481087f0 2024-06-06T03:14:41.209 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.623+0000 7f724f5fc700 1 -- 172.21.15.50:0/1040591973 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f72340390a0 msgr2=0x7f723403b560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T03:14:41.209 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.623+0000 7f724f5fc700 1 --2- 172.21.15.50:0/1040591973 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f72340390a0 0x7f723403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:41.209 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.623+0000 7f724f5fc700 1 -- 172.21.15.50:0/1040591973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72481087f0 msgr2=0x7f724819bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:41.209 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.623+0000 7f724f5fc700 1 --2- 172.21.15.50:0/1040591973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72481087f0 0x7f724819bc90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7244011a50 tx=0x7f7244011b30 comp rx=0 tx=0).stop 2024-06-06T03:14:41.209 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.624+0000 7f724f5fc700 1 -- 172.21.15.50:0/1040591973 shutdown_connections 2024-06-06T03:14:41.209 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.624+0000 7f724f5fc700 1 --2- 172.21.15.50:0/1040591973 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f72340390a0 0x7f723403b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:41.209 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.624+0000 7f724f5fc700 1 --2- 172.21.15.50:0/1040591973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72481087f0 0x7f724819bc90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:41.209 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.624+0000 7f724f5fc700 1 -- 172.21.15.50:0/1040591973 >> 172.21.15.50:0/1040591973 conn(0x7f7248102200 msgr2=0x7f7248102d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:41.209 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.624+0000 7f724f5fc700 1 -- 172.21.15.50:0/1040591973 shutdown_connections 2024-06-06T03:14:41.210 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:40.624+0000 7f724f5fc700 1 -- 172.21.15.50:0/1040591973 wait complete. 2024-06-06T03:14:41.210 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for the mgr to restart... 2024-06-06T03:14:41.210 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for mgr epoch 5... 2024-06-06T03:14:41.447 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:41 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1040591973' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-06-06T03:14:41.447 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:41 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:41.437+0000 7f4a8e70b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-06T03:14:41.870 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:41 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:41.617+0000 7f4a8e70b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-06T03:14:41.870 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:41 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:41.795+0000 7f4a8e70b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-06T03:14:42.189 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:42 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:42.094+0000 7f4a8e70b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-06T03:14:42.190 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:42 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:42.190+0000 7f4a8e70b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-06T03:14:42.501 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:42 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:42.401+0000 7f4a8e70b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-06T03:14:43.001 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:42 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:42.601+0000 7f4a8e70b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-06T03:14:43.501 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:43 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:43.230+0000 7f4a8e70b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-06T03:14:43.976 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:43 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:43.668+0000 7f4a8e70b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-06T03:14:43.976 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:43 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:43.769+0000 7f4a8e70b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-06T03:14:43.976 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:43 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:43.977+0000 7f4a8e70b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-06T03:14:44.870 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:44 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:44.523+0000 7f4a8e70b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-06T03:14:44.870 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:44 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:44.618+0000 7f4a8e70b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-06T03:14:45.226 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:44 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:44.871+0000 7f4a8e70b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-06T03:14:45.226 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:45 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:45.009+0000 7f4a8e70b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-06T03:14:45.226 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:45 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:45.107+0000 7f4a8e70b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-06T03:14:45.226 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:45 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:45.226+0000 7f4a8e70b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-06T03:14:46.001 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:45 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:45.537+0000 7f4a8e70b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-06T03:14:46.439 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:46 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:46.163+0000 7f4a8e70b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-06T03:14:46.439 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:46 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:14:46.387+0000 7f4a8e70b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-06T03:14:46.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:46 smithi050 ceph-mon[32421]: Active manager daemon x restarted 2024-06-06T03:14:46.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:46 smithi050 ceph-mon[32421]: Activating manager daemon x 2024-06-06T03:14:46.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:46 smithi050 ceph-mon[32421]: osdmap e2: 0 total, 0 up, 0 in 2024-06-06T03:14:46.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:46 smithi050 ceph-mon[32421]: mgrmap e6: x(active, starting, since 0.00339212s) 2024-06-06T03:14:46.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:46 smithi050 ceph-mon[32421]: from='mgr.14120 172.21.15.50:0/2290217465' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T03:14:46.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:46 smithi050 ceph-mon[32421]: from='mgr.14120 172.21.15.50:0/2290217465' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-06T03:14:46.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:46 smithi050 ceph-mon[32421]: from='mgr.14120 172.21.15.50:0/2290217465' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-06T03:14:46.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:46 smithi050 ceph-mon[32421]: from='mgr.14120 172.21.15.50:0/2290217465' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-06T03:14:46.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:46 smithi050 ceph-mon[32421]: from='mgr.14120 172.21.15.50:0/2290217465' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-06T03:14:46.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:46 smithi050 ceph-mon[32421]: Manager daemon x is now available 2024-06-06T03:14:46.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:46 smithi050 ceph-mon[32421]: from='mgr.14120 172.21.15.50:0/2290217465' entity='mgr.x' 2024-06-06T03:14:46.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:46 smithi050 ceph-mon[32421]: from='mgr.14120 172.21.15.50:0/2290217465' entity='mgr.x' 2024-06-06T03:14:46.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:46 smithi050 ceph-mon[32421]: from='mgr.14120 172.21.15.50:0/2290217465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:14:46.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:46 smithi050 ceph-mon[32421]: from='mgr.14120 172.21.15.50:0/2290217465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:14:46.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:46 smithi050 ceph-mon[32421]: from='mgr.14120 172.21.15.50:0/2290217465' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-06T03:14:47.727 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:47 smithi050 ceph-mon[32421]: Found migration_current of "None". Setting to last migration. 2024-06-06T03:14:47.728 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:47 smithi050 ceph-mon[32421]: from='mgr.14120 172.21.15.50:0/2290217465' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-06T03:14:47.728 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:47 smithi050 ceph-mon[32421]: from='mgr.14120 172.21.15.50:0/2290217465' entity='mgr.x' 2024-06-06T03:14:47.728 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:47 smithi050 ceph-mon[32421]: from='mgr.14120 172.21.15.50:0/2290217465' entity='mgr.x' 2024-06-06T03:14:47.728 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:47 smithi050 ceph-mon[32421]: mgrmap e7: x(active, since 1.00528s) 2024-06-06T03:14:48.005 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2024-06-06T03:14:48.005 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-06-06T03:14:48.005 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "initialized": true 2024-06-06T03:14:48.005 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2024-06-06T03:14:48.005 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.665+0000 7f417b502700 1 Processor -- start 2024-06-06T03:14:48.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.665+0000 7f417b502700 1 -- start start 2024-06-06T03:14:48.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.665+0000 7f417b502700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4174106c20 0x7f4174107040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:48.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.665+0000 7f417b502700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4174107610 con 0x7f4174106c20 2024-06-06T03:14:48.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.666+0000 7f417929e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4174106c20 0x7f4174107040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:48.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.666+0000 7f417929e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4174106c20 0x7f4174107040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41162/0 (socket says 172.21.15.50:41162) 2024-06-06T03:14:48.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.666+0000 7f417929e700 1 -- 172.21.15.50:0/2419913400 learned_addr learned my addr 172.21.15.50:0/2419913400 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:48.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.666+0000 7f417929e700 1 -- 172.21.15.50:0/2419913400 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4174107e20 con 0x7f4174106c20 2024-06-06T03:14:48.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.666+0000 7f417929e700 1 --2- 172.21.15.50:0/2419913400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4174106c20 0x7f4174107040 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f417000bb40 tx=0x7f417000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a053853395508d08 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:48.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.666+0000 7f416bfff700 1 -- 172.21.15.50:0/2419913400 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f417000dbe0 con 0x7f4174106c20 2024-06-06T03:14:48.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.666+0000 7f416bfff700 1 -- 172.21.15.50:0/2419913400 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f41700044c0 con 0x7f4174106c20 2024-06-06T03:14:48.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.666+0000 7f416bfff700 1 -- 172.21.15.50:0/2419913400 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4170010470 con 0x7f4174106c20 2024-06-06T03:14:48.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.667+0000 7f417b502700 1 -- 172.21.15.50:0/2419913400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4174106c20 msgr2=0x7f4174107040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:48.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.667+0000 7f417b502700 1 --2- 172.21.15.50:0/2419913400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4174106c20 0x7f4174107040 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f417000bb40 tx=0x7f417000be50 comp rx=0 tx=0).stop 2024-06-06T03:14:48.007 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.667+0000 7f417b502700 1 -- 172.21.15.50:0/2419913400 shutdown_connections 2024-06-06T03:14:48.007 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.667+0000 7f417b502700 1 --2- 172.21.15.50:0/2419913400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4174106c20 0x7f4174107040 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:48.007 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.667+0000 7f417b502700 1 -- 172.21.15.50:0/2419913400 >> 172.21.15.50:0/2419913400 conn(0x7f41741021e0 msgr2=0x7f4174104600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:48.007 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.667+0000 7f417b502700 1 -- 172.21.15.50:0/2419913400 shutdown_connections 2024-06-06T03:14:48.007 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.667+0000 7f417b502700 1 -- 172.21.15.50:0/2419913400 wait complete. 2024-06-06T03:14:48.007 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.668+0000 7f417b502700 1 Processor -- start 2024-06-06T03:14:48.007 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.668+0000 7f417b502700 1 -- start start 2024-06-06T03:14:48.007 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.668+0000 7f417b502700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4174106c20 0x7f4174199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:48.007 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.668+0000 7f417b502700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f417407afc0 con 0x7f4174106c20 2024-06-06T03:14:48.007 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.668+0000 7f417929e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4174106c20 0x7f4174199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:48.007 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.668+0000 7f417929e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4174106c20 0x7f4174199ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41170/0 (socket says 172.21.15.50:41170) 2024-06-06T03:14:48.007 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.668+0000 7f417929e700 1 -- 172.21.15.50:0/2103287958 learned_addr learned my addr 172.21.15.50:0/2103287958 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:48.007 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.669+0000 7f417929e700 1 -- 172.21.15.50:0/2103287958 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f417419a000 con 0x7f4174106c20 2024-06-06T03:14:48.008 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.669+0000 7f417929e700 1 --2- 172.21.15.50:0/2103287958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4174106c20 0x7f4174199ac0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f417000b340 tx=0x7f4170003fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:48.008 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.669+0000 7f416a7fc700 1 -- 172.21.15.50:0/2103287958 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4170027070 con 0x7f4174106c20 2024-06-06T03:14:48.008 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.669+0000 7f416a7fc700 1 -- 172.21.15.50:0/2103287958 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f417000de20 con 0x7f4174106c20 2024-06-06T03:14:48.008 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.669+0000 7f416a7fc700 1 -- 172.21.15.50:0/2103287958 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4170022a20 con 0x7f4174106c20 2024-06-06T03:14:48.008 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.669+0000 7f417b502700 1 -- 172.21.15.50:0/2103287958 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f417419a290 con 0x7f4174106c20 2024-06-06T03:14:48.008 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.669+0000 7f417b502700 1 -- 172.21.15.50:0/2103287958 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f417419a6b0 con 0x7f4174106c20 2024-06-06T03:14:48.008 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.670+0000 7f416a7fc700 1 -- 172.21.15.50:0/2103287958 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f417002a070 con 0x7f4174106c20 2024-06-06T03:14:48.008 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.670+0000 7f416a7fc700 1 --2- 172.21.15.50:0/2103287958 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f4160039050 0x7f416003b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:48.008 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.670+0000 7f416a7fc700 1 -- 172.21.15.50:0/2103287958 --> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f416003bc20 con 0x7f4160039050 2024-06-06T03:14:48.008 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.670+0000 7f416a7fc700 1 -- 172.21.15.50:0/2103287958 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f417001f070 con 0x7f4174106c20 2024-06-06T03:14:48.008 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.670+0000 7f4178a9d700 1 -- 172.21.15.50:0/2103287958 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f4160039050 msgr2=0x7f416003b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/2617801068 2024-06-06T03:14:48.008 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.670+0000 7f4178a9d700 1 --2- 172.21.15.50:0/2103287958 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f4160039050 0x7f416003b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-06T03:14:48.008 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.871+0000 7f4178a9d700 1 -- 172.21.15.50:0/2103287958 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f4160039050 msgr2=0x7f416003b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/2617801068 2024-06-06T03:14:48.009 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:41.871+0000 7f4178a9d700 1 --2- 172.21.15.50:0/2103287958 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f4160039050 0x7f416003b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-06T03:14:48.009 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:42.272+0000 7f4178a9d700 1 -- 172.21.15.50:0/2103287958 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f4160039050 msgr2=0x7f416003b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/2617801068 2024-06-06T03:14:48.009 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:42.272+0000 7f4178a9d700 1 --2- 172.21.15.50:0/2103287958 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f4160039050 0x7f416003b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-06-06T03:14:48.009 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:43.073+0000 7f4178a9d700 1 -- 172.21.15.50:0/2103287958 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f4160039050 msgr2=0x7f416003b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/2617801068 2024-06-06T03:14:48.009 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:43.073+0000 7f4178a9d700 1 --2- 172.21.15.50:0/2103287958 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f4160039050 0x7f416003b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-06-06T03:14:48.009 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:44.674+0000 7f4178a9d700 1 -- 172.21.15.50:0/2103287958 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f4160039050 msgr2=0x7f416003b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/2617801068 2024-06-06T03:14:48.009 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:44.674+0000 7f4178a9d700 1 --2- 172.21.15.50:0/2103287958 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f4160039050 0x7f416003b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-06-06T03:14:48.009 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:46.390+0000 7f416a7fc700 1 -- 172.21.15.50:0/2103287958 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7f417002cce0 con 0x7f4174106c20 2024-06-06T03:14:48.009 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:46.390+0000 7f416a7fc700 1 -- 172.21.15.50:0/2103287958 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f4160039050 msgr2=0x7f416003b510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T03:14:48.009 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:46.390+0000 7f416a7fc700 1 --2- 172.21.15.50:0/2103287958 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f4160039050 0x7f416003b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:48.009 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:47.391+0000 7f416a7fc700 1 -- 172.21.15.50:0/2103287958 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f4170051130 con 0x7f4174106c20 2024-06-06T03:14:48.009 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:47.391+0000 7f416a7fc700 1 --2- 172.21.15.50:0/2103287958 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f416003c9d0 0x7f416003edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:48.009 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:47.391+0000 7f416a7fc700 1 -- 172.21.15.50:0/2103287958 --> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4170029e50 con 0x7f416003c9d0 2024-06-06T03:14:48.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:47.392+0000 7f4178a9d700 1 --2- 172.21.15.50:0/2103287958 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f416003c9d0 0x7f416003edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:48.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:47.392+0000 7f4178a9d700 1 --2- 172.21.15.50:0/2103287958 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f416003c9d0 0x7f416003edc0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4164003a10 tx=0x7f4164009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:48.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:47.393+0000 7f416a7fc700 1 -- 172.21.15.50:0/2103287958 <== mgr.14120 v2:172.21.15.50:6800/1311987652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7f4170029e50 con 0x7f416003c9d0 2024-06-06T03:14:48.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:47.400+0000 7f417b502700 1 -- 172.21.15.50:0/2103287958 --> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f4174063af0 con 0x7f416003c9d0 2024-06-06T03:14:48.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:47.400+0000 7f416a7fc700 1 -- 172.21.15.50:0/2103287958 <== mgr.14120 v2:172.21.15.50:6800/1311987652 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f4174063af0 con 0x7f416003c9d0 2024-06-06T03:14:48.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:47.400+0000 7f417b502700 1 -- 172.21.15.50:0/2103287958 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f416003c9d0 msgr2=0x7f416003edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:48.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:47.400+0000 7f417b502700 1 --2- 172.21.15.50:0/2103287958 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f416003c9d0 0x7f416003edc0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4164003a10 tx=0x7f4164009290 comp rx=0 tx=0).stop 2024-06-06T03:14:48.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:47.400+0000 7f417b502700 1 -- 172.21.15.50:0/2103287958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4174106c20 msgr2=0x7f4174199ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:48.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:47.400+0000 7f417b502700 1 --2- 172.21.15.50:0/2103287958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4174106c20 0x7f4174199ac0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f417000b340 tx=0x7f4170003fe0 comp rx=0 tx=0).stop 2024-06-06T03:14:48.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:47.400+0000 7f417b502700 1 -- 172.21.15.50:0/2103287958 shutdown_connections 2024-06-06T03:14:48.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:47.400+0000 7f417b502700 1 --2- 172.21.15.50:0/2103287958 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f416003c9d0 0x7f416003edc0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:48.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:47.400+0000 7f417b502700 1 --2- 172.21.15.50:0/2103287958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4174106c20 0x7f4174199ac0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:48.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:47.400+0000 7f417b502700 1 --2- 172.21.15.50:0/2103287958 >> [v2:172.21.15.50:6800/2617801068,v1:172.21.15.50:6801/2617801068] conn(0x7f4160039050 0x7f416003b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:48.011 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:47.400+0000 7f417b502700 1 -- 172.21.15.50:0/2103287958 >> 172.21.15.50:0/2103287958 conn(0x7f41741021e0 msgr2=0x7f41741905f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:48.011 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:47.400+0000 7f417b502700 1 -- 172.21.15.50:0/2103287958 shutdown_connections 2024-06-06T03:14:48.011 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:47.400+0000 7f417b502700 1 -- 172.21.15.50:0/2103287958 wait complete. 2024-06-06T03:14:48.011 INFO:teuthology.orchestra.run.smithi050.stdout:mgr epoch 5 is available 2024-06-06T03:14:48.011 INFO:teuthology.orchestra.run.smithi050.stdout:Setting orchestrator backend to cephadm... 2024-06-06T03:14:48.632 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:48 smithi050 ceph-mon[32421]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-06-06T03:14:48.632 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:48 smithi050 ceph-mon[32421]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-06-06T03:14:48.632 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:48 smithi050 ceph-mon[32421]: [06/Jun/2024:03:14:47] ENGINE Bus STARTING 2024-06-06T03:14:48.633 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:48 smithi050 ceph-mon[32421]: [06/Jun/2024:03:14:47] ENGINE Serving on http://172.21.15.50:8765 2024-06-06T03:14:48.633 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:48 smithi050 ceph-mon[32421]: [06/Jun/2024:03:14:47] ENGINE Serving on https://172.21.15.50:7150 2024-06-06T03:14:48.633 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:48 smithi050 ceph-mon[32421]: [06/Jun/2024:03:14:47] ENGINE Bus STARTED 2024-06-06T03:14:48.633 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:48 smithi050 ceph-mon[32421]: from='mgr.14120 172.21.15.50:0/2290217465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:14:49.118 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.397+0000 7f5a38b2d700 1 Processor -- start 2024-06-06T03:14:49.118 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.397+0000 7f5a38b2d700 1 -- start start 2024-06-06T03:14:49.118 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.397+0000 7f5a38b2d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a34106400 0x7f5a34106820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:49.118 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.397+0000 7f5a38b2d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5a34106df0 con 0x7f5a34106400 2024-06-06T03:14:49.118 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.397+0000 7f5a3259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a34106400 0x7f5a34106820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:49.118 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.397+0000 7f5a3259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a34106400 0x7f5a34106820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59032/0 (socket says 172.21.15.50:59032) 2024-06-06T03:14:49.118 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.397+0000 7f5a3259c700 1 -- 172.21.15.50:0/1648004068 learned_addr learned my addr 172.21.15.50:0/1648004068 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:49.118 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.398+0000 7f5a3259c700 1 -- 172.21.15.50:0/1648004068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a341075d0 con 0x7f5a34106400 2024-06-06T03:14:49.119 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.398+0000 7f5a3259c700 1 --2- 172.21.15.50:0/1648004068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a34106400 0x7f5a34106820 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5a2400bb40 tx=0x7f5a2400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ea427af7bdd643 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:49.119 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.398+0000 7f5a3159a700 1 -- 172.21.15.50:0/1648004068 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a2400dad0 con 0x7f5a34106400 2024-06-06T03:14:49.119 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.398+0000 7f5a3159a700 1 -- 172.21.15.50:0/1648004068 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f5a240044c0 con 0x7f5a34106400 2024-06-06T03:14:49.119 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.398+0000 7f5a3159a700 1 -- 172.21.15.50:0/1648004068 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a24003de0 con 0x7f5a34106400 2024-06-06T03:14:49.119 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.399+0000 7f5a38b2d700 1 -- 172.21.15.50:0/1648004068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a34106400 msgr2=0x7f5a34106820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:49.119 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.399+0000 7f5a38b2d700 1 --2- 172.21.15.50:0/1648004068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a34106400 0x7f5a34106820 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5a2400bb40 tx=0x7f5a2400be50 comp rx=0 tx=0).stop 2024-06-06T03:14:49.119 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.399+0000 7f5a38b2d700 1 -- 172.21.15.50:0/1648004068 shutdown_connections 2024-06-06T03:14:49.119 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.399+0000 7f5a38b2d700 1 --2- 172.21.15.50:0/1648004068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a34106400 0x7f5a34106820 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:49.119 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.399+0000 7f5a38b2d700 1 -- 172.21.15.50:0/1648004068 >> 172.21.15.50:0/1648004068 conn(0x7f5a34101560 msgr2=0x7f5a34103980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:49.119 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.399+0000 7f5a38b2d700 1 -- 172.21.15.50:0/1648004068 shutdown_connections 2024-06-06T03:14:49.119 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.399+0000 7f5a38b2d700 1 -- 172.21.15.50:0/1648004068 wait complete. 2024-06-06T03:14:49.119 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.399+0000 7f5a38b2d700 1 Processor -- start 2024-06-06T03:14:49.120 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.400+0000 7f5a38b2d700 1 -- start start 2024-06-06T03:14:49.120 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.400+0000 7f5a38b2d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a34106400 0x7f5a34199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:49.120 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.400+0000 7f5a38b2d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5a34107c90 con 0x7f5a34106400 2024-06-06T03:14:49.120 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.400+0000 7f5a3259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a34106400 0x7f5a34199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:49.120 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.400+0000 7f5a3259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a34106400 0x7f5a34199a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59038/0 (socket says 172.21.15.50:59038) 2024-06-06T03:14:49.120 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.400+0000 7f5a3259c700 1 -- 172.21.15.50:0/1485923516 learned_addr learned my addr 172.21.15.50:0/1485923516 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:49.120 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.400+0000 7f5a3259c700 1 -- 172.21.15.50:0/1485923516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a34199f70 con 0x7f5a34106400 2024-06-06T03:14:49.120 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.400+0000 7f5a3259c700 1 --2- 172.21.15.50:0/1485923516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a34106400 0x7f5a34199a30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5a240046b0 tx=0x7f5a24003ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:49.120 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.400+0000 7f5a237fe700 1 -- 172.21.15.50:0/1485923516 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a24017500 con 0x7f5a34106400 2024-06-06T03:14:49.120 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.401+0000 7f5a38b2d700 1 -- 172.21.15.50:0/1485923516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a3419a200 con 0x7f5a34106400 2024-06-06T03:14:49.120 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.401+0000 7f5a237fe700 1 -- 172.21.15.50:0/1485923516 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f5a24017b30 con 0x7f5a34106400 2024-06-06T03:14:49.120 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.401+0000 7f5a237fe700 1 -- 172.21.15.50:0/1485923516 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a24021a20 con 0x7f5a34106400 2024-06-06T03:14:49.120 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.401+0000 7f5a38b2d700 1 -- 172.21.15.50:0/1485923516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a3419cef0 con 0x7f5a34106400 2024-06-06T03:14:49.120 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.401+0000 7f5a237fe700 1 -- 172.21.15.50:0/1485923516 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f5a2402a400 con 0x7f5a34106400 2024-06-06T03:14:49.121 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.402+0000 7f5a237fe700 1 --2- 172.21.15.50:0/1485923516 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f5a1c038f30 0x7f5a1c03b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:49.121 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.402+0000 7f5a237fe700 1 -- 172.21.15.50:0/1485923516 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5a2404fbc0 con 0x7f5a34106400 2024-06-06T03:14:49.121 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.402+0000 7f5a31d9b700 1 --2- 172.21.15.50:0/1485923516 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f5a1c038f30 0x7f5a1c03b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:49.121 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.402+0000 7f5a38b2d700 1 -- 172.21.15.50:0/1485923516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a34063af0 con 0x7f5a34106400 2024-06-06T03:14:49.121 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.402+0000 7f5a31d9b700 1 --2- 172.21.15.50:0/1485923516 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f5a1c038f30 0x7f5a1c03b3f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5a28006fd0 tx=0x7f5a28006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:49.121 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.407+0000 7f5a237fe700 1 -- 172.21.15.50:0/1485923516 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5a24012070 con 0x7f5a34106400 2024-06-06T03:14:49.121 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.444+0000 7f5a237fe700 1 -- 172.21.15.50:0/1485923516 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f5a24017ce0 con 0x7f5a34106400 2024-06-06T03:14:49.121 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.633+0000 7f5a38b2d700 1 -- 172.21.15.50:0/1485923516 --> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f5a3402e010 con 0x7f5a1c038f30 2024-06-06T03:14:49.121 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.637+0000 7f5a237fe700 1 -- 172.21.15.50:0/1485923516 <== mgr.14120 v2:172.21.15.50:6800/1311987652 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5a3402e010 con 0x7f5a1c038f30 2024-06-06T03:14:49.121 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.640+0000 7f5a38b2d700 1 -- 172.21.15.50:0/1485923516 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f5a1c038f30 msgr2=0x7f5a1c03b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:49.121 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.640+0000 7f5a38b2d700 1 --2- 172.21.15.50:0/1485923516 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f5a1c038f30 0x7f5a1c03b3f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5a28006fd0 tx=0x7f5a28006e40 comp rx=0 tx=0).stop 2024-06-06T03:14:49.121 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.640+0000 7f5a38b2d700 1 -- 172.21.15.50:0/1485923516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a34106400 msgr2=0x7f5a34199a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:49.121 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.640+0000 7f5a38b2d700 1 --2- 172.21.15.50:0/1485923516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a34106400 0x7f5a34199a30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5a240046b0 tx=0x7f5a24003ee0 comp rx=0 tx=0).stop 2024-06-06T03:14:49.122 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.640+0000 7f5a38b2d700 1 -- 172.21.15.50:0/1485923516 shutdown_connections 2024-06-06T03:14:49.122 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.640+0000 7f5a38b2d700 1 --2- 172.21.15.50:0/1485923516 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f5a1c038f30 0x7f5a1c03b3f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:49.122 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.640+0000 7f5a38b2d700 1 --2- 172.21.15.50:0/1485923516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a34106400 0x7f5a34199a30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:49.122 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.640+0000 7f5a38b2d700 1 -- 172.21.15.50:0/1485923516 >> 172.21.15.50:0/1485923516 conn(0x7f5a34101560 msgr2=0x7f5a34190690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:49.122 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.640+0000 7f5a38b2d700 1 -- 172.21.15.50:0/1485923516 shutdown_connections 2024-06-06T03:14:49.122 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:48.640+0000 7f5a38b2d700 1 -- 172.21.15.50:0/1485923516 wait complete. 2024-06-06T03:14:49.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:49 smithi050 ceph-mon[32421]: mgrmap e8: x(active, since 2s) 2024-06-06T03:14:49.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:49 smithi050 ceph-mon[32421]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:14:49.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:49 smithi050 ceph-mon[32421]: from='mgr.14120 172.21.15.50:0/2290217465' entity='mgr.x' 2024-06-06T03:14:49.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:49 smithi050 ceph-mon[32421]: from='mgr.14120 172.21.15.50:0/2290217465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:14:50.257 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout value unchanged 2024-06-06T03:14:50.257 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.559+0000 7f265d0cf700 1 Processor -- start 2024-06-06T03:14:50.257 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.559+0000 7f265d0cf700 1 -- start start 2024-06-06T03:14:50.257 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.559+0000 7f265d0cf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2658107db0 0x7f26581081d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:50.257 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.559+0000 7f265d0cf700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f26581087a0 con 0x7f2658107db0 2024-06-06T03:14:50.257 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.559+0000 7f2656d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2658107db0 0x7f26581081d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:50.258 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.559+0000 7f2656d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2658107db0 0x7f26581081d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59042/0 (socket says 172.21.15.50:59042) 2024-06-06T03:14:50.258 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.559+0000 7f2656d9d700 1 -- 172.21.15.50:0/436747172 learned_addr learned my addr 172.21.15.50:0/436747172 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:50.258 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.559+0000 7f2656d9d700 1 -- 172.21.15.50:0/436747172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2658108f60 con 0x7f2658107db0 2024-06-06T03:14:50.258 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.560+0000 7f2656d9d700 1 --2- 172.21.15.50:0/436747172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2658107db0 0x7f26581081d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f26480098a0 tx=0x7f2648009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bb41a478b848a03 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:50.258 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.560+0000 7f2655d9b700 1 -- 172.21.15.50:0/436747172 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2648004160 con 0x7f2658107db0 2024-06-06T03:14:50.258 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.560+0000 7f2655d9b700 1 -- 172.21.15.50:0/436747172 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f2648004300 con 0x7f2658107db0 2024-06-06T03:14:50.258 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.560+0000 7f2655d9b700 1 -- 172.21.15.50:0/436747172 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2648011a80 con 0x7f2658107db0 2024-06-06T03:14:50.259 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.560+0000 7f265d0cf700 1 -- 172.21.15.50:0/436747172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2658107db0 msgr2=0x7f26581081d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:50.259 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.560+0000 7f265d0cf700 1 --2- 172.21.15.50:0/436747172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2658107db0 0x7f26581081d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f26480098a0 tx=0x7f2648009bb0 comp rx=0 tx=0).stop 2024-06-06T03:14:50.259 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.560+0000 7f265d0cf700 1 -- 172.21.15.50:0/436747172 shutdown_connections 2024-06-06T03:14:50.259 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.560+0000 7f265d0cf700 1 --2- 172.21.15.50:0/436747172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2658107db0 0x7f26581081d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:50.259 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.560+0000 7f265d0cf700 1 -- 172.21.15.50:0/436747172 >> 172.21.15.50:0/436747172 conn(0x7f2658103330 msgr2=0x7f2658105790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:50.259 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.560+0000 7f265d0cf700 1 -- 172.21.15.50:0/436747172 shutdown_connections 2024-06-06T03:14:50.259 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.560+0000 7f265d0cf700 1 -- 172.21.15.50:0/436747172 wait complete. 2024-06-06T03:14:50.259 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.561+0000 7f265d0cf700 1 Processor -- start 2024-06-06T03:14:50.259 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.561+0000 7f265d0cf700 1 -- start start 2024-06-06T03:14:50.259 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.562+0000 7f265d0cf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2658107db0 0x7f265819df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:50.259 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.562+0000 7f265d0cf700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f265810c310 con 0x7f2658107db0 2024-06-06T03:14:50.259 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.562+0000 7f2656d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2658107db0 0x7f265819df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:50.260 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.562+0000 7f2656d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2658107db0 0x7f265819df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59050/0 (socket says 172.21.15.50:59050) 2024-06-06T03:14:50.260 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.562+0000 7f2656d9d700 1 -- 172.21.15.50:0/130516276 learned_addr learned my addr 172.21.15.50:0/130516276 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:50.260 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.562+0000 7f2656d9d700 1 -- 172.21.15.50:0/130516276 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f265819e460 con 0x7f2658107db0 2024-06-06T03:14:50.260 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.562+0000 7f2656d9d700 1 --2- 172.21.15.50:0/130516276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2658107db0 0x7f265819df20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2648006af0 tx=0x7f2648011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:50.260 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.562+0000 7f263ffff700 1 -- 172.21.15.50:0/130516276 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26480039e0 con 0x7f2658107db0 2024-06-06T03:14:50.260 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.562+0000 7f263ffff700 1 -- 172.21.15.50:0/130516276 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f2648003b80 con 0x7f2658107db0 2024-06-06T03:14:50.260 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.562+0000 7f265d0cf700 1 -- 172.21.15.50:0/130516276 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f265819e6f0 con 0x7f2658107db0 2024-06-06T03:14:50.260 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.562+0000 7f263ffff700 1 -- 172.21.15.50:0/130516276 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26480196a0 con 0x7f2658107db0 2024-06-06T03:14:50.261 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.562+0000 7f265d0cf700 1 -- 172.21.15.50:0/130516276 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26581a1390 con 0x7f2658107db0 2024-06-06T03:14:50.261 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.563+0000 7f263ffff700 1 -- 172.21.15.50:0/130516276 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f26480199a0 con 0x7f2658107db0 2024-06-06T03:14:50.261 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.563+0000 7f265d0cf700 1 -- 172.21.15.50:0/130516276 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2658063af0 con 0x7f2658107db0 2024-06-06T03:14:50.261 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.564+0000 7f263ffff700 1 --2- 172.21.15.50:0/130516276 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f2640039000 0x7f264003b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:50.261 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.564+0000 7f263ffff700 1 -- 172.21.15.50:0/130516276 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f264804d5f0 con 0x7f2658107db0 2024-06-06T03:14:50.261 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.564+0000 7f265659c700 1 --2- 172.21.15.50:0/130516276 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f2640039000 0x7f264003b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:50.261 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.564+0000 7f265659c700 1 --2- 172.21.15.50:0/130516276 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f2640039000 0x7f264003b4c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f264c006fd0 tx=0x7f264c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:50.261 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.569+0000 7f263ffff700 1 -- 172.21.15.50:0/130516276 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2648020240 con 0x7f2658107db0 2024-06-06T03:14:50.261 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.776+0000 7f265d0cf700 1 -- 172.21.15.50:0/130516276 --> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f26581044d0 con 0x7f2640039000 2024-06-06T03:14:50.261 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.777+0000 7f263ffff700 1 -- 172.21.15.50:0/130516276 <== mgr.14120 v2:172.21.15.50:6800/1311987652 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f26581044d0 con 0x7f2640039000 2024-06-06T03:14:50.261 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.779+0000 7f265d0cf700 1 -- 172.21.15.50:0/130516276 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f2640039000 msgr2=0x7f264003b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:50.261 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.779+0000 7f265d0cf700 1 --2- 172.21.15.50:0/130516276 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f2640039000 0x7f264003b4c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f264c006fd0 tx=0x7f264c006e40 comp rx=0 tx=0).stop 2024-06-06T03:14:50.262 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.779+0000 7f265d0cf700 1 -- 172.21.15.50:0/130516276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2658107db0 msgr2=0x7f265819df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:50.262 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.779+0000 7f265d0cf700 1 --2- 172.21.15.50:0/130516276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2658107db0 0x7f265819df20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2648006af0 tx=0x7f2648011c40 comp rx=0 tx=0).stop 2024-06-06T03:14:50.262 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.779+0000 7f265d0cf700 1 -- 172.21.15.50:0/130516276 shutdown_connections 2024-06-06T03:14:50.262 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.779+0000 7f265d0cf700 1 --2- 172.21.15.50:0/130516276 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f2640039000 0x7f264003b4c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:50.262 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.779+0000 7f265d0cf700 1 --2- 172.21.15.50:0/130516276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2658107db0 0x7f265819df20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:50.262 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.779+0000 7f265d0cf700 1 -- 172.21.15.50:0/130516276 >> 172.21.15.50:0/130516276 conn(0x7f2658103330 msgr2=0x7f2658103dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:50.262 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.779+0000 7f265d0cf700 1 -- 172.21.15.50:0/130516276 shutdown_connections 2024-06-06T03:14:50.262 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:49.779+0000 7f265d0cf700 1 -- 172.21.15.50:0/130516276 wait complete. 2024-06-06T03:14:50.262 INFO:teuthology.orchestra.run.smithi050.stdout:Generating ssh key... 2024-06-06T03:14:50.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:50 smithi050 ceph-mon[32421]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:14:51.252 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:51 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: Generating public/private rsa key pair. 2024-06-06T03:14:51.252 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:51 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: Your identification has been saved in /tmp/tmp1s_69psc/key. 2024-06-06T03:14:51.252 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:51 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: Your public key has been saved in /tmp/tmp1s_69psc/key.pub. 2024-06-06T03:14:51.252 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:51 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: The key fingerprint is: 2024-06-06T03:14:51.252 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:51 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: SHA256:1/Dew5jgUfgdmZMcH4BdS/f3hrT5ZNC2aO6ulzF0Dt0 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:14:51.253 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:51 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: The key's randomart image is: 2024-06-06T03:14:51.253 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:51 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: +---[RSA 3072]----+ 2024-06-06T03:14:51.253 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:51 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: | o.++.| 2024-06-06T03:14:51.253 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:51 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: | o o.B=| 2024-06-06T03:14:51.253 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:51 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: | o . @.B| 2024-06-06T03:14:51.253 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:51 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: | * =.@E| 2024-06-06T03:14:51.253 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:51 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: | S + =oO.=| 2024-06-06T03:14:51.253 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:51 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: | o +oB * | 2024-06-06T03:14:51.253 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:51 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: | . +.B .| 2024-06-06T03:14:51.253 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:51 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: | .o . | 2024-06-06T03:14:51.253 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:51 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: | .+o | 2024-06-06T03:14:51.253 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:14:51 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: +----[SHA256]-----+ 2024-06-06T03:14:51.781 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.709+0000 7f7b1af4f700 1 Processor -- start 2024-06-06T03:14:51.781 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.709+0000 7f7b1af4f700 1 -- start start 2024-06-06T03:14:51.781 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.709+0000 7f7b1af4f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b141087d0 0x7f7b1410abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:51.782 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.709+0000 7f7b1af4f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1407be60 con 0x7f7b141087d0 2024-06-06T03:14:51.782 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.709+0000 7f7b18ceb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b141087d0 0x7f7b1410abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:51.782 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.709+0000 7f7b18ceb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b141087d0 0x7f7b1410abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59064/0 (socket says 172.21.15.50:59064) 2024-06-06T03:14:51.782 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.709+0000 7f7b18ceb700 1 -- 172.21.15.50:0/175920067 learned_addr learned my addr 172.21.15.50:0/175920067 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:51.782 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.709+0000 7f7b18ceb700 1 -- 172.21.15.50:0/175920067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1410b100 con 0x7f7b141087d0 2024-06-06T03:14:51.782 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.710+0000 7f7b18ceb700 1 --2- 172.21.15.50:0/175920067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b141087d0 0x7f7b1410abc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7b080098a0 tx=0x7f7b08009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc50896ba59ccb93 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:51.782 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.710+0000 7f7b137fe700 1 -- 172.21.15.50:0/175920067 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b08004160 con 0x7f7b141087d0 2024-06-06T03:14:51.782 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.710+0000 7f7b137fe700 1 -- 172.21.15.50:0/175920067 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f7b08004300 con 0x7f7b141087d0 2024-06-06T03:14:51.782 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.710+0000 7f7b137fe700 1 -- 172.21.15.50:0/175920067 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b08011a80 con 0x7f7b141087d0 2024-06-06T03:14:51.782 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.710+0000 7f7b1af4f700 1 -- 172.21.15.50:0/175920067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b141087d0 msgr2=0x7f7b1410abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:51.782 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.710+0000 7f7b1af4f700 1 --2- 172.21.15.50:0/175920067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b141087d0 0x7f7b1410abc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7b080098a0 tx=0x7f7b08009bb0 comp rx=0 tx=0).stop 2024-06-06T03:14:51.782 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.710+0000 7f7b1af4f700 1 -- 172.21.15.50:0/175920067 shutdown_connections 2024-06-06T03:14:51.783 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.710+0000 7f7b1af4f700 1 --2- 172.21.15.50:0/175920067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b141087d0 0x7f7b1410abc0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:51.783 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.710+0000 7f7b1af4f700 1 -- 172.21.15.50:0/175920067 >> 172.21.15.50:0/175920067 conn(0x7f7b141021e0 msgr2=0x7f7b14104600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:51.783 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.711+0000 7f7b1af4f700 1 -- 172.21.15.50:0/175920067 shutdown_connections 2024-06-06T03:14:51.783 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.711+0000 7f7b1af4f700 1 -- 172.21.15.50:0/175920067 wait complete. 2024-06-06T03:14:51.783 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.711+0000 7f7b1af4f700 1 Processor -- start 2024-06-06T03:14:51.783 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.711+0000 7f7b1af4f700 1 -- start start 2024-06-06T03:14:51.783 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.711+0000 7f7b1af4f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b141087d0 0x7f7b1419bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:51.783 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.711+0000 7f7b1af4f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1410c0c0 con 0x7f7b141087d0 2024-06-06T03:14:51.783 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.712+0000 7f7b18ceb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b141087d0 0x7f7b1419bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:51.783 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.712+0000 7f7b18ceb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b141087d0 0x7f7b1419bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59070/0 (socket says 172.21.15.50:59070) 2024-06-06T03:14:51.783 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.712+0000 7f7b18ceb700 1 -- 172.21.15.50:0/2947367413 learned_addr learned my addr 172.21.15.50:0/2947367413 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:51.783 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.712+0000 7f7b18ceb700 1 -- 172.21.15.50:0/2947367413 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1419c1b0 con 0x7f7b141087d0 2024-06-06T03:14:51.783 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.712+0000 7f7b18ceb700 1 --2- 172.21.15.50:0/2947367413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b141087d0 0x7f7b1419bc70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7b08011a50 tx=0x7f7b08011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:51.784 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.712+0000 7f7b11ffb700 1 -- 172.21.15.50:0/2947367413 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b08003a80 con 0x7f7b141087d0 2024-06-06T03:14:51.784 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.712+0000 7f7b1af4f700 1 -- 172.21.15.50:0/2947367413 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b1419c440 con 0x7f7b141087d0 2024-06-06T03:14:51.784 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.712+0000 7f7b11ffb700 1 -- 172.21.15.50:0/2947367413 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f7b08003c20 con 0x7f7b141087d0 2024-06-06T03:14:51.784 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.712+0000 7f7b11ffb700 1 -- 172.21.15.50:0/2947367413 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b0801a650 con 0x7f7b141087d0 2024-06-06T03:14:51.784 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.713+0000 7f7b1af4f700 1 -- 172.21.15.50:0/2947367413 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b1419f130 con 0x7f7b141087d0 2024-06-06T03:14:51.784 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.713+0000 7f7b11ffb700 1 -- 172.21.15.50:0/2947367413 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f7b0801a950 con 0x7f7b141087d0 2024-06-06T03:14:51.784 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.713+0000 7f7b1af4f700 1 -- 172.21.15.50:0/2947367413 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b14063af0 con 0x7f7b141087d0 2024-06-06T03:14:51.784 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.714+0000 7f7b11ffb700 1 --2- 172.21.15.50:0/2947367413 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f7b04039050 0x7f7b0403b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:51.784 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.714+0000 7f7b11ffb700 1 -- 172.21.15.50:0/2947367413 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7b0804d780 con 0x7f7b141087d0 2024-06-06T03:14:51.784 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.714+0000 7f7b13fff700 1 --2- 172.21.15.50:0/2947367413 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f7b04039050 0x7f7b0403b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:51.785 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.714+0000 7f7b13fff700 1 --2- 172.21.15.50:0/2947367413 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f7b04039050 0x7f7b0403b510 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7b00006fd0 tx=0x7f7b00006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:51.785 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.719+0000 7f7b11ffb700 1 -- 172.21.15.50:0/2947367413 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7b0800fdd0 con 0x7f7b141087d0 2024-06-06T03:14:51.785 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:50.929+0000 7f7b1af4f700 1 -- 172.21.15.50:0/2947367413 --> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f7b14103400 con 0x7f7b04039050 2024-06-06T03:14:51.785 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:51.164+0000 7f7b11ffb700 1 -- 172.21.15.50:0/2947367413 <== mgr.14120 v2:172.21.15.50:6800/1311987652 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7b14103400 con 0x7f7b04039050 2024-06-06T03:14:51.785 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:51.167+0000 7f7b1af4f700 1 -- 172.21.15.50:0/2947367413 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f7b04039050 msgr2=0x7f7b0403b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:51.785 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:51.167+0000 7f7b1af4f700 1 --2- 172.21.15.50:0/2947367413 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f7b04039050 0x7f7b0403b510 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7b00006fd0 tx=0x7f7b00006e40 comp rx=0 tx=0).stop 2024-06-06T03:14:51.785 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:51.167+0000 7f7b1af4f700 1 -- 172.21.15.50:0/2947367413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b141087d0 msgr2=0x7f7b1419bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:51.785 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:51.167+0000 7f7b1af4f700 1 --2- 172.21.15.50:0/2947367413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b141087d0 0x7f7b1419bc70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7b08011a50 tx=0x7f7b08011b30 comp rx=0 tx=0).stop 2024-06-06T03:14:51.785 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:51.167+0000 7f7b1af4f700 1 -- 172.21.15.50:0/2947367413 shutdown_connections 2024-06-06T03:14:51.785 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:51.167+0000 7f7b1af4f700 1 --2- 172.21.15.50:0/2947367413 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f7b04039050 0x7f7b0403b510 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:51.785 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:51.167+0000 7f7b1af4f700 1 --2- 172.21.15.50:0/2947367413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b141087d0 0x7f7b1419bc70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:51.786 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:51.167+0000 7f7b1af4f700 1 -- 172.21.15.50:0/2947367413 >> 172.21.15.50:0/2947367413 conn(0x7f7b141021e0 msgr2=0x7f7b14102cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:51.786 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:51.167+0000 7f7b1af4f700 1 -- 172.21.15.50:0/2947367413 shutdown_connections 2024-06-06T03:14:51.786 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:51.167+0000 7f7b1af4f700 1 -- 172.21.15.50:0/2947367413 wait complete. 2024-06-06T03:14:52.434 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:52 smithi050 ceph-mon[32421]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:14:52.435 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:52 smithi050 ceph-mon[32421]: Generating ssh key... 2024-06-06T03:14:52.435 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:52 smithi050 ceph-mon[32421]: from='mgr.14120 172.21.15.50:0/2290217465' entity='mgr.x' 2024-06-06T03:14:52.435 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:52 smithi050 ceph-mon[32421]: from='mgr.14120 172.21.15.50:0/2290217465' entity='mgr.x' 2024-06-06T03:14:53.013 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDW7H6b037ZzNSTM8JSKFIyR0lJ/p6CWiLbHhfQ7QkKWpXcQrSnG3AYaQXNBFsWVVp7HaxWV0zfxfRUQinpuqmyw5rE6D/SpB9A+wLRiAl7+ovZq3DGBjLlG7TKaBgWCSt0jRdvM6hnKzD5oIhSI18pMCwaFpmUBMrAgZpAt8kBKymTF3h5DimAZMZNiP5ji6Gc4lrgw2AHUunlpIILrvQ7A+tJKsVkD3yUvZWHq7YRN9ilX1GqfXKw9POtuiusMCyLcZqMsfcDkIKBLWw/RWJGH0Bc8pw2+XpXifXy72dTVLM/Pnxv5qyM0z0Kz2YwWGcAZ7pFEqSTObLbEafg01O2S/X0fp0sdB4WNtzaa/GXfyQU74F5vvU1gED0iugVUYnqaIbtPE3f9cmi7Oda6TemkQevbLvS+ZD9En5jfMWr+PlSxu0Ced0gnjVaY8q26qlqoz/LobOb20i96fOfKRsxj4eYwC8JTapYW/Rdn4qai79S0ccK079QgFQYreyyoz8= ceph-b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:14:53.013 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.216+0000 7f013e817700 1 Processor -- start 2024-06-06T03:14:53.013 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.216+0000 7f013e817700 1 -- start start 2024-06-06T03:14:53.013 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.216+0000 7f013e817700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f013807de10 0x7f013807c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:53.013 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.216+0000 7f013e817700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f013807c850 con 0x7f013807de10 2024-06-06T03:14:53.013 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.216+0000 7f0137fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f013807de10 0x7f013807c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:53.013 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.216+0000 7f0137fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f013807de10 0x7f013807c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59082/0 (socket says 172.21.15.50:59082) 2024-06-06T03:14:53.013 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.216+0000 7f0137fff700 1 -- 172.21.15.50:0/691245155 learned_addr learned my addr 172.21.15.50:0/691245155 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:53.014 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.216+0000 7f0137fff700 1 -- 172.21.15.50:0/691245155 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013807c9d0 con 0x7f013807de10 2024-06-06T03:14:53.014 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.217+0000 7f0137fff700 1 --2- 172.21.15.50:0/691245155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f013807de10 0x7f013807c310 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f01280098a0 tx=0x7f0128009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91813fd9b30b222a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:53.014 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.217+0000 7f0136ffd700 1 -- 172.21.15.50:0/691245155 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0128004160 con 0x7f013807de10 2024-06-06T03:14:53.014 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.217+0000 7f0136ffd700 1 -- 172.21.15.50:0/691245155 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f0128004300 con 0x7f013807de10 2024-06-06T03:14:53.014 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.217+0000 7f0136ffd700 1 -- 172.21.15.50:0/691245155 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0128011a80 con 0x7f013807de10 2024-06-06T03:14:53.014 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.217+0000 7f013e817700 1 -- 172.21.15.50:0/691245155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f013807de10 msgr2=0x7f013807c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:53.014 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.217+0000 7f013e817700 1 --2- 172.21.15.50:0/691245155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f013807de10 0x7f013807c310 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f01280098a0 tx=0x7f0128009bb0 comp rx=0 tx=0).stop 2024-06-06T03:14:53.014 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.217+0000 7f013e817700 1 -- 172.21.15.50:0/691245155 shutdown_connections 2024-06-06T03:14:53.014 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.217+0000 7f013e817700 1 --2- 172.21.15.50:0/691245155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f013807de10 0x7f013807c310 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:53.014 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.217+0000 7f013e817700 1 -- 172.21.15.50:0/691245155 >> 172.21.15.50:0/691245155 conn(0x7f0138103340 msgr2=0x7f01381057a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:53.014 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.217+0000 7f013e817700 1 -- 172.21.15.50:0/691245155 shutdown_connections 2024-06-06T03:14:53.014 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.217+0000 7f013e817700 1 -- 172.21.15.50:0/691245155 wait complete. 2024-06-06T03:14:53.014 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.218+0000 7f013e817700 1 Processor -- start 2024-06-06T03:14:53.014 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.218+0000 7f013e817700 1 -- start start 2024-06-06T03:14:53.015 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.219+0000 7f013e817700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f013807de10 0x7f013819de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:53.015 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.219+0000 7f013e817700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f013810e2f0 con 0x7f013807de10 2024-06-06T03:14:53.015 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.219+0000 7f0137fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f013807de10 0x7f013819de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:53.015 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.219+0000 7f0137fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f013807de10 0x7f013819de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59096/0 (socket says 172.21.15.50:59096) 2024-06-06T03:14:53.015 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.219+0000 7f0137fff700 1 -- 172.21.15.50:0/556376055 learned_addr learned my addr 172.21.15.50:0/556376055 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:53.015 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.219+0000 7f0137fff700 1 -- 172.21.15.50:0/556376055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013819e3c0 con 0x7f013807de10 2024-06-06T03:14:53.015 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.219+0000 7f0137fff700 1 --2- 172.21.15.50:0/556376055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f013807de10 0x7f013819de80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0128011a50 tx=0x7f0128011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:53.015 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.219+0000 7f01357fa700 1 -- 172.21.15.50:0/556376055 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0128003a80 con 0x7f013807de10 2024-06-06T03:14:53.015 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.219+0000 7f01357fa700 1 -- 172.21.15.50:0/556376055 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f0128003c20 con 0x7f013807de10 2024-06-06T03:14:53.015 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.219+0000 7f013e817700 1 -- 172.21.15.50:0/556376055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f013819e650 con 0x7f013807de10 2024-06-06T03:14:53.015 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.219+0000 7f01357fa700 1 -- 172.21.15.50:0/556376055 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f012801a650 con 0x7f013807de10 2024-06-06T03:14:53.015 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.219+0000 7f013e817700 1 -- 172.21.15.50:0/556376055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01381a1340 con 0x7f013807de10 2024-06-06T03:14:53.015 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.220+0000 7f01357fa700 1 -- 172.21.15.50:0/556376055 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f012801a900 con 0x7f013807de10 2024-06-06T03:14:53.015 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.220+0000 7f01357fa700 1 --2- 172.21.15.50:0/556376055 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f01200390a0 0x7f012003b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:53.015 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.220+0000 7f01357fa700 1 -- 172.21.15.50:0/556376055 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f012804d510 con 0x7f013807de10 2024-06-06T03:14:53.016 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.221+0000 7f013e817700 1 -- 172.21.15.50:0/556376055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0138063af0 con 0x7f013807de10 2024-06-06T03:14:53.016 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.221+0000 7f01377fe700 1 --2- 172.21.15.50:0/556376055 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f01200390a0 0x7f012003b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:53.016 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.221+0000 7f01377fe700 1 --2- 172.21.15.50:0/556376055 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f01200390a0 0x7f012003b560 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f012c006fd0 tx=0x7f012c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:53.016 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.226+0000 7f01357fa700 1 -- 172.21.15.50:0/556376055 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0128019c70 con 0x7f013807de10 2024-06-06T03:14:53.016 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.435+0000 7f013e817700 1 -- 172.21.15.50:0/556376055 --> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f0138104560 con 0x7f01200390a0 2024-06-06T03:14:53.016 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.436+0000 7f01357fa700 1 -- 172.21.15.50:0/556376055 <== mgr.14120 v2:172.21.15.50:6800/1311987652 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f0138104560 con 0x7f01200390a0 2024-06-06T03:14:53.016 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.438+0000 7f013e817700 1 -- 172.21.15.50:0/556376055 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f01200390a0 msgr2=0x7f012003b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:53.016 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.438+0000 7f013e817700 1 --2- 172.21.15.50:0/556376055 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f01200390a0 0x7f012003b560 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f012c006fd0 tx=0x7f012c006e40 comp rx=0 tx=0).stop 2024-06-06T03:14:53.016 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.438+0000 7f013e817700 1 -- 172.21.15.50:0/556376055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f013807de10 msgr2=0x7f013819de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:53.016 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.438+0000 7f013e817700 1 --2- 172.21.15.50:0/556376055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f013807de10 0x7f013819de80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0128011a50 tx=0x7f0128011b30 comp rx=0 tx=0).stop 2024-06-06T03:14:53.016 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.438+0000 7f013e817700 1 -- 172.21.15.50:0/556376055 shutdown_connections 2024-06-06T03:14:53.016 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.438+0000 7f013e817700 1 --2- 172.21.15.50:0/556376055 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f01200390a0 0x7f012003b560 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:53.016 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.438+0000 7f013e817700 1 --2- 172.21.15.50:0/556376055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f013807de10 0x7f013819de80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:53.016 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.438+0000 7f013e817700 1 -- 172.21.15.50:0/556376055 >> 172.21.15.50:0/556376055 conn(0x7f0138103340 msgr2=0x7f0138103e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:53.017 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.438+0000 7f013e817700 1 -- 172.21.15.50:0/556376055 shutdown_connections 2024-06-06T03:14:53.017 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:52.438+0000 7f013e817700 1 -- 172.21.15.50:0/556376055 wait complete. 2024-06-06T03:14:53.017 INFO:teuthology.orchestra.run.smithi050.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-06-06T03:14:53.017 INFO:teuthology.orchestra.run.smithi050.stdout:Adding key to root@localhost authorized_keys... 2024-06-06T03:14:53.017 INFO:teuthology.orchestra.run.smithi050.stdout:Adding host smithi050... 2024-06-06T03:14:53.659 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:53 smithi050 ceph-mon[32421]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:14:54.600 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:54 smithi050 ceph-mon[32421]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi050", "addr": "172.21.15.50", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:14:54.600 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:54 smithi050 ceph-mon[32421]: Deploying cephadm binary to smithi050 2024-06-06T03:14:58.604 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout Added host 'smithi050' with addr '172.21.15.50' 2024-06-06T03:14:58.605 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.432+0000 7fd0e2edf700 1 Processor -- start 2024-06-06T03:14:58.605 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.432+0000 7fd0e2edf700 1 -- start start 2024-06-06T03:14:58.605 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.433+0000 7fd0e2edf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0dc107dc0 0x7fd0dc1081e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:58.605 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.433+0000 7fd0e2edf700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc1087b0 con 0x7fd0dc107dc0 2024-06-06T03:14:58.605 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.433+0000 7fd0e0c7b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0dc107dc0 0x7fd0dc1081e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:58.605 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.433+0000 7fd0e0c7b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0dc107dc0 0x7fd0dc1081e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59100/0 (socket says 172.21.15.50:59100) 2024-06-06T03:14:58.605 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.433+0000 7fd0e0c7b700 1 -- 172.21.15.50:0/1581645592 learned_addr learned my addr 172.21.15.50:0/1581645592 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:58.605 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.433+0000 7fd0e0c7b700 1 -- 172.21.15.50:0/1581645592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0dc108f20 con 0x7fd0dc107dc0 2024-06-06T03:14:58.605 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.433+0000 7fd0e0c7b700 1 --2- 172.21.15.50:0/1581645592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0dc107dc0 0x7fd0dc1081e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd0d00098a0 tx=0x7fd0d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8391f46fb883046 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:58.605 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.433+0000 7fd0db7fe700 1 -- 172.21.15.50:0/1581645592 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0d0004160 con 0x7fd0dc107dc0 2024-06-06T03:14:58.605 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.433+0000 7fd0db7fe700 1 -- 172.21.15.50:0/1581645592 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fd0d0004300 con 0x7fd0dc107dc0 2024-06-06T03:14:58.606 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.433+0000 7fd0db7fe700 1 -- 172.21.15.50:0/1581645592 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0d0011a80 con 0x7fd0dc107dc0 2024-06-06T03:14:58.606 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.434+0000 7fd0e2edf700 1 -- 172.21.15.50:0/1581645592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0dc107dc0 msgr2=0x7fd0dc1081e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:58.606 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.434+0000 7fd0e2edf700 1 --2- 172.21.15.50:0/1581645592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0dc107dc0 0x7fd0dc1081e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd0d00098a0 tx=0x7fd0d0009bb0 comp rx=0 tx=0).stop 2024-06-06T03:14:58.606 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.434+0000 7fd0e2edf700 1 -- 172.21.15.50:0/1581645592 shutdown_connections 2024-06-06T03:14:58.606 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.434+0000 7fd0e2edf700 1 --2- 172.21.15.50:0/1581645592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0dc107dc0 0x7fd0dc1081e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:58.606 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.434+0000 7fd0e2edf700 1 -- 172.21.15.50:0/1581645592 >> 172.21.15.50:0/1581645592 conn(0x7fd0dc103340 msgr2=0x7fd0dc1057a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:58.606 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.434+0000 7fd0e2edf700 1 -- 172.21.15.50:0/1581645592 shutdown_connections 2024-06-06T03:14:58.606 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.434+0000 7fd0e2edf700 1 -- 172.21.15.50:0/1581645592 wait complete. 2024-06-06T03:14:58.606 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.435+0000 7fd0e2edf700 1 Processor -- start 2024-06-06T03:14:58.606 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.435+0000 7fd0e2edf700 1 -- start start 2024-06-06T03:14:58.606 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.435+0000 7fd0e2edf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0dc107dc0 0x7fd0dc07db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:58.606 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.435+0000 7fd0e2edf700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc10c2d0 con 0x7fd0dc107dc0 2024-06-06T03:14:58.606 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.435+0000 7fd0e0c7b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0dc107dc0 0x7fd0dc07db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:58.607 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.435+0000 7fd0e0c7b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0dc107dc0 0x7fd0dc07db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59116/0 (socket says 172.21.15.50:59116) 2024-06-06T03:14:58.607 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.435+0000 7fd0e0c7b700 1 -- 172.21.15.50:0/3356601899 learned_addr learned my addr 172.21.15.50:0/3356601899 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:14:58.607 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.435+0000 7fd0e0c7b700 1 -- 172.21.15.50:0/3356601899 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0dc07e0a0 con 0x7fd0dc107dc0 2024-06-06T03:14:58.607 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.436+0000 7fd0e0c7b700 1 --2- 172.21.15.50:0/3356601899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0dc107dc0 0x7fd0dc07db60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0000c00 tx=0x7fd0d0011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:58.607 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.436+0000 7fd0d9ffb700 1 -- 172.21.15.50:0/3356601899 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0d00039f0 con 0x7fd0dc107dc0 2024-06-06T03:14:58.607 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.436+0000 7fd0d9ffb700 1 -- 172.21.15.50:0/3356601899 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fd0d0003b90 con 0x7fd0dc107dc0 2024-06-06T03:14:58.607 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.436+0000 7fd0e2edf700 1 -- 172.21.15.50:0/3356601899 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0dc07c290 con 0x7fd0dc107dc0 2024-06-06T03:14:58.607 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.436+0000 7fd0d9ffb700 1 -- 172.21.15.50:0/3356601899 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0d001a740 con 0x7fd0dc107dc0 2024-06-06T03:14:58.607 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.436+0000 7fd0e2edf700 1 -- 172.21.15.50:0/3356601899 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0dc07c7d0 con 0x7fd0dc107dc0 2024-06-06T03:14:58.607 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.437+0000 7fd0d9ffb700 1 -- 172.21.15.50:0/3356601899 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fd0d001a9f0 con 0x7fd0dc107dc0 2024-06-06T03:14:58.607 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.437+0000 7fd0e2edf700 1 -- 172.21.15.50:0/3356601899 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0dc063af0 con 0x7fd0dc107dc0 2024-06-06T03:14:58.607 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.437+0000 7fd0d9ffb700 1 --2- 172.21.15.50:0/3356601899 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7fd0cc0390a0 0x7fd0cc03b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:14:58.607 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.437+0000 7fd0d9ffb700 1 -- 172.21.15.50:0/3356601899 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd0d004d640 con 0x7fd0dc107dc0 2024-06-06T03:14:58.607 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.438+0000 7fd0dbfff700 1 --2- 172.21.15.50:0/3356601899 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7fd0cc0390a0 0x7fd0cc03b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:14:58.608 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.438+0000 7fd0dbfff700 1 --2- 172.21.15.50:0/3356601899 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7fd0cc0390a0 0x7fd0cc03b560 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8006fd0 tx=0x7fd0c8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:14:58.608 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.447+0000 7fd0d9ffb700 1 -- 172.21.15.50:0/3356601899 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd0d0020240 con 0x7fd0dc107dc0 2024-06-06T03:14:58.608 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:53.659+0000 7fd0e2edf700 1 -- 172.21.15.50:0/3356601899 --> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi050", "addr": "172.21.15.50", "target": ["mon-mgr", ""]}) -- 0x7fd0dc07d030 con 0x7fd0cc0390a0 2024-06-06T03:14:58.608 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:57.986+0000 7fd0d9ffb700 1 -- 172.21.15.50:0/3356601899 <== mgr.14120 v2:172.21.15.50:6800/1311987652 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fd0dc07d030 con 0x7fd0cc0390a0 2024-06-06T03:14:58.608 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:57.989+0000 7fd0e2edf700 1 -- 172.21.15.50:0/3356601899 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7fd0cc0390a0 msgr2=0x7fd0cc03b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:58.608 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:57.989+0000 7fd0e2edf700 1 --2- 172.21.15.50:0/3356601899 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7fd0cc0390a0 0x7fd0cc03b560 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8006fd0 tx=0x7fd0c8006e40 comp rx=0 tx=0).stop 2024-06-06T03:14:58.608 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:57.989+0000 7fd0e2edf700 1 -- 172.21.15.50:0/3356601899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0dc107dc0 msgr2=0x7fd0dc07db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:14:58.608 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:57.989+0000 7fd0e2edf700 1 --2- 172.21.15.50:0/3356601899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0dc107dc0 0x7fd0dc07db60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0000c00 tx=0x7fd0d0011b00 comp rx=0 tx=0).stop 2024-06-06T03:14:58.608 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:57.989+0000 7fd0e2edf700 1 -- 172.21.15.50:0/3356601899 shutdown_connections 2024-06-06T03:14:58.608 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:57.989+0000 7fd0e2edf700 1 --2- 172.21.15.50:0/3356601899 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7fd0cc0390a0 0x7fd0cc03b560 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:58.608 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:57.989+0000 7fd0e2edf700 1 --2- 172.21.15.50:0/3356601899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0dc107dc0 0x7fd0dc07db60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:14:58.608 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:57.989+0000 7fd0e2edf700 1 -- 172.21.15.50:0/3356601899 >> 172.21.15.50:0/3356601899 conn(0x7fd0dc103340 msgr2=0x7fd0dc103ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:14:58.608 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:57.989+0000 7fd0e2edf700 1 -- 172.21.15.50:0/3356601899 shutdown_connections 2024-06-06T03:14:58.609 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:57.989+0000 7fd0e2edf700 1 -- 172.21.15.50:0/3356601899 wait complete. 2024-06-06T03:14:58.609 INFO:teuthology.orchestra.run.smithi050.stdout:Deploying unmanaged mon service... 2024-06-06T03:14:59.161 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:58 smithi050 ceph-mon[32421]: from='mgr.14120 172.21.15.50:0/2290217465' entity='mgr.x' 2024-06-06T03:14:59.161 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:58 smithi050 ceph-mon[32421]: Added host smithi050 2024-06-06T03:14:59.161 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:14:58 smithi050 ceph-mon[32421]: from='mgr.14120 172.21.15.50:0/2290217465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:15:00.234 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-06-06T03:15:00.234 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.117+0000 7f21a940a700 1 Processor -- start 2024-06-06T03:15:00.235 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.117+0000 7f21a940a700 1 -- start start 2024-06-06T03:15:00.235 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.117+0000 7f21a940a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21a4108830 0x7f21a410ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:00.235 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.117+0000 7f21a940a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f21a407be60 con 0x7f21a4108830 2024-06-06T03:15:00.235 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.117+0000 7f21a2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21a4108830 0x7f21a410ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:00.235 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.117+0000 7f21a2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21a4108830 0x7f21a410ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54228/0 (socket says 172.21.15.50:54228) 2024-06-06T03:15:00.235 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.117+0000 7f21a2ffd700 1 -- 172.21.15.50:0/2335472317 learned_addr learned my addr 172.21.15.50:0/2335472317 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:15:00.235 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.118+0000 7f21a2ffd700 1 -- 172.21.15.50:0/2335472317 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a410b160 con 0x7f21a4108830 2024-06-06T03:15:00.235 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.118+0000 7f21a2ffd700 1 --2- 172.21.15.50:0/2335472317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21a4108830 0x7f21a410ac20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f21940098a0 tx=0x7f2194009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3f82049de43311 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:00.235 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.118+0000 7f21a1ffb700 1 -- 172.21.15.50:0/2335472317 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2194004160 con 0x7f21a4108830 2024-06-06T03:15:00.235 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.118+0000 7f21a1ffb700 1 -- 172.21.15.50:0/2335472317 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f2194004300 con 0x7f21a4108830 2024-06-06T03:15:00.235 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.118+0000 7f21a1ffb700 1 -- 172.21.15.50:0/2335472317 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2194011a80 con 0x7f21a4108830 2024-06-06T03:15:00.235 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.119+0000 7f21a940a700 1 -- 172.21.15.50:0/2335472317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21a4108830 msgr2=0x7f21a410ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:00.236 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.119+0000 7f21a940a700 1 --2- 172.21.15.50:0/2335472317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21a4108830 0x7f21a410ac20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f21940098a0 tx=0x7f2194009bb0 comp rx=0 tx=0).stop 2024-06-06T03:15:00.236 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.119+0000 7f21a940a700 1 -- 172.21.15.50:0/2335472317 shutdown_connections 2024-06-06T03:15:00.236 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.119+0000 7f21a940a700 1 --2- 172.21.15.50:0/2335472317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21a4108830 0x7f21a410ac20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:00.236 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.119+0000 7f21a940a700 1 -- 172.21.15.50:0/2335472317 >> 172.21.15.50:0/2335472317 conn(0x7f21a4102240 msgr2=0x7f21a4104660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:00.236 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.119+0000 7f21a940a700 1 -- 172.21.15.50:0/2335472317 shutdown_connections 2024-06-06T03:15:00.236 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.119+0000 7f21a940a700 1 -- 172.21.15.50:0/2335472317 wait complete. 2024-06-06T03:15:00.236 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.119+0000 7f21a940a700 1 Processor -- start 2024-06-06T03:15:00.236 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.119+0000 7f21a940a700 1 -- start start 2024-06-06T03:15:00.236 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.120+0000 7f21a940a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21a4108830 0x7f21a419bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:00.236 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.120+0000 7f21a940a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f21a410c120 con 0x7f21a4108830 2024-06-06T03:15:00.236 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.120+0000 7f21a2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21a4108830 0x7f21a419bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:00.236 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.120+0000 7f21a2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21a4108830 0x7f21a419bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54236/0 (socket says 172.21.15.50:54236) 2024-06-06T03:15:00.236 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.120+0000 7f21a2ffd700 1 -- 172.21.15.50:0/2117185378 learned_addr learned my addr 172.21.15.50:0/2117185378 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:15:00.236 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.120+0000 7f21a2ffd700 1 -- 172.21.15.50:0/2117185378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a419c1b0 con 0x7f21a4108830 2024-06-06T03:15:00.237 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.120+0000 7f21a2ffd700 1 --2- 172.21.15.50:0/2117185378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21a4108830 0x7f21a419bc70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2194006af0 tx=0x7f2194011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:00.237 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.120+0000 7f219bfff700 1 -- 172.21.15.50:0/2117185378 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21940039e0 con 0x7f21a4108830 2024-06-06T03:15:00.237 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.120+0000 7f219bfff700 1 -- 172.21.15.50:0/2117185378 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f2194003b80 con 0x7f21a4108830 2024-06-06T03:15:00.237 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.120+0000 7f21a940a700 1 -- 172.21.15.50:0/2117185378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21a419c440 con 0x7f21a4108830 2024-06-06T03:15:00.237 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.120+0000 7f219bfff700 1 -- 172.21.15.50:0/2117185378 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21940196a0 con 0x7f21a4108830 2024-06-06T03:15:00.237 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.120+0000 7f21a940a700 1 -- 172.21.15.50:0/2117185378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21a419f130 con 0x7f21a4108830 2024-06-06T03:15:00.237 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.121+0000 7f219bfff700 1 -- 172.21.15.50:0/2117185378 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f219401ab50 con 0x7f21a4108830 2024-06-06T03:15:00.237 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.121+0000 7f21a940a700 1 -- 172.21.15.50:0/2117185378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21a4063af0 con 0x7f21a4108830 2024-06-06T03:15:00.237 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.121+0000 7f219bfff700 1 --2- 172.21.15.50:0/2117185378 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f2190039000 0x7f219003b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:00.237 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.122+0000 7f219bfff700 1 -- 172.21.15.50:0/2117185378 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f219404d5b0 con 0x7f21a4108830 2024-06-06T03:15:00.237 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.122+0000 7f21a27fc700 1 --2- 172.21.15.50:0/2117185378 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f2190039000 0x7f219003b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:00.237 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.122+0000 7f21a27fc700 1 --2- 172.21.15.50:0/2117185378 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f2190039000 0x7f219003b4c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f218c006fd0 tx=0x7f218c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:00.237 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.127+0000 7f219bfff700 1 -- 172.21.15.50:0/2117185378 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f219400b3e0 con 0x7f21a4108830 2024-06-06T03:15:00.237 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.374+0000 7f21a940a700 1 -- 172.21.15.50:0/2117185378 --> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f21a41033f0 con 0x7f2190039000 2024-06-06T03:15:00.238 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.378+0000 7f219bfff700 1 -- 172.21.15.50:0/2117185378 <== mgr.14120 v2:172.21.15.50:6800/1311987652 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f21a41033f0 con 0x7f2190039000 2024-06-06T03:15:00.238 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.380+0000 7f21a940a700 1 -- 172.21.15.50:0/2117185378 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f2190039000 msgr2=0x7f219003b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:00.238 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.380+0000 7f21a940a700 1 --2- 172.21.15.50:0/2117185378 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f2190039000 0x7f219003b4c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f218c006fd0 tx=0x7f218c006e40 comp rx=0 tx=0).stop 2024-06-06T03:15:00.238 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.380+0000 7f21a940a700 1 -- 172.21.15.50:0/2117185378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21a4108830 msgr2=0x7f21a419bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:00.238 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.380+0000 7f21a940a700 1 --2- 172.21.15.50:0/2117185378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21a4108830 0x7f21a419bc70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2194006af0 tx=0x7f2194011c40 comp rx=0 tx=0).stop 2024-06-06T03:15:00.238 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.380+0000 7f21a940a700 1 -- 172.21.15.50:0/2117185378 shutdown_connections 2024-06-06T03:15:00.238 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.380+0000 7f21a940a700 1 --2- 172.21.15.50:0/2117185378 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f2190039000 0x7f219003b4c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:00.238 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.380+0000 7f21a940a700 1 --2- 172.21.15.50:0/2117185378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21a4108830 0x7f21a419bc70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:00.238 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.380+0000 7f21a940a700 1 -- 172.21.15.50:0/2117185378 >> 172.21.15.50:0/2117185378 conn(0x7f21a4102240 msgr2=0x7f21a4102ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:00.238 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.381+0000 7f21a940a700 1 -- 172.21.15.50:0/2117185378 shutdown_connections 2024-06-06T03:15:00.238 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:14:59.381+0000 7f21a940a700 1 -- 172.21.15.50:0/2117185378 wait complete. 2024-06-06T03:15:00.238 INFO:teuthology.orchestra.run.smithi050.stdout:Deploying unmanaged mgr service... 2024-06-06T03:15:00.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:00 smithi050 ceph-mon[32421]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:15:00.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:00 smithi050 ceph-mon[32421]: Saving service mon spec with placement count:5 2024-06-06T03:15:00.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:00 smithi050 ceph-mon[32421]: from='mgr.14120 172.21.15.50:0/2290217465' entity='mgr.x' 2024-06-06T03:15:01.912 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:01 smithi050 ceph-mon[32421]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:15:01.912 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:01 smithi050 ceph-mon[32421]: Saving service mgr spec with placement count:2 2024-06-06T03:15:01.912 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:01 smithi050 ceph-mon[32421]: from='mgr.14120 172.21.15.50:0/2290217465' entity='mgr.x' 2024-06-06T03:15:01.912 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:01 smithi050 ceph-mon[32421]: from='mgr.14120 172.21.15.50:0/2290217465' entity='mgr.x' 2024-06-06T03:15:01.920 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-06-06T03:15:01.920 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.633+0000 7ff0f077c700 1 Processor -- start 2024-06-06T03:15:01.920 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.633+0000 7ff0f077c700 1 -- start start 2024-06-06T03:15:01.920 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.633+0000 7ff0f077c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e8107df0 0x7ff0e8108210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:01.920 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.633+0000 7ff0f077c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e81087e0 con 0x7ff0e8107df0 2024-06-06T03:15:01.920 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.634+0000 7ff0ee518700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e8107df0 0x7ff0e8108210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:01.920 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.634+0000 7ff0ee518700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e8107df0 0x7ff0e8108210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54252/0 (socket says 172.21.15.50:54252) 2024-06-06T03:15:01.920 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.634+0000 7ff0ee518700 1 -- 172.21.15.50:0/4265518388 learned_addr learned my addr 172.21.15.50:0/4265518388 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:15:01.921 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.634+0000 7ff0ee518700 1 -- 172.21.15.50:0/4265518388 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e8108f50 con 0x7ff0e8107df0 2024-06-06T03:15:01.921 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.634+0000 7ff0ee518700 1 --2- 172.21.15.50:0/4265518388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e8107df0 0x7ff0e8108210 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4009e80 tx=0x7ff0e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d04ed07e8ba08eb server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:01.921 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.634+0000 7ff0ed516700 1 -- 172.21.15.50:0/4265518388 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0e4017070 con 0x7ff0e8107df0 2024-06-06T03:15:01.921 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.634+0000 7ff0ed516700 1 -- 172.21.15.50:0/4265518388 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7ff0e400b8c0 con 0x7ff0e8107df0 2024-06-06T03:15:01.921 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.634+0000 7ff0ed516700 1 -- 172.21.15.50:0/4265518388 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0e4004520 con 0x7ff0e8107df0 2024-06-06T03:15:01.921 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.635+0000 7ff0f077c700 1 -- 172.21.15.50:0/4265518388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e8107df0 msgr2=0x7ff0e8108210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:01.921 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.635+0000 7ff0f077c700 1 --2- 172.21.15.50:0/4265518388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e8107df0 0x7ff0e8108210 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4009e80 tx=0x7ff0e400b330 comp rx=0 tx=0).stop 2024-06-06T03:15:01.921 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.635+0000 7ff0f077c700 1 -- 172.21.15.50:0/4265518388 shutdown_connections 2024-06-06T03:15:01.921 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.635+0000 7ff0f077c700 1 --2- 172.21.15.50:0/4265518388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e8107df0 0x7ff0e8108210 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:01.921 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.635+0000 7ff0f077c700 1 -- 172.21.15.50:0/4265518388 >> 172.21.15.50:0/4265518388 conn(0x7ff0e81033d0 msgr2=0x7ff0e81057f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:01.921 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.635+0000 7ff0f077c700 1 -- 172.21.15.50:0/4265518388 shutdown_connections 2024-06-06T03:15:01.922 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.635+0000 7ff0f077c700 1 -- 172.21.15.50:0/4265518388 wait complete. 2024-06-06T03:15:01.922 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.636+0000 7ff0f077c700 1 Processor -- start 2024-06-06T03:15:01.922 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.636+0000 7ff0f077c700 1 -- start start 2024-06-06T03:15:01.922 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.636+0000 7ff0f077c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e8107df0 0x7ff0e819bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:01.922 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.636+0000 7ff0f077c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e810c300 con 0x7ff0e8107df0 2024-06-06T03:15:01.922 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.636+0000 7ff0ee518700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e8107df0 0x7ff0e819bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:01.922 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.636+0000 7ff0ee518700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e8107df0 0x7ff0e819bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54254/0 (socket says 172.21.15.50:54254) 2024-06-06T03:15:01.922 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.636+0000 7ff0ee518700 1 -- 172.21.15.50:0/1726348361 learned_addr learned my addr 172.21.15.50:0/1726348361 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:15:01.922 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.636+0000 7ff0ee518700 1 -- 172.21.15.50:0/1726348361 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e819c1b0 con 0x7ff0e8107df0 2024-06-06T03:15:01.922 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.637+0000 7ff0ee518700 1 --2- 172.21.15.50:0/1726348361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e8107df0 0x7ff0e819bc70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4003f60 tx=0x7ff0e4004670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:01.922 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.637+0000 7ff0df7fe700 1 -- 172.21.15.50:0/1726348361 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0e4020020 con 0x7ff0e8107df0 2024-06-06T03:15:01.922 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.637+0000 7ff0df7fe700 1 -- 172.21.15.50:0/1726348361 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7ff0e400bcb0 con 0x7ff0e8107df0 2024-06-06T03:15:01.923 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.637+0000 7ff0f077c700 1 -- 172.21.15.50:0/1726348361 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0e819c440 con 0x7ff0e8107df0 2024-06-06T03:15:01.923 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.637+0000 7ff0df7fe700 1 -- 172.21.15.50:0/1726348361 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0e4017040 con 0x7ff0e8107df0 2024-06-06T03:15:01.923 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.637+0000 7ff0f077c700 1 -- 172.21.15.50:0/1726348361 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0e819f130 con 0x7ff0e8107df0 2024-06-06T03:15:01.923 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.638+0000 7ff0df7fe700 1 -- 172.21.15.50:0/1726348361 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7ff0e4023020 con 0x7ff0e8107df0 2024-06-06T03:15:01.923 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.638+0000 7ff0df7fe700 1 --2- 172.21.15.50:0/1726348361 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7ff0d4039050 0x7ff0d403b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:01.923 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.638+0000 7ff0df7fe700 1 -- 172.21.15.50:0/1726348361 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff0e400f050 con 0x7ff0e8107df0 2024-06-06T03:15:01.923 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.638+0000 7ff0f077c700 1 -- 172.21.15.50:0/1726348361 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0e8063af0 con 0x7ff0e8107df0 2024-06-06T03:15:01.923 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.638+0000 7ff0edd17700 1 --2- 172.21.15.50:0/1726348361 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7ff0d4039050 0x7ff0d403b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:01.923 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.638+0000 7ff0edd17700 1 --2- 172.21.15.50:0/1726348361 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7ff0d4039050 0x7ff0d403b510 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8006fd0 tx=0x7ff0d8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:01.923 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.643+0000 7ff0df7fe700 1 -- 172.21.15.50:0/1726348361 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff0e402a020 con 0x7ff0e8107df0 2024-06-06T03:15:01.923 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.862+0000 7ff0f077c700 1 -- 172.21.15.50:0/1726348361 --> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7ff0e81045d0 con 0x7ff0d4039050 2024-06-06T03:15:01.923 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.867+0000 7ff0df7fe700 1 -- 172.21.15.50:0/1726348361 <== mgr.14120 v2:172.21.15.50:6800/1311987652 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ff0e81045d0 con 0x7ff0d4039050 2024-06-06T03:15:01.924 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.869+0000 7ff0f077c700 1 -- 172.21.15.50:0/1726348361 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7ff0d4039050 msgr2=0x7ff0d403b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:01.924 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.869+0000 7ff0f077c700 1 --2- 172.21.15.50:0/1726348361 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7ff0d4039050 0x7ff0d403b510 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8006fd0 tx=0x7ff0d8006e40 comp rx=0 tx=0).stop 2024-06-06T03:15:01.924 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.869+0000 7ff0f077c700 1 -- 172.21.15.50:0/1726348361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e8107df0 msgr2=0x7ff0e819bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:01.924 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.869+0000 7ff0f077c700 1 --2- 172.21.15.50:0/1726348361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e8107df0 0x7ff0e819bc70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4003f60 tx=0x7ff0e4004670 comp rx=0 tx=0).stop 2024-06-06T03:15:01.924 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.869+0000 7ff0f077c700 1 -- 172.21.15.50:0/1726348361 shutdown_connections 2024-06-06T03:15:01.924 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.869+0000 7ff0f077c700 1 --2- 172.21.15.50:0/1726348361 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7ff0d4039050 0x7ff0d403b510 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:01.924 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.869+0000 7ff0f077c700 1 --2- 172.21.15.50:0/1726348361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e8107df0 0x7ff0e819bc70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:01.924 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.869+0000 7ff0f077c700 1 -- 172.21.15.50:0/1726348361 >> 172.21.15.50:0/1726348361 conn(0x7ff0e81033d0 msgr2=0x7ff0e8103ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:01.924 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.869+0000 7ff0f077c700 1 -- 172.21.15.50:0/1726348361 shutdown_connections 2024-06-06T03:15:01.924 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:00.869+0000 7ff0f077c700 1 -- 172.21.15.50:0/1726348361 wait complete. 2024-06-06T03:15:03.203 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:02 smithi050 ceph-mon[32421]: from='mgr.14120 172.21.15.50:0/2290217465' entity='mgr.x' 2024-06-06T03:15:03.203 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:02 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1917481104' entity='client.admin' 2024-06-06T03:15:03.210 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.339+0000 7fc3b4024700 1 Processor -- start 2024-06-06T03:15:03.210 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.339+0000 7fc3b4024700 1 -- start start 2024-06-06T03:15:03.210 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.339+0000 7fc3b4024700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3ac106c50 0x7fc3ac107070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:03.210 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.339+0000 7fc3b4024700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ac107640 con 0x7fc3ac106c50 2024-06-06T03:15:03.211 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.339+0000 7fc3b1dc0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3ac106c50 0x7fc3ac107070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:03.211 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.339+0000 7fc3b1dc0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3ac106c50 0x7fc3ac107070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54256/0 (socket says 172.21.15.50:54256) 2024-06-06T03:15:03.211 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.339+0000 7fc3b1dc0700 1 -- 172.21.15.50:0/3697110837 learned_addr learned my addr 172.21.15.50:0/3697110837 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:15:03.211 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.340+0000 7fc3b1dc0700 1 -- 172.21.15.50:0/3697110837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3ac107e50 con 0x7fc3ac106c50 2024-06-06T03:15:03.211 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.340+0000 7fc3b1dc0700 1 --2- 172.21.15.50:0/3697110837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3ac106c50 0x7fc3ac107070 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc3a80098a0 tx=0x7fc3a8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eecfc0bed7b33b4f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:03.211 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.340+0000 7fc3b0dbe700 1 -- 172.21.15.50:0/3697110837 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3a8004160 con 0x7fc3ac106c50 2024-06-06T03:15:03.211 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.340+0000 7fc3b0dbe700 1 -- 172.21.15.50:0/3697110837 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc3a8004300 con 0x7fc3ac106c50 2024-06-06T03:15:03.211 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.340+0000 7fc3b0dbe700 1 -- 172.21.15.50:0/3697110837 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3a8011a50 con 0x7fc3ac106c50 2024-06-06T03:15:03.211 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.341+0000 7fc3b4024700 1 -- 172.21.15.50:0/3697110837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3ac106c50 msgr2=0x7fc3ac107070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:03.211 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.341+0000 7fc3b4024700 1 --2- 172.21.15.50:0/3697110837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3ac106c50 0x7fc3ac107070 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc3a80098a0 tx=0x7fc3a8009bb0 comp rx=0 tx=0).stop 2024-06-06T03:15:03.211 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.341+0000 7fc3b4024700 1 -- 172.21.15.50:0/3697110837 shutdown_connections 2024-06-06T03:15:03.211 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.341+0000 7fc3b4024700 1 --2- 172.21.15.50:0/3697110837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3ac106c50 0x7fc3ac107070 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:03.211 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.341+0000 7fc3b4024700 1 -- 172.21.15.50:0/3697110837 >> 172.21.15.50:0/3697110837 conn(0x7fc3ac1021f0 msgr2=0x7fc3ac104630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:03.211 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.341+0000 7fc3b4024700 1 -- 172.21.15.50:0/3697110837 shutdown_connections 2024-06-06T03:15:03.212 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.341+0000 7fc3b4024700 1 -- 172.21.15.50:0/3697110837 wait complete. 2024-06-06T03:15:03.212 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.341+0000 7fc3b4024700 1 Processor -- start 2024-06-06T03:15:03.212 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.342+0000 7fc3b4024700 1 -- start start 2024-06-06T03:15:03.212 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.342+0000 7fc3b4024700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3ac106c50 0x7fc3ac19bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:03.212 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.342+0000 7fc3b4024700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ac10b200 con 0x7fc3ac106c50 2024-06-06T03:15:03.212 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.342+0000 7fc3b1dc0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3ac106c50 0x7fc3ac19bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:03.212 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.342+0000 7fc3b1dc0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3ac106c50 0x7fc3ac19bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54260/0 (socket says 172.21.15.50:54260) 2024-06-06T03:15:03.212 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.342+0000 7fc3b1dc0700 1 -- 172.21.15.50:0/1917481104 learned_addr learned my addr 172.21.15.50:0/1917481104 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:15:03.212 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.342+0000 7fc3b1dc0700 1 -- 172.21.15.50:0/1917481104 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3ac19c1e0 con 0x7fc3ac106c50 2024-06-06T03:15:03.212 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.342+0000 7fc3b1dc0700 1 --2- 172.21.15.50:0/1917481104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3ac106c50 0x7fc3ac19bca0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8006b20 tx=0x7fc3a8011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:03.212 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.342+0000 7fc3a2ffd700 1 -- 172.21.15.50:0/1917481104 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3a80039e0 con 0x7fc3ac106c50 2024-06-06T03:15:03.212 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.343+0000 7fc3b4024700 1 -- 172.21.15.50:0/1917481104 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3ac19c470 con 0x7fc3ac106c50 2024-06-06T03:15:03.212 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.343+0000 7fc3a2ffd700 1 -- 172.21.15.50:0/1917481104 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc3a801a8e0 con 0x7fc3ac106c50 2024-06-06T03:15:03.212 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.343+0000 7fc3a2ffd700 1 -- 172.21.15.50:0/1917481104 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3a80247e0 con 0x7fc3ac106c50 2024-06-06T03:15:03.213 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.343+0000 7fc3b4024700 1 -- 172.21.15.50:0/1917481104 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3ac19f160 con 0x7fc3ac106c50 2024-06-06T03:15:03.213 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.344+0000 7fc3a2ffd700 1 -- 172.21.15.50:0/1917481104 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fc3a8022020 con 0x7fc3ac106c50 2024-06-06T03:15:03.213 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.344+0000 7fc3a2ffd700 1 --2- 172.21.15.50:0/1917481104 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7fc3980390a0 0x7fc39803b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:03.213 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.344+0000 7fc3b4024700 1 -- 172.21.15.50:0/1917481104 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3ac063af0 con 0x7fc3ac106c50 2024-06-06T03:15:03.213 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.344+0000 7fc3a2ffd700 1 -- 172.21.15.50:0/1917481104 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc3a804e320 con 0x7fc3ac106c50 2024-06-06T03:15:03.213 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.344+0000 7fc3b15bf700 1 --2- 172.21.15.50:0/1917481104 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7fc3980390a0 0x7fc39803b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:03.213 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.345+0000 7fc3b15bf700 1 --2- 172.21.15.50:0/1917481104 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7fc3980390a0 0x7fc39803b560 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc39c006fd0 tx=0x7fc39c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:03.213 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.350+0000 7fc3a2ffd700 1 -- 172.21.15.50:0/1917481104 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc3a8020c10 con 0x7fc3ac106c50 2024-06-06T03:15:03.213 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.581+0000 7fc3b4024700 1 -- 172.21.15.50:0/1917481104 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fc3ac02df30 con 0x7fc3ac106c50 2024-06-06T03:15:03.214 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.584+0000 7fc3a2ffd700 1 -- 172.21.15.50:0/1917481104 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fc3a800b5a0 con 0x7fc3ac106c50 2024-06-06T03:15:03.214 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.586+0000 7fc3b4024700 1 -- 172.21.15.50:0/1917481104 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7fc3980390a0 msgr2=0x7fc39803b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:03.214 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.586+0000 7fc3b4024700 1 --2- 172.21.15.50:0/1917481104 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7fc3980390a0 0x7fc39803b560 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc39c006fd0 tx=0x7fc39c006e40 comp rx=0 tx=0).stop 2024-06-06T03:15:03.214 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.586+0000 7fc3b4024700 1 -- 172.21.15.50:0/1917481104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3ac106c50 msgr2=0x7fc3ac19bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:03.214 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.586+0000 7fc3b4024700 1 --2- 172.21.15.50:0/1917481104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3ac106c50 0x7fc3ac19bca0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8006b20 tx=0x7fc3a8011ad0 comp rx=0 tx=0).stop 2024-06-06T03:15:03.214 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.586+0000 7fc3b4024700 1 -- 172.21.15.50:0/1917481104 shutdown_connections 2024-06-06T03:15:03.214 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.586+0000 7fc3b4024700 1 --2- 172.21.15.50:0/1917481104 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7fc3980390a0 0x7fc39803b560 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:03.214 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.586+0000 7fc3b4024700 1 --2- 172.21.15.50:0/1917481104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3ac106c50 0x7fc3ac19bca0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:03.214 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.586+0000 7fc3b4024700 1 -- 172.21.15.50:0/1917481104 >> 172.21.15.50:0/1917481104 conn(0x7fc3ac1021f0 msgr2=0x7fc3ac103070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:03.214 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.586+0000 7fc3b4024700 1 -- 172.21.15.50:0/1917481104 shutdown_connections 2024-06-06T03:15:03.214 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:02.586+0000 7fc3b4024700 1 -- 172.21.15.50:0/1917481104 wait complete. 2024-06-06T03:15:04.954 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:04 smithi050 ceph-mon[32421]: from='mgr.14120 172.21.15.50:0/2290217465' entity='mgr.x' 2024-06-06T03:15:04.954 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:04 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/4222856751' entity='client.admin' 2024-06-06T03:15:04.961 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.109+0000 7f74e97ff700 1 Processor -- start 2024-06-06T03:15:04.961 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.109+0000 7f74e97ff700 1 -- start start 2024-06-06T03:15:04.961 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.109+0000 7f74e97ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e4106060 0x7f74e4106480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:04.961 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.109+0000 7f74e97ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f74e4106a50 con 0x7f74e4106060 2024-06-06T03:15:04.961 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.109+0000 7f74e2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e4106060 0x7f74e4106480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:04.962 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.109+0000 7f74e2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e4106060 0x7f74e4106480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54264/0 (socket says 172.21.15.50:54264) 2024-06-06T03:15:04.962 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.109+0000 7f74e2ffd700 1 -- 172.21.15.50:0/2202309536 learned_addr learned my addr 172.21.15.50:0/2202309536 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:15:04.962 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.109+0000 7f74e2ffd700 1 -- 172.21.15.50:0/2202309536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e4108ff0 con 0x7f74e4106060 2024-06-06T03:15:04.962 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.110+0000 7f74e2ffd700 1 --2- 172.21.15.50:0/2202309536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e4106060 0x7f74e4106480 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f74d40098a0 tx=0x7f74d4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c42a0fca3e29ef server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:04.962 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.110+0000 7f74e1ffb700 1 -- 172.21.15.50:0/2202309536 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74d4004160 con 0x7f74e4106060 2024-06-06T03:15:04.962 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.110+0000 7f74e1ffb700 1 -- 172.21.15.50:0/2202309536 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f74d4004300 con 0x7f74e4106060 2024-06-06T03:15:04.962 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.110+0000 7f74e1ffb700 1 -- 172.21.15.50:0/2202309536 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74d4011a50 con 0x7f74e4106060 2024-06-06T03:15:04.962 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.111+0000 7f74e97ff700 1 -- 172.21.15.50:0/2202309536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e4106060 msgr2=0x7f74e4106480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:04.962 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.111+0000 7f74e97ff700 1 --2- 172.21.15.50:0/2202309536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e4106060 0x7f74e4106480 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f74d40098a0 tx=0x7f74d4009bb0 comp rx=0 tx=0).stop 2024-06-06T03:15:04.962 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.111+0000 7f74e97ff700 1 -- 172.21.15.50:0/2202309536 shutdown_connections 2024-06-06T03:15:04.962 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.111+0000 7f74e97ff700 1 --2- 172.21.15.50:0/2202309536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e4106060 0x7f74e4106480 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:04.962 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.111+0000 7f74e97ff700 1 -- 172.21.15.50:0/2202309536 >> 172.21.15.50:0/2202309536 conn(0x7f74e41019f0 msgr2=0x7f74e4103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:04.962 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.111+0000 7f74e97ff700 1 -- 172.21.15.50:0/2202309536 shutdown_connections 2024-06-06T03:15:04.963 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.111+0000 7f74e97ff700 1 -- 172.21.15.50:0/2202309536 wait complete. 2024-06-06T03:15:04.963 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.112+0000 7f74e97ff700 1 Processor -- start 2024-06-06T03:15:04.963 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.112+0000 7f74e97ff700 1 -- start start 2024-06-06T03:15:04.963 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.112+0000 7f74e97ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e4106060 0x7f74e419bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:04.963 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.112+0000 7f74e97ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f74e410c3a0 con 0x7f74e4106060 2024-06-06T03:15:04.963 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.112+0000 7f74e2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e4106060 0x7f74e419bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:04.963 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.112+0000 7f74e2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e4106060 0x7f74e419bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54278/0 (socket says 172.21.15.50:54278) 2024-06-06T03:15:04.963 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.112+0000 7f74e2ffd700 1 -- 172.21.15.50:0/4222856751 learned_addr learned my addr 172.21.15.50:0/4222856751 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:15:04.963 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.113+0000 7f74e2ffd700 1 -- 172.21.15.50:0/4222856751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e419c170 con 0x7f74e4106060 2024-06-06T03:15:04.963 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.113+0000 7f74e2ffd700 1 --2- 172.21.15.50:0/4222856751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e4106060 0x7f74e419bc30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f74d4006b20 tx=0x7f74d4011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:04.963 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.113+0000 7f74cbfff700 1 -- 172.21.15.50:0/4222856751 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74d40039e0 con 0x7f74e4106060 2024-06-06T03:15:04.963 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.113+0000 7f74cbfff700 1 -- 172.21.15.50:0/4222856751 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f74d401a8e0 con 0x7f74e4106060 2024-06-06T03:15:04.963 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.113+0000 7f74e97ff700 1 -- 172.21.15.50:0/4222856751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74e419c400 con 0x7f74e4106060 2024-06-06T03:15:04.964 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.113+0000 7f74cbfff700 1 -- 172.21.15.50:0/4222856751 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74d40247e0 con 0x7f74e4106060 2024-06-06T03:15:04.964 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.113+0000 7f74e97ff700 1 -- 172.21.15.50:0/4222856751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74e419f0f0 con 0x7f74e4106060 2024-06-06T03:15:04.964 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.114+0000 7f74cbfff700 1 -- 172.21.15.50:0/4222856751 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f74d4022020 con 0x7f74e4106060 2024-06-06T03:15:04.964 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.114+0000 7f74cbfff700 1 --2- 172.21.15.50:0/4222856751 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f74cc039050 0x7f74cc03b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:04.964 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.114+0000 7f74cbfff700 1 -- 172.21.15.50:0/4222856751 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f74d404d4c0 con 0x7f74e4106060 2024-06-06T03:15:04.964 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.114+0000 7f74e27fc700 1 --2- 172.21.15.50:0/4222856751 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f74cc039050 0x7f74cc03b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:04.964 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.114+0000 7f74e97ff700 1 -- 172.21.15.50:0/4222856751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74e4063af0 con 0x7f74e4106060 2024-06-06T03:15:04.964 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.115+0000 7f74e27fc700 1 --2- 172.21.15.50:0/4222856751 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f74cc039050 0x7f74cc03b510 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f74d8006fd0 tx=0x7f74d8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:04.964 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.119+0000 7f74cbfff700 1 -- 172.21.15.50:0/4222856751 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f74d400e260 con 0x7f74e4106060 2024-06-06T03:15:04.964 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.328+0000 7f74e97ff700 1 -- 172.21.15.50:0/4222856751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f74e419f2c0 con 0x7f74e4106060 2024-06-06T03:15:04.964 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.331+0000 7f74cbfff700 1 -- 172.21.15.50:0/4222856751 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f74d403ce20 con 0x7f74e4106060 2024-06-06T03:15:04.964 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.333+0000 7f74e97ff700 1 -- 172.21.15.50:0/4222856751 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f74cc039050 msgr2=0x7f74cc03b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:04.964 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.333+0000 7f74e97ff700 1 --2- 172.21.15.50:0/4222856751 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f74cc039050 0x7f74cc03b510 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f74d8006fd0 tx=0x7f74d8006e40 comp rx=0 tx=0).stop 2024-06-06T03:15:04.964 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.333+0000 7f74e97ff700 1 -- 172.21.15.50:0/4222856751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e4106060 msgr2=0x7f74e419bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:04.965 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.333+0000 7f74e97ff700 1 --2- 172.21.15.50:0/4222856751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e4106060 0x7f74e419bc30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f74d4006b20 tx=0x7f74d4011ad0 comp rx=0 tx=0).stop 2024-06-06T03:15:04.965 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.333+0000 7f74e97ff700 1 -- 172.21.15.50:0/4222856751 shutdown_connections 2024-06-06T03:15:04.965 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.333+0000 7f74e97ff700 1 --2- 172.21.15.50:0/4222856751 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f74cc039050 0x7f74cc03b510 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:04.965 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.333+0000 7f74e97ff700 1 --2- 172.21.15.50:0/4222856751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e4106060 0x7f74e419bc30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:04.965 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.333+0000 7f74e97ff700 1 -- 172.21.15.50:0/4222856751 >> 172.21.15.50:0/4222856751 conn(0x7f74e41019f0 msgr2=0x7f74e41023f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:04.965 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.333+0000 7f74e97ff700 1 -- 172.21.15.50:0/4222856751 shutdown_connections 2024-06-06T03:15:04.965 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:04.333+0000 7f74e97ff700 1 -- 172.21.15.50:0/4222856751 wait complete. 2024-06-06T03:15:04.965 INFO:teuthology.orchestra.run.smithi050.stdout:Enabling the dashboard module... 2024-06-06T03:15:06.237 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:06 smithi050 ceph-mon[32421]: from='mgr.14120 172.21.15.50:0/2290217465' entity='mgr.x' 2024-06-06T03:15:06.237 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:06 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1540510770' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-06-06T03:15:06.237 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:15:06 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: ignoring --setuser ceph since I am not root 2024-06-06T03:15:06.237 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:15:06 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: ignoring --setgroup ceph since I am not root 2024-06-06T03:15:06.238 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:15:06 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:15:06.237+0000 7f2235e4d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-06T03:15:06.501 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:15:06 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:15:06.431+0000 7f2235e4d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-06T03:15:06.867 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:15:06 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:15:06.540+0000 7f2235e4d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-06T03:15:06.868 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:15:06 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:15:06.867+0000 7f2235e4d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-06T03:15:07.159 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:07 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1540510770' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-06-06T03:15:07.160 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:07 smithi050 ceph-mon[32421]: mgrmap e9: x(active, since 19s) 2024-06-06T03:15:07.160 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:15:06 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:15:06.957+0000 7f2235e4d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-06T03:15:07.166 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.431+0000 7faa1be65700 1 Processor -- start 2024-06-06T03:15:07.166 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.432+0000 7faa1be65700 1 -- start start 2024-06-06T03:15:07.167 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.432+0000 7faa1be65700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa14108800 0x7faa1410abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:07.167 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.432+0000 7faa1be65700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7faa1407be20 con 0x7faa14108800 2024-06-06T03:15:07.167 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.432+0000 7faa19c01700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa14108800 0x7faa1410abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:07.167 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.432+0000 7faa19c01700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa14108800 0x7faa1410abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54286/0 (socket says 172.21.15.50:54286) 2024-06-06T03:15:07.167 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.432+0000 7faa19c01700 1 -- 172.21.15.50:0/1495533880 learned_addr learned my addr 172.21.15.50:0/1495533880 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:15:07.167 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.433+0000 7faa19c01700 1 -- 172.21.15.50:0/1495533880 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa1410b130 con 0x7faa14108800 2024-06-06T03:15:07.167 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.433+0000 7faa19c01700 1 --2- 172.21.15.50:0/1495533880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa14108800 0x7faa1410abf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faa100098a0 tx=0x7faa10009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9fa6f4d896f704 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:07.167 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.433+0000 7faa18bff700 1 -- 172.21.15.50:0/1495533880 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa10004160 con 0x7faa14108800 2024-06-06T03:15:07.167 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.433+0000 7faa18bff700 1 -- 172.21.15.50:0/1495533880 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faa10004300 con 0x7faa14108800 2024-06-06T03:15:07.167 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.433+0000 7faa18bff700 1 -- 172.21.15.50:0/1495533880 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa10011a50 con 0x7faa14108800 2024-06-06T03:15:07.167 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.434+0000 7faa1be65700 1 -- 172.21.15.50:0/1495533880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa14108800 msgr2=0x7faa1410abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:07.167 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.434+0000 7faa1be65700 1 --2- 172.21.15.50:0/1495533880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa14108800 0x7faa1410abf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faa100098a0 tx=0x7faa10009bb0 comp rx=0 tx=0).stop 2024-06-06T03:15:07.167 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.434+0000 7faa1be65700 1 -- 172.21.15.50:0/1495533880 shutdown_connections 2024-06-06T03:15:07.167 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.434+0000 7faa1be65700 1 --2- 172.21.15.50:0/1495533880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa14108800 0x7faa1410abf0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:07.168 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.434+0000 7faa1be65700 1 -- 172.21.15.50:0/1495533880 >> 172.21.15.50:0/1495533880 conn(0x7faa141021b0 msgr2=0x7faa141045f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:07.168 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.434+0000 7faa1be65700 1 -- 172.21.15.50:0/1495533880 shutdown_connections 2024-06-06T03:15:07.168 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.434+0000 7faa1be65700 1 -- 172.21.15.50:0/1495533880 wait complete. 2024-06-06T03:15:07.168 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.435+0000 7faa1be65700 1 Processor -- start 2024-06-06T03:15:07.168 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.435+0000 7faa1be65700 1 -- start start 2024-06-06T03:15:07.168 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.435+0000 7faa1be65700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa14108800 0x7faa1419de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:07.168 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.435+0000 7faa1be65700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7faa1410c0d0 con 0x7faa14108800 2024-06-06T03:15:07.168 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.435+0000 7faa19c01700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa14108800 0x7faa1419de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:07.168 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.435+0000 7faa19c01700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa14108800 0x7faa1419de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54294/0 (socket says 172.21.15.50:54294) 2024-06-06T03:15:07.168 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.435+0000 7faa19c01700 1 -- 172.21.15.50:0/1540510770 learned_addr learned my addr 172.21.15.50:0/1540510770 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:15:07.168 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.435+0000 7faa19c01700 1 -- 172.21.15.50:0/1540510770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa1419e390 con 0x7faa14108800 2024-06-06T03:15:07.168 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.435+0000 7faa19c01700 1 --2- 172.21.15.50:0/1540510770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa14108800 0x7faa1419de50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faa10006b20 tx=0x7faa10011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:07.168 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.436+0000 7faa0affd700 1 -- 172.21.15.50:0/1540510770 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa10003b70 con 0x7faa14108800 2024-06-06T03:15:07.169 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.436+0000 7faa0affd700 1 -- 172.21.15.50:0/1540510770 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faa1001a8e0 con 0x7faa14108800 2024-06-06T03:15:07.169 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.436+0000 7faa1be65700 1 -- 172.21.15.50:0/1540510770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa1419e620 con 0x7faa14108800 2024-06-06T03:15:07.169 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.436+0000 7faa0affd700 1 -- 172.21.15.50:0/1540510770 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa100249b0 con 0x7faa14108800 2024-06-06T03:15:07.169 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.436+0000 7faa1be65700 1 -- 172.21.15.50:0/1540510770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa141a1310 con 0x7faa14108800 2024-06-06T03:15:07.169 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.437+0000 7faa0affd700 1 -- 172.21.15.50:0/1540510770 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7faa10022020 con 0x7faa14108800 2024-06-06T03:15:07.169 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.437+0000 7faa1be65700 1 -- 172.21.15.50:0/1540510770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa14063af0 con 0x7faa14108800 2024-06-06T03:15:07.169 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.437+0000 7faa0affd700 1 --2- 172.21.15.50:0/1540510770 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7faa000390a0 0x7faa0003b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:07.169 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.437+0000 7faa0affd700 1 -- 172.21.15.50:0/1540510770 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7faa1004d850 con 0x7faa14108800 2024-06-06T03:15:07.169 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.437+0000 7faa19400700 1 --2- 172.21.15.50:0/1540510770 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7faa000390a0 0x7faa0003b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:07.169 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.438+0000 7faa19400700 1 --2- 172.21.15.50:0/1540510770 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7faa000390a0 0x7faa0003b560 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7faa04006fd0 tx=0x7faa04006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:07.169 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.442+0000 7faa0affd700 1 -- 172.21.15.50:0/1540510770 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7faa1002c3a0 con 0x7faa14108800 2024-06-06T03:15:07.169 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:05.724+0000 7faa1be65700 1 -- 172.21.15.50:0/1540510770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7faa141a18c0 con 0x7faa14108800 2024-06-06T03:15:07.169 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:06.053+0000 7faa0affd700 1 -- 172.21.15.50:0/1540510770 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7faa10016260 con 0x7faa14108800 2024-06-06T03:15:07.170 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:06.054+0000 7faa0affd700 1 -- 172.21.15.50:0/1540510770 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7faa1001a430 con 0x7faa14108800 2024-06-06T03:15:07.170 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:06.056+0000 7faa1be65700 1 -- 172.21.15.50:0/1540510770 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7faa000390a0 msgr2=0x7faa0003b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:07.170 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:06.056+0000 7faa1be65700 1 --2- 172.21.15.50:0/1540510770 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7faa000390a0 0x7faa0003b560 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7faa04006fd0 tx=0x7faa04006e40 comp rx=0 tx=0).stop 2024-06-06T03:15:07.170 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:06.056+0000 7faa1be65700 1 -- 172.21.15.50:0/1540510770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa14108800 msgr2=0x7faa1419de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:07.170 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:06.056+0000 7faa1be65700 1 --2- 172.21.15.50:0/1540510770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa14108800 0x7faa1419de50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faa10006b20 tx=0x7faa10011ad0 comp rx=0 tx=0).stop 2024-06-06T03:15:07.170 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:06.056+0000 7faa1be65700 1 -- 172.21.15.50:0/1540510770 shutdown_connections 2024-06-06T03:15:07.170 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:06.056+0000 7faa1be65700 1 --2- 172.21.15.50:0/1540510770 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7faa000390a0 0x7faa0003b560 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:07.170 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:06.056+0000 7faa1be65700 1 --2- 172.21.15.50:0/1540510770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa14108800 0x7faa1419de50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:07.170 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:06.056+0000 7faa1be65700 1 -- 172.21.15.50:0/1540510770 >> 172.21.15.50:0/1540510770 conn(0x7faa141021b0 msgr2=0x7faa14102bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:07.170 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:06.056+0000 7faa1be65700 1 -- 172.21.15.50:0/1540510770 shutdown_connections 2024-06-06T03:15:07.170 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:06.056+0000 7faa1be65700 1 -- 172.21.15.50:0/1540510770 wait complete. 2024-06-06T03:15:08.224 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:08 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3513096787' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-06-06T03:15:08.501 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:15:08 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:15:08.242+0000 7f2235e4d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-06T03:15:08.501 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:15:08 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:15:08.420+0000 7f2235e4d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-06T03:15:08.535 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2024-06-06T03:15:08.535 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-06-06T03:15:08.535 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "available": true, 2024-06-06T03:15:08.536 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-06-06T03:15:08.536 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-06-06T03:15:08.536 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2024-06-06T03:15:08.536 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.625+0000 7f4ef90f1700 1 Processor -- start 2024-06-06T03:15:08.536 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.625+0000 7f4ef90f1700 1 -- start start 2024-06-06T03:15:08.536 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.626+0000 7f4ef90f1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ef4107d60 0x7f4ef4108180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:08.536 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.626+0000 7f4ef90f1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef41086c0 con 0x7f4ef4107d60 2024-06-06T03:15:08.536 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.626+0000 7f4ef2d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ef4107d60 0x7f4ef4108180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:08.536 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.626+0000 7f4ef2d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ef4107d60 0x7f4ef4108180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54328/0 (socket says 172.21.15.50:54328) 2024-06-06T03:15:08.536 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.626+0000 7f4ef2d9d700 1 -- 172.21.15.50:0/122193599 learned_addr learned my addr 172.21.15.50:0/122193599 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:15:08.537 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.626+0000 7f4ef2d9d700 1 -- 172.21.15.50:0/122193599 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef4108840 con 0x7f4ef4107d60 2024-06-06T03:15:08.537 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.626+0000 7f4ef2d9d700 1 --2- 172.21.15.50:0/122193599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ef4107d60 0x7f4ef4108180 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4ee40098a0 tx=0x7f4ee4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866fe3d49defee5e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:08.537 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.627+0000 7f4ef1d9b700 1 -- 172.21.15.50:0/122193599 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ee4004160 con 0x7f4ef4107d60 2024-06-06T03:15:08.537 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.627+0000 7f4ef1d9b700 1 -- 172.21.15.50:0/122193599 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4ee4004300 con 0x7f4ef4107d60 2024-06-06T03:15:08.537 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.627+0000 7f4ef1d9b700 1 -- 172.21.15.50:0/122193599 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ee4011a50 con 0x7f4ef4107d60 2024-06-06T03:15:08.537 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.627+0000 7f4ef90f1700 1 -- 172.21.15.50:0/122193599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ef4107d60 msgr2=0x7f4ef4108180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:08.537 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.627+0000 7f4ef90f1700 1 --2- 172.21.15.50:0/122193599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ef4107d60 0x7f4ef4108180 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4ee40098a0 tx=0x7f4ee4009bb0 comp rx=0 tx=0).stop 2024-06-06T03:15:08.537 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.627+0000 7f4ef90f1700 1 -- 172.21.15.50:0/122193599 shutdown_connections 2024-06-06T03:15:08.537 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.627+0000 7f4ef90f1700 1 --2- 172.21.15.50:0/122193599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ef4107d60 0x7f4ef4108180 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:08.537 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.627+0000 7f4ef90f1700 1 -- 172.21.15.50:0/122193599 >> 172.21.15.50:0/122193599 conn(0x7f4ef41033a0 msgr2=0x7f4ef41057e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:08.538 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.627+0000 7f4ef90f1700 1 -- 172.21.15.50:0/122193599 shutdown_connections 2024-06-06T03:15:08.538 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.627+0000 7f4ef90f1700 1 -- 172.21.15.50:0/122193599 wait complete. 2024-06-06T03:15:08.538 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.628+0000 7f4ef90f1700 1 Processor -- start 2024-06-06T03:15:08.538 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.628+0000 7f4ef90f1700 1 -- start start 2024-06-06T03:15:08.538 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.628+0000 7f4ef90f1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ef4107d60 0x7f4ef419bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:08.538 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.628+0000 7f4ef90f1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef4109da0 con 0x7f4ef4107d60 2024-06-06T03:15:08.538 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.629+0000 7f4ef2d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ef4107d60 0x7f4ef419bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:08.538 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.629+0000 7f4ef2d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ef4107d60 0x7f4ef419bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54336/0 (socket says 172.21.15.50:54336) 2024-06-06T03:15:08.538 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.629+0000 7f4ef2d9d700 1 -- 172.21.15.50:0/3513096787 learned_addr learned my addr 172.21.15.50:0/3513096787 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:15:08.538 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.629+0000 7f4ef2d9d700 1 -- 172.21.15.50:0/3513096787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef419c100 con 0x7f4ef4107d60 2024-06-06T03:15:08.539 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.629+0000 7f4ef2d9d700 1 --2- 172.21.15.50:0/3513096787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ef4107d60 0x7f4ef419bbc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4011a20 tx=0x7f4ee4011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:08.539 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.629+0000 7f4edbfff700 1 -- 172.21.15.50:0/3513096787 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ee4003b70 con 0x7f4ef4107d60 2024-06-06T03:15:08.539 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.629+0000 7f4ef90f1700 1 -- 172.21.15.50:0/3513096787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ef419c390 con 0x7f4ef4107d60 2024-06-06T03:15:08.539 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.629+0000 7f4edbfff700 1 -- 172.21.15.50:0/3513096787 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4ee401a8e0 con 0x7f4ef4107d60 2024-06-06T03:15:08.539 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.629+0000 7f4edbfff700 1 -- 172.21.15.50:0/3513096787 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ee4024990 con 0x7f4ef4107d60 2024-06-06T03:15:08.539 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.629+0000 7f4ef90f1700 1 -- 172.21.15.50:0/3513096787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ef419f080 con 0x7f4ef4107d60 2024-06-06T03:15:08.539 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.630+0000 7f4edbfff700 1 -- 172.21.15.50:0/3513096787 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f4ee4022020 con 0x7f4ef4107d60 2024-06-06T03:15:08.539 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.631+0000 7f4ef90f1700 1 -- 172.21.15.50:0/3513096787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ef4063af0 con 0x7f4ef4107d60 2024-06-06T03:15:08.539 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.631+0000 7f4edbfff700 1 --2- 172.21.15.50:0/3513096787 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f4edc0390b0 0x7f4edc03b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:08.539 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.631+0000 7f4ef259c700 1 -- 172.21.15.50:0/3513096787 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f4edc0390b0 msgr2=0x7f4edc03b570 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/1311987652 2024-06-06T03:15:08.539 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.631+0000 7f4edbfff700 1 -- 172.21.15.50:0/3513096787 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4ee404d370 con 0x7f4ef4107d60 2024-06-06T03:15:08.540 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.631+0000 7f4ef259c700 1 --2- 172.21.15.50:0/3513096787 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f4edc0390b0 0x7f4edc03b570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-06T03:15:08.540 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.640+0000 7f4edbfff700 1 -- 172.21.15.50:0/3513096787 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4ee40172b0 con 0x7f4ef4107d60 2024-06-06T03:15:08.540 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.832+0000 7f4ef259c700 1 -- 172.21.15.50:0/3513096787 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f4edc0390b0 msgr2=0x7f4edc03b570 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/1311987652 2024-06-06T03:15:08.540 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.832+0000 7f4ef259c700 1 --2- 172.21.15.50:0/3513096787 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f4edc0390b0 0x7f4edc03b570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-06T03:15:08.540 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.907+0000 7f4ef90f1700 1 -- 172.21.15.50:0/3513096787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f4ef419f630 con 0x7f4ef4107d60 2024-06-06T03:15:08.540 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.908+0000 7f4edbfff700 1 -- 172.21.15.50:0/3513096787 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f4ee400fdd0 con 0x7f4ef4107d60 2024-06-06T03:15:08.540 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.910+0000 7f4ef90f1700 1 -- 172.21.15.50:0/3513096787 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f4edc0390b0 msgr2=0x7f4edc03b570 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T03:15:08.540 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.910+0000 7f4ef90f1700 1 --2- 172.21.15.50:0/3513096787 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f4edc0390b0 0x7f4edc03b570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:08.540 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.910+0000 7f4ef90f1700 1 -- 172.21.15.50:0/3513096787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ef4107d60 msgr2=0x7f4ef419bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:08.540 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.910+0000 7f4ef90f1700 1 --2- 172.21.15.50:0/3513096787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ef4107d60 0x7f4ef419bbc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4011a20 tx=0x7f4ee4011b00 comp rx=0 tx=0).stop 2024-06-06T03:15:08.540 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.910+0000 7f4ef90f1700 1 -- 172.21.15.50:0/3513096787 shutdown_connections 2024-06-06T03:15:08.541 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.910+0000 7f4ef90f1700 1 --2- 172.21.15.50:0/3513096787 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f4edc0390b0 0x7f4edc03b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:08.541 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.910+0000 7f4ef90f1700 1 --2- 172.21.15.50:0/3513096787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ef4107d60 0x7f4ef419bbc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:08.541 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.910+0000 7f4ef90f1700 1 -- 172.21.15.50:0/3513096787 >> 172.21.15.50:0/3513096787 conn(0x7f4ef41033a0 msgr2=0x7f4ef4103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:08.541 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.911+0000 7f4ef90f1700 1 -- 172.21.15.50:0/3513096787 shutdown_connections 2024-06-06T03:15:08.541 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:07.911+0000 7f4ef90f1700 1 -- 172.21.15.50:0/3513096787 wait complete. 2024-06-06T03:15:08.541 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for the mgr to restart... 2024-06-06T03:15:08.541 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for mgr epoch 9... 2024-06-06T03:15:08.811 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:15:08 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:15:08.601+0000 7f2235e4d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-06T03:15:09.121 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:15:08 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:15:08.911+0000 7f2235e4d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-06T03:15:09.121 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:15:09 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:15:09.010+0000 7f2235e4d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-06T03:15:09.426 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:15:09 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:15:09.223+0000 7f2235e4d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-06T03:15:09.751 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:15:09 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:15:09.425+0000 7f2235e4d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-06T03:15:10.323 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:15:10 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:15:10.061+0000 7f2235e4d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-06T03:15:10.607 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:15:10 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:15:10.505+0000 7f2235e4d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-06T03:15:10.607 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:15:10 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:15:10.607+0000 7f2235e4d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-06T03:15:11.001 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:15:10 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:15:10.817+0000 7f2235e4d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-06T03:15:11.716 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:15:11 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:15:11.364+0000 7f2235e4d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-06T03:15:11.716 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:15:11 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:15:11.461+0000 7f2235e4d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-06T03:15:12.001 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:15:11 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:15:11.716+0000 7f2235e4d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-06T03:15:12.001 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:15:11 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:15:11.856+0000 7f2235e4d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-06T03:15:12.001 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:15:11 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:15:11.956+0000 7f2235e4d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-06T03:15:12.389 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:15:12 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:15:12.077+0000 7f2235e4d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-06T03:15:12.389 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:15:12 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:15:12.389+0000 7f2235e4d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-06T03:15:13.302 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:15:13 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:15:13.020+0000 7f2235e4d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-06T03:15:13.302 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:15:13 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:15:13.249+0000 7f2235e4d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-06T03:15:13.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:13 smithi050 ceph-mon[32421]: Active manager daemon x restarted 2024-06-06T03:15:13.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:13 smithi050 ceph-mon[32421]: Activating manager daemon x 2024-06-06T03:15:13.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:13 smithi050 ceph-mon[32421]: osdmap e3: 0 total, 0 up, 0 in 2024-06-06T03:15:13.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:13 smithi050 ceph-mon[32421]: mgrmap e10: x(active, starting, since 0.00325364s) 2024-06-06T03:15:13.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T03:15:13.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-06T03:15:13.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-06T03:15:13.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-06T03:15:13.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-06T03:15:13.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:13 smithi050 ceph-mon[32421]: Manager daemon x is now available 2024-06-06T03:15:13.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:15:13.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-06T03:15:14.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-06T03:15:14.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:14 smithi050 ceph-mon[32421]: [06/Jun/2024:03:15:13] ENGINE Bus STARTING 2024-06-06T03:15:14.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:14 smithi050 ceph-mon[32421]: [06/Jun/2024:03:15:13] ENGINE Serving on https://172.21.15.50:7150 2024-06-06T03:15:14.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:14 smithi050 ceph-mon[32421]: [06/Jun/2024:03:15:13] ENGINE Serving on http://172.21.15.50:8765 2024-06-06T03:15:14.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:14 smithi050 ceph-mon[32421]: [06/Jun/2024:03:15:13] ENGINE Bus STARTED 2024-06-06T03:15:14.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:14 smithi050 ceph-mon[32421]: mgrmap e11: x(active, since 1.00604s) 2024-06-06T03:15:14.851 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2024-06-06T03:15:14.851 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-06-06T03:15:14.852 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "initialized": true 2024-06-06T03:15:14.852 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2024-06-06T03:15:14.852 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.915+0000 7f6bedf6d700 1 Processor -- start 2024-06-06T03:15:14.852 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.915+0000 7f6bedf6d700 1 -- start start 2024-06-06T03:15:14.852 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.915+0000 7f6bedf6d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be8106c70 0x7f6be8107090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:14.852 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.915+0000 7f6bedf6d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6be8107660 con 0x7f6be8106c70 2024-06-06T03:15:14.852 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.915+0000 7f6be77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be8106c70 0x7f6be8107090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:14.852 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.915+0000 7f6be77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be8106c70 0x7f6be8107090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44322/0 (socket says 172.21.15.50:44322) 2024-06-06T03:15:14.852 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.915+0000 7f6be77fe700 1 -- 172.21.15.50:0/1966771600 learned_addr learned my addr 172.21.15.50:0/1966771600 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:15:14.852 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.916+0000 7f6be77fe700 1 -- 172.21.15.50:0/1966771600 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be8107e70 con 0x7f6be8106c70 2024-06-06T03:15:14.852 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.916+0000 7f6be77fe700 1 --2- 172.21.15.50:0/1966771600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be8106c70 0x7f6be8107090 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6bd80098a0 tx=0x7f6bd8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=487d3d710aa5e69e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:14.852 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.916+0000 7f6be67fc700 1 -- 172.21.15.50:0/1966771600 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bd8004160 con 0x7f6be8106c70 2024-06-06T03:15:14.853 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.916+0000 7f6be67fc700 1 -- 172.21.15.50:0/1966771600 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6bd8004300 con 0x7f6be8106c70 2024-06-06T03:15:14.853 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.916+0000 7f6be67fc700 1 -- 172.21.15.50:0/1966771600 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bd8011a50 con 0x7f6be8106c70 2024-06-06T03:15:14.853 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.917+0000 7f6bedf6d700 1 -- 172.21.15.50:0/1966771600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be8106c70 msgr2=0x7f6be8107090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:14.853 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.917+0000 7f6bedf6d700 1 --2- 172.21.15.50:0/1966771600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be8106c70 0x7f6be8107090 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6bd80098a0 tx=0x7f6bd8009bb0 comp rx=0 tx=0).stop 2024-06-06T03:15:14.853 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.917+0000 7f6bedf6d700 1 -- 172.21.15.50:0/1966771600 shutdown_connections 2024-06-06T03:15:14.853 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.917+0000 7f6bedf6d700 1 --2- 172.21.15.50:0/1966771600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be8106c70 0x7f6be8107090 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:14.853 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.917+0000 7f6bedf6d700 1 -- 172.21.15.50:0/1966771600 >> 172.21.15.50:0/1966771600 conn(0x7f6be8102290 msgr2=0x7f6be81046b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:14.853 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.917+0000 7f6bedf6d700 1 -- 172.21.15.50:0/1966771600 shutdown_connections 2024-06-06T03:15:14.853 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.917+0000 7f6bedf6d700 1 -- 172.21.15.50:0/1966771600 wait complete. 2024-06-06T03:15:14.853 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.917+0000 7f6bedf6d700 1 Processor -- start 2024-06-06T03:15:14.853 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.918+0000 7f6bedf6d700 1 -- start start 2024-06-06T03:15:14.853 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.918+0000 7f6bedf6d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be8106c70 0x7f6be819bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:14.853 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.918+0000 7f6bedf6d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6be810b220 con 0x7f6be8106c70 2024-06-06T03:15:14.853 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.918+0000 7f6be77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be8106c70 0x7f6be819bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:14.854 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.918+0000 7f6be77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be8106c70 0x7f6be819bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44334/0 (socket says 172.21.15.50:44334) 2024-06-06T03:15:14.854 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.918+0000 7f6be77fe700 1 -- 172.21.15.50:0/2652625600 learned_addr learned my addr 172.21.15.50:0/2652625600 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:15:14.854 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.918+0000 7f6be77fe700 1 -- 172.21.15.50:0/2652625600 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be819c1b0 con 0x7f6be8106c70 2024-06-06T03:15:14.854 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.918+0000 7f6be77fe700 1 --2- 172.21.15.50:0/2652625600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be8106c70 0x7f6be819bc70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8006ba0 tx=0x7f6bd8011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:14.854 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.919+0000 7f6be4ff9700 1 -- 172.21.15.50:0/2652625600 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bd8003af0 con 0x7f6be8106c70 2024-06-06T03:15:14.854 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.919+0000 7f6be4ff9700 1 -- 172.21.15.50:0/2652625600 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6bd801a8e0 con 0x7f6be8106c70 2024-06-06T03:15:14.854 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.919+0000 7f6bedf6d700 1 -- 172.21.15.50:0/2652625600 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6be819c440 con 0x7f6be8106c70 2024-06-06T03:15:14.854 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.919+0000 7f6be4ff9700 1 -- 172.21.15.50:0/2652625600 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bd8024900 con 0x7f6be8106c70 2024-06-06T03:15:14.854 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.919+0000 7f6bedf6d700 1 -- 172.21.15.50:0/2652625600 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6be819f130 con 0x7f6be8106c70 2024-06-06T03:15:14.854 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.919+0000 7f6be4ff9700 1 -- 172.21.15.50:0/2652625600 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f6bd8022020 con 0x7f6be8106c70 2024-06-06T03:15:14.854 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.920+0000 7f6be4ff9700 1 --2- 172.21.15.50:0/2652625600 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f6bd0039100 0x7f6bd003b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:14.854 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.920+0000 7f6be4ff9700 1 -- 172.21.15.50:0/2652625600 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6bd801aa90 con 0x7f6be8106c70 2024-06-06T03:15:14.855 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.920+0000 7f6be6ffd700 1 -- 172.21.15.50:0/2652625600 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f6bd0039100 msgr2=0x7f6bd003b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/1311987652 2024-06-06T03:15:14.855 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.920+0000 7f6be6ffd700 1 --2- 172.21.15.50:0/2652625600 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f6bd0039100 0x7f6bd003b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-06T03:15:14.855 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:08.920+0000 7f6bedf6d700 1 -- 172.21.15.50:0/2652625600 --> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f6be8063af0 con 0x7f6bd0039100 2024-06-06T03:15:14.855 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:09.121+0000 7f6be6ffd700 1 -- 172.21.15.50:0/2652625600 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f6bd0039100 msgr2=0x7f6bd003b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/1311987652 2024-06-06T03:15:14.855 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:09.121+0000 7f6be6ffd700 1 --2- 172.21.15.50:0/2652625600 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f6bd0039100 0x7f6bd003b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-06T03:15:14.855 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:09.522+0000 7f6be6ffd700 1 -- 172.21.15.50:0/2652625600 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f6bd0039100 msgr2=0x7f6bd003b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/1311987652 2024-06-06T03:15:14.855 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:09.522+0000 7f6be6ffd700 1 --2- 172.21.15.50:0/2652625600 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f6bd0039100 0x7f6bd003b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-06-06T03:15:14.855 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:10.323+0000 7f6be6ffd700 1 -- 172.21.15.50:0/2652625600 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f6bd0039100 msgr2=0x7f6bd003b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/1311987652 2024-06-06T03:15:14.855 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:10.323+0000 7f6be6ffd700 1 --2- 172.21.15.50:0/2652625600 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f6bd0039100 0x7f6bd003b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-06-06T03:15:14.855 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:11.924+0000 7f6be6ffd700 1 -- 172.21.15.50:0/2652625600 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f6bd0039100 msgr2=0x7f6bd003b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/1311987652 2024-06-06T03:15:14.855 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:11.924+0000 7f6be6ffd700 1 --2- 172.21.15.50:0/2652625600 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f6bd0039100 0x7f6bd003b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-06-06T03:15:14.855 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:13.252+0000 7f6be4ff9700 1 -- 172.21.15.50:0/2652625600 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7f6bd8017d40 con 0x7f6be8106c70 2024-06-06T03:15:14.855 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:13.253+0000 7f6be4ff9700 1 -- 172.21.15.50:0/2652625600 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f6bd0039100 msgr2=0x7f6bd003b5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T03:15:14.856 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:13.253+0000 7f6be4ff9700 1 --2- 172.21.15.50:0/2652625600 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f6bd0039100 0x7f6bd003b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:14.856 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:14.254+0000 7f6be4ff9700 1 -- 172.21.15.50:0/2652625600 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f6bd8042120 con 0x7f6be8106c70 2024-06-06T03:15:14.856 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:14.255+0000 7f6be4ff9700 1 --2- 172.21.15.50:0/2652625600 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6bd003c9d0 0x7f6bd003edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:14.856 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:14.255+0000 7f6be4ff9700 1 -- 172.21.15.50:0/2652625600 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f6bd804f970 con 0x7f6bd003c9d0 2024-06-06T03:15:14.856 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:14.255+0000 7f6be6ffd700 1 --2- 172.21.15.50:0/2652625600 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6bd003c9d0 0x7f6bd003edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:14.856 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:14.256+0000 7f6be6ffd700 1 --2- 172.21.15.50:0/2652625600 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6bd003c9d0 0x7f6bd003edc0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc003a10 tx=0x7f6bdc0092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:14.856 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:14.256+0000 7f6be4ff9700 1 -- 172.21.15.50:0/2652625600 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7f6bd804f970 con 0x7f6bd003c9d0 2024-06-06T03:15:14.856 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:14.264+0000 7f6bedf6d700 1 -- 172.21.15.50:0/2652625600 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f6be80628d0 con 0x7f6bd003c9d0 2024-06-06T03:15:14.856 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:14.264+0000 7f6be4ff9700 1 -- 172.21.15.50:0/2652625600 <== mgr.14152 v2:172.21.15.50:6800/1779941165 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f6be80628d0 con 0x7f6bd003c9d0 2024-06-06T03:15:14.856 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:14.264+0000 7f6bedf6d700 1 -- 172.21.15.50:0/2652625600 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6bd003c9d0 msgr2=0x7f6bd003edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:14.856 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:14.264+0000 7f6bedf6d700 1 --2- 172.21.15.50:0/2652625600 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6bd003c9d0 0x7f6bd003edc0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc003a10 tx=0x7f6bdc0092b0 comp rx=0 tx=0).stop 2024-06-06T03:15:14.856 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:14.264+0000 7f6bedf6d700 1 -- 172.21.15.50:0/2652625600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be8106c70 msgr2=0x7f6be819bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:14.856 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:14.264+0000 7f6bedf6d700 1 --2- 172.21.15.50:0/2652625600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be8106c70 0x7f6be819bc70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8006ba0 tx=0x7f6bd8011ad0 comp rx=0 tx=0).stop 2024-06-06T03:15:14.856 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:14.265+0000 7f6bedf6d700 1 -- 172.21.15.50:0/2652625600 shutdown_connections 2024-06-06T03:15:14.857 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:14.265+0000 7f6bedf6d700 1 --2- 172.21.15.50:0/2652625600 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6bd003c9d0 0x7f6bd003edc0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:14.857 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:14.265+0000 7f6bedf6d700 1 --2- 172.21.15.50:0/2652625600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be8106c70 0x7f6be819bc70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:14.857 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:14.265+0000 7f6bedf6d700 1 --2- 172.21.15.50:0/2652625600 >> [v2:172.21.15.50:6800/1311987652,v1:172.21.15.50:6801/1311987652] conn(0x7f6bd0039100 0x7f6bd003b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:14.857 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:14.265+0000 7f6bedf6d700 1 -- 172.21.15.50:0/2652625600 >> 172.21.15.50:0/2652625600 conn(0x7f6be8102290 msgr2=0x7f6be8103080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:14.857 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:14.265+0000 7f6bedf6d700 1 -- 172.21.15.50:0/2652625600 shutdown_connections 2024-06-06T03:15:14.857 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:14.265+0000 7f6bedf6d700 1 -- 172.21.15.50:0/2652625600 wait complete. 2024-06-06T03:15:14.857 INFO:teuthology.orchestra.run.smithi050.stdout:mgr epoch 9 is available 2024-06-06T03:15:14.857 INFO:teuthology.orchestra.run.smithi050.stdout:Generating a dashboard self-signed certificate... 2024-06-06T03:15:15.488 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:15 smithi050 ceph-mon[32421]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-06-06T03:15:15.488 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:15 smithi050 ceph-mon[32421]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-06-06T03:15:15.488 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:15 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:16.433 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-06-06T03:15:16.433 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.517+0000 7f61cb053700 1 Processor -- start 2024-06-06T03:15:16.433 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.517+0000 7f61cb053700 1 -- start start 2024-06-06T03:15:16.433 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.518+0000 7f61cb053700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c4107130 0x7f61c4107550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:16.433 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.518+0000 7f61cb053700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f61c4107b20 con 0x7f61c4107130 2024-06-06T03:15:16.433 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.518+0000 7f61c8def700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c4107130 0x7f61c4107550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:16.433 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.518+0000 7f61c8def700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c4107130 0x7f61c4107550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44404/0 (socket says 172.21.15.50:44404) 2024-06-06T03:15:16.433 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.518+0000 7f61c8def700 1 -- 172.21.15.50:0/2446291014 learned_addr learned my addr 172.21.15.50:0/2446291014 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:15:16.433 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.518+0000 7f61c8def700 1 -- 172.21.15.50:0/2446291014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c4107e50 con 0x7f61c4107130 2024-06-06T03:15:16.433 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.518+0000 7f61c8def700 1 --2- 172.21.15.50:0/2446291014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c4107130 0x7f61c4107550 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f61b80098a0 tx=0x7f61b8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df5cc94e0bd8d1cc server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:16.433 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.519+0000 7f61c37fe700 1 -- 172.21.15.50:0/2446291014 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61b8004160 con 0x7f61c4107130 2024-06-06T03:15:16.434 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.519+0000 7f61c37fe700 1 -- 172.21.15.50:0/2446291014 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f61b8004300 con 0x7f61c4107130 2024-06-06T03:15:16.434 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.519+0000 7f61c37fe700 1 -- 172.21.15.50:0/2446291014 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61b8011a50 con 0x7f61c4107130 2024-06-06T03:15:16.434 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.519+0000 7f61cb053700 1 -- 172.21.15.50:0/2446291014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c4107130 msgr2=0x7f61c4107550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:16.434 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.519+0000 7f61cb053700 1 --2- 172.21.15.50:0/2446291014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c4107130 0x7f61c4107550 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f61b80098a0 tx=0x7f61b8009bb0 comp rx=0 tx=0).stop 2024-06-06T03:15:16.434 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.519+0000 7f61cb053700 1 -- 172.21.15.50:0/2446291014 shutdown_connections 2024-06-06T03:15:16.434 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.519+0000 7f61cb053700 1 --2- 172.21.15.50:0/2446291014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c4107130 0x7f61c4107550 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:16.434 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.519+0000 7f61cb053700 1 -- 172.21.15.50:0/2446291014 >> 172.21.15.50:0/2446291014 conn(0x7f61c4101970 msgr2=0x7f61c4103d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:16.434 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.519+0000 7f61cb053700 1 -- 172.21.15.50:0/2446291014 shutdown_connections 2024-06-06T03:15:16.434 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.519+0000 7f61cb053700 1 -- 172.21.15.50:0/2446291014 wait complete. 2024-06-06T03:15:16.434 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.520+0000 7f61cb053700 1 Processor -- start 2024-06-06T03:15:16.434 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.520+0000 7f61cb053700 1 -- start start 2024-06-06T03:15:16.434 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.520+0000 7f61cb053700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c4107130 0x7f61c419bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:16.434 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.520+0000 7f61cb053700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f61c410b200 con 0x7f61c4107130 2024-06-06T03:15:16.435 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.520+0000 7f61c8def700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c4107130 0x7f61c419bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:16.435 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.520+0000 7f61c8def700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c4107130 0x7f61c419bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44406/0 (socket says 172.21.15.50:44406) 2024-06-06T03:15:16.435 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.520+0000 7f61c8def700 1 -- 172.21.15.50:0/655141205 learned_addr learned my addr 172.21.15.50:0/655141205 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:15:16.435 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.521+0000 7f61c8def700 1 -- 172.21.15.50:0/655141205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c419c180 con 0x7f61c4107130 2024-06-06T03:15:16.435 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.521+0000 7f61c8def700 1 --2- 172.21.15.50:0/655141205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c4107130 0x7f61c419bc40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f61b8006b20 tx=0x7f61b8011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:16.435 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.521+0000 7f61c1ffb700 1 -- 172.21.15.50:0/655141205 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61b8003b70 con 0x7f61c4107130 2024-06-06T03:15:16.435 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.521+0000 7f61c1ffb700 1 -- 172.21.15.50:0/655141205 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f61b801a8e0 con 0x7f61c4107130 2024-06-06T03:15:16.435 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.521+0000 7f61c1ffb700 1 -- 172.21.15.50:0/655141205 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61b80249b0 con 0x7f61c4107130 2024-06-06T03:15:16.435 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.521+0000 7f61cb053700 1 -- 172.21.15.50:0/655141205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61c419c410 con 0x7f61c4107130 2024-06-06T03:15:16.435 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.521+0000 7f61cb053700 1 -- 172.21.15.50:0/655141205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61c419f0b0 con 0x7f61c4107130 2024-06-06T03:15:16.435 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.522+0000 7f61c1ffb700 1 -- 172.21.15.50:0/655141205 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f61b8022020 con 0x7f61c4107130 2024-06-06T03:15:16.435 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.522+0000 7f61c1ffb700 1 --2- 172.21.15.50:0/655141205 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f61b4038ff0 0x7f61b403b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:16.435 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.522+0000 7f61c1ffb700 1 -- 172.21.15.50:0/655141205 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f61b804d750 con 0x7f61c4107130 2024-06-06T03:15:16.436 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.522+0000 7f61c3fff700 1 --2- 172.21.15.50:0/655141205 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f61b4038ff0 0x7f61b403b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:16.436 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.523+0000 7f61cb053700 1 -- 172.21.15.50:0/655141205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61c4063af0 con 0x7f61c4107130 2024-06-06T03:15:16.436 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.523+0000 7f61c3fff700 1 --2- 172.21.15.50:0/655141205 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f61b4038ff0 0x7f61b403b4b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f61b0006fd0 tx=0x7f61b0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:16.436 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.528+0000 7f61c1ffb700 1 -- 172.21.15.50:0/655141205 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f61b802c3a0 con 0x7f61c4107130 2024-06-06T03:15:16.436 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.749+0000 7f61cb053700 1 -- 172.21.15.50:0/655141205 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f61c402ddb0 con 0x7f61b4038ff0 2024-06-06T03:15:16.436 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.820+0000 7f61c1ffb700 1 -- 172.21.15.50:0/655141205 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f61c402ddb0 con 0x7f61b4038ff0 2024-06-06T03:15:16.436 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.823+0000 7f61cb053700 1 -- 172.21.15.50:0/655141205 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f61b4038ff0 msgr2=0x7f61b403b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:16.436 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.823+0000 7f61cb053700 1 --2- 172.21.15.50:0/655141205 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f61b4038ff0 0x7f61b403b4b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f61b0006fd0 tx=0x7f61b0006e40 comp rx=0 tx=0).stop 2024-06-06T03:15:16.436 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.823+0000 7f61cb053700 1 -- 172.21.15.50:0/655141205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c4107130 msgr2=0x7f61c419bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:16.436 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.823+0000 7f61cb053700 1 --2- 172.21.15.50:0/655141205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c4107130 0x7f61c419bc40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f61b8006b20 tx=0x7f61b8011ad0 comp rx=0 tx=0).stop 2024-06-06T03:15:16.436 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.823+0000 7f61cb053700 1 -- 172.21.15.50:0/655141205 shutdown_connections 2024-06-06T03:15:16.436 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.823+0000 7f61cb053700 1 --2- 172.21.15.50:0/655141205 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f61b4038ff0 0x7f61b403b4b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:16.436 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.823+0000 7f61cb053700 1 --2- 172.21.15.50:0/655141205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c4107130 0x7f61c419bc40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:16.437 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.823+0000 7f61cb053700 1 -- 172.21.15.50:0/655141205 >> 172.21.15.50:0/655141205 conn(0x7f61c4101970 msgr2=0x7f61c4102760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:16.437 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.823+0000 7f61cb053700 1 -- 172.21.15.50:0/655141205 shutdown_connections 2024-06-06T03:15:16.437 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:15.823+0000 7f61cb053700 1 -- 172.21.15.50:0/655141205 wait complete. 2024-06-06T03:15:16.437 INFO:teuthology.orchestra.run.smithi050.stdout:Creating initial admin user... 2024-06-06T03:15:17.111 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:16 smithi050 ceph-mon[32421]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:15:17.111 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:16 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:17.111 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:16 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:17.111 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:16 smithi050 ceph-mon[32421]: mgrmap e12: x(active, since 2s) 2024-06-06T03:15:17.111 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:16 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:18.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:17 smithi050 ceph-mon[32421]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:15:18.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:17 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:18.596 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$CGA9fO.4bB3Mv443YmSiOu4qu2sACcFg9Zc9MtuYUngCtR..gqi8K", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1717643717, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-06-06T03:15:18.596 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.847+0000 7f61fdc89700 1 Processor -- start 2024-06-06T03:15:18.596 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.847+0000 7f61fdc89700 1 -- start start 2024-06-06T03:15:18.596 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.848+0000 7f61fdc89700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61f8108820 0x7f61f810ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:18.596 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.848+0000 7f61fdc89700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f61f807be60 con 0x7f61f8108820 2024-06-06T03:15:18.596 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.848+0000 7f61f77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61f8108820 0x7f61f810ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:18.596 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.848+0000 7f61f77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61f8108820 0x7f61f810ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44408/0 (socket says 172.21.15.50:44408) 2024-06-06T03:15:18.596 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.848+0000 7f61f77fe700 1 -- 172.21.15.50:0/2746707829 learned_addr learned my addr 172.21.15.50:0/2746707829 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:15:18.596 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.848+0000 7f61f77fe700 1 -- 172.21.15.50:0/2746707829 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61f810b150 con 0x7f61f8108820 2024-06-06T03:15:18.596 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.848+0000 7f61f77fe700 1 --2- 172.21.15.50:0/2746707829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61f8108820 0x7f61f810ac10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f61e00098a0 tx=0x7f61e0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e69b982a4bd401 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:18.596 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.849+0000 7f61f67fc700 1 -- 172.21.15.50:0/2746707829 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61e0004160 con 0x7f61f8108820 2024-06-06T03:15:18.597 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.849+0000 7f61f67fc700 1 -- 172.21.15.50:0/2746707829 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f61e0004300 con 0x7f61f8108820 2024-06-06T03:15:18.597 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.849+0000 7f61f67fc700 1 -- 172.21.15.50:0/2746707829 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61e0011a50 con 0x7f61f8108820 2024-06-06T03:15:18.597 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.849+0000 7f61fdc89700 1 -- 172.21.15.50:0/2746707829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61f8108820 msgr2=0x7f61f810ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:18.597 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.849+0000 7f61fdc89700 1 --2- 172.21.15.50:0/2746707829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61f8108820 0x7f61f810ac10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f61e00098a0 tx=0x7f61e0009bb0 comp rx=0 tx=0).stop 2024-06-06T03:15:18.597 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.850+0000 7f61fdc89700 1 -- 172.21.15.50:0/2746707829 shutdown_connections 2024-06-06T03:15:18.597 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.850+0000 7f61fdc89700 1 --2- 172.21.15.50:0/2746707829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61f8108820 0x7f61f810ac10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:18.597 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.850+0000 7f61fdc89700 1 -- 172.21.15.50:0/2746707829 >> 172.21.15.50:0/2746707829 conn(0x7f61f8102290 msgr2=0x7f61f81046b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:18.597 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.850+0000 7f61fdc89700 1 -- 172.21.15.50:0/2746707829 shutdown_connections 2024-06-06T03:15:18.597 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.850+0000 7f61fdc89700 1 -- 172.21.15.50:0/2746707829 wait complete. 2024-06-06T03:15:18.597 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.850+0000 7f61fdc89700 1 Processor -- start 2024-06-06T03:15:18.597 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.851+0000 7f61fdc89700 1 -- start start 2024-06-06T03:15:18.597 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.851+0000 7f61fdc89700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61f8108820 0x7f61f819bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:18.597 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.851+0000 7f61fdc89700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f61f810c150 con 0x7f61f8108820 2024-06-06T03:15:18.598 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.851+0000 7f61f77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61f8108820 0x7f61f819bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:18.598 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.851+0000 7f61f77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61f8108820 0x7f61f819bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44414/0 (socket says 172.21.15.50:44414) 2024-06-06T03:15:18.598 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.851+0000 7f61f77fe700 1 -- 172.21.15.50:0/655704585 learned_addr learned my addr 172.21.15.50:0/655704585 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:15:18.598 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.851+0000 7f61f77fe700 1 -- 172.21.15.50:0/655704585 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61f819c120 con 0x7f61f8108820 2024-06-06T03:15:18.598 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.851+0000 7f61f77fe700 1 --2- 172.21.15.50:0/655704585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61f8108820 0x7f61f819bbe0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f61e0011a20 tx=0x7f61e0011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:18.598 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.851+0000 7f61f4ff9700 1 -- 172.21.15.50:0/655704585 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61e0003b70 con 0x7f61f8108820 2024-06-06T03:15:18.598 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.851+0000 7f61f4ff9700 1 -- 172.21.15.50:0/655704585 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f61e001a8e0 con 0x7f61f8108820 2024-06-06T03:15:18.598 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.851+0000 7f61fdc89700 1 -- 172.21.15.50:0/655704585 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61f819c3b0 con 0x7f61f8108820 2024-06-06T03:15:18.598 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.852+0000 7f61fdc89700 1 -- 172.21.15.50:0/655704585 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61f819f0a0 con 0x7f61f8108820 2024-06-06T03:15:18.598 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.852+0000 7f61f4ff9700 1 -- 172.21.15.50:0/655704585 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61e0024990 con 0x7f61f8108820 2024-06-06T03:15:18.598 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.852+0000 7f61f4ff9700 1 -- 172.21.15.50:0/655704585 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f61e0022020 con 0x7f61f8108820 2024-06-06T03:15:18.598 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.853+0000 7f61fdc89700 1 -- 172.21.15.50:0/655704585 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61f8063af0 con 0x7f61f8108820 2024-06-06T03:15:18.599 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.853+0000 7f61f4ff9700 1 --2- 172.21.15.50:0/655704585 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f61e40390b0 0x7f61e403b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:18.599 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.853+0000 7f61f4ff9700 1 -- 172.21.15.50:0/655704585 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f61e004d490 con 0x7f61f8108820 2024-06-06T03:15:18.599 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.853+0000 7f61f6ffd700 1 --2- 172.21.15.50:0/655704585 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f61e40390b0 0x7f61e403b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:18.599 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.853+0000 7f61f6ffd700 1 --2- 172.21.15.50:0/655704585 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f61e40390b0 0x7f61e403b570 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f61e8006fd0 tx=0x7f61e8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:18.599 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:16.858+0000 7f61f4ff9700 1 -- 172.21.15.50:0/655704585 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f61e000fdd0 con 0x7f61f8108820 2024-06-06T03:15:18.599 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:17.110+0000 7f61fdc89700 1 -- 172.21.15.50:0/655704585 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f61f819c890 con 0x7f61e40390b0 2024-06-06T03:15:18.599 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:17.357+0000 7f61f4ff9700 1 -- 172.21.15.50:0/655704585 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f61f819c890 con 0x7f61e40390b0 2024-06-06T03:15:18.599 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:17.360+0000 7f61fdc89700 1 -- 172.21.15.50:0/655704585 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f61e40390b0 msgr2=0x7f61e403b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:18.599 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:17.360+0000 7f61fdc89700 1 --2- 172.21.15.50:0/655704585 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f61e40390b0 0x7f61e403b570 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f61e8006fd0 tx=0x7f61e8006e40 comp rx=0 tx=0).stop 2024-06-06T03:15:18.599 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:17.360+0000 7f61fdc89700 1 -- 172.21.15.50:0/655704585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61f8108820 msgr2=0x7f61f819bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:18.599 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:17.360+0000 7f61fdc89700 1 --2- 172.21.15.50:0/655704585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61f8108820 0x7f61f819bbe0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f61e0011a20 tx=0x7f61e0011b00 comp rx=0 tx=0).stop 2024-06-06T03:15:18.599 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:17.360+0000 7f61fdc89700 1 -- 172.21.15.50:0/655704585 shutdown_connections 2024-06-06T03:15:18.599 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:17.360+0000 7f61fdc89700 1 --2- 172.21.15.50:0/655704585 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f61e40390b0 0x7f61e403b570 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:18.600 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:17.360+0000 7f61fdc89700 1 --2- 172.21.15.50:0/655704585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61f8108820 0x7f61f819bbe0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:18.600 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:17.360+0000 7f61fdc89700 1 -- 172.21.15.50:0/655704585 >> 172.21.15.50:0/655704585 conn(0x7f61f8102290 msgr2=0x7f61f8102cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:18.600 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:17.360+0000 7f61fdc89700 1 -- 172.21.15.50:0/655704585 shutdown_connections 2024-06-06T03:15:18.600 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:17.360+0000 7f61fdc89700 1 -- 172.21.15.50:0/655704585 wait complete. 2024-06-06T03:15:18.600 INFO:teuthology.orchestra.run.smithi050.stdout:Fetching dashboard port number... 2024-06-06T03:15:19.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:19 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3082718426' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-06-06T03:15:19.794 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 8443 2024-06-06T03:15:19.794 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.006+0000 7f14189db700 1 Processor -- start 2024-06-06T03:15:19.794 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.006+0000 7f14189db700 1 -- start start 2024-06-06T03:15:19.795 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.007+0000 7f14189db700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1414108840 0x7f141410ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:19.795 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.007+0000 7f14189db700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f141407be40 con 0x7f1414108840 2024-06-06T03:15:19.795 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.007+0000 7f141259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1414108840 0x7f141410ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:19.795 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.007+0000 7f141259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1414108840 0x7f141410ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42430/0 (socket says 172.21.15.50:42430) 2024-06-06T03:15:19.795 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.007+0000 7f141259c700 1 -- 172.21.15.50:0/2418795083 learned_addr learned my addr 172.21.15.50:0/2418795083 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:15:19.795 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.007+0000 7f141259c700 1 -- 172.21.15.50:0/2418795083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f141410b170 con 0x7f1414108840 2024-06-06T03:15:19.795 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.007+0000 7f141259c700 1 --2- 172.21.15.50:0/2418795083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1414108840 0x7f141410ac30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f14040098a0 tx=0x7f1404009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b985738eeabbf6f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:19.795 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.007+0000 7f141159a700 1 -- 172.21.15.50:0/2418795083 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1404004160 con 0x7f1414108840 2024-06-06T03:15:19.795 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.007+0000 7f141159a700 1 -- 172.21.15.50:0/2418795083 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1404004300 con 0x7f1414108840 2024-06-06T03:15:19.795 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.008+0000 7f141159a700 1 -- 172.21.15.50:0/2418795083 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1404011a50 con 0x7f1414108840 2024-06-06T03:15:19.795 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.008+0000 7f14189db700 1 -- 172.21.15.50:0/2418795083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1414108840 msgr2=0x7f141410ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:19.795 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.008+0000 7f14189db700 1 --2- 172.21.15.50:0/2418795083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1414108840 0x7f141410ac30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f14040098a0 tx=0x7f1404009bb0 comp rx=0 tx=0).stop 2024-06-06T03:15:19.796 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.008+0000 7f14189db700 1 -- 172.21.15.50:0/2418795083 shutdown_connections 2024-06-06T03:15:19.796 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.008+0000 7f14189db700 1 --2- 172.21.15.50:0/2418795083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1414108840 0x7f141410ac30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:19.796 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.008+0000 7f14189db700 1 -- 172.21.15.50:0/2418795083 >> 172.21.15.50:0/2418795083 conn(0x7f1414102210 msgr2=0x7f1414104650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:19.796 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.008+0000 7f14189db700 1 -- 172.21.15.50:0/2418795083 shutdown_connections 2024-06-06T03:15:19.796 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.008+0000 7f14189db700 1 -- 172.21.15.50:0/2418795083 wait complete. 2024-06-06T03:15:19.796 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.009+0000 7f14189db700 1 Processor -- start 2024-06-06T03:15:19.796 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.009+0000 7f14189db700 1 -- start start 2024-06-06T03:15:19.796 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.009+0000 7f14189db700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1414108840 0x7f14141080c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:19.796 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.009+0000 7f14189db700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f141410c120 con 0x7f1414108840 2024-06-06T03:15:19.796 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.009+0000 7f141259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1414108840 0x7f14141080c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:19.796 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.009+0000 7f141259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1414108840 0x7f14141080c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42434/0 (socket says 172.21.15.50:42434) 2024-06-06T03:15:19.796 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.009+0000 7f141259c700 1 -- 172.21.15.50:0/3082718426 learned_addr learned my addr 172.21.15.50:0/3082718426 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:15:19.796 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.010+0000 7f141259c700 1 -- 172.21.15.50:0/3082718426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1414108600 con 0x7f1414108840 2024-06-06T03:15:19.796 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.010+0000 7f141259c700 1 --2- 172.21.15.50:0/3082718426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1414108840 0x7f14141080c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1404006b20 tx=0x7f1404011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:19.797 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.010+0000 7f14037fe700 1 -- 172.21.15.50:0/3082718426 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1404003b70 con 0x7f1414108840 2024-06-06T03:15:19.797 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.010+0000 7f14037fe700 1 -- 172.21.15.50:0/3082718426 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f140401a8e0 con 0x7f1414108840 2024-06-06T03:15:19.797 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.010+0000 7f14189db700 1 -- 172.21.15.50:0/3082718426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14141067f0 con 0x7f1414108840 2024-06-06T03:15:19.797 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.010+0000 7f14037fe700 1 -- 172.21.15.50:0/3082718426 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14040249b0 con 0x7f1414108840 2024-06-06T03:15:19.797 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.010+0000 7f14189db700 1 -- 172.21.15.50:0/3082718426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1414106d30 con 0x7f1414108840 2024-06-06T03:15:19.797 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.011+0000 7f14037fe700 1 -- 172.21.15.50:0/3082718426 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f1404022020 con 0x7f1414108840 2024-06-06T03:15:19.797 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.011+0000 7f14189db700 1 -- 172.21.15.50:0/3082718426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1414063af0 con 0x7f1414108840 2024-06-06T03:15:19.797 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.011+0000 7f14037fe700 1 --2- 172.21.15.50:0/3082718426 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f13fc039100 0x7f13fc03b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:19.797 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.011+0000 7f14037fe700 1 -- 172.21.15.50:0/3082718426 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f140404daa0 con 0x7f1414108840 2024-06-06T03:15:19.797 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.011+0000 7f1411d9b700 1 --2- 172.21.15.50:0/3082718426 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f13fc039100 0x7f13fc03b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:19.797 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.012+0000 7f1411d9b700 1 --2- 172.21.15.50:0/3082718426 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f13fc039100 0x7f13fc03b5c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1408006fd0 tx=0x7f1408006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:19.797 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.016+0000 7f14037fe700 1 -- 172.21.15.50:0/3082718426 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1404019c70 con 0x7f1414108840 2024-06-06T03:15:19.798 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.221+0000 7f14189db700 1 -- 172.21.15.50:0/3082718426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f1414106fb0 con 0x7f1414108840 2024-06-06T03:15:19.798 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.221+0000 7f14037fe700 1 -- 172.21.15.50:0/3082718426 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f140402ccb0 con 0x7f1414108840 2024-06-06T03:15:19.798 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.224+0000 7f14189db700 1 -- 172.21.15.50:0/3082718426 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f13fc039100 msgr2=0x7f13fc03b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:19.798 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.224+0000 7f14189db700 1 --2- 172.21.15.50:0/3082718426 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f13fc039100 0x7f13fc03b5c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1408006fd0 tx=0x7f1408006e40 comp rx=0 tx=0).stop 2024-06-06T03:15:19.798 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.224+0000 7f14189db700 1 -- 172.21.15.50:0/3082718426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1414108840 msgr2=0x7f14141080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:19.798 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.224+0000 7f14189db700 1 --2- 172.21.15.50:0/3082718426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1414108840 0x7f14141080c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1404006b20 tx=0x7f1404011ad0 comp rx=0 tx=0).stop 2024-06-06T03:15:19.798 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.225+0000 7f14189db700 1 -- 172.21.15.50:0/3082718426 shutdown_connections 2024-06-06T03:15:19.798 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.225+0000 7f14189db700 1 --2- 172.21.15.50:0/3082718426 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f13fc039100 0x7f13fc03b5c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:19.798 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.225+0000 7f14189db700 1 --2- 172.21.15.50:0/3082718426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1414108840 0x7f14141080c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:19.798 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.225+0000 7f14189db700 1 -- 172.21.15.50:0/3082718426 >> 172.21.15.50:0/3082718426 conn(0x7f1414102210 msgr2=0x7f1414102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:19.798 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.225+0000 7f14189db700 1 -- 172.21.15.50:0/3082718426 shutdown_connections 2024-06-06T03:15:19.798 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:19.225+0000 7f14189db700 1 -- 172.21.15.50:0/3082718426 wait complete. 2024-06-06T03:15:19.802 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-06T03:15:19.803 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout disabled 2024-06-06T03:15:19.811 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-06T03:15:19.811 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2024-06-06T03:15:19.811 INFO:teuthology.orchestra.run.smithi050.stdout:firewalld.service is not enabled 2024-06-06T03:15:19.811 INFO:teuthology.orchestra.run.smithi050.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-06-06T03:15:19.812 INFO:teuthology.orchestra.run.smithi050.stdout:Ceph Dashboard is now available at: 2024-06-06T03:15:19.813 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:15:19.813 INFO:teuthology.orchestra.run.smithi050.stdout: URL: https://smithi050.front.sepia.ceph.com:8443/ 2024-06-06T03:15:19.813 INFO:teuthology.orchestra.run.smithi050.stdout: User: admin 2024-06-06T03:15:19.813 INFO:teuthology.orchestra.run.smithi050.stdout: Password: gchzeyazfh 2024-06-06T03:15:19.813 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:15:19.813 INFO:teuthology.orchestra.run.smithi050.stdout:Saving cluster configuration to /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/config directory 2024-06-06T03:15:19.813 INFO:teuthology.orchestra.run.smithi050.stdout:Enabling autotune for osd_memory_target 2024-06-06T03:15:20.452 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:20 smithi050 ceph-mon[32421]: mgrmap e13: x(active, since 6s) 2024-06-06T03:15:21.004 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.237+0000 7f99476c4700 1 Processor -- start 2024-06-06T03:15:21.009 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.238+0000 7f99476c4700 1 -- start start 2024-06-06T03:15:21.009 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.238+0000 7f99476c4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9940107db0 0x7f99401081d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:21.009 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.238+0000 7f99476c4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f99401087a0 con 0x7f9940107db0 2024-06-06T03:15:21.009 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.238+0000 7f9945460700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9940107db0 0x7f99401081d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:21.009 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.238+0000 7f9945460700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9940107db0 0x7f99401081d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42446/0 (socket says 172.21.15.50:42446) 2024-06-06T03:15:21.009 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.238+0000 7f9945460700 1 -- 172.21.15.50:0/30761686 learned_addr learned my addr 172.21.15.50:0/30761686 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:15:21.009 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.238+0000 7f9945460700 1 -- 172.21.15.50:0/30761686 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9940108f60 con 0x7f9940107db0 2024-06-06T03:15:21.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.238+0000 7f9945460700 1 --2- 172.21.15.50:0/30761686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9940107db0 0x7f99401081d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f993c0098a0 tx=0x7f993c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d7311c0256e6cb server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:21.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.239+0000 7f9937fff700 1 -- 172.21.15.50:0/30761686 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f993c004160 con 0x7f9940107db0 2024-06-06T03:15:21.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.239+0000 7f9937fff700 1 -- 172.21.15.50:0/30761686 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f993c004300 con 0x7f9940107db0 2024-06-06T03:15:21.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.239+0000 7f9937fff700 1 -- 172.21.15.50:0/30761686 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f993c011a50 con 0x7f9940107db0 2024-06-06T03:15:21.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.239+0000 7f99476c4700 1 -- 172.21.15.50:0/30761686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9940107db0 msgr2=0x7f99401081d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:21.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.239+0000 7f99476c4700 1 --2- 172.21.15.50:0/30761686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9940107db0 0x7f99401081d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f993c0098a0 tx=0x7f993c009bb0 comp rx=0 tx=0).stop 2024-06-06T03:15:21.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.239+0000 7f99476c4700 1 -- 172.21.15.50:0/30761686 shutdown_connections 2024-06-06T03:15:21.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.239+0000 7f99476c4700 1 --2- 172.21.15.50:0/30761686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9940107db0 0x7f99401081d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:21.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.239+0000 7f99476c4700 1 -- 172.21.15.50:0/30761686 >> 172.21.15.50:0/30761686 conn(0x7f9940103330 msgr2=0x7f9940105790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:21.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.239+0000 7f99476c4700 1 -- 172.21.15.50:0/30761686 shutdown_connections 2024-06-06T03:15:21.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.239+0000 7f99476c4700 1 -- 172.21.15.50:0/30761686 wait complete. 2024-06-06T03:15:21.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.240+0000 7f99476c4700 1 Processor -- start 2024-06-06T03:15:21.010 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.240+0000 7f99476c4700 1 -- start start 2024-06-06T03:15:21.011 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.240+0000 7f99476c4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9940107db0 0x7f994007db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:21.011 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.240+0000 7f99476c4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f994010c310 con 0x7f9940107db0 2024-06-06T03:15:21.011 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.240+0000 7f9945460700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9940107db0 0x7f994007db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:21.011 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.240+0000 7f9945460700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9940107db0 0x7f994007db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42450/0 (socket says 172.21.15.50:42450) 2024-06-06T03:15:21.011 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.240+0000 7f9945460700 1 -- 172.21.15.50:0/1848649581 learned_addr learned my addr 172.21.15.50:0/1848649581 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:15:21.011 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.241+0000 7f9945460700 1 -- 172.21.15.50:0/1848649581 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f994007e0a0 con 0x7f9940107db0 2024-06-06T03:15:21.011 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.241+0000 7f9945460700 1 --2- 172.21.15.50:0/1848649581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9940107db0 0x7f994007db60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f993c006b20 tx=0x7f993c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:21.011 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.241+0000 7f99367fc700 1 -- 172.21.15.50:0/1848649581 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f993c0039e0 con 0x7f9940107db0 2024-06-06T03:15:21.011 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.241+0000 7f99367fc700 1 -- 172.21.15.50:0/1848649581 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f993c01a8e0 con 0x7f9940107db0 2024-06-06T03:15:21.011 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.241+0000 7f99476c4700 1 -- 172.21.15.50:0/1848649581 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f994007c290 con 0x7f9940107db0 2024-06-06T03:15:21.011 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.241+0000 7f99367fc700 1 -- 172.21.15.50:0/1848649581 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f993c0247e0 con 0x7f9940107db0 2024-06-06T03:15:21.011 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.241+0000 7f99476c4700 1 -- 172.21.15.50:0/1848649581 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f994007c7d0 con 0x7f9940107db0 2024-06-06T03:15:21.011 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.242+0000 7f99367fc700 1 -- 172.21.15.50:0/1848649581 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f993c022020 con 0x7f9940107db0 2024-06-06T03:15:21.012 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.242+0000 7f99476c4700 1 -- 172.21.15.50:0/1848649581 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9940063af0 con 0x7f9940107db0 2024-06-06T03:15:21.012 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.242+0000 7f99367fc700 1 --2- 172.21.15.50:0/1848649581 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f992c039190 0x7f992c03b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:21.012 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.242+0000 7f99367fc700 1 -- 172.21.15.50:0/1848649581 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f993c04d620 con 0x7f9940107db0 2024-06-06T03:15:21.012 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.242+0000 7f9944c5f700 1 --2- 172.21.15.50:0/1848649581 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f992c039190 0x7f992c03b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:21.012 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.243+0000 7f9944c5f700 1 --2- 172.21.15.50:0/1848649581 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f992c039190 0x7f992c03b650 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9930006fd0 tx=0x7f9930006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:21.012 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.248+0000 7f99367fc700 1 -- 172.21.15.50:0/1848649581 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f993c0212c0 con 0x7f9940107db0 2024-06-06T03:15:21.012 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.453+0000 7f99476c4700 1 -- 172.21.15.50:0/1848649581 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7f994007ca50 con 0x7f9940107db0 2024-06-06T03:15:21.012 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.454+0000 7f99367fc700 1 -- 172.21.15.50:0/1848649581 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7f993c02d3f0 con 0x7f9940107db0 2024-06-06T03:15:21.012 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.456+0000 7f99476c4700 1 -- 172.21.15.50:0/1848649581 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f992c039190 msgr2=0x7f992c03b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:21.012 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.456+0000 7f99476c4700 1 --2- 172.21.15.50:0/1848649581 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f992c039190 0x7f992c03b650 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9930006fd0 tx=0x7f9930006e40 comp rx=0 tx=0).stop 2024-06-06T03:15:21.012 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.456+0000 7f99476c4700 1 -- 172.21.15.50:0/1848649581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9940107db0 msgr2=0x7f994007db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:21.012 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.456+0000 7f99476c4700 1 --2- 172.21.15.50:0/1848649581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9940107db0 0x7f994007db60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f993c006b20 tx=0x7f993c011ad0 comp rx=0 tx=0).stop 2024-06-06T03:15:21.012 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.456+0000 7f99476c4700 1 -- 172.21.15.50:0/1848649581 shutdown_connections 2024-06-06T03:15:21.013 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.456+0000 7f99476c4700 1 --2- 172.21.15.50:0/1848649581 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f992c039190 0x7f992c03b650 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:21.013 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.456+0000 7f99476c4700 1 --2- 172.21.15.50:0/1848649581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9940107db0 0x7f994007db60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:21.013 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.456+0000 7f99476c4700 1 -- 172.21.15.50:0/1848649581 >> 172.21.15.50:0/1848649581 conn(0x7f9940103330 msgr2=0x7f9940103df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:21.013 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.456+0000 7f99476c4700 1 -- 172.21.15.50:0/1848649581 shutdown_connections 2024-06-06T03:15:21.013 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:20.456+0000 7f99476c4700 1 -- 172.21.15.50:0/1848649581 wait complete. 2024-06-06T03:15:22.359 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.387+0000 7fc31d711700 1 Processor -- start 2024-06-06T03:15:22.359 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.387+0000 7fc31d711700 1 -- start start 2024-06-06T03:15:22.359 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.387+0000 7fc31d711700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc318108800 0x7fc31810abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:22.359 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.387+0000 7fc31d711700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc31807be80 con 0x7fc318108800 2024-06-06T03:15:22.360 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.388+0000 7fc316ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc318108800 0x7fc31810abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:22.360 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.388+0000 7fc316ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc318108800 0x7fc31810abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42456/0 (socket says 172.21.15.50:42456) 2024-06-06T03:15:22.360 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.388+0000 7fc316ffd700 1 -- 172.21.15.50:0/2762826653 learned_addr learned my addr 172.21.15.50:0/2762826653 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:15:22.360 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.388+0000 7fc316ffd700 1 -- 172.21.15.50:0/2762826653 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc31810b130 con 0x7fc318108800 2024-06-06T03:15:22.360 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.388+0000 7fc316ffd700 1 --2- 172.21.15.50:0/2762826653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc318108800 0x7fc31810abf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc308009e80 tx=0x7fc30800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed2b8585d3ebf026 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:22.360 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.388+0000 7fc3167fc700 1 -- 172.21.15.50:0/2762826653 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc308017070 con 0x7fc318108800 2024-06-06T03:15:22.360 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.389+0000 7fc3167fc700 1 -- 172.21.15.50:0/2762826653 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc30800b8c0 con 0x7fc318108800 2024-06-06T03:15:22.360 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.389+0000 7fc3167fc700 1 -- 172.21.15.50:0/2762826653 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc308004490 con 0x7fc318108800 2024-06-06T03:15:22.360 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.389+0000 7fc31d711700 1 -- 172.21.15.50:0/2762826653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc318108800 msgr2=0x7fc31810abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:22.360 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.389+0000 7fc31d711700 1 --2- 172.21.15.50:0/2762826653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc318108800 0x7fc31810abf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc308009e80 tx=0x7fc30800b330 comp rx=0 tx=0).stop 2024-06-06T03:15:22.360 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.389+0000 7fc31d711700 1 -- 172.21.15.50:0/2762826653 shutdown_connections 2024-06-06T03:15:22.361 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.389+0000 7fc31d711700 1 --2- 172.21.15.50:0/2762826653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc318108800 0x7fc31810abf0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:22.361 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.389+0000 7fc31d711700 1 -- 172.21.15.50:0/2762826653 >> 172.21.15.50:0/2762826653 conn(0x7fc318102290 msgr2=0x7fc3181046b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:22.361 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.389+0000 7fc31d711700 1 -- 172.21.15.50:0/2762826653 shutdown_connections 2024-06-06T03:15:22.361 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.389+0000 7fc31d711700 1 -- 172.21.15.50:0/2762826653 wait complete. 2024-06-06T03:15:22.361 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.390+0000 7fc31d711700 1 Processor -- start 2024-06-06T03:15:22.361 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.390+0000 7fc31d711700 1 -- start start 2024-06-06T03:15:22.361 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.390+0000 7fc31d711700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc318108800 0x7fc31819bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:22.361 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.390+0000 7fc31d711700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc31810c130 con 0x7fc318108800 2024-06-06T03:15:22.361 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.390+0000 7fc316ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc318108800 0x7fc31819bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:22.361 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.390+0000 7fc316ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc318108800 0x7fc31819bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42464/0 (socket says 172.21.15.50:42464) 2024-06-06T03:15:22.361 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.390+0000 7fc316ffd700 1 -- 172.21.15.50:0/1713433439 learned_addr learned my addr 172.21.15.50:0/1713433439 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:15:22.361 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.390+0000 7fc316ffd700 1 -- 172.21.15.50:0/1713433439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc31819c100 con 0x7fc318108800 2024-06-06T03:15:22.361 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.391+0000 7fc316ffd700 1 --2- 172.21.15.50:0/1713433439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc318108800 0x7fc31819bbc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc308004220 tx=0x7fc308003d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:22.362 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.391+0000 7fc314ff9700 1 -- 172.21.15.50:0/1713433439 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc308020020 con 0x7fc318108800 2024-06-06T03:15:22.362 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.391+0000 7fc314ff9700 1 -- 172.21.15.50:0/1713433439 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc30800bba0 con 0x7fc318108800 2024-06-06T03:15:22.362 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.391+0000 7fc31d711700 1 -- 172.21.15.50:0/1713433439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc31819c390 con 0x7fc318108800 2024-06-06T03:15:22.362 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.391+0000 7fc314ff9700 1 -- 172.21.15.50:0/1713433439 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc308017040 con 0x7fc318108800 2024-06-06T03:15:22.362 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.391+0000 7fc31d711700 1 -- 172.21.15.50:0/1713433439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc31819f080 con 0x7fc318108800 2024-06-06T03:15:22.362 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.392+0000 7fc314ff9700 1 -- 172.21.15.50:0/1713433439 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fc308023020 con 0x7fc318108800 2024-06-06T03:15:22.362 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.392+0000 7fc31d711700 1 -- 172.21.15.50:0/1713433439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc318063af0 con 0x7fc318108800 2024-06-06T03:15:22.362 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.392+0000 7fc314ff9700 1 --2- 172.21.15.50:0/1713433439 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc304039140 0x7fc30403b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:22.362 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.392+0000 7fc314ff9700 1 -- 172.21.15.50:0/1713433439 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc30800f050 con 0x7fc318108800 2024-06-06T03:15:22.362 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.392+0000 7fc30e7fc700 1 --2- 172.21.15.50:0/1713433439 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc304039140 0x7fc30403b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:22.362 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.392+0000 7fc30e7fc700 1 --2- 172.21.15.50:0/1713433439 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc304039140 0x7fc30403b600 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc300006fd0 tx=0x7fc300006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:22.362 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.397+0000 7fc314ff9700 1 -- 172.21.15.50:0/1713433439 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc30802a020 con 0x7fc318108800 2024-06-06T03:15:22.363 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.716+0000 7fc31d711700 1 -- 172.21.15.50:0/1713433439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fc31819f250 con 0x7fc318108800 2024-06-06T03:15:22.363 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.718+0000 7fc314ff9700 1 -- 172.21.15.50:0/1713433439 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7fc30800bd50 con 0x7fc318108800 2024-06-06T03:15:22.363 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.721+0000 7fc31d711700 1 -- 172.21.15.50:0/1713433439 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc304039140 msgr2=0x7fc30403b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:22.363 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.721+0000 7fc31d711700 1 --2- 172.21.15.50:0/1713433439 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc304039140 0x7fc30403b600 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc300006fd0 tx=0x7fc300006e40 comp rx=0 tx=0).stop 2024-06-06T03:15:22.363 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.721+0000 7fc31d711700 1 -- 172.21.15.50:0/1713433439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc318108800 msgr2=0x7fc31819bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:22.363 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.721+0000 7fc31d711700 1 --2- 172.21.15.50:0/1713433439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc318108800 0x7fc31819bbc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc308004220 tx=0x7fc308003d70 comp rx=0 tx=0).stop 2024-06-06T03:15:22.363 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.722+0000 7fc31d711700 1 -- 172.21.15.50:0/1713433439 shutdown_connections 2024-06-06T03:15:22.363 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.722+0000 7fc31d711700 1 --2- 172.21.15.50:0/1713433439 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc304039140 0x7fc30403b600 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:22.363 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.722+0000 7fc31d711700 1 --2- 172.21.15.50:0/1713433439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc318108800 0x7fc31819bbc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:22.363 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.722+0000 7fc31d711700 1 -- 172.21.15.50:0/1713433439 >> 172.21.15.50:0/1713433439 conn(0x7fc318102290 msgr2=0x7fc318102d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:22.363 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.722+0000 7fc31d711700 1 -- 172.21.15.50:0/1713433439 shutdown_connections 2024-06-06T03:15:22.363 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-06-06T03:15:21.722+0000 7fc31d711700 1 -- 172.21.15.50:0/1713433439 wait complete. 2024-06-06T03:15:22.363 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-06-06T03:15:22.363 INFO:teuthology.orchestra.run.smithi050.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-06-06T03:15:22.364 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:15:22.364 INFO:teuthology.orchestra.run.smithi050.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-06-06T03:15:22.364 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:15:22.364 INFO:teuthology.orchestra.run.smithi050.stdout:Or, if you are only running a single cluster on this host: 2024-06-06T03:15:22.364 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:15:22.364 INFO:teuthology.orchestra.run.smithi050.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-06-06T03:15:22.364 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:15:22.364 INFO:teuthology.orchestra.run.smithi050.stdout:Please consider enabling telemetry to help improve Ceph: 2024-06-06T03:15:22.364 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:15:22.364 INFO:teuthology.orchestra.run.smithi050.stdout: ceph telemetry on 2024-06-06T03:15:22.364 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:15:22.364 INFO:teuthology.orchestra.run.smithi050.stdout:For more information see: 2024-06-06T03:15:22.364 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:15:22.364 INFO:teuthology.orchestra.run.smithi050.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-06-06T03:15:22.365 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:15:22.365 INFO:teuthology.orchestra.run.smithi050.stdout:Bootstrap complete. 2024-06-06T03:15:22.401 INFO:tasks.cephadm:Fetching config... 2024-06-06T03:15:22.401 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-06-06T03:15:22.402 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-06-06T03:15:22.420 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-06-06T03:15:22.420 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-06-06T03:15:22.420 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-06-06T03:15:22.477 INFO:tasks.cephadm:Fetching mon keyring... 2024-06-06T03:15:22.477 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-06-06T03:15:22.477 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/keyring of=/dev/stdout 2024-06-06T03:15:22.545 INFO:tasks.cephadm:Fetching pub ssh key... 2024-06-06T03:15:22.546 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-06-06T03:15:22.546 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-06-06T03:15:22.601 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-06-06T03:15:22.602 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDW7H6b037ZzNSTM8JSKFIyR0lJ/p6CWiLbHhfQ7QkKWpXcQrSnG3AYaQXNBFsWVVp7HaxWV0zfxfRUQinpuqmyw5rE6D/SpB9A+wLRiAl7+ovZq3DGBjLlG7TKaBgWCSt0jRdvM6hnKzD5oIhSI18pMCwaFpmUBMrAgZpAt8kBKymTF3h5DimAZMZNiP5ji6Gc4lrgw2AHUunlpIILrvQ7A+tJKsVkD3yUvZWHq7YRN9ilX1GqfXKw9POtuiusMCyLcZqMsfcDkIKBLWw/RWJGH0Bc8pw2+XpXifXy72dTVLM/Pnxv5qyM0z0Kz2YwWGcAZ7pFEqSTObLbEafg01O2S/X0fp0sdB4WNtzaa/GXfyQU74F5vvU1gED0iugVUYnqaIbtPE3f9cmi7Oda6TemkQevbLvS+ZD9En5jfMWr+PlSxu0Ced0gnjVaY8q26qlqoz/LobOb20i96fOfKRsxj4eYwC8JTapYW/Rdn4qai79S0ccK079QgFQYreyyoz8= ceph-b6263b26-23b2-11ef-bc9b-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-06-06T03:15:22.686 INFO:teuthology.orchestra.run.smithi050.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDW7H6b037ZzNSTM8JSKFIyR0lJ/p6CWiLbHhfQ7QkKWpXcQrSnG3AYaQXNBFsWVVp7HaxWV0zfxfRUQinpuqmyw5rE6D/SpB9A+wLRiAl7+ovZq3DGBjLlG7TKaBgWCSt0jRdvM6hnKzD5oIhSI18pMCwaFpmUBMrAgZpAt8kBKymTF3h5DimAZMZNiP5ji6Gc4lrgw2AHUunlpIILrvQ7A+tJKsVkD3yUvZWHq7YRN9ilX1GqfXKw9POtuiusMCyLcZqMsfcDkIKBLWw/RWJGH0Bc8pw2+XpXifXy72dTVLM/Pnxv5qyM0z0Kz2YwWGcAZ7pFEqSTObLbEafg01O2S/X0fp0sdB4WNtzaa/GXfyQU74F5vvU1gED0iugVUYnqaIbtPE3f9cmi7Oda6TemkQevbLvS+ZD9En5jfMWr+PlSxu0Ced0gnjVaY8q26qlqoz/LobOb20i96fOfKRsxj4eYwC8JTapYW/Rdn4qai79S0ccK079QgFQYreyyoz8= ceph-b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:15:22.699 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDW7H6b037ZzNSTM8JSKFIyR0lJ/p6CWiLbHhfQ7QkKWpXcQrSnG3AYaQXNBFsWVVp7HaxWV0zfxfRUQinpuqmyw5rE6D/SpB9A+wLRiAl7+ovZq3DGBjLlG7TKaBgWCSt0jRdvM6hnKzD5oIhSI18pMCwaFpmUBMrAgZpAt8kBKymTF3h5DimAZMZNiP5ji6Gc4lrgw2AHUunlpIILrvQ7A+tJKsVkD3yUvZWHq7YRN9ilX1GqfXKw9POtuiusMCyLcZqMsfcDkIKBLWw/RWJGH0Bc8pw2+XpXifXy72dTVLM/Pnxv5qyM0z0Kz2YwWGcAZ7pFEqSTObLbEafg01O2S/X0fp0sdB4WNtzaa/GXfyQU74F5vvU1gED0iugVUYnqaIbtPE3f9cmi7Oda6TemkQevbLvS+ZD9En5jfMWr+PlSxu0Ced0gnjVaY8q26qlqoz/LobOb20i96fOfKRsxj4eYwC8JTapYW/Rdn4qai79S0ccK079QgFQYreyyoz8= ceph-b6263b26-23b2-11ef-bc9b-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-06-06T03:15:22.739 INFO:teuthology.orchestra.run.smithi079.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDW7H6b037ZzNSTM8JSKFIyR0lJ/p6CWiLbHhfQ7QkKWpXcQrSnG3AYaQXNBFsWVVp7HaxWV0zfxfRUQinpuqmyw5rE6D/SpB9A+wLRiAl7+ovZq3DGBjLlG7TKaBgWCSt0jRdvM6hnKzD5oIhSI18pMCwaFpmUBMrAgZpAt8kBKymTF3h5DimAZMZNiP5ji6Gc4lrgw2AHUunlpIILrvQ7A+tJKsVkD3yUvZWHq7YRN9ilX1GqfXKw9POtuiusMCyLcZqMsfcDkIKBLWw/RWJGH0Bc8pw2+XpXifXy72dTVLM/Pnxv5qyM0z0Kz2YwWGcAZ7pFEqSTObLbEafg01O2S/X0fp0sdB4WNtzaa/GXfyQU74F5vvU1gED0iugVUYnqaIbtPE3f9cmi7Oda6TemkQevbLvS+ZD9En5jfMWr+PlSxu0Ced0gnjVaY8q26qlqoz/LobOb20i96fOfKRsxj4eYwC8JTapYW/Rdn4qai79S0ccK079QgFQYreyyoz8= ceph-b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:15:22.752 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDW7H6b037ZzNSTM8JSKFIyR0lJ/p6CWiLbHhfQ7QkKWpXcQrSnG3AYaQXNBFsWVVp7HaxWV0zfxfRUQinpuqmyw5rE6D/SpB9A+wLRiAl7+ovZq3DGBjLlG7TKaBgWCSt0jRdvM6hnKzD5oIhSI18pMCwaFpmUBMrAgZpAt8kBKymTF3h5DimAZMZNiP5ji6Gc4lrgw2AHUunlpIILrvQ7A+tJKsVkD3yUvZWHq7YRN9ilX1GqfXKw9POtuiusMCyLcZqMsfcDkIKBLWw/RWJGH0Bc8pw2+XpXifXy72dTVLM/Pnxv5qyM0z0Kz2YwWGcAZ7pFEqSTObLbEafg01O2S/X0fp0sdB4WNtzaa/GXfyQU74F5vvU1gED0iugVUYnqaIbtPE3f9cmi7Oda6TemkQevbLvS+ZD9En5jfMWr+PlSxu0Ced0gnjVaY8q26qlqoz/LobOb20i96fOfKRsxj4eYwC8JTapYW/Rdn4qai79S0ccK079QgFQYreyyoz8= ceph-b6263b26-23b2-11ef-bc9b-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-06-06T03:15:22.792 INFO:teuthology.orchestra.run.smithi122.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDW7H6b037ZzNSTM8JSKFIyR0lJ/p6CWiLbHhfQ7QkKWpXcQrSnG3AYaQXNBFsWVVp7HaxWV0zfxfRUQinpuqmyw5rE6D/SpB9A+wLRiAl7+ovZq3DGBjLlG7TKaBgWCSt0jRdvM6hnKzD5oIhSI18pMCwaFpmUBMrAgZpAt8kBKymTF3h5DimAZMZNiP5ji6Gc4lrgw2AHUunlpIILrvQ7A+tJKsVkD3yUvZWHq7YRN9ilX1GqfXKw9POtuiusMCyLcZqMsfcDkIKBLWw/RWJGH0Bc8pw2+XpXifXy72dTVLM/Pnxv5qyM0z0Kz2YwWGcAZ7pFEqSTObLbEafg01O2S/X0fp0sdB4WNtzaa/GXfyQU74F5vvU1gED0iugVUYnqaIbtPE3f9cmi7Oda6TemkQevbLvS+ZD9En5jfMWr+PlSxu0Ced0gnjVaY8q26qlqoz/LobOb20i96fOfKRsxj4eYwC8JTapYW/Rdn4qai79S0ccK079QgFQYreyyoz8= ceph-b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:15:22.806 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-06-06T03:15:23.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:22 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1713433439' entity='client.admin' 2024-06-06T03:15:23.065 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:15:25.337 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:25 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:25.337 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:25 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:25.337 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:25 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi050", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:15:25.337 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:25 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:25.337 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:25 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:15:25.337 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:25 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:25.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.555+0000 7f3541bb5700 1 -- 172.21.15.50:0/378090980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f353c101ea0 msgr2=0x7f353c1022c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:25.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.555+0000 7f3541bb5700 1 --2- 172.21.15.50:0/378090980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f353c101ea0 0x7f353c1022c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f352c009910 tx=0x7f352c009c20 comp rx=0 tx=0).stop 2024-06-06T03:15:25.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.555+0000 7f3541bb5700 1 -- 172.21.15.50:0/378090980 shutdown_connections 2024-06-06T03:15:25.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.555+0000 7f3541bb5700 1 --2- 172.21.15.50:0/378090980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f353c101ea0 0x7f353c1022c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:25.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.555+0000 7f3541bb5700 1 -- 172.21.15.50:0/378090980 >> 172.21.15.50:0/378090980 conn(0x7f353c0fd490 msgr2=0x7f353c0ff8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:25.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.555+0000 7f3541bb5700 1 -- 172.21.15.50:0/378090980 shutdown_connections 2024-06-06T03:15:25.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.555+0000 7f3541bb5700 1 -- 172.21.15.50:0/378090980 wait complete. 2024-06-06T03:15:25.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.556+0000 7f3541bb5700 1 Processor -- start 2024-06-06T03:15:25.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.556+0000 7f3541bb5700 1 -- start start 2024-06-06T03:15:25.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.556+0000 7f3541bb5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f353c101ea0 0x7f353c076150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:25.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.556+0000 7f3541bb5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f353c107da0 con 0x7f353c101ea0 2024-06-06T03:15:25.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.556+0000 7f353b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f353c101ea0 0x7f353c076150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:25.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.556+0000 7f353b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f353c101ea0 0x7f353c076150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42484/0 (socket says 172.21.15.50:42484) 2024-06-06T03:15:25.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.556+0000 7f353b7fe700 1 -- 172.21.15.50:0/2064779691 learned_addr learned my addr 172.21.15.50:0/2064779691 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:15:25.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.557+0000 7f353b7fe700 1 -- 172.21.15.50:0/2064779691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f353c076690 con 0x7f353c101ea0 2024-06-06T03:15:25.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.557+0000 7f353b7fe700 1 --2- 172.21.15.50:0/2064779691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f353c101ea0 0x7f353c076150 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f352c005800 tx=0x7f352c009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:25.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.557+0000 7f35397fa700 1 -- 172.21.15.50:0/2064779691 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f352c027070 con 0x7f353c101ea0 2024-06-06T03:15:25.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.557+0000 7f35397fa700 1 -- 172.21.15.50:0/2064779691 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f352c00be10 con 0x7f353c101ea0 2024-06-06T03:15:25.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.557+0000 7f35397fa700 1 -- 172.21.15.50:0/2064779691 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f352c00f460 con 0x7f353c101ea0 2024-06-06T03:15:25.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.557+0000 7f3541bb5700 1 -- 172.21.15.50:0/2064779691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f353c074880 con 0x7f353c101ea0 2024-06-06T03:15:25.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.557+0000 7f3541bb5700 1 -- 172.21.15.50:0/2064779691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f353c074dc0 con 0x7f353c101ea0 2024-06-06T03:15:25.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.558+0000 7f35397fa700 1 -- 172.21.15.50:0/2064779691 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f352c02a070 con 0x7f353c101ea0 2024-06-06T03:15:25.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.558+0000 7f3541bb5700 1 -- 172.21.15.50:0/2064779691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f353c108520 con 0x7f353c101ea0 2024-06-06T03:15:25.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.558+0000 7f35397fa700 1 --2- 172.21.15.50:0/2064779691 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f3528039150 0x7f352803b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:25.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.558+0000 7f35397fa700 1 -- 172.21.15.50:0/2064779691 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f352c01e030 con 0x7f353c101ea0 2024-06-06T03:15:25.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.558+0000 7f3532ffd700 1 --2- 172.21.15.50:0/2064779691 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f3528039150 0x7f352803b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:25.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.559+0000 7f3532ffd700 1 --2- 172.21.15.50:0/2064779691 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f3528039150 0x7f352803b610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3524006fd0 tx=0x7f3524006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:25.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.564+0000 7f35397fa700 1 -- 172.21.15.50:0/2064779691 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f352c013070 con 0x7f353c101ea0 2024-06-06T03:15:25.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.772+0000 7f3541bb5700 1 -- 172.21.15.50:0/2064779691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f353c190820 con 0x7f353c101ea0 2024-06-06T03:15:25.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.774+0000 7f35397fa700 1 -- 172.21.15.50:0/2064779691 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f352c031020 con 0x7f353c101ea0 2024-06-06T03:15:25.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.777+0000 7f3541bb5700 1 -- 172.21.15.50:0/2064779691 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f3528039150 msgr2=0x7f352803b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:25.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.777+0000 7f3541bb5700 1 --2- 172.21.15.50:0/2064779691 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f3528039150 0x7f352803b610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3524006fd0 tx=0x7f3524006e40 comp rx=0 tx=0).stop 2024-06-06T03:15:25.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.777+0000 7f3541bb5700 1 -- 172.21.15.50:0/2064779691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f353c101ea0 msgr2=0x7f353c076150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:25.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.777+0000 7f3541bb5700 1 --2- 172.21.15.50:0/2064779691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f353c101ea0 0x7f353c076150 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f352c005800 tx=0x7f352c009f60 comp rx=0 tx=0).stop 2024-06-06T03:15:25.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.777+0000 7f3541bb5700 1 -- 172.21.15.50:0/2064779691 shutdown_connections 2024-06-06T03:15:25.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.777+0000 7f3541bb5700 1 --2- 172.21.15.50:0/2064779691 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f3528039150 0x7f352803b610 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:25.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.777+0000 7f3541bb5700 1 --2- 172.21.15.50:0/2064779691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f353c101ea0 0x7f353c076150 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:25.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.777+0000 7f3541bb5700 1 -- 172.21.15.50:0/2064779691 >> 172.21.15.50:0/2064779691 conn(0x7f353c0fd490 msgr2=0x7f353c0fdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:25.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.777+0000 7f3541bb5700 1 -- 172.21.15.50:0/2064779691 shutdown_connections 2024-06-06T03:15:25.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:25.777+0000 7f3541bb5700 1 -- 172.21.15.50:0/2064779691 wait complete. 2024-06-06T03:15:26.987 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:26 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/2064779691' entity='client.admin' 2024-06-06T03:15:26.987 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:26 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:15:26.987 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:26 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:27.018 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-06-06T03:15:27.018 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-06-06T03:15:27.268 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:15:28.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.710+0000 7f7a3c648700 1 -- 172.21.15.50:0/3263422136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a341029d0 msgr2=0x7f7a34104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:28.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.710+0000 7f7a3c648700 1 --2- 172.21.15.50:0/3263422136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a341029d0 0x7f7a34104dc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7a30009910 tx=0x7f7a30009c20 comp rx=0 tx=0).stop 2024-06-06T03:15:28.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.710+0000 7f7a3c648700 1 -- 172.21.15.50:0/3263422136 shutdown_connections 2024-06-06T03:15:28.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.710+0000 7f7a3c648700 1 --2- 172.21.15.50:0/3263422136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a341029d0 0x7f7a34104dc0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:28.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.710+0000 7f7a3c648700 1 -- 172.21.15.50:0/3263422136 >> 172.21.15.50:0/3263422136 conn(0x7f7a340fc380 msgr2=0x7f7a340fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:28.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.710+0000 7f7a3c648700 1 -- 172.21.15.50:0/3263422136 shutdown_connections 2024-06-06T03:15:28.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.710+0000 7f7a3c648700 1 -- 172.21.15.50:0/3263422136 wait complete. 2024-06-06T03:15:28.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.711+0000 7f7a3c648700 1 Processor -- start 2024-06-06T03:15:28.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.711+0000 7f7a3c648700 1 -- start start 2024-06-06T03:15:28.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.711+0000 7f7a3c648700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a341029d0 0x7f7a34197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:28.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.711+0000 7f7a3c648700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7a34107e30 con 0x7f7a341029d0 2024-06-06T03:15:28.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.711+0000 7f7a3a3e4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a341029d0 0x7f7a34197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:28.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.711+0000 7f7a3a3e4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a341029d0 0x7f7a34197570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39284/0 (socket says 172.21.15.50:39284) 2024-06-06T03:15:28.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.711+0000 7f7a3a3e4700 1 -- 172.21.15.50:0/380254352 learned_addr learned my addr 172.21.15.50:0/380254352 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:15:28.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.712+0000 7f7a3a3e4700 1 -- 172.21.15.50:0/380254352 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a34197ab0 con 0x7f7a341029d0 2024-06-06T03:15:28.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.712+0000 7f7a3a3e4700 1 --2- 172.21.15.50:0/380254352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a341029d0 0x7f7a34197570 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7a30005b40 tx=0x7f7a30004f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:28.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.712+0000 7f7a2b7fe700 1 -- 172.21.15.50:0/380254352 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a30027070 con 0x7f7a341029d0 2024-06-06T03:15:28.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.712+0000 7f7a2b7fe700 1 -- 172.21.15.50:0/380254352 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7a3000be10 con 0x7f7a341029d0 2024-06-06T03:15:28.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.712+0000 7f7a3c648700 1 -- 172.21.15.50:0/380254352 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a34197d40 con 0x7f7a341029d0 2024-06-06T03:15:28.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.712+0000 7f7a2b7fe700 1 -- 172.21.15.50:0/380254352 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a30022d70 con 0x7f7a341029d0 2024-06-06T03:15:28.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.712+0000 7f7a3c648700 1 -- 172.21.15.50:0/380254352 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a3419aa30 con 0x7f7a341029d0 2024-06-06T03:15:28.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.713+0000 7f7a2b7fe700 1 -- 172.21.15.50:0/380254352 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f7a3002a070 con 0x7f7a341029d0 2024-06-06T03:15:28.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.713+0000 7f7a3c648700 1 -- 172.21.15.50:0/380254352 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a341085b0 con 0x7f7a341029d0 2024-06-06T03:15:28.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.713+0000 7f7a2b7fe700 1 --2- 172.21.15.50:0/380254352 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7a20039150 0x7f7a2003b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:28.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.713+0000 7f7a2b7fe700 1 -- 172.21.15.50:0/380254352 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f7a3001e030 con 0x7f7a341029d0 2024-06-06T03:15:28.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.713+0000 7f7a39be3700 1 --2- 172.21.15.50:0/380254352 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7a20039150 0x7f7a2003b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:28.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.714+0000 7f7a39be3700 1 --2- 172.21.15.50:0/380254352 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7a20039150 0x7f7a2003b610 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7a24006fd0 tx=0x7f7a24006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:28.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.718+0000 7f7a2b7fe700 1 -- 172.21.15.50:0/380254352 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7a30013070 con 0x7f7a341029d0 2024-06-06T03:15:28.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.932+0000 7f7a3c648700 1 -- 172.21.15.50:0/380254352 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f7a3402ddb0 con 0x7f7a20039150 2024-06-06T03:15:28.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.935+0000 7f7a2b7fe700 1 -- 172.21.15.50:0/380254352 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7a3402ddb0 con 0x7f7a20039150 2024-06-06T03:15:28.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.938+0000 7f7a3c648700 1 -- 172.21.15.50:0/380254352 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7a20039150 msgr2=0x7f7a2003b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:28.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.938+0000 7f7a3c648700 1 --2- 172.21.15.50:0/380254352 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7a20039150 0x7f7a2003b610 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7a24006fd0 tx=0x7f7a24006e40 comp rx=0 tx=0).stop 2024-06-06T03:15:28.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.938+0000 7f7a3c648700 1 -- 172.21.15.50:0/380254352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a341029d0 msgr2=0x7f7a34197570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:28.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.938+0000 7f7a3c648700 1 --2- 172.21.15.50:0/380254352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a341029d0 0x7f7a34197570 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7a30005b40 tx=0x7f7a30004f80 comp rx=0 tx=0).stop 2024-06-06T03:15:28.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.938+0000 7f7a3c648700 1 -- 172.21.15.50:0/380254352 shutdown_connections 2024-06-06T03:15:28.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.938+0000 7f7a3c648700 1 --2- 172.21.15.50:0/380254352 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7a20039150 0x7f7a2003b610 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:28.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.938+0000 7f7a3c648700 1 --2- 172.21.15.50:0/380254352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a341029d0 0x7f7a34197570 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:28.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.938+0000 7f7a3c648700 1 -- 172.21.15.50:0/380254352 >> 172.21.15.50:0/380254352 conn(0x7f7a340fc380 msgr2=0x7f7a340fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:28.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.938+0000 7f7a3c648700 1 -- 172.21.15.50:0/380254352 shutdown_connections 2024-06-06T03:15:28.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:28.938+0000 7f7a3c648700 1 -- 172.21.15.50:0/380254352 wait complete. 2024-06-06T03:15:29.651 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi079 2024-06-06T03:15:29.651 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-06T03:15:29.651 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/etc/ceph/ceph.conf 2024-06-06T03:15:29.670 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-06T03:15:29.670 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-06T03:15:29.728 INFO:tasks.cephadm:Adding host smithi079 to orchestrator... 2024-06-06T03:15:29.728 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph orch host add smithi079 2024-06-06T03:15:29.981 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:15:30.218 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:29 smithi050 ceph-mon[32421]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:15:30.218 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:29 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:30.218 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:29 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:15:30.218 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:29 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:15:30.219 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:29 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:15:30.219 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:29 smithi050 ceph-mon[32421]: Updating smithi050:/etc/ceph/ceph.conf 2024-06-06T03:15:31.152 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:31 smithi050 ceph-mon[32421]: Updating smithi050:/var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T03:15:31.152 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:31 smithi050 ceph-mon[32421]: Updating smithi050:/etc/ceph/ceph.client.admin.keyring 2024-06-06T03:15:31.152 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:31 smithi050 ceph-mon[32421]: Updating smithi050:/var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-06T03:15:31.152 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:31 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:31.153 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:31 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:31.153 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:31 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:31.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:31.507+0000 7f7b2a55f700 1 -- 172.21.15.50:0/4230350283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b24101040 msgr2=0x7f7b24101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:31.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:31.507+0000 7f7b2a55f700 1 --2- 172.21.15.50:0/4230350283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b24101040 0x7f7b24101420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c00b0a0 tx=0x7f7b1c00b3b0 comp rx=0 tx=0).stop 2024-06-06T03:15:31.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:31.507+0000 7f7b2a55f700 1 -- 172.21.15.50:0/4230350283 shutdown_connections 2024-06-06T03:15:31.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:31.507+0000 7f7b2a55f700 1 --2- 172.21.15.50:0/4230350283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b24101040 0x7f7b24101420 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:31.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:31.507+0000 7f7b2a55f700 1 -- 172.21.15.50:0/4230350283 >> 172.21.15.50:0/4230350283 conn(0x7f7b240768f0 msgr2=0x7f7b24076d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:31.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:31.507+0000 7f7b2a55f700 1 -- 172.21.15.50:0/4230350283 shutdown_connections 2024-06-06T03:15:31.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:31.507+0000 7f7b2a55f700 1 -- 172.21.15.50:0/4230350283 wait complete. 2024-06-06T03:15:31.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:31.508+0000 7f7b2a55f700 1 Processor -- start 2024-06-06T03:15:31.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:31.508+0000 7f7b2a55f700 1 -- start start 2024-06-06T03:15:31.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:31.508+0000 7f7b2a55f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b24101040 0x7f7b2419d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:31.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:31.508+0000 7f7b2a55f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2410b270 con 0x7f7b24101040 2024-06-06T03:15:31.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:31.508+0000 7f7b23fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b24101040 0x7f7b2419d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:31.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:31.508+0000 7f7b23fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b24101040 0x7f7b2419d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39306/0 (socket says 172.21.15.50:39306) 2024-06-06T03:15:31.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:31.508+0000 7f7b23fff700 1 -- 172.21.15.50:0/1361302667 learned_addr learned my addr 172.21.15.50:0/1361302667 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:15:31.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:31.509+0000 7f7b23fff700 1 -- 172.21.15.50:0/1361302667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2419dae0 con 0x7f7b24101040 2024-06-06T03:15:31.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:31.509+0000 7f7b23fff700 1 --2- 172.21.15.50:0/1361302667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b24101040 0x7f7b2419d5a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0076a0 tx=0x7f7b1c003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:31.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:31.509+0000 7f7b217fa700 1 -- 172.21.15.50:0/1361302667 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b1c017040 con 0x7f7b24101040 2024-06-06T03:15:31.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:31.509+0000 7f7b217fa700 1 -- 172.21.15.50:0/1361302667 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7b1c022070 con 0x7f7b24101040 2024-06-06T03:15:31.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:31.509+0000 7f7b2a55f700 1 -- 172.21.15.50:0/1361302667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b2419dd70 con 0x7f7b24101040 2024-06-06T03:15:31.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:31.509+0000 7f7b217fa700 1 -- 172.21.15.50:0/1361302667 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b1c01d5e0 con 0x7f7b24101040 2024-06-06T03:15:31.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:31.509+0000 7f7b2a55f700 1 -- 172.21.15.50:0/1361302667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b241976c0 con 0x7f7b24101040 2024-06-06T03:15:31.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:31.510+0000 7f7b217fa700 1 -- 172.21.15.50:0/1361302667 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f7b1c01d8a0 con 0x7f7b24101040 2024-06-06T03:15:31.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:31.510+0000 7f7b2a55f700 1 -- 172.21.15.50:0/1361302667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b241024d0 con 0x7f7b24101040 2024-06-06T03:15:31.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:31.510+0000 7f7b217fa700 1 --2- 172.21.15.50:0/1361302667 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7b0c0390f0 0x7f7b0c03b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:31.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:31.510+0000 7f7b217fa700 1 -- 172.21.15.50:0/1361302667 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f7b1c00f050 con 0x7f7b24101040 2024-06-06T03:15:31.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:31.510+0000 7f7b237fe700 1 --2- 172.21.15.50:0/1361302667 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7b0c0390f0 0x7f7b0c03b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:31.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:31.511+0000 7f7b237fe700 1 --2- 172.21.15.50:0/1361302667 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7b0c0390f0 0x7f7b0c03b5b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7b18006fd0 tx=0x7f7b18006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:31.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:31.515+0000 7f7b217fa700 1 -- 172.21.15.50:0/1361302667 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7b1c025c00 con 0x7f7b24101040 2024-06-06T03:15:31.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:31.724+0000 7f7b2a55f700 1 -- 172.21.15.50:0/1361302667 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi079", "target": ["mon-mgr", ""]}) -- 0x7f7b24063b50 con 0x7f7b0c0390f0 2024-06-06T03:15:32.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:32 smithi050 ceph-mon[32421]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi079", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:15:33.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:33 smithi050 ceph-mon[32421]: Deploying cephadm binary to smithi079 2024-06-06T03:15:34.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:34 smithi050 ceph-mon[32421]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:15:36.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:36.006+0000 7f7b217fa700 1 -- 172.21.15.50:0/1361302667 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f7b24063b50 con 0x7f7b0c0390f0 2024-06-06T03:15:36.007 INFO:teuthology.orchestra.run.smithi050.stdout:Added host 'smithi079' with addr '172.21.15.79' 2024-06-06T03:15:36.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:36.008+0000 7f7b2a55f700 1 -- 172.21.15.50:0/1361302667 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7b0c0390f0 msgr2=0x7f7b0c03b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:36.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:36.008+0000 7f7b2a55f700 1 --2- 172.21.15.50:0/1361302667 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7b0c0390f0 0x7f7b0c03b5b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7b18006fd0 tx=0x7f7b18006e40 comp rx=0 tx=0).stop 2024-06-06T03:15:36.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:36.008+0000 7f7b2a55f700 1 -- 172.21.15.50:0/1361302667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b24101040 msgr2=0x7f7b2419d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:36.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:36.008+0000 7f7b2a55f700 1 --2- 172.21.15.50:0/1361302667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b24101040 0x7f7b2419d5a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0076a0 tx=0x7f7b1c003ce0 comp rx=0 tx=0).stop 2024-06-06T03:15:36.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:36.009+0000 7f7b2a55f700 1 -- 172.21.15.50:0/1361302667 shutdown_connections 2024-06-06T03:15:36.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:36.009+0000 7f7b2a55f700 1 --2- 172.21.15.50:0/1361302667 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7b0c0390f0 0x7f7b0c03b5b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:36.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:36.009+0000 7f7b2a55f700 1 --2- 172.21.15.50:0/1361302667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b24101040 0x7f7b2419d5a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:36.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:36.009+0000 7f7b2a55f700 1 -- 172.21.15.50:0/1361302667 >> 172.21.15.50:0/1361302667 conn(0x7f7b240768f0 msgr2=0x7f7b240698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:36.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:36.009+0000 7f7b2a55f700 1 -- 172.21.15.50:0/1361302667 shutdown_connections 2024-06-06T03:15:36.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:36.009+0000 7f7b2a55f700 1 -- 172.21.15.50:0/1361302667 wait complete. 2024-06-06T03:15:36.578 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph orch host ls --format=json 2024-06-06T03:15:36.829 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:15:37.213 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:37 smithi050 ceph-mon[32421]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:15:37.214 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:37 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:37.214 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:37 smithi050 ceph-mon[32421]: Added host smithi079 2024-06-06T03:15:37.214 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:37 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:15:37.214 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:37 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:38.235 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:38 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:38.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.251+0000 7f66aabc8700 1 -- 172.21.15.50:0/429570697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66a4101000 msgr2=0x7f66a41013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:38.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.251+0000 7f66aabc8700 1 --2- 172.21.15.50:0/429570697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66a4101000 0x7f66a41013e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6698009910 tx=0x7f6698009c20 comp rx=0 tx=0).stop 2024-06-06T03:15:38.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.251+0000 7f66aabc8700 1 -- 172.21.15.50:0/429570697 shutdown_connections 2024-06-06T03:15:38.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.251+0000 7f66aabc8700 1 --2- 172.21.15.50:0/429570697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66a4101000 0x7f66a41013e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:38.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.251+0000 7f66aabc8700 1 -- 172.21.15.50:0/429570697 >> 172.21.15.50:0/429570697 conn(0x7f66a40fc8b0 msgr2=0x7f66a40fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:38.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.251+0000 7f66aabc8700 1 -- 172.21.15.50:0/429570697 shutdown_connections 2024-06-06T03:15:38.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.251+0000 7f66aabc8700 1 -- 172.21.15.50:0/429570697 wait complete. 2024-06-06T03:15:38.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.251+0000 7f66aabc8700 1 Processor -- start 2024-06-06T03:15:38.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.251+0000 7f66aabc8700 1 -- start start 2024-06-06T03:15:38.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.252+0000 7f66aabc8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66a4101000 0x7f66a4102aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:38.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.252+0000 7f66aabc8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f66a410b280 con 0x7f66a4101000 2024-06-06T03:15:38.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.252+0000 7f66a8964700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66a4101000 0x7f66a4102aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:38.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.252+0000 7f66a8964700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66a4101000 0x7f66a4102aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54870/0 (socket says 172.21.15.50:54870) 2024-06-06T03:15:38.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.252+0000 7f66a8964700 1 -- 172.21.15.50:0/288199571 learned_addr learned my addr 172.21.15.50:0/288199571 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:15:38.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.252+0000 7f66a8964700 1 -- 172.21.15.50:0/288199571 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a4104990 con 0x7f66a4101000 2024-06-06T03:15:38.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.252+0000 7f66a8964700 1 --2- 172.21.15.50:0/288199571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66a4101000 0x7f66a4102aa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f66980056d0 tx=0x7f66980057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:38.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.252+0000 7f66a1ffb700 1 -- 172.21.15.50:0/288199571 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6698026070 con 0x7f66a4101000 2024-06-06T03:15:38.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.252+0000 7f66aabc8700 1 -- 172.21.15.50:0/288199571 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66a4103040 con 0x7f66a4101000 2024-06-06T03:15:38.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.252+0000 7f66a1ffb700 1 -- 172.21.15.50:0/288199571 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f669800bc00 con 0x7f66a4101000 2024-06-06T03:15:38.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.252+0000 7f66a1ffb700 1 -- 172.21.15.50:0/288199571 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66980039b0 con 0x7f66a4101000 2024-06-06T03:15:38.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.253+0000 7f66aabc8700 1 -- 172.21.15.50:0/288199571 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66a4103500 con 0x7f66a4101000 2024-06-06T03:15:38.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.253+0000 7f66a1ffb700 1 -- 172.21.15.50:0/288199571 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f6698029070 con 0x7f66a4101000 2024-06-06T03:15:38.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.253+0000 7f66aabc8700 1 -- 172.21.15.50:0/288199571 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66a41024e0 con 0x7f66a4101000 2024-06-06T03:15:38.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.254+0000 7f66a1ffb700 1 --2- 172.21.15.50:0/288199571 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f66940390f0 0x7f669403b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:38.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.254+0000 7f66a1ffb700 1 -- 172.21.15.50:0/288199571 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f669801e070 con 0x7f66a4101000 2024-06-06T03:15:38.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.254+0000 7f66a3fff700 1 --2- 172.21.15.50:0/288199571 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f66940390f0 0x7f669403b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:38.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.254+0000 7f66a3fff700 1 --2- 172.21.15.50:0/288199571 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f66940390f0 0x7f669403b5b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6690006fd0 tx=0x7f6690006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.259+0000 7f66a1ffb700 1 -- 172.21.15.50:0/288199571 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6698013070 con 0x7f66a4101000 2024-06-06T03:15:38.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.473+0000 7f66aabc8700 1 -- 172.21.15.50:0/288199571 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f66a4103fd0 con 0x7f66940390f0 2024-06-06T03:15:38.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.474+0000 7f66a1ffb700 1 -- 172.21.15.50:0/288199571 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7f66a4103fd0 con 0x7f66940390f0 2024-06-06T03:15:38.474 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:15:38.474 INFO:teuthology.orchestra.run.smithi050.stdout:[{"addr": "172.21.15.50", "hostname": "smithi050", "labels": [], "status": ""}, {"addr": "172.21.15.79", "hostname": "smithi079", "labels": [], "status": ""}] 2024-06-06T03:15:38.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.476+0000 7f66aabc8700 1 -- 172.21.15.50:0/288199571 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f66940390f0 msgr2=0x7f669403b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:38.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.476+0000 7f66aabc8700 1 --2- 172.21.15.50:0/288199571 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f66940390f0 0x7f669403b5b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6690006fd0 tx=0x7f6690006e40 comp rx=0 tx=0).stop 2024-06-06T03:15:38.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.476+0000 7f66aabc8700 1 -- 172.21.15.50:0/288199571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66a4101000 msgr2=0x7f66a4102aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:38.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.476+0000 7f66aabc8700 1 --2- 172.21.15.50:0/288199571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66a4101000 0x7f66a4102aa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f66980056d0 tx=0x7f66980057b0 comp rx=0 tx=0).stop 2024-06-06T03:15:38.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.476+0000 7f66aabc8700 1 -- 172.21.15.50:0/288199571 shutdown_connections 2024-06-06T03:15:38.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.476+0000 7f66aabc8700 1 --2- 172.21.15.50:0/288199571 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f66940390f0 0x7f669403b5b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:38.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.476+0000 7f66aabc8700 1 --2- 172.21.15.50:0/288199571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66a4101000 0x7f66a4102aa0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:38.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.476+0000 7f66aabc8700 1 -- 172.21.15.50:0/288199571 >> 172.21.15.50:0/288199571 conn(0x7f66a40fc8b0 msgr2=0x7f66a406a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:38.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.476+0000 7f66aabc8700 1 -- 172.21.15.50:0/288199571 shutdown_connections 2024-06-06T03:15:38.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:38.476+0000 7f66aabc8700 1 -- 172.21.15.50:0/288199571 wait complete. 2024-06-06T03:15:39.084 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi122 2024-06-06T03:15:39.085 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-06-06T03:15:39.085 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/etc/ceph/ceph.conf 2024-06-06T03:15:39.104 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-06-06T03:15:39.104 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-06T03:15:39.162 INFO:tasks.cephadm:Adding host smithi122 to orchestrator... 2024-06-06T03:15:39.162 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph orch host add smithi122 2024-06-06T03:15:39.409 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:15:39.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:39 smithi050 ceph-mon[32421]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:15:39.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:39 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:40.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:40 smithi050 ceph-mon[32421]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T03:15:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:40.764+0000 7fd89aa99700 1 -- 172.21.15.50:0/2400830631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd894106eb0 msgr2=0x7fd894107290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:40.764+0000 7fd89aa99700 1 --2- 172.21.15.50:0/2400830631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd894106eb0 0x7fd894107290 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd884009910 tx=0x7fd884009c20 comp rx=0 tx=0).stop 2024-06-06T03:15:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:40.764+0000 7fd89aa99700 1 -- 172.21.15.50:0/2400830631 shutdown_connections 2024-06-06T03:15:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:40.764+0000 7fd89aa99700 1 --2- 172.21.15.50:0/2400830631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd894106eb0 0x7fd894107290 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:40.764+0000 7fd89aa99700 1 -- 172.21.15.50:0/2400830631 >> 172.21.15.50:0/2400830631 conn(0x7fd8940fbfd0 msgr2=0x7fd8940fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:40.764+0000 7fd89aa99700 1 -- 172.21.15.50:0/2400830631 shutdown_connections 2024-06-06T03:15:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:40.764+0000 7fd89aa99700 1 -- 172.21.15.50:0/2400830631 wait complete. 2024-06-06T03:15:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:40.765+0000 7fd89aa99700 1 Processor -- start 2024-06-06T03:15:40.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:40.765+0000 7fd89aa99700 1 -- start start 2024-06-06T03:15:40.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:40.765+0000 7fd89aa99700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd894106eb0 0x7fd89419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:40.765+0000 7fd89aa99700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd89410c4c0 con 0x7fd894106eb0 2024-06-06T03:15:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:40.765+0000 7fd898835700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd894106eb0 0x7fd89419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:40.765+0000 7fd898835700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd894106eb0 0x7fd89419d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54894/0 (socket says 172.21.15.50:54894) 2024-06-06T03:15:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:40.765+0000 7fd898835700 1 -- 172.21.15.50:0/4211750776 learned_addr learned my addr 172.21.15.50:0/4211750776 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:15:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:40.765+0000 7fd898835700 1 -- 172.21.15.50:0/4211750776 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd89419dbb0 con 0x7fd894106eb0 2024-06-06T03:15:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:40.766+0000 7fd898835700 1 --2- 172.21.15.50:0/4211750776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd894106eb0 0x7fd89419d670 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd8840056d0 tx=0x7fd8840057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:40.766+0000 7fd891ffb700 1 -- 172.21.15.50:0/4211750776 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd884026070 con 0x7fd894106eb0 2024-06-06T03:15:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:40.766+0000 7fd891ffb700 1 -- 172.21.15.50:0/4211750776 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd88400bc00 con 0x7fd894106eb0 2024-06-06T03:15:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:40.766+0000 7fd89aa99700 1 -- 172.21.15.50:0/4211750776 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd89419de40 con 0x7fd894106eb0 2024-06-06T03:15:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:40.766+0000 7fd891ffb700 1 -- 172.21.15.50:0/4211750776 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8840039b0 con 0x7fd894106eb0 2024-06-06T03:15:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:40.766+0000 7fd89aa99700 1 -- 172.21.15.50:0/4211750776 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd894197740 con 0x7fd894106eb0 2024-06-06T03:15:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:40.767+0000 7fd891ffb700 1 -- 172.21.15.50:0/4211750776 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fd884029070 con 0x7fd894106eb0 2024-06-06T03:15:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:40.767+0000 7fd89aa99700 1 -- 172.21.15.50:0/4211750776 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8941035f0 con 0x7fd894106eb0 2024-06-06T03:15:40.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:40.767+0000 7fd891ffb700 1 --2- 172.21.15.50:0/4211750776 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd87c039150 0x7fd87c03b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:40.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:40.767+0000 7fd891ffb700 1 -- 172.21.15.50:0/4211750776 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd88401e070 con 0x7fd894106eb0 2024-06-06T03:15:40.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:40.767+0000 7fd893fff700 1 --2- 172.21.15.50:0/4211750776 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd87c039150 0x7fd87c03b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:40.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:40.768+0000 7fd893fff700 1 --2- 172.21.15.50:0/4211750776 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd87c039150 0x7fd87c03b610 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd888006fd0 tx=0x7fd888006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:40.772+0000 7fd891ffb700 1 -- 172.21.15.50:0/4211750776 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd884013070 con 0x7fd894106eb0 2024-06-06T03:15:40.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:40.984+0000 7fd89aa99700 1 -- 172.21.15.50:0/4211750776 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi122", "target": ["mon-mgr", ""]}) -- 0x7fd894063af0 con 0x7fd87c039150 2024-06-06T03:15:41.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:41 smithi050 ceph-mon[32421]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:15:42.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:42 smithi050 ceph-mon[32421]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi122", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:15:42.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:42 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:42.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:42 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:42.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:42 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:42.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:42 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:42.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:42 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi079", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:15:42.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:42 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:15:42.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:42 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:15:43.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:43 smithi050 ceph-mon[32421]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:15:43.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:43 smithi050 ceph-mon[32421]: Deploying cephadm binary to smithi122 2024-06-06T03:15:43.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:43 smithi050 ceph-mon[32421]: Updating smithi079:/etc/ceph/ceph.conf 2024-06-06T03:15:43.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:43 smithi050 ceph-mon[32421]: Updating smithi079:/var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T03:15:45.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:45.267+0000 7fd891ffb700 1 -- 172.21.15.50:0/4211750776 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fd894063af0 con 0x7fd87c039150 2024-06-06T03:15:45.268 INFO:teuthology.orchestra.run.smithi050.stdout:Added host 'smithi122' with addr '172.21.15.122' 2024-06-06T03:15:45.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:45.270+0000 7fd89aa99700 1 -- 172.21.15.50:0/4211750776 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd87c039150 msgr2=0x7fd87c03b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:45.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:45.270+0000 7fd89aa99700 1 --2- 172.21.15.50:0/4211750776 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd87c039150 0x7fd87c03b610 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd888006fd0 tx=0x7fd888006e40 comp rx=0 tx=0).stop 2024-06-06T03:15:45.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:45.270+0000 7fd89aa99700 1 -- 172.21.15.50:0/4211750776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd894106eb0 msgr2=0x7fd89419d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:45.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:45.270+0000 7fd89aa99700 1 --2- 172.21.15.50:0/4211750776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd894106eb0 0x7fd89419d670 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd8840056d0 tx=0x7fd8840057b0 comp rx=0 tx=0).stop 2024-06-06T03:15:45.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:45.270+0000 7fd89aa99700 1 -- 172.21.15.50:0/4211750776 shutdown_connections 2024-06-06T03:15:45.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:45.270+0000 7fd89aa99700 1 --2- 172.21.15.50:0/4211750776 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd87c039150 0x7fd87c03b610 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:45.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:45.270+0000 7fd89aa99700 1 --2- 172.21.15.50:0/4211750776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd894106eb0 0x7fd89419d670 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:45.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:45.270+0000 7fd89aa99700 1 -- 172.21.15.50:0/4211750776 >> 172.21.15.50:0/4211750776 conn(0x7fd8940fbfd0 msgr2=0x7fd8941099d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:45.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:45.270+0000 7fd89aa99700 1 -- 172.21.15.50:0/4211750776 shutdown_connections 2024-06-06T03:15:45.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:45.270+0000 7fd89aa99700 1 -- 172.21.15.50:0/4211750776 wait complete. 2024-06-06T03:15:45.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:45 smithi050 ceph-mon[32421]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:15:45.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:45 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:45.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:45 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:45.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:45 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:45.982 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph orch host ls --format=json 2024-06-06T03:15:46.230 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:15:46.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:46 smithi050 ceph-mon[32421]: Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2024-06-06T03:15:46.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:46 smithi050 ceph-mon[32421]: Updating smithi079:/var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-06T03:15:46.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:46 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:46.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:46 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:15:46.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:46 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:47.415 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:47 smithi050 ceph-mon[32421]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:15:47.416 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:47 smithi050 ceph-mon[32421]: Added host smithi122 2024-06-06T03:15:47.416 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:47 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:47.783+0000 7fcce4132700 1 -- 172.21.15.50:0/3603442309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccdc102100 msgr2=0x7fccdc1024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:47.783+0000 7fcce4132700 1 --2- 172.21.15.50:0/3603442309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccdc102100 0x7fccdc1024e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fccd8009910 tx=0x7fccd8009c20 comp rx=0 tx=0).stop 2024-06-06T03:15:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:47.783+0000 7fcce4132700 1 -- 172.21.15.50:0/3603442309 shutdown_connections 2024-06-06T03:15:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:47.783+0000 7fcce4132700 1 --2- 172.21.15.50:0/3603442309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccdc102100 0x7fccdc1024e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:47.783+0000 7fcce4132700 1 -- 172.21.15.50:0/3603442309 >> 172.21.15.50:0/3603442309 conn(0x7fccdc0fd9d0 msgr2=0x7fccdc0ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:47.783+0000 7fcce4132700 1 -- 172.21.15.50:0/3603442309 shutdown_connections 2024-06-06T03:15:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:47.783+0000 7fcce4132700 1 -- 172.21.15.50:0/3603442309 wait complete. 2024-06-06T03:15:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:47.784+0000 7fcce4132700 1 Processor -- start 2024-06-06T03:15:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:47.784+0000 7fcce4132700 1 -- start start 2024-06-06T03:15:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:47.784+0000 7fcce4132700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccdc102100 0x7fccdc19d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:47.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:47.784+0000 7fcce4132700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fccdc10c380 con 0x7fccdc102100 2024-06-06T03:15:47.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:47.784+0000 7fcce1ece700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccdc102100 0x7fccdc19d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:47.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:47.784+0000 7fcce1ece700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccdc102100 0x7fccdc19d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54916/0 (socket says 172.21.15.50:54916) 2024-06-06T03:15:47.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:47.784+0000 7fcce1ece700 1 -- 172.21.15.50:0/1318387941 learned_addr learned my addr 172.21.15.50:0/1318387941 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:15:47.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:47.784+0000 7fcce1ece700 1 -- 172.21.15.50:0/1318387941 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccdc19dbb0 con 0x7fccdc102100 2024-06-06T03:15:47.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:47.784+0000 7fcce1ece700 1 --2- 172.21.15.50:0/1318387941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccdc102100 0x7fccdc19d670 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fccd80056d0 tx=0x7fccd80057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:47.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:47.784+0000 7fccd2ffd700 1 -- 172.21.15.50:0/1318387941 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccd8026070 con 0x7fccdc102100 2024-06-06T03:15:47.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:47.784+0000 7fccd2ffd700 1 -- 172.21.15.50:0/1318387941 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fccd800bba0 con 0x7fccdc102100 2024-06-06T03:15:47.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:47.785+0000 7fcce4132700 1 -- 172.21.15.50:0/1318387941 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccdc19dea0 con 0x7fccdc102100 2024-06-06T03:15:47.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:47.785+0000 7fccd2ffd700 1 -- 172.21.15.50:0/1318387941 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccd80037f0 con 0x7fccdc102100 2024-06-06T03:15:47.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:47.785+0000 7fcce4132700 1 -- 172.21.15.50:0/1318387941 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccdc197910 con 0x7fccdc102100 2024-06-06T03:15:47.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:47.785+0000 7fccd2ffd700 1 -- 172.21.15.50:0/1318387941 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fccd8029070 con 0x7fccdc102100 2024-06-06T03:15:47.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:47.786+0000 7fcce4132700 1 -- 172.21.15.50:0/1318387941 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccdc1035e0 con 0x7fccdc102100 2024-06-06T03:15:47.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:47.786+0000 7fccd2ffd700 1 --2- 172.21.15.50:0/1318387941 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fccc8039150 0x7fccc803b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:47.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:47.786+0000 7fccd2ffd700 1 -- 172.21.15.50:0/1318387941 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fccd801e070 con 0x7fccdc102100 2024-06-06T03:15:47.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:47.786+0000 7fcce16cd700 1 --2- 172.21.15.50:0/1318387941 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fccc8039150 0x7fccc803b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:47.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:47.786+0000 7fcce16cd700 1 --2- 172.21.15.50:0/1318387941 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fccc8039150 0x7fccc803b610 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcccc006fd0 tx=0x7fcccc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:47.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:47.791+0000 7fccd2ffd700 1 -- 172.21.15.50:0/1318387941 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fccd8013070 con 0x7fccdc102100 2024-06-06T03:15:48.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:48.006+0000 7fcce4132700 1 -- 172.21.15.50:0/1318387941 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fccdc198c70 con 0x7fccc8039150 2024-06-06T03:15:48.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:48.007+0000 7fccd2ffd700 1 -- 172.21.15.50:0/1318387941 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7fccdc198c70 con 0x7fccc8039150 2024-06-06T03:15:48.007 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:15:48.007 INFO:teuthology.orchestra.run.smithi050.stdout:[{"addr": "172.21.15.50", "hostname": "smithi050", "labels": [], "status": ""}, {"addr": "172.21.15.79", "hostname": "smithi079", "labels": [], "status": ""}, {"addr": "172.21.15.122", "hostname": "smithi122", "labels": [], "status": ""}] 2024-06-06T03:15:48.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:48.009+0000 7fcce4132700 1 -- 172.21.15.50:0/1318387941 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fccc8039150 msgr2=0x7fccc803b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:48.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:48.009+0000 7fcce4132700 1 --2- 172.21.15.50:0/1318387941 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fccc8039150 0x7fccc803b610 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcccc006fd0 tx=0x7fcccc006e40 comp rx=0 tx=0).stop 2024-06-06T03:15:48.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:48.009+0000 7fcce4132700 1 -- 172.21.15.50:0/1318387941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccdc102100 msgr2=0x7fccdc19d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:48.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:48.009+0000 7fcce4132700 1 --2- 172.21.15.50:0/1318387941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccdc102100 0x7fccdc19d670 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fccd80056d0 tx=0x7fccd80057b0 comp rx=0 tx=0).stop 2024-06-06T03:15:48.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:48.009+0000 7fcce4132700 1 -- 172.21.15.50:0/1318387941 shutdown_connections 2024-06-06T03:15:48.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:48.009+0000 7fcce4132700 1 --2- 172.21.15.50:0/1318387941 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fccc8039150 0x7fccc803b610 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:48.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:48.009+0000 7fcce4132700 1 --2- 172.21.15.50:0/1318387941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccdc102100 0x7fccdc19d670 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:48.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:48.009+0000 7fcce4132700 1 -- 172.21.15.50:0/1318387941 >> 172.21.15.50:0/1318387941 conn(0x7fccdc0fd9d0 msgr2=0x7fccdc103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:48.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:48.009+0000 7fcce4132700 1 -- 172.21.15.50:0/1318387941 shutdown_connections 2024-06-06T03:15:48.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:48.009+0000 7fcce4132700 1 -- 172.21.15.50:0/1318387941 wait complete. 2024-06-06T03:15:48.608 INFO:tasks.cephadm:Setting crush tunables to default 2024-06-06T03:15:48.609 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd crush tunables default 2024-06-06T03:15:48.852 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:15:48.880 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:48 smithi050 ceph-mon[32421]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:15:48.880 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:48 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:48.880 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:48 smithi050 ceph-mon[32421]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T03:15:50.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.299+0000 7f3219215700 1 -- 172.21.15.50:0/3809932223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32141030a0 msgr2=0x7f3214103480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:50.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.299+0000 7f3219215700 1 --2- 172.21.15.50:0/3809932223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32141030a0 0x7f3214103480 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3204009910 tx=0x7f3204009c20 comp rx=0 tx=0).stop 2024-06-06T03:15:50.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.299+0000 7f3219215700 1 -- 172.21.15.50:0/3809932223 shutdown_connections 2024-06-06T03:15:50.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.299+0000 7f3219215700 1 --2- 172.21.15.50:0/3809932223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32141030a0 0x7f3214103480 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:50.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.299+0000 7f3219215700 1 -- 172.21.15.50:0/3809932223 >> 172.21.15.50:0/3809932223 conn(0x7f32140fc890 msgr2=0x7f32140fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:50.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.299+0000 7f3219215700 1 -- 172.21.15.50:0/3809932223 shutdown_connections 2024-06-06T03:15:50.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.299+0000 7f3219215700 1 -- 172.21.15.50:0/3809932223 wait complete. 2024-06-06T03:15:50.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.300+0000 7f3219215700 1 Processor -- start 2024-06-06T03:15:50.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.300+0000 7f3219215700 1 -- start start 2024-06-06T03:15:50.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.300+0000 7f3219215700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32141030a0 0x7f321419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:50.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.300+0000 7f3219215700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f321410c3d0 con 0x7f32141030a0 2024-06-06T03:15:50.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.300+0000 7f3212d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32141030a0 0x7f321419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:50.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.300+0000 7f3212d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32141030a0 0x7f321419d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35212/0 (socket says 172.21.15.50:35212) 2024-06-06T03:15:50.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.300+0000 7f3212d9d700 1 -- 172.21.15.50:0/3509714609 learned_addr learned my addr 172.21.15.50:0/3509714609 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:15:50.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.301+0000 7f3212d9d700 1 -- 172.21.15.50:0/3509714609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f321419dbe0 con 0x7f32141030a0 2024-06-06T03:15:50.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.301+0000 7f3212d9d700 1 --2- 172.21.15.50:0/3509714609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32141030a0 0x7f321419d6a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f32040056d0 tx=0x7f32040057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:50.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.301+0000 7f31fbfff700 1 -- 172.21.15.50:0/3509714609 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3204026070 con 0x7f32141030a0 2024-06-06T03:15:50.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.301+0000 7f31fbfff700 1 -- 172.21.15.50:0/3509714609 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3204004370 con 0x7f32141030a0 2024-06-06T03:15:50.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.301+0000 7f3219215700 1 -- 172.21.15.50:0/3509714609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f321419de70 con 0x7f32141030a0 2024-06-06T03:15:50.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.301+0000 7f31fbfff700 1 -- 172.21.15.50:0/3509714609 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32040039b0 con 0x7f32141030a0 2024-06-06T03:15:50.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.301+0000 7f3219215700 1 -- 172.21.15.50:0/3509714609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3214197770 con 0x7f32141030a0 2024-06-06T03:15:50.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.302+0000 7f31fbfff700 1 -- 172.21.15.50:0/3509714609 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f3204029070 con 0x7f32141030a0 2024-06-06T03:15:50.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.302+0000 7f3219215700 1 -- 172.21.15.50:0/3509714609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f321406ab80 con 0x7f32141030a0 2024-06-06T03:15:50.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.302+0000 7f31fbfff700 1 --2- 172.21.15.50:0/3509714609 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f31fc0390f0 0x7f31fc03b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:50.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.302+0000 7f31fbfff700 1 -- 172.21.15.50:0/3509714609 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f320401e070 con 0x7f32141030a0 2024-06-06T03:15:50.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.302+0000 7f321259c700 1 --2- 172.21.15.50:0/3509714609 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f31fc0390f0 0x7f31fc03b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:50.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.303+0000 7f321259c700 1 --2- 172.21.15.50:0/3509714609 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f31fc0390f0 0x7f31fc03b5b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3208006fd0 tx=0x7f3208006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:50.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.307+0000 7f31fbfff700 1 -- 172.21.15.50:0/3509714609 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3204013070 con 0x7f32141030a0 2024-06-06T03:15:50.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.518+0000 7f3219215700 1 -- 172.21.15.50:0/3509714609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f3214063af0 con 0x7f32141030a0 2024-06-06T03:15:50.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.883+0000 7f31fbfff700 1 -- 172.21.15.50:0/3509714609 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f3204030090 con 0x7f32141030a0 2024-06-06T03:15:50.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.885+0000 7f3219215700 1 -- 172.21.15.50:0/3509714609 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f31fc0390f0 msgr2=0x7f31fc03b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.885+0000 7f3219215700 1 --2- 172.21.15.50:0/3509714609 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f31fc0390f0 0x7f31fc03b5b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3208006fd0 tx=0x7f3208006e40 comp rx=0 tx=0).stop 2024-06-06T03:15:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.885+0000 7f3219215700 1 -- 172.21.15.50:0/3509714609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32141030a0 msgr2=0x7f321419d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.885+0000 7f3219215700 1 --2- 172.21.15.50:0/3509714609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32141030a0 0x7f321419d6a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f32040056d0 tx=0x7f32040057b0 comp rx=0 tx=0).stop 2024-06-06T03:15:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.885+0000 7f3219215700 1 -- 172.21.15.50:0/3509714609 shutdown_connections 2024-06-06T03:15:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.885+0000 7f3219215700 1 --2- 172.21.15.50:0/3509714609 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f31fc0390f0 0x7f31fc03b5b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.885+0000 7f3219215700 1 --2- 172.21.15.50:0/3509714609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32141030a0 0x7f321419d6a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.885+0000 7f3219215700 1 -- 172.21.15.50:0/3509714609 >> 172.21.15.50:0/3509714609 conn(0x7f32140fc890 msgr2=0x7f3214103e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.886+0000 7f3219215700 1 -- 172.21.15.50:0/3509714609 shutdown_connections 2024-06-06T03:15:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:15:50.886+0000 7f3219215700 1 -- 172.21.15.50:0/3509714609 wait complete. 2024-06-06T03:15:50.887 INFO:teuthology.orchestra.run.smithi050.stderr:adjusted tunables profile to default 2024-06-06T03:15:51.209 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:50 smithi050 ceph-mon[32421]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:15:51.210 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:50 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3509714609' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-06-06T03:15:51.506 INFO:tasks.cephadm:Adding mon.a on smithi050 2024-06-06T03:15:51.506 INFO:tasks.cephadm:Adding mon.b on smithi079 2024-06-06T03:15:51.506 INFO:tasks.cephadm:Adding mon.c on smithi122 2024-06-06T03:15:51.507 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph orch apply mon '3;smithi050:172.21.15.50=a;smithi079:172.21.15.79=b;smithi122:172.21.15.122=c' 2024-06-06T03:15:51.743 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T03:15:52.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:51 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3509714609' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-06-06T03:15:52.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:51 smithi050 ceph-mon[32421]: osdmap e4: 0 total, 0 up, 0 in 2024-06-06T03:15:52.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:51 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:52.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:51 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:52.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:51 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:52.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:51 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:52.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:51 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi122", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:15:52.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:51 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:15:52.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:51 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:15:52.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:51 smithi050 ceph-mon[32421]: Updating smithi122:/etc/ceph/ceph.conf 2024-06-06T03:15:53.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:52 smithi050 ceph-mon[32421]: Updating smithi122:/var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T03:15:53.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:52 smithi050 ceph-mon[32421]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:15:53.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:52 smithi050 ceph-mon[32421]: Updating smithi122:/etc/ceph/ceph.client.admin.keyring 2024-06-06T03:15:53.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:52 smithi050 ceph-mon[32421]: Updating smithi122:/var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-06T03:15:53.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:52 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:53.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:52 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:53.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:52 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:53.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.295+0000 7efc7d9e0700 1 -- 172.21.15.122:0/1074845767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc78102100 msgr2=0x7efc781024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:53.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.295+0000 7efc7d9e0700 1 --2- 172.21.15.122:0/1074845767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc78102100 0x7efc781024e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efc68009910 tx=0x7efc68009c20 comp rx=0 tx=0).stop 2024-06-06T03:15:53.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.295+0000 7efc7d9e0700 1 -- 172.21.15.122:0/1074845767 shutdown_connections 2024-06-06T03:15:53.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.295+0000 7efc7d9e0700 1 --2- 172.21.15.122:0/1074845767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc78102100 0x7efc781024e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:53.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.295+0000 7efc7d9e0700 1 -- 172.21.15.122:0/1074845767 >> 172.21.15.122:0/1074845767 conn(0x7efc780fd9d0 msgr2=0x7efc780ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:53.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.295+0000 7efc7d9e0700 1 -- 172.21.15.122:0/1074845767 shutdown_connections 2024-06-06T03:15:53.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.295+0000 7efc7d9e0700 1 -- 172.21.15.122:0/1074845767 wait complete. 2024-06-06T03:15:53.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.296+0000 7efc7d9e0700 1 Processor -- start 2024-06-06T03:15:53.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.296+0000 7efc7d9e0700 1 -- start start 2024-06-06T03:15:53.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.296+0000 7efc7d9e0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc78102100 0x7efc7819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:53.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.296+0000 7efc7d9e0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efc7810c380 con 0x7efc78102100 2024-06-06T03:15:53.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.296+0000 7efc76ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc78102100 0x7efc7819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:53.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.296+0000 7efc76ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc78102100 0x7efc7819d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.122:58272/0 (socket says 172.21.15.122:58272) 2024-06-06T03:15:53.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.296+0000 7efc76ffd700 1 -- 172.21.15.122:0/1853750076 learned_addr learned my addr 172.21.15.122:0/1853750076 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-06-06T03:15:53.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.296+0000 7efc76ffd700 1 -- 172.21.15.122:0/1853750076 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc7819dbb0 con 0x7efc78102100 2024-06-06T03:15:53.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.297+0000 7efc76ffd700 1 --2- 172.21.15.122:0/1853750076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc78102100 0x7efc7819d670 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efc680056d0 tx=0x7efc680057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:53.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.297+0000 7efc7c9de700 1 -- 172.21.15.122:0/1853750076 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc68026070 con 0x7efc78102100 2024-06-06T03:15:53.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.297+0000 7efc7c9de700 1 -- 172.21.15.122:0/1853750076 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efc6800bba0 con 0x7efc78102100 2024-06-06T03:15:53.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.297+0000 7efc7c9de700 1 -- 172.21.15.122:0/1853750076 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc680037f0 con 0x7efc78102100 2024-06-06T03:15:53.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.297+0000 7efc7d9e0700 1 -- 172.21.15.122:0/1853750076 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc7819dea0 con 0x7efc78102100 2024-06-06T03:15:53.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.297+0000 7efc7d9e0700 1 -- 172.21.15.122:0/1853750076 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc78197910 con 0x7efc78102100 2024-06-06T03:15:53.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.298+0000 7efc7c9de700 1 -- 172.21.15.122:0/1853750076 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7efc68029070 con 0x7efc78102100 2024-06-06T03:15:53.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.298+0000 7efc7d9e0700 1 -- 172.21.15.122:0/1853750076 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc781035e0 con 0x7efc78102100 2024-06-06T03:15:53.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.298+0000 7efc7c9de700 1 --2- 172.21.15.122:0/1853750076 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7efc600390f0 0x7efc6003b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:53.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.298+0000 7efc7c9de700 1 -- 172.21.15.122:0/1853750076 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7efc6801e070 con 0x7efc78102100 2024-06-06T03:15:53.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.298+0000 7efc767fc700 1 --2- 172.21.15.122:0/1853750076 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7efc600390f0 0x7efc6003b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:53.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.299+0000 7efc767fc700 1 --2- 172.21.15.122:0/1853750076 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7efc600390f0 0x7efc6003b5b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7efc6c006fd0 tx=0x7efc6c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:53.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.303+0000 7efc7c9de700 1 -- 172.21.15.122:0/1853750076 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7efc68013070 con 0x7efc78102100 2024-06-06T03:15:53.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.512+0000 7efc7d9e0700 1 -- 172.21.15.122:0/1853750076 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi050:172.21.15.50=a;smithi079:172.21.15.79=b;smithi122:172.21.15.122=c", "target": ["mon-mgr", ""]}) -- 0x7efc780008d0 con 0x7efc600390f0 2024-06-06T03:15:53.517 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.518+0000 7efc7c9de700 1 -- 172.21.15.122:0/1853750076 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7efc780008d0 con 0x7efc600390f0 2024-06-06T03:15:53.517 INFO:teuthology.orchestra.run.smithi122.stdout:Scheduled mon update... 2024-06-06T03:15:53.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.520+0000 7efc7d9e0700 1 -- 172.21.15.122:0/1853750076 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7efc600390f0 msgr2=0x7efc6003b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:53.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.520+0000 7efc7d9e0700 1 --2- 172.21.15.122:0/1853750076 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7efc600390f0 0x7efc6003b5b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7efc6c006fd0 tx=0x7efc6c006e40 comp rx=0 tx=0).stop 2024-06-06T03:15:53.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.520+0000 7efc7d9e0700 1 -- 172.21.15.122:0/1853750076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc78102100 msgr2=0x7efc7819d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:53.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.520+0000 7efc7d9e0700 1 --2- 172.21.15.122:0/1853750076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc78102100 0x7efc7819d670 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efc680056d0 tx=0x7efc680057b0 comp rx=0 tx=0).stop 2024-06-06T03:15:53.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.520+0000 7efc7d9e0700 1 -- 172.21.15.122:0/1853750076 shutdown_connections 2024-06-06T03:15:53.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.520+0000 7efc7d9e0700 1 --2- 172.21.15.122:0/1853750076 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7efc600390f0 0x7efc6003b5b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:53.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.520+0000 7efc7d9e0700 1 --2- 172.21.15.122:0/1853750076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc78102100 0x7efc7819d670 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:53.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.520+0000 7efc7d9e0700 1 -- 172.21.15.122:0/1853750076 >> 172.21.15.122:0/1853750076 conn(0x7efc780fd9d0 msgr2=0x7efc78103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:53.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.520+0000 7efc7d9e0700 1 -- 172.21.15.122:0/1853750076 shutdown_connections 2024-06-06T03:15:53.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:53.520+0000 7efc7d9e0700 1 -- 172.21.15.122:0/1853750076 wait complete. 2024-06-06T03:15:54.115 DEBUG:teuthology.orchestra.run.smithi079:mon.b> sudo journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mon.b.service 2024-06-06T03:15:54.118 DEBUG:teuthology.orchestra.run.smithi122:mon.c> sudo journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mon.c.service 2024-06-06T03:15:54.120 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-06T03:15:54.120 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-06T03:15:54.802 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T03:15:55.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:54 smithi050 ceph-mon[32421]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:15:55.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:54 smithi050 ceph-mon[32421]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi050:172.21.15.50=a;smithi079:172.21.15.79=b;smithi122:172.21.15.122=c", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:15:55.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:54 smithi050 ceph-mon[32421]: Saving service mon spec with placement smithi050:172.21.15.50=a;smithi079:172.21.15.79=b;smithi122:172.21.15.122=c;count:3 2024-06-06T03:15:55.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:54 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:55.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:54 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:15:55.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:54 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:15:55.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:54 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:15:55.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:54 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:55.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:54 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T03:15:55.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:54 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:15:55.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:54 smithi050 ceph-mon[32421]: Deploying daemon mon.c on smithi122 2024-06-06T03:15:57.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:56 smithi050 ceph-mon[32421]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:15:57.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:57.892+0000 7f85d5b88700 1 -- 172.21.15.122:0/2354164681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85d0100fe0 msgr2=0x7f85d01013c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:57.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:57.892+0000 7f85d5b88700 1 --2- 172.21.15.122:0/2354164681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85d0100fe0 0x7f85d01013c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f85c4009910 tx=0x7f85c4009c20 comp rx=0 tx=0).stop 2024-06-06T03:15:57.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:57.892+0000 7f85d5b88700 1 -- 172.21.15.122:0/2354164681 shutdown_connections 2024-06-06T03:15:57.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:57.892+0000 7f85d5b88700 1 --2- 172.21.15.122:0/2354164681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85d0100fe0 0x7f85d01013c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:57.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:57.892+0000 7f85d5b88700 1 -- 172.21.15.122:0/2354164681 >> 172.21.15.122:0/2354164681 conn(0x7f85d00fc890 msgr2=0x7f85d00fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:57.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:57.892+0000 7f85d5b88700 1 -- 172.21.15.122:0/2354164681 shutdown_connections 2024-06-06T03:15:57.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:57.892+0000 7f85d5b88700 1 -- 172.21.15.122:0/2354164681 wait complete. 2024-06-06T03:15:57.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:57.892+0000 7f85d5b88700 1 Processor -- start 2024-06-06T03:15:57.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:57.893+0000 7f85d5b88700 1 -- start start 2024-06-06T03:15:57.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:57.893+0000 7f85d5b88700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85d0100fe0 0x7f85d0198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:57.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:57.893+0000 7f85d5b88700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f85d010b260 con 0x7f85d0100fe0 2024-06-06T03:15:57.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:57.893+0000 7f85cf7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85d0100fe0 0x7f85d0198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:57.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:57.893+0000 7f85cf7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85d0100fe0 0x7f85d0198740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.122:39806/0 (socket says 172.21.15.122:39806) 2024-06-06T03:15:57.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:57.893+0000 7f85cf7fe700 1 -- 172.21.15.122:0/43715579 learned_addr learned my addr 172.21.15.122:0/43715579 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-06-06T03:15:57.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:57.893+0000 7f85cf7fe700 1 -- 172.21.15.122:0/43715579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d0198c80 con 0x7f85d0100fe0 2024-06-06T03:15:57.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:57.894+0000 7f85cf7fe700 1 --2- 172.21.15.122:0/43715579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85d0100fe0 0x7f85d0198740 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f85c40056d0 tx=0x7f85c40057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:57.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:57.894+0000 7f85ccff9700 1 -- 172.21.15.122:0/43715579 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85c4026070 con 0x7f85d0100fe0 2024-06-06T03:15:57.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:57.894+0000 7f85d5b88700 1 -- 172.21.15.122:0/43715579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85d0198f70 con 0x7f85d0100fe0 2024-06-06T03:15:57.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:57.894+0000 7f85ccff9700 1 -- 172.21.15.122:0/43715579 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f85c400bba0 con 0x7f85d0100fe0 2024-06-06T03:15:57.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:57.894+0000 7f85ccff9700 1 -- 172.21.15.122:0/43715579 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85c40037f0 con 0x7f85d0100fe0 2024-06-06T03:15:57.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:57.894+0000 7f85d5b88700 1 -- 172.21.15.122:0/43715579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85d0199430 con 0x7f85d0100fe0 2024-06-06T03:15:57.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:57.895+0000 7f85d5b88700 1 -- 172.21.15.122:0/43715579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85d01024c0 con 0x7f85d0100fe0 2024-06-06T03:15:57.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:57.895+0000 7f85ccff9700 1 -- 172.21.15.122:0/43715579 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f85c4029070 con 0x7f85d0100fe0 2024-06-06T03:15:57.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:57.895+0000 7f85ccff9700 1 --2- 172.21.15.122:0/43715579 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f85b80390f0 0x7f85b803b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:15:57.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:57.895+0000 7f85ccff9700 1 -- 172.21.15.122:0/43715579 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f85c401e070 con 0x7f85d0100fe0 2024-06-06T03:15:57.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:57.895+0000 7f85ceffd700 1 --2- 172.21.15.122:0/43715579 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f85b80390f0 0x7f85b803b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:15:57.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:57.896+0000 7f85ceffd700 1 --2- 172.21.15.122:0/43715579 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f85b80390f0 0x7f85b803b5b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f85c0006fd0 tx=0x7f85c0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:15:57.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:57.900+0000 7f85ccff9700 1 -- 172.21.15.122:0/43715579 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f85c4013070 con 0x7f85d0100fe0 2024-06-06T03:15:58.207 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:58.207+0000 7f85d5b88700 1 -- 172.21.15.122:0/43715579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f85d0063af0 con 0x7f85d0100fe0 2024-06-06T03:15:58.207 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:58.208+0000 7f85ccff9700 1 -- 172.21.15.122:0/43715579 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f85c4030020 con 0x7f85d0100fe0 2024-06-06T03:15:58.208 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-06-06T03:15:58.208 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":1,"fsid":"b6263b26-23b2-11ef-bc9b-c7b262605968","modified":"2024-06-06T03:14:13.774178Z","created":"2024-06-06T03:14:13.774178Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:3300","nonce":0},{"type":"v1","addr":"172.21.15.50:6789","nonce":0}]},"addr":"172.21.15.50:6789/0","public_addr":"172.21.15.50:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-06-06T03:15:58.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:58.210+0000 7f85d5b88700 1 -- 172.21.15.122:0/43715579 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f85b80390f0 msgr2=0x7f85b803b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:58.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:58.210+0000 7f85d5b88700 1 --2- 172.21.15.122:0/43715579 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f85b80390f0 0x7f85b803b5b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f85c0006fd0 tx=0x7f85c0006e40 comp rx=0 tx=0).stop 2024-06-06T03:15:58.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:58.210+0000 7f85d5b88700 1 -- 172.21.15.122:0/43715579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85d0100fe0 msgr2=0x7f85d0198740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:15:58.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:58.210+0000 7f85d5b88700 1 --2- 172.21.15.122:0/43715579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85d0100fe0 0x7f85d0198740 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f85c40056d0 tx=0x7f85c40057b0 comp rx=0 tx=0).stop 2024-06-06T03:15:58.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:58.210+0000 7f85d5b88700 1 -- 172.21.15.122:0/43715579 shutdown_connections 2024-06-06T03:15:58.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:58.210+0000 7f85d5b88700 1 --2- 172.21.15.122:0/43715579 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f85b80390f0 0x7f85b803b5b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:58.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:58.210+0000 7f85d5b88700 1 --2- 172.21.15.122:0/43715579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85d0100fe0 0x7f85d0198740 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:15:58.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:58.210+0000 7f85d5b88700 1 -- 172.21.15.122:0/43715579 >> 172.21.15.122:0/43715579 conn(0x7f85d00fc890 msgr2=0x7f85d01029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:15:58.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:58.210+0000 7f85d5b88700 1 -- 172.21.15.122:0/43715579 shutdown_connections 2024-06-06T03:15:58.211 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:15:58.210+0000 7f85d5b88700 1 -- 172.21.15.122:0/43715579 wait complete. 2024-06-06T03:15:58.211 INFO:teuthology.orchestra.run.smithi122.stderr:dumped monmap epoch 1 2024-06-06T03:15:58.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:58 smithi122 systemd[1]: Starting Ceph mon.c for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:15:59.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:58 smithi050 ceph-mon[32421]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:15:59.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:15:58 smithi050 ceph-mon[32421]: from='client.? 172.21.15.122:0/43715579' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-06T03:15:59.113 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 podman[35740]: 2024-06-06 03:15:59.03256213 +0000 UTC m=+0.106302613 container create ef50acc7ae0464499a80d90f1c89ab1a2d0eed3838948dc960becef95c58cf6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mon-c, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T03:15:59.113 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 podman[35740]: 2024-06-06 03:15:58.943756694 +0000 UTC m=+0.017497136 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T03:15:59.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 podman[35740]: 2024-06-06 03:15:59.20167309 +0000 UTC m=+0.275413522 container init ef50acc7ae0464499a80d90f1c89ab1a2d0eed3838948dc960becef95c58cf6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mon-c, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, ceph=True) 2024-06-06T03:15:59.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 podman[35740]: 2024-06-06 03:15:59.204931514 +0000 UTC m=+0.278671943 container start ef50acc7ae0464499a80d90f1c89ab1a2d0eed3838948dc960becef95c58cf6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mon-c, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240528) 2024-06-06T03:15:59.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: set uid:gid to 167:167 (ceph:ceph) 2024-06-06T03:15:59.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc), process ceph-mon, pid 2 2024-06-06T03:15:59.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: pidfile_write: ignore empty --pid-file 2024-06-06T03:15:59.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: load: jerasure load: lrc 2024-06-06T03:15:59.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: RocksDB version: 7.9.2 2024-06-06T03:15:59.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Git sha 0 2024-06-06T03:15:59.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Compile date 2024-05-30 15:42:47 2024-06-06T03:15:59.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: DB SUMMARY 2024-06-06T03:15:59.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: DB Session ID: 47NI4T7QR808SRDTEASS 2024-06-06T03:15:59.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: CURRENT file: CURRENT 2024-06-06T03:15:59.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: IDENTITY file: IDENTITY 2024-06-06T03:15:59.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-06-06T03:15:59.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-06-06T03:15:59.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-06-06T03:15:59.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.error_if_exists: 0 2024-06-06T03:15:59.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.create_if_missing: 0 2024-06-06T03:15:59.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.paranoid_checks: 1 2024-06-06T03:15:59.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.flush_verify_memtable_count: 1 2024-06-06T03:15:59.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-06-06T03:15:59.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-06-06T03:15:59.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.env: 0x5599c2a51c60 2024-06-06T03:15:59.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.fs: PosixFileSystem 2024-06-06T03:15:59.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.info_log: 0x5599c4173b20 2024-06-06T03:15:59.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.max_file_opening_threads: 16 2024-06-06T03:15:59.685 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.statistics: (nil) 2024-06-06T03:15:59.685 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.use_fsync: 0 2024-06-06T03:15:59.685 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.max_log_file_size: 0 2024-06-06T03:15:59.685 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-06-06T03:15:59.685 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.log_file_time_to_roll: 0 2024-06-06T03:15:59.685 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.keep_log_file_num: 1000 2024-06-06T03:15:59.685 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.recycle_log_file_num: 0 2024-06-06T03:15:59.686 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.allow_fallocate: 1 2024-06-06T03:15:59.686 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.allow_mmap_reads: 0 2024-06-06T03:15:59.686 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.allow_mmap_writes: 0 2024-06-06T03:15:59.686 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.use_direct_reads: 0 2024-06-06T03:15:59.686 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-06-06T03:15:59.686 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.create_missing_column_families: 0 2024-06-06T03:15:59.686 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.db_log_dir: 2024-06-06T03:15:59.686 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.wal_dir: 2024-06-06T03:15:59.686 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.table_cache_numshardbits: 6 2024-06-06T03:15:59.686 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.WAL_ttl_seconds: 0 2024-06-06T03:15:59.686 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.WAL_size_limit_MB: 0 2024-06-06T03:15:59.686 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-06-06T03:15:59.686 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-06-06T03:15:59.687 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.is_fd_close_on_exec: 1 2024-06-06T03:15:59.687 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.advise_random_on_open: 1 2024-06-06T03:15:59.687 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.db_write_buffer_size: 0 2024-06-06T03:15:59.687 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.write_buffer_manager: 0x5599c41441e0 2024-06-06T03:15:59.687 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-06-06T03:15:59.687 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-06-06T03:15:59.687 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.use_adaptive_mutex: 0 2024-06-06T03:15:59.687 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.rate_limiter: (nil) 2024-06-06T03:15:59.687 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-06-06T03:15:59.687 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.wal_recovery_mode: 2 2024-06-06T03:15:59.687 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.enable_thread_tracking: 0 2024-06-06T03:15:59.687 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.enable_pipelined_write: 0 2024-06-06T03:15:59.687 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.unordered_write: 0 2024-06-06T03:15:59.687 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-06-06T03:15:59.688 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-06-06T03:15:59.688 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-06-06T03:15:59.688 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-06-06T03:15:59.688 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.row_cache: None 2024-06-06T03:15:59.688 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.wal_filter: None 2024-06-06T03:15:59.688 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-06-06T03:15:59.688 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.allow_ingest_behind: 0 2024-06-06T03:15:59.688 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.two_write_queues: 0 2024-06-06T03:15:59.688 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.manual_wal_flush: 0 2024-06-06T03:15:59.688 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.wal_compression: 0 2024-06-06T03:15:59.688 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.atomic_flush: 0 2024-06-06T03:15:59.688 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-06-06T03:15:59.688 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.persist_stats_to_disk: 0 2024-06-06T03:15:59.688 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.write_dbid_to_manifest: 0 2024-06-06T03:15:59.688 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.log_readahead_size: 0 2024-06-06T03:15:59.689 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-06-06T03:15:59.689 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.best_efforts_recovery: 0 2024-06-06T03:15:59.689 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-06-06T03:15:59.689 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-06-06T03:15:59.689 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.allow_data_in_errors: 0 2024-06-06T03:15:59.689 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.db_host_id: __hostname__ 2024-06-06T03:15:59.689 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.enforce_single_del_contracts: true 2024-06-06T03:15:59.689 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.max_background_jobs: 2 2024-06-06T03:15:59.689 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.max_background_compactions: -1 2024-06-06T03:15:59.689 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.max_subcompactions: 1 2024-06-06T03:15:59.689 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-06-06T03:15:59.689 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-06-06T03:15:59.689 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.delayed_write_rate : 16777216 2024-06-06T03:15:59.689 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.max_total_wal_size: 0 2024-06-06T03:15:59.689 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-06-06T03:15:59.690 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.stats_dump_period_sec: 600 2024-06-06T03:15:59.690 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.stats_persist_period_sec: 600 2024-06-06T03:15:59.690 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-06-06T03:15:59.690 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.max_open_files: -1 2024-06-06T03:15:59.690 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.bytes_per_sync: 0 2024-06-06T03:15:59.690 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.wal_bytes_per_sync: 0 2024-06-06T03:15:59.690 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.strict_bytes_per_sync: 0 2024-06-06T03:15:59.690 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.compaction_readahead_size: 0 2024-06-06T03:15:59.690 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.max_background_flushes: -1 2024-06-06T03:15:59.690 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Compression algorithms supported: 2024-06-06T03:15:59.690 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-06-06T03:15:59.690 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: kZSTD supported: 0 2024-06-06T03:15:59.690 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: kXpressCompression supported: 0 2024-06-06T03:15:59.694 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: kLZ4HCCompression supported: 1 2024-06-06T03:15:59.694 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: kZlibCompression supported: 1 2024-06-06T03:15:59.694 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: kSnappyCompression supported: 1 2024-06-06T03:15:59.694 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: kLZ4Compression supported: 1 2024-06-06T03:15:59.694 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: kBZip2Compression supported: 0 2024-06-06T03:15:59.694 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Fast CRC32 supported: Supported on x86 2024-06-06T03:15:59.695 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: DMutex implementation: pthread_mutex_t 2024-06-06T03:15:59.695 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-06-06T03:15:59.695 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-06-06T03:15:59.695 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-06-06T03:15:59.695 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.merge_operator: 2024-06-06T03:15:59.695 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.compaction_filter: None 2024-06-06T03:15:59.695 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.compaction_filter_factory: None 2024-06-06T03:15:59.695 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.sst_partitioner_factory: None 2024-06-06T03:15:59.695 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.memtable_factory: SkipListFactory 2024-06-06T03:15:59.695 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.table_factory: BlockBasedTable 2024-06-06T03:15:59.695 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5599c4173c40) 2024-06-06T03:15:59.695 INFO:journalctl@ceph.mon.c.smithi122.stdout: cache_index_and_filter_blocks: 1 2024-06-06T03:15:59.695 INFO:journalctl@ceph.mon.c.smithi122.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-06-06T03:15:59.695 INFO:journalctl@ceph.mon.c.smithi122.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-06-06T03:15:59.696 INFO:journalctl@ceph.mon.c.smithi122.stdout: pin_top_level_index_and_filter: 1 2024-06-06T03:15:59.696 INFO:journalctl@ceph.mon.c.smithi122.stdout: index_type: 0 2024-06-06T03:15:59.696 INFO:journalctl@ceph.mon.c.smithi122.stdout: data_block_index_type: 0 2024-06-06T03:15:59.696 INFO:journalctl@ceph.mon.c.smithi122.stdout: index_shortening: 1 2024-06-06T03:15:59.696 INFO:journalctl@ceph.mon.c.smithi122.stdout: data_block_hash_table_util_ratio: 0.750000 2024-06-06T03:15:59.696 INFO:journalctl@ceph.mon.c.smithi122.stdout: checksum: 4 2024-06-06T03:15:59.696 INFO:journalctl@ceph.mon.c.smithi122.stdout: no_block_cache: 0 2024-06-06T03:15:59.696 INFO:journalctl@ceph.mon.c.smithi122.stdout: block_cache: 0x5599c4175090 2024-06-06T03:15:59.696 INFO:journalctl@ceph.mon.c.smithi122.stdout: block_cache_name: BinnedLRUCache 2024-06-06T03:15:59.696 INFO:journalctl@ceph.mon.c.smithi122.stdout: block_cache_options: 2024-06-06T03:15:59.696 INFO:journalctl@ceph.mon.c.smithi122.stdout: capacity : 536870912 2024-06-06T03:15:59.696 INFO:journalctl@ceph.mon.c.smithi122.stdout: num_shard_bits : 4 2024-06-06T03:15:59.696 INFO:journalctl@ceph.mon.c.smithi122.stdout: strict_capacity_limit : 0 2024-06-06T03:15:59.696 INFO:journalctl@ceph.mon.c.smithi122.stdout: high_pri_pool_ratio: 0.000 2024-06-06T03:15:59.696 INFO:journalctl@ceph.mon.c.smithi122.stdout: block_cache_compressed: (nil) 2024-06-06T03:15:59.697 INFO:journalctl@ceph.mon.c.smithi122.stdout: persistent_cache: (nil) 2024-06-06T03:15:59.697 INFO:journalctl@ceph.mon.c.smithi122.stdout: block_size: 4096 2024-06-06T03:15:59.697 INFO:journalctl@ceph.mon.c.smithi122.stdout: block_size_deviation: 10 2024-06-06T03:15:59.697 INFO:journalctl@ceph.mon.c.smithi122.stdout: block_restart_interval: 16 2024-06-06T03:15:59.697 INFO:journalctl@ceph.mon.c.smithi122.stdout: index_block_restart_interval: 1 2024-06-06T03:15:59.697 INFO:journalctl@ceph.mon.c.smithi122.stdout: metadata_block_size: 4096 2024-06-06T03:15:59.697 INFO:journalctl@ceph.mon.c.smithi122.stdout: partition_filters: 0 2024-06-06T03:15:59.697 INFO:journalctl@ceph.mon.c.smithi122.stdout: use_delta_encoding: 1 2024-06-06T03:15:59.697 INFO:journalctl@ceph.mon.c.smithi122.stdout: filter_policy: bloomfilter 2024-06-06T03:15:59.697 INFO:journalctl@ceph.mon.c.smithi122.stdout: whole_key_filtering: 1 2024-06-06T03:15:59.697 INFO:journalctl@ceph.mon.c.smithi122.stdout: verify_compression: 0 2024-06-06T03:15:59.697 INFO:journalctl@ceph.mon.c.smithi122.stdout: read_amp_bytes_per_bit: 0 2024-06-06T03:15:59.697 INFO:journalctl@ceph.mon.c.smithi122.stdout: format_version: 5 2024-06-06T03:15:59.697 INFO:journalctl@ceph.mon.c.smithi122.stdout: enable_index_compression: 1 2024-06-06T03:15:59.698 INFO:journalctl@ceph.mon.c.smithi122.stdout: block_align: 0 2024-06-06T03:15:59.698 INFO:journalctl@ceph.mon.c.smithi122.stdout: max_auto_readahead_size: 262144 2024-06-06T03:15:59.698 INFO:journalctl@ceph.mon.c.smithi122.stdout: prepopulate_block_cache: 0 2024-06-06T03:15:59.698 INFO:journalctl@ceph.mon.c.smithi122.stdout: initial_auto_readahead_size: 8192 2024-06-06T03:15:59.698 INFO:journalctl@ceph.mon.c.smithi122.stdout: num_file_reads_for_auto_readahead: 2 2024-06-06T03:15:59.698 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.write_buffer_size: 33554432 2024-06-06T03:15:59.698 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.max_write_buffer_number: 2 2024-06-06T03:15:59.698 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.compression: NoCompression 2024-06-06T03:15:59.698 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.bottommost_compression: Disabled 2024-06-06T03:15:59.698 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.prefix_extractor: nullptr 2024-06-06T03:15:59.698 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-06-06T03:15:59.698 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.num_levels: 7 2024-06-06T03:15:59.698 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-06-06T03:15:59.698 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-06-06T03:15:59.699 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-06-06T03:15:59.699 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-06-06T03:15:59.699 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-06-06T03:15:59.699 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-06-06T03:15:59.699 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-06-06T03:15:59.699 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-06-06T03:15:59.699 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-06-06T03:15:59.699 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-06-06T03:15:59.699 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-06-06T03:15:59.699 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-06-06T03:15:59.699 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.compression_opts.window_bits: -14 2024-06-06T03:15:59.699 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.compression_opts.level: 32767 2024-06-06T03:15:59.699 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.compression_opts.strategy: 0 2024-06-06T03:15:59.699 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-06-06T03:15:59.700 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-06-06T03:15:59.700 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-06-06T03:15:59.700 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-06-06T03:15:59.700 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.compression_opts.enabled: false 2024-06-06T03:15:59.700 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-06-06T03:15:59.700 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-06-06T03:15:59.700 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-06-06T03:15:59.700 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-06-06T03:15:59.700 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.target_file_size_base: 67108864 2024-06-06T03:15:59.700 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.target_file_size_multiplier: 1 2024-06-06T03:15:59.700 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-06-06T03:15:59.700 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-06-06T03:15:59.700 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-06-06T03:15:59.700 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-06-06T03:15:59.700 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-06-06T03:15:59.701 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-06-06T03:15:59.701 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-06-06T03:15:59.701 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-06-06T03:15:59.701 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-06-06T03:15:59.701 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-06-06T03:15:59.701 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-06-06T03:15:59.701 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-06-06T03:15:59.701 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-06-06T03:15:59.701 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.arena_block_size: 1048576 2024-06-06T03:15:59.701 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-06-06T03:15:59.701 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-06-06T03:15:59.701 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.disable_auto_compactions: 0 2024-06-06T03:15:59.701 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-06-06T03:15:59.701 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-06-06T03:15:59.702 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-06-06T03:15:59.702 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-06-06T03:15:59.702 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-06-06T03:15:59.702 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-06-06T03:15:59.702 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-06-06T03:15:59.702 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-06-06T03:15:59.702 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-06-06T03:15:59.702 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-06-06T03:15:59.702 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.table_properties_collectors: 2024-06-06T03:15:59.702 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.inplace_update_support: 0 2024-06-06T03:15:59.702 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.inplace_update_num_locks: 10000 2024-06-06T03:15:59.702 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-06-06T03:15:59.702 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-06-06T03:15:59.702 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.memtable_huge_page_size: 0 2024-06-06T03:15:59.703 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.bloom_locality: 0 2024-06-06T03:15:59.703 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.max_successive_merges: 0 2024-06-06T03:15:59.703 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.optimize_filters_for_hits: 0 2024-06-06T03:15:59.703 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.paranoid_file_checks: 0 2024-06-06T03:15:59.703 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.force_consistency_checks: 1 2024-06-06T03:15:59.703 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.report_bg_io_stats: 0 2024-06-06T03:15:59.703 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.ttl: 2592000 2024-06-06T03:15:59.703 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.periodic_compaction_seconds: 0 2024-06-06T03:15:59.703 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-06-06T03:15:59.703 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-06-06T03:15:59.703 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.enable_blob_files: false 2024-06-06T03:15:59.703 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.min_blob_size: 0 2024-06-06T03:15:59.703 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.blob_file_size: 268435456 2024-06-06T03:15:59.703 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.blob_compression_type: NoCompression 2024-06-06T03:15:59.704 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.enable_blob_garbage_collection: false 2024-06-06T03:15:59.704 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-06-06T03:15:59.704 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-06-06T03:15:59.704 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-06-06T03:15:59.704 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.blob_file_starting_level: 0 2024-06-06T03:15:59.704 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-06-06T03:15:59.704 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-06-06T03:15:59.704 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-06-06T03:15:59.704 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: dbd247ad-1184-4707-8cc2-4ff53bcc1bb9 2024-06-06T03:15:59.704 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717643759236125, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-06-06T03:15:59.704 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-06-06T03:15:59.704 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717643759236681, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1717643759, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "dbd247ad-1184-4707-8cc2-4ff53bcc1bb9", "db_session_id": "47NI4T7QR808SRDTEASS", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-06-06T03:15:59.704 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717643759236787, "job": 1, "event": "recovery_finished"} 2024-06-06T03:15:59.704 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-06-06T03:15:59.705 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-06-06T03:15:59.705 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5599c4264000 2024-06-06T03:15:59.705 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: DB pointer 0x5599c424e000 2024-06-06T03:15:59.705 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-06-06T03:15:59.705 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-06-06T03:15:59.705 INFO:journalctl@ceph.mon.c.smithi122.stdout: ** DB Stats ** 2024-06-06T03:15:59.705 INFO:journalctl@ceph.mon.c.smithi122.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-06T03:15:59.705 INFO:journalctl@ceph.mon.c.smithi122.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-06-06T03:15:59.705 INFO:journalctl@ceph.mon.c.smithi122.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-06T03:15:59.705 INFO:journalctl@ceph.mon.c.smithi122.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-06T03:15:59.705 INFO:journalctl@ceph.mon.c.smithi122.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-06-06T03:15:59.705 INFO:journalctl@ceph.mon.c.smithi122.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-06T03:15:59.705 INFO:journalctl@ceph.mon.c.smithi122.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-06T03:15:59.705 INFO:journalctl@ceph.mon.c.smithi122.stdout: 2024-06-06T03:15:59.705 INFO:journalctl@ceph.mon.c.smithi122.stdout: ** Compaction Stats [default] ** 2024-06-06T03:15:59.706 INFO:journalctl@ceph.mon.c.smithi122.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-06T03:15:59.706 INFO:journalctl@ceph.mon.c.smithi122.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-06-06T03:15:59.706 INFO:journalctl@ceph.mon.c.smithi122.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-06T03:15:59.706 INFO:journalctl@ceph.mon.c.smithi122.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-06T03:15:59.706 INFO:journalctl@ceph.mon.c.smithi122.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-06T03:15:59.706 INFO:journalctl@ceph.mon.c.smithi122.stdout: 2024-06-06T03:15:59.706 INFO:journalctl@ceph.mon.c.smithi122.stdout: ** Compaction Stats [default] ** 2024-06-06T03:15:59.706 INFO:journalctl@ceph.mon.c.smithi122.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-06T03:15:59.706 INFO:journalctl@ceph.mon.c.smithi122.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-06T03:15:59.706 INFO:journalctl@ceph.mon.c.smithi122.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-06T03:15:59.706 INFO:journalctl@ceph.mon.c.smithi122.stdout: 2024-06-06T03:15:59.706 INFO:journalctl@ceph.mon.c.smithi122.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-06-06T03:15:59.706 INFO:journalctl@ceph.mon.c.smithi122.stdout: 2024-06-06T03:15:59.707 INFO:journalctl@ceph.mon.c.smithi122.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-06T03:15:59.707 INFO:journalctl@ceph.mon.c.smithi122.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-06-06T03:15:59.707 INFO:journalctl@ceph.mon.c.smithi122.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-06T03:15:59.707 INFO:journalctl@ceph.mon.c.smithi122.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-06T03:15:59.707 INFO:journalctl@ceph.mon.c.smithi122.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-06T03:15:59.707 INFO:journalctl@ceph.mon.c.smithi122.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-06T03:15:59.707 INFO:journalctl@ceph.mon.c.smithi122.stdout: Cumulative compaction: 0.00 GB write, 0.43 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-06T03:15:59.707 INFO:journalctl@ceph.mon.c.smithi122.stdout: Interval compaction: 0.00 GB write, 0.43 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-06T03:15:59.707 INFO:journalctl@ceph.mon.c.smithi122.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-06T03:15:59.707 INFO:journalctl@ceph.mon.c.smithi122.stdout: Block cache BinnedLRUCache@0x5599c4175090#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-06-06T03:15:59.707 INFO:journalctl@ceph.mon.c.smithi122.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-06-06T03:15:59.707 INFO:journalctl@ceph.mon.c.smithi122.stdout: 2024-06-06T03:15:59.707 INFO:journalctl@ceph.mon.c.smithi122.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-06T03:15:59.707 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-06-06T03:15:59.707 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: using public_addr v2:172.21.15.122:0/0 -> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] 2024-06-06T03:15:59.708 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: starting mon.c rank -1 at public addrs [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] at bind addrs [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:15:59.708 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: mon.c@-1(???) e0 preinit fsid b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:15:59.708 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: mon.c@-1(synchronizing).mds e1 new map 2024-06-06T03:15:59.708 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: mon.c@-1(synchronizing).mds e1 print_map 2024-06-06T03:15:59.708 INFO:journalctl@ceph.mon.c.smithi122.stdout: e1 2024-06-06T03:15:59.708 INFO:journalctl@ceph.mon.c.smithi122.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-06T03:15:59.708 INFO:journalctl@ceph.mon.c.smithi122.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-06T03:15:59.708 INFO:journalctl@ceph.mon.c.smithi122.stdout: legacy client fscid: -1 2024-06-06T03:15:59.708 INFO:journalctl@ceph.mon.c.smithi122.stdout: 2024-06-06T03:15:59.708 INFO:journalctl@ceph.mon.c.smithi122.stdout: No filesystems configured 2024-06-06T03:15:59.708 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-06-06T03:15:59.708 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-06-06T03:15:59.708 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-06-06T03:15:59.708 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-06-06T03:15:59.709 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-06-06T03:15:59.709 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-06-06T03:15:59.709 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-06-06T03:15:59.709 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-06T03:15:59.709 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-06T03:15:59.709 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-06T03:15:59.709 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:15:59.709 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi122", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:15:59.709 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:59.709 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:59.709 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:59.709 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:59.709 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi079", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:15:59.709 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:15:59.710 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:15:59.710 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:15:59.710 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: Deploying cephadm binary to smithi122 2024-06-06T03:15:59.710 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: Updating smithi079:/etc/ceph/ceph.conf 2024-06-06T03:15:59.710 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: Updating smithi079:/var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T03:15:59.710 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:15:59.710 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:59.710 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:59.710 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:59.710 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2024-06-06T03:15:59.710 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: Updating smithi079:/var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-06T03:15:59.710 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:59.710 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:15:59.710 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:59.710 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:15:59.711 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: Added host smithi122 2024-06-06T03:15:59.711 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:59.711 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:15:59.711 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:59.711 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T03:15:59.711 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:15:59.711 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/3509714609' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-06-06T03:15:59.711 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/3509714609' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-06-06T03:15:59.711 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: osdmap e4: 0 total, 0 up, 0 in 2024-06-06T03:15:59.711 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:59.711 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:59.711 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:59.711 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:59.711 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi122", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:15:59.712 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:15:59.712 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:15:59.712 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: Updating smithi122:/etc/ceph/ceph.conf 2024-06-06T03:15:59.712 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: Updating smithi122:/var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T03:15:59.712 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:15:59.712 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: Updating smithi122:/etc/ceph/ceph.client.admin.keyring 2024-06-06T03:15:59.712 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: Updating smithi122:/var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-06T03:15:59.712 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:59.712 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:59.712 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:59.712 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:15:59.712 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi050:172.21.15.50=a;smithi079:172.21.15.79=b;smithi122:172.21.15.122=c", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:15:59.713 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: Saving service mon spec with placement smithi050:172.21.15.50=a;smithi079:172.21.15.79=b;smithi122:172.21.15.122=c;count:3 2024-06-06T03:15:59.713 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:59.713 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:15:59.713 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:15:59.713 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:15:59.713 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:15:59.713 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T03:15:59.713 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:15:59.713 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: Deploying daemon mon.c on smithi122 2024-06-06T03:15:59.713 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:15:59.713 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:15:59.713 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: from='client.? 172.21.15.122:0/43715579' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-06T03:15:59.713 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 ceph-mon[35759]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-06-06T03:15:59.713 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 bash[35740]: ef50acc7ae0464499a80d90f1c89ab1a2d0eed3838948dc960becef95c58cf6e 2024-06-06T03:15:59.714 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:15:59 smithi122 systemd[1]: Started Ceph mon.c for b6263b26-23b2-11ef-bc9b-c7b262605968. 2024-06-06T03:15:59.828 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-06T03:15:59.828 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-06T03:16:00.062 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T03:16:04.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.470+0000 7f6fe963e700 1 -- 172.21.15.122:0/874136125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fe4102210 msgr2=0x7f6fd0005610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:16:04.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.470+0000 7f6fe963e700 1 --2- 172.21.15.122:0/874136125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fe4102210 0x7f6fd0005610 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4005fa0 tx=0x7f6fd400ffc0 comp rx=0 tx=0).stop 2024-06-06T03:16:04.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.470+0000 7f6fe963e700 1 -- 172.21.15.122:0/874136125 shutdown_connections 2024-06-06T03:16:04.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.470+0000 7f6fe963e700 1 --2- 172.21.15.122:0/874136125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fe4102210 0x7f6fd0005610 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:04.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.470+0000 7f6fe963e700 1 -- 172.21.15.122:0/874136125 >> 172.21.15.122:0/874136125 conn(0x7f6fe40fdaa0 msgr2=0x7f6fe40ffec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:16:04.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.470+0000 7f6fe963e700 1 -- 172.21.15.122:0/874136125 shutdown_connections 2024-06-06T03:16:04.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.470+0000 7f6fe963e700 1 -- 172.21.15.122:0/874136125 wait complete. 2024-06-06T03:16:04.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.471+0000 7f6fe963e700 1 Processor -- start 2024-06-06T03:16:04.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.471+0000 7f6fe963e700 1 -- start start 2024-06-06T03:16:04.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.471+0000 7f6fe963e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fe4102210 0x7f6fe419d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:16:04.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.471+0000 7f6fe963e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6fe419dc10 0x7f6fe4197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:16:04.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.471+0000 7f6fe963e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe4109ef0 con 0x7f6fe4102210 2024-06-06T03:16:04.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.472+0000 7f6fe963e700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe4109d70 con 0x7f6fe419dc10 2024-06-06T03:16:04.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.472+0000 7f6fda7fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6fe419dc10 0x7f6fe4197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:16:04.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.472+0000 7f6fda7fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6fe419dc10 0x7f6fe4197890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45224/0 (socket says 172.21.15.122:45224) 2024-06-06T03:16:04.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.472+0000 7f6fda7fc700 1 -- 172.21.15.122:0/1706107754 learned_addr learned my addr 172.21.15.122:0/1706107754 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-06-06T03:16:04.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.472+0000 7f6fe2ffd700 1 --2- 172.21.15.122:0/1706107754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fe4102210 0x7f6fe419d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:16:04.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.472+0000 7f6fda7fc700 1 -- 172.21.15.122:0/1706107754 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6fe419dc10 msgr2=0x7f6fe4197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-06-06T03:16:04.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.472+0000 7f6fda7fc700 1 -- 172.21.15.122:0/1706107754 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6fe419dc10 msgr2=0x7f6fe4197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-06-06T03:16:04.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.472+0000 7f6fda7fc700 1 --2- 172.21.15.122:0/1706107754 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6fe419dc10 0x7f6fe4197890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-06T03:16:04.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.472+0000 7f6fda7fc700 1 --2- 172.21.15.122:0/1706107754 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6fe419dc10 0x7f6fe4197890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-06T03:16:04.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.472+0000 7f6fe2ffd700 1 -- 172.21.15.122:0/1706107754 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6fe419dc10 msgr2=0x7f6fe4197890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T03:16:04.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.472+0000 7f6fe2ffd700 1 --2- 172.21.15.122:0/1706107754 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6fe419dc10 0x7f6fe4197890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:04.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.472+0000 7f6fe2ffd700 1 -- 172.21.15.122:0/1706107754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe419e250 con 0x7f6fe4102210 2024-06-06T03:16:04.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.472+0000 7f6fe2ffd700 1 --2- 172.21.15.122:0/1706107754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fe4102210 0x7f6fe419d6d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40137f0 tx=0x7f6fd4004d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:16:04.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.473+0000 7f6fe0ff9700 1 -- 172.21.15.122:0/1706107754 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f6fd40052f0 con 0x7f6fe4102210 2024-06-06T03:16:04.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.473+0000 7f6fe0ff9700 1 -- 172.21.15.122:0/1706107754 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6fd4005490 con 0x7f6fe4102210 2024-06-06T03:16:04.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.473+0000 7f6fe963e700 1 -- 172.21.15.122:0/1706107754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fe4197dd0 con 0x7f6fe4102210 2024-06-06T03:16:04.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.473+0000 7f6fe0ff9700 1 -- 172.21.15.122:0/1706107754 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f6fd4011670 con 0x7f6fe4102210 2024-06-06T03:16:04.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.473+0000 7f6fe963e700 1 -- 172.21.15.122:0/1706107754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fe4198360 con 0x7f6fe4102210 2024-06-06T03:16:04.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.474+0000 7f6fe0ff9700 1 -- 172.21.15.122:0/1706107754 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f6fd4011810 con 0x7f6fe4102210 2024-06-06T03:16:04.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.474+0000 7f6fe963e700 1 -- 172.21.15.122:0/1706107754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fe41036f0 con 0x7f6fe4102210 2024-06-06T03:16:04.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.474+0000 7f6fe0ff9700 1 --2- 172.21.15.122:0/1706107754 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6fc4038f00 0x7f6fc403b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:16:04.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.474+0000 7f6fe0ff9700 1 -- 172.21.15.122:0/1706107754 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6fd404e720 con 0x7f6fe4102210 2024-06-06T03:16:04.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.474+0000 7f6fda7fc700 1 --2- 172.21.15.122:0/1706107754 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6fc4038f00 0x7f6fc403b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:16:04.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.475+0000 7f6fda7fc700 1 --2- 172.21.15.122:0/1706107754 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6fc4038f00 0x7f6fc403b3c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc009180 tx=0x7f6fcc008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:16:04.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.480+0000 7f6fe0ff9700 1 -- 172.21.15.122:0/1706107754 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6fd4022070 con 0x7f6fe4102210 2024-06-06T03:16:04.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:04 smithi122 ceph-mon[35759]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:04.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:04 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T03:16:04.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:04 smithi122 ceph-mon[35759]: mon.a calling monitor election 2024-06-06T03:16:04.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:04 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T03:16:04.684 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:04 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T03:16:04.684 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:04 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T03:16:04.684 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:04 smithi122 ceph-mon[35759]: mon.c calling monitor election 2024-06-06T03:16:04.684 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:04 smithi122 ceph-mon[35759]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:04.684 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:04 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T03:16:04.685 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:04 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T03:16:04.685 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:04 smithi122 ceph-mon[35759]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:04.685 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:04 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T03:16:04.685 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:04 smithi122 ceph-mon[35759]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-06T03:16:04.685 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:04 smithi122 ceph-mon[35759]: monmap epoch 2 2024-06-06T03:16:04.685 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:04 smithi122 ceph-mon[35759]: fsid b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:16:04.685 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:04 smithi122 ceph-mon[35759]: last_changed 2024-06-06T03:15:59.261191+0000 2024-06-06T03:16:04.685 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:04 smithi122 ceph-mon[35759]: created 2024-06-06T03:14:13.774178+0000 2024-06-06T03:16:04.685 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:04 smithi122 ceph-mon[35759]: min_mon_release 19 (squid) 2024-06-06T03:16:04.686 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:04 smithi122 ceph-mon[35759]: election_strategy: 1 2024-06-06T03:16:04.686 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:04 smithi122 ceph-mon[35759]: 0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-06-06T03:16:04.686 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:04 smithi122 ceph-mon[35759]: 1: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.c 2024-06-06T03:16:04.688 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:04 smithi122 ceph-mon[35759]: fsmap 2024-06-06T03:16:04.688 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:04 smithi122 ceph-mon[35759]: osdmap e4: 0 total, 0 up, 0 in 2024-06-06T03:16:04.689 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:04 smithi122 ceph-mon[35759]: mgrmap e13: x(active, since 51s) 2024-06-06T03:16:04.689 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:04 smithi122 ceph-mon[35759]: overall HEALTH_OK 2024-06-06T03:16:04.689 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:04 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:04.689 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:04 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:04.690 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:04 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:04.690 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:04 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T03:16:04.690 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:04 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:04.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:04 smithi050 ceph-mon[32421]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:04.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:04 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T03:16:04.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:04 smithi050 ceph-mon[32421]: mon.a calling monitor election 2024-06-06T03:16:04.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:04 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T03:16:04.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:04 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T03:16:04.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:04 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T03:16:04.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:04 smithi050 ceph-mon[32421]: mon.c calling monitor election 2024-06-06T03:16:04.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:04 smithi050 ceph-mon[32421]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:04.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:04 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T03:16:04.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:04 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T03:16:04.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:04 smithi050 ceph-mon[32421]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:04.754 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:04 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T03:16:04.754 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:04 smithi050 ceph-mon[32421]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-06T03:16:04.754 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:04 smithi050 ceph-mon[32421]: monmap epoch 2 2024-06-06T03:16:04.754 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:04 smithi050 ceph-mon[32421]: fsid b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:16:04.754 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:04 smithi050 ceph-mon[32421]: last_changed 2024-06-06T03:15:59.261191+0000 2024-06-06T03:16:04.754 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:04 smithi050 ceph-mon[32421]: created 2024-06-06T03:14:13.774178+0000 2024-06-06T03:16:04.755 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:04 smithi050 ceph-mon[32421]: min_mon_release 19 (squid) 2024-06-06T03:16:04.755 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:04 smithi050 ceph-mon[32421]: election_strategy: 1 2024-06-06T03:16:04.756 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:04 smithi050 ceph-mon[32421]: 0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-06-06T03:16:04.756 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:04 smithi050 ceph-mon[32421]: 1: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.c 2024-06-06T03:16:04.757 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:04 smithi050 ceph-mon[32421]: fsmap 2024-06-06T03:16:04.757 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:04 smithi050 ceph-mon[32421]: osdmap e4: 0 total, 0 up, 0 in 2024-06-06T03:16:04.757 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:04 smithi050 ceph-mon[32421]: mgrmap e13: x(active, since 51s) 2024-06-06T03:16:04.757 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:04 smithi050 ceph-mon[32421]: overall HEALTH_OK 2024-06-06T03:16:04.757 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:04 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:04.757 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:04 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:04.758 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:04 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:04.758 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:04 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T03:16:04.758 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:04 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:04.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.762+0000 7f6fe963e700 1 -- 172.21.15.122:0/1706107754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f6fe4198dc0 con 0x7f6fe4102210 2024-06-06T03:16:04.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.762+0000 7f6fe0ff9700 1 -- 172.21.15.122:0/1706107754 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f6fd4019bb0 con 0x7f6fe4102210 2024-06-06T03:16:04.763 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-06-06T03:16:04.763 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":2,"fsid":"b6263b26-23b2-11ef-bc9b-c7b262605968","modified":"2024-06-06T03:15:59.261191Z","created":"2024-06-06T03:14:13.774178Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:3300","nonce":0},{"type":"v1","addr":"172.21.15.50:6789","nonce":0}]},"addr":"172.21.15.50:6789/0","public_addr":"172.21.15.50:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:3300","nonce":0},{"type":"v1","addr":"172.21.15.122:6789","nonce":0}]},"addr":"172.21.15.122:6789/0","public_addr":"172.21.15.122:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-06-06T03:16:04.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.764+0000 7f6fe963e700 1 -- 172.21.15.122:0/1706107754 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6fc4038f00 msgr2=0x7f6fc403b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:16:04.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.764+0000 7f6fe963e700 1 --2- 172.21.15.122:0/1706107754 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6fc4038f00 0x7f6fc403b3c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc009180 tx=0x7f6fcc008040 comp rx=0 tx=0).stop 2024-06-06T03:16:04.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.764+0000 7f6fe963e700 1 -- 172.21.15.122:0/1706107754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fe4102210 msgr2=0x7f6fe419d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:16:04.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.764+0000 7f6fe963e700 1 --2- 172.21.15.122:0/1706107754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fe4102210 0x7f6fe419d6d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40137f0 tx=0x7f6fd4004d60 comp rx=0 tx=0).stop 2024-06-06T03:16:04.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.764+0000 7f6fe963e700 1 -- 172.21.15.122:0/1706107754 shutdown_connections 2024-06-06T03:16:04.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.764+0000 7f6fe963e700 1 --2- 172.21.15.122:0/1706107754 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6fc4038f00 0x7f6fc403b3c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:04.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.764+0000 7f6fe963e700 1 --2- 172.21.15.122:0/1706107754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fe4102210 0x7f6fe419d6d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:04.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.764+0000 7f6fe963e700 1 --2- 172.21.15.122:0/1706107754 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6fe419dc10 0x7f6fe4197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:04.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.764+0000 7f6fe963e700 1 -- 172.21.15.122:0/1706107754 >> 172.21.15.122:0/1706107754 conn(0x7f6fe40fdaa0 msgr2=0x7f6fe40fee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:16:04.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.764+0000 7f6fe963e700 1 -- 172.21.15.122:0/1706107754 shutdown_connections 2024-06-06T03:16:04.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:04.764+0000 7f6fe963e700 1 -- 172.21.15.122:0/1706107754 wait complete. 2024-06-06T03:16:04.767 INFO:teuthology.orchestra.run.smithi122.stderr:dumped monmap epoch 2 2024-06-06T03:16:05.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:05 smithi122 ceph-mon[35759]: Deploying daemon mon.b on smithi079 2024-06-06T03:16:05.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:05 smithi122 ceph-mon[35759]: from='client.? 172.21.15.122:0/1706107754' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-06T03:16:05.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:05 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T03:16:05.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:05 smithi050 ceph-mon[32421]: Deploying daemon mon.b on smithi079 2024-06-06T03:16:05.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:05 smithi050 ceph-mon[32421]: from='client.? 172.21.15.122:0/1706107754' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-06T03:16:05.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:05 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T03:16:06.391 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-06T03:16:06.391 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-06T03:16:06.626 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T03:16:06.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:06 smithi122 ceph-mon[35759]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:06.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:06 smithi050 ceph-mon[32421]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:08.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.023+0000 7fe72b586700 1 -- 172.21.15.122:0/3775411527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7241010f0 msgr2=0x7fe7241014d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:16:08.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.023+0000 7fe72b586700 1 --2- 172.21.15.122:0/3775411527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7241010f0 0x7fe7241014d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe714009910 tx=0x7fe714009c20 comp rx=0 tx=0).stop 2024-06-06T03:16:08.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.023+0000 7fe72b586700 1 -- 172.21.15.122:0/3775411527 shutdown_connections 2024-06-06T03:16:08.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.023+0000 7fe72b586700 1 --2- 172.21.15.122:0/3775411527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7241010f0 0x7fe7241014d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:08.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.023+0000 7fe72b586700 1 -- 172.21.15.122:0/3775411527 >> 172.21.15.122:0/3775411527 conn(0x7fe7240fc980 msgr2=0x7fe7240feda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:16:08.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.023+0000 7fe72b586700 1 -- 172.21.15.122:0/3775411527 shutdown_connections 2024-06-06T03:16:08.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.023+0000 7fe72b586700 1 -- 172.21.15.122:0/3775411527 wait complete. 2024-06-06T03:16:08.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.023+0000 7fe72b586700 1 Processor -- start 2024-06-06T03:16:08.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.023+0000 7fe72b586700 1 -- start start 2024-06-06T03:16:08.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.024+0000 7fe72b586700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7241010f0 0x7fe72419d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:16:08.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.024+0000 7fe72b586700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe72419dd10 0x7fe724197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:16:08.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.024+0000 7fe72b586700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe72410b370 con 0x7fe72419dd10 2024-06-06T03:16:08.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.024+0000 7fe72b586700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe72410b1f0 con 0x7fe7241010f0 2024-06-06T03:16:08.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.024+0000 7fe728b21700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe72419dd10 0x7fe724197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:16:08.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.024+0000 7fe728b21700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe72419dd10 0x7fe724197990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.122:39592/0 (socket says 172.21.15.122:39592) 2024-06-06T03:16:08.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.024+0000 7fe728b21700 1 -- 172.21.15.122:0/1298108048 learned_addr learned my addr 172.21.15.122:0/1298108048 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-06-06T03:16:08.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.024+0000 7fe729322700 1 --2- 172.21.15.122:0/1298108048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7241010f0 0x7fe72419d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:16:08.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.024+0000 7fe729322700 1 -- 172.21.15.122:0/1298108048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7241010f0 msgr2=0x7fe72419d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-06-06T03:16:08.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.024+0000 7fe729322700 1 -- 172.21.15.122:0/1298108048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7241010f0 msgr2=0x7fe72419d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-06-06T03:16:08.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.024+0000 7fe729322700 1 --2- 172.21.15.122:0/1298108048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7241010f0 0x7fe72419d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-06T03:16:08.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.024+0000 7fe729322700 1 --2- 172.21.15.122:0/1298108048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7241010f0 0x7fe72419d7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-06T03:16:08.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.024+0000 7fe728b21700 1 -- 172.21.15.122:0/1298108048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7241010f0 msgr2=0x7fe72419d7d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T03:16:08.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.024+0000 7fe728b21700 1 --2- 172.21.15.122:0/1298108048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7241010f0 0x7fe72419d7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:08.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.024+0000 7fe728b21700 1 -- 172.21.15.122:0/1298108048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe72419e350 con 0x7fe72419dd10 2024-06-06T03:16:08.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.024+0000 7fe728b21700 1 --2- 172.21.15.122:0/1298108048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe72419dd10 0x7fe724197990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe72000b700 tx=0x7fe72000bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:16:08.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.025+0000 7fe71a7fc700 1 -- 172.21.15.122:0/1298108048 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fe720011630 con 0x7fe72419dd10 2024-06-06T03:16:08.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.025+0000 7fe71a7fc700 1 -- 172.21.15.122:0/1298108048 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe720011c80 con 0x7fe72419dd10 2024-06-06T03:16:08.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.025+0000 7fe72b586700 1 -- 172.21.15.122:0/1298108048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe724197ed0 con 0x7fe72419dd10 2024-06-06T03:16:08.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.025+0000 7fe71a7fc700 1 -- 172.21.15.122:0/1298108048 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fe720010da0 con 0x7fe72419dd10 2024-06-06T03:16:08.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.025+0000 7fe72b586700 1 -- 172.21.15.122:0/1298108048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe724198460 con 0x7fe72419dd10 2024-06-06T03:16:08.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.025+0000 7fe72b586700 1 -- 172.21.15.122:0/1298108048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7241025d0 con 0x7fe72419dd10 2024-06-06T03:16:08.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.026+0000 7fe71a7fc700 1 -- 172.21.15.122:0/1298108048 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fe720018020 con 0x7fe72419dd10 2024-06-06T03:16:08.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.026+0000 7fe71a7fc700 1 --2- 172.21.15.122:0/1298108048 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe710038e90 0x7fe71003b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:16:08.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.026+0000 7fe71a7fc700 1 -- 172.21.15.122:0/1298108048 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe72004be00 con 0x7fe72419dd10 2024-06-06T03:16:08.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.026+0000 7fe729322700 1 --2- 172.21.15.122:0/1298108048 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe710038e90 0x7fe71003b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:16:08.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.026+0000 7fe729322700 1 --2- 172.21.15.122:0/1298108048 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe710038e90 0x7fe71003b350 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe71400b5c0 tx=0x7fe71401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:16:08.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.031+0000 7fe71a7fc700 1 -- 172.21.15.122:0/1298108048 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe72001f020 con 0x7fe72419dd10 2024-06-06T03:16:08.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.200+0000 7fe71a7fc700 1 -- 172.21.15.122:0/1298108048 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7200177d0 con 0x7fe72419dd10 2024-06-06T03:16:08.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:08.310+0000 7fe72b586700 1 -- 172.21.15.122:0/1298108048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fe724198f60 con 0x7fe72419dd10 2024-06-06T03:16:08.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:08 smithi079 systemd[1]: Started Ceph mon.b for b6263b26-23b2-11ef-bc9b-c7b262605968. 2024-06-06T03:16:13.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:13.209+0000 7fe71a7fc700 1 -- 172.21.15.122:0/1298108048 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1279 (secure 0 0 0) 0x7fe720018770 con 0x7fe72419dd10 2024-06-06T03:16:13.209 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-06-06T03:16:13.209 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":3,"fsid":"b6263b26-23b2-11ef-bc9b-c7b262605968","modified":"2024-06-06T03:16:08.200329Z","created":"2024-06-06T03:14:13.774178Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:3300","nonce":0},{"type":"v1","addr":"172.21.15.50:6789","nonce":0}]},"addr":"172.21.15.50:6789/0","public_addr":"172.21.15.50:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:3300","nonce":0},{"type":"v1","addr":"172.21.15.122:6789","nonce":0}]},"addr":"172.21.15.122:6789/0","public_addr":"172.21.15.122:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-06-06T03:16:13.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:13.212+0000 7fe72b586700 1 -- 172.21.15.122:0/1298108048 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe710038e90 msgr2=0x7fe71003b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:16:13.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:13.212+0000 7fe72b586700 1 --2- 172.21.15.122:0/1298108048 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe710038e90 0x7fe71003b350 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe71400b5c0 tx=0x7fe71401a040 comp rx=0 tx=0).stop 2024-06-06T03:16:13.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:13.212+0000 7fe72b586700 1 -- 172.21.15.122:0/1298108048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe72419dd10 msgr2=0x7fe724197990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:16:13.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:13.212+0000 7fe72b586700 1 --2- 172.21.15.122:0/1298108048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe72419dd10 0x7fe724197990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe72000b700 tx=0x7fe72000bac0 comp rx=0 tx=0).stop 2024-06-06T03:16:13.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:13.212+0000 7fe72b586700 1 -- 172.21.15.122:0/1298108048 shutdown_connections 2024-06-06T03:16:13.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:13.212+0000 7fe72b586700 1 --2- 172.21.15.122:0/1298108048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7241010f0 0x7fe72419d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:13.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:13.212+0000 7fe72b586700 1 --2- 172.21.15.122:0/1298108048 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe710038e90 0x7fe71003b350 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:13.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:13.212+0000 7fe72b586700 1 --2- 172.21.15.122:0/1298108048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe72419dd10 0x7fe724197990 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:13.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:13.212+0000 7fe72b586700 1 -- 172.21.15.122:0/1298108048 >> 172.21.15.122:0/1298108048 conn(0x7fe7240fc980 msgr2=0x7fe72406a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:16:13.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:13.213+0000 7fe72b586700 1 -- 172.21.15.122:0/1298108048 shutdown_connections 2024-06-06T03:16:13.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:13.213+0000 7fe72b586700 1 -- 172.21.15.122:0/1298108048 wait complete. 2024-06-06T03:16:13.213 INFO:teuthology.orchestra.run.smithi122.stderr:dumped monmap epoch 3 2024-06-06T03:16:13.541 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:13 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T03:16:13.541 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:13 smithi122 ceph-mon[35759]: mon.a calling monitor election 2024-06-06T03:16:13.541 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:13 smithi122 ceph-mon[35759]: mon.c calling monitor election 2024-06-06T03:16:13.542 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:13 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:16:13.542 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:13 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T03:16:13.542 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:13 smithi122 ceph-mon[35759]: from='client.? 172.21.15.122:0/1298108048' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-06T03:16:13.542 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:13 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:16:13.542 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:13 smithi122 ceph-mon[35759]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:13.542 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:13 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:16:13.542 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:13 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:16:13.542 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:13 smithi122 ceph-mon[35759]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:13.542 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:13 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:16:13.542 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:13 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:16:13.542 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:13 smithi122 ceph-mon[35759]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-06T03:16:13.542 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:13 smithi122 ceph-mon[35759]: monmap epoch 3 2024-06-06T03:16:13.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:13 smithi122 ceph-mon[35759]: fsid b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:16:13.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:13 smithi122 ceph-mon[35759]: last_changed 2024-06-06T03:16:08.200329+0000 2024-06-06T03:16:13.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:13 smithi122 ceph-mon[35759]: created 2024-06-06T03:14:13.774178+0000 2024-06-06T03:16:13.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:13 smithi122 ceph-mon[35759]: min_mon_release 19 (squid) 2024-06-06T03:16:13.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:13 smithi122 ceph-mon[35759]: election_strategy: 1 2024-06-06T03:16:13.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:13 smithi122 ceph-mon[35759]: 0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-06-06T03:16:13.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:13 smithi122 ceph-mon[35759]: 1: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.c 2024-06-06T03:16:13.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:13 smithi122 ceph-mon[35759]: 2: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.b 2024-06-06T03:16:13.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:13 smithi122 ceph-mon[35759]: fsmap 2024-06-06T03:16:13.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:13 smithi122 ceph-mon[35759]: osdmap e4: 0 total, 0 up, 0 in 2024-06-06T03:16:13.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:13 smithi122 ceph-mon[35759]: mgrmap e13: x(active, since 59s) 2024-06-06T03:16:13.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:13 smithi122 ceph-mon[35759]: overall HEALTH_OK 2024-06-06T03:16:13.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:13 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:13.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:13 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:13.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:13 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:13.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:13 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:13.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T03:16:13.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:13 smithi050 ceph-mon[32421]: mon.a calling monitor election 2024-06-06T03:16:13.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:13 smithi050 ceph-mon[32421]: mon.c calling monitor election 2024-06-06T03:16:13.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:16:13.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T03:16:13.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:13 smithi050 ceph-mon[32421]: from='client.? 172.21.15.122:0/1298108048' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-06T03:16:13.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:16:13.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:13 smithi050 ceph-mon[32421]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:13.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:16:13.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:16:13.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:13 smithi050 ceph-mon[32421]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:13.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:16:13.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:16:13.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:13 smithi050 ceph-mon[32421]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-06T03:16:13.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:13 smithi050 ceph-mon[32421]: monmap epoch 3 2024-06-06T03:16:13.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:13 smithi050 ceph-mon[32421]: fsid b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:16:13.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:13 smithi050 ceph-mon[32421]: last_changed 2024-06-06T03:16:08.200329+0000 2024-06-06T03:16:13.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:13 smithi050 ceph-mon[32421]: created 2024-06-06T03:14:13.774178+0000 2024-06-06T03:16:13.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:13 smithi050 ceph-mon[32421]: min_mon_release 19 (squid) 2024-06-06T03:16:13.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:13 smithi050 ceph-mon[32421]: election_strategy: 1 2024-06-06T03:16:13.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:13 smithi050 ceph-mon[32421]: 0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-06-06T03:16:13.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:13 smithi050 ceph-mon[32421]: 1: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.c 2024-06-06T03:16:13.754 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:13 smithi050 ceph-mon[32421]: 2: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.b 2024-06-06T03:16:13.754 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:13 smithi050 ceph-mon[32421]: fsmap 2024-06-06T03:16:13.754 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:13 smithi050 ceph-mon[32421]: osdmap e4: 0 total, 0 up, 0 in 2024-06-06T03:16:13.754 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:13 smithi050 ceph-mon[32421]: mgrmap e13: x(active, since 59s) 2024-06-06T03:16:13.754 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:13 smithi050 ceph-mon[32421]: overall HEALTH_OK 2024-06-06T03:16:13.754 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:13.754 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:13.754 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:13.754 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:13.892 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-06-06T03:16:13.892 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph config generate-minimal-conf 2024-06-06T03:16:14.151 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:16:14.620 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:14 smithi050 ceph-mon[32421]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:14.620 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:14.620 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:16:14.620 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:16:14.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:14 smithi122 ceph-mon[35759]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:14.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:14.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:16:14.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:16:15.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T03:16:15.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: mon.a calling monitor election 2024-06-06T03:16:15.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: mon.c calling monitor election 2024-06-06T03:16:15.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:16:15.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T03:16:15.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: from='client.? 172.21.15.122:0/1298108048' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-06T03:16:15.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:16:15.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:15.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:16:15.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:16:15.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:15.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:16:15.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:16:15.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-06T03:16:15.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: monmap epoch 3 2024-06-06T03:16:15.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: fsid b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:16:15.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: last_changed 2024-06-06T03:16:08.200329+0000 2024-06-06T03:16:15.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: created 2024-06-06T03:14:13.774178+0000 2024-06-06T03:16:15.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: min_mon_release 19 (squid) 2024-06-06T03:16:15.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: election_strategy: 1 2024-06-06T03:16:15.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: 0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-06-06T03:16:15.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: 1: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.c 2024-06-06T03:16:15.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: 2: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.b 2024-06-06T03:16:15.602 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: fsmap 2024-06-06T03:16:15.602 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: osdmap e4: 0 total, 0 up, 0 in 2024-06-06T03:16:15.602 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: mgrmap e13: x(active, since 59s) 2024-06-06T03:16:15.602 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: overall HEALTH_OK 2024-06-06T03:16:15.602 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:15.602 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:15.602 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:15.602 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:15.602 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:15.602 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:15.602 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:16:15.602 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:16:15.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.770+0000 7f31c94da700 1 -- 172.21.15.50:0/471672301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31c40747b0 msgr2=0x7f31c4074b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:16:15.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.770+0000 7f31c94da700 1 --2- 172.21.15.50:0/471672301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31c40747b0 0x7f31c4074b90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f31b4009910 tx=0x7f31b4009c20 comp rx=0 tx=0).stop 2024-06-06T03:16:15.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.770+0000 7f31c94da700 1 -- 172.21.15.50:0/471672301 shutdown_connections 2024-06-06T03:16:15.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.770+0000 7f31c94da700 1 --2- 172.21.15.50:0/471672301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31c40747b0 0x7f31c4074b90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:15.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.770+0000 7f31c94da700 1 -- 172.21.15.50:0/471672301 >> 172.21.15.50:0/471672301 conn(0x7f31c40fd9f0 msgr2=0x7f31c40ffe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:16:15.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.770+0000 7f31c94da700 1 -- 172.21.15.50:0/471672301 shutdown_connections 2024-06-06T03:16:15.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.770+0000 7f31c94da700 1 -- 172.21.15.50:0/471672301 wait complete. 2024-06-06T03:16:15.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.770+0000 7f31c94da700 1 Processor -- start 2024-06-06T03:16:15.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.771+0000 7f31c94da700 1 -- start start 2024-06-06T03:16:15.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.771+0000 7f31c94da700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31c40747b0 0x7f31c4199e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:16:15.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.771+0000 7f31c94da700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31c419a3c0 0x7f31c419e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:16:15.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.771+0000 7f31c94da700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31c419ec90 0x7f31c419f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:16:15.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.771+0000 7f31c94da700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f31c410e600 con 0x7f31c419a3c0 2024-06-06T03:16:15.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.771+0000 7f31c94da700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f31c410e480 con 0x7f31c40747b0 2024-06-06T03:16:15.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.771+0000 7f31c94da700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f31c410e780 con 0x7f31c419ec90 2024-06-06T03:16:15.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.771+0000 7f31c27fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31c419a3c0 0x7f31c419e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:16:15.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.771+0000 7f31c27fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31c419a3c0 0x7f31c419e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60518/0 (socket says 172.21.15.50:60518) 2024-06-06T03:16:15.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.771+0000 7f31c27fc700 1 -- 172.21.15.50:0/1408575659 learned_addr learned my addr 172.21.15.50:0/1408575659 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:16:15.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.771+0000 7f31c2ffd700 1 --2- 172.21.15.50:0/1408575659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31c40747b0 0x7f31c4199e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:16:15.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.771+0000 7f31c37fe700 1 --2- 172.21.15.50:0/1408575659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31c419ec90 0x7f31c419f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:16:15.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.771+0000 7f31c27fc700 1 -- 172.21.15.50:0/1408575659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31c419ec90 msgr2=0x7f31c419f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:16:15.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.771+0000 7f31c27fc700 1 --2- 172.21.15.50:0/1408575659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31c419ec90 0x7f31c419f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:15.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.772+0000 7f31c27fc700 1 -- 172.21.15.50:0/1408575659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31c40747b0 msgr2=0x7f31c4199e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:16:15.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.772+0000 7f31c27fc700 1 --2- 172.21.15.50:0/1408575659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31c40747b0 0x7f31c4199e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:15.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.772+0000 7f31c27fc700 1 -- 172.21.15.50:0/1408575659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c41a6a00 con 0x7f31c419a3c0 2024-06-06T03:16:15.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.772+0000 7f31c2ffd700 1 --2- 172.21.15.50:0/1408575659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31c40747b0 0x7f31c4199e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:16:15.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.772+0000 7f31c27fc700 1 --2- 172.21.15.50:0/1408575659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31c419a3c0 0x7f31c419e750 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f31ac00b780 tx=0x7f31ac00bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:16:15.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.772+0000 7f31bbfff700 1 -- 172.21.15.50:0/1408575659 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ac004230 con 0x7f31c419a3c0 2024-06-06T03:16:15.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.772+0000 7f31bbfff700 1 -- 172.21.15.50:0/1408575659 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f31ac0043d0 con 0x7f31c419a3c0 2024-06-06T03:16:15.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.772+0000 7f31c94da700 1 -- 172.21.15.50:0/1408575659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31c41a6c30 con 0x7f31c419a3c0 2024-06-06T03:16:15.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.772+0000 7f31bbfff700 1 -- 172.21.15.50:0/1408575659 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ac011b80 con 0x7f31c419a3c0 2024-06-06T03:16:15.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.772+0000 7f31c94da700 1 -- 172.21.15.50:0/1408575659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31c41a71c0 con 0x7f31c419a3c0 2024-06-06T03:16:15.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.773+0000 7f31bbfff700 1 -- 172.21.15.50:0/1408575659 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f31ac01a400 con 0x7f31c419a3c0 2024-06-06T03:16:15.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.773+0000 7f31c94da700 1 -- 172.21.15.50:0/1408575659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31c4063af0 con 0x7f31c419a3c0 2024-06-06T03:16:15.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.773+0000 7f31bbfff700 1 --2- 172.21.15.50:0/1408575659 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f31b0039580 0x7f31b003ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:16:15.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.773+0000 7f31bbfff700 1 -- 172.21.15.50:0/1408575659 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f31ac04bd70 con 0x7f31c419a3c0 2024-06-06T03:16:15.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.774+0000 7f31c2ffd700 1 --2- 172.21.15.50:0/1408575659 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f31b0039580 0x7f31b003ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:16:15.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.774+0000 7f31c2ffd700 1 --2- 172.21.15.50:0/1408575659 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f31b0039580 0x7f31b003ba40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f31b4006010 tx=0x7f31b401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:16:15.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:15.778+0000 7f31bbfff700 1 -- 172.21.15.50:0/1408575659 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f31ac050070 con 0x7f31c419a3c0 2024-06-06T03:16:15.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: mon.b calling monitor election 2024-06-06T03:16:15.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: mon.b calling monitor election 2024-06-06T03:16:15.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: mon.a calling monitor election 2024-06-06T03:16:15.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: mon.c calling monitor election 2024-06-06T03:16:15.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-06T03:16:15.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: monmap epoch 3 2024-06-06T03:16:15.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: fsid b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:16:15.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: last_changed 2024-06-06T03:16:08.200329+0000 2024-06-06T03:16:15.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: created 2024-06-06T03:14:13.774178+0000 2024-06-06T03:16:15.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: min_mon_release 19 (squid) 2024-06-06T03:16:15.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: election_strategy: 1 2024-06-06T03:16:15.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: 0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-06-06T03:16:15.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: 1: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.c 2024-06-06T03:16:15.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: 2: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.b 2024-06-06T03:16:15.933 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: fsmap 2024-06-06T03:16:15.933 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: osdmap e4: 0 total, 0 up, 0 in 2024-06-06T03:16:15.933 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: mgrmap e13: x(active, since 61s) 2024-06-06T03:16:15.933 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: overall HEALTH_OK 2024-06-06T03:16:15.933 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:15.933 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:15.933 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:15.933 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:15.933 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:15.933 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:15.933 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:15.933 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:15.933 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:15.933 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:15.934 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:15.934 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T03:16:15.934 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-06T03:16:15.934 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:15 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:16.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: mon.b calling monitor election 2024-06-06T03:16:16.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: mon.b calling monitor election 2024-06-06T03:16:16.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: mon.a calling monitor election 2024-06-06T03:16:16.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: mon.c calling monitor election 2024-06-06T03:16:16.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-06T03:16:16.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: monmap epoch 3 2024-06-06T03:16:16.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: fsid b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:16:16.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: last_changed 2024-06-06T03:16:08.200329+0000 2024-06-06T03:16:16.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: created 2024-06-06T03:14:13.774178+0000 2024-06-06T03:16:16.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: min_mon_release 19 (squid) 2024-06-06T03:16:16.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: election_strategy: 1 2024-06-06T03:16:16.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: 0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-06-06T03:16:16.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: 1: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.c 2024-06-06T03:16:16.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: 2: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.b 2024-06-06T03:16:16.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: fsmap 2024-06-06T03:16:16.003 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: osdmap e4: 0 total, 0 up, 0 in 2024-06-06T03:16:16.003 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: mgrmap e13: x(active, since 61s) 2024-06-06T03:16:16.003 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: overall HEALTH_OK 2024-06-06T03:16:16.003 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:16.003 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:16.003 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:16.003 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:16.003 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:16.003 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:16.003 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:16.003 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:16.003 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:16.003 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:16.003 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:16.003 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T03:16:16.004 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-06T03:16:16.004 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:15 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:16.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:16.010+0000 7f31c94da700 1 -- 172.21.15.50:0/1408575659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f31c41a73f0 con 0x7f31c419a3c0 2024-06-06T03:16:16.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:16.011+0000 7f31bbfff700 1 -- 172.21.15.50:0/1408575659 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7f31ac018750 con 0x7f31c419a3c0 2024-06-06T03:16:16.011 INFO:teuthology.orchestra.run.smithi050.stdout:# minimal ceph.conf for b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:16:16.011 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2024-06-06T03:16:16.011 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:16:16.011 INFO:teuthology.orchestra.run.smithi050.stdout: mon_host = [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] 2024-06-06T03:16:16.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:16.013+0000 7f31c94da700 1 -- 172.21.15.50:0/1408575659 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f31b0039580 msgr2=0x7f31b003ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:16:16.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:16.013+0000 7f31c94da700 1 --2- 172.21.15.50:0/1408575659 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f31b0039580 0x7f31b003ba40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f31b4006010 tx=0x7f31b401a040 comp rx=0 tx=0).stop 2024-06-06T03:16:16.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:16.013+0000 7f31c94da700 1 -- 172.21.15.50:0/1408575659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31c419a3c0 msgr2=0x7f31c419e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:16:16.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:16.013+0000 7f31c94da700 1 --2- 172.21.15.50:0/1408575659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31c419a3c0 0x7f31c419e750 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f31ac00b780 tx=0x7f31ac00bb40 comp rx=0 tx=0).stop 2024-06-06T03:16:16.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:16.013+0000 7f31c94da700 1 -- 172.21.15.50:0/1408575659 shutdown_connections 2024-06-06T03:16:16.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:16.013+0000 7f31c94da700 1 --2- 172.21.15.50:0/1408575659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31c419ec90 0x7f31c419f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:16.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:16.013+0000 7f31c94da700 1 --2- 172.21.15.50:0/1408575659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31c40747b0 0x7f31c4199e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:16.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:16.013+0000 7f31c94da700 1 --2- 172.21.15.50:0/1408575659 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f31b0039580 0x7f31b003ba40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:16.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:16.013+0000 7f31c94da700 1 --2- 172.21.15.50:0/1408575659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31c419a3c0 0x7f31c419e750 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:16.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:16.013+0000 7f31c94da700 1 -- 172.21.15.50:0/1408575659 >> 172.21.15.50:0/1408575659 conn(0x7f31c40fd9f0 msgr2=0x7f31c4106320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:16:16.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:16.013+0000 7f31c94da700 1 -- 172.21.15.50:0/1408575659 shutdown_connections 2024-06-06T03:16:16.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:16.013+0000 7f31c94da700 1 -- 172.21.15.50:0/1408575659 wait complete. 2024-06-06T03:16:16.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: mon.b calling monitor election 2024-06-06T03:16:16.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: mon.b calling monitor election 2024-06-06T03:16:16.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: mon.a calling monitor election 2024-06-06T03:16:16.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: mon.c calling monitor election 2024-06-06T03:16:16.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-06T03:16:16.101 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: monmap epoch 3 2024-06-06T03:16:16.101 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: fsid b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:16:16.101 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: last_changed 2024-06-06T03:16:08.200329+0000 2024-06-06T03:16:16.101 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: created 2024-06-06T03:14:13.774178+0000 2024-06-06T03:16:16.101 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: min_mon_release 19 (squid) 2024-06-06T03:16:16.101 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: election_strategy: 1 2024-06-06T03:16:16.101 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: 0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-06-06T03:16:16.101 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: 1: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.c 2024-06-06T03:16:16.101 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: 2: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.b 2024-06-06T03:16:16.101 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: fsmap 2024-06-06T03:16:16.101 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: osdmap e4: 0 total, 0 up, 0 in 2024-06-06T03:16:16.101 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: mgrmap e13: x(active, since 61s) 2024-06-06T03:16:16.101 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: overall HEALTH_OK 2024-06-06T03:16:16.101 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:16.102 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:16.102 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:16.102 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:16.102 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:16.102 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:16.102 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:16.102 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:16.102 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:16.102 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:16.102 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:16.102 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T03:16:16.102 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-06T03:16:16.103 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:16.705 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-06-06T03:16:16.705 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-06-06T03:16:16.705 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.conf 2024-06-06T03:16:16.733 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-06-06T03:16:16.734 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-06T03:16:16.799 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-06T03:16:16.800 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.conf 2024-06-06T03:16:16.833 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-06T03:16:16.833 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-06T03:16:16.902 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-06-06T03:16:16.902 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/ceph/ceph.conf 2024-06-06T03:16:16.912 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:16 smithi050 ceph-mon[32421]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:16.912 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:16 smithi050 ceph-mon[32421]: Reconfiguring mon.a (unknown last config time)... 2024-06-06T03:16:16.912 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:16 smithi050 ceph-mon[32421]: Reconfiguring daemon mon.a on smithi050 2024-06-06T03:16:16.912 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:16 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1408575659' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:16.912 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:16 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:16:16.929 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:16 smithi122 ceph-mon[35759]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:16.929 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:16 smithi122 ceph-mon[35759]: Reconfiguring mon.a (unknown last config time)... 2024-06-06T03:16:16.929 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:16 smithi122 ceph-mon[35759]: Reconfiguring daemon mon.a on smithi050 2024-06-06T03:16:16.929 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:16 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/1408575659' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:16.929 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:16 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:16:16.934 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-06-06T03:16:16.935 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-06T03:16:17.002 INFO:tasks.cephadm:Adding mgr.x on smithi050 2024-06-06T03:16:17.003 INFO:tasks.cephadm:Adding mgr.y on smithi079 2024-06-06T03:16:17.003 INFO:tasks.cephadm:Adding mgr.z on smithi122 2024-06-06T03:16:17.003 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph orch apply mgr '3;smithi050=x;smithi079=y;smithi122=z' 2024-06-06T03:16:17.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:16 smithi079 ceph-mon[35478]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:17.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:16 smithi079 ceph-mon[35478]: Reconfiguring mon.a (unknown last config time)... 2024-06-06T03:16:17.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:16 smithi079 ceph-mon[35478]: Reconfiguring daemon mon.a on smithi050 2024-06-06T03:16:17.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:16 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/1408575659' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:17.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:16 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:16:17.276 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T03:16:18.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.768+0000 7f275c031700 1 -- 172.21.15.122:0/1856110496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2754101ff0 msgr2=0x7f2754102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:16:18.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.768+0000 7f275c031700 1 --2- 172.21.15.122:0/1856110496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2754101ff0 0x7f2754102410 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2750009910 tx=0x7f2750009c20 comp rx=0 tx=0).stop 2024-06-06T03:16:18.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.768+0000 7f275c031700 1 -- 172.21.15.122:0/1856110496 shutdown_connections 2024-06-06T03:16:18.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.768+0000 7f275c031700 1 --2- 172.21.15.122:0/1856110496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2754101ff0 0x7f2754102410 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:18.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.768+0000 7f275c031700 1 -- 172.21.15.122:0/1856110496 >> 172.21.15.122:0/1856110496 conn(0x7f27540fd590 msgr2=0x7f27540ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:16:18.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.768+0000 7f275c031700 1 -- 172.21.15.122:0/1856110496 shutdown_connections 2024-06-06T03:16:18.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.768+0000 7f275c031700 1 -- 172.21.15.122:0/1856110496 wait complete. 2024-06-06T03:16:18.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.769+0000 7f275c031700 1 Processor -- start 2024-06-06T03:16:18.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.769+0000 7f275c031700 1 -- start start 2024-06-06T03:16:18.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.769+0000 7f275c031700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2754101ff0 0x7f2754197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:16:18.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.769+0000 7f275c031700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2754197c90 0x7f275419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:16:18.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.769+0000 7f275c031700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2754198110 0x7f275419f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:16:18.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.769+0000 7f275c031700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2754107f30 con 0x7f2754197c90 2024-06-06T03:16:18.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.769+0000 7f275c031700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2754107db0 con 0x7f2754101ff0 2024-06-06T03:16:18.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.769+0000 7f275c031700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f27541080b0 con 0x7f2754198110 2024-06-06T03:16:18.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.769+0000 7f275a5ce700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2754198110 0x7f275419f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:16:18.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.769+0000 7f275a5ce700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2754198110 0x7f275419f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57760/0 (socket says 172.21.15.122:57760) 2024-06-06T03:16:18.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.769+0000 7f27595cc700 1 --2- 172.21.15.122:0/3060618519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2754197c90 0x7f275419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:16:18.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.769+0000 7f275a5ce700 1 -- 172.21.15.122:0/3060618519 learned_addr learned my addr 172.21.15.122:0/3060618519 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-06-06T03:16:18.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.769+0000 7f2759dcd700 1 --2- 172.21.15.122:0/3060618519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2754101ff0 0x7f2754197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:16:18.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.769+0000 7f275a5ce700 1 -- 172.21.15.122:0/3060618519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2754101ff0 msgr2=0x7f2754197750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:16:18.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.769+0000 7f275a5ce700 1 --2- 172.21.15.122:0/3060618519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2754101ff0 0x7f2754197750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:18.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.769+0000 7f275a5ce700 1 -- 172.21.15.122:0/3060618519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2754197c90 msgr2=0x7f275419cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:16:18.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.769+0000 7f275a5ce700 1 --2- 172.21.15.122:0/3060618519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2754197c90 0x7f275419cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:18.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.769+0000 7f275a5ce700 1 -- 172.21.15.122:0/3060618519 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f275419fb60 con 0x7f2754198110 2024-06-06T03:16:18.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.770+0000 7f275a5ce700 1 --2- 172.21.15.122:0/3060618519 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2754198110 0x7f275419f290 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f274c00ba50 tx=0x7f274c00bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:16:18.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.770+0000 7f274affd700 1 -- 172.21.15.122:0/3060618519 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c019070 con 0x7f2754198110 2024-06-06T03:16:18.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.770+0000 7f274affd700 1 -- 172.21.15.122:0/3060618519 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f274c014440 con 0x7f2754198110 2024-06-06T03:16:18.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.770+0000 7f275c031700 1 -- 172.21.15.122:0/3060618519 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f275419fe50 con 0x7f2754198110 2024-06-06T03:16:18.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.770+0000 7f274affd700 1 -- 172.21.15.122:0/3060618519 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c00ce60 con 0x7f2754198110 2024-06-06T03:16:18.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.770+0000 7f275c031700 1 -- 172.21.15.122:0/3060618519 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27541a0380 con 0x7f2754198110 2024-06-06T03:16:18.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.771+0000 7f274affd700 1 -- 172.21.15.122:0/3060618519 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f274c01c070 con 0x7f2754198110 2024-06-06T03:16:18.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.771+0000 7f275c031700 1 -- 172.21.15.122:0/3060618519 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2754063af0 con 0x7f2754198110 2024-06-06T03:16:18.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.771+0000 7f274affd700 1 --2- 172.21.15.122:0/3060618519 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f2740039580 0x7f274003ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:16:18.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.771+0000 7f274affd700 1 -- 172.21.15.122:0/3060618519 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f274c04b890 con 0x7f2754198110 2024-06-06T03:16:18.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.771+0000 7f2759dcd700 1 --2- 172.21.15.122:0/3060618519 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f2740039580 0x7f274003ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:16:18.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.772+0000 7f2759dcd700 1 --2- 172.21.15.122:0/3060618519 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f2740039580 0x7f274003ba40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f27500050f0 tx=0x7f275001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:16:18.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.776+0000 7f274affd700 1 -- 172.21.15.122:0/3060618519 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f274c012500 con 0x7f2754198110 2024-06-06T03:16:18.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:18 smithi079 ceph-mon[35478]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:18.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:18 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:18.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:18 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:18.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:18 smithi079 ceph-mon[35478]: Reconfiguring mon.b (monmap changed)... 2024-06-06T03:16:18.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:18 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T03:16:18.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:18 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-06T03:16:18.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:18 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:18.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:18 smithi079 ceph-mon[35478]: Reconfiguring daemon mon.b on smithi079 2024-06-06T03:16:18.933 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:18 smithi122 ceph-mon[35759]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:18.933 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:18 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:18.934 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:18 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:18.934 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:18 smithi122 ceph-mon[35759]: Reconfiguring mon.b (monmap changed)... 2024-06-06T03:16:18.934 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:18 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T03:16:18.934 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:18 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-06T03:16:18.934 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:18 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:18.934 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:18 smithi122 ceph-mon[35759]: Reconfiguring daemon mon.b on smithi079 2024-06-06T03:16:18.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.984+0000 7f275c031700 1 -- 172.21.15.122:0/3060618519 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi050=x;smithi079=y;smithi122=z", "target": ["mon-mgr", ""]}) -- 0x7f2754062960 con 0x7f2740039580 2024-06-06T03:16:18.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.991+0000 7f274affd700 1 -- 172.21.15.122:0/3060618519 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f2754062960 con 0x7f2740039580 2024-06-06T03:16:18.990 INFO:teuthology.orchestra.run.smithi122.stdout:Scheduled mgr update... 2024-06-06T03:16:18.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.993+0000 7f275c031700 1 -- 172.21.15.122:0/3060618519 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f2740039580 msgr2=0x7f274003ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:16:18.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.993+0000 7f275c031700 1 --2- 172.21.15.122:0/3060618519 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f2740039580 0x7f274003ba40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f27500050f0 tx=0x7f275001a040 comp rx=0 tx=0).stop 2024-06-06T03:16:18.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.993+0000 7f275c031700 1 -- 172.21.15.122:0/3060618519 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2754198110 msgr2=0x7f275419f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:16:18.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.993+0000 7f275c031700 1 --2- 172.21.15.122:0/3060618519 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2754198110 0x7f275419f290 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f274c00ba50 tx=0x7f274c00bd60 comp rx=0 tx=0).stop 2024-06-06T03:16:18.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.993+0000 7f275c031700 1 -- 172.21.15.122:0/3060618519 shutdown_connections 2024-06-06T03:16:18.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.993+0000 7f275c031700 1 --2- 172.21.15.122:0/3060618519 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2754198110 0x7f275419f290 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:18.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.993+0000 7f275c031700 1 --2- 172.21.15.122:0/3060618519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2754101ff0 0x7f2754197750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:18.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.993+0000 7f275c031700 1 --2- 172.21.15.122:0/3060618519 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f2740039580 0x7f274003ba40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:18.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.993+0000 7f275c031700 1 --2- 172.21.15.122:0/3060618519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2754197c90 0x7f275419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:18.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.993+0000 7f275c031700 1 -- 172.21.15.122:0/3060618519 >> 172.21.15.122:0/3060618519 conn(0x7f27540fd590 msgr2=0x7f27540fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:16:18.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.993+0000 7f275c031700 1 -- 172.21.15.122:0/3060618519 shutdown_connections 2024-06-06T03:16:18.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:16:18.993+0000 7f275c031700 1 -- 172.21.15.122:0/3060618519 wait complete. 2024-06-06T03:16:19.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:18 smithi050 ceph-mon[32421]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:19.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:18 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:19.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:18 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:19.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:18 smithi050 ceph-mon[32421]: Reconfiguring mon.b (monmap changed)... 2024-06-06T03:16:19.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:18 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T03:16:19.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:18 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-06T03:16:19.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:18 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:19.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:18 smithi050 ceph-mon[32421]: Reconfiguring daemon mon.b on smithi079 2024-06-06T03:16:19.653 DEBUG:teuthology.orchestra.run.smithi079:mgr.y> sudo journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mgr.y.service 2024-06-06T03:16:19.656 DEBUG:teuthology.orchestra.run.smithi122:mgr.z> sudo journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mgr.z.service 2024-06-06T03:16:19.658 INFO:tasks.cephadm:Deploying OSDs... 2024-06-06T03:16:19.658 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-06-06T03:16:19.659 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/scratch_devs of=/dev/stdout 2024-06-06T03:16:19.679 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-06T03:16:19.679 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_1 2024-06-06T03:16:19.739 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-06T03:16:19.739 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T03:16:19.739 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-06-06T03:16:19.739 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T03:16:19.739 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T03:16:19.739 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-06-06 03:15:25.751185539 +0000 2024-06-06T03:16:19.739 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-06-06 03:10:49.321198556 +0000 2024-06-06T03:16:19.740 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-06-06 03:10:49.321198556 +0000 2024-06-06T03:16:19.740 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-06-06 03:10:49.321198556 +0000 2024-06-06T03:16:19.740 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-06T03:16:19.809 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-06-06T03:16:19.809 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-06-06T03:16:19.809 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.00013086 s, 3.9 MB/s 2024-06-06T03:16:19.811 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-06T03:16:19.871 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_2 2024-06-06T03:16:19.931 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-06T03:16:19.931 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T03:16:19.931 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-06-06T03:16:19.932 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T03:16:19.932 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T03:16:19.932 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-06-06 03:15:25.781184779 +0000 2024-06-06T03:16:19.932 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-06-06 03:10:49.647190159 +0000 2024-06-06T03:16:19.932 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-06-06 03:10:49.647190159 +0000 2024-06-06T03:16:19.932 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-06-06 03:10:49.647190159 +0000 2024-06-06T03:16:19.932 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-06T03:16:20.002 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-06-06T03:16:20.002 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-06-06T03:16:20.002 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000123754 s, 4.1 MB/s 2024-06-06T03:16:20.004 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-06T03:16:20.063 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_3 2024-06-06T03:16:20.122 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-06T03:16:20.122 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T03:16:20.122 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-06-06T03:16:20.123 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T03:16:20.123 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T03:16:20.123 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-06-06 03:15:25.817183867 +0000 2024-06-06T03:16:20.123 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-06-06 03:10:49.974181736 +0000 2024-06-06T03:16:20.123 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-06-06 03:10:49.974181736 +0000 2024-06-06T03:16:20.123 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-06-06 03:10:49.974181736 +0000 2024-06-06T03:16:20.123 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-06T03:16:20.188 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:19 smithi050 ceph-mon[32421]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi050=x;smithi079=y;smithi122=z", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:16:20.188 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:19 smithi050 ceph-mon[32421]: Saving service mgr spec with placement smithi050=x;smithi079=y;smithi122=z;count:3 2024-06-06T03:16:20.188 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:19 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:20.188 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:19 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:20.188 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:19 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:20.188 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:19 smithi050 ceph-mon[32421]: Reconfiguring mon.c (monmap changed)... 2024-06-06T03:16:20.188 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:19 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T03:16:20.188 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:19 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-06T03:16:20.188 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:19 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:20.188 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:19 smithi050 ceph-mon[32421]: Reconfiguring daemon mon.c on smithi122 2024-06-06T03:16:20.190 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-06-06T03:16:20.190 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-06-06T03:16:20.190 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000115728 s, 4.4 MB/s 2024-06-06T03:16:20.192 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-06T03:16:20.250 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_4 2024-06-06T03:16:20.308 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-06T03:16:20.308 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T03:16:20.308 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-06-06T03:16:20.309 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T03:16:20.309 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T03:16:20.309 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-06-06 03:15:25.848183082 +0000 2024-06-06T03:16:20.309 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-06-06 03:10:50.312173030 +0000 2024-06-06T03:16:20.309 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-06-06 03:10:50.312173030 +0000 2024-06-06T03:16:20.309 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-06-06 03:10:50.312173030 +0000 2024-06-06T03:16:20.309 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-06T03:16:20.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:19 smithi079 ceph-mon[35478]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi050=x;smithi079=y;smithi122=z", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:16:20.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:19 smithi079 ceph-mon[35478]: Saving service mgr spec with placement smithi050=x;smithi079=y;smithi122=z;count:3 2024-06-06T03:16:20.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:19 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:20.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:19 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:20.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:19 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:20.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:19 smithi079 ceph-mon[35478]: Reconfiguring mon.c (monmap changed)... 2024-06-06T03:16:20.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:19 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T03:16:20.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:19 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-06T03:16:20.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:19 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:20.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:19 smithi079 ceph-mon[35478]: Reconfiguring daemon mon.c on smithi122 2024-06-06T03:16:20.375 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-06-06T03:16:20.375 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-06-06T03:16:20.376 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000100573 s, 5.1 MB/s 2024-06-06T03:16:20.377 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-06T03:16:20.399 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:19 smithi122 ceph-mon[35759]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi050=x;smithi079=y;smithi122=z", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:16:20.399 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:19 smithi122 ceph-mon[35759]: Saving service mgr spec with placement smithi050=x;smithi079=y;smithi122=z;count:3 2024-06-06T03:16:20.399 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:19 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:20.399 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:19 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:20.399 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:19 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:20.399 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:19 smithi122 ceph-mon[35759]: Reconfiguring mon.c (monmap changed)... 2024-06-06T03:16:20.399 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:19 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T03:16:20.400 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:19 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-06T03:16:20.400 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:19 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:20.400 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:19 smithi122 ceph-mon[35759]: Reconfiguring daemon mon.c on smithi122 2024-06-06T03:16:20.434 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-06-06T03:16:20.434 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/scratch_devs of=/dev/stdout 2024-06-06T03:16:20.454 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-06T03:16:20.454 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_1 2024-06-06T03:16:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-06T03:16:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T03:16:20.513 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 671 Links: 1 2024-06-06T03:16:20.513 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T03:16:20.513 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T03:16:20.513 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-06-06 03:16:07.670788383 +0000 2024-06-06T03:16:20.513 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-06-06 03:10:44.774675300 +0000 2024-06-06T03:16:20.513 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-06-06 03:10:44.774675300 +0000 2024-06-06T03:16:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-06-06 03:10:44.774675300 +0000 2024-06-06T03:16:20.514 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-06T03:16:20.582 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-06-06T03:16:20.582 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-06-06T03:16:20.582 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000226911 s, 2.3 MB/s 2024-06-06T03:16:20.583 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-06T03:16:20.643 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_2 2024-06-06T03:16:20.701 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-06T03:16:20.702 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T03:16:20.702 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 690 Links: 1 2024-06-06T03:16:20.702 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T03:16:20.702 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T03:16:20.702 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-06-06 03:16:07.670788383 +0000 2024-06-06T03:16:20.702 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-06-06 03:10:45.124667215 +0000 2024-06-06T03:16:20.702 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-06-06 03:10:45.124667215 +0000 2024-06-06T03:16:20.702 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-06-06 03:10:45.124667215 +0000 2024-06-06T03:16:20.703 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-06T03:16:20.769 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-06-06T03:16:20.769 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-06-06T03:16:20.769 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000227894 s, 2.2 MB/s 2024-06-06T03:16:20.770 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-06T03:16:20.829 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_3 2024-06-06T03:16:20.887 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-06T03:16:20.887 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T03:16:20.887 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 707 Links: 1 2024-06-06T03:16:20.888 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T03:16:20.888 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T03:16:20.888 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-06-06 03:16:07.671788360 +0000 2024-06-06T03:16:20.888 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-06-06 03:10:45.476659085 +0000 2024-06-06T03:16:20.888 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-06-06 03:10:45.476659085 +0000 2024-06-06T03:16:20.888 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-06-06 03:10:45.476659085 +0000 2024-06-06T03:16:20.888 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-06T03:16:20.953 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-06-06T03:16:20.953 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-06-06T03:16:20.953 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000225541 s, 2.3 MB/s 2024-06-06T03:16:20.954 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-06T03:16:21.012 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_4 2024-06-06T03:16:21.069 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-06T03:16:21.069 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T03:16:21.069 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 726 Links: 1 2024-06-06T03:16:21.069 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T03:16:21.069 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T03:16:21.069 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-06-06 03:16:07.671788360 +0000 2024-06-06T03:16:21.069 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-06-06 03:10:45.806651462 +0000 2024-06-06T03:16:21.069 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-06-06 03:10:45.806651462 +0000 2024-06-06T03:16:21.069 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-06-06 03:10:45.806651462 +0000 2024-06-06T03:16:21.070 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-06T03:16:21.135 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-06-06T03:16:21.135 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-06-06T03:16:21.135 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000222351 s, 2.3 MB/s 2024-06-06T03:16:21.136 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-06T03:16:21.193 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-06-06T03:16:21.193 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/scratch_devs of=/dev/stdout 2024-06-06T03:16:21.213 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-06T03:16:21.213 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_1 2024-06-06T03:16:21.272 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-06T03:16:21.272 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T03:16:21.272 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-06-06T03:16:21.272 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T03:16:21.272 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T03:16:21.272 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-06-06 03:15:58.253823264 +0000 2024-06-06T03:16:21.273 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-06-06 03:10:44.777008330 +0000 2024-06-06T03:16:21.273 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-06-06 03:10:44.777008330 +0000 2024-06-06T03:16:21.273 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-06-06 03:10:44.777008330 +0000 2024-06-06T03:16:21.273 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-06T03:16:21.339 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:21 smithi122 ceph-mon[35759]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:21.339 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:21 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:21.339 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:21 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:21.339 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:21 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:16:21.341 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-06-06T03:16:21.341 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-06-06T03:16:21.341 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000227536 s, 2.3 MB/s 2024-06-06T03:16:21.343 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-06T03:16:21.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:21 smithi079 ceph-mon[35478]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:21.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:21 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:21.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:21 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:21.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:21 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:16:21.402 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_2 2024-06-06T03:16:21.403 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:21 smithi050 ceph-mon[32421]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:21.403 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:21 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:21.403 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:21 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:21.403 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:21 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:16:21.458 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-06T03:16:21.458 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T03:16:21.459 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-06-06T03:16:21.459 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T03:16:21.459 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T03:16:21.459 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-06-06 03:15:58.253823264 +0000 2024-06-06T03:16:21.459 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-06-06 03:10:45.116000900 +0000 2024-06-06T03:16:21.459 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-06-06 03:10:45.116000900 +0000 2024-06-06T03:16:21.459 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-06-06 03:10:45.116000900 +0000 2024-06-06T03:16:21.459 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-06T03:16:21.522 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-06-06T03:16:21.522 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-06-06T03:16:21.522 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.00020193 s, 2.5 MB/s 2024-06-06T03:16:21.523 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-06T03:16:21.579 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_3 2024-06-06T03:16:21.635 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-06T03:16:21.636 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T03:16:21.636 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-06-06T03:16:21.636 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T03:16:21.636 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T03:16:21.636 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-06-06 03:15:58.253823264 +0000 2024-06-06T03:16:21.636 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-06-06 03:10:45.446993645 +0000 2024-06-06T03:16:21.636 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-06-06 03:10:45.446993645 +0000 2024-06-06T03:16:21.636 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-06-06 03:10:45.446993645 +0000 2024-06-06T03:16:21.637 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-06T03:16:21.700 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-06-06T03:16:21.701 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-06-06T03:16:21.701 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000197693 s, 2.6 MB/s 2024-06-06T03:16:21.702 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-06T03:16:21.758 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_4 2024-06-06T03:16:21.816 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-06T03:16:21.816 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T03:16:21.816 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-06-06T03:16:21.816 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T03:16:21.816 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T03:16:21.817 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-06-06 03:15:58.254823242 +0000 2024-06-06T03:16:21.817 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-06-06 03:10:45.784986237 +0000 2024-06-06T03:16:21.817 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-06-06 03:10:45.784986237 +0000 2024-06-06T03:16:21.817 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-06-06 03:10:45.784986237 +0000 2024-06-06T03:16:21.817 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-06T03:16:21.879 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-06-06T03:16:21.879 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-06-06T03:16:21.880 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000196137 s, 2.6 MB/s 2024-06-06T03:16:21.881 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-06T03:16:21.937 INFO:tasks.cephadm:Deploying osd.0 on smithi050 with /dev/vg_nvme/lv_4... 2024-06-06T03:16:21.937 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-06-06T03:16:22.190 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:16:22.204 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:22 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:22.204 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:22 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:16:22.204 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:22 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:22.204 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:22 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-06T03:16:22.204 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:22 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-06T03:16:22.205 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:22 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-06T03:16:22.205 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:22 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:22.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:22 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:22.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:22 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:16:22.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:22 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:22.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:22 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-06T03:16:22.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:22 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-06T03:16:22.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:22 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-06T03:16:22.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:22 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:22.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:22 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:22.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:22 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:16:22.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:22 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:22.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:22 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-06T03:16:22.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:22 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-06T03:16:22.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:22 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-06T03:16:22.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:22 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:23.125 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:23 smithi122 ceph-mon[35759]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:23.125 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:23 smithi122 ceph-mon[35759]: Deploying daemon mgr.z on smithi122 2024-06-06T03:16:23.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:23 smithi079 ceph-mon[35478]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:23.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:23 smithi079 ceph-mon[35478]: Deploying daemon mgr.z on smithi122 2024-06-06T03:16:23.385 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:23 smithi050 ceph-mon[32421]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:23.385 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:23 smithi050 ceph-mon[32421]: Deploying daemon mgr.z on smithi122 2024-06-06T03:16:23.431 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:23 smithi122 systemd[1]: Starting Ceph mgr.z for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:16:23.828 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:23 smithi122 podman[37575]: 2024-06-06 03:16:23.426447828 +0000 UTC m=+0.016861199 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T03:16:23.828 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:23 smithi122 podman[37575]: 2024-06-06 03:16:23.534751937 +0000 UTC m=+0.125165313 container create 192ca4dae59643abc82c46c69f1a2cf590e51282d0d8ee5747ec2e0d96fa4921 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc) 2024-06-06T03:16:23.828 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:23 smithi122 podman[37575]: 2024-06-06 03:16:23.745322132 +0000 UTC m=+0.335735503 container init 192ca4dae59643abc82c46c69f1a2cf590e51282d0d8ee5747ec2e0d96fa4921 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-z, RELEASE=squid-3d89acc, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-06-06T03:16:23.828 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:23 smithi122 podman[37575]: 2024-06-06 03:16:23.748090282 +0000 UTC m=+0.338503651 container start 192ca4dae59643abc82c46c69f1a2cf590e51282d0d8ee5747ec2e0d96fa4921 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T03:16:23.828 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:23 smithi122 ceph-mgr[37594]: -- 172.21.15.122:0/260667230 <== mon.1 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55acc47a05a0 con 0x55acc4775000 2024-06-06T03:16:23.828 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:23 smithi122 bash[37575]: 192ca4dae59643abc82c46c69f1a2cf590e51282d0d8ee5747ec2e0d96fa4921 2024-06-06T03:16:24.101 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:23 smithi122 systemd[1]: Started Ceph mgr.z for b6263b26-23b2-11ef-bc9b-c7b262605968. 2024-06-06T03:16:24.101 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:23 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-z[37590]: 2024-06-06T03:16:23.913+0000 7fb318f31200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-06T03:16:24.101 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:24 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-z[37590]: 2024-06-06T03:16:24.101+0000 7fb318f31200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-06T03:16:24.226 INFO:teuthology.orchestra.run.smithi050.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-06-06T03:16:24.226 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-06-06T03:16:24.226 INFO:teuthology.orchestra.run.smithi050.stderr: stderr: 10+0 records in 2024-06-06T03:16:24.226 INFO:teuthology.orchestra.run.smithi050.stderr:10+0 records out 2024-06-06T03:16:24.226 INFO:teuthology.orchestra.run.smithi050.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00826609 s, 1.3 GB/s 2024-06-06T03:16:24.226 INFO:teuthology.orchestra.run.smithi050.stderr: stderr: 2024-06-06T03:16:24.226 INFO:teuthology.orchestra.run.smithi050.stderr:--> Zapping successful for: 2024-06-06T03:16:24.431 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:24 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-z[37590]: 2024-06-06T03:16:24.202+0000 7fb318f31200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-06T03:16:24.796 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi050:vg_nvme/lv_4 2024-06-06T03:16:24.904 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:24 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-z[37590]: 2024-06-06T03:16:24.511+0000 7fb318f31200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-06T03:16:24.904 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:24 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-z[37590]: 2024-06-06T03:16:24.597+0000 7fb318f31200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-06T03:16:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:16:25.166 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:24 smithi050 ceph-mon[32421]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:25.166 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:24 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:25.166 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:24 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:25.166 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:24 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:25.166 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:24 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-06T03:16:25.166 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:24 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-06T03:16:25.167 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:24 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-06T03:16:25.167 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:24 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:25.167 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:24 smithi050 ceph-mon[32421]: Deploying daemon mgr.y on smithi079 2024-06-06T03:16:25.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:24 smithi122 ceph-mon[35759]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:25.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:24 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:25.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:24 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:25.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:24 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:25.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:24 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-06T03:16:25.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:24 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-06T03:16:25.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:24 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-06T03:16:25.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:24 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:25.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:24 smithi122 ceph-mon[35759]: Deploying daemon mgr.y on smithi079 2024-06-06T03:16:25.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:24 smithi079 ceph-mon[35478]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:25.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:24 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:25.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:24 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:25.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:24 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:25.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:24 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-06T03:16:25.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:24 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-06T03:16:25.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:24 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-06T03:16:25.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:24 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:25.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:24 smithi079 ceph-mon[35478]: Deploying daemon mgr.y on smithi079 2024-06-06T03:16:26.030 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:25 smithi079 systemd[1]: Starting Ceph mgr.y for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:16:26.129 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:25 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-z[37590]: 2024-06-06T03:16:25.783+0000 7fb318f31200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-06T03:16:26.129 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:25 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-z[37590]: 2024-06-06T03:16:25.954+0000 7fb318f31200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-06T03:16:26.129 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:26 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-z[37590]: 2024-06-06T03:16:26.129+0000 7fb318f31200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-06T03:16:26.312 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:26 smithi079 podman[36831]: 2024-06-06 03:16:25.934063923 +0000 UTC m=+0.016875859 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T03:16:26.312 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:26 smithi079 podman[36831]: 2024-06-06 03:16:26.04388467 +0000 UTC m=+0.126696644 container create 512ba03023aede39db4a9fe9d95e49220bdd55c09ab6864f36893d59248c9293 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T03:16:26.312 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:26 smithi079 podman[36831]: 2024-06-06 03:16:26.237969155 +0000 UTC m=+0.320781079 container init 512ba03023aede39db4a9fe9d95e49220bdd55c09ab6864f36893d59248c9293 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc) 2024-06-06T03:16:26.312 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:26 smithi079 podman[36831]: 2024-06-06 03:16:26.241431102 +0000 UTC m=+0.324243036 container start 512ba03023aede39db4a9fe9d95e49220bdd55c09ab6864f36893d59248c9293 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-06T03:16:26.312 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:26 smithi079 ceph-mgr[36851]: -- 172.21.15.79:0/1400122942 <== mon.2 v2:172.21.15.79:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56011571e5a0 con 0x5601156f3000 2024-06-06T03:16:26.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.489+0000 7f166fd1d700 1 -- 172.21.15.50:0/295926684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16681058d0 msgr2=0x7f1668107cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:16:26.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.489+0000 7f166fd1d700 1 --2- 172.21.15.50:0/295926684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16681058d0 0x7f1668107cc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1658009990 tx=0x7f1658009ca0 comp rx=0 tx=0).stop 2024-06-06T03:16:26.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.489+0000 7f166fd1d700 1 -- 172.21.15.50:0/295926684 shutdown_connections 2024-06-06T03:16:26.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.489+0000 7f166fd1d700 1 --2- 172.21.15.50:0/295926684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1668108200 0x7f166810a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:26.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.489+0000 7f166fd1d700 1 --2- 172.21.15.50:0/295926684 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1668102fa0 0x7f1668105390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:26.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.489+0000 7f166fd1d700 1 --2- 172.21.15.50:0/295926684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16681058d0 0x7f1668107cc0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:26.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.489+0000 7f166fd1d700 1 -- 172.21.15.50:0/295926684 >> 172.21.15.50:0/295926684 conn(0x7f16680fc9b0 msgr2=0x7f16680fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:16:26.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.490+0000 7f166fd1d700 1 -- 172.21.15.50:0/295926684 shutdown_connections 2024-06-06T03:16:26.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.490+0000 7f166fd1d700 1 -- 172.21.15.50:0/295926684 wait complete. 2024-06-06T03:16:26.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.490+0000 7f166fd1d700 1 Processor -- start 2024-06-06T03:16:26.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.490+0000 7f166fd1d700 1 -- start start 2024-06-06T03:16:26.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.490+0000 7f166fd1d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1668102fa0 0x7f1668198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:16:26.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.490+0000 7f166fd1d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16681058d0 0x7f1668198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:16:26.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.490+0000 7f166fd1d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1668108200 0x7f166819fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:16:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.490+0000 7f166fd1d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f166810df90 con 0x7f16681058d0 2024-06-06T03:16:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.490+0000 7f166fd1d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f166810de10 con 0x7f1668102fa0 2024-06-06T03:16:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.490+0000 7f166fd1d700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f166810e110 con 0x7f1668108200 2024-06-06T03:16:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.490+0000 7f166d2b8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16681058d0 0x7f1668198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:16:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.491+0000 7f166dab9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1668102fa0 0x7f1668198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:16:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.491+0000 7f166d2b8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16681058d0 0x7f1668198b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60336/0 (socket says 172.21.15.50:60336) 2024-06-06T03:16:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.491+0000 7f166d2b8700 1 -- 172.21.15.50:0/3963588042 learned_addr learned my addr 172.21.15.50:0/3963588042 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:16:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.491+0000 7f166e2ba700 1 --2- 172.21.15.50:0/3963588042 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1668108200 0x7f166819fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:16:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.491+0000 7f166d2b8700 1 -- 172.21.15.50:0/3963588042 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1668108200 msgr2=0x7f166819fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:16:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.491+0000 7f166d2b8700 1 --2- 172.21.15.50:0/3963588042 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1668108200 0x7f166819fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.491+0000 7f166d2b8700 1 -- 172.21.15.50:0/3963588042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1668102fa0 msgr2=0x7f1668198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:16:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.491+0000 7f166d2b8700 1 --2- 172.21.15.50:0/3963588042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1668102fa0 0x7f1668198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:26.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.491+0000 7f166d2b8700 1 -- 172.21.15.50:0/3963588042 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16681a0290 con 0x7f16681058d0 2024-06-06T03:16:26.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.491+0000 7f166dab9700 1 --2- 172.21.15.50:0/3963588042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1668102fa0 0x7f1668198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:16:26.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.491+0000 7f166d2b8700 1 --2- 172.21.15.50:0/3963588042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16681058d0 0x7f1668198b70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1658005910 tx=0x7f1658009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:16:26.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.491+0000 7f165effd700 1 -- 172.21.15.50:0/3963588042 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1658026070 con 0x7f16681058d0 2024-06-06T03:16:26.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.491+0000 7f165effd700 1 -- 172.21.15.50:0/3963588042 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f165800be80 con 0x7f16681058d0 2024-06-06T03:16:26.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.491+0000 7f165effd700 1 -- 172.21.15.50:0/3963588042 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1658017650 con 0x7f16681058d0 2024-06-06T03:16:26.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.491+0000 7f166fd1d700 1 -- 172.21.15.50:0/3963588042 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16681a0520 con 0x7f16681058d0 2024-06-06T03:16:26.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.491+0000 7f166fd1d700 1 -- 172.21.15.50:0/3963588042 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16681a0970 con 0x7f16681058d0 2024-06-06T03:16:26.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.492+0000 7f165effd700 1 -- 172.21.15.50:0/3963588042 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f1658029070 con 0x7f16681058d0 2024-06-06T03:16:26.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.492+0000 7f166fd1d700 1 -- 172.21.15.50:0/3963588042 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1668069180 con 0x7f16681058d0 2024-06-06T03:16:26.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.493+0000 7f165effd700 1 --2- 172.21.15.50:0/3963588042 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f1654039330 0x7f165403b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:16:26.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.493+0000 7f165effd700 1 -- 172.21.15.50:0/3963588042 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f165804d330 con 0x7f16681058d0 2024-06-06T03:16:26.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.493+0000 7f166dab9700 1 --2- 172.21.15.50:0/3963588042 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f1654039330 0x7f165403b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:16:26.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.493+0000 7f166dab9700 1 --2- 172.21.15.50:0/3963588042 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f1654039330 0x7f165403b7f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1664010420 tx=0x7f16640073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:16:26.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.498+0000 7f165effd700 1 -- 172.21.15.50:0/3963588042 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1658013070 con 0x7f16681058d0 2024-06-06T03:16:26.580 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:26 smithi079 bash[36831]: 512ba03023aede39db4a9fe9d95e49220bdd55c09ab6864f36893d59248c9293 2024-06-06T03:16:26.580 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:26 smithi079 systemd[1]: Started Ceph mgr.y for b6263b26-23b2-11ef-bc9b-c7b262605968. 2024-06-06T03:16:26.580 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:26 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y[36846]: 2024-06-06T03:16:26.417+0000 7fe5b1a96200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-06T03:16:26.681 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:26 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-z[37590]: 2024-06-06T03:16:26.431+0000 7fb318f31200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-06T03:16:26.681 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:26 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-z[37590]: 2024-06-06T03:16:26.525+0000 7fb318f31200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-06T03:16:26.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:26.714+0000 7f166fd1d700 1 -- 172.21.15.50:0/3963588042 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f16680628d0 con 0x7f1654039330 2024-06-06T03:16:26.849 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:26 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y[36846]: 2024-06-06T03:16:26.613+0000 7fe5b1a96200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-06T03:16:26.849 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:26 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y[36846]: 2024-06-06T03:16:26.729+0000 7fe5b1a96200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-06T03:16:27.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:26 smithi050 ceph-mon[32421]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:27.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:26 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:27.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:26 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:27.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:26 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:27.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:26 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:27.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:26 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:16:27.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:26 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:16:27.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:26 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:16:27.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:26 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:27.161 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:26 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-z[37590]: 2024-06-06T03:16:26.734+0000 7fb318f31200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-06T03:16:27.161 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:26 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-z[37590]: 2024-06-06T03:16:26.936+0000 7fb318f31200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-06T03:16:27.161 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:26 smithi122 ceph-mon[35759]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:27.161 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:26 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:27.161 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:26 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:27.162 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:26 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:27.162 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:26 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:27.162 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:26 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:16:27.162 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:26 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:16:27.162 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:26 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:16:27.162 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:26 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:27.162 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:27 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y[36846]: 2024-06-06T03:16:27.057+0000 7fe5b1a96200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-06T03:16:27.162 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:26 smithi079 ceph-mon[35478]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:27.163 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:26 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:27.163 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:26 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:27.163 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:26 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:27.163 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:26 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:27.163 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:26 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:16:27.163 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:26 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:16:27.163 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:26 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:16:27.163 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:26 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:27.411 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:27 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y[36846]: 2024-06-06T03:16:27.161+0000 7fe5b1a96200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-06T03:16:27.911 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:27 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-z[37590]: 2024-06-06T03:16:27.588+0000 7fb318f31200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-06T03:16:28.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:27 smithi122 ceph-mon[35759]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:16:28.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:27 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:28.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:27 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:28.182 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:28 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-z[37590]: 2024-06-06T03:16:28.024+0000 7fb318f31200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-06T03:16:28.182 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:28 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-z[37590]: 2024-06-06T03:16:28.121+0000 7fb318f31200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-06T03:16:28.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:27 smithi050 ceph-mon[32421]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:16:28.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:27 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:28.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:27 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:28.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:27 smithi079 ceph-mon[35478]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:16:28.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:27 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:28.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:27 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:28.681 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:28 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-z[37590]: 2024-06-06T03:16:28.324+0000 7fb318f31200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-06T03:16:28.728 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:28 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y[36846]: 2024-06-06T03:16:28.395+0000 7fe5b1a96200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-06T03:16:28.729 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:28 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y[36846]: 2024-06-06T03:16:28.562+0000 7fe5b1a96200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-06T03:16:28.729 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:28 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y[36846]: 2024-06-06T03:16:28.728+0000 7fe5b1a96200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-06T03:16:29.181 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:28 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-z[37590]: 2024-06-06T03:16:28.847+0000 7fb318f31200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-06T03:16:29.182 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:28 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-z[37590]: 2024-06-06T03:16:28.939+0000 7fb318f31200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-06T03:16:29.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:28 smithi122 ceph-mon[35759]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:29.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:28 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:29.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:28 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:29.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:28 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:29.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:28 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:16:29.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:28 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:29.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:28 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-06T03:16:29.183 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:28 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-06T03:16:29.183 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:28 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:29.183 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:28 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:29.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:28 smithi050 ceph-mon[32421]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:29.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:28 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:29.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:28 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:29.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:28 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:29.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:28 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:16:29.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:28 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:29.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:28 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-06T03:16:29.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:28 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-06T03:16:29.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:28 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:29.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:28 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:29.305 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:29 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y[36846]: 2024-06-06T03:16:29.017+0000 7fe5b1a96200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-06T03:16:29.306 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:29 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y[36846]: 2024-06-06T03:16:29.106+0000 7fe5b1a96200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-06T03:16:29.306 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:29 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y[36846]: 2024-06-06T03:16:29.305+0000 7fe5b1a96200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-06T03:16:29.306 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:28 smithi079 ceph-mon[35478]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:29.306 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:28 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:29.306 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:28 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:29.306 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:28 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:29.306 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:28 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:16:29.306 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:28 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:29.306 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:28 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-06T03:16:29.306 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:28 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-06T03:16:29.306 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:28 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:29.306 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:28 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:29.431 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:29 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-z[37590]: 2024-06-06T03:16:29.179+0000 7fb318f31200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-06T03:16:29.431 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:29 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-z[37590]: 2024-06-06T03:16:29.314+0000 7fb318f31200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-06T03:16:29.431 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:29 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-z[37590]: 2024-06-06T03:16:29.408+0000 7fb318f31200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-06T03:16:29.599 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:29 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y[36846]: 2024-06-06T03:16:29.495+0000 7fe5b1a96200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-06T03:16:29.819 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:29 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-z[37590]: 2024-06-06T03:16:29.524+0000 7fb318f31200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-06T03:16:29.819 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:29 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-z[37590]: 2024-06-06T03:16:29.819+0000 7fb318f31200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-06T03:16:30.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:29 smithi122 ceph-mon[35759]: Reconfiguring mgr.x (unknown last config time)... 2024-06-06T03:16:30.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:29 smithi122 ceph-mon[35759]: Reconfiguring daemon mgr.x on smithi050 2024-06-06T03:16:30.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:29 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/2737782001' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eed8040f-a7b7-4d3b-8345-2022918097d3"}]: dispatch 2024-06-06T03:16:30.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:29 smithi122 ceph-mon[35759]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eed8040f-a7b7-4d3b-8345-2022918097d3"}]: dispatch 2024-06-06T03:16:30.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:29 smithi122 ceph-mon[35759]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eed8040f-a7b7-4d3b-8345-2022918097d3"}]': finished 2024-06-06T03:16:30.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:29 smithi122 ceph-mon[35759]: osdmap e5: 1 total, 0 up, 1 in 2024-06-06T03:16:30.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:29 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T03:16:30.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:29 smithi050 ceph-mon[32421]: Reconfiguring mgr.x (unknown last config time)... 2024-06-06T03:16:30.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:29 smithi050 ceph-mon[32421]: Reconfiguring daemon mgr.x on smithi050 2024-06-06T03:16:30.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:29 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/2737782001' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eed8040f-a7b7-4d3b-8345-2022918097d3"}]: dispatch 2024-06-06T03:16:30.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:29 smithi050 ceph-mon[32421]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eed8040f-a7b7-4d3b-8345-2022918097d3"}]: dispatch 2024-06-06T03:16:30.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:29 smithi050 ceph-mon[32421]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eed8040f-a7b7-4d3b-8345-2022918097d3"}]': finished 2024-06-06T03:16:30.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:29 smithi050 ceph-mon[32421]: osdmap e5: 1 total, 0 up, 1 in 2024-06-06T03:16:30.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:29 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T03:16:30.349 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:30 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y[36846]: 2024-06-06T03:16:30.085+0000 7fe5b1a96200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-06T03:16:30.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:29 smithi079 ceph-mon[35478]: Reconfiguring mgr.x (unknown last config time)... 2024-06-06T03:16:30.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:29 smithi079 ceph-mon[35478]: Reconfiguring daemon mgr.x on smithi050 2024-06-06T03:16:30.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:29 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/2737782001' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eed8040f-a7b7-4d3b-8345-2022918097d3"}]: dispatch 2024-06-06T03:16:30.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:29 smithi079 ceph-mon[35478]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eed8040f-a7b7-4d3b-8345-2022918097d3"}]: dispatch 2024-06-06T03:16:30.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:29 smithi079 ceph-mon[35478]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eed8040f-a7b7-4d3b-8345-2022918097d3"}]': finished 2024-06-06T03:16:30.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:29 smithi079 ceph-mon[35478]: osdmap e5: 1 total, 0 up, 1 in 2024-06-06T03:16:30.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:29 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T03:16:30.681 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:30 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-z[37590]: 2024-06-06T03:16:30.415+0000 7fb318f31200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-06T03:16:30.681 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:16:30 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-z[37590]: 2024-06-06T03:16:30.631+0000 7fb318f31200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-06T03:16:30.786 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:30 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y[36846]: 2024-06-06T03:16:30.496+0000 7fe5b1a96200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-06T03:16:30.786 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:30 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y[36846]: 2024-06-06T03:16:30.591+0000 7fe5b1a96200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-06T03:16:30.786 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:30 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y[36846]: 2024-06-06T03:16:30.786+0000 7fe5b1a96200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-06T03:16:30.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:30.994+0000 7f165effd700 1 -- 172.21.15.50:0/3963588042 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 14) ==== 92060+0+0 (secure 0 0 0) 0x7f1658009d10 con 0x7f16681058d0 2024-06-06T03:16:31.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:30 smithi079 ceph-mon[35478]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:31.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:30 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/1334799793' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:16:31.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:30 smithi079 ceph-mon[35478]: Standby manager daemon z started 2024-06-06T03:16:31.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:30 smithi079 ceph-mon[35478]: from='mgr.? 172.21.15.122:0/3174443154' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-06T03:16:31.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:30 smithi079 ceph-mon[35478]: from='mgr.? 172.21.15.122:0/3174443154' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-06T03:16:31.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:30 smithi079 ceph-mon[35478]: from='mgr.? 172.21.15.122:0/3174443154' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-06T03:16:31.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:30 smithi079 ceph-mon[35478]: from='mgr.? 172.21.15.122:0/3174443154' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-06T03:16:31.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:30 smithi050 ceph-mon[32421]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:31.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:30 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1334799793' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:16:31.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:30 smithi050 ceph-mon[32421]: Standby manager daemon z started 2024-06-06T03:16:31.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:30 smithi050 ceph-mon[32421]: from='mgr.? 172.21.15.122:0/3174443154' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-06T03:16:31.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:30 smithi050 ceph-mon[32421]: from='mgr.? 172.21.15.122:0/3174443154' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-06T03:16:31.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:30 smithi050 ceph-mon[32421]: from='mgr.? 172.21.15.122:0/3174443154' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-06T03:16:31.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:30 smithi050 ceph-mon[32421]: from='mgr.? 172.21.15.122:0/3174443154' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-06T03:16:31.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:30 smithi122 ceph-mon[35759]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:31.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:30 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/1334799793' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:16:31.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:30 smithi122 ceph-mon[35759]: Standby manager daemon z started 2024-06-06T03:16:31.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:30 smithi122 ceph-mon[35759]: from='mgr.? 172.21.15.122:0/3174443154' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-06T03:16:31.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:30 smithi122 ceph-mon[35759]: from='mgr.? 172.21.15.122:0/3174443154' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-06T03:16:31.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:30 smithi122 ceph-mon[35759]: from='mgr.? 172.21.15.122:0/3174443154' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-06T03:16:31.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:30 smithi122 ceph-mon[35759]: from='mgr.? 172.21.15.122:0/3174443154' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-06T03:16:31.599 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:31 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y[36846]: 2024-06-06T03:16:31.299+0000 7fe5b1a96200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-06T03:16:31.599 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:31 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y[36846]: 2024-06-06T03:16:31.388+0000 7fe5b1a96200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-06T03:16:31.957 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:31 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y[36846]: 2024-06-06T03:16:31.624+0000 7fe5b1a96200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-06T03:16:31.957 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:31 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y[36846]: 2024-06-06T03:16:31.753+0000 7fe5b1a96200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-06T03:16:31.957 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:31 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y[36846]: 2024-06-06T03:16:31.845+0000 7fe5b1a96200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-06T03:16:31.957 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:31 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y[36846]: 2024-06-06T03:16:31.957+0000 7fe5b1a96200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-06T03:16:32.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:31 smithi050 ceph-mon[32421]: mgrmap e14: x(active, since 77s), standbys: z 2024-06-06T03:16:32.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:31 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-06T03:16:32.252 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:31 smithi079 ceph-mon[35478]: mgrmap e14: x(active, since 77s), standbys: z 2024-06-06T03:16:32.252 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:31 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-06T03:16:32.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:31 smithi122 ceph-mon[35759]: mgrmap e14: x(active, since 77s), standbys: z 2024-06-06T03:16:32.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:31 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-06T03:16:32.599 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:32 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y[36846]: 2024-06-06T03:16:32.251+0000 7fe5b1a96200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-06T03:16:33.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:32 smithi079 ceph-mon[35478]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:33.100 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:32 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y[36846]: 2024-06-06T03:16:32.839+0000 7fe5b1a96200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-06T03:16:33.100 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:16:33 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y[36846]: 2024-06-06T03:16:33.049+0000 7fe5b1a96200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-06T03:16:33.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:32 smithi050 ceph-mon[32421]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:33.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:32 smithi122 ceph-mon[35759]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:34.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:34.009+0000 7f165effd700 1 -- 172.21.15.50:0/3963588042 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f165802b440 con 0x7f16681058d0 2024-06-06T03:16:34.078 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:34 smithi050 ceph-mon[32421]: Standby manager daemon y started 2024-06-06T03:16:34.078 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:34 smithi050 ceph-mon[32421]: from='mgr.? 172.21.15.79:0/791321929' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-06T03:16:34.078 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:34 smithi050 ceph-mon[32421]: from='mgr.? 172.21.15.79:0/791321929' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-06T03:16:34.078 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:34 smithi050 ceph-mon[32421]: from='mgr.? 172.21.15.79:0/791321929' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-06T03:16:34.078 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:34 smithi050 ceph-mon[32421]: from='mgr.? 172.21.15.79:0/791321929' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-06T03:16:34.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:34 smithi079 ceph-mon[35478]: Standby manager daemon y started 2024-06-06T03:16:34.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:34 smithi079 ceph-mon[35478]: from='mgr.? 172.21.15.79:0/791321929' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-06T03:16:34.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:34 smithi079 ceph-mon[35478]: from='mgr.? 172.21.15.79:0/791321929' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-06T03:16:34.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:34 smithi079 ceph-mon[35478]: from='mgr.? 172.21.15.79:0/791321929' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-06T03:16:34.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:34 smithi079 ceph-mon[35478]: from='mgr.? 172.21.15.79:0/791321929' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-06T03:16:34.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:34 smithi122 ceph-mon[35759]: Standby manager daemon y started 2024-06-06T03:16:34.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:34 smithi122 ceph-mon[35759]: from='mgr.? 172.21.15.79:0/791321929' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-06T03:16:34.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:34 smithi122 ceph-mon[35759]: from='mgr.? 172.21.15.79:0/791321929' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-06T03:16:34.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:34 smithi122 ceph-mon[35759]: from='mgr.? 172.21.15.79:0/791321929' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-06T03:16:34.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:34 smithi122 ceph-mon[35759]: from='mgr.? 172.21.15.79:0/791321929' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-06T03:16:35.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:35 smithi050 ceph-mon[32421]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:35.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:35 smithi050 ceph-mon[32421]: mgrmap e15: x(active, since 80s), standbys: z, y 2024-06-06T03:16:35.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:35 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-06T03:16:35.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:35 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:35.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:35 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:35.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:35 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:16:35.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:35 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:35.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:35 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:16:35.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:35 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:35.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:35 smithi079 ceph-mon[35478]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:35.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:35 smithi079 ceph-mon[35478]: mgrmap e15: x(active, since 80s), standbys: z, y 2024-06-06T03:16:35.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:35 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-06T03:16:35.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:35 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:35.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:35 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:35.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:35 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:16:35.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:35 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:35.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:35 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:16:35.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:35 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:35.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:35 smithi122 ceph-mon[35759]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:35.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:35 smithi122 ceph-mon[35759]: mgrmap e15: x(active, since 80s), standbys: z, y 2024-06-06T03:16:35.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:35 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-06T03:16:35.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:35 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:35.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:35 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:35.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:35 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:16:35.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:35 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:35.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:35 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:16:35.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:35 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:37.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:37 smithi079 ceph-mon[35478]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:37.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:37 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-06T03:16:37.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:37 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:37.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:37 smithi122 ceph-mon[35759]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:37.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:37 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-06T03:16:37.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:37 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:37.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:37 smithi050 ceph-mon[32421]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:37.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:37 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-06T03:16:37.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:37 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:38.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:38 smithi050 ceph-mon[32421]: Deploying daemon osd.0 on smithi050 2024-06-06T03:16:38.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:38 smithi079 ceph-mon[35478]: Deploying daemon osd.0 on smithi050 2024-06-06T03:16:38.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:38 smithi122 ceph-mon[35759]: Deploying daemon osd.0 on smithi050 2024-06-06T03:16:39.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:39 smithi079 ceph-mon[35478]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:39.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:39 smithi122 ceph-mon[35759]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:39.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:39 smithi050 ceph-mon[32421]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:41.298 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:41 smithi050 ceph-mon[32421]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:41.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:41 smithi079 ceph-mon[35478]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:41.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:41 smithi122 ceph-mon[35759]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:43.146 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:43 smithi050 ceph-mon[32421]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:43.146 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:43 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:43.146 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:43 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:43.146 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:43 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:16:43.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:43 smithi079 ceph-mon[35478]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:43.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:43 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:43.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:43 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:43.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:43 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:16:43.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:43 smithi122 ceph-mon[35759]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:43.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:43 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:43.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:43 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:43.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:43 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:16:45.169 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:45 smithi050 ceph-mon[32421]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:45.169 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:45 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:45.169 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:45 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:45.169 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:45 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:45.169 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:45 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:16:45.169 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:45 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:45.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:45 smithi079 ceph-mon[35478]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:45.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:45 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:45.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:45 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:45.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:45 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:45.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:45 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:16:45.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:45 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:45.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:45 smithi122 ceph-mon[35759]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:45.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:45 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:45.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:45 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:45.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:45 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:45.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:45 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:16:45.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:45 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:45.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:45.822+0000 7f165effd700 1 -- 172.21.15.50:0/3963588042 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f16680628d0 con 0x7f1654039330 2024-06-06T03:16:45.821 INFO:teuthology.orchestra.run.smithi050.stdout:Created osd(s) 0 on host 'smithi050' 2024-06-06T03:16:45.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:45.824+0000 7f166fd1d700 1 -- 172.21.15.50:0/3963588042 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f1654039330 msgr2=0x7f165403b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:16:45.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:45.824+0000 7f166fd1d700 1 --2- 172.21.15.50:0/3963588042 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f1654039330 0x7f165403b7f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1664010420 tx=0x7f16640073d0 comp rx=0 tx=0).stop 2024-06-06T03:16:45.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:45.824+0000 7f166fd1d700 1 -- 172.21.15.50:0/3963588042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16681058d0 msgr2=0x7f1668198b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:16:45.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:45.824+0000 7f166fd1d700 1 --2- 172.21.15.50:0/3963588042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16681058d0 0x7f1668198b70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1658005910 tx=0x7f1658009580 comp rx=0 tx=0).stop 2024-06-06T03:16:45.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:45.824+0000 7f166fd1d700 1 -- 172.21.15.50:0/3963588042 shutdown_connections 2024-06-06T03:16:45.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:45.824+0000 7f166fd1d700 1 --2- 172.21.15.50:0/3963588042 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1668108200 0x7f166819fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:45.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:45.824+0000 7f166fd1d700 1 --2- 172.21.15.50:0/3963588042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1668102fa0 0x7f1668198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:45.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:45.824+0000 7f166fd1d700 1 --2- 172.21.15.50:0/3963588042 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f1654039330 0x7f165403b7f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:45.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:45.824+0000 7f166fd1d700 1 --2- 172.21.15.50:0/3963588042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16681058d0 0x7f1668198b70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:45.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:45.824+0000 7f166fd1d700 1 -- 172.21.15.50:0/3963588042 >> 172.21.15.50:0/3963588042 conn(0x7f16680fc9b0 msgr2=0x7f1668103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:16:45.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:45.824+0000 7f166fd1d700 1 -- 172.21.15.50:0/3963588042 shutdown_connections 2024-06-06T03:16:45.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:16:45.824+0000 7f166fd1d700 1 -- 172.21.15.50:0/3963588042 wait complete. 2024-06-06T03:16:46.443 DEBUG:teuthology.orchestra.run.smithi050:osd.0> sudo journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.0.service 2024-06-06T03:16:46.445 INFO:tasks.cephadm:Deploying osd.1 on smithi079 with /dev/vg_nvme/lv_4... 2024-06-06T03:16:46.445 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-06-06T03:16:46.689 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T03:16:47.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:46 smithi050 ceph-mon[32421]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:47.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:46 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:47.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:46 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:16:47.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:46 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:47.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:46 smithi050 ceph-mon[32421]: from='osd.0 [v2:172.21.15.50:6802/2379528827,v1:172.21.15.50:6803/2379528827]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-06T03:16:47.090 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:46 smithi079 ceph-mon[35478]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:47.091 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:46 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:47.091 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:46 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:16:47.091 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:46 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:47.091 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:46 smithi079 ceph-mon[35478]: from='osd.0 [v2:172.21.15.50:6802/2379528827,v1:172.21.15.50:6803/2379528827]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-06T03:16:47.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:46 smithi122 ceph-mon[35759]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:47.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:46 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:47.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:46 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:16:47.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:46 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:47.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:46 smithi122 ceph-mon[35759]: from='osd.0 [v2:172.21.15.50:6802/2379528827,v1:172.21.15.50:6803/2379528827]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-06T03:16:48.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:48 smithi050 ceph-mon[32421]: from='osd.0 [v2:172.21.15.50:6802/2379528827,v1:172.21.15.50:6803/2379528827]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-06T03:16:48.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:48 smithi050 ceph-mon[32421]: osdmap e6: 1 total, 0 up, 1 in 2024-06-06T03:16:48.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:48 smithi050 ceph-mon[32421]: from='osd.0 [v2:172.21.15.50:6802/2379528827,v1:172.21.15.50:6803/2379528827]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-06-06T03:16:48.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:48 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T03:16:48.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:48 smithi079 ceph-mon[35478]: from='osd.0 [v2:172.21.15.50:6802/2379528827,v1:172.21.15.50:6803/2379528827]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-06T03:16:48.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:48 smithi079 ceph-mon[35478]: osdmap e6: 1 total, 0 up, 1 in 2024-06-06T03:16:48.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:48 smithi079 ceph-mon[35478]: from='osd.0 [v2:172.21.15.50:6802/2379528827,v1:172.21.15.50:6803/2379528827]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-06-06T03:16:48.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:48 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T03:16:48.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:48 smithi122 ceph-mon[35759]: from='osd.0 [v2:172.21.15.50:6802/2379528827,v1:172.21.15.50:6803/2379528827]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-06T03:16:48.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:48 smithi122 ceph-mon[35759]: osdmap e6: 1 total, 0 up, 1 in 2024-06-06T03:16:48.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:48 smithi122 ceph-mon[35759]: from='osd.0 [v2:172.21.15.50:6802/2379528827,v1:172.21.15.50:6803/2379528827]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-06-06T03:16:48.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:48 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T03:16:48.566 INFO:teuthology.orchestra.run.smithi079.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-06-06T03:16:48.566 INFO:teuthology.orchestra.run.smithi079.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-06-06T03:16:48.566 INFO:teuthology.orchestra.run.smithi079.stderr: stderr: 10+0 records in 2024-06-06T03:16:48.566 INFO:teuthology.orchestra.run.smithi079.stderr:10+0 records out 2024-06-06T03:16:48.566 INFO:teuthology.orchestra.run.smithi079.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110969 s, 945 MB/s 2024-06-06T03:16:48.566 INFO:teuthology.orchestra.run.smithi079.stderr:--> Zapping successful for: 2024-06-06T03:16:49.001 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jun 06 03:16:48 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-0[47092]: 2024-06-06T03:16:48.568+0000 7f12ed4bb700 -1 osd.0 0 waiting for initial osdmap 2024-06-06T03:16:49.002 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jun 06 03:16:48 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-0[47092]: 2024-06-06T03:16:48.572+0000 7f12e52a6700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T03:16:49.133 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:49 smithi079 ceph-mon[35478]: purged_snaps scrub starts 2024-06-06T03:16:49.133 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:49 smithi079 ceph-mon[35478]: purged_snaps scrub ok 2024-06-06T03:16:49.133 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:49 smithi079 ceph-mon[35478]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:49.133 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:49 smithi079 ceph-mon[35478]: from='osd.0 [v2:172.21.15.50:6802/2379528827,v1:172.21.15.50:6803/2379528827]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-06-06T03:16:49.134 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:49 smithi079 ceph-mon[35478]: osdmap e7: 1 total, 0 up, 1 in 2024-06-06T03:16:49.134 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:49 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T03:16:49.134 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:49 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T03:16:49.134 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:49 smithi079 ceph-mon[35478]: from='osd.0 [v2:172.21.15.50:6802/2379528827,v1:172.21.15.50:6803/2379528827]' entity='osd.0' 2024-06-06T03:16:49.135 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi079:vg_nvme/lv_4 2024-06-06T03:16:49.376 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T03:16:49.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:49 smithi122 ceph-mon[35759]: purged_snaps scrub starts 2024-06-06T03:16:49.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:49 smithi122 ceph-mon[35759]: purged_snaps scrub ok 2024-06-06T03:16:49.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:49 smithi122 ceph-mon[35759]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:49.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:49 smithi122 ceph-mon[35759]: from='osd.0 [v2:172.21.15.50:6802/2379528827,v1:172.21.15.50:6803/2379528827]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-06-06T03:16:49.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:49 smithi122 ceph-mon[35759]: osdmap e7: 1 total, 0 up, 1 in 2024-06-06T03:16:49.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:49 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T03:16:49.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:49 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T03:16:49.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:49 smithi122 ceph-mon[35759]: from='osd.0 [v2:172.21.15.50:6802/2379528827,v1:172.21.15.50:6803/2379528827]' entity='osd.0' 2024-06-06T03:16:49.486 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:49 smithi050 ceph-mon[32421]: purged_snaps scrub starts 2024-06-06T03:16:49.487 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:49 smithi050 ceph-mon[32421]: purged_snaps scrub ok 2024-06-06T03:16:49.487 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:49 smithi050 ceph-mon[32421]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:49.487 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:49 smithi050 ceph-mon[32421]: from='osd.0 [v2:172.21.15.50:6802/2379528827,v1:172.21.15.50:6803/2379528827]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-06-06T03:16:49.487 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:49 smithi050 ceph-mon[32421]: osdmap e7: 1 total, 0 up, 1 in 2024-06-06T03:16:49.487 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:49 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T03:16:49.487 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:49 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T03:16:49.487 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:49 smithi050 ceph-mon[32421]: from='osd.0 [v2:172.21.15.50:6802/2379528827,v1:172.21.15.50:6803/2379528827]' entity='osd.0' 2024-06-06T03:16:50.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:50 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T03:16:50.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:50 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:50.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:50 smithi050 ceph-mon[32421]: osd.0 [v2:172.21.15.50:6802/2379528827,v1:172.21.15.50:6803/2379528827] boot 2024-06-06T03:16:50.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:50 smithi050 ceph-mon[32421]: osdmap e8: 1 total, 1 up, 1 in 2024-06-06T03:16:50.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:50 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T03:16:50.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:50 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:50.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:50 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:16:50.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:50 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:50.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:50 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:50.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:50 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:16:50.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:50 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:50.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:50 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T03:16:50.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:50 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:50.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:50 smithi079 ceph-mon[35478]: osd.0 [v2:172.21.15.50:6802/2379528827,v1:172.21.15.50:6803/2379528827] boot 2024-06-06T03:16:50.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:50 smithi079 ceph-mon[35478]: osdmap e8: 1 total, 1 up, 1 in 2024-06-06T03:16:50.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:50 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T03:16:50.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:50 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:50.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:50 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:16:50.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:50 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:50.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:50 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:50.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:50 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:16:50.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:50 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:50.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:50 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T03:16:50.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:50 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:50.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:50 smithi122 ceph-mon[35759]: osd.0 [v2:172.21.15.50:6802/2379528827,v1:172.21.15.50:6803/2379528827] boot 2024-06-06T03:16:50.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:50 smithi122 ceph-mon[35759]: osdmap e8: 1 total, 1 up, 1 in 2024-06-06T03:16:50.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:50 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T03:16:50.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:50 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:50.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:50 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:16:50.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:50 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:50.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:50 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:50.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:50 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:16:50.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:50 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:16:50.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.896+0000 7f6a14907700 1 -- 172.21.15.79:0/3116964771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a101013f0 msgr2=0x7f6a10101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:16:50.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.896+0000 7f6a14907700 1 --2- 172.21.15.79:0/3116964771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a101013f0 0x7f6a10101810 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6a000099c0 tx=0x7f6a00009cd0 comp rx=0 tx=0).stop 2024-06-06T03:16:50.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.896+0000 7f6a14907700 1 -- 172.21.15.79:0/3116964771 shutdown_connections 2024-06-06T03:16:50.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.896+0000 7f6a14907700 1 --2- 172.21.15.79:0/3116964771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a10102f90 0x7f6a10109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:50.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.896+0000 7f6a14907700 1 --2- 172.21.15.79:0/3116964771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a101013f0 0x7f6a10101810 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:50.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.896+0000 7f6a14907700 1 --2- 172.21.15.79:0/3116964771 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a101025f0 0x7f6a10102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:50.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.896+0000 7f6a14907700 1 -- 172.21.15.79:0/3116964771 >> 172.21.15.79:0/3116964771 conn(0x7f6a100fc990 msgr2=0x7f6a100fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:16:50.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.896+0000 7f6a14907700 1 -- 172.21.15.79:0/3116964771 shutdown_connections 2024-06-06T03:16:50.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.896+0000 7f6a14907700 1 -- 172.21.15.79:0/3116964771 wait complete. 2024-06-06T03:16:50.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.897+0000 7f6a14907700 1 Processor -- start 2024-06-06T03:16:50.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.897+0000 7f6a14907700 1 -- start start 2024-06-06T03:16:50.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.897+0000 7f6a14907700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a101013f0 0x7f6a10105380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:16:50.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.897+0000 7f6a14907700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a101025f0 0x7f6a101039d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:16:50.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.897+0000 7f6a14907700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a10102f90 0x7f6a10103f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:16:50.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.897+0000 7f6a14907700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1010cf00 con 0x7f6a101013f0 2024-06-06T03:16:50.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.897+0000 7f6a14907700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1010cd80 con 0x7f6a101025f0 2024-06-06T03:16:50.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.897+0000 7f6a14907700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1010d080 con 0x7f6a10102f90 2024-06-06T03:16:50.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.897+0000 7f6a0dd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a101025f0 0x7f6a101039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:16:50.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.897+0000 7f6a0dd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a101025f0 0x7f6a101039d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33144/0 (socket says 172.21.15.79:33144) 2024-06-06T03:16:50.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.897+0000 7f6a0dd9b700 1 -- 172.21.15.79:0/1563245965 learned_addr learned my addr 172.21.15.79:0/1563245965 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-06T03:16:50.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.897+0000 7f6a0e59c700 1 --2- 172.21.15.79:0/1563245965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a101013f0 0x7f6a10105380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:16:50.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.898+0000 7f6a0ed9d700 1 --2- 172.21.15.79:0/1563245965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a10102f90 0x7f6a10103f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:16:50.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.898+0000 7f6a0dd9b700 1 -- 172.21.15.79:0/1563245965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a10102f90 msgr2=0x7f6a10103f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:16:50.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.898+0000 7f6a0dd9b700 1 --2- 172.21.15.79:0/1563245965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a10102f90 0x7f6a10103f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:50.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.898+0000 7f6a0dd9b700 1 -- 172.21.15.79:0/1563245965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a101013f0 msgr2=0x7f6a10105380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:16:50.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.898+0000 7f6a0dd9b700 1 --2- 172.21.15.79:0/1563245965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a101013f0 0x7f6a10105380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:16:50.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.898+0000 7f6a0dd9b700 1 -- 172.21.15.79:0/1563245965 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a101047c0 con 0x7f6a101025f0 2024-06-06T03:16:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.898+0000 7f6a0e59c700 1 --2- 172.21.15.79:0/1563245965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a101013f0 0x7f6a10105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:16:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.898+0000 7f6a0dd9b700 1 --2- 172.21.15.79:0/1563245965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a101025f0 0x7f6a101039d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400c970 tx=0x7f6a0400cd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:16:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.898+0000 7f69ff7fe700 1 -- 172.21.15.79:0/1563245965 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a04007aa0 con 0x7f6a101025f0 2024-06-06T03:16:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.898+0000 7f6a14907700 1 -- 172.21.15.79:0/1563245965 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a101a28b0 con 0x7f6a101025f0 2024-06-06T03:16:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.898+0000 7f69ff7fe700 1 -- 172.21.15.79:0/1563245965 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6a04004ce0 con 0x7f6a101025f0 2024-06-06T03:16:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.898+0000 7f69ff7fe700 1 -- 172.21.15.79:0/1563245965 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a04005620 con 0x7f6a101025f0 2024-06-06T03:16:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.898+0000 7f6a14907700 1 -- 172.21.15.79:0/1563245965 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a101a2e40 con 0x7f6a101025f0 2024-06-06T03:16:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.899+0000 7f6a14907700 1 -- 172.21.15.79:0/1563245965 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a10069180 con 0x7f6a101025f0 2024-06-06T03:16:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.900+0000 7f69ff7fe700 1 -- 172.21.15.79:0/1563245965 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f6a04004750 con 0x7f6a101025f0 2024-06-06T03:16:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.901+0000 7f69ff7fe700 1 --2- 172.21.15.79:0/1563245965 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f69f80a2b90 0x7f69f80a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:16:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.901+0000 7f69ff7fe700 1 -- 172.21.15.79:0/1563245965 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7f6a040cd3e0 con 0x7f6a101025f0 2024-06-06T03:16:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.901+0000 7f6a0e59c700 1 --2- 172.21.15.79:0/1563245965 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f69f80a2b90 0x7f69f80a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:16:50.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.902+0000 7f6a0e59c700 1 --2- 172.21.15.79:0/1563245965 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f69f80a2b90 0x7f69f80a5050 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6a00000c00 tx=0x7f6a00005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:16:50.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:50.906+0000 7f69ff7fe700 1 -- 172.21.15.79:0/1563245965 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6a0409be40 con 0x7f6a101025f0 2024-06-06T03:16:51.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:16:51.109+0000 7f6a14907700 1 -- 172.21.15.79:0/1563245965 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f6a101a30d0 con 0x7f69f80a2b90 2024-06-06T03:16:51.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:51 smithi079 ceph-mon[35478]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:51.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:51 smithi079 ceph-mon[35478]: Detected new or changed devices on smithi050 2024-06-06T03:16:51.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:51 smithi079 ceph-mon[35478]: Adjusting osd_memory_target on smithi050 to 17092M 2024-06-06T03:16:51.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:51 smithi079 ceph-mon[35478]: osdmap e9: 1 total, 1 up, 1 in 2024-06-06T03:16:51.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:51 smithi122 ceph-mon[35759]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:51.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:51 smithi122 ceph-mon[35759]: Detected new or changed devices on smithi050 2024-06-06T03:16:51.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:51 smithi122 ceph-mon[35759]: Adjusting osd_memory_target on smithi050 to 17092M 2024-06-06T03:16:51.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:51 smithi122 ceph-mon[35759]: osdmap e9: 1 total, 1 up, 1 in 2024-06-06T03:16:51.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:51 smithi050 ceph-mon[32421]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T03:16:51.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:51 smithi050 ceph-mon[32421]: Detected new or changed devices on smithi050 2024-06-06T03:16:51.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:51 smithi050 ceph-mon[32421]: Adjusting osd_memory_target on smithi050 to 17092M 2024-06-06T03:16:51.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:51 smithi050 ceph-mon[32421]: osdmap e9: 1 total, 1 up, 1 in 2024-06-06T03:16:52.339 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:52 smithi079 ceph-mon[35478]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:16:52.340 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:52 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:16:52.340 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:52 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:16:52.340 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:52 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:52.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:52 smithi122 ceph-mon[35759]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:16:52.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:52 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:16:52.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:52 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:16:52.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:52 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:52.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:52 smithi050 ceph-mon[32421]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:16:52.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:52 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:16:52.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:52 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:16:52.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:52 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:16:53.333 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:53 smithi122 ceph-mon[35759]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:16:53.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:53 smithi079 ceph-mon[35478]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:16:53.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:53 smithi050 ceph-mon[32421]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:16:54.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:54 smithi079 ceph-mon[35478]: from='client.? 172.21.15.79:0/1857547080' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "089ecb78-5e1e-4cdb-8fe0-5c1731ec9dce"}]: dispatch 2024-06-06T03:16:54.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:54 smithi079 ceph-mon[35478]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "089ecb78-5e1e-4cdb-8fe0-5c1731ec9dce"}]: dispatch 2024-06-06T03:16:54.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:54 smithi079 ceph-mon[35478]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "089ecb78-5e1e-4cdb-8fe0-5c1731ec9dce"}]': finished 2024-06-06T03:16:54.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:54 smithi079 ceph-mon[35478]: osdmap e10: 2 total, 1 up, 2 in 2024-06-06T03:16:54.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:54 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T03:16:54.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:54 smithi122 ceph-mon[35759]: from='client.? 172.21.15.79:0/1857547080' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "089ecb78-5e1e-4cdb-8fe0-5c1731ec9dce"}]: dispatch 2024-06-06T03:16:54.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:54 smithi122 ceph-mon[35759]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "089ecb78-5e1e-4cdb-8fe0-5c1731ec9dce"}]: dispatch 2024-06-06T03:16:54.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:54 smithi122 ceph-mon[35759]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "089ecb78-5e1e-4cdb-8fe0-5c1731ec9dce"}]': finished 2024-06-06T03:16:54.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:54 smithi122 ceph-mon[35759]: osdmap e10: 2 total, 1 up, 2 in 2024-06-06T03:16:54.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:54 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T03:16:54.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:54 smithi050 ceph-mon[32421]: from='client.? 172.21.15.79:0/1857547080' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "089ecb78-5e1e-4cdb-8fe0-5c1731ec9dce"}]: dispatch 2024-06-06T03:16:54.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:54 smithi050 ceph-mon[32421]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "089ecb78-5e1e-4cdb-8fe0-5c1731ec9dce"}]: dispatch 2024-06-06T03:16:54.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:54 smithi050 ceph-mon[32421]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "089ecb78-5e1e-4cdb-8fe0-5c1731ec9dce"}]': finished 2024-06-06T03:16:54.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:54 smithi050 ceph-mon[32421]: osdmap e10: 2 total, 1 up, 2 in 2024-06-06T03:16:54.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:54 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T03:16:55.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:55 smithi079 ceph-mon[35478]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:16:55.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:55 smithi079 ceph-mon[35478]: from='client.? 172.21.15.79:0/2946383646' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:16:55.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:55 smithi122 ceph-mon[35759]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:16:55.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:55 smithi122 ceph-mon[35759]: from='client.? 172.21.15.79:0/2946383646' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:16:55.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:55 smithi050 ceph-mon[32421]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:16:55.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:55 smithi050 ceph-mon[32421]: from='client.? 172.21.15.79:0/2946383646' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:16:57.335 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:57 smithi079 ceph-mon[35478]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:16:57.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:57 smithi122 ceph-mon[35759]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:16:57.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:57 smithi050 ceph-mon[32421]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:16:59.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:16:59 smithi079 ceph-mon[35478]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:16:59.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:16:59 smithi122 ceph-mon[35759]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:16:59.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:16:59 smithi050 ceph-mon[32421]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:17:01.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:01 smithi079 ceph-mon[35478]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:17:01.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:01 smithi122 ceph-mon[35759]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:17:01.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:01 smithi050 ceph-mon[32421]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:17:02.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:02 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-06T03:17:02.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:02 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:17:02.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:02 smithi079 ceph-mon[35478]: Deploying daemon osd.1 on smithi079 2024-06-06T03:17:02.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:02 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-06T03:17:02.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:02 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:17:02.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:02 smithi122 ceph-mon[35759]: Deploying daemon osd.1 on smithi079 2024-06-06T03:17:02.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:02 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-06T03:17:02.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:02 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:17:02.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:02 smithi050 ceph-mon[32421]: Deploying daemon osd.1 on smithi079 2024-06-06T03:17:03.239 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:03 smithi079 ceph-mon[35478]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:17:03.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:03 smithi122 ceph-mon[35759]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:17:03.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:03 smithi050 ceph-mon[32421]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:17:05.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:05 smithi079 ceph-mon[35478]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:17:05.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:05 smithi122 ceph-mon[35759]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:17:05.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:05 smithi050 ceph-mon[32421]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:17:07.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:07 smithi079 ceph-mon[35478]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:17:07.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:07 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:07.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:07 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:07.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:07 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:17:07.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:07 smithi122 ceph-mon[35759]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:17:07.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:07 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:07.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:07 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:07.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:07 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:17:07.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:07 smithi050 ceph-mon[32421]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:17:07.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:07 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:07.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:07 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:07.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:07 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:17:09.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:09 smithi079 ceph-mon[35478]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:17:09.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:09 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:09.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:09 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:09.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:09 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:17:09.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:09 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:17:09.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:09 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:09.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:09 smithi122 ceph-mon[35759]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:17:09.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:09 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:09.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:09 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:09.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:09 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:17:09.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:09 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:17:09.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:09 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:09.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:09 smithi050 ceph-mon[32421]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:17:09.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:09 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:09.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:09 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:09.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:09 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:17:09.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:09 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:17:09.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:09 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:10.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:17:10.078+0000 7f69ff7fe700 1 -- 172.21.15.79:0/1563245965 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6a101a30d0 con 0x7f69f80a2b90 2024-06-06T03:17:10.078 INFO:teuthology.orchestra.run.smithi079.stdout:Created osd(s) 1 on host 'smithi079' 2024-06-06T03:17:10.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:17:10.080+0000 7f6a14907700 1 -- 172.21.15.79:0/1563245965 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f69f80a2b90 msgr2=0x7f69f80a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:17:10.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:17:10.080+0000 7f6a14907700 1 --2- 172.21.15.79:0/1563245965 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f69f80a2b90 0x7f69f80a5050 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6a00000c00 tx=0x7f6a00005fd0 comp rx=0 tx=0).stop 2024-06-06T03:17:10.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:17:10.080+0000 7f6a14907700 1 -- 172.21.15.79:0/1563245965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a101025f0 msgr2=0x7f6a101039d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:17:10.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:17:10.080+0000 7f6a14907700 1 --2- 172.21.15.79:0/1563245965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a101025f0 0x7f6a101039d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400c970 tx=0x7f6a0400cd30 comp rx=0 tx=0).stop 2024-06-06T03:17:10.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:17:10.080+0000 7f6a14907700 1 -- 172.21.15.79:0/1563245965 shutdown_connections 2024-06-06T03:17:10.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:17:10.080+0000 7f6a14907700 1 --2- 172.21.15.79:0/1563245965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a10102f90 0x7f6a10103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:17:10.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:17:10.080+0000 7f6a14907700 1 --2- 172.21.15.79:0/1563245965 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f69f80a2b90 0x7f69f80a5050 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:17:10.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:17:10.080+0000 7f6a14907700 1 --2- 172.21.15.79:0/1563245965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a101013f0 0x7f6a10105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:17:10.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:17:10.080+0000 7f6a14907700 1 --2- 172.21.15.79:0/1563245965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a101025f0 0x7f6a101039d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:17:10.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:17:10.080+0000 7f6a14907700 1 -- 172.21.15.79:0/1563245965 >> 172.21.15.79:0/1563245965 conn(0x7f6a100fc990 msgr2=0x7f6a100fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:17:10.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:17:10.080+0000 7f6a14907700 1 -- 172.21.15.79:0/1563245965 shutdown_connections 2024-06-06T03:17:10.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:17:10.080+0000 7f6a14907700 1 -- 172.21.15.79:0/1563245965 wait complete. 2024-06-06T03:17:10.775 DEBUG:teuthology.orchestra.run.smithi079:osd.1> sudo journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.1.service 2024-06-06T03:17:10.778 INFO:tasks.cephadm:Deploying osd.2 on smithi122 with /dev/vg_nvme/lv_4... 2024-06-06T03:17:10.778 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-06-06T03:17:11.018 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T03:17:11.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:11 smithi079 ceph-mon[35478]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:17:11.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:11 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:11.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:11 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:11.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:11 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:17:11.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:11 smithi079 ceph-mon[35478]: from='osd.1 [v2:172.21.15.79:6800/3498354151,v1:172.21.15.79:6801/3498354151]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-06T03:17:11.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:11 smithi079 ceph-mon[35478]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-06T03:17:11.365 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:11 smithi122 ceph-mon[35759]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:17:11.365 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:11 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:11.365 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:11 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:11.365 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:11 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:17:11.365 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:11 smithi122 ceph-mon[35759]: from='osd.1 [v2:172.21.15.79:6800/3498354151,v1:172.21.15.79:6801/3498354151]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-06T03:17:11.365 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:11 smithi122 ceph-mon[35759]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-06T03:17:11.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:11 smithi050 ceph-mon[32421]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:17:11.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:11 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:11.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:11 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:11.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:11 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:17:11.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:11 smithi050 ceph-mon[32421]: from='osd.1 [v2:172.21.15.79:6800/3498354151,v1:172.21.15.79:6801/3498354151]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-06T03:17:11.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:11 smithi050 ceph-mon[32421]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-06T03:17:12.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:12 smithi122 ceph-mon[35759]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-06T03:17:12.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:12 smithi122 ceph-mon[35759]: osdmap e11: 2 total, 1 up, 2 in 2024-06-06T03:17:12.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:12 smithi122 ceph-mon[35759]: from='osd.1 [v2:172.21.15.79:6800/3498354151,v1:172.21.15.79:6801/3498354151]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-06-06T03:17:12.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:12 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T03:17:12.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:12 smithi122 ceph-mon[35759]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-06-06T03:17:12.239 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:12 smithi079 ceph-mon[35478]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-06T03:17:12.239 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:12 smithi079 ceph-mon[35478]: osdmap e11: 2 total, 1 up, 2 in 2024-06-06T03:17:12.239 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:12 smithi079 ceph-mon[35478]: from='osd.1 [v2:172.21.15.79:6800/3498354151,v1:172.21.15.79:6801/3498354151]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-06-06T03:17:12.239 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:12 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T03:17:12.239 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:12 smithi079 ceph-mon[35478]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-06-06T03:17:12.240 INFO:journalctl@ceph.osd.1.smithi079.stdout:Jun 06 03:17:12 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-1[40039]: 2024-06-06T03:17:12.089+0000 7f68d702e700 -1 osd.1 0 waiting for initial osdmap 2024-06-06T03:17:12.240 INFO:journalctl@ceph.osd.1.smithi079.stdout:Jun 06 03:17:12 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-1[40039]: 2024-06-06T03:17:12.092+0000 7f68d2e21700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T03:17:12.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:12 smithi050 ceph-mon[32421]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-06T03:17:12.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:12 smithi050 ceph-mon[32421]: osdmap e11: 2 total, 1 up, 2 in 2024-06-06T03:17:12.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:12 smithi050 ceph-mon[32421]: from='osd.1 [v2:172.21.15.79:6800/3498354151,v1:172.21.15.79:6801/3498354151]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-06-06T03:17:12.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:12 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T03:17:12.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:12 smithi050 ceph-mon[32421]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-06-06T03:17:12.762 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-06-06T03:17:12.762 INFO:teuthology.orchestra.run.smithi122.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-06-06T03:17:12.763 INFO:teuthology.orchestra.run.smithi122.stderr: stderr: 10+0 records in 2024-06-06T03:17:12.763 INFO:teuthology.orchestra.run.smithi122.stderr:10+0 records out 2024-06-06T03:17:12.763 INFO:teuthology.orchestra.run.smithi122.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0109983 s, 953 MB/s 2024-06-06T03:17:12.763 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping successful for: 2024-06-06T03:17:13.335 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi122:vg_nvme/lv_4 2024-06-06T03:17:13.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:13 smithi079 ceph-mon[35478]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:17:13.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:13 smithi079 ceph-mon[35478]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-06-06T03:17:13.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:13 smithi079 ceph-mon[35478]: osdmap e12: 2 total, 1 up, 2 in 2024-06-06T03:17:13.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:13 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T03:17:13.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:13 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T03:17:13.351 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:13 smithi122 ceph-mon[35759]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:17:13.351 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:13 smithi122 ceph-mon[35759]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-06-06T03:17:13.351 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:13 smithi122 ceph-mon[35759]: osdmap e12: 2 total, 1 up, 2 in 2024-06-06T03:17:13.351 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:13 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T03:17:13.352 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:13 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T03:17:13.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:13 smithi050 ceph-mon[32421]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:17:13.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:13 smithi050 ceph-mon[32421]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-06-06T03:17:13.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:13 smithi050 ceph-mon[32421]: osdmap e12: 2 total, 1 up, 2 in 2024-06-06T03:17:13.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T03:17:13.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T03:17:13.576 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T03:17:14.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:14 smithi122 ceph-mon[35759]: purged_snaps scrub starts 2024-06-06T03:17:14.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:14 smithi122 ceph-mon[35759]: purged_snaps scrub ok 2024-06-06T03:17:14.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:14 smithi122 ceph-mon[35759]: osd.1 [v2:172.21.15.79:6800/3498354151,v1:172.21.15.79:6801/3498354151] boot 2024-06-06T03:17:14.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:14 smithi122 ceph-mon[35759]: osdmap e13: 2 total, 2 up, 2 in 2024-06-06T03:17:14.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T03:17:14.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:14.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:14.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:17:14.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:14.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:17:14.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:17:14.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:14.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:14 smithi079 ceph-mon[35478]: purged_snaps scrub starts 2024-06-06T03:17:14.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:14 smithi079 ceph-mon[35478]: purged_snaps scrub ok 2024-06-06T03:17:14.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:14 smithi079 ceph-mon[35478]: osd.1 [v2:172.21.15.79:6800/3498354151,v1:172.21.15.79:6801/3498354151] boot 2024-06-06T03:17:14.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:14 smithi079 ceph-mon[35478]: osdmap e13: 2 total, 2 up, 2 in 2024-06-06T03:17:14.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T03:17:14.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:14.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:14.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:17:14.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:14.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:17:14.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:17:14.351 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:14.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:14 smithi050 ceph-mon[32421]: purged_snaps scrub starts 2024-06-06T03:17:14.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:14 smithi050 ceph-mon[32421]: purged_snaps scrub ok 2024-06-06T03:17:14.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:14 smithi050 ceph-mon[32421]: osd.1 [v2:172.21.15.79:6800/3498354151,v1:172.21.15.79:6801/3498354151] boot 2024-06-06T03:17:14.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:14 smithi050 ceph-mon[32421]: osdmap e13: 2 total, 2 up, 2 in 2024-06-06T03:17:14.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T03:17:14.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:14.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:14.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:17:14.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:14.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:17:14.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:17:14.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:15.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.105+0000 7f3acc684700 1 -- 172.21.15.122:0/3158364635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ac41040a0 msgr2=0x7f3ac410a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:17:15.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.105+0000 7f3acc684700 1 --2- 172.21.15.122:0/3158364635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ac41040a0 0x7f3ac410a950 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3ab400b0a0 tx=0x7f3ab400b3b0 comp rx=0 tx=0).stop 2024-06-06T03:17:15.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.105+0000 7f3acc684700 1 -- 172.21.15.122:0/3158364635 shutdown_connections 2024-06-06T03:17:15.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.105+0000 7f3acc684700 1 --2- 172.21.15.122:0/3158364635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ac41040a0 0x7f3ac410a950 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:17:15.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.105+0000 7f3acc684700 1 --2- 172.21.15.122:0/3158364635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ac4102500 0x7f3ac4102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:17:15.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.105+0000 7f3acc684700 1 --2- 172.21.15.122:0/3158364635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ac4103700 0x7f3ac4103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:17:15.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.105+0000 7f3acc684700 1 -- 172.21.15.122:0/3158364635 >> 172.21.15.122:0/3158364635 conn(0x7f3ac40fda60 msgr2=0x7f3ac40ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:17:15.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.105+0000 7f3acc684700 1 -- 172.21.15.122:0/3158364635 shutdown_connections 2024-06-06T03:17:15.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.105+0000 7f3acc684700 1 -- 172.21.15.122:0/3158364635 wait complete. 2024-06-06T03:17:15.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.106+0000 7f3acc684700 1 Processor -- start 2024-06-06T03:17:15.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.106+0000 7f3acc684700 1 -- start start 2024-06-06T03:17:15.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.106+0000 7f3acc684700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ac4102500 0x7f3ac4198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:17:15.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.106+0000 7f3acc684700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ac4103700 0x7f3ac4198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:17:15.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.106+0000 7f3acc684700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ac41040a0 0x7f3ac419fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:17:15.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.106+0000 7f3acc684700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac410df80 con 0x7f3ac4102500 2024-06-06T03:17:15.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.106+0000 7f3acc684700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac410de00 con 0x7f3ac41040a0 2024-06-06T03:17:15.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.106+0000 7f3acc684700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac410e100 con 0x7f3ac4103700 2024-06-06T03:17:15.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.106+0000 7f3ac9c1f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ac4103700 0x7f3ac4198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:17:15.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.106+0000 7f3ac9c1f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ac4103700 0x7f3ac4198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59056/0 (socket says 172.21.15.122:59056) 2024-06-06T03:17:15.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.106+0000 7f3ac9c1f700 1 -- 172.21.15.122:0/2420993341 learned_addr learned my addr 172.21.15.122:0/2420993341 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-06-06T03:17:15.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.107+0000 7f3aca420700 1 --2- 172.21.15.122:0/2420993341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ac4102500 0x7f3ac4198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:17:15.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.107+0000 7f3acac21700 1 --2- 172.21.15.122:0/2420993341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ac41040a0 0x7f3ac419fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:17:15.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.107+0000 7f3ac9c1f700 1 -- 172.21.15.122:0/2420993341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ac41040a0 msgr2=0x7f3ac419fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:17:15.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.107+0000 7f3ac9c1f700 1 --2- 172.21.15.122:0/2420993341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ac41040a0 0x7f3ac419fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:17:15.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.107+0000 7f3ac9c1f700 1 -- 172.21.15.122:0/2420993341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ac4102500 msgr2=0x7f3ac4198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:17:15.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.107+0000 7f3ac9c1f700 1 --2- 172.21.15.122:0/2420993341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ac4102500 0x7f3ac4198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:17:15.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.107+0000 7f3ac9c1f700 1 -- 172.21.15.122:0/2420993341 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac41a01a0 con 0x7f3ac4103700 2024-06-06T03:17:15.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.107+0000 7f3acac21700 1 --2- 172.21.15.122:0/2420993341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ac41040a0 0x7f3ac419fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:17:15.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.107+0000 7f3ac9c1f700 1 --2- 172.21.15.122:0/2420993341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ac4103700 0x7f3ac4198a80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3ab800d980 tx=0x7f3ab800dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:17:15.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.107+0000 7f3ac37fe700 1 -- 172.21.15.122:0/2420993341 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab8016070 con 0x7f3ac4103700 2024-06-06T03:17:15.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.107+0000 7f3acc684700 1 -- 172.21.15.122:0/2420993341 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ac41a0490 con 0x7f3ac4103700 2024-06-06T03:17:15.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.107+0000 7f3ac37fe700 1 -- 172.21.15.122:0/2420993341 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3ab800de70 con 0x7f3ac4103700 2024-06-06T03:17:15.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.107+0000 7f3ac37fe700 1 -- 172.21.15.122:0/2420993341 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab800f3c0 con 0x7f3ac4103700 2024-06-06T03:17:15.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.107+0000 7f3acc684700 1 -- 172.21.15.122:0/2420993341 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ac41a0a20 con 0x7f3ac4103700 2024-06-06T03:17:15.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.108+0000 7f3acc684700 1 -- 172.21.15.122:0/2420993341 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ac4069180 con 0x7f3ac4103700 2024-06-06T03:17:15.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.109+0000 7f3ac37fe700 1 -- 172.21.15.122:0/2420993341 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f3ab8019070 con 0x7f3ac4103700 2024-06-06T03:17:15.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.110+0000 7f3ac37fe700 1 --2- 172.21.15.122:0/2420993341 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f3aac0a2b90 0x7f3aac0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:17:15.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.110+0000 7f3ac37fe700 1 -- 172.21.15.122:0/2420993341 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7f3ab80cd650 con 0x7f3ac4103700 2024-06-06T03:17:15.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.110+0000 7f3aca420700 1 --2- 172.21.15.122:0/2420993341 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f3aac0a2b90 0x7f3aac0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:17:15.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.111+0000 7f3aca420700 1 --2- 172.21.15.122:0/2420993341 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f3aac0a2b90 0x7f3aac0a5050 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4103560 tx=0x7f3abc007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:17:15.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.114+0000 7f3ac37fe700 1 -- 172.21.15.122:0/2420993341 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3ab809bde0 con 0x7f3ac4103700 2024-06-06T03:17:15.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:15.319+0000 7f3acc684700 1 -- 172.21.15.122:0/2420993341 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f3ac4062990 con 0x7f3aac0a2b90 2024-06-06T03:17:15.319 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:15 smithi122 ceph-mon[35759]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:17:15.319 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:15 smithi122 ceph-mon[35759]: Detected new or changed devices on smithi079 2024-06-06T03:17:15.319 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:15 smithi122 ceph-mon[35759]: Adjusting osd_memory_target on smithi079 to 17088M 2024-06-06T03:17:15.320 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:15 smithi122 ceph-mon[35759]: osdmap e14: 2 total, 2 up, 2 in 2024-06-06T03:17:15.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:15 smithi050 ceph-mon[32421]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:17:15.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:15 smithi050 ceph-mon[32421]: Detected new or changed devices on smithi079 2024-06-06T03:17:15.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:15 smithi050 ceph-mon[32421]: Adjusting osd_memory_target on smithi079 to 17088M 2024-06-06T03:17:15.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:15 smithi050 ceph-mon[32421]: osdmap e14: 2 total, 2 up, 2 in 2024-06-06T03:17:15.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:15 smithi079 ceph-mon[35478]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T03:17:15.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:15 smithi079 ceph-mon[35478]: Detected new or changed devices on smithi079 2024-06-06T03:17:15.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:15 smithi079 ceph-mon[35478]: Adjusting osd_memory_target on smithi079 to 17088M 2024-06-06T03:17:15.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:15 smithi079 ceph-mon[35478]: osdmap e14: 2 total, 2 up, 2 in 2024-06-06T03:17:16.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:16 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:17:16.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:16 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:17:16.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:16 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:17:16.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:16 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:17:16.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:16 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:17:16.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:16 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:17:16.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:16 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:17:16.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:16 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:17:16.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:16 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:17:17.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:17 smithi122 ceph-mon[35759]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:17.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:17 smithi122 ceph-mon[35759]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:17:17.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:17 smithi050 ceph-mon[32421]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:17.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:17 smithi050 ceph-mon[32421]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:17:17.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:17 smithi079 ceph-mon[35478]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:17.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:17 smithi079 ceph-mon[35478]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:17:18.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:18 smithi122 ceph-mon[35759]: from='client.? 172.21.15.122:0/3883479607' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "90599e3b-bf86-4a56-b03b-b051528a5b60"}]: dispatch 2024-06-06T03:17:18.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:18 smithi122 ceph-mon[35759]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "90599e3b-bf86-4a56-b03b-b051528a5b60"}]: dispatch 2024-06-06T03:17:18.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:18 smithi122 ceph-mon[35759]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "90599e3b-bf86-4a56-b03b-b051528a5b60"}]': finished 2024-06-06T03:17:18.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:18 smithi122 ceph-mon[35759]: osdmap e15: 3 total, 2 up, 3 in 2024-06-06T03:17:18.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:18 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T03:17:18.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:18 smithi050 ceph-mon[32421]: from='client.? 172.21.15.122:0/3883479607' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "90599e3b-bf86-4a56-b03b-b051528a5b60"}]: dispatch 2024-06-06T03:17:18.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:18 smithi050 ceph-mon[32421]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "90599e3b-bf86-4a56-b03b-b051528a5b60"}]: dispatch 2024-06-06T03:17:18.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:18 smithi050 ceph-mon[32421]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "90599e3b-bf86-4a56-b03b-b051528a5b60"}]': finished 2024-06-06T03:17:18.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:18 smithi050 ceph-mon[32421]: osdmap e15: 3 total, 2 up, 3 in 2024-06-06T03:17:18.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:18 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T03:17:18.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:18 smithi079 ceph-mon[35478]: from='client.? 172.21.15.122:0/3883479607' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "90599e3b-bf86-4a56-b03b-b051528a5b60"}]: dispatch 2024-06-06T03:17:18.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:18 smithi079 ceph-mon[35478]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "90599e3b-bf86-4a56-b03b-b051528a5b60"}]: dispatch 2024-06-06T03:17:18.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:18 smithi079 ceph-mon[35478]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "90599e3b-bf86-4a56-b03b-b051528a5b60"}]': finished 2024-06-06T03:17:18.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:18 smithi079 ceph-mon[35478]: osdmap e15: 3 total, 2 up, 3 in 2024-06-06T03:17:18.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:18 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T03:17:19.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:19 smithi122 ceph-mon[35759]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:19.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:19 smithi122 ceph-mon[35759]: from='client.? 172.21.15.122:0/1511861195' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:17:19.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:19 smithi050 ceph-mon[32421]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:19.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:19 smithi050 ceph-mon[32421]: from='client.? 172.21.15.122:0/1511861195' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:17:19.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:19 smithi079 ceph-mon[35478]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:19.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:19 smithi079 ceph-mon[35478]: from='client.? 172.21.15.122:0/1511861195' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:17:21.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:21 smithi122 ceph-mon[35759]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:21.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:21 smithi050 ceph-mon[32421]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:21.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:21 smithi079 ceph-mon[35478]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:23.372 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:23 smithi122 ceph-mon[35759]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:23.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:23 smithi050 ceph-mon[32421]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:23.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:23 smithi079 ceph-mon[35478]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:25.402 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:25 smithi079 ceph-mon[35478]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:25.402 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:25 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-06T03:17:25.402 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:25 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:17:25.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:25 smithi122 ceph-mon[35759]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:25.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:25 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-06T03:17:25.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:25 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:17:25.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:25 smithi050 ceph-mon[32421]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:25.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:25 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-06T03:17:25.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:25 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:17:26.419 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:26 smithi079 ceph-mon[35478]: Deploying daemon osd.2 on smithi122 2024-06-06T03:17:26.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:26 smithi122 ceph-mon[35759]: Deploying daemon osd.2 on smithi122 2024-06-06T03:17:26.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:26 smithi050 ceph-mon[32421]: Deploying daemon osd.2 on smithi122 2024-06-06T03:17:27.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:27 smithi122 ceph-mon[35759]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:27.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:27 smithi050 ceph-mon[32421]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:27.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:27 smithi079 ceph-mon[35478]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:29.382 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:29 smithi122 ceph-mon[35759]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:29.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:29 smithi050 ceph-mon[32421]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:29.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:29 smithi079 ceph-mon[35478]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:31.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:31 smithi122 ceph-mon[35759]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:31.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:31 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:31.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:31 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:31.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:31 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:17:31.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:31 smithi050 ceph-mon[32421]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:31.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:31 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:31.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:31 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:31.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:31 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:17:31.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:31 smithi079 ceph-mon[35478]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:31.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:31 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:31.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:31 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:31.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:31 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:17:32.254 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:32 smithi122 ceph-mon[35759]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:32.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:32 smithi050 ceph-mon[32421]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:32.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:32 smithi079 ceph-mon[35478]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:33.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:33.592+0000 7f3ac37fe700 1 -- 172.21.15.122:0/2420993341 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3ac4062990 con 0x7f3aac0a2b90 2024-06-06T03:17:33.592 INFO:teuthology.orchestra.run.smithi122.stdout:Created osd(s) 2 on host 'smithi122' 2024-06-06T03:17:33.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:33.595+0000 7f3acc684700 1 -- 172.21.15.122:0/2420993341 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f3aac0a2b90 msgr2=0x7f3aac0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:17:33.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:33.595+0000 7f3acc684700 1 --2- 172.21.15.122:0/2420993341 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f3aac0a2b90 0x7f3aac0a5050 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4103560 tx=0x7f3abc007400 comp rx=0 tx=0).stop 2024-06-06T03:17:33.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:33.595+0000 7f3acc684700 1 -- 172.21.15.122:0/2420993341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ac4103700 msgr2=0x7f3ac4198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:17:33.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:33.595+0000 7f3acc684700 1 --2- 172.21.15.122:0/2420993341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ac4103700 0x7f3ac4198a80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3ab800d980 tx=0x7f3ab800dc90 comp rx=0 tx=0).stop 2024-06-06T03:17:33.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:33.595+0000 7f3acc684700 1 -- 172.21.15.122:0/2420993341 shutdown_connections 2024-06-06T03:17:33.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:33.595+0000 7f3acc684700 1 --2- 172.21.15.122:0/2420993341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ac41040a0 0x7f3ac419fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:17:33.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:33.595+0000 7f3acc684700 1 --2- 172.21.15.122:0/2420993341 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f3aac0a2b90 0x7f3aac0a5050 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:17:33.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:33.595+0000 7f3acc684700 1 --2- 172.21.15.122:0/2420993341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ac4102500 0x7f3ac4198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:17:33.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:33.595+0000 7f3acc684700 1 --2- 172.21.15.122:0/2420993341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ac4103700 0x7f3ac4198a80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:17:33.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:33.595+0000 7f3acc684700 1 -- 172.21.15.122:0/2420993341 >> 172.21.15.122:0/2420993341 conn(0x7f3ac40fda60 msgr2=0x7f3ac4106a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:17:33.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:33.595+0000 7f3acc684700 1 -- 172.21.15.122:0/2420993341 shutdown_connections 2024-06-06T03:17:33.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:17:33.595+0000 7f3acc684700 1 -- 172.21.15.122:0/2420993341 wait complete. 2024-06-06T03:17:34.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:33 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:34.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:33 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:34.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:33 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:17:34.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:33 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:17:34.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:33 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:34.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:33 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:34.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:33 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:34.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:33 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:17:34.228 DEBUG:teuthology.orchestra.run.smithi122:osd.2> sudo journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.2.service 2024-06-06T03:17:34.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:33 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:34.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:33 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:34.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:33 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:17:34.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:33 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:17:34.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:33 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:34.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:33 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:34.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:33 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:34.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:33 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:17:34.271 INFO:tasks.cephadm:Deploying osd.3 on smithi050 with /dev/vg_nvme/lv_3... 2024-06-06T03:17:34.271 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-06-06T03:17:34.352 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:33 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:34.353 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:33 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:34.353 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:33 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:17:34.353 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:33 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:17:34.353 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:33 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:34.353 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:33 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:34.353 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:33 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:34.353 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:33 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:17:34.530 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:17:34.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:34 smithi050 ceph-mon[32421]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:34.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:34 smithi050 ceph-mon[32421]: from='osd.2 [v2:172.21.15.122:6800/566397008,v1:172.21.15.122:6801/566397008]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-06T03:17:34.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:34 smithi050 ceph-mon[32421]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-06T03:17:35.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:34 smithi122 ceph-mon[35759]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:35.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:34 smithi122 ceph-mon[35759]: from='osd.2 [v2:172.21.15.122:6800/566397008,v1:172.21.15.122:6801/566397008]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-06T03:17:35.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:34 smithi122 ceph-mon[35759]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-06T03:17:35.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:34 smithi079 ceph-mon[35478]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:35.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:34 smithi079 ceph-mon[35478]: from='osd.2 [v2:172.21.15.122:6800/566397008,v1:172.21.15.122:6801/566397008]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-06T03:17:35.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:34 smithi079 ceph-mon[35478]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-06T03:17:36.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:35 smithi122 ceph-mon[35759]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-06T03:17:36.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:35 smithi122 ceph-mon[35759]: osdmap e16: 3 total, 2 up, 3 in 2024-06-06T03:17:36.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:35 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T03:17:36.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:35 smithi122 ceph-mon[35759]: from='osd.2 [v2:172.21.15.122:6800/566397008,v1:172.21.15.122:6801/566397008]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-06-06T03:17:36.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:35 smithi122 ceph-mon[35759]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-06-06T03:17:36.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:35 smithi050 ceph-mon[32421]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-06T03:17:36.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:35 smithi050 ceph-mon[32421]: osdmap e16: 3 total, 2 up, 3 in 2024-06-06T03:17:36.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:35 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T03:17:36.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:35 smithi050 ceph-mon[32421]: from='osd.2 [v2:172.21.15.122:6800/566397008,v1:172.21.15.122:6801/566397008]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-06-06T03:17:36.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:35 smithi050 ceph-mon[32421]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-06-06T03:17:36.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:35 smithi079 ceph-mon[35478]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-06T03:17:36.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:35 smithi079 ceph-mon[35478]: osdmap e16: 3 total, 2 up, 3 in 2024-06-06T03:17:36.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:35 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T03:17:36.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:35 smithi079 ceph-mon[35478]: from='osd.2 [v2:172.21.15.122:6800/566397008,v1:172.21.15.122:6801/566397008]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-06-06T03:17:36.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:35 smithi079 ceph-mon[35478]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-06-06T03:17:36.399 INFO:teuthology.orchestra.run.smithi050.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-06-06T03:17:36.399 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-06-06T03:17:36.399 INFO:teuthology.orchestra.run.smithi050.stderr: stderr: 10+0 records in 2024-06-06T03:17:36.400 INFO:teuthology.orchestra.run.smithi050.stderr:10+0 records out 2024-06-06T03:17:36.400 INFO:teuthology.orchestra.run.smithi050.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00855278 s, 1.2 GB/s 2024-06-06T03:17:36.400 INFO:teuthology.orchestra.run.smithi050.stderr:--> Zapping successful for: 2024-06-06T03:17:36.578 INFO:journalctl@ceph.osd.2.smithi122.stdout:Jun 06 03:17:36 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-2[40843]: 2024-06-06T03:17:36.302+0000 7f9c872fb700 -1 osd.2 0 waiting for initial osdmap 2024-06-06T03:17:36.579 INFO:journalctl@ceph.osd.2.smithi122.stdout:Jun 06 03:17:36 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-2[40843]: 2024-06-06T03:17:36.307+0000 7f9c7e8e5700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T03:17:37.048 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi050:vg_nvme/lv_3 2024-06-06T03:17:37.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:36 smithi122 ceph-mon[35759]: pgmap v77: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:37.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:36 smithi122 ceph-mon[35759]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-06-06T03:17:37.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:36 smithi122 ceph-mon[35759]: osdmap e17: 3 total, 2 up, 3 in 2024-06-06T03:17:37.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:36 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T03:17:37.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:36 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T03:17:37.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:36 smithi122 ceph-mon[35759]: from='osd.2 ' entity='osd.2' 2024-06-06T03:17:37.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:36 smithi050 ceph-mon[32421]: pgmap v77: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:37.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:36 smithi050 ceph-mon[32421]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-06-06T03:17:37.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:36 smithi050 ceph-mon[32421]: osdmap e17: 3 total, 2 up, 3 in 2024-06-06T03:17:37.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:36 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T03:17:37.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:36 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T03:17:37.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:36 smithi050 ceph-mon[32421]: from='osd.2 ' entity='osd.2' 2024-06-06T03:17:37.297 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:17:37.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:36 smithi079 ceph-mon[35478]: pgmap v77: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:37.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:36 smithi079 ceph-mon[35478]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-06-06T03:17:37.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:36 smithi079 ceph-mon[35478]: osdmap e17: 3 total, 2 up, 3 in 2024-06-06T03:17:37.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:36 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T03:17:37.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:36 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T03:17:37.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:36 smithi079 ceph-mon[35478]: from='osd.2 ' entity='osd.2' 2024-06-06T03:17:38.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:37 smithi050 ceph-mon[32421]: purged_snaps scrub starts 2024-06-06T03:17:38.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:37 smithi050 ceph-mon[32421]: purged_snaps scrub ok 2024-06-06T03:17:38.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:37 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T03:17:38.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:37 smithi050 ceph-mon[32421]: osd.2 [v2:172.21.15.122:6800/566397008,v1:172.21.15.122:6801/566397008] boot 2024-06-06T03:17:38.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:37 smithi050 ceph-mon[32421]: osdmap e18: 3 total, 3 up, 3 in 2024-06-06T03:17:38.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:37 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T03:17:38.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:37 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:38.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:37 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:38.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:37 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:17:38.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:37 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:38.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:37 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:17:38.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:37 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:17:38.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:37 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:38.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:37 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-06-06T03:17:38.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:37 smithi079 ceph-mon[35478]: purged_snaps scrub starts 2024-06-06T03:17:38.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:37 smithi079 ceph-mon[35478]: purged_snaps scrub ok 2024-06-06T03:17:38.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:37 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T03:17:38.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:37 smithi079 ceph-mon[35478]: osd.2 [v2:172.21.15.122:6800/566397008,v1:172.21.15.122:6801/566397008] boot 2024-06-06T03:17:38.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:37 smithi079 ceph-mon[35478]: osdmap e18: 3 total, 3 up, 3 in 2024-06-06T03:17:38.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:37 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T03:17:38.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:37 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:38.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:37 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:38.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:37 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:17:38.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:37 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:38.101 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:37 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:17:38.101 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:37 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:17:38.101 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:37 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:38.101 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:37 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-06-06T03:17:38.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:37 smithi122 ceph-mon[35759]: purged_snaps scrub starts 2024-06-06T03:17:38.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:37 smithi122 ceph-mon[35759]: purged_snaps scrub ok 2024-06-06T03:17:38.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:37 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T03:17:38.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:37 smithi122 ceph-mon[35759]: osd.2 [v2:172.21.15.122:6800/566397008,v1:172.21.15.122:6801/566397008] boot 2024-06-06T03:17:38.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:37 smithi122 ceph-mon[35759]: osdmap e18: 3 total, 3 up, 3 in 2024-06-06T03:17:38.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:37 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T03:17:38.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:37 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:38.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:37 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:38.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:37 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:17:38.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:37 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:38.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:37 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:17:38.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:37 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:17:38.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:37 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:38.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:37 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-06-06T03:17:38.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.969+0000 7ff5a74c2700 1 -- 172.21.15.50:0/2192025254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5a0104090 msgr2=0x7ff5a010a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:17:38.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.969+0000 7ff5a74c2700 1 --2- 172.21.15.50:0/2192025254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5a0104090 0x7ff5a010a940 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff59800b0d0 tx=0x7ff59800b3e0 comp rx=0 tx=0).stop 2024-06-06T03:17:38.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.969+0000 7ff5a74c2700 1 -- 172.21.15.50:0/2192025254 shutdown_connections 2024-06-06T03:17:38.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.969+0000 7ff5a74c2700 1 --2- 172.21.15.50:0/2192025254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5a0104090 0x7ff5a010a940 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:17:38.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.969+0000 7ff5a74c2700 1 --2- 172.21.15.50:0/2192025254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5a01024f0 0x7ff5a0102910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:17:38.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.969+0000 7ff5a74c2700 1 --2- 172.21.15.50:0/2192025254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5a01036f0 0x7ff5a0103b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:17:38.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.969+0000 7ff5a74c2700 1 -- 172.21.15.50:0/2192025254 >> 172.21.15.50:0/2192025254 conn(0x7ff5a00fda90 msgr2=0x7ff5a00ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:17:38.970 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:38 smithi050 ceph-mon[32421]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:38.970 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:38 smithi050 ceph-mon[32421]: Detected new or changed devices on smithi122 2024-06-06T03:17:38.970 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:38 smithi050 ceph-mon[32421]: Adjusting osd_memory_target on smithi122 to 17088M 2024-06-06T03:17:38.971 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:38 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-06-06T03:17:38.971 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:38 smithi050 ceph-mon[32421]: osdmap e19: 3 total, 3 up, 3 in 2024-06-06T03:17:38.971 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:38 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-06T03:17:38.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.969+0000 7ff5a74c2700 1 -- 172.21.15.50:0/2192025254 shutdown_connections 2024-06-06T03:17:38.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.969+0000 7ff5a74c2700 1 -- 172.21.15.50:0/2192025254 wait complete. 2024-06-06T03:17:38.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.970+0000 7ff5a74c2700 1 Processor -- start 2024-06-06T03:17:38.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.970+0000 7ff5a74c2700 1 -- start start 2024-06-06T03:17:38.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.970+0000 7ff5a74c2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5a01024f0 0x7ff5a019a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:17:38.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.970+0000 7ff5a74c2700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5a01036f0 0x7ff5a019acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:17:38.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.970+0000 7ff5a74c2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5a0104090 0x7ff5a01a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:17:38.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.970+0000 7ff5a74c2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a010df70 con 0x7ff5a01024f0 2024-06-06T03:17:38.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.970+0000 7ff5a74c2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a010ddf0 con 0x7ff5a0104090 2024-06-06T03:17:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.970+0000 7ff5a74c2700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a010e0f0 con 0x7ff5a01036f0 2024-06-06T03:17:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.970+0000 7ff5a525e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5a01024f0 0x7ff5a019a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:17:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.970+0000 7ff5a525e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5a01024f0 0x7ff5a019a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38120/0 (socket says 172.21.15.50:38120) 2024-06-06T03:17:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.970+0000 7ff5a525e700 1 -- 172.21.15.50:0/1567330284 learned_addr learned my addr 172.21.15.50:0/1567330284 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:17:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.970+0000 7ff5a4a5d700 1 --2- 172.21.15.50:0/1567330284 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5a01036f0 0x7ff5a019acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:17:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.970+0000 7ff5a5a5f700 1 --2- 172.21.15.50:0/1567330284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5a0104090 0x7ff5a01a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:17:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.971+0000 7ff5a525e700 1 -- 172.21.15.50:0/1567330284 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5a01036f0 msgr2=0x7ff5a019acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:17:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.971+0000 7ff5a525e700 1 --2- 172.21.15.50:0/1567330284 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5a01036f0 0x7ff5a019acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:17:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.971+0000 7ff5a525e700 1 -- 172.21.15.50:0/1567330284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5a0104090 msgr2=0x7ff5a01a1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:17:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.971+0000 7ff5a525e700 1 --2- 172.21.15.50:0/1567330284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5a0104090 0x7ff5a01a1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:17:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.971+0000 7ff5a525e700 1 -- 172.21.15.50:0/1567330284 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a01a23f0 con 0x7ff5a01024f0 2024-06-06T03:17:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.971+0000 7ff5a525e700 1 --2- 172.21.15.50:0/1567330284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5a01024f0 0x7ff5a019a790 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff59c00d9b0 tx=0x7ff59c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:17:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.971+0000 7ff5967fc700 1 -- 172.21.15.50:0/1567330284 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59c016070 con 0x7ff5a01024f0 2024-06-06T03:17:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.971+0000 7ff5967fc700 1 -- 172.21.15.50:0/1567330284 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff59c00be00 con 0x7ff5a01024f0 2024-06-06T03:17:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.971+0000 7ff5a74c2700 1 -- 172.21.15.50:0/1567330284 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5a01a26e0 con 0x7ff5a01024f0 2024-06-06T03:17:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.971+0000 7ff5967fc700 1 -- 172.21.15.50:0/1567330284 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59c010e30 con 0x7ff5a01024f0 2024-06-06T03:17:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.971+0000 7ff5a74c2700 1 -- 172.21.15.50:0/1567330284 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5a01a2c70 con 0x7ff5a01024f0 2024-06-06T03:17:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.972+0000 7ff5a74c2700 1 -- 172.21.15.50:0/1567330284 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5a0069180 con 0x7ff5a01024f0 2024-06-06T03:17:38.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.974+0000 7ff5967fc700 1 -- 172.21.15.50:0/1567330284 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7ff59c019070 con 0x7ff5a01024f0 2024-06-06T03:17:38.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.974+0000 7ff5967fc700 1 --2- 172.21.15.50:0/1567330284 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff58c0a2c10 0x7ff58c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:17:38.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.974+0000 7ff5a4a5d700 1 --2- 172.21.15.50:0/1567330284 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff58c0a2c10 0x7ff58c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:17:38.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.974+0000 7ff5967fc700 1 -- 172.21.15.50:0/1567330284 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3226+0+0 (secure 0 0 0) 0x7ff59c0cde80 con 0x7ff5a01024f0 2024-06-06T03:17:38.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.975+0000 7ff5a4a5d700 1 --2- 172.21.15.50:0/1567330284 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff58c0a2c10 0x7ff58c0a50d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff590005950 tx=0x7ff59000a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:17:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:38.978+0000 7ff5967fc700 1 -- 172.21.15.50:0/1567330284 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff59c020030 con 0x7ff5a01024f0 2024-06-06T03:17:39.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:38 smithi122 ceph-mon[35759]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:39.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:38 smithi122 ceph-mon[35759]: Detected new or changed devices on smithi122 2024-06-06T03:17:39.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:38 smithi122 ceph-mon[35759]: Adjusting osd_memory_target on smithi122 to 17088M 2024-06-06T03:17:39.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:38 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-06-06T03:17:39.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:38 smithi122 ceph-mon[35759]: osdmap e19: 3 total, 3 up, 3 in 2024-06-06T03:17:39.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:38 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-06T03:17:39.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:39.196+0000 7ff5a74c2700 1 -- 172.21.15.50:0/1567330284 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7ff5a0075de0 con 0x7ff58c0a2c10 2024-06-06T03:17:39.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:38 smithi079 ceph-mon[35478]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T03:17:39.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:38 smithi079 ceph-mon[35478]: Detected new or changed devices on smithi122 2024-06-06T03:17:39.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:38 smithi079 ceph-mon[35478]: Adjusting osd_memory_target on smithi122 to 17088M 2024-06-06T03:17:39.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:38 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-06-06T03:17:39.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:38 smithi079 ceph-mon[35478]: osdmap e19: 3 total, 3 up, 3 in 2024-06-06T03:17:39.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:38 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-06T03:17:40.114 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jun 06 03:17:39 smithi050 sudo[51468]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-06T03:17:40.114 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jun 06 03:17:39 smithi050 sudo[51468]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T03:17:40.115 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jun 06 03:17:39 smithi050 sudo[51468]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-06T03:17:40.115 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jun 06 03:17:39 smithi050 sudo[51468]: pam_unix(sudo:session): session closed for user root 2024-06-06T03:17:40.115 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:39 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:17:40.115 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:39 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:17:40.115 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:39 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:17:40.115 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:39 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-06T03:17:40.115 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:39 smithi050 ceph-mon[32421]: osdmap e20: 3 total, 3 up, 3 in 2024-06-06T03:17:40.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:39 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:17:40.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:39 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:17:40.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:39 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:17:40.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:39 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-06T03:17:40.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:39 smithi122 ceph-mon[35759]: osdmap e20: 3 total, 3 up, 3 in 2024-06-06T03:17:40.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:39 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:17:40.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:39 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:17:40.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:39 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:17:40.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:39 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-06T03:17:40.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:39 smithi079 ceph-mon[35478]: osdmap e20: 3 total, 3 up, 3 in 2024-06-06T03:17:40.501 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jun 06 03:17:40 smithi050 sudo[51489]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-06T03:17:40.501 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jun 06 03:17:40 smithi050 sudo[51489]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T03:17:40.501 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jun 06 03:17:40 smithi050 sudo[51489]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-06T03:17:40.501 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jun 06 03:17:40 smithi050 sudo[51489]: pam_unix(sudo:session): session closed for user root 2024-06-06T03:17:40.869 INFO:journalctl@ceph.osd.1.smithi079.stdout:Jun 06 03:17:40 smithi079 sudo[43715]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-06T03:17:40.869 INFO:journalctl@ceph.osd.1.smithi079.stdout:Jun 06 03:17:40 smithi079 sudo[43715]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T03:17:40.869 INFO:journalctl@ceph.osd.1.smithi079.stdout:Jun 06 03:17:40 smithi079 sudo[43715]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-06T03:17:40.869 INFO:journalctl@ceph.osd.1.smithi079.stdout:Jun 06 03:17:40 smithi079 sudo[43715]: pam_unix(sudo:session): session closed for user root 2024-06-06T03:17:41.115 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:40 smithi050 ceph-mon[32421]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:17:41.115 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:40 smithi050 ceph-mon[32421]: pgmap v82: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:17:41.115 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:40 smithi050 ceph-mon[32421]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-06T03:17:41.116 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:40 smithi050 ceph-mon[32421]: osdmap e21: 3 total, 3 up, 3 in 2024-06-06T03:17:41.116 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:40 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:41.116 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:40 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:41.153 INFO:journalctl@ceph.osd.2.smithi122.stdout:Jun 06 03:17:41 smithi122 sudo[44842]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-06T03:17:41.153 INFO:journalctl@ceph.osd.2.smithi122.stdout:Jun 06 03:17:41 smithi122 sudo[44842]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T03:17:41.153 INFO:journalctl@ceph.osd.2.smithi122.stdout:Jun 06 03:17:41 smithi122 sudo[44842]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-06T03:17:41.153 INFO:journalctl@ceph.osd.2.smithi122.stdout:Jun 06 03:17:41 smithi122 sudo[44842]: pam_unix(sudo:session): session closed for user root 2024-06-06T03:17:41.153 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:40 smithi122 ceph-mon[35759]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:17:41.153 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:40 smithi122 ceph-mon[35759]: pgmap v82: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:17:41.153 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:40 smithi122 ceph-mon[35759]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-06T03:17:41.153 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:40 smithi122 ceph-mon[35759]: osdmap e21: 3 total, 3 up, 3 in 2024-06-06T03:17:41.154 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:40 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:41.154 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:40 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:41.350 INFO:journalctl@ceph.osd.1.smithi079.stdout:Jun 06 03:17:40 smithi079 sudo[43718]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-06T03:17:41.350 INFO:journalctl@ceph.osd.1.smithi079.stdout:Jun 06 03:17:40 smithi079 sudo[43718]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T03:17:41.350 INFO:journalctl@ceph.osd.1.smithi079.stdout:Jun 06 03:17:40 smithi079 sudo[43718]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-06T03:17:41.350 INFO:journalctl@ceph.osd.1.smithi079.stdout:Jun 06 03:17:40 smithi079 sudo[43718]: pam_unix(sudo:session): session closed for user root 2024-06-06T03:17:41.351 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:40 smithi079 ceph-mon[35478]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:17:41.351 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:40 smithi079 ceph-mon[35478]: pgmap v82: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:17:41.351 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:40 smithi079 ceph-mon[35478]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-06T03:17:41.351 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:40 smithi079 ceph-mon[35478]: osdmap e21: 3 total, 3 up, 3 in 2024-06-06T03:17:41.351 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:40 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:41.351 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:40 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:41.431 INFO:journalctl@ceph.osd.2.smithi122.stdout:Jun 06 03:17:41 smithi122 sudo[44845]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-06T03:17:41.431 INFO:journalctl@ceph.osd.2.smithi122.stdout:Jun 06 03:17:41 smithi122 sudo[44845]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T03:17:41.431 INFO:journalctl@ceph.osd.2.smithi122.stdout:Jun 06 03:17:41 smithi122 sudo[44845]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-06T03:17:41.431 INFO:journalctl@ceph.osd.2.smithi122.stdout:Jun 06 03:17:41 smithi122 sudo[44845]: pam_unix(sudo:session): session closed for user root 2024-06-06T03:17:42.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:41 smithi050 sudo[51565]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-06T03:17:42.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:41 smithi050 sudo[51565]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T03:17:42.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:41 smithi050 sudo[51565]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-06T03:17:42.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:41 smithi050 sudo[51565]: pam_unix(sudo:session): session closed for user root 2024-06-06T03:17:42.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:42.331+0000 7ff5967fc700 1 -- 172.21.15.50:0/1567330284 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff59c098210 con 0x7ff5a01024f0 2024-06-06T03:17:42.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:42 smithi050 sudo[51569]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-06T03:17:42.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:42 smithi050 sudo[51569]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T03:17:42.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:42 smithi050 sudo[51569]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-06T03:17:42.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:42 smithi050 sudo[51569]: pam_unix(sudo:session): session closed for user root 2024-06-06T03:17:42.826 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:42 smithi122 sudo[44848]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-06T03:17:42.826 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:42 smithi122 sudo[44848]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T03:17:42.826 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:42 smithi122 sudo[44848]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-06T03:17:42.826 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:42 smithi122 sudo[44848]: pam_unix(sudo:session): session closed for user root 2024-06-06T03:17:43.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:42 smithi122 sudo[44851]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-06T03:17:43.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:42 smithi122 sudo[44851]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T03:17:43.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:42 smithi122 sudo[44851]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-06T03:17:43.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:42 smithi122 sudo[44851]: pam_unix(sudo:session): session closed for user root 2024-06-06T03:17:43.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:42 smithi122 ceph-mon[35759]: pgmap v85: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:17:43.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:42 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:43.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:42 smithi122 ceph-mon[35759]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-06T03:17:43.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:42 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/4165558358' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd295e6c-64cd-4164-83dc-4d32c2ae103a"}]: dispatch 2024-06-06T03:17:43.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:42 smithi122 ceph-mon[35759]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-06T03:17:43.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:42 smithi122 ceph-mon[35759]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-06-06T03:17:43.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:42 smithi122 ceph-mon[35759]: Cluster is now healthy 2024-06-06T03:17:43.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:42 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T03:17:43.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:42 smithi122 ceph-mon[35759]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd295e6c-64cd-4164-83dc-4d32c2ae103a"}]: dispatch 2024-06-06T03:17:43.183 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:42 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:17:43.183 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:42 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T03:17:43.183 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:42 smithi122 ceph-mon[35759]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-06-06T03:17:43.183 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:42 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T03:17:43.183 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:42 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:17:43.183 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:42 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T03:17:43.188 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:42 smithi050 ceph-mon[32421]: pgmap v85: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:17:43.188 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:42 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:43.188 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:42 smithi050 ceph-mon[32421]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-06T03:17:43.188 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:42 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/4165558358' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd295e6c-64cd-4164-83dc-4d32c2ae103a"}]: dispatch 2024-06-06T03:17:43.188 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:42 smithi050 ceph-mon[32421]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-06T03:17:43.188 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:42 smithi050 ceph-mon[32421]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-06-06T03:17:43.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:42 smithi050 ceph-mon[32421]: Cluster is now healthy 2024-06-06T03:17:43.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:42 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T03:17:43.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:42 smithi050 ceph-mon[32421]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd295e6c-64cd-4164-83dc-4d32c2ae103a"}]: dispatch 2024-06-06T03:17:43.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:42 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:17:43.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:42 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T03:17:43.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:42 smithi050 ceph-mon[32421]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-06-06T03:17:43.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:42 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T03:17:43.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:42 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:17:43.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:42 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T03:17:43.320 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 sudo[43721]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-06T03:17:43.321 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 sudo[43721]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T03:17:43.321 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 sudo[43721]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-06T03:17:43.321 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 sudo[43721]: pam_unix(sudo:session): session closed for user root 2024-06-06T03:17:43.321 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 sudo[43724]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-06T03:17:43.321 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 sudo[43724]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T03:17:43.321 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 sudo[43724]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-06T03:17:43.321 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 sudo[43724]: pam_unix(sudo:session): session closed for user root 2024-06-06T03:17:43.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 ceph-mon[35478]: pgmap v85: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:17:43.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:43.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 ceph-mon[35478]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-06T03:17:43.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/4165558358' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd295e6c-64cd-4164-83dc-4d32c2ae103a"}]: dispatch 2024-06-06T03:17:43.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 ceph-mon[35478]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-06T03:17:43.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 ceph-mon[35478]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-06-06T03:17:43.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 ceph-mon[35478]: Cluster is now healthy 2024-06-06T03:17:43.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T03:17:43.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 ceph-mon[35478]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd295e6c-64cd-4164-83dc-4d32c2ae103a"}]: dispatch 2024-06-06T03:17:43.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:17:43.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T03:17:43.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 ceph-mon[35478]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-06-06T03:17:43.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T03:17:43.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:17:43.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T03:17:44.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 ceph-mon[35478]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-06T03:17:44.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 ceph-mon[35478]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-06T03:17:44.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 ceph-mon[35478]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd295e6c-64cd-4164-83dc-4d32c2ae103a"}]': finished 2024-06-06T03:17:44.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 ceph-mon[35478]: osdmap e22: 4 total, 3 up, 4 in 2024-06-06T03:17:44.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T03:17:44.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 ceph-mon[35478]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-06T03:17:44.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T03:17:44.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:17:44.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T03:17:44.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 ceph-mon[35478]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-06T03:17:44.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:43 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/1148430765' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:17:44.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:43 smithi122 ceph-mon[35759]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-06T03:17:44.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:43 smithi122 ceph-mon[35759]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-06T03:17:44.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:43 smithi122 ceph-mon[35759]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd295e6c-64cd-4164-83dc-4d32c2ae103a"}]': finished 2024-06-06T03:17:44.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:43 smithi122 ceph-mon[35759]: osdmap e22: 4 total, 3 up, 4 in 2024-06-06T03:17:44.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:43 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T03:17:44.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:43 smithi122 ceph-mon[35759]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-06T03:17:44.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:43 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T03:17:44.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:43 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:17:44.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:43 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T03:17:44.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:43 smithi122 ceph-mon[35759]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-06T03:17:44.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:43 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/1148430765' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:17:44.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:43 smithi050 ceph-mon[32421]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-06T03:17:44.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:43 smithi050 ceph-mon[32421]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-06T03:17:44.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:43 smithi050 ceph-mon[32421]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd295e6c-64cd-4164-83dc-4d32c2ae103a"}]': finished 2024-06-06T03:17:44.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:43 smithi050 ceph-mon[32421]: osdmap e22: 4 total, 3 up, 4 in 2024-06-06T03:17:44.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:43 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T03:17:44.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:43 smithi050 ceph-mon[32421]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-06T03:17:44.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:43 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T03:17:44.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:43 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T03:17:44.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:43 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T03:17:44.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:43 smithi050 ceph-mon[32421]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-06T03:17:44.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:43 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1148430765' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:17:45.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:44 smithi079 ceph-mon[35478]: pgmap v87: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:17:45.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:44 smithi122 ceph-mon[35759]: pgmap v87: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:17:45.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:44 smithi050 ceph-mon[32421]: pgmap v87: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:17:47.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:46 smithi079 ceph-mon[35478]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:17:47.179 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:46 smithi050 ceph-mon[32421]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:17:47.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:46 smithi122 ceph-mon[35759]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:17:49.150 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:48 smithi050 ceph-mon[32421]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:17:49.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:48 smithi122 ceph-mon[35759]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:17:49.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:48 smithi079 ceph-mon[35478]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:17:51.137 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:50 smithi050 ceph-mon[32421]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:17:51.137 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:50 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-06T03:17:51.137 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:50 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:17:51.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:50 smithi122 ceph-mon[35759]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:17:51.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:50 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-06T03:17:51.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:50 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:17:51.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:50 smithi079 ceph-mon[35478]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:17:51.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:50 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-06T03:17:51.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:50 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:17:52.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:51 smithi122 ceph-mon[35759]: Deploying daemon osd.3 on smithi050 2024-06-06T03:17:52.209 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:51 smithi050 ceph-mon[32421]: Deploying daemon osd.3 on smithi050 2024-06-06T03:17:52.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:51 smithi079 ceph-mon[35478]: Deploying daemon osd.3 on smithi050 2024-06-06T03:17:53.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:52 smithi122 ceph-mon[35759]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:17:53.239 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:52 smithi050 ceph-mon[32421]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:17:53.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:52 smithi079 ceph-mon[35478]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:17:55.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:54 smithi050 ceph-mon[32421]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:17:55.152 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:54 smithi079 ceph-mon[35478]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:17:55.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:54 smithi122 ceph-mon[35759]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:17:57.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:56 smithi050 ceph-mon[32421]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:17:57.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:56 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:57.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:56 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:57.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:56 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:17:57.252 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:56 smithi079 ceph-mon[35478]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:17:57.253 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:56 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:57.253 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:56 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:57.253 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:56 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:17:57.433 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:56 smithi122 ceph-mon[35759]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:17:57.434 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:56 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:57.434 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:56 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:57.434 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:56 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:17:59.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:58 smithi050 ceph-mon[32421]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:17:59.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:58 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:59.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:58 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:59.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:58 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:17:59.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:58 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:17:59.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:17:58 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:59.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:58 smithi079 ceph-mon[35478]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:17:59.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:58 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:59.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:58 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:59.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:58 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:17:59.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:58 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:17:59.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:17:58 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:59.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:58 smithi122 ceph-mon[35759]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:17:59.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:58 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:59.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:58 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:59.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:58 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:17:59.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:58 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:17:59.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:17:58 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:17:59.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:59.810+0000 7ff5967fc700 1 -- 172.21.15.50:0/1567330284 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff5a0075de0 con 0x7ff58c0a2c10 2024-06-06T03:17:59.809 INFO:teuthology.orchestra.run.smithi050.stdout:Created osd(s) 3 on host 'smithi050' 2024-06-06T03:17:59.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:59.812+0000 7ff5a74c2700 1 -- 172.21.15.50:0/1567330284 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff58c0a2c10 msgr2=0x7ff58c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:17:59.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:59.812+0000 7ff5a74c2700 1 --2- 172.21.15.50:0/1567330284 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff58c0a2c10 0x7ff58c0a50d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff590005950 tx=0x7ff59000a300 comp rx=0 tx=0).stop 2024-06-06T03:17:59.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:59.812+0000 7ff5a74c2700 1 -- 172.21.15.50:0/1567330284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5a01024f0 msgr2=0x7ff5a019a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:17:59.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:59.812+0000 7ff5a74c2700 1 --2- 172.21.15.50:0/1567330284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5a01024f0 0x7ff5a019a790 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff59c00d9b0 tx=0x7ff59c00dcc0 comp rx=0 tx=0).stop 2024-06-06T03:17:59.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:59.812+0000 7ff5a74c2700 1 -- 172.21.15.50:0/1567330284 shutdown_connections 2024-06-06T03:17:59.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:59.812+0000 7ff5a74c2700 1 --2- 172.21.15.50:0/1567330284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5a0104090 0x7ff5a01a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:17:59.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:59.812+0000 7ff5a74c2700 1 --2- 172.21.15.50:0/1567330284 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff58c0a2c10 0x7ff58c0a50d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:17:59.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:59.812+0000 7ff5a74c2700 1 --2- 172.21.15.50:0/1567330284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5a01024f0 0x7ff5a019a790 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:17:59.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:59.812+0000 7ff5a74c2700 1 --2- 172.21.15.50:0/1567330284 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5a01036f0 0x7ff5a019acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:17:59.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:59.812+0000 7ff5a74c2700 1 -- 172.21.15.50:0/1567330284 >> 172.21.15.50:0/1567330284 conn(0x7ff5a00fda90 msgr2=0x7ff5a00746c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:17:59.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:59.813+0000 7ff5a74c2700 1 -- 172.21.15.50:0/1567330284 shutdown_connections 2024-06-06T03:17:59.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:17:59.813+0000 7ff5a74c2700 1 -- 172.21.15.50:0/1567330284 wait complete. 2024-06-06T03:18:00.491 DEBUG:teuthology.orchestra.run.smithi050:osd.3> sudo journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.3.service 2024-06-06T03:18:00.494 INFO:tasks.cephadm:Deploying osd.4 on smithi079 with /dev/vg_nvme/lv_3... 2024-06-06T03:18:00.494 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-06-06T03:18:00.740 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T03:18:01.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:00 smithi050 ceph-mon[32421]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:18:01.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:00 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:01.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:00 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:01.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:00 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:18:01.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:00 smithi050 ceph-mon[32421]: from='osd.3 [v2:172.21.15.50:6810/820123083,v1:172.21.15.50:6811/820123083]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-06T03:18:01.090 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:00 smithi079 ceph-mon[35478]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:18:01.090 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:00 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:01.091 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:00 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:01.091 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:00 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:18:01.091 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:00 smithi079 ceph-mon[35478]: from='osd.3 [v2:172.21.15.50:6810/820123083,v1:172.21.15.50:6811/820123083]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-06T03:18:01.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:00 smithi122 ceph-mon[35759]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:18:01.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:00 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:01.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:00 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:01.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:00 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:18:01.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:00 smithi122 ceph-mon[35759]: from='osd.3 [v2:172.21.15.50:6810/820123083,v1:172.21.15.50:6811/820123083]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-06T03:18:01.894 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:01 smithi050 ceph-mon[32421]: from='osd.3 [v2:172.21.15.50:6810/820123083,v1:172.21.15.50:6811/820123083]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-06T03:18:01.895 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:01 smithi050 ceph-mon[32421]: osdmap e23: 4 total, 3 up, 4 in 2024-06-06T03:18:01.895 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:01 smithi050 ceph-mon[32421]: from='osd.3 [v2:172.21.15.50:6810/820123083,v1:172.21.15.50:6811/820123083]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-06-06T03:18:01.895 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:01 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T03:18:01.895 INFO:journalctl@ceph.osd.3.smithi050.stdout:Jun 06 03:18:01 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-3[53586]: 2024-06-06T03:18:01.803+0000 7fc36c0f5700 -1 osd.3 0 waiting for initial osdmap 2024-06-06T03:18:01.895 INFO:journalctl@ceph.osd.3.smithi050.stdout:Jun 06 03:18:01 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-3[53586]: 2024-06-06T03:18:01.808+0000 7fc367ee8700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T03:18:02.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:01 smithi079 ceph-mon[35478]: from='osd.3 [v2:172.21.15.50:6810/820123083,v1:172.21.15.50:6811/820123083]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-06T03:18:02.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:01 smithi079 ceph-mon[35478]: osdmap e23: 4 total, 3 up, 4 in 2024-06-06T03:18:02.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:01 smithi079 ceph-mon[35478]: from='osd.3 [v2:172.21.15.50:6810/820123083,v1:172.21.15.50:6811/820123083]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-06-06T03:18:02.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:01 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T03:18:02.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:01 smithi122 ceph-mon[35759]: from='osd.3 [v2:172.21.15.50:6810/820123083,v1:172.21.15.50:6811/820123083]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-06T03:18:02.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:01 smithi122 ceph-mon[35759]: osdmap e23: 4 total, 3 up, 4 in 2024-06-06T03:18:02.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:01 smithi122 ceph-mon[35759]: from='osd.3 [v2:172.21.15.50:6810/820123083,v1:172.21.15.50:6811/820123083]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-06-06T03:18:02.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:01 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T03:18:02.764 INFO:teuthology.orchestra.run.smithi079.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-06-06T03:18:02.764 INFO:teuthology.orchestra.run.smithi079.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-06-06T03:18:02.764 INFO:teuthology.orchestra.run.smithi079.stderr: stderr: 10+0 records in 2024-06-06T03:18:02.765 INFO:teuthology.orchestra.run.smithi079.stderr:10+0 records out 2024-06-06T03:18:02.765 INFO:teuthology.orchestra.run.smithi079.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0136414 s, 769 MB/s 2024-06-06T03:18:02.765 INFO:teuthology.orchestra.run.smithi079.stderr:--> Zapping successful for: 2024-06-06T03:18:03.083 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:02 smithi079 ceph-mon[35478]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:18:03.084 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:02 smithi079 ceph-mon[35478]: from='osd.3 [v2:172.21.15.50:6810/820123083,v1:172.21.15.50:6811/820123083]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-06-06T03:18:03.084 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:02 smithi079 ceph-mon[35478]: osdmap e24: 4 total, 3 up, 4 in 2024-06-06T03:18:03.084 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:02 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T03:18:03.084 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:02 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T03:18:03.106 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:02 smithi050 ceph-mon[32421]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:18:03.106 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:02 smithi050 ceph-mon[32421]: from='osd.3 [v2:172.21.15.50:6810/820123083,v1:172.21.15.50:6811/820123083]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-06-06T03:18:03.106 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:02 smithi050 ceph-mon[32421]: osdmap e24: 4 total, 3 up, 4 in 2024-06-06T03:18:03.107 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:02 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T03:18:03.107 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:02 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T03:18:03.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:02 smithi122 ceph-mon[35759]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:18:03.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:02 smithi122 ceph-mon[35759]: from='osd.3 [v2:172.21.15.50:6810/820123083,v1:172.21.15.50:6811/820123083]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-06-06T03:18:03.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:02 smithi122 ceph-mon[35759]: osdmap e24: 4 total, 3 up, 4 in 2024-06-06T03:18:03.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:02 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T03:18:03.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:02 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T03:18:03.453 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi079:vg_nvme/lv_3 2024-06-06T03:18:03.691 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T03:18:04.080 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:03 smithi079 ceph-mon[35478]: purged_snaps scrub starts 2024-06-06T03:18:04.080 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:03 smithi079 ceph-mon[35478]: purged_snaps scrub ok 2024-06-06T03:18:04.080 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:03 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T03:18:04.080 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:03 smithi079 ceph-mon[35478]: osd.3 [v2:172.21.15.50:6810/820123083,v1:172.21.15.50:6811/820123083] boot 2024-06-06T03:18:04.080 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:03 smithi079 ceph-mon[35478]: osdmap e25: 4 total, 4 up, 4 in 2024-06-06T03:18:04.080 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:03 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T03:18:04.080 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:03 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:04.080 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:03 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:04.080 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:03 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:18:04.081 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:03 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:18:04.081 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:03 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:04.081 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:03 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:18:04.081 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:03 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:18:04.081 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:03 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:04.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:03 smithi122 ceph-mon[35759]: purged_snaps scrub starts 2024-06-06T03:18:04.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:03 smithi122 ceph-mon[35759]: purged_snaps scrub ok 2024-06-06T03:18:04.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:03 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T03:18:04.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:03 smithi122 ceph-mon[35759]: osd.3 [v2:172.21.15.50:6810/820123083,v1:172.21.15.50:6811/820123083] boot 2024-06-06T03:18:04.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:03 smithi122 ceph-mon[35759]: osdmap e25: 4 total, 4 up, 4 in 2024-06-06T03:18:04.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:03 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T03:18:04.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:03 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:04.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:03 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:04.183 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:03 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:18:04.183 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:03 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:18:04.183 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:03 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:04.183 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:03 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:18:04.183 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:03 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:18:04.183 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:03 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:04.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:03 smithi050 ceph-mon[32421]: purged_snaps scrub starts 2024-06-06T03:18:04.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:03 smithi050 ceph-mon[32421]: purged_snaps scrub ok 2024-06-06T03:18:04.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:03 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T03:18:04.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:03 smithi050 ceph-mon[32421]: osd.3 [v2:172.21.15.50:6810/820123083,v1:172.21.15.50:6811/820123083] boot 2024-06-06T03:18:04.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:03 smithi050 ceph-mon[32421]: osdmap e25: 4 total, 4 up, 4 in 2024-06-06T03:18:04.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:03 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T03:18:04.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:03 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:04.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:03 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:04.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:03 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:18:04.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:03 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:18:04.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:03 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:04.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:03 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:18:04.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:03 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:18:04.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:03 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:05.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:04 smithi079 ceph-mon[35478]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:18:05.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:04 smithi079 ceph-mon[35478]: Detected new or changed devices on smithi050 2024-06-06T03:18:05.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:04 smithi079 ceph-mon[35478]: Adjusting osd_memory_target on smithi050 to 8546M 2024-06-06T03:18:05.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:04 smithi079 ceph-mon[35478]: osdmap e26: 4 total, 4 up, 4 in 2024-06-06T03:18:05.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:04 smithi122 ceph-mon[35759]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:18:05.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:04 smithi122 ceph-mon[35759]: Detected new or changed devices on smithi050 2024-06-06T03:18:05.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:04 smithi122 ceph-mon[35759]: Adjusting osd_memory_target on smithi050 to 8546M 2024-06-06T03:18:05.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:04 smithi122 ceph-mon[35759]: osdmap e26: 4 total, 4 up, 4 in 2024-06-06T03:18:05.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:04 smithi050 ceph-mon[32421]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-06T03:18:05.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:04 smithi050 ceph-mon[32421]: Detected new or changed devices on smithi050 2024-06-06T03:18:05.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:04 smithi050 ceph-mon[32421]: Adjusting osd_memory_target on smithi050 to 8546M 2024-06-06T03:18:05.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:04 smithi050 ceph-mon[32421]: osdmap e26: 4 total, 4 up, 4 in 2024-06-06T03:18:05.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.419+0000 7f33191c1700 1 -- 172.21.15.79:0/1222000070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33141041f0 msgr2=0x7f331410aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:18:05.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.419+0000 7f33191c1700 1 --2- 172.21.15.79:0/1222000070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33141041f0 0x7f331410aaa0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f330c00b0a0 tx=0x7f330c00b3b0 comp rx=0 tx=0).stop 2024-06-06T03:18:05.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.419+0000 7f33191c1700 1 -- 172.21.15.79:0/1222000070 shutdown_connections 2024-06-06T03:18:05.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.419+0000 7f33191c1700 1 --2- 172.21.15.79:0/1222000070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33141041f0 0x7f331410aaa0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:18:05.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.419+0000 7f33191c1700 1 --2- 172.21.15.79:0/1222000070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3314100870 0x7f3314100c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:18:05.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.419+0000 7f33191c1700 1 --2- 172.21.15.79:0/1222000070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3314103850 0x7f3314103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:18:05.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.419+0000 7f33191c1700 1 -- 172.21.15.79:0/1222000070 >> 172.21.15.79:0/1222000070 conn(0x7f33140fc1d0 msgr2=0x7f33140fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:18:05.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.420+0000 7f33191c1700 1 -- 172.21.15.79:0/1222000070 shutdown_connections 2024-06-06T03:18:05.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.420+0000 7f33191c1700 1 -- 172.21.15.79:0/1222000070 wait complete. 2024-06-06T03:18:05.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.420+0000 7f33191c1700 1 Processor -- start 2024-06-06T03:18:05.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.420+0000 7f33191c1700 1 -- start start 2024-06-06T03:18:05.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.421+0000 7f33191c1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3314100870 0x7f3314198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:18:05.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.421+0000 7f33191c1700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3314103850 0x7f3314198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:18:05.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.421+0000 7f33191c1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33141041f0 0x7f331419fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:18:05.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.421+0000 7f33191c1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f331410e090 con 0x7f3314100870 2024-06-06T03:18:05.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.421+0000 7f33191c1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f331410df10 con 0x7f33141041f0 2024-06-06T03:18:05.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.421+0000 7f33191c1700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f331410e210 con 0x7f3314103850 2024-06-06T03:18:05.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.421+0000 7f331359e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33141041f0 0x7f331419fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:18:05.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.421+0000 7f3312d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3314100870 0x7f3314198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:18:05.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.421+0000 7f331359e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33141041f0 0x7f331419fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45156/0 (socket says 172.21.15.79:45156) 2024-06-06T03:18:05.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.421+0000 7f3312d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3314100870 0x7f3314198650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.79:51924/0 (socket says 172.21.15.79:51924) 2024-06-06T03:18:05.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.421+0000 7f331359e700 1 -- 172.21.15.79:0/2846416360 learned_addr learned my addr 172.21.15.79:0/2846416360 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-06T03:18:05.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.421+0000 7f331259c700 1 --2- 172.21.15.79:0/2846416360 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3314103850 0x7f3314198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:18:05.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.421+0000 7f331359e700 1 -- 172.21.15.79:0/2846416360 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3314103850 msgr2=0x7f3314198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:18:05.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.421+0000 7f331359e700 1 --2- 172.21.15.79:0/2846416360 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3314103850 0x7f3314198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:18:05.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.421+0000 7f331359e700 1 -- 172.21.15.79:0/2846416360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3314100870 msgr2=0x7f3314198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:18:05.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.421+0000 7f331359e700 1 --2- 172.21.15.79:0/2846416360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3314100870 0x7f3314198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:18:05.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.421+0000 7f331359e700 1 -- 172.21.15.79:0/2846416360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33141a02b0 con 0x7f33141041f0 2024-06-06T03:18:05.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.421+0000 7f331359e700 1 --2- 172.21.15.79:0/2846416360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33141041f0 0x7f331419fc10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f330c0062a0 tx=0x7f330c004e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:18:05.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.421+0000 7f32fbfff700 1 -- 172.21.15.79:0/2846416360 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330c021070 con 0x7f33141041f0 2024-06-06T03:18:05.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.421+0000 7f33191c1700 1 -- 172.21.15.79:0/2846416360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33141a0540 con 0x7f33141041f0 2024-06-06T03:18:05.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.421+0000 7f32fbfff700 1 -- 172.21.15.79:0/2846416360 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f330c007c80 con 0x7f33141041f0 2024-06-06T03:18:05.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.421+0000 7f32fbfff700 1 -- 172.21.15.79:0/2846416360 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330c01d450 con 0x7f33141041f0 2024-06-06T03:18:05.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.422+0000 7f33191c1700 1 -- 172.21.15.79:0/2846416360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33141a0a30 con 0x7f33141041f0 2024-06-06T03:18:05.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.422+0000 7f33191c1700 1 -- 172.21.15.79:0/2846416360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3314069180 con 0x7f33141041f0 2024-06-06T03:18:05.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.424+0000 7f32fbfff700 1 -- 172.21.15.79:0/2846416360 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f330c003a00 con 0x7f33141041f0 2024-06-06T03:18:05.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.424+0000 7f32fbfff700 1 --2- 172.21.15.79:0/2846416360 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f32fc0a2c20 0x7f32fc0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:18:05.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.424+0000 7f32fbfff700 1 -- 172.21.15.79:0/2846416360 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3698+0+0 (secure 0 0 0) 0x7f330c0cf310 con 0x7f33141041f0 2024-06-06T03:18:05.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.424+0000 7f3312d9d700 1 --2- 172.21.15.79:0/2846416360 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f32fc0a2c20 0x7f32fc0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:18:05.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.425+0000 7f3312d9d700 1 --2- 172.21.15.79:0/2846416360 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f32fc0a2c20 0x7f32fc0a50e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f331406a9a0 tx=0x7f330400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:18:05.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.428+0000 7f32fbfff700 1 -- 172.21.15.79:0/2846416360 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f330c09d620 con 0x7f33141041f0 2024-06-06T03:18:05.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:05.633+0000 7f33191c1700 1 -- 172.21.15.79:0/2846416360 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f33140628d0 con 0x7f32fc0a2c20 2024-06-06T03:18:06.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:05 smithi079 ceph-mon[35478]: osdmap e27: 4 total, 4 up, 4 in 2024-06-06T03:18:06.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:05 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:18:06.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:05 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:18:06.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:05 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:18:06.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:05 smithi122 ceph-mon[35759]: osdmap e27: 4 total, 4 up, 4 in 2024-06-06T03:18:06.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:05 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:18:06.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:05 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:18:06.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:05 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:18:06.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:05 smithi050 ceph-mon[32421]: osdmap e27: 4 total, 4 up, 4 in 2024-06-06T03:18:06.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:05 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:18:06.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:05 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:18:06.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:05 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:18:07.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:06 smithi079 ceph-mon[35478]: pgmap v103: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-06-06T03:18:07.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:06 smithi079 ceph-mon[35478]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:18:07.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:06 smithi079 ceph-mon[35478]: osdmap e28: 4 total, 4 up, 4 in 2024-06-06T03:18:07.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:06 smithi122 ceph-mon[35759]: pgmap v103: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-06-06T03:18:07.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:06 smithi122 ceph-mon[35759]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:18:07.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:06 smithi122 ceph-mon[35759]: osdmap e28: 4 total, 4 up, 4 in 2024-06-06T03:18:07.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:06 smithi050 ceph-mon[32421]: pgmap v103: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-06-06T03:18:07.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:06 smithi050 ceph-mon[32421]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:18:07.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:06 smithi050 ceph-mon[32421]: osdmap e28: 4 total, 4 up, 4 in 2024-06-06T03:18:08.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:07 smithi079 ceph-mon[35478]: osdmap e29: 4 total, 4 up, 4 in 2024-06-06T03:18:08.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:07 smithi122 ceph-mon[35759]: osdmap e29: 4 total, 4 up, 4 in 2024-06-06T03:18:08.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:07 smithi050 ceph-mon[32421]: osdmap e29: 4 total, 4 up, 4 in 2024-06-06T03:18:09.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:08 smithi079 ceph-mon[35478]: pgmap v106: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-06-06T03:18:09.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:08 smithi079 ceph-mon[35478]: from='client.? 172.21.15.79:0/2103467399' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4c854d90-5353-4f7c-b2f3-2af6216d799b"}]: dispatch 2024-06-06T03:18:09.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:08 smithi079 ceph-mon[35478]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4c854d90-5353-4f7c-b2f3-2af6216d799b"}]: dispatch 2024-06-06T03:18:09.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:08 smithi079 ceph-mon[35478]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4c854d90-5353-4f7c-b2f3-2af6216d799b"}]': finished 2024-06-06T03:18:09.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:08 smithi079 ceph-mon[35478]: osdmap e30: 5 total, 4 up, 5 in 2024-06-06T03:18:09.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:08 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T03:18:09.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:08 smithi122 ceph-mon[35759]: pgmap v106: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-06-06T03:18:09.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:08 smithi122 ceph-mon[35759]: from='client.? 172.21.15.79:0/2103467399' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4c854d90-5353-4f7c-b2f3-2af6216d799b"}]: dispatch 2024-06-06T03:18:09.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:08 smithi122 ceph-mon[35759]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4c854d90-5353-4f7c-b2f3-2af6216d799b"}]: dispatch 2024-06-06T03:18:09.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:08 smithi122 ceph-mon[35759]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4c854d90-5353-4f7c-b2f3-2af6216d799b"}]': finished 2024-06-06T03:18:09.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:08 smithi122 ceph-mon[35759]: osdmap e30: 5 total, 4 up, 5 in 2024-06-06T03:18:09.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:08 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T03:18:09.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:08 smithi050 ceph-mon[32421]: pgmap v106: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-06-06T03:18:09.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:08 smithi050 ceph-mon[32421]: from='client.? 172.21.15.79:0/2103467399' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4c854d90-5353-4f7c-b2f3-2af6216d799b"}]: dispatch 2024-06-06T03:18:09.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:08 smithi050 ceph-mon[32421]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4c854d90-5353-4f7c-b2f3-2af6216d799b"}]: dispatch 2024-06-06T03:18:09.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:08 smithi050 ceph-mon[32421]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4c854d90-5353-4f7c-b2f3-2af6216d799b"}]': finished 2024-06-06T03:18:09.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:08 smithi050 ceph-mon[32421]: osdmap e30: 5 total, 4 up, 5 in 2024-06-06T03:18:09.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:08 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T03:18:10.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:09 smithi079 ceph-mon[35478]: from='client.? 172.21.15.79:0/4107014821' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:18:10.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:09 smithi122 ceph-mon[35759]: from='client.? 172.21.15.79:0/4107014821' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:18:10.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:09 smithi050 ceph-mon[32421]: from='client.? 172.21.15.79:0/4107014821' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:18:11.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:10 smithi079 ceph-mon[35478]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 129 KiB/s, 0 objects/s recovering 2024-06-06T03:18:11.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:10 smithi122 ceph-mon[35759]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 129 KiB/s, 0 objects/s recovering 2024-06-06T03:18:11.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:10 smithi050 ceph-mon[32421]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 129 KiB/s, 0 objects/s recovering 2024-06-06T03:18:13.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:12 smithi079 ceph-mon[35478]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-06T03:18:13.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:12 smithi122 ceph-mon[35759]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-06T03:18:13.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:12 smithi050 ceph-mon[32421]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-06T03:18:14.921 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:14 smithi079 ceph-mon[35478]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-06-06T03:18:15.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:14 smithi122 ceph-mon[35759]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-06-06T03:18:15.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:14 smithi050 ceph-mon[32421]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-06-06T03:18:16.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-06T03:18:16.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:18:16.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:15 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-06T03:18:16.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:15 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:18:16.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:15 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-06T03:18:16.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:15 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:18:17.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:16 smithi079 ceph-mon[35478]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-06-06T03:18:17.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:16 smithi079 ceph-mon[35478]: Deploying daemon osd.4 on smithi079 2024-06-06T03:18:17.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:16 smithi122 ceph-mon[35759]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-06-06T03:18:17.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:16 smithi122 ceph-mon[35759]: Deploying daemon osd.4 on smithi079 2024-06-06T03:18:17.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:16 smithi050 ceph-mon[32421]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-06-06T03:18:17.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:16 smithi050 ceph-mon[32421]: Deploying daemon osd.4 on smithi079 2024-06-06T03:18:19.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:18 smithi079 ceph-mon[35478]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T03:18:19.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:18 smithi122 ceph-mon[35759]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T03:18:19.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:18 smithi050 ceph-mon[32421]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T03:18:21.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:20 smithi079 ceph-mon[35478]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-06-06T03:18:21.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:20 smithi122 ceph-mon[35759]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-06-06T03:18:21.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:20 smithi050 ceph-mon[32421]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-06-06T03:18:22.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:22 smithi079 ceph-mon[35478]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-06-06T03:18:22.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:22 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:22.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:22 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:22.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:22 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:18:22.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:22 smithi122 ceph-mon[35759]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-06-06T03:18:22.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:22 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:22.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:22 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:22.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:22 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:18:22.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:22 smithi050 ceph-mon[32421]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-06-06T03:18:22.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:22 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:22.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:22 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:22.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:22 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:18:24.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:24 smithi122 ceph-mon[35759]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-06-06T03:18:24.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:24 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:24.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:24 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:24.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:24 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:18:24.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:24 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:18:24.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:24 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:24.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:24 smithi050 ceph-mon[32421]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-06-06T03:18:24.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:24 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:24.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:24 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:24.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:24 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:18:24.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:24 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:18:24.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:24 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:24.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:24 smithi079 ceph-mon[35478]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-06-06T03:18:24.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:24 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:24.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:24 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:24.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:24 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:18:24.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:24 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:18:24.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:24 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:25.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:25.303+0000 7f32fbfff700 1 -- 172.21.15.79:0/2846416360 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f33140628d0 con 0x7f32fc0a2c20 2024-06-06T03:18:25.303 INFO:teuthology.orchestra.run.smithi079.stdout:Created osd(s) 4 on host 'smithi079' 2024-06-06T03:18:25.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:25.305+0000 7f33191c1700 1 -- 172.21.15.79:0/2846416360 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f32fc0a2c20 msgr2=0x7f32fc0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:18:25.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:25.305+0000 7f33191c1700 1 --2- 172.21.15.79:0/2846416360 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f32fc0a2c20 0x7f32fc0a50e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f331406a9a0 tx=0x7f330400b410 comp rx=0 tx=0).stop 2024-06-06T03:18:25.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:25.305+0000 7f33191c1700 1 -- 172.21.15.79:0/2846416360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33141041f0 msgr2=0x7f331419fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:18:25.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:25.305+0000 7f33191c1700 1 --2- 172.21.15.79:0/2846416360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33141041f0 0x7f331419fc10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f330c0062a0 tx=0x7f330c004e40 comp rx=0 tx=0).stop 2024-06-06T03:18:25.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:25.305+0000 7f33191c1700 1 -- 172.21.15.79:0/2846416360 shutdown_connections 2024-06-06T03:18:25.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:25.305+0000 7f33191c1700 1 --2- 172.21.15.79:0/2846416360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33141041f0 0x7f331419fc10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:18:25.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:25.305+0000 7f33191c1700 1 --2- 172.21.15.79:0/2846416360 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f32fc0a2c20 0x7f32fc0a50e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:18:25.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:25.305+0000 7f33191c1700 1 --2- 172.21.15.79:0/2846416360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3314100870 0x7f3314198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:18:25.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:25.305+0000 7f33191c1700 1 --2- 172.21.15.79:0/2846416360 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3314103850 0x7f3314198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:18:25.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:25.305+0000 7f33191c1700 1 -- 172.21.15.79:0/2846416360 >> 172.21.15.79:0/2846416360 conn(0x7f33140fc1d0 msgr2=0x7f3314106af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:18:25.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:25.306+0000 7f33191c1700 1 -- 172.21.15.79:0/2846416360 shutdown_connections 2024-06-06T03:18:25.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:18:25.306+0000 7f33191c1700 1 -- 172.21.15.79:0/2846416360 wait complete. 2024-06-06T03:18:25.997 DEBUG:teuthology.orchestra.run.smithi079:osd.4> sudo journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.4.service 2024-06-06T03:18:26.000 INFO:tasks.cephadm:Deploying osd.5 on smithi122 with /dev/vg_nvme/lv_3... 2024-06-06T03:18:26.000 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-06-06T03:18:26.232 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T03:18:26.433 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:26 smithi079 ceph-mon[35478]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-06-06T03:18:26.433 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:26 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:26.433 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:26 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:26.433 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:26 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:18:26.433 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:26 smithi079 ceph-mon[35478]: from='osd.4 [v2:172.21.15.79:6808/1784117997,v1:172.21.15.79:6809/1784117997]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-06T03:18:26.434 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:26 smithi079 ceph-mon[35478]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-06T03:18:26.588 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:26 smithi122 ceph-mon[35759]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-06-06T03:18:26.588 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:26 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:26.588 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:26 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:26.588 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:26 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:18:26.588 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:26 smithi122 ceph-mon[35759]: from='osd.4 [v2:172.21.15.79:6808/1784117997,v1:172.21.15.79:6809/1784117997]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-06T03:18:26.589 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:26 smithi122 ceph-mon[35759]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-06T03:18:26.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:26 smithi050 ceph-mon[32421]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-06-06T03:18:26.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:26 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:26.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:26 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:26.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:26 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:18:26.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:26 smithi050 ceph-mon[32421]: from='osd.4 [v2:172.21.15.79:6808/1784117997,v1:172.21.15.79:6809/1784117997]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-06T03:18:26.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:26 smithi050 ceph-mon[32421]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-06T03:18:27.507 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:27 smithi122 ceph-mon[35759]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-06T03:18:27.507 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:27 smithi122 ceph-mon[35759]: from='osd.4 [v2:172.21.15.79:6808/1784117997,v1:172.21.15.79:6809/1784117997]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-06-06T03:18:27.507 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:27 smithi122 ceph-mon[35759]: osdmap e31: 5 total, 4 up, 5 in 2024-06-06T03:18:27.507 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:27 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T03:18:27.507 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:27 smithi122 ceph-mon[35759]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-06-06T03:18:27.542 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:27 smithi079 ceph-mon[35478]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-06T03:18:27.542 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:27 smithi079 ceph-mon[35478]: from='osd.4 [v2:172.21.15.79:6808/1784117997,v1:172.21.15.79:6809/1784117997]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-06-06T03:18:27.542 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:27 smithi079 ceph-mon[35478]: osdmap e31: 5 total, 4 up, 5 in 2024-06-06T03:18:27.542 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:27 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T03:18:27.542 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:27 smithi079 ceph-mon[35478]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-06-06T03:18:27.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:27 smithi050 ceph-mon[32421]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-06T03:18:27.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:27 smithi050 ceph-mon[32421]: from='osd.4 [v2:172.21.15.79:6808/1784117997,v1:172.21.15.79:6809/1784117997]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-06-06T03:18:27.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:27 smithi050 ceph-mon[32421]: osdmap e31: 5 total, 4 up, 5 in 2024-06-06T03:18:27.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:27 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T03:18:27.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:27 smithi050 ceph-mon[32421]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-06-06T03:18:27.807 INFO:journalctl@ceph.osd.4.smithi079.stdout:Jun 06 03:18:27 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-4[46512]: 2024-06-06T03:18:27.737+0000 7f12a6304700 -1 osd.4 0 waiting for initial osdmap 2024-06-06T03:18:27.808 INFO:journalctl@ceph.osd.4.smithi079.stdout:Jun 06 03:18:27 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-4[46512]: 2024-06-06T03:18:27.743+0000 7f129e0ef700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T03:18:28.087 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-06-06T03:18:28.088 INFO:teuthology.orchestra.run.smithi122.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-06-06T03:18:28.088 INFO:teuthology.orchestra.run.smithi122.stderr: stderr: 10+0 records in 2024-06-06T03:18:28.088 INFO:teuthology.orchestra.run.smithi122.stderr:10+0 records out 2024-06-06T03:18:28.088 INFO:teuthology.orchestra.run.smithi122.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.010898 s, 962 MB/s 2024-06-06T03:18:28.088 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping successful for: 2024-06-06T03:18:28.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:28 smithi079 ceph-mon[35478]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-06-06T03:18:28.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:28 smithi079 ceph-mon[35478]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-06-06T03:18:28.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:28 smithi079 ceph-mon[35478]: osdmap e32: 5 total, 4 up, 5 in 2024-06-06T03:18:28.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:28 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T03:18:28.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:28 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T03:18:28.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:28 smithi079 ceph-mon[35478]: from='osd.4 ' entity='osd.4' 2024-06-06T03:18:28.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:28 smithi122 ceph-mon[35759]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-06-06T03:18:28.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:28 smithi122 ceph-mon[35759]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-06-06T03:18:28.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:28 smithi122 ceph-mon[35759]: osdmap e32: 5 total, 4 up, 5 in 2024-06-06T03:18:28.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:28 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T03:18:28.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:28 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T03:18:28.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:28 smithi122 ceph-mon[35759]: from='osd.4 ' entity='osd.4' 2024-06-06T03:18:28.752 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi122:vg_nvme/lv_3 2024-06-06T03:18:28.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:28 smithi050 ceph-mon[32421]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-06-06T03:18:28.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:28 smithi050 ceph-mon[32421]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-06-06T03:18:28.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:28 smithi050 ceph-mon[32421]: osdmap e32: 5 total, 4 up, 5 in 2024-06-06T03:18:28.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:28 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T03:18:28.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:28 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T03:18:28.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:28 smithi050 ceph-mon[32421]: from='osd.4 ' entity='osd.4' 2024-06-06T03:18:28.985 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T03:18:29.344 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:29 smithi122 ceph-mon[35759]: purged_snaps scrub starts 2024-06-06T03:18:29.344 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:29 smithi122 ceph-mon[35759]: purged_snaps scrub ok 2024-06-06T03:18:29.344 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:29 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T03:18:29.344 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:29 smithi122 ceph-mon[35759]: osd.4 [v2:172.21.15.79:6808/1784117997,v1:172.21.15.79:6809/1784117997] boot 2024-06-06T03:18:29.344 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:29 smithi122 ceph-mon[35759]: osdmap e33: 5 total, 5 up, 5 in 2024-06-06T03:18:29.344 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:29 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T03:18:29.344 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:29 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:29.344 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:29 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:29.344 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:29 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:18:29.345 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:29 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:18:29.345 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:29 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:29.345 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:29 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:18:29.345 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:29 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:18:29.345 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:29 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:29.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:29 smithi079 ceph-mon[35478]: purged_snaps scrub starts 2024-06-06T03:18:29.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:29 smithi079 ceph-mon[35478]: purged_snaps scrub ok 2024-06-06T03:18:29.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:29 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T03:18:29.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:29 smithi079 ceph-mon[35478]: osd.4 [v2:172.21.15.79:6808/1784117997,v1:172.21.15.79:6809/1784117997] boot 2024-06-06T03:18:29.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:29 smithi079 ceph-mon[35478]: osdmap e33: 5 total, 5 up, 5 in 2024-06-06T03:18:29.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:29 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T03:18:29.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:29 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:29.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:29 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:29.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:29 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:18:29.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:29 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:18:29.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:29 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:29.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:29 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:18:29.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:29 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:18:29.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:29 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:29.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:29 smithi050 ceph-mon[32421]: purged_snaps scrub starts 2024-06-06T03:18:29.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:29 smithi050 ceph-mon[32421]: purged_snaps scrub ok 2024-06-06T03:18:29.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:29 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T03:18:29.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:29 smithi050 ceph-mon[32421]: osd.4 [v2:172.21.15.79:6808/1784117997,v1:172.21.15.79:6809/1784117997] boot 2024-06-06T03:18:29.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:29 smithi050 ceph-mon[32421]: osdmap e33: 5 total, 5 up, 5 in 2024-06-06T03:18:29.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:29 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T03:18:29.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:29 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:29.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:29 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:29.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:29 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:18:29.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:29 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:18:29.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:29 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:29.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:29 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:18:29.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:29 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:18:29.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:29 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:30.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.521+0000 7f6eada71700 1 -- 172.21.15.122:0/4191141082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ea8103860 msgr2=0x7f6ea8103cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:18:30.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.521+0000 7f6eada71700 1 --2- 172.21.15.122:0/4191141082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ea8103860 0x7f6ea8103cc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c009990 tx=0x7f6e9c009ca0 comp rx=0 tx=0).stop 2024-06-06T03:18:30.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.521+0000 7f6eada71700 1 -- 172.21.15.122:0/4191141082 shutdown_connections 2024-06-06T03:18:30.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.521+0000 7f6eada71700 1 --2- 172.21.15.122:0/4191141082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ea8104200 0x7f6ea810aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:18:30.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.521+0000 7f6eada71700 1 --2- 172.21.15.122:0/4191141082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ea81007e0 0x7f6ea8100c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:18:30.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.521+0000 7f6eada71700 1 --2- 172.21.15.122:0/4191141082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ea8103860 0x7f6ea8103cc0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:18:30.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.521+0000 7f6eada71700 1 -- 172.21.15.122:0/4191141082 >> 172.21.15.122:0/4191141082 conn(0x7f6ea80fc100 msgr2=0x7f6ea80fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:18:30.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.521+0000 7f6eada71700 1 -- 172.21.15.122:0/4191141082 shutdown_connections 2024-06-06T03:18:30.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.521+0000 7f6eada71700 1 -- 172.21.15.122:0/4191141082 wait complete. 2024-06-06T03:18:30.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.521+0000 7f6eada71700 1 Processor -- start 2024-06-06T03:18:30.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.522+0000 7f6eada71700 1 -- start start 2024-06-06T03:18:30.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.522+0000 7f6eada71700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ea81007e0 0x7f6ea8198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:18:30.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.522+0000 7f6eada71700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ea8103860 0x7f6ea8198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:18:30.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.522+0000 7f6eada71700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ea8104200 0x7f6ea819fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:18:30.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.522+0000 7f6eada71700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea810dff0 con 0x7f6ea81007e0 2024-06-06T03:18:30.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.522+0000 7f6eada71700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea810de70 con 0x7f6ea8104200 2024-06-06T03:18:30.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.522+0000 7f6eada71700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea810e170 con 0x7f6ea8103860 2024-06-06T03:18:30.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.522+0000 7f6ea6ffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ea8103860 0x7f6ea8198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:18:30.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.522+0000 7f6ea6ffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ea8103860 0x7f6ea8198b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:35594/0 (socket says 172.21.15.122:35594) 2024-06-06T03:18:30.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.522+0000 7f6ea6ffd700 1 -- 172.21.15.122:0/3451068256 learned_addr learned my addr 172.21.15.122:0/3451068256 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-06-06T03:18:30.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.522+0000 7f6ea77fe700 1 --2- 172.21.15.122:0/3451068256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ea81007e0 0x7f6ea8198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:18:30.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.522+0000 7f6ea7fff700 1 --2- 172.21.15.122:0/3451068256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ea8104200 0x7f6ea819fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:18:30.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.522+0000 7f6ea6ffd700 1 -- 172.21.15.122:0/3451068256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ea8104200 msgr2=0x7f6ea819fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:18:30.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.522+0000 7f6ea6ffd700 1 --2- 172.21.15.122:0/3451068256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ea8104200 0x7f6ea819fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:18:30.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.522+0000 7f6ea6ffd700 1 -- 172.21.15.122:0/3451068256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ea81007e0 msgr2=0x7f6ea8198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:18:30.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.522+0000 7f6ea6ffd700 1 --2- 172.21.15.122:0/3451068256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ea81007e0 0x7f6ea8198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:18:30.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.522+0000 7f6ea6ffd700 1 -- 172.21.15.122:0/3451068256 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea81a0290 con 0x7f6ea8103860 2024-06-06T03:18:30.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.522+0000 7f6ea7fff700 1 --2- 172.21.15.122:0/3451068256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ea8104200 0x7f6ea819fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:18:30.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.522+0000 7f6ea6ffd700 1 --2- 172.21.15.122:0/3451068256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ea8103860 0x7f6ea8198b70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c004790 tx=0x7f6e9c009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:18:30.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.523+0000 7f6ea4ff9700 1 -- 172.21.15.122:0/3451068256 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c027070 con 0x7f6ea8103860 2024-06-06T03:18:30.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.523+0000 7f6eada71700 1 -- 172.21.15.122:0/3451068256 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ea81a0520 con 0x7f6ea8103860 2024-06-06T03:18:30.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.523+0000 7f6ea4ff9700 1 -- 172.21.15.122:0/3451068256 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6e9c004140 con 0x7f6ea8103860 2024-06-06T03:18:30.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.523+0000 7f6ea4ff9700 1 -- 172.21.15.122:0/3451068256 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c022d70 con 0x7f6ea8103860 2024-06-06T03:18:30.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.523+0000 7f6eada71700 1 -- 172.21.15.122:0/3451068256 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ea81a0a00 con 0x7f6ea8103860 2024-06-06T03:18:30.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.524+0000 7f6eada71700 1 -- 172.21.15.122:0/3451068256 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ea8069180 con 0x7f6ea8103860 2024-06-06T03:18:30.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.525+0000 7f6ea4ff9700 1 -- 172.21.15.122:0/3451068256 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6e9c02a070 con 0x7f6ea8103860 2024-06-06T03:18:30.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.525+0000 7f6ea4ff9700 1 --2- 172.21.15.122:0/3451068256 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6e900a2c20 0x7f6e900a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:18:30.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.526+0000 7f6ea4ff9700 1 -- 172.21.15.122:0/3451068256 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4101+0+0 (secure 0 0 0) 0x7f6e9c0cf5f0 con 0x7f6ea8103860 2024-06-06T03:18:30.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.526+0000 7f6ea77fe700 1 --2- 172.21.15.122:0/3451068256 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6e900a2c20 0x7f6e900a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:18:30.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.526+0000 7f6ea77fe700 1 --2- 172.21.15.122:0/3451068256 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6e900a2c20 0x7f6e900a50e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6e98009550 tx=0x7f6e980091b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:18:30.528 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.529+0000 7f6ea4ff9700 1 -- 172.21.15.122:0/3451068256 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6e9c031070 con 0x7f6ea8103860 2024-06-06T03:18:30.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:30 smithi079 ceph-mon[35478]: Detected new or changed devices on smithi079 2024-06-06T03:18:30.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:30 smithi079 ceph-mon[35478]: Adjusting osd_memory_target on smithi079 to 8544M 2024-06-06T03:18:30.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:30 smithi079 ceph-mon[35478]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-06-06T03:18:30.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:30 smithi122 ceph-mon[35759]: Detected new or changed devices on smithi079 2024-06-06T03:18:30.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:30 smithi122 ceph-mon[35759]: Adjusting osd_memory_target on smithi079 to 8544M 2024-06-06T03:18:30.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:30 smithi122 ceph-mon[35759]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-06-06T03:18:30.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:30.737+0000 7f6eada71700 1 -- 172.21.15.122:0/3451068256 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f6ea80628d0 con 0x7f6e900a2c20 2024-06-06T03:18:30.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:30 smithi050 ceph-mon[32421]: Detected new or changed devices on smithi079 2024-06-06T03:18:30.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:30 smithi050 ceph-mon[32421]: Adjusting osd_memory_target on smithi079 to 8544M 2024-06-06T03:18:30.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:30 smithi050 ceph-mon[32421]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-06-06T03:18:31.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:31 smithi079 ceph-mon[35478]: osdmap e34: 5 total, 5 up, 5 in 2024-06-06T03:18:31.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:31 smithi079 ceph-mon[35478]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:18:31.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:31 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:18:31.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:31 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:18:31.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:31 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:18:31.604 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:31 smithi122 ceph-mon[35759]: osdmap e34: 5 total, 5 up, 5 in 2024-06-06T03:18:31.604 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:31 smithi122 ceph-mon[35759]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:18:31.604 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:31 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:18:31.604 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:31 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:18:31.604 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:31 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:18:31.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:31 smithi050 ceph-mon[32421]: osdmap e34: 5 total, 5 up, 5 in 2024-06-06T03:18:31.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:31 smithi050 ceph-mon[32421]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:18:31.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:31 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:18:31.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:31 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:18:31.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:31 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:18:32.566 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:32 smithi122 ceph-mon[35759]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:32.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:32 smithi079 ceph-mon[35478]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:32.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:32 smithi050 ceph-mon[32421]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:34.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:34 smithi079 ceph-mon[35478]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:34.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:34 smithi079 ceph-mon[35478]: from='client.? 172.21.15.122:0/3880344592' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80041e10-a643-4338-b621-f882c7bc48b4"}]: dispatch 2024-06-06T03:18:34.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:34 smithi079 ceph-mon[35478]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80041e10-a643-4338-b621-f882c7bc48b4"}]: dispatch 2024-06-06T03:18:34.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:34 smithi079 ceph-mon[35478]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "80041e10-a643-4338-b621-f882c7bc48b4"}]': finished 2024-06-06T03:18:34.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:34 smithi079 ceph-mon[35478]: osdmap e35: 6 total, 5 up, 6 in 2024-06-06T03:18:34.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:34 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T03:18:34.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:34 smithi079 ceph-mon[35478]: from='client.? 172.21.15.122:0/1739794233' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:18:34.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:34 smithi122 ceph-mon[35759]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:34.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:34 smithi122 ceph-mon[35759]: from='client.? 172.21.15.122:0/3880344592' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80041e10-a643-4338-b621-f882c7bc48b4"}]: dispatch 2024-06-06T03:18:34.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:34 smithi122 ceph-mon[35759]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80041e10-a643-4338-b621-f882c7bc48b4"}]: dispatch 2024-06-06T03:18:34.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:34 smithi122 ceph-mon[35759]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "80041e10-a643-4338-b621-f882c7bc48b4"}]': finished 2024-06-06T03:18:34.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:34 smithi122 ceph-mon[35759]: osdmap e35: 6 total, 5 up, 6 in 2024-06-06T03:18:34.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:34 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T03:18:34.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:34 smithi122 ceph-mon[35759]: from='client.? 172.21.15.122:0/1739794233' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:18:34.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:34 smithi050 ceph-mon[32421]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:34.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:34 smithi050 ceph-mon[32421]: from='client.? 172.21.15.122:0/3880344592' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80041e10-a643-4338-b621-f882c7bc48b4"}]: dispatch 2024-06-06T03:18:34.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:34 smithi050 ceph-mon[32421]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80041e10-a643-4338-b621-f882c7bc48b4"}]: dispatch 2024-06-06T03:18:34.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:34 smithi050 ceph-mon[32421]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "80041e10-a643-4338-b621-f882c7bc48b4"}]': finished 2024-06-06T03:18:34.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:34 smithi050 ceph-mon[32421]: osdmap e35: 6 total, 5 up, 6 in 2024-06-06T03:18:34.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:34 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T03:18:34.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:34 smithi050 ceph-mon[32421]: from='client.? 172.21.15.122:0/1739794233' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:18:36.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:36 smithi079 ceph-mon[35478]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:36.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:36 smithi122 ceph-mon[35759]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:36.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:36 smithi050 ceph-mon[32421]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:38.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:38 smithi122 ceph-mon[35759]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:38.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:38 smithi079 ceph-mon[35478]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:38.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:38 smithi050 ceph-mon[32421]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:40.420 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:40 smithi122 ceph-mon[35759]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:40.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:40 smithi079 ceph-mon[35478]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:40.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:40 smithi050 ceph-mon[32421]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:41.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:41 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-06T03:18:41.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:41 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:18:41.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:41 smithi079 ceph-mon[35478]: Deploying daemon osd.5 on smithi122 2024-06-06T03:18:41.608 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:41 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-06T03:18:41.608 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:41 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:18:41.609 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:41 smithi122 ceph-mon[35759]: Deploying daemon osd.5 on smithi122 2024-06-06T03:18:41.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:41 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-06T03:18:41.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:41 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:18:41.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:41 smithi050 ceph-mon[32421]: Deploying daemon osd.5 on smithi122 2024-06-06T03:18:42.534 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:42 smithi122 ceph-mon[35759]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:42.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:42 smithi079 ceph-mon[35478]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:42.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:42 smithi050 ceph-mon[32421]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:44.558 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:44 smithi122 ceph-mon[35759]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:44.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:44 smithi079 ceph-mon[35478]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:44.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:44 smithi050 ceph-mon[32421]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:47.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:47 smithi122 ceph-mon[35759]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:47.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:47 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:47.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:47 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:47.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:47 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:18:47.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:47 smithi050 ceph-mon[32421]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:47.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:47 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:47.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:47 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:47.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:47 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:18:47.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:47 smithi079 ceph-mon[35478]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:47.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:47 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:47.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:47 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:47.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:47 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:18:49.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:49 smithi122 ceph-mon[35759]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:49.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:49 smithi050 ceph-mon[32421]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:49.559 INFO:teuthology.orchestra.run.smithi122.stdout:Created osd(s) 5 on host 'smithi122' 2024-06-06T03:18:49.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:49.559+0000 7f6ea4ff9700 1 -- 172.21.15.122:0/3451068256 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6ea80628d0 con 0x7f6e900a2c20 2024-06-06T03:18:49.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:49.561+0000 7f6eada71700 1 -- 172.21.15.122:0/3451068256 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6e900a2c20 msgr2=0x7f6e900a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:18:49.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:49.561+0000 7f6eada71700 1 --2- 172.21.15.122:0/3451068256 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6e900a2c20 0x7f6e900a50e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6e98009550 tx=0x7f6e980091b0 comp rx=0 tx=0).stop 2024-06-06T03:18:49.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:49.561+0000 7f6eada71700 1 -- 172.21.15.122:0/3451068256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ea8103860 msgr2=0x7f6ea8198b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:18:49.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:49.561+0000 7f6eada71700 1 --2- 172.21.15.122:0/3451068256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ea8103860 0x7f6ea8198b70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c004790 tx=0x7f6e9c009580 comp rx=0 tx=0).stop 2024-06-06T03:18:49.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:49.561+0000 7f6eada71700 1 -- 172.21.15.122:0/3451068256 shutdown_connections 2024-06-06T03:18:49.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:49.561+0000 7f6eada71700 1 --2- 172.21.15.122:0/3451068256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ea8104200 0x7f6ea819fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:18:49.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:49.561+0000 7f6eada71700 1 --2- 172.21.15.122:0/3451068256 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6e900a2c20 0x7f6e900a50e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:18:49.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:49.561+0000 7f6eada71700 1 --2- 172.21.15.122:0/3451068256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ea81007e0 0x7f6ea8198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:18:49.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:49.561+0000 7f6eada71700 1 --2- 172.21.15.122:0/3451068256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ea8103860 0x7f6ea8198b70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:18:49.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:49.561+0000 7f6eada71700 1 -- 172.21.15.122:0/3451068256 >> 172.21.15.122:0/3451068256 conn(0x7f6ea80fc100 msgr2=0x7f6ea8106b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:18:49.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:49.561+0000 7f6eada71700 1 -- 172.21.15.122:0/3451068256 shutdown_connections 2024-06-06T03:18:49.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:18:49.561+0000 7f6eada71700 1 -- 172.21.15.122:0/3451068256 wait complete. 2024-06-06T03:18:49.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:49 smithi079 ceph-mon[35478]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:50.142 DEBUG:teuthology.orchestra.run.smithi122:osd.5> sudo journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.5.service 2024-06-06T03:18:50.144 INFO:tasks.cephadm:Deploying osd.6 on smithi050 with /dev/vg_nvme/lv_2... 2024-06-06T03:18:50.145 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-06-06T03:18:50.406 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:18:50.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:50 smithi079 ceph-mon[35478]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:50.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:50 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:50.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:50 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:50.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:50 smithi079 ceph-mon[35478]: from='osd.5 [v2:172.21.15.122:6808/2755878218,v1:172.21.15.122:6809/2755878218]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-06T03:18:50.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:50 smithi079 ceph-mon[35478]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-06T03:18:50.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:50 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:50.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:50 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:50.851 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:50 smithi050 ceph-mon[32421]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:50.851 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:50 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:50.851 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:50 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:50.852 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:50 smithi050 ceph-mon[32421]: from='osd.5 [v2:172.21.15.122:6808/2755878218,v1:172.21.15.122:6809/2755878218]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-06T03:18:50.852 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:50 smithi050 ceph-mon[32421]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-06T03:18:50.852 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:50 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:50.852 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:50 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:50.859 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:50 smithi122 ceph-mon[35759]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:50.860 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:50 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:50.860 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:50 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:50.860 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:50 smithi122 ceph-mon[35759]: from='osd.5 [v2:172.21.15.122:6808/2755878218,v1:172.21.15.122:6809/2755878218]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-06T03:18:50.860 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:50 smithi122 ceph-mon[35759]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-06T03:18:50.860 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:50 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:50.860 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:50 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:51.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:51 smithi079 ceph-mon[35478]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-06T03:18:51.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:51 smithi079 ceph-mon[35478]: osdmap e36: 6 total, 5 up, 6 in 2024-06-06T03:18:51.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:51 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T03:18:51.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:51 smithi079 ceph-mon[35478]: from='osd.5 [v2:172.21.15.122:6808/2755878218,v1:172.21.15.122:6809/2755878218]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-06-06T03:18:51.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:51 smithi079 ceph-mon[35478]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-06-06T03:18:51.861 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:51 smithi050 ceph-mon[32421]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-06T03:18:51.861 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:51 smithi050 ceph-mon[32421]: osdmap e36: 6 total, 5 up, 6 in 2024-06-06T03:18:51.861 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:51 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T03:18:51.861 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:51 smithi050 ceph-mon[32421]: from='osd.5 [v2:172.21.15.122:6808/2755878218,v1:172.21.15.122:6809/2755878218]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-06-06T03:18:51.861 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:51 smithi050 ceph-mon[32421]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-06-06T03:18:51.891 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:51 smithi122 ceph-mon[35759]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-06T03:18:51.891 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:51 smithi122 ceph-mon[35759]: osdmap e36: 6 total, 5 up, 6 in 2024-06-06T03:18:51.891 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:51 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T03:18:51.891 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:51 smithi122 ceph-mon[35759]: from='osd.5 [v2:172.21.15.122:6808/2755878218,v1:172.21.15.122:6809/2755878218]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-06-06T03:18:51.891 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:51 smithi122 ceph-mon[35759]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-06-06T03:18:52.181 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:18:52 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:18:52.001+0000 7f2a12315700 -1 osd.5 0 waiting for initial osdmap 2024-06-06T03:18:52.182 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:18:52 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:18:52.009+0000 7f2a098ff700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T03:18:52.616 INFO:teuthology.orchestra.run.smithi050.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-06-06T03:18:52.617 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-06-06T03:18:52.617 INFO:teuthology.orchestra.run.smithi050.stderr: stderr: 10+0 records in 2024-06-06T03:18:52.617 INFO:teuthology.orchestra.run.smithi050.stderr:10+0 records out 2024-06-06T03:18:52.617 INFO:teuthology.orchestra.run.smithi050.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00839611 s, 1.2 GB/s 2024-06-06T03:18:52.617 INFO:teuthology.orchestra.run.smithi050.stderr:--> Zapping successful for: 2024-06-06T03:18:52.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:52 smithi050 ceph-mon[32421]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:52.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:52 smithi050 ceph-mon[32421]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-06-06T03:18:52.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:52 smithi050 ceph-mon[32421]: osdmap e37: 6 total, 5 up, 6 in 2024-06-06T03:18:52.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:52 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T03:18:52.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:52 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T03:18:52.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:52 smithi050 ceph-mon[32421]: from='osd.5 ' entity='osd.5' 2024-06-06T03:18:52.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:52 smithi079 ceph-mon[35478]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:52.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:52 smithi079 ceph-mon[35478]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-06-06T03:18:52.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:52 smithi079 ceph-mon[35478]: osdmap e37: 6 total, 5 up, 6 in 2024-06-06T03:18:52.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:52 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T03:18:52.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:52 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T03:18:52.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:52 smithi079 ceph-mon[35478]: from='osd.5 ' entity='osd.5' 2024-06-06T03:18:52.879 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:52 smithi122 ceph-mon[35759]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:52.879 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:52 smithi122 ceph-mon[35759]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-06-06T03:18:52.879 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:52 smithi122 ceph-mon[35759]: osdmap e37: 6 total, 5 up, 6 in 2024-06-06T03:18:52.879 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:52 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T03:18:52.879 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:52 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T03:18:52.879 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:52 smithi122 ceph-mon[35759]: from='osd.5 ' entity='osd.5' 2024-06-06T03:18:53.249 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi050:vg_nvme/lv_2 2024-06-06T03:18:53.499 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:18:53.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:53 smithi079 ceph-mon[35478]: purged_snaps scrub starts 2024-06-06T03:18:53.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:53 smithi079 ceph-mon[35478]: purged_snaps scrub ok 2024-06-06T03:18:53.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:53 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T03:18:53.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:53 smithi079 ceph-mon[35478]: osd.5 [v2:172.21.15.122:6808/2755878218,v1:172.21.15.122:6809/2755878218] boot 2024-06-06T03:18:53.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:53 smithi079 ceph-mon[35478]: osdmap e38: 6 total, 6 up, 6 in 2024-06-06T03:18:53.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:53 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T03:18:53.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:53 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:53.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:53 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:53.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:53 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:18:53.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:53 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:18:53.851 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:53 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:53.851 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:53 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:18:53.851 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:53 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:18:53.851 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:53 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:53.884 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:53 smithi050 ceph-mon[32421]: purged_snaps scrub starts 2024-06-06T03:18:53.884 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:53 smithi050 ceph-mon[32421]: purged_snaps scrub ok 2024-06-06T03:18:53.884 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:53 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T03:18:53.884 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:53 smithi050 ceph-mon[32421]: osd.5 [v2:172.21.15.122:6808/2755878218,v1:172.21.15.122:6809/2755878218] boot 2024-06-06T03:18:53.885 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:53 smithi050 ceph-mon[32421]: osdmap e38: 6 total, 6 up, 6 in 2024-06-06T03:18:53.885 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:53 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T03:18:53.885 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:53 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:53.885 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:53 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:53.885 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:53 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:18:53.885 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:53 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:18:53.885 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:53 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:53.885 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:53 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:18:53.885 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:53 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:18:53.885 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:53 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:53.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:53 smithi122 ceph-mon[35759]: purged_snaps scrub starts 2024-06-06T03:18:53.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:53 smithi122 ceph-mon[35759]: purged_snaps scrub ok 2024-06-06T03:18:53.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:53 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T03:18:53.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:53 smithi122 ceph-mon[35759]: osd.5 [v2:172.21.15.122:6808/2755878218,v1:172.21.15.122:6809/2755878218] boot 2024-06-06T03:18:53.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:53 smithi122 ceph-mon[35759]: osdmap e38: 6 total, 6 up, 6 in 2024-06-06T03:18:53.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:53 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T03:18:53.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:53 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:53.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:53 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:53.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:53 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:18:53.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:53 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:18:53.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:53 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:53.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:53 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:18:53.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:53 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:18:53.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:53 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:54.826 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:54 smithi050 ceph-mon[32421]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:54.827 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:54 smithi050 ceph-mon[32421]: Detected new or changed devices on smithi122 2024-06-06T03:18:54.827 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:54 smithi050 ceph-mon[32421]: Adjusting osd_memory_target on smithi122 to 8544M 2024-06-06T03:18:54.827 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:54 smithi050 ceph-mon[32421]: osdmap e39: 6 total, 6 up, 6 in 2024-06-06T03:18:54.827 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:54 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:18:54.827 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:54 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:18:54.827 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:54 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:18:54.827 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:54 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:54.833 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:54 smithi122 ceph-mon[35759]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:54.833 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:54 smithi122 ceph-mon[35759]: Detected new or changed devices on smithi122 2024-06-06T03:18:54.833 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:54 smithi122 ceph-mon[35759]: Adjusting osd_memory_target on smithi122 to 8544M 2024-06-06T03:18:54.833 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:54 smithi122 ceph-mon[35759]: osdmap e39: 6 total, 6 up, 6 in 2024-06-06T03:18:54.833 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:54 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:18:54.833 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:54 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:18:54.833 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:54 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:18:54.833 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:54 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:54.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:54 smithi079 ceph-mon[35478]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-06-06T03:18:54.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:54 smithi079 ceph-mon[35478]: Detected new or changed devices on smithi122 2024-06-06T03:18:54.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:54 smithi079 ceph-mon[35478]: Adjusting osd_memory_target on smithi122 to 8544M 2024-06-06T03:18:54.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:54 smithi079 ceph-mon[35478]: osdmap e39: 6 total, 6 up, 6 in 2024-06-06T03:18:54.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:54 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:18:54.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:54 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:18:54.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:54 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:18:54.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:54 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:18:55.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.071+0000 7f4bc8b81700 1 -- 172.21.15.50:0/1377490455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bc41025f0 msgr2=0x7f4bc4102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:18:55.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.071+0000 7f4bc8b81700 1 --2- 172.21.15.50:0/1377490455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bc41025f0 0x7f4bc4102a50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0099c0 tx=0x7f4bac009cd0 comp rx=0 tx=0).stop 2024-06-06T03:18:55.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.072+0000 7f4bc8b81700 1 -- 172.21.15.50:0/1377490455 shutdown_connections 2024-06-06T03:18:55.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.072+0000 7f4bc8b81700 1 --2- 172.21.15.50:0/1377490455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bc4102f90 0x7f4bc4109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:18:55.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.072+0000 7f4bc8b81700 1 --2- 172.21.15.50:0/1377490455 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bc41013f0 0x7f4bc4101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:18:55.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.072+0000 7f4bc8b81700 1 --2- 172.21.15.50:0/1377490455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bc41025f0 0x7f4bc4102a50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:18:55.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.072+0000 7f4bc8b81700 1 -- 172.21.15.50:0/1377490455 >> 172.21.15.50:0/1377490455 conn(0x7f4bc40fc990 msgr2=0x7f4bc40fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:18:55.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.072+0000 7f4bc8b81700 1 -- 172.21.15.50:0/1377490455 shutdown_connections 2024-06-06T03:18:55.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.072+0000 7f4bc8b81700 1 -- 172.21.15.50:0/1377490455 wait complete. 2024-06-06T03:18:55.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.072+0000 7f4bc8b81700 1 Processor -- start 2024-06-06T03:18:55.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.073+0000 7f4bc8b81700 1 -- start start 2024-06-06T03:18:55.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.073+0000 7f4bc8b81700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bc41013f0 0x7f4bc4198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:18:55.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.073+0000 7f4bc8b81700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bc41025f0 0x7f4bc4198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:18:55.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.073+0000 7f4bc8b81700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bc4102f90 0x7f4bc419fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:18:55.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.073+0000 7f4bc8b81700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc410ce70 con 0x7f4bc41025f0 2024-06-06T03:18:55.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.073+0000 7f4bc8b81700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc410ccf0 con 0x7f4bc4102f90 2024-06-06T03:18:55.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.073+0000 7f4bc8b81700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc410cff0 con 0x7f4bc41013f0 2024-06-06T03:18:55.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.073+0000 7f4bc259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bc41025f0 0x7f4bc4198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:18:55.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.073+0000 7f4bc259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bc41025f0 0x7f4bc4198b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47644/0 (socket says 172.21.15.50:47644) 2024-06-06T03:18:55.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.073+0000 7f4bc259c700 1 -- 172.21.15.50:0/3253018325 learned_addr learned my addr 172.21.15.50:0/3253018325 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:18:55.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.073+0000 7f4bba59c700 1 --2- 172.21.15.50:0/3253018325 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bc41013f0 0x7f4bc4198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:18:55.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.073+0000 7f4bc2d9d700 1 --2- 172.21.15.50:0/3253018325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bc4102f90 0x7f4bc419fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:18:55.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.073+0000 7f4bc259c700 1 -- 172.21.15.50:0/3253018325 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bc41013f0 msgr2=0x7f4bc4198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:18:55.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.073+0000 7f4bc259c700 1 --2- 172.21.15.50:0/3253018325 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bc41013f0 0x7f4bc4198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:18:55.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.073+0000 7f4bc259c700 1 -- 172.21.15.50:0/3253018325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bc4102f90 msgr2=0x7f4bc419fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:18:55.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.073+0000 7f4bc259c700 1 --2- 172.21.15.50:0/3253018325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bc4102f90 0x7f4bc419fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:18:55.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.073+0000 7f4bc259c700 1 -- 172.21.15.50:0/3253018325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc41a0250 con 0x7f4bc41025f0 2024-06-06T03:18:55.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.073+0000 7f4bc259c700 1 --2- 172.21.15.50:0/3253018325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bc41025f0 0x7f4bc4198b80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00b580 tx=0x7f4bac00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:18:55.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.073+0000 7f4bbbfff700 1 -- 172.21.15.50:0/3253018325 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac027070 con 0x7f4bc41025f0 2024-06-06T03:18:55.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.074+0000 7f4bc8b81700 1 -- 172.21.15.50:0/3253018325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bc41a04e0 con 0x7f4bc41025f0 2024-06-06T03:18:55.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.074+0000 7f4bbbfff700 1 -- 172.21.15.50:0/3253018325 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4bac00fe30 con 0x7f4bc41025f0 2024-06-06T03:18:55.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.074+0000 7f4bbbfff700 1 -- 172.21.15.50:0/3253018325 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac022e60 con 0x7f4bc41025f0 2024-06-06T03:18:55.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.074+0000 7f4bc8b81700 1 -- 172.21.15.50:0/3253018325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bc41a0930 con 0x7f4bc41025f0 2024-06-06T03:18:55.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.075+0000 7f4bc8b81700 1 -- 172.21.15.50:0/3253018325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bc4069180 con 0x7f4bc41025f0 2024-06-06T03:18:55.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.076+0000 7f4bbbfff700 1 -- 172.21.15.50:0/3253018325 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f4bac02a070 con 0x7f4bc41025f0 2024-06-06T03:18:55.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.076+0000 7f4bbbfff700 1 --2- 172.21.15.50:0/3253018325 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4bb00a2c20 0x7f4bb00a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:18:55.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.077+0000 7f4bba59c700 1 --2- 172.21.15.50:0/3253018325 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4bb00a2c20 0x7f4bb00a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:18:55.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.077+0000 7f4bbbfff700 1 -- 172.21.15.50:0/3253018325 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4562+0+0 (secure 0 0 0) 0x7f4bac0cee50 con 0x7f4bc41025f0 2024-06-06T03:18:55.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.077+0000 7f4bba59c700 1 --2- 172.21.15.50:0/3253018325 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4bb00a2c20 0x7f4bb00a50e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4102450 tx=0x7f4bb4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:18:55.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.081+0000 7f4bbbfff700 1 -- 172.21.15.50:0/3253018325 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4bac013070 con 0x7f4bc41025f0 2024-06-06T03:18:55.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:18:55.298+0000 7f4bc8b81700 1 -- 172.21.15.50:0/3253018325 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f4bc40feba0 con 0x7f4bb00a2c20 2024-06-06T03:18:55.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:55 smithi079 ceph-mon[35478]: osdmap e40: 6 total, 6 up, 6 in 2024-06-06T03:18:55.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:55 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:18:55.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:55 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:18:55.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:55 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:18:55.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:55 smithi122 ceph-mon[35759]: osdmap e40: 6 total, 6 up, 6 in 2024-06-06T03:18:55.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:55 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:18:55.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:55 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:18:55.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:55 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:18:55.937 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:55 smithi050 ceph-mon[32421]: osdmap e40: 6 total, 6 up, 6 in 2024-06-06T03:18:55.937 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:55 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:18:55.937 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:55 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:18:55.937 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:55 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:18:56.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:56 smithi079 ceph-mon[35478]: pgmap v141: 1 pgs: 1 remapped+peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-06T03:18:56.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:56 smithi079 ceph-mon[35478]: from='client.14376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:18:56.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:56 smithi079 ceph-mon[35478]: osdmap e41: 6 total, 6 up, 6 in 2024-06-06T03:18:56.924 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:56 smithi050 ceph-mon[32421]: pgmap v141: 1 pgs: 1 remapped+peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-06T03:18:56.924 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:56 smithi050 ceph-mon[32421]: from='client.14376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:18:56.924 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:56 smithi050 ceph-mon[32421]: osdmap e41: 6 total, 6 up, 6 in 2024-06-06T03:18:56.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:56 smithi122 ceph-mon[35759]: pgmap v141: 1 pgs: 1 remapped+peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-06T03:18:56.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:56 smithi122 ceph-mon[35759]: from='client.14376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:18:56.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:56 smithi122 ceph-mon[35759]: osdmap e41: 6 total, 6 up, 6 in 2024-06-06T03:18:57.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:57 smithi122 ceph-mon[35759]: osdmap e42: 6 total, 6 up, 6 in 2024-06-06T03:18:58.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:57 smithi050 ceph-mon[32421]: osdmap e42: 6 total, 6 up, 6 in 2024-06-06T03:18:58.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:57 smithi079 ceph-mon[35478]: osdmap e42: 6 total, 6 up, 6 in 2024-06-06T03:18:58.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:58 smithi050 ceph-mon[32421]: pgmap v144: 1 pgs: 1 remapped+peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-06T03:18:58.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:58 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1686029453' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e15c6c3-bb4b-4c2b-bb7e-4653b10874d2"}]: dispatch 2024-06-06T03:18:58.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:58 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1686029453' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e15c6c3-bb4b-4c2b-bb7e-4653b10874d2"}]': finished 2024-06-06T03:18:58.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:58 smithi050 ceph-mon[32421]: osdmap e43: 7 total, 6 up, 7 in 2024-06-06T03:18:58.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:58 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T03:18:58.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:58 smithi122 ceph-mon[35759]: pgmap v144: 1 pgs: 1 remapped+peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-06T03:18:58.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:58 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/1686029453' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e15c6c3-bb4b-4c2b-bb7e-4653b10874d2"}]: dispatch 2024-06-06T03:18:58.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:58 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/1686029453' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e15c6c3-bb4b-4c2b-bb7e-4653b10874d2"}]': finished 2024-06-06T03:18:58.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:58 smithi122 ceph-mon[35759]: osdmap e43: 7 total, 6 up, 7 in 2024-06-06T03:18:58.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:58 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T03:18:59.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:58 smithi079 ceph-mon[35478]: pgmap v144: 1 pgs: 1 remapped+peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-06T03:18:59.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:58 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/1686029453' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e15c6c3-bb4b-4c2b-bb7e-4653b10874d2"}]: dispatch 2024-06-06T03:18:59.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:58 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/1686029453' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e15c6c3-bb4b-4c2b-bb7e-4653b10874d2"}]': finished 2024-06-06T03:18:59.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:58 smithi079 ceph-mon[35478]: osdmap e43: 7 total, 6 up, 7 in 2024-06-06T03:18:59.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:58 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T03:18:59.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:18:59 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/3719306814' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:19:00.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:18:59 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3719306814' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:19:00.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:18:59 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/3719306814' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:19:00.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:00 smithi122 ceph-mon[35759]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-06-06T03:19:01.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:00 smithi050 ceph-mon[32421]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-06-06T03:19:01.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:00 smithi079 ceph-mon[35478]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-06-06T03:19:02.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:02 smithi050 ceph-mon[32421]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-06T03:19:02.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:02 smithi122 ceph-mon[35759]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-06T03:19:03.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:02 smithi079 ceph-mon[35478]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-06T03:19:04.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:04 smithi050 ceph-mon[32421]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-06-06T03:19:04.934 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:04 smithi122 ceph-mon[35759]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-06-06T03:19:05.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:04 smithi079 ceph-mon[35478]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-06-06T03:19:05.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:05 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-06T03:19:05.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:05 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:19:05.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:05 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-06T03:19:05.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:05 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:19:06.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:05 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-06T03:19:06.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:05 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:19:06.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:06 smithi050 ceph-mon[32421]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-06-06T03:19:06.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:06 smithi050 ceph-mon[32421]: Deploying daemon osd.6 on smithi050 2024-06-06T03:19:06.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:06 smithi079 ceph-mon[35478]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-06-06T03:19:06.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:06 smithi079 ceph-mon[35478]: Deploying daemon osd.6 on smithi050 2024-06-06T03:19:06.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:06 smithi122 ceph-mon[35759]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-06-06T03:19:06.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:06 smithi122 ceph-mon[35759]: Deploying daemon osd.6 on smithi050 2024-06-06T03:19:08.870 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:08 smithi050 ceph-mon[32421]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T03:19:08.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:08 smithi122 ceph-mon[35759]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T03:19:09.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:08 smithi079 ceph-mon[35478]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T03:19:10.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:10 smithi122 ceph-mon[35759]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-06-06T03:19:10.960 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:10 smithi050 ceph-mon[32421]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-06-06T03:19:11.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:10 smithi079 ceph-mon[35478]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-06-06T03:19:12.442 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:12 smithi050 ceph-mon[32421]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-06T03:19:12.442 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:12 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:12.442 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:12 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:12.442 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:12 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:19:12.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:12 smithi079 ceph-mon[35478]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-06T03:19:12.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:12 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:12.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:12 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:12.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:12 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:19:12.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:12 smithi122 ceph-mon[35759]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-06T03:19:12.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:12 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:12.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:12 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:12.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:12 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:19:14.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:14 smithi050 ceph-mon[32421]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-06T03:19:14.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:14.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:14.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:19:14.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:19:14.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:14.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:14 smithi079 ceph-mon[35478]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-06T03:19:14.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:14.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:14.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:19:14.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:19:14.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:14.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:14 smithi122 ceph-mon[35759]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-06T03:19:14.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:14.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:14.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:19:14.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:19:14.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:15.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:19:15.360+0000 7f4bbbfff700 1 -- 172.21.15.50:0/3253018325 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4bc40feba0 con 0x7f4bb00a2c20 2024-06-06T03:19:15.361 INFO:teuthology.orchestra.run.smithi050.stdout:Created osd(s) 6 on host 'smithi050' 2024-06-06T03:19:15.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:19:15.362+0000 7f4bc8b81700 1 -- 172.21.15.50:0/3253018325 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4bb00a2c20 msgr2=0x7f4bb00a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:19:15.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:19:15.362+0000 7f4bc8b81700 1 --2- 172.21.15.50:0/3253018325 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4bb00a2c20 0x7f4bb00a50e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4102450 tx=0x7f4bb4009260 comp rx=0 tx=0).stop 2024-06-06T03:19:15.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:19:15.362+0000 7f4bc8b81700 1 -- 172.21.15.50:0/3253018325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bc41025f0 msgr2=0x7f4bc4198b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:19:15.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:19:15.362+0000 7f4bc8b81700 1 --2- 172.21.15.50:0/3253018325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bc41025f0 0x7f4bc4198b80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00b580 tx=0x7f4bac00fa00 comp rx=0 tx=0).stop 2024-06-06T03:19:15.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:19:15.363+0000 7f4bc8b81700 1 -- 172.21.15.50:0/3253018325 shutdown_connections 2024-06-06T03:19:15.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:19:15.363+0000 7f4bc8b81700 1 --2- 172.21.15.50:0/3253018325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bc4102f90 0x7f4bc419fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:19:15.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:19:15.363+0000 7f4bc8b81700 1 --2- 172.21.15.50:0/3253018325 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bc41013f0 0x7f4bc4198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:19:15.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:19:15.363+0000 7f4bc8b81700 1 --2- 172.21.15.50:0/3253018325 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4bb00a2c20 0x7f4bb00a50e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:19:15.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:19:15.363+0000 7f4bc8b81700 1 --2- 172.21.15.50:0/3253018325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bc41025f0 0x7f4bc4198b80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:19:15.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:19:15.363+0000 7f4bc8b81700 1 -- 172.21.15.50:0/3253018325 >> 172.21.15.50:0/3253018325 conn(0x7f4bc40fc990 msgr2=0x7f4bc40fe490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:19:15.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:19:15.363+0000 7f4bc8b81700 1 -- 172.21.15.50:0/3253018325 shutdown_connections 2024-06-06T03:19:15.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:19:15.363+0000 7f4bc8b81700 1 -- 172.21.15.50:0/3253018325 wait complete. 2024-06-06T03:19:15.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:15 smithi050 ceph-mon[32421]: from='osd.6 [v2:172.21.15.50:6818/474595612,v1:172.21.15.50:6819/474595612]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-06T03:19:15.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:15 smithi079 ceph-mon[35478]: from='osd.6 [v2:172.21.15.50:6818/474595612,v1:172.21.15.50:6819/474595612]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-06T03:19:15.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:15 smithi122 ceph-mon[35759]: from='osd.6 [v2:172.21.15.50:6818/474595612,v1:172.21.15.50:6819/474595612]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-06T03:19:15.989 DEBUG:teuthology.orchestra.run.smithi050:osd.6> sudo journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.6.service 2024-06-06T03:19:15.992 INFO:tasks.cephadm:Deploying osd.7 on smithi079 with /dev/vg_nvme/lv_2... 2024-06-06T03:19:15.992 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-06-06T03:19:16.237 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T03:19:16.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:16 smithi079 ceph-mon[35478]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-06T03:19:16.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:16 smithi079 ceph-mon[35478]: from='osd.6 [v2:172.21.15.50:6818/474595612,v1:172.21.15.50:6819/474595612]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-06T03:19:16.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:16 smithi079 ceph-mon[35478]: osdmap e44: 7 total, 6 up, 7 in 2024-06-06T03:19:16.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:16 smithi079 ceph-mon[35478]: from='osd.6 [v2:172.21.15.50:6818/474595612,v1:172.21.15.50:6819/474595612]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-06-06T03:19:16.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:16 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T03:19:16.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:16 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:19:16.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:16 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:16.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:16 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:16.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:16 smithi122 ceph-mon[35759]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-06T03:19:16.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:16 smithi122 ceph-mon[35759]: from='osd.6 [v2:172.21.15.50:6818/474595612,v1:172.21.15.50:6819/474595612]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-06T03:19:16.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:16 smithi122 ceph-mon[35759]: osdmap e44: 7 total, 6 up, 7 in 2024-06-06T03:19:16.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:16 smithi122 ceph-mon[35759]: from='osd.6 [v2:172.21.15.50:6818/474595612,v1:172.21.15.50:6819/474595612]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-06-06T03:19:16.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:16 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T03:19:16.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:16 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:19:16.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:16 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:16.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:16 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:16.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:16 smithi050 ceph-mon[32421]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-06T03:19:16.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:16 smithi050 ceph-mon[32421]: from='osd.6 [v2:172.21.15.50:6818/474595612,v1:172.21.15.50:6819/474595612]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-06T03:19:16.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:16 smithi050 ceph-mon[32421]: osdmap e44: 7 total, 6 up, 7 in 2024-06-06T03:19:16.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:16 smithi050 ceph-mon[32421]: from='osd.6 [v2:172.21.15.50:6818/474595612,v1:172.21.15.50:6819/474595612]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-06-06T03:19:16.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:16 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T03:19:16.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:16 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:19:16.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:16 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:16.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:16 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:17.251 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:19:16 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:19:16.809+0000 7fc912039700 -1 osd.6 0 waiting for initial osdmap 2024-06-06T03:19:17.251 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:19:16 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:19:16.819+0000 7fc909e24700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T03:19:17.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:17 smithi079 ceph-mon[35478]: from='osd.6 [v2:172.21.15.50:6818/474595612,v1:172.21.15.50:6819/474595612]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-06-06T03:19:17.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:17 smithi079 ceph-mon[35478]: osdmap e45: 7 total, 6 up, 7 in 2024-06-06T03:19:17.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:17 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T03:19:17.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:17 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T03:19:17.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:17 smithi079 ceph-mon[35478]: from='osd.6 [v2:172.21.15.50:6818/474595612,v1:172.21.15.50:6819/474595612]' entity='osd.6' 2024-06-06T03:19:17.624 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:17 smithi050 ceph-mon[32421]: from='osd.6 [v2:172.21.15.50:6818/474595612,v1:172.21.15.50:6819/474595612]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-06-06T03:19:17.624 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:17 smithi050 ceph-mon[32421]: osdmap e45: 7 total, 6 up, 7 in 2024-06-06T03:19:17.625 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:17 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T03:19:17.625 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:17 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T03:19:17.625 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:17 smithi050 ceph-mon[32421]: from='osd.6 [v2:172.21.15.50:6818/474595612,v1:172.21.15.50:6819/474595612]' entity='osd.6' 2024-06-06T03:19:17.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:17 smithi122 ceph-mon[35759]: from='osd.6 [v2:172.21.15.50:6818/474595612,v1:172.21.15.50:6819/474595612]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-06-06T03:19:17.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:17 smithi122 ceph-mon[35759]: osdmap e45: 7 total, 6 up, 7 in 2024-06-06T03:19:17.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:17 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T03:19:17.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:17 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T03:19:17.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:17 smithi122 ceph-mon[35759]: from='osd.6 [v2:172.21.15.50:6818/474595612,v1:172.21.15.50:6819/474595612]' entity='osd.6' 2024-06-06T03:19:18.523 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:18 smithi079 ceph-mon[35478]: purged_snaps scrub starts 2024-06-06T03:19:18.523 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:18 smithi079 ceph-mon[35478]: purged_snaps scrub ok 2024-06-06T03:19:18.523 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:18 smithi079 ceph-mon[35478]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-06T03:19:18.523 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:18 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T03:19:18.523 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:18 smithi079 ceph-mon[35478]: osd.6 [v2:172.21.15.50:6818/474595612,v1:172.21.15.50:6819/474595612] boot 2024-06-06T03:19:18.523 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:18 smithi079 ceph-mon[35478]: osdmap e46: 7 total, 7 up, 7 in 2024-06-06T03:19:18.523 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:18 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T03:19:18.618 INFO:teuthology.orchestra.run.smithi079.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-06-06T03:19:18.618 INFO:teuthology.orchestra.run.smithi079.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-06-06T03:19:18.619 INFO:teuthology.orchestra.run.smithi079.stderr: stderr: 10+0 records in 2024-06-06T03:19:18.619 INFO:teuthology.orchestra.run.smithi079.stderr:10+0 records out 2024-06-06T03:19:18.619 INFO:teuthology.orchestra.run.smithi079.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114593 s, 915 MB/s 2024-06-06T03:19:18.619 INFO:teuthology.orchestra.run.smithi079.stderr:--> Zapping successful for: 2024-06-06T03:19:18.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:18 smithi122 ceph-mon[35759]: purged_snaps scrub starts 2024-06-06T03:19:18.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:18 smithi122 ceph-mon[35759]: purged_snaps scrub ok 2024-06-06T03:19:18.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:18 smithi122 ceph-mon[35759]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-06T03:19:18.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:18 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T03:19:18.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:18 smithi122 ceph-mon[35759]: osd.6 [v2:172.21.15.50:6818/474595612,v1:172.21.15.50:6819/474595612] boot 2024-06-06T03:19:18.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:18 smithi122 ceph-mon[35759]: osdmap e46: 7 total, 7 up, 7 in 2024-06-06T03:19:18.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:18 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T03:19:18.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:18 smithi050 ceph-mon[32421]: purged_snaps scrub starts 2024-06-06T03:19:18.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:18 smithi050 ceph-mon[32421]: purged_snaps scrub ok 2024-06-06T03:19:18.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:18 smithi050 ceph-mon[32421]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-06T03:19:18.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:18 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T03:19:18.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:18 smithi050 ceph-mon[32421]: osd.6 [v2:172.21.15.50:6818/474595612,v1:172.21.15.50:6819/474595612] boot 2024-06-06T03:19:18.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:18 smithi050 ceph-mon[32421]: osdmap e46: 7 total, 7 up, 7 in 2024-06-06T03:19:18.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:18 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T03:19:19.268 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi079:vg_nvme/lv_2 2024-06-06T03:19:19.515 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T03:19:20.026 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:19 smithi079 ceph-mon[35478]: osdmap e47: 7 total, 7 up, 7 in 2024-06-06T03:19:20.026 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:19 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:20.026 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:19 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:20.026 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:19 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:19:20.026 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:19 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:19:20.027 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:19 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:19:20.027 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:19 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:20.027 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:19 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:19:20.027 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:19 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:19:20.027 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:19 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:20.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:19 smithi122 ceph-mon[35759]: osdmap e47: 7 total, 7 up, 7 in 2024-06-06T03:19:20.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:19 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:20.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:19 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:20.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:19 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:19:20.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:19 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:19:20.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:19 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:19:20.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:19 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:20.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:19 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:19:20.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:19 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:19:20.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:19 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:20.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:19 smithi050 ceph-mon[32421]: osdmap e47: 7 total, 7 up, 7 in 2024-06-06T03:19:20.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:19 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:20.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:19 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:20.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:19 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:19:20.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:19 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:19:20.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:19 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:19:20.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:19 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:20.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:19 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:19:20.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:19 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:19:20.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:19 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:20.998 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:20 smithi079 ceph-mon[35478]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:20.998 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:20 smithi079 ceph-mon[35478]: Detected new or changed devices on smithi050 2024-06-06T03:19:20.998 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:20 smithi079 ceph-mon[35478]: Adjusting osd_memory_target on smithi050 to 5697M 2024-06-06T03:19:21.153 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:20 smithi050 ceph-mon[32421]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:21.153 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:20 smithi050 ceph-mon[32421]: Detected new or changed devices on smithi050 2024-06-06T03:19:21.153 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:20 smithi050 ceph-mon[32421]: Adjusting osd_memory_target on smithi050 to 5697M 2024-06-06T03:19:21.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:20 smithi122 ceph-mon[35759]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:21.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:20 smithi122 ceph-mon[35759]: Detected new or changed devices on smithi050 2024-06-06T03:19:21.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:20 smithi122 ceph-mon[35759]: Adjusting osd_memory_target on smithi050 to 5697M 2024-06-06T03:19:21.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.254+0000 7f23bd040700 1 -- 172.21.15.79:0/4174334399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23b81013f0 msgr2=0x7f23b8101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:19:21.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.254+0000 7f23bd040700 1 --2- 172.21.15.79:0/4174334399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23b81013f0 0x7f23b8101810 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f23a80099c0 tx=0x7f23a8009cd0 comp rx=0 tx=0).stop 2024-06-06T03:19:21.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.254+0000 7f23bd040700 1 -- 172.21.15.79:0/4174334399 shutdown_connections 2024-06-06T03:19:21.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.254+0000 7f23bd040700 1 --2- 172.21.15.79:0/4174334399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23b8102f90 0x7f23b8109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:19:21.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.254+0000 7f23bd040700 1 --2- 172.21.15.79:0/4174334399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23b81013f0 0x7f23b8101810 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:19:21.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.254+0000 7f23bd040700 1 --2- 172.21.15.79:0/4174334399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23b81025f0 0x7f23b8102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:19:21.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.254+0000 7f23bd040700 1 -- 172.21.15.79:0/4174334399 >> 172.21.15.79:0/4174334399 conn(0x7f23b80fc990 msgr2=0x7f23b80fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:19:21.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.254+0000 7f23bd040700 1 -- 172.21.15.79:0/4174334399 shutdown_connections 2024-06-06T03:19:21.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.254+0000 7f23bd040700 1 -- 172.21.15.79:0/4174334399 wait complete. 2024-06-06T03:19:21.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.255+0000 7f23bd040700 1 Processor -- start 2024-06-06T03:19:21.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.255+0000 7f23bd040700 1 -- start start 2024-06-06T03:19:21.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.255+0000 7f23bd040700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23b81013f0 0x7f23b8198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:19:21.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.255+0000 7f23bd040700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23b81025f0 0x7f23b8198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:19:21.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.255+0000 7f23bd040700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23b8102f90 0x7f23b819fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:19:21.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.255+0000 7f23bd040700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f23b810cee0 con 0x7f23b81013f0 2024-06-06T03:19:21.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.255+0000 7f23bd040700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f23b810cd60 con 0x7f23b81025f0 2024-06-06T03:19:21.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.255+0000 7f23bd040700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f23b810d060 con 0x7f23b8102f90 2024-06-06T03:19:21.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.255+0000 7f23b659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23b81025f0 0x7f23b8198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:19:21.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.255+0000 7f23b6d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23b81013f0 0x7f23b8198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:19:21.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.255+0000 7f23b659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23b81025f0 0x7f23b8198c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36578/0 (socket says 172.21.15.79:36578) 2024-06-06T03:19:21.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.255+0000 7f23b6d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23b81013f0 0x7f23b8198720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.79:35318/0 (socket says 172.21.15.79:35318) 2024-06-06T03:19:21.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.255+0000 7f23b659c700 1 -- 172.21.15.79:0/2661568519 learned_addr learned my addr 172.21.15.79:0/2661568519 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-06T03:19:21.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.255+0000 7f23b759e700 1 --2- 172.21.15.79:0/2661568519 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23b8102f90 0x7f23b819fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:19:21.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.256+0000 7f23b659c700 1 -- 172.21.15.79:0/2661568519 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23b8102f90 msgr2=0x7f23b819fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:19:21.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.256+0000 7f23b659c700 1 --2- 172.21.15.79:0/2661568519 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23b8102f90 0x7f23b819fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:19:21.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.256+0000 7f23b659c700 1 -- 172.21.15.79:0/2661568519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23b81013f0 msgr2=0x7f23b8198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:19:21.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.256+0000 7f23b659c700 1 --2- 172.21.15.79:0/2661568519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23b81013f0 0x7f23b8198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:19:21.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.256+0000 7f23b659c700 1 -- 172.21.15.79:0/2661568519 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23b81a0380 con 0x7f23b81025f0 2024-06-06T03:19:21.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.256+0000 7f23b759e700 1 --2- 172.21.15.79:0/2661568519 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23b8102f90 0x7f23b819fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:19:21.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.256+0000 7f23b659c700 1 --2- 172.21.15.79:0/2661568519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23b81025f0 0x7f23b8198c60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f23a000b530 tx=0x7f23a000b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:19:21.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.256+0000 7f23affff700 1 -- 172.21.15.79:0/2661568519 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a0015020 con 0x7f23b81025f0 2024-06-06T03:19:21.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.256+0000 7f23affff700 1 -- 172.21.15.79:0/2661568519 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f23a0011ce0 con 0x7f23b81025f0 2024-06-06T03:19:21.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.256+0000 7f23bd040700 1 -- 172.21.15.79:0/2661568519 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23b81a0670 con 0x7f23b81025f0 2024-06-06T03:19:21.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.256+0000 7f23affff700 1 -- 172.21.15.79:0/2661568519 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a000f2e0 con 0x7f23b81025f0 2024-06-06T03:19:21.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.256+0000 7f23bd040700 1 -- 172.21.15.79:0/2661568519 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23b81a0be0 con 0x7f23b81025f0 2024-06-06T03:19:21.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.257+0000 7f23bd040700 1 -- 172.21.15.79:0/2661568519 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23b8069180 con 0x7f23b81025f0 2024-06-06T03:19:21.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.258+0000 7f23affff700 1 -- 172.21.15.79:0/2661568519 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f23a0018020 con 0x7f23b81025f0 2024-06-06T03:19:21.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.259+0000 7f23affff700 1 --2- 172.21.15.79:0/2661568519 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f23a40a2c20 0x7f23a40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:19:21.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.259+0000 7f23affff700 1 -- 172.21.15.79:0/2661568519 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 4965+0+0 (secure 0 0 0) 0x7f23a00ce150 con 0x7f23b81025f0 2024-06-06T03:19:21.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.259+0000 7f23b6d9d700 1 --2- 172.21.15.79:0/2661568519 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f23a40a2c20 0x7f23a40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:19:21.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.260+0000 7f23b6d9d700 1 --2- 172.21.15.79:0/2661568519 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f23a40a2c20 0x7f23a40a50e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f23a8000c00 tx=0x7f23a8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:19:21.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.263+0000 7f23affff700 1 -- 172.21.15.79:0/2661568519 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f23a001f020 con 0x7f23b81025f0 2024-06-06T03:19:21.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:21.466+0000 7f23bd040700 1 -- 172.21.15.79:0/2661568519 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f23b806b340 con 0x7f23a40a2c20 2024-06-06T03:19:22.092 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:21 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:19:22.092 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:21 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:19:22.092 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:21 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:19:22.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:21 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:19:22.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:21 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:19:22.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:21 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:19:22.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:21 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:19:22.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:21 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:19:22.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:21 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:19:23.094 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:22 smithi079 ceph-mon[35478]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:23.095 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:22 smithi079 ceph-mon[35478]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:19:23.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:22 smithi122 ceph-mon[35759]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:23.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:22 smithi122 ceph-mon[35759]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:19:23.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:22 smithi050 ceph-mon[32421]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:23.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:22 smithi050 ceph-mon[32421]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:19:25.001 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:24 smithi079 ceph-mon[35478]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:25.001 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:24 smithi079 ceph-mon[35478]: from='client.? 172.21.15.79:0/996483488' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62585bba-c540-4498-8768-b84183e19abd"}]: dispatch 2024-06-06T03:19:25.001 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:24 smithi079 ceph-mon[35478]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62585bba-c540-4498-8768-b84183e19abd"}]: dispatch 2024-06-06T03:19:25.001 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:24 smithi079 ceph-mon[35478]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62585bba-c540-4498-8768-b84183e19abd"}]': finished 2024-06-06T03:19:25.001 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:24 smithi079 ceph-mon[35478]: osdmap e48: 8 total, 7 up, 8 in 2024-06-06T03:19:25.001 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:24 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T03:19:25.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:24 smithi122 ceph-mon[35759]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:25.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:24 smithi122 ceph-mon[35759]: from='client.? 172.21.15.79:0/996483488' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62585bba-c540-4498-8768-b84183e19abd"}]: dispatch 2024-06-06T03:19:25.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:24 smithi122 ceph-mon[35759]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62585bba-c540-4498-8768-b84183e19abd"}]: dispatch 2024-06-06T03:19:25.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:24 smithi122 ceph-mon[35759]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62585bba-c540-4498-8768-b84183e19abd"}]': finished 2024-06-06T03:19:25.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:24 smithi122 ceph-mon[35759]: osdmap e48: 8 total, 7 up, 8 in 2024-06-06T03:19:25.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:24 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T03:19:25.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:24 smithi050 ceph-mon[32421]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:25.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:24 smithi050 ceph-mon[32421]: from='client.? 172.21.15.79:0/996483488' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62585bba-c540-4498-8768-b84183e19abd"}]: dispatch 2024-06-06T03:19:25.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:24 smithi050 ceph-mon[32421]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62585bba-c540-4498-8768-b84183e19abd"}]: dispatch 2024-06-06T03:19:25.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:24 smithi050 ceph-mon[32421]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62585bba-c540-4498-8768-b84183e19abd"}]': finished 2024-06-06T03:19:25.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:24 smithi050 ceph-mon[32421]: osdmap e48: 8 total, 7 up, 8 in 2024-06-06T03:19:25.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:24 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T03:19:26.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:25 smithi079 ceph-mon[35478]: from='client.? 172.21.15.79:0/687214044' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:19:26.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:25 smithi122 ceph-mon[35759]: from='client.? 172.21.15.79:0/687214044' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:19:26.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:25 smithi050 ceph-mon[32421]: from='client.? 172.21.15.79:0/687214044' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:19:27.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:26 smithi079 ceph-mon[35478]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:27.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:26 smithi122 ceph-mon[35759]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:27.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:26 smithi050 ceph-mon[32421]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:29.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:28 smithi079 ceph-mon[35478]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:29.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:28 smithi122 ceph-mon[35759]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:29.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:28 smithi050 ceph-mon[32421]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:31.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:30 smithi079 ceph-mon[35478]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:31.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:30 smithi122 ceph-mon[35759]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:31.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:30 smithi050 ceph-mon[32421]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:32.874 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:32 smithi079 ceph-mon[35478]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:32.874 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:32 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-06T03:19:32.875 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:32 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:19:32.875 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:32 smithi079 ceph-mon[35478]: Deploying daemon osd.7 on smithi079 2024-06-06T03:19:33.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:32 smithi122 ceph-mon[35759]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:33.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:32 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-06T03:19:33.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:32 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:19:33.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:32 smithi122 ceph-mon[35759]: Deploying daemon osd.7 on smithi079 2024-06-06T03:19:33.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:32 smithi050 ceph-mon[32421]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:33.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:32 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-06T03:19:33.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:32 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:19:33.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:32 smithi050 ceph-mon[32421]: Deploying daemon osd.7 on smithi079 2024-06-06T03:19:35.079 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:34 smithi079 ceph-mon[35478]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:35.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:34 smithi122 ceph-mon[35759]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:35.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:34 smithi050 ceph-mon[32421]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:37.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:36 smithi122 ceph-mon[35759]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:37.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:36 smithi050 ceph-mon[32421]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:37.305 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:36 smithi079 ceph-mon[35478]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:39.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:38 smithi050 ceph-mon[32421]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:39.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:38 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:39.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:38 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:39.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:38 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:19:39.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:38 smithi079 ceph-mon[35478]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:39.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:38 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:39.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:38 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:39.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:38 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:19:39.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:38 smithi122 ceph-mon[35759]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:39.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:38 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:39.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:38 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:39.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:38 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:19:41.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:40 smithi079 ceph-mon[35478]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:41.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:40 smithi050 ceph-mon[32421]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:41.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:40 smithi122 ceph-mon[35759]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:41.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:41.984+0000 7f23affff700 1 -- 172.21.15.79:0/2661568519 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f23b806b340 con 0x7f23a40a2c20 2024-06-06T03:19:41.984 INFO:teuthology.orchestra.run.smithi079.stdout:Created osd(s) 7 on host 'smithi079' 2024-06-06T03:19:41.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:41.986+0000 7f23bd040700 1 -- 172.21.15.79:0/2661568519 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f23a40a2c20 msgr2=0x7f23a40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:19:41.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:41.986+0000 7f23bd040700 1 --2- 172.21.15.79:0/2661568519 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f23a40a2c20 0x7f23a40a50e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f23a8000c00 tx=0x7f23a8005fb0 comp rx=0 tx=0).stop 2024-06-06T03:19:41.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:41.986+0000 7f23bd040700 1 -- 172.21.15.79:0/2661568519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23b81025f0 msgr2=0x7f23b8198c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:19:41.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:41.986+0000 7f23bd040700 1 --2- 172.21.15.79:0/2661568519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23b81025f0 0x7f23b8198c60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f23a000b530 tx=0x7f23a000b840 comp rx=0 tx=0).stop 2024-06-06T03:19:41.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:41.986+0000 7f23bd040700 1 -- 172.21.15.79:0/2661568519 shutdown_connections 2024-06-06T03:19:41.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:41.986+0000 7f23bd040700 1 --2- 172.21.15.79:0/2661568519 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23b8102f90 0x7f23b819fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:19:41.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:41.986+0000 7f23bd040700 1 --2- 172.21.15.79:0/2661568519 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f23a40a2c20 0x7f23a40a50e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:19:41.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:41.986+0000 7f23bd040700 1 --2- 172.21.15.79:0/2661568519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23b81013f0 0x7f23b8198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:19:41.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:41.986+0000 7f23bd040700 1 --2- 172.21.15.79:0/2661568519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23b81025f0 0x7f23b8198c60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:19:41.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:41.986+0000 7f23bd040700 1 -- 172.21.15.79:0/2661568519 >> 172.21.15.79:0/2661568519 conn(0x7f23b80fc990 msgr2=0x7f23b806ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:19:41.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:41.987+0000 7f23bd040700 1 -- 172.21.15.79:0/2661568519 shutdown_connections 2024-06-06T03:19:41.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:19:41.987+0000 7f23bd040700 1 -- 172.21.15.79:0/2661568519 wait complete. 2024-06-06T03:19:42.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:42 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:42.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:42 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:42.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:42 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:19:42.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:42 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:19:42.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:42 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:42.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:42 smithi079 ceph-mon[35478]: from='osd.7 [v2:172.21.15.79:6816/3504864579,v1:172.21.15.79:6817/3504864579]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-06T03:19:42.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:42 smithi079 ceph-mon[35478]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-06T03:19:42.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:42 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:42.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:42 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:42.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:42 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:19:42.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:42 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:42.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:42 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:42.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:42 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:19:42.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:42 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:19:42.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:42 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:42.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:42 smithi122 ceph-mon[35759]: from='osd.7 [v2:172.21.15.79:6816/3504864579,v1:172.21.15.79:6817/3504864579]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-06T03:19:42.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:42 smithi122 ceph-mon[35759]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-06T03:19:42.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:42 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:42.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:42 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:42.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:42 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:19:42.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:42 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:42.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:42 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:42.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:42 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:19:42.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:42 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:19:42.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:42 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:42.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:42 smithi050 ceph-mon[32421]: from='osd.7 [v2:172.21.15.79:6816/3504864579,v1:172.21.15.79:6817/3504864579]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-06T03:19:42.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:42 smithi050 ceph-mon[32421]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-06T03:19:42.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:42 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:42.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:42 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:42.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:42 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:19:42.742 DEBUG:teuthology.orchestra.run.smithi079:osd.7> sudo journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.7.service 2024-06-06T03:19:42.744 INFO:tasks.cephadm:Deploying osd.8 on smithi122 with /dev/vg_nvme/lv_2... 2024-06-06T03:19:42.745 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-06-06T03:19:42.994 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T03:19:43.298 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:43 smithi122 ceph-mon[35759]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:43.298 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:43 smithi122 ceph-mon[35759]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-06T03:19:43.298 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:43 smithi122 ceph-mon[35759]: from='osd.7 [v2:172.21.15.79:6816/3504864579,v1:172.21.15.79:6817/3504864579]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-06-06T03:19:43.299 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:43 smithi122 ceph-mon[35759]: osdmap e49: 8 total, 7 up, 8 in 2024-06-06T03:19:43.299 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:43 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T03:19:43.299 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:43 smithi122 ceph-mon[35759]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-06-06T03:19:43.333 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:43 smithi079 ceph-mon[35478]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:43.334 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:43 smithi079 ceph-mon[35478]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-06T03:19:43.334 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:43 smithi079 ceph-mon[35478]: from='osd.7 [v2:172.21.15.79:6816/3504864579,v1:172.21.15.79:6817/3504864579]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-06-06T03:19:43.334 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:43 smithi079 ceph-mon[35478]: osdmap e49: 8 total, 7 up, 8 in 2024-06-06T03:19:43.334 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:43 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T03:19:43.334 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:43 smithi079 ceph-mon[35478]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-06-06T03:19:43.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:43 smithi050 ceph-mon[32421]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:43.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:43 smithi050 ceph-mon[32421]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-06T03:19:43.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:43 smithi050 ceph-mon[32421]: from='osd.7 [v2:172.21.15.79:6816/3504864579,v1:172.21.15.79:6817/3504864579]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-06-06T03:19:43.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:43 smithi050 ceph-mon[32421]: osdmap e49: 8 total, 7 up, 8 in 2024-06-06T03:19:43.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:43 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T03:19:43.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:43 smithi050 ceph-mon[32421]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-06-06T03:19:43.599 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:19:43 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:19:43.466+0000 7fb14ce8f700 -1 osd.7 0 waiting for initial osdmap 2024-06-06T03:19:43.599 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:19:43 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:19:43.476+0000 7fb144c7a700 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T03:19:44.240 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:44 smithi079 ceph-mon[35478]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-06-06T03:19:44.240 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:44 smithi079 ceph-mon[35478]: osdmap e50: 8 total, 7 up, 8 in 2024-06-06T03:19:44.240 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:44 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T03:19:44.240 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:44 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T03:19:44.240 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:44 smithi079 ceph-mon[35478]: from='osd.7 ' entity='osd.7' 2024-06-06T03:19:44.391 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:44 smithi122 ceph-mon[35759]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-06-06T03:19:44.391 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:44 smithi122 ceph-mon[35759]: osdmap e50: 8 total, 7 up, 8 in 2024-06-06T03:19:44.391 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:44 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T03:19:44.391 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:44 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T03:19:44.391 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:44 smithi122 ceph-mon[35759]: from='osd.7 ' entity='osd.7' 2024-06-06T03:19:44.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:44 smithi050 ceph-mon[32421]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-06-06T03:19:44.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:44 smithi050 ceph-mon[32421]: osdmap e50: 8 total, 7 up, 8 in 2024-06-06T03:19:44.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:44 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T03:19:44.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:44 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T03:19:44.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:44 smithi050 ceph-mon[32421]: from='osd.7 ' entity='osd.7' 2024-06-06T03:19:44.965 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-06-06T03:19:44.966 INFO:teuthology.orchestra.run.smithi122.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-06-06T03:19:44.966 INFO:teuthology.orchestra.run.smithi122.stderr: stderr: 10+0 records in 2024-06-06T03:19:44.966 INFO:teuthology.orchestra.run.smithi122.stderr:10+0 records out 2024-06-06T03:19:44.966 INFO:teuthology.orchestra.run.smithi122.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0109101 s, 961 MB/s 2024-06-06T03:19:44.966 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping successful for: 2024-06-06T03:19:45.269 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:45 smithi122 ceph-mon[35759]: purged_snaps scrub starts 2024-06-06T03:19:45.269 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:45 smithi122 ceph-mon[35759]: purged_snaps scrub ok 2024-06-06T03:19:45.270 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:45 smithi122 ceph-mon[35759]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:45.270 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:45 smithi122 ceph-mon[35759]: osd.7 [v2:172.21.15.79:6816/3504864579,v1:172.21.15.79:6817/3504864579] boot 2024-06-06T03:19:45.270 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:45 smithi122 ceph-mon[35759]: osdmap e51: 8 total, 8 up, 8 in 2024-06-06T03:19:45.270 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:45 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T03:19:45.270 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:45 smithi122 ceph-mon[35759]: osdmap e52: 8 total, 8 up, 8 in 2024-06-06T03:19:45.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:45 smithi079 ceph-mon[35478]: purged_snaps scrub starts 2024-06-06T03:19:45.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:45 smithi079 ceph-mon[35478]: purged_snaps scrub ok 2024-06-06T03:19:45.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:45 smithi079 ceph-mon[35478]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:45.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:45 smithi079 ceph-mon[35478]: osd.7 [v2:172.21.15.79:6816/3504864579,v1:172.21.15.79:6817/3504864579] boot 2024-06-06T03:19:45.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:45 smithi079 ceph-mon[35478]: osdmap e51: 8 total, 8 up, 8 in 2024-06-06T03:19:45.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:45 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T03:19:45.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:45 smithi079 ceph-mon[35478]: osdmap e52: 8 total, 8 up, 8 in 2024-06-06T03:19:45.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:45 smithi050 ceph-mon[32421]: purged_snaps scrub starts 2024-06-06T03:19:45.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:45 smithi050 ceph-mon[32421]: purged_snaps scrub ok 2024-06-06T03:19:45.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:45 smithi050 ceph-mon[32421]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-06-06T03:19:45.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:45 smithi050 ceph-mon[32421]: osd.7 [v2:172.21.15.79:6816/3504864579,v1:172.21.15.79:6817/3504864579] boot 2024-06-06T03:19:45.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:45 smithi050 ceph-mon[32421]: osdmap e51: 8 total, 8 up, 8 in 2024-06-06T03:19:45.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:45 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T03:19:45.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:45 smithi050 ceph-mon[32421]: osdmap e52: 8 total, 8 up, 8 in 2024-06-06T03:19:45.555 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi122:vg_nvme/lv_2 2024-06-06T03:19:45.794 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T03:19:46.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:46 smithi079 ceph-mon[35478]: pgmap v178: 1 pgs: 1 unknown; 577 KiB data, 247 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:19:46.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:46 smithi079 ceph-mon[35478]: osdmap e53: 8 total, 8 up, 8 in 2024-06-06T03:19:46.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:46 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:46.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:46 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:46.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:46 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:19:46.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:46 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:19:46.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:46 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:19:46.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:46 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:46.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:46 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:19:46.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:46 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:19:46.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:46 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:46.798 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:46 smithi122 ceph-mon[35759]: pgmap v178: 1 pgs: 1 unknown; 577 KiB data, 247 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:19:46.798 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:46 smithi122 ceph-mon[35759]: osdmap e53: 8 total, 8 up, 8 in 2024-06-06T03:19:46.798 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:46 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:46.799 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:46 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:46.799 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:46 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:19:46.799 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:46 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:19:46.799 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:46 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:19:46.799 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:46 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:46.799 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:46 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:19:46.799 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:46 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:19:46.799 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:46 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:47.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:46 smithi050 ceph-mon[32421]: pgmap v178: 1 pgs: 1 unknown; 577 KiB data, 247 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:19:47.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:46 smithi050 ceph-mon[32421]: osdmap e53: 8 total, 8 up, 8 in 2024-06-06T03:19:47.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:46 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:47.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:46 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:47.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:46 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:19:47.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:46 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:19:47.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:46 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:19:47.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:46 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:47.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:46 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:19:47.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:46 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:19:47.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:46 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:19:47.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.522+0000 7f168030e700 1 -- 172.21.15.122:0/1919366594 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1678102f70 msgr2=0x7f1678105360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:19:47.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.522+0000 7f168030e700 1 --2- 172.21.15.122:0/1919366594 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1678102f70 0x7f1678105360 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1674009990 tx=0x7f1674009ca0 comp rx=0 tx=0).stop 2024-06-06T03:19:47.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.523+0000 7f168030e700 1 -- 172.21.15.122:0/1919366594 shutdown_connections 2024-06-06T03:19:47.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.523+0000 7f168030e700 1 --2- 172.21.15.122:0/1919366594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16781081d0 0x7f167810a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:19:47.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.523+0000 7f168030e700 1 --2- 172.21.15.122:0/1919366594 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1678102f70 0x7f1678105360 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:19:47.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.523+0000 7f168030e700 1 --2- 172.21.15.122:0/1919366594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16781058a0 0x7f1678107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:19:47.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.523+0000 7f168030e700 1 -- 172.21.15.122:0/1919366594 >> 172.21.15.122:0/1919366594 conn(0x7f16780fc980 msgr2=0x7f16780fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:19:47.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.523+0000 7f168030e700 1 -- 172.21.15.122:0/1919366594 shutdown_connections 2024-06-06T03:19:47.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.523+0000 7f168030e700 1 -- 172.21.15.122:0/1919366594 wait complete. 2024-06-06T03:19:47.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.523+0000 7f168030e700 1 Processor -- start 2024-06-06T03:19:47.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.523+0000 7f168030e700 1 -- start start 2024-06-06T03:19:47.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.523+0000 7f168030e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1678102f70 0x7f16781985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:19:47.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.523+0000 7f168030e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16781058a0 0x7f1678198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:19:47.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.523+0000 7f168030e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16781081d0 0x7f167819fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:19:47.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.523+0000 7f168030e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f167810dfa0 con 0x7f16781081d0 2024-06-06T03:19:47.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.523+0000 7f168030e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f167810de20 con 0x7f16781058a0 2024-06-06T03:19:47.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.523+0000 7f168030e700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f167810e120 con 0x7f1678102f70 2024-06-06T03:19:47.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.524+0000 7f167e0aa700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1678102f70 0x7f16781985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:19:47.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.524+0000 7f167e0aa700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1678102f70 0x7f16781985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49944/0 (socket says 172.21.15.122:49944) 2024-06-06T03:19:47.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.524+0000 7f167e0aa700 1 -- 172.21.15.122:0/2916486786 learned_addr learned my addr 172.21.15.122:0/2916486786 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-06-06T03:19:47.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.524+0000 7f167d8a9700 1 --2- 172.21.15.122:0/2916486786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16781058a0 0x7f1678198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:19:47.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.524+0000 7f167e8ab700 1 --2- 172.21.15.122:0/2916486786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16781081d0 0x7f167819fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:19:47.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.524+0000 7f167e0aa700 1 -- 172.21.15.122:0/2916486786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16781058a0 msgr2=0x7f1678198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:19:47.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.524+0000 7f167e0aa700 1 --2- 172.21.15.122:0/2916486786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16781058a0 0x7f1678198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:19:47.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.524+0000 7f167e0aa700 1 -- 172.21.15.122:0/2916486786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16781081d0 msgr2=0x7f167819fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:19:47.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.524+0000 7f167e0aa700 1 --2- 172.21.15.122:0/2916486786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16781081d0 0x7f167819fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:19:47.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.524+0000 7f167e0aa700 1 -- 172.21.15.122:0/2916486786 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16781a0250 con 0x7f1678102f70 2024-06-06T03:19:47.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.524+0000 7f167e8ab700 1 --2- 172.21.15.122:0/2916486786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16781081d0 0x7f167819fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:19:47.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.524+0000 7f167d8a9700 1 --2- 172.21.15.122:0/2916486786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16781058a0 0x7f1678198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:19:47.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.524+0000 7f167e0aa700 1 --2- 172.21.15.122:0/2916486786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1678102f70 0x7f16781985f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1674005910 tx=0x7f1674009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:19:47.528 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.524+0000 7f166f7fe700 1 -- 172.21.15.122:0/2916486786 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1674026070 con 0x7f1678102f70 2024-06-06T03:19:47.528 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.524+0000 7f166f7fe700 1 -- 172.21.15.122:0/2916486786 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f167400be80 con 0x7f1678102f70 2024-06-06T03:19:47.528 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.524+0000 7f168030e700 1 -- 172.21.15.122:0/2916486786 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16781a04e0 con 0x7f1678102f70 2024-06-06T03:19:47.528 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.524+0000 7f166f7fe700 1 -- 172.21.15.122:0/2916486786 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1674017770 con 0x7f1678102f70 2024-06-06T03:19:47.528 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.524+0000 7f168030e700 1 -- 172.21.15.122:0/2916486786 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16781a0990 con 0x7f1678102f70 2024-06-06T03:19:47.528 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.525+0000 7f168030e700 1 -- 172.21.15.122:0/2916486786 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1678069180 con 0x7f1678102f70 2024-06-06T03:19:47.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.526+0000 7f166f7fe700 1 -- 172.21.15.122:0/2916486786 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1674029070 con 0x7f1678102f70 2024-06-06T03:19:47.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.527+0000 7f166f7fe700 1 --2- 172.21.15.122:0/2916486786 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f16640a2ca0 0x7f16640a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:19:47.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.527+0000 7f166f7fe700 1 -- 172.21.15.122:0/2916486786 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5397+0+0 (secure 0 0 0) 0x7f16740cf4e0 con 0x7f1678102f70 2024-06-06T03:19:47.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.527+0000 7f167d8a9700 1 --2- 172.21.15.122:0/2916486786 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f16640a2ca0 0x7f16640a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:19:47.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.527+0000 7f167d8a9700 1 --2- 172.21.15.122:0/2916486786 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f16640a2ca0 0x7f16640a5160 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1668005950 tx=0x7f1668005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:19:47.531 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.531+0000 7f166f7fe700 1 -- 172.21.15.122:0/2916486786 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f167405d850 con 0x7f1678102f70 2024-06-06T03:19:47.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:19:47.735+0000 7f168030e700 1 -- 172.21.15.122:0/2916486786 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f16780628d0 con 0x7f16640a2ca0 2024-06-06T03:19:47.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:47 smithi079 ceph-mon[35478]: Detected new or changed devices on smithi079 2024-06-06T03:19:47.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:47 smithi079 ceph-mon[35478]: Adjusting osd_memory_target on smithi079 to 5696M 2024-06-06T03:19:47.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:47 smithi079 ceph-mon[35478]: osdmap e54: 8 total, 8 up, 8 in 2024-06-06T03:19:47.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:47 smithi122 ceph-mon[35759]: Detected new or changed devices on smithi079 2024-06-06T03:19:47.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:47 smithi122 ceph-mon[35759]: Adjusting osd_memory_target on smithi079 to 5696M 2024-06-06T03:19:47.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:47 smithi122 ceph-mon[35759]: osdmap e54: 8 total, 8 up, 8 in 2024-06-06T03:19:48.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:47 smithi050 ceph-mon[32421]: Detected new or changed devices on smithi079 2024-06-06T03:19:48.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:47 smithi050 ceph-mon[32421]: Adjusting osd_memory_target on smithi079 to 5696M 2024-06-06T03:19:48.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:47 smithi050 ceph-mon[32421]: osdmap e54: 8 total, 8 up, 8 in 2024-06-06T03:19:48.638 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:48 smithi122 ceph-mon[35759]: pgmap v181: 1 pgs: 1 unknown; 577 KiB data, 247 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:19:48.638 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:48 smithi122 ceph-mon[35759]: osdmap e55: 8 total, 8 up, 8 in 2024-06-06T03:19:48.638 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:48 smithi122 ceph-mon[35759]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:19:48.638 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:48 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:19:48.638 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:48 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:19:48.638 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:48 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:19:48.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:48 smithi079 ceph-mon[35478]: pgmap v181: 1 pgs: 1 unknown; 577 KiB data, 247 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:19:48.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:48 smithi079 ceph-mon[35478]: osdmap e55: 8 total, 8 up, 8 in 2024-06-06T03:19:48.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:48 smithi079 ceph-mon[35478]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:19:48.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:48 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:19:48.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:48 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:19:48.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:48 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:19:49.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:48 smithi050 ceph-mon[32421]: pgmap v181: 1 pgs: 1 unknown; 577 KiB data, 247 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:19:49.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:48 smithi050 ceph-mon[32421]: osdmap e55: 8 total, 8 up, 8 in 2024-06-06T03:19:49.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:48 smithi050 ceph-mon[32421]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:19:49.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:48 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:19:49.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:48 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:19:49.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:48 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:19:50.797 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:50 smithi122 ceph-mon[35759]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:19:50.797 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:50 smithi122 ceph-mon[35759]: from='client.? 172.21.15.122:0/1642397144' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a272157-460a-4d4a-a63e-30436022ac7b"}]: dispatch 2024-06-06T03:19:50.797 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:50 smithi122 ceph-mon[35759]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a272157-460a-4d4a-a63e-30436022ac7b"}]: dispatch 2024-06-06T03:19:50.797 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:50 smithi122 ceph-mon[35759]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a272157-460a-4d4a-a63e-30436022ac7b"}]': finished 2024-06-06T03:19:50.797 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:50 smithi122 ceph-mon[35759]: osdmap e56: 9 total, 8 up, 9 in 2024-06-06T03:19:50.797 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:50 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T03:19:50.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:50 smithi079 ceph-mon[35478]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:19:50.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:50 smithi079 ceph-mon[35478]: from='client.? 172.21.15.122:0/1642397144' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a272157-460a-4d4a-a63e-30436022ac7b"}]: dispatch 2024-06-06T03:19:50.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:50 smithi079 ceph-mon[35478]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a272157-460a-4d4a-a63e-30436022ac7b"}]: dispatch 2024-06-06T03:19:50.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:50 smithi079 ceph-mon[35478]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a272157-460a-4d4a-a63e-30436022ac7b"}]': finished 2024-06-06T03:19:50.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:50 smithi079 ceph-mon[35478]: osdmap e56: 9 total, 8 up, 9 in 2024-06-06T03:19:50.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:50 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T03:19:51.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:50 smithi050 ceph-mon[32421]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:19:51.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:50 smithi050 ceph-mon[32421]: from='client.? 172.21.15.122:0/1642397144' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a272157-460a-4d4a-a63e-30436022ac7b"}]: dispatch 2024-06-06T03:19:51.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:50 smithi050 ceph-mon[32421]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a272157-460a-4d4a-a63e-30436022ac7b"}]: dispatch 2024-06-06T03:19:51.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:50 smithi050 ceph-mon[32421]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a272157-460a-4d4a-a63e-30436022ac7b"}]': finished 2024-06-06T03:19:51.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:50 smithi050 ceph-mon[32421]: osdmap e56: 9 total, 8 up, 9 in 2024-06-06T03:19:51.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:50 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T03:19:51.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:51 smithi079 ceph-mon[35478]: from='client.? 172.21.15.122:0/111172800' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:19:51.902 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:51 smithi050 ceph-mon[32421]: from='client.? 172.21.15.122:0/111172800' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:19:51.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:51 smithi122 ceph-mon[35759]: from='client.? 172.21.15.122:0/111172800' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:19:52.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:52 smithi079 ceph-mon[35478]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:19:52.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:52 smithi122 ceph-mon[35759]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:19:53.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:52 smithi050 ceph-mon[32421]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:19:54.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:54 smithi079 ceph-mon[35478]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:19:54.850 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:54 smithi122 ceph-mon[35759]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:19:55.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:54 smithi050 ceph-mon[32421]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:19:56.778 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:56 smithi122 ceph-mon[35759]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:19:56.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:56 smithi079 ceph-mon[35478]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:19:57.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:56 smithi050 ceph-mon[32421]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:19:58.746 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:58 smithi122 ceph-mon[35759]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:19:58.747 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:58 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-06-06T03:19:58.747 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:58 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:19:58.747 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:19:58 smithi122 ceph-mon[35759]: Deploying daemon osd.8 on smithi122 2024-06-06T03:19:58.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:58 smithi079 ceph-mon[35478]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:19:58.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:58 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-06-06T03:19:58.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:58 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:19:58.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:19:58 smithi079 ceph-mon[35478]: Deploying daemon osd.8 on smithi122 2024-06-06T03:19:59.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:58 smithi050 ceph-mon[32421]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:19:59.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:58 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-06-06T03:19:59.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:58 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:19:59.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:19:58 smithi050 ceph-mon[32421]: Deploying daemon osd.8 on smithi122 2024-06-06T03:20:00.809 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:00 smithi122 ceph-mon[35759]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:20:00.809 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:00 smithi122 ceph-mon[35759]: overall HEALTH_OK 2024-06-06T03:20:00.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:00 smithi079 ceph-mon[35478]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:20:00.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:00 smithi079 ceph-mon[35478]: overall HEALTH_OK 2024-06-06T03:20:01.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:00 smithi050 ceph-mon[32421]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:20:01.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:00 smithi050 ceph-mon[32421]: overall HEALTH_OK 2024-06-06T03:20:02.720 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:02 smithi122 ceph-mon[35759]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:20:02.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:02 smithi079 ceph-mon[35478]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:20:03.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:02 smithi050 ceph-mon[32421]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:20:04.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:04 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:04.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:04 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:20:04.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:04 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:04.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:04 smithi079 ceph-mon[35478]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:20:04.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:04 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:04.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:04 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:20:04.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:04 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:04.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:04 smithi122 ceph-mon[35759]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:20:04.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:04 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:04.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:04 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:20:04.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:04 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:04.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:04 smithi050 ceph-mon[32421]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:20:06.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:06 smithi122 ceph-mon[35759]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:20:06.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:06 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:06.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:06 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:06.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:06 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:20:06.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:06 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:20:06.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:06 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:06.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:06 smithi050 ceph-mon[32421]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:20:06.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:06 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:06.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:06 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:06.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:06 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:20:06.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:06 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:20:06.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:06 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:06.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:06 smithi079 ceph-mon[35478]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:20:06.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:06 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:06.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:06 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:06.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:06 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:20:06.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:06 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:20:06.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:06 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:07.103 INFO:teuthology.orchestra.run.smithi122.stdout:Created osd(s) 8 on host 'smithi122' 2024-06-06T03:20:07.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:20:07.103+0000 7f166f7fe700 1 -- 172.21.15.122:0/2916486786 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f16780628d0 con 0x7f16640a2ca0 2024-06-06T03:20:07.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:20:07.106+0000 7f168030e700 1 -- 172.21.15.122:0/2916486786 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f16640a2ca0 msgr2=0x7f16640a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:20:07.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:20:07.106+0000 7f168030e700 1 --2- 172.21.15.122:0/2916486786 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f16640a2ca0 0x7f16640a5160 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1668005950 tx=0x7f1668005f50 comp rx=0 tx=0).stop 2024-06-06T03:20:07.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:20:07.106+0000 7f168030e700 1 -- 172.21.15.122:0/2916486786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1678102f70 msgr2=0x7f16781985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:20:07.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:20:07.106+0000 7f168030e700 1 --2- 172.21.15.122:0/2916486786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1678102f70 0x7f16781985f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1674005910 tx=0x7f1674009580 comp rx=0 tx=0).stop 2024-06-06T03:20:07.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:20:07.106+0000 7f168030e700 1 -- 172.21.15.122:0/2916486786 shutdown_connections 2024-06-06T03:20:07.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:20:07.106+0000 7f168030e700 1 --2- 172.21.15.122:0/2916486786 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f16640a2ca0 0x7f16640a5160 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:20:07.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:20:07.106+0000 7f168030e700 1 --2- 172.21.15.122:0/2916486786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16781081d0 0x7f167819fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:20:07.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:20:07.106+0000 7f168030e700 1 --2- 172.21.15.122:0/2916486786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1678102f70 0x7f16781985f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:20:07.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:20:07.106+0000 7f168030e700 1 --2- 172.21.15.122:0/2916486786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16781058a0 0x7f1678198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:20:07.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:20:07.106+0000 7f168030e700 1 -- 172.21.15.122:0/2916486786 >> 172.21.15.122:0/2916486786 conn(0x7f16780fc980 msgr2=0x7f1678104df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:20:07.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:20:07.106+0000 7f168030e700 1 -- 172.21.15.122:0/2916486786 shutdown_connections 2024-06-06T03:20:07.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:20:07.106+0000 7f168030e700 1 -- 172.21.15.122:0/2916486786 wait complete. 2024-06-06T03:20:07.727 DEBUG:teuthology.orchestra.run.smithi122:osd.8> sudo journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.8.service 2024-06-06T03:20:07.729 INFO:tasks.cephadm:Deploying osd.9 on smithi050 with /dev/vg_nvme/lv_1... 2024-06-06T03:20:07.730 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-06-06T03:20:07.988 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:20:08.307 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:08 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:08.307 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:08 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:08.307 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:08 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:20:08.307 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:08 smithi050 ceph-mon[32421]: from='osd.8 [v2:172.21.15.122:6816/3484833116,v1:172.21.15.122:6817/3484833116]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-06T03:20:08.307 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:08 smithi050 ceph-mon[32421]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-06T03:20:08.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:08 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:08.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:08 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:08.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:08 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:20:08.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:08 smithi079 ceph-mon[35478]: from='osd.8 [v2:172.21.15.122:6816/3484833116,v1:172.21.15.122:6817/3484833116]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-06T03:20:08.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:08 smithi079 ceph-mon[35478]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-06T03:20:08.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:08 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:08.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:08 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:08.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:08 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:20:08.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:08 smithi122 ceph-mon[35759]: from='osd.8 [v2:172.21.15.122:6816/3484833116,v1:172.21.15.122:6817/3484833116]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-06T03:20:08.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:08 smithi122 ceph-mon[35759]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-06T03:20:09.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:09 smithi122 ceph-mon[35759]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:20:09.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:09 smithi122 ceph-mon[35759]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-06-06T03:20:09.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:09 smithi122 ceph-mon[35759]: osdmap e57: 9 total, 8 up, 9 in 2024-06-06T03:20:09.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:09 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T03:20:09.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:09 smithi122 ceph-mon[35759]: from='osd.8 [v2:172.21.15.122:6816/3484833116,v1:172.21.15.122:6817/3484833116]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-06-06T03:20:09.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:09 smithi122 ceph-mon[35759]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-06-06T03:20:09.182 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:20:09 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:20:09.075+0000 7fd027c53700 -1 osd.8 0 waiting for initial osdmap 2024-06-06T03:20:09.182 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:20:09 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:20:09.085+0000 7fd023a46700 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T03:20:09.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:09 smithi079 ceph-mon[35478]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:20:09.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:09 smithi079 ceph-mon[35478]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-06-06T03:20:09.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:09 smithi079 ceph-mon[35478]: osdmap e57: 9 total, 8 up, 9 in 2024-06-06T03:20:09.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:09 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T03:20:09.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:09 smithi079 ceph-mon[35478]: from='osd.8 [v2:172.21.15.122:6816/3484833116,v1:172.21.15.122:6817/3484833116]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-06-06T03:20:09.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:09 smithi079 ceph-mon[35478]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-06-06T03:20:09.462 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:09 smithi050 ceph-mon[32421]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:20:09.462 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:09 smithi050 ceph-mon[32421]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-06-06T03:20:09.462 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:09 smithi050 ceph-mon[32421]: osdmap e57: 9 total, 8 up, 9 in 2024-06-06T03:20:09.463 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:09 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T03:20:09.463 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:09 smithi050 ceph-mon[32421]: from='osd.8 [v2:172.21.15.122:6816/3484833116,v1:172.21.15.122:6817/3484833116]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-06-06T03:20:09.463 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:09 smithi050 ceph-mon[32421]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-06-06T03:20:10.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:10 smithi079 ceph-mon[35478]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-06-06T03:20:10.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:10 smithi079 ceph-mon[35478]: osdmap e58: 9 total, 8 up, 9 in 2024-06-06T03:20:10.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:10 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T03:20:10.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:10 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T03:20:10.351 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:10 smithi079 ceph-mon[35478]: osd.8 [v2:172.21.15.122:6816/3484833116,v1:172.21.15.122:6817/3484833116] boot 2024-06-06T03:20:10.351 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:10 smithi079 ceph-mon[35478]: osdmap e59: 9 total, 9 up, 9 in 2024-06-06T03:20:10.351 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:10 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T03:20:10.376 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:10 smithi122 ceph-mon[35759]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-06-06T03:20:10.376 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:10 smithi122 ceph-mon[35759]: osdmap e58: 9 total, 8 up, 9 in 2024-06-06T03:20:10.376 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:10 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T03:20:10.376 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:10 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T03:20:10.376 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:10 smithi122 ceph-mon[35759]: osd.8 [v2:172.21.15.122:6816/3484833116,v1:172.21.15.122:6817/3484833116] boot 2024-06-06T03:20:10.376 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:10 smithi122 ceph-mon[35759]: osdmap e59: 9 total, 9 up, 9 in 2024-06-06T03:20:10.377 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:10 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T03:20:10.382 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:10 smithi050 ceph-mon[32421]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-06-06T03:20:10.382 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:10 smithi050 ceph-mon[32421]: osdmap e58: 9 total, 8 up, 9 in 2024-06-06T03:20:10.383 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:10 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T03:20:10.383 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:10 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T03:20:10.383 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:10 smithi050 ceph-mon[32421]: osd.8 [v2:172.21.15.122:6816/3484833116,v1:172.21.15.122:6817/3484833116] boot 2024-06-06T03:20:10.383 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:10 smithi050 ceph-mon[32421]: osdmap e59: 9 total, 9 up, 9 in 2024-06-06T03:20:10.383 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:10 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T03:20:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-06-06T03:20:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-06-06T03:20:10.383 INFO:teuthology.orchestra.run.smithi050.stderr: stderr: 10+0 records in 2024-06-06T03:20:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:10+0 records out 2024-06-06T03:20:10.383 INFO:teuthology.orchestra.run.smithi050.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00835608 s, 1.3 GB/s 2024-06-06T03:20:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:--> Zapping successful for: 2024-06-06T03:20:11.058 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi050:vg_nvme/lv_1 2024-06-06T03:20:11.309 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:20:11.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:11 smithi079 ceph-mon[35478]: purged_snaps scrub starts 2024-06-06T03:20:11.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:11 smithi079 ceph-mon[35478]: purged_snaps scrub ok 2024-06-06T03:20:11.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:11 smithi079 ceph-mon[35478]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:20:11.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:11 smithi079 ceph-mon[35478]: osdmap e60: 9 total, 9 up, 9 in 2024-06-06T03:20:11.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:11 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:11.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:11 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:11.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:11 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:20:11.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:11 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:20:11.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:11 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:20:11.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:11 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:11.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:11 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:20:11.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:11 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:20:11.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:11 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:11.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:11 smithi122 ceph-mon[35759]: purged_snaps scrub starts 2024-06-06T03:20:11.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:11 smithi122 ceph-mon[35759]: purged_snaps scrub ok 2024-06-06T03:20:11.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:11 smithi122 ceph-mon[35759]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:20:11.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:11 smithi122 ceph-mon[35759]: osdmap e60: 9 total, 9 up, 9 in 2024-06-06T03:20:11.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:11 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:11.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:11 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:11.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:11 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:20:11.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:11 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:20:11.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:11 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:20:11.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:11 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:11.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:11 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:20:11.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:11 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:20:11.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:11 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:11.432 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:11 smithi050 ceph-mon[32421]: purged_snaps scrub starts 2024-06-06T03:20:11.433 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:11 smithi050 ceph-mon[32421]: purged_snaps scrub ok 2024-06-06T03:20:11.433 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:11 smithi050 ceph-mon[32421]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-06T03:20:11.433 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:11 smithi050 ceph-mon[32421]: osdmap e60: 9 total, 9 up, 9 in 2024-06-06T03:20:11.433 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:11 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:11.433 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:11 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:11.433 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:11 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:20:11.433 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:11 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:20:11.433 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:11 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:20:11.433 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:11 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:11.433 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:11 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:20:11.433 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:11 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:20:11.433 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:11 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:12.323 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:12 smithi050 ceph-mon[32421]: Detected new or changed devices on smithi122 2024-06-06T03:20:12.323 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:12 smithi050 ceph-mon[32421]: Adjusting osd_memory_target on smithi122 to 5696M 2024-06-06T03:20:12.323 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:12 smithi050 ceph-mon[32421]: osdmap e61: 9 total, 9 up, 9 in 2024-06-06T03:20:12.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:12 smithi079 ceph-mon[35478]: Detected new or changed devices on smithi122 2024-06-06T03:20:12.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:12 smithi079 ceph-mon[35478]: Adjusting osd_memory_target on smithi122 to 5696M 2024-06-06T03:20:12.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:12 smithi079 ceph-mon[35478]: osdmap e61: 9 total, 9 up, 9 in 2024-06-06T03:20:12.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:12 smithi122 ceph-mon[35759]: Detected new or changed devices on smithi122 2024-06-06T03:20:12.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:12 smithi122 ceph-mon[35759]: Adjusting osd_memory_target on smithi122 to 5696M 2024-06-06T03:20:12.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:12 smithi122 ceph-mon[35759]: osdmap e61: 9 total, 9 up, 9 in 2024-06-06T03:20:12.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.863+0000 7fc65092b700 1 -- 172.21.15.50:0/2406797012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc64c102f90 msgr2=0x7fc64c109840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:20:12.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.863+0000 7fc65092b700 1 --2- 172.21.15.50:0/2406797012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc64c102f90 0x7fc64c109840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc64400b0d0 tx=0x7fc64400b3e0 comp rx=0 tx=0).stop 2024-06-06T03:20:12.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.863+0000 7fc65092b700 1 -- 172.21.15.50:0/2406797012 shutdown_connections 2024-06-06T03:20:12.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.863+0000 7fc65092b700 1 --2- 172.21.15.50:0/2406797012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc64c102f90 0x7fc64c109840 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:20:12.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.863+0000 7fc65092b700 1 --2- 172.21.15.50:0/2406797012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc64c1013f0 0x7fc64c101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:20:12.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.863+0000 7fc65092b700 1 --2- 172.21.15.50:0/2406797012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc64c1025f0 0x7fc64c102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:20:12.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.863+0000 7fc65092b700 1 -- 172.21.15.50:0/2406797012 >> 172.21.15.50:0/2406797012 conn(0x7fc64c0fc9b0 msgr2=0x7fc64c0fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:20:12.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.863+0000 7fc65092b700 1 -- 172.21.15.50:0/2406797012 shutdown_connections 2024-06-06T03:20:12.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.863+0000 7fc65092b700 1 -- 172.21.15.50:0/2406797012 wait complete. 2024-06-06T03:20:12.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.864+0000 7fc65092b700 1 Processor -- start 2024-06-06T03:20:12.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.864+0000 7fc65092b700 1 -- start start 2024-06-06T03:20:12.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.864+0000 7fc65092b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc64c1013f0 0x7fc64c105380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:20:12.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.864+0000 7fc65092b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc64c1025f0 0x7fc64c1039d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:20:12.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.864+0000 7fc65092b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc64c102f90 0x7fc64c103f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:20:12.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.864+0000 7fc65092b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc64c10ce80 con 0x7fc64c102f90 2024-06-06T03:20:12.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.864+0000 7fc65092b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc64c10cd00 con 0x7fc64c1013f0 2024-06-06T03:20:12.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.864+0000 7fc65092b700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc64c10d000 con 0x7fc64c1025f0 2024-06-06T03:20:12.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.864+0000 7fc64ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc64c102f90 0x7fc64c103f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:20:12.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.864+0000 7fc64ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc64c102f90 0x7fc64c103f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39218/0 (socket says 172.21.15.50:39218) 2024-06-06T03:20:12.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.864+0000 7fc64ad9d700 1 -- 172.21.15.50:0/2955417302 learned_addr learned my addr 172.21.15.50:0/2955417302 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:20:12.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.864+0000 7fc64a59c700 1 --2- 172.21.15.50:0/2955417302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc64c1013f0 0x7fc64c105380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:20:12.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.865+0000 7fc649d9b700 1 --2- 172.21.15.50:0/2955417302 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc64c1025f0 0x7fc64c1039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:20:12.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.865+0000 7fc64ad9d700 1 -- 172.21.15.50:0/2955417302 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc64c1025f0 msgr2=0x7fc64c1039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:20:12.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.865+0000 7fc64ad9d700 1 --2- 172.21.15.50:0/2955417302 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc64c1025f0 0x7fc64c1039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:20:12.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.865+0000 7fc64ad9d700 1 -- 172.21.15.50:0/2955417302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc64c1013f0 msgr2=0x7fc64c105380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:20:12.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.865+0000 7fc64ad9d700 1 --2- 172.21.15.50:0/2955417302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc64c1013f0 0x7fc64c105380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:20:12.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.865+0000 7fc64ad9d700 1 -- 172.21.15.50:0/2955417302 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc64c1047c0 con 0x7fc64c102f90 2024-06-06T03:20:12.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.865+0000 7fc64a59c700 1 --2- 172.21.15.50:0/2955417302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc64c1013f0 0x7fc64c105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:20:12.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.865+0000 7fc64ad9d700 1 --2- 172.21.15.50:0/2955417302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc64c102f90 0x7fc64c103f10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc644009040 tx=0x7fc644004e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:20:12.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.865+0000 7fc63b7fe700 1 -- 172.21.15.50:0/2955417302 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc64401f030 con 0x7fc64c102f90 2024-06-06T03:20:12.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.865+0000 7fc63b7fe700 1 -- 172.21.15.50:0/2955417302 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc644007a80 con 0x7fc64c102f90 2024-06-06T03:20:12.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.865+0000 7fc65092b700 1 -- 172.21.15.50:0/2955417302 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc64c1a26c0 con 0x7fc64c102f90 2024-06-06T03:20:12.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.865+0000 7fc63b7fe700 1 -- 172.21.15.50:0/2955417302 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc644004790 con 0x7fc64c102f90 2024-06-06T03:20:12.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.865+0000 7fc65092b700 1 -- 172.21.15.50:0/2955417302 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc64c1a2b10 con 0x7fc64c102f90 2024-06-06T03:20:12.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.866+0000 7fc65092b700 1 -- 172.21.15.50:0/2955417302 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc64c069180 con 0x7fc64c102f90 2024-06-06T03:20:12.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.867+0000 7fc63b7fe700 1 -- 172.21.15.50:0/2955417302 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc644003a00 con 0x7fc64c102f90 2024-06-06T03:20:12.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.868+0000 7fc63b7fe700 1 --2- 172.21.15.50:0/2955417302 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc6340a2c20 0x7fc6340a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:20:12.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.868+0000 7fc64a59c700 1 --2- 172.21.15.50:0/2955417302 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc6340a2c20 0x7fc6340a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:20:12.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.868+0000 7fc63b7fe700 1 -- 172.21.15.50:0/2955417302 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5858+0+0 (secure 0 0 0) 0x7fc64400f020 con 0x7fc64c102f90 2024-06-06T03:20:12.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.869+0000 7fc64a59c700 1 --2- 172.21.15.50:0/2955417302 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc6340a2c20 0x7fc6340a50e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc64c102450 tx=0x7fc63c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:20:12.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:12.872+0000 7fc63b7fe700 1 -- 172.21.15.50:0/2955417302 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc644029020 con 0x7fc64c102f90 2024-06-06T03:20:13.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:13.090+0000 7fc65092b700 1 -- 172.21.15.50:0/2955417302 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fc64c0feb60 con 0x7fc6340a2c20 2024-06-06T03:20:13.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:13 smithi079 ceph-mon[35478]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-06-06T03:20:13.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:13 smithi122 ceph-mon[35759]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-06-06T03:20:13.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:13 smithi050 ceph-mon[32421]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-06-06T03:20:14.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:14 smithi079 ceph-mon[35478]: osdmap e62: 9 total, 9 up, 9 in 2024-06-06T03:20:14.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:14 smithi079 ceph-mon[35478]: from='client.14433 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:20:14.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:20:14.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:20:14.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:20:14.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:14 smithi122 ceph-mon[35759]: osdmap e62: 9 total, 9 up, 9 in 2024-06-06T03:20:14.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:14 smithi122 ceph-mon[35759]: from='client.14433 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:20:14.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:20:14.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:20:14.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:20:14.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:14 smithi050 ceph-mon[32421]: osdmap e62: 9 total, 9 up, 9 in 2024-06-06T03:20:14.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:14 smithi050 ceph-mon[32421]: from='client.14433 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:20:14.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:20:14.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:20:14.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:20:15.342 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:15 smithi050 ceph-mon[32421]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-06-06T03:20:15.343 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:15 smithi050 ceph-mon[32421]: osdmap e63: 9 total, 9 up, 9 in 2024-06-06T03:20:15.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:15 smithi122 ceph-mon[35759]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-06-06T03:20:15.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:15 smithi122 ceph-mon[35759]: osdmap e63: 9 total, 9 up, 9 in 2024-06-06T03:20:15.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:15 smithi079 ceph-mon[35478]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-06-06T03:20:15.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:15 smithi079 ceph-mon[35478]: osdmap e63: 9 total, 9 up, 9 in 2024-06-06T03:20:16.382 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:16 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/2492150670' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7e768ff7-f78d-4a12-b863-4b692e0f4a0b"}]: dispatch 2024-06-06T03:20:16.382 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:16 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/2492150670' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7e768ff7-f78d-4a12-b863-4b692e0f4a0b"}]': finished 2024-06-06T03:20:16.382 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:16 smithi050 ceph-mon[32421]: osdmap e64: 10 total, 9 up, 10 in 2024-06-06T03:20:16.383 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:16 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T03:20:16.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:16 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/2492150670' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7e768ff7-f78d-4a12-b863-4b692e0f4a0b"}]: dispatch 2024-06-06T03:20:16.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:16 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/2492150670' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7e768ff7-f78d-4a12-b863-4b692e0f4a0b"}]': finished 2024-06-06T03:20:16.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:16 smithi122 ceph-mon[35759]: osdmap e64: 10 total, 9 up, 10 in 2024-06-06T03:20:16.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:16 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T03:20:16.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:16 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/2492150670' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7e768ff7-f78d-4a12-b863-4b692e0f4a0b"}]: dispatch 2024-06-06T03:20:16.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:16 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/2492150670' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7e768ff7-f78d-4a12-b863-4b692e0f4a0b"}]': finished 2024-06-06T03:20:16.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:16 smithi079 ceph-mon[35478]: osdmap e64: 10 total, 9 up, 10 in 2024-06-06T03:20:16.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:16 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T03:20:17.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:17 smithi122 ceph-mon[35759]: pgmap v204: 1 pgs: 1 peering; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-06-06T03:20:17.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:17 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/739996960' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:20:17.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:17 smithi050 ceph-mon[32421]: pgmap v204: 1 pgs: 1 peering; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-06-06T03:20:17.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:17 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/739996960' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:20:17.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:17 smithi079 ceph-mon[35478]: pgmap v204: 1 pgs: 1 peering; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-06-06T03:20:17.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:17 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/739996960' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:20:19.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:19 smithi122 ceph-mon[35759]: pgmap v206: 1 pgs: 1 peering; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-06-06T03:20:19.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:19 smithi050 ceph-mon[32421]: pgmap v206: 1 pgs: 1 peering; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-06-06T03:20:19.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:19 smithi079 ceph-mon[35478]: pgmap v206: 1 pgs: 1 peering; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-06-06T03:20:21.287 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:21 smithi050 ceph-mon[32421]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-06-06T03:20:21.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:21 smithi122 ceph-mon[35759]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-06-06T03:20:21.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:21 smithi079 ceph-mon[35478]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-06-06T03:20:23.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:23 smithi050 ceph-mon[32421]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-06T03:20:23.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:23 smithi122 ceph-mon[35759]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-06T03:20:23.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:23 smithi079 ceph-mon[35478]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-06T03:20:24.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:24 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-06-06T03:20:24.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:24 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:20:24.434 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:24 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-06-06T03:20:24.434 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:24 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:20:24.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:24 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-06-06T03:20:24.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:24 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:20:25.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:25 smithi122 ceph-mon[35759]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-06T03:20:25.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:25 smithi122 ceph-mon[35759]: Deploying daemon osd.9 on smithi050 2024-06-06T03:20:25.463 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:25 smithi050 ceph-mon[32421]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-06T03:20:25.463 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:25 smithi050 ceph-mon[32421]: Deploying daemon osd.9 on smithi050 2024-06-06T03:20:25.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:25 smithi079 ceph-mon[35478]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-06T03:20:25.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:25 smithi079 ceph-mon[35478]: Deploying daemon osd.9 on smithi050 2024-06-06T03:20:27.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:27 smithi050 ceph-mon[32421]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-06T03:20:27.402 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:27 smithi079 ceph-mon[35478]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-06T03:20:27.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:27 smithi122 ceph-mon[35759]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-06T03:20:29.386 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:29 smithi050 ceph-mon[32421]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-06T03:20:29.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:29 smithi122 ceph-mon[35759]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-06T03:20:29.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:29 smithi079 ceph-mon[35478]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-06T03:20:31.051 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:30 smithi050 ceph-mon[32421]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-06T03:20:31.051 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:30 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:31.051 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:30 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:31.051 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:30 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:20:31.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:30 smithi079 ceph-mon[35478]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-06T03:20:31.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:30 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:31.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:30 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:31.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:30 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:20:31.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:30 smithi122 ceph-mon[35759]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-06T03:20:31.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:30 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:31.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:30 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:31.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:30 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:20:33.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:32 smithi050 ceph-mon[32421]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-06T03:20:33.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:32 smithi079 ceph-mon[35478]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-06T03:20:33.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:32 smithi122 ceph-mon[35759]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-06T03:20:33.766 INFO:teuthology.orchestra.run.smithi050.stdout:Created osd(s) 9 on host 'smithi050' 2024-06-06T03:20:33.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:33.766+0000 7fc63b7fe700 1 -- 172.21.15.50:0/2955417302 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc64c0feb60 con 0x7fc6340a2c20 2024-06-06T03:20:33.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:33.768+0000 7fc65092b700 1 -- 172.21.15.50:0/2955417302 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc6340a2c20 msgr2=0x7fc6340a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:20:33.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:33.768+0000 7fc65092b700 1 --2- 172.21.15.50:0/2955417302 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc6340a2c20 0x7fc6340a50e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc64c102450 tx=0x7fc63c005f90 comp rx=0 tx=0).stop 2024-06-06T03:20:33.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:33.768+0000 7fc65092b700 1 -- 172.21.15.50:0/2955417302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc64c102f90 msgr2=0x7fc64c103f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:20:33.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:33.768+0000 7fc65092b700 1 --2- 172.21.15.50:0/2955417302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc64c102f90 0x7fc64c103f10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc644009040 tx=0x7fc644004e00 comp rx=0 tx=0).stop 2024-06-06T03:20:33.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:33.768+0000 7fc65092b700 1 -- 172.21.15.50:0/2955417302 shutdown_connections 2024-06-06T03:20:33.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:33.768+0000 7fc65092b700 1 --2- 172.21.15.50:0/2955417302 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc6340a2c20 0x7fc6340a50e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:20:33.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:33.768+0000 7fc65092b700 1 --2- 172.21.15.50:0/2955417302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc64c102f90 0x7fc64c103f10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:20:33.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:33.768+0000 7fc65092b700 1 --2- 172.21.15.50:0/2955417302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc64c1013f0 0x7fc64c105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:20:33.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:33.768+0000 7fc65092b700 1 --2- 172.21.15.50:0/2955417302 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc64c1025f0 0x7fc64c1039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:20:33.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:33.768+0000 7fc65092b700 1 -- 172.21.15.50:0/2955417302 >> 172.21.15.50:0/2955417302 conn(0x7fc64c0fc9b0 msgr2=0x7fc64c0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:20:33.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:33.768+0000 7fc65092b700 1 -- 172.21.15.50:0/2955417302 shutdown_connections 2024-06-06T03:20:33.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:20:33.768+0000 7fc65092b700 1 -- 172.21.15.50:0/2955417302 wait complete. 2024-06-06T03:20:34.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:34 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:34.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:34 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:34.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:34 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:20:34.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:34 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:20:34.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:34 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:34.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:34 smithi079 ceph-mon[35478]: from='osd.9 [v2:172.21.15.50:6826/2600273670,v1:172.21.15.50:6827/2600273670]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-06T03:20:34.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:34 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:20:34.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:34 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:34.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:34 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:34.356 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:34 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:34.356 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:34 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:34.356 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:34 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:20:34.357 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:34 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:20:34.357 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:34 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:34.357 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:34 smithi050 ceph-mon[32421]: from='osd.9 [v2:172.21.15.50:6826/2600273670,v1:172.21.15.50:6827/2600273670]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-06T03:20:34.357 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:34 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:20:34.357 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:34 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:34.357 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:34 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:34.383 DEBUG:teuthology.orchestra.run.smithi050:osd.9> sudo journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.9.service 2024-06-06T03:20:34.385 INFO:tasks.cephadm:Deploying osd.10 on smithi079 with /dev/vg_nvme/lv_1... 2024-06-06T03:20:34.385 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-06-06T03:20:34.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:34 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:34.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:34 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:34.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:34 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:20:34.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:34 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:20:34.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:34 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:34.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:34 smithi122 ceph-mon[35759]: from='osd.9 [v2:172.21.15.50:6826/2600273670,v1:172.21.15.50:6827/2600273670]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-06T03:20:34.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:34 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:20:34.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:34 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:34.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:34 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:34.629 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T03:20:35.298 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:35 smithi050 ceph-mon[32421]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-06T03:20:35.298 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:35 smithi050 ceph-mon[32421]: from='osd.9 [v2:172.21.15.50:6826/2600273670,v1:172.21.15.50:6827/2600273670]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-06-06T03:20:35.298 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:35 smithi050 ceph-mon[32421]: osdmap e65: 10 total, 9 up, 10 in 2024-06-06T03:20:35.298 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:35 smithi050 ceph-mon[32421]: from='osd.9 [v2:172.21.15.50:6826/2600273670,v1:172.21.15.50:6827/2600273670]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-06-06T03:20:35.298 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:35 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T03:20:35.298 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:20:35 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:20:35.049+0000 7f4424972700 -1 osd.9 0 waiting for initial osdmap 2024-06-06T03:20:35.298 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:20:35 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:20:35.061+0000 7f4420765700 -1 osd.9 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T03:20:35.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:35 smithi079 ceph-mon[35478]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-06T03:20:35.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:35 smithi079 ceph-mon[35478]: from='osd.9 [v2:172.21.15.50:6826/2600273670,v1:172.21.15.50:6827/2600273670]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-06-06T03:20:35.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:35 smithi079 ceph-mon[35478]: osdmap e65: 10 total, 9 up, 10 in 2024-06-06T03:20:35.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:35 smithi079 ceph-mon[35478]: from='osd.9 [v2:172.21.15.50:6826/2600273670,v1:172.21.15.50:6827/2600273670]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-06-06T03:20:35.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:35 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T03:20:35.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:35 smithi122 ceph-mon[35759]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-06T03:20:35.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:35 smithi122 ceph-mon[35759]: from='osd.9 [v2:172.21.15.50:6826/2600273670,v1:172.21.15.50:6827/2600273670]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-06-06T03:20:35.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:35 smithi122 ceph-mon[35759]: osdmap e65: 10 total, 9 up, 10 in 2024-06-06T03:20:35.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:35 smithi122 ceph-mon[35759]: from='osd.9 [v2:172.21.15.50:6826/2600273670,v1:172.21.15.50:6827/2600273670]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-06-06T03:20:35.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:35 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T03:20:36.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:36 smithi050 ceph-mon[32421]: from='osd.9 [v2:172.21.15.50:6826/2600273670,v1:172.21.15.50:6827/2600273670]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-06-06T03:20:36.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:36 smithi050 ceph-mon[32421]: osdmap e66: 10 total, 9 up, 10 in 2024-06-06T03:20:36.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:36 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T03:20:36.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:36 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T03:20:36.308 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:36 smithi079 ceph-mon[35478]: from='osd.9 [v2:172.21.15.50:6826/2600273670,v1:172.21.15.50:6827/2600273670]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-06-06T03:20:36.309 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:36 smithi079 ceph-mon[35478]: osdmap e66: 10 total, 9 up, 10 in 2024-06-06T03:20:36.309 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:36 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T03:20:36.309 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:36 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T03:20:36.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:36 smithi122 ceph-mon[35759]: from='osd.9 [v2:172.21.15.50:6826/2600273670,v1:172.21.15.50:6827/2600273670]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-06-06T03:20:36.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:36 smithi122 ceph-mon[35759]: osdmap e66: 10 total, 9 up, 10 in 2024-06-06T03:20:36.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:36 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T03:20:36.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:36 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T03:20:36.751 INFO:teuthology.orchestra.run.smithi079.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-06-06T03:20:36.751 INFO:teuthology.orchestra.run.smithi079.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-06-06T03:20:36.752 INFO:teuthology.orchestra.run.smithi079.stderr: stderr: 10+0 records in 2024-06-06T03:20:36.752 INFO:teuthology.orchestra.run.smithi079.stderr:10+0 records out 2024-06-06T03:20:36.752 INFO:teuthology.orchestra.run.smithi079.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.011358 s, 923 MB/s 2024-06-06T03:20:36.752 INFO:teuthology.orchestra.run.smithi079.stderr:--> Zapping successful for: 2024-06-06T03:20:37.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:37 smithi079 ceph-mon[35478]: purged_snaps scrub starts 2024-06-06T03:20:37.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:37 smithi079 ceph-mon[35478]: purged_snaps scrub ok 2024-06-06T03:20:37.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:37 smithi079 ceph-mon[35478]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-06T03:20:37.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:37 smithi079 ceph-mon[35478]: osd.9 [v2:172.21.15.50:6826/2600273670,v1:172.21.15.50:6827/2600273670] boot 2024-06-06T03:20:37.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:37 smithi079 ceph-mon[35478]: osdmap e67: 10 total, 10 up, 10 in 2024-06-06T03:20:37.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:37 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T03:20:37.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:37 smithi122 ceph-mon[35759]: purged_snaps scrub starts 2024-06-06T03:20:37.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:37 smithi122 ceph-mon[35759]: purged_snaps scrub ok 2024-06-06T03:20:37.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:37 smithi122 ceph-mon[35759]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-06T03:20:37.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:37 smithi122 ceph-mon[35759]: osd.9 [v2:172.21.15.50:6826/2600273670,v1:172.21.15.50:6827/2600273670] boot 2024-06-06T03:20:37.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:37 smithi122 ceph-mon[35759]: osdmap e67: 10 total, 10 up, 10 in 2024-06-06T03:20:37.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:37 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T03:20:37.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:37 smithi050 ceph-mon[32421]: purged_snaps scrub starts 2024-06-06T03:20:37.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:37 smithi050 ceph-mon[32421]: purged_snaps scrub ok 2024-06-06T03:20:37.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:37 smithi050 ceph-mon[32421]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-06T03:20:37.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:37 smithi050 ceph-mon[32421]: osd.9 [v2:172.21.15.50:6826/2600273670,v1:172.21.15.50:6827/2600273670] boot 2024-06-06T03:20:37.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:37 smithi050 ceph-mon[32421]: osdmap e67: 10 total, 10 up, 10 in 2024-06-06T03:20:37.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:37 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T03:20:37.525 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi079:vg_nvme/lv_1 2024-06-06T03:20:37.765 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T03:20:38.150 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:38 smithi079 ceph-mon[35478]: osdmap e68: 10 total, 10 up, 10 in 2024-06-06T03:20:38.150 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:38 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:38.150 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:38 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:38.150 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:38 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:20:38.151 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:38 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:20:38.151 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:38 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:20:38.151 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:38 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:20:38.151 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:38 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:38.151 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:38 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:20:38.151 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:38 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:20:38.151 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:38 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:38.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:38 smithi122 ceph-mon[35759]: osdmap e68: 10 total, 10 up, 10 in 2024-06-06T03:20:38.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:38 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:38.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:38 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:38.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:38 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:20:38.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:38 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:20:38.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:38 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:20:38.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:38 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:20:38.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:38 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:38.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:38 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:20:38.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:38 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:20:38.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:38 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:38.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:38 smithi050 ceph-mon[32421]: osdmap e68: 10 total, 10 up, 10 in 2024-06-06T03:20:38.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:38 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:38.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:38 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:38.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:38 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:20:38.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:38 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:20:38.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:38 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:20:38.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:38 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:20:38.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:38 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:38.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:38 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:20:38.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:38 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:20:38.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:38 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:39.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:39 smithi079 ceph-mon[35478]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:39.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:39 smithi079 ceph-mon[35478]: Detected new or changed devices on smithi050 2024-06-06T03:20:39.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:39 smithi079 ceph-mon[35478]: Adjusting osd_memory_target on smithi050 to 4273M 2024-06-06T03:20:39.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:39 smithi122 ceph-mon[35759]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:39.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:39 smithi122 ceph-mon[35759]: Detected new or changed devices on smithi050 2024-06-06T03:20:39.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:39 smithi122 ceph-mon[35759]: Adjusting osd_memory_target on smithi050 to 4273M 2024-06-06T03:20:39.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:39 smithi050 ceph-mon[32421]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:39.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:39 smithi050 ceph-mon[32421]: Detected new or changed devices on smithi050 2024-06-06T03:20:39.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:39 smithi050 ceph-mon[32421]: Adjusting osd_memory_target on smithi050 to 4273M 2024-06-06T03:20:39.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.648+0000 7f699a887700 1 -- 172.21.15.79:0/3583756216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6994103af0 msgr2=0x7f6994103f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:20:39.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.648+0000 7f699a887700 1 --2- 172.21.15.79:0/3583756216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6994103af0 0x7f6994103f10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6984009990 tx=0x7f6984009ca0 comp rx=0 tx=0).stop 2024-06-06T03:20:39.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.648+0000 7f699a887700 1 -- 172.21.15.79:0/3583756216 shutdown_connections 2024-06-06T03:20:39.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.648+0000 7f699a887700 1 --2- 172.21.15.79:0/3583756216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6994100f10 0x7f699410aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:20:39.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.648+0000 7f699a887700 1 --2- 172.21.15.79:0/3583756216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6994103af0 0x7f6994103f10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:20:39.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.648+0000 7f699a887700 1 --2- 172.21.15.79:0/3583756216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6994100570 0x7f69941009d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:20:39.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.648+0000 7f699a887700 1 -- 172.21.15.79:0/3583756216 >> 172.21.15.79:0/3583756216 conn(0x7f69940fc130 msgr2=0x7f69940fe570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:20:39.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.648+0000 7f699a887700 1 -- 172.21.15.79:0/3583756216 shutdown_connections 2024-06-06T03:20:39.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.648+0000 7f699a887700 1 -- 172.21.15.79:0/3583756216 wait complete. 2024-06-06T03:20:39.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.648+0000 7f699a887700 1 Processor -- start 2024-06-06T03:20:39.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.649+0000 7f699a887700 1 -- start start 2024-06-06T03:20:39.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.649+0000 7f699a887700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6994100570 0x7f69941031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:20:39.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.649+0000 7f699a887700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6994100f10 0x7f6994101840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:20:39.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.649+0000 7f699a887700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6994103af0 0x7f6994101d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:20:39.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.649+0000 7f699a887700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f699410dfb0 con 0x7f6994100f10 2024-06-06T03:20:39.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.649+0000 7f699a887700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f699410de30 con 0x7f6994103af0 2024-06-06T03:20:39.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.649+0000 7f699a887700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f699410e130 con 0x7f6994100570 2024-06-06T03:20:39.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.649+0000 7f6998e24700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6994103af0 0x7f6994101d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:20:39.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.649+0000 7f6998e24700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6994103af0 0x7f6994101d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38390/0 (socket says 172.21.15.79:38390) 2024-06-06T03:20:39.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.649+0000 7f6998e24700 1 -- 172.21.15.79:0/499791183 learned_addr learned my addr 172.21.15.79:0/499791183 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-06-06T03:20:39.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.649+0000 7f6993fff700 1 --2- 172.21.15.79:0/499791183 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6994100570 0x7f69941031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:20:39.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.649+0000 7f69937fe700 1 --2- 172.21.15.79:0/499791183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6994100f10 0x7f6994101840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:20:39.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.649+0000 7f6998e24700 1 -- 172.21.15.79:0/499791183 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6994100570 msgr2=0x7f69941031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:20:39.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.649+0000 7f6998e24700 1 --2- 172.21.15.79:0/499791183 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6994100570 0x7f69941031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:20:39.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.649+0000 7f6998e24700 1 -- 172.21.15.79:0/499791183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6994100f10 msgr2=0x7f6994101840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:20:39.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.649+0000 7f6998e24700 1 --2- 172.21.15.79:0/499791183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6994100f10 0x7f6994101840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:20:39.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.649+0000 7f6998e24700 1 -- 172.21.15.79:0/499791183 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6994102630 con 0x7f6994103af0 2024-06-06T03:20:39.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.650+0000 7f6998e24700 1 --2- 172.21.15.79:0/499791183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6994103af0 0x7f6994101d80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f698c007ee0 tx=0x7f698c00d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:20:39.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.650+0000 7f69917fa700 1 -- 172.21.15.79:0/499791183 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698c004bb0 con 0x7f6994103af0 2024-06-06T03:20:39.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.650+0000 7f69917fa700 1 -- 172.21.15.79:0/499791183 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f698c004d50 con 0x7f6994103af0 2024-06-06T03:20:39.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.650+0000 7f699a887700 1 -- 172.21.15.79:0/499791183 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69941a27d0 con 0x7f6994103af0 2024-06-06T03:20:39.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.650+0000 7f69917fa700 1 -- 172.21.15.79:0/499791183 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698c0058e0 con 0x7f6994103af0 2024-06-06T03:20:39.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.650+0000 7f699a887700 1 -- 172.21.15.79:0/499791183 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69941a2ce0 con 0x7f6994103af0 2024-06-06T03:20:39.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.651+0000 7f699a887700 1 -- 172.21.15.79:0/499791183 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6994069180 con 0x7f6994103af0 2024-06-06T03:20:39.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.652+0000 7f69917fa700 1 -- 172.21.15.79:0/499791183 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f698c01a020 con 0x7f6994103af0 2024-06-06T03:20:39.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.653+0000 7f69917fa700 1 --2- 172.21.15.79:0/499791183 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f697c0a2c20 0x7f697c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:20:39.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.653+0000 7f69917fa700 1 -- 172.21.15.79:0/499791183 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6261+0+0 (secure 0 0 0) 0x7f698c0ce560 con 0x7f6994103af0 2024-06-06T03:20:39.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.653+0000 7f6993fff700 1 --2- 172.21.15.79:0/499791183 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f697c0a2c20 0x7f697c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:20:39.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.653+0000 7f6993fff700 1 --2- 172.21.15.79:0/499791183 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f697c0a2c20 0x7f697c0a50e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f698400b5c0 tx=0x7f69840037c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:20:39.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.656+0000 7f69917fa700 1 -- 172.21.15.79:0/499791183 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f698c010070 con 0x7f6994103af0 2024-06-06T03:20:39.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:20:39.861+0000 7f699a887700 1 -- 172.21.15.79:0/499791183 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f69940628d0 con 0x7f697c0a2c20 2024-06-06T03:20:40.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:40 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:20:40.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:40 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:20:40.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:40 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:20:40.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:40 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:20:40.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:40 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:20:40.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:40 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:20:40.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:40 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:20:40.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:40 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:20:40.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:40 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:20:41.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:41 smithi079 ceph-mon[35478]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:41.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:41 smithi079 ceph-mon[35478]: from='client.24317 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:20:41.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:41 smithi122 ceph-mon[35759]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:41.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:41 smithi122 ceph-mon[35759]: from='client.24317 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:20:41.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:41 smithi050 ceph-mon[32421]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:41.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:41 smithi050 ceph-mon[32421]: from='client.24317 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:20:43.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:43 smithi079 ceph-mon[35478]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:43.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:43 smithi079 ceph-mon[35478]: from='client.? 172.21.15.79:0/1707974247' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a42df29a-d88d-4401-878d-6c8f75f3f604"}]: dispatch 2024-06-06T03:20:43.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:43 smithi079 ceph-mon[35478]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a42df29a-d88d-4401-878d-6c8f75f3f604"}]: dispatch 2024-06-06T03:20:43.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:43 smithi079 ceph-mon[35478]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a42df29a-d88d-4401-878d-6c8f75f3f604"}]': finished 2024-06-06T03:20:43.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:43 smithi079 ceph-mon[35478]: osdmap e69: 11 total, 10 up, 11 in 2024-06-06T03:20:43.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:43 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T03:20:43.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:43 smithi122 ceph-mon[35759]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:43.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:43 smithi122 ceph-mon[35759]: from='client.? 172.21.15.79:0/1707974247' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a42df29a-d88d-4401-878d-6c8f75f3f604"}]: dispatch 2024-06-06T03:20:43.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:43 smithi122 ceph-mon[35759]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a42df29a-d88d-4401-878d-6c8f75f3f604"}]: dispatch 2024-06-06T03:20:43.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:43 smithi122 ceph-mon[35759]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a42df29a-d88d-4401-878d-6c8f75f3f604"}]': finished 2024-06-06T03:20:43.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:43 smithi122 ceph-mon[35759]: osdmap e69: 11 total, 10 up, 11 in 2024-06-06T03:20:43.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:43 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T03:20:43.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:43 smithi050 ceph-mon[32421]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:43.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:43 smithi050 ceph-mon[32421]: from='client.? 172.21.15.79:0/1707974247' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a42df29a-d88d-4401-878d-6c8f75f3f604"}]: dispatch 2024-06-06T03:20:43.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:43 smithi050 ceph-mon[32421]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a42df29a-d88d-4401-878d-6c8f75f3f604"}]: dispatch 2024-06-06T03:20:43.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:43 smithi050 ceph-mon[32421]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a42df29a-d88d-4401-878d-6c8f75f3f604"}]': finished 2024-06-06T03:20:43.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:43 smithi050 ceph-mon[32421]: osdmap e69: 11 total, 10 up, 11 in 2024-06-06T03:20:43.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:43 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T03:20:44.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:44 smithi079 ceph-mon[35478]: from='client.? 172.21.15.79:0/3781410536' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:20:44.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:44 smithi122 ceph-mon[35759]: from='client.? 172.21.15.79:0/3781410536' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:20:44.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:44 smithi050 ceph-mon[32421]: from='client.? 172.21.15.79:0/3781410536' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:20:45.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:45 smithi079 ceph-mon[35478]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:45.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:45 smithi122 ceph-mon[35759]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:45.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:45 smithi050 ceph-mon[32421]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:47.229 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:47 smithi079 ceph-mon[35478]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:47.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:47 smithi122 ceph-mon[35759]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:47.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:47 smithi050 ceph-mon[32421]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:49.186 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:49 smithi079 ceph-mon[35478]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:49.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:49 smithi122 ceph-mon[35759]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:49.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:49 smithi050 ceph-mon[32421]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:51.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:51 smithi079 ceph-mon[35478]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:51.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:51 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-06-06T03:20:51.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:51 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:20:51.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:51 smithi122 ceph-mon[35759]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:51.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:51 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-06-06T03:20:51.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:51 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:20:51.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:51 smithi050 ceph-mon[32421]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:51.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:51 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-06-06T03:20:51.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:51 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:20:52.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:52 smithi079 ceph-mon[35478]: Deploying daemon osd.10 on smithi079 2024-06-06T03:20:52.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:52 smithi122 ceph-mon[35759]: Deploying daemon osd.10 on smithi079 2024-06-06T03:20:52.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:52 smithi050 ceph-mon[32421]: Deploying daemon osd.10 on smithi079 2024-06-06T03:20:53.359 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:53 smithi079 ceph-mon[35478]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:53.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:53 smithi122 ceph-mon[35759]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:53.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:53 smithi050 ceph-mon[32421]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:55.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:55 smithi122 ceph-mon[35759]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:55.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:55 smithi050 ceph-mon[32421]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:55.559 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:55 smithi079 ceph-mon[35478]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:57.226 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:57 smithi079 ceph-mon[35478]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:57.226 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:57 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:57.226 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:57 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:57.227 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:57 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:20:57.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:57 smithi122 ceph-mon[35759]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:57.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:57 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:57.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:57 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:57.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:57 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:20:57.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:57 smithi050 ceph-mon[32421]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:57.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:57 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:57.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:57 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:20:57.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:57 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:20:59.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:20:59 smithi079 ceph-mon[35478]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:59.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:20:59 smithi122 ceph-mon[35759]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:20:59.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:20:59 smithi050 ceph-mon[32421]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:21:00.784 INFO:teuthology.orchestra.run.smithi079.stdout:Created osd(s) 10 on host 'smithi079' 2024-06-06T03:21:00.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:21:00.783+0000 7f69917fa700 1 -- 172.21.15.79:0/499791183 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f69940628d0 con 0x7f697c0a2c20 2024-06-06T03:21:00.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:21:00.787+0000 7f699a887700 1 -- 172.21.15.79:0/499791183 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f697c0a2c20 msgr2=0x7f697c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:00.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:21:00.787+0000 7f699a887700 1 --2- 172.21.15.79:0/499791183 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f697c0a2c20 0x7f697c0a50e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f698400b5c0 tx=0x7f69840037c0 comp rx=0 tx=0).stop 2024-06-06T03:21:00.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:21:00.787+0000 7f699a887700 1 -- 172.21.15.79:0/499791183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6994103af0 msgr2=0x7f6994101d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:00.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:21:00.787+0000 7f699a887700 1 --2- 172.21.15.79:0/499791183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6994103af0 0x7f6994101d80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f698c007ee0 tx=0x7f698c00d3b0 comp rx=0 tx=0).stop 2024-06-06T03:21:00.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:21:00.787+0000 7f699a887700 1 -- 172.21.15.79:0/499791183 shutdown_connections 2024-06-06T03:21:00.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:21:00.787+0000 7f699a887700 1 --2- 172.21.15.79:0/499791183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6994103af0 0x7f6994101d80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:00.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:21:00.787+0000 7f699a887700 1 --2- 172.21.15.79:0/499791183 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6994100570 0x7f69941031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:00.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:21:00.787+0000 7f699a887700 1 --2- 172.21.15.79:0/499791183 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f697c0a2c20 0x7f697c0a50e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:00.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:21:00.787+0000 7f699a887700 1 --2- 172.21.15.79:0/499791183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6994100f10 0x7f6994101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:00.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:21:00.787+0000 7f699a887700 1 -- 172.21.15.79:0/499791183 >> 172.21.15.79:0/499791183 conn(0x7f69940fc130 msgr2=0x7f6994106b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:21:00.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:21:00.787+0000 7f699a887700 1 -- 172.21.15.79:0/499791183 shutdown_connections 2024-06-06T03:21:00.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-06-06T03:21:00.787+0000 7f699a887700 1 -- 172.21.15.79:0/499791183 wait complete. 2024-06-06T03:21:01.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:00 smithi079 ceph-mon[35478]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:21:01.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:00 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:01.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:00 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:01.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:00 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:01.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:00 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:21:01.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:00 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:01.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:00 smithi079 ceph-mon[35478]: from='osd.10 [v2:172.21.15.79:6824/2740366543,v1:172.21.15.79:6825/2740366543]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-06T03:21:01.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:00 smithi079 ceph-mon[35478]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-06T03:21:01.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:00 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:01.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:00 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:01.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:00 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:21:01.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:00 smithi122 ceph-mon[35759]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:21:01.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:00 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:01.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:00 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:01.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:00 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:01.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:00 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:21:01.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:00 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:01.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:00 smithi122 ceph-mon[35759]: from='osd.10 [v2:172.21.15.79:6824/2740366543,v1:172.21.15.79:6825/2740366543]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-06T03:21:01.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:00 smithi122 ceph-mon[35759]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-06T03:21:01.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:00 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:01.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:00 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:01.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:00 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:21:01.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:00 smithi050 ceph-mon[32421]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:21:01.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:00 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:01.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:00 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:01.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:00 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:01.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:00 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:21:01.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:00 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:01.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:00 smithi050 ceph-mon[32421]: from='osd.10 [v2:172.21.15.79:6824/2740366543,v1:172.21.15.79:6825/2740366543]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-06T03:21:01.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:00 smithi050 ceph-mon[32421]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-06T03:21:01.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:00 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:01.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:00 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:01.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:00 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:21:01.538 DEBUG:teuthology.orchestra.run.smithi079:osd.10> sudo journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.10.service 2024-06-06T03:21:01.540 INFO:tasks.cephadm:Deploying osd.11 on smithi122 with /dev/vg_nvme/lv_1... 2024-06-06T03:21:01.541 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-06-06T03:21:01.785 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T03:21:02.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:02 smithi122 ceph-mon[35759]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-06-06T03:21:02.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:02 smithi122 ceph-mon[35759]: osdmap e70: 11 total, 10 up, 11 in 2024-06-06T03:21:02.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:02 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T03:21:02.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:02 smithi122 ceph-mon[35759]: from='osd.10 [v2:172.21.15.79:6824/2740366543,v1:172.21.15.79:6825/2740366543]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-06-06T03:21:02.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:02 smithi122 ceph-mon[35759]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-06-06T03:21:02.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:02 smithi050 ceph-mon[32421]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-06-06T03:21:02.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:02 smithi050 ceph-mon[32421]: osdmap e70: 11 total, 10 up, 11 in 2024-06-06T03:21:02.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:02 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T03:21:02.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:02 smithi050 ceph-mon[32421]: from='osd.10 [v2:172.21.15.79:6824/2740366543,v1:172.21.15.79:6825/2740366543]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-06-06T03:21:02.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:02 smithi050 ceph-mon[32421]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-06-06T03:21:02.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:02 smithi079 ceph-mon[35478]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-06-06T03:21:02.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:02 smithi079 ceph-mon[35478]: osdmap e70: 11 total, 10 up, 11 in 2024-06-06T03:21:02.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:02 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T03:21:02.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:02 smithi079 ceph-mon[35478]: from='osd.10 [v2:172.21.15.79:6824/2740366543,v1:172.21.15.79:6825/2740366543]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-06-06T03:21:02.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:02 smithi079 ceph-mon[35478]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-06-06T03:21:02.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:21:02 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:21:02.128+0000 7f167512d700 -1 osd.10 0 waiting for initial osdmap 2024-06-06T03:21:02.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:21:02 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:21:02.138+0000 7f1670f20700 -1 osd.10 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T03:21:03.201 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:03 smithi122 ceph-mon[35759]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:21:03.201 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:03 smithi122 ceph-mon[35759]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-06-06T03:21:03.201 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:03 smithi122 ceph-mon[35759]: osdmap e71: 11 total, 10 up, 11 in 2024-06-06T03:21:03.201 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:03 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T03:21:03.201 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:03 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T03:21:03.282 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:03 smithi079 ceph-mon[35478]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:21:03.282 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:03 smithi079 ceph-mon[35478]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-06-06T03:21:03.282 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:03 smithi079 ceph-mon[35478]: osdmap e71: 11 total, 10 up, 11 in 2024-06-06T03:21:03.283 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:03 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T03:21:03.283 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:03 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T03:21:03.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:03 smithi050 ceph-mon[32421]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:21:03.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:03 smithi050 ceph-mon[32421]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-06-06T03:21:03.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:03 smithi050 ceph-mon[32421]: osdmap e71: 11 total, 10 up, 11 in 2024-06-06T03:21:03.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:03 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T03:21:03.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:03 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T03:21:03.898 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-06-06T03:21:03.898 INFO:teuthology.orchestra.run.smithi122.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-06-06T03:21:03.898 INFO:teuthology.orchestra.run.smithi122.stderr: stderr: 10+0 records in 2024-06-06T03:21:03.899 INFO:teuthology.orchestra.run.smithi122.stderr:10+0 records out 2024-06-06T03:21:03.899 INFO:teuthology.orchestra.run.smithi122.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0131108 s, 800 MB/s 2024-06-06T03:21:03.899 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping successful for: 2024-06-06T03:21:04.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:04 smithi122 ceph-mon[35759]: purged_snaps scrub starts 2024-06-06T03:21:04.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:04 smithi122 ceph-mon[35759]: purged_snaps scrub ok 2024-06-06T03:21:04.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:04 smithi122 ceph-mon[35759]: osd.10 [v2:172.21.15.79:6824/2740366543,v1:172.21.15.79:6825/2740366543] boot 2024-06-06T03:21:04.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:04 smithi122 ceph-mon[35759]: osdmap e72: 11 total, 11 up, 11 in 2024-06-06T03:21:04.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:04 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T03:21:04.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:04 smithi079 ceph-mon[35478]: purged_snaps scrub starts 2024-06-06T03:21:04.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:04 smithi079 ceph-mon[35478]: purged_snaps scrub ok 2024-06-06T03:21:04.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:04 smithi079 ceph-mon[35478]: osd.10 [v2:172.21.15.79:6824/2740366543,v1:172.21.15.79:6825/2740366543] boot 2024-06-06T03:21:04.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:04 smithi079 ceph-mon[35478]: osdmap e72: 11 total, 11 up, 11 in 2024-06-06T03:21:04.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:04 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T03:21:04.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:04 smithi050 ceph-mon[32421]: purged_snaps scrub starts 2024-06-06T03:21:04.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:04 smithi050 ceph-mon[32421]: purged_snaps scrub ok 2024-06-06T03:21:04.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:04 smithi050 ceph-mon[32421]: osd.10 [v2:172.21.15.79:6824/2740366543,v1:172.21.15.79:6825/2740366543] boot 2024-06-06T03:21:04.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:04 smithi050 ceph-mon[32421]: osdmap e72: 11 total, 11 up, 11 in 2024-06-06T03:21:04.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:04 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T03:21:04.658 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi122:vg_nvme/lv_1 2024-06-06T03:21:04.899 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T03:21:05.272 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:05 smithi122 ceph-mon[35759]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:21:05.272 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:05 smithi122 ceph-mon[35759]: osdmap e73: 11 total, 11 up, 11 in 2024-06-06T03:21:05.272 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:05 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:05.272 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:05 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:05.272 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:05 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:21:05.273 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:05 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:21:05.273 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:05 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:21:05.273 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:05 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:21:05.273 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:05 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:05.273 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:05 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:05.273 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:05 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:21:05.273 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:05 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:05.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:05 smithi050 ceph-mon[32421]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:21:05.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:05 smithi050 ceph-mon[32421]: osdmap e73: 11 total, 11 up, 11 in 2024-06-06T03:21:05.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:05 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:05.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:05 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:05.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:05 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:21:05.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:05 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:21:05.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:05 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:21:05.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:05 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:21:05.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:05 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:05.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:05 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:05.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:05 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:21:05.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:05 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:05.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:05 smithi079 ceph-mon[35478]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-06T03:21:05.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:05 smithi079 ceph-mon[35478]: osdmap e73: 11 total, 11 up, 11 in 2024-06-06T03:21:05.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:05 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:05.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:05 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:05.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:05 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:21:05.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:05 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:21:05.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:05 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:21:05.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:05 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:21:05.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:05 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:05.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:05 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:05.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:05 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:21:05.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:05 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:06.326 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:06 smithi122 ceph-mon[35759]: Detected new or changed devices on smithi079 2024-06-06T03:21:06.326 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:06 smithi122 ceph-mon[35759]: Adjusting osd_memory_target on smithi079 to 4272M 2024-06-06T03:21:06.326 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:06 smithi122 ceph-mon[35759]: osdmap e74: 11 total, 11 up, 11 in 2024-06-06T03:21:06.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:06 smithi050 ceph-mon[32421]: Detected new or changed devices on smithi079 2024-06-06T03:21:06.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:06 smithi050 ceph-mon[32421]: Adjusting osd_memory_target on smithi079 to 4272M 2024-06-06T03:21:06.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:06 smithi050 ceph-mon[32421]: osdmap e74: 11 total, 11 up, 11 in 2024-06-06T03:21:06.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.547+0000 7f531d97e700 1 -- 172.21.15.122:0/597743849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53181025f0 msgr2=0x7f5318102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:06.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.547+0000 7f531d97e700 1 --2- 172.21.15.122:0/597743849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53181025f0 0x7f5318102a50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5308009990 tx=0x7f5308009ca0 comp rx=0 tx=0).stop 2024-06-06T03:21:06.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.547+0000 7f531d97e700 1 -- 172.21.15.122:0/597743849 shutdown_connections 2024-06-06T03:21:06.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.547+0000 7f531d97e700 1 --2- 172.21.15.122:0/597743849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5318102f90 0x7f5318109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:06.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.547+0000 7f531d97e700 1 --2- 172.21.15.122:0/597743849 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53181013f0 0x7f5318101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:06.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.547+0000 7f531d97e700 1 --2- 172.21.15.122:0/597743849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53181025f0 0x7f5318102a50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:06.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.547+0000 7f531d97e700 1 -- 172.21.15.122:0/597743849 >> 172.21.15.122:0/597743849 conn(0x7f53180fc990 msgr2=0x7f53180fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:21:06.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.547+0000 7f531d97e700 1 -- 172.21.15.122:0/597743849 shutdown_connections 2024-06-06T03:21:06.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.547+0000 7f531d97e700 1 -- 172.21.15.122:0/597743849 wait complete. 2024-06-06T03:21:06.548 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.548+0000 7f531d97e700 1 Processor -- start 2024-06-06T03:21:06.549 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.548+0000 7f531d97e700 1 -- start start 2024-06-06T03:21:06.549 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.548+0000 7f531d97e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53181013f0 0x7f531806b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:06.549 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.548+0000 7f531d97e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53181025f0 0x7f531819d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:06.549 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.548+0000 7f531d97e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5318102f90 0x7f531819fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:06.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.548+0000 7f531d97e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f531810cf80 con 0x7f5318102f90 2024-06-06T03:21:06.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.548+0000 7f531d97e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f531810ce00 con 0x7f53181013f0 2024-06-06T03:21:06.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.548+0000 7f531d97e700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f531810d100 con 0x7f53181025f0 2024-06-06T03:21:06.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.548+0000 7f53167fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53181025f0 0x7f531819d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:06.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.548+0000 7f53167fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53181025f0 0x7f531819d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45700/0 (socket says 172.21.15.122:45700) 2024-06-06T03:21:06.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.548+0000 7f53167fc700 1 -- 172.21.15.122:0/696873555 learned_addr learned my addr 172.21.15.122:0/696873555 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-06-06T03:21:06.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.548+0000 7f53177fe700 1 --2- 172.21.15.122:0/696873555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5318102f90 0x7f531819fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:06.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.548+0000 7f5316ffd700 1 --2- 172.21.15.122:0/696873555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53181013f0 0x7f531806b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:06.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.548+0000 7f53167fc700 1 -- 172.21.15.122:0/696873555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53181013f0 msgr2=0x7f531806b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:06.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.548+0000 7f53167fc700 1 --2- 172.21.15.122:0/696873555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53181013f0 0x7f531806b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:06.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.548+0000 7f53167fc700 1 -- 172.21.15.122:0/696873555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5318102f90 msgr2=0x7f531819fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:06.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.548+0000 7f53167fc700 1 --2- 172.21.15.122:0/696873555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5318102f90 0x7f531819fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:06.551 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.549+0000 7f53167fc700 1 -- 172.21.15.122:0/696873555 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53181a03b0 con 0x7f53181025f0 2024-06-06T03:21:06.551 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.549+0000 7f53167fc700 1 --2- 172.21.15.122:0/696873555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53181025f0 0x7f531819d4f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5308005910 tx=0x7f5308009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:21:06.551 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.549+0000 7f531c97c700 1 -- 172.21.15.122:0/696873555 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5308027070 con 0x7f53181025f0 2024-06-06T03:21:06.551 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.549+0000 7f531d97e700 1 -- 172.21.15.122:0/696873555 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53181a0640 con 0x7f53181025f0 2024-06-06T03:21:06.551 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.549+0000 7f531c97c700 1 -- 172.21.15.122:0/696873555 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5308022470 con 0x7f53181025f0 2024-06-06T03:21:06.551 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.549+0000 7f531c97c700 1 -- 172.21.15.122:0/696873555 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530800f6c0 con 0x7f53181025f0 2024-06-06T03:21:06.551 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.549+0000 7f531d97e700 1 -- 172.21.15.122:0/696873555 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53181a0b10 con 0x7f53181025f0 2024-06-06T03:21:06.551 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.550+0000 7f531d97e700 1 -- 172.21.15.122:0/696873555 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5318069180 con 0x7f53181025f0 2024-06-06T03:21:06.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.551+0000 7f531c97c700 1 -- 172.21.15.122:0/696873555 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f530802a070 con 0x7f53181025f0 2024-06-06T03:21:06.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.551+0000 7f531c97c700 1 --2- 172.21.15.122:0/696873555 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f53040a2c20 0x7f53040a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:06.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.552+0000 7f531c97c700 1 -- 172.21.15.122:0/696873555 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6694+0+0 (secure 0 0 0) 0x7f53080cfb80 con 0x7f53181025f0 2024-06-06T03:21:06.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.552+0000 7f5316ffd700 1 --2- 172.21.15.122:0/696873555 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f53040a2c20 0x7f53040a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:06.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.552+0000 7f5316ffd700 1 --2- 172.21.15.122:0/696873555 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f53040a2c20 0x7f53040a50e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5300006fd0 tx=0x7f5300008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:21:06.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.555+0000 7f531c97c700 1 -- 172.21.15.122:0/696873555 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5308013070 con 0x7f53181025f0 2024-06-06T03:21:06.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:06 smithi079 ceph-mon[35478]: Detected new or changed devices on smithi079 2024-06-06T03:21:06.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:06 smithi079 ceph-mon[35478]: Adjusting osd_memory_target on smithi079 to 4272M 2024-06-06T03:21:06.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:06 smithi079 ceph-mon[35478]: osdmap e74: 11 total, 11 up, 11 in 2024-06-06T03:21:06.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:06.761+0000 7f531d97e700 1 -- 172.21.15.122:0/696873555 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f53180628d0 con 0x7f53040a2c20 2024-06-06T03:21:07.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:07 smithi122 ceph-mon[35759]: pgmap v240: 1 pgs: 1 remapped+peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-06-06T03:21:07.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:07 smithi122 ceph-mon[35759]: osdmap e75: 11 total, 11 up, 11 in 2024-06-06T03:21:07.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:07 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:21:07.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:07 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:21:07.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:07 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:07.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:07 smithi050 ceph-mon[32421]: pgmap v240: 1 pgs: 1 remapped+peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-06-06T03:21:07.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:07 smithi050 ceph-mon[32421]: osdmap e75: 11 total, 11 up, 11 in 2024-06-06T03:21:07.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:07 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:21:07.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:07 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:21:07.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:07 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:07.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:07 smithi079 ceph-mon[35478]: pgmap v240: 1 pgs: 1 remapped+peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-06-06T03:21:07.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:07 smithi079 ceph-mon[35478]: osdmap e75: 11 total, 11 up, 11 in 2024-06-06T03:21:07.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:07 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T03:21:07.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:07 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T03:21:07.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:07 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:08.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:08 smithi079 ceph-mon[35478]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:21:08.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:08 smithi079 ceph-mon[35478]: osdmap e76: 11 total, 11 up, 11 in 2024-06-06T03:21:08.412 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:08 smithi122 ceph-mon[35759]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:21:08.412 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:08 smithi122 ceph-mon[35759]: osdmap e76: 11 total, 11 up, 11 in 2024-06-06T03:21:08.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:08 smithi050 ceph-mon[32421]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:21:08.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:08 smithi050 ceph-mon[32421]: osdmap e76: 11 total, 11 up, 11 in 2024-06-06T03:21:09.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:09 smithi122 ceph-mon[35759]: pgmap v243: 1 pgs: 1 remapped+peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-06-06T03:21:09.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:09 smithi050 ceph-mon[32421]: pgmap v243: 1 pgs: 1 remapped+peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-06-06T03:21:09.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:09 smithi079 ceph-mon[35478]: pgmap v243: 1 pgs: 1 remapped+peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-06-06T03:21:10.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:10 smithi122 ceph-mon[35759]: from='client.? 172.21.15.122:0/3160498579' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "35bcde30-49e4-49b9-a348-98d21a0d3cc4"}]: dispatch 2024-06-06T03:21:10.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:10 smithi122 ceph-mon[35759]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "35bcde30-49e4-49b9-a348-98d21a0d3cc4"}]: dispatch 2024-06-06T03:21:10.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:10 smithi122 ceph-mon[35759]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "35bcde30-49e4-49b9-a348-98d21a0d3cc4"}]': finished 2024-06-06T03:21:10.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:10 smithi122 ceph-mon[35759]: osdmap e77: 12 total, 11 up, 12 in 2024-06-06T03:21:10.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:10 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T03:21:10.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:10 smithi050 ceph-mon[32421]: from='client.? 172.21.15.122:0/3160498579' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "35bcde30-49e4-49b9-a348-98d21a0d3cc4"}]: dispatch 2024-06-06T03:21:10.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:10 smithi050 ceph-mon[32421]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "35bcde30-49e4-49b9-a348-98d21a0d3cc4"}]: dispatch 2024-06-06T03:21:10.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:10 smithi050 ceph-mon[32421]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "35bcde30-49e4-49b9-a348-98d21a0d3cc4"}]': finished 2024-06-06T03:21:10.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:10 smithi050 ceph-mon[32421]: osdmap e77: 12 total, 11 up, 12 in 2024-06-06T03:21:10.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:10 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T03:21:10.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:10 smithi079 ceph-mon[35478]: from='client.? 172.21.15.122:0/3160498579' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "35bcde30-49e4-49b9-a348-98d21a0d3cc4"}]: dispatch 2024-06-06T03:21:10.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:10 smithi079 ceph-mon[35478]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "35bcde30-49e4-49b9-a348-98d21a0d3cc4"}]: dispatch 2024-06-06T03:21:10.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:10 smithi079 ceph-mon[35478]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "35bcde30-49e4-49b9-a348-98d21a0d3cc4"}]': finished 2024-06-06T03:21:10.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:10 smithi079 ceph-mon[35478]: osdmap e77: 12 total, 11 up, 12 in 2024-06-06T03:21:10.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:10 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T03:21:11.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:11 smithi122 ceph-mon[35759]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-06-06T03:21:11.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:11 smithi122 ceph-mon[35759]: from='client.? 172.21.15.122:0/2588943485' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:21:11.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:11 smithi050 ceph-mon[32421]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-06-06T03:21:11.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:11 smithi050 ceph-mon[32421]: from='client.? 172.21.15.122:0/2588943485' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:21:11.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:11 smithi079 ceph-mon[35478]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-06-06T03:21:11.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:11 smithi079 ceph-mon[35478]: from='client.? 172.21.15.122:0/2588943485' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T03:21:13.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:13 smithi122 ceph-mon[35759]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-06T03:21:13.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:13 smithi050 ceph-mon[32421]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-06T03:21:13.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:13 smithi079 ceph-mon[35478]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-06T03:21:15.334 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:15 smithi122 ceph-mon[35759]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-06-06T03:21:15.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:15 smithi050 ceph-mon[32421]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-06-06T03:21:15.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:15 smithi079 ceph-mon[35478]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-06-06T03:21:16.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:16 smithi050 ceph-mon[32421]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-06-06T03:21:16.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:16 smithi079 ceph-mon[35478]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-06-06T03:21:16.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:16 smithi122 ceph-mon[35759]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-06-06T03:21:17.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:17 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-06-06T03:21:17.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:17 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:17.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:17 smithi050 ceph-mon[32421]: Deploying daemon osd.11 on smithi122 2024-06-06T03:21:17.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:17 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-06-06T03:21:17.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:17 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:17.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:17 smithi079 ceph-mon[35478]: Deploying daemon osd.11 on smithi122 2024-06-06T03:21:17.676 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:17 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-06-06T03:21:17.676 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:17 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:17.676 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:17 smithi122 ceph-mon[35759]: Deploying daemon osd.11 on smithi122 2024-06-06T03:21:18.340 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:18 smithi122 ceph-mon[35759]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T03:21:18.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:18 smithi050 ceph-mon[32421]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T03:21:18.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:18 smithi079 ceph-mon[35478]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T03:21:20.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:20 smithi122 ceph-mon[35759]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-06-06T03:21:20.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:20 smithi050 ceph-mon[32421]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-06-06T03:21:20.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:20 smithi079 ceph-mon[35478]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-06-06T03:21:22.648 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:22 smithi122 ceph-mon[35759]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-06-06T03:21:22.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:22 smithi050 ceph-mon[32421]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-06-06T03:21:22.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:22 smithi079 ceph-mon[35478]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-06-06T03:21:24.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:24 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:24.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:24 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:24.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:24 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:21:24.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:24 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:24.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:24 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:24.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:24 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:21:24.357 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:24 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:24.357 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:24 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:24.357 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:24 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:21:25.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:25 smithi122 ceph-mon[35759]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-06-06T03:21:25.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:25 smithi079 ceph-mon[35478]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-06-06T03:21:25.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:25 smithi050 ceph-mon[32421]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-06-06T03:21:26.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:26.892+0000 7f531c97c700 1 -- 172.21.15.122:0/696873555 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f53180628d0 con 0x7f53040a2c20 2024-06-06T03:21:26.892 INFO:teuthology.orchestra.run.smithi122.stdout:Created osd(s) 11 on host 'smithi122' 2024-06-06T03:21:26.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:26.894+0000 7f531d97e700 1 -- 172.21.15.122:0/696873555 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f53040a2c20 msgr2=0x7f53040a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:26.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:26.894+0000 7f531d97e700 1 --2- 172.21.15.122:0/696873555 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f53040a2c20 0x7f53040a50e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5300006fd0 tx=0x7f5300008040 comp rx=0 tx=0).stop 2024-06-06T03:21:26.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:26.894+0000 7f531d97e700 1 -- 172.21.15.122:0/696873555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53181025f0 msgr2=0x7f531819d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:26.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:26.894+0000 7f531d97e700 1 --2- 172.21.15.122:0/696873555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53181025f0 0x7f531819d4f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5308005910 tx=0x7f5308009f90 comp rx=0 tx=0).stop 2024-06-06T03:21:26.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:26.894+0000 7f531d97e700 1 -- 172.21.15.122:0/696873555 shutdown_connections 2024-06-06T03:21:26.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:26.894+0000 7f531d97e700 1 --2- 172.21.15.122:0/696873555 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f53040a2c20 0x7f53040a50e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:26.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:26.894+0000 7f531d97e700 1 --2- 172.21.15.122:0/696873555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5318102f90 0x7f531819fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:26.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:26.894+0000 7f531d97e700 1 --2- 172.21.15.122:0/696873555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53181013f0 0x7f531806b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:26.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:26.894+0000 7f531d97e700 1 --2- 172.21.15.122:0/696873555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53181025f0 0x7f531819d4f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:26.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:26.894+0000 7f531d97e700 1 -- 172.21.15.122:0/696873555 >> 172.21.15.122:0/696873555 conn(0x7f53180fc990 msgr2=0x7f5318105ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:21:26.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:26.895+0000 7f531d97e700 1 -- 172.21.15.122:0/696873555 shutdown_connections 2024-06-06T03:21:26.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:26.895+0000 7f531d97e700 1 -- 172.21.15.122:0/696873555 wait complete. 2024-06-06T03:21:27.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:27 smithi122 ceph-mon[35759]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-06-06T03:21:27.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:27 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:27.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:27 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:27.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:27 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:27.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:27 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:21:27.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:27 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:27.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:27 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:27.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:27 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:27.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:27 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:21:27.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:27 smithi122 ceph-mon[35759]: from='osd.11 [v2:172.21.15.122:6824/4160854238,v1:172.21.15.122:6825/4160854238]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-06T03:21:27.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:27 smithi122 ceph-mon[35759]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-06T03:21:27.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:27 smithi079 ceph-mon[35478]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-06-06T03:21:27.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:27 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:27.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:27 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:27.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:27 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:27.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:27 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:21:27.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:27 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:27.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:27 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:27.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:27 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:27.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:27 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:21:27.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:27 smithi079 ceph-mon[35478]: from='osd.11 [v2:172.21.15.122:6824/4160854238,v1:172.21.15.122:6825/4160854238]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-06T03:21:27.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:27 smithi079 ceph-mon[35478]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-06T03:21:27.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:27 smithi050 ceph-mon[32421]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-06-06T03:21:27.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:27 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:27.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:27 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:27.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:27 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:27.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:27 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:21:27.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:27 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:27.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:27 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:27.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:27 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:27.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:27 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:21:27.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:27 smithi050 ceph-mon[32421]: from='osd.11 [v2:172.21.15.122:6824/4160854238,v1:172.21.15.122:6825/4160854238]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-06T03:21:27.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:27 smithi050 ceph-mon[32421]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-06T03:21:27.557 DEBUG:teuthology.orchestra.run.smithi122:osd.11> sudo journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.11.service 2024-06-06T03:21:27.559 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-06-06T03:21:27.560 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd stat -f json 2024-06-06T03:21:27.819 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:21:28.965 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:28 smithi122 ceph-mon[35759]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-06-06T03:21:28.965 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:28 smithi122 ceph-mon[35759]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-06-06T03:21:28.965 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:28 smithi122 ceph-mon[35759]: osdmap e78: 12 total, 11 up, 12 in 2024-06-06T03:21:28.965 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:28 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T03:21:28.965 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:28 smithi122 ceph-mon[35759]: from='osd.11 [v2:172.21.15.122:6824/4160854238,v1:172.21.15.122:6825/4160854238]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-06-06T03:21:28.965 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:28 smithi122 ceph-mon[35759]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-06-06T03:21:29.184 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:28 smithi050 ceph-mon[32421]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-06-06T03:21:29.184 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:28 smithi050 ceph-mon[32421]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-06-06T03:21:29.184 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:28 smithi050 ceph-mon[32421]: osdmap e78: 12 total, 11 up, 12 in 2024-06-06T03:21:29.184 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:28 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T03:21:29.184 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:28 smithi050 ceph-mon[32421]: from='osd.11 [v2:172.21.15.122:6824/4160854238,v1:172.21.15.122:6825/4160854238]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-06-06T03:21:29.184 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:28 smithi050 ceph-mon[32421]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-06-06T03:21:29.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:28 smithi079 ceph-mon[35478]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-06-06T03:21:29.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:28 smithi079 ceph-mon[35478]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-06-06T03:21:29.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:28 smithi079 ceph-mon[35478]: osdmap e78: 12 total, 11 up, 12 in 2024-06-06T03:21:29.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:28 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T03:21:29.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:28 smithi079 ceph-mon[35478]: from='osd.11 [v2:172.21.15.122:6824/4160854238,v1:172.21.15.122:6825/4160854238]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-06-06T03:21:29.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:28 smithi079 ceph-mon[35478]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-06-06T03:21:29.681 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:21:29 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:21:29.285+0000 7f095c80c700 -1 osd.11 0 waiting for initial osdmap 2024-06-06T03:21:29.681 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:21:29 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:21:29.300+0000 7f09545f7700 -1 osd.11 79 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T03:21:29.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.754+0000 7f20ef352700 1 -- 172.21.15.50:0/1218276138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20e8105930 msgr2=0x7f20e8107d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:29.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.754+0000 7f20ef352700 1 --2- 172.21.15.50:0/1218276138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20e8105930 0x7f20e8107d20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f20d8009990 tx=0x7f20d8009ca0 comp rx=0 tx=0).stop 2024-06-06T03:21:29.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.754+0000 7f20ef352700 1 -- 172.21.15.50:0/1218276138 shutdown_connections 2024-06-06T03:21:29.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.754+0000 7f20ef352700 1 --2- 172.21.15.50:0/1218276138 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20e8108260 0x7f20e810a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:29.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.754+0000 7f20ef352700 1 --2- 172.21.15.50:0/1218276138 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20e8103000 0x7f20e81053f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:29.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.754+0000 7f20ef352700 1 --2- 172.21.15.50:0/1218276138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20e8105930 0x7f20e8107d20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:29.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.754+0000 7f20ef352700 1 -- 172.21.15.50:0/1218276138 >> 172.21.15.50:0/1218276138 conn(0x7f20e80fc9b0 msgr2=0x7f20e80fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:21:29.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.754+0000 7f20ef352700 1 -- 172.21.15.50:0/1218276138 shutdown_connections 2024-06-06T03:21:29.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.754+0000 7f20ef352700 1 -- 172.21.15.50:0/1218276138 wait complete. 2024-06-06T03:21:29.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.754+0000 7f20ef352700 1 Processor -- start 2024-06-06T03:21:29.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.755+0000 7f20ef352700 1 -- start start 2024-06-06T03:21:29.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.755+0000 7f20ef352700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20e8103000 0x7f20e8198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:29.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.755+0000 7f20ef352700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20e8105930 0x7f20e8198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:29.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.755+0000 7f20ef352700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20e8108260 0x7f20e819fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:29.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.755+0000 7f20ef352700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f20e810dfd0 con 0x7f20e8108260 2024-06-06T03:21:29.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.755+0000 7f20ef352700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f20e810de50 con 0x7f20e8105930 2024-06-06T03:21:29.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.755+0000 7f20ef352700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f20e810e150 con 0x7f20e8103000 2024-06-06T03:21:29.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.755+0000 7f20ed0ee700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20e8103000 0x7f20e8198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:29.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.755+0000 7f20ed8ef700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20e8108260 0x7f20e819fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:29.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.755+0000 7f20ed0ee700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20e8103000 0x7f20e8198630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:58914/0 (socket says 172.21.15.50:58914) 2024-06-06T03:21:29.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.755+0000 7f20ed0ee700 1 -- 172.21.15.50:0/2619838879 learned_addr learned my addr 172.21.15.50:0/2619838879 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:21:29.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.755+0000 7f20ec8ed700 1 --2- 172.21.15.50:0/2619838879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20e8105930 0x7f20e8198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:29.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.755+0000 7f20ed8ef700 1 -- 172.21.15.50:0/2619838879 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20e8103000 msgr2=0x7f20e8198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:29.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.755+0000 7f20ed8ef700 1 --2- 172.21.15.50:0/2619838879 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20e8103000 0x7f20e8198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:29.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.755+0000 7f20ed8ef700 1 -- 172.21.15.50:0/2619838879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20e8105930 msgr2=0x7f20e8198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:29.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.755+0000 7f20ed8ef700 1 --2- 172.21.15.50:0/2619838879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20e8105930 0x7f20e8198b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:29.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.755+0000 7f20ed8ef700 1 -- 172.21.15.50:0/2619838879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e81a0290 con 0x7f20e8108260 2024-06-06T03:21:29.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.755+0000 7f20ec8ed700 1 --2- 172.21.15.50:0/2619838879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20e8105930 0x7f20e8198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:21:29.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.755+0000 7f20ed8ef700 1 --2- 172.21.15.50:0/2619838879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20e8108260 0x7f20e819fbf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f20e0007f10 tx=0x7f20e000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:21:29.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.756+0000 7f20de7fc700 1 -- 172.21.15.50:0/2619838879 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e0004db0 con 0x7f20e8108260 2024-06-06T03:21:29.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.756+0000 7f20ef352700 1 -- 172.21.15.50:0/2619838879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20e81a0580 con 0x7f20e8108260 2024-06-06T03:21:29.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.756+0000 7f20de7fc700 1 -- 172.21.15.50:0/2619838879 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f20e0009e20 con 0x7f20e8108260 2024-06-06T03:21:29.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.756+0000 7f20de7fc700 1 -- 172.21.15.50:0/2619838879 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e0015400 con 0x7f20e8108260 2024-06-06T03:21:29.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.756+0000 7f20ef352700 1 -- 172.21.15.50:0/2619838879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20e81a0ac0 con 0x7f20e8108260 2024-06-06T03:21:29.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.757+0000 7f20ef352700 1 -- 172.21.15.50:0/2619838879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20e8069180 con 0x7f20e8108260 2024-06-06T03:21:29.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.758+0000 7f20de7fc700 1 -- 172.21.15.50:0/2619838879 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f20e0005000 con 0x7f20e8108260 2024-06-06T03:21:29.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.758+0000 7f20de7fc700 1 --2- 172.21.15.50:0/2619838879 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f20d40a2c20 0x7f20d40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:29.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.759+0000 7f20ed0ee700 1 --2- 172.21.15.50:0/2619838879 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f20d40a2c20 0x7f20d40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:29.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.759+0000 7f20de7fc700 1 -- 172.21.15.50:0/2619838879 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6847+0+0 (secure 0 0 0) 0x7f20e00cec90 con 0x7f20e8108260 2024-06-06T03:21:29.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.759+0000 7f20ed0ee700 1 --2- 172.21.15.50:0/2619838879 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f20d40a2c20 0x7f20d40a50e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f20e4009d60 tx=0x7f20e4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:21:29.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.762+0000 7f20de7fc700 1 -- 172.21.15.50:0/2619838879 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f20e0010070 con 0x7f20e8108260 2024-06-06T03:21:29.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.971+0000 7f20ef352700 1 -- 172.21.15.50:0/2619838879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f20e802dd40 con 0x7f20e8108260 2024-06-06T03:21:29.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.972+0000 7f20de7fc700 1 -- 172.21.15.50:0/2619838879 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v79) ==== 74+0+133 (secure 0 0 0) 0x7f20e802dd40 con 0x7f20e8108260 2024-06-06T03:21:29.972 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:21:29.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.974+0000 7f20ef352700 1 -- 172.21.15.50:0/2619838879 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f20d40a2c20 msgr2=0x7f20d40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:29.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.974+0000 7f20ef352700 1 --2- 172.21.15.50:0/2619838879 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f20d40a2c20 0x7f20d40a50e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f20e4009d60 tx=0x7f20e4009260 comp rx=0 tx=0).stop 2024-06-06T03:21:29.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.974+0000 7f20ef352700 1 -- 172.21.15.50:0/2619838879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20e8108260 msgr2=0x7f20e819fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:29.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.974+0000 7f20ef352700 1 --2- 172.21.15.50:0/2619838879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20e8108260 0x7f20e819fbf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f20e0007f10 tx=0x7f20e000d3b0 comp rx=0 tx=0).stop 2024-06-06T03:21:29.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.974+0000 7f20ef352700 1 -- 172.21.15.50:0/2619838879 shutdown_connections 2024-06-06T03:21:29.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.974+0000 7f20ef352700 1 --2- 172.21.15.50:0/2619838879 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f20d40a2c20 0x7f20d40a50e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:29.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.974+0000 7f20ef352700 1 --2- 172.21.15.50:0/2619838879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20e8108260 0x7f20e819fbf0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:29.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.974+0000 7f20ef352700 1 --2- 172.21.15.50:0/2619838879 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20e8103000 0x7f20e8198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:29.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.974+0000 7f20ef352700 1 --2- 172.21.15.50:0/2619838879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20e8105930 0x7f20e8198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:29.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.974+0000 7f20ef352700 1 -- 172.21.15.50:0/2619838879 >> 172.21.15.50:0/2619838879 conn(0x7f20e80fc9b0 msgr2=0x7f20e8103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:21:29.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.974+0000 7f20ef352700 1 -- 172.21.15.50:0/2619838879 shutdown_connections 2024-06-06T03:21:29.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:29.974+0000 7f20ef352700 1 -- 172.21.15.50:0/2619838879 wait complete. 2024-06-06T03:21:30.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:29 smithi122 ceph-mon[35759]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-06-06T03:21:30.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:29 smithi122 ceph-mon[35759]: osdmap e79: 12 total, 11 up, 12 in 2024-06-06T03:21:30.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:29 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T03:21:30.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:29 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T03:21:30.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:29 smithi122 ceph-mon[35759]: from='osd.11 ' entity='osd.11' 2024-06-06T03:21:30.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:29 smithi050 ceph-mon[32421]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-06-06T03:21:30.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:29 smithi050 ceph-mon[32421]: osdmap e79: 12 total, 11 up, 12 in 2024-06-06T03:21:30.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:29 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T03:21:30.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:29 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T03:21:30.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:29 smithi050 ceph-mon[32421]: from='osd.11 ' entity='osd.11' 2024-06-06T03:21:30.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:29 smithi079 ceph-mon[35478]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-06-06T03:21:30.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:29 smithi079 ceph-mon[35478]: osdmap e79: 12 total, 11 up, 12 in 2024-06-06T03:21:30.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:29 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T03:21:30.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:29 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T03:21:30.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:29 smithi079 ceph-mon[35478]: from='osd.11 ' entity='osd.11' 2024-06-06T03:21:30.663 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":79,"num_osds":12,"num_up_osds":11,"osd_up_since":1717644063,"num_in_osds":12,"osd_in_since":1717644069,"num_remapped_pgs":0} 2024-06-06T03:21:30.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:30 smithi122 ceph-mon[35759]: purged_snaps scrub starts 2024-06-06T03:21:30.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:30 smithi122 ceph-mon[35759]: purged_snaps scrub ok 2024-06-06T03:21:30.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:30 smithi122 ceph-mon[35759]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-06-06T03:21:30.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:30 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T03:21:30.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:30 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/2619838879' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-06T03:21:30.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:30 smithi122 ceph-mon[35759]: osd.11 [v2:172.21.15.122:6824/4160854238,v1:172.21.15.122:6825/4160854238] boot 2024-06-06T03:21:30.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:30 smithi122 ceph-mon[35759]: osdmap e80: 12 total, 12 up, 12 in 2024-06-06T03:21:30.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:30 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T03:21:30.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:30 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:30.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:30 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:30.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:30 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:21:30.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:30 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:21:30.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:30 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:21:30.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:30 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:21:30.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:30 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:30.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:30 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:30.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:30 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:21:30.933 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:30 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:31.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:30 smithi050 ceph-mon[32421]: purged_snaps scrub starts 2024-06-06T03:21:31.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:30 smithi050 ceph-mon[32421]: purged_snaps scrub ok 2024-06-06T03:21:31.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:30 smithi050 ceph-mon[32421]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-06-06T03:21:31.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:30 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T03:21:31.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:30 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/2619838879' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-06T03:21:31.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:30 smithi050 ceph-mon[32421]: osd.11 [v2:172.21.15.122:6824/4160854238,v1:172.21.15.122:6825/4160854238] boot 2024-06-06T03:21:31.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:30 smithi050 ceph-mon[32421]: osdmap e80: 12 total, 12 up, 12 in 2024-06-06T03:21:31.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:30 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T03:21:31.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:30 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:31.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:30 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:31.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:30 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:21:31.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:30 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:21:31.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:30 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:21:31.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:30 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:21:31.003 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:30 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:31.003 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:30 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:31.003 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:30 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:21:31.003 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:30 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:31.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:30 smithi079 ceph-mon[35478]: purged_snaps scrub starts 2024-06-06T03:21:31.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:30 smithi079 ceph-mon[35478]: purged_snaps scrub ok 2024-06-06T03:21:31.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:30 smithi079 ceph-mon[35478]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-06-06T03:21:31.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:30 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T03:21:31.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:30 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/2619838879' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-06T03:21:31.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:30 smithi079 ceph-mon[35478]: osd.11 [v2:172.21.15.122:6824/4160854238,v1:172.21.15.122:6825/4160854238] boot 2024-06-06T03:21:31.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:30 smithi079 ceph-mon[35478]: osdmap e80: 12 total, 12 up, 12 in 2024-06-06T03:21:31.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:30 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T03:21:31.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:30 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:31.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:30 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:31.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:30 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:21:31.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:30 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:21:31.351 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:30 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:21:31.351 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:30 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:21:31.351 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:30 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:31.351 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:30 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:31.351 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:30 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:21:31.351 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:30 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:31.664 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd stat -f json 2024-06-06T03:21:31.926 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:21:32.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:31 smithi050 ceph-mon[32421]: Detected new or changed devices on smithi122 2024-06-06T03:21:32.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:31 smithi050 ceph-mon[32421]: Adjusting osd_memory_target on smithi122 to 4272M 2024-06-06T03:21:32.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:31 smithi122 ceph-mon[35759]: Detected new or changed devices on smithi122 2024-06-06T03:21:32.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:31 smithi122 ceph-mon[35759]: Adjusting osd_memory_target on smithi122 to 4272M 2024-06-06T03:21:32.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:31 smithi079 ceph-mon[35478]: Detected new or changed devices on smithi122 2024-06-06T03:21:32.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:31 smithi079 ceph-mon[35478]: Adjusting osd_memory_target on smithi122 to 4272M 2024-06-06T03:21:33.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:32 smithi050 ceph-mon[32421]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:33.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:32 smithi050 ceph-mon[32421]: osdmap e81: 12 total, 12 up, 12 in 2024-06-06T03:21:33.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:32 smithi122 ceph-mon[35759]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:33.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:32 smithi122 ceph-mon[35759]: osdmap e81: 12 total, 12 up, 12 in 2024-06-06T03:21:33.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:32 smithi079 ceph-mon[35478]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:33.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:32 smithi079 ceph-mon[35478]: osdmap e81: 12 total, 12 up, 12 in 2024-06-06T03:21:33.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.663+0000 7fca0e6a9700 1 -- 172.21.15.50:0/1861001886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca08104090 msgr2=0x7fca0810a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:33.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.663+0000 7fca0e6a9700 1 --2- 172.21.15.50:0/1861001886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca08104090 0x7fca0810a940 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fca0000b0d0 tx=0x7fca0000b3e0 comp rx=0 tx=0).stop 2024-06-06T03:21:33.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.663+0000 7fca0e6a9700 1 -- 172.21.15.50:0/1861001886 shutdown_connections 2024-06-06T03:21:33.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.663+0000 7fca0e6a9700 1 --2- 172.21.15.50:0/1861001886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca08104090 0x7fca0810a940 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:33.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.663+0000 7fca0e6a9700 1 --2- 172.21.15.50:0/1861001886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca081024f0 0x7fca08102910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:33.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.663+0000 7fca0e6a9700 1 --2- 172.21.15.50:0/1861001886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca081036f0 0x7fca08103b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:33.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.663+0000 7fca0e6a9700 1 -- 172.21.15.50:0/1861001886 >> 172.21.15.50:0/1861001886 conn(0x7fca080fda90 msgr2=0x7fca080ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:21:33.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.663+0000 7fca0e6a9700 1 -- 172.21.15.50:0/1861001886 shutdown_connections 2024-06-06T03:21:33.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.663+0000 7fca0e6a9700 1 -- 172.21.15.50:0/1861001886 wait complete. 2024-06-06T03:21:33.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.663+0000 7fca0e6a9700 1 Processor -- start 2024-06-06T03:21:33.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.664+0000 7fca0e6a9700 1 -- start start 2024-06-06T03:21:33.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.664+0000 7fca0e6a9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca081024f0 0x7fca0819a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:33.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.664+0000 7fca0e6a9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca081036f0 0x7fca0819acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:33.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.664+0000 7fca0e6a9700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca08104090 0x7fca081a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:33.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.664+0000 7fca0e6a9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fca0810df70 con 0x7fca081036f0 2024-06-06T03:21:33.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.664+0000 7fca0e6a9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fca0810ddf0 con 0x7fca081024f0 2024-06-06T03:21:33.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.664+0000 7fca0e6a9700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fca0810e0f0 con 0x7fca08104090 2024-06-06T03:21:33.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.664+0000 7fca077fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca081036f0 0x7fca0819acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:33.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.664+0000 7fca077fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca081036f0 0x7fca0819acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34350/0 (socket says 172.21.15.50:34350) 2024-06-06T03:21:33.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.664+0000 7fca077fe700 1 -- 172.21.15.50:0/4066659757 learned_addr learned my addr 172.21.15.50:0/4066659757 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:21:33.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.664+0000 7fca0cc46700 1 --2- 172.21.15.50:0/4066659757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca08104090 0x7fca081a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:33.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.664+0000 7fca07fff700 1 --2- 172.21.15.50:0/4066659757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca081024f0 0x7fca0819a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:33.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.664+0000 7fca077fe700 1 -- 172.21.15.50:0/4066659757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca08104090 msgr2=0x7fca081a1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:33.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.664+0000 7fca077fe700 1 --2- 172.21.15.50:0/4066659757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca08104090 0x7fca081a1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:33.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.664+0000 7fca077fe700 1 -- 172.21.15.50:0/4066659757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca081024f0 msgr2=0x7fca0819a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:33.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.664+0000 7fca077fe700 1 --2- 172.21.15.50:0/4066659757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca081024f0 0x7fca0819a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:33.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.664+0000 7fca077fe700 1 -- 172.21.15.50:0/4066659757 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca081a23f0 con 0x7fca081036f0 2024-06-06T03:21:33.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.664+0000 7fca07fff700 1 --2- 172.21.15.50:0/4066659757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca081024f0 0x7fca0819a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:21:33.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.665+0000 7fca077fe700 1 --2- 172.21.15.50:0/4066659757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca081036f0 0x7fca0819acd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00d980 tx=0x7fc9fc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:21:33.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.665+0000 7fca057fa700 1 -- 172.21.15.50:0/4066659757 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc016070 con 0x7fca081036f0 2024-06-06T03:21:33.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.665+0000 7fca057fa700 1 -- 172.21.15.50:0/4066659757 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9fc00de70 con 0x7fca081036f0 2024-06-06T03:21:33.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.665+0000 7fca0e6a9700 1 -- 172.21.15.50:0/4066659757 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca081a26e0 con 0x7fca081036f0 2024-06-06T03:21:33.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.665+0000 7fca057fa700 1 -- 172.21.15.50:0/4066659757 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc00f3c0 con 0x7fca081036f0 2024-06-06T03:21:33.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.665+0000 7fca0e6a9700 1 -- 172.21.15.50:0/4066659757 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca081a2c70 con 0x7fca081036f0 2024-06-06T03:21:33.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.666+0000 7fca0e6a9700 1 -- 172.21.15.50:0/4066659757 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca08069180 con 0x7fca081036f0 2024-06-06T03:21:33.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.668+0000 7fca057fa700 1 -- 172.21.15.50:0/4066659757 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc9fc019070 con 0x7fca081036f0 2024-06-06T03:21:33.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.668+0000 7fca057fa700 1 --2- 172.21.15.50:0/4066659757 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc9f00a2ca0 0x7fc9f00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:33.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.669+0000 7fca07fff700 1 --2- 172.21.15.50:0/4066659757 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc9f00a2ca0 0x7fc9f00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:33.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.669+0000 7fca057fa700 1 -- 172.21.15.50:0/4066659757 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fc9fc0ce6b0 con 0x7fca081036f0 2024-06-06T03:21:33.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.669+0000 7fca07fff700 1 --2- 172.21.15.50:0/4066659757 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc9f00a2ca0 0x7fc9f00a5160 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8005950 tx=0x7fc9f80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:21:33.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.672+0000 7fca057fa700 1 -- 172.21.15.50:0/4066659757 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc9fc09ba10 con 0x7fca081036f0 2024-06-06T03:21:33.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.879+0000 7fca0e6a9700 1 -- 172.21.15.50:0/4066659757 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fca081a3090 con 0x7fca081036f0 2024-06-06T03:21:33.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.879+0000 7fca057fa700 1 -- 172.21.15.50:0/4066659757 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v81) ==== 74+0+133 (secure 0 0 0) 0x7fc9fc09b310 con 0x7fca081036f0 2024-06-06T03:21:33.880 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:21:33.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.881+0000 7fca0e6a9700 1 -- 172.21.15.50:0/4066659757 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc9f00a2ca0 msgr2=0x7fc9f00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:33.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.881+0000 7fca0e6a9700 1 --2- 172.21.15.50:0/4066659757 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc9f00a2ca0 0x7fc9f00a5160 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8005950 tx=0x7fc9f80058e0 comp rx=0 tx=0).stop 2024-06-06T03:21:33.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.882+0000 7fca0e6a9700 1 -- 172.21.15.50:0/4066659757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca081036f0 msgr2=0x7fca0819acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:33.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.882+0000 7fca0e6a9700 1 --2- 172.21.15.50:0/4066659757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca081036f0 0x7fca0819acd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00d980 tx=0x7fc9fc00dc90 comp rx=0 tx=0).stop 2024-06-06T03:21:33.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.882+0000 7fca0e6a9700 1 -- 172.21.15.50:0/4066659757 shutdown_connections 2024-06-06T03:21:33.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.882+0000 7fca0e6a9700 1 --2- 172.21.15.50:0/4066659757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca08104090 0x7fca081a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:33.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.882+0000 7fca0e6a9700 1 --2- 172.21.15.50:0/4066659757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca081024f0 0x7fca0819a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:33.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.882+0000 7fca0e6a9700 1 --2- 172.21.15.50:0/4066659757 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc9f00a2ca0 0x7fc9f00a5160 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:33.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.882+0000 7fca0e6a9700 1 --2- 172.21.15.50:0/4066659757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca081036f0 0x7fca0819acd0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:33.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.882+0000 7fca0e6a9700 1 -- 172.21.15.50:0/4066659757 >> 172.21.15.50:0/4066659757 conn(0x7fca080fda90 msgr2=0x7fca080746c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:21:33.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.882+0000 7fca0e6a9700 1 -- 172.21.15.50:0/4066659757 shutdown_connections 2024-06-06T03:21:33.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:33.882+0000 7fca0e6a9700 1 -- 172.21.15.50:0/4066659757 wait complete. 2024-06-06T03:21:34.634 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":81,"num_osds":12,"num_up_osds":12,"osd_up_since":1717644090,"num_in_osds":12,"osd_in_since":1717644069,"num_remapped_pgs":0} 2024-06-06T03:21:34.635 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-06T03:21:34.887 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:21:35.156 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:34 smithi050 ceph-mon[32421]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:35.156 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:34 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/4066659757' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-06T03:21:35.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:34 smithi122 ceph-mon[35759]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:35.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:34 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/4066659757' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-06T03:21:35.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:34 smithi079 ceph-mon[35478]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:35.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:34 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/4066659757' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-06T03:21:36.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.710+0000 7fcd2f8a7700 1 -- 172.21.15.50:0/3053234783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd28101d50 msgr2=0x7fcd2810e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:36.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.710+0000 7fcd2f8a7700 1 --2- 172.21.15.50:0/3053234783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd28101d50 0x7fcd2810e240 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcd2000b0a0 tx=0x7fcd2000b3b0 comp rx=0 tx=0).stop 2024-06-06T03:21:36.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.710+0000 7fcd2f8a7700 1 -- 172.21.15.50:0/3053234783 shutdown_connections 2024-06-06T03:21:36.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.710+0000 7fcd2f8a7700 1 --2- 172.21.15.50:0/3053234783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd28101d50 0x7fcd2810e240 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:36.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.710+0000 7fcd2f8a7700 1 --2- 172.21.15.50:0/3053234783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd28107400 0x7fcd281077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:36.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.710+0000 7fcd2f8a7700 1 --2- 172.21.15.50:0/3053234783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd28101390 0x7fcd28101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:36.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.710+0000 7fcd2f8a7700 1 -- 172.21.15.50:0/3053234783 >> 172.21.15.50:0/3053234783 conn(0x7fcd28078340 msgr2=0x7fcd28078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:21:36.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.710+0000 7fcd2f8a7700 1 -- 172.21.15.50:0/3053234783 shutdown_connections 2024-06-06T03:21:36.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.710+0000 7fcd2f8a7700 1 -- 172.21.15.50:0/3053234783 wait complete. 2024-06-06T03:21:36.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.711+0000 7fcd2f8a7700 1 Processor -- start 2024-06-06T03:21:36.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.711+0000 7fcd2f8a7700 1 -- start start 2024-06-06T03:21:36.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.711+0000 7fcd2f8a7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd28101390 0x7fcd28103070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:36.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.711+0000 7fcd2f8a7700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd28101d50 0x7fcd281035b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:36.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.711+0000 7fcd2f8a7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd28107400 0x7fcd28103af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:36.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.711+0000 7fcd2f8a7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcd281115a0 con 0x7fcd28107400 2024-06-06T03:21:36.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.711+0000 7fcd2f8a7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcd28111420 con 0x7fcd28101390 2024-06-06T03:21:36.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.711+0000 7fcd2f8a7700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcd28111720 con 0x7fcd28101d50 2024-06-06T03:21:36.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.711+0000 7fcd2de44700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd28107400 0x7fcd28103af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:36.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.711+0000 7fcd2de44700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd28107400 0x7fcd28103af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34362/0 (socket says 172.21.15.50:34362) 2024-06-06T03:21:36.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.711+0000 7fcd2de44700 1 -- 172.21.15.50:0/3605585096 learned_addr learned my addr 172.21.15.50:0/3605585096 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:21:36.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.711+0000 7fcd2ce42700 1 --2- 172.21.15.50:0/3605585096 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd28101d50 0x7fcd281035b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:36.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.711+0000 7fcd2d643700 1 --2- 172.21.15.50:0/3605585096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd28101390 0x7fcd28103070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:36.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.712+0000 7fcd2de44700 1 -- 172.21.15.50:0/3605585096 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd28101d50 msgr2=0x7fcd281035b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:36.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.712+0000 7fcd2de44700 1 --2- 172.21.15.50:0/3605585096 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd28101d50 0x7fcd281035b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:36.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.712+0000 7fcd2de44700 1 -- 172.21.15.50:0/3605585096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd28101390 msgr2=0x7fcd28103070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:36.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.712+0000 7fcd2de44700 1 --2- 172.21.15.50:0/3605585096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd28101390 0x7fcd28103070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:36.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.712+0000 7fcd2de44700 1 -- 172.21.15.50:0/3605585096 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd281a7080 con 0x7fcd28107400 2024-06-06T03:21:36.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.712+0000 7fcd2de44700 1 --2- 172.21.15.50:0/3605585096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd28107400 0x7fcd28103af0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcd200062a0 tx=0x7fcd20004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:21:36.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.712+0000 7fcd1e7fc700 1 -- 172.21.15.50:0/3605585096 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd20021070 con 0x7fcd28107400 2024-06-06T03:21:36.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.712+0000 7fcd1e7fc700 1 -- 172.21.15.50:0/3605585096 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcd20003c00 con 0x7fcd28107400 2024-06-06T03:21:36.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.712+0000 7fcd2f8a7700 1 -- 172.21.15.50:0/3605585096 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd281a7310 con 0x7fcd28107400 2024-06-06T03:21:36.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.712+0000 7fcd1e7fc700 1 -- 172.21.15.50:0/3605585096 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd20004820 con 0x7fcd28107400 2024-06-06T03:21:36.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.712+0000 7fcd2f8a7700 1 -- 172.21.15.50:0/3605585096 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd281a77c0 con 0x7fcd28107400 2024-06-06T03:21:36.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.713+0000 7fcd2f8a7700 1 -- 172.21.15.50:0/3605585096 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd28069180 con 0x7fcd28107400 2024-06-06T03:21:36.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.714+0000 7fcd1e7fc700 1 -- 172.21.15.50:0/3605585096 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fcd20004000 con 0x7fcd28107400 2024-06-06T03:21:36.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.715+0000 7fcd1e7fc700 1 --2- 172.21.15.50:0/3605585096 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcd140a2c20 0x7fcd140a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:36.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.715+0000 7fcd2d643700 1 --2- 172.21.15.50:0/3605585096 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcd140a2c20 0x7fcd140a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:36.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.715+0000 7fcd1e7fc700 1 -- 172.21.15.50:0/3605585096 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fcd2000f020 con 0x7fcd28107400 2024-06-06T03:21:36.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.716+0000 7fcd2d643700 1 --2- 172.21.15.50:0/3605585096 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcd140a2c20 0x7fcd140a50e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcd24009a10 tx=0x7fcd24009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:21:36.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.719+0000 7fcd1e7fc700 1 -- 172.21.15.50:0/3605585096 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fcd2002a020 con 0x7fcd28107400 2024-06-06T03:21:36.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.926+0000 7fcd2f8a7700 1 -- 172.21.15.50:0/3605585096 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcd281a7a60 con 0x7fcd28107400 2024-06-06T03:21:36.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.927+0000 7fcd1e7fc700 1 -- 172.21.15.50:0/3605585096 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18409 (secure 0 0 0) 0x7fcd2009d9e0 con 0x7fcd28107400 2024-06-06T03:21:36.927 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:21:36.927 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":81,"fsid":"b6263b26-23b2-11ef-bc9b-c7b262605968","created":"2024-06-06T03:14:19.062632+0000","modified":"2024-06-06T03:21:31.870105+0000","last_up_change":"2024-06-06T03:21:30.287918+0000","last_in_change":"2024-06-06T03:21:09.550417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T03:17:37.777608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eed8040f-a7b7-4d3b-8345-2022918097d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6803","nonce":2379528827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6805","nonce":2379528827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6809","nonce":2379528827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6807","nonce":2379528827}]},"public_addr":"172.21.15.50:6803/2379528827","cluster_addr":"172.21.15.50:6805/2379528827","heartbeat_back_addr":"172.21.15.50:6809/2379528827","heartbeat_front_addr":"172.21.15.50:6807/2379528827","state":["exists","up"]},{"osd":1,"uuid":"089ecb78-5e1e-4cdb-8fe0-5c1731ec9dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6801","nonce":3498354151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6803","nonce":3498354151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6807","nonce":3498354151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6805","nonce":3498354151}]},"public_addr":"172.21.15.79:6801/3498354151","cluster_addr":"172.21.15.79:6803/3498354151","heartbeat_back_addr":"172.21.15.79:6807/3498354151","heartbeat_front_addr":"172.21.15.79:6805/3498354151","state":["exists","up"]},{"osd":2,"uuid":"90599e3b-bf86-4a56-b03b-b051528a5b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6801","nonce":566397008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6803","nonce":566397008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6807","nonce":566397008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6805","nonce":566397008}]},"public_addr":"172.21.15.122:6801/566397008","cluster_addr":"172.21.15.122:6803/566397008","heartbeat_back_addr":"172.21.15.122:6807/566397008","heartbeat_front_addr":"172.21.15.122:6805/566397008","state":["exists","up"]},{"osd":3,"uuid":"fd295e6c-64cd-4164-83dc-4d32c2ae103a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6811","nonce":820123083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6813","nonce":820123083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6817","nonce":820123083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6815","nonce":820123083}]},"public_addr":"172.21.15.50:6811/820123083","cluster_addr":"172.21.15.50:6813/820123083","heartbeat_back_addr":"172.21.15.50:6817/820123083","heartbeat_front_addr":"172.21.15.50:6815/820123083","state":["exists","up"]},{"osd":4,"uuid":"4c854d90-5353-4f7c-b2f3-2af6216d799b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6809","nonce":1784117997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6811","nonce":1784117997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6815","nonce":1784117997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6813","nonce":1784117997}]},"public_addr":"172.21.15.79:6809/1784117997","cluster_addr":"172.21.15.79:6811/1784117997","heartbeat_back_addr":"172.21.15.79:6815/1784117997","heartbeat_front_addr":"172.21.15.79:6813/1784117997","state":["exists","up"]},{"osd":5,"uuid":"80041e10-a643-4338-b621-f882c7bc48b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6809","nonce":2755878218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6811","nonce":2755878218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6815","nonce":2755878218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6813","nonce":2755878218}]},"public_addr":"172.21.15.122:6809/2755878218","cluster_addr":"172.21.15.122:6811/2755878218","heartbeat_back_addr":"172.21.15.122:6815/2755878218","heartbeat_front_addr":"172.21.15.122:6813/2755878218","state":["exists","up"]},{"osd":6,"uuid":"9e15c6c3-bb4b-4c2b-bb7e-4653b10874d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6819","nonce":474595612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6821","nonce":474595612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6825","nonce":474595612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6823","nonce":474595612}]},"public_addr":"172.21.15.50:6819/474595612","cluster_addr":"172.21.15.50:6821/474595612","heartbeat_back_addr":"172.21.15.50:6825/474595612","heartbeat_front_addr":"172.21.15.50:6823/474595612","state":["exists","up"]},{"osd":7,"uuid":"62585bba-c540-4498-8768-b84183e19abd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6817","nonce":3504864579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6819","nonce":3504864579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6823","nonce":3504864579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6821","nonce":3504864579}]},"public_addr":"172.21.15.79:6817/3504864579","cluster_addr":"172.21.15.79:6819/3504864579","heartbeat_back_addr":"172.21.15.79:6823/3504864579","heartbeat_front_addr":"172.21.15.79:6821/3504864579","state":["exists","up"]},{"osd":8,"uuid":"7a272157-460a-4d4a-a63e-30436022ac7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6817","nonce":3484833116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6819","nonce":3484833116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6823","nonce":3484833116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6821","nonce":3484833116}]},"public_addr":"172.21.15.122:6817/3484833116","cluster_addr":"172.21.15.122:6819/3484833116","heartbeat_back_addr":"172.21.15.122:6823/3484833116","heartbeat_front_addr":"172.21.15.122:6821/3484833116","state":["exists","up"]},{"osd":9,"uuid":"7e768ff7-f78d-4a12-b863-4b692e0f4a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6827","nonce":2600273670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6829","nonce":2600273670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6833","nonce":2600273670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6831","nonce":2600273670}]},"public_addr":"172.21.15.50:6827/2600273670","cluster_addr":"172.21.15.50:6829/2600273670","heartbeat_back_addr":"172.21.15.50:6833/2600273670","heartbeat_front_addr":"172.21.15.50:6831/2600273670","state":["exists","up"]},{"osd":10,"uuid":"a42df29a-d88d-4401-878d-6c8f75f3f604","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6825","nonce":2740366543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6827","nonce":2740366543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6831","nonce":2740366543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6829","nonce":2740366543}]},"public_addr":"172.21.15.79:6825/2740366543","cluster_addr":"172.21.15.79:6827/2740366543","heartbeat_back_addr":"172.21.15.79:6831/2740366543","heartbeat_front_addr":"172.21.15.79:6829/2740366543","state":["exists","up"]},{"osd":11,"uuid":"35bcde30-49e4-49b9-a348-98d21a0d3cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6825","nonce":4160854238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6827","nonce":4160854238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6831","nonce":4160854238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6829","nonce":4160854238}]},"public_addr":"172.21.15.122:6825/4160854238","cluster_addr":"172.21.15.122:6827/4160854238","heartbeat_back_addr":"172.21.15.122:6831/4160854238","heartbeat_front_addr":"172.21.15.122:6829/4160854238","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:16:46.989554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:17:11.269759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:17:35.105846+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:00.940943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:26.284520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:51.064143+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:19:16.254750+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:19:42.841380+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:20:08.185133+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:20:34.700082+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:21:01.485278+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:21:27.938715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1311987652":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/1149897118":"2024-06-07T03:15:13.252241+0000","172.21.15.50:6800/2617801068":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/1068038293":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/4038080419":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/149912088":"2024-06-07T03:14:46.388744+0000","172.21.15.50:6801/2617801068":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/2963887224":"2024-06-07T03:14:46.388744+0000","172.21.15.50:6801/1311987652":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/2554563139":"2024-06-07T03:15:13.252241+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T03:21:36.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.929+0000 7fcd2f8a7700 1 -- 172.21.15.50:0/3605585096 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcd140a2c20 msgr2=0x7fcd140a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:36.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.929+0000 7fcd2f8a7700 1 --2- 172.21.15.50:0/3605585096 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcd140a2c20 0x7fcd140a50e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcd24009a10 tx=0x7fcd24009190 comp rx=0 tx=0).stop 2024-06-06T03:21:36.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.929+0000 7fcd2f8a7700 1 -- 172.21.15.50:0/3605585096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd28107400 msgr2=0x7fcd28103af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:36.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.929+0000 7fcd2f8a7700 1 --2- 172.21.15.50:0/3605585096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd28107400 0x7fcd28103af0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcd200062a0 tx=0x7fcd20004e20 comp rx=0 tx=0).stop 2024-06-06T03:21:36.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.929+0000 7fcd2f8a7700 1 -- 172.21.15.50:0/3605585096 shutdown_connections 2024-06-06T03:21:36.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.929+0000 7fcd2f8a7700 1 --2- 172.21.15.50:0/3605585096 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcd140a2c20 0x7fcd140a50e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:36.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.929+0000 7fcd2f8a7700 1 --2- 172.21.15.50:0/3605585096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd28107400 0x7fcd28103af0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:36.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.929+0000 7fcd2f8a7700 1 --2- 172.21.15.50:0/3605585096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd28101390 0x7fcd28103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:36.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.929+0000 7fcd2f8a7700 1 --2- 172.21.15.50:0/3605585096 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd28101d50 0x7fcd281035b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:36.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.929+0000 7fcd2f8a7700 1 -- 172.21.15.50:0/3605585096 >> 172.21.15.50:0/3605585096 conn(0x7fcd28078340 msgr2=0x7fcd281006a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:21:36.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.929+0000 7fcd2f8a7700 1 -- 172.21.15.50:0/3605585096 shutdown_connections 2024-06-06T03:21:36.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:36.929+0000 7fcd2f8a7700 1 -- 172.21.15.50:0/3605585096 wait complete. 2024-06-06T03:21:37.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:36 smithi050 ceph-mon[32421]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:37.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:36 smithi122 ceph-mon[35759]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:37.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:36 smithi079 ceph-mon[35478]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:37.671 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-06T03:17:37.777608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-06T03:21:37.671 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-06-06T03:21:37.922 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:21:38.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:37 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3605585096' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:21:38.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:37 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/3605585096' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:21:38.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:37 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/3605585096' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:21:39.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:38 smithi122 ceph-mon[35759]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:39.205 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:38 smithi050 ceph-mon[32421]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:39.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:38 smithi079 ceph-mon[35478]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:39.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.594+0000 7f97d046d700 1 -- 172.21.15.50:0/555816738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97c806a170 msgr2=0x7f97c806a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:39.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.594+0000 7f97d046d700 1 --2- 172.21.15.50:0/555816738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97c806a170 0x7f97c806a5f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f97bc009990 tx=0x7f97bc009ca0 comp rx=0 tx=0).stop 2024-06-06T03:21:39.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.595+0000 7f97d046d700 1 -- 172.21.15.50:0/555816738 shutdown_connections 2024-06-06T03:21:39.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.595+0000 7f97d046d700 1 --2- 172.21.15.50:0/555816738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97c806ab30 0x7f97c810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:39.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.595+0000 7f97d046d700 1 --2- 172.21.15.50:0/555816738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97c8108500 0x7f97c81088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:39.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.595+0000 7f97d046d700 1 --2- 172.21.15.50:0/555816738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97c806a170 0x7f97c806a5f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:39.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.595+0000 7f97d046d700 1 -- 172.21.15.50:0/555816738 >> 172.21.15.50:0/555816738 conn(0x7f97c8078340 msgr2=0x7f97c8078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:21:39.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.595+0000 7f97d046d700 1 -- 172.21.15.50:0/555816738 shutdown_connections 2024-06-06T03:21:39.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.595+0000 7f97d046d700 1 -- 172.21.15.50:0/555816738 wait complete. 2024-06-06T03:21:39.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.595+0000 7f97d046d700 1 Processor -- start 2024-06-06T03:21:39.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.595+0000 7f97d046d700 1 -- start start 2024-06-06T03:21:39.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.596+0000 7f97d046d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97c806a170 0x7f97c819e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:39.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.596+0000 7f97d046d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97c806ab30 0x7f97c819eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:39.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.596+0000 7f97d046d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97c8108500 0x7f97c8198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:39.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.596+0000 7f97d046d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f97c81126e0 con 0x7f97c8108500 2024-06-06T03:21:39.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.596+0000 7f97d046d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f97c8112560 con 0x7f97c806ab30 2024-06-06T03:21:39.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.596+0000 7f97d046d700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f97c8112860 con 0x7f97c806a170 2024-06-06T03:21:39.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.596+0000 7f97cea0a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97c8108500 0x7f97c8198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:39.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.596+0000 7f97cea0a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97c8108500 0x7f97c8198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52624/0 (socket says 172.21.15.50:52624) 2024-06-06T03:21:39.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.596+0000 7f97cea0a700 1 -- 172.21.15.50:0/2031882428 learned_addr learned my addr 172.21.15.50:0/2031882428 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:21:39.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.596+0000 7f97ce209700 1 --2- 172.21.15.50:0/2031882428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97c806a170 0x7f97c819e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:39.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.596+0000 7f97cda08700 1 --2- 172.21.15.50:0/2031882428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97c806ab30 0x7f97c819eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:39.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.596+0000 7f97cea0a700 1 -- 172.21.15.50:0/2031882428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97c806a170 msgr2=0x7f97c819e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.596+0000 7f97cea0a700 1 --2- 172.21.15.50:0/2031882428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97c806a170 0x7f97c819e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.596+0000 7f97cea0a700 1 -- 172.21.15.50:0/2031882428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97c806ab30 msgr2=0x7f97c819eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.596+0000 7f97cea0a700 1 --2- 172.21.15.50:0/2031882428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97c806ab30 0x7f97c819eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.596+0000 7f97cea0a700 1 -- 172.21.15.50:0/2031882428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c8199180 con 0x7f97c8108500 2024-06-06T03:21:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.596+0000 7f97ce209700 1 --2- 172.21.15.50:0/2031882428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97c806a170 0x7f97c819e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:21:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.596+0000 7f97cda08700 1 --2- 172.21.15.50:0/2031882428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97c806ab30 0x7f97c819eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:21:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.596+0000 7f97cea0a700 1 --2- 172.21.15.50:0/2031882428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97c8108500 0x7f97c8198a20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f97c000b550 tx=0x7f97c000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:21:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.596+0000 7f97c77fe700 1 -- 172.21.15.50:0/2031882428 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c0015020 con 0x7f97c8108500 2024-06-06T03:21:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.597+0000 7f97c77fe700 1 -- 172.21.15.50:0/2031882428 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f97c0011ce0 con 0x7f97c8108500 2024-06-06T03:21:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.597+0000 7f97c77fe700 1 -- 172.21.15.50:0/2031882428 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c0010cb0 con 0x7f97c8108500 2024-06-06T03:21:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.597+0000 7f97d046d700 1 -- 172.21.15.50:0/2031882428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97c8199470 con 0x7f97c8108500 2024-06-06T03:21:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.597+0000 7f97d046d700 1 -- 172.21.15.50:0/2031882428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97c81a5730 con 0x7f97c8108500 2024-06-06T03:21:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.598+0000 7f97d046d700 1 -- 172.21.15.50:0/2031882428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97c8069180 con 0x7f97c8108500 2024-06-06T03:21:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.599+0000 7f97c77fe700 1 -- 172.21.15.50:0/2031882428 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f97c0018020 con 0x7f97c8108500 2024-06-06T03:21:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.599+0000 7f97c77fe700 1 --2- 172.21.15.50:0/2031882428 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f97b00a2ca0 0x7f97b00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.600+0000 7f97ce209700 1 --2- 172.21.15.50:0/2031882428 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f97b00a2ca0 0x7f97b00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.600+0000 7f97c77fe700 1 -- 172.21.15.50:0/2031882428 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f97c00ce2e0 con 0x7f97c8108500 2024-06-06T03:21:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.600+0000 7f97ce209700 1 --2- 172.21.15.50:0/2031882428 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f97b00a2ca0 0x7f97b00a5160 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f97b8007fd0 tx=0x7f97b8007830 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:21:39.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.604+0000 7f97c77fe700 1 -- 172.21.15.50:0/2031882428 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f97c001f020 con 0x7f97c8108500 2024-06-06T03:21:39.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.808+0000 7f97d046d700 1 -- 172.21.15.50:0/2031882428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f97c8199f50 con 0x7f97c8108500 2024-06-06T03:21:39.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.809+0000 7f97c77fe700 1 -- 172.21.15.50:0/2031882428 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f97c009b6e0 con 0x7f97c8108500 2024-06-06T03:21:39.809 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-06-06T03:21:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.811+0000 7f97d046d700 1 -- 172.21.15.50:0/2031882428 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f97b00a2ca0 msgr2=0x7f97b00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.811+0000 7f97d046d700 1 --2- 172.21.15.50:0/2031882428 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f97b00a2ca0 0x7f97b00a5160 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f97b8007fd0 tx=0x7f97b8007830 comp rx=0 tx=0).stop 2024-06-06T03:21:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.811+0000 7f97d046d700 1 -- 172.21.15.50:0/2031882428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97c8108500 msgr2=0x7f97c8198a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.811+0000 7f97d046d700 1 --2- 172.21.15.50:0/2031882428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97c8108500 0x7f97c8198a20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f97c000b550 tx=0x7f97c000b910 comp rx=0 tx=0).stop 2024-06-06T03:21:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.811+0000 7f97d046d700 1 -- 172.21.15.50:0/2031882428 shutdown_connections 2024-06-06T03:21:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.811+0000 7f97d046d700 1 --2- 172.21.15.50:0/2031882428 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f97b00a2ca0 0x7f97b00a5160 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.811+0000 7f97d046d700 1 --2- 172.21.15.50:0/2031882428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97c8108500 0x7f97c8198a20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.811+0000 7f97d046d700 1 --2- 172.21.15.50:0/2031882428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97c806a170 0x7f97c819e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.811+0000 7f97d046d700 1 --2- 172.21.15.50:0/2031882428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97c806ab30 0x7f97c819eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.811+0000 7f97d046d700 1 -- 172.21.15.50:0/2031882428 >> 172.21.15.50:0/2031882428 conn(0x7f97c8078340 msgr2=0x7f97c81000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:21:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.811+0000 7f97d046d700 1 -- 172.21.15.50:0/2031882428 shutdown_connections 2024-06-06T03:21:39.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:39.812+0000 7f97d046d700 1 -- 172.21.15.50:0/2031882428 wait complete. 2024-06-06T03:21:40.105 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:39 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/2031882428' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-06T03:21:40.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:39 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/2031882428' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-06T03:21:40.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:39 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/2031882428' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-06T03:21:40.542 INFO:tasks.cephadm:Adding mds.a on smithi050 2024-06-06T03:21:40.542 INFO:tasks.cephadm:Adding mds.d on smithi050 2024-06-06T03:21:40.542 INFO:tasks.cephadm:Adding mds.g on smithi050 2024-06-06T03:21:40.542 INFO:tasks.cephadm:Adding mds.j on smithi050 2024-06-06T03:21:40.542 INFO:tasks.cephadm:Adding mds.b on smithi079 2024-06-06T03:21:40.542 INFO:tasks.cephadm:Adding mds.e on smithi079 2024-06-06T03:21:40.542 INFO:tasks.cephadm:Adding mds.h on smithi079 2024-06-06T03:21:40.542 INFO:tasks.cephadm:Adding mds.k on smithi079 2024-06-06T03:21:40.543 INFO:tasks.cephadm:Adding mds.c on smithi122 2024-06-06T03:21:40.543 INFO:tasks.cephadm:Adding mds.f on smithi122 2024-06-06T03:21:40.543 INFO:tasks.cephadm:Adding mds.i on smithi122 2024-06-06T03:21:40.543 INFO:tasks.cephadm:Adding mds.l on smithi122 2024-06-06T03:21:40.543 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph orch apply mds all '12;smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi079=b;smithi079=e;smithi079=h;smithi079=k;smithi122=c;smithi122=f;smithi122=i;smithi122=l' 2024-06-06T03:21:40.794 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T03:21:41.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:40 smithi122 ceph-mon[35759]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:41.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:40 smithi050 ceph-mon[32421]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:41.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:40 smithi079 ceph-mon[35478]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:42.447 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.445+0000 7f9737c28700 1 -- 172.21.15.122:0/3523026097 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97301081f0 msgr2=0x7f973010a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:42.447 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.445+0000 7f9737c28700 1 --2- 172.21.15.122:0/3523026097 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97301081f0 0x7f973010a660 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f972800b0a0 tx=0x7f972800b3b0 comp rx=0 tx=0).stop 2024-06-06T03:21:42.447 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.445+0000 7f9737c28700 1 -- 172.21.15.122:0/3523026097 shutdown_connections 2024-06-06T03:21:42.447 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.445+0000 7f9737c28700 1 --2- 172.21.15.122:0/3523026097 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97301081f0 0x7f973010a660 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:42.447 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.445+0000 7f9737c28700 1 --2- 172.21.15.122:0/3523026097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9730102f90 0x7f9730105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:42.447 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.445+0000 7f9737c28700 1 --2- 172.21.15.122:0/3523026097 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97301058c0 0x7f9730107cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:42.447 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.445+0000 7f9737c28700 1 -- 172.21.15.122:0/3523026097 >> 172.21.15.122:0/3523026097 conn(0x7f97300fc9c0 msgr2=0x7f97300fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:21:42.447 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.445+0000 7f9737c28700 1 -- 172.21.15.122:0/3523026097 shutdown_connections 2024-06-06T03:21:42.447 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.445+0000 7f9737c28700 1 -- 172.21.15.122:0/3523026097 wait complete. 2024-06-06T03:21:42.447 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.445+0000 7f9737c28700 1 Processor -- start 2024-06-06T03:21:42.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.445+0000 7f9737c28700 1 -- start start 2024-06-06T03:21:42.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.446+0000 7f9737c28700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9730102f90 0x7f9730198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:42.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.446+0000 7f9737c28700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97301058c0 0x7f9730198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:42.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.446+0000 7f9737c28700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97301081f0 0x7f973019fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:42.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.446+0000 7f9737c28700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f973010df60 con 0x7f97301081f0 2024-06-06T03:21:42.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.446+0000 7f9737c28700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f973010dde0 con 0x7f97301058c0 2024-06-06T03:21:42.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.446+0000 7f9737c28700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f973010e0e0 con 0x7f9730102f90 2024-06-06T03:21:42.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.446+0000 7f97359c4700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9730102f90 0x7f9730198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:42.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.446+0000 7f97359c4700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9730102f90 0x7f9730198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:42164/0 (socket says 172.21.15.122:42164) 2024-06-06T03:21:42.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.446+0000 7f97359c4700 1 -- 172.21.15.122:0/1795206416 learned_addr learned my addr 172.21.15.122:0/1795206416 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-06-06T03:21:42.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.446+0000 7f97351c3700 1 --2- 172.21.15.122:0/1795206416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97301058c0 0x7f9730198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:42.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.446+0000 7f97361c5700 1 --2- 172.21.15.122:0/1795206416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97301081f0 0x7f973019fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:42.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.446+0000 7f97359c4700 1 -- 172.21.15.122:0/1795206416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97301058c0 msgr2=0x7f9730198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:42.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.446+0000 7f97359c4700 1 --2- 172.21.15.122:0/1795206416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97301058c0 0x7f9730198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:42.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.446+0000 7f97359c4700 1 -- 172.21.15.122:0/1795206416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97301081f0 msgr2=0x7f973019fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:42.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.446+0000 7f97359c4700 1 --2- 172.21.15.122:0/1795206416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97301081f0 0x7f973019fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:42.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.446+0000 7f97359c4700 1 -- 172.21.15.122:0/1795206416 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97301a02a0 con 0x7f9730102f90 2024-06-06T03:21:42.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.446+0000 7f97361c5700 1 --2- 172.21.15.122:0/1795206416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97301081f0 0x7f973019fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:21:42.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.446+0000 7f97359c4700 1 --2- 172.21.15.122:0/1795206416 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9730102f90 0x7f9730198640 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f972c00d9b0 tx=0x7f972c00dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:21:42.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.446+0000 7f9726ffd700 1 -- 172.21.15.122:0/1795206416 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c016070 con 0x7f9730102f90 2024-06-06T03:21:42.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.446+0000 7f9726ffd700 1 -- 172.21.15.122:0/1795206416 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f972c004830 con 0x7f9730102f90 2024-06-06T03:21:42.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.446+0000 7f9737c28700 1 -- 172.21.15.122:0/1795206416 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9730100de0 con 0x7f9730102f90 2024-06-06T03:21:42.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.446+0000 7f9726ffd700 1 -- 172.21.15.122:0/1795206416 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c0054f0 con 0x7f9730102f90 2024-06-06T03:21:42.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.446+0000 7f9737c28700 1 -- 172.21.15.122:0/1795206416 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9730101370 con 0x7f9730102f90 2024-06-06T03:21:42.450 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.447+0000 7f9737c28700 1 -- 172.21.15.122:0/1795206416 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9730069180 con 0x7f9730102f90 2024-06-06T03:21:42.450 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.448+0000 7f9726ffd700 1 -- 172.21.15.122:0/1795206416 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f972c0049e0 con 0x7f9730102f90 2024-06-06T03:21:42.450 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.449+0000 7f9726ffd700 1 --2- 172.21.15.122:0/1795206416 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f971c0a2ca0 0x7f971c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:42.450 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.449+0000 7f9726ffd700 1 -- 172.21.15.122:0/1795206416 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f972c0cef40 con 0x7f9730102f90 2024-06-06T03:21:42.451 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.450+0000 7f97351c3700 1 --2- 172.21.15.122:0/1795206416 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f971c0a2ca0 0x7f971c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:42.451 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.450+0000 7f97351c3700 1 --2- 172.21.15.122:0/1795206416 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f971c0a2ca0 0x7f971c0a5160 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9720005950 tx=0x7f972000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:21:42.452 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.453+0000 7f9726ffd700 1 -- 172.21.15.122:0/1795206416 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f972c01f020 con 0x7f9730102f90 2024-06-06T03:21:42.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.656+0000 7f9737c28700 1 -- 172.21.15.122:0/1795206416 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi079=b;smithi079=e;smithi079=h;smithi079=k;smithi122=c;smithi122=f;smithi122=i;smithi122=l", "target": ["mon-mgr", ""]}) -- 0x7f97300fe090 con 0x7f971c0a2ca0 2024-06-06T03:21:42.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.664+0000 7f9726ffd700 1 -- 172.21.15.122:0/1795206416 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f97300fe090 con 0x7f971c0a2ca0 2024-06-06T03:21:42.663 INFO:teuthology.orchestra.run.smithi122.stdout:Scheduled mds.all update... 2024-06-06T03:21:42.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.666+0000 7f9737c28700 1 -- 172.21.15.122:0/1795206416 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f971c0a2ca0 msgr2=0x7f971c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:42.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.666+0000 7f9737c28700 1 --2- 172.21.15.122:0/1795206416 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f971c0a2ca0 0x7f971c0a5160 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9720005950 tx=0x7f972000b410 comp rx=0 tx=0).stop 2024-06-06T03:21:42.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.666+0000 7f9737c28700 1 -- 172.21.15.122:0/1795206416 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9730102f90 msgr2=0x7f9730198640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:42.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.666+0000 7f9737c28700 1 --2- 172.21.15.122:0/1795206416 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9730102f90 0x7f9730198640 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f972c00d9b0 tx=0x7f972c00dcc0 comp rx=0 tx=0).stop 2024-06-06T03:21:42.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.666+0000 7f9737c28700 1 -- 172.21.15.122:0/1795206416 shutdown_connections 2024-06-06T03:21:42.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.666+0000 7f9737c28700 1 --2- 172.21.15.122:0/1795206416 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f971c0a2ca0 0x7f971c0a5160 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:42.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.666+0000 7f9737c28700 1 --2- 172.21.15.122:0/1795206416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97301081f0 0x7f973019fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:42.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.666+0000 7f9737c28700 1 --2- 172.21.15.122:0/1795206416 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9730102f90 0x7f9730198640 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:42.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.666+0000 7f9737c28700 1 --2- 172.21.15.122:0/1795206416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97301058c0 0x7f9730198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:42.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.666+0000 7f9737c28700 1 -- 172.21.15.122:0/1795206416 >> 172.21.15.122:0/1795206416 conn(0x7f97300fc9c0 msgr2=0x7f97301039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:21:42.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.666+0000 7f9737c28700 1 -- 172.21.15.122:0/1795206416 shutdown_connections 2024-06-06T03:21:42.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-06-06T03:21:42.666+0000 7f9737c28700 1 -- 172.21.15.122:0/1795206416 wait complete. 2024-06-06T03:21:42.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:42 smithi122 ceph-mon[35759]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:42.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:42 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:42.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:42 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:21:43.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:42 smithi050 ceph-mon[32421]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:43.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:42 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:43.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:42 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:21:43.279 DEBUG:teuthology.orchestra.run.smithi050:mds.a> sudo journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.a.service 2024-06-06T03:21:43.282 DEBUG:teuthology.orchestra.run.smithi050:mds.d> sudo journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.d.service 2024-06-06T03:21:43.326 DEBUG:teuthology.orchestra.run.smithi050:mds.g> sudo journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.g.service 2024-06-06T03:21:43.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:42 smithi079 ceph-mon[35478]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:43.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:42 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:43.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:42 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:21:43.369 DEBUG:teuthology.orchestra.run.smithi050:mds.j> sudo journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.j.service 2024-06-06T03:21:43.412 DEBUG:teuthology.orchestra.run.smithi079:mds.b> sudo journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.b.service 2024-06-06T03:21:43.415 DEBUG:teuthology.orchestra.run.smithi079:mds.e> sudo journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.e.service 2024-06-06T03:21:43.458 DEBUG:teuthology.orchestra.run.smithi079:mds.h> sudo journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.h.service 2024-06-06T03:21:43.501 DEBUG:teuthology.orchestra.run.smithi079:mds.k> sudo journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.k.service 2024-06-06T03:21:43.544 DEBUG:teuthology.orchestra.run.smithi122:mds.c> sudo journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.c.service 2024-06-06T03:21:43.547 DEBUG:teuthology.orchestra.run.smithi122:mds.f> sudo journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.f.service 2024-06-06T03:21:43.589 DEBUG:teuthology.orchestra.run.smithi122:mds.i> sudo journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.i.service 2024-06-06T03:21:43.633 DEBUG:teuthology.orchestra.run.smithi122:mds.l> sudo journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.l.service 2024-06-06T03:21:43.676 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-06-06T03:21:43.676 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T03:21:43.925 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:21:44.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:43 smithi050 ceph-mon[32421]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi079=b;smithi079=e;smithi079=h;smithi079=k;smithi122=c;smithi122=f;smithi122=i;smithi122=l", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:21:44.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:43 smithi050 ceph-mon[32421]: Saving service mds.all spec with placement smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi079=b;smithi079=e;smithi079=h;smithi079=k;smithi122=c;smithi122=f;smithi122=i;smithi122=l;count:12 2024-06-06T03:21:44.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:43 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:44.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:43 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:21:44.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:43 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:44.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:43 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:21:44.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:43 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:21:44.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:43 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:44.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:43 smithi122 ceph-mon[35759]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi079=b;smithi079=e;smithi079=h;smithi079=k;smithi122=c;smithi122=f;smithi122=i;smithi122=l", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:21:44.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:43 smithi122 ceph-mon[35759]: Saving service mds.all spec with placement smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi079=b;smithi079=e;smithi079=h;smithi079=k;smithi122=c;smithi122=f;smithi122=i;smithi122=l;count:12 2024-06-06T03:21:44.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:43 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:44.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:43 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:21:44.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:43 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:44.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:43 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:21:44.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:43 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:21:44.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:43 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:44.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:43 smithi079 ceph-mon[35478]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi079=b;smithi079=e;smithi079=h;smithi079=k;smithi122=c;smithi122=f;smithi122=i;smithi122=l", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:21:44.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:43 smithi079 ceph-mon[35478]: Saving service mds.all spec with placement smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi079=b;smithi079=e;smithi079=h;smithi079=k;smithi122=c;smithi122=f;smithi122=i;smithi122=l;count:12 2024-06-06T03:21:44.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:43 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:44.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:43 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:21:44.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:43 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:44.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:43 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:21:44.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:43 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:21:44.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:43 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:45.166 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:44 smithi050 ceph-mon[32421]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:45.167 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:44 smithi050 ceph-mon[32421]: Deploying daemon mds.l on smithi122 2024-06-06T03:21:45.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:44 smithi122 ceph-mon[35759]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:45.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:44 smithi122 ceph-mon[35759]: Deploying daemon mds.l on smithi122 2024-06-06T03:21:45.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:44 smithi079 ceph-mon[35478]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:45.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:44 smithi079 ceph-mon[35478]: Deploying daemon mds.l on smithi122 2024-06-06T03:21:45.591 INFO:journalctl@ceph.mds.l.smithi122.stdout:Jun 06 03:21:45 smithi122 systemd[1]: Starting Ceph mds.l for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:21:45.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.752+0000 7f2ceabba700 1 -- 172.21.15.50:0/2711175781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce4107840 msgr2=0x7f2ce410f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:45.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.752+0000 7f2ceabba700 1 --2- 172.21.15.50:0/2711175781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce4107840 0x7f2ce410f3c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc00b0d0 tx=0x7f2cdc00b3e0 comp rx=0 tx=0).stop 2024-06-06T03:21:45.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.752+0000 7f2ceabba700 1 -- 172.21.15.50:0/2711175781 shutdown_connections 2024-06-06T03:21:45.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.752+0000 7f2ceabba700 1 --2- 172.21.15.50:0/2711175781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce4107840 0x7f2ce410f3c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:45.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.752+0000 7f2ceabba700 1 --2- 172.21.15.50:0/2711175781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ce4102740 0x7f2ce4102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:45.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.752+0000 7f2ceabba700 1 --2- 172.21.15.50:0/2711175781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ce41030f0 0x7f2ce4107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:45.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.752+0000 7f2ceabba700 1 -- 172.21.15.50:0/2711175781 >> 172.21.15.50:0/2711175781 conn(0x7f2ce40795f0 msgr2=0x7f2ce4079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:21:45.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.752+0000 7f2ceabba700 1 -- 172.21.15.50:0/2711175781 shutdown_connections 2024-06-06T03:21:45.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.752+0000 7f2ceabba700 1 -- 172.21.15.50:0/2711175781 wait complete. 2024-06-06T03:21:45.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.753+0000 7f2ceabba700 1 Processor -- start 2024-06-06T03:21:45.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.753+0000 7f2ceabba700 1 -- start start 2024-06-06T03:21:45.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.753+0000 7f2ceabba700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ce4102740 0x7f2ce419e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:45.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.753+0000 7f2ceabba700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ce41030f0 0x7f2ce419ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:45.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.753+0000 7f2ceabba700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce4107840 0x7f2ce4198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:45.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.753+0000 7f2ceabba700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce4112610 con 0x7f2ce4107840 2024-06-06T03:21:45.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.753+0000 7f2ceabba700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce4112490 con 0x7f2ce41030f0 2024-06-06T03:21:45.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.753+0000 7f2ceabba700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce4112790 con 0x7f2ce4102740 2024-06-06T03:21:45.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.753+0000 7f2ce9157700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce4107840 0x7f2ce4198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:45.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.753+0000 7f2ce8956700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ce4102740 0x7f2ce419e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:45.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.753+0000 7f2ce9157700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce4107840 0x7f2ce4198890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52654/0 (socket says 172.21.15.50:52654) 2024-06-06T03:21:45.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.753+0000 7f2ce8956700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ce4102740 0x7f2ce419e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:48408/0 (socket says 172.21.15.50:48408) 2024-06-06T03:21:45.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.753+0000 7f2ce9157700 1 -- 172.21.15.50:0/2408855386 learned_addr learned my addr 172.21.15.50:0/2408855386 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:21:45.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.753+0000 7f2ce3fff700 1 --2- 172.21.15.50:0/2408855386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ce41030f0 0x7f2ce419ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:45.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.753+0000 7f2ce9157700 1 -- 172.21.15.50:0/2408855386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ce4102740 msgr2=0x7f2ce419e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:45.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.753+0000 7f2ce9157700 1 --2- 172.21.15.50:0/2408855386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ce4102740 0x7f2ce419e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:45.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.753+0000 7f2ce9157700 1 -- 172.21.15.50:0/2408855386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ce41030f0 msgr2=0x7f2ce419ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:45.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.753+0000 7f2ce9157700 1 --2- 172.21.15.50:0/2408855386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ce41030f0 0x7f2ce419ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:45.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.753+0000 7f2ce9157700 1 -- 172.21.15.50:0/2408855386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce4199070 con 0x7f2ce4107840 2024-06-06T03:21:45.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.754+0000 7f2ce9157700 1 --2- 172.21.15.50:0/2408855386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce4107840 0x7f2ce4198890 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc0095c0 tx=0x7f2cdc007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:21:45.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.754+0000 7f2ce1ffb700 1 -- 172.21.15.50:0/2408855386 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc01f070 con 0x7f2ce4107840 2024-06-06T03:21:45.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.754+0000 7f2ceabba700 1 -- 172.21.15.50:0/2408855386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ce4199300 con 0x7f2ce4107840 2024-06-06T03:21:45.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.754+0000 7f2ce1ffb700 1 -- 172.21.15.50:0/2408855386 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2cdc007e20 con 0x7f2ce4107840 2024-06-06T03:21:45.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.754+0000 7f2ce1ffb700 1 -- 172.21.15.50:0/2408855386 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc01b4a0 con 0x7f2ce4107840 2024-06-06T03:21:45.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.754+0000 7f2ceabba700 1 -- 172.21.15.50:0/2408855386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ce41a5520 con 0x7f2ce4107840 2024-06-06T03:21:45.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.755+0000 7f2ceabba700 1 -- 172.21.15.50:0/2408855386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ce4103bd0 con 0x7f2ce4107840 2024-06-06T03:21:45.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.756+0000 7f2ce1ffb700 1 -- 172.21.15.50:0/2408855386 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2cdc022070 con 0x7f2ce4107840 2024-06-06T03:21:45.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.757+0000 7f2ce1ffb700 1 --2- 172.21.15.50:0/2408855386 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f2cd40a2ca0 0x7f2cd40a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:45.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.757+0000 7f2ce8956700 1 --2- 172.21.15.50:0/2408855386 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f2cd40a2ca0 0x7f2cd40a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:45.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.757+0000 7f2ce1ffb700 1 -- 172.21.15.50:0/2408855386 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f2cdc00f020 con 0x7f2ce4107840 2024-06-06T03:21:45.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.757+0000 7f2ce8956700 1 --2- 172.21.15.50:0/2408855386 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f2cd40a2ca0 0x7f2cd40a5160 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8007c60 tx=0x7f2cd80073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:21:45.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:45.760+0000 7f2ce1ffb700 1 -- 172.21.15.50:0/2408855386 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2cdc029020 con 0x7f2ce4107840 2024-06-06T03:21:45.876 INFO:journalctl@ceph.mds.l.smithi122.stdout:Jun 06 03:21:45 smithi122 podman[65587]: 2024-06-06 03:21:45.494174201 +0000 UTC m=+0.017433820 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T03:21:45.876 INFO:journalctl@ceph.mds.l.smithi122.stdout:Jun 06 03:21:45 smithi122 podman[65587]: 2024-06-06 03:21:45.628881978 +0000 UTC m=+0.152141598 container create 12f963a3dbd1d1231a6565052fb934780ed880839f26d9847382547ecfc773d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-l, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-06-06T03:21:45.876 INFO:journalctl@ceph.mds.l.smithi122.stdout:Jun 06 03:21:45 smithi122 podman[65587]: 2024-06-06 03:21:45.877305381 +0000 UTC m=+0.400564985 container init 12f963a3dbd1d1231a6565052fb934780ed880839f26d9847382547ecfc773d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-l, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-06-06T03:21:46.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:46.019+0000 7f2ceabba700 1 -- 172.21.15.50:0/2408855386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ce402dca0 con 0x7f2ce4107840 2024-06-06T03:21:46.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:46.021+0000 7f2ce1ffb700 1 -- 172.21.15.50:0/2408855386 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1390 (secure 0 0 0) 0x7f2cdc09d500 con 0x7f2ce4107840 2024-06-06T03:21:46.021 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:21:46.022 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/57533154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":57533154},{"type":"v1","addr":"172.21.15.122:6833","nonce":57533154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-06-06T03:21:46.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:46.024+0000 7f2ceabba700 1 -- 172.21.15.50:0/2408855386 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f2cd40a2ca0 msgr2=0x7f2cd40a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:46.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:46.024+0000 7f2ceabba700 1 --2- 172.21.15.50:0/2408855386 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f2cd40a2ca0 0x7f2cd40a5160 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8007c60 tx=0x7f2cd80073d0 comp rx=0 tx=0).stop 2024-06-06T03:21:46.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:46.024+0000 7f2ceabba700 1 -- 172.21.15.50:0/2408855386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce4107840 msgr2=0x7f2ce4198890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:46.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:46.024+0000 7f2ceabba700 1 --2- 172.21.15.50:0/2408855386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce4107840 0x7f2ce4198890 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc0095c0 tx=0x7f2cdc007a20 comp rx=0 tx=0).stop 2024-06-06T03:21:46.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:46.024+0000 7f2ceabba700 1 -- 172.21.15.50:0/2408855386 shutdown_connections 2024-06-06T03:21:46.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:46.024+0000 7f2ceabba700 1 --2- 172.21.15.50:0/2408855386 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f2cd40a2ca0 0x7f2cd40a5160 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:46.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:46.024+0000 7f2ceabba700 1 --2- 172.21.15.50:0/2408855386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce4107840 0x7f2ce4198890 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:46.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:46.024+0000 7f2ceabba700 1 --2- 172.21.15.50:0/2408855386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ce4102740 0x7f2ce419e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:46.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:46.024+0000 7f2ceabba700 1 --2- 172.21.15.50:0/2408855386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ce41030f0 0x7f2ce419ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:46.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:46.024+0000 7f2ceabba700 1 -- 172.21.15.50:0/2408855386 >> 172.21.15.50:0/2408855386 conn(0x7f2ce40795f0 msgr2=0x7f2ce4100650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:21:46.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:46.024+0000 7f2ceabba700 1 -- 172.21.15.50:0/2408855386 shutdown_connections 2024-06-06T03:21:46.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:46.024+0000 7f2ceabba700 1 -- 172.21.15.50:0/2408855386 wait complete. 2024-06-06T03:21:46.025 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 2 2024-06-06T03:21:46.181 INFO:journalctl@ceph.mds.l.smithi122.stdout:Jun 06 03:21:45 smithi122 podman[65587]: 2024-06-06 03:21:45.880465944 +0000 UTC m=+0.403725545 container start 12f963a3dbd1d1231a6565052fb934780ed880839f26d9847382547ecfc773d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-l, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528) 2024-06-06T03:21:46.181 INFO:journalctl@ceph.mds.l.smithi122.stdout:Jun 06 03:21:45 smithi122 ceph-mds[65606]: -- 172.21.15.122:0/4155887170 <== mon.1 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c1001dfa40 con 0x55c1001b2c00 2024-06-06T03:21:46.181 INFO:journalctl@ceph.mds.l.smithi122.stdout:Jun 06 03:21:45 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-l[65602]: starting mds.l at 2024-06-06T03:21:46.181 INFO:journalctl@ceph.mds.l.smithi122.stdout:Jun 06 03:21:45 smithi122 bash[65587]: 12f963a3dbd1d1231a6565052fb934780ed880839f26d9847382547ecfc773d1 2024-06-06T03:21:46.182 INFO:journalctl@ceph.mds.l.smithi122.stdout:Jun 06 03:21:45 smithi122 systemd[1]: Started Ceph mds.l for b6263b26-23b2-11ef-bc9b-c7b262605968. 2024-06-06T03:21:46.950 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:46 smithi079 ceph-mon[35478]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:46.950 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:46 smithi079 ceph-mon[35478]: mds.? [v2:172.21.15.122:6832/57533154,v1:172.21.15.122:6833/57533154] up:boot 2024-06-06T03:21:46.950 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:46 smithi079 ceph-mon[35478]: fsmap 1 up:standby 2024-06-06T03:21:46.950 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:46 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-06T03:21:46.950 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:46 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:46.950 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:46 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:46.950 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:46 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/2408855386' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:21:46.950 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:46 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:46.950 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:46 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:21:46.950 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:46 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:21:46.951 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:46 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:46.951 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:46 smithi079 ceph-mon[35478]: Deploying daemon mds.k on smithi079 2024-06-06T03:21:47.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:46 smithi050 ceph-mon[32421]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:47.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:46 smithi050 ceph-mon[32421]: mds.? [v2:172.21.15.122:6832/57533154,v1:172.21.15.122:6833/57533154] up:boot 2024-06-06T03:21:47.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:46 smithi050 ceph-mon[32421]: fsmap 1 up:standby 2024-06-06T03:21:47.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:46 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-06T03:21:47.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:46 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:47.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:46 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:47.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:46 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/2408855386' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:21:47.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:46 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:47.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:46 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:21:47.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:46 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:21:47.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:46 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:47.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:46 smithi050 ceph-mon[32421]: Deploying daemon mds.k on smithi079 2024-06-06T03:21:47.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:46 smithi122 ceph-mon[35759]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:47.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:46 smithi122 ceph-mon[35759]: mds.? [v2:172.21.15.122:6832/57533154,v1:172.21.15.122:6833/57533154] up:boot 2024-06-06T03:21:47.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:46 smithi122 ceph-mon[35759]: fsmap 1 up:standby 2024-06-06T03:21:47.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:46 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-06T03:21:47.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:46 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:47.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:46 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:47.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:46 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/2408855386' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:21:47.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:46 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:47.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:46 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:21:47.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:46 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:21:47.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:46 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:47.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:46 smithi122 ceph-mon[35759]: Deploying daemon mds.k on smithi079 2024-06-06T03:21:48.600 INFO:journalctl@ceph.mds.k.smithi079.stdout:Jun 06 03:21:48 smithi079 systemd[1]: Starting Ceph mds.k for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:21:48.784 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T03:21:48.900 INFO:journalctl@ceph.mds.k.smithi079.stdout:Jun 06 03:21:48 smithi079 podman[64507]: 2024-06-06 03:21:48.518067287 +0000 UTC m=+0.017675360 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T03:21:48.900 INFO:journalctl@ceph.mds.k.smithi079.stdout:Jun 06 03:21:48 smithi079 podman[64507]: 2024-06-06 03:21:48.63940306 +0000 UTC m=+0.139011112 container create ffda9cce81842fc51da2b42c2f62db4ff758fdd5b05a8bf9914e4fabb2b36922 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-k, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, ceph=True, GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-06-06T03:21:49.047 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:21:49.171 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:48 smithi050 ceph-mon[32421]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:49.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:48 smithi122 ceph-mon[35759]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:49.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:48 smithi079 ceph-mon[35478]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:49.350 INFO:journalctl@ceph.mds.k.smithi079.stdout:Jun 06 03:21:48 smithi079 podman[64507]: 2024-06-06 03:21:48.901837587 +0000 UTC m=+0.401445655 container init ffda9cce81842fc51da2b42c2f62db4ff758fdd5b05a8bf9914e4fabb2b36922 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-k, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528) 2024-06-06T03:21:49.350 INFO:journalctl@ceph.mds.k.smithi079.stdout:Jun 06 03:21:48 smithi079 podman[64507]: 2024-06-06 03:21:48.905100509 +0000 UTC m=+0.404708577 container start ffda9cce81842fc51da2b42c2f62db4ff758fdd5b05a8bf9914e4fabb2b36922 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-k, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-3d89acc, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T03:21:49.350 INFO:journalctl@ceph.mds.k.smithi079.stdout:Jun 06 03:21:48 smithi079 ceph-mds[64526]: -- 172.21.15.79:0/490986706 <== mon.2 v2:172.21.15.79:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557ef8989a40 con 0x557ef895d000 2024-06-06T03:21:49.350 INFO:journalctl@ceph.mds.k.smithi079.stdout:Jun 06 03:21:48 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-k[64522]: starting mds.k at 2024-06-06T03:21:49.350 INFO:journalctl@ceph.mds.k.smithi079.stdout:Jun 06 03:21:49 smithi079 bash[64507]: ffda9cce81842fc51da2b42c2f62db4ff758fdd5b05a8bf9914e4fabb2b36922 2024-06-06T03:21:49.350 INFO:journalctl@ceph.mds.k.smithi079.stdout:Jun 06 03:21:49 smithi079 systemd[1]: Started Ceph mds.k for b6263b26-23b2-11ef-bc9b-c7b262605968. 2024-06-06T03:21:50.316 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:50 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:50.316 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:50 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:50.316 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:50 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:50.316 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:50 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:21:50.316 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:50 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:21:50.317 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:50 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:50.317 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:50 smithi079 ceph-mon[35478]: Deploying daemon mds.j on smithi050 2024-06-06T03:21:50.317 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:50 smithi079 ceph-mon[35478]: mds.? [v2:172.21.15.79:6832/864537078,v1:172.21.15.79:6833/864537078] up:boot 2024-06-06T03:21:50.317 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:50 smithi079 ceph-mon[35478]: fsmap 2 up:standby 2024-06-06T03:21:50.317 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:50 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-06T03:21:50.358 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:50 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:50.359 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:50 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:50.359 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:50 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:50.359 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:50 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:21:50.359 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:50 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:21:50.359 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:50 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:50.359 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:50 smithi050 ceph-mon[32421]: Deploying daemon mds.j on smithi050 2024-06-06T03:21:50.359 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:50 smithi050 ceph-mon[32421]: mds.? [v2:172.21.15.79:6832/864537078,v1:172.21.15.79:6833/864537078] up:boot 2024-06-06T03:21:50.359 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:50 smithi050 ceph-mon[32421]: fsmap 2 up:standby 2024-06-06T03:21:50.359 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:50 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-06T03:21:50.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:50 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:50.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:50 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:50.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:50 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:50.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:50 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:21:50.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:50 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:21:50.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:50 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:50.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:50 smithi122 ceph-mon[35759]: Deploying daemon mds.j on smithi050 2024-06-06T03:21:50.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:50 smithi122 ceph-mon[35759]: mds.? [v2:172.21.15.79:6832/864537078,v1:172.21.15.79:6833/864537078] up:boot 2024-06-06T03:21:50.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:50 smithi122 ceph-mon[35759]: fsmap 2 up:standby 2024-06-06T03:21:50.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:50 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-06T03:21:50.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.777+0000 7fad9ace9700 1 -- 172.21.15.50:0/3913299039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad94101d30 msgr2=0x7fad9410e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:50.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.777+0000 7fad9ace9700 1 --2- 172.21.15.50:0/3913299039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad94101d30 0x7fad9410e210 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00b0a0 tx=0x7fad8c00b3b0 comp rx=0 tx=0).stop 2024-06-06T03:21:50.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.777+0000 7fad9ace9700 1 -- 172.21.15.50:0/3913299039 shutdown_connections 2024-06-06T03:21:50.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.777+0000 7fad9ace9700 1 --2- 172.21.15.50:0/3913299039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad94101d30 0x7fad9410e210 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:50.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.777+0000 7fad9ace9700 1 --2- 172.21.15.50:0/3913299039 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad941073d0 0x7fad941077b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:50.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.777+0000 7fad9ace9700 1 --2- 172.21.15.50:0/3913299039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad94101390 0x7fad941017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:50.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.777+0000 7fad9ace9700 1 -- 172.21.15.50:0/3913299039 >> 172.21.15.50:0/3913299039 conn(0x7fad940782c0 msgr2=0x7fad940786d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:21:50.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.777+0000 7fad9ace9700 1 -- 172.21.15.50:0/3913299039 shutdown_connections 2024-06-06T03:21:50.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.777+0000 7fad9ace9700 1 -- 172.21.15.50:0/3913299039 wait complete. 2024-06-06T03:21:50.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.778+0000 7fad9ace9700 1 Processor -- start 2024-06-06T03:21:50.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.778+0000 7fad9ace9700 1 -- start start 2024-06-06T03:21:50.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.778+0000 7fad9ace9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad94101390 0x7fad9419e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:50.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.778+0000 7fad9ace9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad94101d30 0x7fad9419ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:50.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.778+0000 7fad9ace9700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad941073d0 0x7fad94198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:50.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.778+0000 7fad9ace9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fad941114d0 con 0x7fad94101390 2024-06-06T03:21:50.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.778+0000 7fad9ace9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fad94111350 con 0x7fad94101d30 2024-06-06T03:21:50.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.778+0000 7fad9ace9700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fad94111650 con 0x7fad941073d0 2024-06-06T03:21:50.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.778+0000 7fad98a85700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad94101390 0x7fad9419e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:50.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.778+0000 7fad98a85700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad94101390 0x7fad9419e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59808/0 (socket says 172.21.15.50:59808) 2024-06-06T03:21:50.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.778+0000 7fad98a85700 1 -- 172.21.15.50:0/352759248 learned_addr learned my addr 172.21.15.50:0/352759248 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:21:50.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.778+0000 7fad93fff700 1 --2- 172.21.15.50:0/352759248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad94101d30 0x7fad9419ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:50.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.778+0000 7fad99286700 1 --2- 172.21.15.50:0/352759248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad941073d0 0x7fad94198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:50.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.779+0000 7fad93fff700 1 -- 172.21.15.50:0/352759248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad941073d0 msgr2=0x7fad94198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:50.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.779+0000 7fad93fff700 1 --2- 172.21.15.50:0/352759248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad941073d0 0x7fad94198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:50.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.779+0000 7fad93fff700 1 -- 172.21.15.50:0/352759248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad94101390 msgr2=0x7fad9419e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:50.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.779+0000 7fad93fff700 1 --2- 172.21.15.50:0/352759248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad94101390 0x7fad9419e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:50.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.779+0000 7fad93fff700 1 -- 172.21.15.50:0/352759248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad941990a0 con 0x7fad94101d30 2024-06-06T03:21:50.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.779+0000 7fad98a85700 1 --2- 172.21.15.50:0/352759248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad94101390 0x7fad9419e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:21:50.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.779+0000 7fad93fff700 1 --2- 172.21.15.50:0/352759248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad94101d30 0x7fad9419ec70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fad8800e9f0 tx=0x7fad8800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:21:50.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.779+0000 7fad91ffb700 1 -- 172.21.15.50:0/352759248 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8800c9c0 con 0x7fad94101d30 2024-06-06T03:21:50.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.779+0000 7fad9ace9700 1 -- 172.21.15.50:0/352759248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad94199390 con 0x7fad94101d30 2024-06-06T03:21:50.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.779+0000 7fad91ffb700 1 -- 172.21.15.50:0/352759248 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fad8800cb60 con 0x7fad94101d30 2024-06-06T03:21:50.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.779+0000 7fad91ffb700 1 -- 172.21.15.50:0/352759248 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad88018680 con 0x7fad94101d30 2024-06-06T03:21:50.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.779+0000 7fad9ace9700 1 -- 172.21.15.50:0/352759248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad941a5600 con 0x7fad94101d30 2024-06-06T03:21:50.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.780+0000 7fad9ace9700 1 -- 172.21.15.50:0/352759248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad94069180 con 0x7fad94101d30 2024-06-06T03:21:50.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.781+0000 7fad91ffb700 1 -- 172.21.15.50:0/352759248 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fad88010430 con 0x7fad94101d30 2024-06-06T03:21:50.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.782+0000 7fad91ffb700 1 --2- 172.21.15.50:0/352759248 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fad7c0a2c20 0x7fad7c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:50.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.782+0000 7fad98a85700 1 --2- 172.21.15.50:0/352759248 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fad7c0a2c20 0x7fad7c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:50.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.782+0000 7fad91ffb700 1 -- 172.21.15.50:0/352759248 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fad880cf1c0 con 0x7fad94101d30 2024-06-06T03:21:50.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.782+0000 7fad98a85700 1 --2- 172.21.15.50:0/352759248 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fad7c0a2c20 0x7fad7c0a50e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fad84005950 tx=0x7fad8400a400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:21:50.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:50.785+0000 7fad91ffb700 1 -- 172.21.15.50:0/352759248 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fad8809c520 con 0x7fad94101d30 2024-06-06T03:21:51.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:51.042+0000 7fad9ace9700 1 -- 172.21.15.50:0/352759248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fad94199e20 con 0x7fad94101d30 2024-06-06T03:21:51.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:51.043+0000 7fad91ffb700 1 -- 172.21.15.50:0/352759248 <== mon.2 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2212 (secure 0 0 0) 0x7fad8809be20 con 0x7fad94101d30 2024-06-06T03:21:51.043 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:21:51.043 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/864537078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":864537078},{"type":"v1","addr":"172.21.15.79:6833","nonce":864537078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/57533154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":57533154},{"type":"v1","addr":"172.21.15.122:6833","nonce":57533154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-06-06T03:21:51.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:51.045+0000 7fad9ace9700 1 -- 172.21.15.50:0/352759248 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fad7c0a2c20 msgr2=0x7fad7c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:51.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:51.045+0000 7fad9ace9700 1 --2- 172.21.15.50:0/352759248 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fad7c0a2c20 0x7fad7c0a50e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fad84005950 tx=0x7fad8400a400 comp rx=0 tx=0).stop 2024-06-06T03:21:51.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:51.045+0000 7fad9ace9700 1 -- 172.21.15.50:0/352759248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad94101d30 msgr2=0x7fad9419ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:51.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:51.045+0000 7fad9ace9700 1 --2- 172.21.15.50:0/352759248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad94101d30 0x7fad9419ec70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fad8800e9f0 tx=0x7fad8800ed00 comp rx=0 tx=0).stop 2024-06-06T03:21:51.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:51.045+0000 7fad9ace9700 1 -- 172.21.15.50:0/352759248 shutdown_connections 2024-06-06T03:21:51.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:51.045+0000 7fad9ace9700 1 --2- 172.21.15.50:0/352759248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad941073d0 0x7fad94198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:51.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:51.045+0000 7fad9ace9700 1 --2- 172.21.15.50:0/352759248 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fad7c0a2c20 0x7fad7c0a50e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:51.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:51.045+0000 7fad9ace9700 1 --2- 172.21.15.50:0/352759248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad94101390 0x7fad9419e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:51.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:51.045+0000 7fad9ace9700 1 --2- 172.21.15.50:0/352759248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad94101d30 0x7fad9419ec70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:51.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:51.045+0000 7fad9ace9700 1 -- 172.21.15.50:0/352759248 >> 172.21.15.50:0/352759248 conn(0x7fad940782c0 msgr2=0x7fad94100730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:21:51.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:51.045+0000 7fad9ace9700 1 -- 172.21.15.50:0/352759248 shutdown_connections 2024-06-06T03:21:51.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:51.045+0000 7fad9ace9700 1 -- 172.21.15.50:0/352759248 wait complete. 2024-06-06T03:21:51.046 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 3 2024-06-06T03:21:51.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:51 smithi050 ceph-mon[32421]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:51.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:51 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/352759248' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:21:51.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:51 smithi079 ceph-mon[35478]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:51.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:51 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/352759248' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:21:51.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:51 smithi122 ceph-mon[35759]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:51.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:51 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/352759248' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:21:53.098 INFO:journalctl@ceph.mds.j.smithi050.stdout:Jun 06 03:21:53 smithi050 systemd[1]: Starting Ceph mds.j for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:21:53.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:53 smithi079 ceph-mon[35478]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:53.380 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:53 smithi050 ceph-mon[32421]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:53.380 INFO:journalctl@ceph.mds.j.smithi050.stdout:Jun 06 03:21:53 smithi050 podman[72576]: 2024-06-06 03:21:53.159235478 +0000 UTC m=+0.018095574 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T03:21:53.380 INFO:journalctl@ceph.mds.j.smithi050.stdout:Jun 06 03:21:53 smithi050 podman[72576]: 2024-06-06 03:21:53.272426033 +0000 UTC m=+0.131286126 container create 29b68f57afbb962cefc68dc29087bf5561fc1274361060d2e95c9ade7f4654fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-j, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T03:21:53.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:53 smithi122 ceph-mon[35759]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:53.751 INFO:journalctl@ceph.mds.j.smithi050.stdout:Jun 06 03:21:53 smithi050 podman[72576]: 2024-06-06 03:21:53.508731546 +0000 UTC m=+0.367591635 container init 29b68f57afbb962cefc68dc29087bf5561fc1274361060d2e95c9ade7f4654fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-j, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-06-06T03:21:53.751 INFO:journalctl@ceph.mds.j.smithi050.stdout:Jun 06 03:21:53 smithi050 podman[72576]: 2024-06-06 03:21:53.511831738 +0000 UTC m=+0.370691836 container start 29b68f57afbb962cefc68dc29087bf5561fc1274361060d2e95c9ade7f4654fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-06T03:21:53.751 INFO:journalctl@ceph.mds.j.smithi050.stdout:Jun 06 03:21:53 smithi050 ceph-mds[72603]: -- 172.21.15.50:0/2640800352 <== mon.0 v2:172.21.15.50:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563d12175a40 con 0x563d12148c00 2024-06-06T03:21:53.751 INFO:journalctl@ceph.mds.j.smithi050.stdout:Jun 06 03:21:53 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-j[72591]: starting mds.j at 2024-06-06T03:21:53.751 INFO:journalctl@ceph.mds.j.smithi050.stdout:Jun 06 03:21:53 smithi050 bash[72576]: 29b68f57afbb962cefc68dc29087bf5561fc1274361060d2e95c9ade7f4654fc 2024-06-06T03:21:53.752 INFO:journalctl@ceph.mds.j.smithi050.stdout:Jun 06 03:21:53 smithi050 systemd[1]: Started Ceph mds.j for b6263b26-23b2-11ef-bc9b-c7b262605968. 2024-06-06T03:21:54.119 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T03:21:54.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:54 smithi050 ceph-mon[32421]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:54.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:54 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:54.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:54 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:54.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:54 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:54.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:54 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:21:54.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:54 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:21:54.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:54 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:54.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:54 smithi050 ceph-mon[32421]: Deploying daemon mds.d on smithi050 2024-06-06T03:21:54.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:54 smithi050 ceph-mon[32421]: mds.? [v2:172.21.15.50:6834/1667847852,v1:172.21.15.50:6835/1667847852] up:boot 2024-06-06T03:21:54.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:54 smithi050 ceph-mon[32421]: fsmap 3 up:standby 2024-06-06T03:21:54.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:54 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-06T03:21:54.908 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:21:54.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:54 smithi122 ceph-mon[35759]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:54.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:54 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:54.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:54 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:54.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:54 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:54.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:54 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:21:54.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:54 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:21:54.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:54 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:54.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:54 smithi122 ceph-mon[35759]: Deploying daemon mds.d on smithi050 2024-06-06T03:21:54.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:54 smithi122 ceph-mon[35759]: mds.? [v2:172.21.15.50:6834/1667847852,v1:172.21.15.50:6835/1667847852] up:boot 2024-06-06T03:21:54.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:54 smithi122 ceph-mon[35759]: fsmap 3 up:standby 2024-06-06T03:21:54.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:54 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-06T03:21:55.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:54 smithi079 ceph-mon[35478]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:55.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:54 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:55.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:54 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:55.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:54 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:55.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:54 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:21:55.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:54 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:21:55.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:54 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:55.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:54 smithi079 ceph-mon[35478]: Deploying daemon mds.d on smithi050 2024-06-06T03:21:55.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:54 smithi079 ceph-mon[35478]: mds.? [v2:172.21.15.50:6834/1667847852,v1:172.21.15.50:6835/1667847852] up:boot 2024-06-06T03:21:55.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:54 smithi079 ceph-mon[35478]: fsmap 3 up:standby 2024-06-06T03:21:55.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:54 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-06T03:21:56.830 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:56 smithi050 ceph-mon[32421]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:56.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:56 smithi122 ceph-mon[35759]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:57.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.085+0000 7f927240f700 1 -- 172.21.15.50:0/899486137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f926c101d50 msgr2=0x7f926c10e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:57.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.085+0000 7f927240f700 1 --2- 172.21.15.50:0/899486137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f926c101d50 0x7f926c10e240 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f925400b0a0 tx=0x7f925400b3b0 comp rx=0 tx=0).stop 2024-06-06T03:21:57.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.085+0000 7f927240f700 1 -- 172.21.15.50:0/899486137 shutdown_connections 2024-06-06T03:21:57.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.085+0000 7f927240f700 1 --2- 172.21.15.50:0/899486137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f926c101d50 0x7f926c10e240 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:57.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.085+0000 7f927240f700 1 --2- 172.21.15.50:0/899486137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f926c107400 0x7f926c1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:57.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.085+0000 7f927240f700 1 --2- 172.21.15.50:0/899486137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f926c101390 0x7f926c101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:57.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.085+0000 7f927240f700 1 -- 172.21.15.50:0/899486137 >> 172.21.15.50:0/899486137 conn(0x7f926c078340 msgr2=0x7f926c078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:21:57.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.085+0000 7f927240f700 1 -- 172.21.15.50:0/899486137 shutdown_connections 2024-06-06T03:21:57.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.085+0000 7f927240f700 1 -- 172.21.15.50:0/899486137 wait complete. 2024-06-06T03:21:57.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.086+0000 7f927240f700 1 Processor -- start 2024-06-06T03:21:57.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.086+0000 7f927240f700 1 -- start start 2024-06-06T03:21:57.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.086+0000 7f927240f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f926c101390 0x7f926c199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:57.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.086+0000 7f927240f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f926c101d50 0x7f926c199e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:57.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.086+0000 7f927240f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f926c107400 0x7f926c1a4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:57.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.086+0000 7f927240f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f926c111570 con 0x7f926c101d50 2024-06-06T03:21:57.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.086+0000 7f927240f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f926c1113f0 con 0x7f926c107400 2024-06-06T03:21:57.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.086+0000 7f927240f700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f926c1116f0 con 0x7f926c101390 2024-06-06T03:21:57.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.086+0000 7f926b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f926c101d50 0x7f926c199e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:57.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.087+0000 7f926b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f926c101d50 0x7f926c199e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59848/0 (socket says 172.21.15.50:59848) 2024-06-06T03:21:57.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.087+0000 7f926bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f926c101390 0x7f926c199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:57.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.087+0000 7f926b7fe700 1 -- 172.21.15.50:0/3869330837 learned_addr learned my addr 172.21.15.50:0/3869330837 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:21:57.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.087+0000 7f92709ac700 1 --2- 172.21.15.50:0/3869330837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f926c107400 0x7f926c1a4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:57.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.087+0000 7f926b7fe700 1 -- 172.21.15.50:0/3869330837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f926c101390 msgr2=0x7f926c199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:57.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.087+0000 7f926b7fe700 1 --2- 172.21.15.50:0/3869330837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f926c101390 0x7f926c199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:57.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.087+0000 7f926b7fe700 1 -- 172.21.15.50:0/3869330837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f926c107400 msgr2=0x7f926c1a4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:57.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.087+0000 7f926b7fe700 1 --2- 172.21.15.50:0/3869330837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f926c107400 0x7f926c1a4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:57.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.087+0000 7f926b7fe700 1 -- 172.21.15.50:0/3869330837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f926c1a4ed0 con 0x7f926c101d50 2024-06-06T03:21:57.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.087+0000 7f926bfff700 1 --2- 172.21.15.50:0/3869330837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f926c101390 0x7f926c199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:21:57.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.087+0000 7f926b7fe700 1 --2- 172.21.15.50:0/3869330837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f926c101d50 0x7f926c199e50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f925c00d980 tx=0x7f925c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:21:57.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.087+0000 7f92697fa700 1 -- 172.21.15.50:0/3869330837 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c016070 con 0x7f926c101d50 2024-06-06T03:21:57.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.087+0000 7f927240f700 1 -- 172.21.15.50:0/3869330837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f926c1a5160 con 0x7f926c101d50 2024-06-06T03:21:57.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.087+0000 7f92697fa700 1 -- 172.21.15.50:0/3869330837 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f925c004830 con 0x7f926c101d50 2024-06-06T03:21:57.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.087+0000 7f92697fa700 1 -- 172.21.15.50:0/3869330837 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c005530 con 0x7f926c101d50 2024-06-06T03:21:57.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.088+0000 7f927240f700 1 -- 172.21.15.50:0/3869330837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f926c1a56c0 con 0x7f926c101d50 2024-06-06T03:21:57.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.089+0000 7f927240f700 1 -- 172.21.15.50:0/3869330837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f926c069180 con 0x7f926c101d50 2024-06-06T03:21:57.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.091+0000 7f92697fa700 1 -- 172.21.15.50:0/3869330837 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f925c0049e0 con 0x7f926c101d50 2024-06-06T03:21:57.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.092+0000 7f92697fa700 1 --2- 172.21.15.50:0/3869330837 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f92580a2c20 0x7f92580a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:21:57.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.092+0000 7f926bfff700 1 --2- 172.21.15.50:0/3869330837 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f92580a2c20 0x7f92580a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:21:57.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.092+0000 7f92697fa700 1 -- 172.21.15.50:0/3869330837 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f925c0ce8b0 con 0x7f926c101d50 2024-06-06T03:21:57.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.092+0000 7f926bfff700 1 --2- 172.21.15.50:0/3869330837 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f92580a2c20 0x7f92580a50e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9264005950 tx=0x7f926400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:21:57.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.097+0000 7f92697fa700 1 -- 172.21.15.50:0/3869330837 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f925c01f020 con 0x7f926c101d50 2024-06-06T03:21:57.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:56 smithi079 ceph-mon[35478]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:57.354 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:21:57.354 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1667847852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1667847852},{"type":"v1","addr":"172.21.15.50:6835","nonce":1667847852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/864537078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":864537078},{"type":"v1","addr":"172.21.15.79:6833","nonce":864537078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/57533154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":57533154},{"type":"v1","addr":"172.21.15.122:6833","nonce":57533154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-06-06T03:21:57.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.354+0000 7f927240f700 1 -- 172.21.15.50:0/3869330837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f926c06a7c0 con 0x7f926c101d50 2024-06-06T03:21:57.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.355+0000 7f92697fa700 1 -- 172.21.15.50:0/3869330837 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3037 (secure 0 0 0) 0x7f925c09bcb0 con 0x7f926c101d50 2024-06-06T03:21:57.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.357+0000 7f927240f700 1 -- 172.21.15.50:0/3869330837 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f92580a2c20 msgr2=0x7f92580a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:57.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.357+0000 7f927240f700 1 --2- 172.21.15.50:0/3869330837 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f92580a2c20 0x7f92580a50e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9264005950 tx=0x7f926400a300 comp rx=0 tx=0).stop 2024-06-06T03:21:57.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.357+0000 7f927240f700 1 -- 172.21.15.50:0/3869330837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f926c101d50 msgr2=0x7f926c199e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:21:57.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.357+0000 7f927240f700 1 --2- 172.21.15.50:0/3869330837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f926c101d50 0x7f926c199e50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f925c00d980 tx=0x7f925c00dc90 comp rx=0 tx=0).stop 2024-06-06T03:21:57.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.357+0000 7f927240f700 1 -- 172.21.15.50:0/3869330837 shutdown_connections 2024-06-06T03:21:57.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.357+0000 7f927240f700 1 --2- 172.21.15.50:0/3869330837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f926c107400 0x7f926c1a4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:57.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.357+0000 7f927240f700 1 --2- 172.21.15.50:0/3869330837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f926c101390 0x7f926c199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:57.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.357+0000 7f927240f700 1 --2- 172.21.15.50:0/3869330837 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f92580a2c20 0x7f92580a50e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:57.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.357+0000 7f927240f700 1 --2- 172.21.15.50:0/3869330837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f926c101d50 0x7f926c199e50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:21:57.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.357+0000 7f927240f700 1 -- 172.21.15.50:0/3869330837 >> 172.21.15.50:0/3869330837 conn(0x7f926c078340 msgr2=0x7f926c0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:21:57.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.357+0000 7f927240f700 1 -- 172.21.15.50:0/3869330837 shutdown_connections 2024-06-06T03:21:57.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:21:57.357+0000 7f927240f700 1 -- 172.21.15.50:0/3869330837 wait complete. 2024-06-06T03:21:57.357 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 4 2024-06-06T03:21:57.611 INFO:journalctl@ceph.mds.d.smithi050.stdout:Jun 06 03:21:57 smithi050 systemd[1]: Started Ceph mds.d for b6263b26-23b2-11ef-bc9b-c7b262605968. 2024-06-06T03:21:57.866 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:57 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3869330837' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:21:57.866 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:57 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:57.866 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:57 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:57.866 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:57 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:57.867 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:57 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:21:57.867 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:57 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:21:57.867 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:57 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:57.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:57 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/3869330837' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:21:57.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:57 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:57.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:57 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:57.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:57 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:57.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:57 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:21:57.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:57 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:21:57.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:57 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:58.001 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:57 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/3869330837' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:21:58.001 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:57 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:58.001 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:57 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:58.001 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:57 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:21:58.001 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:57 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:21:58.001 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:57 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:21:58.001 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:57 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:21:58.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:58 smithi079 ceph-mon[35478]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:58.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:58 smithi079 ceph-mon[35478]: Deploying daemon mds.e on smithi079 2024-06-06T03:21:58.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:58 smithi079 ceph-mon[35478]: mds.? [v2:172.21.15.50:6836/239971838,v1:172.21.15.50:6837/239971838] up:boot 2024-06-06T03:21:58.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:58 smithi079 ceph-mon[35478]: fsmap 4 up:standby 2024-06-06T03:21:58.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:21:58 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-06T03:21:58.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:58 smithi122 ceph-mon[35759]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:58.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:58 smithi122 ceph-mon[35759]: Deploying daemon mds.e on smithi079 2024-06-06T03:21:58.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:58 smithi122 ceph-mon[35759]: mds.? [v2:172.21.15.50:6836/239971838,v1:172.21.15.50:6837/239971838] up:boot 2024-06-06T03:21:58.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:58 smithi122 ceph-mon[35759]: fsmap 4 up:standby 2024-06-06T03:21:58.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:21:58 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-06T03:21:59.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:58 smithi050 ceph-mon[32421]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:21:59.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:58 smithi050 ceph-mon[32421]: Deploying daemon mds.e on smithi079 2024-06-06T03:21:59.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:58 smithi050 ceph-mon[32421]: mds.? [v2:172.21.15.50:6836/239971838,v1:172.21.15.50:6837/239971838] up:boot 2024-06-06T03:21:59.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:58 smithi050 ceph-mon[32421]: fsmap 4 up:standby 2024-06-06T03:21:59.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:21:58 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-06T03:21:59.980 INFO:journalctl@ceph.mds.e.smithi079.stdout:Jun 06 03:21:59 smithi079 systemd[1]: Starting Ceph mds.e for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:22:00.193 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T03:22:00.335 INFO:journalctl@ceph.mds.e.smithi079.stdout:Jun 06 03:22:00 smithi079 podman[64820]: 2024-06-06 03:22:00.09949371 +0000 UTC m=+0.016914503 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T03:22:00.336 INFO:journalctl@ceph.mds.e.smithi079.stdout:Jun 06 03:22:00 smithi079 podman[64820]: 2024-06-06 03:22:00.214984629 +0000 UTC m=+0.132405406 container create 099ff07748198793a62b89bb8fcd8631e6c3ce5bf1be9589561e73809827b96c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-e, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-06-06T03:22:00.458 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:22:00.741 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:00 smithi079 ceph-mon[35478]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:00.741 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:00 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:00.741 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:00 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:00.741 INFO:journalctl@ceph.mds.e.smithi079.stdout:Jun 06 03:22:00 smithi079 podman[64820]: 2024-06-06 03:22:00.476382627 +0000 UTC m=+0.393803396 container init 099ff07748198793a62b89bb8fcd8631e6c3ce5bf1be9589561e73809827b96c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-e, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc) 2024-06-06T03:22:00.741 INFO:journalctl@ceph.mds.e.smithi079.stdout:Jun 06 03:22:00 smithi079 podman[64820]: 2024-06-06 03:22:00.479299948 +0000 UTC m=+0.396720733 container start 099ff07748198793a62b89bb8fcd8631e6c3ce5bf1be9589561e73809827b96c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-e, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, ceph=True, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-06-06T03:22:00.741 INFO:journalctl@ceph.mds.e.smithi079.stdout:Jun 06 03:22:00 smithi079 ceph-mds[64839]: -- 172.21.15.79:0/75614289 <== mon.2 v2:172.21.15.79:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557b6073fa40 con 0x557b60712800 2024-06-06T03:22:00.741 INFO:journalctl@ceph.mds.e.smithi079.stdout:Jun 06 03:22:00 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-e[64835]: starting mds.e at 2024-06-06T03:22:00.742 INFO:journalctl@ceph.mds.e.smithi079.stdout:Jun 06 03:22:00 smithi079 bash[64820]: 099ff07748198793a62b89bb8fcd8631e6c3ce5bf1be9589561e73809827b96c 2024-06-06T03:22:00.742 INFO:journalctl@ceph.mds.e.smithi079.stdout:Jun 06 03:22:00 smithi079 systemd[1]: Started Ceph mds.e for b6263b26-23b2-11ef-bc9b-c7b262605968. 2024-06-06T03:22:00.885 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:00 smithi050 ceph-mon[32421]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:00.885 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:00 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:00.885 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:00 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:00.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:00 smithi122 ceph-mon[35759]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:00.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:00 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:00.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:00 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:01.926 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:01 smithi050 ceph-mon[32421]: mds.? [v2:172.21.15.79:6834/279268898,v1:172.21.15.79:6835/279268898] up:boot 2024-06-06T03:22:01.926 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:01 smithi050 ceph-mon[32421]: fsmap 5 up:standby 2024-06-06T03:22:01.926 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:01 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-06T03:22:01.926 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:01 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:01.927 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:01 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:22:01.927 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:01 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:22:01.927 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:01 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:22:01.927 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:01 smithi050 ceph-mon[32421]: Deploying daemon mds.f on smithi122 2024-06-06T03:22:01.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:01 smithi122 ceph-mon[35759]: mds.? [v2:172.21.15.79:6834/279268898,v1:172.21.15.79:6835/279268898] up:boot 2024-06-06T03:22:01.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:01 smithi122 ceph-mon[35759]: fsmap 5 up:standby 2024-06-06T03:22:01.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:01 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-06T03:22:01.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:01 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:01.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:01 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:22:01.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:01 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:22:01.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:01 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:22:01.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:01 smithi122 ceph-mon[35759]: Deploying daemon mds.f on smithi122 2024-06-06T03:22:02.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:01 smithi079 ceph-mon[35478]: mds.? [v2:172.21.15.79:6834/279268898,v1:172.21.15.79:6835/279268898] up:boot 2024-06-06T03:22:02.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:01 smithi079 ceph-mon[35478]: fsmap 5 up:standby 2024-06-06T03:22:02.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:01 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-06T03:22:02.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:01 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:02.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:01 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:22:02.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:01 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:22:02.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:01 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:22:02.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:01 smithi079 ceph-mon[35478]: Deploying daemon mds.f on smithi122 2024-06-06T03:22:02.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.170+0000 7f8f52a41700 1 -- 172.21.15.50:0/2575370513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f4c107400 msgr2=0x7f8f4c1077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:02.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.170+0000 7f8f52a41700 1 --2- 172.21.15.50:0/2575370513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f4c107400 0x7f8f4c1077e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c009990 tx=0x7f8f3c009ca0 comp rx=0 tx=0).stop 2024-06-06T03:22:02.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.170+0000 7f8f52a41700 1 -- 172.21.15.50:0/2575370513 shutdown_connections 2024-06-06T03:22:02.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.170+0000 7f8f52a41700 1 --2- 172.21.15.50:0/2575370513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f4c101d50 0x7f8f4c10e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:02.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.170+0000 7f8f52a41700 1 --2- 172.21.15.50:0/2575370513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f4c107400 0x7f8f4c1077e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:02.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.170+0000 7f8f52a41700 1 --2- 172.21.15.50:0/2575370513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f4c101390 0x7f8f4c101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:02.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.170+0000 7f8f52a41700 1 -- 172.21.15.50:0/2575370513 >> 172.21.15.50:0/2575370513 conn(0x7f8f4c078340 msgr2=0x7f8f4c078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:22:02.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.170+0000 7f8f52a41700 1 -- 172.21.15.50:0/2575370513 shutdown_connections 2024-06-06T03:22:02.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.170+0000 7f8f52a41700 1 -- 172.21.15.50:0/2575370513 wait complete. 2024-06-06T03:22:02.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.171+0000 7f8f52a41700 1 Processor -- start 2024-06-06T03:22:02.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.171+0000 7f8f52a41700 1 -- start start 2024-06-06T03:22:02.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.171+0000 7f8f52a41700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f4c101390 0x7f8f4c103070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:02.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.171+0000 7f8f52a41700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f4c101d50 0x7f8f4c1035b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:02.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.171+0000 7f8f52a41700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f4c107400 0x7f8f4c103af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:02.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.171+0000 7f8f52a41700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4c111570 con 0x7f8f4c101390 2024-06-06T03:22:02.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.171+0000 7f8f52a41700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4c1113f0 con 0x7f8f4c101d50 2024-06-06T03:22:02.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.171+0000 7f8f52a41700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4c1116f0 con 0x7f8f4c107400 2024-06-06T03:22:02.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.171+0000 7f8f4bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f4c101390 0x7f8f4c103070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:02.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.171+0000 7f8f4bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f4c101390 0x7f8f4c103070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44176/0 (socket says 172.21.15.50:44176) 2024-06-06T03:22:02.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.171+0000 7f8f4bfff700 1 -- 172.21.15.50:0/1579994701 learned_addr learned my addr 172.21.15.50:0/1579994701 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:22:02.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.172+0000 7f8f43fff700 1 --2- 172.21.15.50:0/1579994701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f4c101d50 0x7f8f4c1035b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:02.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.172+0000 7f8f50fde700 1 --2- 172.21.15.50:0/1579994701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f4c107400 0x7f8f4c103af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:02.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.172+0000 7f8f4bfff700 1 -- 172.21.15.50:0/1579994701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f4c107400 msgr2=0x7f8f4c103af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:02.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.172+0000 7f8f4bfff700 1 --2- 172.21.15.50:0/1579994701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f4c107400 0x7f8f4c103af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:02.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.172+0000 7f8f4bfff700 1 -- 172.21.15.50:0/1579994701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f4c101d50 msgr2=0x7f8f4c1035b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:02.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.172+0000 7f8f4bfff700 1 --2- 172.21.15.50:0/1579994701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f4c101d50 0x7f8f4c1035b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:02.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.172+0000 7f8f4bfff700 1 -- 172.21.15.50:0/1579994701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f4c1a70e0 con 0x7f8f4c101390 2024-06-06T03:22:02.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.172+0000 7f8f4bfff700 1 --2- 172.21.15.50:0/1579994701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f4c101390 0x7f8f4c103070 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c000c00 tx=0x7f8f3c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:22:02.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.172+0000 7f8f49ffb700 1 -- 172.21.15.50:0/1579994701 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c027070 con 0x7f8f4c101390 2024-06-06T03:22:02.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.172+0000 7f8f49ffb700 1 -- 172.21.15.50:0/1579994701 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8f3c004010 con 0x7f8f4c101390 2024-06-06T03:22:02.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.172+0000 7f8f52a41700 1 -- 172.21.15.50:0/1579994701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f4c1a7370 con 0x7f8f4c101390 2024-06-06T03:22:02.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.172+0000 7f8f49ffb700 1 -- 172.21.15.50:0/1579994701 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c00f460 con 0x7f8f4c101390 2024-06-06T03:22:02.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.172+0000 7f8f52a41700 1 -- 172.21.15.50:0/1579994701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f4c1a77c0 con 0x7f8f4c101390 2024-06-06T03:22:02.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.173+0000 7f8f52a41700 1 -- 172.21.15.50:0/1579994701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f4c069180 con 0x7f8f4c101390 2024-06-06T03:22:02.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.175+0000 7f8f49ffb700 1 -- 172.21.15.50:0/1579994701 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8f3c02a070 con 0x7f8f4c101390 2024-06-06T03:22:02.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.175+0000 7f8f49ffb700 1 --2- 172.21.15.50:0/1579994701 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8f380a2c20 0x7f8f380a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:02.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.175+0000 7f8f43fff700 1 --2- 172.21.15.50:0/1579994701 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8f380a2c20 0x7f8f380a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:02.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.175+0000 7f8f49ffb700 1 -- 172.21.15.50:0/1579994701 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f8f3c0d02a0 con 0x7f8f4c101390 2024-06-06T03:22:02.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.176+0000 7f8f43fff700 1 --2- 172.21.15.50:0/1579994701 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8f380a2c20 0x7f8f380a50e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c0788d0 tx=0x7f8f3400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:22:02.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.179+0000 7f8f49ffb700 1 -- 172.21.15.50:0/1579994701 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8f3c031070 con 0x7f8f4c101390 2024-06-06T03:22:02.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.433+0000 7f8f52a41700 1 -- 172.21.15.50:0/1579994701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f4c1a7ae0 con 0x7f8f4c101390 2024-06-06T03:22:02.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.433+0000 7f8f49ffb700 1 -- 172.21.15.50:0/1579994701 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4681 (secure 0 0 0) 0x7f8f3c013070 con 0x7f8f4c101390 2024-06-06T03:22:02.433 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:22:02.433 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1667847852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1667847852},{"type":"v1","addr":"172.21.15.50:6835","nonce":1667847852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/239971838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":239971838},{"type":"v1","addr":"172.21.15.50:6837","nonce":239971838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/864537078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":864537078},{"type":"v1","addr":"172.21.15.79:6833","nonce":864537078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/279268898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":279268898},{"type":"v1","addr":"172.21.15.79:6835","nonce":279268898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/57533154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":57533154},{"type":"v1","addr":"172.21.15.122:6833","nonce":57533154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-06-06T03:22:02.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.436+0000 7f8f52a41700 1 -- 172.21.15.50:0/1579994701 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8f380a2c20 msgr2=0x7f8f380a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:02.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.436+0000 7f8f52a41700 1 --2- 172.21.15.50:0/1579994701 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8f380a2c20 0x7f8f380a50e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c0788d0 tx=0x7f8f3400a300 comp rx=0 tx=0).stop 2024-06-06T03:22:02.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.436+0000 7f8f52a41700 1 -- 172.21.15.50:0/1579994701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f4c101390 msgr2=0x7f8f4c103070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:02.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.436+0000 7f8f52a41700 1 --2- 172.21.15.50:0/1579994701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f4c101390 0x7f8f4c103070 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c000c00 tx=0x7f8f3c0047b0 comp rx=0 tx=0).stop 2024-06-06T03:22:02.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.436+0000 7f8f52a41700 1 -- 172.21.15.50:0/1579994701 shutdown_connections 2024-06-06T03:22:02.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.436+0000 7f8f52a41700 1 --2- 172.21.15.50:0/1579994701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f4c107400 0x7f8f4c103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:02.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.436+0000 7f8f52a41700 1 --2- 172.21.15.50:0/1579994701 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8f380a2c20 0x7f8f380a50e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:02.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.436+0000 7f8f52a41700 1 --2- 172.21.15.50:0/1579994701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f4c101390 0x7f8f4c103070 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:02.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.436+0000 7f8f52a41700 1 --2- 172.21.15.50:0/1579994701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f4c101d50 0x7f8f4c1035b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:02.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.436+0000 7f8f52a41700 1 -- 172.21.15.50:0/1579994701 >> 172.21.15.50:0/1579994701 conn(0x7f8f4c078340 msgr2=0x7f8f4c06a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:22:02.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.436+0000 7f8f52a41700 1 -- 172.21.15.50:0/1579994701 shutdown_connections 2024-06-06T03:22:02.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:02.436+0000 7f8f52a41700 1 -- 172.21.15.50:0/1579994701 wait complete. 2024-06-06T03:22:02.436 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 6 2024-06-06T03:22:02.989 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:02 smithi050 ceph-mon[32421]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:02.990 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:02 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1579994701' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:22:03.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:02 smithi079 ceph-mon[35478]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:03.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:02 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/1579994701' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:22:03.105 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:02 smithi122 ceph-mon[35759]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:03.105 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:02 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/1579994701' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:22:03.105 INFO:journalctl@ceph.mds.f.smithi122.stdout:Jun 06 03:22:02 smithi122 systemd[1]: Starting Ceph mds.f for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:22:03.363 INFO:journalctl@ceph.mds.f.smithi122.stdout:Jun 06 03:22:03 smithi122 podman[65904]: 2024-06-06 03:22:03.008888307 +0000 UTC m=+0.016993579 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T03:22:03.364 INFO:journalctl@ceph.mds.f.smithi122.stdout:Jun 06 03:22:03 smithi122 podman[65904]: 2024-06-06 03:22:03.112118149 +0000 UTC m=+0.120223403 container create 7166a28c57a19faabfc3c4628fe646b3d2e460b9d21540c282f199e676a15fd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-f, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, GIT_CLEAN=True) 2024-06-06T03:22:03.364 INFO:journalctl@ceph.mds.f.smithi122.stdout:Jun 06 03:22:03 smithi122 podman[65904]: 2024-06-06 03:22:03.364972875 +0000 UTC m=+0.373078130 container init 7166a28c57a19faabfc3c4628fe646b3d2e460b9d21540c282f199e676a15fd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-06T03:22:03.681 INFO:journalctl@ceph.mds.f.smithi122.stdout:Jun 06 03:22:03 smithi122 podman[65904]: 2024-06-06 03:22:03.367711981 +0000 UTC m=+0.375817236 container start 7166a28c57a19faabfc3c4628fe646b3d2e460b9d21540c282f199e676a15fd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-f, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-06-06T03:22:03.681 INFO:journalctl@ceph.mds.f.smithi122.stdout:Jun 06 03:22:03 smithi122 ceph-mds[65924]: -- 172.21.15.122:0/1910630475 <== mon.1 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557b528e7a40 con 0x557b528bb000 2024-06-06T03:22:03.681 INFO:journalctl@ceph.mds.f.smithi122.stdout:Jun 06 03:22:03 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-f[65920]: starting mds.f at 2024-06-06T03:22:03.681 INFO:journalctl@ceph.mds.f.smithi122.stdout:Jun 06 03:22:03 smithi122 bash[65904]: 7166a28c57a19faabfc3c4628fe646b3d2e460b9d21540c282f199e676a15fd0 2024-06-06T03:22:03.681 INFO:journalctl@ceph.mds.f.smithi122.stdout:Jun 06 03:22:03 smithi122 systemd[1]: Started Ceph mds.f for b6263b26-23b2-11ef-bc9b-c7b262605968. 2024-06-06T03:22:04.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:04 smithi079 ceph-mon[35478]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:04.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:04 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:04.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:04 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:04.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:04 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:04.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:04 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:22:04.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:04 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:22:04.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:04 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:22:04.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:04 smithi079 ceph-mon[35478]: Deploying daemon mds.c on smithi122 2024-06-06T03:22:04.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:04 smithi079 ceph-mon[35478]: mds.? [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] up:boot 2024-06-06T03:22:04.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:04 smithi079 ceph-mon[35478]: fsmap 6 up:standby 2024-06-06T03:22:04.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:04 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-06T03:22:04.872 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:04 smithi122 ceph-mon[35759]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:04.872 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:04 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:04.872 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:04 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:04.872 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:04 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:04.872 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:04 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:22:04.872 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:04 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:22:04.872 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:04 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:22:04.872 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:04 smithi122 ceph-mon[35759]: Deploying daemon mds.c on smithi122 2024-06-06T03:22:04.872 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:04 smithi122 ceph-mon[35759]: mds.? [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] up:boot 2024-06-06T03:22:04.873 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:04 smithi122 ceph-mon[35759]: fsmap 6 up:standby 2024-06-06T03:22:04.873 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:04 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-06T03:22:05.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:04 smithi050 ceph-mon[32421]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:05.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:04 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:05.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:04 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:05.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:04 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:05.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:04 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:22:05.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:04 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:22:05.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:04 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:22:05.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:04 smithi050 ceph-mon[32421]: Deploying daemon mds.c on smithi122 2024-06-06T03:22:05.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:04 smithi050 ceph-mon[32421]: mds.? [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] up:boot 2024-06-06T03:22:05.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:04 smithi050 ceph-mon[32421]: fsmap 6 up:standby 2024-06-06T03:22:05.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:04 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-06T03:22:05.021 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T03:22:05.284 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:22:05.907 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:22:05 smithi122 systemd[1]: Starting Ceph mds.c for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:22:06.181 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:22:05 smithi122 podman[66203]: 2024-06-06 03:22:05.811094704 +0000 UTC m=+0.017455790 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T03:22:06.181 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:22:05 smithi122 podman[66203]: 2024-06-06 03:22:05.942951298 +0000 UTC m=+0.149312390 container create ebf5370b21a841a2c71bbc07406675ff53d4adbbcce0527890b1230e64ffd84f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-c, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, io.buildah.version=1.33.5) 2024-06-06T03:22:06.514 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:22:06 smithi122 podman[66203]: 2024-06-06 03:22:06.215963833 +0000 UTC m=+0.422324917 container init ebf5370b21a841a2c71bbc07406675ff53d4adbbcce0527890b1230e64ffd84f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-06-06T03:22:06.514 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:22:06 smithi122 podman[66203]: 2024-06-06 03:22:06.219000739 +0000 UTC m=+0.425361826 container start ebf5370b21a841a2c71bbc07406675ff53d4adbbcce0527890b1230e64ffd84f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc) 2024-06-06T03:22:06.514 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:22:06 smithi122 ceph-mds[66222]: -- 172.21.15.122:0/1682779055 <== mon.1 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562af2b3da40 con 0x562af2b10800 2024-06-06T03:22:06.514 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:22:06 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-c[66218]: starting mds.c at 2024-06-06T03:22:06.514 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:22:06 smithi122 bash[66203]: ebf5370b21a841a2c71bbc07406675ff53d4adbbcce0527890b1230e64ffd84f 2024-06-06T03:22:06.514 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:22:06 smithi122 systemd[1]: Started Ceph mds.c for b6263b26-23b2-11ef-bc9b-c7b262605968. 2024-06-06T03:22:06.683 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:06 smithi050 ceph-mon[32421]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:06.683 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:06 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:06.683 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:06 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:06.683 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:06 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:06.683 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:06 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:22:06.684 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:06 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:22:06.684 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:06 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:22:06.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:06 smithi079 ceph-mon[35478]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:06.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:06 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:06.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:06 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:06.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:06 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:06.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:06 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:22:06.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:06 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:22:06.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:06 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:22:06.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.926+0000 7fdc36a61700 1 -- 172.21.15.50:0/1743702897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc30108500 msgr2=0x7fdc301088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:06.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.926+0000 7fdc36a61700 1 --2- 172.21.15.50:0/1743702897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc30108500 0x7fdc301088e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdc20009990 tx=0x7fdc20009ca0 comp rx=0 tx=0).stop 2024-06-06T03:22:06.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.926+0000 7fdc36a61700 1 -- 172.21.15.50:0/1743702897 shutdown_connections 2024-06-06T03:22:06.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.926+0000 7fdc36a61700 1 --2- 172.21.15.50:0/1743702897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc3006ab30 0x7fdc3010f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:06.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.926+0000 7fdc36a61700 1 --2- 172.21.15.50:0/1743702897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc30108500 0x7fdc301088e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:06.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.926+0000 7fdc36a61700 1 --2- 172.21.15.50:0/1743702897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc3006a170 0x7fdc3006a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:06.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.926+0000 7fdc36a61700 1 -- 172.21.15.50:0/1743702897 >> 172.21.15.50:0/1743702897 conn(0x7fdc30078340 msgr2=0x7fdc30078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:22:06.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.926+0000 7fdc36a61700 1 -- 172.21.15.50:0/1743702897 shutdown_connections 2024-06-06T03:22:06.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.926+0000 7fdc36a61700 1 -- 172.21.15.50:0/1743702897 wait complete. 2024-06-06T03:22:06.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.927+0000 7fdc36a61700 1 Processor -- start 2024-06-06T03:22:06.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.927+0000 7fdc36a61700 1 -- start start 2024-06-06T03:22:06.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.927+0000 7fdc36a61700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc3006a170 0x7fdc3019e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:06.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.927+0000 7fdc36a61700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc3006ab30 0x7fdc3019ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:06.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.927+0000 7fdc36a61700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc30108500 0x7fdc301989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:06.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.927+0000 7fdc36a61700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdc30112630 con 0x7fdc30108500 2024-06-06T03:22:06.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.927+0000 7fdc36a61700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdc301124b0 con 0x7fdc3006ab30 2024-06-06T03:22:06.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.927+0000 7fdc36a61700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdc301127b0 con 0x7fdc3006a170 2024-06-06T03:22:06.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.928+0000 7fdc34ffe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc30108500 0x7fdc301989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:06.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.928+0000 7fdc34ffe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc30108500 0x7fdc301989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44190/0 (socket says 172.21.15.50:44190) 2024-06-06T03:22:06.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.928+0000 7fdc34ffe700 1 -- 172.21.15.50:0/2170806572 learned_addr learned my addr 172.21.15.50:0/2170806572 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:22:06.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.928+0000 7fdc27fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc3006ab30 0x7fdc3019ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:06.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.928+0000 7fdc2ffff700 1 --2- 172.21.15.50:0/2170806572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc3006a170 0x7fdc3019e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:06.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.928+0000 7fdc34ffe700 1 -- 172.21.15.50:0/2170806572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc3006a170 msgr2=0x7fdc3019e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:06.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.928+0000 7fdc34ffe700 1 --2- 172.21.15.50:0/2170806572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc3006a170 0x7fdc3019e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:06.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.928+0000 7fdc34ffe700 1 -- 172.21.15.50:0/2170806572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc3006ab30 msgr2=0x7fdc3019ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:06.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.928+0000 7fdc34ffe700 1 --2- 172.21.15.50:0/2170806572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc3006ab30 0x7fdc3019ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:06.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.928+0000 7fdc34ffe700 1 -- 172.21.15.50:0/2170806572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc30199110 con 0x7fdc30108500 2024-06-06T03:22:06.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.928+0000 7fdc27fff700 1 --2- 172.21.15.50:0/2170806572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc3006ab30 0x7fdc3019ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:22:06.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.928+0000 7fdc2ffff700 1 --2- 172.21.15.50:0/2170806572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc3006a170 0x7fdc3019e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:22:06.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.928+0000 7fdc34ffe700 1 --2- 172.21.15.50:0/2170806572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc30108500 0x7fdc301989b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdc2800ef30 tx=0x7fdc2800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:22:06.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.928+0000 7fdc2dffb700 1 -- 172.21.15.50:0/2170806572 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc280092e0 con 0x7fdc30108500 2024-06-06T03:22:06.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.928+0000 7fdc36a61700 1 -- 172.21.15.50:0/2170806572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc301993a0 con 0x7fdc30108500 2024-06-06T03:22:06.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.928+0000 7fdc2dffb700 1 -- 172.21.15.50:0/2170806572 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdc28004bb0 con 0x7fdc30108500 2024-06-06T03:22:06.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.928+0000 7fdc2dffb700 1 -- 172.21.15.50:0/2170806572 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc28004020 con 0x7fdc30108500 2024-06-06T03:22:06.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.928+0000 7fdc36a61700 1 -- 172.21.15.50:0/2170806572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc301a5670 con 0x7fdc30108500 2024-06-06T03:22:06.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.929+0000 7fdc36a61700 1 -- 172.21.15.50:0/2170806572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc3010a9e0 con 0x7fdc30108500 2024-06-06T03:22:06.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.931+0000 7fdc2dffb700 1 -- 172.21.15.50:0/2170806572 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fdc2801b030 con 0x7fdc30108500 2024-06-06T03:22:06.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.931+0000 7fdc2dffb700 1 --2- 172.21.15.50:0/2170806572 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fdc1c0a2c20 0x7fdc1c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:06.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.931+0000 7fdc2dffb700 1 -- 172.21.15.50:0/2170806572 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fdc280ce640 con 0x7fdc30108500 2024-06-06T03:22:06.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.931+0000 7fdc2ffff700 1 --2- 172.21.15.50:0/2170806572 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fdc1c0a2c20 0x7fdc1c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:06.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.932+0000 7fdc2ffff700 1 --2- 172.21.15.50:0/2170806572 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fdc1c0a2c20 0x7fdc1c0a50e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdc20006010 tx=0x7fdc2001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:22:06.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:06 smithi122 ceph-mon[35759]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:06.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:06 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:06.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:06 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:06.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:06 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:06.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:06 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:22:06.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:06 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:22:06.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:06 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:22:06.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:06.936+0000 7fdc2dffb700 1 -- 172.21.15.50:0/2170806572 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fdc28022020 con 0x7fdc30108500 2024-06-06T03:22:07.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:07.187+0000 7fdc36a61700 1 -- 172.21.15.50:0/2170806572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc3010a3c0 con 0x7fdc30108500 2024-06-06T03:22:07.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:07.188+0000 7fdc2dffb700 1 -- 172.21.15.50:0/2170806572 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6337 (secure 0 0 0) 0x7fdc28010040 con 0x7fdc30108500 2024-06-06T03:22:07.187 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:22:07.187 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1667847852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1667847852},{"type":"v1","addr":"172.21.15.50:6835","nonce":1667847852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/239971838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":239971838},{"type":"v1","addr":"172.21.15.50:6837","nonce":239971838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/864537078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":864537078},{"type":"v1","addr":"172.21.15.79:6833","nonce":864537078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/279268898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":279268898},{"type":"v1","addr":"172.21.15.79:6835","nonce":279268898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/57533154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":57533154},{"type":"v1","addr":"172.21.15.122:6833","nonce":57533154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/2987597320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2987597320},{"type":"v1","addr":"172.21.15.122:6835","nonce":2987597320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1604366318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1604366318},{"type":"v1","addr":"172.21.15.122:6837","nonce":1604366318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-06-06T03:22:07.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:07.190+0000 7fdc36a61700 1 -- 172.21.15.50:0/2170806572 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fdc1c0a2c20 msgr2=0x7fdc1c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:07.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:07.190+0000 7fdc36a61700 1 --2- 172.21.15.50:0/2170806572 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fdc1c0a2c20 0x7fdc1c0a50e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdc20006010 tx=0x7fdc2001a040 comp rx=0 tx=0).stop 2024-06-06T03:22:07.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:07.190+0000 7fdc36a61700 1 -- 172.21.15.50:0/2170806572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc30108500 msgr2=0x7fdc301989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:07.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:07.190+0000 7fdc36a61700 1 --2- 172.21.15.50:0/2170806572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc30108500 0x7fdc301989b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdc2800ef30 tx=0x7fdc2800c3a0 comp rx=0 tx=0).stop 2024-06-06T03:22:07.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:07.190+0000 7fdc36a61700 1 -- 172.21.15.50:0/2170806572 shutdown_connections 2024-06-06T03:22:07.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:07.190+0000 7fdc36a61700 1 --2- 172.21.15.50:0/2170806572 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fdc1c0a2c20 0x7fdc1c0a50e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:07.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:07.190+0000 7fdc36a61700 1 --2- 172.21.15.50:0/2170806572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc30108500 0x7fdc301989b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:07.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:07.190+0000 7fdc36a61700 1 --2- 172.21.15.50:0/2170806572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc3006a170 0x7fdc3019e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:07.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:07.190+0000 7fdc36a61700 1 --2- 172.21.15.50:0/2170806572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc3006ab30 0x7fdc3019ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:07.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:07.190+0000 7fdc36a61700 1 -- 172.21.15.50:0/2170806572 >> 172.21.15.50:0/2170806572 conn(0x7fdc30078340 msgr2=0x7fdc301000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:22:07.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:07.190+0000 7fdc36a61700 1 -- 172.21.15.50:0/2170806572 shutdown_connections 2024-06-06T03:22:07.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:07.190+0000 7fdc36a61700 1 -- 172.21.15.50:0/2170806572 wait complete. 2024-06-06T03:22:07.190 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 8 2024-06-06T03:22:07.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:07 smithi079 ceph-mon[35478]: Deploying daemon mds.h on smithi079 2024-06-06T03:22:07.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:07 smithi079 ceph-mon[35478]: mds.? [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] up:boot 2024-06-06T03:22:07.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:07 smithi079 ceph-mon[35478]: fsmap 7 up:standby 2024-06-06T03:22:07.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:07 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-06T03:22:07.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:07 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/2170806572' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:22:07.840 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:07 smithi050 ceph-mon[32421]: Deploying daemon mds.h on smithi079 2024-06-06T03:22:07.840 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:07 smithi050 ceph-mon[32421]: mds.? [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] up:boot 2024-06-06T03:22:07.840 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:07 smithi050 ceph-mon[32421]: fsmap 7 up:standby 2024-06-06T03:22:07.840 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:07 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-06T03:22:07.840 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:07 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/2170806572' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:22:07.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:07 smithi122 ceph-mon[35759]: Deploying daemon mds.h on smithi079 2024-06-06T03:22:07.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:07 smithi122 ceph-mon[35759]: mds.? [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] up:boot 2024-06-06T03:22:07.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:07 smithi122 ceph-mon[35759]: fsmap 7 up:standby 2024-06-06T03:22:07.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:07 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-06T03:22:07.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:07 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/2170806572' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:22:08.822 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:08 smithi079 ceph-mon[35478]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:08.823 INFO:journalctl@ceph.mds.h.smithi079.stdout:Jun 06 03:22:08 smithi079 systemd[1]: Starting Ceph mds.h for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:22:08.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:08 smithi122 ceph-mon[35759]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:09.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:08 smithi050 ceph-mon[32421]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:09.099 INFO:journalctl@ceph.mds.h.smithi079.stdout:Jun 06 03:22:08 smithi079 podman[65123]: 2024-06-06 03:22:08.725917176 +0000 UTC m=+0.017153355 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T03:22:09.099 INFO:journalctl@ceph.mds.h.smithi079.stdout:Jun 06 03:22:08 smithi079 podman[65123]: 2024-06-06 03:22:08.844812733 +0000 UTC m=+0.136048925 container create ad37c9a33c0d8fed3d12a926673f0e3ca870ffc222bd43d7d6490eb0a85c1b34 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-h, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-06-06T03:22:09.599 INFO:journalctl@ceph.mds.h.smithi079.stdout:Jun 06 03:22:09 smithi079 podman[65123]: 2024-06-06 03:22:09.133592173 +0000 UTC m=+0.424828352 container init ad37c9a33c0d8fed3d12a926673f0e3ca870ffc222bd43d7d6490eb0a85c1b34 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-h, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-06-06T03:22:09.600 INFO:journalctl@ceph.mds.h.smithi079.stdout:Jun 06 03:22:09 smithi079 podman[65123]: 2024-06-06 03:22:09.136392077 +0000 UTC m=+0.427628254 container start ad37c9a33c0d8fed3d12a926673f0e3ca870ffc222bd43d7d6490eb0a85c1b34 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-h, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-06-06T03:22:09.600 INFO:journalctl@ceph.mds.h.smithi079.stdout:Jun 06 03:22:09 smithi079 ceph-mds[65143]: -- 172.21.15.79:0/1607443557 <== mon.2 v2:172.21.15.79:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560da699fa40 con 0x560da6972800 2024-06-06T03:22:09.600 INFO:journalctl@ceph.mds.h.smithi079.stdout:Jun 06 03:22:09 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-h[65139]: starting mds.h at 2024-06-06T03:22:09.600 INFO:journalctl@ceph.mds.h.smithi079.stdout:Jun 06 03:22:09 smithi079 bash[65123]: ad37c9a33c0d8fed3d12a926673f0e3ca870ffc222bd43d7d6490eb0a85c1b34 2024-06-06T03:22:09.600 INFO:journalctl@ceph.mds.h.smithi079.stdout:Jun 06 03:22:09 smithi079 systemd[1]: Started Ceph mds.h for b6263b26-23b2-11ef-bc9b-c7b262605968. 2024-06-06T03:22:09.869 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T03:22:10.133 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:22:10.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:10 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:10.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:10 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:10.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:10 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:10.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:10 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:22:10.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:10 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:22:10.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:10 smithi050 ceph-mon[32421]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:10.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:10 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:22:10.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:10 smithi050 ceph-mon[32421]: Deploying daemon mds.i on smithi122 2024-06-06T03:22:10.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:10 smithi050 ceph-mon[32421]: mds.? [v2:172.21.15.79:6836/3286722213,v1:172.21.15.79:6837/3286722213] up:boot 2024-06-06T03:22:10.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:10 smithi050 ceph-mon[32421]: fsmap 8 up:standby 2024-06-06T03:22:10.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:10 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-06T03:22:10.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:10 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:10.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:10 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:10.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:10 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:10.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:10 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:22:10.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:10 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:22:10.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:10 smithi079 ceph-mon[35478]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:10.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:10 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:22:10.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:10 smithi079 ceph-mon[35478]: Deploying daemon mds.i on smithi122 2024-06-06T03:22:10.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:10 smithi079 ceph-mon[35478]: mds.? [v2:172.21.15.79:6836/3286722213,v1:172.21.15.79:6837/3286722213] up:boot 2024-06-06T03:22:10.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:10 smithi079 ceph-mon[35478]: fsmap 8 up:standby 2024-06-06T03:22:10.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:10 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-06T03:22:10.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:10 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:10.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:10 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:10.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:10 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:10.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:10 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:22:10.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:10 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:22:10.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:10 smithi122 ceph-mon[35759]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:10.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:10 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:22:10.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:10 smithi122 ceph-mon[35759]: Deploying daemon mds.i on smithi122 2024-06-06T03:22:10.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:10 smithi122 ceph-mon[35759]: mds.? [v2:172.21.15.79:6836/3286722213,v1:172.21.15.79:6837/3286722213] up:boot 2024-06-06T03:22:10.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:10 smithi122 ceph-mon[35759]: fsmap 8 up:standby 2024-06-06T03:22:10.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:10 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-06T03:22:11.682 INFO:journalctl@ceph.mds.i.smithi122.stdout:Jun 06 03:22:11 smithi122 systemd[1]: Starting Ceph mds.i for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:22:11.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.815+0000 7fc448da0700 1 -- 172.21.15.50:0/485305147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc44406abc0 msgr2=0x7fc44406b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:11.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.815+0000 7fc448da0700 1 --2- 172.21.15.50:0/485305147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc44406abc0 0x7fc44406b040 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc42c009990 tx=0x7fc42c009ca0 comp rx=0 tx=0).stop 2024-06-06T03:22:11.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.815+0000 7fc448da0700 1 -- 172.21.15.50:0/485305147 shutdown_connections 2024-06-06T03:22:11.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.815+0000 7fc448da0700 1 --2- 172.21.15.50:0/485305147 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc44406b580 0x7fc44410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:11.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.815+0000 7fc448da0700 1 --2- 172.21.15.50:0/485305147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc444108500 0x7fc4441088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:11.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.815+0000 7fc448da0700 1 --2- 172.21.15.50:0/485305147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc44406abc0 0x7fc44406b040 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:11.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.815+0000 7fc448da0700 1 -- 172.21.15.50:0/485305147 >> 172.21.15.50:0/485305147 conn(0x7fc444078340 msgr2=0x7fc444078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:22:11.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.815+0000 7fc448da0700 1 -- 172.21.15.50:0/485305147 shutdown_connections 2024-06-06T03:22:11.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.815+0000 7fc448da0700 1 -- 172.21.15.50:0/485305147 wait complete. 2024-06-06T03:22:11.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.816+0000 7fc448da0700 1 Processor -- start 2024-06-06T03:22:11.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.816+0000 7fc448da0700 1 -- start start 2024-06-06T03:22:11.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.816+0000 7fc448da0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc44406abc0 0x7fc4441a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:11.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.816+0000 7fc448da0700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc44406b580 0x7fc4441a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:11.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.816+0000 7fc448da0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc444108500 0x7fc44419aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:11.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.816+0000 7fc448da0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc444112610 con 0x7fc444108500 2024-06-06T03:22:11.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.816+0000 7fc448da0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc444112490 con 0x7fc44406abc0 2024-06-06T03:22:11.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.816+0000 7fc448da0700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc444112790 con 0x7fc44406b580 2024-06-06T03:22:11.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.816+0000 7fc442d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc444108500 0x7fc44419aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:11.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.816+0000 7fc44259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc44406abc0 0x7fc4441a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:11.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.816+0000 7fc442d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc444108500 0x7fc44419aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52178/0 (socket says 172.21.15.50:52178) 2024-06-06T03:22:11.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.816+0000 7fc442d9d700 1 -- 172.21.15.50:0/967725550 learned_addr learned my addr 172.21.15.50:0/967725550 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:22:11.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.817+0000 7fc43bfff700 1 --2- 172.21.15.50:0/967725550 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc44406b580 0x7fc4441a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:11.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.817+0000 7fc442d9d700 1 -- 172.21.15.50:0/967725550 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc44406b580 msgr2=0x7fc4441a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:11.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.817+0000 7fc442d9d700 1 --2- 172.21.15.50:0/967725550 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc44406b580 0x7fc4441a0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:11.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.817+0000 7fc442d9d700 1 -- 172.21.15.50:0/967725550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc44406abc0 msgr2=0x7fc4441a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:11.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.817+0000 7fc442d9d700 1 --2- 172.21.15.50:0/967725550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc44406abc0 0x7fc4441a08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:11.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.817+0000 7fc442d9d700 1 -- 172.21.15.50:0/967725550 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44419b200 con 0x7fc444108500 2024-06-06T03:22:11.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.817+0000 7fc442d9d700 1 --2- 172.21.15.50:0/967725550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc444108500 0x7fc44419aaa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc43c007d70 tx=0x7fc43c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:22:11.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.817+0000 7fc43b7fe700 1 -- 172.21.15.50:0/967725550 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c016020 con 0x7fc444108500 2024-06-06T03:22:11.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.817+0000 7fc448da0700 1 -- 172.21.15.50:0/967725550 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc44419b4f0 con 0x7fc444108500 2024-06-06T03:22:11.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.817+0000 7fc43b7fe700 1 -- 172.21.15.50:0/967725550 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc43c00ac90 con 0x7fc444108500 2024-06-06T03:22:11.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.817+0000 7fc43b7fe700 1 -- 172.21.15.50:0/967725550 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c0115e0 con 0x7fc444108500 2024-06-06T03:22:11.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.817+0000 7fc448da0700 1 -- 172.21.15.50:0/967725550 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4441a77b0 con 0x7fc444108500 2024-06-06T03:22:11.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.818+0000 7fc448da0700 1 -- 172.21.15.50:0/967725550 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc444103bc0 con 0x7fc444108500 2024-06-06T03:22:11.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.819+0000 7fc43b7fe700 1 -- 172.21.15.50:0/967725550 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc43c019020 con 0x7fc444108500 2024-06-06T03:22:11.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.820+0000 7fc43b7fe700 1 --2- 172.21.15.50:0/967725550 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc4300a2c20 0x7fc4300a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:11.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.820+0000 7fc44259c700 1 --2- 172.21.15.50:0/967725550 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc4300a2c20 0x7fc4300a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:11.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.820+0000 7fc43b7fe700 1 -- 172.21.15.50:0/967725550 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fc43c0cf010 con 0x7fc444108500 2024-06-06T03:22:11.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.821+0000 7fc44259c700 1 --2- 172.21.15.50:0/967725550 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc4300a2c20 0x7fc4300a50e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc44419bbe0 tx=0x7fc43400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:22:11.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:11.824+0000 7fc43b7fe700 1 -- 172.21.15.50:0/967725550 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc43c020020 con 0x7fc444108500 2024-06-06T03:22:11.962 INFO:journalctl@ceph.mds.i.smithi122.stdout:Jun 06 03:22:11 smithi122 podman[66504]: 2024-06-06 03:22:11.595809548 +0000 UTC m=+0.017437797 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T03:22:11.962 INFO:journalctl@ceph.mds.i.smithi122.stdout:Jun 06 03:22:11 smithi122 podman[66504]: 2024-06-06 03:22:11.725733758 +0000 UTC m=+0.147361984 container create fdbaaaa092f715b3840e616517f99eebe791515c6dfd921f2e2bc78d39e47fb9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, RELEASE=squid-3d89acc) 2024-06-06T03:22:11.962 INFO:journalctl@ceph.mds.i.smithi122.stdout:Jun 06 03:22:11 smithi122 podman[66504]: 2024-06-06 03:22:11.936726724 +0000 UTC m=+0.358354950 container init fdbaaaa092f715b3840e616517f99eebe791515c6dfd921f2e2bc78d39e47fb9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-i, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, GIT_CLEAN=True, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T03:22:11.962 INFO:journalctl@ceph.mds.i.smithi122.stdout:Jun 06 03:22:11 smithi122 podman[66504]: 2024-06-06 03:22:11.939389335 +0000 UTC m=+0.361017570 container start fdbaaaa092f715b3840e616517f99eebe791515c6dfd921f2e2bc78d39e47fb9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-06T03:22:12.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:12.075+0000 7fc448da0700 1 -- 172.21.15.50:0/967725550 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4441a7a40 con 0x7fc444108500 2024-06-06T03:22:12.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:12.075+0000 7fc43b7fe700 1 -- 172.21.15.50:0/967725550 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7162 (secure 0 0 0) 0x7fc43c01ae40 con 0x7fc444108500 2024-06-06T03:22:12.075 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:22:12.076 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1667847852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1667847852},{"type":"v1","addr":"172.21.15.50:6835","nonce":1667847852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/239971838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":239971838},{"type":"v1","addr":"172.21.15.50:6837","nonce":239971838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/864537078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":864537078},{"type":"v1","addr":"172.21.15.79:6833","nonce":864537078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/279268898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":279268898},{"type":"v1","addr":"172.21.15.79:6835","nonce":279268898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/57533154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":57533154},{"type":"v1","addr":"172.21.15.122:6833","nonce":57533154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/3286722213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3286722213},{"type":"v1","addr":"172.21.15.79:6837","nonce":3286722213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/2987597320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2987597320},{"type":"v1","addr":"172.21.15.122:6835","nonce":2987597320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1604366318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1604366318},{"type":"v1","addr":"172.21.15.122:6837","nonce":1604366318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-06-06T03:22:12.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:12.078+0000 7fc448da0700 1 -- 172.21.15.50:0/967725550 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc4300a2c20 msgr2=0x7fc4300a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:12.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:12.078+0000 7fc448da0700 1 --2- 172.21.15.50:0/967725550 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc4300a2c20 0x7fc4300a50e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc44419bbe0 tx=0x7fc43400a380 comp rx=0 tx=0).stop 2024-06-06T03:22:12.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:12.078+0000 7fc448da0700 1 -- 172.21.15.50:0/967725550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc444108500 msgr2=0x7fc44419aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:12.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:12.078+0000 7fc448da0700 1 --2- 172.21.15.50:0/967725550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc444108500 0x7fc44419aaa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc43c007d70 tx=0x7fc43c00a340 comp rx=0 tx=0).stop 2024-06-06T03:22:12.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:12.078+0000 7fc448da0700 1 -- 172.21.15.50:0/967725550 shutdown_connections 2024-06-06T03:22:12.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:12.078+0000 7fc448da0700 1 --2- 172.21.15.50:0/967725550 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc4300a2c20 0x7fc4300a50e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:12.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:12.078+0000 7fc448da0700 1 --2- 172.21.15.50:0/967725550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc444108500 0x7fc44419aaa0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:12.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:12.078+0000 7fc448da0700 1 --2- 172.21.15.50:0/967725550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc44406abc0 0x7fc4441a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:12.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:12.078+0000 7fc448da0700 1 --2- 172.21.15.50:0/967725550 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc44406b580 0x7fc4441a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:12.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:12.078+0000 7fc448da0700 1 -- 172.21.15.50:0/967725550 >> 172.21.15.50:0/967725550 conn(0x7fc444078340 msgr2=0x7fc44410d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:22:12.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:12.078+0000 7fc448da0700 1 -- 172.21.15.50:0/967725550 shutdown_connections 2024-06-06T03:22:12.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:12.078+0000 7fc448da0700 1 -- 172.21.15.50:0/967725550 wait complete. 2024-06-06T03:22:12.079 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2024-06-06T03:22:12.391 INFO:journalctl@ceph.mds.i.smithi122.stdout:Jun 06 03:22:11 smithi122 ceph-mds[66523]: -- 172.21.15.122:0/1326424733 <== mon.1 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b4a7d37a40 con 0x55b4a7d0b000 2024-06-06T03:22:12.391 INFO:journalctl@ceph.mds.i.smithi122.stdout:Jun 06 03:22:11 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-i[66519]: starting mds.i at 2024-06-06T03:22:12.391 INFO:journalctl@ceph.mds.i.smithi122.stdout:Jun 06 03:22:12 smithi122 bash[66504]: fdbaaaa092f715b3840e616517f99eebe791515c6dfd921f2e2bc78d39e47fb9 2024-06-06T03:22:12.391 INFO:journalctl@ceph.mds.i.smithi122.stdout:Jun 06 03:22:12 smithi122 systemd[1]: Started Ceph mds.i for b6263b26-23b2-11ef-bc9b-c7b262605968. 2024-06-06T03:22:12.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:12 smithi122 ceph-mon[35759]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:12.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:12 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/967725550' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:22:12.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:12 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:12.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:12 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:12.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:12 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:12.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:12 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:22:12.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:12 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:22:12.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:12 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:22:12.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:12 smithi122 ceph-mon[35759]: Deploying daemon mds.g on smithi050 2024-06-06T03:22:12.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:12 smithi050 ceph-mon[32421]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:12.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:12 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/967725550' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:22:12.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:12 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:12.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:12 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:12.691 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:12 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:12.691 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:12 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:22:12.691 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:12 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:22:12.691 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:12 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:22:12.691 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:12 smithi050 ceph-mon[32421]: Deploying daemon mds.g on smithi050 2024-06-06T03:22:12.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:12 smithi079 ceph-mon[35478]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:12.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:12 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/967725550' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:22:12.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:12 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:12.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:12 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:12.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:12 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:12.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:12 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:22:12.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:12 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:22:12.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:12 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:22:12.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:12 smithi079 ceph-mon[35478]: Deploying daemon mds.g on smithi050 2024-06-06T03:22:13.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:13 smithi122 ceph-mon[35759]: mds.? [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] up:boot 2024-06-06T03:22:13.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:13 smithi122 ceph-mon[35759]: fsmap 9 up:standby 2024-06-06T03:22:13.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:13 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-06T03:22:13.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:13 smithi050 ceph-mon[32421]: mds.? [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] up:boot 2024-06-06T03:22:13.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:13 smithi050 ceph-mon[32421]: fsmap 9 up:standby 2024-06-06T03:22:13.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-06T03:22:13.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:13 smithi079 ceph-mon[35478]: mds.? [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] up:boot 2024-06-06T03:22:13.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:13 smithi079 ceph-mon[35478]: fsmap 9 up:standby 2024-06-06T03:22:13.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:13 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-06T03:22:14.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:14 smithi050 ceph-mon[32421]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:14.501 INFO:journalctl@ceph.mds.g.smithi050.stdout:Jun 06 03:22:14 smithi050 systemd[1]: Starting Ceph mds.g for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:22:14.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:14 smithi122 ceph-mon[35759]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:14.723 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T03:22:14.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:14 smithi079 ceph-mon[35478]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:14.878 INFO:journalctl@ceph.mds.g.smithi050.stdout:Jun 06 03:22:14 smithi050 podman[73807]: 2024-06-06 03:22:14.522869541 +0000 UTC m=+0.017752090 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T03:22:14.878 INFO:journalctl@ceph.mds.g.smithi050.stdout:Jun 06 03:22:14 smithi050 podman[73807]: 2024-06-06 03:22:14.643973265 +0000 UTC m=+0.138855825 container create 8a7835e5a2ab7232c325397223f5c3138fdf3197d225f060a30e4558686205f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-g, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2) 2024-06-06T03:22:14.879 INFO:journalctl@ceph.mds.g.smithi050.stdout:Jun 06 03:22:14 smithi050 podman[73807]: 2024-06-06 03:22:14.880111193 +0000 UTC m=+0.374993748 container init 8a7835e5a2ab7232c325397223f5c3138fdf3197d225f060a30e4558686205f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-g, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=) 2024-06-06T03:22:15.056 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:22:15.181 INFO:journalctl@ceph.mds.g.smithi050.stdout:Jun 06 03:22:14 smithi050 podman[73807]: 2024-06-06 03:22:14.884719571 +0000 UTC m=+0.379602124 container start 8a7835e5a2ab7232c325397223f5c3138fdf3197d225f060a30e4558686205f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-g, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.build-date=20240528) 2024-06-06T03:22:15.181 INFO:journalctl@ceph.mds.g.smithi050.stdout:Jun 06 03:22:14 smithi050 ceph-mds[73844]: -- 172.21.15.50:0/2651629882 <== mon.0 v2:172.21.15.50:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56083c439a40 con 0x56083c40cc00 2024-06-06T03:22:15.181 INFO:journalctl@ceph.mds.g.smithi050.stdout:Jun 06 03:22:14 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-g[73840]: starting mds.g at 2024-06-06T03:22:15.181 INFO:journalctl@ceph.mds.g.smithi050.stdout:Jun 06 03:22:14 smithi050 bash[73807]: 8a7835e5a2ab7232c325397223f5c3138fdf3197d225f060a30e4558686205f8 2024-06-06T03:22:15.181 INFO:journalctl@ceph.mds.g.smithi050.stdout:Jun 06 03:22:14 smithi050 systemd[1]: Started Ceph mds.g for b6263b26-23b2-11ef-bc9b-c7b262605968. 2024-06-06T03:22:16.096 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:16 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:16.096 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:16 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:16.096 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:16 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:16.096 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:16 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:22:16.096 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:16 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:22:16.096 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:16 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:22:16.096 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:16 smithi050 ceph-mon[32421]: Deploying daemon mds.a on smithi050 2024-06-06T03:22:16.096 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:16 smithi050 ceph-mon[32421]: mds.? [v2:172.21.15.50:6838/2188134216,v1:172.21.15.50:6839/2188134216] up:boot 2024-06-06T03:22:16.096 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:16 smithi050 ceph-mon[32421]: fsmap 10 up:standby 2024-06-06T03:22:16.096 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:16 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-06T03:22:16.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:16 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:16.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:16 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:16.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:16 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:16.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:16 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:22:16.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:16 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:22:16.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:16 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:22:16.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:16 smithi079 ceph-mon[35478]: Deploying daemon mds.a on smithi050 2024-06-06T03:22:16.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:16 smithi079 ceph-mon[35478]: mds.? [v2:172.21.15.50:6838/2188134216,v1:172.21.15.50:6839/2188134216] up:boot 2024-06-06T03:22:16.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:16 smithi079 ceph-mon[35478]: fsmap 10 up:standby 2024-06-06T03:22:16.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:16 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-06T03:22:16.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:16 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:16.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:16 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:16.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:16 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:16.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:16 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:22:16.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:16 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:22:16.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:16 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:22:16.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:16 smithi122 ceph-mon[35759]: Deploying daemon mds.a on smithi050 2024-06-06T03:22:16.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:16 smithi122 ceph-mon[35759]: mds.? [v2:172.21.15.50:6838/2188134216,v1:172.21.15.50:6839/2188134216] up:boot 2024-06-06T03:22:16.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:16 smithi122 ceph-mon[35759]: fsmap 10 up:standby 2024-06-06T03:22:16.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:16 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-06T03:22:16.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.631+0000 7fcc06168700 1 -- 172.21.15.50:0/2556927957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc0006ab60 msgr2=0x7fcc0006afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:16.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.631+0000 7fcc06168700 1 --2- 172.21.15.50:0/2556927957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc0006ab60 0x7fcc0006afe0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4009990 tx=0x7fcbf4009ca0 comp rx=0 tx=0).stop 2024-06-06T03:22:16.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.631+0000 7fcc06168700 1 -- 172.21.15.50:0/2556927957 shutdown_connections 2024-06-06T03:22:16.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.631+0000 7fcc06168700 1 --2- 172.21.15.50:0/2556927957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc0006b520 0x7fcc0010f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:16.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.631+0000 7fcc06168700 1 --2- 172.21.15.50:0/2556927957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc00108520 0x7fcc00108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:16.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.631+0000 7fcc06168700 1 --2- 172.21.15.50:0/2556927957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc0006ab60 0x7fcc0006afe0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:16.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.631+0000 7fcc06168700 1 -- 172.21.15.50:0/2556927957 >> 172.21.15.50:0/2556927957 conn(0x7fcc00078340 msgr2=0x7fcc00078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:22:16.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.631+0000 7fcc06168700 1 -- 172.21.15.50:0/2556927957 shutdown_connections 2024-06-06T03:22:16.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.631+0000 7fcc06168700 1 -- 172.21.15.50:0/2556927957 wait complete. 2024-06-06T03:22:16.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.632+0000 7fcc06168700 1 Processor -- start 2024-06-06T03:22:16.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.632+0000 7fcc06168700 1 -- start start 2024-06-06T03:22:16.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.632+0000 7fcc06168700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc0006ab60 0x7fcc0019adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:16.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.632+0000 7fcc06168700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc0006b520 0x7fcc0019b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:16.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.632+0000 7fcc06168700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc00108520 0x7fcc0019f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:16.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.632+0000 7fcc06168700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcc00112650 con 0x7fcc00108520 2024-06-06T03:22:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.632+0000 7fcc06168700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcc001124d0 con 0x7fcc0006b520 2024-06-06T03:22:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.632+0000 7fcc06168700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcc001127d0 con 0x7fcc0006ab60 2024-06-06T03:22:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.632+0000 7fcbfffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc00108520 0x7fcc0019f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.632+0000 7fcbfffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc00108520 0x7fcc0019f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52212/0 (socket says 172.21.15.50:52212) 2024-06-06T03:22:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.633+0000 7fcbfffff700 1 -- 172.21.15.50:0/609930967 learned_addr learned my addr 172.21.15.50:0/609930967 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:22:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.632+0000 7fcbff7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc0006ab60 0x7fcc0019adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.633+0000 7fcbfeffd700 1 --2- 172.21.15.50:0/609930967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc0006b520 0x7fcc0019b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.633+0000 7fcbfffff700 1 -- 172.21.15.50:0/609930967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc0006ab60 msgr2=0x7fcc0019adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.633+0000 7fcbfffff700 1 --2- 172.21.15.50:0/609930967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc0006ab60 0x7fcc0019adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.633+0000 7fcbfffff700 1 -- 172.21.15.50:0/609930967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc0006b520 msgr2=0x7fcc0019b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.633+0000 7fcbfffff700 1 --2- 172.21.15.50:0/609930967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc0006b520 0x7fcc0019b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:16.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.633+0000 7fcbfffff700 1 -- 172.21.15.50:0/609930967 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc0019fdd0 con 0x7fcc00108520 2024-06-06T03:22:16.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.633+0000 7fcbff7fe700 1 --2- 172.21.15.50:0/609930967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc0006ab60 0x7fcc0019adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:22:16.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.633+0000 7fcbfffff700 1 --2- 172.21.15.50:0/609930967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc00108520 0x7fcc0019f690 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcbf800ef30 tx=0x7fcbf800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:22:16.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.633+0000 7fcbfcff9700 1 -- 172.21.15.50:0/609930967 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf80092e0 con 0x7fcc00108520 2024-06-06T03:22:16.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.633+0000 7fcbfcff9700 1 -- 172.21.15.50:0/609930967 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcbf8004bb0 con 0x7fcc00108520 2024-06-06T03:22:16.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.633+0000 7fcc06168700 1 -- 172.21.15.50:0/609930967 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc001a0060 con 0x7fcc00108520 2024-06-06T03:22:16.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.633+0000 7fcbfcff9700 1 -- 172.21.15.50:0/609930967 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf8004020 con 0x7fcc00108520 2024-06-06T03:22:16.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.633+0000 7fcc06168700 1 -- 172.21.15.50:0/609930967 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc001a7940 con 0x7fcc00108520 2024-06-06T03:22:16.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.635+0000 7fcc06168700 1 -- 172.21.15.50:0/609930967 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc00103be0 con 0x7fcc00108520 2024-06-06T03:22:16.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.636+0000 7fcbfcff9700 1 -- 172.21.15.50:0/609930967 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fcbf801b030 con 0x7fcc00108520 2024-06-06T03:22:16.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.636+0000 7fcbfcff9700 1 --2- 172.21.15.50:0/609930967 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcbe80a2c20 0x7fcbe80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:16.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.636+0000 7fcbfcff9700 1 -- 172.21.15.50:0/609930967 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fcbf80ce630 con 0x7fcc00108520 2024-06-06T03:22:16.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.636+0000 7fcbff7fe700 1 --2- 172.21.15.50:0/609930967 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcbe80a2c20 0x7fcbe80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:16.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.637+0000 7fcbff7fe700 1 --2- 172.21.15.50:0/609930967 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcbe80a2c20 0x7fcbe80a50e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0007f50 tx=0x7fcbf00073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:22:16.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.642+0000 7fcbfcff9700 1 -- 172.21.15.50:0/609930967 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fcbf8022020 con 0x7fcc00108520 2024-06-06T03:22:16.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.905+0000 7fcc06168700 1 -- 172.21.15.50:0/609930967 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc0019c150 con 0x7fcc00108520 2024-06-06T03:22:16.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.905+0000 7fcbfcff9700 1 -- 172.21.15.50:0/609930967 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8818 (secure 0 0 0) 0x7fcc0019c150 con 0x7fcc00108520 2024-06-06T03:22:16.905 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:22:16.906 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1667847852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1667847852},{"type":"v1","addr":"172.21.15.50:6835","nonce":1667847852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/239971838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":239971838},{"type":"v1","addr":"172.21.15.50:6837","nonce":239971838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/2188134216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2188134216},{"type":"v1","addr":"172.21.15.50:6839","nonce":2188134216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/864537078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":864537078},{"type":"v1","addr":"172.21.15.79:6833","nonce":864537078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/279268898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":279268898},{"type":"v1","addr":"172.21.15.79:6835","nonce":279268898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/57533154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":57533154},{"type":"v1","addr":"172.21.15.122:6833","nonce":57533154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/3286722213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3286722213},{"type":"v1","addr":"172.21.15.79:6837","nonce":3286722213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/2987597320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2987597320},{"type":"v1","addr":"172.21.15.122:6835","nonce":2987597320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1604366318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1604366318},{"type":"v1","addr":"172.21.15.122:6837","nonce":1604366318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24490,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6839/4129732900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":4129732900},{"type":"v1","addr":"172.21.15.122:6839","nonce":4129732900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-06-06T03:22:16.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.908+0000 7fcc06168700 1 -- 172.21.15.50:0/609930967 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcbe80a2c20 msgr2=0x7fcbe80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:16.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.908+0000 7fcc06168700 1 --2- 172.21.15.50:0/609930967 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcbe80a2c20 0x7fcbe80a50e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0007f50 tx=0x7fcbf00073d0 comp rx=0 tx=0).stop 2024-06-06T03:22:16.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.908+0000 7fcc06168700 1 -- 172.21.15.50:0/609930967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc00108520 msgr2=0x7fcc0019f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:16.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.908+0000 7fcc06168700 1 --2- 172.21.15.50:0/609930967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc00108520 0x7fcc0019f690 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcbf800ef30 tx=0x7fcbf800c3a0 comp rx=0 tx=0).stop 2024-06-06T03:22:16.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.908+0000 7fcc06168700 1 -- 172.21.15.50:0/609930967 shutdown_connections 2024-06-06T03:22:16.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.908+0000 7fcc06168700 1 --2- 172.21.15.50:0/609930967 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcbe80a2c20 0x7fcbe80a50e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:16.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.908+0000 7fcc06168700 1 --2- 172.21.15.50:0/609930967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc00108520 0x7fcc0019f690 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:16.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.908+0000 7fcc06168700 1 --2- 172.21.15.50:0/609930967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc0006ab60 0x7fcc0019adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:16.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.908+0000 7fcc06168700 1 --2- 172.21.15.50:0/609930967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc0006b520 0x7fcc0019b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:16.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.908+0000 7fcc06168700 1 -- 172.21.15.50:0/609930967 >> 172.21.15.50:0/609930967 conn(0x7fcc00078340 msgr2=0x7fcc0010d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:22:16.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.909+0000 7fcc06168700 1 -- 172.21.15.50:0/609930967 shutdown_connections 2024-06-06T03:22:16.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:16.909+0000 7fcc06168700 1 -- 172.21.15.50:0/609930967 wait complete. 2024-06-06T03:22:16.909 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 11 2024-06-06T03:22:17.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:17 smithi050 ceph-mon[32421]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:17.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:17 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/609930967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:22:17.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:17 smithi079 ceph-mon[35478]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:17.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:17 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/609930967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:22:17.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:17 smithi122 ceph-mon[35759]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:17.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:17 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/609930967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:22:19.001 INFO:journalctl@ceph.mds.a.smithi050.stdout:Jun 06 03:22:18 smithi050 podman[74265]: 2024-06-06 03:22:18.911450062 +0000 UTC m=+0.119530049 container create 624c20db84eeb5a928619fe1e63bb015aa5505f33b33b9b1b2dfedba75b082a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-a, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T03:22:19.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:19 smithi079 ceph-mon[35478]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:19.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:19 smithi122 ceph-mon[35759]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:19.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:19 smithi050 ceph-mon[32421]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:19.501 INFO:journalctl@ceph.mds.a.smithi050.stdout:Jun 06 03:22:19 smithi050 podman[74265]: 2024-06-06 03:22:19.131166149 +0000 UTC m=+0.339246126 container init 624c20db84eeb5a928619fe1e63bb015aa5505f33b33b9b1b2dfedba75b082a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-a, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-06-06T03:22:19.501 INFO:journalctl@ceph.mds.a.smithi050.stdout:Jun 06 03:22:19 smithi050 podman[74265]: 2024-06-06 03:22:19.134196226 +0000 UTC m=+0.342276217 container start 624c20db84eeb5a928619fe1e63bb015aa5505f33b33b9b1b2dfedba75b082a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-a, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=squid-3d89acc) 2024-06-06T03:22:19.501 INFO:journalctl@ceph.mds.a.smithi050.stdout:Jun 06 03:22:19 smithi050 ceph-mds[74284]: -- 172.21.15.50:0/3442362346 <== mon.0 v2:172.21.15.50:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b0e8aeda40 con 0x55b0e8ac0c00 2024-06-06T03:22:19.501 INFO:journalctl@ceph.mds.a.smithi050.stdout:Jun 06 03:22:19 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-a[74280]: starting mds.a at 2024-06-06T03:22:19.501 INFO:journalctl@ceph.mds.a.smithi050.stdout:Jun 06 03:22:19 smithi050 bash[74265]: 624c20db84eeb5a928619fe1e63bb015aa5505f33b33b9b1b2dfedba75b082a8 2024-06-06T03:22:19.502 INFO:journalctl@ceph.mds.a.smithi050.stdout:Jun 06 03:22:19 smithi050 systemd[1]: Started Ceph mds.a for b6263b26-23b2-11ef-bc9b-c7b262605968. 2024-06-06T03:22:20.571 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T03:22:20.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:20 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:20.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:20 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:20.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:20 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:20.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:20 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:22:20.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:20 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:22:20.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:20 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:22:20.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:20 smithi079 ceph-mon[35478]: Deploying daemon mds.b on smithi079 2024-06-06T03:22:20.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:20 smithi079 ceph-mon[35478]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:20.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:20 smithi079 ceph-mon[35478]: mds.? [v2:172.21.15.50:6840/632572420,v1:172.21.15.50:6841/632572420] up:boot 2024-06-06T03:22:20.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:20 smithi079 ceph-mon[35478]: fsmap 11 up:standby 2024-06-06T03:22:20.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:20 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-06T03:22:20.601 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:20 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:20.601 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:20 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:20.601 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:20 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:20.601 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:20 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:22:20.601 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:20 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:22:20.601 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:20 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:22:20.602 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:20 smithi050 ceph-mon[32421]: Deploying daemon mds.b on smithi079 2024-06-06T03:22:20.602 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:20 smithi050 ceph-mon[32421]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:20.602 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:20 smithi050 ceph-mon[32421]: mds.? [v2:172.21.15.50:6840/632572420,v1:172.21.15.50:6841/632572420] up:boot 2024-06-06T03:22:20.602 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:20 smithi050 ceph-mon[32421]: fsmap 11 up:standby 2024-06-06T03:22:20.602 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:20 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-06T03:22:20.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:20 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:20.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:20 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:20.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:20 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:20.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:20 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T03:22:20.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:20 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T03:22:20.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:20 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:22:20.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:20 smithi122 ceph-mon[35759]: Deploying daemon mds.b on smithi079 2024-06-06T03:22:20.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:20 smithi122 ceph-mon[35759]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:20.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:20 smithi122 ceph-mon[35759]: mds.? [v2:172.21.15.50:6840/632572420,v1:172.21.15.50:6841/632572420] up:boot 2024-06-06T03:22:20.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:20 smithi122 ceph-mon[35759]: fsmap 11 up:standby 2024-06-06T03:22:20.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:20 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-06T03:22:20.839 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:22:21.771 INFO:journalctl@ceph.mds.b.smithi079.stdout:Jun 06 03:22:21 smithi079 systemd[1]: Starting Ceph mds.b for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:22:22.044 INFO:journalctl@ceph.mds.b.smithi079.stdout:Jun 06 03:22:21 smithi079 podman[65427]: 2024-06-06 03:22:21.674575036 +0000 UTC m=+0.017310012 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T03:22:22.044 INFO:journalctl@ceph.mds.b.smithi079.stdout:Jun 06 03:22:21 smithi079 podman[65427]: 2024-06-06 03:22:21.791642589 +0000 UTC m=+0.134377549 container create 4aa3980a15ca2957cf652f7be8af447ce54e9723bb0f00c3dad1e29cab0e9042 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-b, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528) 2024-06-06T03:22:22.044 INFO:journalctl@ceph.mds.b.smithi079.stdout:Jun 06 03:22:22 smithi079 podman[65427]: 2024-06-06 03:22:22.04483314 +0000 UTC m=+0.387568117 container init 4aa3980a15ca2957cf652f7be8af447ce54e9723bb0f00c3dad1e29cab0e9042 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True) 2024-06-06T03:22:22.349 INFO:journalctl@ceph.mds.b.smithi079.stdout:Jun 06 03:22:22 smithi079 podman[65427]: 2024-06-06 03:22:22.048073696 +0000 UTC m=+0.390808668 container start 4aa3980a15ca2957cf652f7be8af447ce54e9723bb0f00c3dad1e29cab0e9042 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-b, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, GIT_CLEAN=True) 2024-06-06T03:22:22.349 INFO:journalctl@ceph.mds.b.smithi079.stdout:Jun 06 03:22:22 smithi079 ceph-mds[65446]: -- 172.21.15.79:0/142864601 <== mon.2 v2:172.21.15.79:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c10c939a40 con 0x55c10c90cc00 2024-06-06T03:22:22.349 INFO:journalctl@ceph.mds.b.smithi079.stdout:Jun 06 03:22:22 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-b[65442]: starting mds.b at 2024-06-06T03:22:22.349 INFO:journalctl@ceph.mds.b.smithi079.stdout:Jun 06 03:22:22 smithi079 bash[65427]: 4aa3980a15ca2957cf652f7be8af447ce54e9723bb0f00c3dad1e29cab0e9042 2024-06-06T03:22:22.350 INFO:journalctl@ceph.mds.b.smithi079.stdout:Jun 06 03:22:22 smithi079 systemd[1]: Started Ceph mds.b for b6263b26-23b2-11ef-bc9b-c7b262605968. 2024-06-06T03:22:22.538 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:22 smithi050 ceph-mon[32421]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:22.538 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:22 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:22.538 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:22 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:22.538 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:22 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:22.538 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:22 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:22.538 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:22 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:22.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.537+0000 7ffb93fff700 1 -- 172.21.15.50:0/3002845981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb94102eb0 msgr2=0x7ffb94103330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:22.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.537+0000 7ffb93fff700 1 --2- 172.21.15.50:0/3002845981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb94102eb0 0x7ffb94103330 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0099c0 tx=0x7ffb7c009cd0 comp rx=0 tx=0).stop 2024-06-06T03:22:22.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.537+0000 7ffb93fff700 1 -- 172.21.15.50:0/3002845981 shutdown_connections 2024-06-06T03:22:22.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.537+0000 7ffb93fff700 1 --2- 172.21.15.50:0/3002845981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb94103870 0x7ffb9410e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:22.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.537+0000 7ffb93fff700 1 --2- 172.21.15.50:0/3002845981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb941015c0 0x7ffb941019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:22.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.537+0000 7ffb93fff700 1 --2- 172.21.15.50:0/3002845981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb94102eb0 0x7ffb94103330 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:22.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.537+0000 7ffb93fff700 1 -- 172.21.15.50:0/3002845981 >> 172.21.15.50:0/3002845981 conn(0x7ffb940fcd70 msgr2=0x7ffb940ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:22:22.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.537+0000 7ffb93fff700 1 -- 172.21.15.50:0/3002845981 shutdown_connections 2024-06-06T03:22:22.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.537+0000 7ffb93fff700 1 -- 172.21.15.50:0/3002845981 wait complete. 2024-06-06T03:22:22.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.538+0000 7ffb93fff700 1 Processor -- start 2024-06-06T03:22:22.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.538+0000 7ffb93fff700 1 -- start start 2024-06-06T03:22:22.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.539+0000 7ffb93fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb941015c0 0x7ffb941a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:22.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.539+0000 7ffb93fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb94102eb0 0x7ffb941a0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:22.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.539+0000 7ffb93fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb94103870 0x7ffb9419aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:22.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.539+0000 7ffb93fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffb94111550 con 0x7ffb94103870 2024-06-06T03:22:22.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.539+0000 7ffb93fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffb941113d0 con 0x7ffb94102eb0 2024-06-06T03:22:22.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.539+0000 7ffb93fff700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ffb941116d0 con 0x7ffb941015c0 2024-06-06T03:22:22.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.539+0000 7ffb937fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb94103870 0x7ffb9419aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:22.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.539+0000 7ffb937fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb94103870 0x7ffb9419aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52484/0 (socket says 172.21.15.50:52484) 2024-06-06T03:22:22.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.539+0000 7ffb937fe700 1 -- 172.21.15.50:0/3669511962 learned_addr learned my addr 172.21.15.50:0/3669511962 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:22:22.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.539+0000 7ffb927fc700 1 --2- 172.21.15.50:0/3669511962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb94102eb0 0x7ffb941a0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:22.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.539+0000 7ffb92ffd700 1 --2- 172.21.15.50:0/3669511962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb941015c0 0x7ffb941a08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:22.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.539+0000 7ffb937fe700 1 -- 172.21.15.50:0/3669511962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb941015c0 msgr2=0x7ffb941a08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:22.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.539+0000 7ffb937fe700 1 --2- 172.21.15.50:0/3669511962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb941015c0 0x7ffb941a08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:22.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.539+0000 7ffb937fe700 1 -- 172.21.15.50:0/3669511962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb94102eb0 msgr2=0x7ffb941a0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:22.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.539+0000 7ffb937fe700 1 --2- 172.21.15.50:0/3669511962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb94102eb0 0x7ffb941a0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:22.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.539+0000 7ffb937fe700 1 -- 172.21.15.50:0/3669511962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb9419b1d0 con 0x7ffb94103870 2024-06-06T03:22:22.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.539+0000 7ffb927fc700 1 --2- 172.21.15.50:0/3669511962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb94102eb0 0x7ffb941a0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:22:22.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.539+0000 7ffb937fe700 1 --2- 172.21.15.50:0/3669511962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb94103870 0x7ffb9419aa70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c00ef30 tx=0x7ffb8c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:22:22.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.539+0000 7ffb989fd700 1 -- 172.21.15.50:0/3669511962 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c0092e0 con 0x7ffb94103870 2024-06-06T03:22:22.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.540+0000 7ffb989fd700 1 -- 172.21.15.50:0/3669511962 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb8c004bb0 con 0x7ffb94103870 2024-06-06T03:22:22.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.540+0000 7ffb93fff700 1 -- 172.21.15.50:0/3669511962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb9419b460 con 0x7ffb94103870 2024-06-06T03:22:22.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.540+0000 7ffb989fd700 1 -- 172.21.15.50:0/3669511962 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c004020 con 0x7ffb94103870 2024-06-06T03:22:22.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.540+0000 7ffb93fff700 1 -- 172.21.15.50:0/3669511962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb941a7780 con 0x7ffb94103870 2024-06-06T03:22:22.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.540+0000 7ffb93fff700 1 -- 172.21.15.50:0/3669511962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb94069180 con 0x7ffb94103870 2024-06-06T03:22:22.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.543+0000 7ffb989fd700 1 -- 172.21.15.50:0/3669511962 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ffb8c01b030 con 0x7ffb94103870 2024-06-06T03:22:22.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.544+0000 7ffb989fd700 1 --2- 172.21.15.50:0/3669511962 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ffb800a2ca0 0x7ffb800a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:22.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.544+0000 7ffb92ffd700 1 --2- 172.21.15.50:0/3669511962 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ffb800a2ca0 0x7ffb800a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:22.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.544+0000 7ffb989fd700 1 -- 172.21.15.50:0/3669511962 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7ffb8c0cef90 con 0x7ffb94103870 2024-06-06T03:22:22.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.544+0000 7ffb92ffd700 1 --2- 172.21.15.50:0/3669511962 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ffb800a2ca0 0x7ffb800a5160 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ffb9419bbb0 tx=0x7ffb84009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:22:22.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.547+0000 7ffb989fd700 1 -- 172.21.15.50:0/3669511962 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ffb8c022020 con 0x7ffb94103870 2024-06-06T03:22:22.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:22 smithi122 ceph-mon[35759]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:22.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:22 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:22.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:22 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:22.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:22 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:22.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:22 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:22.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:22 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:22.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.804+0000 7ffb93fff700 1 -- 172.21.15.50:0/3669511962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb941a7950 con 0x7ffb94103870 2024-06-06T03:22:22.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.804+0000 7ffb989fd700 1 -- 172.21.15.50:0/3669511962 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10464 (secure 0 0 0) 0x7ffb8c0b38f0 con 0x7ffb94103870 2024-06-06T03:22:22.804 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:22:22.805 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1667847852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1667847852},{"type":"v1","addr":"172.21.15.50:6835","nonce":1667847852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/239971838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":239971838},{"type":"v1","addr":"172.21.15.50:6837","nonce":239971838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/2188134216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2188134216},{"type":"v1","addr":"172.21.15.50:6839","nonce":2188134216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/632572420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":632572420},{"type":"v1","addr":"172.21.15.50:6841","nonce":632572420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/864537078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":864537078},{"type":"v1","addr":"172.21.15.79:6833","nonce":864537078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/279268898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":279268898},{"type":"v1","addr":"172.21.15.79:6835","nonce":279268898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/57533154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":57533154},{"type":"v1","addr":"172.21.15.122:6833","nonce":57533154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/3286722213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3286722213},{"type":"v1","addr":"172.21.15.79:6837","nonce":3286722213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24464,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/768067336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":768067336},{"type":"v1","addr":"172.21.15.79:6839","nonce":768067336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/2987597320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2987597320},{"type":"v1","addr":"172.21.15.122:6835","nonce":2987597320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1604366318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1604366318},{"type":"v1","addr":"172.21.15.122:6837","nonce":1604366318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24490,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6839/4129732900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":4129732900},{"type":"v1","addr":"172.21.15.122:6839","nonce":4129732900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-06-06T03:22:22.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.807+0000 7ffb93fff700 1 -- 172.21.15.50:0/3669511962 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ffb800a2ca0 msgr2=0x7ffb800a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:22.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.807+0000 7ffb93fff700 1 --2- 172.21.15.50:0/3669511962 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ffb800a2ca0 0x7ffb800a5160 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ffb9419bbb0 tx=0x7ffb84009260 comp rx=0 tx=0).stop 2024-06-06T03:22:22.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.807+0000 7ffb93fff700 1 -- 172.21.15.50:0/3669511962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb94103870 msgr2=0x7ffb9419aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:22.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.807+0000 7ffb93fff700 1 --2- 172.21.15.50:0/3669511962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb94103870 0x7ffb9419aa70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c00ef30 tx=0x7ffb8c00c3a0 comp rx=0 tx=0).stop 2024-06-06T03:22:22.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.807+0000 7ffb93fff700 1 -- 172.21.15.50:0/3669511962 shutdown_connections 2024-06-06T03:22:22.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.807+0000 7ffb93fff700 1 --2- 172.21.15.50:0/3669511962 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ffb800a2ca0 0x7ffb800a5160 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:22.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.807+0000 7ffb93fff700 1 --2- 172.21.15.50:0/3669511962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb94103870 0x7ffb9419aa70 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:22.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.807+0000 7ffb93fff700 1 --2- 172.21.15.50:0/3669511962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb941015c0 0x7ffb941a08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:22.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.807+0000 7ffb93fff700 1 --2- 172.21.15.50:0/3669511962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb94102eb0 0x7ffb941a0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:22.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.807+0000 7ffb93fff700 1 -- 172.21.15.50:0/3669511962 >> 172.21.15.50:0/3669511962 conn(0x7ffb940fcd70 msgr2=0x7ffb9410cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:22:22.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.807+0000 7ffb93fff700 1 -- 172.21.15.50:0/3669511962 shutdown_connections 2024-06-06T03:22:22.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:22.807+0000 7ffb93fff700 1 -- 172.21.15.50:0/3669511962 wait complete. 2024-06-06T03:22:22.808 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2024-06-06T03:22:22.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:22 smithi079 ceph-mon[35478]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:22.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:22 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:22.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:22 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:22.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:22 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:22.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:22 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:22.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:22 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:23.467 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-06-06T03:22:23.666 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:23 smithi079 ceph-mon[35478]: mds.? [v2:172.21.15.79:6838/768067336,v1:172.21.15.79:6839/768067336] up:boot 2024-06-06T03:22:23.666 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:23 smithi079 ceph-mon[35478]: fsmap 12 up:standby 2024-06-06T03:22:23.666 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:23 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-06T03:22:23.666 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:23 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:22:23.667 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:23 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/3669511962' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:22:23.667 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:23 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:23.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:23 smithi122 ceph-mon[35759]: mds.? [v2:172.21.15.79:6838/768067336,v1:172.21.15.79:6839/768067336] up:boot 2024-06-06T03:22:23.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:23 smithi122 ceph-mon[35759]: fsmap 12 up:standby 2024-06-06T03:22:23.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:23 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-06T03:22:23.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:23 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:22:23.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:23 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/3669511962' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:22:23.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:23 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:23.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:23 smithi050 ceph-mon[32421]: mds.? [v2:172.21.15.79:6838/768067336,v1:172.21.15.79:6839/768067336] up:boot 2024-06-06T03:22:23.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:23 smithi050 ceph-mon[32421]: fsmap 12 up:standby 2024-06-06T03:22:23.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:23 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-06T03:22:23.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:23 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:22:23.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:23 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3669511962' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:22:23.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:23 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:24.344 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:22:25.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:25 smithi122 ceph-mon[35759]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:25.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:25 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:25.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:25 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:25.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:25 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:25.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:25 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:25.470 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:25 smithi050 ceph-mon[32421]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:25.471 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:25 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:25.471 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:25 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:25.471 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:25 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:25.471 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:25 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:25.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:25 smithi079 ceph-mon[35478]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:25.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:25 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:25.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:25 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:25.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:25 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:25.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:25 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:26.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.013+0000 7f0025849700 1 -- 172.21.15.50:0/4142402669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00201084f0 msgr2=0x7f00201088d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:26.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.013+0000 7f0025849700 1 --2- 172.21.15.50:0/4142402669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00201084f0 0x7f00201088d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0010009990 tx=0x7f0010009ca0 comp rx=0 tx=0).stop 2024-06-06T03:22:26.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.014+0000 7f0025849700 1 -- 172.21.15.50:0/4142402669 shutdown_connections 2024-06-06T03:22:26.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.014+0000 7f0025849700 1 --2- 172.21.15.50:0/4142402669 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f002006b3c0 0x7f002010f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:26.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.014+0000 7f0025849700 1 --2- 172.21.15.50:0/4142402669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00201084f0 0x7f00201088d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:26.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.014+0000 7f0025849700 1 --2- 172.21.15.50:0/4142402669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f002006aa00 0x7f002006ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:26.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.014+0000 7f0025849700 1 -- 172.21.15.50:0/4142402669 >> 172.21.15.50:0/4142402669 conn(0x7f0020078300 msgr2=0x7f0020078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:22:26.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.014+0000 7f0025849700 1 -- 172.21.15.50:0/4142402669 shutdown_connections 2024-06-06T03:22:26.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.014+0000 7f0025849700 1 -- 172.21.15.50:0/4142402669 wait complete. 2024-06-06T03:22:26.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.014+0000 7f0025849700 1 Processor -- start 2024-06-06T03:22:26.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.014+0000 7f0025849700 1 -- start start 2024-06-06T03:22:26.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.015+0000 7f0025849700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f002006aa00 0x7f002019e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:26.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.015+0000 7f0025849700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f002006b3c0 0x7f002019ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:26.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.015+0000 7f0025849700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00201084f0 0x7f0020198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:26.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.015+0000 7f0025849700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0020112600 con 0x7f002006aa00 2024-06-06T03:22:26.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.015+0000 7f0025849700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0020112480 con 0x7f00201084f0 2024-06-06T03:22:26.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.015+0000 7f0025849700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0020112780 con 0x7f002006b3c0 2024-06-06T03:22:26.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.015+0000 7f001effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f002006aa00 0x7f002019e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:26.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.015+0000 7f001effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f002006aa00 0x7f002019e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52504/0 (socket says 172.21.15.50:52504) 2024-06-06T03:22:26.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.015+0000 7f001effd700 1 -- 172.21.15.50:0/2227436079 learned_addr learned my addr 172.21.15.50:0/2227436079 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:22:26.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.015+0000 7f00167fc700 1 --2- 172.21.15.50:0/2227436079 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f002006b3c0 0x7f002019ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:26.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.015+0000 7f001f7fe700 1 --2- 172.21.15.50:0/2227436079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00201084f0 0x7f0020198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:26.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.015+0000 7f001effd700 1 -- 172.21.15.50:0/2227436079 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f002006b3c0 msgr2=0x7f002019ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:26.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.015+0000 7f001effd700 1 --2- 172.21.15.50:0/2227436079 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f002006b3c0 0x7f002019ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:26.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.016+0000 7f001effd700 1 -- 172.21.15.50:0/2227436079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00201084f0 msgr2=0x7f0020198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:26.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.016+0000 7f001effd700 1 --2- 172.21.15.50:0/2227436079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00201084f0 0x7f0020198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:26.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.016+0000 7f001effd700 1 -- 172.21.15.50:0/2227436079 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00201990c0 con 0x7f002006aa00 2024-06-06T03:22:26.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.016+0000 7f001f7fe700 1 --2- 172.21.15.50:0/2227436079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00201084f0 0x7f0020198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:22:26.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.016+0000 7f001effd700 1 --2- 172.21.15.50:0/2227436079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f002006aa00 0x7f002019e7a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0010000c00 tx=0x7f0010003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:22:26.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.016+0000 7f0024847700 1 -- 172.21.15.50:0/2227436079 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0010027070 con 0x7f002006aa00 2024-06-06T03:22:26.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.016+0000 7f0025849700 1 -- 172.21.15.50:0/2227436079 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0020199350 con 0x7f002006aa00 2024-06-06T03:22:26.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.016+0000 7f0024847700 1 -- 172.21.15.50:0/2227436079 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f001000bdc0 con 0x7f002006aa00 2024-06-06T03:22:26.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.016+0000 7f0024847700 1 -- 172.21.15.50:0/2227436079 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001000f460 con 0x7f002006aa00 2024-06-06T03:22:26.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.016+0000 7f0025849700 1 -- 172.21.15.50:0/2227436079 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00201a5670 con 0x7f002006aa00 2024-06-06T03:22:26.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.017+0000 7f0025849700 1 -- 172.21.15.50:0/2227436079 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f002010a9d0 con 0x7f002006aa00 2024-06-06T03:22:26.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.019+0000 7f0024847700 1 -- 172.21.15.50:0/2227436079 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f001002a070 con 0x7f002006aa00 2024-06-06T03:22:26.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.020+0000 7f0024847700 1 --2- 172.21.15.50:0/2227436079 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f000c0a2c20 0x7f000c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:26.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.020+0000 7f00167fc700 1 --2- 172.21.15.50:0/2227436079 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f000c0a2c20 0x7f000c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:26.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.020+0000 7f0024847700 1 -- 172.21.15.50:0/2227436079 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f00100cfb40 con 0x7f002006aa00 2024-06-06T03:22:26.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.020+0000 7f00167fc700 1 --2- 172.21.15.50:0/2227436079 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f000c0a2c20 0x7f000c0a50e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0020078a20 tx=0x7f000800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:22:26.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.025+0000 7f0024847700 1 -- 172.21.15.50:0/2227436079 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f001005e850 con 0x7f002006aa00 2024-06-06T03:22:26.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.240+0000 7f0025849700 1 -- 172.21.15.50:0/2227436079 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f0020199e90 con 0x7f002006aa00 2024-06-06T03:22:26.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.241+0000 7f0024847700 1 -- 172.21.15.50:0/2227436079 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) ==== 84+0+65 (secure 0 0 0) 0x7f0010013070 con 0x7f002006aa00 2024-06-06T03:22:26.241 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:22:26.241 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2024-06-06T03:22:26.241 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:22:26.241 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2024-06-06T03:22:26.241 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2024-06-06T03:22:26.242 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:22:26.242 INFO:teuthology.orchestra.run.smithi050.stdout:] 2024-06-06T03:22:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.243+0000 7f0025849700 1 -- 172.21.15.50:0/2227436079 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f000c0a2c20 msgr2=0x7f000c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.243+0000 7f0025849700 1 --2- 172.21.15.50:0/2227436079 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f000c0a2c20 0x7f000c0a50e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0020078a20 tx=0x7f000800a300 comp rx=0 tx=0).stop 2024-06-06T03:22:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.243+0000 7f0025849700 1 -- 172.21.15.50:0/2227436079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f002006aa00 msgr2=0x7f002019e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.243+0000 7f0025849700 1 --2- 172.21.15.50:0/2227436079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f002006aa00 0x7f002019e7a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0010000c00 tx=0x7f0010003a80 comp rx=0 tx=0).stop 2024-06-06T03:22:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.243+0000 7f0025849700 1 -- 172.21.15.50:0/2227436079 shutdown_connections 2024-06-06T03:22:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.243+0000 7f0025849700 1 --2- 172.21.15.50:0/2227436079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00201084f0 0x7f0020198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.243+0000 7f0025849700 1 --2- 172.21.15.50:0/2227436079 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f000c0a2c20 0x7f000c0a50e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.243+0000 7f0025849700 1 --2- 172.21.15.50:0/2227436079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f002006aa00 0x7f002019e7a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.243+0000 7f0025849700 1 --2- 172.21.15.50:0/2227436079 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f002006b3c0 0x7f002019ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.243+0000 7f0025849700 1 -- 172.21.15.50:0/2227436079 >> 172.21.15.50:0/2227436079 conn(0x7f0020078300 msgr2=0x7f00201000e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:22:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.244+0000 7f0025849700 1 -- 172.21.15.50:0/2227436079 shutdown_connections 2024-06-06T03:22:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:26.244+0000 7f0025849700 1 -- 172.21.15.50:0/2227436079 wait complete. 2024-06-06T03:22:26.906 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-06-06T03:22:26.906 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-06-06T03:22:27.204 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:22:27.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:27 smithi122 ceph-mon[35759]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:27.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:27 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:27.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:27 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:27.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:27 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/2227436079' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-06-06T03:22:27.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:27 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:22:27.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:27 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:22:27.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:27 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:27.459 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:27 smithi050 ceph-mon[32421]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:27.459 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:27 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:27.459 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:27 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:27.459 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:27 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/2227436079' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-06-06T03:22:27.459 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:27 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:22:27.459 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:27 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:22:27.459 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:27 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:27.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:27 smithi079 ceph-mon[35478]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:27.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:27 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:27.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:27 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:27.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:27 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/2227436079' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-06-06T03:22:27.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:27 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:22:27.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:27 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:22:27.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:27 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:28.288 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:28 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:22:28.428 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:28 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:22:28.501 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:28 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:22:28.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.825+0000 7f54b197e700 1 -- 172.21.15.50:0/459499712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54ac107840 msgr2=0x7f54ac10f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:28.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.825+0000 7f54b197e700 1 --2- 172.21.15.50:0/459499712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54ac107840 0x7f54ac10f3c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f54a40099c0 tx=0x7f54a4009cd0 comp rx=0 tx=0).stop 2024-06-06T03:22:28.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.825+0000 7f54b197e700 1 -- 172.21.15.50:0/459499712 shutdown_connections 2024-06-06T03:22:28.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.825+0000 7f54b197e700 1 --2- 172.21.15.50:0/459499712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54ac107840 0x7f54ac10f3c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:28.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.825+0000 7f54b197e700 1 --2- 172.21.15.50:0/459499712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54ac102740 0x7f54ac102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:28.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.825+0000 7f54b197e700 1 --2- 172.21.15.50:0/459499712 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54ac1030f0 0x7f54ac107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:28.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.825+0000 7f54b197e700 1 -- 172.21.15.50:0/459499712 >> 172.21.15.50:0/459499712 conn(0x7f54ac0795f0 msgr2=0x7f54ac079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:22:28.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.825+0000 7f54b197e700 1 -- 172.21.15.50:0/459499712 shutdown_connections 2024-06-06T03:22:28.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.825+0000 7f54b197e700 1 -- 172.21.15.50:0/459499712 wait complete. 2024-06-06T03:22:28.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.826+0000 7f54b197e700 1 Processor -- start 2024-06-06T03:22:28.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.826+0000 7f54b197e700 1 -- start start 2024-06-06T03:22:28.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.826+0000 7f54b197e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54ac102740 0x7f54ac074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:28.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.826+0000 7f54b197e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54ac1030f0 0x7f54ac074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:28.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.826+0000 7f54b197e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54ac107840 0x7f54ac075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:28.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.827+0000 7f54b197e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac112680 con 0x7f54ac1030f0 2024-06-06T03:22:28.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.827+0000 7f54b197e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac112500 con 0x7f54ac107840 2024-06-06T03:22:28.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.827+0000 7f54b197e700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac112800 con 0x7f54ac102740 2024-06-06T03:22:28.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.827+0000 7f54aa7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54ac1030f0 0x7f54ac074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:28.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.827+0000 7f54aa7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54ac1030f0 0x7f54ac074cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39554/0 (socket says 172.21.15.50:39554) 2024-06-06T03:22:28.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.827+0000 7f54aa7fc700 1 -- 172.21.15.50:0/1333931260 learned_addr learned my addr 172.21.15.50:0/1333931260 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:22:28.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.827+0000 7f54aaffd700 1 --2- 172.21.15.50:0/1333931260 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54ac102740 0x7f54ac074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:28.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.827+0000 7f54ab7fe700 1 --2- 172.21.15.50:0/1333931260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54ac107840 0x7f54ac075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:28.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.827+0000 7f54aa7fc700 1 -- 172.21.15.50:0/1333931260 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54ac102740 msgr2=0x7f54ac074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:28.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.827+0000 7f54aa7fc700 1 --2- 172.21.15.50:0/1333931260 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54ac102740 0x7f54ac074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:28.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.827+0000 7f54aa7fc700 1 -- 172.21.15.50:0/1333931260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54ac107840 msgr2=0x7f54ac075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:28.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.827+0000 7f54aa7fc700 1 --2- 172.21.15.50:0/1333931260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54ac107840 0x7f54ac075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:28.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.827+0000 7f54aa7fc700 1 -- 172.21.15.50:0/1333931260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ac1a6fd0 con 0x7f54ac1030f0 2024-06-06T03:22:28.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.827+0000 7f54aa7fc700 1 --2- 172.21.15.50:0/1333931260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54ac1030f0 0x7f54ac074cd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f549400e9c0 tx=0x7f549400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:22:28.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.827+0000 7f54b097c700 1 -- 172.21.15.50:0/1333931260 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549400cbd0 con 0x7f54ac1030f0 2024-06-06T03:22:28.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.827+0000 7f54b097c700 1 -- 172.21.15.50:0/1333931260 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f549400ee60 con 0x7f54ac1030f0 2024-06-06T03:22:28.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.827+0000 7f54b097c700 1 -- 172.21.15.50:0/1333931260 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54940055b0 con 0x7f54ac1030f0 2024-06-06T03:22:28.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.827+0000 7f54b197e700 1 -- 172.21.15.50:0/1333931260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54ac1a72c0 con 0x7f54ac1030f0 2024-06-06T03:22:28.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.827+0000 7f54b197e700 1 -- 172.21.15.50:0/1333931260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54ac1a77b0 con 0x7f54ac1030f0 2024-06-06T03:22:28.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.828+0000 7f54b197e700 1 -- 172.21.15.50:0/1333931260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54ac069180 con 0x7f54ac1030f0 2024-06-06T03:22:28.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.830+0000 7f54b097c700 1 -- 172.21.15.50:0/1333931260 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5494004750 con 0x7f54ac1030f0 2024-06-06T03:22:28.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.830+0000 7f54b097c700 1 --2- 172.21.15.50:0/1333931260 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f54980a2ca0 0x7f54980a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:28.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.830+0000 7f54aaffd700 1 --2- 172.21.15.50:0/1333931260 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f54980a2ca0 0x7f54980a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:28.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.830+0000 7f54b097c700 1 -- 172.21.15.50:0/1333931260 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f54940ceef0 con 0x7f54ac1030f0 2024-06-06T03:22:28.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.831+0000 7f54aaffd700 1 --2- 172.21.15.50:0/1333931260 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f54980a2ca0 0x7f54980a5160 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f549c009550 tx=0x7f549c0091f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:22:28.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:28.834+0000 7f54b097c700 1 -- 172.21.15.50:0/1333931260 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5494053850 con 0x7f54ac1030f0 2024-06-06T03:22:29.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:29.054+0000 7f54b197e700 1 -- 172.21.15.50:0/1333931260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f54ac02dd40 con 0x7f54ac1030f0 2024-06-06T03:22:29.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:29 smithi050 ceph-mon[32421]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:29.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:29 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:29.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:29 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:29.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:29 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1333931260' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-06T03:22:29.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:29 smithi079 ceph-mon[35478]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:29.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:29 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:29.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:29 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:29.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:29 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/1333931260' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-06T03:22:29.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:29 smithi122 ceph-mon[35759]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:29.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:29 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:29.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:29 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:29.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:29 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/1333931260' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-06T03:22:30.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:30.039+0000 7f54b097c700 1 -- 172.21.15.50:0/1333931260 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) ==== 138+0+0 (secure 0 0 0) 0x7f549409c2f0 con 0x7f54ac1030f0 2024-06-06T03:22:30.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:30.042+0000 7f54b197e700 1 -- 172.21.15.50:0/1333931260 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f54980a2ca0 msgr2=0x7f54980a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:30.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:30.042+0000 7f54b197e700 1 --2- 172.21.15.50:0/1333931260 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f54980a2ca0 0x7f54980a5160 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f549c009550 tx=0x7f549c0091f0 comp rx=0 tx=0).stop 2024-06-06T03:22:30.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:30.042+0000 7f54b197e700 1 -- 172.21.15.50:0/1333931260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54ac1030f0 msgr2=0x7f54ac074cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:30.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:30.042+0000 7f54b197e700 1 --2- 172.21.15.50:0/1333931260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54ac1030f0 0x7f54ac074cd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f549400e9c0 tx=0x7f549400ecd0 comp rx=0 tx=0).stop 2024-06-06T03:22:30.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:30.042+0000 7f54b197e700 1 -- 172.21.15.50:0/1333931260 shutdown_connections 2024-06-06T03:22:30.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:30.042+0000 7f54b197e700 1 --2- 172.21.15.50:0/1333931260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54ac107840 0x7f54ac075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:30.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:30.042+0000 7f54b197e700 1 --2- 172.21.15.50:0/1333931260 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54ac102740 0x7f54ac074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:30.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:30.042+0000 7f54b197e700 1 --2- 172.21.15.50:0/1333931260 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f54980a2ca0 0x7f54980a5160 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:30.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:30.042+0000 7f54b197e700 1 --2- 172.21.15.50:0/1333931260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54ac1030f0 0x7f54ac074cd0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:30.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:30.042+0000 7f54b197e700 1 -- 172.21.15.50:0/1333931260 >> 172.21.15.50:0/1333931260 conn(0x7f54ac0795f0 msgr2=0x7f54ac100760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:22:30.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:30.042+0000 7f54b197e700 1 -- 172.21.15.50:0/1333931260 shutdown_connections 2024-06-06T03:22:30.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:30.043+0000 7f54b197e700 1 -- 172.21.15.50:0/1333931260 wait complete. 2024-06-06T03:22:30.045 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2024-06-06T03:22:30.661 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:30 smithi050 ceph-mon[32421]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:30.661 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:30 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:30.661 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:30 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:30.661 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:30 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1333931260' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-06-06T03:22:30.661 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:30 smithi050 ceph-mon[32421]: osdmap e82: 12 total, 12 up, 12 in 2024-06-06T03:22:30.661 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:30 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:30.661 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:30 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:30.661 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:30 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:22:30.661 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:30 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:22:30.661 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:30 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:30.691 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-06-06T03:22:30.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:30 smithi079 ceph-mon[35478]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:30.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:30 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:30.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:30 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:30.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:30 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/1333931260' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-06-06T03:22:30.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:30 smithi079 ceph-mon[35478]: osdmap e82: 12 total, 12 up, 12 in 2024-06-06T03:22:30.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:30 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:30.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:30 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:30.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:30 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:22:30.851 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:30 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:22:30.851 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:30 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:30.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:30 smithi122 ceph-mon[35759]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:30.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:30 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:30.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:30 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:30.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:30 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/1333931260' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-06-06T03:22:30.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:30 smithi122 ceph-mon[35759]: osdmap e82: 12 total, 12 up, 12 in 2024-06-06T03:22:30.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:30 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:30.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:30 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:30.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:30 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:22:30.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:30 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:22:30.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:30 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:22:30.941 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:22:32.315 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:32 smithi050 ceph-mon[32421]: osdmap e83: 12 total, 12 up, 12 in 2024-06-06T03:22:32.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:32 smithi079 ceph-mon[35478]: osdmap e83: 12 total, 12 up, 12 in 2024-06-06T03:22:32.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:32 smithi122 ceph-mon[35759]: osdmap e83: 12 total, 12 up, 12 in 2024-06-06T03:22:32.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.570+0000 7f4775a1a700 1 -- 172.21.15.50:0/4245661545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4770101d50 msgr2=0x7f477010e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:32.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.570+0000 7f4775a1a700 1 --2- 172.21.15.50:0/4245661545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4770101d50 0x7f477010e240 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f476800b0a0 tx=0x7f476800b3b0 comp rx=0 tx=0).stop 2024-06-06T03:22:32.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.570+0000 7f4775a1a700 1 -- 172.21.15.50:0/4245661545 shutdown_connections 2024-06-06T03:22:32.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.570+0000 7f4775a1a700 1 --2- 172.21.15.50:0/4245661545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4770101d50 0x7f477010e240 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:32.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.570+0000 7f4775a1a700 1 --2- 172.21.15.50:0/4245661545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4770107400 0x7f47701077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:32.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.570+0000 7f4775a1a700 1 --2- 172.21.15.50:0/4245661545 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4770101390 0x7f4770101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:32.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.570+0000 7f4775a1a700 1 -- 172.21.15.50:0/4245661545 >> 172.21.15.50:0/4245661545 conn(0x7f4770078340 msgr2=0x7f4770078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:22:32.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.570+0000 7f4775a1a700 1 -- 172.21.15.50:0/4245661545 shutdown_connections 2024-06-06T03:22:32.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.570+0000 7f4775a1a700 1 -- 172.21.15.50:0/4245661545 wait complete. 2024-06-06T03:22:32.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.571+0000 7f4775a1a700 1 Processor -- start 2024-06-06T03:22:32.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.571+0000 7f4775a1a700 1 -- start start 2024-06-06T03:22:32.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.571+0000 7f4775a1a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4770101390 0x7f477019e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:32.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.571+0000 7f4775a1a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4770101d50 0x7f477019edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:32.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.571+0000 7f4775a1a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4770107400 0x7f4770198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:32.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.572+0000 7f4775a1a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4770112700 con 0x7f4770107400 2024-06-06T03:22:32.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.572+0000 7f4775a1a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4770112580 con 0x7f4770101d50 2024-06-06T03:22:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.572+0000 7f4775a1a700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4770112880 con 0x7f4770101390 2024-06-06T03:22:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.572+0000 7f476f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4770107400 0x7f4770198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.572+0000 7f476f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4770107400 0x7f4770198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39582/0 (socket says 172.21.15.50:39582) 2024-06-06T03:22:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.572+0000 7f476f7fe700 1 -- 172.21.15.50:0/1183483421 learned_addr learned my addr 172.21.15.50:0/1183483421 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:22:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.572+0000 7f476e7fc700 1 --2- 172.21.15.50:0/1183483421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4770101d50 0x7f477019edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.572+0000 7f476effd700 1 --2- 172.21.15.50:0/1183483421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4770101390 0x7f477019e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.572+0000 7f476f7fe700 1 -- 172.21.15.50:0/1183483421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4770101390 msgr2=0x7f477019e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.572+0000 7f476f7fe700 1 --2- 172.21.15.50:0/1183483421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4770101390 0x7f477019e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.572+0000 7f476f7fe700 1 -- 172.21.15.50:0/1183483421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4770101d50 msgr2=0x7f477019edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.572+0000 7f476f7fe700 1 --2- 172.21.15.50:0/1183483421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4770101d50 0x7f477019edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.572+0000 7f476f7fe700 1 -- 172.21.15.50:0/1183483421 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47701991a0 con 0x7f4770107400 2024-06-06T03:22:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.572+0000 7f476e7fc700 1 --2- 172.21.15.50:0/1183483421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4770101d50 0x7f477019edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:22:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.572+0000 7f476f7fe700 1 --2- 172.21.15.50:0/1183483421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4770107400 0x7f4770198a40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4768009fd0 tx=0x7f4768004e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:22:32.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.572+0000 7f4774a18700 1 -- 172.21.15.50:0/1183483421 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4768021070 con 0x7f4770107400 2024-06-06T03:22:32.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.572+0000 7f4774a18700 1 -- 172.21.15.50:0/1183483421 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4768007c80 con 0x7f4770107400 2024-06-06T03:22:32.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.572+0000 7f4774a18700 1 -- 172.21.15.50:0/1183483421 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4768005280 con 0x7f4770107400 2024-06-06T03:22:32.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.572+0000 7f4775a1a700 1 -- 172.21.15.50:0/1183483421 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4770199430 con 0x7f4770107400 2024-06-06T03:22:32.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.572+0000 7f4775a1a700 1 -- 172.21.15.50:0/1183483421 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47701a5750 con 0x7f4770107400 2024-06-06T03:22:32.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.574+0000 7f4775a1a700 1 -- 172.21.15.50:0/1183483421 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4770069180 con 0x7f4770107400 2024-06-06T03:22:32.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.575+0000 7f4774a18700 1 -- 172.21.15.50:0/1183483421 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f4768024070 con 0x7f4770107400 2024-06-06T03:22:32.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.575+0000 7f4774a18700 1 --2- 172.21.15.50:0/1183483421 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f47580a2c20 0x7f47580a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:32.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.575+0000 7f476effd700 1 --2- 172.21.15.50:0/1183483421 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f47580a2c20 0x7f47580a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:32.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.576+0000 7f4774a18700 1 -- 172.21.15.50:0/1183483421 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7497+0+0 (secure 0 0 0) 0x7f476800f020 con 0x7f4770107400 2024-06-06T03:22:32.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.576+0000 7f476effd700 1 --2- 172.21.15.50:0/1183483421 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f47580a2c20 0x7f47580a50e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4760005950 tx=0x7f47600058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:22:32.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.580+0000 7f4774a18700 1 -- 172.21.15.50:0/1183483421 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f476802b020 con 0x7f4770107400 2024-06-06T03:22:32.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:32.785+0000 7f4775a1a700 1 -- 172.21.15.50:0/1183483421 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f477002dca0 con 0x7f4770107400 2024-06-06T03:22:33.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:33.273+0000 7f4774a18700 1 -- 172.21.15.50:0/1183483421 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v85) ==== 171+0+0 (secure 0 0 0) 0x7f476809da30 con 0x7f4770107400 2024-06-06T03:22:33.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:33.276+0000 7f4775a1a700 1 -- 172.21.15.50:0/1183483421 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f47580a2c20 msgr2=0x7f47580a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:33.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:33.276+0000 7f4775a1a700 1 --2- 172.21.15.50:0/1183483421 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f47580a2c20 0x7f47580a50e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4760005950 tx=0x7f47600058e0 comp rx=0 tx=0).stop 2024-06-06T03:22:33.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:33.276+0000 7f4775a1a700 1 -- 172.21.15.50:0/1183483421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4770107400 msgr2=0x7f4770198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:33.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:33.276+0000 7f4775a1a700 1 --2- 172.21.15.50:0/1183483421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4770107400 0x7f4770198a40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4768009fd0 tx=0x7f4768004e70 comp rx=0 tx=0).stop 2024-06-06T03:22:33.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:33.277+0000 7f4775a1a700 1 -- 172.21.15.50:0/1183483421 shutdown_connections 2024-06-06T03:22:33.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:33.277+0000 7f4775a1a700 1 --2- 172.21.15.50:0/1183483421 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f47580a2c20 0x7f47580a50e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:33.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:33.277+0000 7f4775a1a700 1 --2- 172.21.15.50:0/1183483421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4770107400 0x7f4770198a40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:33.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:33.277+0000 7f4775a1a700 1 --2- 172.21.15.50:0/1183483421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4770101390 0x7f477019e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:33.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:33.277+0000 7f4775a1a700 1 --2- 172.21.15.50:0/1183483421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4770101d50 0x7f477019edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:33.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:33.277+0000 7f4775a1a700 1 -- 172.21.15.50:0/1183483421 >> 172.21.15.50:0/1183483421 conn(0x7f4770078340 msgr2=0x7f47700ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:22:33.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:33.277+0000 7f4775a1a700 1 -- 172.21.15.50:0/1183483421 shutdown_connections 2024-06-06T03:22:33.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:33.277+0000 7f4775a1a700 1 -- 172.21.15.50:0/1183483421 wait complete. 2024-06-06T03:22:33.279 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2024-06-06T03:22:33.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:33 smithi050 ceph-mon[32421]: pgmap v292: 33 pgs: 6 creating+peering, 1 active+clean, 26 unknown; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:33.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:33 smithi050 ceph-mon[32421]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-06T03:22:33.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:33 smithi050 ceph-mon[32421]: osdmap e84: 12 total, 12 up, 12 in 2024-06-06T03:22:33.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:33 smithi079 ceph-mon[35478]: pgmap v292: 33 pgs: 6 creating+peering, 1 active+clean, 26 unknown; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:33.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:33 smithi079 ceph-mon[35478]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-06T03:22:33.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:33 smithi079 ceph-mon[35478]: osdmap e84: 12 total, 12 up, 12 in 2024-06-06T03:22:33.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:33 smithi122 ceph-mon[35759]: pgmap v292: 33 pgs: 6 creating+peering, 1 active+clean, 26 unknown; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:33.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:33 smithi122 ceph-mon[35759]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-06T03:22:33.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:33 smithi122 ceph-mon[35759]: osdmap e84: 12 total, 12 up, 12 in 2024-06-06T03:22:33.883 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-06-06T03:22:34.134 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:22:34.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:34 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1183483421' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-06-06T03:22:34.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:34 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1183483421' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-06-06T03:22:34.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:34 smithi050 ceph-mon[32421]: osdmap e85: 12 total, 12 up, 12 in 2024-06-06T03:22:34.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:34 smithi050 ceph-mon[32421]: pgmap v295: 97 pgs: 6 creating+peering, 7 active+clean, 84 unknown; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:34.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:34 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/1183483421' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-06-06T03:22:34.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:34 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/1183483421' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-06-06T03:22:34.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:34 smithi079 ceph-mon[35478]: osdmap e85: 12 total, 12 up, 12 in 2024-06-06T03:22:34.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:34 smithi079 ceph-mon[35478]: pgmap v295: 97 pgs: 6 creating+peering, 7 active+clean, 84 unknown; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:34.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:34 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/1183483421' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-06-06T03:22:34.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:34 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/1183483421' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-06-06T03:22:34.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:34 smithi122 ceph-mon[35759]: osdmap e85: 12 total, 12 up, 12 in 2024-06-06T03:22:34.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:34 smithi122 ceph-mon[35759]: pgmap v295: 97 pgs: 6 creating+peering, 7 active+clean, 84 unknown; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:35.533 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:35 smithi050 ceph-mon[32421]: osdmap e86: 12 total, 12 up, 12 in 2024-06-06T03:22:35.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:35 smithi079 ceph-mon[35478]: osdmap e86: 12 total, 12 up, 12 in 2024-06-06T03:22:35.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:35 smithi122 ceph-mon[35759]: osdmap e86: 12 total, 12 up, 12 in 2024-06-06T03:22:35.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.938+0000 7f08e7420700 1 -- 172.21.15.50:0/649135048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08e0102770 msgr2=0x7f08e0102b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:35.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.938+0000 7f08e7420700 1 --2- 172.21.15.50:0/649135048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08e0102770 0x7f08e0102b50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0099c0 tx=0x7f08dc009cd0 comp rx=0 tx=0).stop 2024-06-06T03:22:35.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.938+0000 7f08e7420700 1 -- 172.21.15.50:0/649135048 shutdown_connections 2024-06-06T03:22:35.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.938+0000 7f08e7420700 1 --2- 172.21.15.50:0/649135048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08e0107860 0x7f08e010f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:35.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.938+0000 7f08e7420700 1 --2- 172.21.15.50:0/649135048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08e0102770 0x7f08e0102b50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:35.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.938+0000 7f08e7420700 1 --2- 172.21.15.50:0/649135048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08e0103120 0x7f08e0107130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:35.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.938+0000 7f08e7420700 1 -- 172.21.15.50:0/649135048 >> 172.21.15.50:0/649135048 conn(0x7f08e0079600 msgr2=0x7f08e0079a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:22:35.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.938+0000 7f08e7420700 1 -- 172.21.15.50:0/649135048 shutdown_connections 2024-06-06T03:22:35.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.938+0000 7f08e7420700 1 -- 172.21.15.50:0/649135048 wait complete. 2024-06-06T03:22:35.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.939+0000 7f08e7420700 1 Processor -- start 2024-06-06T03:22:35.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.939+0000 7f08e7420700 1 -- start start 2024-06-06T03:22:35.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.939+0000 7f08e7420700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08e0102770 0x7f08e019e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:35.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.939+0000 7f08e7420700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08e0103120 0x7f08e019ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:35.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.939+0000 7f08e7420700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08e0107860 0x7f08e01989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:35.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.939+0000 7f08e7420700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f08e01126d0 con 0x7f08e0103120 2024-06-06T03:22:35.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.939+0000 7f08e7420700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f08e0112550 con 0x7f08e0107860 2024-06-06T03:22:35.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.939+0000 7f08e7420700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f08e0112850 con 0x7f08e0102770 2024-06-06T03:22:35.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.939+0000 7f08e49bb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08e0103120 0x7f08e019ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:35.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.939+0000 7f08e49bb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08e0103120 0x7f08e019ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39600/0 (socket says 172.21.15.50:39600) 2024-06-06T03:22:35.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.939+0000 7f08e49bb700 1 -- 172.21.15.50:0/1151212605 learned_addr learned my addr 172.21.15.50:0/1151212605 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:22:35.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.939+0000 7f08e59bd700 1 --2- 172.21.15.50:0/1151212605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08e0107860 0x7f08e01989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:35.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.939+0000 7f08e51bc700 1 --2- 172.21.15.50:0/1151212605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08e0102770 0x7f08e019e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:35.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.939+0000 7f08e49bb700 1 -- 172.21.15.50:0/1151212605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08e0102770 msgr2=0x7f08e019e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:35.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.939+0000 7f08e49bb700 1 --2- 172.21.15.50:0/1151212605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08e0102770 0x7f08e019e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:35.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.939+0000 7f08e49bb700 1 -- 172.21.15.50:0/1151212605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08e0107860 msgr2=0x7f08e01989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:35.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.939+0000 7f08e49bb700 1 --2- 172.21.15.50:0/1151212605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08e0107860 0x7f08e01989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:35.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.939+0000 7f08e49bb700 1 -- 172.21.15.50:0/1151212605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e0199130 con 0x7f08e0103120 2024-06-06T03:22:35.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.940+0000 7f08e49bb700 1 --2- 172.21.15.50:0/1151212605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08e0103120 0x7f08e019ed00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f08d000c970 tx=0x7f08d000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:22:35.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.940+0000 7f08d67fc700 1 -- 172.21.15.50:0/1151212605 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d0007aa0 con 0x7f08e0103120 2024-06-06T03:22:35.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.940+0000 7f08d67fc700 1 -- 172.21.15.50:0/1151212605 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f08d0004ce0 con 0x7f08e0103120 2024-06-06T03:22:35.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.940+0000 7f08e7420700 1 -- 172.21.15.50:0/1151212605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08e0199420 con 0x7f08e0103120 2024-06-06T03:22:35.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.940+0000 7f08d67fc700 1 -- 172.21.15.50:0/1151212605 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d0005520 con 0x7f08e0103120 2024-06-06T03:22:35.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.940+0000 7f08e7420700 1 -- 172.21.15.50:0/1151212605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08e01a5690 con 0x7f08e0103120 2024-06-06T03:22:35.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.941+0000 7f08e7420700 1 -- 172.21.15.50:0/1151212605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08e010aaa0 con 0x7f08e0103120 2024-06-06T03:22:35.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.942+0000 7f08d67fc700 1 -- 172.21.15.50:0/1151212605 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f08d0004750 con 0x7f08e0103120 2024-06-06T03:22:35.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.943+0000 7f08d67fc700 1 --2- 172.21.15.50:0/1151212605 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f08cc0a2ca0 0x7f08cc0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:35.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.943+0000 7f08d67fc700 1 -- 172.21.15.50:0/1151212605 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 7879+0+0 (secure 0 0 0) 0x7f08d00cef90 con 0x7f08e0103120 2024-06-06T03:22:35.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.943+0000 7f08e51bc700 1 --2- 172.21.15.50:0/1151212605 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f08cc0a2ca0 0x7f08cc0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:35.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.943+0000 7f08e51bc700 1 --2- 172.21.15.50:0/1151212605 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f08cc0a2ca0 0x7f08cc0a5160 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f08dc000c00 tx=0x7f08dc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:22:35.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:35.947+0000 7f08d67fc700 1 -- 172.21.15.50:0/1151212605 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f08d009c120 con 0x7f08e0103120 2024-06-06T03:22:36.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:36.201+0000 7f08e7420700 1 -- 172.21.15.50:0/1151212605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f08e0069180 con 0x7f08e0103120 2024-06-06T03:22:36.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:36.288+0000 7f08d67fc700 1 -- 172.21.15.50:0/1151212605 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f08d009ba20 con 0x7f08e0103120 2024-06-06T03:22:36.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:36.291+0000 7f08e7420700 1 -- 172.21.15.50:0/1151212605 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f08cc0a2ca0 msgr2=0x7f08cc0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:36.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:36.291+0000 7f08e7420700 1 --2- 172.21.15.50:0/1151212605 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f08cc0a2ca0 0x7f08cc0a5160 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f08dc000c00 tx=0x7f08dc005fb0 comp rx=0 tx=0).stop 2024-06-06T03:22:36.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:36.291+0000 7f08e7420700 1 -- 172.21.15.50:0/1151212605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08e0103120 msgr2=0x7f08e019ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:36.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:36.291+0000 7f08e7420700 1 --2- 172.21.15.50:0/1151212605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08e0103120 0x7f08e019ed00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f08d000c970 tx=0x7f08d000cc80 comp rx=0 tx=0).stop 2024-06-06T03:22:36.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:36.291+0000 7f08e7420700 1 -- 172.21.15.50:0/1151212605 shutdown_connections 2024-06-06T03:22:36.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:36.291+0000 7f08e7420700 1 --2- 172.21.15.50:0/1151212605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08e0107860 0x7f08e01989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:36.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:36.291+0000 7f08e7420700 1 --2- 172.21.15.50:0/1151212605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08e0102770 0x7f08e019e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:36.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:36.291+0000 7f08e7420700 1 --2- 172.21.15.50:0/1151212605 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f08cc0a2ca0 0x7f08cc0a5160 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:36.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:36.291+0000 7f08e7420700 1 --2- 172.21.15.50:0/1151212605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08e0103120 0x7f08e019ed00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:36.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:36.291+0000 7f08e7420700 1 -- 172.21.15.50:0/1151212605 >> 172.21.15.50:0/1151212605 conn(0x7f08e0079600 msgr2=0x7f08e0101d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:22:36.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:36.291+0000 7f08e7420700 1 -- 172.21.15.50:0/1151212605 shutdown_connections 2024-06-06T03:22:36.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:36.291+0000 7f08e7420700 1 -- 172.21.15.50:0/1151212605 wait complete. 2024-06-06T03:22:36.291 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 2 and data pool 3 2024-06-06T03:22:36.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:36 smithi050 ceph-mon[32421]: osdmap e87: 12 total, 12 up, 12 in 2024-06-06T03:22:36.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:36 smithi050 ceph-mon[32421]: pgmap v298: 97 pgs: 37 creating+peering, 47 active+clean, 13 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:36.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:36 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1151212605' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-06T03:22:36.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:36 smithi050 ceph-mon[32421]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-06-06T03:22:36.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:36 smithi079 ceph-mon[35478]: osdmap e87: 12 total, 12 up, 12 in 2024-06-06T03:22:36.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:36 smithi079 ceph-mon[35478]: pgmap v298: 97 pgs: 37 creating+peering, 47 active+clean, 13 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:36.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:36 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/1151212605' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-06T03:22:36.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:36 smithi079 ceph-mon[35478]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-06-06T03:22:36.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:36 smithi122 ceph-mon[35759]: osdmap e87: 12 total, 12 up, 12 in 2024-06-06T03:22:36.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:36 smithi122 ceph-mon[35759]: pgmap v298: 97 pgs: 37 creating+peering, 47 active+clean, 13 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:36.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:36 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/1151212605' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-06T03:22:36.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:36 smithi122 ceph-mon[35759]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-06-06T03:22:37.071 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-06-06T03:22:37.072 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-06-06T03:22:37.326 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:22:37.571 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:37 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1151212605' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-06-06T03:22:37.571 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:37 smithi050 ceph-mon[32421]: osdmap e88: 12 total, 12 up, 12 in 2024-06-06T03:22:37.571 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:37 smithi050 ceph-mon[32421]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-06-06T03:22:37.571 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:37 smithi050 ceph-mon[32421]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-06-06T03:22:37.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:37 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/1151212605' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-06-06T03:22:37.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:37 smithi079 ceph-mon[35478]: osdmap e88: 12 total, 12 up, 12 in 2024-06-06T03:22:37.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:37 smithi079 ceph-mon[35478]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-06-06T03:22:37.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:37 smithi079 ceph-mon[35478]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-06-06T03:22:37.681 INFO:journalctl@ceph.mds.i.smithi122.stdout:Jun 06 03:22:37 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-i[66519]: 2024-06-06T03:22:37.393+0000 7fe6cc340700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-06T03:22:37.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:37 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/1151212605' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-06-06T03:22:37.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:37 smithi122 ceph-mon[35759]: osdmap e88: 12 total, 12 up, 12 in 2024-06-06T03:22:37.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:37 smithi122 ceph-mon[35759]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-06-06T03:22:37.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:37 smithi122 ceph-mon[35759]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-06-06T03:22:38.482 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:38 smithi050 ceph-mon[32421]: mds.? [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] up:active 2024-06-06T03:22:38.482 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:38 smithi050 ceph-mon[32421]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-06T03:22:38.483 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:38 smithi050 ceph-mon[32421]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-06T03:22:38.483 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:38 smithi050 ceph-mon[32421]: pgmap v300: 97 pgs: 37 creating+peering, 56 active+clean, 4 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 251 B/s wr, 0 op/s 2024-06-06T03:22:38.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:38 smithi079 ceph-mon[35478]: mds.? [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] up:active 2024-06-06T03:22:38.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:38 smithi079 ceph-mon[35478]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-06T03:22:38.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:38 smithi079 ceph-mon[35478]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-06T03:22:38.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:38 smithi079 ceph-mon[35478]: pgmap v300: 97 pgs: 37 creating+peering, 56 active+clean, 4 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 251 B/s wr, 0 op/s 2024-06-06T03:22:38.606 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:38 smithi122 ceph-mon[35759]: mds.? [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] up:active 2024-06-06T03:22:38.607 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:38 smithi122 ceph-mon[35759]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-06T03:22:38.607 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:38 smithi122 ceph-mon[35759]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-06T03:22:38.607 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:38 smithi122 ceph-mon[35759]: pgmap v300: 97 pgs: 37 creating+peering, 56 active+clean, 4 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 251 B/s wr, 0 op/s 2024-06-06T03:22:39.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.059+0000 7f71d2f1f700 1 -- 172.21.15.50:0/2347601833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71cc101d50 msgr2=0x7f71cc10e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:39.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.059+0000 7f71d2f1f700 1 --2- 172.21.15.50:0/2347601833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71cc101d50 0x7f71cc10e240 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f71c400b0a0 tx=0x7f71c400b3b0 comp rx=0 tx=0).stop 2024-06-06T03:22:39.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.060+0000 7f71d2f1f700 1 -- 172.21.15.50:0/2347601833 shutdown_connections 2024-06-06T03:22:39.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.060+0000 7f71d2f1f700 1 --2- 172.21.15.50:0/2347601833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71cc101d50 0x7f71cc10e240 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:39.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.060+0000 7f71d2f1f700 1 --2- 172.21.15.50:0/2347601833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71cc107400 0x7f71cc1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:39.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.060+0000 7f71d2f1f700 1 --2- 172.21.15.50:0/2347601833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71cc101390 0x7f71cc101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:39.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.060+0000 7f71d2f1f700 1 -- 172.21.15.50:0/2347601833 >> 172.21.15.50:0/2347601833 conn(0x7f71cc078340 msgr2=0x7f71cc078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:22:39.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.060+0000 7f71d2f1f700 1 -- 172.21.15.50:0/2347601833 shutdown_connections 2024-06-06T03:22:39.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.060+0000 7f71d2f1f700 1 -- 172.21.15.50:0/2347601833 wait complete. 2024-06-06T03:22:39.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.060+0000 7f71d2f1f700 1 Processor -- start 2024-06-06T03:22:39.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.060+0000 7f71d2f1f700 1 -- start start 2024-06-06T03:22:39.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.060+0000 7f71d2f1f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71cc101390 0x7f71cc19e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:39.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.060+0000 7f71d2f1f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71cc101d50 0x7f71cc19ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:39.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.061+0000 7f71d2f1f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71cc107400 0x7f71cc198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:39.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.061+0000 7f71d2f1f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f71cc111550 con 0x7f71cc101390 2024-06-06T03:22:39.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.061+0000 7f71d2f1f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f71cc1113d0 con 0x7f71cc101d50 2024-06-06T03:22:39.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.061+0000 7f71d2f1f700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f71cc1116d0 con 0x7f71cc107400 2024-06-06T03:22:39.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.061+0000 7f71d0cbb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71cc101390 0x7f71cc19e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:39.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.061+0000 7f71d0cbb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71cc101390 0x7f71cc19e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52978/0 (socket says 172.21.15.50:52978) 2024-06-06T03:22:39.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.061+0000 7f71d0cbb700 1 -- 172.21.15.50:0/2405994150 learned_addr learned my addr 172.21.15.50:0/2405994150 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:22:39.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.061+0000 7f71d14bc700 1 --2- 172.21.15.50:0/2405994150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71cc107400 0x7f71cc198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:39.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.061+0000 7f71cbfff700 1 --2- 172.21.15.50:0/2405994150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71cc101d50 0x7f71cc19ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:39.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.061+0000 7f71d0cbb700 1 -- 172.21.15.50:0/2405994150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71cc107400 msgr2=0x7f71cc198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:39.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.061+0000 7f71d0cbb700 1 --2- 172.21.15.50:0/2405994150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71cc107400 0x7f71cc198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:39.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.061+0000 7f71d0cbb700 1 -- 172.21.15.50:0/2405994150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71cc101d50 msgr2=0x7f71cc19ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:39.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.061+0000 7f71d0cbb700 1 --2- 172.21.15.50:0/2405994150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71cc101d50 0x7f71cc19ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:39.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.061+0000 7f71d0cbb700 1 -- 172.21.15.50:0/2405994150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71cc1990b0 con 0x7f71cc101390 2024-06-06T03:22:39.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.061+0000 7f71d0cbb700 1 --2- 172.21.15.50:0/2405994150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71cc101390 0x7f71cc19e740 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f71c000e9a0 tx=0x7f71c000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:22:39.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.061+0000 7f71c9ffb700 1 -- 172.21.15.50:0/2405994150 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c000ca10 con 0x7f71cc101390 2024-06-06T03:22:39.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.061+0000 7f71c9ffb700 1 -- 172.21.15.50:0/2405994150 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f71c000cbb0 con 0x7f71cc101390 2024-06-06T03:22:39.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.061+0000 7f71d2f1f700 1 -- 172.21.15.50:0/2405994150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71cc1993a0 con 0x7f71cc101390 2024-06-06T03:22:39.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.061+0000 7f71c9ffb700 1 -- 172.21.15.50:0/2405994150 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c0018680 con 0x7f71cc101390 2024-06-06T03:22:39.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.062+0000 7f71d2f1f700 1 -- 172.21.15.50:0/2405994150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71cc1a5610 con 0x7f71cc101390 2024-06-06T03:22:39.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.062+0000 7f71d2f1f700 1 -- 172.21.15.50:0/2405994150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71cc069180 con 0x7f71cc101390 2024-06-06T03:22:39.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.064+0000 7f71c9ffb700 1 -- 172.21.15.50:0/2405994150 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f71c0010430 con 0x7f71cc101390 2024-06-06T03:22:39.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.064+0000 7f71c9ffb700 1 --2- 172.21.15.50:0/2405994150 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f71bc0a2c20 0x7f71bc0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:39.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.064+0000 7f71c9ffb700 1 -- 172.21.15.50:0/2405994150 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7f71c00cf220 con 0x7f71cc101390 2024-06-06T03:22:39.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.064+0000 7f71cbfff700 1 --2- 172.21.15.50:0/2405994150 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f71bc0a2c20 0x7f71bc0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:39.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.065+0000 7f71cbfff700 1 --2- 172.21.15.50:0/2405994150 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f71bc0a2c20 0x7f71bc0a50e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f71cc078940 tx=0x7f71b8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:22:39.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.070+0000 7f71c9ffb700 1 -- 172.21.15.50:0/2405994150 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f71c009c2d0 con 0x7f71cc101390 2024-06-06T03:22:39.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.287+0000 7f71d2f1f700 1 -- 172.21.15.50:0/2405994150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f71cc1a5840 con 0x7f71cc101390 2024-06-06T03:22:39.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.306+0000 7f71c9ffb700 1 -- 172.21.15.50:0/2405994150 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v89) ==== 157+0+0 (secure 0 0 0) 0x7f71c009bbd0 con 0x7f71cc101390 2024-06-06T03:22:39.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.308+0000 7f71d2f1f700 1 -- 172.21.15.50:0/2405994150 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f71bc0a2c20 msgr2=0x7f71bc0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:39.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.308+0000 7f71d2f1f700 1 --2- 172.21.15.50:0/2405994150 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f71bc0a2c20 0x7f71bc0a50e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f71cc078940 tx=0x7f71b8009260 comp rx=0 tx=0).stop 2024-06-06T03:22:39.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.308+0000 7f71d2f1f700 1 -- 172.21.15.50:0/2405994150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71cc101390 msgr2=0x7f71cc19e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:39.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.308+0000 7f71d2f1f700 1 --2- 172.21.15.50:0/2405994150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71cc101390 0x7f71cc19e740 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f71c000e9a0 tx=0x7f71c000ecb0 comp rx=0 tx=0).stop 2024-06-06T03:22:39.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.308+0000 7f71d2f1f700 1 -- 172.21.15.50:0/2405994150 shutdown_connections 2024-06-06T03:22:39.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.308+0000 7f71d2f1f700 1 --2- 172.21.15.50:0/2405994150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71cc107400 0x7f71cc198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:39.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.308+0000 7f71d2f1f700 1 --2- 172.21.15.50:0/2405994150 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f71bc0a2c20 0x7f71bc0a50e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:39.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.308+0000 7f71d2f1f700 1 --2- 172.21.15.50:0/2405994150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71cc101390 0x7f71cc19e740 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:39.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.308+0000 7f71d2f1f700 1 --2- 172.21.15.50:0/2405994150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71cc101d50 0x7f71cc19ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:39.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.308+0000 7f71d2f1f700 1 -- 172.21.15.50:0/2405994150 >> 172.21.15.50:0/2405994150 conn(0x7f71cc078340 msgr2=0x7f71cc100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:22:39.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.308+0000 7f71d2f1f700 1 -- 172.21.15.50:0/2405994150 shutdown_connections 2024-06-06T03:22:39.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:39.309+0000 7f71d2f1f700 1 -- 172.21.15.50:0/2405994150 wait complete. 2024-06-06T03:22:39.319 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:39 smithi050 ceph-mon[32421]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-06-06T03:22:39.319 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:39 smithi050 ceph-mon[32421]: Cluster is now healthy 2024-06-06T03:22:39.319 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:39 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/2405994150' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-06-06T03:22:39.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:39 smithi079 ceph-mon[35478]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-06-06T03:22:39.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:39 smithi079 ceph-mon[35478]: Cluster is now healthy 2024-06-06T03:22:39.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:39 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/2405994150' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-06-06T03:22:39.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:39 smithi122 ceph-mon[35759]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-06-06T03:22:39.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:39 smithi122 ceph-mon[35759]: Cluster is now healthy 2024-06-06T03:22:39.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:39 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/2405994150' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-06-06T03:22:40.007 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-06-06T03:22:40.259 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:22:40.570 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:40 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/2405994150' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-06-06T03:22:40.570 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:40 smithi050 ceph-mon[32421]: osdmap e89: 12 total, 12 up, 12 in 2024-06-06T03:22:40.571 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:40 smithi050 ceph-mon[32421]: pgmap v302: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 4 op/s 2024-06-06T03:22:40.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:40 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/2405994150' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-06-06T03:22:40.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:40 smithi079 ceph-mon[35478]: osdmap e89: 12 total, 12 up, 12 in 2024-06-06T03:22:40.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:40 smithi079 ceph-mon[35478]: pgmap v302: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 4 op/s 2024-06-06T03:22:40.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:40 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/2405994150' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-06-06T03:22:40.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:40 smithi122 ceph-mon[35759]: osdmap e89: 12 total, 12 up, 12 in 2024-06-06T03:22:40.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:40 smithi122 ceph-mon[35759]: pgmap v302: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 4 op/s 2024-06-06T03:22:42.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.023+0000 7fba9d0b0700 1 -- 172.21.15.50:0/1669433037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba98107790 msgr2=0x7fba9810f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:42.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.023+0000 7fba9d0b0700 1 --2- 172.21.15.50:0/1669433037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba98107790 0x7fba9810f3a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fba9000b0d0 tx=0x7fba9000b3e0 comp rx=0 tx=0).stop 2024-06-06T03:22:42.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.023+0000 7fba9d0b0700 1 -- 172.21.15.50:0/1669433037 shutdown_connections 2024-06-06T03:22:42.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.023+0000 7fba9d0b0700 1 --2- 172.21.15.50:0/1669433037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba98107790 0x7fba9810f3a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:42.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.023+0000 7fba9d0b0700 1 --2- 172.21.15.50:0/1669433037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba981027a0 0x7fba98102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:42.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.023+0000 7fba9d0b0700 1 --2- 172.21.15.50:0/1669433037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba98103150 0x7fba981070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:42.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.023+0000 7fba9d0b0700 1 -- 172.21.15.50:0/1669433037 >> 172.21.15.50:0/1669433037 conn(0x7fba98079560 msgr2=0x7fba98079970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:22:42.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.023+0000 7fba9d0b0700 1 -- 172.21.15.50:0/1669433037 shutdown_connections 2024-06-06T03:22:42.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.024+0000 7fba9d0b0700 1 -- 172.21.15.50:0/1669433037 wait complete. 2024-06-06T03:22:42.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.024+0000 7fba9d0b0700 1 Processor -- start 2024-06-06T03:22:42.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.025+0000 7fba9d0b0700 1 -- start start 2024-06-06T03:22:42.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.025+0000 7fba9d0b0700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba981027a0 0x7fba9819e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:42.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.025+0000 7fba9d0b0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba98103150 0x7fba9819ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:42.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.025+0000 7fba9d0b0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba98107790 0x7fba981988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:42.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.025+0000 7fba9d0b0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fba98112670 con 0x7fba98107790 2024-06-06T03:22:42.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.025+0000 7fba9d0b0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fba981124f0 con 0x7fba98103150 2024-06-06T03:22:42.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.025+0000 7fba9d0b0700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fba981127f0 con 0x7fba981027a0 2024-06-06T03:22:42.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.025+0000 7fba9759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba98107790 0x7fba981988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:42.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.025+0000 7fba9759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba98107790 0x7fba981988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52998/0 (socket says 172.21.15.50:52998) 2024-06-06T03:22:42.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.025+0000 7fba9759e700 1 -- 172.21.15.50:0/487357069 learned_addr learned my addr 172.21.15.50:0/487357069 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:22:42.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.025+0000 7fba96d9d700 1 --2- 172.21.15.50:0/487357069 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba981027a0 0x7fba9819e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:42.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.025+0000 7fba9659c700 1 --2- 172.21.15.50:0/487357069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba98103150 0x7fba9819ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:42.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.025+0000 7fba9759e700 1 -- 172.21.15.50:0/487357069 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba981027a0 msgr2=0x7fba9819e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:42.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.025+0000 7fba9759e700 1 --2- 172.21.15.50:0/487357069 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba981027a0 0x7fba9819e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:42.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.025+0000 7fba9759e700 1 -- 172.21.15.50:0/487357069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba98103150 msgr2=0x7fba9819ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:42.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.025+0000 7fba9759e700 1 --2- 172.21.15.50:0/487357069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba98103150 0x7fba9819ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:42.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.025+0000 7fba9759e700 1 -- 172.21.15.50:0/487357069 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba98199030 con 0x7fba98107790 2024-06-06T03:22:42.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.026+0000 7fba9759e700 1 --2- 172.21.15.50:0/487357069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba98107790 0x7fba981988d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fba90009fd0 tx=0x7fba90007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:22:42.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.026+0000 7fba7ffff700 1 -- 172.21.15.50:0/487357069 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9001f070 con 0x7fba98107790 2024-06-06T03:22:42.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.026+0000 7fba9d0b0700 1 -- 172.21.15.50:0/487357069 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba981992c0 con 0x7fba98107790 2024-06-06T03:22:42.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.026+0000 7fba7ffff700 1 -- 172.21.15.50:0/487357069 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fba90003c00 con 0x7fba98107790 2024-06-06T03:22:42.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.026+0000 7fba9d0b0700 1 -- 172.21.15.50:0/487357069 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba981a5590 con 0x7fba98107790 2024-06-06T03:22:42.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.026+0000 7fba7ffff700 1 -- 172.21.15.50:0/487357069 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9001b770 con 0x7fba98107790 2024-06-06T03:22:42.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.027+0000 7fba9d0b0700 1 -- 172.21.15.50:0/487357069 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba98050a00 con 0x7fba98107790 2024-06-06T03:22:42.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.028+0000 7fba7ffff700 1 -- 172.21.15.50:0/487357069 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fba90022070 con 0x7fba98107790 2024-06-06T03:22:42.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.029+0000 7fba7ffff700 1 --2- 172.21.15.50:0/487357069 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fba800a2cc0 0x7fba800a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:42.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.029+0000 7fba96d9d700 1 --2- 172.21.15.50:0/487357069 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fba800a2cc0 0x7fba800a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:42.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.029+0000 7fba7ffff700 1 -- 172.21.15.50:0/487357069 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8277+0+0 (secure 0 0 0) 0x7fba9000f020 con 0x7fba98107790 2024-06-06T03:22:42.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.029+0000 7fba96d9d700 1 --2- 172.21.15.50:0/487357069 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fba800a2cc0 0x7fba800a5180 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fba98079cc0 tx=0x7fba8800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:22:42.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.032+0000 7fba7ffff700 1 -- 172.21.15.50:0/487357069 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fba90029020 con 0x7fba98107790 2024-06-06T03:22:42.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:42.241+0000 7fba9d0b0700 1 -- 172.21.15.50:0/487357069 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fba9802dca0 con 0x7fba98107790 2024-06-06T03:22:43.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:42 smithi079 ceph-mon[35478]: pgmap v303: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-06-06T03:22:43.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:42 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/487357069' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-06T03:22:43.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:42 smithi122 ceph-mon[35759]: pgmap v303: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-06-06T03:22:43.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:42 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/487357069' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-06T03:22:43.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:42 smithi050 ceph-mon[32421]: pgmap v303: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-06-06T03:22:43.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:42 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/487357069' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-06T03:22:43.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:43.394+0000 7fba7ffff700 1 -- 172.21.15.50:0/487357069 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v91) ==== 228+0+0 (secure 0 0 0) 0x7fba9009d6e0 con 0x7fba98107790 2024-06-06T03:22:43.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:43.397+0000 7fba9d0b0700 1 -- 172.21.15.50:0/487357069 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fba800a2cc0 msgr2=0x7fba800a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:43.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:43.397+0000 7fba9d0b0700 1 --2- 172.21.15.50:0/487357069 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fba800a2cc0 0x7fba800a5180 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fba98079cc0 tx=0x7fba8800a380 comp rx=0 tx=0).stop 2024-06-06T03:22:43.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:43.397+0000 7fba9d0b0700 1 -- 172.21.15.50:0/487357069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba98107790 msgr2=0x7fba981988d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:43.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:43.397+0000 7fba9d0b0700 1 --2- 172.21.15.50:0/487357069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba98107790 0x7fba981988d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fba90009fd0 tx=0x7fba90007a20 comp rx=0 tx=0).stop 2024-06-06T03:22:43.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:43.397+0000 7fba9d0b0700 1 -- 172.21.15.50:0/487357069 shutdown_connections 2024-06-06T03:22:43.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:43.397+0000 7fba9d0b0700 1 --2- 172.21.15.50:0/487357069 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fba800a2cc0 0x7fba800a5180 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:43.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:43.397+0000 7fba9d0b0700 1 --2- 172.21.15.50:0/487357069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba98107790 0x7fba981988d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:43.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:43.397+0000 7fba9d0b0700 1 --2- 172.21.15.50:0/487357069 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba981027a0 0x7fba9819e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:43.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:43.397+0000 7fba9d0b0700 1 --2- 172.21.15.50:0/487357069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba98103150 0x7fba9819ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:43.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:43.397+0000 7fba9d0b0700 1 -- 172.21.15.50:0/487357069 >> 172.21.15.50:0/487357069 conn(0x7fba98079560 msgr2=0x7fba981015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:22:43.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:43.397+0000 7fba9d0b0700 1 -- 172.21.15.50:0/487357069 shutdown_connections 2024-06-06T03:22:43.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:43.397+0000 7fba9d0b0700 1 -- 172.21.15.50:0/487357069 wait complete. 2024-06-06T03:22:43.398 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data_ec' created 2024-06-06T03:22:43.985 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:43 smithi050 ceph-mon[32421]: osdmap e90: 12 total, 12 up, 12 in 2024-06-06T03:22:44.702 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:43 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/487357069' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-06-06T03:22:44.702 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:43 smithi050 ceph-mon[32421]: osdmap e91: 12 total, 12 up, 12 in 2024-06-06T03:22:44.703 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:43 smithi122 ceph-mon[35759]: osdmap e90: 12 total, 12 up, 12 in 2024-06-06T03:22:44.703 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:43 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/487357069' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-06-06T03:22:44.703 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:43 smithi122 ceph-mon[35759]: osdmap e91: 12 total, 12 up, 12 in 2024-06-06T03:22:44.703 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:43 smithi079 ceph-mon[35478]: osdmap e90: 12 total, 12 up, 12 in 2024-06-06T03:22:44.703 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:43 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/487357069' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-06-06T03:22:44.703 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:43 smithi079 ceph-mon[35478]: osdmap e91: 12 total, 12 up, 12 in 2024-06-06T03:22:44.704 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-06-06T03:22:44.968 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:22:45.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:44 smithi050 ceph-mon[32421]: pgmap v305: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-06-06T03:22:45.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:44 smithi050 ceph-mon[32421]: osdmap e92: 12 total, 12 up, 12 in 2024-06-06T03:22:45.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:44 smithi079 ceph-mon[35478]: pgmap v305: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-06-06T03:22:45.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:44 smithi079 ceph-mon[35478]: osdmap e92: 12 total, 12 up, 12 in 2024-06-06T03:22:45.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:44 smithi122 ceph-mon[35759]: pgmap v305: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-06-06T03:22:45.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:44 smithi122 ceph-mon[35759]: osdmap e92: 12 total, 12 up, 12 in 2024-06-06T03:22:46.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.658+0000 7f10701c3700 1 -- 172.21.15.50:0/2947746567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f106806b770 msgr2=0x7f1068107130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:46.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.658+0000 7f10701c3700 1 --2- 172.21.15.50:0/2947746567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f106806b770 0x7f1068107130 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f10580099c0 tx=0x7f1058009cd0 comp rx=0 tx=0).stop 2024-06-06T03:22:46.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.658+0000 7f10701c3700 1 -- 172.21.15.50:0/2947746567 shutdown_connections 2024-06-06T03:22:46.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.658+0000 7f10701c3700 1 --2- 172.21.15.50:0/2947746567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1068107860 0x7f106810f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:46.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.658+0000 7f10701c3700 1 --2- 172.21.15.50:0/2947746567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f106806adc0 0x7f106806b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:46.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.658+0000 7f10701c3700 1 --2- 172.21.15.50:0/2947746567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f106806b770 0x7f1068107130 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:46.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.658+0000 7f10701c3700 1 -- 172.21.15.50:0/2947746567 >> 172.21.15.50:0/2947746567 conn(0x7f1068078340 msgr2=0x7f1068078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:22:46.658 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:46 smithi050 ceph-mon[32421]: pgmap v308: 129 pgs: 15 creating+peering, 14 unknown, 100 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 3 op/s 2024-06-06T03:22:46.658 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:46 smithi050 ceph-mon[32421]: osdmap e93: 12 total, 12 up, 12 in 2024-06-06T03:22:46.659 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:46 smithi050 ceph-mon[32421]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-06T03:22:46.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.658+0000 7f10701c3700 1 -- 172.21.15.50:0/2947746567 shutdown_connections 2024-06-06T03:22:46.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.658+0000 7f10701c3700 1 -- 172.21.15.50:0/2947746567 wait complete. 2024-06-06T03:22:46.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.659+0000 7f10701c3700 1 Processor -- start 2024-06-06T03:22:46.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.659+0000 7f10701c3700 1 -- start start 2024-06-06T03:22:46.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.659+0000 7f10701c3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f106806adc0 0x7f1068101840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:46.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.659+0000 7f10701c3700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f106806b770 0x7f1068101d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:46.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.659+0000 7f10701c3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1068107860 0x7f10681022c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:46.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.659+0000 7f10701c3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f10681126c0 con 0x7f1068107860 2024-06-06T03:22:46.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.659+0000 7f10701c3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1068112540 con 0x7f106806adc0 2024-06-06T03:22:46.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.659+0000 7f10701c3700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1068112840 con 0x7f106806b770 2024-06-06T03:22:46.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.660+0000 7f106e760700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1068107860 0x7f10681022c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:46.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.660+0000 7f106e760700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1068107860 0x7f10681022c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53018/0 (socket says 172.21.15.50:53018) 2024-06-06T03:22:46.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.660+0000 7f106e760700 1 -- 172.21.15.50:0/2567702295 learned_addr learned my addr 172.21.15.50:0/2567702295 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:22:46.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.660+0000 7f106df5f700 1 --2- 172.21.15.50:0/2567702295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f106806adc0 0x7f1068101840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:46.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.660+0000 7f106d75e700 1 --2- 172.21.15.50:0/2567702295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f106806b770 0x7f1068101d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:46.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.660+0000 7f106e760700 1 -- 172.21.15.50:0/2567702295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f106806b770 msgr2=0x7f1068101d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:46.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.660+0000 7f106e760700 1 --2- 172.21.15.50:0/2567702295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f106806b770 0x7f1068101d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:46.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.660+0000 7f106e760700 1 -- 172.21.15.50:0/2567702295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f106806adc0 msgr2=0x7f1068101840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:46.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.660+0000 7f106e760700 1 --2- 172.21.15.50:0/2567702295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f106806adc0 0x7f1068101840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:46.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.660+0000 7f106e760700 1 -- 172.21.15.50:0/2567702295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10681a70c0 con 0x7f1068107860 2024-06-06T03:22:46.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.660+0000 7f106e760700 1 --2- 172.21.15.50:0/2567702295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1068107860 0x7f10681022c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f106000b970 tx=0x7f106000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:22:46.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.660+0000 7f105effd700 1 -- 172.21.15.50:0/2567702295 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060019070 con 0x7f1068107860 2024-06-06T03:22:46.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.660+0000 7f105effd700 1 -- 172.21.15.50:0/2567702295 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f106000cde0 con 0x7f1068107860 2024-06-06T03:22:46.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.660+0000 7f10701c3700 1 -- 172.21.15.50:0/2567702295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10681a73b0 con 0x7f1068107860 2024-06-06T03:22:46.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.660+0000 7f105effd700 1 -- 172.21.15.50:0/2567702295 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060007370 con 0x7f1068107860 2024-06-06T03:22:46.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.660+0000 7f10701c3700 1 -- 172.21.15.50:0/2567702295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10681a78c0 con 0x7f1068107860 2024-06-06T03:22:46.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.661+0000 7f10701c3700 1 -- 172.21.15.50:0/2567702295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f106810aa30 con 0x7f1068107860 2024-06-06T03:22:46.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.663+0000 7f105effd700 1 -- 172.21.15.50:0/2567702295 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f106001c070 con 0x7f1068107860 2024-06-06T03:22:46.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.663+0000 7f105effd700 1 --2- 172.21.15.50:0/2567702295 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f10540a2ca0 0x7f10540a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:46.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.664+0000 7f106df5f700 1 --2- 172.21.15.50:0/2567702295 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f10540a2ca0 0x7f10540a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:46.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.664+0000 7f105effd700 1 -- 172.21.15.50:0/2567702295 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8770+0+0 (secure 0 0 0) 0x7f10600cee10 con 0x7f1068107860 2024-06-06T03:22:46.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.664+0000 7f106df5f700 1 --2- 172.21.15.50:0/2567702295 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f10540a2ca0 0x7f10540a5160 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1064004630 tx=0x7f106400b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:22:46.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.667+0000 7f105effd700 1 -- 172.21.15.50:0/2567702295 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1060023070 con 0x7f1068107860 2024-06-06T03:22:46.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:46 smithi122 ceph-mon[35759]: pgmap v308: 129 pgs: 15 creating+peering, 14 unknown, 100 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 3 op/s 2024-06-06T03:22:46.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:46 smithi122 ceph-mon[35759]: osdmap e93: 12 total, 12 up, 12 in 2024-06-06T03:22:46.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:46 smithi122 ceph-mon[35759]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-06T03:22:46.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:46 smithi079 ceph-mon[35478]: pgmap v308: 129 pgs: 15 creating+peering, 14 unknown, 100 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 3 op/s 2024-06-06T03:22:46.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:46 smithi079 ceph-mon[35478]: osdmap e93: 12 total, 12 up, 12 in 2024-06-06T03:22:46.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:46 smithi079 ceph-mon[35478]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-06T03:22:46.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:46.872+0000 7f10701c3700 1 -- 172.21.15.50:0/2567702295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f1068103be0 con 0x7f1068107860 2024-06-06T03:22:47.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:47.404+0000 7f105effd700 1 -- 172.21.15.50:0/2567702295 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v94) ==== 169+0+0 (secure 0 0 0) 0x7f1068103be0 con 0x7f1068107860 2024-06-06T03:22:47.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:47.408+0000 7f10701c3700 1 -- 172.21.15.50:0/2567702295 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f10540a2ca0 msgr2=0x7f10540a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:47.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:47.408+0000 7f10701c3700 1 --2- 172.21.15.50:0/2567702295 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f10540a2ca0 0x7f10540a5160 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1064004630 tx=0x7f106400b3c0 comp rx=0 tx=0).stop 2024-06-06T03:22:47.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:47.408+0000 7f10701c3700 1 -- 172.21.15.50:0/2567702295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1068107860 msgr2=0x7f10681022c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:47.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:47.408+0000 7f10701c3700 1 --2- 172.21.15.50:0/2567702295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1068107860 0x7f10681022c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f106000b970 tx=0x7f106000bc80 comp rx=0 tx=0).stop 2024-06-06T03:22:47.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:47.408+0000 7f10701c3700 1 -- 172.21.15.50:0/2567702295 shutdown_connections 2024-06-06T03:22:47.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:47.408+0000 7f10701c3700 1 --2- 172.21.15.50:0/2567702295 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f10540a2ca0 0x7f10540a5160 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:47.408+0000 7f10701c3700 1 --2- 172.21.15.50:0/2567702295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1068107860 0x7f10681022c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:47.408+0000 7f10701c3700 1 --2- 172.21.15.50:0/2567702295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f106806adc0 0x7f1068101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:47.408+0000 7f10701c3700 1 --2- 172.21.15.50:0/2567702295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f106806b770 0x7f1068101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:47.408+0000 7f10701c3700 1 -- 172.21.15.50:0/2567702295 >> 172.21.15.50:0/2567702295 conn(0x7f1068078340 msgr2=0x7f10680ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:22:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:47.408+0000 7f10701c3700 1 -- 172.21.15.50:0/2567702295 shutdown_connections 2024-06-06T03:22:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:47.408+0000 7f10701c3700 1 -- 172.21.15.50:0/2567702295 wait complete. 2024-06-06T03:22:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:set pool 4 allow_ec_overwrites to true 2024-06-06T03:22:47.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:47 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/2567702295' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-06-06T03:22:47.726 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:47 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/2567702295' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-06-06T03:22:47.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:47 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/2567702295' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-06-06T03:22:48.127 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-06-06T03:22:48.384 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:22:48.657 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:48 smithi050 ceph-mon[32421]: pgmap v310: 129 pgs: 15 creating+peering, 7 unknown, 107 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:48.657 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:48 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/2567702295' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-06-06T03:22:48.657 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:48 smithi050 ceph-mon[32421]: osdmap e94: 12 total, 12 up, 12 in 2024-06-06T03:22:48.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:48 smithi122 ceph-mon[35759]: pgmap v310: 129 pgs: 15 creating+peering, 7 unknown, 107 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:48.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:48 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/2567702295' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-06-06T03:22:48.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:48 smithi122 ceph-mon[35759]: osdmap e94: 12 total, 12 up, 12 in 2024-06-06T03:22:48.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:48 smithi079 ceph-mon[35478]: pgmap v310: 129 pgs: 15 creating+peering, 7 unknown, 107 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:48.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:48 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/2567702295' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-06-06T03:22:48.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:48 smithi079 ceph-mon[35478]: osdmap e94: 12 total, 12 up, 12 in 2024-06-06T03:22:50.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.137+0000 7f7f76adf700 1 -- 172.21.15.50:0/115077039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f70101620 msgr2=0x7f7f70101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:50.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.137+0000 7f7f76adf700 1 --2- 172.21.15.50:0/115077039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f70101620 0x7f7f70101a00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7f640099c0 tx=0x7f7f64009cd0 comp rx=0 tx=0).stop 2024-06-06T03:22:50.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.137+0000 7f7f76adf700 1 -- 172.21.15.50:0/115077039 shutdown_connections 2024-06-06T03:22:50.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.137+0000 7f7f76adf700 1 --2- 172.21.15.50:0/115077039 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f701066b0 0x7f7f7010e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:50.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.137+0000 7f7f76adf700 1 --2- 172.21.15.50:0/115077039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f70101620 0x7f7f70101a00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:50.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.137+0000 7f7f76adf700 1 --2- 172.21.15.50:0/115077039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f70101fd0 0x7f7f70105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:50.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.137+0000 7f7f76adf700 1 -- 172.21.15.50:0/115077039 >> 172.21.15.50:0/115077039 conn(0x7f7f70078340 msgr2=0x7f7f70078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:22:50.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.137+0000 7f7f76adf700 1 -- 172.21.15.50:0/115077039 shutdown_connections 2024-06-06T03:22:50.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.137+0000 7f7f76adf700 1 -- 172.21.15.50:0/115077039 wait complete. 2024-06-06T03:22:50.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.138+0000 7f7f76adf700 1 Processor -- start 2024-06-06T03:22:50.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.138+0000 7f7f76adf700 1 -- start start 2024-06-06T03:22:50.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.138+0000 7f7f76adf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f70101620 0x7f7f7019add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:50.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.138+0000 7f7f76adf700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f70101fd0 0x7f7f7019b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:50.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.138+0000 7f7f76adf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f701066b0 0x7f7f7019f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:50.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.138+0000 7f7f76adf700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7f701115c0 con 0x7f7f70101620 2024-06-06T03:22:50.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.138+0000 7f7f76adf700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7f70111440 con 0x7f7f701066b0 2024-06-06T03:22:50.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.138+0000 7f7f76adf700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7f70111740 con 0x7f7f70101fd0 2024-06-06T03:22:50.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.138+0000 7f7f7487b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f70101620 0x7f7f7019add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:50.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.138+0000 7f7f7487b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f70101620 0x7f7f7019add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51182/0 (socket says 172.21.15.50:51182) 2024-06-06T03:22:50.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.138+0000 7f7f7487b700 1 -- 172.21.15.50:0/3478139163 learned_addr learned my addr 172.21.15.50:0/3478139163 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:22:50.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.138+0000 7f7f6ffff700 1 --2- 172.21.15.50:0/3478139163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f70101fd0 0x7f7f7019b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:50.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.138+0000 7f7f7507c700 1 --2- 172.21.15.50:0/3478139163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f701066b0 0x7f7f7019f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:50.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.138+0000 7f7f7487b700 1 -- 172.21.15.50:0/3478139163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f70101fd0 msgr2=0x7f7f7019b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:50.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.138+0000 7f7f7487b700 1 --2- 172.21.15.50:0/3478139163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f70101fd0 0x7f7f7019b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:50.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.138+0000 7f7f7487b700 1 -- 172.21.15.50:0/3478139163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f701066b0 msgr2=0x7f7f7019f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:50.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.138+0000 7f7f7487b700 1 --2- 172.21.15.50:0/3478139163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f701066b0 0x7f7f7019f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:50.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.138+0000 7f7f7487b700 1 -- 172.21.15.50:0/3478139163 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f7019fde0 con 0x7f7f70101620 2024-06-06T03:22:50.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.138+0000 7f7f6ffff700 1 --2- 172.21.15.50:0/3478139163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f70101fd0 0x7f7f7019b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:22:50.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.138+0000 7f7f7507c700 1 --2- 172.21.15.50:0/3478139163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f701066b0 0x7f7f7019f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:22:50.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.139+0000 7f7f7487b700 1 --2- 172.21.15.50:0/3478139163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f70101620 0x7f7f7019add0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009fd0 tx=0x7f7f640037a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:22:50.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.139+0000 7f7f6dffb700 1 -- 172.21.15.50:0/3478139163 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f64027070 con 0x7f7f70101620 2024-06-06T03:22:50.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.139+0000 7f7f6dffb700 1 -- 172.21.15.50:0/3478139163 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7f64004140 con 0x7f7f70101620 2024-06-06T03:22:50.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.139+0000 7f7f76adf700 1 -- 172.21.15.50:0/3478139163 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f701a0070 con 0x7f7f70101620 2024-06-06T03:22:50.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.139+0000 7f7f6dffb700 1 -- 172.21.15.50:0/3478139163 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f64022e60 con 0x7f7f70101620 2024-06-06T03:22:50.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.139+0000 7f7f76adf700 1 -- 172.21.15.50:0/3478139163 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f701a7950 con 0x7f7f70101620 2024-06-06T03:22:50.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.140+0000 7f7f76adf700 1 -- 172.21.15.50:0/3478139163 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f70069180 con 0x7f7f70101620 2024-06-06T03:22:50.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.141+0000 7f7f6dffb700 1 -- 172.21.15.50:0/3478139163 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7f6402a070 con 0x7f7f70101620 2024-06-06T03:22:50.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.142+0000 7f7f6dffb700 1 --2- 172.21.15.50:0/3478139163 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7f600a2ca0 0x7f7f600a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:50.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.143+0000 7f7f6ffff700 1 --2- 172.21.15.50:0/3478139163 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7f600a2ca0 0x7f7f600a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:50.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.143+0000 7f7f6dffb700 1 -- 172.21.15.50:0/3478139163 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8770+0+0 (secure 0 0 0) 0x7f7f640d0050 con 0x7f7f70101620 2024-06-06T03:22:50.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.143+0000 7f7f6ffff700 1 --2- 172.21.15.50:0/3478139163 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7f600a2ca0 0x7f7f600a5160 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c005fd0 tx=0x7f7f5c005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:22:50.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.147+0000 7f7f6dffb700 1 -- 172.21.15.50:0/3478139163 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7f64013070 con 0x7f7f70101620 2024-06-06T03:22:50.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:50.408+0000 7f7f76adf700 1 -- 172.21.15.50:0/3478139163 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f7f7002dca0 con 0x7f7f70101620 2024-06-06T03:22:50.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:50 smithi122 ceph-mon[35759]: pgmap v312: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:50.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:50 smithi050 ceph-mon[32421]: pgmap v312: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:50.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:50 smithi079 ceph-mon[35478]: pgmap v312: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:51.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:51.415+0000 7f7f6dffb700 1 -- 172.21.15.50:0/3478139163 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7f7f6409ce20 con 0x7f7f70101620 2024-06-06T03:22:51.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:51.418+0000 7f7f76adf700 1 -- 172.21.15.50:0/3478139163 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7f600a2ca0 msgr2=0x7f7f600a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:51.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:51.418+0000 7f7f76adf700 1 --2- 172.21.15.50:0/3478139163 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7f600a2ca0 0x7f7f600a5160 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c005fd0 tx=0x7f7f5c005dc0 comp rx=0 tx=0).stop 2024-06-06T03:22:51.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:51.418+0000 7f7f76adf700 1 -- 172.21.15.50:0/3478139163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f70101620 msgr2=0x7f7f7019add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:51.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:51.418+0000 7f7f76adf700 1 --2- 172.21.15.50:0/3478139163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f70101620 0x7f7f7019add0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009fd0 tx=0x7f7f640037a0 comp rx=0 tx=0).stop 2024-06-06T03:22:51.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:51.418+0000 7f7f76adf700 1 -- 172.21.15.50:0/3478139163 shutdown_connections 2024-06-06T03:22:51.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:51.418+0000 7f7f76adf700 1 --2- 172.21.15.50:0/3478139163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f701066b0 0x7f7f7019f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:51.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:51.418+0000 7f7f76adf700 1 --2- 172.21.15.50:0/3478139163 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7f600a2ca0 0x7f7f600a5160 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:51.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:51.418+0000 7f7f76adf700 1 --2- 172.21.15.50:0/3478139163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f70101620 0x7f7f7019add0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:51.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:51.418+0000 7f7f76adf700 1 --2- 172.21.15.50:0/3478139163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f70101fd0 0x7f7f7019b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:51.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:51.418+0000 7f7f76adf700 1 -- 172.21.15.50:0/3478139163 >> 172.21.15.50:0/3478139163 conn(0x7f7f70078340 msgr2=0x7f7f701006f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:22:51.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:51.418+0000 7f7f76adf700 1 -- 172.21.15.50:0/3478139163 shutdown_connections 2024-06-06T03:22:51.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:51.418+0000 7f7f76adf700 1 -- 172.21.15.50:0/3478139163 wait complete. 2024-06-06T03:22:51.419 INFO:teuthology.orchestra.run.smithi050.stderr:added data pool 4 to fsmap 2024-06-06T03:22:51.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:51 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/3478139163' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-06-06T03:22:51.728 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:51 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3478139163' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-06-06T03:22:51.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:51 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/3478139163' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-06-06T03:22:52.182 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T03:22:52.440 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:22:52.679 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:52 smithi050 ceph-mon[32421]: pgmap v313: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:52.679 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:52 smithi050 ceph-mon[32421]: osdmap e95: 12 total, 12 up, 12 in 2024-06-06T03:22:52.679 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:52 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3478139163' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-06-06T03:22:52.679 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:52 smithi050 ceph-mon[32421]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-06T03:22:52.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:52 smithi122 ceph-mon[35759]: pgmap v313: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:52.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:52 smithi122 ceph-mon[35759]: osdmap e95: 12 total, 12 up, 12 in 2024-06-06T03:22:52.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:52 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/3478139163' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-06-06T03:22:52.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:52 smithi122 ceph-mon[35759]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-06T03:22:52.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:52 smithi079 ceph-mon[35478]: pgmap v313: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:52.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:52 smithi079 ceph-mon[35478]: osdmap e95: 12 total, 12 up, 12 in 2024-06-06T03:22:52.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:52 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/3478139163' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-06-06T03:22:52.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:52 smithi079 ceph-mon[35478]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-06T03:22:53.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:53 smithi050 ceph-mon[32421]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-06-06T03:22:53.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:53 smithi050 ceph-mon[32421]: Cluster is now healthy 2024-06-06T03:22:53.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:53 smithi079 ceph-mon[35478]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-06-06T03:22:53.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:53 smithi079 ceph-mon[35478]: Cluster is now healthy 2024-06-06T03:22:53.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:53 smithi122 ceph-mon[35759]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-06-06T03:22:53.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:53 smithi122 ceph-mon[35759]: Cluster is now healthy 2024-06-06T03:22:54.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.142+0000 7f617899a700 1 -- 172.21.15.50:0/208755550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6174101380 msgr2=0x7f6174101800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:54.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.142+0000 7f617899a700 1 --2- 172.21.15.50:0/208755550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6174101380 0x7f6174101800 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6168009990 tx=0x7f6168009ca0 comp rx=0 tx=0).stop 2024-06-06T03:22:54.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.142+0000 7f617899a700 1 -- 172.21.15.50:0/208755550 shutdown_connections 2024-06-06T03:22:54.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.142+0000 7f617899a700 1 --2- 172.21.15.50:0/208755550 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6174101d40 0x7f617410e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:54.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.142+0000 7f617899a700 1 --2- 172.21.15.50:0/208755550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61741073c0 0x7f61741077a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:54.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.142+0000 7f617899a700 1 --2- 172.21.15.50:0/208755550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6174101380 0x7f6174101800 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:54.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.142+0000 7f617899a700 1 -- 172.21.15.50:0/208755550 >> 172.21.15.50:0/208755550 conn(0x7f6174078330 msgr2=0x7f6174078740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:22:54.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.142+0000 7f617899a700 1 -- 172.21.15.50:0/208755550 shutdown_connections 2024-06-06T03:22:54.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.142+0000 7f617899a700 1 -- 172.21.15.50:0/208755550 wait complete. 2024-06-06T03:22:54.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.143+0000 7f617899a700 1 Processor -- start 2024-06-06T03:22:54.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.143+0000 7f617899a700 1 -- start start 2024-06-06T03:22:54.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.143+0000 7f617899a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6174101380 0x7f617419e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:54.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.143+0000 7f617899a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6174101d40 0x7f617419ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:54.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.143+0000 7f617899a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61741073c0 0x7f6174198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:54.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.143+0000 7f617899a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6174111510 con 0x7f6174101d40 2024-06-06T03:22:54.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.143+0000 7f617899a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6174111390 con 0x7f6174101380 2024-06-06T03:22:54.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.143+0000 7f617899a700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6174111690 con 0x7f61741073c0 2024-06-06T03:22:54.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.143+0000 7f6171d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6174101d40 0x7f617419ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:54.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.143+0000 7f6171d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6174101d40 0x7f617419ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51194/0 (socket says 172.21.15.50:51194) 2024-06-06T03:22:54.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.143+0000 7f6171d9b700 1 -- 172.21.15.50:0/1178912201 learned_addr learned my addr 172.21.15.50:0/1178912201 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:22:54.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.144+0000 7f617259c700 1 --2- 172.21.15.50:0/1178912201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6174101380 0x7f617419e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:54.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.144+0000 7f6172d9d700 1 --2- 172.21.15.50:0/1178912201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61741073c0 0x7f6174198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:54.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.144+0000 7f6171d9b700 1 -- 172.21.15.50:0/1178912201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61741073c0 msgr2=0x7f6174198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:54.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.144+0000 7f6171d9b700 1 --2- 172.21.15.50:0/1178912201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61741073c0 0x7f6174198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:54.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.144+0000 7f6171d9b700 1 -- 172.21.15.50:0/1178912201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6174101380 msgr2=0x7f617419e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:54.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.144+0000 7f6171d9b700 1 --2- 172.21.15.50:0/1178912201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6174101380 0x7f617419e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:54.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.144+0000 7f6171d9b700 1 -- 172.21.15.50:0/1178912201 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61741990b0 con 0x7f6174101d40 2024-06-06T03:22:54.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.144+0000 7f6171d9b700 1 --2- 172.21.15.50:0/1178912201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6174101d40 0x7f617419ecd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6168000c00 tx=0x7f6168003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:22:54.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.144+0000 7f61637fe700 1 -- 172.21.15.50:0/1178912201 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6168027070 con 0x7f6174101d40 2024-06-06T03:22:54.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.144+0000 7f61637fe700 1 -- 172.21.15.50:0/1178912201 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f616800bdc0 con 0x7f6174101d40 2024-06-06T03:22:54.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.144+0000 7f617899a700 1 -- 172.21.15.50:0/1178912201 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6174199340 con 0x7f6174101d40 2024-06-06T03:22:54.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.144+0000 7f61637fe700 1 -- 172.21.15.50:0/1178912201 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6168022cd0 con 0x7f6174101d40 2024-06-06T03:22:54.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.144+0000 7f617899a700 1 -- 172.21.15.50:0/1178912201 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61741a5660 con 0x7f6174101d40 2024-06-06T03:22:54.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.145+0000 7f617899a700 1 -- 172.21.15.50:0/1178912201 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6174102a70 con 0x7f6174101d40 2024-06-06T03:22:54.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.147+0000 7f61637fe700 1 -- 172.21.15.50:0/1178912201 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f616802a070 con 0x7f6174101d40 2024-06-06T03:22:54.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.147+0000 7f61637fe700 1 --2- 172.21.15.50:0/1178912201 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f615c0a2ca0 0x7f615c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:54.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.147+0000 7f617259c700 1 --2- 172.21.15.50:0/1178912201 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f615c0a2ca0 0x7f615c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:54.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.147+0000 7f61637fe700 1 -- 172.21.15.50:0/1178912201 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8802+0+0 (secure 0 0 0) 0x7f61680d0300 con 0x7f6174101d40 2024-06-06T03:22:54.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.148+0000 7f617259c700 1 --2- 172.21.15.50:0/1178912201 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f615c0a2ca0 0x7f615c0a5160 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6174199a90 tx=0x7f61640073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:22:54.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.151+0000 7f61637fe700 1 -- 172.21.15.50:0/1178912201 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6168013070 con 0x7f6174101d40 2024-06-06T03:22:54.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.404+0000 7f617899a700 1 -- 172.21.15.50:0/1178912201 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6174069180 con 0x7f6174101d40 2024-06-06T03:22:54.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.405+0000 7f61637fe700 1 -- 172.21.15.50:0/1178912201 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11782 (secure 0 0 0) 0x7f616809d0b0 con 0x7f6174101d40 2024-06-06T03:22:54.405 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:22:54.405 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1667847852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1667847852},{"type":"v1","addr":"172.21.15.50:6835","nonce":1667847852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/239971838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":239971838},{"type":"v1","addr":"172.21.15.50:6837","nonce":239971838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/2188134216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2188134216},{"type":"v1","addr":"172.21.15.50:6839","nonce":2188134216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/632572420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":632572420},{"type":"v1","addr":"172.21.15.50:6841","nonce":632572420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/864537078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":864537078},{"type":"v1","addr":"172.21.15.79:6833","nonce":864537078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/279268898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":279268898},{"type":"v1","addr":"172.21.15.79:6835","nonce":279268898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/57533154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":57533154},{"type":"v1","addr":"172.21.15.122:6833","nonce":57533154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/3286722213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3286722213},{"type":"v1","addr":"172.21.15.79:6837","nonce":3286722213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24464,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/768067336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":768067336},{"type":"v1","addr":"172.21.15.79:6839","nonce":768067336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/2987597320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2987597320},{"type":"v1","addr":"172.21.15.122:6835","nonce":2987597320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1604366318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1604366318},{"type":"v1","addr":"172.21.15.122:6837","nonce":1604366318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-06T03:22:36.202061+0000","modified":"2024-06-06T03:22:50.412282+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6839/4129732900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":4129732900},{"type":"v1","addr":"172.21.15.122:6839","nonce":4129732900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24490,"qdb_cluster":[24490]},"id":1}]} 2024-06-06T03:22:54.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.407+0000 7f617899a700 1 -- 172.21.15.50:0/1178912201 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f615c0a2ca0 msgr2=0x7f615c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:54.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.407+0000 7f617899a700 1 --2- 172.21.15.50:0/1178912201 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f615c0a2ca0 0x7f615c0a5160 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6174199a90 tx=0x7f61640073d0 comp rx=0 tx=0).stop 2024-06-06T03:22:54.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.407+0000 7f617899a700 1 -- 172.21.15.50:0/1178912201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6174101d40 msgr2=0x7f617419ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:54.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.407+0000 7f617899a700 1 --2- 172.21.15.50:0/1178912201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6174101d40 0x7f617419ecd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6168000c00 tx=0x7f6168003a80 comp rx=0 tx=0).stop 2024-06-06T03:22:54.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.407+0000 7f617899a700 1 -- 172.21.15.50:0/1178912201 shutdown_connections 2024-06-06T03:22:54.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.407+0000 7f617899a700 1 --2- 172.21.15.50:0/1178912201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61741073c0 0x7f6174198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:54.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.407+0000 7f617899a700 1 --2- 172.21.15.50:0/1178912201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6174101380 0x7f617419e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:54.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.407+0000 7f617899a700 1 --2- 172.21.15.50:0/1178912201 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f615c0a2ca0 0x7f615c0a5160 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:54.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.407+0000 7f617899a700 1 --2- 172.21.15.50:0/1178912201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6174101d40 0x7f617419ecd0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:54.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.407+0000 7f617899a700 1 -- 172.21.15.50:0/1178912201 >> 172.21.15.50:0/1178912201 conn(0x7f6174078330 msgr2=0x7f6174100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:22:54.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.407+0000 7f617899a700 1 -- 172.21.15.50:0/1178912201 shutdown_connections 2024-06-06T03:22:54.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:54.407+0000 7f617899a700 1 -- 172.21.15.50:0/1178912201 wait complete. 2024-06-06T03:22:54.409 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 17 2024-06-06T03:22:54.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:54 smithi050 ceph-mon[32421]: pgmap v315: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:54.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:54 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1178912201' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:22:54.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:54 smithi079 ceph-mon[35478]: pgmap v315: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:54.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:54 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/1178912201' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:22:54.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:54 smithi122 ceph-mon[35759]: pgmap v315: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:54.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:54 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/1178912201' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:22:55.234 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-06T03:22:55.486 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:22:56.565 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:56 smithi050 ceph-mon[32421]: pgmap v316: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:56.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:56 smithi079 ceph-mon[35478]: pgmap v316: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:56.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:56 smithi122 ceph-mon[35759]: pgmap v316: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:57.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.150+0000 7fe5cae6c700 1 -- 172.21.15.50:0/1405727897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5c4100e30 msgr2=0x7fe5c41012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:57.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.150+0000 7fe5cae6c700 1 --2- 172.21.15.50:0/1405727897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5c4100e30 0x7fe5c41012b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0009990 tx=0x7fe5b0009ca0 comp rx=0 tx=0).stop 2024-06-06T03:22:57.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.150+0000 7fe5cae6c700 1 -- 172.21.15.50:0/1405727897 shutdown_connections 2024-06-06T03:22:57.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.150+0000 7fe5cae6c700 1 --2- 172.21.15.50:0/1405727897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5c41017f0 0x7fe5c410f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:57.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.150+0000 7fe5cae6c700 1 --2- 172.21.15.50:0/1405727897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5c4107550 0x7fe5c4107930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:57.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.150+0000 7fe5cae6c700 1 --2- 172.21.15.50:0/1405727897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5c4100e30 0x7fe5c41012b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:57.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.150+0000 7fe5cae6c700 1 -- 172.21.15.50:0/1405727897 >> 172.21.15.50:0/1405727897 conn(0x7fe5c40766b0 msgr2=0x7fe5c4076ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:22:57.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.150+0000 7fe5cae6c700 1 -- 172.21.15.50:0/1405727897 shutdown_connections 2024-06-06T03:22:57.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.150+0000 7fe5cae6c700 1 -- 172.21.15.50:0/1405727897 wait complete. 2024-06-06T03:22:57.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.150+0000 7fe5cae6c700 1 Processor -- start 2024-06-06T03:22:57.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.151+0000 7fe5cae6c700 1 -- start start 2024-06-06T03:22:57.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.151+0000 7fe5cae6c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5c4100e30 0x7fe5c4102010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:57.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.151+0000 7fe5cae6c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5c41017f0 0x7fe5c4102550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:57.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.151+0000 7fe5cae6c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5c4107550 0x7fe5c4102a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:57.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.151+0000 7fe5cae6c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c4112660 con 0x7fe5c4107550 2024-06-06T03:22:57.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.151+0000 7fe5cae6c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c41124e0 con 0x7fe5c4100e30 2024-06-06T03:22:57.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.151+0000 7fe5cae6c700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c41127e0 con 0x7fe5c41017f0 2024-06-06T03:22:57.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.151+0000 7fe5c9409700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5c4107550 0x7fe5c4102a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:57.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.151+0000 7fe5c9409700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5c4107550 0x7fe5c4102a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51204/0 (socket says 172.21.15.50:51204) 2024-06-06T03:22:57.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.151+0000 7fe5c9409700 1 -- 172.21.15.50:0/1627227943 learned_addr learned my addr 172.21.15.50:0/1627227943 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:22:57.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.151+0000 7fe5c3fff700 1 --2- 172.21.15.50:0/1627227943 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5c41017f0 0x7fe5c4102550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:57.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.151+0000 7fe5c8c08700 1 --2- 172.21.15.50:0/1627227943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5c4100e30 0x7fe5c4102010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:57.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.151+0000 7fe5c9409700 1 -- 172.21.15.50:0/1627227943 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5c41017f0 msgr2=0x7fe5c4102550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:57.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.151+0000 7fe5c9409700 1 --2- 172.21.15.50:0/1627227943 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5c41017f0 0x7fe5c4102550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:57.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.151+0000 7fe5c9409700 1 -- 172.21.15.50:0/1627227943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5c4100e30 msgr2=0x7fe5c4102010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:57.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.151+0000 7fe5c9409700 1 --2- 172.21.15.50:0/1627227943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5c4100e30 0x7fe5c4102010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:57.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.151+0000 7fe5c9409700 1 -- 172.21.15.50:0/1627227943 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c41a7000 con 0x7fe5c4107550 2024-06-06T03:22:57.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.151+0000 7fe5c8c08700 1 --2- 172.21.15.50:0/1627227943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5c4100e30 0x7fe5c4102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:22:57.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.151+0000 7fe5c9409700 1 --2- 172.21.15.50:0/1627227943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5c4107550 0x7fe5c4102a90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc00ada0 tx=0x7fe5bc00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:22:57.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.152+0000 7fe5c1ffb700 1 -- 172.21.15.50:0/1627227943 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc017020 con 0x7fe5c4107550 2024-06-06T03:22:57.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.152+0000 7fe5c1ffb700 1 -- 172.21.15.50:0/1627227943 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe5bc00ce30 con 0x7fe5c4107550 2024-06-06T03:22:57.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.152+0000 7fe5c1ffb700 1 -- 172.21.15.50:0/1627227943 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc005350 con 0x7fe5c4107550 2024-06-06T03:22:57.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.152+0000 7fe5cae6c700 1 -- 172.21.15.50:0/1627227943 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5c41a72f0 con 0x7fe5c4107550 2024-06-06T03:22:57.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.152+0000 7fe5cae6c700 1 -- 172.21.15.50:0/1627227943 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5c41a77b0 con 0x7fe5c4107550 2024-06-06T03:22:57.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.153+0000 7fe5cae6c700 1 -- 172.21.15.50:0/1627227943 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5c4069180 con 0x7fe5c4107550 2024-06-06T03:22:57.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.154+0000 7fe5c1ffb700 1 -- 172.21.15.50:0/1627227943 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe5bc00c980 con 0x7fe5c4107550 2024-06-06T03:22:57.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.155+0000 7fe5c1ffb700 1 --2- 172.21.15.50:0/1627227943 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe5b40a2ca0 0x7fe5b40a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:22:57.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.155+0000 7fe5c8c08700 1 --2- 172.21.15.50:0/1627227943 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe5b40a2ca0 0x7fe5b40a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:22:57.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.155+0000 7fe5c1ffb700 1 -- 172.21.15.50:0/1627227943 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8802+0+0 (secure 0 0 0) 0x7fe5bc0ce950 con 0x7fe5c4107550 2024-06-06T03:22:57.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.155+0000 7fe5c8c08700 1 --2- 172.21.15.50:0/1627227943 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe5b40a2ca0 0x7fe5b40a5160 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe5b80059d0 tx=0x7fe5b8005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:22:57.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.159+0000 7fe5c1ffb700 1 -- 172.21.15.50:0/1627227943 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe5bc021020 con 0x7fe5c4107550 2024-06-06T03:22:57.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.365+0000 7fe5cae6c700 1 -- 172.21.15.50:0/1627227943 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe5c402df00 con 0x7fe5c4107550 2024-06-06T03:22:57.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.367+0000 7fe5c1ffb700 1 -- 172.21.15.50:0/1627227943 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+24081 (secure 0 0 0) 0x7fe5bc09b700 con 0x7fe5c4107550 2024-06-06T03:22:57.367 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:22:57.367 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":95,"fsid":"b6263b26-23b2-11ef-bc9b-c7b262605968","created":"2024-06-06T03:14:19.062632+0000","modified":"2024-06-06T03:22:50.412154+0000","last_up_change":"2024-06-06T03:21:30.287918+0000","last_in_change":"2024-06-06T03:21:09.550417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T03:17:37.777608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T03:22:29.496859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T03:22:33.221878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-06T03:22:42.829873+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"eed8040f-a7b7-4d3b-8345-2022918097d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6803","nonce":2379528827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6805","nonce":2379528827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6809","nonce":2379528827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6807","nonce":2379528827}]},"public_addr":"172.21.15.50:6803/2379528827","cluster_addr":"172.21.15.50:6805/2379528827","heartbeat_back_addr":"172.21.15.50:6809/2379528827","heartbeat_front_addr":"172.21.15.50:6807/2379528827","state":["exists","up"]},{"osd":1,"uuid":"089ecb78-5e1e-4cdb-8fe0-5c1731ec9dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6801","nonce":3498354151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6803","nonce":3498354151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6807","nonce":3498354151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6805","nonce":3498354151}]},"public_addr":"172.21.15.79:6801/3498354151","cluster_addr":"172.21.15.79:6803/3498354151","heartbeat_back_addr":"172.21.15.79:6807/3498354151","heartbeat_front_addr":"172.21.15.79:6805/3498354151","state":["exists","up"]},{"osd":2,"uuid":"90599e3b-bf86-4a56-b03b-b051528a5b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6801","nonce":566397008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6803","nonce":566397008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6807","nonce":566397008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6805","nonce":566397008}]},"public_addr":"172.21.15.122:6801/566397008","cluster_addr":"172.21.15.122:6803/566397008","heartbeat_back_addr":"172.21.15.122:6807/566397008","heartbeat_front_addr":"172.21.15.122:6805/566397008","state":["exists","up"]},{"osd":3,"uuid":"fd295e6c-64cd-4164-83dc-4d32c2ae103a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6811","nonce":820123083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6813","nonce":820123083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6817","nonce":820123083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6815","nonce":820123083}]},"public_addr":"172.21.15.50:6811/820123083","cluster_addr":"172.21.15.50:6813/820123083","heartbeat_back_addr":"172.21.15.50:6817/820123083","heartbeat_front_addr":"172.21.15.50:6815/820123083","state":["exists","up"]},{"osd":4,"uuid":"4c854d90-5353-4f7c-b2f3-2af6216d799b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6809","nonce":1784117997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6811","nonce":1784117997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6815","nonce":1784117997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6813","nonce":1784117997}]},"public_addr":"172.21.15.79:6809/1784117997","cluster_addr":"172.21.15.79:6811/1784117997","heartbeat_back_addr":"172.21.15.79:6815/1784117997","heartbeat_front_addr":"172.21.15.79:6813/1784117997","state":["exists","up"]},{"osd":5,"uuid":"80041e10-a643-4338-b621-f882c7bc48b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6809","nonce":2755878218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6811","nonce":2755878218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6815","nonce":2755878218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6813","nonce":2755878218}]},"public_addr":"172.21.15.122:6809/2755878218","cluster_addr":"172.21.15.122:6811/2755878218","heartbeat_back_addr":"172.21.15.122:6815/2755878218","heartbeat_front_addr":"172.21.15.122:6813/2755878218","state":["exists","up"]},{"osd":6,"uuid":"9e15c6c3-bb4b-4c2b-bb7e-4653b10874d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6819","nonce":474595612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6821","nonce":474595612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6825","nonce":474595612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6823","nonce":474595612}]},"public_addr":"172.21.15.50:6819/474595612","cluster_addr":"172.21.15.50:6821/474595612","heartbeat_back_addr":"172.21.15.50:6825/474595612","heartbeat_front_addr":"172.21.15.50:6823/474595612","state":["exists","up"]},{"osd":7,"uuid":"62585bba-c540-4498-8768-b84183e19abd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6817","nonce":3504864579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6819","nonce":3504864579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6823","nonce":3504864579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6821","nonce":3504864579}]},"public_addr":"172.21.15.79:6817/3504864579","cluster_addr":"172.21.15.79:6819/3504864579","heartbeat_back_addr":"172.21.15.79:6823/3504864579","heartbeat_front_addr":"172.21.15.79:6821/3504864579","state":["exists","up"]},{"osd":8,"uuid":"7a272157-460a-4d4a-a63e-30436022ac7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6817","nonce":3484833116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6819","nonce":3484833116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6823","nonce":3484833116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6821","nonce":3484833116}]},"public_addr":"172.21.15.122:6817/3484833116","cluster_addr":"172.21.15.122:6819/3484833116","heartbeat_back_addr":"172.21.15.122:6823/3484833116","heartbeat_front_addr":"172.21.15.122:6821/3484833116","state":["exists","up"]},{"osd":9,"uuid":"7e768ff7-f78d-4a12-b863-4b692e0f4a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6827","nonce":2600273670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6829","nonce":2600273670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6833","nonce":2600273670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6831","nonce":2600273670}]},"public_addr":"172.21.15.50:6827/2600273670","cluster_addr":"172.21.15.50:6829/2600273670","heartbeat_back_addr":"172.21.15.50:6833/2600273670","heartbeat_front_addr":"172.21.15.50:6831/2600273670","state":["exists","up"]},{"osd":10,"uuid":"a42df29a-d88d-4401-878d-6c8f75f3f604","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6825","nonce":2740366543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6827","nonce":2740366543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6831","nonce":2740366543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6829","nonce":2740366543}]},"public_addr":"172.21.15.79:6825/2740366543","cluster_addr":"172.21.15.79:6827/2740366543","heartbeat_back_addr":"172.21.15.79:6831/2740366543","heartbeat_front_addr":"172.21.15.79:6829/2740366543","state":["exists","up"]},{"osd":11,"uuid":"35bcde30-49e4-49b9-a348-98d21a0d3cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6825","nonce":4160854238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6827","nonce":4160854238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6831","nonce":4160854238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6829","nonce":4160854238}]},"public_addr":"172.21.15.122:6825/4160854238","cluster_addr":"172.21.15.122:6827/4160854238","heartbeat_back_addr":"172.21.15.122:6831/4160854238","heartbeat_front_addr":"172.21.15.122:6829/4160854238","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:16:46.989554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:17:11.269759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:17:35.105846+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:00.940943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:26.284520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:51.064143+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:19:16.254750+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:19:42.841380+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:20:08.185133+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:20:34.700082+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:21:01.485278+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:21:27.938715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1311987652":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/1149897118":"2024-06-07T03:15:13.252241+0000","172.21.15.50:6800/2617801068":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/1068038293":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/4038080419":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/149912088":"2024-06-07T03:14:46.388744+0000","172.21.15.50:6801/2617801068":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/2963887224":"2024-06-07T03:14:46.388744+0000","172.21.15.50:6801/1311987652":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/2554563139":"2024-06-07T03:15:13.252241+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T03:22:57.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.369+0000 7fe5cae6c700 1 -- 172.21.15.50:0/1627227943 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe5b40a2ca0 msgr2=0x7fe5b40a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:57.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.369+0000 7fe5cae6c700 1 --2- 172.21.15.50:0/1627227943 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe5b40a2ca0 0x7fe5b40a5160 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe5b80059d0 tx=0x7fe5b8005900 comp rx=0 tx=0).stop 2024-06-06T03:22:57.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.369+0000 7fe5cae6c700 1 -- 172.21.15.50:0/1627227943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5c4107550 msgr2=0x7fe5c4102a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:22:57.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.369+0000 7fe5cae6c700 1 --2- 172.21.15.50:0/1627227943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5c4107550 0x7fe5c4102a90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc00ada0 tx=0x7fe5bc00c330 comp rx=0 tx=0).stop 2024-06-06T03:22:57.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.369+0000 7fe5cae6c700 1 -- 172.21.15.50:0/1627227943 shutdown_connections 2024-06-06T03:22:57.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.369+0000 7fe5cae6c700 1 --2- 172.21.15.50:0/1627227943 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe5b40a2ca0 0x7fe5b40a5160 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:57.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.369+0000 7fe5cae6c700 1 --2- 172.21.15.50:0/1627227943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5c4107550 0x7fe5c4102a90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:57.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.369+0000 7fe5cae6c700 1 --2- 172.21.15.50:0/1627227943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5c4100e30 0x7fe5c4102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:57.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.369+0000 7fe5cae6c700 1 --2- 172.21.15.50:0/1627227943 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5c41017f0 0x7fe5c4102550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:22:57.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.369+0000 7fe5cae6c700 1 -- 172.21.15.50:0/1627227943 >> 172.21.15.50:0/1627227943 conn(0x7fe5c40766b0 msgr2=0x7fe5c40ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:22:57.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.369+0000 7fe5cae6c700 1 -- 172.21.15.50:0/1627227943 shutdown_connections 2024-06-06T03:22:57.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:22:57.369+0000 7fe5cae6c700 1 -- 172.21.15.50:0/1627227943 wait complete. 2024-06-06T03:22:57.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:57 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1627227943' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:22:57.833 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:57 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/1627227943' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:22:57.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:57 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/1627227943' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:22:58.098 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-06T03:22:58.354 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:22:58.727 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:22:58 smithi050 ceph-mon[32421]: pgmap v317: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:58.750 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:22:58 smithi079 ceph-mon[35478]: pgmap v317: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:22:58.849 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:22:58 smithi122 ceph-mon[35759]: pgmap v317: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:23:00.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.121+0000 7f8ea4404700 1 -- 172.21.15.50:0/3624221903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e9c108570 msgr2=0x7f8e9c108950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:00.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.121+0000 7f8ea4404700 1 --2- 172.21.15.50:0/3624221903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e9c108570 0x7f8e9c108950 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8e98009990 tx=0x7f8e98009ca0 comp rx=0 tx=0).stop 2024-06-06T03:23:00.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.121+0000 7f8ea4404700 1 -- 172.21.15.50:0/3624221903 shutdown_connections 2024-06-06T03:23:00.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.121+0000 7f8ea4404700 1 --2- 172.21.15.50:0/3624221903 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e9c06b5c0 0x7f8e9c10f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:00.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.121+0000 7f8ea4404700 1 --2- 172.21.15.50:0/3624221903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e9c108570 0x7f8e9c108950 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:00.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.121+0000 7f8ea4404700 1 --2- 172.21.15.50:0/3624221903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e9c06ac00 0x7f8e9c06b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:00.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.121+0000 7f8ea4404700 1 -- 172.21.15.50:0/3624221903 >> 172.21.15.50:0/3624221903 conn(0x7f8e9c0773e0 msgr2=0x7f8e9c0777f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:00.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.122+0000 7f8ea4404700 1 -- 172.21.15.50:0/3624221903 shutdown_connections 2024-06-06T03:23:00.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.122+0000 7f8ea4404700 1 -- 172.21.15.50:0/3624221903 wait complete. 2024-06-06T03:23:00.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.122+0000 7f8ea4404700 1 Processor -- start 2024-06-06T03:23:00.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.122+0000 7f8ea4404700 1 -- start start 2024-06-06T03:23:00.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.122+0000 7f8ea4404700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e9c06ac00 0x7f8e9c19aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:00.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.123+0000 7f8ea4404700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e9c06b5c0 0x7f8e9c19b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:00.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.123+0000 7f8ea4404700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e9c108570 0x7f8e9c19f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:00.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.123+0000 7f8ea4404700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8e9c1127a0 con 0x7f8e9c06b5c0 2024-06-06T03:23:00.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.123+0000 7f8ea4404700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8e9c112620 con 0x7f8e9c06ac00 2024-06-06T03:23:00.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.123+0000 7f8ea4404700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8e9c112920 con 0x7f8e9c108570 2024-06-06T03:23:00.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.123+0000 7f8ea199f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e9c06b5c0 0x7f8e9c19b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:00.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.123+0000 7f8ea199f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e9c06b5c0 0x7f8e9c19b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44670/0 (socket says 172.21.15.50:44670) 2024-06-06T03:23:00.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.123+0000 7f8ea199f700 1 -- 172.21.15.50:0/930664023 learned_addr learned my addr 172.21.15.50:0/930664023 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:23:00.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.123+0000 7f8ea21a0700 1 --2- 172.21.15.50:0/930664023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e9c06ac00 0x7f8e9c19aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:00.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.123+0000 7f8ea29a1700 1 --2- 172.21.15.50:0/930664023 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e9c108570 0x7f8e9c19f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:00.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.123+0000 7f8ea199f700 1 -- 172.21.15.50:0/930664023 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e9c108570 msgr2=0x7f8e9c19f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:00.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.123+0000 7f8ea199f700 1 --2- 172.21.15.50:0/930664023 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e9c108570 0x7f8e9c19f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:00.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.123+0000 7f8ea199f700 1 -- 172.21.15.50:0/930664023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e9c06ac00 msgr2=0x7f8e9c19aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:00.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.123+0000 7f8ea199f700 1 --2- 172.21.15.50:0/930664023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e9c06ac00 0x7f8e9c19aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:00.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.123+0000 7f8ea199f700 1 -- 172.21.15.50:0/930664023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e9c19feb0 con 0x7f8e9c06b5c0 2024-06-06T03:23:00.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.123+0000 7f8ea29a1700 1 --2- 172.21.15.50:0/930664023 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e9c108570 0x7f8e9c19f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:23:00.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.123+0000 7f8ea199f700 1 --2- 172.21.15.50:0/930664023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e9c06b5c0 0x7f8e9c19b3e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c00b530 tx=0x7f8e8c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:00.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.123+0000 7f8e937fe700 1 -- 172.21.15.50:0/930664023 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c015020 con 0x7f8e9c06b5c0 2024-06-06T03:23:00.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.123+0000 7f8ea4404700 1 -- 172.21.15.50:0/930664023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e9c1a01a0 con 0x7f8e9c06b5c0 2024-06-06T03:23:00.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.123+0000 7f8e937fe700 1 -- 172.21.15.50:0/930664023 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8e8c011ce0 con 0x7f8e9c06b5c0 2024-06-06T03:23:00.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.123+0000 7f8e937fe700 1 -- 172.21.15.50:0/930664023 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c010e40 con 0x7f8e9c06b5c0 2024-06-06T03:23:00.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.123+0000 7f8ea4404700 1 -- 172.21.15.50:0/930664023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e9c1a7a20 con 0x7f8e9c06b5c0 2024-06-06T03:23:00.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.124+0000 7f8ea4404700 1 -- 172.21.15.50:0/930664023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e9c069180 con 0x7f8e9c06b5c0 2024-06-06T03:23:00.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.126+0000 7f8e937fe700 1 -- 172.21.15.50:0/930664023 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8e8c018020 con 0x7f8e9c06b5c0 2024-06-06T03:23:00.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.126+0000 7f8e937fe700 1 --2- 172.21.15.50:0/930664023 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8e880a2c20 0x7f8e880a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:00.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.127+0000 7f8ea21a0700 1 --2- 172.21.15.50:0/930664023 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8e880a2c20 0x7f8e880a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:00.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.127+0000 7f8e937fe700 1 -- 172.21.15.50:0/930664023 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8802+0+0 (secure 0 0 0) 0x7f8e8c0cf060 con 0x7f8e9c06b5c0 2024-06-06T03:23:00.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.127+0000 7f8ea21a0700 1 --2- 172.21.15.50:0/930664023 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8e880a2c20 0x7f8e880a50e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8e98006010 tx=0x7f8e9800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:00.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.130+0000 7f8e937fe700 1 -- 172.21.15.50:0/930664023 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8e8c01f020 con 0x7f8e9c06b5c0 2024-06-06T03:23:00.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.337+0000 7f8ea4404700 1 -- 172.21.15.50:0/930664023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e9c1a7cb0 con 0x7f8e9c06b5c0 2024-06-06T03:23:00.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.338+0000 7f8e937fe700 1 -- 172.21.15.50:0/930664023 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+24081 (secure 0 0 0) 0x7f8e8c010380 con 0x7f8e9c06b5c0 2024-06-06T03:23:00.338 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:23:00.339 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":95,"fsid":"b6263b26-23b2-11ef-bc9b-c7b262605968","created":"2024-06-06T03:14:19.062632+0000","modified":"2024-06-06T03:22:50.412154+0000","last_up_change":"2024-06-06T03:21:30.287918+0000","last_in_change":"2024-06-06T03:21:09.550417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T03:17:37.777608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T03:22:29.496859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T03:22:33.221878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-06T03:22:42.829873+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"eed8040f-a7b7-4d3b-8345-2022918097d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6803","nonce":2379528827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6805","nonce":2379528827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6809","nonce":2379528827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6807","nonce":2379528827}]},"public_addr":"172.21.15.50:6803/2379528827","cluster_addr":"172.21.15.50:6805/2379528827","heartbeat_back_addr":"172.21.15.50:6809/2379528827","heartbeat_front_addr":"172.21.15.50:6807/2379528827","state":["exists","up"]},{"osd":1,"uuid":"089ecb78-5e1e-4cdb-8fe0-5c1731ec9dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6801","nonce":3498354151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6803","nonce":3498354151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6807","nonce":3498354151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6805","nonce":3498354151}]},"public_addr":"172.21.15.79:6801/3498354151","cluster_addr":"172.21.15.79:6803/3498354151","heartbeat_back_addr":"172.21.15.79:6807/3498354151","heartbeat_front_addr":"172.21.15.79:6805/3498354151","state":["exists","up"]},{"osd":2,"uuid":"90599e3b-bf86-4a56-b03b-b051528a5b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6801","nonce":566397008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6803","nonce":566397008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6807","nonce":566397008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6805","nonce":566397008}]},"public_addr":"172.21.15.122:6801/566397008","cluster_addr":"172.21.15.122:6803/566397008","heartbeat_back_addr":"172.21.15.122:6807/566397008","heartbeat_front_addr":"172.21.15.122:6805/566397008","state":["exists","up"]},{"osd":3,"uuid":"fd295e6c-64cd-4164-83dc-4d32c2ae103a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6811","nonce":820123083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6813","nonce":820123083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6817","nonce":820123083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6815","nonce":820123083}]},"public_addr":"172.21.15.50:6811/820123083","cluster_addr":"172.21.15.50:6813/820123083","heartbeat_back_addr":"172.21.15.50:6817/820123083","heartbeat_front_addr":"172.21.15.50:6815/820123083","state":["exists","up"]},{"osd":4,"uuid":"4c854d90-5353-4f7c-b2f3-2af6216d799b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6809","nonce":1784117997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6811","nonce":1784117997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6815","nonce":1784117997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6813","nonce":1784117997}]},"public_addr":"172.21.15.79:6809/1784117997","cluster_addr":"172.21.15.79:6811/1784117997","heartbeat_back_addr":"172.21.15.79:6815/1784117997","heartbeat_front_addr":"172.21.15.79:6813/1784117997","state":["exists","up"]},{"osd":5,"uuid":"80041e10-a643-4338-b621-f882c7bc48b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6809","nonce":2755878218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6811","nonce":2755878218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6815","nonce":2755878218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6813","nonce":2755878218}]},"public_addr":"172.21.15.122:6809/2755878218","cluster_addr":"172.21.15.122:6811/2755878218","heartbeat_back_addr":"172.21.15.122:6815/2755878218","heartbeat_front_addr":"172.21.15.122:6813/2755878218","state":["exists","up"]},{"osd":6,"uuid":"9e15c6c3-bb4b-4c2b-bb7e-4653b10874d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6819","nonce":474595612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6821","nonce":474595612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6825","nonce":474595612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6823","nonce":474595612}]},"public_addr":"172.21.15.50:6819/474595612","cluster_addr":"172.21.15.50:6821/474595612","heartbeat_back_addr":"172.21.15.50:6825/474595612","heartbeat_front_addr":"172.21.15.50:6823/474595612","state":["exists","up"]},{"osd":7,"uuid":"62585bba-c540-4498-8768-b84183e19abd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6817","nonce":3504864579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6819","nonce":3504864579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6823","nonce":3504864579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6821","nonce":3504864579}]},"public_addr":"172.21.15.79:6817/3504864579","cluster_addr":"172.21.15.79:6819/3504864579","heartbeat_back_addr":"172.21.15.79:6823/3504864579","heartbeat_front_addr":"172.21.15.79:6821/3504864579","state":["exists","up"]},{"osd":8,"uuid":"7a272157-460a-4d4a-a63e-30436022ac7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6817","nonce":3484833116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6819","nonce":3484833116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6823","nonce":3484833116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6821","nonce":3484833116}]},"public_addr":"172.21.15.122:6817/3484833116","cluster_addr":"172.21.15.122:6819/3484833116","heartbeat_back_addr":"172.21.15.122:6823/3484833116","heartbeat_front_addr":"172.21.15.122:6821/3484833116","state":["exists","up"]},{"osd":9,"uuid":"7e768ff7-f78d-4a12-b863-4b692e0f4a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6827","nonce":2600273670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6829","nonce":2600273670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6833","nonce":2600273670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6831","nonce":2600273670}]},"public_addr":"172.21.15.50:6827/2600273670","cluster_addr":"172.21.15.50:6829/2600273670","heartbeat_back_addr":"172.21.15.50:6833/2600273670","heartbeat_front_addr":"172.21.15.50:6831/2600273670","state":["exists","up"]},{"osd":10,"uuid":"a42df29a-d88d-4401-878d-6c8f75f3f604","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6825","nonce":2740366543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6827","nonce":2740366543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6831","nonce":2740366543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6829","nonce":2740366543}]},"public_addr":"172.21.15.79:6825/2740366543","cluster_addr":"172.21.15.79:6827/2740366543","heartbeat_back_addr":"172.21.15.79:6831/2740366543","heartbeat_front_addr":"172.21.15.79:6829/2740366543","state":["exists","up"]},{"osd":11,"uuid":"35bcde30-49e4-49b9-a348-98d21a0d3cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6825","nonce":4160854238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6827","nonce":4160854238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6831","nonce":4160854238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6829","nonce":4160854238}]},"public_addr":"172.21.15.122:6825/4160854238","cluster_addr":"172.21.15.122:6827/4160854238","heartbeat_back_addr":"172.21.15.122:6831/4160854238","heartbeat_front_addr":"172.21.15.122:6829/4160854238","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:16:46.989554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:17:11.269759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:17:35.105846+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:00.940943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:26.284520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:51.064143+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:19:16.254750+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:19:42.841380+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:20:08.185133+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:20:34.700082+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:21:01.485278+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:21:27.938715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1311987652":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/1149897118":"2024-06-07T03:15:13.252241+0000","172.21.15.50:6800/2617801068":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/1068038293":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/4038080419":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/149912088":"2024-06-07T03:14:46.388744+0000","172.21.15.50:6801/2617801068":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/2963887224":"2024-06-07T03:14:46.388744+0000","172.21.15.50:6801/1311987652":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/2554563139":"2024-06-07T03:15:13.252241+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T03:23:00.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.340+0000 7f8ea4404700 1 -- 172.21.15.50:0/930664023 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8e880a2c20 msgr2=0x7f8e880a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:00.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.340+0000 7f8ea4404700 1 --2- 172.21.15.50:0/930664023 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8e880a2c20 0x7f8e880a50e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8e98006010 tx=0x7f8e9800b540 comp rx=0 tx=0).stop 2024-06-06T03:23:00.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.340+0000 7f8ea4404700 1 -- 172.21.15.50:0/930664023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e9c06b5c0 msgr2=0x7f8e9c19b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:00.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.340+0000 7f8ea4404700 1 --2- 172.21.15.50:0/930664023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e9c06b5c0 0x7f8e9c19b3e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c00b530 tx=0x7f8e8c00b840 comp rx=0 tx=0).stop 2024-06-06T03:23:00.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.341+0000 7f8ea4404700 1 -- 172.21.15.50:0/930664023 shutdown_connections 2024-06-06T03:23:00.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.341+0000 7f8ea4404700 1 --2- 172.21.15.50:0/930664023 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e9c108570 0x7f8e9c19f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:00.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.341+0000 7f8ea4404700 1 --2- 172.21.15.50:0/930664023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e9c06ac00 0x7f8e9c19aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:00.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.341+0000 7f8ea4404700 1 --2- 172.21.15.50:0/930664023 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8e880a2c20 0x7f8e880a50e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:00.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.341+0000 7f8ea4404700 1 --2- 172.21.15.50:0/930664023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e9c06b5c0 0x7f8e9c19b3e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:00.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.341+0000 7f8ea4404700 1 -- 172.21.15.50:0/930664023 >> 172.21.15.50:0/930664023 conn(0x7f8e9c0773e0 msgr2=0x7f8e9c0ffef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:00.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.341+0000 7f8ea4404700 1 -- 172.21.15.50:0/930664023 shutdown_connections 2024-06-06T03:23:00.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:00.341+0000 7f8ea4404700 1 -- 172.21.15.50:0/930664023 wait complete. 2024-06-06T03:23:00.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:00 smithi050 ceph-mon[32421]: pgmap v318: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:23:00.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:00 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/930664023' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:23:00.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:00 smithi079 ceph-mon[35478]: pgmap v318: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:23:00.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:00 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/930664023' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:23:00.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:00 smithi122 ceph-mon[35759]: pgmap v318: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:23:00.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:00 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/930664023' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:23:01.146 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T03:23:01.403 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:23:02.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:02 smithi050 ceph-mon[32421]: pgmap v319: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:23:02.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:02 smithi079 ceph-mon[35478]: pgmap v319: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:23:02.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:02 smithi122 ceph-mon[35759]: pgmap v319: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:23:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.190+0000 7f50ee1f7700 1 -- 172.21.15.50:0/909783135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50e8102770 msgr2=0x7f50e8102b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.190+0000 7f50ee1f7700 1 --2- 172.21.15.50:0/909783135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50e8102770 0x7f50e8102b50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f50d80099c0 tx=0x7f50d8009cd0 comp rx=0 tx=0).stop 2024-06-06T03:23:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.190+0000 7f50ee1f7700 1 -- 172.21.15.50:0/909783135 shutdown_connections 2024-06-06T03:23:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.190+0000 7f50ee1f7700 1 --2- 172.21.15.50:0/909783135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50e8107860 0x7f50e810f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.190+0000 7f50ee1f7700 1 --2- 172.21.15.50:0/909783135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50e8102770 0x7f50e8102b50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.190+0000 7f50ee1f7700 1 --2- 172.21.15.50:0/909783135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50e8103120 0x7f50e8107130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.190+0000 7f50ee1f7700 1 -- 172.21.15.50:0/909783135 >> 172.21.15.50:0/909783135 conn(0x7f50e8079600 msgr2=0x7f50e8079a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:03.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.190+0000 7f50ee1f7700 1 -- 172.21.15.50:0/909783135 shutdown_connections 2024-06-06T03:23:03.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.190+0000 7f50ee1f7700 1 -- 172.21.15.50:0/909783135 wait complete. 2024-06-06T03:23:03.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.191+0000 7f50ee1f7700 1 Processor -- start 2024-06-06T03:23:03.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.191+0000 7f50ee1f7700 1 -- start start 2024-06-06T03:23:03.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.192+0000 7f50ee1f7700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50e8102770 0x7f50e819e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:03.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.192+0000 7f50ee1f7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50e8103120 0x7f50e819ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:03.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.192+0000 7f50ee1f7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50e8107860 0x7f50e8198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:03.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.192+0000 7f50ee1f7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f50e8112650 con 0x7f50e8103120 2024-06-06T03:23:03.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.192+0000 7f50ee1f7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f50e81124d0 con 0x7f50e8107860 2024-06-06T03:23:03.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.192+0000 7f50ee1f7700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f50e81127d0 con 0x7f50e8102770 2024-06-06T03:23:03.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.192+0000 7f50e6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50e8103120 0x7f50e819ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:03.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.192+0000 7f50e6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50e8103120 0x7f50e819ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44688/0 (socket says 172.21.15.50:44688) 2024-06-06T03:23:03.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.192+0000 7f50e6ffd700 1 -- 172.21.15.50:0/2873487249 learned_addr learned my addr 172.21.15.50:0/2873487249 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:23:03.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.192+0000 7f50e77fe700 1 --2- 172.21.15.50:0/2873487249 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50e8102770 0x7f50e819e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:03.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.192+0000 7f50e7fff700 1 --2- 172.21.15.50:0/2873487249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50e8107860 0x7f50e8198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:03.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.192+0000 7f50e6ffd700 1 -- 172.21.15.50:0/2873487249 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50e8102770 msgr2=0x7f50e819e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:03.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.192+0000 7f50e6ffd700 1 --2- 172.21.15.50:0/2873487249 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50e8102770 0x7f50e819e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:03.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.192+0000 7f50e6ffd700 1 -- 172.21.15.50:0/2873487249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50e8107860 msgr2=0x7f50e8198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:03.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.192+0000 7f50e6ffd700 1 --2- 172.21.15.50:0/2873487249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50e8107860 0x7f50e8198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:03.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.192+0000 7f50e6ffd700 1 -- 172.21.15.50:0/2873487249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e8199070 con 0x7f50e8103120 2024-06-06T03:23:03.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.192+0000 7f50e6ffd700 1 --2- 172.21.15.50:0/2873487249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50e8103120 0x7f50e819ec90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00d980 tx=0x7f50dc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:03.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.193+0000 7f50e4ff9700 1 -- 172.21.15.50:0/2873487249 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc017070 con 0x7f50e8103120 2024-06-06T03:23:03.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.193+0000 7f50ee1f7700 1 -- 172.21.15.50:0/2873487249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50e8199360 con 0x7f50e8103120 2024-06-06T03:23:03.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.193+0000 7f50e4ff9700 1 -- 172.21.15.50:0/2873487249 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f50dc005020 con 0x7f50e8103120 2024-06-06T03:23:03.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.193+0000 7f50e4ff9700 1 -- 172.21.15.50:0/2873487249 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc00fa90 con 0x7f50e8103120 2024-06-06T03:23:03.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.193+0000 7f50ee1f7700 1 -- 172.21.15.50:0/2873487249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50e81a5620 con 0x7f50e8103120 2024-06-06T03:23:03.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.194+0000 7f50ee1f7700 1 -- 172.21.15.50:0/2873487249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50e810aaa0 con 0x7f50e8103120 2024-06-06T03:23:03.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.195+0000 7f50e4ff9700 1 -- 172.21.15.50:0/2873487249 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f50dc0051d0 con 0x7f50e8103120 2024-06-06T03:23:03.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.196+0000 7f50e4ff9700 1 --2- 172.21.15.50:0/2873487249 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f50d00a2c20 0x7f50d00a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:03.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.196+0000 7f50e77fe700 1 --2- 172.21.15.50:0/2873487249 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f50d00a2c20 0x7f50d00a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:03.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.196+0000 7f50e4ff9700 1 -- 172.21.15.50:0/2873487249 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8802+0+0 (secure 0 0 0) 0x7f50dc0cf120 con 0x7f50e8103120 2024-06-06T03:23:03.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.196+0000 7f50e77fe700 1 --2- 172.21.15.50:0/2873487249 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f50d00a2c20 0x7f50d00a50e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f50d8000c00 tx=0x7f50d8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:03.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.200+0000 7f50e4ff9700 1 -- 172.21.15.50:0/2873487249 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f50dc020020 con 0x7f50e8103120 2024-06-06T03:23:03.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.452+0000 7f50ee1f7700 1 -- 172.21.15.50:0/2873487249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50e8199e40 con 0x7f50e8103120 2024-06-06T03:23:03.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.453+0000 7f50e4ff9700 1 -- 172.21.15.50:0/2873487249 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11782 (secure 0 0 0) 0x7f50dc09be40 con 0x7f50e8103120 2024-06-06T03:23:03.453 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:23:03.453 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1667847852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1667847852},{"type":"v1","addr":"172.21.15.50:6835","nonce":1667847852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/239971838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":239971838},{"type":"v1","addr":"172.21.15.50:6837","nonce":239971838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/2188134216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2188134216},{"type":"v1","addr":"172.21.15.50:6839","nonce":2188134216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/632572420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":632572420},{"type":"v1","addr":"172.21.15.50:6841","nonce":632572420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/864537078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":864537078},{"type":"v1","addr":"172.21.15.79:6833","nonce":864537078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/279268898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":279268898},{"type":"v1","addr":"172.21.15.79:6835","nonce":279268898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/57533154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":57533154},{"type":"v1","addr":"172.21.15.122:6833","nonce":57533154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/3286722213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3286722213},{"type":"v1","addr":"172.21.15.79:6837","nonce":3286722213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24464,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/768067336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":768067336},{"type":"v1","addr":"172.21.15.79:6839","nonce":768067336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/2987597320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2987597320},{"type":"v1","addr":"172.21.15.122:6835","nonce":2987597320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1604366318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1604366318},{"type":"v1","addr":"172.21.15.122:6837","nonce":1604366318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-06T03:22:36.202061+0000","modified":"2024-06-06T03:22:50.412282+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6839/4129732900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":4129732900},{"type":"v1","addr":"172.21.15.122:6839","nonce":4129732900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24490,"qdb_cluster":[24490]},"id":1}]} 2024-06-06T03:23:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.455+0000 7f50ee1f7700 1 -- 172.21.15.50:0/2873487249 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f50d00a2c20 msgr2=0x7f50d00a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.455+0000 7f50ee1f7700 1 --2- 172.21.15.50:0/2873487249 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f50d00a2c20 0x7f50d00a50e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f50d8000c00 tx=0x7f50d8005fb0 comp rx=0 tx=0).stop 2024-06-06T03:23:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.455+0000 7f50ee1f7700 1 -- 172.21.15.50:0/2873487249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50e8103120 msgr2=0x7f50e819ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.455+0000 7f50ee1f7700 1 --2- 172.21.15.50:0/2873487249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50e8103120 0x7f50e819ec90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00d980 tx=0x7f50dc00dc90 comp rx=0 tx=0).stop 2024-06-06T03:23:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.455+0000 7f50ee1f7700 1 -- 172.21.15.50:0/2873487249 shutdown_connections 2024-06-06T03:23:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.455+0000 7f50ee1f7700 1 --2- 172.21.15.50:0/2873487249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50e8107860 0x7f50e8198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.455+0000 7f50ee1f7700 1 --2- 172.21.15.50:0/2873487249 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50e8102770 0x7f50e819e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.455+0000 7f50ee1f7700 1 --2- 172.21.15.50:0/2873487249 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f50d00a2c20 0x7f50d00a50e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:03.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.455+0000 7f50ee1f7700 1 --2- 172.21.15.50:0/2873487249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50e8103120 0x7f50e819ec90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:03.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.455+0000 7f50ee1f7700 1 -- 172.21.15.50:0/2873487249 >> 172.21.15.50:0/2873487249 conn(0x7f50e8079600 msgr2=0x7f50e8100790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:03.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.455+0000 7f50ee1f7700 1 -- 172.21.15.50:0/2873487249 shutdown_connections 2024-06-06T03:23:03.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:03.455+0000 7f50ee1f7700 1 -- 172.21.15.50:0/2873487249 wait complete. 2024-06-06T03:23:03.456 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 17 2024-06-06T03:23:03.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:03 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/2873487249' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:23:03.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:03 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/2873487249' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:23:03.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:03 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/2873487249' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:23:04.110 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-06T03:23:04.361 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:23:04.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:04 smithi050 ceph-mon[32421]: pgmap v320: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:23:04.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:04 smithi079 ceph-mon[35478]: pgmap v320: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:23:04.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:04 smithi122 ceph-mon[35759]: pgmap v320: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:23:06.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.078+0000 7fa839ac7700 1 -- 172.21.15.50:0/1537805513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8341015d0 msgr2=0x7fa8341019b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:06.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.078+0000 7fa839ac7700 1 --2- 172.21.15.50:0/1537805513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8341015d0 0x7fa8341019b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa8240099c0 tx=0x7fa824009cd0 comp rx=0 tx=0).stop 2024-06-06T03:23:06.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.078+0000 7fa839ac7700 1 -- 172.21.15.50:0/1537805513 shutdown_connections 2024-06-06T03:23:06.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.078+0000 7fa839ac7700 1 --2- 172.21.15.50:0/1537805513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8341066b0 0x7fa83410e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:06.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.078+0000 7fa839ac7700 1 --2- 172.21.15.50:0/1537805513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8341015d0 0x7fa8341019b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:06.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.078+0000 7fa839ac7700 1 --2- 172.21.15.50:0/1537805513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa834101f80 0x7fa834105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:06.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.078+0000 7fa839ac7700 1 -- 172.21.15.50:0/1537805513 >> 172.21.15.50:0/1537805513 conn(0x7fa834078400 msgr2=0x7fa834078810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:06.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.078+0000 7fa839ac7700 1 -- 172.21.15.50:0/1537805513 shutdown_connections 2024-06-06T03:23:06.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.078+0000 7fa839ac7700 1 -- 172.21.15.50:0/1537805513 wait complete. 2024-06-06T03:23:06.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.078+0000 7fa839ac7700 1 Processor -- start 2024-06-06T03:23:06.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.079+0000 7fa839ac7700 1 -- start start 2024-06-06T03:23:06.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.079+0000 7fa839ac7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8341015d0 0x7fa83419e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:06.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.079+0000 7fa839ac7700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa834101f80 0x7fa83419ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:06.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.079+0000 7fa839ac7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8341066b0 0x7fa8341989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:06.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.079+0000 7fa839ac7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa834111540 con 0x7fa8341066b0 2024-06-06T03:23:06.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.079+0000 7fa839ac7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa8341113c0 con 0x7fa8341015d0 2024-06-06T03:23:06.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.079+0000 7fa839ac7700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa8341116c0 con 0x7fa834101f80 2024-06-06T03:23:06.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.079+0000 7fa833fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8341066b0 0x7fa8341989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:06.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.079+0000 7fa8337fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8341015d0 0x7fa83419e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:06.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.079+0000 7fa833fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8341066b0 0x7fa8341989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44704/0 (socket says 172.21.15.50:44704) 2024-06-06T03:23:06.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.079+0000 7fa833fff700 1 -- 172.21.15.50:0/1267082842 learned_addr learned my addr 172.21.15.50:0/1267082842 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:23:06.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.079+0000 7fa832ffd700 1 --2- 172.21.15.50:0/1267082842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa834101f80 0x7fa83419ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:06.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.079+0000 7fa833fff700 1 -- 172.21.15.50:0/1267082842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa834101f80 msgr2=0x7fa83419ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:06.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.079+0000 7fa833fff700 1 --2- 172.21.15.50:0/1267082842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa834101f80 0x7fa83419ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:06.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.079+0000 7fa833fff700 1 -- 172.21.15.50:0/1267082842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8341015d0 msgr2=0x7fa83419e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:06.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.079+0000 7fa833fff700 1 --2- 172.21.15.50:0/1267082842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8341015d0 0x7fa83419e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:06.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.079+0000 7fa833fff700 1 -- 172.21.15.50:0/1267082842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa834199100 con 0x7fa8341066b0 2024-06-06T03:23:06.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.079+0000 7fa832ffd700 1 --2- 172.21.15.50:0/1267082842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa834101f80 0x7fa83419ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:23:06.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.080+0000 7fa833fff700 1 --2- 172.21.15.50:0/1267082842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8341066b0 0x7fa8341989a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa82c007ee0 tx=0x7fa82c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:06.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.080+0000 7fa830ff9700 1 -- 172.21.15.50:0/1267082842 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c00dbd0 con 0x7fa8341066b0 2024-06-06T03:23:06.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.080+0000 7fa839ac7700 1 -- 172.21.15.50:0/1267082842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8341993f0 con 0x7fa8341066b0 2024-06-06T03:23:06.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.080+0000 7fa830ff9700 1 -- 172.21.15.50:0/1267082842 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa82c00dd70 con 0x7fa8341066b0 2024-06-06T03:23:06.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.080+0000 7fa830ff9700 1 -- 172.21.15.50:0/1267082842 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c005990 con 0x7fa8341066b0 2024-06-06T03:23:06.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.080+0000 7fa839ac7700 1 -- 172.21.15.50:0/1267082842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8341a56b0 con 0x7fa8341066b0 2024-06-06T03:23:06.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.081+0000 7fa839ac7700 1 -- 172.21.15.50:0/1267082842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa834069180 con 0x7fa8341066b0 2024-06-06T03:23:06.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.082+0000 7fa830ff9700 1 -- 172.21.15.50:0/1267082842 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa82c01a020 con 0x7fa8341066b0 2024-06-06T03:23:06.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.083+0000 7fa830ff9700 1 --2- 172.21.15.50:0/1267082842 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa81c0a2c20 0x7fa81c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:06.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.083+0000 7fa8337fe700 1 --2- 172.21.15.50:0/1267082842 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa81c0a2c20 0x7fa81c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:06.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.083+0000 7fa830ff9700 1 -- 172.21.15.50:0/1267082842 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8802+0+0 (secure 0 0 0) 0x7fa82c0ceff0 con 0x7fa8341066b0 2024-06-06T03:23:06.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.084+0000 7fa8337fe700 1 --2- 172.21.15.50:0/1267082842 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa81c0a2c20 0x7fa81c0a50e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa824000c00 tx=0x7fa824005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:06.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.086+0000 7fa830ff9700 1 -- 172.21.15.50:0/1267082842 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa82c010070 con 0x7fa8341066b0 2024-06-06T03:23:06.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.294+0000 7fa839ac7700 1 -- 172.21.15.50:0/1267082842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa8341a5940 con 0x7fa8341066b0 2024-06-06T03:23:06.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.295+0000 7fa830ff9700 1 -- 172.21.15.50:0/1267082842 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+24081 (secure 0 0 0) 0x7fa82c09bd10 con 0x7fa8341066b0 2024-06-06T03:23:06.296 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:23:06.296 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":95,"fsid":"b6263b26-23b2-11ef-bc9b-c7b262605968","created":"2024-06-06T03:14:19.062632+0000","modified":"2024-06-06T03:22:50.412154+0000","last_up_change":"2024-06-06T03:21:30.287918+0000","last_in_change":"2024-06-06T03:21:09.550417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T03:17:37.777608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T03:22:29.496859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T03:22:33.221878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-06T03:22:42.829873+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"eed8040f-a7b7-4d3b-8345-2022918097d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6803","nonce":2379528827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6805","nonce":2379528827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6809","nonce":2379528827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6807","nonce":2379528827}]},"public_addr":"172.21.15.50:6803/2379528827","cluster_addr":"172.21.15.50:6805/2379528827","heartbeat_back_addr":"172.21.15.50:6809/2379528827","heartbeat_front_addr":"172.21.15.50:6807/2379528827","state":["exists","up"]},{"osd":1,"uuid":"089ecb78-5e1e-4cdb-8fe0-5c1731ec9dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6801","nonce":3498354151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6803","nonce":3498354151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6807","nonce":3498354151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6805","nonce":3498354151}]},"public_addr":"172.21.15.79:6801/3498354151","cluster_addr":"172.21.15.79:6803/3498354151","heartbeat_back_addr":"172.21.15.79:6807/3498354151","heartbeat_front_addr":"172.21.15.79:6805/3498354151","state":["exists","up"]},{"osd":2,"uuid":"90599e3b-bf86-4a56-b03b-b051528a5b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6801","nonce":566397008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6803","nonce":566397008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6807","nonce":566397008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6805","nonce":566397008}]},"public_addr":"172.21.15.122:6801/566397008","cluster_addr":"172.21.15.122:6803/566397008","heartbeat_back_addr":"172.21.15.122:6807/566397008","heartbeat_front_addr":"172.21.15.122:6805/566397008","state":["exists","up"]},{"osd":3,"uuid":"fd295e6c-64cd-4164-83dc-4d32c2ae103a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6811","nonce":820123083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6813","nonce":820123083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6817","nonce":820123083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6815","nonce":820123083}]},"public_addr":"172.21.15.50:6811/820123083","cluster_addr":"172.21.15.50:6813/820123083","heartbeat_back_addr":"172.21.15.50:6817/820123083","heartbeat_front_addr":"172.21.15.50:6815/820123083","state":["exists","up"]},{"osd":4,"uuid":"4c854d90-5353-4f7c-b2f3-2af6216d799b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6809","nonce":1784117997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6811","nonce":1784117997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6815","nonce":1784117997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6813","nonce":1784117997}]},"public_addr":"172.21.15.79:6809/1784117997","cluster_addr":"172.21.15.79:6811/1784117997","heartbeat_back_addr":"172.21.15.79:6815/1784117997","heartbeat_front_addr":"172.21.15.79:6813/1784117997","state":["exists","up"]},{"osd":5,"uuid":"80041e10-a643-4338-b621-f882c7bc48b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6809","nonce":2755878218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6811","nonce":2755878218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6815","nonce":2755878218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6813","nonce":2755878218}]},"public_addr":"172.21.15.122:6809/2755878218","cluster_addr":"172.21.15.122:6811/2755878218","heartbeat_back_addr":"172.21.15.122:6815/2755878218","heartbeat_front_addr":"172.21.15.122:6813/2755878218","state":["exists","up"]},{"osd":6,"uuid":"9e15c6c3-bb4b-4c2b-bb7e-4653b10874d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6819","nonce":474595612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6821","nonce":474595612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6825","nonce":474595612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6823","nonce":474595612}]},"public_addr":"172.21.15.50:6819/474595612","cluster_addr":"172.21.15.50:6821/474595612","heartbeat_back_addr":"172.21.15.50:6825/474595612","heartbeat_front_addr":"172.21.15.50:6823/474595612","state":["exists","up"]},{"osd":7,"uuid":"62585bba-c540-4498-8768-b84183e19abd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6817","nonce":3504864579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6819","nonce":3504864579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6823","nonce":3504864579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6821","nonce":3504864579}]},"public_addr":"172.21.15.79:6817/3504864579","cluster_addr":"172.21.15.79:6819/3504864579","heartbeat_back_addr":"172.21.15.79:6823/3504864579","heartbeat_front_addr":"172.21.15.79:6821/3504864579","state":["exists","up"]},{"osd":8,"uuid":"7a272157-460a-4d4a-a63e-30436022ac7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6817","nonce":3484833116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6819","nonce":3484833116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6823","nonce":3484833116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6821","nonce":3484833116}]},"public_addr":"172.21.15.122:6817/3484833116","cluster_addr":"172.21.15.122:6819/3484833116","heartbeat_back_addr":"172.21.15.122:6823/3484833116","heartbeat_front_addr":"172.21.15.122:6821/3484833116","state":["exists","up"]},{"osd":9,"uuid":"7e768ff7-f78d-4a12-b863-4b692e0f4a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6827","nonce":2600273670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6829","nonce":2600273670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6833","nonce":2600273670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6831","nonce":2600273670}]},"public_addr":"172.21.15.50:6827/2600273670","cluster_addr":"172.21.15.50:6829/2600273670","heartbeat_back_addr":"172.21.15.50:6833/2600273670","heartbeat_front_addr":"172.21.15.50:6831/2600273670","state":["exists","up"]},{"osd":10,"uuid":"a42df29a-d88d-4401-878d-6c8f75f3f604","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6825","nonce":2740366543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6827","nonce":2740366543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6831","nonce":2740366543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6829","nonce":2740366543}]},"public_addr":"172.21.15.79:6825/2740366543","cluster_addr":"172.21.15.79:6827/2740366543","heartbeat_back_addr":"172.21.15.79:6831/2740366543","heartbeat_front_addr":"172.21.15.79:6829/2740366543","state":["exists","up"]},{"osd":11,"uuid":"35bcde30-49e4-49b9-a348-98d21a0d3cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6825","nonce":4160854238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6827","nonce":4160854238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6831","nonce":4160854238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6829","nonce":4160854238}]},"public_addr":"172.21.15.122:6825/4160854238","cluster_addr":"172.21.15.122:6827/4160854238","heartbeat_back_addr":"172.21.15.122:6831/4160854238","heartbeat_front_addr":"172.21.15.122:6829/4160854238","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:16:46.989554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:17:11.269759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:17:35.105846+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:00.940943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:26.284520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:51.064143+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:19:16.254750+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:19:42.841380+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:20:08.185133+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:20:34.700082+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:21:01.485278+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:21:27.938715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1311987652":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/1149897118":"2024-06-07T03:15:13.252241+0000","172.21.15.50:6800/2617801068":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/1068038293":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/4038080419":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/149912088":"2024-06-07T03:14:46.388744+0000","172.21.15.50:6801/2617801068":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/2963887224":"2024-06-07T03:14:46.388744+0000","172.21.15.50:6801/1311987652":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/2554563139":"2024-06-07T03:15:13.252241+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T03:23:06.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.298+0000 7fa839ac7700 1 -- 172.21.15.50:0/1267082842 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa81c0a2c20 msgr2=0x7fa81c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:06.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.298+0000 7fa839ac7700 1 --2- 172.21.15.50:0/1267082842 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa81c0a2c20 0x7fa81c0a50e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa824000c00 tx=0x7fa824005fb0 comp rx=0 tx=0).stop 2024-06-06T03:23:06.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.298+0000 7fa839ac7700 1 -- 172.21.15.50:0/1267082842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8341066b0 msgr2=0x7fa8341989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:06.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.298+0000 7fa839ac7700 1 --2- 172.21.15.50:0/1267082842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8341066b0 0x7fa8341989a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa82c007ee0 tx=0x7fa82c00d3b0 comp rx=0 tx=0).stop 2024-06-06T03:23:06.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.298+0000 7fa839ac7700 1 -- 172.21.15.50:0/1267082842 shutdown_connections 2024-06-06T03:23:06.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.298+0000 7fa839ac7700 1 --2- 172.21.15.50:0/1267082842 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa81c0a2c20 0x7fa81c0a50e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:06.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.298+0000 7fa839ac7700 1 --2- 172.21.15.50:0/1267082842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8341066b0 0x7fa8341989a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:06.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.298+0000 7fa839ac7700 1 --2- 172.21.15.50:0/1267082842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8341015d0 0x7fa83419e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:06.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.298+0000 7fa839ac7700 1 --2- 172.21.15.50:0/1267082842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa834101f80 0x7fa83419ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:06.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.298+0000 7fa839ac7700 1 -- 172.21.15.50:0/1267082842 >> 172.21.15.50:0/1267082842 conn(0x7fa834078400 msgr2=0x7fa834107880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:06.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.298+0000 7fa839ac7700 1 -- 172.21.15.50:0/1267082842 shutdown_connections 2024-06-06T03:23:06.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:06.298+0000 7fa839ac7700 1 -- 172.21.15.50:0/1267082842 wait complete. 2024-06-06T03:23:06.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:06 smithi050 ceph-mon[32421]: pgmap v321: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:23:06.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:06 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1267082842' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:23:06.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:06 smithi079 ceph-mon[35478]: pgmap v321: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:23:06.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:06 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/1267082842' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:23:06.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:06 smithi122 ceph-mon[35759]: pgmap v321: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:23:06.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:06 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/1267082842' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:23:07.112 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-06T03:22:36.202061+0000', 'modified': '2024-06-06T03:22:50.412282+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24490}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24490': {'gid': 24490, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.122:6839/4129732900', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6838', 'nonce': 4129732900}, {'type': 'v1', 'addr': '172.21.15.122:6839', 'nonce': 4129732900}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24490, 'qdb_cluster': [24490]} 2024-06-06T03:23:07.112 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-06T03:23:07.113 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.i status 2024-06-06T03:23:07.365 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:23:08.730 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:08 smithi050 ceph-mon[32421]: pgmap v322: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:23:08.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:08 smithi079 ceph-mon[35478]: pgmap v322: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:23:08.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:08 smithi122 ceph-mon[35759]: pgmap v322: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:23:08.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.986+0000 7f716b8e2700 1 -- 172.21.15.50:0/953507831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7164103120 msgr2=0x7f7164107130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:08.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.986+0000 7f716b8e2700 1 --2- 172.21.15.50:0/953507831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7164103120 0x7f7164107130 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f71540099c0 tx=0x7f7154009cd0 comp rx=0 tx=0).stop 2024-06-06T03:23:08.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.986+0000 7f716b8e2700 1 -- 172.21.15.50:0/953507831 shutdown_connections 2024-06-06T03:23:08.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.986+0000 7f716b8e2700 1 --2- 172.21.15.50:0/953507831 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7164107860 0x7f716410f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:08.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.986+0000 7f716b8e2700 1 --2- 172.21.15.50:0/953507831 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7164102770 0x7f7164102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:08.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.986+0000 7f716b8e2700 1 --2- 172.21.15.50:0/953507831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7164103120 0x7f7164107130 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:08.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.986+0000 7f716b8e2700 1 -- 172.21.15.50:0/953507831 >> 172.21.15.50:0/953507831 conn(0x7f7164079600 msgr2=0x7f7164079a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:08.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.986+0000 7f716b8e2700 1 -- 172.21.15.50:0/953507831 shutdown_connections 2024-06-06T03:23:08.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.986+0000 7f716b8e2700 1 -- 172.21.15.50:0/953507831 wait complete. 2024-06-06T03:23:08.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.986+0000 7f716b8e2700 1 Processor -- start 2024-06-06T03:23:08.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.987+0000 7f716b8e2700 1 -- start start 2024-06-06T03:23:08.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.987+0000 7f716b8e2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7164102770 0x7f716419e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:08.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.987+0000 7f716b8e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7164103120 0x7f716419eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:08.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.987+0000 7f716b8e2700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7164107860 0x7f7164198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:08.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.987+0000 7f716b8e2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f71641126a0 con 0x7f7164103120 2024-06-06T03:23:08.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.987+0000 7f716b8e2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7164112520 con 0x7f7164102770 2024-06-06T03:23:08.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.987+0000 7f716b8e2700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7164112820 con 0x7f7164107860 2024-06-06T03:23:08.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.987+0000 7f7168e7d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7164103120 0x7f716419eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:08.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.987+0000 7f7168e7d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7164103120 0x7f716419eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58592/0 (socket says 172.21.15.50:58592) 2024-06-06T03:23:08.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.987+0000 7f7168e7d700 1 -- 172.21.15.50:0/697095437 learned_addr learned my addr 172.21.15.50:0/697095437 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:23:08.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.987+0000 7f716967e700 1 --2- 172.21.15.50:0/697095437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7164102770 0x7f716419e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:08.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.987+0000 7f7169e7f700 1 --2- 172.21.15.50:0/697095437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7164107860 0x7f7164198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:08.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.987+0000 7f7168e7d700 1 -- 172.21.15.50:0/697095437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7164107860 msgr2=0x7f7164198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.987+0000 7f7168e7d700 1 --2- 172.21.15.50:0/697095437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7164107860 0x7f7164198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.987+0000 7f7168e7d700 1 -- 172.21.15.50:0/697095437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7164102770 msgr2=0x7f716419e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.987+0000 7f7168e7d700 1 --2- 172.21.15.50:0/697095437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7164102770 0x7f716419e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.987+0000 7f7168e7d700 1 -- 172.21.15.50:0/697095437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7164199080 con 0x7f7164103120 2024-06-06T03:23:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.987+0000 7f7168e7d700 1 --2- 172.21.15.50:0/697095437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7164103120 0x7f716419eca0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7154006010 tx=0x7f7154009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.988+0000 7f715a7fc700 1 -- 172.21.15.50:0/697095437 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7154027070 con 0x7f7164103120 2024-06-06T03:23:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.988+0000 7f715a7fc700 1 -- 172.21.15.50:0/697095437 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7154003f50 con 0x7f7164103120 2024-06-06T03:23:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.988+0000 7f716b8e2700 1 -- 172.21.15.50:0/697095437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7164199310 con 0x7f7164103120 2024-06-06T03:23:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.988+0000 7f715a7fc700 1 -- 172.21.15.50:0/697095437 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7154022cd0 con 0x7f7164103120 2024-06-06T03:23:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.988+0000 7f716b8e2700 1 -- 172.21.15.50:0/697095437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71641a5630 con 0x7f7164103120 2024-06-06T03:23:08.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.990+0000 7f715a7fc700 1 -- 172.21.15.50:0/697095437 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f715402a070 con 0x7f7164103120 2024-06-06T03:23:08.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.991+0000 7f715a7fc700 1 --2- 172.21.15.50:0/697095437 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f71500a2ca0 0x7f71500a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:08.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.991+0000 7f715a7fc700 1 -- 172.21.15.50:0/697095437 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8802+0+0 (secure 0 0 0) 0x7f71540cff00 con 0x7f7164103120 2024-06-06T03:23:08.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.991+0000 7f716967e700 1 --2- 172.21.15.50:0/697095437 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f71500a2ca0 0x7f71500a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:08.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.991+0000 7f716967e700 1 --2- 172.21.15.50:0/697095437 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f71500a2ca0 0x7f71500a5160 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7164199a60 tx=0x7f716000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:08.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.992+0000 7f7176165b80 1 Processor -- start 2024-06-06T03:23:08.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.992+0000 7f7176165b80 1 -- start start 2024-06-06T03:23:08.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.992+0000 7f7176165b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55db834cc5f0 0x55db834cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:08.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.992+0000 7f7176165b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db834ccf10 0x55db834c6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:08.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.992+0000 7f7176165b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db834c6ed0 0x55db834c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:08.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.992+0000 7f7176165b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55db834187c0 con 0x55db834ccf10 2024-06-06T03:23:08.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.992+0000 7f7176165b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55db833c06d0 con 0x55db834cc5f0 2024-06-06T03:23:08.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.992+0000 7f7176165b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55db83414780 con 0x55db834c6ed0 2024-06-06T03:23:08.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.992+0000 7f7168e7d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db834ccf10 0x55db834c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:08.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.992+0000 7f7168e7d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db834ccf10 0x55db834c6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58606/0 (socket says 172.21.15.50:58606) 2024-06-06T03:23:08.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.992+0000 7f7168e7d700 1 -- 172.21.15.50:0/994662373 learned_addr learned my addr 172.21.15.50:0/994662373 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:23:08.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.992+0000 7f716967e700 1 --2- 172.21.15.50:0/994662373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55db834cc5f0 0x55db834cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:08.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.992+0000 7f7169e7f700 1 --2- 172.21.15.50:0/994662373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db834c6ed0 0x55db834c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:08.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.992+0000 7f7168e7d700 1 -- 172.21.15.50:0/994662373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db834c6ed0 msgr2=0x55db834c72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:23:08.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.992+0000 7f7168e7d700 1 --2- 172.21.15.50:0/994662373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db834c6ed0 0x55db834c72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:08.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.992+0000 7f7168e7d700 1 -- 172.21.15.50:0/994662373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55db834cc5f0 msgr2=0x55db834cc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:23:08.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.992+0000 7f7168e7d700 1 --2- 172.21.15.50:0/994662373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55db834cc5f0 0x55db834cc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:08.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.992+0000 7f7168e7d700 1 -- 172.21.15.50:0/994662373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db833b6f00 con 0x55db834ccf10 2024-06-06T03:23:08.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.993+0000 7f7168e7d700 1 --2- 172.21.15.50:0/994662373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db834ccf10 0x55db834c6990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7154098ad0 tx=0x7f715409c050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1411f95d0004a7e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:08.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.993+0000 7f714f7fe700 1 -- 172.21.15.50:0/994662373 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71540b5070 con 0x55db834ccf10 2024-06-06T03:23:08.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.993+0000 7f714f7fe700 1 -- 172.21.15.50:0/994662373 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f715409cd70 con 0x55db834ccf10 2024-06-06T03:23:08.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.993+0000 7f714f7fe700 1 -- 172.21.15.50:0/994662373 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71540094b0 con 0x55db834ccf10 2024-06-06T03:23:08.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.994+0000 7f7176165b80 1 -- 172.21.15.50:0/994662373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db834ccf10 msgr2=0x55db834c6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:08.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.994+0000 7f7176165b80 1 --2- 172.21.15.50:0/994662373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db834ccf10 0x55db834c6990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7154098ad0 tx=0x7f715409c050 comp rx=0 tx=0).stop 2024-06-06T03:23:08.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.994+0000 7f7176165b80 1 -- 172.21.15.50:0/994662373 shutdown_connections 2024-06-06T03:23:08.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.994+0000 7f7176165b80 1 --2- 172.21.15.50:0/994662373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db834c6ed0 0x55db834c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:08.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.994+0000 7f7176165b80 1 --2- 172.21.15.50:0/994662373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55db834cc5f0 0x55db834cc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:08.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.994+0000 7f7176165b80 1 --2- 172.21.15.50:0/994662373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db834ccf10 0x55db834c6990 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:08.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.994+0000 7f7176165b80 1 -- 172.21.15.50:0/994662373 >> 172.21.15.50:0/994662373 conn(0x55db833f1c70 msgr2=0x55db834c1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:08.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.994+0000 7f7176165b80 1 -- 172.21.15.50:0/994662373 shutdown_connections 2024-06-06T03:23:08.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.994+0000 7f7176165b80 1 -- 172.21.15.50:0/994662373 wait complete. 2024-06-06T03:23:08.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.994+0000 7f7176165b80 1 -- start start 2024-06-06T03:23:08.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.994+0000 7f7176165b80 1 Processor -- start 2024-06-06T03:23:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.995+0000 7f7176165b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55db834c6ed0 0x55db834d2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.995+0000 7f7176165b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db834cc5f0 0x55db834d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.995+0000 7f7176165b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db834ccf10 0x55db834d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.995+0000 7f7176165b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55db834d36a0 con 0x55db834cc5f0 2024-06-06T03:23:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.995+0000 7f7176165b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55db833b8ba0 con 0x55db834c6ed0 2024-06-06T03:23:09.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.995+0000 7f7176165b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55db834d3820 con 0x55db834ccf10 2024-06-06T03:23:09.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.995+0000 7f7176165b80 10 client.0 _ll_register_callbacks cb 0x55db833b28d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:23:09.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.995+0000 7f7169e7f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db834ccf10 0x55db834d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:09.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.995+0000 7f716967e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55db834c6ed0 0x55db834d2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:09.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.995+0000 7f716967e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55db834c6ed0 0x55db834d2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:36234/0 (socket says 172.21.15.50:36234) 2024-06-06T03:23:09.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.995+0000 7f7169e7f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db834ccf10 0x55db834d05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:36524/0 (socket says 172.21.15.50:36524) 2024-06-06T03:23:09.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.995+0000 7f716967e700 1 -- 172.21.15.50:0/2678914573 learned_addr learned my addr 172.21.15.50:0/2678914573 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:23:09.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.995+0000 7f716967e700 1 -- 172.21.15.50:0/2678914573 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db834ccf10 msgr2=0x55db834d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:23:09.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.995+0000 7f716967e700 1 --2- 172.21.15.50:0/2678914573 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db834ccf10 0x55db834d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:09.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.995+0000 7f716967e700 1 -- 172.21.15.50:0/2678914573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db834cc5f0 msgr2=0x55db834d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:23:09.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.995+0000 7f716967e700 1 --2- 172.21.15.50:0/2678914573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db834cc5f0 0x55db834d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:09.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.995+0000 7f716967e700 1 -- 172.21.15.50:0/2678914573 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db83367880 con 0x55db834c6ed0 2024-06-06T03:23:09.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.995+0000 7f716967e700 1 --2- 172.21.15.50:0/2678914573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55db834c6ed0 0x55db834d2d60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f71600116f0 tx=0x7f71600047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fabdaaac092d2d0d server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:09.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.995+0000 7f714cff9700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:23:09.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.995+0000 7f714cff9700 1 -- 172.21.15.50:0/2678914573 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7160028670 con 0x55db834c6ed0 2024-06-06T03:23:09.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.996+0000 7f7176165b80 1 -- 172.21.15.50:0/2678914573 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f715409cd70 con 0x55db834c6ed0 2024-06-06T03:23:09.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.996+0000 7f714cff9700 1 -- 172.21.15.50:0/2678914573 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8802+0+0 (secure 0 0 0) 0x7f7160028810 con 0x55db834c6ed0 2024-06-06T03:23:09.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.996+0000 7f714cff9700 1 -- 172.21.15.50:0/2678914573 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f7160028a10 con 0x55db834c6ed0 2024-06-06T03:23:09.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.996+0000 7f7176165b80 10 client.24533 fetch_fsmap learned FSMap version 17 2024-06-06T03:23:09.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.996+0000 7f7176165b80 1 -- 172.21.15.50:0/2678914573 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55db834de160 con 0x55db834c6ed0 2024-06-06T03:23:09.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.996+0000 7f714cff9700 1 -- 172.21.15.50:0/2678914573 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f715409cd70 con 0x55db834c6ed0 2024-06-06T03:23:09.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.996+0000 7f714cff9700 1 -- 172.21.15.50:0/2678914573 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 17) ==== 8342+0+0 (secure 0 0 0) 0x7f716001e430 con 0x55db834c6ed0 2024-06-06T03:23:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.996+0000 7f7176165b80 10 client.24533 fetch_fsmap finished waiting for FSMap version 17 2024-06-06T03:23:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.996+0000 7f7176165b80 10 client.24533 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-06T03:23:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.996+0000 7f7176165b80 20 client.24533 populate_metadata read hostname 'smithi050' 2024-06-06T03:23:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.996+0000 7f7176165b80 1 --2- 172.21.15.50:0/2678914573 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55db834e07a0 0x55db834e1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.996+0000 7f7176165b80 4 client.24533 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:23:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.996+0000 7f7176165b80 1 -- 172.21.15.50:0/2678914573 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db83425cc0 con 0x55db834e07a0 2024-06-06T03:23:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.997+0000 7f7168e7d700 1 --2- 172.21.15.50:0/2678914573 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55db834e07a0 0x55db834e1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.997+0000 7f714cff9700 10 client.24533 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:23:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.997+0000 7f7168e7d700 1 --2- 172.21.15.50:0/2678914573 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55db834e07a0 0x55db834e1c10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7859c8503b76dc77 server_cookie=3836e1cad568e2a4 in_seq=0 out_seq=0 2024-06-06T03:23:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.998+0000 7f714cff9700 1 -- 172.21.15.50:0/2678914573 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55db83425cc0 con 0x55db834e07a0 2024-06-06T03:23:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.998+0000 7f714cff9700 10 client.24533 handle_command_reply: tid=0 2024-06-06T03:23:09.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.998+0000 7f7176165b80 1 client.24533 shutdown 2024-06-06T03:23:09.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.998+0000 7f7176165b80 1 -- 172.21.15.50:0/2678914573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55db834c6ed0 msgr2=0x55db834d2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:09.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.998+0000 7f7176165b80 1 --2- 172.21.15.50:0/2678914573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55db834c6ed0 0x55db834d2d60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f71600116f0 tx=0x7f71600047c0 comp rx=0 tx=0).stop 2024-06-06T03:23:09.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.998+0000 7f7176165b80 1 -- 172.21.15.50:0/2678914573 shutdown_connections 2024-06-06T03:23:09.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.998+0000 7f7176165b80 1 --2- 172.21.15.50:0/2678914573 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55db834e07a0 0x55db834e1c10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:09.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.998+0000 7f7176165b80 1 --2- 172.21.15.50:0/2678914573 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db834ccf10 0x55db834d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:09.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.998+0000 7f7176165b80 1 --2- 172.21.15.50:0/2678914573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55db834c6ed0 0x55db834d2d60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:09.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.998+0000 7f714cff9700 0 client.24533 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:23:09.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.998+0000 7f7176165b80 1 --2- 172.21.15.50:0/2678914573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db834cc5f0 0x55db834d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:09.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.998+0000 7f7176165b80 1 -- 172.21.15.50:0/2678914573 >> 172.21.15.50:0/2678914573 conn(0x55db833f1c70 msgr2=0x55db834c15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:09.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.998+0000 7f7176165b80 1 -- 172.21.15.50:0/2678914573 shutdown_connections 2024-06-06T03:23:09.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.999+0000 7f7176165b80 1 -- 172.21.15.50:0/2678914573 wait complete. 2024-06-06T03:23:09.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:08.999+0000 7f7176165b80 20 client.24533 trim_cache size 0 max 16384 2024-06-06T03:23:09.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.020+0000 7f7176165b80 1 Processor -- start 2024-06-06T03:23:09.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.020+0000 7f7176165b80 1 -- start start 2024-06-06T03:23:09.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.020+0000 7f7176165b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55db834c6ed0 0x55db834c6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:09.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.020+0000 7f7176165b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db834cc5f0 0x55db834c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:09.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.020+0000 7f7176165b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db834ccf10 0x55db834bb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:09.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.020+0000 7f7176165b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55db834dff50 con 0x55db834cc5f0 2024-06-06T03:23:09.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.020+0000 7f7176165b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55db834e0620 con 0x55db834c6ed0 2024-06-06T03:23:09.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.020+0000 7f7176165b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55db834e0cf0 con 0x55db834ccf10 2024-06-06T03:23:09.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.020+0000 7f7168e7d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db834cc5f0 0x55db834c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:09.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.020+0000 7f7168e7d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db834cc5f0 0x55db834c72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58624/0 (socket says 172.21.15.50:58624) 2024-06-06T03:23:09.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.020+0000 7f7168e7d700 1 -- 172.21.15.50:0/1713303035 learned_addr learned my addr 172.21.15.50:0/1713303035 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:23:09.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.020+0000 7f716967e700 1 --2- 172.21.15.50:0/1713303035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55db834c6ed0 0x55db834c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:09.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.021+0000 7f7169e7f700 1 --2- 172.21.15.50:0/1713303035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db834ccf10 0x55db834bb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:09.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.021+0000 7f7168e7d700 1 -- 172.21.15.50:0/1713303035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db834ccf10 msgr2=0x55db834bb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:23:09.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.021+0000 7f7168e7d700 1 --2- 172.21.15.50:0/1713303035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db834ccf10 0x55db834bb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:09.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.021+0000 7f7168e7d700 1 -- 172.21.15.50:0/1713303035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55db834c6ed0 msgr2=0x55db834c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:23:09.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.021+0000 7f7168e7d700 1 --2- 172.21.15.50:0/1713303035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55db834c6ed0 0x55db834c6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:09.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.021+0000 7f7168e7d700 1 -- 172.21.15.50:0/1713303035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db834c3030 con 0x55db834cc5f0 2024-06-06T03:23:09.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.021+0000 7f7168e7d700 1 --2- 172.21.15.50:0/1713303035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db834cc5f0 0x55db834c72b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f715400c010 tx=0x7f7154022470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db07448e0831ec34 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:09.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.021+0000 7f714effd700 1 -- 172.21.15.50:0/1713303035 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71540b5040 con 0x55db834cc5f0 2024-06-06T03:23:09.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.021+0000 7f714effd700 1 -- 172.21.15.50:0/1713303035 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f71540a5250 con 0x55db834cc5f0 2024-06-06T03:23:09.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.021+0000 7f714effd700 1 -- 172.21.15.50:0/1713303035 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71540094b0 con 0x55db834cc5f0 2024-06-06T03:23:09.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.022+0000 7f7176165b80 1 -- 172.21.15.50:0/1713303035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db834cc5f0 msgr2=0x55db834c72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:09.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.022+0000 7f7176165b80 1 --2- 172.21.15.50:0/1713303035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db834cc5f0 0x55db834c72b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f715400c010 tx=0x7f7154022470 comp rx=0 tx=0).stop 2024-06-06T03:23:09.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.022+0000 7f7176165b80 1 -- 172.21.15.50:0/1713303035 shutdown_connections 2024-06-06T03:23:09.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.022+0000 7f7176165b80 1 --2- 172.21.15.50:0/1713303035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db834ccf10 0x55db834bb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:09.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.022+0000 7f7176165b80 1 --2- 172.21.15.50:0/1713303035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55db834c6ed0 0x55db834c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:09.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.022+0000 7f7176165b80 1 --2- 172.21.15.50:0/1713303035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db834cc5f0 0x55db834c72b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:09.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.022+0000 7f7176165b80 1 -- 172.21.15.50:0/1713303035 >> 172.21.15.50:0/1713303035 conn(0x55db833f1c70 msgr2=0x55db834cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:09.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.022+0000 7f7176165b80 1 -- 172.21.15.50:0/1713303035 shutdown_connections 2024-06-06T03:23:09.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.022+0000 7f7176165b80 1 -- 172.21.15.50:0/1713303035 wait complete. 2024-06-06T03:23:09.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.022+0000 7f7176165b80 1 -- start start 2024-06-06T03:23:09.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.022+0000 7f7176165b80 1 Processor -- start 2024-06-06T03:23:09.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.023+0000 7f7176165b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db834c6ed0 0x55db83546c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:09.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.023+0000 7f7176165b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db834cc5f0 0x55db835471d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:09.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.023+0000 7f7176165b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55db834ccf10 0x55db83547710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:09.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.023+0000 7f7176165b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55db834e1a90 con 0x55db834cc5f0 2024-06-06T03:23:09.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.023+0000 7f7176165b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55db834e13c0 con 0x55db834ccf10 2024-06-06T03:23:09.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.023+0000 7f7176165b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55db834e2160 con 0x55db834c6ed0 2024-06-06T03:23:09.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.023+0000 7f7176165b80 10 client.0 _ll_register_callbacks cb 0x55db833b28d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:23:09.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.023+0000 7f7168e7d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db834cc5f0 0x55db835471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:09.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.023+0000 7f7168e7d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db834cc5f0 0x55db835471d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58640/0 (socket says 172.21.15.50:58640) 2024-06-06T03:23:09.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.023+0000 7f7168e7d700 1 -- 172.21.15.50:0/1051549813 learned_addr learned my addr 172.21.15.50:0/1051549813 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:23:09.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.023+0000 7f7169e7f700 1 --2- 172.21.15.50:0/1051549813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55db834ccf10 0x55db83547710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:09.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.023+0000 7f716967e700 1 --2- 172.21.15.50:0/1051549813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db834c6ed0 0x55db83546c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:09.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.023+0000 7f7168e7d700 1 -- 172.21.15.50:0/1051549813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db834c6ed0 msgr2=0x55db83546c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:23:09.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.023+0000 7f7168e7d700 1 --2- 172.21.15.50:0/1051549813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db834c6ed0 0x55db83546c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:09.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.023+0000 7f7168e7d700 1 -- 172.21.15.50:0/1051549813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55db834ccf10 msgr2=0x55db83547710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:23:09.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.023+0000 7f7168e7d700 1 --2- 172.21.15.50:0/1051549813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55db834ccf10 0x55db83547710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:09.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.023+0000 7f7168e7d700 1 -- 172.21.15.50:0/1051549813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db834e7460 con 0x55db834cc5f0 2024-06-06T03:23:09.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.023+0000 7f7168e7d700 1 --2- 172.21.15.50:0/1051549813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db834cc5f0 0x55db835471d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f71540059d0 tx=0x7f7154009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15aacb4ca9678323 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:09.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.023+0000 7f714cff9700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:23:09.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.023+0000 7f714cff9700 1 -- 172.21.15.50:0/1051549813 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7154080060 con 0x55db834cc5f0 2024-06-06T03:23:09.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.024+0000 7f714cff9700 1 -- 172.21.15.50:0/1051549813 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8802+0+0 (secure 0 0 0) 0x7f7154004100 con 0x55db834cc5f0 2024-06-06T03:23:09.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.024+0000 7f7176165b80 1 -- 172.21.15.50:0/1051549813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71540a5250 con 0x55db834cc5f0 2024-06-06T03:23:09.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.024+0000 7f714cff9700 1 -- 172.21.15.50:0/1051549813 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f71540b5040 con 0x55db834cc5f0 2024-06-06T03:23:09.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.024+0000 7f7176165b80 10 client.14721 fetch_fsmap learned FSMap version 17 2024-06-06T03:23:09.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.024+0000 7f7176165b80 1 -- 172.21.15.50:0/1051549813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55db83550690 con 0x55db834cc5f0 2024-06-06T03:23:09.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.024+0000 7f714cff9700 1 -- 172.21.15.50:0/1051549813 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f71540a5250 con 0x55db834cc5f0 2024-06-06T03:23:09.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.024+0000 7f714cff9700 1 -- 172.21.15.50:0/1051549813 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 17) ==== 8342+0+0 (secure 0 0 0) 0x7f715409bac0 con 0x55db834cc5f0 2024-06-06T03:23:09.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.024+0000 7f7176165b80 10 client.14721 fetch_fsmap finished waiting for FSMap version 17 2024-06-06T03:23:09.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.024+0000 7f7176165b80 10 client.14721 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-06T03:23:09.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.024+0000 7f7176165b80 20 client.14721 populate_metadata read hostname 'smithi050' 2024-06-06T03:23:09.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.024+0000 7f7176165b80 1 --2- 172.21.15.50:0/1051549813 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55db83554db0 0x55db83553ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:09.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.024+0000 7f7176165b80 4 client.14721 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-06T03:23:09.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.024+0000 7f7176165b80 1 -- 172.21.15.50:0/1051549813 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "status"}) -- 0x55db834c7860 con 0x55db83554db0 2024-06-06T03:23:09.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.024+0000 7f716967e700 1 --2- 172.21.15.50:0/1051549813 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55db83554db0 0x55db83553ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:09.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.025+0000 7f716967e700 1 --2- 172.21.15.50:0/1051549813 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55db83554db0 0x55db83553ac0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3ca9245c16b31e9 server_cookie=998849a01f14d2ed in_seq=0 out_seq=0 2024-06-06T03:23:09.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.025+0000 7f714cff9700 10 client.14721 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:23:09.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.025+0000 7f714cff9700 1 -- 172.21.15.50:0/1051549813 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55db834c7860 con 0x55db83554db0 2024-06-06T03:23:09.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.025+0000 7f714cff9700 10 client.14721 handle_command_reply: tid=0 2024-06-06T03:23:09.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.025+0000 7f7176165b80 1 client.14721 shutdown 2024-06-06T03:23:09.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.025+0000 7f7176165b80 1 -- 172.21.15.50:0/1051549813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db834cc5f0 msgr2=0x55db835471d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:09.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.025+0000 7f7176165b80 1 --2- 172.21.15.50:0/1051549813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db834cc5f0 0x55db835471d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f71540059d0 tx=0x7f7154009cd0 comp rx=0 tx=0).stop 2024-06-06T03:23:09.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.025+0000 7f7176165b80 1 -- 172.21.15.50:0/1051549813 shutdown_connections 2024-06-06T03:23:09.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.025+0000 7f7176165b80 1 --2- 172.21.15.50:0/1051549813 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55db83554db0 0x55db83553ac0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:09.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.025+0000 7f7176165b80 1 --2- 172.21.15.50:0/1051549813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55db834ccf10 0x55db83547710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:09.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.025+0000 7f7176165b80 1 --2- 172.21.15.50:0/1051549813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55db834c6ed0 0x55db83546c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:09.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.025+0000 7f7176165b80 1 --2- 172.21.15.50:0/1051549813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db834cc5f0 0x55db835471d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:09.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.025+0000 7f7176165b80 1 -- 172.21.15.50:0/1051549813 >> 172.21.15.50:0/1051549813 conn(0x55db833f1c70 msgr2=0x55db834cdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:09.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.025+0000 7f714cff9700 0 client.14721 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:23:09.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.025+0000 7f7176165b80 1 -- 172.21.15.50:0/1051549813 shutdown_connections 2024-06-06T03:23:09.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.025+0000 7f7176165b80 1 -- 172.21.15.50:0/1051549813 wait complete. 2024-06-06T03:23:09.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.026+0000 7f7176165b80 20 client.14721 trim_cache size 0 max 16384 2024-06-06T03:23:09.033 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:23:09.033 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "b6263b26-23b2-11ef-bc9b-c7b262605968", 2024-06-06T03:23:09.033 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-06-06T03:23:09.033 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24490, 2024-06-06T03:23:09.033 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-06-06T03:23:09.033 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-06-06T03:23:09.033 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-06-06T03:23:09.033 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 32.736207573000002, 2024-06-06T03:23:09.033 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 17, 2024-06-06T03:23:09.033 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 95, 2024-06-06T03:23:09.034 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 95, 2024-06-06T03:23:09.034 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 57.060995888000001 2024-06-06T03:23:09.034 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:23:09.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.026+0000 7f716b8e2700 1 -- 172.21.15.50:0/697095437 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f71500a2ca0 msgr2=0x7f71500a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:09.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.026+0000 7f716b8e2700 1 --2- 172.21.15.50:0/697095437 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f71500a2ca0 0x7f71500a5160 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7164199a60 tx=0x7f716000b410 comp rx=0 tx=0).stop 2024-06-06T03:23:09.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.026+0000 7f716b8e2700 1 -- 172.21.15.50:0/697095437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7164103120 msgr2=0x7f716419eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:09.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.026+0000 7f716b8e2700 1 --2- 172.21.15.50:0/697095437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7164103120 0x7f716419eca0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7154006010 tx=0x7f7154009f80 comp rx=0 tx=0).stop 2024-06-06T03:23:09.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.026+0000 7f716b8e2700 1 -- 172.21.15.50:0/697095437 shutdown_connections 2024-06-06T03:23:09.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.026+0000 7f716b8e2700 1 --2- 172.21.15.50:0/697095437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7164107860 0x7f7164198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:09.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.026+0000 7f716b8e2700 1 --2- 172.21.15.50:0/697095437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7164102770 0x7f716419e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:09.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.026+0000 7f716b8e2700 1 --2- 172.21.15.50:0/697095437 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f71500a2ca0 0x7f71500a5160 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:09.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.026+0000 7f716b8e2700 1 --2- 172.21.15.50:0/697095437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7164103120 0x7f716419eca0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:09.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.026+0000 7f716b8e2700 1 -- 172.21.15.50:0/697095437 >> 172.21.15.50:0/697095437 conn(0x7f7164079600 msgr2=0x7f71641005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:09.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.026+0000 7f716b8e2700 1 -- 172.21.15.50:0/697095437 shutdown_connections 2024-06-06T03:23:09.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:09.026+0000 7f716b8e2700 1 -- 172.21.15.50:0/697095437 wait complete. 2024-06-06T03:23:09.740 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-06T03:23:09.741 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-06-06T03:23:09.741 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs ls 2024-06-06T03:23:09.993 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:23:10.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:10 smithi050 ceph-mon[32421]: pgmap v323: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:23:10.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:10 smithi079 ceph-mon[35478]: pgmap v323: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:23:10.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:10 smithi122 ceph-mon[35759]: pgmap v323: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:23:11.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.662+0000 7fbbf6b33700 1 -- 172.21.15.50:0/1838778577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbf0101610 msgr2=0x7fbbf01019f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:11.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.662+0000 7fbbf6b33700 1 --2- 172.21.15.50:0/1838778577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbf0101610 0x7fbbf01019f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40099c0 tx=0x7fbbe4009cd0 comp rx=0 tx=0).stop 2024-06-06T03:23:11.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.662+0000 7fbbf6b33700 1 -- 172.21.15.50:0/1838778577 shutdown_connections 2024-06-06T03:23:11.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.662+0000 7fbbf6b33700 1 --2- 172.21.15.50:0/1838778577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbf01066f0 0x7fbbf010e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.662+0000 7fbbf6b33700 1 --2- 172.21.15.50:0/1838778577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbf0101610 0x7fbbf01019f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.662+0000 7fbbf6b33700 1 --2- 172.21.15.50:0/1838778577 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbbf0101fc0 0x7fbbf0106010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.662+0000 7fbbf6b33700 1 -- 172.21.15.50:0/1838778577 >> 172.21.15.50:0/1838778577 conn(0x7fbbf0078430 msgr2=0x7fbbf0078840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.662+0000 7fbbf6b33700 1 -- 172.21.15.50:0/1838778577 shutdown_connections 2024-06-06T03:23:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.662+0000 7fbbf6b33700 1 -- 172.21.15.50:0/1838778577 wait complete. 2024-06-06T03:23:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.663+0000 7fbbf6b33700 1 Processor -- start 2024-06-06T03:23:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.663+0000 7fbbf6b33700 1 -- start start 2024-06-06T03:23:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.663+0000 7fbbf6b33700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbbf0101610 0x7fbbf01030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.663+0000 7fbbf6b33700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbf0101fc0 0x7fbbf01035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.663+0000 7fbbf6b33700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbf01066f0 0x7fbbf0103b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.663+0000 7fbbf6b33700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf01115f0 con 0x7fbbf01066f0 2024-06-06T03:23:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.663+0000 7fbbf6b33700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf0111470 con 0x7fbbf0101fc0 2024-06-06T03:23:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.663+0000 7fbbf6b33700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf0111770 con 0x7fbbf0101610 2024-06-06T03:23:11.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.663+0000 7fbbf50d0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbf01066f0 0x7fbbf0103b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:11.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.663+0000 7fbbf50d0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbf01066f0 0x7fbbf0103b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58658/0 (socket says 172.21.15.50:58658) 2024-06-06T03:23:11.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.663+0000 7fbbf50d0700 1 -- 172.21.15.50:0/2325011766 learned_addr learned my addr 172.21.15.50:0/2325011766 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:23:11.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.663+0000 7fbbf48cf700 1 --2- 172.21.15.50:0/2325011766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbbf0101610 0x7fbbf01030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:11.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.663+0000 7fbbf50d0700 1 -- 172.21.15.50:0/2325011766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbbf0101610 msgr2=0x7fbbf01030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:11.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.663+0000 7fbbf50d0700 1 --2- 172.21.15.50:0/2325011766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbbf0101610 0x7fbbf01030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:11.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.663+0000 7fbbeffff700 1 --2- 172.21.15.50:0/2325011766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbf0101fc0 0x7fbbf01035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:11.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.663+0000 7fbbf50d0700 1 -- 172.21.15.50:0/2325011766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbf0101fc0 msgr2=0x7fbbf01035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:11.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.663+0000 7fbbf50d0700 1 --2- 172.21.15.50:0/2325011766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbf0101fc0 0x7fbbf01035f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:11.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.663+0000 7fbbf50d0700 1 -- 172.21.15.50:0/2325011766 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf01a7180 con 0x7fbbf01066f0 2024-06-06T03:23:11.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.664+0000 7fbbf50d0700 1 --2- 172.21.15.50:0/2325011766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbf01066f0 0x7fbbf0103b30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbbe800ada0 tx=0x7fbbe800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:11.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.664+0000 7fbbedffb700 1 -- 172.21.15.50:0/2325011766 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8017020 con 0x7fbbf01066f0 2024-06-06T03:23:11.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.664+0000 7fbbf6b33700 1 -- 172.21.15.50:0/2325011766 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbf01a7470 con 0x7fbbf01066f0 2024-06-06T03:23:11.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.664+0000 7fbbedffb700 1 -- 172.21.15.50:0/2325011766 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbbe800ce30 con 0x7fbbf01066f0 2024-06-06T03:23:11.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.664+0000 7fbbedffb700 1 -- 172.21.15.50:0/2325011766 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8005350 con 0x7fbbf01066f0 2024-06-06T03:23:11.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.664+0000 7fbbf6b33700 1 -- 172.21.15.50:0/2325011766 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbf01a7960 con 0x7fbbf01066f0 2024-06-06T03:23:11.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.665+0000 7fbbf6b33700 1 -- 172.21.15.50:0/2325011766 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbf0069180 con 0x7fbbf01066f0 2024-06-06T03:23:11.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.666+0000 7fbbedffb700 1 -- 172.21.15.50:0/2325011766 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbbe800c980 con 0x7fbbf01066f0 2024-06-06T03:23:11.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.667+0000 7fbbedffb700 1 --2- 172.21.15.50:0/2325011766 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbbe00a2c20 0x7fbbe00a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:11.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.667+0000 7fbbf48cf700 1 --2- 172.21.15.50:0/2325011766 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbbe00a2c20 0x7fbbe00a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:11.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.667+0000 7fbbedffb700 1 -- 172.21.15.50:0/2325011766 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8802+0+0 (secure 0 0 0) 0x7fbbe80ce980 con 0x7fbbf01066f0 2024-06-06T03:23:11.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.667+0000 7fbbf48cf700 1 --2- 172.21.15.50:0/2325011766 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbbe00a2c20 0x7fbbe00a50e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4000c00 tx=0x7fbbe4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:11.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.671+0000 7fbbedffb700 1 -- 172.21.15.50:0/2325011766 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fbbe8021020 con 0x7fbbf01066f0 2024-06-06T03:23:11.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.926+0000 7fbbf6b33700 1 -- 172.21.15.50:0/2325011766 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbbf002de60 con 0x7fbbf01066f0 2024-06-06T03:23:11.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.926+0000 7fbbedffb700 1 -- 172.21.15.50:0/2325011766 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7fbbe809b730 con 0x7fbbf01066f0 2024-06-06T03:23:11.927 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-06-06T03:23:11.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.929+0000 7fbbf6b33700 1 -- 172.21.15.50:0/2325011766 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbbe00a2c20 msgr2=0x7fbbe00a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:11.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.929+0000 7fbbf6b33700 1 --2- 172.21.15.50:0/2325011766 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbbe00a2c20 0x7fbbe00a50e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4000c00 tx=0x7fbbe4005fb0 comp rx=0 tx=0).stop 2024-06-06T03:23:11.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.929+0000 7fbbf6b33700 1 -- 172.21.15.50:0/2325011766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbf01066f0 msgr2=0x7fbbf0103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:11.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.929+0000 7fbbf6b33700 1 --2- 172.21.15.50:0/2325011766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbf01066f0 0x7fbbf0103b30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbbe800ada0 tx=0x7fbbe800c330 comp rx=0 tx=0).stop 2024-06-06T03:23:11.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.929+0000 7fbbf6b33700 1 -- 172.21.15.50:0/2325011766 shutdown_connections 2024-06-06T03:23:11.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.929+0000 7fbbf6b33700 1 --2- 172.21.15.50:0/2325011766 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbbe00a2c20 0x7fbbe00a50e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:11.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.929+0000 7fbbf6b33700 1 --2- 172.21.15.50:0/2325011766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbbf01066f0 0x7fbbf0103b30 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:11.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.929+0000 7fbbf6b33700 1 --2- 172.21.15.50:0/2325011766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbbf0101610 0x7fbbf01030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:11.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.929+0000 7fbbf6b33700 1 --2- 172.21.15.50:0/2325011766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbf0101fc0 0x7fbbf01035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:11.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.929+0000 7fbbf6b33700 1 -- 172.21.15.50:0/2325011766 >> 172.21.15.50:0/2325011766 conn(0x7fbbf0078430 msgr2=0x7fbbf006af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:11.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.929+0000 7fbbf6b33700 1 -- 172.21.15.50:0/2325011766 shutdown_connections 2024-06-06T03:23:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:11.929+0000 7fbbf6b33700 1 -- 172.21.15.50:0/2325011766 wait complete. 2024-06-06T03:23:12.602 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:12 smithi050 ceph-mon[32421]: pgmap v324: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:23:12.603 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:12 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/2325011766' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-06T03:23:12.638 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-06-06T03:23:12.638 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-06T03:23:12.638 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-06-06T03:23:12.638 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-06-06T03:23:12.638 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-06-06T03:23:12.638 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-06-06T03:23:12.639 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-06T03:23:12.639 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-06T03:23:12.639 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-06-06T03:23:12.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T03:23:12.639 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-06-06T03:23:12.658 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-06T03:23:12.658 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-06T03:23:12.658 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-06-06T03:23:12.658 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-06-06T03:23:12.658 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-06-06T03:23:12.658 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-06-06T03:23:12.658 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-06T03:23:12.658 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-06-06T03:23:12.658 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-06-06T03:23:12.659 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-06T03:23:12.659 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-06-06T03:23:12.659 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-06-06T03:23:12.659 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-06T03:23:12.659 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-06-06T03:23:12.659 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-06-06T03:23:12.659 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-06-06T03:23:12.659 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42178sec preferred_lft 42178sec 2024-06-06T03:23:12.659 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link noprefixroute 2024-06-06T03:23:12.659 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-06-06T03:23:12.659 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-06T03:23:12.659 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-06-06T03:23:12.659 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-06-06T03:23:12.660 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-06-06T03:23:12.660 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-06T03:23:12.660 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-06-06T03:23:12.660 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add name ceph-brx type bridge 2024-06-06T03:23:12.660 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr flush dev ceph-brx 2024-06-06T03:23:12.660 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set ceph-brx up 2024-06-06T03:23:12.660 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-06-06T03:23:12.661 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-06-06T03:23:12.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-06T03:23:12.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:12 smithi079 ceph-mon[35478]: pgmap v324: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:23:12.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:12 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/2325011766' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-06T03:23:12.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-06T03:23:12.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T03:23:12.883 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-06T03:23:12.909 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-06-06T03:23:12.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T03:23:12.912 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-06-06T03:23:12.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:12 smithi122 ceph-mon[35759]: pgmap v324: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:23:12.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:12 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/2325011766' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-06T03:23:12.984 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-06-06T03:23:12.984 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-06T03:23:12.984 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-06-06T03:23:12.984 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-06-06T03:23:12.984 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-06T03:23:12.985 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-06T03:23:12.985 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-06-06T03:23:12.985 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-06-06T03:23:12.985 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-06-06T03:23:12.985 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-06-06T03:23:12.985 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-06-06T03:23:13.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-06T03:23:13.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-06T03:23:13.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T03:23:13.300 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-06-06T03:23:13.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T03:23:13.317 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list-id 2024-06-06T03:23:13.373 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-06T03:23:13.373 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-06-06T03:23:13.373 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-06T03:23:13.373 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-06-06T03:23:13.373 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-06-06T03:23:13.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-06T03:23:13.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-06T03:23:13.498 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-06-06T03:23:13.498 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-06T03:23:13.498 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-06-06T03:23:13.498 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-06-06T03:23:13.498 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-06-06T03:23:13.498 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-06-06T03:23:13.498 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-06-06T03:23:13.498 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-06-06T03:23:13.499 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-06-06T03:23:13.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-06T03:23:13.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-06T03:23:13.641 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-06T03:23:13.642 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-06-06T03:23:13.642 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-06-06T03:23:13.642 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set dev brx.0 master ceph-brx 2024-06-06T03:23:13.642 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-06-06T03:23:13.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-06T03:23:13.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-06T03:23:13.724 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-06-06T03:23:13.724 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-06T03:23:13.724 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-06-06T03:23:13.740 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-06-06T03:23:13.740 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-06T03:23:13.740 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-06-06T03:23:13.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-06-06T03:23:13.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-06-06T03:23:13.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-06-06T03:23:13.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-06-06T03:23:13.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]: dispatch 2024-06-06T03:23:13.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-06-06T03:23:13.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-06-06T03:23:13.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]: dispatch 2024-06-06T03:23:13.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]: dispatch 2024-06-06T03:23:13.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]: dispatch 2024-06-06T03:23:13.766 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2024-06-06T03:23:13.834 DEBUG:teuthology.orchestra.run.smithi050:> cat /proc/self/mounts | awk '{print $2}' 2024-06-06T03:23:13.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:13 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-06-06T03:23:13.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:13 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-06-06T03:23:13.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:13 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-06-06T03:23:13.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:13 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-06-06T03:23:13.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:13 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]: dispatch 2024-06-06T03:23:13.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:13 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-06-06T03:23:13.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:13 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-06-06T03:23:13.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:13 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]: dispatch 2024-06-06T03:23:13.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:13 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]: dispatch 2024-06-06T03:23:13.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:13 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]: dispatch 2024-06-06T03:23:13.891 INFO:teuthology.orchestra.run.smithi050.stdout:/proc 2024-06-06T03:23:13.891 INFO:teuthology.orchestra.run.smithi050.stdout:/sys 2024-06-06T03:23:13.891 INFO:teuthology.orchestra.run.smithi050.stdout:/dev 2024-06-06T03:23:13.891 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/security 2024-06-06T03:23:13.891 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/shm 2024-06-06T03:23:13.892 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/pts 2024-06-06T03:23:13.892 INFO:teuthology.orchestra.run.smithi050.stdout:/run 2024-06-06T03:23:13.892 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/cgroup 2024-06-06T03:23:13.892 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/pstore 2024-06-06T03:23:13.892 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/bpf 2024-06-06T03:23:13.892 INFO:teuthology.orchestra.run.smithi050.stdout:/ 2024-06-06T03:23:13.892 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/selinux 2024-06-06T03:23:13.892 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2024-06-06T03:23:13.892 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/debug 2024-06-06T03:23:13.892 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/mqueue 2024-06-06T03:23:13.892 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/tracing 2024-06-06T03:23:13.893 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/hugepages 2024-06-06T03:23:13.893 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-06T03:23:13.893 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/fuse/connections 2024-06-06T03:23:13.893 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/config 2024-06-06T03:23:13.893 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-sysctl.service 2024-06-06T03:23:13.893 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-06T03:23:13.893 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/nfs/rpc_pipefs 2024-06-06T03:23:13.893 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/1000 2024-06-06T03:23:13.893 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph 2024-06-06T03:23:13.893 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay 2024-06-06T03:23:13.893 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/55475d8de65bb5675e341d66de7fbd12fecbd8312fb56fc0a659485d49e94c25/merged 2024-06-06T03:23:13.893 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/ff8c55fbe961acbd6027329a72b4757abb0d888c4c4e25bca39bc2c85f77560b/merged 2024-06-06T03:23:13.893 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/0 2024-06-06T03:23:13.893 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2024-06-06T03:23:13.894 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/e9df8d70483ed98265a611823834b052f5b21544d2cf5ba63451e95dc98bd332/merged 2024-06-06T03:23:13.894 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/64a70138420bd382a3a7641d0af8bbea78863030ece29d1c0bad415cc648659a/merged 2024-06-06T03:23:13.894 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/1daec0589c743b85cdd39f49dbc6723597e793604d588352aff4792c0ce2983c/merged 2024-06-06T03:23:13.894 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/8cea9c4a8ea1b6ae4dfa58693269e3f57a77cd5c94c5b2db50cfb963c4adce0e/merged 2024-06-06T03:23:13.894 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/f25fcc4a07433479657db56d79139ec762e0ff1e1c0ba6e3fc85084350be0fba/merged 2024-06-06T03:23:13.894 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/4eeb14e018357eee6e3629d4e906965e49b7bd6673b60301a46cc40ca93507f1/merged 2024-06-06T03:23:13.894 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/b82976c82aa2d7cca9d3a2c8a813ba195334bdcc33d1fb19950c84f4117e68c2/merged 2024-06-06T03:23:13.894 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/3f40688c26007f9f8656bddf2a15dd1ca5087f85532e22ea84834329eb331d1e/merged 2024-06-06T03:23:13.894 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns 2024-06-06T03:23:13.894 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-06T03:23:13.894 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-06T03:23:13.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T03:23:13.895 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2024-06-06T03:23:13.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:13 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-06-06T03:23:13.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:13 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-06-06T03:23:13.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:13 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-06-06T03:23:13.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:13 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-06-06T03:23:13.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:13 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]: dispatch 2024-06-06T03:23:13.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:13 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-06-06T03:23:13.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:13 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-06-06T03:23:13.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:13 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]: dispatch 2024-06-06T03:23:13.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:13 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]: dispatch 2024-06-06T03:23:13.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:13 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]: dispatch 2024-06-06T03:23:13.947 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-06T03:23:13.948 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-06-06T03:23:13.990 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2024-06-06T03:23:14.016 DEBUG:teuthology.orchestra.run.smithi050:> cat /proc/self/mounts | awk '{print $2}' 2024-06-06T03:23:14.073 INFO:teuthology.orchestra.run.smithi050.stdout:/proc 2024-06-06T03:23:14.073 INFO:teuthology.orchestra.run.smithi050.stdout:/sys 2024-06-06T03:23:14.074 INFO:teuthology.orchestra.run.smithi050.stdout:/dev 2024-06-06T03:23:14.074 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/security 2024-06-06T03:23:14.074 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/shm 2024-06-06T03:23:14.074 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/pts 2024-06-06T03:23:14.074 INFO:teuthology.orchestra.run.smithi050.stdout:/run 2024-06-06T03:23:14.074 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/cgroup 2024-06-06T03:23:14.074 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/pstore 2024-06-06T03:23:14.074 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/bpf 2024-06-06T03:23:14.074 INFO:teuthology.orchestra.run.smithi050.stdout:/ 2024-06-06T03:23:14.074 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/selinux 2024-06-06T03:23:14.074 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2024-06-06T03:23:14.075 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/debug 2024-06-06T03:23:14.075 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/mqueue 2024-06-06T03:23:14.075 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/tracing 2024-06-06T03:23:14.075 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/hugepages 2024-06-06T03:23:14.075 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-06T03:23:14.075 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/fuse/connections 2024-06-06T03:23:14.075 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/config 2024-06-06T03:23:14.075 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-sysctl.service 2024-06-06T03:23:14.075 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-06T03:23:14.075 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/nfs/rpc_pipefs 2024-06-06T03:23:14.075 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/1000 2024-06-06T03:23:14.075 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph 2024-06-06T03:23:14.075 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay 2024-06-06T03:23:14.076 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/55475d8de65bb5675e341d66de7fbd12fecbd8312fb56fc0a659485d49e94c25/merged 2024-06-06T03:23:14.076 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/ff8c55fbe961acbd6027329a72b4757abb0d888c4c4e25bca39bc2c85f77560b/merged 2024-06-06T03:23:14.076 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/0 2024-06-06T03:23:14.076 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2024-06-06T03:23:14.076 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/e9df8d70483ed98265a611823834b052f5b21544d2cf5ba63451e95dc98bd332/merged 2024-06-06T03:23:14.076 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/64a70138420bd382a3a7641d0af8bbea78863030ece29d1c0bad415cc648659a/merged 2024-06-06T03:23:14.077 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/1daec0589c743b85cdd39f49dbc6723597e793604d588352aff4792c0ce2983c/merged 2024-06-06T03:23:14.077 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/8cea9c4a8ea1b6ae4dfa58693269e3f57a77cd5c94c5b2db50cfb963c4adce0e/merged 2024-06-06T03:23:14.077 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/f25fcc4a07433479657db56d79139ec762e0ff1e1c0ba6e3fc85084350be0fba/merged 2024-06-06T03:23:14.077 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/4eeb14e018357eee6e3629d4e906965e49b7bd6673b60301a46cc40ca93507f1/merged 2024-06-06T03:23:14.077 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/b82976c82aa2d7cca9d3a2c8a813ba195334bdcc33d1fb19950c84f4117e68c2/merged 2024-06-06T03:23:14.077 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/3f40688c26007f9f8656bddf2a15dd1ca5087f85532e22ea84834329eb331d1e/merged 2024-06-06T03:23:14.077 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns 2024-06-06T03:23:14.077 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-06T03:23:14.077 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-06T03:23:14.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T03:23:14.078 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2024-06-06T03:23:14.101 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:2024-06-06T03:23:14.102+0000 7f0ebbf1b480 -1 init, newargv = 0x5636ed0a4800 newargc=15 2024-06-06T03:23:14.101 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:ceph-fuse[78148]: starting ceph client 2024-06-06T03:23:14.107 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:ceph-fuse[78148]: starting fuse 2024-06-06T03:23:14.117 INFO:teuthology.orchestra.run.smithi050.stdout:119 2024-06-06T03:23:14.117 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [119] 2024-06-06T03:23:14.118 DEBUG:teuthology.orchestra.run.smithi050:> sudo stdin-killer -- python3 -c ' 2024-06-06T03:23:14.118 DEBUG:teuthology.orchestra.run.smithi050:> import glob 2024-06-06T03:23:14.118 DEBUG:teuthology.orchestra.run.smithi050:> import re 2024-06-06T03:23:14.118 DEBUG:teuthology.orchestra.run.smithi050:> import os 2024-06-06T03:23:14.118 DEBUG:teuthology.orchestra.run.smithi050:> import subprocess 2024-06-06T03:23:14.118 DEBUG:teuthology.orchestra.run.smithi050:> 2024-06-06T03:23:14.118 DEBUG:teuthology.orchestra.run.smithi050:> def _find_admin_socket(client_name): 2024-06-06T03:23:14.118 DEBUG:teuthology.orchestra.run.smithi050:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-06-06T03:23:14.118 DEBUG:teuthology.orchestra.run.smithi050:> files = glob.glob(asok_path) 2024-06-06T03:23:14.118 DEBUG:teuthology.orchestra.run.smithi050:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-06-06T03:23:14.118 DEBUG:teuthology.orchestra.run.smithi050:> 2024-06-06T03:23:14.118 DEBUG:teuthology.orchestra.run.smithi050:> # Given a non-glob path, it better be there 2024-06-06T03:23:14.118 DEBUG:teuthology.orchestra.run.smithi050:> if "*" not in asok_path: 2024-06-06T03:23:14.118 DEBUG:teuthology.orchestra.run.smithi050:> assert(len(files) == 1) 2024-06-06T03:23:14.119 DEBUG:teuthology.orchestra.run.smithi050:> return files[0] 2024-06-06T03:23:14.119 DEBUG:teuthology.orchestra.run.smithi050:> 2024-06-06T03:23:14.119 DEBUG:teuthology.orchestra.run.smithi050:> for f in files: 2024-06-06T03:23:14.119 DEBUG:teuthology.orchestra.run.smithi050:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-06T03:23:14.119 DEBUG:teuthology.orchestra.run.smithi050:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-06T03:23:14.119 DEBUG:teuthology.orchestra.run.smithi050:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-06T03:23:14.119 DEBUG:teuthology.orchestra.run.smithi050:> contents = proc_f.read() 2024-06-06T03:23:14.119 DEBUG:teuthology.orchestra.run.smithi050:> if mountpoint in contents: 2024-06-06T03:23:14.119 DEBUG:teuthology.orchestra.run.smithi050:> return f 2024-06-06T03:23:14.119 DEBUG:teuthology.orchestra.run.smithi050:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-06T03:23:14.119 DEBUG:teuthology.orchestra.run.smithi050:> 2024-06-06T03:23:14.119 DEBUG:teuthology.orchestra.run.smithi050:> print(_find_admin_socket("client.admin")) 2024-06-06T03:23:14.119 DEBUG:teuthology.orchestra.run.smithi050:> ' 2024-06-06T03:23:14.239 INFO:teuthology.orchestra.run.smithi050.stdout:/var/run/ceph/ceph-client.admin.78148.asok 2024-06-06T03:23:14.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-06T03:23:14.250 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.78148.asok 2024-06-06T03:23:14.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T03:23:14.250 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.78148.asok status 2024-06-06T03:23:14.391 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:23:14.392 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": { 2024-06-06T03:23:14.392 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-06T03:23:14.392 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-06T03:23:14.392 INFO:teuthology.orchestra.run.smithi050.stdout: "entity_id": "admin", 2024-06-06T03:23:14.392 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": "smithi050", 2024-06-06T03:23:14.392 INFO:teuthology.orchestra.run.smithi050.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-06-06T03:23:14.392 INFO:teuthology.orchestra.run.smithi050.stdout: "pid": "78148", 2024-06-06T03:23:14.392 INFO:teuthology.orchestra.run.smithi050.stdout: "root": "/" 2024-06-06T03:23:14.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:23:14.392 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_count": 0, 2024-06-06T03:23:14.392 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_pinned_count": 0, 2024-06-06T03:23:14.392 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 14733, 2024-06-06T03:23:14.392 INFO:teuthology.orchestra.run.smithi050.stdout: "inst": { 2024-06-06T03:23:14.393 INFO:teuthology.orchestra.run.smithi050.stdout: "name": { 2024-06-06T03:23:14.393 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "client", 2024-06-06T03:23:14.393 INFO:teuthology.orchestra.run.smithi050.stdout: "num": 14733 2024-06-06T03:23:14.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:23:14.393 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2024-06-06T03:23:14.393 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-06-06T03:23:14.393 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2024-06-06T03:23:14.393 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 252767609 2024-06-06T03:23:14.393 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:23:14.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:23:14.393 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2024-06-06T03:23:14.393 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-06-06T03:23:14.393 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2024-06-06T03:23:14.393 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 252767609 2024-06-06T03:23:14.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:23:14.394 INFO:teuthology.orchestra.run.smithi050.stdout: "inst_str": "client.14733 192.168.0.1:0/252767609", 2024-06-06T03:23:14.394 INFO:teuthology.orchestra.run.smithi050.stdout: "addr_str": "192.168.0.1:0/252767609", 2024-06-06T03:23:14.394 INFO:teuthology.orchestra.run.smithi050.stdout: "inode_count": 1, 2024-06-06T03:23:14.394 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_epoch": 17, 2024-06-06T03:23:14.394 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch": 96, 2024-06-06T03:23:14.394 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch_barrier": 0, 2024-06-06T03:23:14.394 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklisted": false, 2024-06-06T03:23:14.394 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs" 2024-06-06T03:23:14.394 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:23:14.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T03:23:14.400 DEBUG:teuthology.orchestra.run.smithi050:> stat --file-system '--printf=%T 2024-06-06T03:23:14.400 DEBUG:teuthology.orchestra.run.smithi050:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-06-06T03:23:14.417 INFO:teuthology.orchestra.run.smithi050.stdout:fuseblk 2024-06-06T03:23:14.417 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-06-06T03:23:14.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T03:23:14.417 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-06-06T03:23:14.483 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-06-06T03:23:14.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-06T03:23:14.594 INFO:teuthology.orchestra.run.smithi050.stdout:# file: . 2024-06-06T03:23:14.668 INFO:teuthology.orchestra.run.smithi050.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-06-06T03:23:14.668 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:23:14.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-06T03:23:14.670 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-06-06T03:23:14.670 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-06T03:23:14.688 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd blocklist ls 2024-06-06T03:23:14.750 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:14 smithi050 ceph-mon[32421]: pgmap v325: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:23:14.750 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-06-06T03:23:14.750 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-06-06T03:23:14.750 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-06-06T03:23:14.750 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-06-06T03:23:14.750 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2024-06-06T03:23:14.750 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-06-06T03:23:14.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-06-06T03:23:14.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]': finished 2024-06-06T03:23:14.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2024-06-06T03:23:14.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-06-06T03:23:14.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:14 smithi050 ceph-mon[32421]: osdmap e96: 12 total, 12 up, 12 in 2024-06-06T03:23:14.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:14 smithi079 ceph-mon[35478]: pgmap v325: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:23:14.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-06-06T03:23:14.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-06-06T03:23:14.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-06-06T03:23:14.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-06-06T03:23:14.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2024-06-06T03:23:14.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-06-06T03:23:14.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-06-06T03:23:14.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]': finished 2024-06-06T03:23:14.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2024-06-06T03:23:14.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-06-06T03:23:14.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:14 smithi079 ceph-mon[35478]: osdmap e96: 12 total, 12 up, 12 in 2024-06-06T03:23:14.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:14 smithi122 ceph-mon[35759]: pgmap v325: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T03:23:14.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-06-06T03:23:14.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-06-06T03:23:14.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-06-06T03:23:14.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-06-06T03:23:14.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2024-06-06T03:23:14.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-06-06T03:23:14.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-06-06T03:23:14.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]': finished 2024-06-06T03:23:14.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2024-06-06T03:23:14.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-06-06T03:23:14.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:14 smithi122 ceph-mon[35759]: osdmap e96: 12 total, 12 up, 12 in 2024-06-06T03:23:14.978 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:23:15.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:15 smithi050 ceph-mon[32421]: osdmap e97: 12 total, 12 up, 12 in 2024-06-06T03:23:15.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:15 smithi079 ceph-mon[35478]: osdmap e97: 12 total, 12 up, 12 in 2024-06-06T03:23:15.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:15 smithi122 ceph-mon[35759]: osdmap e97: 12 total, 12 up, 12 in 2024-06-06T03:23:16.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.654+0000 7ff53b262700 1 -- 172.21.15.50:0/1530315129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff534108570 msgr2=0x7ff534108950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:16.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.654+0000 7ff53b262700 1 --2- 172.21.15.50:0/1530315129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff534108570 0x7ff534108950 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff524009990 tx=0x7ff524009ca0 comp rx=0 tx=0).stop 2024-06-06T03:23:16.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.654+0000 7ff53b262700 1 -- 172.21.15.50:0/1530315129 shutdown_connections 2024-06-06T03:23:16.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.654+0000 7ff53b262700 1 --2- 172.21.15.50:0/1530315129 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff53406b560 0x7ff53410f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:16.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.654+0000 7ff53b262700 1 --2- 172.21.15.50:0/1530315129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff534108570 0x7ff534108950 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:16.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.654+0000 7ff53b262700 1 --2- 172.21.15.50:0/1530315129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff53406aba0 0x7ff53406b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:16.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.654+0000 7ff53b262700 1 -- 172.21.15.50:0/1530315129 >> 172.21.15.50:0/1530315129 conn(0x7ff5340773e0 msgr2=0x7ff5340777f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:16.655 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:16 smithi050 ceph-mon[32421]: pgmap v328: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-06-06T03:23:16.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.654+0000 7ff53b262700 1 -- 172.21.15.50:0/1530315129 shutdown_connections 2024-06-06T03:23:16.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.654+0000 7ff53b262700 1 -- 172.21.15.50:0/1530315129 wait complete. 2024-06-06T03:23:16.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.655+0000 7ff53b262700 1 Processor -- start 2024-06-06T03:23:16.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.655+0000 7ff53b262700 1 -- start start 2024-06-06T03:23:16.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.655+0000 7ff53b262700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff53406aba0 0x7ff5341014f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:16.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.655+0000 7ff53b262700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff53406b560 0x7ff534101a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:16.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.655+0000 7ff53b262700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff534108570 0x7ff534101f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:16.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.655+0000 7ff53b262700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff534112670 con 0x7ff53406aba0 2024-06-06T03:23:16.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.655+0000 7ff53b262700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff5341124f0 con 0x7ff534108570 2024-06-06T03:23:16.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.655+0000 7ff53b262700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff5341127f0 con 0x7ff53406b560 2024-06-06T03:23:16.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.655+0000 7ff538ffe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff53406aba0 0x7ff5341014f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:16.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.656+0000 7ff538ffe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff53406aba0 0x7ff5341014f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58670/0 (socket says 172.21.15.50:58670) 2024-06-06T03:23:16.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.656+0000 7ff538ffe700 1 -- 172.21.15.50:0/3284585542 learned_addr learned my addr 172.21.15.50:0/3284585542 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:23:16.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.656+0000 7ff5397ff700 1 --2- 172.21.15.50:0/3284585542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff534108570 0x7ff534101f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:16.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.656+0000 7ff533fff700 1 --2- 172.21.15.50:0/3284585542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff53406b560 0x7ff534101a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:16.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.656+0000 7ff538ffe700 1 -- 172.21.15.50:0/3284585542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff53406b560 msgr2=0x7ff534101a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:16.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.656+0000 7ff538ffe700 1 --2- 172.21.15.50:0/3284585542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff53406b560 0x7ff534101a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:16.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.656+0000 7ff538ffe700 1 -- 172.21.15.50:0/3284585542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff534108570 msgr2=0x7ff534101f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:16.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.656+0000 7ff538ffe700 1 --2- 172.21.15.50:0/3284585542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff534108570 0x7ff534101f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:16.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.656+0000 7ff538ffe700 1 -- 172.21.15.50:0/3284585542 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5341a6f90 con 0x7ff53406aba0 2024-06-06T03:23:16.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.656+0000 7ff538ffe700 1 --2- 172.21.15.50:0/3284585542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff53406aba0 0x7ff5341014f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff524000c00 tx=0x7ff524003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:16.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.656+0000 7ff531ffb700 1 -- 172.21.15.50:0/3284585542 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff524027070 con 0x7ff53406aba0 2024-06-06T03:23:16.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.656+0000 7ff53b262700 1 -- 172.21.15.50:0/3284585542 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5341a7220 con 0x7ff53406aba0 2024-06-06T03:23:16.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.656+0000 7ff531ffb700 1 -- 172.21.15.50:0/3284585542 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff52400bdc0 con 0x7ff53406aba0 2024-06-06T03:23:16.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.656+0000 7ff531ffb700 1 -- 172.21.15.50:0/3284585542 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff524022cd0 con 0x7ff53406aba0 2024-06-06T03:23:16.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.657+0000 7ff53b262700 1 -- 172.21.15.50:0/3284585542 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5341a7670 con 0x7ff53406aba0 2024-06-06T03:23:16.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.658+0000 7ff53b262700 1 -- 172.21.15.50:0/3284585542 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff53410aa20 con 0x7ff53406aba0 2024-06-06T03:23:16.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.659+0000 7ff531ffb700 1 -- 172.21.15.50:0/3284585542 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff52402a070 con 0x7ff53406aba0 2024-06-06T03:23:16.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.660+0000 7ff531ffb700 1 --2- 172.21.15.50:0/3284585542 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff5200a2c20 0x7ff5200a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:16.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.660+0000 7ff531ffb700 1 -- 172.21.15.50:0/3284585542 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7ff5240d0420 con 0x7ff53406aba0 2024-06-06T03:23:16.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.660+0000 7ff533fff700 1 --2- 172.21.15.50:0/3284585542 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff5200a2c20 0x7ff5200a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:16.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.660+0000 7ff533fff700 1 --2- 172.21.15.50:0/3284585542 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff5200a2c20 0x7ff5200a50e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff534077900 tx=0x7ff51c0079e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:16.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.663+0000 7ff531ffb700 1 -- 172.21.15.50:0/3284585542 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff524013070 con 0x7ff53406aba0 2024-06-06T03:23:16.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:16 smithi079 ceph-mon[35478]: pgmap v328: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-06-06T03:23:16.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.886+0000 7ff53b262700 1 -- 172.21.15.50:0/3284585542 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff53410a400 con 0x7ff53406aba0 2024-06-06T03:23:16.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.886+0000 7ff531ffb700 1 -- 172.21.15.50:0/3284585542 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v97) ==== 81+0+591 (secure 0 0 0) 0x7ff52409d0b0 con 0x7ff53406aba0 2024-06-06T03:23:16.885 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6800/1311987652 2024-06-07T03:15:13.252241+0000 2024-06-06T03:23:16.885 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/1149897118 2024-06-07T03:15:13.252241+0000 2024-06-06T03:23:16.885 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6800/2617801068 2024-06-07T03:14:46.388744+0000 2024-06-06T03:23:16.885 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/1068038293 2024-06-07T03:14:46.388744+0000 2024-06-06T03:23:16.886 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/4038080419 2024-06-07T03:15:13.252241+0000 2024-06-06T03:23:16.886 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/149912088 2024-06-07T03:14:46.388744+0000 2024-06-06T03:23:16.886 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6801/2617801068 2024-06-07T03:14:46.388744+0000 2024-06-06T03:23:16.886 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/2963887224 2024-06-07T03:14:46.388744+0000 2024-06-06T03:23:16.886 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6801/1311987652 2024-06-07T03:15:13.252241+0000 2024-06-06T03:23:16.886 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/2554563139 2024-06-07T03:15:13.252241+0000 2024-06-06T03:23:16.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.889+0000 7ff53b262700 1 -- 172.21.15.50:0/3284585542 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff5200a2c20 msgr2=0x7ff5200a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:16.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.889+0000 7ff53b262700 1 --2- 172.21.15.50:0/3284585542 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff5200a2c20 0x7ff5200a50e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff534077900 tx=0x7ff51c0079e0 comp rx=0 tx=0).stop 2024-06-06T03:23:16.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.889+0000 7ff53b262700 1 -- 172.21.15.50:0/3284585542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff53406aba0 msgr2=0x7ff5341014f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:16.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.889+0000 7ff53b262700 1 --2- 172.21.15.50:0/3284585542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff53406aba0 0x7ff5341014f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff524000c00 tx=0x7ff524003a80 comp rx=0 tx=0).stop 2024-06-06T03:23:16.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.889+0000 7ff53b262700 1 -- 172.21.15.50:0/3284585542 shutdown_connections 2024-06-06T03:23:16.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.889+0000 7ff53b262700 1 --2- 172.21.15.50:0/3284585542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff534108570 0x7ff534101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:16.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.889+0000 7ff53b262700 1 --2- 172.21.15.50:0/3284585542 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff5200a2c20 0x7ff5200a50e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:16.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.889+0000 7ff53b262700 1 --2- 172.21.15.50:0/3284585542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff53406aba0 0x7ff5341014f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:16.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.889+0000 7ff53b262700 1 --2- 172.21.15.50:0/3284585542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff53406b560 0x7ff534101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:16.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.889+0000 7ff53b262700 1 -- 172.21.15.50:0/3284585542 >> 172.21.15.50:0/3284585542 conn(0x7ff5340773e0 msgr2=0x7ff5340ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:16.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.889+0000 7ff53b262700 1 -- 172.21.15.50:0/3284585542 shutdown_connections 2024-06-06T03:23:16.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:16.889+0000 7ff53b262700 1 -- 172.21.15.50:0/3284585542 wait complete. 2024-06-06T03:23:16.889 INFO:teuthology.orchestra.run.smithi050.stderr:listed 10 entries 2024-06-06T03:23:16.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:16 smithi122 ceph-mon[35759]: pgmap v328: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-06-06T03:23:17.635 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-06-06T03:23:17.635 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-06T03:23:17.694 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd blocklist ls 2024-06-06T03:23:17.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:17 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/3284585542' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-06T03:23:17.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:17 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/3284585542' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-06T03:23:17.986 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:23:18.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:17 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3284585542' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-06T03:23:18.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:18 smithi050 ceph-mon[32421]: pgmap v329: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-06-06T03:23:18.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:18 smithi079 ceph-mon[35478]: pgmap v329: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-06-06T03:23:18.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:18 smithi122 ceph-mon[35759]: pgmap v329: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-06-06T03:23:19.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.651+0000 7fc600d36700 1 -- 172.21.15.50:0/1617848154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5fc06abc0 msgr2=0x7fc5fc06b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:19.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.651+0000 7fc600d36700 1 --2- 172.21.15.50:0/1617848154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5fc06abc0 0x7fc5fc06b040 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4009990 tx=0x7fc5e4009ca0 comp rx=0 tx=0).stop 2024-06-06T03:23:19.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.651+0000 7fc600d36700 1 -- 172.21.15.50:0/1617848154 shutdown_connections 2024-06-06T03:23:19.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.651+0000 7fc600d36700 1 --2- 172.21.15.50:0/1617848154 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5fc06b580 0x7fc5fc10f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:19.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.651+0000 7fc600d36700 1 --2- 172.21.15.50:0/1617848154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5fc108500 0x7fc5fc1088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:19.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.651+0000 7fc600d36700 1 --2- 172.21.15.50:0/1617848154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5fc06abc0 0x7fc5fc06b040 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:19.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.651+0000 7fc600d36700 1 -- 172.21.15.50:0/1617848154 >> 172.21.15.50:0/1617848154 conn(0x7fc5fc078340 msgr2=0x7fc5fc078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:19.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.651+0000 7fc600d36700 1 -- 172.21.15.50:0/1617848154 shutdown_connections 2024-06-06T03:23:19.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.651+0000 7fc600d36700 1 -- 172.21.15.50:0/1617848154 wait complete. 2024-06-06T03:23:19.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.652+0000 7fc600d36700 1 Processor -- start 2024-06-06T03:23:19.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.652+0000 7fc600d36700 1 -- start start 2024-06-06T03:23:19.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.652+0000 7fc600d36700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5fc06abc0 0x7fc5fc101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:19.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.652+0000 7fc600d36700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5fc06b580 0x7fc5fc1019d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:19.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.652+0000 7fc600d36700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5fc108500 0x7fc5fc101f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:19.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.652+0000 7fc600d36700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc5fc112610 con 0x7fc5fc108500 2024-06-06T03:23:19.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.652+0000 7fc600d36700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc5fc112490 con 0x7fc5fc06abc0 2024-06-06T03:23:19.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.652+0000 7fc600d36700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc5fc112790 con 0x7fc5fc06b580 2024-06-06T03:23:19.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.652+0000 7fc5fad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5fc108500 0x7fc5fc101f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:19.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.652+0000 7fc5fad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5fc108500 0x7fc5fc101f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60078/0 (socket says 172.21.15.50:60078) 2024-06-06T03:23:19.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.652+0000 7fc5fad9d700 1 -- 172.21.15.50:0/2383183978 learned_addr learned my addr 172.21.15.50:0/2383183978 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:23:19.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.652+0000 7fc5fa59c700 1 --2- 172.21.15.50:0/2383183978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5fc06abc0 0x7fc5fc101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:19.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.652+0000 7fc5f9d9b700 1 --2- 172.21.15.50:0/2383183978 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5fc06b580 0x7fc5fc1019d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:19.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.653+0000 7fc5fad9d700 1 -- 172.21.15.50:0/2383183978 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5fc06b580 msgr2=0x7fc5fc1019d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:19.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.653+0000 7fc5fad9d700 1 --2- 172.21.15.50:0/2383183978 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5fc06b580 0x7fc5fc1019d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:19.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.653+0000 7fc5fad9d700 1 -- 172.21.15.50:0/2383183978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5fc06abc0 msgr2=0x7fc5fc101490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:19.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.653+0000 7fc5fad9d700 1 --2- 172.21.15.50:0/2383183978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5fc06abc0 0x7fc5fc101490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:19.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.653+0000 7fc5fad9d700 1 -- 172.21.15.50:0/2383183978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5fc1a6f90 con 0x7fc5fc108500 2024-06-06T03:23:19.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.653+0000 7fc5f9d9b700 1 --2- 172.21.15.50:0/2383183978 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5fc06b580 0x7fc5fc1019d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:23:19.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.653+0000 7fc5fad9d700 1 --2- 172.21.15.50:0/2383183978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5fc108500 0x7fc5fc101f10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4007d70 tx=0x7fc5f400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:19.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.653+0000 7fc5f37fe700 1 -- 172.21.15.50:0/2383183978 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f4016020 con 0x7fc5fc108500 2024-06-06T03:23:19.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.653+0000 7fc600d36700 1 -- 172.21.15.50:0/2383183978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5fc1a7280 con 0x7fc5fc108500 2024-06-06T03:23:19.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.653+0000 7fc5f37fe700 1 -- 172.21.15.50:0/2383183978 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc5f400ad40 con 0x7fc5fc108500 2024-06-06T03:23:19.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.653+0000 7fc5f37fe700 1 -- 172.21.15.50:0/2383183978 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f40115e0 con 0x7fc5fc108500 2024-06-06T03:23:19.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.653+0000 7fc600d36700 1 -- 172.21.15.50:0/2383183978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5fc1a77c0 con 0x7fc5fc108500 2024-06-06T03:23:19.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.654+0000 7fc600d36700 1 -- 172.21.15.50:0/2383183978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5fc069180 con 0x7fc5fc108500 2024-06-06T03:23:19.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.655+0000 7fc5f37fe700 1 -- 172.21.15.50:0/2383183978 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc5f4019020 con 0x7fc5fc108500 2024-06-06T03:23:19.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.656+0000 7fc5f37fe700 1 --2- 172.21.15.50:0/2383183978 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc5e80a2ca0 0x7fc5e80a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:19.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.656+0000 7fc5fa59c700 1 --2- 172.21.15.50:0/2383183978 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc5e80a2ca0 0x7fc5e80a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:19.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.657+0000 7fc5f37fe700 1 -- 172.21.15.50:0/2383183978 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7fc5f40cf8b0 con 0x7fc5fc108500 2024-06-06T03:23:19.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.657+0000 7fc5fa59c700 1 --2- 172.21.15.50:0/2383183978 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc5e80a2ca0 0x7fc5e80a5160 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec00abd0 tx=0x7fc5ec00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:19.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.660+0000 7fc5f37fe700 1 -- 172.21.15.50:0/2383183978 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc5f4020020 con 0x7fc5fc108500 2024-06-06T03:23:19.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.881+0000 7fc600d36700 1 -- 172.21.15.50:0/2383183978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc5fc02dca0 con 0x7fc5fc108500 2024-06-06T03:23:19.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.881+0000 7fc5f37fe700 1 -- 172.21.15.50:0/2383183978 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v97) ==== 81+0+591 (secure 0 0 0) 0x7fc5f409c450 con 0x7fc5fc108500 2024-06-06T03:23:19.880 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6800/1311987652 2024-06-07T03:15:13.252241+0000 2024-06-06T03:23:19.880 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/1149897118 2024-06-07T03:15:13.252241+0000 2024-06-06T03:23:19.881 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6800/2617801068 2024-06-07T03:14:46.388744+0000 2024-06-06T03:23:19.881 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/1068038293 2024-06-07T03:14:46.388744+0000 2024-06-06T03:23:19.881 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/4038080419 2024-06-07T03:15:13.252241+0000 2024-06-06T03:23:19.881 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/149912088 2024-06-07T03:14:46.388744+0000 2024-06-06T03:23:19.881 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6801/2617801068 2024-06-07T03:14:46.388744+0000 2024-06-06T03:23:19.881 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/2963887224 2024-06-07T03:14:46.388744+0000 2024-06-06T03:23:19.881 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6801/1311987652 2024-06-07T03:15:13.252241+0000 2024-06-06T03:23:19.881 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/2554563139 2024-06-07T03:15:13.252241+0000 2024-06-06T03:23:19.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.883+0000 7fc600d36700 1 -- 172.21.15.50:0/2383183978 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc5e80a2ca0 msgr2=0x7fc5e80a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:19.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.883+0000 7fc600d36700 1 --2- 172.21.15.50:0/2383183978 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc5e80a2ca0 0x7fc5e80a5160 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec00abd0 tx=0x7fc5ec00a380 comp rx=0 tx=0).stop 2024-06-06T03:23:19.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.883+0000 7fc600d36700 1 -- 172.21.15.50:0/2383183978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5fc108500 msgr2=0x7fc5fc101f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:19.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.883+0000 7fc600d36700 1 --2- 172.21.15.50:0/2383183978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5fc108500 0x7fc5fc101f10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4007d70 tx=0x7fc5f400a340 comp rx=0 tx=0).stop 2024-06-06T03:23:19.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.884+0000 7fc600d36700 1 -- 172.21.15.50:0/2383183978 shutdown_connections 2024-06-06T03:23:19.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.884+0000 7fc600d36700 1 --2- 172.21.15.50:0/2383183978 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc5e80a2ca0 0x7fc5e80a5160 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:19.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.884+0000 7fc600d36700 1 --2- 172.21.15.50:0/2383183978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5fc108500 0x7fc5fc101f10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:19.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.884+0000 7fc600d36700 1 --2- 172.21.15.50:0/2383183978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5fc06abc0 0x7fc5fc101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:19.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.884+0000 7fc600d36700 1 --2- 172.21.15.50:0/2383183978 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5fc06b580 0x7fc5fc1019d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:19.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.884+0000 7fc600d36700 1 -- 172.21.15.50:0/2383183978 >> 172.21.15.50:0/2383183978 conn(0x7fc5fc078340 msgr2=0x7fc5fc100050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:19.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.884+0000 7fc600d36700 1 -- 172.21.15.50:0/2383183978 shutdown_connections 2024-06-06T03:23:19.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:19.884+0000 7fc600d36700 1 -- 172.21.15.50:0/2383183978 wait complete. 2024-06-06T03:23:19.884 INFO:teuthology.orchestra.run.smithi050.stderr:listed 10 entries 2024-06-06T03:23:20.590 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi050.front.sepia.ceph.com... 2024-06-06T03:23:20.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T03:23:20.591 DEBUG:teuthology.orchestra.run.smithi050:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-06-06T03:23:20.619 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:ceph-fuse[78148]: fuse finished with error 0 and tester_r 0 2024-06-06T03:23:20.621 INFO:teuthology.orchestra.run:waiting for 300 2024-06-06T03:23:20.686 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-06-06T03:23:20.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T03:23:20.686 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-06-06T03:23:20.708 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-06T03:23:20.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:20 smithi079 ceph-mon[35478]: pgmap v330: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-06-06T03:23:20.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:20 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/2383183978' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-06T03:23:20.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:20 smithi122 ceph-mon[35759]: pgmap v330: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-06-06T03:23:20.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:20 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/2383183978' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-06T03:23:20.999 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:23:21.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:20 smithi050 ceph-mon[32421]: pgmap v330: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-06-06T03:23:21.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:20 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/2383183978' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-06T03:23:22.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.579+0000 7f81b2fed700 1 -- 172.21.15.50:0/3854436132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81ac06a170 msgr2=0x7f81ac06a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:22.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.579+0000 7f81b2fed700 1 --2- 172.21.15.50:0/3854436132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81ac06a170 0x7f81ac06a5f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8198009990 tx=0x7f8198009ca0 comp rx=0 tx=0).stop 2024-06-06T03:23:22.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.579+0000 7f81b2fed700 1 -- 172.21.15.50:0/3854436132 shutdown_connections 2024-06-06T03:23:22.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.579+0000 7f81b2fed700 1 --2- 172.21.15.50:0/3854436132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81ac06ab30 0x7f81ac10f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:22.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.579+0000 7f81b2fed700 1 --2- 172.21.15.50:0/3854436132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81ac108500 0x7f81ac1088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:22.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.579+0000 7f81b2fed700 1 --2- 172.21.15.50:0/3854436132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81ac06a170 0x7f81ac06a5f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:22.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.579+0000 7f81b2fed700 1 -- 172.21.15.50:0/3854436132 >> 172.21.15.50:0/3854436132 conn(0x7f81ac078340 msgr2=0x7f81ac078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:22.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.579+0000 7f81b2fed700 1 -- 172.21.15.50:0/3854436132 shutdown_connections 2024-06-06T03:23:22.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.579+0000 7f81b2fed700 1 -- 172.21.15.50:0/3854436132 wait complete. 2024-06-06T03:23:22.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.580+0000 7f81b2fed700 1 Processor -- start 2024-06-06T03:23:22.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.580+0000 7f81b2fed700 1 -- start start 2024-06-06T03:23:22.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.580+0000 7f81b2fed700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81ac06a170 0x7f81ac101460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:22.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.580+0000 7f81b2fed700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81ac06ab30 0x7f81ac1019a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:22.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.580+0000 7f81b2fed700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81ac108500 0x7f81ac101ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:22.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.580+0000 7f81b2fed700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f81ac112680 con 0x7f81ac06a170 2024-06-06T03:23:22.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.580+0000 7f81b2fed700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f81ac112500 con 0x7f81ac108500 2024-06-06T03:23:22.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.580+0000 7f81b2fed700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f81ac112800 con 0x7f81ac06ab30 2024-06-06T03:23:22.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.580+0000 7f81b0d89700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81ac06a170 0x7f81ac101460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:22.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.580+0000 7f81b0d89700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81ac06a170 0x7f81ac101460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60096/0 (socket says 172.21.15.50:60096) 2024-06-06T03:23:22.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.580+0000 7f81b0d89700 1 -- 172.21.15.50:0/141643279 learned_addr learned my addr 172.21.15.50:0/141643279 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:23:22.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.580+0000 7f81abfff700 1 --2- 172.21.15.50:0/141643279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81ac06ab30 0x7f81ac1019a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:22.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.580+0000 7f81b0d89700 1 -- 172.21.15.50:0/141643279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81ac06ab30 msgr2=0x7f81ac1019a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.580+0000 7f81b0d89700 1 --2- 172.21.15.50:0/141643279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81ac06ab30 0x7f81ac1019a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.580+0000 7f81b0d89700 1 -- 172.21.15.50:0/141643279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81ac108500 msgr2=0x7f81ac101ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.580+0000 7f81b158a700 1 --2- 172.21.15.50:0/141643279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81ac108500 0x7f81ac101ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.580+0000 7f81b0d89700 1 --2- 172.21.15.50:0/141643279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81ac108500 0x7f81ac101ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.580+0000 7f81b0d89700 1 -- 172.21.15.50:0/141643279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81ac1a7090 con 0x7f81ac06a170 2024-06-06T03:23:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.580+0000 7f81b158a700 1 --2- 172.21.15.50:0/141643279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81ac108500 0x7f81ac101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:23:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.581+0000 7f81b0d89700 1 --2- 172.21.15.50:0/141643279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81ac06a170 0x7f81ac101460 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f81a000d980 tx=0x7f81a000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.581+0000 7f81a9ffb700 1 -- 172.21.15.50:0/141643279 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a0017070 con 0x7f81ac06a170 2024-06-06T03:23:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.581+0000 7f81a9ffb700 1 -- 172.21.15.50:0/141643279 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f81a0004830 con 0x7f81ac06a170 2024-06-06T03:23:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.581+0000 7f81b2fed700 1 -- 172.21.15.50:0/141643279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81ac1a7380 con 0x7f81ac06a170 2024-06-06T03:23:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.581+0000 7f81a9ffb700 1 -- 172.21.15.50:0/141643279 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a0005440 con 0x7f81ac06a170 2024-06-06T03:23:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.581+0000 7f81b2fed700 1 -- 172.21.15.50:0/141643279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81ac1a7870 con 0x7f81ac06a170 2024-06-06T03:23:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.582+0000 7f81b2fed700 1 -- 172.21.15.50:0/141643279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81ac10a9e0 con 0x7f81ac06a170 2024-06-06T03:23:22.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.583+0000 7f81a9ffb700 1 -- 172.21.15.50:0/141643279 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f81a00055e0 con 0x7f81ac06a170 2024-06-06T03:23:22.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.584+0000 7f81a9ffb700 1 --2- 172.21.15.50:0/141643279 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f819c0a2c20 0x7f819c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:22.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.584+0000 7f81abfff700 1 --2- 172.21.15.50:0/141643279 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f819c0a2c20 0x7f819c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:22.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.584+0000 7f81a9ffb700 1 -- 172.21.15.50:0/141643279 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7f81a00cf320 con 0x7f81ac06a170 2024-06-06T03:23:22.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.584+0000 7f81abfff700 1 --2- 172.21.15.50:0/141643279 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f819c0a2c20 0x7f819c0a50e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f819800b5c0 tx=0x7f819801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:22.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.588+0000 7f81a9ffb700 1 -- 172.21.15.50:0/141643279 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f81a0020020 con 0x7f81ac06a170 2024-06-06T03:23:22.587 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:22 smithi050 ceph-mon[32421]: pgmap v331: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-06-06T03:23:22.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.795+0000 7f81b2fed700 1 -- 172.21.15.50:0/141643279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f81ac10a3c0 con 0x7f81ac06a170 2024-06-06T03:23:22.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.797+0000 7f81a9ffb700 1 -- 172.21.15.50:0/141643279 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+24607 (secure 0 0 0) 0x7f81a009bec0 con 0x7f81ac06a170 2024-06-06T03:23:22.796 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:23:22.797 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":97,"fsid":"b6263b26-23b2-11ef-bc9b-c7b262605968","created":"2024-06-06T03:14:19.062632+0000","modified":"2024-06-06T03:23:14.506132+0000","last_up_change":"2024-06-06T03:21:30.287918+0000","last_in_change":"2024-06-06T03:21:09.550417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T03:17:37.777608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T03:22:29.496859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T03:22:33.221878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-06T03:22:42.829873+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"eed8040f-a7b7-4d3b-8345-2022918097d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6803","nonce":2379528827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6805","nonce":2379528827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6809","nonce":2379528827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6807","nonce":2379528827}]},"public_addr":"172.21.15.50:6803/2379528827","cluster_addr":"172.21.15.50:6805/2379528827","heartbeat_back_addr":"172.21.15.50:6809/2379528827","heartbeat_front_addr":"172.21.15.50:6807/2379528827","state":["exists","up"]},{"osd":1,"uuid":"089ecb78-5e1e-4cdb-8fe0-5c1731ec9dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6801","nonce":3498354151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6803","nonce":3498354151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6807","nonce":3498354151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6805","nonce":3498354151}]},"public_addr":"172.21.15.79:6801/3498354151","cluster_addr":"172.21.15.79:6803/3498354151","heartbeat_back_addr":"172.21.15.79:6807/3498354151","heartbeat_front_addr":"172.21.15.79:6805/3498354151","state":["exists","up"]},{"osd":2,"uuid":"90599e3b-bf86-4a56-b03b-b051528a5b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6801","nonce":566397008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6803","nonce":566397008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6807","nonce":566397008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6805","nonce":566397008}]},"public_addr":"172.21.15.122:6801/566397008","cluster_addr":"172.21.15.122:6803/566397008","heartbeat_back_addr":"172.21.15.122:6807/566397008","heartbeat_front_addr":"172.21.15.122:6805/566397008","state":["exists","up"]},{"osd":3,"uuid":"fd295e6c-64cd-4164-83dc-4d32c2ae103a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6811","nonce":820123083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6813","nonce":820123083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6817","nonce":820123083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6815","nonce":820123083}]},"public_addr":"172.21.15.50:6811/820123083","cluster_addr":"172.21.15.50:6813/820123083","heartbeat_back_addr":"172.21.15.50:6817/820123083","heartbeat_front_addr":"172.21.15.50:6815/820123083","state":["exists","up"]},{"osd":4,"uuid":"4c854d90-5353-4f7c-b2f3-2af6216d799b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6809","nonce":1784117997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6811","nonce":1784117997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6815","nonce":1784117997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6813","nonce":1784117997}]},"public_addr":"172.21.15.79:6809/1784117997","cluster_addr":"172.21.15.79:6811/1784117997","heartbeat_back_addr":"172.21.15.79:6815/1784117997","heartbeat_front_addr":"172.21.15.79:6813/1784117997","state":["exists","up"]},{"osd":5,"uuid":"80041e10-a643-4338-b621-f882c7bc48b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6809","nonce":2755878218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6811","nonce":2755878218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6815","nonce":2755878218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6813","nonce":2755878218}]},"public_addr":"172.21.15.122:6809/2755878218","cluster_addr":"172.21.15.122:6811/2755878218","heartbeat_back_addr":"172.21.15.122:6815/2755878218","heartbeat_front_addr":"172.21.15.122:6813/2755878218","state":["exists","up"]},{"osd":6,"uuid":"9e15c6c3-bb4b-4c2b-bb7e-4653b10874d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6819","nonce":474595612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6821","nonce":474595612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6825","nonce":474595612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6823","nonce":474595612}]},"public_addr":"172.21.15.50:6819/474595612","cluster_addr":"172.21.15.50:6821/474595612","heartbeat_back_addr":"172.21.15.50:6825/474595612","heartbeat_front_addr":"172.21.15.50:6823/474595612","state":["exists","up"]},{"osd":7,"uuid":"62585bba-c540-4498-8768-b84183e19abd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6817","nonce":3504864579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6819","nonce":3504864579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6823","nonce":3504864579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6821","nonce":3504864579}]},"public_addr":"172.21.15.79:6817/3504864579","cluster_addr":"172.21.15.79:6819/3504864579","heartbeat_back_addr":"172.21.15.79:6823/3504864579","heartbeat_front_addr":"172.21.15.79:6821/3504864579","state":["exists","up"]},{"osd":8,"uuid":"7a272157-460a-4d4a-a63e-30436022ac7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6817","nonce":3484833116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6819","nonce":3484833116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6823","nonce":3484833116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6821","nonce":3484833116}]},"public_addr":"172.21.15.122:6817/3484833116","cluster_addr":"172.21.15.122:6819/3484833116","heartbeat_back_addr":"172.21.15.122:6823/3484833116","heartbeat_front_addr":"172.21.15.122:6821/3484833116","state":["exists","up"]},{"osd":9,"uuid":"7e768ff7-f78d-4a12-b863-4b692e0f4a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6827","nonce":2600273670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6829","nonce":2600273670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6833","nonce":2600273670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6831","nonce":2600273670}]},"public_addr":"172.21.15.50:6827/2600273670","cluster_addr":"172.21.15.50:6829/2600273670","heartbeat_back_addr":"172.21.15.50:6833/2600273670","heartbeat_front_addr":"172.21.15.50:6831/2600273670","state":["exists","up"]},{"osd":10,"uuid":"a42df29a-d88d-4401-878d-6c8f75f3f604","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6825","nonce":2740366543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6827","nonce":2740366543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6831","nonce":2740366543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6829","nonce":2740366543}]},"public_addr":"172.21.15.79:6825/2740366543","cluster_addr":"172.21.15.79:6827/2740366543","heartbeat_back_addr":"172.21.15.79:6831/2740366543","heartbeat_front_addr":"172.21.15.79:6829/2740366543","state":["exists","up"]},{"osd":11,"uuid":"35bcde30-49e4-49b9-a348-98d21a0d3cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6825","nonce":4160854238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6827","nonce":4160854238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6831","nonce":4160854238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6829","nonce":4160854238}]},"public_addr":"172.21.15.122:6825/4160854238","cluster_addr":"172.21.15.122:6827/4160854238","heartbeat_back_addr":"172.21.15.122:6831/4160854238","heartbeat_front_addr":"172.21.15.122:6829/4160854238","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:16:46.989554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:17:11.269759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:17:35.105846+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:00.940943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:26.284520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:51.064143+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:19:16.254750+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:19:42.841380+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:20:08.185133+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:20:34.700082+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:21:01.485278+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:21:27.938715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1311987652":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/1149897118":"2024-06-07T03:15:13.252241+0000","172.21.15.50:6800/2617801068":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/1068038293":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/4038080419":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/149912088":"2024-06-07T03:14:46.388744+0000","172.21.15.50:6801/2617801068":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/2963887224":"2024-06-07T03:14:46.388744+0000","172.21.15.50:6801/1311987652":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/2554563139":"2024-06-07T03:15:13.252241+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T03:23:22.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.799+0000 7f81b2fed700 1 -- 172.21.15.50:0/141643279 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f819c0a2c20 msgr2=0x7f819c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:22.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.799+0000 7f81b2fed700 1 --2- 172.21.15.50:0/141643279 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f819c0a2c20 0x7f819c0a50e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f819800b5c0 tx=0x7f819801a040 comp rx=0 tx=0).stop 2024-06-06T03:23:22.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.799+0000 7f81b2fed700 1 -- 172.21.15.50:0/141643279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81ac06a170 msgr2=0x7f81ac101460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:22.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.799+0000 7f81b2fed700 1 --2- 172.21.15.50:0/141643279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81ac06a170 0x7f81ac101460 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f81a000d980 tx=0x7f81a000dd40 comp rx=0 tx=0).stop 2024-06-06T03:23:22.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.799+0000 7f81b2fed700 1 -- 172.21.15.50:0/141643279 shutdown_connections 2024-06-06T03:23:22.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.799+0000 7f81b2fed700 1 --2- 172.21.15.50:0/141643279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81ac108500 0x7f81ac101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:22.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.799+0000 7f81b2fed700 1 --2- 172.21.15.50:0/141643279 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f819c0a2c20 0x7f819c0a50e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:22.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.799+0000 7f81b2fed700 1 --2- 172.21.15.50:0/141643279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81ac06a170 0x7f81ac101460 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:22.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.799+0000 7f81b2fed700 1 --2- 172.21.15.50:0/141643279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81ac06ab30 0x7f81ac1019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:22.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.799+0000 7f81b2fed700 1 -- 172.21.15.50:0/141643279 >> 172.21.15.50:0/141643279 conn(0x7f81ac078340 msgr2=0x7f81ac0fffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:22.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.800+0000 7f81b2fed700 1 -- 172.21.15.50:0/141643279 shutdown_connections 2024-06-06T03:23:22.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:22.800+0000 7f81b2fed700 1 -- 172.21.15.50:0/141643279 wait complete. 2024-06-06T03:23:22.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:22 smithi079 ceph-mon[35478]: pgmap v331: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-06-06T03:23:22.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:22 smithi122 ceph-mon[35759]: pgmap v331: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-06-06T03:23:23.459 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-06T03:23:23.721 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:23:23.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:23 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/141643279' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:23:23.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:23 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/141643279' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:23:23.935 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:23 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/141643279' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:23:24.800 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:24 smithi050 ceph-mon[32421]: pgmap v332: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 416 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-06-06T03:23:24.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:24 smithi079 ceph-mon[35478]: pgmap v332: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 416 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-06-06T03:23:24.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:24 smithi122 ceph-mon[35759]: pgmap v332: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 416 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-06-06T03:23:25.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.318+0000 7fd53957d700 1 -- 172.21.15.50:0/3854789601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd534101370 msgr2=0x7fd5341017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:25.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.318+0000 7fd53957d700 1 --2- 172.21.15.50:0/3854789601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd534101370 0x7fd5341017f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd528009990 tx=0x7fd528009ca0 comp rx=0 tx=0).stop 2024-06-06T03:23:25.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.318+0000 7fd53957d700 1 -- 172.21.15.50:0/3854789601 shutdown_connections 2024-06-06T03:23:25.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.318+0000 7fd53957d700 1 --2- 172.21.15.50:0/3854789601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd534101d30 0x7fd53410e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:25.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.318+0000 7fd53957d700 1 --2- 172.21.15.50:0/3854789601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd534107420 0x7fd534107800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:25.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.318+0000 7fd53957d700 1 --2- 172.21.15.50:0/3854789601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd534101370 0x7fd5341017f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:25.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.318+0000 7fd53957d700 1 -- 172.21.15.50:0/3854789601 >> 172.21.15.50:0/3854789601 conn(0x7fd534078340 msgr2=0x7fd534078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:25.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.318+0000 7fd53957d700 1 -- 172.21.15.50:0/3854789601 shutdown_connections 2024-06-06T03:23:25.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.318+0000 7fd53957d700 1 -- 172.21.15.50:0/3854789601 wait complete. 2024-06-06T03:23:25.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.318+0000 7fd53957d700 1 Processor -- start 2024-06-06T03:23:25.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.319+0000 7fd53957d700 1 -- start start 2024-06-06T03:23:25.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.319+0000 7fd53957d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd534101370 0x7fd534103020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:25.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.319+0000 7fd53957d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd534101d30 0x7fd534103560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:25.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.319+0000 7fd53957d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd534107420 0x7fd534103aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:25.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.319+0000 7fd53957d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd534111510 con 0x7fd534101370 2024-06-06T03:23:25.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.319+0000 7fd53957d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd534111390 con 0x7fd534101d30 2024-06-06T03:23:25.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.319+0000 7fd53957d700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd534111690 con 0x7fd534107420 2024-06-06T03:23:25.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.319+0000 7fd532ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd534101370 0x7fd534103020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.319+0000 7fd532ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd534101370 0x7fd534103020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60114/0 (socket says 172.21.15.50:60114) 2024-06-06T03:23:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.319+0000 7fd532ffd700 1 -- 172.21.15.50:0/4179986596 learned_addr learned my addr 172.21.15.50:0/4179986596 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:23:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.319+0000 7fd5327fc700 1 --2- 172.21.15.50:0/4179986596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd534101d30 0x7fd534103560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.319+0000 7fd5337fe700 1 --2- 172.21.15.50:0/4179986596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd534107420 0x7fd534103aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.319+0000 7fd532ffd700 1 -- 172.21.15.50:0/4179986596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd534107420 msgr2=0x7fd534103aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.319+0000 7fd532ffd700 1 --2- 172.21.15.50:0/4179986596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd534107420 0x7fd534103aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.319+0000 7fd532ffd700 1 -- 172.21.15.50:0/4179986596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd534101d30 msgr2=0x7fd534103560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.319+0000 7fd532ffd700 1 --2- 172.21.15.50:0/4179986596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd534101d30 0x7fd534103560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.319+0000 7fd532ffd700 1 -- 172.21.15.50:0/4179986596 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5341a7090 con 0x7fd534101370 2024-06-06T03:23:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.319+0000 7fd5327fc700 1 --2- 172.21.15.50:0/4179986596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd534101d30 0x7fd534103560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:23:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.320+0000 7fd532ffd700 1 --2- 172.21.15.50:0/4179986596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd534101370 0x7fd534103020 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd52400d950 tx=0x7fd52400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.320+0000 7fd51bfff700 1 -- 172.21.15.50:0/4179986596 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd524016070 con 0x7fd534101370 2024-06-06T03:23:25.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.320+0000 7fd51bfff700 1 -- 172.21.15.50:0/4179986596 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd524010460 con 0x7fd534101370 2024-06-06T03:23:25.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.320+0000 7fd53957d700 1 -- 172.21.15.50:0/4179986596 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5341a7380 con 0x7fd534101370 2024-06-06T03:23:25.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.320+0000 7fd51bfff700 1 -- 172.21.15.50:0/4179986596 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd52400f620 con 0x7fd534101370 2024-06-06T03:23:25.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.320+0000 7fd53957d700 1 -- 172.21.15.50:0/4179986596 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5341a78c0 con 0x7fd534101370 2024-06-06T03:23:25.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.321+0000 7fd53957d700 1 -- 172.21.15.50:0/4179986596 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd534069180 con 0x7fd534101370 2024-06-06T03:23:25.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.323+0000 7fd51bfff700 1 -- 172.21.15.50:0/4179986596 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd524019070 con 0x7fd534101370 2024-06-06T03:23:25.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.323+0000 7fd51bfff700 1 --2- 172.21.15.50:0/4179986596 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd51c0a2c20 0x7fd51c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:25.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.324+0000 7fd5327fc700 1 --2- 172.21.15.50:0/4179986596 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd51c0a2c20 0x7fd51c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:25.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.324+0000 7fd51bfff700 1 -- 172.21.15.50:0/4179986596 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7fd5240cefe0 con 0x7fd534101370 2024-06-06T03:23:25.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.324+0000 7fd5327fc700 1 --2- 172.21.15.50:0/4179986596 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd51c0a2c20 0x7fd51c0a50e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd528006010 tx=0x7fd52800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:25.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.327+0000 7fd51bfff700 1 -- 172.21.15.50:0/4179986596 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd52409bba0 con 0x7fd534101370 2024-06-06T03:23:25.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.531+0000 7fd53957d700 1 -- 172.21.15.50:0/4179986596 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd5341a7b20 con 0x7fd534101370 2024-06-06T03:23:25.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.533+0000 7fd51bfff700 1 -- 172.21.15.50:0/4179986596 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+24607 (secure 0 0 0) 0x7fd52409b4a0 con 0x7fd534101370 2024-06-06T03:23:25.532 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:23:25.533 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":97,"fsid":"b6263b26-23b2-11ef-bc9b-c7b262605968","created":"2024-06-06T03:14:19.062632+0000","modified":"2024-06-06T03:23:14.506132+0000","last_up_change":"2024-06-06T03:21:30.287918+0000","last_in_change":"2024-06-06T03:21:09.550417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T03:17:37.777608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T03:22:29.496859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T03:22:33.221878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-06T03:22:42.829873+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"eed8040f-a7b7-4d3b-8345-2022918097d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6803","nonce":2379528827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6805","nonce":2379528827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6809","nonce":2379528827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6807","nonce":2379528827}]},"public_addr":"172.21.15.50:6803/2379528827","cluster_addr":"172.21.15.50:6805/2379528827","heartbeat_back_addr":"172.21.15.50:6809/2379528827","heartbeat_front_addr":"172.21.15.50:6807/2379528827","state":["exists","up"]},{"osd":1,"uuid":"089ecb78-5e1e-4cdb-8fe0-5c1731ec9dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6801","nonce":3498354151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6803","nonce":3498354151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6807","nonce":3498354151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6805","nonce":3498354151}]},"public_addr":"172.21.15.79:6801/3498354151","cluster_addr":"172.21.15.79:6803/3498354151","heartbeat_back_addr":"172.21.15.79:6807/3498354151","heartbeat_front_addr":"172.21.15.79:6805/3498354151","state":["exists","up"]},{"osd":2,"uuid":"90599e3b-bf86-4a56-b03b-b051528a5b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6801","nonce":566397008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6803","nonce":566397008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6807","nonce":566397008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6805","nonce":566397008}]},"public_addr":"172.21.15.122:6801/566397008","cluster_addr":"172.21.15.122:6803/566397008","heartbeat_back_addr":"172.21.15.122:6807/566397008","heartbeat_front_addr":"172.21.15.122:6805/566397008","state":["exists","up"]},{"osd":3,"uuid":"fd295e6c-64cd-4164-83dc-4d32c2ae103a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6811","nonce":820123083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6813","nonce":820123083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6817","nonce":820123083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6815","nonce":820123083}]},"public_addr":"172.21.15.50:6811/820123083","cluster_addr":"172.21.15.50:6813/820123083","heartbeat_back_addr":"172.21.15.50:6817/820123083","heartbeat_front_addr":"172.21.15.50:6815/820123083","state":["exists","up"]},{"osd":4,"uuid":"4c854d90-5353-4f7c-b2f3-2af6216d799b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6809","nonce":1784117997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6811","nonce":1784117997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6815","nonce":1784117997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6813","nonce":1784117997}]},"public_addr":"172.21.15.79:6809/1784117997","cluster_addr":"172.21.15.79:6811/1784117997","heartbeat_back_addr":"172.21.15.79:6815/1784117997","heartbeat_front_addr":"172.21.15.79:6813/1784117997","state":["exists","up"]},{"osd":5,"uuid":"80041e10-a643-4338-b621-f882c7bc48b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6809","nonce":2755878218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6811","nonce":2755878218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6815","nonce":2755878218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6813","nonce":2755878218}]},"public_addr":"172.21.15.122:6809/2755878218","cluster_addr":"172.21.15.122:6811/2755878218","heartbeat_back_addr":"172.21.15.122:6815/2755878218","heartbeat_front_addr":"172.21.15.122:6813/2755878218","state":["exists","up"]},{"osd":6,"uuid":"9e15c6c3-bb4b-4c2b-bb7e-4653b10874d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6819","nonce":474595612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6821","nonce":474595612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6825","nonce":474595612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6823","nonce":474595612}]},"public_addr":"172.21.15.50:6819/474595612","cluster_addr":"172.21.15.50:6821/474595612","heartbeat_back_addr":"172.21.15.50:6825/474595612","heartbeat_front_addr":"172.21.15.50:6823/474595612","state":["exists","up"]},{"osd":7,"uuid":"62585bba-c540-4498-8768-b84183e19abd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6817","nonce":3504864579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6819","nonce":3504864579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6823","nonce":3504864579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6821","nonce":3504864579}]},"public_addr":"172.21.15.79:6817/3504864579","cluster_addr":"172.21.15.79:6819/3504864579","heartbeat_back_addr":"172.21.15.79:6823/3504864579","heartbeat_front_addr":"172.21.15.79:6821/3504864579","state":["exists","up"]},{"osd":8,"uuid":"7a272157-460a-4d4a-a63e-30436022ac7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6817","nonce":3484833116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6819","nonce":3484833116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6823","nonce":3484833116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6821","nonce":3484833116}]},"public_addr":"172.21.15.122:6817/3484833116","cluster_addr":"172.21.15.122:6819/3484833116","heartbeat_back_addr":"172.21.15.122:6823/3484833116","heartbeat_front_addr":"172.21.15.122:6821/3484833116","state":["exists","up"]},{"osd":9,"uuid":"7e768ff7-f78d-4a12-b863-4b692e0f4a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6827","nonce":2600273670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6829","nonce":2600273670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6833","nonce":2600273670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6831","nonce":2600273670}]},"public_addr":"172.21.15.50:6827/2600273670","cluster_addr":"172.21.15.50:6829/2600273670","heartbeat_back_addr":"172.21.15.50:6833/2600273670","heartbeat_front_addr":"172.21.15.50:6831/2600273670","state":["exists","up"]},{"osd":10,"uuid":"a42df29a-d88d-4401-878d-6c8f75f3f604","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6825","nonce":2740366543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6827","nonce":2740366543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6831","nonce":2740366543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6829","nonce":2740366543}]},"public_addr":"172.21.15.79:6825/2740366543","cluster_addr":"172.21.15.79:6827/2740366543","heartbeat_back_addr":"172.21.15.79:6831/2740366543","heartbeat_front_addr":"172.21.15.79:6829/2740366543","state":["exists","up"]},{"osd":11,"uuid":"35bcde30-49e4-49b9-a348-98d21a0d3cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6825","nonce":4160854238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6827","nonce":4160854238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6831","nonce":4160854238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6829","nonce":4160854238}]},"public_addr":"172.21.15.122:6825/4160854238","cluster_addr":"172.21.15.122:6827/4160854238","heartbeat_back_addr":"172.21.15.122:6831/4160854238","heartbeat_front_addr":"172.21.15.122:6829/4160854238","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:16:46.989554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:17:11.269759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:17:35.105846+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:00.940943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:26.284520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:51.064143+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:19:16.254750+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:19:42.841380+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:20:08.185133+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:20:34.700082+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:21:01.485278+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:21:27.938715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1311987652":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/1149897118":"2024-06-07T03:15:13.252241+0000","172.21.15.50:6800/2617801068":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/1068038293":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/4038080419":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/149912088":"2024-06-07T03:14:46.388744+0000","172.21.15.50:6801/2617801068":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/2963887224":"2024-06-07T03:14:46.388744+0000","172.21.15.50:6801/1311987652":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/2554563139":"2024-06-07T03:15:13.252241+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T03:23:25.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.536+0000 7fd53957d700 1 -- 172.21.15.50:0/4179986596 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd51c0a2c20 msgr2=0x7fd51c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:25.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.536+0000 7fd53957d700 1 --2- 172.21.15.50:0/4179986596 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd51c0a2c20 0x7fd51c0a50e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd528006010 tx=0x7fd52800b540 comp rx=0 tx=0).stop 2024-06-06T03:23:25.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.536+0000 7fd53957d700 1 -- 172.21.15.50:0/4179986596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd534101370 msgr2=0x7fd534103020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:25.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.536+0000 7fd53957d700 1 --2- 172.21.15.50:0/4179986596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd534101370 0x7fd534103020 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd52400d950 tx=0x7fd52400dd10 comp rx=0 tx=0).stop 2024-06-06T03:23:25.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.536+0000 7fd53957d700 1 -- 172.21.15.50:0/4179986596 shutdown_connections 2024-06-06T03:23:25.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.536+0000 7fd53957d700 1 --2- 172.21.15.50:0/4179986596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd534107420 0x7fd534103aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:25.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.536+0000 7fd53957d700 1 --2- 172.21.15.50:0/4179986596 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd51c0a2c20 0x7fd51c0a50e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:25.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.536+0000 7fd53957d700 1 --2- 172.21.15.50:0/4179986596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd534101370 0x7fd534103020 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:25.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.536+0000 7fd53957d700 1 --2- 172.21.15.50:0/4179986596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd534101d30 0x7fd534103560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:25.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.536+0000 7fd53957d700 1 -- 172.21.15.50:0/4179986596 >> 172.21.15.50:0/4179986596 conn(0x7fd534078340 msgr2=0x7fd53406aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:25.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.536+0000 7fd53957d700 1 -- 172.21.15.50:0/4179986596 shutdown_connections 2024-06-06T03:23:25.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:25.536+0000 7fd53957d700 1 -- 172.21.15.50:0/4179986596 wait complete. 2024-06-06T03:23:25.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:25 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/4179986596' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:23:25.870 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:25 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/4179986596' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:23:25.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:25 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/4179986596' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:23:26.235 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-06-06T03:23:26.491 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:23:26.820 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:26 smithi050 ceph-mon[32421]: pgmap v333: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 283 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-06-06T03:23:26.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:26 smithi079 ceph-mon[35478]: pgmap v333: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 283 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-06-06T03:23:26.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:26 smithi122 ceph-mon[35759]: pgmap v333: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 283 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-06-06T03:23:28.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.168+0000 7f9e021d2700 1 -- 172.21.15.50:0/1121266094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dfc06a170 msgr2=0x7f9dfc06a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:28.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.168+0000 7f9e021d2700 1 --2- 172.21.15.50:0/1121266094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dfc06a170 0x7f9dfc06a5f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9df0009990 tx=0x7f9df0009ca0 comp rx=0 tx=0).stop 2024-06-06T03:23:28.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.168+0000 7f9e021d2700 1 -- 172.21.15.50:0/1121266094 shutdown_connections 2024-06-06T03:23:28.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.168+0000 7f9e021d2700 1 --2- 172.21.15.50:0/1121266094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9dfc06ab30 0x7f9dfc10f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:28.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.168+0000 7f9e021d2700 1 --2- 172.21.15.50:0/1121266094 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dfc108500 0x7f9dfc1088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:28.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.168+0000 7f9e021d2700 1 --2- 172.21.15.50:0/1121266094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dfc06a170 0x7f9dfc06a5f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:28.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.168+0000 7f9e021d2700 1 -- 172.21.15.50:0/1121266094 >> 172.21.15.50:0/1121266094 conn(0x7f9dfc078340 msgr2=0x7f9dfc078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:28.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.168+0000 7f9e021d2700 1 -- 172.21.15.50:0/1121266094 shutdown_connections 2024-06-06T03:23:28.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.168+0000 7f9e021d2700 1 -- 172.21.15.50:0/1121266094 wait complete. 2024-06-06T03:23:28.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.169+0000 7f9e021d2700 1 Processor -- start 2024-06-06T03:23:28.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.169+0000 7f9e021d2700 1 -- start start 2024-06-06T03:23:28.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.169+0000 7f9e021d2700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9dfc06a170 0x7f9dfc19e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:28.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.169+0000 7f9e021d2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dfc06ab30 0x7f9dfc19ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:28.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.169+0000 7f9e021d2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dfc108500 0x7f9dfc198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:28.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.169+0000 7f9e021d2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc112690 con 0x7f9dfc108500 2024-06-06T03:23:28.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.170+0000 7f9e021d2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc112510 con 0x7f9dfc06ab30 2024-06-06T03:23:28.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.170+0000 7f9e021d2700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc112810 con 0x7f9dfc06a170 2024-06-06T03:23:28.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.170+0000 7f9dfbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dfc108500 0x7f9dfc198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:28.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.170+0000 7f9dfbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dfc108500 0x7f9dfc198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36070/0 (socket says 172.21.15.50:36070) 2024-06-06T03:23:28.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.170+0000 7f9dfbfff700 1 -- 172.21.15.50:0/1480914350 learned_addr learned my addr 172.21.15.50:0/1480914350 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:23:28.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.170+0000 7f9dfaffd700 1 --2- 172.21.15.50:0/1480914350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dfc06ab30 0x7f9dfc19ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:28.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.170+0000 7f9dfb7fe700 1 --2- 172.21.15.50:0/1480914350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9dfc06a170 0x7f9dfc19e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:28.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.170+0000 7f9dfbfff700 1 -- 172.21.15.50:0/1480914350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9dfc06a170 msgr2=0x7f9dfc19e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:28.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.170+0000 7f9dfbfff700 1 --2- 172.21.15.50:0/1480914350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9dfc06a170 0x7f9dfc19e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:28.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.170+0000 7f9dfbfff700 1 -- 172.21.15.50:0/1480914350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dfc06ab30 msgr2=0x7f9dfc19ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:28.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.170+0000 7f9dfbfff700 1 --2- 172.21.15.50:0/1480914350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dfc06ab30 0x7f9dfc19ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:28.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.170+0000 7f9dfbfff700 1 -- 172.21.15.50:0/1480914350 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dfc199090 con 0x7f9dfc108500 2024-06-06T03:23:28.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.170+0000 7f9dfbfff700 1 --2- 172.21.15.50:0/1480914350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dfc108500 0x7f9dfc198930 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9df400b550 tx=0x7f9df400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:28.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.170+0000 7f9df8ff9700 1 -- 172.21.15.50:0/1480914350 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df4015020 con 0x7f9dfc108500 2024-06-06T03:23:28.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.170+0000 7f9df8ff9700 1 -- 172.21.15.50:0/1480914350 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9df4011ce0 con 0x7f9dfc108500 2024-06-06T03:23:28.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.170+0000 7f9e021d2700 1 -- 172.21.15.50:0/1480914350 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dfc199380 con 0x7f9dfc108500 2024-06-06T03:23:28.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.170+0000 7f9df8ff9700 1 -- 172.21.15.50:0/1480914350 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df4010cd0 con 0x7f9dfc108500 2024-06-06T03:23:28.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.171+0000 7f9e021d2700 1 -- 172.21.15.50:0/1480914350 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dfc1a5640 con 0x7f9dfc108500 2024-06-06T03:23:28.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.172+0000 7f9e021d2700 1 -- 172.21.15.50:0/1480914350 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dfc103bc0 con 0x7f9dfc108500 2024-06-06T03:23:28.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.173+0000 7f9df8ff9700 1 -- 172.21.15.50:0/1480914350 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9df4018020 con 0x7f9dfc108500 2024-06-06T03:23:28.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.173+0000 7f9df8ff9700 1 --2- 172.21.15.50:0/1480914350 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9de40a2c20 0x7f9de40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:28.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.174+0000 7f9dfb7fe700 1 --2- 172.21.15.50:0/1480914350 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9de40a2c20 0x7f9de40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:28.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.174+0000 7f9df8ff9700 1 -- 172.21.15.50:0/1480914350 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7f9df40ceae0 con 0x7f9dfc108500 2024-06-06T03:23:28.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.174+0000 7f9dfb7fe700 1 --2- 172.21.15.50:0/1480914350 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9de40a2c20 0x7f9de40a50e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc199a70 tx=0x7f9dec0079e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:28.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.178+0000 7f9df8ff9700 1 -- 172.21.15.50:0/1480914350 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9df401f020 con 0x7f9dfc108500 2024-06-06T03:23:28.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.431+0000 7f9e021d2700 1 -- 172.21.15.50:0/1480914350 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9dfc02dca0 con 0x7f9dfc108500 2024-06-06T03:23:28.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.550+0000 7f9df8ff9700 1 -- 172.21.15.50:0/1480914350 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f9df409b680 con 0x7f9dfc108500 2024-06-06T03:23:28.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.553+0000 7f9e021d2700 1 -- 172.21.15.50:0/1480914350 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9de40a2c20 msgr2=0x7f9de40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:28.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.553+0000 7f9e021d2700 1 --2- 172.21.15.50:0/1480914350 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9de40a2c20 0x7f9de40a50e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc199a70 tx=0x7f9dec0079e0 comp rx=0 tx=0).stop 2024-06-06T03:23:28.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.553+0000 7f9e021d2700 1 -- 172.21.15.50:0/1480914350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dfc108500 msgr2=0x7f9dfc198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:28.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.553+0000 7f9e021d2700 1 --2- 172.21.15.50:0/1480914350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dfc108500 0x7f9dfc198930 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9df400b550 tx=0x7f9df400b860 comp rx=0 tx=0).stop 2024-06-06T03:23:28.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.553+0000 7f9e021d2700 1 -- 172.21.15.50:0/1480914350 shutdown_connections 2024-06-06T03:23:28.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.553+0000 7f9e021d2700 1 --2- 172.21.15.50:0/1480914350 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9de40a2c20 0x7f9de40a50e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:28.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.553+0000 7f9e021d2700 1 --2- 172.21.15.50:0/1480914350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dfc108500 0x7f9dfc198930 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:28.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.553+0000 7f9e021d2700 1 --2- 172.21.15.50:0/1480914350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9dfc06a170 0x7f9dfc19e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:28.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.553+0000 7f9e021d2700 1 --2- 172.21.15.50:0/1480914350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dfc06ab30 0x7f9dfc19ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:28.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.553+0000 7f9e021d2700 1 -- 172.21.15.50:0/1480914350 >> 172.21.15.50:0/1480914350 conn(0x7f9dfc078340 msgr2=0x7f9dfc100020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:28.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.553+0000 7f9e021d2700 1 -- 172.21.15.50:0/1480914350 shutdown_connections 2024-06-06T03:23:28.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:28.553+0000 7f9e021d2700 1 -- 172.21.15.50:0/1480914350 wait complete. 2024-06-06T03:23:28.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:28 smithi050 ceph-mon[32421]: pgmap v334: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-06-06T03:23:28.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:28 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1480914350' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-06T03:23:28.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:28 smithi079 ceph-mon[35478]: pgmap v334: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-06-06T03:23:28.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:28 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/1480914350' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-06T03:23:28.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:28 smithi122 ceph-mon[35759]: pgmap v334: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-06-06T03:23:28.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:28 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/1480914350' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-06T03:23:29.183 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-06-06T03:23:29.183 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-06-06T03:23:29.437 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:23:29.811 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:29 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1480914350' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-06-06T03:23:29.812 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:29 smithi050 ceph-mon[32421]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-06T03:23:29.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:29 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/1480914350' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-06-06T03:23:29.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:29 smithi079 ceph-mon[35478]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-06T03:23:29.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:29 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/1480914350' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-06-06T03:23:29.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:29 smithi122 ceph-mon[35759]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-06T03:23:30.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:30 smithi079 ceph-mon[35478]: pgmap v335: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-06-06T03:23:30.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:30 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:23:30.921 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:30 smithi050 ceph-mon[32421]: pgmap v335: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-06-06T03:23:30.921 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:30 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:23:30.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:30 smithi122 ceph-mon[35759]: pgmap v335: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-06-06T03:23:30.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:30 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:23:31.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.164+0000 7f9551010700 1 -- 172.21.15.50:0/211942695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f954c06b620 msgr2=0x7f954c10f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:31.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.164+0000 7f9551010700 1 --2- 172.21.15.50:0/211942695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f954c06b620 0x7f954c10f350 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f954400b0d0 tx=0x7f954400b3e0 comp rx=0 tx=0).stop 2024-06-06T03:23:31.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.164+0000 7f9551010700 1 -- 172.21.15.50:0/211942695 shutdown_connections 2024-06-06T03:23:31.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.164+0000 7f9551010700 1 --2- 172.21.15.50:0/211942695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f954c06b620 0x7f954c10f350 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:31.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.164+0000 7f9551010700 1 --2- 172.21.15.50:0/211942695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f954c108580 0x7f954c108960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:31.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.164+0000 7f9551010700 1 --2- 172.21.15.50:0/211942695 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f954c06ac60 0x7f954c06b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:31.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.164+0000 7f9551010700 1 -- 172.21.15.50:0/211942695 >> 172.21.15.50:0/211942695 conn(0x7f954c078430 msgr2=0x7f954c078840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:31.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.164+0000 7f9551010700 1 -- 172.21.15.50:0/211942695 shutdown_connections 2024-06-06T03:23:31.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.164+0000 7f9551010700 1 -- 172.21.15.50:0/211942695 wait complete. 2024-06-06T03:23:31.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.165+0000 7f9551010700 1 Processor -- start 2024-06-06T03:23:31.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.165+0000 7f9551010700 1 -- start start 2024-06-06T03:23:31.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.165+0000 7f9551010700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f954c06ac60 0x7f954c19e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:31.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.165+0000 7f9551010700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f954c06b620 0x7f954c19ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:31.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.165+0000 7f9551010700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f954c108580 0x7f954c198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:31.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.165+0000 7f9551010700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f954c112670 con 0x7f954c108580 2024-06-06T03:23:31.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.165+0000 7f9551010700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f954c1124f0 con 0x7f954c06b620 2024-06-06T03:23:31.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.165+0000 7f9551010700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f954c1127f0 con 0x7f954c06ac60 2024-06-06T03:23:31.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.165+0000 7f954259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f954c06b620 0x7f954c19ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:31.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.165+0000 7f954b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f954c108580 0x7f954c198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:31.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.165+0000 7f954259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f954c06b620 0x7f954c19ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:34906/0 (socket says 172.21.15.50:34906) 2024-06-06T03:23:31.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.165+0000 7f954b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f954c108580 0x7f954c198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36090/0 (socket says 172.21.15.50:36090) 2024-06-06T03:23:31.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.165+0000 7f954259c700 1 -- 172.21.15.50:0/1260043203 learned_addr learned my addr 172.21.15.50:0/1260043203 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:23:31.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.165+0000 7f954ad9d700 1 --2- 172.21.15.50:0/1260043203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f954c06ac60 0x7f954c19e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:31.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.166+0000 7f954259c700 1 -- 172.21.15.50:0/1260043203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f954c06ac60 msgr2=0x7f954c19e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:31.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.166+0000 7f954259c700 1 --2- 172.21.15.50:0/1260043203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f954c06ac60 0x7f954c19e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:31.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.166+0000 7f954259c700 1 -- 172.21.15.50:0/1260043203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f954c108580 msgr2=0x7f954c198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:31.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.166+0000 7f954259c700 1 --2- 172.21.15.50:0/1260043203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f954c108580 0x7f954c198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:31.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.166+0000 7f954259c700 1 -- 172.21.15.50:0/1260043203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f954c199010 con 0x7f954c06b620 2024-06-06T03:23:31.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.166+0000 7f954259c700 1 --2- 172.21.15.50:0/1260043203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f954c06b620 0x7f954c19ebf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f953400c9b0 tx=0x7f953400ccc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:31.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.166+0000 7f9548d99700 1 -- 172.21.15.50:0/1260043203 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9534007b00 con 0x7f954c06b620 2024-06-06T03:23:31.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.166+0000 7f9548d99700 1 -- 172.21.15.50:0/1260043203 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f953400ce50 con 0x7f954c06b620 2024-06-06T03:23:31.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.166+0000 7f9551010700 1 -- 172.21.15.50:0/1260043203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f954c199300 con 0x7f954c06b620 2024-06-06T03:23:31.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.166+0000 7f9548d99700 1 -- 172.21.15.50:0/1260043203 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9534018660 con 0x7f954c06b620 2024-06-06T03:23:31.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.166+0000 7f9551010700 1 -- 172.21.15.50:0/1260043203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f954c1a5510 con 0x7f954c06b620 2024-06-06T03:23:31.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.167+0000 7f9551010700 1 -- 172.21.15.50:0/1260043203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f954c103bf0 con 0x7f954c06b620 2024-06-06T03:23:31.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.168+0000 7f9548d99700 1 -- 172.21.15.50:0/1260043203 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f953400f450 con 0x7f954c06b620 2024-06-06T03:23:31.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.169+0000 7f9548d99700 1 --2- 172.21.15.50:0/1260043203 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f95380a2c20 0x7f95380a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:31.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.169+0000 7f954ad9d700 1 --2- 172.21.15.50:0/1260043203 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f95380a2c20 0x7f95380a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:31.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.169+0000 7f9548d99700 1 -- 172.21.15.50:0/1260043203 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7f95340cf330 con 0x7f954c06b620 2024-06-06T03:23:31.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.170+0000 7f954ad9d700 1 --2- 172.21.15.50:0/1260043203 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f95380a2c20 0x7f95380a50e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f953c009c60 tx=0x7f953c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:31.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.174+0000 7f9548d99700 1 -- 172.21.15.50:0/1260043203 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9534014030 con 0x7f954c06b620 2024-06-06T03:23:31.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.454+0000 7f9551010700 1 -- 172.21.15.50:0/1260043203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f954c1a57a0 con 0x7f954c06b620 2024-06-06T03:23:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.569+0000 7f9548d99700 1 -- 172.21.15.50:0/1260043203 <== mon.2 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7f953409bed0 con 0x7f954c06b620 2024-06-06T03:23:31.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.571+0000 7f9551010700 1 -- 172.21.15.50:0/1260043203 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f95380a2c20 msgr2=0x7f95380a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:31.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.571+0000 7f9551010700 1 --2- 172.21.15.50:0/1260043203 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f95380a2c20 0x7f95380a50e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f953c009c60 tx=0x7f953c009260 comp rx=0 tx=0).stop 2024-06-06T03:23:31.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.572+0000 7f9551010700 1 -- 172.21.15.50:0/1260043203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f954c06b620 msgr2=0x7f954c19ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:31.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.572+0000 7f9551010700 1 --2- 172.21.15.50:0/1260043203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f954c06b620 0x7f954c19ebf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f953400c9b0 tx=0x7f953400ccc0 comp rx=0 tx=0).stop 2024-06-06T03:23:31.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.572+0000 7f9551010700 1 -- 172.21.15.50:0/1260043203 shutdown_connections 2024-06-06T03:23:31.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.572+0000 7f9551010700 1 --2- 172.21.15.50:0/1260043203 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f95380a2c20 0x7f95380a50e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:31.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.572+0000 7f9551010700 1 --2- 172.21.15.50:0/1260043203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f954c108580 0x7f954c198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:31.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.572+0000 7f9551010700 1 --2- 172.21.15.50:0/1260043203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f954c06ac60 0x7f954c19e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:31.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.572+0000 7f9551010700 1 --2- 172.21.15.50:0/1260043203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f954c06b620 0x7f954c19ebf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:31.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.572+0000 7f9551010700 1 -- 172.21.15.50:0/1260043203 >> 172.21.15.50:0/1260043203 conn(0x7f954c078430 msgr2=0x7f954c0ffdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:31.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.572+0000 7f9551010700 1 -- 172.21.15.50:0/1260043203 shutdown_connections 2024-06-06T03:23:31.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:31.572+0000 7f9551010700 1 -- 172.21.15.50:0/1260043203 wait complete. 2024-06-06T03:23:31.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:31 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/1260043203' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-06-06T03:23:31.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:31 smithi122 ceph-mon[35759]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-06-06T03:23:31.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:31 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1260043203' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-06-06T03:23:31.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:31 smithi050 ceph-mon[32421]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-06-06T03:23:31.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:31 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/1260043203' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-06-06T03:23:31.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:31 smithi079 ceph-mon[35478]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-06-06T03:23:32.345 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-06-06T03:23:32.782 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:23:32.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:32 smithi079 ceph-mon[35478]: pgmap v336: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-06T03:23:32.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:32 smithi079 ceph-mon[35478]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-06-06T03:23:32.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:32 smithi079 ceph-mon[35478]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-06-06T03:23:32.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:32 smithi079 ceph-mon[35478]: daemon mds.c assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-06-06T03:23:32.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:32 smithi079 ceph-mon[35478]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-06T03:23:32.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:32 smithi079 ceph-mon[35478]: fsmap cephfs:2 {0=i=up:active,1=c=up:creating} 10 up:standby 2024-06-06T03:23:32.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:32 smithi079 ceph-mon[35478]: daemon mds.c is now active in filesystem cephfs as rank 1 2024-06-06T03:23:32.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:32 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:23:32.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:32 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:23:32.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:32 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:23:32.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:32 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:23:32.906 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:32 smithi050 ceph-mon[32421]: pgmap v336: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-06T03:23:32.906 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:32 smithi050 ceph-mon[32421]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-06-06T03:23:32.906 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:32 smithi050 ceph-mon[32421]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-06-06T03:23:32.906 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:32 smithi050 ceph-mon[32421]: daemon mds.c assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-06-06T03:23:32.906 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:32 smithi050 ceph-mon[32421]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-06T03:23:32.906 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:32 smithi050 ceph-mon[32421]: fsmap cephfs:2 {0=i=up:active,1=c=up:creating} 10 up:standby 2024-06-06T03:23:32.906 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:32 smithi050 ceph-mon[32421]: daemon mds.c is now active in filesystem cephfs as rank 1 2024-06-06T03:23:32.906 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:32 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:23:32.906 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:32 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:23:32.906 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:32 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:23:32.906 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:32 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:23:32.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:32 smithi122 ceph-mon[35759]: pgmap v336: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-06T03:23:32.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:32 smithi122 ceph-mon[35759]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-06-06T03:23:32.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:32 smithi122 ceph-mon[35759]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-06-06T03:23:32.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:32 smithi122 ceph-mon[35759]: daemon mds.c assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-06-06T03:23:32.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:32 smithi122 ceph-mon[35759]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-06T03:23:32.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:32 smithi122 ceph-mon[35759]: fsmap cephfs:2 {0=i=up:active,1=c=up:creating} 10 up:standby 2024-06-06T03:23:32.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:32 smithi122 ceph-mon[35759]: daemon mds.c is now active in filesystem cephfs as rank 1 2024-06-06T03:23:32.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:32 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:23:32.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:32 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:23:32.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:32 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:23:32.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:32 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:23:33.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:33 smithi079 ceph-mon[35478]: mds.? [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] up:active 2024-06-06T03:23:33.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:33 smithi079 ceph-mon[35478]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-06-06T03:23:33.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:33 smithi079 ceph-mon[35478]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-06-06T03:23:33.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:33 smithi079 ceph-mon[35478]: Cluster is now healthy 2024-06-06T03:23:33.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:33 smithi079 ceph-mon[35478]: fsmap cephfs:2 {0=i=up:active,1=c=up:active} 10 up:standby 2024-06-06T03:23:33.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:33 smithi079 ceph-mon[35478]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:creating} 9 up:standby 2024-06-06T03:23:33.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:33 smithi079 ceph-mon[35478]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-06-06T03:23:33.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:33 smithi122 ceph-mon[35759]: mds.? [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] up:active 2024-06-06T03:23:33.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:33 smithi122 ceph-mon[35759]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-06-06T03:23:33.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:33 smithi122 ceph-mon[35759]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-06-06T03:23:33.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:33 smithi122 ceph-mon[35759]: Cluster is now healthy 2024-06-06T03:23:33.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:33 smithi122 ceph-mon[35759]: fsmap cephfs:2 {0=i=up:active,1=c=up:active} 10 up:standby 2024-06-06T03:23:33.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:33 smithi122 ceph-mon[35759]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:creating} 9 up:standby 2024-06-06T03:23:33.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:33 smithi122 ceph-mon[35759]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-06-06T03:23:33.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:33 smithi050 ceph-mon[32421]: mds.? [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] up:active 2024-06-06T03:23:33.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:33 smithi050 ceph-mon[32421]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-06-06T03:23:33.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:33 smithi050 ceph-mon[32421]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-06-06T03:23:33.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:33 smithi050 ceph-mon[32421]: Cluster is now healthy 2024-06-06T03:23:33.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:33 smithi050 ceph-mon[32421]: fsmap cephfs:2 {0=i=up:active,1=c=up:active} 10 up:standby 2024-06-06T03:23:33.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:33 smithi050 ceph-mon[32421]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:creating} 9 up:standby 2024-06-06T03:23:33.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:33 smithi050 ceph-mon[32421]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-06-06T03:23:34.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.496+0000 7f88da42e700 1 -- 172.21.15.50:0/1254210315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d4107840 msgr2=0x7f88d410f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:34.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.496+0000 7f88da42e700 1 --2- 172.21.15.50:0/1254210315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d4107840 0x7f88d410f3c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00b0d0 tx=0x7f88cc00b3e0 comp rx=0 tx=0).stop 2024-06-06T03:23:34.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.496+0000 7f88da42e700 1 -- 172.21.15.50:0/1254210315 shutdown_connections 2024-06-06T03:23:34.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.496+0000 7f88da42e700 1 --2- 172.21.15.50:0/1254210315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d4107840 0x7f88d410f3c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:34.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.496+0000 7f88da42e700 1 --2- 172.21.15.50:0/1254210315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88d4101020 0x7f88d4101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:34.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.496+0000 7f88da42e700 1 --2- 172.21.15.50:0/1254210315 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88d41019d0 0x7f88d4107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:34.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.497+0000 7f88da42e700 1 -- 172.21.15.50:0/1254210315 >> 172.21.15.50:0/1254210315 conn(0x7f88d40766c0 msgr2=0x7f88d4076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:34.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.497+0000 7f88da42e700 1 -- 172.21.15.50:0/1254210315 shutdown_connections 2024-06-06T03:23:34.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.497+0000 7f88da42e700 1 -- 172.21.15.50:0/1254210315 wait complete. 2024-06-06T03:23:34.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.497+0000 7f88da42e700 1 Processor -- start 2024-06-06T03:23:34.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.497+0000 7f88da42e700 1 -- start start 2024-06-06T03:23:34.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.498+0000 7f88da42e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88d4101020 0x7f88d419e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:34.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.498+0000 7f88da42e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d41019d0 0x7f88d419ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:34.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.498+0000 7f88da42e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88d4107840 0x7f88d41989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:34.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.498+0000 7f88da42e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f88d41126e0 con 0x7f88d41019d0 2024-06-06T03:23:34.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.498+0000 7f88da42e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f88d4112560 con 0x7f88d4101020 2024-06-06T03:23:34.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.498+0000 7f88da42e700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f88d4112860 con 0x7f88d4107840 2024-06-06T03:23:34.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.498+0000 7f88d37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d41019d0 0x7f88d419ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:34.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.498+0000 7f88d37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d41019d0 0x7f88d419ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36108/0 (socket says 172.21.15.50:36108) 2024-06-06T03:23:34.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.498+0000 7f88d37fe700 1 -- 172.21.15.50:0/1990772927 learned_addr learned my addr 172.21.15.50:0/1990772927 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:23:34.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.498+0000 7f88d3fff700 1 --2- 172.21.15.50:0/1990772927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88d4101020 0x7f88d419e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:34.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.498+0000 7f88d89cb700 1 --2- 172.21.15.50:0/1990772927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88d4107840 0x7f88d41989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:34.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.498+0000 7f88d37fe700 1 -- 172.21.15.50:0/1990772927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88d4107840 msgr2=0x7f88d41989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:34.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.498+0000 7f88d37fe700 1 --2- 172.21.15.50:0/1990772927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88d4107840 0x7f88d41989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:34.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.498+0000 7f88d37fe700 1 -- 172.21.15.50:0/1990772927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88d4101020 msgr2=0x7f88d419e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:34.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.498+0000 7f88d37fe700 1 --2- 172.21.15.50:0/1990772927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88d4101020 0x7f88d419e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:34.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.498+0000 7f88d37fe700 1 -- 172.21.15.50:0/1990772927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d4199120 con 0x7f88d41019d0 2024-06-06T03:23:34.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.498+0000 7f88d37fe700 1 --2- 172.21.15.50:0/1990772927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d41019d0 0x7f88d419ed40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f88c800b4d0 tx=0x7f88c800b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:34.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.498+0000 7f88d17fa700 1 -- 172.21.15.50:0/1990772927 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c8015020 con 0x7f88d41019d0 2024-06-06T03:23:34.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.499+0000 7f88da42e700 1 -- 172.21.15.50:0/1990772927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88d4199410 con 0x7f88d41019d0 2024-06-06T03:23:34.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.499+0000 7f88d17fa700 1 -- 172.21.15.50:0/1990772927 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f88c8011ce0 con 0x7f88d41019d0 2024-06-06T03:23:34.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.499+0000 7f88d17fa700 1 -- 172.21.15.50:0/1990772927 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c8010cd0 con 0x7f88d41019d0 2024-06-06T03:23:34.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.499+0000 7f88da42e700 1 -- 172.21.15.50:0/1990772927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88d41a56d0 con 0x7f88d41019d0 2024-06-06T03:23:34.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.500+0000 7f88da42e700 1 -- 172.21.15.50:0/1990772927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88d410aa80 con 0x7f88d41019d0 2024-06-06T03:23:34.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.501+0000 7f88d17fa700 1 -- 172.21.15.50:0/1990772927 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f88c8018020 con 0x7f88d41019d0 2024-06-06T03:23:34.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.502+0000 7f88d17fa700 1 --2- 172.21.15.50:0/1990772927 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f88bc0a2c20 0x7f88bc0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:34.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.502+0000 7f88d3fff700 1 --2- 172.21.15.50:0/1990772927 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f88bc0a2c20 0x7f88bc0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:34.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.502+0000 7f88d17fa700 1 -- 172.21.15.50:0/1990772927 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7f88c80cf0b0 con 0x7f88d41019d0 2024-06-06T03:23:34.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.502+0000 7f88d3fff700 1 --2- 172.21.15.50:0/1990772927 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f88bc0a2c20 0x7f88bc0a50e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f88d4199b00 tx=0x7f88c400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:34.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.505+0000 7f88d17fa700 1 -- 172.21.15.50:0/1990772927 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f88c801f020 con 0x7f88d41019d0 2024-06-06T03:23:34.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:34 smithi050 ceph-mon[32421]: pgmap v337: 129 pgs: 129 active+clean; 582 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-06-06T03:23:34.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:34 smithi050 ceph-mon[32421]: mds.? [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] up:active 2024-06-06T03:23:34.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:34 smithi050 ceph-mon[32421]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 9 up:standby 2024-06-06T03:23:34.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:34 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:23:34.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:34.771+0000 7f88da42e700 1 -- 172.21.15.50:0/1990772927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f88d4069180 con 0x7f88d41019d0 2024-06-06T03:23:34.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:34 smithi079 ceph-mon[35478]: pgmap v337: 129 pgs: 129 active+clean; 582 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-06-06T03:23:34.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:34 smithi079 ceph-mon[35478]: mds.? [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] up:active 2024-06-06T03:23:34.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:34 smithi079 ceph-mon[35478]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 9 up:standby 2024-06-06T03:23:34.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:34 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:23:34.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:34 smithi122 ceph-mon[35759]: pgmap v337: 129 pgs: 129 active+clean; 582 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-06-06T03:23:34.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:34 smithi122 ceph-mon[35759]: mds.? [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] up:active 2024-06-06T03:23:34.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:34 smithi122 ceph-mon[35759]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 9 up:standby 2024-06-06T03:23:34.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:34 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:23:35.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:35.596+0000 7f88d17fa700 1 -- 172.21.15.50:0/1990772927 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v24) ==== 121+0+0 (secure 0 0 0) 0x7f88c809bc50 con 0x7f88d41019d0 2024-06-06T03:23:35.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:35.599+0000 7f88da42e700 1 -- 172.21.15.50:0/1990772927 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f88bc0a2c20 msgr2=0x7f88bc0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:35.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:35.599+0000 7f88da42e700 1 --2- 172.21.15.50:0/1990772927 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f88bc0a2c20 0x7f88bc0a50e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f88d4199b00 tx=0x7f88c400b410 comp rx=0 tx=0).stop 2024-06-06T03:23:35.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:35.599+0000 7f88da42e700 1 -- 172.21.15.50:0/1990772927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d41019d0 msgr2=0x7f88d419ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:35.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:35.599+0000 7f88da42e700 1 --2- 172.21.15.50:0/1990772927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d41019d0 0x7f88d419ed40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f88c800b4d0 tx=0x7f88c800b7e0 comp rx=0 tx=0).stop 2024-06-06T03:23:35.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:35.599+0000 7f88da42e700 1 -- 172.21.15.50:0/1990772927 shutdown_connections 2024-06-06T03:23:35.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:35.599+0000 7f88da42e700 1 --2- 172.21.15.50:0/1990772927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88d4107840 0x7f88d41989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:35.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:35.599+0000 7f88da42e700 1 --2- 172.21.15.50:0/1990772927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88d4101020 0x7f88d419e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:35.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:35.599+0000 7f88da42e700 1 --2- 172.21.15.50:0/1990772927 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f88bc0a2c20 0x7f88bc0a50e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:35.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:35.599+0000 7f88da42e700 1 --2- 172.21.15.50:0/1990772927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d41019d0 0x7f88d419ed40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:35.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:35.599+0000 7f88da42e700 1 -- 172.21.15.50:0/1990772927 >> 172.21.15.50:0/1990772927 conn(0x7f88d40766c0 msgr2=0x7f88d40fee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:35.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:35.599+0000 7f88da42e700 1 -- 172.21.15.50:0/1990772927 shutdown_connections 2024-06-06T03:23:35.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:35.599+0000 7f88da42e700 1 -- 172.21.15.50:0/1990772927 wait complete. 2024-06-06T03:23:35.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:35 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:23:35.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:35 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1990772927' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-06T03:23:35.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:35 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:23:35.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:35 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:23:35.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:35 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:23:35.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:35 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:23:35.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:35 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/1990772927' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-06T03:23:35.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:35 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:23:35.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:35 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:23:35.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:35 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:23:35.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:35 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:23:35.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:35 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/1990772927' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-06T03:23:35.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:35 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:23:35.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:35 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:23:35.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:35 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:23:36.253 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-06-06T03:23:36.515 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:23:36.757 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:36 smithi050 ceph-mon[32421]: pgmap v338: 129 pgs: 129 active+clean; 584 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 5 op/s 2024-06-06T03:23:36.757 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:36 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1990772927' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-06-06T03:23:36.757 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:36 smithi050 ceph-mon[32421]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 9 up:standby 2024-06-06T03:23:36.758 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:36 smithi050 ceph-mon[32421]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:23:36.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:36 smithi079 ceph-mon[35478]: pgmap v338: 129 pgs: 129 active+clean; 584 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 5 op/s 2024-06-06T03:23:36.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:36 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/1990772927' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-06-06T03:23:36.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:36 smithi079 ceph-mon[35478]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 9 up:standby 2024-06-06T03:23:36.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:36 smithi079 ceph-mon[35478]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:23:36.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:36 smithi122 ceph-mon[35759]: pgmap v338: 129 pgs: 129 active+clean; 584 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 5 op/s 2024-06-06T03:23:36.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:36 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/1990772927' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-06-06T03:23:36.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:36 smithi122 ceph-mon[35759]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 9 up:standby 2024-06-06T03:23:36.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:36 smithi122 ceph-mon[35759]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:23:38.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.298+0000 7f67c7160700 1 -- 172.21.15.50:0/2491377045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67c006ac00 msgr2=0x7f67c006afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:38.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.298+0000 7f67c7160700 1 --2- 172.21.15.50:0/2491377045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67c006ac00 0x7f67c006afe0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f67b4009990 tx=0x7f67b4009ca0 comp rx=0 tx=0).stop 2024-06-06T03:23:38.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.298+0000 7f67c7160700 1 -- 172.21.15.50:0/2491377045 shutdown_connections 2024-06-06T03:23:38.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.298+0000 7f67c7160700 1 --2- 172.21.15.50:0/2491377045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67c010efd0 0x7f67c01113c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:38.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.298+0000 7f67c7160700 1 --2- 172.21.15.50:0/2491377045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67c006ac00 0x7f67c006afe0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:38.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.298+0000 7f67c7160700 1 --2- 172.21.15.50:0/2491377045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67c006b520 0x7f67c010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:38.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.298+0000 7f67c7160700 1 -- 172.21.15.50:0/2491377045 >> 172.21.15.50:0/2491377045 conn(0x7f67c00773e0 msgr2=0x7f67c00777f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:38.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.298+0000 7f67c7160700 1 -- 172.21.15.50:0/2491377045 shutdown_connections 2024-06-06T03:23:38.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.298+0000 7f67c7160700 1 -- 172.21.15.50:0/2491377045 wait complete. 2024-06-06T03:23:38.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.299+0000 7f67c7160700 1 Processor -- start 2024-06-06T03:23:38.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.299+0000 7f67c7160700 1 -- start start 2024-06-06T03:23:38.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.300+0000 7f67c7160700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67c006ac00 0x7f67c019ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:38.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.300+0000 7f67c7160700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67c006b520 0x7f67c019b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:38.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.300+0000 7f67c7160700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67c010efd0 0x7f67c019f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:38.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.300+0000 7f67c7160700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f67c0114880 con 0x7f67c006ac00 2024-06-06T03:23:38.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.300+0000 7f67c7160700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f67c0114700 con 0x7f67c010efd0 2024-06-06T03:23:38.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.300+0000 7f67c7160700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f67c0114a00 con 0x7f67c006b520 2024-06-06T03:23:38.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.300+0000 7f67bffff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67c006b520 0x7f67c019b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:38.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.300+0000 7f67c56fd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67c010efd0 0x7f67c019f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:38.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.300+0000 7f67bffff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67c006b520 0x7f67c019b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:55418/0 (socket says 172.21.15.50:55418) 2024-06-06T03:23:38.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.300+0000 7f67bffff700 1 -- 172.21.15.50:0/3771634097 learned_addr learned my addr 172.21.15.50:0/3771634097 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:23:38.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.300+0000 7f67c4efc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67c006ac00 0x7f67c019ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:38.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.300+0000 7f67bffff700 1 -- 172.21.15.50:0/3771634097 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67c010efd0 msgr2=0x7f67c019f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:38.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.300+0000 7f67bffff700 1 --2- 172.21.15.50:0/3771634097 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67c010efd0 0x7f67c019f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:38.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.300+0000 7f67bffff700 1 -- 172.21.15.50:0/3771634097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67c006ac00 msgr2=0x7f67c019ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:38.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.300+0000 7f67bffff700 1 --2- 172.21.15.50:0/3771634097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67c006ac00 0x7f67c019ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:38.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.301+0000 7f67bffff700 1 -- 172.21.15.50:0/3771634097 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67c019fda0 con 0x7f67c006b520 2024-06-06T03:23:38.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.301+0000 7f67c56fd700 1 --2- 172.21.15.50:0/3771634097 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67c010efd0 0x7f67c019f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:23:38.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.301+0000 7f67bffff700 1 --2- 172.21.15.50:0/3771634097 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67c006b520 0x7f67c019b2d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f67ac00e9c0 tx=0x7f67ac00ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:38.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.301+0000 7f67bdffb700 1 -- 172.21.15.50:0/3771634097 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac00cbd0 con 0x7f67c006b520 2024-06-06T03:23:38.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.301+0000 7f67c7160700 1 -- 172.21.15.50:0/3771634097 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67c01a0090 con 0x7f67c006b520 2024-06-06T03:23:38.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.301+0000 7f67bdffb700 1 -- 172.21.15.50:0/3771634097 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f67ac00cd70 con 0x7f67c006b520 2024-06-06T03:23:38.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.302+0000 7f67bdffb700 1 -- 172.21.15.50:0/3771634097 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac0056c0 con 0x7f67c006b520 2024-06-06T03:23:38.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.302+0000 7f67c7160700 1 -- 172.21.15.50:0/3771634097 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67c01a7910 con 0x7f67c006b520 2024-06-06T03:23:38.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.303+0000 7f67c7160700 1 -- 172.21.15.50:0/3771634097 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67c0069180 con 0x7f67c006b520 2024-06-06T03:23:38.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.304+0000 7f67bdffb700 1 -- 172.21.15.50:0/3771634097 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f67ac004750 con 0x7f67c006b520 2024-06-06T03:23:38.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.305+0000 7f67bdffb700 1 --2- 172.21.15.50:0/3771634097 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f67b00a2ca0 0x7f67b00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:38.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.305+0000 7f67c4efc700 1 --2- 172.21.15.50:0/3771634097 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f67b00a2ca0 0x7f67b00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:38.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.305+0000 7f67bdffb700 1 -- 172.21.15.50:0/3771634097 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7f67ac0cf660 con 0x7f67c006b520 2024-06-06T03:23:38.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.306+0000 7f67c4efc700 1 --2- 172.21.15.50:0/3771634097 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f67b00a2ca0 0x7f67b00a5160 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f67b40098e0 tx=0x7f67b4005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:38.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.310+0000 7f67bdffb700 1 -- 172.21.15.50:0/3771634097 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f67ac09c200 con 0x7f67c006b520 2024-06-06T03:23:38.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.562+0000 7f67c7160700 1 -- 172.21.15.50:0/3771634097 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f67c002dca0 con 0x7f67c006b520 2024-06-06T03:23:38.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.605+0000 7f67bdffb700 1 -- 172.21.15.50:0/3771634097 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7f67ac09bb00 con 0x7f67c006b520 2024-06-06T03:23:38.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.607+0000 7f67c7160700 1 -- 172.21.15.50:0/3771634097 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f67b00a2ca0 msgr2=0x7f67b00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:38.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.607+0000 7f67c7160700 1 --2- 172.21.15.50:0/3771634097 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f67b00a2ca0 0x7f67b00a5160 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f67b40098e0 tx=0x7f67b4005960 comp rx=0 tx=0).stop 2024-06-06T03:23:38.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.607+0000 7f67c7160700 1 -- 172.21.15.50:0/3771634097 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67c006b520 msgr2=0x7f67c019b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:38.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.607+0000 7f67c7160700 1 --2- 172.21.15.50:0/3771634097 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67c006b520 0x7f67c019b2d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f67ac00e9c0 tx=0x7f67ac00ecd0 comp rx=0 tx=0).stop 2024-06-06T03:23:38.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.607+0000 7f67c7160700 1 -- 172.21.15.50:0/3771634097 shutdown_connections 2024-06-06T03:23:38.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.607+0000 7f67c7160700 1 --2- 172.21.15.50:0/3771634097 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67c010efd0 0x7f67c019f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:38.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.607+0000 7f67c7160700 1 --2- 172.21.15.50:0/3771634097 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f67b00a2ca0 0x7f67b00a5160 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:38.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.607+0000 7f67c7160700 1 --2- 172.21.15.50:0/3771634097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67c006ac00 0x7f67c019ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:38.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.607+0000 7f67c7160700 1 --2- 172.21.15.50:0/3771634097 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67c006b520 0x7f67c019b2d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:38.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.607+0000 7f67c7160700 1 -- 172.21.15.50:0/3771634097 >> 172.21.15.50:0/3771634097 conn(0x7f67c00773e0 msgr2=0x7f67c0110480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:38.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.607+0000 7f67c7160700 1 -- 172.21.15.50:0/3771634097 shutdown_connections 2024-06-06T03:23:38.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:38.607+0000 7f67c7160700 1 -- 172.21.15.50:0/3771634097 wait complete. 2024-06-06T03:23:38.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:38 smithi122 ceph-mon[35759]: pgmap v339: 129 pgs: 129 active+clean; 584 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 2.0 KiB/s wr, 6 op/s 2024-06-06T03:23:38.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:38 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/3771634097' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-06T03:23:38.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:38 smithi122 ceph-mon[35759]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-06T03:23:38.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:38 smithi050 ceph-mon[32421]: pgmap v339: 129 pgs: 129 active+clean; 584 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 2.0 KiB/s wr, 6 op/s 2024-06-06T03:23:38.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:38 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3771634097' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-06T03:23:38.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:38 smithi050 ceph-mon[32421]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-06T03:23:39.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:38 smithi079 ceph-mon[35478]: pgmap v339: 129 pgs: 129 active+clean; 584 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 2.0 KiB/s wr, 6 op/s 2024-06-06T03:23:39.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:38 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/3771634097' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-06T03:23:39.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:38 smithi079 ceph-mon[35478]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-06T03:23:39.273 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-06-06T03:23:39.274 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-06-06T03:23:39.528 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:23:39.871 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:39 smithi050 ceph-mon[32421]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-06-06T03:23:39.872 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:39 smithi050 ceph-mon[32421]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:23:39.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:39 smithi122 ceph-mon[35759]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-06-06T03:23:39.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:39 smithi122 ceph-mon[35759]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:23:40.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:39 smithi079 ceph-mon[35478]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-06-06T03:23:40.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:39 smithi079 ceph-mon[35478]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:23:40.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:40 smithi122 ceph-mon[35759]: pgmap v340: 129 pgs: 129 active+clean; 584 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-06-06T03:23:40.954 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:40 smithi050 ceph-mon[32421]: pgmap v340: 129 pgs: 129 active+clean; 584 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-06-06T03:23:41.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:40 smithi079 ceph-mon[35478]: pgmap v340: 129 pgs: 129 active+clean; 584 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-06-06T03:23:41.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.181+0000 7fab927f0700 1 -- 172.21.15.50:0/694574088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab8c107400 msgr2=0x7fab8c1077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:41.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.181+0000 7fab927f0700 1 --2- 172.21.15.50:0/694574088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab8c107400 0x7fab8c1077e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fab7c009990 tx=0x7fab7c009ca0 comp rx=0 tx=0).stop 2024-06-06T03:23:41.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.181+0000 7fab927f0700 1 -- 172.21.15.50:0/694574088 shutdown_connections 2024-06-06T03:23:41.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.181+0000 7fab927f0700 1 --2- 172.21.15.50:0/694574088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab8c101d50 0x7fab8c10e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:41.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.181+0000 7fab927f0700 1 --2- 172.21.15.50:0/694574088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab8c107400 0x7fab8c1077e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:41.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.181+0000 7fab927f0700 1 --2- 172.21.15.50:0/694574088 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab8c101390 0x7fab8c101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:41.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.181+0000 7fab927f0700 1 -- 172.21.15.50:0/694574088 >> 172.21.15.50:0/694574088 conn(0x7fab8c078340 msgr2=0x7fab8c078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:41.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.181+0000 7fab927f0700 1 -- 172.21.15.50:0/694574088 shutdown_connections 2024-06-06T03:23:41.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.181+0000 7fab927f0700 1 -- 172.21.15.50:0/694574088 wait complete. 2024-06-06T03:23:41.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.181+0000 7fab927f0700 1 Processor -- start 2024-06-06T03:23:41.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.181+0000 7fab927f0700 1 -- start start 2024-06-06T03:23:41.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.181+0000 7fab927f0700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab8c101390 0x7fab8c1998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:41.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.181+0000 7fab927f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab8c101d50 0x7fab8c199e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:41.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.182+0000 7fab927f0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab8c107400 0x7fab8c1a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:41.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.182+0000 7fab927f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c111520 con 0x7fab8c101d50 2024-06-06T03:23:41.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.182+0000 7fab927f0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c1113a0 con 0x7fab8c107400 2024-06-06T03:23:41.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.182+0000 7fab927f0700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c1116a0 con 0x7fab8c101390 2024-06-06T03:23:41.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.182+0000 7fab83fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab8c101d50 0x7fab8c199e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:41.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.182+0000 7fab83fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab8c101d50 0x7fab8c199e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47812/0 (socket says 172.21.15.50:47812) 2024-06-06T03:23:41.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.182+0000 7fab83fff700 1 -- 172.21.15.50:0/2234136167 learned_addr learned my addr 172.21.15.50:0/2234136167 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:23:41.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.182+0000 7fab8bfff700 1 --2- 172.21.15.50:0/2234136167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab8c101390 0x7fab8c1998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:41.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.182+0000 7fab90d8d700 1 --2- 172.21.15.50:0/2234136167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab8c107400 0x7fab8c1a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:41.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.182+0000 7fab83fff700 1 -- 172.21.15.50:0/2234136167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab8c101390 msgr2=0x7fab8c1998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:41.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.182+0000 7fab83fff700 1 --2- 172.21.15.50:0/2234136167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab8c101390 0x7fab8c1998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:41.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.182+0000 7fab83fff700 1 -- 172.21.15.50:0/2234136167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab8c107400 msgr2=0x7fab8c1a4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:41.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.182+0000 7fab83fff700 1 --2- 172.21.15.50:0/2234136167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab8c107400 0x7fab8c1a4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:41.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.182+0000 7fab83fff700 1 -- 172.21.15.50:0/2234136167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab8c1a4ea0 con 0x7fab8c101d50 2024-06-06T03:23:41.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.182+0000 7fab90d8d700 1 --2- 172.21.15.50:0/2234136167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab8c107400 0x7fab8c1a4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:23:41.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.182+0000 7fab83fff700 1 --2- 172.21.15.50:0/2234136167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab8c101d50 0x7fab8c199e20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fab7400c9b0 tx=0x7fab7400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:41.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.182+0000 7fab89ffb700 1 -- 172.21.15.50:0/2234136167 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74007b00 con 0x7fab8c101d50 2024-06-06T03:23:41.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.182+0000 7fab927f0700 1 -- 172.21.15.50:0/2234136167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab8c1a5070 con 0x7fab8c101d50 2024-06-06T03:23:41.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.182+0000 7fab89ffb700 1 -- 172.21.15.50:0/2234136167 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fab74007ca0 con 0x7fab8c101d50 2024-06-06T03:23:41.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.182+0000 7fab89ffb700 1 -- 172.21.15.50:0/2234136167 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74018660 con 0x7fab8c101d50 2024-06-06T03:23:41.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.183+0000 7fab927f0700 1 -- 172.21.15.50:0/2234136167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab8c1a55d0 con 0x7fab8c101d50 2024-06-06T03:23:41.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.184+0000 7fab927f0700 1 -- 172.21.15.50:0/2234136167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab8c069180 con 0x7fab8c101d50 2024-06-06T03:23:41.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.185+0000 7fab89ffb700 1 -- 172.21.15.50:0/2234136167 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fab7400f450 con 0x7fab8c101d50 2024-06-06T03:23:41.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.186+0000 7fab89ffb700 1 --2- 172.21.15.50:0/2234136167 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fab780a2ca0 0x7fab780a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:41.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.186+0000 7fab8bfff700 1 --2- 172.21.15.50:0/2234136167 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fab780a2ca0 0x7fab780a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:41.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.186+0000 7fab89ffb700 1 -- 172.21.15.50:0/2234136167 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7fab740cf330 con 0x7fab8c101d50 2024-06-06T03:23:41.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.186+0000 7fab8bfff700 1 --2- 172.21.15.50:0/2234136167 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fab780a2ca0 0x7fab780a5160 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fab7c0098e0 tx=0x7fab7c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:41.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.190+0000 7fab89ffb700 1 -- 172.21.15.50:0/2234136167 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fab74014030 con 0x7fab8c101d50 2024-06-06T03:23:41.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.429+0000 7fab927f0700 1 -- 172.21.15.50:0/2234136167 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fab8c0628d0 con 0x7fab780a2ca0 2024-06-06T03:23:41.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.455+0000 7fab89ffb700 1 -- 172.21.15.50:0/2234136167 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fab8c0628d0 con 0x7fab780a2ca0 2024-06-06T03:23:41.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.457+0000 7fab927f0700 1 -- 172.21.15.50:0/2234136167 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fab780a2ca0 msgr2=0x7fab780a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:41.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.457+0000 7fab927f0700 1 --2- 172.21.15.50:0/2234136167 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fab780a2ca0 0x7fab780a5160 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fab7c0098e0 tx=0x7fab7c005960 comp rx=0 tx=0).stop 2024-06-06T03:23:41.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.457+0000 7fab927f0700 1 -- 172.21.15.50:0/2234136167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab8c101d50 msgr2=0x7fab8c199e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:41.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.457+0000 7fab927f0700 1 --2- 172.21.15.50:0/2234136167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab8c101d50 0x7fab8c199e20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fab7400c9b0 tx=0x7fab7400ccc0 comp rx=0 tx=0).stop 2024-06-06T03:23:41.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.457+0000 7fab927f0700 1 -- 172.21.15.50:0/2234136167 shutdown_connections 2024-06-06T03:23:41.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.457+0000 7fab927f0700 1 --2- 172.21.15.50:0/2234136167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab8c107400 0x7fab8c1a4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:41.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.457+0000 7fab927f0700 1 --2- 172.21.15.50:0/2234136167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab8c101390 0x7fab8c1998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:41.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.457+0000 7fab927f0700 1 --2- 172.21.15.50:0/2234136167 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fab780a2ca0 0x7fab780a5160 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:41.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.457+0000 7fab927f0700 1 --2- 172.21.15.50:0/2234136167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab8c101d50 0x7fab8c199e20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:41.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.457+0000 7fab927f0700 1 -- 172.21.15.50:0/2234136167 >> 172.21.15.50:0/2234136167 conn(0x7fab8c078340 msgr2=0x7fab8c0fff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:41.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.457+0000 7fab927f0700 1 -- 172.21.15.50:0/2234136167 shutdown_connections 2024-06-06T03:23:41.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:41.457+0000 7fab927f0700 1 -- 172.21.15.50:0/2234136167 wait complete. 2024-06-06T03:23:41.751 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:23:41 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:23:41.435+0000 7f21981cc700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-06T03:23:41.751 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:23:41 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:23:41.435+0000 7f21981cc700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-06T03:23:41.751 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:23:41 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:23:41.435+0000 7f21981cc700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-06T03:23:41.751 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:23:41 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:23:41.435+0000 7f21981cc700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-06T03:23:41.752 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:23:41 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:23:41.435+0000 7f21981cc700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-06T03:23:42.150 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-06-06T03:23:42.405 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:23:42.865 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:42 smithi050 ceph-mon[32421]: pgmap v341: 129 pgs: 129 active+clean; 584 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-06-06T03:23:42.865 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:42 smithi050 ceph-mon[32421]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:23:42.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:42 smithi122 ceph-mon[35759]: pgmap v341: 129 pgs: 129 active+clean; 584 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-06-06T03:23:42.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:42 smithi122 ceph-mon[35759]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:23:43.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:42 smithi079 ceph-mon[35478]: pgmap v341: 129 pgs: 129 active+clean; 584 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-06-06T03:23:43.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:42 smithi079 ceph-mon[35478]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:23:44.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.027+0000 7f0b89527700 1 -- 172.21.15.50:0/3041985770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b84102770 msgr2=0x7f0b84102b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:44.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.027+0000 7f0b89527700 1 --2- 172.21.15.50:0/3041985770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b84102770 0x7f0b84102b50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0b740099c0 tx=0x7f0b74009cd0 comp rx=0 tx=0).stop 2024-06-06T03:23:44.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.027+0000 7f0b89527700 1 -- 172.21.15.50:0/3041985770 shutdown_connections 2024-06-06T03:23:44.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.027+0000 7f0b89527700 1 --2- 172.21.15.50:0/3041985770 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b84107860 0x7f0b8410f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:44.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.027+0000 7f0b89527700 1 --2- 172.21.15.50:0/3041985770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b84102770 0x7f0b84102b50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:44.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.027+0000 7f0b89527700 1 --2- 172.21.15.50:0/3041985770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b84103120 0x7f0b84107130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:44.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.028+0000 7f0b89527700 1 -- 172.21.15.50:0/3041985770 >> 172.21.15.50:0/3041985770 conn(0x7f0b84079600 msgr2=0x7f0b84079a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:44.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.028+0000 7f0b89527700 1 -- 172.21.15.50:0/3041985770 shutdown_connections 2024-06-06T03:23:44.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.028+0000 7f0b89527700 1 -- 172.21.15.50:0/3041985770 wait complete. 2024-06-06T03:23:44.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.028+0000 7f0b89527700 1 Processor -- start 2024-06-06T03:23:44.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.028+0000 7f0b89527700 1 -- start start 2024-06-06T03:23:44.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.029+0000 7f0b89527700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b84102770 0x7f0b8419e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:44.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.029+0000 7f0b89527700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b84103120 0x7f0b8419ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:44.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.029+0000 7f0b89527700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b84107860 0x7f0b841988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:44.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.029+0000 7f0b89527700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0b84112630 con 0x7f0b84107860 2024-06-06T03:23:44.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.029+0000 7f0b89527700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0b841124b0 con 0x7f0b84103120 2024-06-06T03:23:44.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.029+0000 7f0b89527700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0b841127b0 con 0x7f0b84102770 2024-06-06T03:23:44.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.029+0000 7f0b837fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b84107860 0x7f0b841988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:44.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.029+0000 7f0b837fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b84107860 0x7f0b841988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47854/0 (socket says 172.21.15.50:47854) 2024-06-06T03:23:44.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.029+0000 7f0b837fe700 1 -- 172.21.15.50:0/590733528 learned_addr learned my addr 172.21.15.50:0/590733528 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:23:44.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.029+0000 7f0b82ffd700 1 --2- 172.21.15.50:0/590733528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b84102770 0x7f0b8419e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:44.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.029+0000 7f0b7bfff700 1 --2- 172.21.15.50:0/590733528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b84103120 0x7f0b8419ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:44.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.029+0000 7f0b837fe700 1 -- 172.21.15.50:0/590733528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b84102770 msgr2=0x7f0b8419e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:44.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.029+0000 7f0b837fe700 1 --2- 172.21.15.50:0/590733528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b84102770 0x7f0b8419e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:44.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.029+0000 7f0b837fe700 1 -- 172.21.15.50:0/590733528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b84103120 msgr2=0x7f0b8419ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:44.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.029+0000 7f0b837fe700 1 --2- 172.21.15.50:0/590733528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b84103120 0x7f0b8419ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:44.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.029+0000 7f0b837fe700 1 -- 172.21.15.50:0/590733528 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b84199010 con 0x7f0b84107860 2024-06-06T03:23:44.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.029+0000 7f0b82ffd700 1 --2- 172.21.15.50:0/590733528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b84102770 0x7f0b8419e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:23:44.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.029+0000 7f0b7bfff700 1 --2- 172.21.15.50:0/590733528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b84103120 0x7f0b8419ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:23:44.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.029+0000 7f0b837fe700 1 --2- 172.21.15.50:0/590733528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b84107860 0x7f0b841988b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c007ee0 tx=0x7f0b7c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:44.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.030+0000 7f0b80ff9700 1 -- 172.21.15.50:0/590733528 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c00dbd0 con 0x7f0b84107860 2024-06-06T03:23:44.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.030+0000 7f0b89527700 1 -- 172.21.15.50:0/590733528 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b84199300 con 0x7f0b84107860 2024-06-06T03:23:44.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.030+0000 7f0b80ff9700 1 -- 172.21.15.50:0/590733528 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0b7c00dd70 con 0x7f0b84107860 2024-06-06T03:23:44.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.030+0000 7f0b80ff9700 1 -- 172.21.15.50:0/590733528 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c005a20 con 0x7f0b84107860 2024-06-06T03:23:44.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.030+0000 7f0b89527700 1 -- 172.21.15.50:0/590733528 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b841a5570 con 0x7f0b84107860 2024-06-06T03:23:44.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.031+0000 7f0b89527700 1 -- 172.21.15.50:0/590733528 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b8410aaa0 con 0x7f0b84107860 2024-06-06T03:23:44.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.032+0000 7f0b80ff9700 1 -- 172.21.15.50:0/590733528 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0b7c01a020 con 0x7f0b84107860 2024-06-06T03:23:44.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.032+0000 7f0b80ff9700 1 --2- 172.21.15.50:0/590733528 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f0b700a2cb0 0x7f0b700a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:44.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.032+0000 7f0b82ffd700 1 --2- 172.21.15.50:0/590733528 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f0b700a2cb0 0x7f0b700a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:44.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.032+0000 7f0b80ff9700 1 -- 172.21.15.50:0/590733528 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7f0b7c0ced50 con 0x7f0b84107860 2024-06-06T03:23:44.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.033+0000 7f0b82ffd700 1 --2- 172.21.15.50:0/590733528 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f0b700a2cb0 0x7f0b700a5170 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0b74000c00 tx=0x7f0b74005940 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:44.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.037+0000 7f0b80ff9700 1 -- 172.21.15.50:0/590733528 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0b7c010070 con 0x7f0b84107860 2024-06-06T03:23:44.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.278+0000 7f0b89527700 1 -- 172.21.15.50:0/590733528 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f0b840628d0 con 0x7f0b700a2cb0 2024-06-06T03:23:44.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.307+0000 7f0b80ff9700 1 -- 172.21.15.50:0/590733528 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0b840628d0 con 0x7f0b700a2cb0 2024-06-06T03:23:44.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.309+0000 7f0b89527700 1 -- 172.21.15.50:0/590733528 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f0b700a2cb0 msgr2=0x7f0b700a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:44.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.309+0000 7f0b89527700 1 --2- 172.21.15.50:0/590733528 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f0b700a2cb0 0x7f0b700a5170 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0b74000c00 tx=0x7f0b74005940 comp rx=0 tx=0).stop 2024-06-06T03:23:44.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.309+0000 7f0b89527700 1 -- 172.21.15.50:0/590733528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b84107860 msgr2=0x7f0b841988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.309+0000 7f0b89527700 1 --2- 172.21.15.50:0/590733528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b84107860 0x7f0b841988b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c007ee0 tx=0x7f0b7c00d3b0 comp rx=0 tx=0).stop 2024-06-06T03:23:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.309+0000 7f0b89527700 1 -- 172.21.15.50:0/590733528 shutdown_connections 2024-06-06T03:23:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.309+0000 7f0b89527700 1 --2- 172.21.15.50:0/590733528 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f0b700a2cb0 0x7f0b700a5170 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.309+0000 7f0b89527700 1 --2- 172.21.15.50:0/590733528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b84107860 0x7f0b841988b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.309+0000 7f0b89527700 1 --2- 172.21.15.50:0/590733528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b84102770 0x7f0b8419e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.309+0000 7f0b89527700 1 --2- 172.21.15.50:0/590733528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b84103120 0x7f0b8419ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.309+0000 7f0b89527700 1 -- 172.21.15.50:0/590733528 >> 172.21.15.50:0/590733528 conn(0x7f0b84079600 msgr2=0x7f0b84101c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.309+0000 7f0b89527700 1 -- 172.21.15.50:0/590733528 shutdown_connections 2024-06-06T03:23:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:44.309+0000 7f0b89527700 1 -- 172.21.15.50:0/590733528 wait complete. 2024-06-06T03:23:44.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:44 smithi122 ceph-mon[35759]: pgmap v342: 129 pgs: 129 active+clean; 584 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-06-06T03:23:44.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:44 smithi122 ceph-mon[35759]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-06-06T03:23:44.987 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:44 smithi050 ceph-mon[32421]: pgmap v342: 129 pgs: 129 active+clean; 584 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-06-06T03:23:44.987 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:44 smithi050 ceph-mon[32421]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-06-06T03:23:45.023 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-06-06T03:23:45.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:44 smithi079 ceph-mon[35478]: pgmap v342: 129 pgs: 129 active+clean; 584 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-06-06T03:23:45.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:44 smithi079 ceph-mon[35478]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-06-06T03:23:45.279 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:23:45.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:45 smithi122 ceph-mon[35759]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:23:45.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:45 smithi050 ceph-mon[32421]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:23:46.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:45 smithi079 ceph-mon[35478]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:23:46.908 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:46 smithi050 ceph-mon[32421]: pgmap v343: 129 pgs: 129 active+clean; 591 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-06-06T03:23:46.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.929+0000 7efee418a700 1 -- 172.21.15.50:0/1099246575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efedc06b100 msgr2=0x7efedc06b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:46.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.929+0000 7efee418a700 1 --2- 172.21.15.50:0/1099246575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efedc06b100 0x7efedc06b580 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7efecc009990 tx=0x7efecc009ca0 comp rx=0 tx=0).stop 2024-06-06T03:23:46.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.929+0000 7efee418a700 1 -- 172.21.15.50:0/1099246575 shutdown_connections 2024-06-06T03:23:46.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.929+0000 7efee418a700 1 --2- 172.21.15.50:0/1099246575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efedc10ede0 0x7efedc1111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:46.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.929+0000 7efee418a700 1 --2- 172.21.15.50:0/1099246575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efedc103410 0x7efedc06abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:46.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.929+0000 7efee418a700 1 --2- 172.21.15.50:0/1099246575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efedc06b100 0x7efedc06b580 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:46.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.929+0000 7efee418a700 1 -- 172.21.15.50:0/1099246575 >> 172.21.15.50:0/1099246575 conn(0x7efedc077200 msgr2=0x7efedc077610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:46.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.929+0000 7efee418a700 1 -- 172.21.15.50:0/1099246575 shutdown_connections 2024-06-06T03:23:46.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.929+0000 7efee418a700 1 -- 172.21.15.50:0/1099246575 wait complete. 2024-06-06T03:23:46.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.930+0000 7efee418a700 1 Processor -- start 2024-06-06T03:23:46.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.930+0000 7efee418a700 1 -- start start 2024-06-06T03:23:46.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.930+0000 7efee418a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efedc06b100 0x7efedc19ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:46.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.930+0000 7efee418a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efedc103410 0x7efedc19b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:46.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.930+0000 7efee418a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efedc10ede0 0x7efedc19f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:46.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.930+0000 7efee418a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efedc1148e0 con 0x7efedc103410 2024-06-06T03:23:46.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.930+0000 7efee418a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efedc114760 con 0x7efedc10ede0 2024-06-06T03:23:46.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.930+0000 7efee418a700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efedc114a60 con 0x7efedc06b100 2024-06-06T03:23:46.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.930+0000 7efee1725700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efedc103410 0x7efedc19b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:46.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.930+0000 7efee1725700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efedc103410 0x7efedc19b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47870/0 (socket says 172.21.15.50:47870) 2024-06-06T03:23:46.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.930+0000 7efee1725700 1 -- 172.21.15.50:0/1399713892 learned_addr learned my addr 172.21.15.50:0/1399713892 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:23:46.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.930+0000 7efee2727700 1 --2- 172.21.15.50:0/1399713892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efedc10ede0 0x7efedc19f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:46.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.930+0000 7efee1f26700 1 --2- 172.21.15.50:0/1399713892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efedc06b100 0x7efedc19ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:46.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.931+0000 7efee1725700 1 -- 172.21.15.50:0/1399713892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efedc06b100 msgr2=0x7efedc19ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:46.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.931+0000 7efee1725700 1 --2- 172.21.15.50:0/1399713892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efedc06b100 0x7efedc19ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:46.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.931+0000 7efee1725700 1 -- 172.21.15.50:0/1399713892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efedc10ede0 msgr2=0x7efedc19f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:46.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.931+0000 7efee1725700 1 --2- 172.21.15.50:0/1399713892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efedc10ede0 0x7efedc19f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:46.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.931+0000 7efee1725700 1 -- 172.21.15.50:0/1399713892 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efedc19fe20 con 0x7efedc103410 2024-06-06T03:23:46.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.931+0000 7efee1f26700 1 --2- 172.21.15.50:0/1399713892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efedc06b100 0x7efedc19ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:23:46.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.931+0000 7efee1725700 1 --2- 172.21.15.50:0/1399713892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efedc103410 0x7efedc19b350 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7efecc000c00 tx=0x7efecc003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:46.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.931+0000 7efed2ffd700 1 -- 172.21.15.50:0/1399713892 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efecc027070 con 0x7efedc103410 2024-06-06T03:23:46.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.931+0000 7efed2ffd700 1 -- 172.21.15.50:0/1399713892 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efecc00bdc0 con 0x7efedc103410 2024-06-06T03:23:46.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.931+0000 7efee418a700 1 -- 172.21.15.50:0/1399713892 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efedc1a00b0 con 0x7efedc103410 2024-06-06T03:23:46.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.931+0000 7efed2ffd700 1 -- 172.21.15.50:0/1399713892 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efecc00f460 con 0x7efedc103410 2024-06-06T03:23:46.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.931+0000 7efee418a700 1 -- 172.21.15.50:0/1399713892 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efedc1a7990 con 0x7efedc103410 2024-06-06T03:23:46.934 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:46 smithi122 ceph-mon[35759]: pgmap v343: 129 pgs: 129 active+clean; 591 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-06-06T03:23:46.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.932+0000 7efee418a700 1 -- 172.21.15.50:0/1399713892 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efedc101a10 con 0x7efedc103410 2024-06-06T03:23:46.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.933+0000 7efed2ffd700 1 -- 172.21.15.50:0/1399713892 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7efecc02a070 con 0x7efedc103410 2024-06-06T03:23:46.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.934+0000 7efed2ffd700 1 --2- 172.21.15.50:0/1399713892 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7efec80a2d30 0x7efec80a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:46.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.934+0000 7efee1f26700 1 --2- 172.21.15.50:0/1399713892 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7efec80a2d30 0x7efec80a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:46.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.934+0000 7efed2ffd700 1 -- 172.21.15.50:0/1399713892 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7efecc0d0870 con 0x7efedc103410 2024-06-06T03:23:46.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.935+0000 7efee1f26700 1 --2- 172.21.15.50:0/1399713892 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7efec80a2d30 0x7efec80a51f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7efed8005950 tx=0x7efed8005f30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:46.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:46.938+0000 7efed2ffd700 1 -- 172.21.15.50:0/1399713892 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7efecc031070 con 0x7efedc103410 2024-06-06T03:23:47.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:46 smithi079 ceph-mon[35478]: pgmap v343: 129 pgs: 129 active+clean; 591 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-06-06T03:23:47.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:47.180+0000 7efee418a700 1 -- 172.21.15.50:0/1399713892 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7efedc100de0 con 0x7efec80a2d30 2024-06-06T03:23:47.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:47.186+0000 7efed2ffd700 1 -- 172.21.15.50:0/1399713892 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7efedc100de0 con 0x7efec80a2d30 2024-06-06T03:23:47.186 INFO:teuthology.orchestra.run.smithi050.stdout:/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df 2024-06-06T03:23:47.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:47.189+0000 7efee418a700 1 -- 172.21.15.50:0/1399713892 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7efec80a2d30 msgr2=0x7efec80a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:47.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:47.189+0000 7efee418a700 1 --2- 172.21.15.50:0/1399713892 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7efec80a2d30 0x7efec80a51f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7efed8005950 tx=0x7efed8005f30 comp rx=0 tx=0).stop 2024-06-06T03:23:47.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:47.189+0000 7efee418a700 1 -- 172.21.15.50:0/1399713892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efedc103410 msgr2=0x7efedc19b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:47.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:47.189+0000 7efee418a700 1 --2- 172.21.15.50:0/1399713892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efedc103410 0x7efedc19b350 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7efecc000c00 tx=0x7efecc003a80 comp rx=0 tx=0).stop 2024-06-06T03:23:47.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:47.189+0000 7efee418a700 1 -- 172.21.15.50:0/1399713892 shutdown_connections 2024-06-06T03:23:47.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:47.189+0000 7efee418a700 1 --2- 172.21.15.50:0/1399713892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efedc10ede0 0x7efedc19f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:47.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:47.189+0000 7efee418a700 1 --2- 172.21.15.50:0/1399713892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efedc06b100 0x7efedc19ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:47.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:47.189+0000 7efee418a700 1 --2- 172.21.15.50:0/1399713892 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7efec80a2d30 0x7efec80a51f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:47.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:47.189+0000 7efee418a700 1 --2- 172.21.15.50:0/1399713892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efedc103410 0x7efedc19b350 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:47.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:47.189+0000 7efee418a700 1 -- 172.21.15.50:0/1399713892 >> 172.21.15.50:0/1399713892 conn(0x7efedc077200 msgr2=0x7efedc1006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:47.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:47.189+0000 7efee418a700 1 -- 172.21.15.50:0/1399713892 shutdown_connections 2024-06-06T03:23:47.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:47.189+0000 7efee418a700 1 -- 172.21.15.50:0/1399713892 wait complete. 2024-06-06T03:23:47.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:47 smithi050 ceph-mon[32421]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:23:47.834 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-06-06T03:23:47.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:47 smithi122 ceph-mon[35759]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:23:48.083 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:23:48.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:47 smithi079 ceph-mon[35478]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:23:48.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:48 smithi050 ceph-mon[32421]: pgmap v344: 129 pgs: 129 active+clean; 591 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-06-06T03:23:48.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:48 smithi122 ceph-mon[35759]: pgmap v344: 129 pgs: 129 active+clean; 591 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-06-06T03:23:49.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:48 smithi079 ceph-mon[35478]: pgmap v344: 129 pgs: 129 active+clean; 591 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-06-06T03:23:49.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.737+0000 7f3e91498700 1 -- 172.21.15.50:0/1440189166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e8c107840 msgr2=0x7f3e8c10f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:49.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.737+0000 7f3e91498700 1 --2- 172.21.15.50:0/1440189166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e8c107840 0x7f3e8c10f3c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3e8400b0d0 tx=0x7f3e8400b3e0 comp rx=0 tx=0).stop 2024-06-06T03:23:49.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.737+0000 7f3e91498700 1 -- 172.21.15.50:0/1440189166 shutdown_connections 2024-06-06T03:23:49.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.737+0000 7f3e91498700 1 --2- 172.21.15.50:0/1440189166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e8c107840 0x7f3e8c10f3c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:49.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.737+0000 7f3e91498700 1 --2- 172.21.15.50:0/1440189166 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e8c102740 0x7f3e8c102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:49.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.737+0000 7f3e91498700 1 --2- 172.21.15.50:0/1440189166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e8c1030f0 0x7f3e8c107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:49.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.737+0000 7f3e91498700 1 -- 172.21.15.50:0/1440189166 >> 172.21.15.50:0/1440189166 conn(0x7f3e8c0795f0 msgr2=0x7f3e8c079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:49.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.737+0000 7f3e91498700 1 -- 172.21.15.50:0/1440189166 shutdown_connections 2024-06-06T03:23:49.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.737+0000 7f3e91498700 1 -- 172.21.15.50:0/1440189166 wait complete. 2024-06-06T03:23:49.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.737+0000 7f3e91498700 1 Processor -- start 2024-06-06T03:23:49.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.738+0000 7f3e91498700 1 -- start start 2024-06-06T03:23:49.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.738+0000 7f3e91498700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e8c102740 0x7f3e8c1a0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:49.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.738+0000 7f3e91498700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e8c1030f0 0x7f3e8c1a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:49.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.738+0000 7f3e91498700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e8c107840 0x7f3e8c19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:49.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.738+0000 7f3e91498700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8c112610 con 0x7f3e8c1030f0 2024-06-06T03:23:49.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.738+0000 7f3e91498700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8c112490 con 0x7f3e8c102740 2024-06-06T03:23:49.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.738+0000 7f3e91498700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8c112790 con 0x7f3e8c107840 2024-06-06T03:23:49.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.738+0000 7f3e8a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e8c1030f0 0x7f3e8c1a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:49.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.738+0000 7f3e8a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e8c1030f0 0x7f3e8c1a0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33148/0 (socket says 172.21.15.50:33148) 2024-06-06T03:23:49.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.738+0000 7f3e8a7fc700 1 -- 172.21.15.50:0/3286530946 learned_addr learned my addr 172.21.15.50:0/3286530946 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:23:49.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.738+0000 7f3e8affd700 1 --2- 172.21.15.50:0/3286530946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e8c102740 0x7f3e8c1a0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:49.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.738+0000 7f3e8b7fe700 1 --2- 172.21.15.50:0/3286530946 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e8c107840 0x7f3e8c19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:49.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.738+0000 7f3e8a7fc700 1 -- 172.21.15.50:0/3286530946 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e8c107840 msgr2=0x7f3e8c19aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:49.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.738+0000 7f3e8a7fc700 1 --2- 172.21.15.50:0/3286530946 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e8c107840 0x7f3e8c19aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:49.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.738+0000 7f3e8a7fc700 1 -- 172.21.15.50:0/3286530946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e8c102740 msgr2=0x7f3e8c1a0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:49.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.738+0000 7f3e8a7fc700 1 --2- 172.21.15.50:0/3286530946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e8c102740 0x7f3e8c1a0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:49.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.738+0000 7f3e8a7fc700 1 -- 172.21.15.50:0/3286530946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e8c19b1b0 con 0x7f3e8c1030f0 2024-06-06T03:23:49.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.738+0000 7f3e8b7fe700 1 --2- 172.21.15.50:0/3286530946 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e8c107840 0x7f3e8c19aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:23:49.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.738+0000 7f3e8a7fc700 1 --2- 172.21.15.50:0/3286530946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e8c1030f0 0x7f3e8c1a0dd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3e8000d980 tx=0x7f3e8000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:49.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.739+0000 7f3e73fff700 1 -- 172.21.15.50:0/3286530946 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e80016070 con 0x7f3e8c1030f0 2024-06-06T03:23:49.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.739+0000 7f3e91498700 1 -- 172.21.15.50:0/3286530946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e8c19b4a0 con 0x7f3e8c1030f0 2024-06-06T03:23:49.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.739+0000 7f3e73fff700 1 -- 172.21.15.50:0/3286530946 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3e80004830 con 0x7f3e8c1030f0 2024-06-06T03:23:49.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.739+0000 7f3e73fff700 1 -- 172.21.15.50:0/3286530946 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e800054b0 con 0x7f3e8c1030f0 2024-06-06T03:23:49.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.739+0000 7f3e91498700 1 -- 172.21.15.50:0/3286530946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e8c1a7760 con 0x7f3e8c1030f0 2024-06-06T03:23:49.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.740+0000 7f3e91498700 1 -- 172.21.15.50:0/3286530946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e8c069180 con 0x7f3e8c1030f0 2024-06-06T03:23:49.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.741+0000 7f3e73fff700 1 -- 172.21.15.50:0/3286530946 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3e800049e0 con 0x7f3e8c1030f0 2024-06-06T03:23:49.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.741+0000 7f3e73fff700 1 --2- 172.21.15.50:0/3286530946 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f3e740a2cb0 0x7f3e740a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:49.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.742+0000 7f3e8affd700 1 --2- 172.21.15.50:0/3286530946 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f3e740a2cb0 0x7f3e740a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:49.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.742+0000 7f3e73fff700 1 -- 172.21.15.50:0/3286530946 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7f3e800cf330 con 0x7f3e8c1030f0 2024-06-06T03:23:49.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.742+0000 7f3e8affd700 1 --2- 172.21.15.50:0/3286530946 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f3e740a2cb0 0x7f3e740a5170 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c19bb90 tx=0x7f3e7c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:49.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.746+0000 7f3e73fff700 1 -- 172.21.15.50:0/3286530946 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3e8001f020 con 0x7f3e8c1030f0 2024-06-06T03:23:49.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:49.983+0000 7f3e91498700 1 -- 172.21.15.50:0/3286530946 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f3e8c10e720 con 0x7f3e740a2cb0 2024-06-06T03:23:50.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:50.010+0000 7f3e73fff700 1 -- 172.21.15.50:0/3286530946 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3e8c10e720 con 0x7f3e740a2cb0 2024-06-06T03:23:50.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:50.012+0000 7f3e91498700 1 -- 172.21.15.50:0/3286530946 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f3e740a2cb0 msgr2=0x7f3e740a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:50.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:50.012+0000 7f3e91498700 1 --2- 172.21.15.50:0/3286530946 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f3e740a2cb0 0x7f3e740a5170 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c19bb90 tx=0x7f3e7c00b410 comp rx=0 tx=0).stop 2024-06-06T03:23:50.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:50.012+0000 7f3e91498700 1 -- 172.21.15.50:0/3286530946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e8c1030f0 msgr2=0x7f3e8c1a0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:50.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:50.012+0000 7f3e91498700 1 --2- 172.21.15.50:0/3286530946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e8c1030f0 0x7f3e8c1a0dd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3e8000d980 tx=0x7f3e8000dc90 comp rx=0 tx=0).stop 2024-06-06T03:23:50.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:50.012+0000 7f3e91498700 1 -- 172.21.15.50:0/3286530946 shutdown_connections 2024-06-06T03:23:50.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:50.012+0000 7f3e91498700 1 --2- 172.21.15.50:0/3286530946 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e8c107840 0x7f3e8c19aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:50.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:50.012+0000 7f3e91498700 1 --2- 172.21.15.50:0/3286530946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e8c102740 0x7f3e8c1a0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:50.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:50.012+0000 7f3e91498700 1 --2- 172.21.15.50:0/3286530946 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f3e740a2cb0 0x7f3e740a5170 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:50.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:50.012+0000 7f3e91498700 1 --2- 172.21.15.50:0/3286530946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e8c1030f0 0x7f3e8c1a0dd0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:50.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:50.012+0000 7f3e91498700 1 -- 172.21.15.50:0/3286530946 >> 172.21.15.50:0/3286530946 conn(0x7f3e8c0795f0 msgr2=0x7f3e8c1007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:50.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:50.012+0000 7f3e91498700 1 -- 172.21.15.50:0/3286530946 shutdown_connections 2024-06-06T03:23:50.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:50.012+0000 7f3e91498700 1 -- 172.21.15.50:0/3286530946 wait complete. 2024-06-06T03:23:50.767 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-06-06T03:23:50.933 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:50 smithi122 ceph-mon[35759]: pgmap v345: 129 pgs: 129 active+clean; 610 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.0 KiB/s wr, 10 op/s 2024-06-06T03:23:50.934 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:50 smithi122 ceph-mon[35759]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:23:51.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:50 smithi050 ceph-mon[32421]: pgmap v345: 129 pgs: 129 active+clean; 610 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.0 KiB/s wr, 10 op/s 2024-06-06T03:23:51.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:50 smithi050 ceph-mon[32421]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:23:51.024 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:23:51.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:50 smithi079 ceph-mon[35478]: pgmap v345: 129 pgs: 129 active+clean; 610 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.0 KiB/s wr, 10 op/s 2024-06-06T03:23:51.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:50 smithi079 ceph-mon[35478]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:23:52.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.729+0000 7f040349f700 1 -- 172.21.15.50:0/2259825156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03fc102740 msgr2=0x7f03fc102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:52.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.729+0000 7f040349f700 1 --2- 172.21.15.50:0/2259825156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03fc102740 0x7f03fc102b20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f03f80099c0 tx=0x7f03f8009cd0 comp rx=0 tx=0).stop 2024-06-06T03:23:52.728 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:52 smithi050 ceph-mon[32421]: pgmap v346: 129 pgs: 129 active+clean; 610 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-06-06T03:23:52.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.729+0000 7f040349f700 1 -- 172.21.15.50:0/2259825156 shutdown_connections 2024-06-06T03:23:52.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.729+0000 7f040349f700 1 --2- 172.21.15.50:0/2259825156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03fc107840 0x7f03fc10f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:52.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.729+0000 7f040349f700 1 --2- 172.21.15.50:0/2259825156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03fc102740 0x7f03fc102b20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:52.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.729+0000 7f040349f700 1 --2- 172.21.15.50:0/2259825156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03fc1030f0 0x7f03fc107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:52.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.729+0000 7f040349f700 1 -- 172.21.15.50:0/2259825156 >> 172.21.15.50:0/2259825156 conn(0x7f03fc0795f0 msgr2=0x7f03fc079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:52.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.729+0000 7f040349f700 1 -- 172.21.15.50:0/2259825156 shutdown_connections 2024-06-06T03:23:52.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.729+0000 7f040349f700 1 -- 172.21.15.50:0/2259825156 wait complete. 2024-06-06T03:23:52.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.729+0000 7f040349f700 1 Processor -- start 2024-06-06T03:23:52.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.730+0000 7f040349f700 1 -- start start 2024-06-06T03:23:52.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.730+0000 7f040349f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03fc102740 0x7f03fc19e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:52.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.730+0000 7f040349f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03fc1030f0 0x7f03fc19ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:52.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.730+0000 7f040349f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03fc107840 0x7f03fc198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:52.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.730+0000 7f040349f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f03fc112690 con 0x7f03fc102740 2024-06-06T03:23:52.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.730+0000 7f040349f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f03fc112510 con 0x7f03fc107840 2024-06-06T03:23:52.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.730+0000 7f040349f700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f03fc112810 con 0x7f03fc1030f0 2024-06-06T03:23:52.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.730+0000 7f040123b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03fc102740 0x7f03fc19e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:52.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.730+0000 7f040123b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03fc102740 0x7f03fc19e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33172/0 (socket says 172.21.15.50:33172) 2024-06-06T03:23:52.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.730+0000 7f040123b700 1 -- 172.21.15.50:0/1653007055 learned_addr learned my addr 172.21.15.50:0/1653007055 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:23:52.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.730+0000 7f0400a3a700 1 --2- 172.21.15.50:0/1653007055 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03fc1030f0 0x7f03fc19ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:52.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.730+0000 7f0401a3c700 1 --2- 172.21.15.50:0/1653007055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03fc107840 0x7f03fc198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:52.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.730+0000 7f040123b700 1 -- 172.21.15.50:0/1653007055 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03fc1030f0 msgr2=0x7f03fc19ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:52.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.730+0000 7f040123b700 1 --2- 172.21.15.50:0/1653007055 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03fc1030f0 0x7f03fc19ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:52.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.730+0000 7f040123b700 1 -- 172.21.15.50:0/1653007055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03fc107840 msgr2=0x7f03fc198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:52.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.730+0000 7f040123b700 1 --2- 172.21.15.50:0/1653007055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03fc107840 0x7f03fc198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:52.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.730+0000 7f040123b700 1 -- 172.21.15.50:0/1653007055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03fc199070 con 0x7f03fc102740 2024-06-06T03:23:52.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.730+0000 7f0401a3c700 1 --2- 172.21.15.50:0/1653007055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03fc107840 0x7f03fc198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:23:52.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.731+0000 7f040123b700 1 --2- 172.21.15.50:0/1653007055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03fc102740 0x7f03fc19e700 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f03f8009fd0 tx=0x7f03f80047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:52.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.731+0000 7f03f27fc700 1 -- 172.21.15.50:0/1653007055 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f8027070 con 0x7f03fc102740 2024-06-06T03:23:52.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.731+0000 7f03f27fc700 1 -- 172.21.15.50:0/1653007055 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f03f8004050 con 0x7f03fc102740 2024-06-06T03:23:52.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.731+0000 7f03f27fc700 1 -- 172.21.15.50:0/1653007055 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f8022d80 con 0x7f03fc102740 2024-06-06T03:23:52.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.731+0000 7f040349f700 1 -- 172.21.15.50:0/1653007055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03fc199300 con 0x7f03fc102740 2024-06-06T03:23:52.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.731+0000 7f040349f700 1 -- 172.21.15.50:0/1653007055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03fc1a55d0 con 0x7f03fc102740 2024-06-06T03:23:52.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.732+0000 7f040349f700 1 -- 172.21.15.50:0/1653007055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03fc069180 con 0x7f03fc102740 2024-06-06T03:23:52.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.733+0000 7f03f27fc700 1 -- 172.21.15.50:0/1653007055 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f03f802a070 con 0x7f03fc102740 2024-06-06T03:23:52.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.734+0000 7f03f27fc700 1 --2- 172.21.15.50:0/1653007055 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f03e80a2d30 0x7f03e80a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:52.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.734+0000 7f0400a3a700 1 --2- 172.21.15.50:0/1653007055 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f03e80a2d30 0x7f03e80a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:52.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.734+0000 7f03f27fc700 1 -- 172.21.15.50:0/1653007055 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7f03f80d0bc0 con 0x7f03fc102740 2024-06-06T03:23:52.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.734+0000 7f0400a3a700 1 --2- 172.21.15.50:0/1653007055 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f03e80a2d30 0x7f03e80a51f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f03fc102020 tx=0x7f03ec00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:52.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.737+0000 7f03f27fc700 1 -- 172.21.15.50:0/1653007055 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f03f8031070 con 0x7f03fc102740 2024-06-06T03:23:52.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:52 smithi122 ceph-mon[35759]: pgmap v346: 129 pgs: 129 active+clean; 610 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-06-06T03:23:52.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.977+0000 7f040349f700 1 -- 172.21.15.50:0/1653007055 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f03fc199df0 con 0x7f03e80a2d30 2024-06-06T03:23:52.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.982+0000 7f03f27fc700 1 -- 172.21.15.50:0/1653007055 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f03fc199df0 con 0x7f03e80a2d30 2024-06-06T03:23:52.981 INFO:teuthology.orchestra.run.smithi050.stdout:/volumes/qa/sv_1/493f83bd-673b-4832-bd6f-dd63eb0b158e 2024-06-06T03:23:52.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.984+0000 7f040349f700 1 -- 172.21.15.50:0/1653007055 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f03e80a2d30 msgr2=0x7f03e80a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:52.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.984+0000 7f040349f700 1 --2- 172.21.15.50:0/1653007055 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f03e80a2d30 0x7f03e80a51f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f03fc102020 tx=0x7f03ec00a380 comp rx=0 tx=0).stop 2024-06-06T03:23:52.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.984+0000 7f040349f700 1 -- 172.21.15.50:0/1653007055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03fc102740 msgr2=0x7f03fc19e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:52.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.984+0000 7f040349f700 1 --2- 172.21.15.50:0/1653007055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03fc102740 0x7f03fc19e700 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f03f8009fd0 tx=0x7f03f80047b0 comp rx=0 tx=0).stop 2024-06-06T03:23:52.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.984+0000 7f040349f700 1 -- 172.21.15.50:0/1653007055 shutdown_connections 2024-06-06T03:23:52.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.984+0000 7f040349f700 1 --2- 172.21.15.50:0/1653007055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03fc107840 0x7f03fc198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:52.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.984+0000 7f040349f700 1 --2- 172.21.15.50:0/1653007055 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f03e80a2d30 0x7f03e80a51f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:52.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.984+0000 7f040349f700 1 --2- 172.21.15.50:0/1653007055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03fc102740 0x7f03fc19e700 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:52.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.984+0000 7f040349f700 1 --2- 172.21.15.50:0/1653007055 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03fc1030f0 0x7f03fc19ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:52.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.984+0000 7f040349f700 1 -- 172.21.15.50:0/1653007055 >> 172.21.15.50:0/1653007055 conn(0x7f03fc0795f0 msgr2=0x7f03fc1006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:52.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.984+0000 7f040349f700 1 -- 172.21.15.50:0/1653007055 shutdown_connections 2024-06-06T03:23:52.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:52.984+0000 7f040349f700 1 -- 172.21.15.50:0/1653007055 wait complete. 2024-06-06T03:23:53.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:52 smithi079 ceph-mon[35478]: pgmap v346: 129 pgs: 129 active+clean; 610 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-06-06T03:23:53.781 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T03:23:53.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:53 smithi122 ceph-mon[35759]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:23:54.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:53 smithi050 ceph-mon[32421]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:23:54.034 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:23:54.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:53 smithi079 ceph-mon[35478]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:23:54.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:54 smithi050 ceph-mon[32421]: pgmap v347: 129 pgs: 129 active+clean; 610 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-06-06T03:23:54.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:54 smithi122 ceph-mon[35759]: pgmap v347: 129 pgs: 129 active+clean; 610 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-06-06T03:23:55.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:54 smithi079 ceph-mon[35478]: pgmap v347: 129 pgs: 129 active+clean; 610 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-06-06T03:23:55.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.757+0000 7fceb517a700 1 -- 172.21.15.50:0/1733442157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fceb006ab60 msgr2=0x7fceb006afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:55.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.757+0000 7fceb517a700 1 --2- 172.21.15.50:0/1733442157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fceb006ab60 0x7fceb006afe0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcea4009990 tx=0x7fcea4009ca0 comp rx=0 tx=0).stop 2024-06-06T03:23:55.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.757+0000 7fceb517a700 1 -- 172.21.15.50:0/1733442157 shutdown_connections 2024-06-06T03:23:55.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.757+0000 7fceb517a700 1 --2- 172.21.15.50:0/1733442157 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fceb006b520 0x7fceb010f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:55.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.757+0000 7fceb517a700 1 --2- 172.21.15.50:0/1733442157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fceb0108520 0x7fceb0108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:55.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.757+0000 7fceb517a700 1 --2- 172.21.15.50:0/1733442157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fceb006ab60 0x7fceb006afe0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:55.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.757+0000 7fceb517a700 1 -- 172.21.15.50:0/1733442157 >> 172.21.15.50:0/1733442157 conn(0x7fceb0078340 msgr2=0x7fceb0078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:55.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.757+0000 7fceb517a700 1 -- 172.21.15.50:0/1733442157 shutdown_connections 2024-06-06T03:23:55.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.757+0000 7fceb517a700 1 -- 172.21.15.50:0/1733442157 wait complete. 2024-06-06T03:23:55.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.758+0000 7fceb517a700 1 Processor -- start 2024-06-06T03:23:55.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.759+0000 7fceb517a700 1 -- start start 2024-06-06T03:23:55.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.759+0000 7fceb517a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fceb006ab60 0x7fceb0101840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:55.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.759+0000 7fceb517a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fceb006b520 0x7fceb0101d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:55.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.759+0000 7fceb517a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fceb0108520 0x7fceb01022c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:55.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.759+0000 7fceb517a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fceb0112630 con 0x7fceb006ab60 2024-06-06T03:23:55.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.759+0000 7fceb517a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fceb01124b0 con 0x7fceb006b520 2024-06-06T03:23:55.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.759+0000 7fceb517a700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fceb01127b0 con 0x7fceb0108520 2024-06-06T03:23:55.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.759+0000 7fceaed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fceb006ab60 0x7fceb0101840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:55.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.759+0000 7fceaed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fceb006ab60 0x7fceb0101840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33202/0 (socket says 172.21.15.50:33202) 2024-06-06T03:23:55.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.759+0000 7fceaed9d700 1 -- 172.21.15.50:0/4226170214 learned_addr learned my addr 172.21.15.50:0/4226170214 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:23:55.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.759+0000 7fceae59c700 1 --2- 172.21.15.50:0/4226170214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fceb006b520 0x7fceb0101d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:55.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.759+0000 7fceaf59e700 1 --2- 172.21.15.50:0/4226170214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fceb0108520 0x7fceb01022c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:55.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.759+0000 7fceaed9d700 1 -- 172.21.15.50:0/4226170214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fceb0108520 msgr2=0x7fceb01022c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:55.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.759+0000 7fceaed9d700 1 --2- 172.21.15.50:0/4226170214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fceb0108520 0x7fceb01022c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:55.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.759+0000 7fceaed9d700 1 -- 172.21.15.50:0/4226170214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fceb006b520 msgr2=0x7fceb0101d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:55.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.759+0000 7fceaed9d700 1 --2- 172.21.15.50:0/4226170214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fceb006b520 0x7fceb0101d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:55.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.759+0000 7fceaed9d700 1 -- 172.21.15.50:0/4226170214 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceb01a7130 con 0x7fceb006ab60 2024-06-06T03:23:55.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.760+0000 7fceaed9d700 1 --2- 172.21.15.50:0/4226170214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fceb006ab60 0x7fceb0101840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcea000d950 tx=0x7fcea000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:55.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.760+0000 7fce97fff700 1 -- 172.21.15.50:0/4226170214 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea0016070 con 0x7fceb006ab60 2024-06-06T03:23:55.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.760+0000 7fceb517a700 1 -- 172.21.15.50:0/4226170214 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fceb01a7420 con 0x7fceb006ab60 2024-06-06T03:23:55.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.760+0000 7fce97fff700 1 -- 172.21.15.50:0/4226170214 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcea000fd40 con 0x7fceb006ab60 2024-06-06T03:23:55.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.760+0000 7fce97fff700 1 -- 172.21.15.50:0/4226170214 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea000e3b0 con 0x7fceb006ab60 2024-06-06T03:23:55.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.760+0000 7fceb517a700 1 -- 172.21.15.50:0/4226170214 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fceb01a7980 con 0x7fceb006ab60 2024-06-06T03:23:55.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.761+0000 7fceb517a700 1 -- 172.21.15.50:0/4226170214 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fceb0103be0 con 0x7fceb006ab60 2024-06-06T03:23:55.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.762+0000 7fce97fff700 1 -- 172.21.15.50:0/4226170214 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fcea0019070 con 0x7fceb006ab60 2024-06-06T03:23:55.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.763+0000 7fce97fff700 1 --2- 172.21.15.50:0/4226170214 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fce980a2cb0 0x7fce980a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:55.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.763+0000 7fceae59c700 1 --2- 172.21.15.50:0/4226170214 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fce980a2cb0 0x7fce980a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:55.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.763+0000 7fce97fff700 1 -- 172.21.15.50:0/4226170214 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7fcea00cef90 con 0x7fceb006ab60 2024-06-06T03:23:55.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.763+0000 7fceae59c700 1 --2- 172.21.15.50:0/4226170214 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fce980a2cb0 0x7fce980a5170 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcea400b5c0 tx=0x7fcea4005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:55.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:55.767+0000 7fce97fff700 1 -- 172.21.15.50:0/4226170214 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fcea009ba30 con 0x7fceb006ab60 2024-06-06T03:23:56.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:56.018+0000 7fceb517a700 1 -- 172.21.15.50:0/4226170214 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fceb002dca0 con 0x7fceb006ab60 2024-06-06T03:23:56.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:56.019+0000 7fce97fff700 1 -- 172.21.15.50:0/4226170214 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11855 (secure 0 0 0) 0x7fcea009b330 con 0x7fceb006ab60 2024-06-06T03:23:56.018 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:23:56.018 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1667847852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1667847852},{"type":"v1","addr":"172.21.15.50:6835","nonce":1667847852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/239971838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":239971838},{"type":"v1","addr":"172.21.15.50:6837","nonce":239971838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/2188134216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2188134216},{"type":"v1","addr":"172.21.15.50:6839","nonce":2188134216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/632572420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":632572420},{"type":"v1","addr":"172.21.15.50:6841","nonce":632572420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/864537078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":864537078},{"type":"v1","addr":"172.21.15.79:6833","nonce":864537078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/279268898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":279268898},{"type":"v1","addr":"172.21.15.79:6835","nonce":279268898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T03:22:36.202061+0000","modified":"2024-06-06T03:23:38.564714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24490,"mds_1":24472,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/57533154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":57533154},{"type":"v1","addr":"172.21.15.122:6833","nonce":57533154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/3286722213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3286722213},{"type":"v1","addr":"172.21.15.79:6837","nonce":3286722213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/768067336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":768067336},{"type":"v1","addr":"172.21.15.79:6839","nonce":768067336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.122:6835/2987597320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2987597320},{"type":"v1","addr":"172.21.15.122:6835","nonce":2987597320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":23,"addr":"172.21.15.122:6837/1604366318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1604366318},{"type":"v1","addr":"172.21.15.122:6837","nonce":1604366318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6839/4129732900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":4129732900},{"type":"v1","addr":"172.21.15.122:6839","nonce":4129732900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24472,24490,24466]},"id":1}]} 2024-06-06T03:23:56.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:56.021+0000 7fceb517a700 1 -- 172.21.15.50:0/4226170214 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fce980a2cb0 msgr2=0x7fce980a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:56.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:56.021+0000 7fceb517a700 1 --2- 172.21.15.50:0/4226170214 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fce980a2cb0 0x7fce980a5170 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcea400b5c0 tx=0x7fcea4005960 comp rx=0 tx=0).stop 2024-06-06T03:23:56.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:56.021+0000 7fceb517a700 1 -- 172.21.15.50:0/4226170214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fceb006ab60 msgr2=0x7fceb0101840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:56.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:56.021+0000 7fceb517a700 1 --2- 172.21.15.50:0/4226170214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fceb006ab60 0x7fceb0101840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcea000d950 tx=0x7fcea000dc60 comp rx=0 tx=0).stop 2024-06-06T03:23:56.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:56.021+0000 7fceb517a700 1 -- 172.21.15.50:0/4226170214 shutdown_connections 2024-06-06T03:23:56.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:56.021+0000 7fceb517a700 1 --2- 172.21.15.50:0/4226170214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fceb0108520 0x7fceb01022c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:56.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:56.021+0000 7fceb517a700 1 --2- 172.21.15.50:0/4226170214 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fce980a2cb0 0x7fce980a5170 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:56.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:56.021+0000 7fceb517a700 1 --2- 172.21.15.50:0/4226170214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fceb006ab60 0x7fceb0101840 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:56.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:56.021+0000 7fceb517a700 1 --2- 172.21.15.50:0/4226170214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fceb006b520 0x7fceb0101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:56.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:56.021+0000 7fceb517a700 1 -- 172.21.15.50:0/4226170214 >> 172.21.15.50:0/4226170214 conn(0x7fceb0078340 msgr2=0x7fceb01004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:56.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:56.021+0000 7fceb517a700 1 -- 172.21.15.50:0/4226170214 shutdown_connections 2024-06-06T03:23:56.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:56.021+0000 7fceb517a700 1 -- 172.21.15.50:0/4226170214 wait complete. 2024-06-06T03:23:56.022 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 26 2024-06-06T03:23:56.727 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-06T03:23:56.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:56 smithi122 ceph-mon[35759]: pgmap v348: 129 pgs: 129 active+clean; 632 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.3 KiB/s wr, 10 op/s 2024-06-06T03:23:56.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:56 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/4226170214' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:23:56.980 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:23:57.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:56 smithi050 ceph-mon[32421]: pgmap v348: 129 pgs: 129 active+clean; 632 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.3 KiB/s wr, 10 op/s 2024-06-06T03:23:57.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:56 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/4226170214' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:23:57.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:56 smithi079 ceph-mon[35478]: pgmap v348: 129 pgs: 129 active+clean; 632 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.3 KiB/s wr, 10 op/s 2024-06-06T03:23:57.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:56 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/4226170214' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:23:58.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.659+0000 7fc86519e700 1 -- 172.21.15.50:0/1714401020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc860106600 msgr2=0x7fc86010e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:58.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.659+0000 7fc86519e700 1 --2- 172.21.15.50:0/1714401020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc860106600 0x7fc86010e1d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc85800b0d0 tx=0x7fc85800b3e0 comp rx=0 tx=0).stop 2024-06-06T03:23:58.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.659+0000 7fc86519e700 1 -- 172.21.15.50:0/1714401020 shutdown_connections 2024-06-06T03:23:58.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.659+0000 7fc86519e700 1 --2- 172.21.15.50:0/1714401020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc860106600 0x7fc86010e1d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:58.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.659+0000 7fc86519e700 1 --2- 172.21.15.50:0/1714401020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc860101520 0x7fc860101900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:58.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.659+0000 7fc86519e700 1 --2- 172.21.15.50:0/1714401020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc860101ed0 0x7fc860105f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:58.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.659+0000 7fc86519e700 1 -- 172.21.15.50:0/1714401020 >> 172.21.15.50:0/1714401020 conn(0x7fc8600fcdb0 msgr2=0x7fc8600ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:58.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.659+0000 7fc86519e700 1 -- 172.21.15.50:0/1714401020 shutdown_connections 2024-06-06T03:23:58.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.659+0000 7fc86519e700 1 -- 172.21.15.50:0/1714401020 wait complete. 2024-06-06T03:23:58.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.660+0000 7fc86519e700 1 Processor -- start 2024-06-06T03:23:58.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.660+0000 7fc86519e700 1 -- start start 2024-06-06T03:23:58.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.660+0000 7fc86519e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc860101520 0x7fc8600fd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:58.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.660+0000 7fc86519e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc860101ed0 0x7fc8600fdca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:58.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.660+0000 7fc86519e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc860106600 0x7fc8600fe1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:58.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.660+0000 7fc86519e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc8601114c0 con 0x7fc860106600 2024-06-06T03:23:58.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.660+0000 7fc86519e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc860111340 con 0x7fc860101ed0 2024-06-06T03:23:58.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.660+0000 7fc86519e700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc860111640 con 0x7fc860101520 2024-06-06T03:23:58.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.661+0000 7fc86499d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc860106600 0x7fc8600fe1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:58.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.661+0000 7fc86499d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc860106600 0x7fc8600fe1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36076/0 (socket says 172.21.15.50:36076) 2024-06-06T03:23:58.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.661+0000 7fc86499d700 1 -- 172.21.15.50:0/1716604691 learned_addr learned my addr 172.21.15.50:0/1716604691 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:23:58.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.661+0000 7fc85ffff700 1 --2- 172.21.15.50:0/1716604691 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc860101520 0x7fc8600fd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:58.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.661+0000 7fc857fff700 1 --2- 172.21.15.50:0/1716604691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc860101ed0 0x7fc8600fdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:58.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.661+0000 7fc86499d700 1 -- 172.21.15.50:0/1716604691 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc860101520 msgr2=0x7fc8600fd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:58.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.661+0000 7fc86499d700 1 --2- 172.21.15.50:0/1716604691 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc860101520 0x7fc8600fd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:58.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.661+0000 7fc86499d700 1 -- 172.21.15.50:0/1716604691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc860101ed0 msgr2=0x7fc8600fdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:58.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.661+0000 7fc86499d700 1 --2- 172.21.15.50:0/1716604691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc860101ed0 0x7fc8600fdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:58.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.661+0000 7fc86499d700 1 -- 172.21.15.50:0/1716604691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8601a6f60 con 0x7fc860106600 2024-06-06T03:23:58.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.661+0000 7fc857fff700 1 --2- 172.21.15.50:0/1716604691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc860101ed0 0x7fc8600fdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:23:58.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.661+0000 7fc86499d700 1 --2- 172.21.15.50:0/1716604691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc860106600 0x7fc8600fe1e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc858007a00 tx=0x7fc858007a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:58.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.661+0000 7fc85dffb700 1 -- 172.21.15.50:0/1716604691 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85801f070 con 0x7fc860106600 2024-06-06T03:23:58.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.661+0000 7fc85dffb700 1 -- 172.21.15.50:0/1716604691 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc858004c50 con 0x7fc860106600 2024-06-06T03:23:58.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.661+0000 7fc86519e700 1 -- 172.21.15.50:0/1716604691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8601a71f0 con 0x7fc860106600 2024-06-06T03:23:58.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.661+0000 7fc85dffb700 1 -- 172.21.15.50:0/1716604691 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85801b690 con 0x7fc860106600 2024-06-06T03:23:58.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.661+0000 7fc86519e700 1 -- 172.21.15.50:0/1716604691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8601a75f0 con 0x7fc860106600 2024-06-06T03:23:58.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.662+0000 7fc86519e700 1 -- 172.21.15.50:0/1716604691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc860069180 con 0x7fc860106600 2024-06-06T03:23:58.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.664+0000 7fc85dffb700 1 -- 172.21.15.50:0/1716604691 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc858022070 con 0x7fc860106600 2024-06-06T03:23:58.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.664+0000 7fc85dffb700 1 --2- 172.21.15.50:0/1716604691 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc84c0a2cb0 0x7fc84c0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:23:58.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.664+0000 7fc85dffb700 1 -- 172.21.15.50:0/1716604691 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7fc8580d0490 con 0x7fc860106600 2024-06-06T03:23:58.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.664+0000 7fc85ffff700 1 --2- 172.21.15.50:0/1716604691 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc84c0a2cb0 0x7fc84c0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:23:58.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.665+0000 7fc85ffff700 1 --2- 172.21.15.50:0/1716604691 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc84c0a2cb0 0x7fc84c0a5170 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc850009c60 tx=0x7fc850009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:23:58.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.668+0000 7fc85dffb700 1 -- 172.21.15.50:0/1716604691 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc85809cfc0 con 0x7fc860106600 2024-06-06T03:23:58.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.876+0000 7fc86519e700 1 -- 172.21.15.50:0/1716604691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc86002dca0 con 0x7fc860106600 2024-06-06T03:23:58.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.877+0000 7fc85dffb700 1 -- 172.21.15.50:0/1716604691 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+24607 (secure 0 0 0) 0x7fc85809c8c0 con 0x7fc860106600 2024-06-06T03:23:58.877 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:23:58.877 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":97,"fsid":"b6263b26-23b2-11ef-bc9b-c7b262605968","created":"2024-06-06T03:14:19.062632+0000","modified":"2024-06-06T03:23:14.506132+0000","last_up_change":"2024-06-06T03:21:30.287918+0000","last_in_change":"2024-06-06T03:21:09.550417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T03:17:37.777608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T03:22:29.496859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T03:22:33.221878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-06T03:22:42.829873+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"eed8040f-a7b7-4d3b-8345-2022918097d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6803","nonce":2379528827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6805","nonce":2379528827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6809","nonce":2379528827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6807","nonce":2379528827}]},"public_addr":"172.21.15.50:6803/2379528827","cluster_addr":"172.21.15.50:6805/2379528827","heartbeat_back_addr":"172.21.15.50:6809/2379528827","heartbeat_front_addr":"172.21.15.50:6807/2379528827","state":["exists","up"]},{"osd":1,"uuid":"089ecb78-5e1e-4cdb-8fe0-5c1731ec9dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6801","nonce":3498354151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6803","nonce":3498354151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6807","nonce":3498354151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6805","nonce":3498354151}]},"public_addr":"172.21.15.79:6801/3498354151","cluster_addr":"172.21.15.79:6803/3498354151","heartbeat_back_addr":"172.21.15.79:6807/3498354151","heartbeat_front_addr":"172.21.15.79:6805/3498354151","state":["exists","up"]},{"osd":2,"uuid":"90599e3b-bf86-4a56-b03b-b051528a5b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6801","nonce":566397008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6803","nonce":566397008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6807","nonce":566397008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6805","nonce":566397008}]},"public_addr":"172.21.15.122:6801/566397008","cluster_addr":"172.21.15.122:6803/566397008","heartbeat_back_addr":"172.21.15.122:6807/566397008","heartbeat_front_addr":"172.21.15.122:6805/566397008","state":["exists","up"]},{"osd":3,"uuid":"fd295e6c-64cd-4164-83dc-4d32c2ae103a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6811","nonce":820123083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6813","nonce":820123083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6817","nonce":820123083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6815","nonce":820123083}]},"public_addr":"172.21.15.50:6811/820123083","cluster_addr":"172.21.15.50:6813/820123083","heartbeat_back_addr":"172.21.15.50:6817/820123083","heartbeat_front_addr":"172.21.15.50:6815/820123083","state":["exists","up"]},{"osd":4,"uuid":"4c854d90-5353-4f7c-b2f3-2af6216d799b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6809","nonce":1784117997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6811","nonce":1784117997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6815","nonce":1784117997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6813","nonce":1784117997}]},"public_addr":"172.21.15.79:6809/1784117997","cluster_addr":"172.21.15.79:6811/1784117997","heartbeat_back_addr":"172.21.15.79:6815/1784117997","heartbeat_front_addr":"172.21.15.79:6813/1784117997","state":["exists","up"]},{"osd":5,"uuid":"80041e10-a643-4338-b621-f882c7bc48b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6809","nonce":2755878218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6811","nonce":2755878218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6815","nonce":2755878218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6813","nonce":2755878218}]},"public_addr":"172.21.15.122:6809/2755878218","cluster_addr":"172.21.15.122:6811/2755878218","heartbeat_back_addr":"172.21.15.122:6815/2755878218","heartbeat_front_addr":"172.21.15.122:6813/2755878218","state":["exists","up"]},{"osd":6,"uuid":"9e15c6c3-bb4b-4c2b-bb7e-4653b10874d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6819","nonce":474595612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6821","nonce":474595612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6825","nonce":474595612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6823","nonce":474595612}]},"public_addr":"172.21.15.50:6819/474595612","cluster_addr":"172.21.15.50:6821/474595612","heartbeat_back_addr":"172.21.15.50:6825/474595612","heartbeat_front_addr":"172.21.15.50:6823/474595612","state":["exists","up"]},{"osd":7,"uuid":"62585bba-c540-4498-8768-b84183e19abd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6817","nonce":3504864579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6819","nonce":3504864579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6823","nonce":3504864579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6821","nonce":3504864579}]},"public_addr":"172.21.15.79:6817/3504864579","cluster_addr":"172.21.15.79:6819/3504864579","heartbeat_back_addr":"172.21.15.79:6823/3504864579","heartbeat_front_addr":"172.21.15.79:6821/3504864579","state":["exists","up"]},{"osd":8,"uuid":"7a272157-460a-4d4a-a63e-30436022ac7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6817","nonce":3484833116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6819","nonce":3484833116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6823","nonce":3484833116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6821","nonce":3484833116}]},"public_addr":"172.21.15.122:6817/3484833116","cluster_addr":"172.21.15.122:6819/3484833116","heartbeat_back_addr":"172.21.15.122:6823/3484833116","heartbeat_front_addr":"172.21.15.122:6821/3484833116","state":["exists","up"]},{"osd":9,"uuid":"7e768ff7-f78d-4a12-b863-4b692e0f4a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6827","nonce":2600273670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6829","nonce":2600273670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6833","nonce":2600273670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6831","nonce":2600273670}]},"public_addr":"172.21.15.50:6827/2600273670","cluster_addr":"172.21.15.50:6829/2600273670","heartbeat_back_addr":"172.21.15.50:6833/2600273670","heartbeat_front_addr":"172.21.15.50:6831/2600273670","state":["exists","up"]},{"osd":10,"uuid":"a42df29a-d88d-4401-878d-6c8f75f3f604","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6825","nonce":2740366543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6827","nonce":2740366543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6831","nonce":2740366543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6829","nonce":2740366543}]},"public_addr":"172.21.15.79:6825/2740366543","cluster_addr":"172.21.15.79:6827/2740366543","heartbeat_back_addr":"172.21.15.79:6831/2740366543","heartbeat_front_addr":"172.21.15.79:6829/2740366543","state":["exists","up"]},{"osd":11,"uuid":"35bcde30-49e4-49b9-a348-98d21a0d3cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6825","nonce":4160854238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6827","nonce":4160854238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6831","nonce":4160854238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6829","nonce":4160854238}]},"public_addr":"172.21.15.122:6825/4160854238","cluster_addr":"172.21.15.122:6827/4160854238","heartbeat_back_addr":"172.21.15.122:6831/4160854238","heartbeat_front_addr":"172.21.15.122:6829/4160854238","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:16:46.989554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:17:11.269759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:17:35.105846+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:00.940943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:26.284520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:51.064143+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:19:16.254750+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:19:42.841380+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:20:08.185133+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:20:34.700082+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:21:01.485278+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:21:27.938715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1311987652":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/1149897118":"2024-06-07T03:15:13.252241+0000","172.21.15.50:6800/2617801068":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/1068038293":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/4038080419":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/149912088":"2024-06-07T03:14:46.388744+0000","172.21.15.50:6801/2617801068":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/2963887224":"2024-06-07T03:14:46.388744+0000","172.21.15.50:6801/1311987652":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/2554563139":"2024-06-07T03:15:13.252241+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T03:23:58.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.879+0000 7fc86519e700 1 -- 172.21.15.50:0/1716604691 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc84c0a2cb0 msgr2=0x7fc84c0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:58.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.879+0000 7fc86519e700 1 --2- 172.21.15.50:0/1716604691 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc84c0a2cb0 0x7fc84c0a5170 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc850009c60 tx=0x7fc850009260 comp rx=0 tx=0).stop 2024-06-06T03:23:58.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.879+0000 7fc86519e700 1 -- 172.21.15.50:0/1716604691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc860106600 msgr2=0x7fc8600fe1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:23:58.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.879+0000 7fc86519e700 1 --2- 172.21.15.50:0/1716604691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc860106600 0x7fc8600fe1e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc858007a00 tx=0x7fc858007a30 comp rx=0 tx=0).stop 2024-06-06T03:23:58.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.880+0000 7fc86519e700 1 -- 172.21.15.50:0/1716604691 shutdown_connections 2024-06-06T03:23:58.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.880+0000 7fc86519e700 1 --2- 172.21.15.50:0/1716604691 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc84c0a2cb0 0x7fc84c0a5170 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:58.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.880+0000 7fc86519e700 1 --2- 172.21.15.50:0/1716604691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc860106600 0x7fc8600fe1e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:58.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.880+0000 7fc86519e700 1 --2- 172.21.15.50:0/1716604691 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc860101520 0x7fc8600fd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:58.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.880+0000 7fc86519e700 1 --2- 172.21.15.50:0/1716604691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc860101ed0 0x7fc8600fdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:23:58.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.880+0000 7fc86519e700 1 -- 172.21.15.50:0/1716604691 >> 172.21.15.50:0/1716604691 conn(0x7fc8600fcdb0 msgr2=0x7fc86006a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:23:58.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.880+0000 7fc86519e700 1 -- 172.21.15.50:0/1716604691 shutdown_connections 2024-06-06T03:23:58.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:23:58.880+0000 7fc86519e700 1 -- 172.21.15.50:0/1716604691 wait complete. 2024-06-06T03:23:58.902 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:58 smithi079 ceph-mon[35478]: pgmap v349: 129 pgs: 129 active+clean; 632 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.6 KiB/s wr, 7 op/s 2024-06-06T03:23:58.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:58 smithi122 ceph-mon[35759]: pgmap v349: 129 pgs: 129 active+clean; 632 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.6 KiB/s wr, 7 op/s 2024-06-06T03:23:59.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:58 smithi050 ceph-mon[32421]: pgmap v349: 129 pgs: 129 active+clean; 632 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.6 KiB/s wr, 7 op/s 2024-06-06T03:23:59.591 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-06-06T03:23:59.591 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-06-06T03:23:59.847 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:23:59.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:23:59 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/1716604691' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:23:59.969 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:23:59 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1716604691' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:24:00.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:23:59 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/1716604691' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:24:00.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:00 smithi122 ceph-mon[35759]: pgmap v350: 129 pgs: 129 active+clean; 637 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.9 KiB/s wr, 10 op/s 2024-06-06T03:24:00.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:00 smithi050 ceph-mon[32421]: pgmap v350: 129 pgs: 129 active+clean; 637 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.9 KiB/s wr, 10 op/s 2024-06-06T03:24:01.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:00 smithi079 ceph-mon[35478]: pgmap v350: 129 pgs: 129 active+clean; 637 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.9 KiB/s wr, 10 op/s 2024-06-06T03:24:01.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.505+0000 7f30e3189700 1 -- 172.21.15.50:0/1530736318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30dc102740 msgr2=0x7f30dc102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:01.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.505+0000 7f30e3189700 1 --2- 172.21.15.50:0/1530736318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30dc102740 0x7f30dc102b20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f30d00099c0 tx=0x7f30d0009cd0 comp rx=0 tx=0).stop 2024-06-06T03:24:01.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.505+0000 7f30e3189700 1 -- 172.21.15.50:0/1530736318 shutdown_connections 2024-06-06T03:24:01.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.505+0000 7f30e3189700 1 --2- 172.21.15.50:0/1530736318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30dc107840 0x7f30dc10f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:01.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.505+0000 7f30e3189700 1 --2- 172.21.15.50:0/1530736318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30dc102740 0x7f30dc102b20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:01.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.505+0000 7f30e3189700 1 --2- 172.21.15.50:0/1530736318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30dc1030f0 0x7f30dc107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:01.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.505+0000 7f30e3189700 1 -- 172.21.15.50:0/1530736318 >> 172.21.15.50:0/1530736318 conn(0x7f30dc0795f0 msgr2=0x7f30dc079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:01.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.505+0000 7f30e3189700 1 -- 172.21.15.50:0/1530736318 shutdown_connections 2024-06-06T03:24:01.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.505+0000 7f30e3189700 1 -- 172.21.15.50:0/1530736318 wait complete. 2024-06-06T03:24:01.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.506+0000 7f30e3189700 1 Processor -- start 2024-06-06T03:24:01.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.506+0000 7f30e3189700 1 -- start start 2024-06-06T03:24:01.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.506+0000 7f30e3189700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30dc102740 0x7f30dc19e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:01.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.506+0000 7f30e3189700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30dc1030f0 0x7f30dc19ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:01.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.506+0000 7f30e3189700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30dc107840 0x7f30dc198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:01.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.506+0000 7f30e3189700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f30dc1126e0 con 0x7f30dc1030f0 2024-06-06T03:24:01.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.506+0000 7f30e3189700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f30dc112560 con 0x7f30dc102740 2024-06-06T03:24:01.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.506+0000 7f30e3189700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f30dc112860 con 0x7f30dc107840 2024-06-06T03:24:01.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.506+0000 7f30dbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30dc1030f0 0x7f30dc19ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:01.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.506+0000 7f30dbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30dc1030f0 0x7f30dc19ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36094/0 (socket says 172.21.15.50:36094) 2024-06-06T03:24:01.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.506+0000 7f30dbfff700 1 -- 172.21.15.50:0/385589992 learned_addr learned my addr 172.21.15.50:0/385589992 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:24:01.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.506+0000 7f30e0f25700 1 --2- 172.21.15.50:0/385589992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30dc102740 0x7f30dc19e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:01.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.506+0000 7f30e1726700 1 --2- 172.21.15.50:0/385589992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30dc107840 0x7f30dc198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:01.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.507+0000 7f30dbfff700 1 -- 172.21.15.50:0/385589992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30dc107840 msgr2=0x7f30dc198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:01.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.507+0000 7f30dbfff700 1 --2- 172.21.15.50:0/385589992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30dc107840 0x7f30dc198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:01.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.507+0000 7f30dbfff700 1 -- 172.21.15.50:0/385589992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30dc102740 msgr2=0x7f30dc19e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:01.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.507+0000 7f30dbfff700 1 --2- 172.21.15.50:0/385589992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30dc102740 0x7f30dc19e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:01.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.507+0000 7f30dbfff700 1 -- 172.21.15.50:0/385589992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30dc1990e0 con 0x7f30dc1030f0 2024-06-06T03:24:01.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.507+0000 7f30e0f25700 1 --2- 172.21.15.50:0/385589992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30dc102740 0x7f30dc19e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:24:01.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.507+0000 7f30dbfff700 1 --2- 172.21.15.50:0/385589992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30dc1030f0 0x7f30dc19ed00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f30c800c920 tx=0x7f30c800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:01.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.507+0000 7f30d9ffb700 1 -- 172.21.15.50:0/385589992 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c8007b00 con 0x7f30dc1030f0 2024-06-06T03:24:01.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.507+0000 7f30d9ffb700 1 -- 172.21.15.50:0/385589992 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f30c8004ce0 con 0x7f30dc1030f0 2024-06-06T03:24:01.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.507+0000 7f30e3189700 1 -- 172.21.15.50:0/385589992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30dc1993d0 con 0x7f30dc1030f0 2024-06-06T03:24:01.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.507+0000 7f30d9ffb700 1 -- 172.21.15.50:0/385589992 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c8005600 con 0x7f30dc1030f0 2024-06-06T03:24:01.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.507+0000 7f30e3189700 1 -- 172.21.15.50:0/385589992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30dc1a5690 con 0x7f30dc1030f0 2024-06-06T03:24:01.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.508+0000 7f30e3189700 1 -- 172.21.15.50:0/385589992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30dc10aa80 con 0x7f30dc1030f0 2024-06-06T03:24:01.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.509+0000 7f30d9ffb700 1 -- 172.21.15.50:0/385589992 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f30c8007ca0 con 0x7f30dc1030f0 2024-06-06T03:24:01.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.510+0000 7f30d9ffb700 1 --2- 172.21.15.50:0/385589992 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f30cc0a2cb0 0x7f30cc0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:01.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.510+0000 7f30d9ffb700 1 -- 172.21.15.50:0/385589992 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7f30c80cf160 con 0x7f30dc1030f0 2024-06-06T03:24:01.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.510+0000 7f30e0f25700 1 --2- 172.21.15.50:0/385589992 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f30cc0a2cb0 0x7f30cc0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:01.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.511+0000 7f30e0f25700 1 --2- 172.21.15.50:0/385589992 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f30cc0a2cb0 0x7f30cc0a5170 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f30d0000c00 tx=0x7f30d0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:01.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.515+0000 7f30d9ffb700 1 -- 172.21.15.50:0/385589992 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f30c8014030 con 0x7f30dc1030f0 2024-06-06T03:24:01.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.719+0000 7f30e3189700 1 -- 172.21.15.50:0/385589992 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f30dc0628d0 con 0x7f30cc0a2cb0 2024-06-06T03:24:01.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.729+0000 7f30d9ffb700 1 -- 172.21.15.50:0/385589992 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340624 (secure 0 0 0) 0x7f30dc0628d0 con 0x7f30cc0a2cb0 2024-06-06T03:24:01.733 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:24:01.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.733+0000 7f30e3189700 1 -- 172.21.15.50:0/385589992 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f30cc0a2cb0 msgr2=0x7f30cc0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:01.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.733+0000 7f30e3189700 1 --2- 172.21.15.50:0/385589992 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f30cc0a2cb0 0x7f30cc0a5170 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f30d0000c00 tx=0x7f30d0005fb0 comp rx=0 tx=0).stop 2024-06-06T03:24:01.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.733+0000 7f30e3189700 1 -- 172.21.15.50:0/385589992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30dc1030f0 msgr2=0x7f30dc19ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:01.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.733+0000 7f30e3189700 1 --2- 172.21.15.50:0/385589992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30dc1030f0 0x7f30dc19ed00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f30c800c920 tx=0x7f30c800cce0 comp rx=0 tx=0).stop 2024-06-06T03:24:01.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.733+0000 7f30e3189700 1 -- 172.21.15.50:0/385589992 shutdown_connections 2024-06-06T03:24:01.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.733+0000 7f30e3189700 1 --2- 172.21.15.50:0/385589992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30dc107840 0x7f30dc198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:01.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.733+0000 7f30e3189700 1 --2- 172.21.15.50:0/385589992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30dc102740 0x7f30dc19e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:01.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.733+0000 7f30e3189700 1 --2- 172.21.15.50:0/385589992 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f30cc0a2cb0 0x7f30cc0a5170 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:01.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.733+0000 7f30e3189700 1 --2- 172.21.15.50:0/385589992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30dc1030f0 0x7f30dc19ed00 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:01.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.733+0000 7f30e3189700 1 -- 172.21.15.50:0/385589992 >> 172.21.15.50:0/385589992 conn(0x7f30dc0795f0 msgr2=0x7f30dc100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:01.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.733+0000 7f30e3189700 1 -- 172.21.15.50:0/385589992 shutdown_connections 2024-06-06T03:24:01.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:01.733+0000 7f30e3189700 1 -- 172.21.15.50:0/385589992 wait complete. 2024-06-06T03:24:01.737 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-06-06T03:24:02.534 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":351,"stamp":"2024-06-06T03:24:01.360750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":652407,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":295,"num_read_kb":259,"num_write":350,"num_write_kb":3053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":281,"ondisk_log_size":281,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374636,"kb_used_data":13004,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567188,"statfs":{"total":1151940427776,"available":1151556800512,"internally_reserved":0,"allocated":13316096,"data_stored":8545043,"data_compressed":426720,"data_compressed_allocated":577536,"data_compressed_original":2654208,"omap_allocated":19141,"internal_metadata":370193723},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":27579,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":58,"num_write":22,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003461"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.513503+0000","last_change":"2024-06-06T03:22:34.302364+0000","last_active":"2024-06-06T03:23:14.513503+0000","last_peered":"2024-06-06T03:23:14.513503+0000","last_clean":"2024-06-06T03:23:14.513503+0000","last_became_active":"2024-06-06T03:22:34.300403+0000","last_became_peered":"2024-06-06T03:22:34.300403+0000","last_unstale":"2024-06-06T03:23:14.513503+0000","last_undegraded":"2024-06-06T03:23:14.513503+0000","last_fullsized":"2024-06-06T03:23:14.513503+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:27:55.377346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.514671+0000","last_change":"2024-06-06T03:22:34.306188+0000","last_active":"2024-06-06T03:23:14.514671+0000","last_peered":"2024-06-06T03:23:14.514671+0000","last_clean":"2024-06-06T03:23:14.514671+0000","last_became_active":"2024-06-06T03:22:34.305705+0000","last_became_peered":"2024-06-06T03:22:34.305705+0000","last_unstale":"2024-06-06T03:23:14.514671+0000","last_undegraded":"2024-06-06T03:23:14.514671+0000","last_fullsized":"2024-06-06T03:23:14.514671+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:10:07.337989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.512210+0000","last_change":"2024-06-06T03:22:34.303568+0000","last_active":"2024-06-06T03:23:14.512210+0000","last_peered":"2024-06-06T03:23:14.512210+0000","last_clean":"2024-06-06T03:23:14.512210+0000","last_became_active":"2024-06-06T03:22:34.303194+0000","last_became_peered":"2024-06-06T03:22:34.303194+0000","last_unstale":"2024-06-06T03:23:14.512210+0000","last_undegraded":"2024-06-06T03:23:14.512210+0000","last_fullsized":"2024-06-06T03:23:14.512210+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:40:46.387476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.514793+0000","last_change":"2024-06-06T03:22:34.303896+0000","last_active":"2024-06-06T03:23:14.514793+0000","last_peered":"2024-06-06T03:23:14.514793+0000","last_clean":"2024-06-06T03:23:14.514793+0000","last_became_active":"2024-06-06T03:22:34.303568+0000","last_became_peered":"2024-06-06T03:22:34.303568+0000","last_unstale":"2024-06-06T03:23:14.514793+0000","last_undegraded":"2024-06-06T03:23:14.514793+0000","last_fullsized":"2024-06-06T03:23:14.514793+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:24:20.160115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.831387+0000","last_change":"2024-06-06T03:22:34.289868+0000","last_active":"2024-06-06T03:23:14.831387+0000","last_peered":"2024-06-06T03:23:14.831387+0000","last_clean":"2024-06-06T03:23:14.831387+0000","last_became_active":"2024-06-06T03:22:34.289485+0000","last_became_peered":"2024-06-06T03:22:34.289485+0000","last_unstale":"2024-06-06T03:23:14.831387+0000","last_undegraded":"2024-06-06T03:23:14.831387+0000","last_fullsized":"2024-06-06T03:23:14.831387+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:28:58.226092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.513942+0000","last_change":"2024-06-06T03:22:34.304643+0000","last_active":"2024-06-06T03:23:14.513942+0000","last_peered":"2024-06-06T03:23:14.513942+0000","last_clean":"2024-06-06T03:23:14.513942+0000","last_became_active":"2024-06-06T03:22:34.303342+0000","last_became_peered":"2024-06-06T03:22:34.303342+0000","last_unstale":"2024-06-06T03:23:14.513942+0000","last_undegraded":"2024-06-06T03:23:14.513942+0000","last_fullsized":"2024-06-06T03:23:14.513942+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:28:27.838518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.025817+0000","last_change":"2024-06-06T03:22:34.304958+0000","last_active":"2024-06-06T03:23:15.025817+0000","last_peered":"2024-06-06T03:23:15.025817+0000","last_clean":"2024-06-06T03:23:15.025817+0000","last_became_active":"2024-06-06T03:22:34.304582+0000","last_became_peered":"2024-06-06T03:22:34.304582+0000","last_unstale":"2024-06-06T03:23:15.025817+0000","last_undegraded":"2024-06-06T03:23:15.025817+0000","last_fullsized":"2024-06-06T03:23:15.025817+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:08:56.304446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.517547+0000","last_change":"2024-06-06T03:22:34.299883+0000","last_active":"2024-06-06T03:23:14.517547+0000","last_peered":"2024-06-06T03:23:14.517547+0000","last_clean":"2024-06-06T03:23:14.517547+0000","last_became_active":"2024-06-06T03:22:34.299568+0000","last_became_peered":"2024-06-06T03:22:34.299568+0000","last_unstale":"2024-06-06T03:23:14.517547+0000","last_undegraded":"2024-06-06T03:23:14.517547+0000","last_fullsized":"2024-06-06T03:23:14.517547+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:23:32.479592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.594708+0000","last_change":"2024-06-06T03:22:34.303157+0000","last_active":"2024-06-06T03:23:14.594708+0000","last_peered":"2024-06-06T03:23:14.594708+0000","last_clean":"2024-06-06T03:23:14.594708+0000","last_became_active":"2024-06-06T03:22:34.302332+0000","last_became_peered":"2024-06-06T03:22:34.302332+0000","last_unstale":"2024-06-06T03:23:14.594708+0000","last_undegraded":"2024-06-06T03:23:14.594708+0000","last_fullsized":"2024-06-06T03:23:14.594708+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:27:32.420058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":40,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.517357+0000","last_change":"2024-06-06T03:23:14.517357+0000","last_active":"2024-06-06T03:23:14.517357+0000","last_peered":"2024-06-06T03:23:14.517357+0000","last_clean":"2024-06-06T03:23:14.517357+0000","last_became_active":"2024-06-06T03:23:14.516932+0000","last_became_peered":"2024-06-06T03:23:14.516932+0000","last_unstale":"2024-06-06T03:23:14.517357+0000","last_undegraded":"2024-06-06T03:23:14.517357+0000","last_fullsized":"2024-06-06T03:23:14.517357+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:23:43.907192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.026359+0000","last_change":"2024-06-06T03:22:34.310010+0000","last_active":"2024-06-06T03:23:15.026359+0000","last_peered":"2024-06-06T03:23:15.026359+0000","last_clean":"2024-06-06T03:23:15.026359+0000","last_became_active":"2024-06-06T03:22:34.309636+0000","last_became_peered":"2024-06-06T03:22:34.309636+0000","last_unstale":"2024-06-06T03:23:15.026359+0000","last_undegraded":"2024-06-06T03:23:15.026359+0000","last_fullsized":"2024-06-06T03:23:15.026359+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:35:53.745050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.514704+0000","last_change":"2024-06-06T03:22:34.311364+0000","last_active":"2024-06-06T03:23:14.514704+0000","last_peered":"2024-06-06T03:23:14.514704+0000","last_clean":"2024-06-06T03:23:14.514704+0000","last_became_active":"2024-06-06T03:22:34.311003+0000","last_became_peered":"2024-06-06T03:22:34.311003+0000","last_unstale":"2024-06-06T03:23:14.514704+0000","last_undegraded":"2024-06-06T03:23:14.514704+0000","last_fullsized":"2024-06-06T03:23:14.514704+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:35:32.460362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.513201+0000","last_change":"2024-06-06T03:22:34.302843+0000","last_active":"2024-06-06T03:23:14.513201+0000","last_peered":"2024-06-06T03:23:14.513201+0000","last_clean":"2024-06-06T03:23:14.513201+0000","last_became_active":"2024-06-06T03:22:34.302581+0000","last_became_peered":"2024-06-06T03:22:34.302581+0000","last_unstale":"2024-06-06T03:23:14.513201+0000","last_undegraded":"2024-06-06T03:23:14.513201+0000","last_fullsized":"2024-06-06T03:23:14.513201+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:56:14.178848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.511691+0000","last_change":"2024-06-06T03:22:34.305792+0000","last_active":"2024-06-06T03:23:14.511691+0000","last_peered":"2024-06-06T03:23:14.511691+0000","last_clean":"2024-06-06T03:23:14.511691+0000","last_became_active":"2024-06-06T03:22:34.305389+0000","last_became_peered":"2024-06-06T03:22:34.305389+0000","last_unstale":"2024-06-06T03:23:14.511691+0000","last_undegraded":"2024-06-06T03:23:14.511691+0000","last_fullsized":"2024-06-06T03:23:14.511691+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:17:05.992382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.511718+0000","last_change":"2024-06-06T03:22:34.298396+0000","last_active":"2024-06-06T03:23:14.511718+0000","last_peered":"2024-06-06T03:23:14.511718+0000","last_clean":"2024-06-06T03:23:14.511718+0000","last_became_active":"2024-06-06T03:22:34.297697+0000","last_became_peered":"2024-06-06T03:22:34.297697+0000","last_unstale":"2024-06-06T03:23:14.511718+0000","last_undegraded":"2024-06-06T03:23:14.511718+0000","last_fullsized":"2024-06-06T03:23:14.511718+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:24:07.143699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.593938+0000","last_change":"2024-06-06T03:22:34.312801+0000","last_active":"2024-06-06T03:23:14.593938+0000","last_peered":"2024-06-06T03:23:14.593938+0000","last_clean":"2024-06-06T03:23:14.593938+0000","last_became_active":"2024-06-06T03:22:34.312206+0000","last_became_peered":"2024-06-06T03:22:34.312206+0000","last_unstale":"2024-06-06T03:23:14.593938+0000","last_undegraded":"2024-06-06T03:23:14.593938+0000","last_fullsized":"2024-06-06T03:23:14.593938+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:31:41.286548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.513218+0000","last_change":"2024-06-06T03:22:34.303527+0000","last_active":"2024-06-06T03:23:14.513218+0000","last_peered":"2024-06-06T03:23:14.513218+0000","last_clean":"2024-06-06T03:23:14.513218+0000","last_became_active":"2024-06-06T03:22:34.302919+0000","last_became_peered":"2024-06-06T03:22:34.302919+0000","last_unstale":"2024-06-06T03:23:14.513218+0000","last_undegraded":"2024-06-06T03:23:14.513218+0000","last_fullsized":"2024-06-06T03:23:14.513218+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:41:44.128543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.509787+0000","last_change":"2024-06-06T03:22:34.304801+0000","last_active":"2024-06-06T03:23:14.509787+0000","last_peered":"2024-06-06T03:23:14.509787+0000","last_clean":"2024-06-06T03:23:14.509787+0000","last_became_active":"2024-06-06T03:22:34.304463+0000","last_became_peered":"2024-06-06T03:22:34.304463+0000","last_unstale":"2024-06-06T03:23:14.509787+0000","last_undegraded":"2024-06-06T03:23:14.509787+0000","last_fullsized":"2024-06-06T03:23:14.509787+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:28:22.789816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.511853+0000","last_change":"2024-06-06T03:22:34.290053+0000","last_active":"2024-06-06T03:23:14.511853+0000","last_peered":"2024-06-06T03:23:14.511853+0000","last_clean":"2024-06-06T03:23:14.511853+0000","last_became_active":"2024-06-06T03:22:34.289712+0000","last_became_peered":"2024-06-06T03:22:34.289712+0000","last_unstale":"2024-06-06T03:23:14.511853+0000","last_undegraded":"2024-06-06T03:23:14.511853+0000","last_fullsized":"2024-06-06T03:23:14.511853+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:12:02.296431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.510798+0000","last_change":"2024-06-06T03:22:44.421722+0000","last_active":"2024-06-06T03:23:14.510798+0000","last_peered":"2024-06-06T03:23:14.510798+0000","last_clean":"2024-06-06T03:23:14.510798+0000","last_became_active":"2024-06-06T03:22:44.421215+0000","last_became_peered":"2024-06-06T03:22:44.421215+0000","last_unstale":"2024-06-06T03:23:14.510798+0000","last_undegraded":"2024-06-06T03:23:14.510798+0000","last_fullsized":"2024-06-06T03:23:14.510798+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:22:59.749839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"97'9","reported_seq":50,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:32.589353+0000","last_change":"2024-06-06T03:22:31.053826+0000","last_active":"2024-06-06T03:23:32.589353+0000","last_peered":"2024-06-06T03:23:32.589353+0000","last_clean":"2024-06-06T03:23:32.589353+0000","last_became_active":"2024-06-06T03:22:31.053537+0000","last_became_peered":"2024-06-06T03:22:31.053537+0000","last_unstale":"2024-06-06T03:23:32.589353+0000","last_undegraded":"2024-06-06T03:23:32.589353+0000","last_fullsized":"2024-06-06T03:23:32.589353+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:18:52.967104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.516822+0000","last_change":"2024-06-06T03:22:34.291554+0000","last_active":"2024-06-06T03:23:14.516822+0000","last_peered":"2024-06-06T03:23:14.516822+0000","last_clean":"2024-06-06T03:23:14.516822+0000","last_became_active":"2024-06-06T03:22:34.290600+0000","last_became_peered":"2024-06-06T03:22:34.290600+0000","last_unstale":"2024-06-06T03:23:14.516822+0000","last_undegraded":"2024-06-06T03:23:14.516822+0000","last_fullsized":"2024-06-06T03:23:14.516822+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:03:32.860134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.514175+0000","last_change":"2024-06-06T03:22:44.424337+0000","last_active":"2024-06-06T03:23:14.514175+0000","last_peered":"2024-06-06T03:23:14.514175+0000","last_clean":"2024-06-06T03:23:14.514175+0000","last_became_active":"2024-06-06T03:22:44.423919+0000","last_became_peered":"2024-06-06T03:22:44.423919+0000","last_unstale":"2024-06-06T03:23:14.514175+0000","last_undegraded":"2024-06-06T03:23:14.514175+0000","last_fullsized":"2024-06-06T03:23:14.514175+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:34:32.801117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"97'2","reported_seq":41,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.516789+0000","last_change":"2024-06-06T03:22:31.242326+0000","last_active":"2024-06-06T03:23:14.516789+0000","last_peered":"2024-06-06T03:23:14.516789+0000","last_clean":"2024-06-06T03:23:14.516789+0000","last_became_active":"2024-06-06T03:22:31.241960+0000","last_became_peered":"2024-06-06T03:22:31.241960+0000","last_unstale":"2024-06-06T03:23:14.516789+0000","last_undegraded":"2024-06-06T03:23:14.516789+0000","last_fullsized":"2024-06-06T03:23:14.516789+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:19:57.820119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.512587+0000","last_change":"2024-06-06T03:22:34.303438+0000","last_active":"2024-06-06T03:23:14.512587+0000","last_peered":"2024-06-06T03:23:14.512587+0000","last_clean":"2024-06-06T03:23:14.512587+0000","last_became_active":"2024-06-06T03:22:34.302057+0000","last_became_peered":"2024-06-06T03:22:34.302057+0000","last_unstale":"2024-06-06T03:23:14.512587+0000","last_undegraded":"2024-06-06T03:23:14.512587+0000","last_fullsized":"2024-06-06T03:23:14.512587+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:52:20.508656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.513966+0000","last_change":"2024-06-06T03:22:44.424732+0000","last_active":"2024-06-06T03:23:14.513966+0000","last_peered":"2024-06-06T03:23:14.513966+0000","last_clean":"2024-06-06T03:23:14.513966+0000","last_became_active":"2024-06-06T03:22:44.423906+0000","last_became_peered":"2024-06-06T03:22:44.423906+0000","last_unstale":"2024-06-06T03:23:14.513966+0000","last_undegraded":"2024-06-06T03:23:14.513966+0000","last_fullsized":"2024-06-06T03:23:14.513966+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:45:04.344747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"97'4","reported_seq":43,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:32.587499+0000","last_change":"2024-06-06T03:22:31.057003+0000","last_active":"2024-06-06T03:23:32.587499+0000","last_peered":"2024-06-06T03:23:32.587499+0000","last_clean":"2024-06-06T03:23:32.587499+0000","last_became_active":"2024-06-06T03:22:31.056660+0000","last_became_peered":"2024-06-06T03:22:31.056660+0000","last_unstale":"2024-06-06T03:23:32.587499+0000","last_undegraded":"2024-06-06T03:23:32.587499+0000","last_fullsized":"2024-06-06T03:23:32.587499+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:44:16.726749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.594316+0000","last_change":"2024-06-06T03:22:34.306196+0000","last_active":"2024-06-06T03:23:14.594316+0000","last_peered":"2024-06-06T03:23:14.594316+0000","last_clean":"2024-06-06T03:23:14.594316+0000","last_became_active":"2024-06-06T03:22:34.304962+0000","last_became_peered":"2024-06-06T03:22:34.304962+0000","last_unstale":"2024-06-06T03:23:14.594316+0000","last_undegraded":"2024-06-06T03:23:14.594316+0000","last_fullsized":"2024-06-06T03:23:14.594316+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:25:04.990371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.514098+0000","last_change":"2024-06-06T03:22:44.419624+0000","last_active":"2024-06-06T03:23:14.514098+0000","last_peered":"2024-06-06T03:23:14.514098+0000","last_clean":"2024-06-06T03:23:14.514098+0000","last_became_active":"2024-06-06T03:22:44.418713+0000","last_became_peered":"2024-06-06T03:22:44.418713+0000","last_unstale":"2024-06-06T03:23:14.514098+0000","last_undegraded":"2024-06-06T03:23:14.514098+0000","last_fullsized":"2024-06-06T03:23:14.514098+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:04:54.010364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'2","reported_seq":41,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.831706+0000","last_change":"2024-06-06T03:22:31.059332+0000","last_active":"2024-06-06T03:23:14.831706+0000","last_peered":"2024-06-06T03:23:14.831706+0000","last_clean":"2024-06-06T03:23:14.831706+0000","last_became_active":"2024-06-06T03:22:31.058478+0000","last_became_peered":"2024-06-06T03:22:31.058478+0000","last_unstale":"2024-06-06T03:23:14.831706+0000","last_undegraded":"2024-06-06T03:23:14.831706+0000","last_fullsized":"2024-06-06T03:23:14.831706+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:24:46.452708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.073717+0000","last_change":"2024-06-06T03:22:34.301650+0000","last_active":"2024-06-06T03:23:15.073717+0000","last_peered":"2024-06-06T03:23:15.073717+0000","last_clean":"2024-06-06T03:23:15.073717+0000","last_became_active":"2024-06-06T03:22:34.301220+0000","last_became_peered":"2024-06-06T03:22:34.301220+0000","last_unstale":"2024-06-06T03:23:15.073717+0000","last_undegraded":"2024-06-06T03:23:15.073717+0000","last_fullsized":"2024-06-06T03:23:15.073717+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:43:07.396971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.511520+0000","last_change":"2024-06-06T03:22:44.413406+0000","last_active":"2024-06-06T03:23:14.511520+0000","last_peered":"2024-06-06T03:23:14.511520+0000","last_clean":"2024-06-06T03:23:14.511520+0000","last_became_active":"2024-06-06T03:22:44.412977+0000","last_became_peered":"2024-06-06T03:22:44.412977+0000","last_unstale":"2024-06-06T03:23:14.511520+0000","last_undegraded":"2024-06-06T03:23:14.511520+0000","last_fullsized":"2024-06-06T03:23:14.511520+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:11:02.017352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"97'5","reported_seq":70,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:56.641372+0000","last_change":"2024-06-06T03:22:31.056091+0000","last_active":"2024-06-06T03:23:56.641372+0000","last_peered":"2024-06-06T03:23:56.641372+0000","last_clean":"2024-06-06T03:23:56.641372+0000","last_became_active":"2024-06-06T03:22:31.055184+0000","last_became_peered":"2024-06-06T03:22:31.055184+0000","last_unstale":"2024-06-06T03:23:56.641372+0000","last_undegraded":"2024-06-06T03:23:56.641372+0000","last_fullsized":"2024-06-06T03:23:56.641372+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:32:37.761082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.831414+0000","last_change":"2024-06-06T03:22:34.305386+0000","last_active":"2024-06-06T03:23:14.831414+0000","last_peered":"2024-06-06T03:23:14.831414+0000","last_clean":"2024-06-06T03:23:14.831414+0000","last_became_active":"2024-06-06T03:22:34.304505+0000","last_became_peered":"2024-06-06T03:22:34.304505+0000","last_unstale":"2024-06-06T03:23:14.831414+0000","last_undegraded":"2024-06-06T03:23:14.831414+0000","last_fullsized":"2024-06-06T03:23:14.831414+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:34:31.800443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":31,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.075519+0000","last_change":"2024-06-06T03:23:15.075519+0000","last_active":"2024-06-06T03:23:15.075519+0000","last_peered":"2024-06-06T03:23:15.075519+0000","last_clean":"2024-06-06T03:23:15.075519+0000","last_became_active":"2024-06-06T03:23:15.074970+0000","last_became_peered":"2024-06-06T03:23:15.074970+0000","last_unstale":"2024-06-06T03:23:15.075519+0000","last_undegraded":"2024-06-06T03:23:15.075519+0000","last_fullsized":"2024-06-06T03:23:15.075519+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:39:25.915175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"97'3","reported_seq":43,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:32.587213+0000","last_change":"2024-06-06T03:22:31.058530+0000","last_active":"2024-06-06T03:23:32.587213+0000","last_peered":"2024-06-06T03:23:32.587213+0000","last_clean":"2024-06-06T03:23:32.587213+0000","last_became_active":"2024-06-06T03:22:31.058185+0000","last_became_peered":"2024-06-06T03:22:31.058185+0000","last_unstale":"2024-06-06T03:23:32.587213+0000","last_undegraded":"2024-06-06T03:23:32.587213+0000","last_fullsized":"2024-06-06T03:23:32.587213+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:28:59.023322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.073763+0000","last_change":"2024-06-06T03:22:34.292995+0000","last_active":"2024-06-06T03:23:15.073763+0000","last_peered":"2024-06-06T03:23:15.073763+0000","last_clean":"2024-06-06T03:23:15.073763+0000","last_became_active":"2024-06-06T03:22:34.292625+0000","last_became_peered":"2024-06-06T03:22:34.292625+0000","last_unstale":"2024-06-06T03:23:15.073763+0000","last_undegraded":"2024-06-06T03:23:15.073763+0000","last_fullsized":"2024-06-06T03:23:15.073763+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:03:18.985660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.513602+0000","last_change":"2024-06-06T03:22:44.417395+0000","last_active":"2024-06-06T03:23:14.513602+0000","last_peered":"2024-06-06T03:23:14.513602+0000","last_clean":"2024-06-06T03:23:14.513602+0000","last_became_active":"2024-06-06T03:22:44.416929+0000","last_became_peered":"2024-06-06T03:22:44.416929+0000","last_unstale":"2024-06-06T03:23:14.513602+0000","last_undegraded":"2024-06-06T03:23:14.513602+0000","last_fullsized":"2024-06-06T03:23:14.513602+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:28:09.548691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"97'2","reported_seq":42,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:32.586379+0000","last_change":"2024-06-06T03:22:31.051163+0000","last_active":"2024-06-06T03:23:32.586379+0000","last_peered":"2024-06-06T03:23:32.586379+0000","last_clean":"2024-06-06T03:23:32.586379+0000","last_became_active":"2024-06-06T03:22:31.050800+0000","last_became_peered":"2024-06-06T03:22:31.050800+0000","last_unstale":"2024-06-06T03:23:32.586379+0000","last_undegraded":"2024-06-06T03:23:32.586379+0000","last_fullsized":"2024-06-06T03:23:32.586379+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:13:40.197723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.517426+0000","last_change":"2024-06-06T03:22:34.293586+0000","last_active":"2024-06-06T03:23:14.517426+0000","last_peered":"2024-06-06T03:23:14.517426+0000","last_clean":"2024-06-06T03:23:14.517426+0000","last_became_active":"2024-06-06T03:22:34.292651+0000","last_became_peered":"2024-06-06T03:22:34.292651+0000","last_unstale":"2024-06-06T03:23:14.517426+0000","last_undegraded":"2024-06-06T03:23:14.517426+0000","last_fullsized":"2024-06-06T03:23:14.517426+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:11:16.221948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.514671+0000","last_change":"2024-06-06T03:22:44.415005+0000","last_active":"2024-06-06T03:23:14.514671+0000","last_peered":"2024-06-06T03:23:14.514671+0000","last_clean":"2024-06-06T03:23:14.514671+0000","last_became_active":"2024-06-06T03:22:44.414522+0000","last_became_peered":"2024-06-06T03:22:44.414522+0000","last_unstale":"2024-06-06T03:23:14.514671+0000","last_undegraded":"2024-06-06T03:23:14.514671+0000","last_fullsized":"2024-06-06T03:23:14.514671+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:36:03.240089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"97'1","reported_seq":41,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.073679+0000","last_change":"2024-06-06T03:22:31.056068+0000","last_active":"2024-06-06T03:23:15.073679+0000","last_peered":"2024-06-06T03:23:15.073679+0000","last_clean":"2024-06-06T03:23:15.073679+0000","last_became_active":"2024-06-06T03:22:31.055628+0000","last_became_peered":"2024-06-06T03:22:31.055628+0000","last_unstale":"2024-06-06T03:23:15.073679+0000","last_undegraded":"2024-06-06T03:23:15.073679+0000","last_fullsized":"2024-06-06T03:23:15.073679+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:40:37.491491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.509557+0000","last_change":"2024-06-06T03:22:34.300945+0000","last_active":"2024-06-06T03:23:14.509557+0000","last_peered":"2024-06-06T03:23:14.509557+0000","last_clean":"2024-06-06T03:23:14.509557+0000","last_became_active":"2024-06-06T03:22:34.300618+0000","last_became_peered":"2024-06-06T03:22:34.300618+0000","last_unstale":"2024-06-06T03:23:14.509557+0000","last_undegraded":"2024-06-06T03:23:14.509557+0000","last_fullsized":"2024-06-06T03:23:14.509557+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:32:39.875148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.516884+0000","last_change":"2024-06-06T03:22:44.417759+0000","last_active":"2024-06-06T03:23:14.516884+0000","last_peered":"2024-06-06T03:23:14.516884+0000","last_clean":"2024-06-06T03:23:14.516884+0000","last_became_active":"2024-06-06T03:22:44.417335+0000","last_became_peered":"2024-06-06T03:22:44.417335+0000","last_unstale":"2024-06-06T03:23:14.516884+0000","last_undegraded":"2024-06-06T03:23:14.516884+0000","last_fullsized":"2024-06-06T03:23:14.516884+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:43:24.408740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"97'3","reported_seq":67,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:57.642062+0000","last_change":"2024-06-06T03:22:31.054351+0000","last_active":"2024-06-06T03:23:57.642062+0000","last_peered":"2024-06-06T03:23:57.642062+0000","last_clean":"2024-06-06T03:23:57.642062+0000","last_became_active":"2024-06-06T03:22:31.053954+0000","last_became_peered":"2024-06-06T03:22:31.053954+0000","last_unstale":"2024-06-06T03:23:57.642062+0000","last_undegraded":"2024-06-06T03:23:57.642062+0000","last_fullsized":"2024-06-06T03:23:57.642062+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:22:46.405507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.594645+0000","last_change":"2024-06-06T03:22:34.303208+0000","last_active":"2024-06-06T03:23:14.594645+0000","last_peered":"2024-06-06T03:23:14.594645+0000","last_clean":"2024-06-06T03:23:14.594645+0000","last_became_active":"2024-06-06T03:22:34.302882+0000","last_became_peered":"2024-06-06T03:22:34.302882+0000","last_unstale":"2024-06-06T03:23:14.594645+0000","last_undegraded":"2024-06-06T03:23:14.594645+0000","last_fullsized":"2024-06-06T03:23:14.594645+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:01:36.963056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.509439+0000","last_change":"2024-06-06T03:22:44.418095+0000","last_active":"2024-06-06T03:23:14.509439+0000","last_peered":"2024-06-06T03:23:14.509439+0000","last_clean":"2024-06-06T03:23:14.509439+0000","last_became_active":"2024-06-06T03:22:44.417625+0000","last_became_peered":"2024-06-06T03:22:44.417625+0000","last_unstale":"2024-06-06T03:23:14.509439+0000","last_undegraded":"2024-06-06T03:23:14.509439+0000","last_fullsized":"2024-06-06T03:23:14.509439+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:20:53.859638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"97'2","reported_seq":42,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:31.583947+0000","last_change":"2024-06-06T03:22:31.057558+0000","last_active":"2024-06-06T03:23:31.583947+0000","last_peered":"2024-06-06T03:23:31.583947+0000","last_clean":"2024-06-06T03:23:31.583947+0000","last_became_active":"2024-06-06T03:22:31.057168+0000","last_became_peered":"2024-06-06T03:22:31.057168+0000","last_unstale":"2024-06-06T03:23:31.583947+0000","last_undegraded":"2024-06-06T03:23:31.583947+0000","last_fullsized":"2024-06-06T03:23:31.583947+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:33:59.019923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.512836+0000","last_change":"2024-06-06T03:22:34.299220+0000","last_active":"2024-06-06T03:23:14.512836+0000","last_peered":"2024-06-06T03:23:14.512836+0000","last_clean":"2024-06-06T03:23:14.512836+0000","last_became_active":"2024-06-06T03:22:34.298873+0000","last_became_peered":"2024-06-06T03:22:34.298873+0000","last_unstale":"2024-06-06T03:23:14.512836+0000","last_undegraded":"2024-06-06T03:23:14.512836+0000","last_fullsized":"2024-06-06T03:23:14.512836+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:31:53.501036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.514113+0000","last_change":"2024-06-06T03:22:44.424792+0000","last_active":"2024-06-06T03:23:14.514113+0000","last_peered":"2024-06-06T03:23:14.514113+0000","last_clean":"2024-06-06T03:23:14.514113+0000","last_became_active":"2024-06-06T03:22:44.423973+0000","last_became_peered":"2024-06-06T03:22:44.423973+0000","last_unstale":"2024-06-06T03:23:14.514113+0000","last_undegraded":"2024-06-06T03:23:14.514113+0000","last_fullsized":"2024-06-06T03:23:14.514113+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:46:51.232764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"97'4","reported_seq":45,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:31.583322+0000","last_change":"2024-06-06T03:22:31.243885+0000","last_active":"2024-06-06T03:23:31.583322+0000","last_peered":"2024-06-06T03:23:31.583322+0000","last_clean":"2024-06-06T03:23:31.583322+0000","last_became_active":"2024-06-06T03:22:31.243367+0000","last_became_peered":"2024-06-06T03:22:31.243367+0000","last_unstale":"2024-06-06T03:23:31.583322+0000","last_undegraded":"2024-06-06T03:23:31.583322+0000","last_fullsized":"2024-06-06T03:23:31.583322+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:57:13.464974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.594284+0000","last_change":"2024-06-06T03:22:34.299247+0000","last_active":"2024-06-06T03:23:14.594284+0000","last_peered":"2024-06-06T03:23:14.594284+0000","last_clean":"2024-06-06T03:23:14.594284+0000","last_became_active":"2024-06-06T03:22:34.298538+0000","last_became_peered":"2024-06-06T03:22:34.298538+0000","last_unstale":"2024-06-06T03:23:14.594284+0000","last_undegraded":"2024-06-06T03:23:14.594284+0000","last_fullsized":"2024-06-06T03:23:14.594284+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:53:16.724575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.509611+0000","last_change":"2024-06-06T03:22:44.423817+0000","last_active":"2024-06-06T03:23:14.509611+0000","last_peered":"2024-06-06T03:23:14.509611+0000","last_clean":"2024-06-06T03:23:14.509611+0000","last_became_active":"2024-06-06T03:22:44.423333+0000","last_became_peered":"2024-06-06T03:22:44.423333+0000","last_unstale":"2024-06-06T03:23:14.509611+0000","last_undegraded":"2024-06-06T03:23:14.509611+0000","last_fullsized":"2024-06-06T03:23:14.509611+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:22:46.174850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"97'32","reported_seq":128,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:58.644168+0000","last_change":"2024-06-06T03:22:31.056446+0000","last_active":"2024-06-06T03:23:58.644168+0000","last_peered":"2024-06-06T03:23:58.644168+0000","last_clean":"2024-06-06T03:23:58.644168+0000","last_became_active":"2024-06-06T03:22:31.056089+0000","last_became_peered":"2024-06-06T03:22:31.056089+0000","last_unstale":"2024-06-06T03:23:58.644168+0000","last_undegraded":"2024-06-06T03:23:58.644168+0000","last_fullsized":"2024-06-06T03:23:58.644168+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:11:37.705889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57805,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":84,"num_write":33,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.832126+0000","last_change":"2024-06-06T03:22:34.302229+0000","last_active":"2024-06-06T03:23:14.832126+0000","last_peered":"2024-06-06T03:23:14.832126+0000","last_clean":"2024-06-06T03:23:14.832126+0000","last_became_active":"2024-06-06T03:22:34.301877+0000","last_became_peered":"2024-06-06T03:22:34.301877+0000","last_unstale":"2024-06-06T03:23:14.832126+0000","last_undegraded":"2024-06-06T03:23:14.832126+0000","last_fullsized":"2024-06-06T03:23:14.832126+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:19:22.545435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.074113+0000","last_change":"2024-06-06T03:22:44.421024+0000","last_active":"2024-06-06T03:23:15.074113+0000","last_peered":"2024-06-06T03:23:15.074113+0000","last_clean":"2024-06-06T03:23:15.074113+0000","last_became_active":"2024-06-06T03:22:44.420502+0000","last_became_peered":"2024-06-06T03:22:44.420502+0000","last_unstale":"2024-06-06T03:23:15.074113+0000","last_undegraded":"2024-06-06T03:23:15.074113+0000","last_fullsized":"2024-06-06T03:23:15.074113+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:15:55.246032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"97'6","reported_seq":46,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:32.588528+0000","last_change":"2024-06-06T03:22:31.054128+0000","last_active":"2024-06-06T03:23:32.588528+0000","last_peered":"2024-06-06T03:23:32.588528+0000","last_clean":"2024-06-06T03:23:32.588528+0000","last_became_active":"2024-06-06T03:22:31.053740+0000","last_became_peered":"2024-06-06T03:22:31.053740+0000","last_unstale":"2024-06-06T03:23:32.588528+0000","last_undegraded":"2024-06-06T03:23:32.588528+0000","last_fullsized":"2024-06-06T03:23:32.588528+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:12:21.494702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.512309+0000","last_change":"2024-06-06T03:22:34.297861+0000","last_active":"2024-06-06T03:23:14.512309+0000","last_peered":"2024-06-06T03:23:14.512309+0000","last_clean":"2024-06-06T03:23:14.512309+0000","last_became_active":"2024-06-06T03:22:34.297391+0000","last_became_peered":"2024-06-06T03:22:34.297391+0000","last_unstale":"2024-06-06T03:23:14.512309+0000","last_undegraded":"2024-06-06T03:23:14.512309+0000","last_fullsized":"2024-06-06T03:23:14.512309+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:10:33.973635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.512583+0000","last_change":"2024-06-06T03:22:44.416087+0000","last_active":"2024-06-06T03:23:14.512583+0000","last_peered":"2024-06-06T03:23:14.512583+0000","last_clean":"2024-06-06T03:23:14.512583+0000","last_became_active":"2024-06-06T03:22:44.415646+0000","last_became_peered":"2024-06-06T03:22:44.415646+0000","last_unstale":"2024-06-06T03:23:14.512583+0000","last_undegraded":"2024-06-06T03:23:14.512583+0000","last_fullsized":"2024-06-06T03:23:14.512583+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:44:43.690830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"97'3","reported_seq":43,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:31.582990+0000","last_change":"2024-06-06T03:22:31.056814+0000","last_active":"2024-06-06T03:23:31.582990+0000","last_peered":"2024-06-06T03:23:31.582990+0000","last_clean":"2024-06-06T03:23:31.582990+0000","last_became_active":"2024-06-06T03:22:31.055183+0000","last_became_peered":"2024-06-06T03:22:31.055183+0000","last_unstale":"2024-06-06T03:23:31.582990+0000","last_undegraded":"2024-06-06T03:23:31.582990+0000","last_fullsized":"2024-06-06T03:23:31.582990+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:26:27.299068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.026078+0000","last_change":"2024-06-06T03:22:34.311995+0000","last_active":"2024-06-06T03:23:15.026078+0000","last_peered":"2024-06-06T03:23:15.026078+0000","last_clean":"2024-06-06T03:23:15.026078+0000","last_became_active":"2024-06-06T03:22:34.311665+0000","last_became_peered":"2024-06-06T03:22:34.311665+0000","last_unstale":"2024-06-06T03:23:15.026078+0000","last_undegraded":"2024-06-06T03:23:15.026078+0000","last_fullsized":"2024-06-06T03:23:15.026078+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:53:10.539212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.509816+0000","last_change":"2024-06-06T03:22:44.414170+0000","last_active":"2024-06-06T03:23:14.509816+0000","last_peered":"2024-06-06T03:23:14.509816+0000","last_clean":"2024-06-06T03:23:14.509816+0000","last_became_active":"2024-06-06T03:22:44.413635+0000","last_became_peered":"2024-06-06T03:22:44.413635+0000","last_unstale":"2024-06-06T03:23:14.509816+0000","last_undegraded":"2024-06-06T03:23:14.509816+0000","last_fullsized":"2024-06-06T03:23:14.509816+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:06:25.223810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"97'4","reported_seq":70,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:57.650505+0000","last_change":"2024-06-06T03:22:31.057846+0000","last_active":"2024-06-06T03:23:57.650505+0000","last_peered":"2024-06-06T03:23:57.650505+0000","last_clean":"2024-06-06T03:23:57.650505+0000","last_became_active":"2024-06-06T03:22:31.056635+0000","last_became_peered":"2024-06-06T03:22:31.056635+0000","last_unstale":"2024-06-06T03:23:57.650505+0000","last_undegraded":"2024-06-06T03:23:57.650505+0000","last_fullsized":"2024-06-06T03:23:57.650505+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:59:03.845722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.025961+0000","last_change":"2024-06-06T03:22:34.304832+0000","last_active":"2024-06-06T03:23:15.025961+0000","last_peered":"2024-06-06T03:23:15.025961+0000","last_clean":"2024-06-06T03:23:15.025961+0000","last_became_active":"2024-06-06T03:22:34.304494+0000","last_became_peered":"2024-06-06T03:22:34.304494+0000","last_unstale":"2024-06-06T03:23:15.025961+0000","last_undegraded":"2024-06-06T03:23:15.025961+0000","last_fullsized":"2024-06-06T03:23:15.025961+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:17:02.855580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.512634+0000","last_change":"2024-06-06T03:22:44.418561+0000","last_active":"2024-06-06T03:23:14.512634+0000","last_peered":"2024-06-06T03:23:14.512634+0000","last_clean":"2024-06-06T03:23:14.512634+0000","last_became_active":"2024-06-06T03:22:44.418050+0000","last_became_peered":"2024-06-06T03:22:44.418050+0000","last_unstale":"2024-06-06T03:23:14.512634+0000","last_undegraded":"2024-06-06T03:23:14.512634+0000","last_fullsized":"2024-06-06T03:23:14.512634+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:39:57.680990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"97'15","reported_seq":55,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:32.589316+0000","last_change":"2024-06-06T03:22:31.242981+0000","last_active":"2024-06-06T03:23:32.589316+0000","last_peered":"2024-06-06T03:23:32.589316+0000","last_clean":"2024-06-06T03:23:32.589316+0000","last_became_active":"2024-06-06T03:22:31.242448+0000","last_became_peered":"2024-06-06T03:22:31.242448+0000","last_unstale":"2024-06-06T03:23:32.589316+0000","last_undegraded":"2024-06-06T03:23:32.589316+0000","last_fullsized":"2024-06-06T03:23:32.589316+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:18:25.855327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.073527+0000","last_change":"2024-06-06T03:22:34.300799+0000","last_active":"2024-06-06T03:23:15.073527+0000","last_peered":"2024-06-06T03:23:15.073527+0000","last_clean":"2024-06-06T03:23:15.073527+0000","last_became_active":"2024-06-06T03:22:34.300397+0000","last_became_peered":"2024-06-06T03:22:34.300397+0000","last_unstale":"2024-06-06T03:23:15.073527+0000","last_undegraded":"2024-06-06T03:23:15.073527+0000","last_fullsized":"2024-06-06T03:23:15.073527+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:55:31.621711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.073391+0000","last_change":"2024-06-06T03:22:44.418341+0000","last_active":"2024-06-06T03:23:15.073391+0000","last_peered":"2024-06-06T03:23:15.073391+0000","last_clean":"2024-06-06T03:23:15.073391+0000","last_became_active":"2024-06-06T03:22:44.417881+0000","last_became_peered":"2024-06-06T03:22:44.417881+0000","last_unstale":"2024-06-06T03:23:15.073391+0000","last_undegraded":"2024-06-06T03:23:15.073391+0000","last_fullsized":"2024-06-06T03:23:15.073391+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:43:13.869298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"97'2","reported_seq":42,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:34.583893+0000","last_change":"2024-06-06T03:22:31.054749+0000","last_active":"2024-06-06T03:23:34.583893+0000","last_peered":"2024-06-06T03:23:34.583893+0000","last_clean":"2024-06-06T03:23:34.583893+0000","last_became_active":"2024-06-06T03:22:31.054180+0000","last_became_peered":"2024-06-06T03:22:31.054180+0000","last_unstale":"2024-06-06T03:23:34.583893+0000","last_undegraded":"2024-06-06T03:23:34.583893+0000","last_fullsized":"2024-06-06T03:23:34.583893+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:30:17.902778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.513221+0000","last_change":"2024-06-06T03:22:34.299573+0000","last_active":"2024-06-06T03:23:14.513221+0000","last_peered":"2024-06-06T03:23:14.513221+0000","last_clean":"2024-06-06T03:23:14.513221+0000","last_became_active":"2024-06-06T03:22:34.299201+0000","last_became_peered":"2024-06-06T03:22:34.299201+0000","last_unstale":"2024-06-06T03:23:14.513221+0000","last_undegraded":"2024-06-06T03:23:14.513221+0000","last_fullsized":"2024-06-06T03:23:14.513221+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:02:47.043087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.831302+0000","last_change":"2024-06-06T03:22:44.409672+0000","last_active":"2024-06-06T03:23:14.831302+0000","last_peered":"2024-06-06T03:23:14.831302+0000","last_clean":"2024-06-06T03:23:14.831302+0000","last_became_active":"2024-06-06T03:22:44.409246+0000","last_became_peered":"2024-06-06T03:22:44.409246+0000","last_unstale":"2024-06-06T03:23:14.831302+0000","last_undegraded":"2024-06-06T03:23:14.831302+0000","last_fullsized":"2024-06-06T03:23:14.831302+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:44:49.481886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.509998+0000","last_change":"2024-06-06T03:22:31.243562+0000","last_active":"2024-06-06T03:23:14.509998+0000","last_peered":"2024-06-06T03:23:14.509998+0000","last_clean":"2024-06-06T03:23:14.509998+0000","last_became_active":"2024-06-06T03:22:31.243164+0000","last_became_peered":"2024-06-06T03:22:31.243164+0000","last_unstale":"2024-06-06T03:23:14.509998+0000","last_undegraded":"2024-06-06T03:23:14.509998+0000","last_fullsized":"2024-06-06T03:23:14.509998+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:04:46.877389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.514691+0000","last_change":"2024-06-06T03:22:34.300756+0000","last_active":"2024-06-06T03:23:14.514691+0000","last_peered":"2024-06-06T03:23:14.514691+0000","last_clean":"2024-06-06T03:23:14.514691+0000","last_became_active":"2024-06-06T03:22:34.300333+0000","last_became_peered":"2024-06-06T03:22:34.300333+0000","last_unstale":"2024-06-06T03:23:14.514691+0000","last_undegraded":"2024-06-06T03:23:14.514691+0000","last_fullsized":"2024-06-06T03:23:14.514691+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:29:37.174432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.512408+0000","last_change":"2024-06-06T03:22:44.412741+0000","last_active":"2024-06-06T03:23:14.512408+0000","last_peered":"2024-06-06T03:23:14.512408+0000","last_clean":"2024-06-06T03:23:14.512408+0000","last_became_active":"2024-06-06T03:22:44.412263+0000","last_became_peered":"2024-06-06T03:22:44.412263+0000","last_unstale":"2024-06-06T03:23:14.512408+0000","last_undegraded":"2024-06-06T03:23:14.512408+0000","last_fullsized":"2024-06-06T03:23:14.512408+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:00:13.925279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"97'1","reported_seq":41,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.025967+0000","last_change":"2024-06-06T03:22:31.055124+0000","last_active":"2024-06-06T03:23:15.025967+0000","last_peered":"2024-06-06T03:23:15.025967+0000","last_clean":"2024-06-06T03:23:15.025967+0000","last_became_active":"2024-06-06T03:22:31.054562+0000","last_became_peered":"2024-06-06T03:22:31.054562+0000","last_unstale":"2024-06-06T03:23:15.025967+0000","last_undegraded":"2024-06-06T03:23:15.025967+0000","last_fullsized":"2024-06-06T03:23:15.025967+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:57:54.783815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.514141+0000","last_change":"2024-06-06T03:22:34.310893+0000","last_active":"2024-06-06T03:23:14.514141+0000","last_peered":"2024-06-06T03:23:14.514141+0000","last_clean":"2024-06-06T03:23:14.514141+0000","last_became_active":"2024-06-06T03:22:34.310510+0000","last_became_peered":"2024-06-06T03:22:34.310510+0000","last_unstale":"2024-06-06T03:23:14.514141+0000","last_undegraded":"2024-06-06T03:23:14.514141+0000","last_fullsized":"2024-06-06T03:23:14.514141+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:52:10.979031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.512428+0000","last_change":"2024-06-06T03:22:44.416330+0000","last_active":"2024-06-06T03:23:14.512428+0000","last_peered":"2024-06-06T03:23:14.512428+0000","last_clean":"2024-06-06T03:23:14.512428+0000","last_became_active":"2024-06-06T03:22:44.415021+0000","last_became_peered":"2024-06-06T03:22:44.415021+0000","last_unstale":"2024-06-06T03:23:14.512428+0000","last_undegraded":"2024-06-06T03:23:14.512428+0000","last_fullsized":"2024-06-06T03:23:14.512428+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:12:22.017689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.074086+0000","last_change":"2024-06-06T03:22:34.294540+0000","last_active":"2024-06-06T03:23:15.074086+0000","last_peered":"2024-06-06T03:23:15.074086+0000","last_clean":"2024-06-06T03:23:15.074086+0000","last_became_active":"2024-06-06T03:22:34.294204+0000","last_became_peered":"2024-06-06T03:22:34.294204+0000","last_unstale":"2024-06-06T03:23:15.074086+0000","last_undegraded":"2024-06-06T03:23:15.074086+0000","last_fullsized":"2024-06-06T03:23:15.074086+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:16:39.386345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"97'4","reported_seq":67,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:56.647342+0000","last_change":"2024-06-06T03:22:31.242275+0000","last_active":"2024-06-06T03:23:56.647342+0000","last_peered":"2024-06-06T03:23:56.647342+0000","last_clean":"2024-06-06T03:23:56.647342+0000","last_became_active":"2024-06-06T03:22:31.241930+0000","last_became_peered":"2024-06-06T03:22:31.241930+0000","last_unstale":"2024-06-06T03:23:56.647342+0000","last_undegraded":"2024-06-06T03:23:56.647342+0000","last_fullsized":"2024-06-06T03:23:56.647342+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:46:16.407946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"97'1","reported_seq":25,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.026354+0000","last_change":"2024-06-06T03:22:44.416191+0000","last_active":"2024-06-06T03:23:15.026354+0000","last_peered":"2024-06-06T03:23:15.026354+0000","last_clean":"2024-06-06T03:23:15.026354+0000","last_became_active":"2024-06-06T03:22:44.415632+0000","last_became_peered":"2024-06-06T03:22:44.415632+0000","last_unstale":"2024-06-06T03:23:15.026354+0000","last_undegraded":"2024-06-06T03:23:15.026354+0000","last_fullsized":"2024-06-06T03:23:15.026354+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:10:48.995029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.517612+0000","last_change":"2024-06-06T03:22:34.304567+0000","last_active":"2024-06-06T03:23:14.517612+0000","last_peered":"2024-06-06T03:23:14.517612+0000","last_clean":"2024-06-06T03:23:14.517612+0000","last_became_active":"2024-06-06T03:22:34.304183+0000","last_became_peered":"2024-06-06T03:22:34.304183+0000","last_unstale":"2024-06-06T03:23:14.517612+0000","last_undegraded":"2024-06-06T03:23:14.517612+0000","last_fullsized":"2024-06-06T03:23:14.517612+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:34:02.229528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"97'3","reported_seq":44,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:35.607202+0000","last_change":"2024-06-06T03:22:31.056188+0000","last_active":"2024-06-06T03:23:35.607202+0000","last_peered":"2024-06-06T03:23:35.607202+0000","last_clean":"2024-06-06T03:23:35.607202+0000","last_became_active":"2024-06-06T03:22:31.055758+0000","last_became_peered":"2024-06-06T03:22:31.055758+0000","last_unstale":"2024-06-06T03:23:35.607202+0000","last_undegraded":"2024-06-06T03:23:35.607202+0000","last_fullsized":"2024-06-06T03:23:35.607202+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:35:51.016087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":363,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.025760+0000","last_change":"2024-06-06T03:21:07.156236+0000","last_active":"2024-06-06T03:23:15.025760+0000","last_peered":"2024-06-06T03:23:15.025760+0000","last_clean":"2024-06-06T03:23:15.025760+0000","last_became_active":"2024-06-06T03:21:07.155807+0000","last_became_peered":"2024-06-06T03:21:07.155807+0000","last_unstale":"2024-06-06T03:23:15.025760+0000","last_undegraded":"2024-06-06T03:23:15.025760+0000","last_fullsized":"2024-06-06T03:23:15.025760+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:17:38.330402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:17:38.330402+0000","last_clean_scrub_stamp":"2024-06-06T03:17:38.330402+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:30:13.968755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.074001+0000","last_change":"2024-06-06T03:22:44.424693+0000","last_active":"2024-06-06T03:23:15.074001+0000","last_peered":"2024-06-06T03:23:15.074001+0000","last_clean":"2024-06-06T03:23:15.074001+0000","last_became_active":"2024-06-06T03:22:44.423607+0000","last_became_peered":"2024-06-06T03:22:44.423607+0000","last_unstale":"2024-06-06T03:23:15.074001+0000","last_undegraded":"2024-06-06T03:23:15.074001+0000","last_fullsized":"2024-06-06T03:23:15.074001+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:57:56.974785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.512047+0000","last_change":"2024-06-06T03:22:34.297940+0000","last_active":"2024-06-06T03:23:14.512047+0000","last_peered":"2024-06-06T03:23:14.512047+0000","last_clean":"2024-06-06T03:23:14.512047+0000","last_became_active":"2024-06-06T03:22:34.297597+0000","last_became_peered":"2024-06-06T03:22:34.297597+0000","last_unstale":"2024-06-06T03:23:14.512047+0000","last_undegraded":"2024-06-06T03:23:14.512047+0000","last_fullsized":"2024-06-06T03:23:14.512047+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:52:52.155070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"97'3","reported_seq":43,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:32.587942+0000","last_change":"2024-06-06T03:22:31.055329+0000","last_active":"2024-06-06T03:23:32.587942+0000","last_peered":"2024-06-06T03:23:32.587942+0000","last_clean":"2024-06-06T03:23:32.587942+0000","last_became_active":"2024-06-06T03:22:31.054493+0000","last_became_peered":"2024-06-06T03:22:31.054493+0000","last_unstale":"2024-06-06T03:23:32.587942+0000","last_undegraded":"2024-06-06T03:23:32.587942+0000","last_fullsized":"2024-06-06T03:23:32.587942+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:45:32.068810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.512587+0000","last_change":"2024-06-06T03:22:44.413560+0000","last_active":"2024-06-06T03:23:14.512587+0000","last_peered":"2024-06-06T03:23:14.512587+0000","last_clean":"2024-06-06T03:23:14.512587+0000","last_became_active":"2024-06-06T03:22:44.413100+0000","last_became_peered":"2024-06-06T03:22:44.413100+0000","last_unstale":"2024-06-06T03:23:14.512587+0000","last_undegraded":"2024-06-06T03:23:14.512587+0000","last_fullsized":"2024-06-06T03:23:14.512587+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:58:02.780671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"97'1","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:31.583136+0000","last_change":"2024-06-06T03:23:14.515805+0000","last_active":"2024-06-06T03:23:31.583136+0000","last_peered":"2024-06-06T03:23:31.583136+0000","last_clean":"2024-06-06T03:23:31.583136+0000","last_became_active":"2024-06-06T03:23:14.515436+0000","last_became_peered":"2024-06-06T03:23:14.515436+0000","last_unstale":"2024-06-06T03:23:31.583136+0000","last_undegraded":"2024-06-06T03:23:31.583136+0000","last_fullsized":"2024-06-06T03:23:31.583136+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:59:16.246609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.513108+0000","last_change":"2024-06-06T03:22:34.294549+0000","last_active":"2024-06-06T03:23:14.513108+0000","last_peered":"2024-06-06T03:23:14.513108+0000","last_clean":"2024-06-06T03:23:14.513108+0000","last_became_active":"2024-06-06T03:22:34.294202+0000","last_became_peered":"2024-06-06T03:22:34.294202+0000","last_unstale":"2024-06-06T03:23:14.513108+0000","last_undegraded":"2024-06-06T03:23:14.513108+0000","last_fullsized":"2024-06-06T03:23:14.513108+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:55:59.823957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.517426+0000","last_change":"2024-06-06T03:22:44.416890+0000","last_active":"2024-06-06T03:23:14.517426+0000","last_peered":"2024-06-06T03:23:14.517426+0000","last_clean":"2024-06-06T03:23:14.517426+0000","last_became_active":"2024-06-06T03:22:44.416473+0000","last_became_peered":"2024-06-06T03:22:44.416473+0000","last_unstale":"2024-06-06T03:23:14.517426+0000","last_undegraded":"2024-06-06T03:23:14.517426+0000","last_fullsized":"2024-06-06T03:23:14.517426+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:23:48.972196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"97'11","reported_seq":51,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:53.306800+0000","last_change":"2024-06-06T03:22:31.054481+0000","last_active":"2024-06-06T03:23:53.306800+0000","last_peered":"2024-06-06T03:23:53.306800+0000","last_clean":"2024-06-06T03:23:53.306800+0000","last_became_active":"2024-06-06T03:22:31.054173+0000","last_became_peered":"2024-06-06T03:22:31.054173+0000","last_unstale":"2024-06-06T03:23:53.306800+0000","last_undegraded":"2024-06-06T03:23:53.306800+0000","last_fullsized":"2024-06-06T03:23:53.306800+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:52:45.311149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.516538+0000","last_change":"2024-06-06T03:22:34.300211+0000","last_active":"2024-06-06T03:23:14.516538+0000","last_peered":"2024-06-06T03:23:14.516538+0000","last_clean":"2024-06-06T03:23:14.516538+0000","last_became_active":"2024-06-06T03:22:34.299870+0000","last_became_peered":"2024-06-06T03:22:34.299870+0000","last_unstale":"2024-06-06T03:23:14.516538+0000","last_undegraded":"2024-06-06T03:23:14.516538+0000","last_fullsized":"2024-06-06T03:23:14.516538+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:50:56.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.510508+0000","last_change":"2024-06-06T03:22:44.414727+0000","last_active":"2024-06-06T03:23:14.510508+0000","last_peered":"2024-06-06T03:23:14.510508+0000","last_clean":"2024-06-06T03:23:14.510508+0000","last_became_active":"2024-06-06T03:22:44.414232+0000","last_became_peered":"2024-06-06T03:22:44.414232+0000","last_unstale":"2024-06-06T03:23:14.510508+0000","last_undegraded":"2024-06-06T03:23:14.510508+0000","last_fullsized":"2024-06-06T03:23:14.510508+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:26:21.540309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"97'4","reported_seq":43,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:31.582714+0000","last_change":"2024-06-06T03:22:31.178740+0000","last_active":"2024-06-06T03:23:31.582714+0000","last_peered":"2024-06-06T03:23:31.582714+0000","last_clean":"2024-06-06T03:23:31.582714+0000","last_became_active":"2024-06-06T03:22:31.178353+0000","last_became_peered":"2024-06-06T03:22:31.178353+0000","last_unstale":"2024-06-06T03:23:31.582714+0000","last_undegraded":"2024-06-06T03:23:31.582714+0000","last_fullsized":"2024-06-06T03:23:31.582714+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:56:50.159463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.514778+0000","last_change":"2024-06-06T03:22:34.298011+0000","last_active":"2024-06-06T03:23:14.514778+0000","last_peered":"2024-06-06T03:23:14.514778+0000","last_clean":"2024-06-06T03:23:14.514778+0000","last_became_active":"2024-06-06T03:22:34.297697+0000","last_became_peered":"2024-06-06T03:22:34.297697+0000","last_unstale":"2024-06-06T03:23:14.514778+0000","last_undegraded":"2024-06-06T03:23:14.514778+0000","last_fullsized":"2024-06-06T03:23:14.514778+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:01:38.606543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.515087+0000","last_change":"2024-06-06T03:22:44.425675+0000","last_active":"2024-06-06T03:23:14.515087+0000","last_peered":"2024-06-06T03:23:14.515087+0000","last_clean":"2024-06-06T03:23:14.515087+0000","last_became_active":"2024-06-06T03:22:44.424023+0000","last_became_peered":"2024-06-06T03:22:44.424023+0000","last_unstale":"2024-06-06T03:23:14.515087+0000","last_undegraded":"2024-06-06T03:23:14.515087+0000","last_fullsized":"2024-06-06T03:23:14.515087+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:47:48.718771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"97'2","reported_seq":41,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:31.583602+0000","last_change":"2024-06-06T03:22:31.242360+0000","last_active":"2024-06-06T03:23:31.583602+0000","last_peered":"2024-06-06T03:23:31.583602+0000","last_clean":"2024-06-06T03:23:31.583602+0000","last_became_active":"2024-06-06T03:22:31.242015+0000","last_became_peered":"2024-06-06T03:22:31.242015+0000","last_unstale":"2024-06-06T03:23:31.583602+0000","last_undegraded":"2024-06-06T03:23:31.583602+0000","last_fullsized":"2024-06-06T03:23:31.583602+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:14:30.674106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.830882+0000","last_change":"2024-06-06T03:22:34.302980+0000","last_active":"2024-06-06T03:23:14.830882+0000","last_peered":"2024-06-06T03:23:14.830882+0000","last_clean":"2024-06-06T03:23:14.830882+0000","last_became_active":"2024-06-06T03:22:34.302625+0000","last_became_peered":"2024-06-06T03:22:34.302625+0000","last_unstale":"2024-06-06T03:23:14.830882+0000","last_undegraded":"2024-06-06T03:23:14.830882+0000","last_fullsized":"2024-06-06T03:23:14.830882+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:13:01.603365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.510071+0000","last_change":"2024-06-06T03:22:44.423741+0000","last_active":"2024-06-06T03:23:14.510071+0000","last_peered":"2024-06-06T03:23:14.510071+0000","last_clean":"2024-06-06T03:23:14.510071+0000","last_became_active":"2024-06-06T03:22:44.423266+0000","last_became_peered":"2024-06-06T03:22:44.423266+0000","last_unstale":"2024-06-06T03:23:14.510071+0000","last_undegraded":"2024-06-06T03:23:14.510071+0000","last_fullsized":"2024-06-06T03:23:14.510071+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:09:19.324145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"97'3","reported_seq":42,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:31.583145+0000","last_change":"2024-06-06T03:22:31.052988+0000","last_active":"2024-06-06T03:23:31.583145+0000","last_peered":"2024-06-06T03:23:31.583145+0000","last_clean":"2024-06-06T03:23:31.583145+0000","last_became_active":"2024-06-06T03:22:31.052743+0000","last_became_peered":"2024-06-06T03:22:31.052743+0000","last_unstale":"2024-06-06T03:23:31.583145+0000","last_undegraded":"2024-06-06T03:23:31.583145+0000","last_fullsized":"2024-06-06T03:23:31.583145+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:31:45.176416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.512110+0000","last_change":"2024-06-06T03:22:34.299991+0000","last_active":"2024-06-06T03:23:14.512110+0000","last_peered":"2024-06-06T03:23:14.512110+0000","last_clean":"2024-06-06T03:23:14.512110+0000","last_became_active":"2024-06-06T03:22:34.299659+0000","last_became_peered":"2024-06-06T03:22:34.299659+0000","last_unstale":"2024-06-06T03:23:14.512110+0000","last_undegraded":"2024-06-06T03:23:14.512110+0000","last_fullsized":"2024-06-06T03:23:14.512110+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:16:51.492749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"97'1","reported_seq":32,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.028062+0000","last_change":"2024-06-06T03:23:15.027541+0000","last_active":"2024-06-06T03:23:15.028062+0000","last_peered":"2024-06-06T03:23:15.028062+0000","last_clean":"2024-06-06T03:23:15.028062+0000","last_became_active":"2024-06-06T03:23:15.026931+0000","last_became_peered":"2024-06-06T03:23:15.026931+0000","last_unstale":"2024-06-06T03:23:15.028062+0000","last_undegraded":"2024-06-06T03:23:15.028062+0000","last_fullsized":"2024-06-06T03:23:15.028062+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:47:44.197067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"97'1","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.881095+0000","last_change":"2024-06-06T03:23:14.831383+0000","last_active":"2024-06-06T03:23:15.881095+0000","last_peered":"2024-06-06T03:23:15.881095+0000","last_clean":"2024-06-06T03:23:15.881095+0000","last_became_active":"2024-06-06T03:23:14.830948+0000","last_became_peered":"2024-06-06T03:23:14.830948+0000","last_unstale":"2024-06-06T03:23:15.881095+0000","last_undegraded":"2024-06-06T03:23:15.881095+0000","last_fullsized":"2024-06-06T03:23:15.881095+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:58:00.326112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.516794+0000","last_change":"2024-06-06T03:22:34.301842+0000","last_active":"2024-06-06T03:23:14.516794+0000","last_peered":"2024-06-06T03:23:14.516794+0000","last_clean":"2024-06-06T03:23:14.516794+0000","last_became_active":"2024-06-06T03:22:34.301513+0000","last_became_peered":"2024-06-06T03:22:34.301513+0000","last_unstale":"2024-06-06T03:23:14.516794+0000","last_undegraded":"2024-06-06T03:23:14.516794+0000","last_fullsized":"2024-06-06T03:23:14.516794+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:30:03.813861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.514668+0000","last_change":"2024-06-06T03:22:44.419621+0000","last_active":"2024-06-06T03:23:14.514668+0000","last_peered":"2024-06-06T03:23:14.514668+0000","last_clean":"2024-06-06T03:23:14.514668+0000","last_became_active":"2024-06-06T03:22:44.419065+0000","last_became_peered":"2024-06-06T03:22:44.419065+0000","last_unstale":"2024-06-06T03:23:14.514668+0000","last_undegraded":"2024-06-06T03:23:14.514668+0000","last_fullsized":"2024-06-06T03:23:14.514668+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:10:49.762284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"97'4","reported_seq":44,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:31.583894+0000","last_change":"2024-06-06T03:22:31.056409+0000","last_active":"2024-06-06T03:23:31.583894+0000","last_peered":"2024-06-06T03:23:31.583894+0000","last_clean":"2024-06-06T03:23:31.583894+0000","last_became_active":"2024-06-06T03:22:31.055994+0000","last_became_peered":"2024-06-06T03:22:31.055994+0000","last_unstale":"2024-06-06T03:23:31.583894+0000","last_undegraded":"2024-06-06T03:23:31.583894+0000","last_fullsized":"2024-06-06T03:23:31.583894+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:09:00.784820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.025927+0000","last_change":"2024-06-06T03:22:34.302238+0000","last_active":"2024-06-06T03:23:15.025927+0000","last_peered":"2024-06-06T03:23:15.025927+0000","last_clean":"2024-06-06T03:23:15.025927+0000","last_became_active":"2024-06-06T03:22:34.301869+0000","last_became_peered":"2024-06-06T03:22:34.301869+0000","last_unstale":"2024-06-06T03:23:15.025927+0000","last_undegraded":"2024-06-06T03:23:15.025927+0000","last_fullsized":"2024-06-06T03:23:15.025927+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:17:08.350692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.594087+0000","last_change":"2024-06-06T03:22:44.414052+0000","last_active":"2024-06-06T03:23:14.594087+0000","last_peered":"2024-06-06T03:23:14.594087+0000","last_clean":"2024-06-06T03:23:14.594087+0000","last_became_active":"2024-06-06T03:22:44.413633+0000","last_became_peered":"2024-06-06T03:22:44.413633+0000","last_unstale":"2024-06-06T03:23:14.594087+0000","last_undegraded":"2024-06-06T03:23:14.594087+0000","last_fullsized":"2024-06-06T03:23:14.594087+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:41:16.942699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"97'3","reported_seq":43,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:32.588897+0000","last_change":"2024-06-06T03:22:31.243570+0000","last_active":"2024-06-06T03:23:32.588897+0000","last_peered":"2024-06-06T03:23:32.588897+0000","last_clean":"2024-06-06T03:23:32.588897+0000","last_became_active":"2024-06-06T03:22:31.243194+0000","last_became_peered":"2024-06-06T03:22:31.243194+0000","last_unstale":"2024-06-06T03:23:32.588897+0000","last_undegraded":"2024-06-06T03:23:32.588897+0000","last_fullsized":"2024-06-06T03:23:32.588897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:21:22.233139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.026489+0000","last_change":"2024-06-06T03:22:34.301665+0000","last_active":"2024-06-06T03:23:15.026489+0000","last_peered":"2024-06-06T03:23:15.026489+0000","last_clean":"2024-06-06T03:23:15.026489+0000","last_became_active":"2024-06-06T03:22:34.300967+0000","last_became_peered":"2024-06-06T03:22:34.300967+0000","last_unstale":"2024-06-06T03:23:15.026489+0000","last_undegraded":"2024-06-06T03:23:15.026489+0000","last_fullsized":"2024-06-06T03:23:15.026489+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:57:58.905488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":31,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.833267+0000","last_change":"2024-06-06T03:23:14.833267+0000","last_active":"2024-06-06T03:23:14.833267+0000","last_peered":"2024-06-06T03:23:14.833267+0000","last_clean":"2024-06-06T03:23:14.833267+0000","last_became_active":"2024-06-06T03:23:14.832760+0000","last_became_peered":"2024-06-06T03:23:14.832760+0000","last_unstale":"2024-06-06T03:23:14.833267+0000","last_undegraded":"2024-06-06T03:23:14.833267+0000","last_fullsized":"2024-06-06T03:23:14.833267+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:24:32.668781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'1","reported_seq":42,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.073793+0000","last_change":"2024-06-06T03:22:31.054686+0000","last_active":"2024-06-06T03:23:15.073793+0000","last_peered":"2024-06-06T03:23:15.073793+0000","last_clean":"2024-06-06T03:23:15.073793+0000","last_became_active":"2024-06-06T03:22:31.053219+0000","last_became_peered":"2024-06-06T03:22:31.053219+0000","last_unstale":"2024-06-06T03:23:15.073793+0000","last_undegraded":"2024-06-06T03:23:15.073793+0000","last_fullsized":"2024-06-06T03:23:15.073793+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:32:27.423208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.026210+0000","last_change":"2024-06-06T03:22:34.304916+0000","last_active":"2024-06-06T03:23:15.026210+0000","last_peered":"2024-06-06T03:23:15.026210+0000","last_clean":"2024-06-06T03:23:15.026210+0000","last_became_active":"2024-06-06T03:22:34.302442+0000","last_became_peered":"2024-06-06T03:22:34.302442+0000","last_unstale":"2024-06-06T03:23:15.026210+0000","last_undegraded":"2024-06-06T03:23:15.026210+0000","last_fullsized":"2024-06-06T03:23:15.026210+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:01:24.034386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.073166+0000","last_change":"2024-06-06T03:22:44.415478+0000","last_active":"2024-06-06T03:23:15.073166+0000","last_peered":"2024-06-06T03:23:15.073166+0000","last_clean":"2024-06-06T03:23:15.073166+0000","last_became_active":"2024-06-06T03:22:44.415007+0000","last_became_peered":"2024-06-06T03:22:44.415007+0000","last_unstale":"2024-06-06T03:23:15.073166+0000","last_undegraded":"2024-06-06T03:23:15.073166+0000","last_fullsized":"2024-06-06T03:23:15.073166+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:57:47.793481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'2","reported_seq":52,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.521037+0000","last_change":"2024-06-06T03:23:14.521037+0000","last_active":"2024-06-06T03:23:14.521037+0000","last_peered":"2024-06-06T03:23:14.521037+0000","last_clean":"2024-06-06T03:23:14.521037+0000","last_became_active":"2024-06-06T03:23:14.517922+0000","last_became_peered":"2024-06-06T03:23:14.517922+0000","last_unstale":"2024-06-06T03:23:14.521037+0000","last_undegraded":"2024-06-06T03:23:14.521037+0000","last_fullsized":"2024-06-06T03:23:14.521037+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:12:46.222984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.026574+0000","last_change":"2024-06-06T03:22:34.305178+0000","last_active":"2024-06-06T03:23:15.026574+0000","last_peered":"2024-06-06T03:23:15.026574+0000","last_clean":"2024-06-06T03:23:15.026574+0000","last_became_active":"2024-06-06T03:22:34.302420+0000","last_became_peered":"2024-06-06T03:22:34.302420+0000","last_unstale":"2024-06-06T03:23:15.026574+0000","last_undegraded":"2024-06-06T03:23:15.026574+0000","last_fullsized":"2024-06-06T03:23:15.026574+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:22:08.736542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":40,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.514756+0000","last_change":"2024-06-06T03:23:14.514756+0000","last_active":"2024-06-06T03:23:14.514756+0000","last_peered":"2024-06-06T03:23:14.514756+0000","last_clean":"2024-06-06T03:23:14.514756+0000","last_became_active":"2024-06-06T03:23:14.514325+0000","last_became_peered":"2024-06-06T03:23:14.514325+0000","last_unstale":"2024-06-06T03:23:14.514756+0000","last_undegraded":"2024-06-06T03:23:14.514756+0000","last_fullsized":"2024-06-06T03:23:14.514756+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:45:44.594836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.511017+0000","last_change":"2024-06-06T03:22:34.298570+0000","last_active":"2024-06-06T03:23:14.511017+0000","last_peered":"2024-06-06T03:23:14.511017+0000","last_clean":"2024-06-06T03:23:14.511017+0000","last_became_active":"2024-06-06T03:22:34.298137+0000","last_became_peered":"2024-06-06T03:22:34.298137+0000","last_unstale":"2024-06-06T03:23:14.511017+0000","last_undegraded":"2024-06-06T03:23:14.511017+0000","last_fullsized":"2024-06-06T03:23:14.511017+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:07:25.290355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.510721+0000","last_change":"2024-06-06T03:22:34.297750+0000","last_active":"2024-06-06T03:23:14.510721+0000","last_peered":"2024-06-06T03:23:14.510721+0000","last_clean":"2024-06-06T03:23:14.510721+0000","last_became_active":"2024-06-06T03:22:34.297264+0000","last_became_peered":"2024-06-06T03:22:34.297264+0000","last_unstale":"2024-06-06T03:23:14.510721+0000","last_undegraded":"2024-06-06T03:23:14.510721+0000","last_fullsized":"2024-06-06T03:23:14.510721+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:14:58.580044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":40,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.832804+0000","last_change":"2024-06-06T03:23:14.832804+0000","last_active":"2024-06-06T03:23:14.832804+0000","last_peered":"2024-06-06T03:23:14.832804+0000","last_clean":"2024-06-06T03:23:14.832804+0000","last_became_active":"2024-06-06T03:23:14.832448+0000","last_became_peered":"2024-06-06T03:23:14.832448+0000","last_unstale":"2024-06-06T03:23:14.832804+0000","last_undegraded":"2024-06-06T03:23:14.832804+0000","last_fullsized":"2024-06-06T03:23:14.832804+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:52:16.907033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.515841+0000","last_change":"2024-06-06T03:23:14.515841+0000","last_active":"2024-06-06T03:23:14.515841+0000","last_peered":"2024-06-06T03:23:14.515841+0000","last_clean":"2024-06-06T03:23:14.515841+0000","last_became_active":"2024-06-06T03:23:14.515331+0000","last_became_peered":"2024-06-06T03:23:14.515331+0000","last_unstale":"2024-06-06T03:23:14.515841+0000","last_undegraded":"2024-06-06T03:23:14.515841+0000","last_fullsized":"2024-06-06T03:23:14.515841+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:46:57.178054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.512969+0000","last_change":"2024-06-06T03:22:34.299660+0000","last_active":"2024-06-06T03:23:14.512969+0000","last_peered":"2024-06-06T03:23:14.512969+0000","last_clean":"2024-06-06T03:23:14.512969+0000","last_became_active":"2024-06-06T03:22:34.298411+0000","last_became_peered":"2024-06-06T03:22:34.298411+0000","last_unstale":"2024-06-06T03:23:14.512969+0000","last_undegraded":"2024-06-06T03:23:14.512969+0000","last_fullsized":"2024-06-06T03:23:14.512969+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:29:16.170700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.511387+0000","last_change":"2024-06-06T03:22:34.308110+0000","last_active":"2024-06-06T03:23:14.511387+0000","last_peered":"2024-06-06T03:23:14.511387+0000","last_clean":"2024-06-06T03:23:14.511387+0000","last_became_active":"2024-06-06T03:22:34.307637+0000","last_became_peered":"2024-06-06T03:22:34.307637+0000","last_unstale":"2024-06-06T03:23:14.511387+0000","last_undegraded":"2024-06-06T03:23:14.511387+0000","last_fullsized":"2024-06-06T03:23:14.511387+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:40:23.264509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.516723+0000","last_change":"2024-06-06T03:22:34.295494+0000","last_active":"2024-06-06T03:23:14.516723+0000","last_peered":"2024-06-06T03:23:14.516723+0000","last_clean":"2024-06-06T03:23:14.516723+0000","last_became_active":"2024-06-06T03:22:34.295101+0000","last_became_peered":"2024-06-06T03:22:34.295101+0000","last_unstale":"2024-06-06T03:23:14.516723+0000","last_undegraded":"2024-06-06T03:23:14.516723+0000","last_fullsized":"2024-06-06T03:23:14.516723+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:39:07.298053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.073844+0000","last_change":"2024-06-06T03:22:34.291312+0000","last_active":"2024-06-06T03:23:15.073844+0000","last_peered":"2024-06-06T03:23:15.073844+0000","last_clean":"2024-06-06T03:23:15.073844+0000","last_became_active":"2024-06-06T03:22:34.290971+0000","last_became_peered":"2024-06-06T03:22:34.290971+0000","last_unstale":"2024-06-06T03:23:15.073844+0000","last_undegraded":"2024-06-06T03:23:15.073844+0000","last_fullsized":"2024-06-06T03:23:15.073844+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:06:27.333831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.517089+0000","last_change":"2024-06-06T03:22:34.292000+0000","last_active":"2024-06-06T03:23:14.517089+0000","last_peered":"2024-06-06T03:23:14.517089+0000","last_clean":"2024-06-06T03:23:14.517089+0000","last_became_active":"2024-06-06T03:22:34.291500+0000","last_became_peered":"2024-06-06T03:22:34.291500+0000","last_unstale":"2024-06-06T03:23:14.517089+0000","last_undegraded":"2024-06-06T03:23:14.517089+0000","last_fullsized":"2024-06-06T03:23:14.517089+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:37:20.677107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.594358+0000","last_change":"2024-06-06T03:22:34.303138+0000","last_active":"2024-06-06T03:23:14.594358+0000","last_peered":"2024-06-06T03:23:14.594358+0000","last_clean":"2024-06-06T03:23:14.594358+0000","last_became_active":"2024-06-06T03:22:34.302758+0000","last_became_peered":"2024-06-06T03:22:34.302758+0000","last_unstale":"2024-06-06T03:23:14.594358+0000","last_undegraded":"2024-06-06T03:23:14.594358+0000","last_fullsized":"2024-06-06T03:23:14.594358+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:34:18.516891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.513298+0000","last_change":"2024-06-06T03:22:34.297035+0000","last_active":"2024-06-06T03:23:14.513298+0000","last_peered":"2024-06-06T03:23:14.513298+0000","last_clean":"2024-06-06T03:23:14.513298+0000","last_became_active":"2024-06-06T03:22:34.296706+0000","last_became_peered":"2024-06-06T03:22:34.296706+0000","last_unstale":"2024-06-06T03:23:14.513298+0000","last_undegraded":"2024-06-06T03:23:14.513298+0000","last_fullsized":"2024-06-06T03:23:14.513298+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:26:26.959215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.512715+0000","last_change":"2024-06-06T03:22:34.296365+0000","last_active":"2024-06-06T03:23:14.512715+0000","last_peered":"2024-06-06T03:23:14.512715+0000","last_clean":"2024-06-06T03:23:14.512715+0000","last_became_active":"2024-06-06T03:22:34.296021+0000","last_became_peered":"2024-06-06T03:22:34.296021+0000","last_unstale":"2024-06-06T03:23:14.512715+0000","last_undegraded":"2024-06-06T03:23:14.512715+0000","last_fullsized":"2024-06-06T03:23:14.512715+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:40:33.183110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":249510,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":61805,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":169,"num_read_kb":150,"num_write":167,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":185415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":142,"ondisk_log_size":142,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383713,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1073152,"data_stored":551013,"data_compressed":26532,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645348,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28200,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716952,"statfs":{"total":95995035648,"available":95966158848,"internally_reserved":0,"allocated":1212416,"data_stored":1200550,"data_compressed":62644,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808874,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1085440,"data_stored":551227,"data_compressed":26532,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070512,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1081344,"data_stored":551125,"data_compressed":26532,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332149,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32284,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712868,"statfs":{"total":95995035648,"available":95961976832,"internally_reserved":0,"allocated":1134592,"data_stored":1147055,"data_compressed":62644,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495675,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1064960,"data_stored":546403,"data_compressed":26532,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28116,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717036,"statfs":{"total":95995035648,"available":95966244864,"internally_reserved":0,"allocated":1126400,"data_stored":604118,"data_compressed":26532,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36400,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708752,"statfs":{"total":95995035648,"available":95957762048,"internally_reserved":0,"allocated":1089536,"data_stored":547791,"data_compressed":26532,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411407,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32300,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712852,"statfs":{"total":95995035648,"available":95961960448,"internally_reserved":0,"allocated":1150976,"data_stored":605468,"data_compressed":26532,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182473,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1077248,"data_stored":546597,"data_compressed":26532,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920837,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1077248,"data_stored":551443,"data_compressed":26532,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757312,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32292,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712860,"statfs":{"total":95995035648,"available":95961968640,"internally_reserved":0,"allocated":1142784,"data_stored":1142253,"data_compressed":62644,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34475,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34475,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":57805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":59155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":59773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-06T03:24:02.540 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-06-06T03:24:02.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:02 smithi050 ceph-mon[32421]: pgmap v351: 129 pgs: 129 active+clean; 637 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-06-06T03:24:02.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:02 smithi050 ceph-mon[32421]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T03:24:02.800 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:24:02.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:02 smithi122 ceph-mon[35759]: pgmap v351: 129 pgs: 129 active+clean; 637 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-06-06T03:24:02.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:02 smithi122 ceph-mon[35759]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T03:24:03.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:02 smithi079 ceph-mon[35478]: pgmap v351: 129 pgs: 129 active+clean; 637 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-06-06T03:24:03.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:02 smithi079 ceph-mon[35478]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T03:24:04.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.637+0000 7f7d56b70700 1 -- 172.21.15.50:0/653995787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d501066d0 msgr2=0x7f7d5010e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:04.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.637+0000 7f7d56b70700 1 --2- 172.21.15.50:0/653995787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d501066d0 0x7f7d5010e2a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7d480099c0 tx=0x7f7d48009cd0 comp rx=0 tx=0).stop 2024-06-06T03:24:04.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.637+0000 7f7d56b70700 1 -- 172.21.15.50:0/653995787 shutdown_connections 2024-06-06T03:24:04.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.637+0000 7f7d56b70700 1 --2- 172.21.15.50:0/653995787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d501066d0 0x7f7d5010e2a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:04.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.637+0000 7f7d56b70700 1 --2- 172.21.15.50:0/653995787 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d50101680 0x7f7d50101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:04.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.637+0000 7f7d56b70700 1 --2- 172.21.15.50:0/653995787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d50102030 0x7f7d50105ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:04.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.637+0000 7f7d56b70700 1 -- 172.21.15.50:0/653995787 >> 172.21.15.50:0/653995787 conn(0x7f7d500773e0 msgr2=0x7f7d500777f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:04.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.637+0000 7f7d56b70700 1 -- 172.21.15.50:0/653995787 shutdown_connections 2024-06-06T03:24:04.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.637+0000 7f7d56b70700 1 -- 172.21.15.50:0/653995787 wait complete. 2024-06-06T03:24:04.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.638+0000 7f7d56b70700 1 Processor -- start 2024-06-06T03:24:04.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.638+0000 7f7d56b70700 1 -- start start 2024-06-06T03:24:04.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.638+0000 7f7d56b70700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d50101680 0x7f7d5019e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:04.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.638+0000 7f7d56b70700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d50102030 0x7f7d5019ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:04.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.638+0000 7f7d56b70700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d501066d0 0x7f7d501989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:04.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.638+0000 7f7d56b70700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7d50111600 con 0x7f7d50102030 2024-06-06T03:24:04.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.638+0000 7f7d56b70700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7d50111480 con 0x7f7d50101680 2024-06-06T03:24:04.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.638+0000 7f7d56b70700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7d50111780 con 0x7f7d501066d0 2024-06-06T03:24:04.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.638+0000 7f7d4ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d50102030 0x7f7d5019ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:04.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.638+0000 7f7d4ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d50102030 0x7f7d5019ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36104/0 (socket says 172.21.15.50:36104) 2024-06-06T03:24:04.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.638+0000 7f7d4ffff700 1 -- 172.21.15.50:0/4273099022 learned_addr learned my addr 172.21.15.50:0/4273099022 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:24:04.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.638+0000 7f7d5490c700 1 --2- 172.21.15.50:0/4273099022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d50101680 0x7f7d5019e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:04.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.638+0000 7f7d5510d700 1 --2- 172.21.15.50:0/4273099022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d501066d0 0x7f7d501989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:04.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.639+0000 7f7d4ffff700 1 -- 172.21.15.50:0/4273099022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d501066d0 msgr2=0x7f7d501989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:04.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.639+0000 7f7d4ffff700 1 --2- 172.21.15.50:0/4273099022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d501066d0 0x7f7d501989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:04.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.639+0000 7f7d4ffff700 1 -- 172.21.15.50:0/4273099022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d50101680 msgr2=0x7f7d5019e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:04.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.639+0000 7f7d4ffff700 1 --2- 172.21.15.50:0/4273099022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d50101680 0x7f7d5019e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:04.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.639+0000 7f7d4ffff700 1 -- 172.21.15.50:0/4273099022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d50199110 con 0x7f7d50102030 2024-06-06T03:24:04.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.639+0000 7f7d4ffff700 1 --2- 172.21.15.50:0/4273099022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d50102030 0x7f7d5019ed30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7d3800b9c0 tx=0x7f7d3800bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:04.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.639+0000 7f7d4dffb700 1 -- 172.21.15.50:0/4273099022 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3800d8e0 con 0x7f7d50102030 2024-06-06T03:24:04.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.639+0000 7f7d56b70700 1 -- 172.21.15.50:0/4273099022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d50199400 con 0x7f7d50102030 2024-06-06T03:24:04.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.639+0000 7f7d4dffb700 1 -- 172.21.15.50:0/4273099022 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7d38015420 con 0x7f7d50102030 2024-06-06T03:24:04.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.639+0000 7f7d4dffb700 1 -- 172.21.15.50:0/4273099022 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3800c660 con 0x7f7d50102030 2024-06-06T03:24:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.639+0000 7f7d56b70700 1 -- 172.21.15.50:0/4273099022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d501a56c0 con 0x7f7d50102030 2024-06-06T03:24:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.640+0000 7f7d56b70700 1 -- 172.21.15.50:0/4273099022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d50069180 con 0x7f7d50102030 2024-06-06T03:24:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.641+0000 7f7d4dffb700 1 -- 172.21.15.50:0/4273099022 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7d380155d0 con 0x7f7d50102030 2024-06-06T03:24:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.642+0000 7f7d4dffb700 1 --2- 172.21.15.50:0/4273099022 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7d3c0a2cb0 0x7f7d3c0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.642+0000 7f7d5490c700 1 --2- 172.21.15.50:0/4273099022 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7d3c0a2cb0 0x7f7d3c0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.642+0000 7f7d4dffb700 1 -- 172.21.15.50:0/4273099022 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7f7d380cf2f0 con 0x7f7d50102030 2024-06-06T03:24:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.643+0000 7f7d5490c700 1 --2- 172.21.15.50:0/4273099022 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7d3c0a2cb0 0x7f7d3c0a5170 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7d50199af0 tx=0x7f7d4000b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.646+0000 7f7d4dffb700 1 -- 172.21.15.50:0/4273099022 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7d3809bd90 con 0x7f7d50102030 2024-06-06T03:24:04.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.852+0000 7f7d56b70700 1 -- 172.21.15.50:0/4273099022 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7d500ff290 con 0x7f7d3c0a2cb0 2024-06-06T03:24:04.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.861+0000 7f7d4dffb700 1 -- 172.21.15.50:0/4273099022 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340624 (secure 0 0 0) 0x7f7d500ff290 con 0x7f7d3c0a2cb0 2024-06-06T03:24:04.865 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:24:04.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.865+0000 7f7d56b70700 1 -- 172.21.15.50:0/4273099022 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7d3c0a2cb0 msgr2=0x7f7d3c0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:04.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.865+0000 7f7d56b70700 1 --2- 172.21.15.50:0/4273099022 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7d3c0a2cb0 0x7f7d3c0a5170 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7d50199af0 tx=0x7f7d4000b3c0 comp rx=0 tx=0).stop 2024-06-06T03:24:04.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.865+0000 7f7d56b70700 1 -- 172.21.15.50:0/4273099022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d50102030 msgr2=0x7f7d5019ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:04.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.865+0000 7f7d56b70700 1 --2- 172.21.15.50:0/4273099022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d50102030 0x7f7d5019ed30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7d3800b9c0 tx=0x7f7d3800bcd0 comp rx=0 tx=0).stop 2024-06-06T03:24:04.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.865+0000 7f7d56b70700 1 -- 172.21.15.50:0/4273099022 shutdown_connections 2024-06-06T03:24:04.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.865+0000 7f7d56b70700 1 --2- 172.21.15.50:0/4273099022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d501066d0 0x7f7d501989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:04.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.865+0000 7f7d56b70700 1 --2- 172.21.15.50:0/4273099022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d50101680 0x7f7d5019e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:04.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.865+0000 7f7d56b70700 1 --2- 172.21.15.50:0/4273099022 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7d3c0a2cb0 0x7f7d3c0a5170 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:04.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.865+0000 7f7d56b70700 1 --2- 172.21.15.50:0/4273099022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d50102030 0x7f7d5019ed30 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:04.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.865+0000 7f7d56b70700 1 -- 172.21.15.50:0/4273099022 >> 172.21.15.50:0/4273099022 conn(0x7f7d500773e0 msgr2=0x7f7d50105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:04.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.865+0000 7f7d56b70700 1 -- 172.21.15.50:0/4273099022 shutdown_connections 2024-06-06T03:24:04.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:04.865+0000 7f7d56b70700 1 -- 172.21.15.50:0/4273099022 wait complete. 2024-06-06T03:24:04.869 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-06-06T03:24:04.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:04 smithi122 ceph-mon[35759]: pgmap v352: 129 pgs: 129 active+clean; 637 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-06-06T03:24:05.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:04 smithi050 ceph-mon[32421]: pgmap v352: 129 pgs: 129 active+clean; 637 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-06-06T03:24:05.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:04 smithi079 ceph-mon[35478]: pgmap v352: 129 pgs: 129 active+clean; 637 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-06-06T03:24:05.672 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":352,"stamp":"2024-06-06T03:24:03.361356+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":652407,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":295,"num_read_kb":259,"num_write":352,"num_write_kb":3053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":282,"ondisk_log_size":282,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374640,"kb_used_data":13008,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567184,"statfs":{"total":1151940427776,"available":1151556796416,"internally_reserved":0,"allocated":13320192,"data_stored":8549308,"data_compressed":426720,"data_compressed_allocated":577536,"data_compressed_original":2654208,"omap_allocated":19141,"internal_metadata":370193723},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":27579,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":58,"num_write":24,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003429"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.513503+0000","last_change":"2024-06-06T03:22:34.302364+0000","last_active":"2024-06-06T03:23:14.513503+0000","last_peered":"2024-06-06T03:23:14.513503+0000","last_clean":"2024-06-06T03:23:14.513503+0000","last_became_active":"2024-06-06T03:22:34.300403+0000","last_became_peered":"2024-06-06T03:22:34.300403+0000","last_unstale":"2024-06-06T03:23:14.513503+0000","last_undegraded":"2024-06-06T03:23:14.513503+0000","last_fullsized":"2024-06-06T03:23:14.513503+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:27:55.377346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.514671+0000","last_change":"2024-06-06T03:22:34.306188+0000","last_active":"2024-06-06T03:23:14.514671+0000","last_peered":"2024-06-06T03:23:14.514671+0000","last_clean":"2024-06-06T03:23:14.514671+0000","last_became_active":"2024-06-06T03:22:34.305705+0000","last_became_peered":"2024-06-06T03:22:34.305705+0000","last_unstale":"2024-06-06T03:23:14.514671+0000","last_undegraded":"2024-06-06T03:23:14.514671+0000","last_fullsized":"2024-06-06T03:23:14.514671+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:10:07.337989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.512210+0000","last_change":"2024-06-06T03:22:34.303568+0000","last_active":"2024-06-06T03:23:14.512210+0000","last_peered":"2024-06-06T03:23:14.512210+0000","last_clean":"2024-06-06T03:23:14.512210+0000","last_became_active":"2024-06-06T03:22:34.303194+0000","last_became_peered":"2024-06-06T03:22:34.303194+0000","last_unstale":"2024-06-06T03:23:14.512210+0000","last_undegraded":"2024-06-06T03:23:14.512210+0000","last_fullsized":"2024-06-06T03:23:14.512210+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:40:46.387476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.514793+0000","last_change":"2024-06-06T03:22:34.303896+0000","last_active":"2024-06-06T03:23:14.514793+0000","last_peered":"2024-06-06T03:23:14.514793+0000","last_clean":"2024-06-06T03:23:14.514793+0000","last_became_active":"2024-06-06T03:22:34.303568+0000","last_became_peered":"2024-06-06T03:22:34.303568+0000","last_unstale":"2024-06-06T03:23:14.514793+0000","last_undegraded":"2024-06-06T03:23:14.514793+0000","last_fullsized":"2024-06-06T03:23:14.514793+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:24:20.160115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.831387+0000","last_change":"2024-06-06T03:22:34.289868+0000","last_active":"2024-06-06T03:23:14.831387+0000","last_peered":"2024-06-06T03:23:14.831387+0000","last_clean":"2024-06-06T03:23:14.831387+0000","last_became_active":"2024-06-06T03:22:34.289485+0000","last_became_peered":"2024-06-06T03:22:34.289485+0000","last_unstale":"2024-06-06T03:23:14.831387+0000","last_undegraded":"2024-06-06T03:23:14.831387+0000","last_fullsized":"2024-06-06T03:23:14.831387+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:28:58.226092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.513942+0000","last_change":"2024-06-06T03:22:34.304643+0000","last_active":"2024-06-06T03:23:14.513942+0000","last_peered":"2024-06-06T03:23:14.513942+0000","last_clean":"2024-06-06T03:23:14.513942+0000","last_became_active":"2024-06-06T03:22:34.303342+0000","last_became_peered":"2024-06-06T03:22:34.303342+0000","last_unstale":"2024-06-06T03:23:14.513942+0000","last_undegraded":"2024-06-06T03:23:14.513942+0000","last_fullsized":"2024-06-06T03:23:14.513942+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:28:27.838518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.025817+0000","last_change":"2024-06-06T03:22:34.304958+0000","last_active":"2024-06-06T03:23:15.025817+0000","last_peered":"2024-06-06T03:23:15.025817+0000","last_clean":"2024-06-06T03:23:15.025817+0000","last_became_active":"2024-06-06T03:22:34.304582+0000","last_became_peered":"2024-06-06T03:22:34.304582+0000","last_unstale":"2024-06-06T03:23:15.025817+0000","last_undegraded":"2024-06-06T03:23:15.025817+0000","last_fullsized":"2024-06-06T03:23:15.025817+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:08:56.304446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.517547+0000","last_change":"2024-06-06T03:22:34.299883+0000","last_active":"2024-06-06T03:23:14.517547+0000","last_peered":"2024-06-06T03:23:14.517547+0000","last_clean":"2024-06-06T03:23:14.517547+0000","last_became_active":"2024-06-06T03:22:34.299568+0000","last_became_peered":"2024-06-06T03:22:34.299568+0000","last_unstale":"2024-06-06T03:23:14.517547+0000","last_undegraded":"2024-06-06T03:23:14.517547+0000","last_fullsized":"2024-06-06T03:23:14.517547+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:23:32.479592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.594708+0000","last_change":"2024-06-06T03:22:34.303157+0000","last_active":"2024-06-06T03:23:14.594708+0000","last_peered":"2024-06-06T03:23:14.594708+0000","last_clean":"2024-06-06T03:23:14.594708+0000","last_became_active":"2024-06-06T03:22:34.302332+0000","last_became_peered":"2024-06-06T03:22:34.302332+0000","last_unstale":"2024-06-06T03:23:14.594708+0000","last_undegraded":"2024-06-06T03:23:14.594708+0000","last_fullsized":"2024-06-06T03:23:14.594708+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:27:32.420058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":40,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.517357+0000","last_change":"2024-06-06T03:23:14.517357+0000","last_active":"2024-06-06T03:23:14.517357+0000","last_peered":"2024-06-06T03:23:14.517357+0000","last_clean":"2024-06-06T03:23:14.517357+0000","last_became_active":"2024-06-06T03:23:14.516932+0000","last_became_peered":"2024-06-06T03:23:14.516932+0000","last_unstale":"2024-06-06T03:23:14.517357+0000","last_undegraded":"2024-06-06T03:23:14.517357+0000","last_fullsized":"2024-06-06T03:23:14.517357+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:23:43.907192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.026359+0000","last_change":"2024-06-06T03:22:34.310010+0000","last_active":"2024-06-06T03:23:15.026359+0000","last_peered":"2024-06-06T03:23:15.026359+0000","last_clean":"2024-06-06T03:23:15.026359+0000","last_became_active":"2024-06-06T03:22:34.309636+0000","last_became_peered":"2024-06-06T03:22:34.309636+0000","last_unstale":"2024-06-06T03:23:15.026359+0000","last_undegraded":"2024-06-06T03:23:15.026359+0000","last_fullsized":"2024-06-06T03:23:15.026359+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:35:53.745050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.514704+0000","last_change":"2024-06-06T03:22:34.311364+0000","last_active":"2024-06-06T03:23:14.514704+0000","last_peered":"2024-06-06T03:23:14.514704+0000","last_clean":"2024-06-06T03:23:14.514704+0000","last_became_active":"2024-06-06T03:22:34.311003+0000","last_became_peered":"2024-06-06T03:22:34.311003+0000","last_unstale":"2024-06-06T03:23:14.514704+0000","last_undegraded":"2024-06-06T03:23:14.514704+0000","last_fullsized":"2024-06-06T03:23:14.514704+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:35:32.460362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.513201+0000","last_change":"2024-06-06T03:22:34.302843+0000","last_active":"2024-06-06T03:23:14.513201+0000","last_peered":"2024-06-06T03:23:14.513201+0000","last_clean":"2024-06-06T03:23:14.513201+0000","last_became_active":"2024-06-06T03:22:34.302581+0000","last_became_peered":"2024-06-06T03:22:34.302581+0000","last_unstale":"2024-06-06T03:23:14.513201+0000","last_undegraded":"2024-06-06T03:23:14.513201+0000","last_fullsized":"2024-06-06T03:23:14.513201+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:56:14.178848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.511691+0000","last_change":"2024-06-06T03:22:34.305792+0000","last_active":"2024-06-06T03:23:14.511691+0000","last_peered":"2024-06-06T03:23:14.511691+0000","last_clean":"2024-06-06T03:23:14.511691+0000","last_became_active":"2024-06-06T03:22:34.305389+0000","last_became_peered":"2024-06-06T03:22:34.305389+0000","last_unstale":"2024-06-06T03:23:14.511691+0000","last_undegraded":"2024-06-06T03:23:14.511691+0000","last_fullsized":"2024-06-06T03:23:14.511691+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:17:05.992382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.511718+0000","last_change":"2024-06-06T03:22:34.298396+0000","last_active":"2024-06-06T03:23:14.511718+0000","last_peered":"2024-06-06T03:23:14.511718+0000","last_clean":"2024-06-06T03:23:14.511718+0000","last_became_active":"2024-06-06T03:22:34.297697+0000","last_became_peered":"2024-06-06T03:22:34.297697+0000","last_unstale":"2024-06-06T03:23:14.511718+0000","last_undegraded":"2024-06-06T03:23:14.511718+0000","last_fullsized":"2024-06-06T03:23:14.511718+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:24:07.143699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.593938+0000","last_change":"2024-06-06T03:22:34.312801+0000","last_active":"2024-06-06T03:23:14.593938+0000","last_peered":"2024-06-06T03:23:14.593938+0000","last_clean":"2024-06-06T03:23:14.593938+0000","last_became_active":"2024-06-06T03:22:34.312206+0000","last_became_peered":"2024-06-06T03:22:34.312206+0000","last_unstale":"2024-06-06T03:23:14.593938+0000","last_undegraded":"2024-06-06T03:23:14.593938+0000","last_fullsized":"2024-06-06T03:23:14.593938+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:31:41.286548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.513218+0000","last_change":"2024-06-06T03:22:34.303527+0000","last_active":"2024-06-06T03:23:14.513218+0000","last_peered":"2024-06-06T03:23:14.513218+0000","last_clean":"2024-06-06T03:23:14.513218+0000","last_became_active":"2024-06-06T03:22:34.302919+0000","last_became_peered":"2024-06-06T03:22:34.302919+0000","last_unstale":"2024-06-06T03:23:14.513218+0000","last_undegraded":"2024-06-06T03:23:14.513218+0000","last_fullsized":"2024-06-06T03:23:14.513218+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:41:44.128543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.509787+0000","last_change":"2024-06-06T03:22:34.304801+0000","last_active":"2024-06-06T03:23:14.509787+0000","last_peered":"2024-06-06T03:23:14.509787+0000","last_clean":"2024-06-06T03:23:14.509787+0000","last_became_active":"2024-06-06T03:22:34.304463+0000","last_became_peered":"2024-06-06T03:22:34.304463+0000","last_unstale":"2024-06-06T03:23:14.509787+0000","last_undegraded":"2024-06-06T03:23:14.509787+0000","last_fullsized":"2024-06-06T03:23:14.509787+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:28:22.789816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.511853+0000","last_change":"2024-06-06T03:22:34.290053+0000","last_active":"2024-06-06T03:23:14.511853+0000","last_peered":"2024-06-06T03:23:14.511853+0000","last_clean":"2024-06-06T03:23:14.511853+0000","last_became_active":"2024-06-06T03:22:34.289712+0000","last_became_peered":"2024-06-06T03:22:34.289712+0000","last_unstale":"2024-06-06T03:23:14.511853+0000","last_undegraded":"2024-06-06T03:23:14.511853+0000","last_fullsized":"2024-06-06T03:23:14.511853+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:12:02.296431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.510798+0000","last_change":"2024-06-06T03:22:44.421722+0000","last_active":"2024-06-06T03:23:14.510798+0000","last_peered":"2024-06-06T03:23:14.510798+0000","last_clean":"2024-06-06T03:23:14.510798+0000","last_became_active":"2024-06-06T03:22:44.421215+0000","last_became_peered":"2024-06-06T03:22:44.421215+0000","last_unstale":"2024-06-06T03:23:14.510798+0000","last_undegraded":"2024-06-06T03:23:14.510798+0000","last_fullsized":"2024-06-06T03:23:14.510798+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:22:59.749839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"97'9","reported_seq":50,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:32.589353+0000","last_change":"2024-06-06T03:22:31.053826+0000","last_active":"2024-06-06T03:23:32.589353+0000","last_peered":"2024-06-06T03:23:32.589353+0000","last_clean":"2024-06-06T03:23:32.589353+0000","last_became_active":"2024-06-06T03:22:31.053537+0000","last_became_peered":"2024-06-06T03:22:31.053537+0000","last_unstale":"2024-06-06T03:23:32.589353+0000","last_undegraded":"2024-06-06T03:23:32.589353+0000","last_fullsized":"2024-06-06T03:23:32.589353+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:18:52.967104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.516822+0000","last_change":"2024-06-06T03:22:34.291554+0000","last_active":"2024-06-06T03:23:14.516822+0000","last_peered":"2024-06-06T03:23:14.516822+0000","last_clean":"2024-06-06T03:23:14.516822+0000","last_became_active":"2024-06-06T03:22:34.290600+0000","last_became_peered":"2024-06-06T03:22:34.290600+0000","last_unstale":"2024-06-06T03:23:14.516822+0000","last_undegraded":"2024-06-06T03:23:14.516822+0000","last_fullsized":"2024-06-06T03:23:14.516822+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:03:32.860134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.514175+0000","last_change":"2024-06-06T03:22:44.424337+0000","last_active":"2024-06-06T03:23:14.514175+0000","last_peered":"2024-06-06T03:23:14.514175+0000","last_clean":"2024-06-06T03:23:14.514175+0000","last_became_active":"2024-06-06T03:22:44.423919+0000","last_became_peered":"2024-06-06T03:22:44.423919+0000","last_unstale":"2024-06-06T03:23:14.514175+0000","last_undegraded":"2024-06-06T03:23:14.514175+0000","last_fullsized":"2024-06-06T03:23:14.514175+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:34:32.801117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"97'2","reported_seq":41,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.516789+0000","last_change":"2024-06-06T03:22:31.242326+0000","last_active":"2024-06-06T03:23:14.516789+0000","last_peered":"2024-06-06T03:23:14.516789+0000","last_clean":"2024-06-06T03:23:14.516789+0000","last_became_active":"2024-06-06T03:22:31.241960+0000","last_became_peered":"2024-06-06T03:22:31.241960+0000","last_unstale":"2024-06-06T03:23:14.516789+0000","last_undegraded":"2024-06-06T03:23:14.516789+0000","last_fullsized":"2024-06-06T03:23:14.516789+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:19:57.820119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.512587+0000","last_change":"2024-06-06T03:22:34.303438+0000","last_active":"2024-06-06T03:23:14.512587+0000","last_peered":"2024-06-06T03:23:14.512587+0000","last_clean":"2024-06-06T03:23:14.512587+0000","last_became_active":"2024-06-06T03:22:34.302057+0000","last_became_peered":"2024-06-06T03:22:34.302057+0000","last_unstale":"2024-06-06T03:23:14.512587+0000","last_undegraded":"2024-06-06T03:23:14.512587+0000","last_fullsized":"2024-06-06T03:23:14.512587+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:52:20.508656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.513966+0000","last_change":"2024-06-06T03:22:44.424732+0000","last_active":"2024-06-06T03:23:14.513966+0000","last_peered":"2024-06-06T03:23:14.513966+0000","last_clean":"2024-06-06T03:23:14.513966+0000","last_became_active":"2024-06-06T03:22:44.423906+0000","last_became_peered":"2024-06-06T03:22:44.423906+0000","last_unstale":"2024-06-06T03:23:14.513966+0000","last_undegraded":"2024-06-06T03:23:14.513966+0000","last_fullsized":"2024-06-06T03:23:14.513966+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:45:04.344747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"97'4","reported_seq":43,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:32.587499+0000","last_change":"2024-06-06T03:22:31.057003+0000","last_active":"2024-06-06T03:23:32.587499+0000","last_peered":"2024-06-06T03:23:32.587499+0000","last_clean":"2024-06-06T03:23:32.587499+0000","last_became_active":"2024-06-06T03:22:31.056660+0000","last_became_peered":"2024-06-06T03:22:31.056660+0000","last_unstale":"2024-06-06T03:23:32.587499+0000","last_undegraded":"2024-06-06T03:23:32.587499+0000","last_fullsized":"2024-06-06T03:23:32.587499+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:44:16.726749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.594316+0000","last_change":"2024-06-06T03:22:34.306196+0000","last_active":"2024-06-06T03:23:14.594316+0000","last_peered":"2024-06-06T03:23:14.594316+0000","last_clean":"2024-06-06T03:23:14.594316+0000","last_became_active":"2024-06-06T03:22:34.304962+0000","last_became_peered":"2024-06-06T03:22:34.304962+0000","last_unstale":"2024-06-06T03:23:14.594316+0000","last_undegraded":"2024-06-06T03:23:14.594316+0000","last_fullsized":"2024-06-06T03:23:14.594316+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:25:04.990371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.514098+0000","last_change":"2024-06-06T03:22:44.419624+0000","last_active":"2024-06-06T03:23:14.514098+0000","last_peered":"2024-06-06T03:23:14.514098+0000","last_clean":"2024-06-06T03:23:14.514098+0000","last_became_active":"2024-06-06T03:22:44.418713+0000","last_became_peered":"2024-06-06T03:22:44.418713+0000","last_unstale":"2024-06-06T03:23:14.514098+0000","last_undegraded":"2024-06-06T03:23:14.514098+0000","last_fullsized":"2024-06-06T03:23:14.514098+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:04:54.010364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'2","reported_seq":41,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.831706+0000","last_change":"2024-06-06T03:22:31.059332+0000","last_active":"2024-06-06T03:23:14.831706+0000","last_peered":"2024-06-06T03:23:14.831706+0000","last_clean":"2024-06-06T03:23:14.831706+0000","last_became_active":"2024-06-06T03:22:31.058478+0000","last_became_peered":"2024-06-06T03:22:31.058478+0000","last_unstale":"2024-06-06T03:23:14.831706+0000","last_undegraded":"2024-06-06T03:23:14.831706+0000","last_fullsized":"2024-06-06T03:23:14.831706+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:24:46.452708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.073717+0000","last_change":"2024-06-06T03:22:34.301650+0000","last_active":"2024-06-06T03:23:15.073717+0000","last_peered":"2024-06-06T03:23:15.073717+0000","last_clean":"2024-06-06T03:23:15.073717+0000","last_became_active":"2024-06-06T03:22:34.301220+0000","last_became_peered":"2024-06-06T03:22:34.301220+0000","last_unstale":"2024-06-06T03:23:15.073717+0000","last_undegraded":"2024-06-06T03:23:15.073717+0000","last_fullsized":"2024-06-06T03:23:15.073717+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:43:07.396971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.511520+0000","last_change":"2024-06-06T03:22:44.413406+0000","last_active":"2024-06-06T03:23:14.511520+0000","last_peered":"2024-06-06T03:23:14.511520+0000","last_clean":"2024-06-06T03:23:14.511520+0000","last_became_active":"2024-06-06T03:22:44.412977+0000","last_became_peered":"2024-06-06T03:22:44.412977+0000","last_unstale":"2024-06-06T03:23:14.511520+0000","last_undegraded":"2024-06-06T03:23:14.511520+0000","last_fullsized":"2024-06-06T03:23:14.511520+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:11:02.017352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"97'5","reported_seq":70,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:56.641372+0000","last_change":"2024-06-06T03:22:31.056091+0000","last_active":"2024-06-06T03:23:56.641372+0000","last_peered":"2024-06-06T03:23:56.641372+0000","last_clean":"2024-06-06T03:23:56.641372+0000","last_became_active":"2024-06-06T03:22:31.055184+0000","last_became_peered":"2024-06-06T03:22:31.055184+0000","last_unstale":"2024-06-06T03:23:56.641372+0000","last_undegraded":"2024-06-06T03:23:56.641372+0000","last_fullsized":"2024-06-06T03:23:56.641372+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:32:37.761082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.831414+0000","last_change":"2024-06-06T03:22:34.305386+0000","last_active":"2024-06-06T03:23:14.831414+0000","last_peered":"2024-06-06T03:23:14.831414+0000","last_clean":"2024-06-06T03:23:14.831414+0000","last_became_active":"2024-06-06T03:22:34.304505+0000","last_became_peered":"2024-06-06T03:22:34.304505+0000","last_unstale":"2024-06-06T03:23:14.831414+0000","last_undegraded":"2024-06-06T03:23:14.831414+0000","last_fullsized":"2024-06-06T03:23:14.831414+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:34:31.800443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":31,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.075519+0000","last_change":"2024-06-06T03:23:15.075519+0000","last_active":"2024-06-06T03:23:15.075519+0000","last_peered":"2024-06-06T03:23:15.075519+0000","last_clean":"2024-06-06T03:23:15.075519+0000","last_became_active":"2024-06-06T03:23:15.074970+0000","last_became_peered":"2024-06-06T03:23:15.074970+0000","last_unstale":"2024-06-06T03:23:15.075519+0000","last_undegraded":"2024-06-06T03:23:15.075519+0000","last_fullsized":"2024-06-06T03:23:15.075519+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:39:25.915175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"97'3","reported_seq":43,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:32.587213+0000","last_change":"2024-06-06T03:22:31.058530+0000","last_active":"2024-06-06T03:23:32.587213+0000","last_peered":"2024-06-06T03:23:32.587213+0000","last_clean":"2024-06-06T03:23:32.587213+0000","last_became_active":"2024-06-06T03:22:31.058185+0000","last_became_peered":"2024-06-06T03:22:31.058185+0000","last_unstale":"2024-06-06T03:23:32.587213+0000","last_undegraded":"2024-06-06T03:23:32.587213+0000","last_fullsized":"2024-06-06T03:23:32.587213+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:28:59.023322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.073763+0000","last_change":"2024-06-06T03:22:34.292995+0000","last_active":"2024-06-06T03:23:15.073763+0000","last_peered":"2024-06-06T03:23:15.073763+0000","last_clean":"2024-06-06T03:23:15.073763+0000","last_became_active":"2024-06-06T03:22:34.292625+0000","last_became_peered":"2024-06-06T03:22:34.292625+0000","last_unstale":"2024-06-06T03:23:15.073763+0000","last_undegraded":"2024-06-06T03:23:15.073763+0000","last_fullsized":"2024-06-06T03:23:15.073763+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:03:18.985660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.513602+0000","last_change":"2024-06-06T03:22:44.417395+0000","last_active":"2024-06-06T03:23:14.513602+0000","last_peered":"2024-06-06T03:23:14.513602+0000","last_clean":"2024-06-06T03:23:14.513602+0000","last_became_active":"2024-06-06T03:22:44.416929+0000","last_became_peered":"2024-06-06T03:22:44.416929+0000","last_unstale":"2024-06-06T03:23:14.513602+0000","last_undegraded":"2024-06-06T03:23:14.513602+0000","last_fullsized":"2024-06-06T03:23:14.513602+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:28:09.548691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"97'2","reported_seq":42,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:32.586379+0000","last_change":"2024-06-06T03:22:31.051163+0000","last_active":"2024-06-06T03:23:32.586379+0000","last_peered":"2024-06-06T03:23:32.586379+0000","last_clean":"2024-06-06T03:23:32.586379+0000","last_became_active":"2024-06-06T03:22:31.050800+0000","last_became_peered":"2024-06-06T03:22:31.050800+0000","last_unstale":"2024-06-06T03:23:32.586379+0000","last_undegraded":"2024-06-06T03:23:32.586379+0000","last_fullsized":"2024-06-06T03:23:32.586379+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:13:40.197723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.517426+0000","last_change":"2024-06-06T03:22:34.293586+0000","last_active":"2024-06-06T03:23:14.517426+0000","last_peered":"2024-06-06T03:23:14.517426+0000","last_clean":"2024-06-06T03:23:14.517426+0000","last_became_active":"2024-06-06T03:22:34.292651+0000","last_became_peered":"2024-06-06T03:22:34.292651+0000","last_unstale":"2024-06-06T03:23:14.517426+0000","last_undegraded":"2024-06-06T03:23:14.517426+0000","last_fullsized":"2024-06-06T03:23:14.517426+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:11:16.221948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.514671+0000","last_change":"2024-06-06T03:22:44.415005+0000","last_active":"2024-06-06T03:23:14.514671+0000","last_peered":"2024-06-06T03:23:14.514671+0000","last_clean":"2024-06-06T03:23:14.514671+0000","last_became_active":"2024-06-06T03:22:44.414522+0000","last_became_peered":"2024-06-06T03:22:44.414522+0000","last_unstale":"2024-06-06T03:23:14.514671+0000","last_undegraded":"2024-06-06T03:23:14.514671+0000","last_fullsized":"2024-06-06T03:23:14.514671+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:36:03.240089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"97'1","reported_seq":41,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.073679+0000","last_change":"2024-06-06T03:22:31.056068+0000","last_active":"2024-06-06T03:23:15.073679+0000","last_peered":"2024-06-06T03:23:15.073679+0000","last_clean":"2024-06-06T03:23:15.073679+0000","last_became_active":"2024-06-06T03:22:31.055628+0000","last_became_peered":"2024-06-06T03:22:31.055628+0000","last_unstale":"2024-06-06T03:23:15.073679+0000","last_undegraded":"2024-06-06T03:23:15.073679+0000","last_fullsized":"2024-06-06T03:23:15.073679+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:40:37.491491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.509557+0000","last_change":"2024-06-06T03:22:34.300945+0000","last_active":"2024-06-06T03:23:14.509557+0000","last_peered":"2024-06-06T03:23:14.509557+0000","last_clean":"2024-06-06T03:23:14.509557+0000","last_became_active":"2024-06-06T03:22:34.300618+0000","last_became_peered":"2024-06-06T03:22:34.300618+0000","last_unstale":"2024-06-06T03:23:14.509557+0000","last_undegraded":"2024-06-06T03:23:14.509557+0000","last_fullsized":"2024-06-06T03:23:14.509557+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:32:39.875148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.516884+0000","last_change":"2024-06-06T03:22:44.417759+0000","last_active":"2024-06-06T03:23:14.516884+0000","last_peered":"2024-06-06T03:23:14.516884+0000","last_clean":"2024-06-06T03:23:14.516884+0000","last_became_active":"2024-06-06T03:22:44.417335+0000","last_became_peered":"2024-06-06T03:22:44.417335+0000","last_unstale":"2024-06-06T03:23:14.516884+0000","last_undegraded":"2024-06-06T03:23:14.516884+0000","last_fullsized":"2024-06-06T03:23:14.516884+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:43:24.408740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"97'3","reported_seq":67,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:57.642062+0000","last_change":"2024-06-06T03:22:31.054351+0000","last_active":"2024-06-06T03:23:57.642062+0000","last_peered":"2024-06-06T03:23:57.642062+0000","last_clean":"2024-06-06T03:23:57.642062+0000","last_became_active":"2024-06-06T03:22:31.053954+0000","last_became_peered":"2024-06-06T03:22:31.053954+0000","last_unstale":"2024-06-06T03:23:57.642062+0000","last_undegraded":"2024-06-06T03:23:57.642062+0000","last_fullsized":"2024-06-06T03:23:57.642062+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:22:46.405507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.594645+0000","last_change":"2024-06-06T03:22:34.303208+0000","last_active":"2024-06-06T03:23:14.594645+0000","last_peered":"2024-06-06T03:23:14.594645+0000","last_clean":"2024-06-06T03:23:14.594645+0000","last_became_active":"2024-06-06T03:22:34.302882+0000","last_became_peered":"2024-06-06T03:22:34.302882+0000","last_unstale":"2024-06-06T03:23:14.594645+0000","last_undegraded":"2024-06-06T03:23:14.594645+0000","last_fullsized":"2024-06-06T03:23:14.594645+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:01:36.963056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.509439+0000","last_change":"2024-06-06T03:22:44.418095+0000","last_active":"2024-06-06T03:23:14.509439+0000","last_peered":"2024-06-06T03:23:14.509439+0000","last_clean":"2024-06-06T03:23:14.509439+0000","last_became_active":"2024-06-06T03:22:44.417625+0000","last_became_peered":"2024-06-06T03:22:44.417625+0000","last_unstale":"2024-06-06T03:23:14.509439+0000","last_undegraded":"2024-06-06T03:23:14.509439+0000","last_fullsized":"2024-06-06T03:23:14.509439+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:20:53.859638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"97'2","reported_seq":42,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:31.583947+0000","last_change":"2024-06-06T03:22:31.057558+0000","last_active":"2024-06-06T03:23:31.583947+0000","last_peered":"2024-06-06T03:23:31.583947+0000","last_clean":"2024-06-06T03:23:31.583947+0000","last_became_active":"2024-06-06T03:22:31.057168+0000","last_became_peered":"2024-06-06T03:22:31.057168+0000","last_unstale":"2024-06-06T03:23:31.583947+0000","last_undegraded":"2024-06-06T03:23:31.583947+0000","last_fullsized":"2024-06-06T03:23:31.583947+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:33:59.019923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.512836+0000","last_change":"2024-06-06T03:22:34.299220+0000","last_active":"2024-06-06T03:23:14.512836+0000","last_peered":"2024-06-06T03:23:14.512836+0000","last_clean":"2024-06-06T03:23:14.512836+0000","last_became_active":"2024-06-06T03:22:34.298873+0000","last_became_peered":"2024-06-06T03:22:34.298873+0000","last_unstale":"2024-06-06T03:23:14.512836+0000","last_undegraded":"2024-06-06T03:23:14.512836+0000","last_fullsized":"2024-06-06T03:23:14.512836+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:31:53.501036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.514113+0000","last_change":"2024-06-06T03:22:44.424792+0000","last_active":"2024-06-06T03:23:14.514113+0000","last_peered":"2024-06-06T03:23:14.514113+0000","last_clean":"2024-06-06T03:23:14.514113+0000","last_became_active":"2024-06-06T03:22:44.423973+0000","last_became_peered":"2024-06-06T03:22:44.423973+0000","last_unstale":"2024-06-06T03:23:14.514113+0000","last_undegraded":"2024-06-06T03:23:14.514113+0000","last_fullsized":"2024-06-06T03:23:14.514113+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:46:51.232764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"97'4","reported_seq":45,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:31.583322+0000","last_change":"2024-06-06T03:22:31.243885+0000","last_active":"2024-06-06T03:23:31.583322+0000","last_peered":"2024-06-06T03:23:31.583322+0000","last_clean":"2024-06-06T03:23:31.583322+0000","last_became_active":"2024-06-06T03:22:31.243367+0000","last_became_peered":"2024-06-06T03:22:31.243367+0000","last_unstale":"2024-06-06T03:23:31.583322+0000","last_undegraded":"2024-06-06T03:23:31.583322+0000","last_fullsized":"2024-06-06T03:23:31.583322+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:57:13.464974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.594284+0000","last_change":"2024-06-06T03:22:34.299247+0000","last_active":"2024-06-06T03:23:14.594284+0000","last_peered":"2024-06-06T03:23:14.594284+0000","last_clean":"2024-06-06T03:23:14.594284+0000","last_became_active":"2024-06-06T03:22:34.298538+0000","last_became_peered":"2024-06-06T03:22:34.298538+0000","last_unstale":"2024-06-06T03:23:14.594284+0000","last_undegraded":"2024-06-06T03:23:14.594284+0000","last_fullsized":"2024-06-06T03:23:14.594284+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:53:16.724575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.509611+0000","last_change":"2024-06-06T03:22:44.423817+0000","last_active":"2024-06-06T03:23:14.509611+0000","last_peered":"2024-06-06T03:23:14.509611+0000","last_clean":"2024-06-06T03:23:14.509611+0000","last_became_active":"2024-06-06T03:22:44.423333+0000","last_became_peered":"2024-06-06T03:22:44.423333+0000","last_unstale":"2024-06-06T03:23:14.509611+0000","last_undegraded":"2024-06-06T03:23:14.509611+0000","last_fullsized":"2024-06-06T03:23:14.509611+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:22:46.174850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"97'32","reported_seq":128,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:58.644168+0000","last_change":"2024-06-06T03:22:31.056446+0000","last_active":"2024-06-06T03:23:58.644168+0000","last_peered":"2024-06-06T03:23:58.644168+0000","last_clean":"2024-06-06T03:23:58.644168+0000","last_became_active":"2024-06-06T03:22:31.056089+0000","last_became_peered":"2024-06-06T03:22:31.056089+0000","last_unstale":"2024-06-06T03:23:58.644168+0000","last_undegraded":"2024-06-06T03:23:58.644168+0000","last_fullsized":"2024-06-06T03:23:58.644168+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:11:37.705889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57805,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":84,"num_write":33,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.832126+0000","last_change":"2024-06-06T03:22:34.302229+0000","last_active":"2024-06-06T03:23:14.832126+0000","last_peered":"2024-06-06T03:23:14.832126+0000","last_clean":"2024-06-06T03:23:14.832126+0000","last_became_active":"2024-06-06T03:22:34.301877+0000","last_became_peered":"2024-06-06T03:22:34.301877+0000","last_unstale":"2024-06-06T03:23:14.832126+0000","last_undegraded":"2024-06-06T03:23:14.832126+0000","last_fullsized":"2024-06-06T03:23:14.832126+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:19:22.545435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.074113+0000","last_change":"2024-06-06T03:22:44.421024+0000","last_active":"2024-06-06T03:23:15.074113+0000","last_peered":"2024-06-06T03:23:15.074113+0000","last_clean":"2024-06-06T03:23:15.074113+0000","last_became_active":"2024-06-06T03:22:44.420502+0000","last_became_peered":"2024-06-06T03:22:44.420502+0000","last_unstale":"2024-06-06T03:23:15.074113+0000","last_undegraded":"2024-06-06T03:23:15.074113+0000","last_fullsized":"2024-06-06T03:23:15.074113+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:15:55.246032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"97'6","reported_seq":46,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:32.588528+0000","last_change":"2024-06-06T03:22:31.054128+0000","last_active":"2024-06-06T03:23:32.588528+0000","last_peered":"2024-06-06T03:23:32.588528+0000","last_clean":"2024-06-06T03:23:32.588528+0000","last_became_active":"2024-06-06T03:22:31.053740+0000","last_became_peered":"2024-06-06T03:22:31.053740+0000","last_unstale":"2024-06-06T03:23:32.588528+0000","last_undegraded":"2024-06-06T03:23:32.588528+0000","last_fullsized":"2024-06-06T03:23:32.588528+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:12:21.494702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.512309+0000","last_change":"2024-06-06T03:22:34.297861+0000","last_active":"2024-06-06T03:23:14.512309+0000","last_peered":"2024-06-06T03:23:14.512309+0000","last_clean":"2024-06-06T03:23:14.512309+0000","last_became_active":"2024-06-06T03:22:34.297391+0000","last_became_peered":"2024-06-06T03:22:34.297391+0000","last_unstale":"2024-06-06T03:23:14.512309+0000","last_undegraded":"2024-06-06T03:23:14.512309+0000","last_fullsized":"2024-06-06T03:23:14.512309+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:10:33.973635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.512583+0000","last_change":"2024-06-06T03:22:44.416087+0000","last_active":"2024-06-06T03:23:14.512583+0000","last_peered":"2024-06-06T03:23:14.512583+0000","last_clean":"2024-06-06T03:23:14.512583+0000","last_became_active":"2024-06-06T03:22:44.415646+0000","last_became_peered":"2024-06-06T03:22:44.415646+0000","last_unstale":"2024-06-06T03:23:14.512583+0000","last_undegraded":"2024-06-06T03:23:14.512583+0000","last_fullsized":"2024-06-06T03:23:14.512583+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:44:43.690830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"97'3","reported_seq":43,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:31.582990+0000","last_change":"2024-06-06T03:22:31.056814+0000","last_active":"2024-06-06T03:23:31.582990+0000","last_peered":"2024-06-06T03:23:31.582990+0000","last_clean":"2024-06-06T03:23:31.582990+0000","last_became_active":"2024-06-06T03:22:31.055183+0000","last_became_peered":"2024-06-06T03:22:31.055183+0000","last_unstale":"2024-06-06T03:23:31.582990+0000","last_undegraded":"2024-06-06T03:23:31.582990+0000","last_fullsized":"2024-06-06T03:23:31.582990+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:26:27.299068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.026078+0000","last_change":"2024-06-06T03:22:34.311995+0000","last_active":"2024-06-06T03:23:15.026078+0000","last_peered":"2024-06-06T03:23:15.026078+0000","last_clean":"2024-06-06T03:23:15.026078+0000","last_became_active":"2024-06-06T03:22:34.311665+0000","last_became_peered":"2024-06-06T03:22:34.311665+0000","last_unstale":"2024-06-06T03:23:15.026078+0000","last_undegraded":"2024-06-06T03:23:15.026078+0000","last_fullsized":"2024-06-06T03:23:15.026078+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:53:10.539212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.509816+0000","last_change":"2024-06-06T03:22:44.414170+0000","last_active":"2024-06-06T03:23:14.509816+0000","last_peered":"2024-06-06T03:23:14.509816+0000","last_clean":"2024-06-06T03:23:14.509816+0000","last_became_active":"2024-06-06T03:22:44.413635+0000","last_became_peered":"2024-06-06T03:22:44.413635+0000","last_unstale":"2024-06-06T03:23:14.509816+0000","last_undegraded":"2024-06-06T03:23:14.509816+0000","last_fullsized":"2024-06-06T03:23:14.509816+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:06:25.223810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"97'4","reported_seq":70,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:57.650505+0000","last_change":"2024-06-06T03:22:31.057846+0000","last_active":"2024-06-06T03:23:57.650505+0000","last_peered":"2024-06-06T03:23:57.650505+0000","last_clean":"2024-06-06T03:23:57.650505+0000","last_became_active":"2024-06-06T03:22:31.056635+0000","last_became_peered":"2024-06-06T03:22:31.056635+0000","last_unstale":"2024-06-06T03:23:57.650505+0000","last_undegraded":"2024-06-06T03:23:57.650505+0000","last_fullsized":"2024-06-06T03:23:57.650505+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:59:03.845722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.025961+0000","last_change":"2024-06-06T03:22:34.304832+0000","last_active":"2024-06-06T03:23:15.025961+0000","last_peered":"2024-06-06T03:23:15.025961+0000","last_clean":"2024-06-06T03:23:15.025961+0000","last_became_active":"2024-06-06T03:22:34.304494+0000","last_became_peered":"2024-06-06T03:22:34.304494+0000","last_unstale":"2024-06-06T03:23:15.025961+0000","last_undegraded":"2024-06-06T03:23:15.025961+0000","last_fullsized":"2024-06-06T03:23:15.025961+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:17:02.855580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.512634+0000","last_change":"2024-06-06T03:22:44.418561+0000","last_active":"2024-06-06T03:23:14.512634+0000","last_peered":"2024-06-06T03:23:14.512634+0000","last_clean":"2024-06-06T03:23:14.512634+0000","last_became_active":"2024-06-06T03:22:44.418050+0000","last_became_peered":"2024-06-06T03:22:44.418050+0000","last_unstale":"2024-06-06T03:23:14.512634+0000","last_undegraded":"2024-06-06T03:23:14.512634+0000","last_fullsized":"2024-06-06T03:23:14.512634+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:39:57.680990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"97'15","reported_seq":55,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:32.589316+0000","last_change":"2024-06-06T03:22:31.242981+0000","last_active":"2024-06-06T03:23:32.589316+0000","last_peered":"2024-06-06T03:23:32.589316+0000","last_clean":"2024-06-06T03:23:32.589316+0000","last_became_active":"2024-06-06T03:22:31.242448+0000","last_became_peered":"2024-06-06T03:22:31.242448+0000","last_unstale":"2024-06-06T03:23:32.589316+0000","last_undegraded":"2024-06-06T03:23:32.589316+0000","last_fullsized":"2024-06-06T03:23:32.589316+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:18:25.855327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.073527+0000","last_change":"2024-06-06T03:22:34.300799+0000","last_active":"2024-06-06T03:23:15.073527+0000","last_peered":"2024-06-06T03:23:15.073527+0000","last_clean":"2024-06-06T03:23:15.073527+0000","last_became_active":"2024-06-06T03:22:34.300397+0000","last_became_peered":"2024-06-06T03:22:34.300397+0000","last_unstale":"2024-06-06T03:23:15.073527+0000","last_undegraded":"2024-06-06T03:23:15.073527+0000","last_fullsized":"2024-06-06T03:23:15.073527+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:55:31.621711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.073391+0000","last_change":"2024-06-06T03:22:44.418341+0000","last_active":"2024-06-06T03:23:15.073391+0000","last_peered":"2024-06-06T03:23:15.073391+0000","last_clean":"2024-06-06T03:23:15.073391+0000","last_became_active":"2024-06-06T03:22:44.417881+0000","last_became_peered":"2024-06-06T03:22:44.417881+0000","last_unstale":"2024-06-06T03:23:15.073391+0000","last_undegraded":"2024-06-06T03:23:15.073391+0000","last_fullsized":"2024-06-06T03:23:15.073391+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:43:13.869298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"97'2","reported_seq":42,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:34.583893+0000","last_change":"2024-06-06T03:22:31.054749+0000","last_active":"2024-06-06T03:23:34.583893+0000","last_peered":"2024-06-06T03:23:34.583893+0000","last_clean":"2024-06-06T03:23:34.583893+0000","last_became_active":"2024-06-06T03:22:31.054180+0000","last_became_peered":"2024-06-06T03:22:31.054180+0000","last_unstale":"2024-06-06T03:23:34.583893+0000","last_undegraded":"2024-06-06T03:23:34.583893+0000","last_fullsized":"2024-06-06T03:23:34.583893+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:30:17.902778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.513221+0000","last_change":"2024-06-06T03:22:34.299573+0000","last_active":"2024-06-06T03:23:14.513221+0000","last_peered":"2024-06-06T03:23:14.513221+0000","last_clean":"2024-06-06T03:23:14.513221+0000","last_became_active":"2024-06-06T03:22:34.299201+0000","last_became_peered":"2024-06-06T03:22:34.299201+0000","last_unstale":"2024-06-06T03:23:14.513221+0000","last_undegraded":"2024-06-06T03:23:14.513221+0000","last_fullsized":"2024-06-06T03:23:14.513221+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:02:47.043087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.831302+0000","last_change":"2024-06-06T03:22:44.409672+0000","last_active":"2024-06-06T03:23:14.831302+0000","last_peered":"2024-06-06T03:23:14.831302+0000","last_clean":"2024-06-06T03:23:14.831302+0000","last_became_active":"2024-06-06T03:22:44.409246+0000","last_became_peered":"2024-06-06T03:22:44.409246+0000","last_unstale":"2024-06-06T03:23:14.831302+0000","last_undegraded":"2024-06-06T03:23:14.831302+0000","last_fullsized":"2024-06-06T03:23:14.831302+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:44:49.481886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.509998+0000","last_change":"2024-06-06T03:22:31.243562+0000","last_active":"2024-06-06T03:23:14.509998+0000","last_peered":"2024-06-06T03:23:14.509998+0000","last_clean":"2024-06-06T03:23:14.509998+0000","last_became_active":"2024-06-06T03:22:31.243164+0000","last_became_peered":"2024-06-06T03:22:31.243164+0000","last_unstale":"2024-06-06T03:23:14.509998+0000","last_undegraded":"2024-06-06T03:23:14.509998+0000","last_fullsized":"2024-06-06T03:23:14.509998+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:04:46.877389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.514691+0000","last_change":"2024-06-06T03:22:34.300756+0000","last_active":"2024-06-06T03:23:14.514691+0000","last_peered":"2024-06-06T03:23:14.514691+0000","last_clean":"2024-06-06T03:23:14.514691+0000","last_became_active":"2024-06-06T03:22:34.300333+0000","last_became_peered":"2024-06-06T03:22:34.300333+0000","last_unstale":"2024-06-06T03:23:14.514691+0000","last_undegraded":"2024-06-06T03:23:14.514691+0000","last_fullsized":"2024-06-06T03:23:14.514691+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:29:37.174432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.512408+0000","last_change":"2024-06-06T03:22:44.412741+0000","last_active":"2024-06-06T03:23:14.512408+0000","last_peered":"2024-06-06T03:23:14.512408+0000","last_clean":"2024-06-06T03:23:14.512408+0000","last_became_active":"2024-06-06T03:22:44.412263+0000","last_became_peered":"2024-06-06T03:22:44.412263+0000","last_unstale":"2024-06-06T03:23:14.512408+0000","last_undegraded":"2024-06-06T03:23:14.512408+0000","last_fullsized":"2024-06-06T03:23:14.512408+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:00:13.925279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"97'1","reported_seq":41,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.025967+0000","last_change":"2024-06-06T03:22:31.055124+0000","last_active":"2024-06-06T03:23:15.025967+0000","last_peered":"2024-06-06T03:23:15.025967+0000","last_clean":"2024-06-06T03:23:15.025967+0000","last_became_active":"2024-06-06T03:22:31.054562+0000","last_became_peered":"2024-06-06T03:22:31.054562+0000","last_unstale":"2024-06-06T03:23:15.025967+0000","last_undegraded":"2024-06-06T03:23:15.025967+0000","last_fullsized":"2024-06-06T03:23:15.025967+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:57:54.783815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.514141+0000","last_change":"2024-06-06T03:22:34.310893+0000","last_active":"2024-06-06T03:23:14.514141+0000","last_peered":"2024-06-06T03:23:14.514141+0000","last_clean":"2024-06-06T03:23:14.514141+0000","last_became_active":"2024-06-06T03:22:34.310510+0000","last_became_peered":"2024-06-06T03:22:34.310510+0000","last_unstale":"2024-06-06T03:23:14.514141+0000","last_undegraded":"2024-06-06T03:23:14.514141+0000","last_fullsized":"2024-06-06T03:23:14.514141+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:52:10.979031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.512428+0000","last_change":"2024-06-06T03:22:44.416330+0000","last_active":"2024-06-06T03:23:14.512428+0000","last_peered":"2024-06-06T03:23:14.512428+0000","last_clean":"2024-06-06T03:23:14.512428+0000","last_became_active":"2024-06-06T03:22:44.415021+0000","last_became_peered":"2024-06-06T03:22:44.415021+0000","last_unstale":"2024-06-06T03:23:14.512428+0000","last_undegraded":"2024-06-06T03:23:14.512428+0000","last_fullsized":"2024-06-06T03:23:14.512428+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:12:22.017689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.074086+0000","last_change":"2024-06-06T03:22:34.294540+0000","last_active":"2024-06-06T03:23:15.074086+0000","last_peered":"2024-06-06T03:23:15.074086+0000","last_clean":"2024-06-06T03:23:15.074086+0000","last_became_active":"2024-06-06T03:22:34.294204+0000","last_became_peered":"2024-06-06T03:22:34.294204+0000","last_unstale":"2024-06-06T03:23:15.074086+0000","last_undegraded":"2024-06-06T03:23:15.074086+0000","last_fullsized":"2024-06-06T03:23:15.074086+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:16:39.386345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"97'4","reported_seq":67,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:56.647342+0000","last_change":"2024-06-06T03:22:31.242275+0000","last_active":"2024-06-06T03:23:56.647342+0000","last_peered":"2024-06-06T03:23:56.647342+0000","last_clean":"2024-06-06T03:23:56.647342+0000","last_became_active":"2024-06-06T03:22:31.241930+0000","last_became_peered":"2024-06-06T03:22:31.241930+0000","last_unstale":"2024-06-06T03:23:56.647342+0000","last_undegraded":"2024-06-06T03:23:56.647342+0000","last_fullsized":"2024-06-06T03:23:56.647342+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:46:16.407946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"97'1","reported_seq":25,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.026354+0000","last_change":"2024-06-06T03:22:44.416191+0000","last_active":"2024-06-06T03:23:15.026354+0000","last_peered":"2024-06-06T03:23:15.026354+0000","last_clean":"2024-06-06T03:23:15.026354+0000","last_became_active":"2024-06-06T03:22:44.415632+0000","last_became_peered":"2024-06-06T03:22:44.415632+0000","last_unstale":"2024-06-06T03:23:15.026354+0000","last_undegraded":"2024-06-06T03:23:15.026354+0000","last_fullsized":"2024-06-06T03:23:15.026354+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:10:48.995029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.517612+0000","last_change":"2024-06-06T03:22:34.304567+0000","last_active":"2024-06-06T03:23:14.517612+0000","last_peered":"2024-06-06T03:23:14.517612+0000","last_clean":"2024-06-06T03:23:14.517612+0000","last_became_active":"2024-06-06T03:22:34.304183+0000","last_became_peered":"2024-06-06T03:22:34.304183+0000","last_unstale":"2024-06-06T03:23:14.517612+0000","last_undegraded":"2024-06-06T03:23:14.517612+0000","last_fullsized":"2024-06-06T03:23:14.517612+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:34:02.229528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"97'3","reported_seq":44,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:35.607202+0000","last_change":"2024-06-06T03:22:31.056188+0000","last_active":"2024-06-06T03:23:35.607202+0000","last_peered":"2024-06-06T03:23:35.607202+0000","last_clean":"2024-06-06T03:23:35.607202+0000","last_became_active":"2024-06-06T03:22:31.055758+0000","last_became_peered":"2024-06-06T03:22:31.055758+0000","last_unstale":"2024-06-06T03:23:35.607202+0000","last_undegraded":"2024-06-06T03:23:35.607202+0000","last_fullsized":"2024-06-06T03:23:35.607202+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:35:51.016087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":363,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.025760+0000","last_change":"2024-06-06T03:21:07.156236+0000","last_active":"2024-06-06T03:23:15.025760+0000","last_peered":"2024-06-06T03:23:15.025760+0000","last_clean":"2024-06-06T03:23:15.025760+0000","last_became_active":"2024-06-06T03:21:07.155807+0000","last_became_peered":"2024-06-06T03:21:07.155807+0000","last_unstale":"2024-06-06T03:23:15.025760+0000","last_undegraded":"2024-06-06T03:23:15.025760+0000","last_fullsized":"2024-06-06T03:23:15.025760+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:17:38.330402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:17:38.330402+0000","last_clean_scrub_stamp":"2024-06-06T03:17:38.330402+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:30:13.968755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.074001+0000","last_change":"2024-06-06T03:22:44.424693+0000","last_active":"2024-06-06T03:23:15.074001+0000","last_peered":"2024-06-06T03:23:15.074001+0000","last_clean":"2024-06-06T03:23:15.074001+0000","last_became_active":"2024-06-06T03:22:44.423607+0000","last_became_peered":"2024-06-06T03:22:44.423607+0000","last_unstale":"2024-06-06T03:23:15.074001+0000","last_undegraded":"2024-06-06T03:23:15.074001+0000","last_fullsized":"2024-06-06T03:23:15.074001+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:57:56.974785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.512047+0000","last_change":"2024-06-06T03:22:34.297940+0000","last_active":"2024-06-06T03:23:14.512047+0000","last_peered":"2024-06-06T03:23:14.512047+0000","last_clean":"2024-06-06T03:23:14.512047+0000","last_became_active":"2024-06-06T03:22:34.297597+0000","last_became_peered":"2024-06-06T03:22:34.297597+0000","last_unstale":"2024-06-06T03:23:14.512047+0000","last_undegraded":"2024-06-06T03:23:14.512047+0000","last_fullsized":"2024-06-06T03:23:14.512047+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:52:52.155070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"97'3","reported_seq":43,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:32.587942+0000","last_change":"2024-06-06T03:22:31.055329+0000","last_active":"2024-06-06T03:23:32.587942+0000","last_peered":"2024-06-06T03:23:32.587942+0000","last_clean":"2024-06-06T03:23:32.587942+0000","last_became_active":"2024-06-06T03:22:31.054493+0000","last_became_peered":"2024-06-06T03:22:31.054493+0000","last_unstale":"2024-06-06T03:23:32.587942+0000","last_undegraded":"2024-06-06T03:23:32.587942+0000","last_fullsized":"2024-06-06T03:23:32.587942+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:45:32.068810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.512587+0000","last_change":"2024-06-06T03:22:44.413560+0000","last_active":"2024-06-06T03:23:14.512587+0000","last_peered":"2024-06-06T03:23:14.512587+0000","last_clean":"2024-06-06T03:23:14.512587+0000","last_became_active":"2024-06-06T03:22:44.413100+0000","last_became_peered":"2024-06-06T03:22:44.413100+0000","last_unstale":"2024-06-06T03:23:14.512587+0000","last_undegraded":"2024-06-06T03:23:14.512587+0000","last_fullsized":"2024-06-06T03:23:14.512587+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:58:02.780671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"97'1","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:31.583136+0000","last_change":"2024-06-06T03:23:14.515805+0000","last_active":"2024-06-06T03:23:31.583136+0000","last_peered":"2024-06-06T03:23:31.583136+0000","last_clean":"2024-06-06T03:23:31.583136+0000","last_became_active":"2024-06-06T03:23:14.515436+0000","last_became_peered":"2024-06-06T03:23:14.515436+0000","last_unstale":"2024-06-06T03:23:31.583136+0000","last_undegraded":"2024-06-06T03:23:31.583136+0000","last_fullsized":"2024-06-06T03:23:31.583136+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:59:16.246609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.513108+0000","last_change":"2024-06-06T03:22:34.294549+0000","last_active":"2024-06-06T03:23:14.513108+0000","last_peered":"2024-06-06T03:23:14.513108+0000","last_clean":"2024-06-06T03:23:14.513108+0000","last_became_active":"2024-06-06T03:22:34.294202+0000","last_became_peered":"2024-06-06T03:22:34.294202+0000","last_unstale":"2024-06-06T03:23:14.513108+0000","last_undegraded":"2024-06-06T03:23:14.513108+0000","last_fullsized":"2024-06-06T03:23:14.513108+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:55:59.823957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.517426+0000","last_change":"2024-06-06T03:22:44.416890+0000","last_active":"2024-06-06T03:23:14.517426+0000","last_peered":"2024-06-06T03:23:14.517426+0000","last_clean":"2024-06-06T03:23:14.517426+0000","last_became_active":"2024-06-06T03:22:44.416473+0000","last_became_peered":"2024-06-06T03:22:44.416473+0000","last_unstale":"2024-06-06T03:23:14.517426+0000","last_undegraded":"2024-06-06T03:23:14.517426+0000","last_fullsized":"2024-06-06T03:23:14.517426+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:23:48.972196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"97'12","reported_seq":52,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:56.307205+0000","last_change":"2024-06-06T03:22:31.054481+0000","last_active":"2024-06-06T03:23:56.307205+0000","last_peered":"2024-06-06T03:23:56.307205+0000","last_clean":"2024-06-06T03:23:56.307205+0000","last_became_active":"2024-06-06T03:22:31.054173+0000","last_became_peered":"2024-06-06T03:22:31.054173+0000","last_unstale":"2024-06-06T03:23:56.307205+0000","last_undegraded":"2024-06-06T03:23:56.307205+0000","last_fullsized":"2024-06-06T03:23:56.307205+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:52:45.311149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.516538+0000","last_change":"2024-06-06T03:22:34.300211+0000","last_active":"2024-06-06T03:23:14.516538+0000","last_peered":"2024-06-06T03:23:14.516538+0000","last_clean":"2024-06-06T03:23:14.516538+0000","last_became_active":"2024-06-06T03:22:34.299870+0000","last_became_peered":"2024-06-06T03:22:34.299870+0000","last_unstale":"2024-06-06T03:23:14.516538+0000","last_undegraded":"2024-06-06T03:23:14.516538+0000","last_fullsized":"2024-06-06T03:23:14.516538+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:50:56.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.510508+0000","last_change":"2024-06-06T03:22:44.414727+0000","last_active":"2024-06-06T03:23:14.510508+0000","last_peered":"2024-06-06T03:23:14.510508+0000","last_clean":"2024-06-06T03:23:14.510508+0000","last_became_active":"2024-06-06T03:22:44.414232+0000","last_became_peered":"2024-06-06T03:22:44.414232+0000","last_unstale":"2024-06-06T03:23:14.510508+0000","last_undegraded":"2024-06-06T03:23:14.510508+0000","last_fullsized":"2024-06-06T03:23:14.510508+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:26:21.540309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"97'4","reported_seq":43,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:31.582714+0000","last_change":"2024-06-06T03:22:31.178740+0000","last_active":"2024-06-06T03:23:31.582714+0000","last_peered":"2024-06-06T03:23:31.582714+0000","last_clean":"2024-06-06T03:23:31.582714+0000","last_became_active":"2024-06-06T03:22:31.178353+0000","last_became_peered":"2024-06-06T03:22:31.178353+0000","last_unstale":"2024-06-06T03:23:31.582714+0000","last_undegraded":"2024-06-06T03:23:31.582714+0000","last_fullsized":"2024-06-06T03:23:31.582714+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:56:50.159463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.514778+0000","last_change":"2024-06-06T03:22:34.298011+0000","last_active":"2024-06-06T03:23:14.514778+0000","last_peered":"2024-06-06T03:23:14.514778+0000","last_clean":"2024-06-06T03:23:14.514778+0000","last_became_active":"2024-06-06T03:22:34.297697+0000","last_became_peered":"2024-06-06T03:22:34.297697+0000","last_unstale":"2024-06-06T03:23:14.514778+0000","last_undegraded":"2024-06-06T03:23:14.514778+0000","last_fullsized":"2024-06-06T03:23:14.514778+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:01:38.606543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.515087+0000","last_change":"2024-06-06T03:22:44.425675+0000","last_active":"2024-06-06T03:23:14.515087+0000","last_peered":"2024-06-06T03:23:14.515087+0000","last_clean":"2024-06-06T03:23:14.515087+0000","last_became_active":"2024-06-06T03:22:44.424023+0000","last_became_peered":"2024-06-06T03:22:44.424023+0000","last_unstale":"2024-06-06T03:23:14.515087+0000","last_undegraded":"2024-06-06T03:23:14.515087+0000","last_fullsized":"2024-06-06T03:23:14.515087+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:47:48.718771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"97'2","reported_seq":41,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:31.583602+0000","last_change":"2024-06-06T03:22:31.242360+0000","last_active":"2024-06-06T03:23:31.583602+0000","last_peered":"2024-06-06T03:23:31.583602+0000","last_clean":"2024-06-06T03:23:31.583602+0000","last_became_active":"2024-06-06T03:22:31.242015+0000","last_became_peered":"2024-06-06T03:22:31.242015+0000","last_unstale":"2024-06-06T03:23:31.583602+0000","last_undegraded":"2024-06-06T03:23:31.583602+0000","last_fullsized":"2024-06-06T03:23:31.583602+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:14:30.674106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.830882+0000","last_change":"2024-06-06T03:22:34.302980+0000","last_active":"2024-06-06T03:23:14.830882+0000","last_peered":"2024-06-06T03:23:14.830882+0000","last_clean":"2024-06-06T03:23:14.830882+0000","last_became_active":"2024-06-06T03:22:34.302625+0000","last_became_peered":"2024-06-06T03:22:34.302625+0000","last_unstale":"2024-06-06T03:23:14.830882+0000","last_undegraded":"2024-06-06T03:23:14.830882+0000","last_fullsized":"2024-06-06T03:23:14.830882+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:13:01.603365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.510071+0000","last_change":"2024-06-06T03:22:44.423741+0000","last_active":"2024-06-06T03:23:14.510071+0000","last_peered":"2024-06-06T03:23:14.510071+0000","last_clean":"2024-06-06T03:23:14.510071+0000","last_became_active":"2024-06-06T03:22:44.423266+0000","last_became_peered":"2024-06-06T03:22:44.423266+0000","last_unstale":"2024-06-06T03:23:14.510071+0000","last_undegraded":"2024-06-06T03:23:14.510071+0000","last_fullsized":"2024-06-06T03:23:14.510071+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:09:19.324145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"97'3","reported_seq":42,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:31.583145+0000","last_change":"2024-06-06T03:22:31.052988+0000","last_active":"2024-06-06T03:23:31.583145+0000","last_peered":"2024-06-06T03:23:31.583145+0000","last_clean":"2024-06-06T03:23:31.583145+0000","last_became_active":"2024-06-06T03:22:31.052743+0000","last_became_peered":"2024-06-06T03:22:31.052743+0000","last_unstale":"2024-06-06T03:23:31.583145+0000","last_undegraded":"2024-06-06T03:23:31.583145+0000","last_fullsized":"2024-06-06T03:23:31.583145+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:31:45.176416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.512110+0000","last_change":"2024-06-06T03:22:34.299991+0000","last_active":"2024-06-06T03:23:14.512110+0000","last_peered":"2024-06-06T03:23:14.512110+0000","last_clean":"2024-06-06T03:23:14.512110+0000","last_became_active":"2024-06-06T03:22:34.299659+0000","last_became_peered":"2024-06-06T03:22:34.299659+0000","last_unstale":"2024-06-06T03:23:14.512110+0000","last_undegraded":"2024-06-06T03:23:14.512110+0000","last_fullsized":"2024-06-06T03:23:14.512110+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:16:51.492749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"97'1","reported_seq":32,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.028062+0000","last_change":"2024-06-06T03:23:15.027541+0000","last_active":"2024-06-06T03:23:15.028062+0000","last_peered":"2024-06-06T03:23:15.028062+0000","last_clean":"2024-06-06T03:23:15.028062+0000","last_became_active":"2024-06-06T03:23:15.026931+0000","last_became_peered":"2024-06-06T03:23:15.026931+0000","last_unstale":"2024-06-06T03:23:15.028062+0000","last_undegraded":"2024-06-06T03:23:15.028062+0000","last_fullsized":"2024-06-06T03:23:15.028062+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:47:44.197067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"97'1","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.881095+0000","last_change":"2024-06-06T03:23:14.831383+0000","last_active":"2024-06-06T03:23:15.881095+0000","last_peered":"2024-06-06T03:23:15.881095+0000","last_clean":"2024-06-06T03:23:15.881095+0000","last_became_active":"2024-06-06T03:23:14.830948+0000","last_became_peered":"2024-06-06T03:23:14.830948+0000","last_unstale":"2024-06-06T03:23:15.881095+0000","last_undegraded":"2024-06-06T03:23:15.881095+0000","last_fullsized":"2024-06-06T03:23:15.881095+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:58:00.326112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.516794+0000","last_change":"2024-06-06T03:22:34.301842+0000","last_active":"2024-06-06T03:23:14.516794+0000","last_peered":"2024-06-06T03:23:14.516794+0000","last_clean":"2024-06-06T03:23:14.516794+0000","last_became_active":"2024-06-06T03:22:34.301513+0000","last_became_peered":"2024-06-06T03:22:34.301513+0000","last_unstale":"2024-06-06T03:23:14.516794+0000","last_undegraded":"2024-06-06T03:23:14.516794+0000","last_fullsized":"2024-06-06T03:23:14.516794+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:30:03.813861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.514668+0000","last_change":"2024-06-06T03:22:44.419621+0000","last_active":"2024-06-06T03:23:14.514668+0000","last_peered":"2024-06-06T03:23:14.514668+0000","last_clean":"2024-06-06T03:23:14.514668+0000","last_became_active":"2024-06-06T03:22:44.419065+0000","last_became_peered":"2024-06-06T03:22:44.419065+0000","last_unstale":"2024-06-06T03:23:14.514668+0000","last_undegraded":"2024-06-06T03:23:14.514668+0000","last_fullsized":"2024-06-06T03:23:14.514668+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:10:49.762284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"97'4","reported_seq":44,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:31.583894+0000","last_change":"2024-06-06T03:22:31.056409+0000","last_active":"2024-06-06T03:23:31.583894+0000","last_peered":"2024-06-06T03:23:31.583894+0000","last_clean":"2024-06-06T03:23:31.583894+0000","last_became_active":"2024-06-06T03:22:31.055994+0000","last_became_peered":"2024-06-06T03:22:31.055994+0000","last_unstale":"2024-06-06T03:23:31.583894+0000","last_undegraded":"2024-06-06T03:23:31.583894+0000","last_fullsized":"2024-06-06T03:23:31.583894+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:09:00.784820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.025927+0000","last_change":"2024-06-06T03:22:34.302238+0000","last_active":"2024-06-06T03:23:15.025927+0000","last_peered":"2024-06-06T03:23:15.025927+0000","last_clean":"2024-06-06T03:23:15.025927+0000","last_became_active":"2024-06-06T03:22:34.301869+0000","last_became_peered":"2024-06-06T03:22:34.301869+0000","last_unstale":"2024-06-06T03:23:15.025927+0000","last_undegraded":"2024-06-06T03:23:15.025927+0000","last_fullsized":"2024-06-06T03:23:15.025927+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:17:08.350692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.594087+0000","last_change":"2024-06-06T03:22:44.414052+0000","last_active":"2024-06-06T03:23:14.594087+0000","last_peered":"2024-06-06T03:23:14.594087+0000","last_clean":"2024-06-06T03:23:14.594087+0000","last_became_active":"2024-06-06T03:22:44.413633+0000","last_became_peered":"2024-06-06T03:22:44.413633+0000","last_unstale":"2024-06-06T03:23:14.594087+0000","last_undegraded":"2024-06-06T03:23:14.594087+0000","last_fullsized":"2024-06-06T03:23:14.594087+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:41:16.942699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"97'3","reported_seq":43,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:32.588897+0000","last_change":"2024-06-06T03:22:31.243570+0000","last_active":"2024-06-06T03:23:32.588897+0000","last_peered":"2024-06-06T03:23:32.588897+0000","last_clean":"2024-06-06T03:23:32.588897+0000","last_became_active":"2024-06-06T03:22:31.243194+0000","last_became_peered":"2024-06-06T03:22:31.243194+0000","last_unstale":"2024-06-06T03:23:32.588897+0000","last_undegraded":"2024-06-06T03:23:32.588897+0000","last_fullsized":"2024-06-06T03:23:32.588897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:21:22.233139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.026489+0000","last_change":"2024-06-06T03:22:34.301665+0000","last_active":"2024-06-06T03:23:15.026489+0000","last_peered":"2024-06-06T03:23:15.026489+0000","last_clean":"2024-06-06T03:23:15.026489+0000","last_became_active":"2024-06-06T03:22:34.300967+0000","last_became_peered":"2024-06-06T03:22:34.300967+0000","last_unstale":"2024-06-06T03:23:15.026489+0000","last_undegraded":"2024-06-06T03:23:15.026489+0000","last_fullsized":"2024-06-06T03:23:15.026489+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:57:58.905488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":31,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.833267+0000","last_change":"2024-06-06T03:23:14.833267+0000","last_active":"2024-06-06T03:23:14.833267+0000","last_peered":"2024-06-06T03:23:14.833267+0000","last_clean":"2024-06-06T03:23:14.833267+0000","last_became_active":"2024-06-06T03:23:14.832760+0000","last_became_peered":"2024-06-06T03:23:14.832760+0000","last_unstale":"2024-06-06T03:23:14.833267+0000","last_undegraded":"2024-06-06T03:23:14.833267+0000","last_fullsized":"2024-06-06T03:23:14.833267+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:24:32.668781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'1","reported_seq":42,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.073793+0000","last_change":"2024-06-06T03:22:31.054686+0000","last_active":"2024-06-06T03:23:15.073793+0000","last_peered":"2024-06-06T03:23:15.073793+0000","last_clean":"2024-06-06T03:23:15.073793+0000","last_became_active":"2024-06-06T03:22:31.053219+0000","last_became_peered":"2024-06-06T03:22:31.053219+0000","last_unstale":"2024-06-06T03:23:15.073793+0000","last_undegraded":"2024-06-06T03:23:15.073793+0000","last_fullsized":"2024-06-06T03:23:15.073793+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:32:27.423208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.026210+0000","last_change":"2024-06-06T03:22:34.304916+0000","last_active":"2024-06-06T03:23:15.026210+0000","last_peered":"2024-06-06T03:23:15.026210+0000","last_clean":"2024-06-06T03:23:15.026210+0000","last_became_active":"2024-06-06T03:22:34.302442+0000","last_became_peered":"2024-06-06T03:22:34.302442+0000","last_unstale":"2024-06-06T03:23:15.026210+0000","last_undegraded":"2024-06-06T03:23:15.026210+0000","last_fullsized":"2024-06-06T03:23:15.026210+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:01:24.034386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.073166+0000","last_change":"2024-06-06T03:22:44.415478+0000","last_active":"2024-06-06T03:23:15.073166+0000","last_peered":"2024-06-06T03:23:15.073166+0000","last_clean":"2024-06-06T03:23:15.073166+0000","last_became_active":"2024-06-06T03:22:44.415007+0000","last_became_peered":"2024-06-06T03:22:44.415007+0000","last_unstale":"2024-06-06T03:23:15.073166+0000","last_undegraded":"2024-06-06T03:23:15.073166+0000","last_fullsized":"2024-06-06T03:23:15.073166+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:57:47.793481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'2","reported_seq":52,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.521037+0000","last_change":"2024-06-06T03:23:14.521037+0000","last_active":"2024-06-06T03:23:14.521037+0000","last_peered":"2024-06-06T03:23:14.521037+0000","last_clean":"2024-06-06T03:23:14.521037+0000","last_became_active":"2024-06-06T03:23:14.517922+0000","last_became_peered":"2024-06-06T03:23:14.517922+0000","last_unstale":"2024-06-06T03:23:14.521037+0000","last_undegraded":"2024-06-06T03:23:14.521037+0000","last_fullsized":"2024-06-06T03:23:14.521037+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:12:46.222984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.026574+0000","last_change":"2024-06-06T03:22:34.305178+0000","last_active":"2024-06-06T03:23:15.026574+0000","last_peered":"2024-06-06T03:23:15.026574+0000","last_clean":"2024-06-06T03:23:15.026574+0000","last_became_active":"2024-06-06T03:22:34.302420+0000","last_became_peered":"2024-06-06T03:22:34.302420+0000","last_unstale":"2024-06-06T03:23:15.026574+0000","last_undegraded":"2024-06-06T03:23:15.026574+0000","last_fullsized":"2024-06-06T03:23:15.026574+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:22:08.736542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":40,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.514756+0000","last_change":"2024-06-06T03:23:14.514756+0000","last_active":"2024-06-06T03:23:14.514756+0000","last_peered":"2024-06-06T03:23:14.514756+0000","last_clean":"2024-06-06T03:23:14.514756+0000","last_became_active":"2024-06-06T03:23:14.514325+0000","last_became_peered":"2024-06-06T03:23:14.514325+0000","last_unstale":"2024-06-06T03:23:14.514756+0000","last_undegraded":"2024-06-06T03:23:14.514756+0000","last_fullsized":"2024-06-06T03:23:14.514756+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:45:44.594836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.511017+0000","last_change":"2024-06-06T03:22:34.298570+0000","last_active":"2024-06-06T03:23:14.511017+0000","last_peered":"2024-06-06T03:23:14.511017+0000","last_clean":"2024-06-06T03:23:14.511017+0000","last_became_active":"2024-06-06T03:22:34.298137+0000","last_became_peered":"2024-06-06T03:22:34.298137+0000","last_unstale":"2024-06-06T03:23:14.511017+0000","last_undegraded":"2024-06-06T03:23:14.511017+0000","last_fullsized":"2024-06-06T03:23:14.511017+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:07:25.290355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.510721+0000","last_change":"2024-06-06T03:22:34.297750+0000","last_active":"2024-06-06T03:23:14.510721+0000","last_peered":"2024-06-06T03:23:14.510721+0000","last_clean":"2024-06-06T03:23:14.510721+0000","last_became_active":"2024-06-06T03:22:34.297264+0000","last_became_peered":"2024-06-06T03:22:34.297264+0000","last_unstale":"2024-06-06T03:23:14.510721+0000","last_undegraded":"2024-06-06T03:23:14.510721+0000","last_fullsized":"2024-06-06T03:23:14.510721+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:14:58.580044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":40,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.832804+0000","last_change":"2024-06-06T03:23:14.832804+0000","last_active":"2024-06-06T03:23:14.832804+0000","last_peered":"2024-06-06T03:23:14.832804+0000","last_clean":"2024-06-06T03:23:14.832804+0000","last_became_active":"2024-06-06T03:23:14.832448+0000","last_became_peered":"2024-06-06T03:23:14.832448+0000","last_unstale":"2024-06-06T03:23:14.832804+0000","last_undegraded":"2024-06-06T03:23:14.832804+0000","last_fullsized":"2024-06-06T03:23:14.832804+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:52:16.907033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.515841+0000","last_change":"2024-06-06T03:23:14.515841+0000","last_active":"2024-06-06T03:23:14.515841+0000","last_peered":"2024-06-06T03:23:14.515841+0000","last_clean":"2024-06-06T03:23:14.515841+0000","last_became_active":"2024-06-06T03:23:14.515331+0000","last_became_peered":"2024-06-06T03:23:14.515331+0000","last_unstale":"2024-06-06T03:23:14.515841+0000","last_undegraded":"2024-06-06T03:23:14.515841+0000","last_fullsized":"2024-06-06T03:23:14.515841+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:46:57.178054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.512969+0000","last_change":"2024-06-06T03:22:34.299660+0000","last_active":"2024-06-06T03:23:14.512969+0000","last_peered":"2024-06-06T03:23:14.512969+0000","last_clean":"2024-06-06T03:23:14.512969+0000","last_became_active":"2024-06-06T03:22:34.298411+0000","last_became_peered":"2024-06-06T03:22:34.298411+0000","last_unstale":"2024-06-06T03:23:14.512969+0000","last_undegraded":"2024-06-06T03:23:14.512969+0000","last_fullsized":"2024-06-06T03:23:14.512969+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:29:16.170700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.511387+0000","last_change":"2024-06-06T03:22:34.308110+0000","last_active":"2024-06-06T03:23:14.511387+0000","last_peered":"2024-06-06T03:23:14.511387+0000","last_clean":"2024-06-06T03:23:14.511387+0000","last_became_active":"2024-06-06T03:22:34.307637+0000","last_became_peered":"2024-06-06T03:22:34.307637+0000","last_unstale":"2024-06-06T03:23:14.511387+0000","last_undegraded":"2024-06-06T03:23:14.511387+0000","last_fullsized":"2024-06-06T03:23:14.511387+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:40:23.264509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.516723+0000","last_change":"2024-06-06T03:22:34.295494+0000","last_active":"2024-06-06T03:23:14.516723+0000","last_peered":"2024-06-06T03:23:14.516723+0000","last_clean":"2024-06-06T03:23:14.516723+0000","last_became_active":"2024-06-06T03:22:34.295101+0000","last_became_peered":"2024-06-06T03:22:34.295101+0000","last_unstale":"2024-06-06T03:23:14.516723+0000","last_undegraded":"2024-06-06T03:23:14.516723+0000","last_fullsized":"2024-06-06T03:23:14.516723+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:39:07.298053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:15.073844+0000","last_change":"2024-06-06T03:22:34.291312+0000","last_active":"2024-06-06T03:23:15.073844+0000","last_peered":"2024-06-06T03:23:15.073844+0000","last_clean":"2024-06-06T03:23:15.073844+0000","last_became_active":"2024-06-06T03:22:34.290971+0000","last_became_peered":"2024-06-06T03:22:34.290971+0000","last_unstale":"2024-06-06T03:23:15.073844+0000","last_undegraded":"2024-06-06T03:23:15.073844+0000","last_fullsized":"2024-06-06T03:23:15.073844+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:06:27.333831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.517089+0000","last_change":"2024-06-06T03:22:34.292000+0000","last_active":"2024-06-06T03:23:14.517089+0000","last_peered":"2024-06-06T03:23:14.517089+0000","last_clean":"2024-06-06T03:23:14.517089+0000","last_became_active":"2024-06-06T03:22:34.291500+0000","last_became_peered":"2024-06-06T03:22:34.291500+0000","last_unstale":"2024-06-06T03:23:14.517089+0000","last_undegraded":"2024-06-06T03:23:14.517089+0000","last_fullsized":"2024-06-06T03:23:14.517089+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:37:20.677107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.594358+0000","last_change":"2024-06-06T03:22:34.303138+0000","last_active":"2024-06-06T03:23:14.594358+0000","last_peered":"2024-06-06T03:23:14.594358+0000","last_clean":"2024-06-06T03:23:14.594358+0000","last_became_active":"2024-06-06T03:22:34.302758+0000","last_became_peered":"2024-06-06T03:22:34.302758+0000","last_unstale":"2024-06-06T03:23:14.594358+0000","last_undegraded":"2024-06-06T03:23:14.594358+0000","last_fullsized":"2024-06-06T03:23:14.594358+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:34:18.516891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.513298+0000","last_change":"2024-06-06T03:22:34.297035+0000","last_active":"2024-06-06T03:23:14.513298+0000","last_peered":"2024-06-06T03:23:14.513298+0000","last_clean":"2024-06-06T03:23:14.513298+0000","last_became_active":"2024-06-06T03:22:34.296706+0000","last_became_peered":"2024-06-06T03:22:34.296706+0000","last_unstale":"2024-06-06T03:23:14.513298+0000","last_undegraded":"2024-06-06T03:23:14.513298+0000","last_fullsized":"2024-06-06T03:23:14.513298+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:26:26.959215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":34,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-06-06T03:23:14.512715+0000","last_change":"2024-06-06T03:22:34.296365+0000","last_active":"2024-06-06T03:23:14.512715+0000","last_peered":"2024-06-06T03:23:14.512715+0000","last_clean":"2024-06-06T03:23:14.512715+0000","last_became_active":"2024-06-06T03:22:34.296021+0000","last_became_peered":"2024-06-06T03:22:34.296021+0000","last_unstale":"2024-06-06T03:23:14.512715+0000","last_undegraded":"2024-06-06T03:23:14.512715+0000","last_fullsized":"2024-06-06T03:23:14.512715+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:40:33.183110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":249510,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":61805,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":169,"num_read_kb":150,"num_write":169,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":189680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383713,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1073152,"data_stored":551013,"data_compressed":26532,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645348,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28200,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716952,"statfs":{"total":95995035648,"available":95966158848,"internally_reserved":0,"allocated":1212416,"data_stored":1200550,"data_compressed":62644,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808875,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1085440,"data_stored":551227,"data_compressed":26532,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070512,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1081344,"data_stored":551125,"data_compressed":26532,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332149,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32284,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712868,"statfs":{"total":95995035648,"available":95961976832,"internally_reserved":0,"allocated":1134592,"data_stored":1147055,"data_compressed":62644,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495675,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1064960,"data_stored":546403,"data_compressed":26532,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28116,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717036,"statfs":{"total":95995035648,"available":95966244864,"internally_reserved":0,"allocated":1126400,"data_stored":604118,"data_compressed":26532,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36400,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708752,"statfs":{"total":95995035648,"available":95957762048,"internally_reserved":0,"allocated":1089536,"data_stored":547791,"data_compressed":26532,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411408,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32304,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712848,"statfs":{"total":95995035648,"available":95961956352,"internally_reserved":0,"allocated":1155072,"data_stored":609733,"data_compressed":26532,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182473,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1077248,"data_stored":546597,"data_compressed":26532,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920837,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1077248,"data_stored":551443,"data_compressed":26532,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757312,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32292,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712860,"statfs":{"total":95995035648,"available":95961968640,"internally_reserved":0,"allocated":1142784,"data_stored":1142253,"data_compressed":62644,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34475,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34475,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":57805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":59773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-06T03:24:05.678 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-06-06T03:24:05.679 INFO:tasks.cephadm:Setting up client nodes... 2024-06-06T03:24:05.679 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-06-06T03:24:05.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:05 smithi122 ceph-mon[35759]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T03:24:05.945 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:24:05.967 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:05 smithi050 ceph-mon[32421]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T03:24:06.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:05 smithi079 ceph-mon[35478]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T03:24:06.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:06 smithi122 ceph-mon[35759]: pgmap v353: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.2 KiB/s wr, 9 op/s 2024-06-06T03:24:06.955 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:06 smithi050 ceph-mon[32421]: pgmap v353: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.2 KiB/s wr, 9 op/s 2024-06-06T03:24:07.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:06 smithi079 ceph-mon[35478]: pgmap v353: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.2 KiB/s wr, 9 op/s 2024-06-06T03:24:07.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.749+0000 7f77e3bd9700 1 -- 172.21.15.50:0/941759399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77dc1020b0 msgr2=0x7f77dc102530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:07.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.749+0000 7f77e3bd9700 1 --2- 172.21.15.50:0/941759399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77dc1020b0 0x7f77dc102530 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f77d400b0a0 tx=0x7f77d400b3b0 comp rx=0 tx=0).stop 2024-06-06T03:24:07.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.749+0000 7f77e3bd9700 1 -- 172.21.15.50:0/941759399 shutdown_connections 2024-06-06T03:24:07.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.749+0000 7f77e3bd9700 1 --2- 172.21.15.50:0/941759399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77dc1020b0 0x7f77dc102530 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:07.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.749+0000 7f77e3bd9700 1 --2- 172.21.15.50:0/941759399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77dc100d90 0x7f77dc1011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:07.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.749+0000 7f77e3bd9700 1 --2- 172.21.15.50:0/941759399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77dc1016f0 0x7f77dc101b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:07.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.749+0000 7f77e3bd9700 1 -- 172.21.15.50:0/941759399 >> 172.21.15.50:0/941759399 conn(0x7f77dc0fc9b0 msgr2=0x7f77dc0fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:07.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.749+0000 7f77e3bd9700 1 -- 172.21.15.50:0/941759399 shutdown_connections 2024-06-06T03:24:07.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.749+0000 7f77e3bd9700 1 -- 172.21.15.50:0/941759399 wait complete. 2024-06-06T03:24:07.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.750+0000 7f77e3bd9700 1 Processor -- start 2024-06-06T03:24:07.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.750+0000 7f77e3bd9700 1 -- start start 2024-06-06T03:24:07.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.750+0000 7f77e3bd9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77dc100d90 0x7f77dc19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:07.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.750+0000 7f77e3bd9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77dc1016f0 0x7f77dc19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:07.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.750+0000 7f77e3bd9700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77dc1020b0 0x7f77dc1a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:07.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.750+0000 7f77e3bd9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f77dc110170 con 0x7f77dc100d90 2024-06-06T03:24:07.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.750+0000 7f77e3bd9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f77dc10fff0 con 0x7f77dc1016f0 2024-06-06T03:24:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.750+0000 7f77e3bd9700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f77dc1102f0 con 0x7f77dc1020b0 2024-06-06T03:24:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.750+0000 7f77e1975700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77dc100d90 0x7f77dc19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.750+0000 7f77e1975700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77dc100d90 0x7f77dc19a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36122/0 (socket says 172.21.15.50:36122) 2024-06-06T03:24:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.750+0000 7f77e1975700 1 -- 172.21.15.50:0/3817186593 learned_addr learned my addr 172.21.15.50:0/3817186593 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:24:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.750+0000 7f77e1174700 1 --2- 172.21.15.50:0/3817186593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77dc1016f0 0x7f77dc19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.750+0000 7f77e2176700 1 --2- 172.21.15.50:0/3817186593 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77dc1020b0 0x7f77dc1a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.751+0000 7f77e1975700 1 -- 172.21.15.50:0/3817186593 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77dc1020b0 msgr2=0x7f77dc1a1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.751+0000 7f77e1975700 1 --2- 172.21.15.50:0/3817186593 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77dc1020b0 0x7f77dc1a1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.751+0000 7f77e1975700 1 -- 172.21.15.50:0/3817186593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77dc1016f0 msgr2=0x7f77dc19aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.751+0000 7f77e1975700 1 --2- 172.21.15.50:0/3817186593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77dc1016f0 0x7f77dc19aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.751+0000 7f77e1975700 1 -- 172.21.15.50:0/3817186593 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77dc1a22c0 con 0x7f77dc100d90 2024-06-06T03:24:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.751+0000 7f77e1975700 1 --2- 172.21.15.50:0/3817186593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77dc100d90 0x7f77dc19a660 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f77d800d980 tx=0x7f77d800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.751+0000 7f77d2ffd700 1 -- 172.21.15.50:0/3817186593 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d8016070 con 0x7f77dc100d90 2024-06-06T03:24:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.751+0000 7f77d2ffd700 1 -- 172.21.15.50:0/3817186593 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f77d8009d80 con 0x7f77dc100d90 2024-06-06T03:24:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.751+0000 7f77e3bd9700 1 -- 172.21.15.50:0/3817186593 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77dc1a25b0 con 0x7f77dc100d90 2024-06-06T03:24:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.751+0000 7f77d2ffd700 1 -- 172.21.15.50:0/3817186593 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d800f3c0 con 0x7f77dc100d90 2024-06-06T03:24:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.751+0000 7f77e3bd9700 1 -- 172.21.15.50:0/3817186593 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77dc1a2b40 con 0x7f77dc100d90 2024-06-06T03:24:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.752+0000 7f77e3bd9700 1 -- 172.21.15.50:0/3817186593 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77dc050a00 con 0x7f77dc100d90 2024-06-06T03:24:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.753+0000 7f77d2ffd700 1 -- 172.21.15.50:0/3817186593 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f77d8019070 con 0x7f77dc100d90 2024-06-06T03:24:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.754+0000 7f77d2ffd700 1 --2- 172.21.15.50:0/3817186593 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f77c80a2de0 0x7f77c80a52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.754+0000 7f77e1174700 1 --2- 172.21.15.50:0/3817186593 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f77c80a2de0 0x7f77c80a52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.754+0000 7f77d2ffd700 1 -- 172.21.15.50:0/3817186593 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7f77d80cefb0 con 0x7f77dc100d90 2024-06-06T03:24:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.755+0000 7f77e1174700 1 --2- 172.21.15.50:0/3817186593 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f77c80a2de0 0x7f77c80a52a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f77cc00ac50 tx=0x7f77cc00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:07.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:07.759+0000 7f77d2ffd700 1 -- 172.21.15.50:0/3817186593 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f77d809ba50 con 0x7f77dc100d90 2024-06-06T03:24:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:08.059+0000 7f77e3bd9700 1 -- 172.21.15.50:0/3817186593 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f77dc02dde0 con 0x7f77dc100d90 2024-06-06T03:24:08.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:08.062+0000 7f77d2ffd700 1 -- 172.21.15.50:0/3817186593 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f77dc02dde0 con 0x7f77dc100d90 2024-06-06T03:24:08.062 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2024-06-06T03:24:08.062 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDYK2FmaWarAxAAEZUrPRURa4ID/2fUT+MUvQ== 2024-06-06T03:24:08.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:08.064+0000 7f77e3bd9700 1 -- 172.21.15.50:0/3817186593 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f77c80a2de0 msgr2=0x7f77c80a52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:08.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:08.064+0000 7f77e3bd9700 1 --2- 172.21.15.50:0/3817186593 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f77c80a2de0 0x7f77c80a52a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f77cc00ac50 tx=0x7f77cc00a380 comp rx=0 tx=0).stop 2024-06-06T03:24:08.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:08.064+0000 7f77e3bd9700 1 -- 172.21.15.50:0/3817186593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77dc100d90 msgr2=0x7f77dc19a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:08.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:08.064+0000 7f77e3bd9700 1 --2- 172.21.15.50:0/3817186593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77dc100d90 0x7f77dc19a660 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f77d800d980 tx=0x7f77d800dc90 comp rx=0 tx=0).stop 2024-06-06T03:24:08.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:08.064+0000 7f77e3bd9700 1 -- 172.21.15.50:0/3817186593 shutdown_connections 2024-06-06T03:24:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:08.064+0000 7f77e3bd9700 1 --2- 172.21.15.50:0/3817186593 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77dc1020b0 0x7f77dc1a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:08.064+0000 7f77e3bd9700 1 --2- 172.21.15.50:0/3817186593 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f77c80a2de0 0x7f77c80a52a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:08.064+0000 7f77e3bd9700 1 --2- 172.21.15.50:0/3817186593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77dc100d90 0x7f77dc19a660 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:08.064+0000 7f77e3bd9700 1 --2- 172.21.15.50:0/3817186593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77dc1016f0 0x7f77dc19aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:08.064+0000 7f77e3bd9700 1 -- 172.21.15.50:0/3817186593 >> 172.21.15.50:0/3817186593 conn(0x7f77dc0fc9b0 msgr2=0x7f77dc0fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:08.064+0000 7f77e3bd9700 1 -- 172.21.15.50:0/3817186593 shutdown_connections 2024-06-06T03:24:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:08.064+0000 7f77e3bd9700 1 -- 172.21.15.50:0/3817186593 wait complete. 2024-06-06T03:24:08.931 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:08 smithi050 ceph-mon[32421]: pgmap v354: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-06-06T03:24:08.931 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:08 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3817186593' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-06T03:24:08.931 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:08 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3817186593' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-06T03:24:08.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:08 smithi122 ceph-mon[35759]: pgmap v354: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-06-06T03:24:08.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:08 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/3817186593' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-06T03:24:08.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:08 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/3817186593' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-06T03:24:08.966 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-06-06T03:24:08.967 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-06-06T03:24:08.967 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-06-06T03:24:09.011 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-06-06T03:24:09.011 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-06-06T03:24:09.012 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph mgr dump --format=json 2024-06-06T03:24:09.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:08 smithi079 ceph-mon[35478]: pgmap v354: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-06-06T03:24:09.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:08 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/3817186593' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-06T03:24:09.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:08 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/3817186593' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-06T03:24:09.305 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:24:10.857 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:10 smithi050 ceph-mon[32421]: pgmap v355: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1023 B/s wr, 8 op/s 2024-06-06T03:24:10.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:10 smithi122 ceph-mon[35759]: pgmap v355: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1023 B/s wr, 8 op/s 2024-06-06T03:24:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.094+0000 7fb47038a700 1 -- 172.21.15.50:0/918108665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb46806abc0 msgr2=0x7fb46806b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.094+0000 7fb47038a700 1 --2- 172.21.15.50:0/918108665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb46806abc0 0x7fb46806b040 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb458009990 tx=0x7fb458009ca0 comp rx=0 tx=0).stop 2024-06-06T03:24:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.095+0000 7fb47038a700 1 -- 172.21.15.50:0/918108665 shutdown_connections 2024-06-06T03:24:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.095+0000 7fb47038a700 1 --2- 172.21.15.50:0/918108665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb46806b580 0x7fb46810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.095+0000 7fb47038a700 1 --2- 172.21.15.50:0/918108665 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb468108500 0x7fb4681088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.095+0000 7fb47038a700 1 --2- 172.21.15.50:0/918108665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb46806abc0 0x7fb46806b040 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.095+0000 7fb47038a700 1 -- 172.21.15.50:0/918108665 >> 172.21.15.50:0/918108665 conn(0x7fb468078340 msgr2=0x7fb468078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.095+0000 7fb47038a700 1 -- 172.21.15.50:0/918108665 shutdown_connections 2024-06-06T03:24:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.095+0000 7fb47038a700 1 -- 172.21.15.50:0/918108665 wait complete. 2024-06-06T03:24:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.095+0000 7fb47038a700 1 Processor -- start 2024-06-06T03:24:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.095+0000 7fb47038a700 1 -- start start 2024-06-06T03:24:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.096+0000 7fb47038a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb46806abc0 0x7fb46819e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.096+0000 7fb47038a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb46806b580 0x7fb46819edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.096+0000 7fb47038a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb468108500 0x7fb468198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.096+0000 7fb47038a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb468112710 con 0x7fb46806abc0 2024-06-06T03:24:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.096+0000 7fb47038a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb468112590 con 0x7fb468108500 2024-06-06T03:24:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.096+0000 7fb47038a700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb468112890 con 0x7fb46806b580 2024-06-06T03:24:11.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.096+0000 7fb46e126700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb46806abc0 0x7fb46819e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:11.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.096+0000 7fb46e126700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb46806abc0 0x7fb46819e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40846/0 (socket says 172.21.15.50:40846) 2024-06-06T03:24:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.096+0000 7fb46e126700 1 -- 172.21.15.50:0/506344704 learned_addr learned my addr 172.21.15.50:0/506344704 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:24:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.096+0000 7fb46d925700 1 --2- 172.21.15.50:0/506344704 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb46806b580 0x7fb46819edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.096+0000 7fb46e927700 1 --2- 172.21.15.50:0/506344704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb468108500 0x7fb468198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.096+0000 7fb46e126700 1 -- 172.21.15.50:0/506344704 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb46806b580 msgr2=0x7fb46819edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.096+0000 7fb46e126700 1 --2- 172.21.15.50:0/506344704 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb46806b580 0x7fb46819edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.096+0000 7fb46e126700 1 -- 172.21.15.50:0/506344704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb468108500 msgr2=0x7fb468198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.096+0000 7fb46e126700 1 --2- 172.21.15.50:0/506344704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb468108500 0x7fb468198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.096+0000 7fb46e126700 1 -- 172.21.15.50:0/506344704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4681991b0 con 0x7fb46806abc0 2024-06-06T03:24:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.096+0000 7fb46e126700 1 --2- 172.21.15.50:0/506344704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb46806abc0 0x7fb46819e890 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb46400b530 tx=0x7fb46400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.096+0000 7fb45f7fe700 1 -- 172.21.15.50:0/506344704 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb464015020 con 0x7fb46806abc0 2024-06-06T03:24:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.096+0000 7fb45f7fe700 1 -- 172.21.15.50:0/506344704 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb464011ce0 con 0x7fb46806abc0 2024-06-06T03:24:11.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.096+0000 7fb45f7fe700 1 -- 172.21.15.50:0/506344704 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb464010d60 con 0x7fb46806abc0 2024-06-06T03:24:11.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.097+0000 7fb47038a700 1 -- 172.21.15.50:0/506344704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4681994a0 con 0x7fb46806abc0 2024-06-06T03:24:11.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.097+0000 7fb47038a700 1 -- 172.21.15.50:0/506344704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4681a5760 con 0x7fb46806abc0 2024-06-06T03:24:11.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.098+0000 7fb47038a700 1 -- 172.21.15.50:0/506344704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb46810a9e0 con 0x7fb46806abc0 2024-06-06T03:24:11.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.099+0000 7fb45f7fe700 1 -- 172.21.15.50:0/506344704 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb464018020 con 0x7fb46806abc0 2024-06-06T03:24:11.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.100+0000 7fb45f7fe700 1 --2- 172.21.15.50:0/506344704 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb4540a2d30 0x7fb4540a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:11.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.100+0000 7fb46d925700 1 --2- 172.21.15.50:0/506344704 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb4540a2d30 0x7fb4540a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:11.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.100+0000 7fb45f7fe700 1 -- 172.21.15.50:0/506344704 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7fb4640ced30 con 0x7fb46806abc0 2024-06-06T03:24:11.102 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:10 smithi079 ceph-mon[35478]: pgmap v355: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1023 B/s wr, 8 op/s 2024-06-06T03:24:11.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.100+0000 7fb46d925700 1 --2- 172.21.15.50:0/506344704 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb4540a2d30 0x7fb4540a51f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb458006010 tx=0x7fb45801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:11.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.104+0000 7fb45f7fe700 1 -- 172.21.15.50:0/506344704 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb46401f020 con 0x7fb46806abc0 2024-06-06T03:24:11.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.372+0000 7fb47038a700 1 -- 172.21.15.50:0/506344704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fb468199f80 con 0x7fb46806abc0 2024-06-06T03:24:11.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.376+0000 7fb45f7fe700 1 -- 172.21.15.50:0/506344704 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263201 (secure 0 0 0) 0x7fb46409b880 con 0x7fb46806abc0 2024-06-06T03:24:11.377 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:24:11.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.380+0000 7fb47038a700 1 -- 172.21.15.50:0/506344704 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb4540a2d30 msgr2=0x7fb4540a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:11.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.380+0000 7fb47038a700 1 --2- 172.21.15.50:0/506344704 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb4540a2d30 0x7fb4540a51f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb458006010 tx=0x7fb45801a040 comp rx=0 tx=0).stop 2024-06-06T03:24:11.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.380+0000 7fb47038a700 1 -- 172.21.15.50:0/506344704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb46806abc0 msgr2=0x7fb46819e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:11.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.380+0000 7fb47038a700 1 --2- 172.21.15.50:0/506344704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb46806abc0 0x7fb46819e890 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb46400b530 tx=0x7fb46400b8f0 comp rx=0 tx=0).stop 2024-06-06T03:24:11.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.380+0000 7fb47038a700 1 -- 172.21.15.50:0/506344704 shutdown_connections 2024-06-06T03:24:11.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.380+0000 7fb47038a700 1 --2- 172.21.15.50:0/506344704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb468108500 0x7fb468198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:11.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.380+0000 7fb47038a700 1 --2- 172.21.15.50:0/506344704 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb4540a2d30 0x7fb4540a51f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:11.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.380+0000 7fb47038a700 1 --2- 172.21.15.50:0/506344704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb46806abc0 0x7fb46819e890 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:11.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.380+0000 7fb47038a700 1 --2- 172.21.15.50:0/506344704 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb46806b580 0x7fb46819edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:11.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.380+0000 7fb47038a700 1 -- 172.21.15.50:0/506344704 >> 172.21.15.50:0/506344704 conn(0x7fb468078340 msgr2=0x7fb4681001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:11.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.380+0000 7fb47038a700 1 -- 172.21.15.50:0/506344704 shutdown_connections 2024-06-06T03:24:11.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:11.380+0000 7fb47038a700 1 -- 172.21.15.50:0/506344704 wait complete. 2024-06-06T03:24:12.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:11 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/506344704' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-06T03:24:12.053 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1779941165},{"type":"v1","addr":"172.21.15.50:6801","nonce":1779941165}]},"active_addr":"172.21.15.50:6801/1779941165","active_change":"2024-06-06T03:15:13.252355+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.50:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":4170664250}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":4254839466}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":4078698808}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":2261627271}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":2064230571}]}]} 2024-06-06T03:24:12.058 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-06-06T03:24:12.058 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-06-06T03:24:12.059 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-06T03:24:12.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:11 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/506344704' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-06T03:24:12.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:11 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/506344704' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-06T03:24:12.311 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:24:13.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:12 smithi050 ceph-mon[32421]: pgmap v356: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-06-06T03:24:13.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:12 smithi079 ceph-mon[35478]: pgmap v356: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-06-06T03:24:13.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:12 smithi122 ceph-mon[35759]: pgmap v356: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-06-06T03:24:13.884 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [5, 8]}]: dispatch 2024-06-06T03:24:14.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:13 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [5, 8]}]: dispatch 2024-06-06T03:24:14.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.120+0000 7f1a9c6b8700 1 -- 172.21.15.50:0/1123944776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a94107420 msgr2=0x7f1a94107800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:14.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.120+0000 7f1a9c6b8700 1 --2- 172.21.15.50:0/1123944776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a94107420 0x7f1a94107800 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1a90009990 tx=0x7f1a90009ca0 comp rx=0 tx=0).stop 2024-06-06T03:24:14.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.120+0000 7f1a9c6b8700 1 -- 172.21.15.50:0/1123944776 shutdown_connections 2024-06-06T03:24:14.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.120+0000 7f1a9c6b8700 1 --2- 172.21.15.50:0/1123944776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a94101d30 0x7f1a9410e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:14.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.120+0000 7f1a9c6b8700 1 --2- 172.21.15.50:0/1123944776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a94107420 0x7f1a94107800 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:14.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.120+0000 7f1a9c6b8700 1 --2- 172.21.15.50:0/1123944776 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a94101370 0x7f1a941017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:14.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.120+0000 7f1a9c6b8700 1 -- 172.21.15.50:0/1123944776 >> 172.21.15.50:0/1123944776 conn(0x7f1a94078340 msgr2=0x7f1a94078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:14.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.120+0000 7f1a9c6b8700 1 -- 172.21.15.50:0/1123944776 shutdown_connections 2024-06-06T03:24:14.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.120+0000 7f1a9c6b8700 1 -- 172.21.15.50:0/1123944776 wait complete. 2024-06-06T03:24:14.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.121+0000 7f1a9c6b8700 1 Processor -- start 2024-06-06T03:24:14.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.121+0000 7f1a9c6b8700 1 -- start start 2024-06-06T03:24:14.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.121+0000 7f1a9c6b8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a94101370 0x7f1a94103020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:14.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.121+0000 7f1a9c6b8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a94101d30 0x7f1a94103560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:14.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.121+0000 7f1a9c6b8700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a94107420 0x7f1a94103aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:14.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.121+0000 7f1a9c6b8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1a94111560 con 0x7f1a94101370 2024-06-06T03:24:14.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.121+0000 7f1a9c6b8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1a941113e0 con 0x7f1a94101d30 2024-06-06T03:24:14.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.121+0000 7f1a9c6b8700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1a941116e0 con 0x7f1a94107420 2024-06-06T03:24:14.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.121+0000 7f1a9a454700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a94101370 0x7f1a94103020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:14.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.121+0000 7f1a9a454700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a94101370 0x7f1a94103020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40858/0 (socket says 172.21.15.50:40858) 2024-06-06T03:24:14.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.121+0000 7f1a9a454700 1 -- 172.21.15.50:0/1762821735 learned_addr learned my addr 172.21.15.50:0/1762821735 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:24:14.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.121+0000 7f1a99c53700 1 --2- 172.21.15.50:0/1762821735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a94101d30 0x7f1a94103560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:14.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.121+0000 7f1a9ac55700 1 --2- 172.21.15.50:0/1762821735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a94107420 0x7f1a94103aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:14.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.122+0000 7f1a9a454700 1 -- 172.21.15.50:0/1762821735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a94107420 msgr2=0x7f1a94103aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:14.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.122+0000 7f1a9a454700 1 --2- 172.21.15.50:0/1762821735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a94107420 0x7f1a94103aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:14.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.122+0000 7f1a9a454700 1 -- 172.21.15.50:0/1762821735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a94101d30 msgr2=0x7f1a94103560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:14.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.122+0000 7f1a9a454700 1 --2- 172.21.15.50:0/1762821735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a94101d30 0x7f1a94103560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:14.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.122+0000 7f1a9a454700 1 -- 172.21.15.50:0/1762821735 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a941a7060 con 0x7f1a94101370 2024-06-06T03:24:14.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.122+0000 7f1a99c53700 1 --2- 172.21.15.50:0/1762821735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a94101d30 0x7f1a94103560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:24:14.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.122+0000 7f1a9a454700 1 --2- 172.21.15.50:0/1762821735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a94101370 0x7f1a94103020 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1a90000c00 tx=0x7f1a90003b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:14.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.122+0000 7f1a8b7fe700 1 -- 172.21.15.50:0/1762821735 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a90027070 con 0x7f1a94101370 2024-06-06T03:24:14.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.122+0000 7f1a8b7fe700 1 -- 172.21.15.50:0/1762821735 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a9000bdc0 con 0x7f1a94101370 2024-06-06T03:24:14.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.122+0000 7f1a9c6b8700 1 -- 172.21.15.50:0/1762821735 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a941a72f0 con 0x7f1a94101370 2024-06-06T03:24:14.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.122+0000 7f1a8b7fe700 1 -- 172.21.15.50:0/1762821735 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9000f6c0 con 0x7f1a94101370 2024-06-06T03:24:14.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.122+0000 7f1a9c6b8700 1 -- 172.21.15.50:0/1762821735 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a941a77d0 con 0x7f1a94101370 2024-06-06T03:24:14.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.123+0000 7f1a9c6b8700 1 -- 172.21.15.50:0/1762821735 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a94069180 con 0x7f1a94101370 2024-06-06T03:24:14.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.124+0000 7f1a8b7fe700 1 -- 172.21.15.50:0/1762821735 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1a9002a070 con 0x7f1a94101370 2024-06-06T03:24:14.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.125+0000 7f1a8b7fe700 1 --2- 172.21.15.50:0/1762821735 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f1a800a2cb0 0x7f1a800a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:14.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.125+0000 7f1a99c53700 1 --2- 172.21.15.50:0/1762821735 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f1a800a2cb0 0x7f1a800a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:14.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.125+0000 7f1a8b7fe700 1 -- 172.21.15.50:0/1762821735 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9121+0+0 (secure 0 0 0) 0x7f1a900d06f0 con 0x7f1a94101370 2024-06-06T03:24:14.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.125+0000 7f1a99c53700 1 --2- 172.21.15.50:0/1762821735 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f1a800a2cb0 0x7f1a800a5170 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1a940788b0 tx=0x7f1a84005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:14.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.129+0000 7f1a8b7fe700 1 -- 172.21.15.50:0/1762821735 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1a9005e850 con 0x7f1a94101370 2024-06-06T03:24:14.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:13 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [5, 8]}]: dispatch 2024-06-06T03:24:14.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.337+0000 7f1a9c6b8700 1 -- 172.21.15.50:0/1762821735 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1a941a7af0 con 0x7f1a94101370 2024-06-06T03:24:14.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.339+0000 7f1a8b7fe700 1 -- 172.21.15.50:0/1762821735 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+24653 (secure 0 0 0) 0x7f1a90013070 con 0x7f1a94101370 2024-06-06T03:24:14.339 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:24:14.339 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":98,"fsid":"b6263b26-23b2-11ef-bc9b-c7b262605968","created":"2024-06-06T03:14:19.062632+0000","modified":"2024-06-06T03:24:13.685799+0000","last_up_change":"2024-06-06T03:21:30.287918+0000","last_in_change":"2024-06-06T03:21:09.550417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T03:17:37.777608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T03:22:29.496859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T03:22:33.221878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-06T03:22:42.829873+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"eed8040f-a7b7-4d3b-8345-2022918097d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6803","nonce":2379528827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6805","nonce":2379528827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6809","nonce":2379528827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6807","nonce":2379528827}]},"public_addr":"172.21.15.50:6803/2379528827","cluster_addr":"172.21.15.50:6805/2379528827","heartbeat_back_addr":"172.21.15.50:6809/2379528827","heartbeat_front_addr":"172.21.15.50:6807/2379528827","state":["exists","up"]},{"osd":1,"uuid":"089ecb78-5e1e-4cdb-8fe0-5c1731ec9dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6801","nonce":3498354151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6803","nonce":3498354151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6807","nonce":3498354151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6805","nonce":3498354151}]},"public_addr":"172.21.15.79:6801/3498354151","cluster_addr":"172.21.15.79:6803/3498354151","heartbeat_back_addr":"172.21.15.79:6807/3498354151","heartbeat_front_addr":"172.21.15.79:6805/3498354151","state":["exists","up"]},{"osd":2,"uuid":"90599e3b-bf86-4a56-b03b-b051528a5b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6801","nonce":566397008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6803","nonce":566397008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6807","nonce":566397008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6805","nonce":566397008}]},"public_addr":"172.21.15.122:6801/566397008","cluster_addr":"172.21.15.122:6803/566397008","heartbeat_back_addr":"172.21.15.122:6807/566397008","heartbeat_front_addr":"172.21.15.122:6805/566397008","state":["exists","up"]},{"osd":3,"uuid":"fd295e6c-64cd-4164-83dc-4d32c2ae103a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6811","nonce":820123083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6813","nonce":820123083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6817","nonce":820123083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6815","nonce":820123083}]},"public_addr":"172.21.15.50:6811/820123083","cluster_addr":"172.21.15.50:6813/820123083","heartbeat_back_addr":"172.21.15.50:6817/820123083","heartbeat_front_addr":"172.21.15.50:6815/820123083","state":["exists","up"]},{"osd":4,"uuid":"4c854d90-5353-4f7c-b2f3-2af6216d799b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6809","nonce":1784117997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6811","nonce":1784117997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6815","nonce":1784117997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6813","nonce":1784117997}]},"public_addr":"172.21.15.79:6809/1784117997","cluster_addr":"172.21.15.79:6811/1784117997","heartbeat_back_addr":"172.21.15.79:6815/1784117997","heartbeat_front_addr":"172.21.15.79:6813/1784117997","state":["exists","up"]},{"osd":5,"uuid":"80041e10-a643-4338-b621-f882c7bc48b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6809","nonce":2755878218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6811","nonce":2755878218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6815","nonce":2755878218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6813","nonce":2755878218}]},"public_addr":"172.21.15.122:6809/2755878218","cluster_addr":"172.21.15.122:6811/2755878218","heartbeat_back_addr":"172.21.15.122:6815/2755878218","heartbeat_front_addr":"172.21.15.122:6813/2755878218","state":["exists","up"]},{"osd":6,"uuid":"9e15c6c3-bb4b-4c2b-bb7e-4653b10874d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6819","nonce":474595612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6821","nonce":474595612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6825","nonce":474595612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6823","nonce":474595612}]},"public_addr":"172.21.15.50:6819/474595612","cluster_addr":"172.21.15.50:6821/474595612","heartbeat_back_addr":"172.21.15.50:6825/474595612","heartbeat_front_addr":"172.21.15.50:6823/474595612","state":["exists","up"]},{"osd":7,"uuid":"62585bba-c540-4498-8768-b84183e19abd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6817","nonce":3504864579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6819","nonce":3504864579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6823","nonce":3504864579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6821","nonce":3504864579}]},"public_addr":"172.21.15.79:6817/3504864579","cluster_addr":"172.21.15.79:6819/3504864579","heartbeat_back_addr":"172.21.15.79:6823/3504864579","heartbeat_front_addr":"172.21.15.79:6821/3504864579","state":["exists","up"]},{"osd":8,"uuid":"7a272157-460a-4d4a-a63e-30436022ac7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6817","nonce":3484833116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6819","nonce":3484833116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6823","nonce":3484833116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6821","nonce":3484833116}]},"public_addr":"172.21.15.122:6817/3484833116","cluster_addr":"172.21.15.122:6819/3484833116","heartbeat_back_addr":"172.21.15.122:6823/3484833116","heartbeat_front_addr":"172.21.15.122:6821/3484833116","state":["exists","up"]},{"osd":9,"uuid":"7e768ff7-f78d-4a12-b863-4b692e0f4a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6827","nonce":2600273670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6829","nonce":2600273670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6833","nonce":2600273670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6831","nonce":2600273670}]},"public_addr":"172.21.15.50:6827/2600273670","cluster_addr":"172.21.15.50:6829/2600273670","heartbeat_back_addr":"172.21.15.50:6833/2600273670","heartbeat_front_addr":"172.21.15.50:6831/2600273670","state":["exists","up"]},{"osd":10,"uuid":"a42df29a-d88d-4401-878d-6c8f75f3f604","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6825","nonce":2740366543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6827","nonce":2740366543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6831","nonce":2740366543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6829","nonce":2740366543}]},"public_addr":"172.21.15.79:6825/2740366543","cluster_addr":"172.21.15.79:6827/2740366543","heartbeat_back_addr":"172.21.15.79:6831/2740366543","heartbeat_front_addr":"172.21.15.79:6829/2740366543","state":["exists","up"]},{"osd":11,"uuid":"35bcde30-49e4-49b9-a348-98d21a0d3cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6825","nonce":4160854238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6827","nonce":4160854238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6831","nonce":4160854238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6829","nonce":4160854238}]},"public_addr":"172.21.15.122:6825/4160854238","cluster_addr":"172.21.15.122:6827/4160854238","heartbeat_back_addr":"172.21.15.122:6831/4160854238","heartbeat_front_addr":"172.21.15.122:6829/4160854238","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:16:46.989554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:17:11.269759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:17:35.105846+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:00.940943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:26.284520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:51.064143+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:19:16.254750+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:19:42.841380+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:20:08.185133+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:20:34.700082+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:21:01.485278+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:21:27.938715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1311987652":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/1149897118":"2024-06-07T03:15:13.252241+0000","172.21.15.50:6800/2617801068":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/1068038293":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/4038080419":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/149912088":"2024-06-07T03:14:46.388744+0000","172.21.15.50:6801/2617801068":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/2963887224":"2024-06-07T03:14:46.388744+0000","172.21.15.50:6801/1311987652":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/2554563139":"2024-06-07T03:15:13.252241+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T03:24:14.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.341+0000 7f1a9c6b8700 1 -- 172.21.15.50:0/1762821735 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f1a800a2cb0 msgr2=0x7f1a800a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:14.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.341+0000 7f1a9c6b8700 1 --2- 172.21.15.50:0/1762821735 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f1a800a2cb0 0x7f1a800a5170 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1a940788b0 tx=0x7f1a84005f50 comp rx=0 tx=0).stop 2024-06-06T03:24:14.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.341+0000 7f1a9c6b8700 1 -- 172.21.15.50:0/1762821735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a94101370 msgr2=0x7f1a94103020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:14.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.341+0000 7f1a9c6b8700 1 --2- 172.21.15.50:0/1762821735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a94101370 0x7f1a94103020 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1a90000c00 tx=0x7f1a90003b30 comp rx=0 tx=0).stop 2024-06-06T03:24:14.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.341+0000 7f1a9c6b8700 1 -- 172.21.15.50:0/1762821735 shutdown_connections 2024-06-06T03:24:14.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.341+0000 7f1a9c6b8700 1 --2- 172.21.15.50:0/1762821735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a94107420 0x7f1a94103aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:14.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.341+0000 7f1a9c6b8700 1 --2- 172.21.15.50:0/1762821735 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f1a800a2cb0 0x7f1a800a5170 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:14.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.341+0000 7f1a9c6b8700 1 --2- 172.21.15.50:0/1762821735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a94101370 0x7f1a94103020 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:14.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.341+0000 7f1a9c6b8700 1 --2- 172.21.15.50:0/1762821735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a94101d30 0x7f1a94103560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:14.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.341+0000 7f1a9c6b8700 1 -- 172.21.15.50:0/1762821735 >> 172.21.15.50:0/1762821735 conn(0x7f1a94078340 msgr2=0x7f1a94100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:14.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.341+0000 7f1a9c6b8700 1 -- 172.21.15.50:0/1762821735 shutdown_connections 2024-06-06T03:24:14.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:14.341+0000 7f1a9c6b8700 1 -- 172.21.15.50:0/1762821735 wait complete. 2024-06-06T03:24:15.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:14 smithi050 ceph-mon[32421]: pgmap v357: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-06-06T03:24:15.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [5, 8]}]': finished 2024-06-06T03:24:15.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:14 smithi050 ceph-mon[32421]: osdmap e98: 12 total, 12 up, 12 in 2024-06-06T03:24:15.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:14 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1762821735' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:24:15.082 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-06-06T03:24:15.082 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-06T03:24:15.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:14 smithi079 ceph-mon[35478]: pgmap v357: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-06-06T03:24:15.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [5, 8]}]': finished 2024-06-06T03:24:15.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:14 smithi079 ceph-mon[35478]: osdmap e98: 12 total, 12 up, 12 in 2024-06-06T03:24:15.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:14 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/1762821735' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:24:15.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:14 smithi122 ceph-mon[35759]: pgmap v357: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-06-06T03:24:15.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [5, 8]}]': finished 2024-06-06T03:24:15.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:14 smithi122 ceph-mon[35759]: osdmap e98: 12 total, 12 up, 12 in 2024-06-06T03:24:15.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:14 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/1762821735' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:24:15.341 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:24:15.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:15 smithi050 ceph-mon[32421]: osdmap e99: 12 total, 12 up, 12 in 2024-06-06T03:24:16.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:15 smithi079 ceph-mon[35478]: osdmap e99: 12 total, 12 up, 12 in 2024-06-06T03:24:16.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:15 smithi122 ceph-mon[35759]: osdmap e99: 12 total, 12 up, 12 in 2024-06-06T03:24:16.990 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:16 smithi050 ceph-mon[32421]: pgmap v360: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:24:17.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.098+0000 7f0f6f85f700 1 -- 172.21.15.50:0/1285430047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f68074fe0 msgr2=0x7f0f6810e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:17.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.098+0000 7f0f6f85f700 1 --2- 172.21.15.50:0/1285430047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f68074fe0 0x7f0f6810e950 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009990 tx=0x7f0f58009ca0 comp rx=0 tx=0).stop 2024-06-06T03:24:17.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.098+0000 7f0f6f85f700 1 -- 172.21.15.50:0/1285430047 shutdown_connections 2024-06-06T03:24:17.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.098+0000 7f0f6f85f700 1 --2- 172.21.15.50:0/1285430047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f6810ee90 0x7f0f68111280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:17.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.098+0000 7f0f6f85f700 1 --2- 172.21.15.50:0/1285430047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f680746c0 0x7f0f68074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:17.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.098+0000 7f0f6f85f700 1 --2- 172.21.15.50:0/1285430047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f68074fe0 0x7f0f6810e950 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:17.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.098+0000 7f0f6f85f700 1 -- 172.21.15.50:0/1285430047 >> 172.21.15.50:0/1285430047 conn(0x7f0f680795f0 msgr2=0x7f0f68079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:17.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.098+0000 7f0f6f85f700 1 -- 172.21.15.50:0/1285430047 shutdown_connections 2024-06-06T03:24:17.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.098+0000 7f0f6f85f700 1 -- 172.21.15.50:0/1285430047 wait complete. 2024-06-06T03:24:17.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.098+0000 7f0f6f85f700 1 Processor -- start 2024-06-06T03:24:17.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.098+0000 7f0f6f85f700 1 -- start start 2024-06-06T03:24:17.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.099+0000 7f0f6f85f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f680746c0 0x7f0f681a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:17.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.099+0000 7f0f6f85f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f68074fe0 0x7f0f681a0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:17.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.099+0000 7f0f6f85f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f6810ee90 0x7f0f6819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:17.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.099+0000 7f0f6f85f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0f68114850 con 0x7f0f6810ee90 2024-06-06T03:24:17.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.099+0000 7f0f6f85f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0f681146d0 con 0x7f0f680746c0 2024-06-06T03:24:17.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.099+0000 7f0f6f85f700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0f681149d0 con 0x7f0f68074fe0 2024-06-06T03:24:17.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.099+0000 7f0f6ddfc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f6810ee90 0x7f0f6819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:17.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.099+0000 7f0f6ddfc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f6810ee90 0x7f0f6819aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40880/0 (socket says 172.21.15.50:40880) 2024-06-06T03:24:17.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.099+0000 7f0f6ddfc700 1 -- 172.21.15.50:0/668728690 learned_addr learned my addr 172.21.15.50:0/668728690 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:24:17.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.099+0000 7f0f6cdfa700 1 --2- 172.21.15.50:0/668728690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f68074fe0 0x7f0f681a0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:17.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.099+0000 7f0f6d5fb700 1 --2- 172.21.15.50:0/668728690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f680746c0 0x7f0f681a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:17.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.099+0000 7f0f6ddfc700 1 -- 172.21.15.50:0/668728690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f68074fe0 msgr2=0x7f0f681a0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:17.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.099+0000 7f0f6ddfc700 1 --2- 172.21.15.50:0/668728690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f68074fe0 0x7f0f681a0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:17.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.099+0000 7f0f6ddfc700 1 -- 172.21.15.50:0/668728690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f680746c0 msgr2=0x7f0f681a0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:17.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.099+0000 7f0f6ddfc700 1 --2- 172.21.15.50:0/668728690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f680746c0 0x7f0f681a0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:17.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.099+0000 7f0f6ddfc700 1 -- 172.21.15.50:0/668728690 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6819b250 con 0x7f0f6810ee90 2024-06-06T03:24:17.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.099+0000 7f0f6ddfc700 1 --2- 172.21.15.50:0/668728690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f6810ee90 0x7f0f6819aaf0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0f60007d40 tx=0x7f0f6000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:17.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.100+0000 7f0f5e7fc700 1 -- 172.21.15.50:0/668728690 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60016020 con 0x7f0f6810ee90 2024-06-06T03:24:17.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.100+0000 7f0f6f85f700 1 -- 172.21.15.50:0/668728690 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f6819b540 con 0x7f0f6810ee90 2024-06-06T03:24:17.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.100+0000 7f0f5e7fc700 1 -- 172.21.15.50:0/668728690 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0f6000ad40 con 0x7f0f6810ee90 2024-06-06T03:24:17.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.100+0000 7f0f5e7fc700 1 -- 172.21.15.50:0/668728690 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f600115e0 con 0x7f0f6810ee90 2024-06-06T03:24:17.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.100+0000 7f0f6f85f700 1 -- 172.21.15.50:0/668728690 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f681a7800 con 0x7f0f6810ee90 2024-06-06T03:24:17.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.101+0000 7f0f6f85f700 1 -- 172.21.15.50:0/668728690 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f68069180 con 0x7f0f6810ee90 2024-06-06T03:24:17.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.102+0000 7f0f5e7fc700 1 -- 172.21.15.50:0/668728690 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0f60019020 con 0x7f0f6810ee90 2024-06-06T03:24:17.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.103+0000 7f0f5e7fc700 1 --2- 172.21.15.50:0/668728690 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f0f540a2cb0 0x7f0f540a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:17.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.103+0000 7f0f6d5fb700 1 --2- 172.21.15.50:0/668728690 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f0f540a2cb0 0x7f0f540a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:17.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.103+0000 7f0f5e7fc700 1 -- 172.21.15.50:0/668728690 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f0f600cf7e0 con 0x7f0f6810ee90 2024-06-06T03:24:17.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.103+0000 7f0f6d5fb700 1 --2- 172.21.15.50:0/668728690 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f0f540a2cb0 0x7f0f540a5170 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0f64005950 tx=0x7f0f640058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:17.107 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:16 smithi079 ceph-mon[35478]: pgmap v360: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:24:17.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.107+0000 7f0f5e7fc700 1 -- 172.21.15.50:0/668728690 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0f60020020 con 0x7f0f6810ee90 2024-06-06T03:24:17.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:16 smithi122 ceph-mon[35759]: pgmap v360: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:24:17.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.314+0000 7f0f6f85f700 1 -- 172.21.15.50:0/668728690 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f681a79d0 con 0x7f0f6810ee90 2024-06-06T03:24:17.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.316+0000 7f0f5e7fc700 1 -- 172.21.15.50:0/668728690 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+24653 (secure 0 0 0) 0x7f0f6009c370 con 0x7f0f6810ee90 2024-06-06T03:24:17.316 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:24:17.316 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":99,"fsid":"b6263b26-23b2-11ef-bc9b-c7b262605968","created":"2024-06-06T03:14:19.062632+0000","modified":"2024-06-06T03:24:14.691472+0000","last_up_change":"2024-06-06T03:21:30.287918+0000","last_in_change":"2024-06-06T03:21:09.550417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T03:17:37.777608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T03:22:29.496859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T03:22:33.221878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-06T03:22:42.829873+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"eed8040f-a7b7-4d3b-8345-2022918097d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6803","nonce":2379528827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6805","nonce":2379528827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6809","nonce":2379528827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6807","nonce":2379528827}]},"public_addr":"172.21.15.50:6803/2379528827","cluster_addr":"172.21.15.50:6805/2379528827","heartbeat_back_addr":"172.21.15.50:6809/2379528827","heartbeat_front_addr":"172.21.15.50:6807/2379528827","state":["exists","up"]},{"osd":1,"uuid":"089ecb78-5e1e-4cdb-8fe0-5c1731ec9dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6801","nonce":3498354151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6803","nonce":3498354151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6807","nonce":3498354151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6805","nonce":3498354151}]},"public_addr":"172.21.15.79:6801/3498354151","cluster_addr":"172.21.15.79:6803/3498354151","heartbeat_back_addr":"172.21.15.79:6807/3498354151","heartbeat_front_addr":"172.21.15.79:6805/3498354151","state":["exists","up"]},{"osd":2,"uuid":"90599e3b-bf86-4a56-b03b-b051528a5b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6801","nonce":566397008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6803","nonce":566397008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6807","nonce":566397008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6805","nonce":566397008}]},"public_addr":"172.21.15.122:6801/566397008","cluster_addr":"172.21.15.122:6803/566397008","heartbeat_back_addr":"172.21.15.122:6807/566397008","heartbeat_front_addr":"172.21.15.122:6805/566397008","state":["exists","up"]},{"osd":3,"uuid":"fd295e6c-64cd-4164-83dc-4d32c2ae103a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6811","nonce":820123083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6813","nonce":820123083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6817","nonce":820123083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6815","nonce":820123083}]},"public_addr":"172.21.15.50:6811/820123083","cluster_addr":"172.21.15.50:6813/820123083","heartbeat_back_addr":"172.21.15.50:6817/820123083","heartbeat_front_addr":"172.21.15.50:6815/820123083","state":["exists","up"]},{"osd":4,"uuid":"4c854d90-5353-4f7c-b2f3-2af6216d799b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6809","nonce":1784117997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6811","nonce":1784117997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6815","nonce":1784117997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6813","nonce":1784117997}]},"public_addr":"172.21.15.79:6809/1784117997","cluster_addr":"172.21.15.79:6811/1784117997","heartbeat_back_addr":"172.21.15.79:6815/1784117997","heartbeat_front_addr":"172.21.15.79:6813/1784117997","state":["exists","up"]},{"osd":5,"uuid":"80041e10-a643-4338-b621-f882c7bc48b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6809","nonce":2755878218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6811","nonce":2755878218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6815","nonce":2755878218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6813","nonce":2755878218}]},"public_addr":"172.21.15.122:6809/2755878218","cluster_addr":"172.21.15.122:6811/2755878218","heartbeat_back_addr":"172.21.15.122:6815/2755878218","heartbeat_front_addr":"172.21.15.122:6813/2755878218","state":["exists","up"]},{"osd":6,"uuid":"9e15c6c3-bb4b-4c2b-bb7e-4653b10874d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6819","nonce":474595612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6821","nonce":474595612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6825","nonce":474595612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6823","nonce":474595612}]},"public_addr":"172.21.15.50:6819/474595612","cluster_addr":"172.21.15.50:6821/474595612","heartbeat_back_addr":"172.21.15.50:6825/474595612","heartbeat_front_addr":"172.21.15.50:6823/474595612","state":["exists","up"]},{"osd":7,"uuid":"62585bba-c540-4498-8768-b84183e19abd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6817","nonce":3504864579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6819","nonce":3504864579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6823","nonce":3504864579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6821","nonce":3504864579}]},"public_addr":"172.21.15.79:6817/3504864579","cluster_addr":"172.21.15.79:6819/3504864579","heartbeat_back_addr":"172.21.15.79:6823/3504864579","heartbeat_front_addr":"172.21.15.79:6821/3504864579","state":["exists","up"]},{"osd":8,"uuid":"7a272157-460a-4d4a-a63e-30436022ac7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6817","nonce":3484833116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6819","nonce":3484833116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6823","nonce":3484833116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6821","nonce":3484833116}]},"public_addr":"172.21.15.122:6817/3484833116","cluster_addr":"172.21.15.122:6819/3484833116","heartbeat_back_addr":"172.21.15.122:6823/3484833116","heartbeat_front_addr":"172.21.15.122:6821/3484833116","state":["exists","up"]},{"osd":9,"uuid":"7e768ff7-f78d-4a12-b863-4b692e0f4a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6827","nonce":2600273670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6829","nonce":2600273670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6833","nonce":2600273670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6831","nonce":2600273670}]},"public_addr":"172.21.15.50:6827/2600273670","cluster_addr":"172.21.15.50:6829/2600273670","heartbeat_back_addr":"172.21.15.50:6833/2600273670","heartbeat_front_addr":"172.21.15.50:6831/2600273670","state":["exists","up"]},{"osd":10,"uuid":"a42df29a-d88d-4401-878d-6c8f75f3f604","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6825","nonce":2740366543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6827","nonce":2740366543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6831","nonce":2740366543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6829","nonce":2740366543}]},"public_addr":"172.21.15.79:6825/2740366543","cluster_addr":"172.21.15.79:6827/2740366543","heartbeat_back_addr":"172.21.15.79:6831/2740366543","heartbeat_front_addr":"172.21.15.79:6829/2740366543","state":["exists","up"]},{"osd":11,"uuid":"35bcde30-49e4-49b9-a348-98d21a0d3cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6825","nonce":4160854238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6827","nonce":4160854238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6831","nonce":4160854238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6829","nonce":4160854238}]},"public_addr":"172.21.15.122:6825/4160854238","cluster_addr":"172.21.15.122:6827/4160854238","heartbeat_back_addr":"172.21.15.122:6831/4160854238","heartbeat_front_addr":"172.21.15.122:6829/4160854238","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:16:46.989554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:17:11.269759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:17:35.105846+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:00.940943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:26.284520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:51.064143+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:19:16.254750+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:19:42.841380+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:20:08.185133+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:20:34.700082+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:21:01.485278+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:21:27.938715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1311987652":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/1149897118":"2024-06-07T03:15:13.252241+0000","172.21.15.50:6800/2617801068":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/1068038293":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/4038080419":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/149912088":"2024-06-07T03:14:46.388744+0000","172.21.15.50:6801/2617801068":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/2963887224":"2024-06-07T03:14:46.388744+0000","172.21.15.50:6801/1311987652":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/2554563139":"2024-06-07T03:15:13.252241+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T03:24:17.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.318+0000 7f0f6f85f700 1 -- 172.21.15.50:0/668728690 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f0f540a2cb0 msgr2=0x7f0f540a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:17.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.318+0000 7f0f6f85f700 1 --2- 172.21.15.50:0/668728690 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f0f540a2cb0 0x7f0f540a5170 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0f64005950 tx=0x7f0f640058e0 comp rx=0 tx=0).stop 2024-06-06T03:24:17.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.318+0000 7f0f6f85f700 1 -- 172.21.15.50:0/668728690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f6810ee90 msgr2=0x7f0f6819aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:17.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.318+0000 7f0f6f85f700 1 --2- 172.21.15.50:0/668728690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f6810ee90 0x7f0f6819aaf0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0f60007d40 tx=0x7f0f6000a340 comp rx=0 tx=0).stop 2024-06-06T03:24:17.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.318+0000 7f0f6f85f700 1 -- 172.21.15.50:0/668728690 shutdown_connections 2024-06-06T03:24:17.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.318+0000 7f0f6f85f700 1 --2- 172.21.15.50:0/668728690 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f0f540a2cb0 0x7f0f540a5170 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:17.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.318+0000 7f0f6f85f700 1 --2- 172.21.15.50:0/668728690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f6810ee90 0x7f0f6819aaf0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:17.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.318+0000 7f0f6f85f700 1 --2- 172.21.15.50:0/668728690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f680746c0 0x7f0f681a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:17.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.318+0000 7f0f6f85f700 1 --2- 172.21.15.50:0/668728690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f68074fe0 0x7f0f681a0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:17.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.318+0000 7f0f6f85f700 1 -- 172.21.15.50:0/668728690 >> 172.21.15.50:0/668728690 conn(0x7f0f680795f0 msgr2=0x7f0f68100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:17.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.318+0000 7f0f6f85f700 1 -- 172.21.15.50:0/668728690 shutdown_connections 2024-06-06T03:24:17.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:17.318+0000 7f0f6f85f700 1 -- 172.21.15.50:0/668728690 wait complete. 2024-06-06T03:24:17.954 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:17 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/668728690' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:24:17.985 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-06-06T03:24:17.985 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-06-06T03:24:17.986 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-06-06T03:24:17.986 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-06-06T03:24:17.987 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-06-06T03:24:17.987 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-06-06T03:24:17.987 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-06-06T03:24:17.988 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-06-06T03:24:17.988 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-06-06T03:24:17.989 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-06-06T03:24:17.989 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-06-06T03:24:17.989 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-06-06T03:24:18.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:17 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/668728690' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:24:18.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:17 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/668728690' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:24:18.781 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:24:18.781 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:24:18.789 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:24:18.791 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:24:18.793 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:24:18.794 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:24:18.795 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:24:18.797 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:24:18.799 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:24:18.804 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:24:18.811 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:24:18.833 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:24:18.961 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:18 smithi050 ceph-mon[32421]: pgmap v361: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-06-06T03:24:19.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:18 smithi079 ceph-mon[35478]: pgmap v361: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-06-06T03:24:19.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:18 smithi122 ceph-mon[35759]: pgmap v361: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-06-06T03:24:21.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:20 smithi050 ceph-mon[32421]: pgmap v362: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:24:21.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:20 smithi079 ceph-mon[35478]: pgmap v362: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:24:21.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:20 smithi122 ceph-mon[35759]: pgmap v362: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:24:22.913 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:22 smithi050 ceph-mon[32421]: pgmap v363: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:24:23.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:22 smithi079 ceph-mon[35478]: pgmap v363: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:24:23.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:22 smithi122 ceph-mon[35759]: pgmap v363: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:24:24.986 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:24 smithi050 ceph-mon[32421]: pgmap v364: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-06-06T03:24:25.102 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:24 smithi079 ceph-mon[35478]: pgmap v364: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-06-06T03:24:25.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:24 smithi122 ceph-mon[35759]: pgmap v364: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-06-06T03:24:27.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:26 smithi050 ceph-mon[32421]: pgmap v365: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-06-06T03:24:27.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:26 smithi079 ceph-mon[35478]: pgmap v365: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-06-06T03:24:27.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:26 smithi122 ceph-mon[35759]: pgmap v365: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-06-06T03:24:28.972 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:28 smithi050 ceph-mon[32421]: pgmap v366: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:24:28.983 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:28 smithi122 ceph-mon[35759]: pgmap v366: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:24:29.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:28 smithi079 ceph-mon[35478]: pgmap v366: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:24:29.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.744+0000 7fd0bab06700 1 -- 172.21.15.50:0/1357129240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0b4106ac0 msgr2=0x7fd0b4106ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:29.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.744+0000 7fd0bab06700 1 --2- 172.21.15.50:0/1357129240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0b4106ac0 0x7fd0b4106ea0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd0a400b0a0 tx=0x7fd0a400b3b0 comp rx=0 tx=0).stop 2024-06-06T03:24:29.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.744+0000 7fd0bab06700 1 -- 172.21.15.50:0/1357129240 shutdown_connections 2024-06-06T03:24:29.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.744+0000 7fd0bab06700 1 --2- 172.21.15.50:0/1357129240 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0b4101480 0x7fd0b410d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:29.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.744+0000 7fd0bab06700 1 --2- 172.21.15.50:0/1357129240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0b4106ac0 0x7fd0b4106ea0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:29.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.744+0000 7fd0bab06700 1 --2- 172.21.15.50:0/1357129240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0b4100ac0 0x7fd0b4100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:29.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.744+0000 7fd0bab06700 1 -- 172.21.15.50:0/1357129240 >> 172.21.15.50:0/1357129240 conn(0x7fd0b4077a00 msgr2=0x7fd0b40fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:29.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.744+0000 7fd0bab06700 1 -- 172.21.15.50:0/1357129240 shutdown_connections 2024-06-06T03:24:29.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.744+0000 7fd0bab06700 1 -- 172.21.15.50:0/1357129240 wait complete. 2024-06-06T03:24:29.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.745+0000 7fd0bab06700 1 Processor -- start 2024-06-06T03:24:29.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.745+0000 7fd0bab06700 1 -- start start 2024-06-06T03:24:29.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.745+0000 7fd0bab06700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0b4100ac0 0x7fd0b419e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:29.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.745+0000 7fd0bab06700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0b4101480 0x7fd0b419ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:29.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.745+0000 7fd0bab06700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0b4106ac0 0x7fd0b4198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:29.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.745+0000 7fd0bab06700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b4110d00 con 0x7fd0b4100ac0 2024-06-06T03:24:29.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.745+0000 7fd0bab06700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b4110b80 con 0x7fd0b4106ac0 2024-06-06T03:24:29.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.745+0000 7fd0bab06700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b4110e80 con 0x7fd0b4101480 2024-06-06T03:24:29.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.745+0000 7fd0b88a2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0b4100ac0 0x7fd0b419e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:29.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.745+0000 7fd0b88a2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0b4100ac0 0x7fd0b419e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59434/0 (socket says 172.21.15.50:59434) 2024-06-06T03:24:29.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.746+0000 7fd0b88a2700 1 -- 172.21.15.50:0/823956434 learned_addr learned my addr 172.21.15.50:0/823956434 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:24:29.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.746+0000 7fd0b90a3700 1 --2- 172.21.15.50:0/823956434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0b4106ac0 0x7fd0b4198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:29.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.746+0000 7fd0b88a2700 1 -- 172.21.15.50:0/823956434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0b4101480 msgr2=0x7fd0b419ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:29.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.746+0000 7fd0b3fff700 1 --2- 172.21.15.50:0/823956434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0b4101480 0x7fd0b419ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:29.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.746+0000 7fd0b88a2700 1 --2- 172.21.15.50:0/823956434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0b4101480 0x7fd0b419ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:29.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.746+0000 7fd0b88a2700 1 -- 172.21.15.50:0/823956434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0b4106ac0 msgr2=0x7fd0b4198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:29.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.746+0000 7fd0b88a2700 1 --2- 172.21.15.50:0/823956434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0b4106ac0 0x7fd0b4198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:29.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.746+0000 7fd0b88a2700 1 -- 172.21.15.50:0/823956434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0b4199170 con 0x7fd0b4100ac0 2024-06-06T03:24:29.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.746+0000 7fd0b90a3700 1 --2- 172.21.15.50:0/823956434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0b4106ac0 0x7fd0b4198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:24:29.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.746+0000 7fd0b88a2700 1 --2- 172.21.15.50:0/823956434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0b4100ac0 0x7fd0b419e850 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4006070 tx=0x7fd0a4004ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:29.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.746+0000 7fd0b1ffb700 1 -- 172.21.15.50:0/823956434 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4021070 con 0x7fd0b4100ac0 2024-06-06T03:24:29.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.746+0000 7fd0b1ffb700 1 -- 172.21.15.50:0/823956434 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd0a4007df0 con 0x7fd0b4100ac0 2024-06-06T03:24:29.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.746+0000 7fd0bab06700 1 -- 172.21.15.50:0/823956434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0b4199400 con 0x7fd0b4100ac0 2024-06-06T03:24:29.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.746+0000 7fd0b1ffb700 1 -- 172.21.15.50:0/823956434 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a401d450 con 0x7fd0b4100ac0 2024-06-06T03:24:29.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.746+0000 7fd0bab06700 1 -- 172.21.15.50:0/823956434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0b41a5720 con 0x7fd0b4100ac0 2024-06-06T03:24:29.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.747+0000 7fd0bab06700 1 -- 172.21.15.50:0/823956434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd0b40ff990 con 0x7fd0b4100ac0 2024-06-06T03:24:29.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.749+0000 7fd0b1ffb700 1 -- 172.21.15.50:0/823956434 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd0a4004140 con 0x7fd0b4100ac0 2024-06-06T03:24:29.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.749+0000 7fd0b1ffb700 1 --2- 172.21.15.50:0/823956434 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd0a00a2d30 0x7fd0a00a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:29.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.749+0000 7fd0b1ffb700 1 -- 172.21.15.50:0/823956434 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fd0a400f020 con 0x7fd0b4100ac0 2024-06-06T03:24:29.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.749+0000 7fd0b3fff700 1 --2- 172.21.15.50:0/823956434 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd0a00a2d30 0x7fd0a00a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:29.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.750+0000 7fd0b1ffb700 1 --2- 172.21.15.50:0/823956434 >> [v2:172.21.15.50:6810/820123083,v1:172.21.15.50:6811/820123083] conn(0x7fd0a00adf10 0x7fd0a00b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:29.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.750+0000 7fd0b1ffb700 1 -- 172.21.15.50:0/823956434 --> [v2:172.21.15.50:6810/820123083,v1:172.21.15.50:6811/820123083] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd0a401ae50 con 0x7fd0a00adf10 2024-06-06T03:24:29.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.750+0000 7fd0b1ffb700 1 -- 172.21.15.50:0/823956434 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7fd0a40d1240 con 0x7fd0b4100ac0 2024-06-06T03:24:29.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.750+0000 7fd0b90a3700 1 --2- 172.21.15.50:0/823956434 >> [v2:172.21.15.50:6810/820123083,v1:172.21.15.50:6811/820123083] conn(0x7fd0a00adf10 0x7fd0a00b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:29.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.750+0000 7fd0b3fff700 1 --2- 172.21.15.50:0/823956434 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd0a00a2d30 0x7fd0a00a51f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4104aa0 tx=0x7fd09c005cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:29.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.750+0000 7fd0b90a3700 1 --2- 172.21.15.50:0/823956434 >> [v2:172.21.15.50:6810/820123083,v1:172.21.15.50:6811/820123083] conn(0x7fd0a00adf10 0x7fd0a00b03b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:29.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.751+0000 7fd0b1ffb700 1 -- 172.21.15.50:0/823956434 <== osd.3 v2:172.21.15.50:6810/820123083 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd0a401ae50 con 0x7fd0a00adf10 2024-06-06T03:24:29.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.767+0000 7fd0bab06700 1 -- 172.21.15.50:0/823956434 --> [v2:172.21.15.50:6810/820123083,v1:172.21.15.50:6811/820123083] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd0b4102200 con 0x7fd0a00adf10 2024-06-06T03:24:29.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.767+0000 7fd0b1ffb700 1 -- 172.21.15.50:0/823956434 <== osd.3 v2:172.21.15.50:6810/820123083 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd0b4102200 con 0x7fd0a00adf10 2024-06-06T03:24:29.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.768+0000 7fd0bab06700 1 -- 172.21.15.50:0/823956434 >> [v2:172.21.15.50:6810/820123083,v1:172.21.15.50:6811/820123083] conn(0x7fd0a00adf10 msgr2=0x7fd0a00b03b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:29.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.768+0000 7fd0bab06700 1 --2- 172.21.15.50:0/823956434 >> [v2:172.21.15.50:6810/820123083,v1:172.21.15.50:6811/820123083] conn(0x7fd0a00adf10 0x7fd0a00b03b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:29.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.768+0000 7fd0bab06700 1 -- 172.21.15.50:0/823956434 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd0a00a2d30 msgr2=0x7fd0a00a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:29.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.768+0000 7fd0bab06700 1 --2- 172.21.15.50:0/823956434 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd0a00a2d30 0x7fd0a00a51f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4104aa0 tx=0x7fd09c005cf0 comp rx=0 tx=0).stop 2024-06-06T03:24:29.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.768+0000 7fd0bab06700 1 -- 172.21.15.50:0/823956434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0b4100ac0 msgr2=0x7fd0b419e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:29.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.768+0000 7fd0bab06700 1 --2- 172.21.15.50:0/823956434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0b4100ac0 0x7fd0b419e850 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4006070 tx=0x7fd0a4004ef0 comp rx=0 tx=0).stop 2024-06-06T03:24:29.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.768+0000 7fd0b90a3700 1 -- 172.21.15.50:0/823956434 reap_dead start 2024-06-06T03:24:29.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.768+0000 7fd0bab06700 1 -- 172.21.15.50:0/823956434 shutdown_connections 2024-06-06T03:24:29.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.768+0000 7fd0bab06700 1 -- 172.21.15.50:0/823956434 >> 172.21.15.50:0/823956434 conn(0x7fd0b4077a00 msgr2=0x7fd0b40fefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:29.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.768+0000 7fd0bab06700 1 -- 172.21.15.50:0/823956434 shutdown_connections 2024-06-06T03:24:29.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:26.768+0000 7fd0bab06700 1 -- 172.21.15.50:0/823956434 wait complete. 2024-06-06T03:24:30.603 INFO:teuthology.orchestra.run.smithi050.stdout:107374182479 2024-06-06T03:24:30.603 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-06-06T03:24:31.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:30 smithi050 ceph-mon[32421]: pgmap v367: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:24:31.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:30 smithi079 ceph-mon[35478]: pgmap v367: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:24:31.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:30 smithi122 ceph-mon[35759]: pgmap v367: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:24:31.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.577+0000 7f1524560700 1 -- 172.21.15.50:0/3434100534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f151c1030f0 msgr2=0x7f151c107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:31.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.577+0000 7f1524560700 1 --2- 172.21.15.50:0/3434100534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f151c1030f0 0x7f151c107110 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f150c0099c0 tx=0x7f150c009cd0 comp rx=0 tx=0).stop 2024-06-06T03:24:31.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.577+0000 7f1524560700 1 -- 172.21.15.50:0/3434100534 shutdown_connections 2024-06-06T03:24:31.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.577+0000 7f1524560700 1 --2- 172.21.15.50:0/3434100534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f151c107840 0x7f151c10f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:31.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.577+0000 7f1524560700 1 --2- 172.21.15.50:0/3434100534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f151c102740 0x7f151c102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:31.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.577+0000 7f1524560700 1 --2- 172.21.15.50:0/3434100534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f151c1030f0 0x7f151c107110 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:31.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.577+0000 7f1524560700 1 -- 172.21.15.50:0/3434100534 >> 172.21.15.50:0/3434100534 conn(0x7f151c0795f0 msgr2=0x7f151c079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:31.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.577+0000 7f1524560700 1 -- 172.21.15.50:0/3434100534 shutdown_connections 2024-06-06T03:24:31.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.577+0000 7f1524560700 1 -- 172.21.15.50:0/3434100534 wait complete. 2024-06-06T03:24:31.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.578+0000 7f1524560700 1 Processor -- start 2024-06-06T03:24:31.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.578+0000 7f1524560700 1 -- start start 2024-06-06T03:24:31.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.578+0000 7f1524560700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f151c102740 0x7f151c19e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:31.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.578+0000 7f1524560700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f151c1030f0 0x7f151c19ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:31.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.578+0000 7f1524560700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f151c107840 0x7f151c198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:31.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.578+0000 7f1524560700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f151c112600 con 0x7f151c102740 2024-06-06T03:24:31.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.578+0000 7f1524560700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f151c112480 con 0x7f151c107840 2024-06-06T03:24:31.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.578+0000 7f1524560700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f151c112780 con 0x7f151c1030f0 2024-06-06T03:24:31.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.578+0000 7f15222fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f151c102740 0x7f151c19e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:31.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.578+0000 7f15222fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f151c102740 0x7f151c19e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35408/0 (socket says 172.21.15.50:35408) 2024-06-06T03:24:31.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.578+0000 7f15222fc700 1 -- 172.21.15.50:0/234345934 learned_addr learned my addr 172.21.15.50:0/234345934 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:24:31.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.578+0000 7f1521afb700 1 --2- 172.21.15.50:0/234345934 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f151c1030f0 0x7f151c19ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:31.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.578+0000 7f1522afd700 1 --2- 172.21.15.50:0/234345934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f151c107840 0x7f151c198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:31.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.579+0000 7f15222fc700 1 -- 172.21.15.50:0/234345934 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f151c1030f0 msgr2=0x7f151c19ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:31.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.579+0000 7f15222fc700 1 --2- 172.21.15.50:0/234345934 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f151c1030f0 0x7f151c19ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:31.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.579+0000 7f15222fc700 1 -- 172.21.15.50:0/234345934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f151c107840 msgr2=0x7f151c198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:31.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.579+0000 7f15222fc700 1 --2- 172.21.15.50:0/234345934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f151c107840 0x7f151c198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:31.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.579+0000 7f15222fc700 1 -- 172.21.15.50:0/234345934 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f151c198fe0 con 0x7f151c102740 2024-06-06T03:24:31.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.579+0000 7f15222fc700 1 --2- 172.21.15.50:0/234345934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f151c102740 0x7f151c19e6c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f151800c9b0 tx=0x7f151800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:31.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.579+0000 7f15137fe700 1 -- 172.21.15.50:0/234345934 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1518007b00 con 0x7f151c102740 2024-06-06T03:24:31.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.579+0000 7f15137fe700 1 -- 172.21.15.50:0/234345934 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f151800ce50 con 0x7f151c102740 2024-06-06T03:24:31.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.579+0000 7f1524560700 1 -- 172.21.15.50:0/234345934 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f151c1992d0 con 0x7f151c102740 2024-06-06T03:24:31.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.579+0000 7f15137fe700 1 -- 172.21.15.50:0/234345934 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1518018660 con 0x7f151c102740 2024-06-06T03:24:31.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.579+0000 7f1524560700 1 -- 172.21.15.50:0/234345934 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f151c0746c0 con 0x7f151c102740 2024-06-06T03:24:31.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.580+0000 7f1524560700 1 -- 172.21.15.50:0/234345934 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f151c062ba0 con 0x7f151c102740 2024-06-06T03:24:31.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.581+0000 7f15137fe700 1 -- 172.21.15.50:0/234345934 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f151800f450 con 0x7f151c102740 2024-06-06T03:24:31.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.582+0000 7f15137fe700 1 --2- 172.21.15.50:0/234345934 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f15080a2cb0 0x7f15080a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:31.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.582+0000 7f1521afb700 1 --2- 172.21.15.50:0/234345934 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f15080a2cb0 0x7f15080a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:31.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.582+0000 7f15137fe700 1 -- 172.21.15.50:0/234345934 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f15180cf8d0 con 0x7f151c102740 2024-06-06T03:24:31.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.582+0000 7f15137fe700 1 --2- 172.21.15.50:0/234345934 >> [v2:172.21.15.50:6818/474595612,v1:172.21.15.50:6819/474595612] conn(0x7f15080ade90 0x7f15080b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:31.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.582+0000 7f15137fe700 1 -- 172.21.15.50:0/234345934 --> [v2:172.21.15.50:6818/474595612,v1:172.21.15.50:6819/474595612] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1518015e70 con 0x7f15080ade90 2024-06-06T03:24:31.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.582+0000 7f15137fe700 1 -- 172.21.15.50:0/234345934 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7f15180cfc80 con 0x7f151c102740 2024-06-06T03:24:31.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.583+0000 7f1522afd700 1 --2- 172.21.15.50:0/234345934 >> [v2:172.21.15.50:6818/474595612,v1:172.21.15.50:6819/474595612] conn(0x7f15080ade90 0x7f15080b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:31.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.583+0000 7f1521afb700 1 --2- 172.21.15.50:0/234345934 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f15080a2cb0 0x7f15080a5170 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f151c1070e0 tx=0x7f150c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:31.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.583+0000 7f1522afd700 1 --2- 172.21.15.50:0/234345934 >> [v2:172.21.15.50:6818/474595612,v1:172.21.15.50:6819/474595612] conn(0x7f15080ade90 0x7f15080b0330 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:31.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.584+0000 7f15137fe700 1 -- 172.21.15.50:0/234345934 <== osd.6 v2:172.21.15.50:6818/474595612 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1518015e70 con 0x7f15080ade90 2024-06-06T03:24:31.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.600+0000 7f1524560700 1 -- 172.21.15.50:0/234345934 --> [v2:172.21.15.50:6818/474595612,v1:172.21.15.50:6819/474595612] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f151c063020 con 0x7f15080ade90 2024-06-06T03:24:31.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.601+0000 7f15137fe700 1 -- 172.21.15.50:0/234345934 <== osd.6 v2:172.21.15.50:6818/474595612 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f151c063020 con 0x7f15080ade90 2024-06-06T03:24:31.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.601+0000 7f1524560700 1 -- 172.21.15.50:0/234345934 >> [v2:172.21.15.50:6818/474595612,v1:172.21.15.50:6819/474595612] conn(0x7f15080ade90 msgr2=0x7f15080b0330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:31.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.601+0000 7f1524560700 1 --2- 172.21.15.50:0/234345934 >> [v2:172.21.15.50:6818/474595612,v1:172.21.15.50:6819/474595612] conn(0x7f15080ade90 0x7f15080b0330 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:31.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.601+0000 7f1524560700 1 -- 172.21.15.50:0/234345934 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f15080a2cb0 msgr2=0x7f15080a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:31.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.601+0000 7f1524560700 1 --2- 172.21.15.50:0/234345934 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f15080a2cb0 0x7f15080a5170 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f151c1070e0 tx=0x7f150c005fb0 comp rx=0 tx=0).stop 2024-06-06T03:24:31.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.601+0000 7f1524560700 1 -- 172.21.15.50:0/234345934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f151c102740 msgr2=0x7f151c19e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:31.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.601+0000 7f1524560700 1 --2- 172.21.15.50:0/234345934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f151c102740 0x7f151c19e6c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f151800c9b0 tx=0x7f151800ccc0 comp rx=0 tx=0).stop 2024-06-06T03:24:31.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.601+0000 7f1522afd700 1 -- 172.21.15.50:0/234345934 reap_dead start 2024-06-06T03:24:31.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.601+0000 7f1524560700 1 -- 172.21.15.50:0/234345934 shutdown_connections 2024-06-06T03:24:31.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.601+0000 7f1524560700 1 -- 172.21.15.50:0/234345934 >> 172.21.15.50:0/234345934 conn(0x7f151c0795f0 msgr2=0x7f151c100510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:31.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.601+0000 7f1524560700 1 -- 172.21.15.50:0/234345934 shutdown_connections 2024-06-06T03:24:31.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:31.601+0000 7f1524560700 1 -- 172.21.15.50:0/234345934 wait complete. 2024-06-06T03:24:32.854 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:32 smithi050 ceph-mon[32421]: pgmap v368: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:24:32.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.855+0000 7f82cb192700 1 -- 172.21.15.50:0/543147199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82c4101620 msgr2=0x7f82c4101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:32.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.855+0000 7f82cb192700 1 --2- 172.21.15.50:0/543147199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82c4101620 0x7f82c4101a00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f82b80099c0 tx=0x7f82b8009cd0 comp rx=0 tx=0).stop 2024-06-06T03:24:32.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.855+0000 7f82cb192700 1 -- 172.21.15.50:0/543147199 shutdown_connections 2024-06-06T03:24:32.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.855+0000 7f82cb192700 1 --2- 172.21.15.50:0/543147199 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82c41066b0 0x7f82c410e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:32.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.855+0000 7f82cb192700 1 --2- 172.21.15.50:0/543147199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82c4101620 0x7f82c4101a00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:32.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.855+0000 7f82cb192700 1 --2- 172.21.15.50:0/543147199 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82c4101fd0 0x7f82c4105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:32.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.855+0000 7f82cb192700 1 -- 172.21.15.50:0/543147199 >> 172.21.15.50:0/543147199 conn(0x7f82c4078340 msgr2=0x7f82c4078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:32.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.855+0000 7f82cb192700 1 -- 172.21.15.50:0/543147199 shutdown_connections 2024-06-06T03:24:32.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.855+0000 7f82cb192700 1 -- 172.21.15.50:0/543147199 wait complete. 2024-06-06T03:24:32.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.855+0000 7f82cb192700 1 Processor -- start 2024-06-06T03:24:32.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.855+0000 7f82cb192700 1 -- start start 2024-06-06T03:24:32.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.856+0000 7f82cb192700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82c4101620 0x7f82c419e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:32.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.856+0000 7f82cb192700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82c4101fd0 0x7f82c419ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:32.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.856+0000 7f82cb192700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82c41066b0 0x7f82c4198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:32.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.856+0000 7f82cb192700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f82c4111560 con 0x7f82c4101fd0 2024-06-06T03:24:32.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.856+0000 7f82cb192700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f82c41113e0 con 0x7f82c41066b0 2024-06-06T03:24:32.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.856+0000 7f82cb192700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f82c41116e0 con 0x7f82c4101620 2024-06-06T03:24:32.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.856+0000 7f82c3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82c4101fd0 0x7f82c419ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:32.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.856+0000 7f82c3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82c4101fd0 0x7f82c419ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35438/0 (socket says 172.21.15.50:35438) 2024-06-06T03:24:32.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.856+0000 7f82c3fff700 1 -- 172.21.15.50:0/1548873279 learned_addr learned my addr 172.21.15.50:0/1548873279 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:24:32.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.856+0000 7f82c8f2e700 1 --2- 172.21.15.50:0/1548873279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82c4101620 0x7f82c419e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:32.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.856+0000 7f82c972f700 1 --2- 172.21.15.50:0/1548873279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82c41066b0 0x7f82c4198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:32.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.856+0000 7f82c3fff700 1 -- 172.21.15.50:0/1548873279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82c4101620 msgr2=0x7f82c419e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:32.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.856+0000 7f82c3fff700 1 --2- 172.21.15.50:0/1548873279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82c4101620 0x7f82c419e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:32.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.856+0000 7f82c3fff700 1 -- 172.21.15.50:0/1548873279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82c41066b0 msgr2=0x7f82c4198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:32.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.856+0000 7f82c3fff700 1 --2- 172.21.15.50:0/1548873279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82c41066b0 0x7f82c4198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:32.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.856+0000 7f82c3fff700 1 -- 172.21.15.50:0/1548873279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c4199170 con 0x7f82c4101fd0 2024-06-06T03:24:32.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.856+0000 7f82c3fff700 1 --2- 172.21.15.50:0/1548873279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82c4101fd0 0x7f82c419ed90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f82b000d950 tx=0x7f82b000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:32.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.856+0000 7f82c1ffb700 1 -- 172.21.15.50:0/1548873279 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b0017070 con 0x7f82c4101fd0 2024-06-06T03:24:32.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.857+0000 7f82c1ffb700 1 -- 172.21.15.50:0/1548873279 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f82b0005020 con 0x7f82c4101fd0 2024-06-06T03:24:32.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.857+0000 7f82cb192700 1 -- 172.21.15.50:0/1548873279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82c4199460 con 0x7f82c4101fd0 2024-06-06T03:24:32.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.857+0000 7f82c1ffb700 1 -- 172.21.15.50:0/1548873279 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b000fa90 con 0x7f82c4101fd0 2024-06-06T03:24:32.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.857+0000 7f82cb192700 1 -- 172.21.15.50:0/1548873279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82c41a5720 con 0x7f82c4101fd0 2024-06-06T03:24:32.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.858+0000 7f82cb192700 1 -- 172.21.15.50:0/1548873279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f82c4062c20 con 0x7f82c4101fd0 2024-06-06T03:24:32.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.859+0000 7f82c1ffb700 1 -- 172.21.15.50:0/1548873279 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f82b00051d0 con 0x7f82c4101fd0 2024-06-06T03:24:32.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.860+0000 7f82c1ffb700 1 --2- 172.21.15.50:0/1548873279 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f82b40a2d30 0x7f82b40a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:32.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.860+0000 7f82c8f2e700 1 --2- 172.21.15.50:0/1548873279 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f82b40a2d30 0x7f82b40a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:32.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.860+0000 7f82c1ffb700 1 -- 172.21.15.50:0/1548873279 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f82b00cf030 con 0x7f82c4101fd0 2024-06-06T03:24:32.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.860+0000 7f82c1ffb700 1 --2- 172.21.15.50:0/1548873279 >> [v2:172.21.15.79:6800/3498354151,v1:172.21.15.79:6801/3498354151] conn(0x7f82b40adf10 0x7f82b40b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:32.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.860+0000 7f82c1ffb700 1 -- 172.21.15.50:0/1548873279 --> [v2:172.21.15.79:6800/3498354151,v1:172.21.15.79:6801/3498354151] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f82b00044e0 con 0x7f82b40adf10 2024-06-06T03:24:32.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.860+0000 7f82c1ffb700 1 -- 172.21.15.50:0/1548873279 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7f82b00cf480 con 0x7f82c4101fd0 2024-06-06T03:24:32.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.860+0000 7f82c8f2e700 1 --2- 172.21.15.50:0/1548873279 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f82b40a2d30 0x7f82b40a51f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f82b8000c00 tx=0x7f82b8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:32.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.860+0000 7f82c972f700 1 --2- 172.21.15.50:0/1548873279 >> [v2:172.21.15.79:6800/3498354151,v1:172.21.15.79:6801/3498354151] conn(0x7f82b40adf10 0x7f82b40b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:32.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.861+0000 7f82c972f700 1 --2- 172.21.15.50:0/1548873279 >> [v2:172.21.15.79:6800/3498354151,v1:172.21.15.79:6801/3498354151] conn(0x7f82b40adf10 0x7f82b40b03b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:32.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.861+0000 7f82c1ffb700 1 -- 172.21.15.50:0/1548873279 <== osd.1 v2:172.21.15.79:6800/3498354151 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f82b00044e0 con 0x7f82b40adf10 2024-06-06T03:24:32.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.878+0000 7f82cb192700 1 -- 172.21.15.50:0/1548873279 --> [v2:172.21.15.79:6800/3498354151,v1:172.21.15.79:6801/3498354151] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f82c40630a0 con 0x7f82b40adf10 2024-06-06T03:24:32.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.878+0000 7f82c1ffb700 1 -- 172.21.15.50:0/1548873279 <== osd.1 v2:172.21.15.79:6800/3498354151 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f82c40630a0 con 0x7f82b40adf10 2024-06-06T03:24:32.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.879+0000 7f82cb192700 1 -- 172.21.15.50:0/1548873279 >> [v2:172.21.15.79:6800/3498354151,v1:172.21.15.79:6801/3498354151] conn(0x7f82b40adf10 msgr2=0x7f82b40b03b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:32.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.879+0000 7f82cb192700 1 --2- 172.21.15.50:0/1548873279 >> [v2:172.21.15.79:6800/3498354151,v1:172.21.15.79:6801/3498354151] conn(0x7f82b40adf10 0x7f82b40b03b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:32.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.879+0000 7f82cb192700 1 -- 172.21.15.50:0/1548873279 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f82b40a2d30 msgr2=0x7f82b40a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:32.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.879+0000 7f82cb192700 1 --2- 172.21.15.50:0/1548873279 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f82b40a2d30 0x7f82b40a51f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f82b8000c00 tx=0x7f82b8005fb0 comp rx=0 tx=0).stop 2024-06-06T03:24:32.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.879+0000 7f82cb192700 1 -- 172.21.15.50:0/1548873279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82c4101fd0 msgr2=0x7f82c419ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:32.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.879+0000 7f82cb192700 1 --2- 172.21.15.50:0/1548873279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82c4101fd0 0x7f82c419ed90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f82b000d950 tx=0x7f82b000dc60 comp rx=0 tx=0).stop 2024-06-06T03:24:32.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.879+0000 7f82c972f700 1 -- 172.21.15.50:0/1548873279 reap_dead start 2024-06-06T03:24:32.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.879+0000 7f82cb192700 1 -- 172.21.15.50:0/1548873279 shutdown_connections 2024-06-06T03:24:32.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.879+0000 7f82cb192700 1 -- 172.21.15.50:0/1548873279 >> 172.21.15.50:0/1548873279 conn(0x7f82c4078340 msgr2=0x7f82c406b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:32.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.879+0000 7f82cb192700 1 -- 172.21.15.50:0/1548873279 shutdown_connections 2024-06-06T03:24:32.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:32.879+0000 7f82cb192700 1 -- 172.21.15.50:0/1548873279 wait complete. 2024-06-06T03:24:33.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:32 smithi079 ceph-mon[35478]: pgmap v368: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:24:33.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:32 smithi122 ceph-mon[35759]: pgmap v368: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:24:33.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.614+0000 7faae828c700 1 -- 172.21.15.50:0/1404086779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faae006ac00 msgr2=0x7faae006b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:33.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.614+0000 7faae828c700 1 --2- 172.21.15.50:0/1404086779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faae006ac00 0x7faae006b080 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7faad0009990 tx=0x7faad0009ca0 comp rx=0 tx=0).stop 2024-06-06T03:24:33.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.614+0000 7faae828c700 1 -- 172.21.15.50:0/1404086779 shutdown_connections 2024-06-06T03:24:33.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.614+0000 7faae828c700 1 --2- 172.21.15.50:0/1404086779 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faae006b5c0 0x7faae010f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:33.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.614+0000 7faae828c700 1 --2- 172.21.15.50:0/1404086779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faae0108500 0x7faae01088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:33.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.614+0000 7faae828c700 1 --2- 172.21.15.50:0/1404086779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faae006ac00 0x7faae006b080 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:33.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.614+0000 7faae828c700 1 -- 172.21.15.50:0/1404086779 >> 172.21.15.50:0/1404086779 conn(0x7faae0078340 msgr2=0x7faae0078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:33.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.614+0000 7faae828c700 1 -- 172.21.15.50:0/1404086779 shutdown_connections 2024-06-06T03:24:33.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.614+0000 7faae828c700 1 -- 172.21.15.50:0/1404086779 wait complete. 2024-06-06T03:24:33.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.614+0000 7faae828c700 1 Processor -- start 2024-06-06T03:24:33.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.615+0000 7faae828c700 1 -- start start 2024-06-06T03:24:33.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.615+0000 7faae828c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faae006ac00 0x7faae019ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:33.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.615+0000 7faae828c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faae006b5c0 0x7faae019b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:33.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.615+0000 7faae828c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faae0108500 0x7faae019f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:33.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.615+0000 7faae828c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7faae0112610 con 0x7faae006ac00 2024-06-06T03:24:33.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.615+0000 7faae828c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faae0112490 con 0x7faae0108500 2024-06-06T03:24:33.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.615+0000 7faae828c700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7faae0112790 con 0x7faae006b5c0 2024-06-06T03:24:33.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.615+0000 7faae6028700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faae006ac00 0x7faae019ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:33.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.615+0000 7faae6028700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faae006ac00 0x7faae019ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35472/0 (socket says 172.21.15.50:35472) 2024-06-06T03:24:33.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.615+0000 7faae6028700 1 -- 172.21.15.50:0/1507536925 learned_addr learned my addr 172.21.15.50:0/1507536925 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:24:33.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.615+0000 7faae5827700 1 --2- 172.21.15.50:0/1507536925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faae006b5c0 0x7faae019b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:33.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.615+0000 7faae6829700 1 --2- 172.21.15.50:0/1507536925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faae0108500 0x7faae019f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:33.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.615+0000 7faae6028700 1 -- 172.21.15.50:0/1507536925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faae006b5c0 msgr2=0x7faae019b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:33.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.615+0000 7faae6028700 1 --2- 172.21.15.50:0/1507536925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faae006b5c0 0x7faae019b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:33.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.615+0000 7faae6028700 1 -- 172.21.15.50:0/1507536925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faae0108500 msgr2=0x7faae019f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:33.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.615+0000 7faae6028700 1 --2- 172.21.15.50:0/1507536925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faae0108500 0x7faae019f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:33.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.615+0000 7faae6028700 1 -- 172.21.15.50:0/1507536925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae019fd70 con 0x7faae006ac00 2024-06-06T03:24:33.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.615+0000 7faae6028700 1 --2- 172.21.15.50:0/1507536925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faae006ac00 0x7faae019ad60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faadc00d950 tx=0x7faadc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:33.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.616+0000 7faad77fe700 1 -- 172.21.15.50:0/1507536925 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faadc016070 con 0x7faae006ac00 2024-06-06T03:24:33.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.616+0000 7faad77fe700 1 -- 172.21.15.50:0/1507536925 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faadc009df0 con 0x7faae006ac00 2024-06-06T03:24:33.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.616+0000 7faad77fe700 1 -- 172.21.15.50:0/1507536925 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faadc00f3c0 con 0x7faae006ac00 2024-06-06T03:24:33.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.616+0000 7faae828c700 1 -- 172.21.15.50:0/1507536925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faae01a0060 con 0x7faae006ac00 2024-06-06T03:24:33.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.616+0000 7faae828c700 1 -- 172.21.15.50:0/1507536925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faae01a78e0 con 0x7faae006ac00 2024-06-06T03:24:33.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.616+0000 7faae828c700 1 -- 172.21.15.50:0/1507536925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faae010e070 con 0x7faae006ac00 2024-06-06T03:24:33.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.618+0000 7faad77fe700 1 -- 172.21.15.50:0/1507536925 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7faadc019070 con 0x7faae006ac00 2024-06-06T03:24:33.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.618+0000 7faad77fe700 1 --2- 172.21.15.50:0/1507536925 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7faacc0a2cb0 0x7faacc0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:33.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.619+0000 7faae5827700 1 --2- 172.21.15.50:0/1507536925 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7faacc0a2cb0 0x7faacc0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:33.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.619+0000 7faad77fe700 1 -- 172.21.15.50:0/1507536925 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7faadc0cf5e0 con 0x7faae006ac00 2024-06-06T03:24:33.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.619+0000 7faad77fe700 1 --2- 172.21.15.50:0/1507536925 >> [v2:172.21.15.79:6808/1784117997,v1:172.21.15.79:6809/1784117997] conn(0x7faacc0ade90 0x7faacc0b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:33.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.619+0000 7faad77fe700 1 -- 172.21.15.50:0/1507536925 --> [v2:172.21.15.79:6808/1784117997,v1:172.21.15.79:6809/1784117997] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faadc024ea0 con 0x7faacc0ade90 2024-06-06T03:24:33.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.619+0000 7faad77fe700 1 -- 172.21.15.50:0/1507536925 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7faadc0cfa30 con 0x7faae006ac00 2024-06-06T03:24:33.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.619+0000 7faae5827700 1 --2- 172.21.15.50:0/1507536925 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7faacc0a2cb0 0x7faacc0a5170 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7faad00098e0 tx=0x7faad0005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:33.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.619+0000 7faae6829700 1 --2- 172.21.15.50:0/1507536925 >> [v2:172.21.15.79:6808/1784117997,v1:172.21.15.79:6809/1784117997] conn(0x7faacc0ade90 0x7faacc0b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:33.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.620+0000 7faae6829700 1 --2- 172.21.15.50:0/1507536925 >> [v2:172.21.15.79:6808/1784117997,v1:172.21.15.79:6809/1784117997] conn(0x7faacc0ade90 0x7faacc0b0330 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:33.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.621+0000 7faad77fe700 1 -- 172.21.15.50:0/1507536925 <== osd.4 v2:172.21.15.79:6808/1784117997 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faadc024ea0 con 0x7faacc0ade90 2024-06-06T03:24:33.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.637+0000 7faae828c700 1 -- 172.21.15.50:0/1507536925 --> [v2:172.21.15.79:6808/1784117997,v1:172.21.15.79:6809/1784117997] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faae0103bc0 con 0x7faacc0ade90 2024-06-06T03:24:33.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.638+0000 7faad77fe700 1 -- 172.21.15.50:0/1507536925 <== osd.4 v2:172.21.15.79:6808/1784117997 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7faae0103bc0 con 0x7faacc0ade90 2024-06-06T03:24:33.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.638+0000 7faae828c700 1 -- 172.21.15.50:0/1507536925 >> [v2:172.21.15.79:6808/1784117997,v1:172.21.15.79:6809/1784117997] conn(0x7faacc0ade90 msgr2=0x7faacc0b0330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:33.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.638+0000 7faae828c700 1 --2- 172.21.15.50:0/1507536925 >> [v2:172.21.15.79:6808/1784117997,v1:172.21.15.79:6809/1784117997] conn(0x7faacc0ade90 0x7faacc0b0330 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:33.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.638+0000 7faae828c700 1 -- 172.21.15.50:0/1507536925 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7faacc0a2cb0 msgr2=0x7faacc0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:33.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.638+0000 7faae828c700 1 --2- 172.21.15.50:0/1507536925 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7faacc0a2cb0 0x7faacc0a5170 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7faad00098e0 tx=0x7faad0005960 comp rx=0 tx=0).stop 2024-06-06T03:24:33.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.638+0000 7faae828c700 1 -- 172.21.15.50:0/1507536925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faae006ac00 msgr2=0x7faae019ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:33.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.638+0000 7faae828c700 1 --2- 172.21.15.50:0/1507536925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faae006ac00 0x7faae019ad60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faadc00d950 tx=0x7faadc00dc60 comp rx=0 tx=0).stop 2024-06-06T03:24:33.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.638+0000 7faae6829700 1 -- 172.21.15.50:0/1507536925 reap_dead start 2024-06-06T03:24:33.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.638+0000 7faae828c700 1 -- 172.21.15.50:0/1507536925 shutdown_connections 2024-06-06T03:24:33.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.638+0000 7faae828c700 1 -- 172.21.15.50:0/1507536925 >> 172.21.15.50:0/1507536925 conn(0x7faae0078340 msgr2=0x7faae010d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:33.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.638+0000 7faae828c700 1 -- 172.21.15.50:0/1507536925 shutdown_connections 2024-06-06T03:24:33.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.638+0000 7faae828c700 1 -- 172.21.15.50:0/1507536925 wait complete. 2024-06-06T03:24:34.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.487+0000 7f9ab310d700 1 -- 172.21.15.50:0/1154773381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9aac101390 msgr2=0x7f9aac101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:34.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.487+0000 7f9ab310d700 1 --2- 172.21.15.50:0/1154773381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9aac101390 0x7f9aac101810 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009990 tx=0x7f9aa0009ca0 comp rx=0 tx=0).stop 2024-06-06T03:24:34.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.487+0000 7f9ab310d700 1 -- 172.21.15.50:0/1154773381 shutdown_connections 2024-06-06T03:24:34.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.487+0000 7f9ab310d700 1 --2- 172.21.15.50:0/1154773381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9aac101d50 0x7f9aac10e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:34.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.487+0000 7f9ab310d700 1 --2- 172.21.15.50:0/1154773381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9aac107400 0x7f9aac1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:34.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.487+0000 7f9ab310d700 1 --2- 172.21.15.50:0/1154773381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9aac101390 0x7f9aac101810 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:34.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.487+0000 7f9ab310d700 1 -- 172.21.15.50:0/1154773381 >> 172.21.15.50:0/1154773381 conn(0x7f9aac078340 msgr2=0x7f9aac078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:34.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.487+0000 7f9ab310d700 1 -- 172.21.15.50:0/1154773381 shutdown_connections 2024-06-06T03:24:34.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.487+0000 7f9ab310d700 1 -- 172.21.15.50:0/1154773381 wait complete. 2024-06-06T03:24:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.488+0000 7f9ab310d700 1 Processor -- start 2024-06-06T03:24:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.488+0000 7f9ab310d700 1 -- start start 2024-06-06T03:24:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.489+0000 7f9ab310d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9aac101390 0x7f9aac1998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.489+0000 7f9ab310d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9aac101d50 0x7f9aac199e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.489+0000 7f9ab310d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9aac107400 0x7f9aac1a4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.489+0000 7f9ab310d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9aac111550 con 0x7f9aac101d50 2024-06-06T03:24:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.489+0000 7f9ab310d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9aac1113d0 con 0x7f9aac101390 2024-06-06T03:24:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.489+0000 7f9ab310d700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9aac1116d0 con 0x7f9aac107400 2024-06-06T03:24:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.489+0000 7f9aabfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9aac101d50 0x7f9aac199e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.489+0000 7f9aabfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9aac101d50 0x7f9aac199e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35454/0 (socket says 172.21.15.50:35454) 2024-06-06T03:24:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.489+0000 7f9aabfff700 1 -- 172.21.15.50:0/2365543904 learned_addr learned my addr 172.21.15.50:0/2365543904 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:24:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.489+0000 7f9ab0ea9700 1 --2- 172.21.15.50:0/2365543904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9aac101390 0x7f9aac1998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.489+0000 7f9ab16aa700 1 --2- 172.21.15.50:0/2365543904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9aac107400 0x7f9aac1a4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.489+0000 7f9aabfff700 1 -- 172.21.15.50:0/2365543904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9aac107400 msgr2=0x7f9aac1a4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.489+0000 7f9aabfff700 1 --2- 172.21.15.50:0/2365543904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9aac107400 0x7f9aac1a4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.489+0000 7f9aabfff700 1 -- 172.21.15.50:0/2365543904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9aac101390 msgr2=0x7f9aac1998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.489+0000 7f9aabfff700 1 --2- 172.21.15.50:0/2365543904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9aac101390 0x7f9aac1998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.489+0000 7f9aabfff700 1 -- 172.21.15.50:0/2365543904 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aac1a4e90 con 0x7f9aac101d50 2024-06-06T03:24:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.489+0000 7f9ab16aa700 1 --2- 172.21.15.50:0/2365543904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9aac107400 0x7f9aac1a4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:24:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.489+0000 7f9aabfff700 1 --2- 172.21.15.50:0/2365543904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9aac101d50 0x7f9aac199e10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0000c00 tx=0x7f9aa0003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.489+0000 7f9aa9ffb700 1 -- 172.21.15.50:0/2365543904 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0027070 con 0x7f9aac101d50 2024-06-06T03:24:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.489+0000 7f9aa9ffb700 1 -- 172.21.15.50:0/2365543904 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9aa000bdc0 con 0x7f9aac101d50 2024-06-06T03:24:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.489+0000 7f9ab310d700 1 -- 172.21.15.50:0/2365543904 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aac1a50c0 con 0x7f9aac101d50 2024-06-06T03:24:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.489+0000 7f9aa9ffb700 1 -- 172.21.15.50:0/2365543904 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa000f460 con 0x7f9aac101d50 2024-06-06T03:24:34.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.490+0000 7f9ab310d700 1 -- 172.21.15.50:0/2365543904 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aac1a5510 con 0x7f9aac101d50 2024-06-06T03:24:34.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.490+0000 7f9ab310d700 1 -- 172.21.15.50:0/2365543904 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9aac062b60 con 0x7f9aac101d50 2024-06-06T03:24:34.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.492+0000 7f9aa9ffb700 1 -- 172.21.15.50:0/2365543904 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9aa002a070 con 0x7f9aac101d50 2024-06-06T03:24:34.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.492+0000 7f9aa9ffb700 1 --2- 172.21.15.50:0/2365543904 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9a940a2cb0 0x7f9a940a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:34.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.492+0000 7f9ab0ea9700 1 --2- 172.21.15.50:0/2365543904 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9a940a2cb0 0x7f9a940a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:34.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.492+0000 7f9aa9ffb700 1 -- 172.21.15.50:0/2365543904 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f9aa00d0c10 con 0x7f9aac101d50 2024-06-06T03:24:34.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.493+0000 7f9aa9ffb700 1 --2- 172.21.15.50:0/2365543904 >> [v2:172.21.15.50:6802/2379528827,v1:172.21.15.50:6803/2379528827] conn(0x7f9a940ade90 0x7f9a940b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:34.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.493+0000 7f9aa9ffb700 1 -- 172.21.15.50:0/2365543904 --> [v2:172.21.15.50:6802/2379528827,v1:172.21.15.50:6803/2379528827] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9aa00043d0 con 0x7f9a940ade90 2024-06-06T03:24:34.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.493+0000 7f9aa9ffb700 1 -- 172.21.15.50:0/2365543904 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7f9aa00d1060 con 0x7f9aac101d50 2024-06-06T03:24:34.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.493+0000 7f9ab16aa700 1 --2- 172.21.15.50:0/2365543904 >> [v2:172.21.15.50:6802/2379528827,v1:172.21.15.50:6803/2379528827] conn(0x7f9a940ade90 0x7f9a940b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:34.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.493+0000 7f9ab0ea9700 1 --2- 172.21.15.50:0/2365543904 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9a940a2cb0 0x7f9a940a5170 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c00abd0 tx=0x7f9a9c00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:34.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.493+0000 7f9ab16aa700 1 --2- 172.21.15.50:0/2365543904 >> [v2:172.21.15.50:6802/2379528827,v1:172.21.15.50:6803/2379528827] conn(0x7f9a940ade90 0x7f9a940b0330 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:34.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.494+0000 7f9aa9ffb700 1 -- 172.21.15.50:0/2365543904 <== osd.0 v2:172.21.15.50:6802/2379528827 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9aa00043d0 con 0x7f9a940ade90 2024-06-06T03:24:34.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.511+0000 7f9ab310d700 1 -- 172.21.15.50:0/2365543904 --> [v2:172.21.15.50:6802/2379528827,v1:172.21.15.50:6803/2379528827] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9aac063010 con 0x7f9a940ade90 2024-06-06T03:24:34.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.511+0000 7f9aa9ffb700 1 -- 172.21.15.50:0/2365543904 <== osd.0 v2:172.21.15.50:6802/2379528827 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9aac063010 con 0x7f9a940ade90 2024-06-06T03:24:34.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.512+0000 7f9ab310d700 1 -- 172.21.15.50:0/2365543904 >> [v2:172.21.15.50:6802/2379528827,v1:172.21.15.50:6803/2379528827] conn(0x7f9a940ade90 msgr2=0x7f9a940b0330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:34.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.512+0000 7f9ab310d700 1 --2- 172.21.15.50:0/2365543904 >> [v2:172.21.15.50:6802/2379528827,v1:172.21.15.50:6803/2379528827] conn(0x7f9a940ade90 0x7f9a940b0330 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:34.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.512+0000 7f9ab310d700 1 -- 172.21.15.50:0/2365543904 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9a940a2cb0 msgr2=0x7f9a940a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:34.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.512+0000 7f9ab310d700 1 --2- 172.21.15.50:0/2365543904 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9a940a2cb0 0x7f9a940a5170 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c00abd0 tx=0x7f9a9c00a380 comp rx=0 tx=0).stop 2024-06-06T03:24:34.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.512+0000 7f9ab310d700 1 -- 172.21.15.50:0/2365543904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9aac101d50 msgr2=0x7f9aac199e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:34.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.512+0000 7f9ab310d700 1 --2- 172.21.15.50:0/2365543904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9aac101d50 0x7f9aac199e10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0000c00 tx=0x7f9aa0003a80 comp rx=0 tx=0).stop 2024-06-06T03:24:34.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.512+0000 7f9ab16aa700 1 -- 172.21.15.50:0/2365543904 reap_dead start 2024-06-06T03:24:34.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.512+0000 7f9ab310d700 1 -- 172.21.15.50:0/2365543904 shutdown_connections 2024-06-06T03:24:34.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.512+0000 7f9ab310d700 1 -- 172.21.15.50:0/2365543904 >> 172.21.15.50:0/2365543904 conn(0x7f9aac078340 msgr2=0x7f9aac0fff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:34.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.512+0000 7f9ab310d700 1 -- 172.21.15.50:0/2365543904 shutdown_connections 2024-06-06T03:24:34.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:33.512+0000 7f9ab310d700 1 -- 172.21.15.50:0/2365543904 wait complete. 2024-06-06T03:24:34.919 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:34 smithi050 ceph-mon[32421]: pgmap v369: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-06T03:24:34.957 INFO:teuthology.orchestra.run.smithi050.stdout:55834574938 2024-06-06T03:24:34.958 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-06-06T03:24:35.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:34 smithi079 ceph-mon[35478]: pgmap v369: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-06T03:24:35.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:34 smithi122 ceph-mon[35759]: pgmap v369: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-06T03:24:35.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.900+0000 7f0102452700 1 -- 172.21.15.50:0/2081056632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00fc108500 msgr2=0x7f00fc1088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:35.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.900+0000 7f0102452700 1 --2- 172.21.15.50:0/2081056632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00fc108500 0x7f00fc1088e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f00f400b0a0 tx=0x7f00f400b3b0 comp rx=0 tx=0).stop 2024-06-06T03:24:35.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.900+0000 7f0102452700 1 -- 172.21.15.50:0/2081056632 shutdown_connections 2024-06-06T03:24:35.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.900+0000 7f0102452700 1 --2- 172.21.15.50:0/2081056632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00fc06ab30 0x7f00fc10f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:35.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.900+0000 7f0102452700 1 --2- 172.21.15.50:0/2081056632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00fc108500 0x7f00fc1088e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:35.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.900+0000 7f0102452700 1 --2- 172.21.15.50:0/2081056632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00fc06a170 0x7f00fc06a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:35.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.900+0000 7f0102452700 1 -- 172.21.15.50:0/2081056632 >> 172.21.15.50:0/2081056632 conn(0x7f00fc078340 msgr2=0x7f00fc078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:35.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.900+0000 7f0102452700 1 -- 172.21.15.50:0/2081056632 shutdown_connections 2024-06-06T03:24:35.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.900+0000 7f0102452700 1 -- 172.21.15.50:0/2081056632 wait complete. 2024-06-06T03:24:35.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.901+0000 7f0102452700 1 Processor -- start 2024-06-06T03:24:35.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.901+0000 7f0102452700 1 -- start start 2024-06-06T03:24:35.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.902+0000 7f0102452700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00fc06a170 0x7f00fc101460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:35.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.902+0000 7f0102452700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00fc06ab30 0x7f00fc1019a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:35.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.902+0000 7f0102452700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00fc108500 0x7f00fc101ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:35.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.902+0000 7f0102452700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc112680 con 0x7f00fc06a170 2024-06-06T03:24:35.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.902+0000 7f01009ef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00fc108500 0x7f00fc101ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:35.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.902+0000 7f01009ef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00fc108500 0x7f00fc101ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:48806/0 (socket says 172.21.15.50:48806) 2024-06-06T03:24:35.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.902+0000 7f01009ef700 1 -- 172.21.15.50:0/1276444666 learned_addr learned my addr 172.21.15.50:0/1276444666 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:24:35.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.902+0000 7f0102452700 1 -- 172.21.15.50:0/1276444666 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc112500 con 0x7f00fc108500 2024-06-06T03:24:35.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.902+0000 7f0102452700 1 -- 172.21.15.50:0/1276444666 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc112800 con 0x7f00fc06ab30 2024-06-06T03:24:35.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.903+0000 7f00fbfff700 1 --2- 172.21.15.50:0/1276444666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00fc06a170 0x7f00fc101460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:35.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.903+0000 7f01009ef700 1 -- 172.21.15.50:0/1276444666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00fc06ab30 msgr2=0x7f00fc1019a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:35.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.903+0000 7f01009ef700 1 --2- 172.21.15.50:0/1276444666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00fc06ab30 0x7f00fc1019a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:35.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.903+0000 7f01009ef700 1 -- 172.21.15.50:0/1276444666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00fc06a170 msgr2=0x7f00fc101460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:35.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.903+0000 7f01009ef700 1 --2- 172.21.15.50:0/1276444666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00fc06a170 0x7f00fc101460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:35.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.903+0000 7f01009ef700 1 -- 172.21.15.50:0/1276444666 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00fc1033c0 con 0x7f00fc108500 2024-06-06T03:24:35.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.904+0000 7f01009ef700 1 --2- 172.21.15.50:0/1276444666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00fc108500 0x7f00fc101ee0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f00ec00e940 tx=0x7f00ec00ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:35.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.904+0000 7f00f97fa700 1 -- 172.21.15.50:0/1276444666 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ec00ee90 con 0x7f00fc108500 2024-06-06T03:24:35.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.904+0000 7f00f97fa700 1 -- 172.21.15.50:0/1276444666 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f00ec004ce0 con 0x7f00fc108500 2024-06-06T03:24:35.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.904+0000 7f00f97fa700 1 -- 172.21.15.50:0/1276444666 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ec005280 con 0x7f00fc108500 2024-06-06T03:24:35.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.904+0000 7f0102452700 1 -- 172.21.15.50:0/1276444666 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00fc06ce20 con 0x7f00fc108500 2024-06-06T03:24:35.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.904+0000 7f0102452700 1 -- 172.21.15.50:0/1276444666 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00fc06d2f0 con 0x7f00fc108500 2024-06-06T03:24:35.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.905+0000 7f0102452700 1 -- 172.21.15.50:0/1276444666 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f00fc062ba0 con 0x7f00fc108500 2024-06-06T03:24:35.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.907+0000 7f00f97fa700 1 -- 172.21.15.50:0/1276444666 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f00ec005420 con 0x7f00fc108500 2024-06-06T03:24:35.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.908+0000 7f00f97fa700 1 --2- 172.21.15.50:0/1276444666 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f00e40a2ed0 0x7f00e40a5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:35.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.908+0000 7f00f97fa700 1 -- 172.21.15.50:0/1276444666 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f00ec0d7de0 con 0x7f00fc108500 2024-06-06T03:24:35.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.908+0000 7f00fbfff700 1 --2- 172.21.15.50:0/1276444666 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f00e40a2ed0 0x7f00e40a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:35.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.908+0000 7f00f97fa700 1 --2- 172.21.15.50:0/1276444666 >> [v2:172.21.15.122:6808/2755878218,v1:172.21.15.122:6809/2755878218] conn(0x7f00e40ae0b0 0x7f00e40b0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:35.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.908+0000 7f00f97fa700 1 -- 172.21.15.50:0/1276444666 --> [v2:172.21.15.122:6808/2755878218,v1:172.21.15.122:6809/2755878218] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f00ec01bec0 con 0x7f00e40ae0b0 2024-06-06T03:24:35.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.908+0000 7f00f97fa700 1 -- 172.21.15.50:0/1276444666 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7f00ec0d8230 con 0x7f00fc108500 2024-06-06T03:24:35.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.908+0000 7f00fb7fe700 1 --2- 172.21.15.50:0/1276444666 >> [v2:172.21.15.122:6808/2755878218,v1:172.21.15.122:6809/2755878218] conn(0x7f00e40ae0b0 0x7f00e40b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:35.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.909+0000 7f00fbfff700 1 --2- 172.21.15.50:0/1276444666 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f00e40a2ed0 0x7f00e40a5390 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f00f40062a0 tx=0x7f00f4006210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:35.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.909+0000 7f00fb7fe700 1 --2- 172.21.15.50:0/1276444666 >> [v2:172.21.15.122:6808/2755878218,v1:172.21.15.122:6809/2755878218] conn(0x7f00e40ae0b0 0x7f00e40b0550 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:35.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.910+0000 7f00f97fa700 1 -- 172.21.15.50:0/1276444666 <== osd.5 v2:172.21.15.122:6808/2755878218 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f00ec01bec0 con 0x7f00e40ae0b0 2024-06-06T03:24:35.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.927+0000 7f0102452700 1 -- 172.21.15.50:0/1276444666 --> [v2:172.21.15.122:6808/2755878218,v1:172.21.15.122:6809/2755878218] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f00fc062fa0 con 0x7f00e40ae0b0 2024-06-06T03:24:35.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.927+0000 7f00f97fa700 1 -- 172.21.15.50:0/1276444666 <== osd.5 v2:172.21.15.122:6808/2755878218 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f00fc062fa0 con 0x7f00e40ae0b0 2024-06-06T03:24:35.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.928+0000 7f0102452700 1 -- 172.21.15.50:0/1276444666 >> [v2:172.21.15.122:6808/2755878218,v1:172.21.15.122:6809/2755878218] conn(0x7f00e40ae0b0 msgr2=0x7f00e40b0550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:35.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.928+0000 7f0102452700 1 --2- 172.21.15.50:0/1276444666 >> [v2:172.21.15.122:6808/2755878218,v1:172.21.15.122:6809/2755878218] conn(0x7f00e40ae0b0 0x7f00e40b0550 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:35.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.928+0000 7f0102452700 1 -- 172.21.15.50:0/1276444666 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f00e40a2ed0 msgr2=0x7f00e40a5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:35.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.928+0000 7f0102452700 1 --2- 172.21.15.50:0/1276444666 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f00e40a2ed0 0x7f00e40a5390 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f00f40062a0 tx=0x7f00f4006210 comp rx=0 tx=0).stop 2024-06-06T03:24:35.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.928+0000 7f0102452700 1 -- 172.21.15.50:0/1276444666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00fc108500 msgr2=0x7f00fc101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:35.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.928+0000 7f0102452700 1 --2- 172.21.15.50:0/1276444666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00fc108500 0x7f00fc101ee0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f00ec00e940 tx=0x7f00ec00ec50 comp rx=0 tx=0).stop 2024-06-06T03:24:35.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.928+0000 7f01009ef700 1 -- 172.21.15.50:0/1276444666 reap_dead start 2024-06-06T03:24:35.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.928+0000 7f0102452700 1 -- 172.21.15.50:0/1276444666 shutdown_connections 2024-06-06T03:24:35.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.928+0000 7f0102452700 1 -- 172.21.15.50:0/1276444666 >> 172.21.15.50:0/1276444666 conn(0x7f00fc078340 msgr2=0x7f00fc100260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:35.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.928+0000 7f0102452700 1 -- 172.21.15.50:0/1276444666 shutdown_connections 2024-06-06T03:24:35.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:35.928+0000 7f0102452700 1 -- 172.21.15.50:0/1276444666 wait complete. 2024-06-06T03:24:36.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:35 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:24:36.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:35 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:24:36.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:35 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:24:36.567 INFO:teuthology.orchestra.run.smithi050.stdout:34359738464 2024-06-06T03:24:36.568 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-06-06T03:24:36.792 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:36 smithi050 ceph-mon[32421]: pgmap v370: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:24:37.389 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:36 smithi122 ceph-mon[35759]: pgmap v370: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:24:37.389 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:36 smithi079 ceph-mon[35478]: pgmap v370: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:24:37.430 INFO:teuthology.orchestra.run.smithi050.stdout:163208757320 2024-06-06T03:24:37.430 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-06-06T03:24:37.814 INFO:teuthology.orchestra.run.smithi050.stdout:197568495682 2024-06-06T03:24:37.814 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-06-06T03:24:38.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.125+0000 7fb284bc6700 1 -- 172.21.15.50:0/3950233164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb28006ab30 msgr2=0x7fb28010f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:38.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.125+0000 7fb284bc6700 1 --2- 172.21.15.50:0/3950233164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb28006ab30 0x7fb28010f320 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb27800b0a0 tx=0x7fb27800b3b0 comp rx=0 tx=0).stop 2024-06-06T03:24:38.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.125+0000 7fb284bc6700 1 -- 172.21.15.50:0/3950233164 shutdown_connections 2024-06-06T03:24:38.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.125+0000 7fb284bc6700 1 --2- 172.21.15.50:0/3950233164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb28006ab30 0x7fb28010f320 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:38.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.125+0000 7fb284bc6700 1 --2- 172.21.15.50:0/3950233164 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb280108500 0x7fb2801088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:38.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.125+0000 7fb284bc6700 1 --2- 172.21.15.50:0/3950233164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb28006a170 0x7fb28006a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:38.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.125+0000 7fb284bc6700 1 -- 172.21.15.50:0/3950233164 >> 172.21.15.50:0/3950233164 conn(0x7fb280078340 msgr2=0x7fb280078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:38.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.125+0000 7fb284bc6700 1 -- 172.21.15.50:0/3950233164 shutdown_connections 2024-06-06T03:24:38.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.125+0000 7fb284bc6700 1 -- 172.21.15.50:0/3950233164 wait complete. 2024-06-06T03:24:38.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.126+0000 7fb284bc6700 1 Processor -- start 2024-06-06T03:24:38.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.126+0000 7fb284bc6700 1 -- start start 2024-06-06T03:24:38.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.126+0000 7fb284bc6700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb28006a170 0x7fb28019f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:38.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.126+0000 7fb284bc6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb28006ab30 0x7fb28019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:38.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.126+0000 7fb284bc6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb280108500 0x7fb28010d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:38.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.126+0000 7fb284bc6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb280112610 con 0x7fb28006ab30 2024-06-06T03:24:38.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.126+0000 7fb284bc6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb280112490 con 0x7fb280108500 2024-06-06T03:24:38.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.126+0000 7fb284bc6700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb280112790 con 0x7fb28006a170 2024-06-06T03:24:38.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.126+0000 7fb27dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb28006ab30 0x7fb28019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:38.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.126+0000 7fb27dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb28006ab30 0x7fb28019fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44138/0 (socket says 172.21.15.50:44138) 2024-06-06T03:24:38.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.126+0000 7fb27dd9b700 1 -- 172.21.15.50:0/1159727881 learned_addr learned my addr 172.21.15.50:0/1159727881 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:24:38.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.126+0000 7fb27e59c700 1 --2- 172.21.15.50:0/1159727881 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb28006a170 0x7fb28019f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:38.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.127+0000 7fb27dd9b700 1 -- 172.21.15.50:0/1159727881 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb28006a170 msgr2=0x7fb28019f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:38.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.127+0000 7fb27dd9b700 1 --2- 172.21.15.50:0/1159727881 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb28006a170 0x7fb28019f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:38.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.127+0000 7fb27ed9d700 1 --2- 172.21.15.50:0/1159727881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb280108500 0x7fb28010d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:38.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.127+0000 7fb27dd9b700 1 -- 172.21.15.50:0/1159727881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb280108500 msgr2=0x7fb28010d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:38.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.127+0000 7fb27dd9b700 1 --2- 172.21.15.50:0/1159727881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb280108500 0x7fb28010d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:38.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.127+0000 7fb27dd9b700 1 -- 172.21.15.50:0/1159727881 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28010dd00 con 0x7fb28006ab30 2024-06-06T03:24:38.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.127+0000 7fb27ed9d700 1 --2- 172.21.15.50:0/1159727881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb280108500 0x7fb28010d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:24:38.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.127+0000 7fb27dd9b700 1 --2- 172.21.15.50:0/1159727881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb28006ab30 0x7fb28019fce0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb27400e9a0 tx=0x7fb27400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:38.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.127+0000 7fb26f7fe700 1 -- 172.21.15.50:0/1159727881 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27400cbd0 con 0x7fb28006ab30 2024-06-06T03:24:38.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.127+0000 7fb284bc6700 1 -- 172.21.15.50:0/1159727881 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb28010dff0 con 0x7fb28006ab30 2024-06-06T03:24:38.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.127+0000 7fb26f7fe700 1 -- 172.21.15.50:0/1159727881 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb27400cd70 con 0x7fb28006ab30 2024-06-06T03:24:38.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.127+0000 7fb26f7fe700 1 -- 172.21.15.50:0/1159727881 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb274018680 con 0x7fb28006ab30 2024-06-06T03:24:38.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.127+0000 7fb284bc6700 1 -- 172.21.15.50:0/1159727881 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb28019b480 con 0x7fb28006ab30 2024-06-06T03:24:38.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.128+0000 7fb284bc6700 1 -- 172.21.15.50:0/1159727881 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb2801027a0 con 0x7fb28006ab30 2024-06-06T03:24:38.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.130+0000 7fb26f7fe700 1 -- 172.21.15.50:0/1159727881 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb274010430 con 0x7fb28006ab30 2024-06-06T03:24:38.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.130+0000 7fb26f7fe700 1 --2- 172.21.15.50:0/1159727881 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb2680a2d30 0x7fb2680a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:38.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.131+0000 7fb27e59c700 1 --2- 172.21.15.50:0/1159727881 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb2680a2d30 0x7fb2680a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:38.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.131+0000 7fb26f7fe700 1 -- 172.21.15.50:0/1159727881 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fb2740d02a0 con 0x7fb28006ab30 2024-06-06T03:24:38.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.131+0000 7fb26f7fe700 1 --2- 172.21.15.50:0/1159727881 >> [v2:172.21.15.50:6826/2600273670,v1:172.21.15.50:6827/2600273670] conn(0x7fb2680adf10 0x7fb2680b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:38.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.131+0000 7fb26f7fe700 1 -- 172.21.15.50:0/1159727881 --> [v2:172.21.15.50:6826/2600273670,v1:172.21.15.50:6827/2600273670] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb27401bec0 con 0x7fb2680adf10 2024-06-06T03:24:38.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.131+0000 7fb26f7fe700 1 -- 172.21.15.50:0/1159727881 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7fb2740d06f0 con 0x7fb28006ab30 2024-06-06T03:24:38.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.131+0000 7fb27ed9d700 1 --2- 172.21.15.50:0/1159727881 >> [v2:172.21.15.50:6826/2600273670,v1:172.21.15.50:6827/2600273670] conn(0x7fb2680adf10 0x7fb2680b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:38.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.131+0000 7fb27e59c700 1 --2- 172.21.15.50:0/1159727881 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb2680a2d30 0x7fb2680a51f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb270005950 tx=0x7fb27000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:38.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.132+0000 7fb27ed9d700 1 --2- 172.21.15.50:0/1159727881 >> [v2:172.21.15.50:6826/2600273670,v1:172.21.15.50:6827/2600273670] conn(0x7fb2680adf10 0x7fb2680b03b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:38.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.132+0000 7fb26f7fe700 1 -- 172.21.15.50:0/1159727881 <== osd.9 v2:172.21.15.50:6826/2600273670 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb27401bec0 con 0x7fb2680adf10 2024-06-06T03:24:38.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.164+0000 7fb284bc6700 1 -- 172.21.15.50:0/1159727881 --> [v2:172.21.15.50:6826/2600273670,v1:172.21.15.50:6827/2600273670] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb280103bc0 con 0x7fb2680adf10 2024-06-06T03:24:38.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.164+0000 7fb26f7fe700 1 -- 172.21.15.50:0/1159727881 <== osd.9 v2:172.21.15.50:6826/2600273670 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb280103bc0 con 0x7fb2680adf10 2024-06-06T03:24:38.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.165+0000 7fb284bc6700 1 -- 172.21.15.50:0/1159727881 >> [v2:172.21.15.50:6826/2600273670,v1:172.21.15.50:6827/2600273670] conn(0x7fb2680adf10 msgr2=0x7fb2680b03b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:38.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.165+0000 7fb284bc6700 1 --2- 172.21.15.50:0/1159727881 >> [v2:172.21.15.50:6826/2600273670,v1:172.21.15.50:6827/2600273670] conn(0x7fb2680adf10 0x7fb2680b03b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:38.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.165+0000 7fb284bc6700 1 -- 172.21.15.50:0/1159727881 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb2680a2d30 msgr2=0x7fb2680a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:38.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.165+0000 7fb284bc6700 1 --2- 172.21.15.50:0/1159727881 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb2680a2d30 0x7fb2680a51f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb270005950 tx=0x7fb27000b410 comp rx=0 tx=0).stop 2024-06-06T03:24:38.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.165+0000 7fb284bc6700 1 -- 172.21.15.50:0/1159727881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb28006ab30 msgr2=0x7fb28019fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:38.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.165+0000 7fb284bc6700 1 --2- 172.21.15.50:0/1159727881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb28006ab30 0x7fb28019fce0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb27400e9a0 tx=0x7fb27400ecb0 comp rx=0 tx=0).stop 2024-06-06T03:24:38.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.165+0000 7fb27ed9d700 1 -- 172.21.15.50:0/1159727881 reap_dead start 2024-06-06T03:24:38.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.165+0000 7fb284bc6700 1 -- 172.21.15.50:0/1159727881 shutdown_connections 2024-06-06T03:24:38.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.165+0000 7fb284bc6700 1 -- 172.21.15.50:0/1159727881 >> 172.21.15.50:0/1159727881 conn(0x7fb280078340 msgr2=0x7fb280101dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:38.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.165+0000 7fb284bc6700 1 -- 172.21.15.50:0/1159727881 shutdown_connections 2024-06-06T03:24:38.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:38.165+0000 7fb284bc6700 1 -- 172.21.15.50:0/1159727881 wait complete. 2024-06-06T03:24:38.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:38 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:24:38.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:38 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:24:38.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:38 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:24:38.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:38 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:24:38.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:38 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:24:38.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:38 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:24:38.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:38 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:24:38.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:38 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:24:38.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:38 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:24:38.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:38 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:24:38.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:38 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:24:38.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:38 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:24:39.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.366+0000 7f7d78b4f700 1 -- 172.21.15.50:0/755123090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d741066e0 msgr2=0x7f7d7410e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:39.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.366+0000 7f7d78b4f700 1 --2- 172.21.15.50:0/755123090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d741066e0 0x7f7d7410e2b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c00b0a0 tx=0x7f7d6c00b3b0 comp rx=0 tx=0).stop 2024-06-06T03:24:39.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.366+0000 7f7d78b4f700 1 -- 172.21.15.50:0/755123090 shutdown_connections 2024-06-06T03:24:39.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.366+0000 7f7d78b4f700 1 --2- 172.21.15.50:0/755123090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d741066e0 0x7f7d7410e2b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:39.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.366+0000 7f7d78b4f700 1 --2- 172.21.15.50:0/755123090 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d74101650 0x7f7d74101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:39.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.366+0000 7f7d78b4f700 1 --2- 172.21.15.50:0/755123090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d74102000 0x7f7d74106000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:39.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.366+0000 7f7d78b4f700 1 -- 172.21.15.50:0/755123090 >> 172.21.15.50:0/755123090 conn(0x7f7d740773e0 msgr2=0x7f7d740777f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:39.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.366+0000 7f7d78b4f700 1 -- 172.21.15.50:0/755123090 shutdown_connections 2024-06-06T03:24:39.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.366+0000 7f7d78b4f700 1 -- 172.21.15.50:0/755123090 wait complete. 2024-06-06T03:24:39.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.367+0000 7f7d78b4f700 1 Processor -- start 2024-06-06T03:24:39.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.367+0000 7f7d78b4f700 1 -- start start 2024-06-06T03:24:39.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.367+0000 7f7d78b4f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d74101650 0x7f7d74199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:39.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.367+0000 7f7d78b4f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d74102000 0x7f7d74199e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:39.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.367+0000 7f7d78b4f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d741066e0 0x7f7d741a49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:39.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.367+0000 7f7d78b4f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7d74111570 con 0x7f7d74102000 2024-06-06T03:24:39.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.367+0000 7f7d78b4f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7d741113f0 con 0x7f7d74101650 2024-06-06T03:24:39.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.367+0000 7f7d78b4f700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7d741116f0 con 0x7f7d741066e0 2024-06-06T03:24:39.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.367+0000 7f7d71d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d74102000 0x7f7d74199e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:39.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.367+0000 7f7d71d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d74102000 0x7f7d74199e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44152/0 (socket says 172.21.15.50:44152) 2024-06-06T03:24:39.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.367+0000 7f7d71d9b700 1 -- 172.21.15.50:0/2539887207 learned_addr learned my addr 172.21.15.50:0/2539887207 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:24:39.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.367+0000 7f7d7259c700 1 --2- 172.21.15.50:0/2539887207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d74101650 0x7f7d74199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:39.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.368+0000 7f7d72d9d700 1 --2- 172.21.15.50:0/2539887207 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d741066e0 0x7f7d741a49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:39.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.368+0000 7f7d71d9b700 1 -- 172.21.15.50:0/2539887207 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d741066e0 msgr2=0x7f7d741a49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:39.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.368+0000 7f7d71d9b700 1 --2- 172.21.15.50:0/2539887207 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d741066e0 0x7f7d741a49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:39.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.368+0000 7f7d71d9b700 1 -- 172.21.15.50:0/2539887207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d74101650 msgr2=0x7f7d74199930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:39.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.368+0000 7f7d71d9b700 1 --2- 172.21.15.50:0/2539887207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d74101650 0x7f7d74199930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:39.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.368+0000 7f7d71d9b700 1 -- 172.21.15.50:0/2539887207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d741a4ef0 con 0x7f7d74102000 2024-06-06T03:24:39.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.368+0000 7f7d71d9b700 1 --2- 172.21.15.50:0/2539887207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d74102000 0x7f7d74199e70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800d980 tx=0x7f7d6800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:39.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.368+0000 7f7d637fe700 1 -- 172.21.15.50:0/2539887207 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d68017070 con 0x7f7d74102000 2024-06-06T03:24:39.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.368+0000 7f7d637fe700 1 -- 172.21.15.50:0/2539887207 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7d68009de0 con 0x7f7d74102000 2024-06-06T03:24:39.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.368+0000 7f7d78b4f700 1 -- 172.21.15.50:0/2539887207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d741a5120 con 0x7f7d74102000 2024-06-06T03:24:39.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.368+0000 7f7d637fe700 1 -- 172.21.15.50:0/2539887207 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6800f3c0 con 0x7f7d74102000 2024-06-06T03:24:39.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.368+0000 7f7d78b4f700 1 -- 172.21.15.50:0/2539887207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d741a5660 con 0x7f7d74102000 2024-06-06T03:24:39.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.369+0000 7f7d78b4f700 1 -- 172.21.15.50:0/2539887207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7d74062ba0 con 0x7f7d74102000 2024-06-06T03:24:39.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.370+0000 7f7d637fe700 1 -- 172.21.15.50:0/2539887207 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7d68009930 con 0x7f7d74102000 2024-06-06T03:24:39.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.371+0000 7f7d637fe700 1 --2- 172.21.15.50:0/2539887207 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7d5c0a2cb0 0x7f7d5c0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:39.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.371+0000 7f7d7259c700 1 --2- 172.21.15.50:0/2539887207 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7d5c0a2cb0 0x7f7d5c0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:39.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.371+0000 7f7d637fe700 1 -- 172.21.15.50:0/2539887207 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f7d680cf440 con 0x7f7d74102000 2024-06-06T03:24:39.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.371+0000 7f7d637fe700 1 --2- 172.21.15.50:0/2539887207 >> [v2:172.21.15.122:6824/4160854238,v1:172.21.15.122:6825/4160854238] conn(0x7f7d5c0ade90 0x7f7d5c0b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:39.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.371+0000 7f7d637fe700 1 -- 172.21.15.50:0/2539887207 --> [v2:172.21.15.122:6824/4160854238,v1:172.21.15.122:6825/4160854238] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7d6800fec0 con 0x7f7d5c0ade90 2024-06-06T03:24:39.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.371+0000 7f7d637fe700 1 -- 172.21.15.50:0/2539887207 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7f7d680cf7f0 con 0x7f7d74102000 2024-06-06T03:24:39.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.372+0000 7f7d72d9d700 1 --2- 172.21.15.50:0/2539887207 >> [v2:172.21.15.122:6824/4160854238,v1:172.21.15.122:6825/4160854238] conn(0x7f7d5c0ade90 0x7f7d5c0b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:39.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.372+0000 7f7d7259c700 1 --2- 172.21.15.50:0/2539887207 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7d5c0a2cb0 0x7f7d5c0a5170 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7d64004630 tx=0x7f7d6400b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:39.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.372+0000 7f7d72d9d700 1 --2- 172.21.15.50:0/2539887207 >> [v2:172.21.15.122:6824/4160854238,v1:172.21.15.122:6825/4160854238] conn(0x7f7d5c0ade90 0x7f7d5c0b0330 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:39.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.373+0000 7f7d637fe700 1 -- 172.21.15.50:0/2539887207 <== osd.11 v2:172.21.15.122:6824/4160854238 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7d6800fec0 con 0x7f7d5c0ade90 2024-06-06T03:24:39.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.389+0000 7f7d78b4f700 1 -- 172.21.15.50:0/2539887207 --> [v2:172.21.15.122:6824/4160854238,v1:172.21.15.122:6825/4160854238] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7d74063020 con 0x7f7d5c0ade90 2024-06-06T03:24:39.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.390+0000 7f7d637fe700 1 -- 172.21.15.50:0/2539887207 <== osd.11 v2:172.21.15.122:6824/4160854238 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7d74063020 con 0x7f7d5c0ade90 2024-06-06T03:24:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.390+0000 7f7d78b4f700 1 -- 172.21.15.50:0/2539887207 >> [v2:172.21.15.122:6824/4160854238,v1:172.21.15.122:6825/4160854238] conn(0x7f7d5c0ade90 msgr2=0x7f7d5c0b0330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.390+0000 7f7d78b4f700 1 --2- 172.21.15.50:0/2539887207 >> [v2:172.21.15.122:6824/4160854238,v1:172.21.15.122:6825/4160854238] conn(0x7f7d5c0ade90 0x7f7d5c0b0330 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.390+0000 7f7d78b4f700 1 -- 172.21.15.50:0/2539887207 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7d5c0a2cb0 msgr2=0x7f7d5c0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:39.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.390+0000 7f7d78b4f700 1 --2- 172.21.15.50:0/2539887207 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7d5c0a2cb0 0x7f7d5c0a5170 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7d64004630 tx=0x7f7d6400b3c0 comp rx=0 tx=0).stop 2024-06-06T03:24:39.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.390+0000 7f7d78b4f700 1 -- 172.21.15.50:0/2539887207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d74102000 msgr2=0x7f7d74199e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:39.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.390+0000 7f7d78b4f700 1 --2- 172.21.15.50:0/2539887207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d74102000 0x7f7d74199e70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800d980 tx=0x7f7d6800dc90 comp rx=0 tx=0).stop 2024-06-06T03:24:39.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.390+0000 7f7d72d9d700 1 -- 172.21.15.50:0/2539887207 reap_dead start 2024-06-06T03:24:39.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.390+0000 7f7d78b4f700 1 -- 172.21.15.50:0/2539887207 shutdown_connections 2024-06-06T03:24:39.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.390+0000 7f7d78b4f700 1 -- 172.21.15.50:0/2539887207 >> 172.21.15.50:0/2539887207 conn(0x7f7d740773e0 msgr2=0x7f7d740ff4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:39.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.390+0000 7f7d78b4f700 1 -- 172.21.15.50:0/2539887207 shutdown_connections 2024-06-06T03:24:39.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.390+0000 7f7d78b4f700 1 -- 172.21.15.50:0/2539887207 wait complete. 2024-06-06T03:24:39.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:39 smithi050 ceph-mon[32421]: pgmap v371: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T03:24:39.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:39 smithi079 ceph-mon[35478]: pgmap v371: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T03:24:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.615+0000 7fbf5ae34700 1 -- 172.21.15.50:0/2766821289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf54102ed0 msgr2=0x7fbf5410f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.615+0000 7fbf5ae34700 1 --2- 172.21.15.50:0/2766821289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf54102ed0 0x7fbf5410f350 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c00b0a0 tx=0x7fbf4c00b3b0 comp rx=0 tx=0).stop 2024-06-06T03:24:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.615+0000 7fbf5ae34700 1 -- 172.21.15.50:0/2766821289 shutdown_connections 2024-06-06T03:24:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.615+0000 7fbf5ae34700 1 --2- 172.21.15.50:0/2766821289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf54102ed0 0x7fbf5410f350 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.615+0000 7fbf5ae34700 1 --2- 172.21.15.50:0/2766821289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbf54108510 0x7fbf541088f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.615+0000 7fbf5ae34700 1 --2- 172.21.15.50:0/2766821289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf54102510 0x7fbf54102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:39.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.615+0000 7fbf5ae34700 1 -- 172.21.15.50:0/2766821289 >> 172.21.15.50:0/2766821289 conn(0x7fbf540795b0 msgr2=0x7fbf540799c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:39.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.615+0000 7fbf5ae34700 1 -- 172.21.15.50:0/2766821289 shutdown_connections 2024-06-06T03:24:39.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.615+0000 7fbf5ae34700 1 -- 172.21.15.50:0/2766821289 wait complete. 2024-06-06T03:24:39.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.616+0000 7fbf5ae34700 1 Processor -- start 2024-06-06T03:24:39.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.616+0000 7fbf5ae34700 1 -- start start 2024-06-06T03:24:39.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.616+0000 7fbf5ae34700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf54102510 0x7fbf54074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:39.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.616+0000 7fbf5ae34700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf54102ed0 0x7fbf54074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:39.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.616+0000 7fbf5ae34700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbf54108510 0x7fbf54075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:39.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.616+0000 7fbf5ae34700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbf54112610 con 0x7fbf54102510 2024-06-06T03:24:39.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.616+0000 7fbf5ae34700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbf54112490 con 0x7fbf54102ed0 2024-06-06T03:24:39.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.616+0000 7fbf5ae34700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbf54112790 con 0x7fbf54108510 2024-06-06T03:24:39.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.616+0000 7fbf58bd0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf54102510 0x7fbf54074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:39.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.616+0000 7fbf58bd0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf54102510 0x7fbf54074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44162/0 (socket says 172.21.15.50:44162) 2024-06-06T03:24:39.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.616+0000 7fbf58bd0700 1 -- 172.21.15.50:0/422715644 learned_addr learned my addr 172.21.15.50:0/422715644 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:24:39.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.616+0000 7fbf53fff700 1 --2- 172.21.15.50:0/422715644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf54102ed0 0x7fbf54074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:39.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.616+0000 7fbf593d1700 1 --2- 172.21.15.50:0/422715644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbf54108510 0x7fbf54075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:39.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.616+0000 7fbf58bd0700 1 -- 172.21.15.50:0/422715644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbf54108510 msgr2=0x7fbf54075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:39.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.616+0000 7fbf58bd0700 1 --2- 172.21.15.50:0/422715644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbf54108510 0x7fbf54075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:39.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.616+0000 7fbf58bd0700 1 -- 172.21.15.50:0/422715644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf54102ed0 msgr2=0x7fbf54074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.616+0000 7fbf58bd0700 1 --2- 172.21.15.50:0/422715644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf54102ed0 0x7fbf54074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.616+0000 7fbf58bd0700 1 -- 172.21.15.50:0/422715644 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf541a6f90 con 0x7fbf54102510 2024-06-06T03:24:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.617+0000 7fbf58bd0700 1 --2- 172.21.15.50:0/422715644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf54102510 0x7fbf54074790 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00c970 tx=0x7fbf3c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.617+0000 7fbf51ffb700 1 -- 172.21.15.50:0/422715644 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c007aa0 con 0x7fbf54102510 2024-06-06T03:24:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.617+0000 7fbf5ae34700 1 -- 172.21.15.50:0/422715644 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf541a7280 con 0x7fbf54102510 2024-06-06T03:24:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.617+0000 7fbf51ffb700 1 -- 172.21.15.50:0/422715644 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbf3c004ce0 con 0x7fbf54102510 2024-06-06T03:24:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.617+0000 7fbf51ffb700 1 -- 172.21.15.50:0/422715644 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c005520 con 0x7fbf54102510 2024-06-06T03:24:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.617+0000 7fbf5ae34700 1 -- 172.21.15.50:0/422715644 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf541a7770 con 0x7fbf54102510 2024-06-06T03:24:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.618+0000 7fbf5ae34700 1 -- 172.21.15.50:0/422715644 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbf54062ba0 con 0x7fbf54102510 2024-06-06T03:24:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.619+0000 7fbf51ffb700 1 -- 172.21.15.50:0/422715644 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fbf3c004750 con 0x7fbf54102510 2024-06-06T03:24:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.620+0000 7fbf51ffb700 1 --2- 172.21.15.50:0/422715644 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbf400a2cb0 0x7fbf400a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.620+0000 7fbf53fff700 1 --2- 172.21.15.50:0/422715644 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbf400a2cb0 0x7fbf400a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.620+0000 7fbf51ffb700 1 -- 172.21.15.50:0/422715644 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fbf3c0cf750 con 0x7fbf54102510 2024-06-06T03:24:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.620+0000 7fbf51ffb700 1 --2- 172.21.15.50:0/422715644 >> [v2:172.21.15.122:6816/3484833116,v1:172.21.15.122:6817/3484833116] conn(0x7fbf400ade90 0x7fbf400b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:39.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.620+0000 7fbf51ffb700 1 -- 172.21.15.50:0/422715644 --> [v2:172.21.15.122:6816/3484833116,v1:172.21.15.122:6817/3484833116] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbf3c00eec0 con 0x7fbf400ade90 2024-06-06T03:24:39.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.620+0000 7fbf51ffb700 1 -- 172.21.15.50:0/422715644 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7fbf3c0cfba0 con 0x7fbf54102510 2024-06-06T03:24:39.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.621+0000 7fbf53fff700 1 --2- 172.21.15.50:0/422715644 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbf400a2cb0 0x7fbf400a5170 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbf54079bb0 tx=0x7fbf4400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:39.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.621+0000 7fbf593d1700 1 --2- 172.21.15.50:0/422715644 >> [v2:172.21.15.122:6816/3484833116,v1:172.21.15.122:6817/3484833116] conn(0x7fbf400ade90 0x7fbf400b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:39.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.621+0000 7fbf593d1700 1 --2- 172.21.15.50:0/422715644 >> [v2:172.21.15.122:6816/3484833116,v1:172.21.15.122:6817/3484833116] conn(0x7fbf400ade90 0x7fbf400b0330 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:39.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.622+0000 7fbf51ffb700 1 -- 172.21.15.50:0/422715644 <== osd.8 v2:172.21.15.122:6816/3484833116 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbf3c00eec0 con 0x7fbf400ade90 2024-06-06T03:24:39.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.639+0000 7fbf5ae34700 1 -- 172.21.15.50:0/422715644 --> [v2:172.21.15.122:6816/3484833116,v1:172.21.15.122:6817/3484833116] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbf54063020 con 0x7fbf400ade90 2024-06-06T03:24:39.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.639+0000 7fbf51ffb700 1 -- 172.21.15.50:0/422715644 <== osd.8 v2:172.21.15.122:6816/3484833116 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbf54063020 con 0x7fbf400ade90 2024-06-06T03:24:39.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.639+0000 7fbf5ae34700 1 -- 172.21.15.50:0/422715644 >> [v2:172.21.15.122:6816/3484833116,v1:172.21.15.122:6817/3484833116] conn(0x7fbf400ade90 msgr2=0x7fbf400b0330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:39.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.639+0000 7fbf5ae34700 1 --2- 172.21.15.50:0/422715644 >> [v2:172.21.15.122:6816/3484833116,v1:172.21.15.122:6817/3484833116] conn(0x7fbf400ade90 0x7fbf400b0330 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:39.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.640+0000 7fbf5ae34700 1 -- 172.21.15.50:0/422715644 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbf400a2cb0 msgr2=0x7fbf400a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:39.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.640+0000 7fbf5ae34700 1 --2- 172.21.15.50:0/422715644 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbf400a2cb0 0x7fbf400a5170 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbf54079bb0 tx=0x7fbf4400a380 comp rx=0 tx=0).stop 2024-06-06T03:24:39.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.640+0000 7fbf5ae34700 1 -- 172.21.15.50:0/422715644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf54102510 msgr2=0x7fbf54074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:39.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.640+0000 7fbf5ae34700 1 --2- 172.21.15.50:0/422715644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf54102510 0x7fbf54074790 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00c970 tx=0x7fbf3c00cc80 comp rx=0 tx=0).stop 2024-06-06T03:24:39.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.640+0000 7fbf593d1700 1 -- 172.21.15.50:0/422715644 reap_dead start 2024-06-06T03:24:39.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.640+0000 7fbf5ae34700 1 -- 172.21.15.50:0/422715644 shutdown_connections 2024-06-06T03:24:39.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.640+0000 7fbf5ae34700 1 -- 172.21.15.50:0/422715644 >> 172.21.15.50:0/422715644 conn(0x7fbf540795b0 msgr2=0x7fbf54101160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:39.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.640+0000 7fbf5ae34700 1 -- 172.21.15.50:0/422715644 shutdown_connections 2024-06-06T03:24:39.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:39.640+0000 7fbf5ae34700 1 -- 172.21.15.50:0/422715644 wait complete. 2024-06-06T03:24:39.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:39 smithi122 ceph-mon[35759]: pgmap v371: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T03:24:40.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.815+0000 7fc48dfae700 1 -- 172.21.15.50:0/2843684298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc48806a170 msgr2=0x7fc48806a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:40.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.815+0000 7fc48dfae700 1 --2- 172.21.15.50:0/2843684298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc48806a170 0x7fc48806a5f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc470009990 tx=0x7fc470009ca0 comp rx=0 tx=0).stop 2024-06-06T03:24:40.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.815+0000 7fc48dfae700 1 -- 172.21.15.50:0/2843684298 shutdown_connections 2024-06-06T03:24:40.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.815+0000 7fc48dfae700 1 --2- 172.21.15.50:0/2843684298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc48806ab30 0x7fc48810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:40.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.815+0000 7fc48dfae700 1 --2- 172.21.15.50:0/2843684298 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc488108500 0x7fc4881088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:40.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.815+0000 7fc48dfae700 1 --2- 172.21.15.50:0/2843684298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc48806a170 0x7fc48806a5f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:40.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.815+0000 7fc48dfae700 1 -- 172.21.15.50:0/2843684298 >> 172.21.15.50:0/2843684298 conn(0x7fc488078340 msgr2=0x7fc488078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:40.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.815+0000 7fc48dfae700 1 -- 172.21.15.50:0/2843684298 shutdown_connections 2024-06-06T03:24:40.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.815+0000 7fc48dfae700 1 -- 172.21.15.50:0/2843684298 wait complete. 2024-06-06T03:24:40.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.816+0000 7fc48dfae700 1 Processor -- start 2024-06-06T03:24:40.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.816+0000 7fc48dfae700 1 -- start start 2024-06-06T03:24:40.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.816+0000 7fc48dfae700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc48806a170 0x7fc48819ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:40.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.816+0000 7fc48dfae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc48806ab30 0x7fc48819b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:40.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.816+0000 7fc48dfae700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc488108500 0x7fc48819f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:40.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.816+0000 7fc48dfae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc488112760 con 0x7fc48806ab30 2024-06-06T03:24:40.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.816+0000 7fc48dfae700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc4881125e0 con 0x7fc488108500 2024-06-06T03:24:40.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.816+0000 7fc48dfae700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc4881128e0 con 0x7fc48806a170 2024-06-06T03:24:40.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.816+0000 7fc47effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc48806ab30 0x7fc48819b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:40.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.816+0000 7fc47effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc48806ab30 0x7fc48819b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44200/0 (socket says 172.21.15.50:44200) 2024-06-06T03:24:40.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.816+0000 7fc47effd700 1 -- 172.21.15.50:0/2028149953 learned_addr learned my addr 172.21.15.50:0/2028149953 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:24:40.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.816+0000 7fc4877fe700 1 --2- 172.21.15.50:0/2028149953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc48806a170 0x7fc48819ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:40.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.816+0000 7fc487fff700 1 --2- 172.21.15.50:0/2028149953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc488108500 0x7fc48819f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:40.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.817+0000 7fc47effd700 1 -- 172.21.15.50:0/2028149953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc48806a170 msgr2=0x7fc48819ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:40.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.817+0000 7fc47effd700 1 --2- 172.21.15.50:0/2028149953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc48806a170 0x7fc48819ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:40.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.817+0000 7fc47effd700 1 -- 172.21.15.50:0/2028149953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc488108500 msgr2=0x7fc48819f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:40.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.817+0000 7fc47effd700 1 --2- 172.21.15.50:0/2028149953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc488108500 0x7fc48819f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:40.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.817+0000 7fc47effd700 1 -- 172.21.15.50:0/2028149953 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc48819fea0 con 0x7fc48806ab30 2024-06-06T03:24:40.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.817+0000 7fc47effd700 1 --2- 172.21.15.50:0/2028149953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc48806ab30 0x7fc48819b3d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc470000c00 tx=0x7fc4700057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:40.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.817+0000 7fc4857fa700 1 -- 172.21.15.50:0/2028149953 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc470027070 con 0x7fc48806ab30 2024-06-06T03:24:40.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.817+0000 7fc48dfae700 1 -- 172.21.15.50:0/2028149953 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4881a0130 con 0x7fc48806ab30 2024-06-06T03:24:40.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.817+0000 7fc4857fa700 1 -- 172.21.15.50:0/2028149953 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc470004090 con 0x7fc48806ab30 2024-06-06T03:24:40.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.817+0000 7fc4857fa700 1 -- 172.21.15.50:0/2028149953 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc470022e00 con 0x7fc48806ab30 2024-06-06T03:24:40.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.817+0000 7fc48dfae700 1 -- 172.21.15.50:0/2028149953 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4881a7a10 con 0x7fc48806ab30 2024-06-06T03:24:40.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.818+0000 7fc48dfae700 1 -- 172.21.15.50:0/2028149953 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc48810e0d0 con 0x7fc48806ab30 2024-06-06T03:24:40.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.819+0000 7fc4857fa700 1 -- 172.21.15.50:0/2028149953 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc47002a070 con 0x7fc48806ab30 2024-06-06T03:24:40.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.820+0000 7fc4857fa700 1 --2- 172.21.15.50:0/2028149953 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc4740a2cb0 0x7fc4740a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:40.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.820+0000 7fc4857fa700 1 -- 172.21.15.50:0/2028149953 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fc4700d0f30 con 0x7fc48806ab30 2024-06-06T03:24:40.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.820+0000 7fc4877fe700 1 --2- 172.21.15.50:0/2028149953 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc4740a2cb0 0x7fc4740a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:40.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.820+0000 7fc4857fa700 1 --2- 172.21.15.50:0/2028149953 >> [v2:172.21.15.79:6816/3504864579,v1:172.21.15.79:6817/3504864579] conn(0x7fc4740ade90 0x7fc4740b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:40.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.820+0000 7fc4857fa700 1 -- 172.21.15.50:0/2028149953 --> [v2:172.21.15.79:6816/3504864579,v1:172.21.15.79:6817/3504864579] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc4740b0a00 con 0x7fc4740ade90 2024-06-06T03:24:40.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.820+0000 7fc4857fa700 1 -- 172.21.15.50:0/2028149953 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7fc4700d1380 con 0x7fc48806ab30 2024-06-06T03:24:40.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.820+0000 7fc4877fe700 1 --2- 172.21.15.50:0/2028149953 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc4740a2cb0 0x7fc4740a5170 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc478009a10 tx=0x7fc478009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:40.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.821+0000 7fc487fff700 1 --2- 172.21.15.50:0/2028149953 >> [v2:172.21.15.79:6816/3504864579,v1:172.21.15.79:6817/3504864579] conn(0x7fc4740ade90 0x7fc4740b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:40.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.821+0000 7fc487fff700 1 --2- 172.21.15.50:0/2028149953 >> [v2:172.21.15.79:6816/3504864579,v1:172.21.15.79:6817/3504864579] conn(0x7fc4740ade90 0x7fc4740b0330 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:40.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.822+0000 7fc4857fa700 1 -- 172.21.15.50:0/2028149953 <== osd.7 v2:172.21.15.79:6816/3504864579 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc4740b0a00 con 0x7fc4740ade90 2024-06-06T03:24:40.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.838+0000 7fc48dfae700 1 -- 172.21.15.50:0/2028149953 --> [v2:172.21.15.79:6816/3504864579,v1:172.21.15.79:6817/3504864579] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc488103bc0 con 0x7fc4740ade90 2024-06-06T03:24:40.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.839+0000 7fc4857fa700 1 -- 172.21.15.50:0/2028149953 <== osd.7 v2:172.21.15.79:6816/3504864579 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc488103bc0 con 0x7fc4740ade90 2024-06-06T03:24:40.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.839+0000 7fc48dfae700 1 -- 172.21.15.50:0/2028149953 >> [v2:172.21.15.79:6816/3504864579,v1:172.21.15.79:6817/3504864579] conn(0x7fc4740ade90 msgr2=0x7fc4740b0330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:40.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.839+0000 7fc48dfae700 1 --2- 172.21.15.50:0/2028149953 >> [v2:172.21.15.79:6816/3504864579,v1:172.21.15.79:6817/3504864579] conn(0x7fc4740ade90 0x7fc4740b0330 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:40.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.839+0000 7fc48dfae700 1 -- 172.21.15.50:0/2028149953 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc4740a2cb0 msgr2=0x7fc4740a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:40.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.839+0000 7fc48dfae700 1 --2- 172.21.15.50:0/2028149953 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc4740a2cb0 0x7fc4740a5170 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc478009a10 tx=0x7fc478009190 comp rx=0 tx=0).stop 2024-06-06T03:24:40.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.839+0000 7fc48dfae700 1 -- 172.21.15.50:0/2028149953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc48806ab30 msgr2=0x7fc48819b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:40.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.839+0000 7fc48dfae700 1 --2- 172.21.15.50:0/2028149953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc48806ab30 0x7fc48819b3d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc470000c00 tx=0x7fc4700057c0 comp rx=0 tx=0).stop 2024-06-06T03:24:40.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.839+0000 7fc487fff700 1 -- 172.21.15.50:0/2028149953 reap_dead start 2024-06-06T03:24:40.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.840+0000 7fc48dfae700 1 -- 172.21.15.50:0/2028149953 shutdown_connections 2024-06-06T03:24:40.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.840+0000 7fc48dfae700 1 -- 172.21.15.50:0/2028149953 >> 172.21.15.50:0/2028149953 conn(0x7fc488078340 msgr2=0x7fc48810d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:40.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.840+0000 7fc48dfae700 1 -- 172.21.15.50:0/2028149953 shutdown_connections 2024-06-06T03:24:40.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.840+0000 7fc48dfae700 1 -- 172.21.15.50:0/2028149953 wait complete. 2024-06-06T03:24:41.280 INFO:teuthology.orchestra.run.smithi050.stdout:287762808883 2024-06-06T03:24:41.281 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-06-06T03:24:41.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:41 smithi050 ceph-mon[32421]: pgmap v372: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:24:41.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:41 smithi079 ceph-mon[35478]: pgmap v372: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:24:41.671 INFO:teuthology.orchestra.run.smithi050.stdout:343597383721 2024-06-06T03:24:41.671 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-06-06T03:24:41.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:41 smithi122 ceph-mon[35759]: pgmap v372: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:24:41.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.710+0000 7f5b14879700 1 -- 172.21.15.50:0/3566363156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b10101440 msgr2=0x7f5b1010f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:41.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.710+0000 7f5b14879700 1 --2- 172.21.15.50:0/3566363156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b10101440 0x7f5b1010f330 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800b0a0 tx=0x7f5b0800b3b0 comp rx=0 tx=0).stop 2024-06-06T03:24:41.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.710+0000 7f5b14879700 1 -- 172.21.15.50:0/3566363156 shutdown_connections 2024-06-06T03:24:41.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.710+0000 7f5b14879700 1 --2- 172.21.15.50:0/3566363156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b10101440 0x7f5b1010f330 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:41.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.710+0000 7f5b14879700 1 --2- 172.21.15.50:0/3566363156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b10108510 0x7f5b101088f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:41.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.710+0000 7f5b14879700 1 --2- 172.21.15.50:0/3566363156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b10100a80 0x7f5b10100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:41.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.710+0000 7f5b14879700 1 -- 172.21.15.50:0/3566363156 >> 172.21.15.50:0/3566363156 conn(0x7f5b10077a00 msgr2=0x7f5b100fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:41.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.710+0000 7f5b14879700 1 -- 172.21.15.50:0/3566363156 shutdown_connections 2024-06-06T03:24:41.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.710+0000 7f5b14879700 1 -- 172.21.15.50:0/3566363156 wait complete. 2024-06-06T03:24:41.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.711+0000 7f5b14879700 1 Processor -- start 2024-06-06T03:24:41.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.711+0000 7f5b14879700 1 -- start start 2024-06-06T03:24:41.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.711+0000 7f5b14879700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b10100a80 0x7f5b1019e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:41.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.711+0000 7f5b14879700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b10101440 0x7f5b1019ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:41.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.711+0000 7f5b14879700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b10108510 0x7f5b10198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:41.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.711+0000 7f5b14879700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5b10112620 con 0x7f5b10101440 2024-06-06T03:24:41.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.711+0000 7f5b14879700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5b101124a0 con 0x7f5b10100a80 2024-06-06T03:24:41.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.711+0000 7f5b14879700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5b101127a0 con 0x7f5b10108510 2024-06-06T03:24:41.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.711+0000 7f5b0dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b10101440 0x7f5b1019ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:41.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.711+0000 7f5b0dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b10101440 0x7f5b1019ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44184/0 (socket says 172.21.15.50:44184) 2024-06-06T03:24:41.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.711+0000 7f5b0dd9b700 1 -- 172.21.15.50:0/2239105836 learned_addr learned my addr 172.21.15.50:0/2239105836 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:24:41.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.711+0000 7f5b0e59c700 1 --2- 172.21.15.50:0/2239105836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b10100a80 0x7f5b1019e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:41.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.711+0000 7f5b0dd9b700 1 -- 172.21.15.50:0/2239105836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b10108510 msgr2=0x7f5b10198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:41.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.711+0000 7f5b0dd9b700 1 --2- 172.21.15.50:0/2239105836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b10108510 0x7f5b10198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:41.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.711+0000 7f5b0dd9b700 1 -- 172.21.15.50:0/2239105836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b10100a80 msgr2=0x7f5b1019e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:41.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.711+0000 7f5b0dd9b700 1 --2- 172.21.15.50:0/2239105836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b10100a80 0x7f5b1019e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:41.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.712+0000 7f5b0dd9b700 1 -- 172.21.15.50:0/2239105836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b10199080 con 0x7f5b10101440 2024-06-06T03:24:41.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.712+0000 7f5b0dd9b700 1 --2- 172.21.15.50:0/2239105836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b10101440 0x7f5b1019ec50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5b0400d950 tx=0x7f5b0400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:41.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.712+0000 7f5aff7fe700 1 -- 172.21.15.50:0/2239105836 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b04016070 con 0x7f5b10101440 2024-06-06T03:24:41.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.712+0000 7f5aff7fe700 1 -- 172.21.15.50:0/2239105836 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5b04009df0 con 0x7f5b10101440 2024-06-06T03:24:41.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.712+0000 7f5b14879700 1 -- 172.21.15.50:0/2239105836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b10199370 con 0x7f5b10101440 2024-06-06T03:24:41.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.712+0000 7f5aff7fe700 1 -- 172.21.15.50:0/2239105836 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0400f3c0 con 0x7f5b10101440 2024-06-06T03:24:41.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.712+0000 7f5b14879700 1 -- 172.21.15.50:0/2239105836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b101a55e0 con 0x7f5b10101440 2024-06-06T03:24:41.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.713+0000 7f5b14879700 1 -- 172.21.15.50:0/2239105836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5b10062c20 con 0x7f5b10101440 2024-06-06T03:24:41.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.714+0000 7f5aff7fe700 1 -- 172.21.15.50:0/2239105836 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5b04019070 con 0x7f5b10101440 2024-06-06T03:24:41.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.715+0000 7f5aff7fe700 1 --2- 172.21.15.50:0/2239105836 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f5af80a2cb0 0x7f5af80a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:41.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.715+0000 7f5aff7fe700 1 -- 172.21.15.50:0/2239105836 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f5b040cf6e0 con 0x7f5b10101440 2024-06-06T03:24:41.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.715+0000 7f5b0e59c700 1 --2- 172.21.15.50:0/2239105836 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f5af80a2cb0 0x7f5af80a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:41.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.715+0000 7f5aff7fe700 1 --2- 172.21.15.50:0/2239105836 >> [v2:172.21.15.122:6800/566397008,v1:172.21.15.122:6801/566397008] conn(0x7f5af80ade90 0x7f5af80b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:41.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.715+0000 7f5aff7fe700 1 -- 172.21.15.50:0/2239105836 --> [v2:172.21.15.122:6800/566397008,v1:172.21.15.122:6801/566397008] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5b04027ea0 con 0x7f5af80ade90 2024-06-06T03:24:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.715+0000 7f5aff7fe700 1 -- 172.21.15.50:0/2239105836 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7f5b040cfb30 con 0x7f5b10101440 2024-06-06T03:24:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.715+0000 7f5b0e59c700 1 --2- 172.21.15.50:0/2239105836 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f5af80a2cb0 0x7f5af80a5170 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5b100fe490 tx=0x7f5b0000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.716+0000 7f5b0ed9d700 1 --2- 172.21.15.50:0/2239105836 >> [v2:172.21.15.122:6800/566397008,v1:172.21.15.122:6801/566397008] conn(0x7f5af80ade90 0x7f5af80b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.716+0000 7f5b0ed9d700 1 --2- 172.21.15.50:0/2239105836 >> [v2:172.21.15.122:6800/566397008,v1:172.21.15.122:6801/566397008] conn(0x7f5af80ade90 0x7f5af80b0330 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.717+0000 7f5aff7fe700 1 -- 172.21.15.50:0/2239105836 <== osd.2 v2:172.21.15.122:6800/566397008 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5b04027ea0 con 0x7f5af80ade90 2024-06-06T03:24:41.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.733+0000 7f5b14879700 1 -- 172.21.15.50:0/2239105836 --> [v2:172.21.15.122:6800/566397008,v1:172.21.15.122:6801/566397008] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5b10063020 con 0x7f5af80ade90 2024-06-06T03:24:41.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.734+0000 7f5aff7fe700 1 -- 172.21.15.50:0/2239105836 <== osd.2 v2:172.21.15.122:6800/566397008 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5b10063020 con 0x7f5af80ade90 2024-06-06T03:24:41.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.734+0000 7f5b14879700 1 -- 172.21.15.50:0/2239105836 >> [v2:172.21.15.122:6800/566397008,v1:172.21.15.122:6801/566397008] conn(0x7f5af80ade90 msgr2=0x7f5af80b0330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:41.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.734+0000 7f5b14879700 1 --2- 172.21.15.50:0/2239105836 >> [v2:172.21.15.122:6800/566397008,v1:172.21.15.122:6801/566397008] conn(0x7f5af80ade90 0x7f5af80b0330 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:41.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.735+0000 7f5b14879700 1 -- 172.21.15.50:0/2239105836 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f5af80a2cb0 msgr2=0x7f5af80a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:41.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.735+0000 7f5b14879700 1 --2- 172.21.15.50:0/2239105836 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f5af80a2cb0 0x7f5af80a5170 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5b100fe490 tx=0x7f5b0000b410 comp rx=0 tx=0).stop 2024-06-06T03:24:41.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.735+0000 7f5b14879700 1 -- 172.21.15.50:0/2239105836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b10101440 msgr2=0x7f5b1019ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:41.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.735+0000 7f5b14879700 1 --2- 172.21.15.50:0/2239105836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b10101440 0x7f5b1019ec50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5b0400d950 tx=0x7f5b0400dc60 comp rx=0 tx=0).stop 2024-06-06T03:24:41.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.735+0000 7f5b0ed9d700 1 -- 172.21.15.50:0/2239105836 reap_dead start 2024-06-06T03:24:41.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.735+0000 7f5b14879700 1 -- 172.21.15.50:0/2239105836 shutdown_connections 2024-06-06T03:24:41.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.735+0000 7f5b14879700 1 -- 172.21.15.50:0/2239105836 >> 172.21.15.50:0/2239105836 conn(0x7f5b10077a00 msgr2=0x7f5b100ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:41.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.735+0000 7f5b14879700 1 -- 172.21.15.50:0/2239105836 shutdown_connections 2024-06-06T03:24:41.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:40.735+0000 7f5b14879700 1 -- 172.21.15.50:0/2239105836 wait complete. 2024-06-06T03:24:42.388 INFO:teuthology.orchestra.run.smithi050.stdout:77309411416 2024-06-06T03:24:42.389 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-06-06T03:24:43.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:43 smithi050 ceph-mon[32421]: pgmap v373: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:24:43.575 INFO:teuthology.orchestra.run.smithi050.stdout:253403070520 2024-06-06T03:24:43.575 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-06-06T03:24:43.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:43 smithi079 ceph-mon[35478]: pgmap v373: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:24:43.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:43 smithi122 ceph-mon[35759]: pgmap v373: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:24:44.130 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:24:44.132 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:24:44.145 INFO:teuthology.orchestra.run.smithi050.stdout:141733920844 2024-06-06T03:24:44.145 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-06-06T03:24:44.350 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:44 smithi050 ceph-mon[32421]: pgmap v374: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:24:44.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:44 smithi079 ceph-mon[35478]: pgmap v374: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:24:44.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:44 smithi122 ceph-mon[35759]: pgmap v374: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:24:44.702 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:24:44.702 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:24:44.736 INFO:teuthology.orchestra.run.smithi050.stdout:219043332158 2024-06-06T03:24:44.736 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-06-06T03:24:45.727 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:24:45.729 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:24:45.730 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:24:45.743 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:24:46.492 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:46 smithi050 ceph-mon[32421]: pgmap v375: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-06-06T03:24:46.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:46 smithi122 ceph-mon[35759]: pgmap v375: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-06-06T03:24:46.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:46 smithi079 ceph-mon[35478]: pgmap v375: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-06-06T03:24:48.678 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:48 smithi050 ceph-mon[32421]: pgmap v376: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:24:48.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:48 smithi122 ceph-mon[35759]: pgmap v376: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:24:48.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:48 smithi079 ceph-mon[35478]: pgmap v376: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:24:50.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.145+0000 7f8f276e4700 1 -- 172.21.15.50:0/2131855110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f2006b520 msgr2=0x7f8f2010f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:50.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.145+0000 7f8f276e4700 1 --2- 172.21.15.50:0/2131855110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f2006b520 0x7f8f2010f340 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8f1800b0a0 tx=0x7f8f1800b3b0 comp rx=0 tx=0).stop 2024-06-06T03:24:50.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.146+0000 7f8f276e4700 1 -- 172.21.15.50:0/2131855110 shutdown_connections 2024-06-06T03:24:50.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.146+0000 7f8f276e4700 1 --2- 172.21.15.50:0/2131855110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f2006b520 0x7f8f2010f340 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:50.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.146+0000 7f8f276e4700 1 --2- 172.21.15.50:0/2131855110 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f20108520 0x7f8f20108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:50.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.146+0000 7f8f276e4700 1 --2- 172.21.15.50:0/2131855110 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f2006ab60 0x7f8f2006afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:50.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.146+0000 7f8f276e4700 1 -- 172.21.15.50:0/2131855110 >> 172.21.15.50:0/2131855110 conn(0x7f8f20078340 msgr2=0x7f8f20078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:50.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.146+0000 7f8f276e4700 1 -- 172.21.15.50:0/2131855110 shutdown_connections 2024-06-06T03:24:50.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.146+0000 7f8f276e4700 1 -- 172.21.15.50:0/2131855110 wait complete. 2024-06-06T03:24:50.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.146+0000 7f8f276e4700 1 Processor -- start 2024-06-06T03:24:50.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.146+0000 7f8f276e4700 1 -- start start 2024-06-06T03:24:50.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.147+0000 7f8f276e4700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f2006ab60 0x7f8f2019e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:50.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.147+0000 7f8f276e4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f2006b520 0x7f8f2019ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:50.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.147+0000 7f8f276e4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f20108520 0x7f8f20198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:50.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.147+0000 7f8f276e4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8f20112650 con 0x7f8f2006b520 2024-06-06T03:24:50.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.147+0000 7f8f276e4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8f201124d0 con 0x7f8f20108520 2024-06-06T03:24:50.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.147+0000 7f8f276e4700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8f201127d0 con 0x7f8f2006ab60 2024-06-06T03:24:50.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.147+0000 7f8f24c7f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f2006b520 0x7f8f2019ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:50.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.147+0000 7f8f24c7f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f2006b520 0x7f8f2019ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60874/0 (socket says 172.21.15.50:60874) 2024-06-06T03:24:50.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.147+0000 7f8f24c7f700 1 -- 172.21.15.50:0/1569909492 learned_addr learned my addr 172.21.15.50:0/1569909492 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:24:50.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.147+0000 7f8f25480700 1 --2- 172.21.15.50:0/1569909492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f2006ab60 0x7f8f2019e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:50.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.147+0000 7f8f25c81700 1 --2- 172.21.15.50:0/1569909492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f20108520 0x7f8f20198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:50.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.147+0000 7f8f24c7f700 1 -- 172.21.15.50:0/1569909492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f2006ab60 msgr2=0x7f8f2019e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:50.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.147+0000 7f8f24c7f700 1 --2- 172.21.15.50:0/1569909492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f2006ab60 0x7f8f2019e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:50.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.147+0000 7f8f24c7f700 1 -- 172.21.15.50:0/1569909492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f20108520 msgr2=0x7f8f20198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:50.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.147+0000 7f8f24c7f700 1 --2- 172.21.15.50:0/1569909492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f20108520 0x7f8f20198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:50.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.147+0000 7f8f24c7f700 1 -- 172.21.15.50:0/1569909492 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f201990b0 con 0x7f8f2006b520 2024-06-06T03:24:50.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.147+0000 7f8f24c7f700 1 --2- 172.21.15.50:0/1569909492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f2006b520 0x7f8f2019ec80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8f1000d980 tx=0x7f8f1000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:50.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.148+0000 7f8f167fc700 1 -- 172.21.15.50:0/1569909492 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f10017070 con 0x7f8f2006b520 2024-06-06T03:24:50.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.148+0000 7f8f276e4700 1 -- 172.21.15.50:0/1569909492 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f201993a0 con 0x7f8f2006b520 2024-06-06T03:24:50.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.148+0000 7f8f167fc700 1 -- 172.21.15.50:0/1569909492 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8f10005020 con 0x7f8f2006b520 2024-06-06T03:24:50.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.148+0000 7f8f167fc700 1 -- 172.21.15.50:0/1569909492 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1000fa90 con 0x7f8f2006b520 2024-06-06T03:24:50.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.148+0000 7f8f276e4700 1 -- 172.21.15.50:0/1569909492 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f201a5610 con 0x7f8f2006b520 2024-06-06T03:24:50.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.149+0000 7f8f276e4700 1 -- 172.21.15.50:0/1569909492 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f20103be0 con 0x7f8f2006b520 2024-06-06T03:24:50.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.151+0000 7f8f167fc700 1 -- 172.21.15.50:0/1569909492 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8f100051d0 con 0x7f8f2006b520 2024-06-06T03:24:50.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.152+0000 7f8f167fc700 1 --2- 172.21.15.50:0/1569909492 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8f0c0a2cb0 0x7f8f0c0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:50.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.152+0000 7f8f25480700 1 --2- 172.21.15.50:0/1569909492 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8f0c0a2cb0 0x7f8f0c0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:50.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.152+0000 7f8f167fc700 1 -- 172.21.15.50:0/1569909492 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f8f100cf830 con 0x7f8f2006b520 2024-06-06T03:24:50.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.152+0000 7f8f25480700 1 --2- 172.21.15.50:0/1569909492 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8f0c0a2cb0 0x7f8f0c0a5170 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8f200ffe40 tx=0x7f8f1c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:50.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.155+0000 7f8f167fc700 1 -- 172.21.15.50:0/1569909492 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8f10020020 con 0x7f8f2006b520 2024-06-06T03:24:50.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.066+0000 7f15b5f34700 1 -- 172.21.15.50:0/3202204316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15b0101390 msgr2=0x7f15b0101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:50.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.066+0000 7f15b5f34700 1 --2- 172.21.15.50:0/3202204316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15b0101390 0x7f15b0101810 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f15a4009990 tx=0x7f15a4009ca0 comp rx=0 tx=0).stop 2024-06-06T03:24:50.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.066+0000 7f15b5f34700 1 -- 172.21.15.50:0/3202204316 shutdown_connections 2024-06-06T03:24:50.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.066+0000 7f15b5f34700 1 --2- 172.21.15.50:0/3202204316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15b0101d50 0x7f15b010e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:50.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.066+0000 7f15b5f34700 1 --2- 172.21.15.50:0/3202204316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15b0107400 0x7f15b01077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.066+0000 7f15b5f34700 1 --2- 172.21.15.50:0/3202204316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15b0101390 0x7f15b0101810 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.066+0000 7f15b5f34700 1 -- 172.21.15.50:0/3202204316 >> 172.21.15.50:0/3202204316 conn(0x7f15b0078340 msgr2=0x7f15b0078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.066+0000 7f15b5f34700 1 -- 172.21.15.50:0/3202204316 shutdown_connections 2024-06-06T03:24:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.066+0000 7f15b5f34700 1 -- 172.21.15.50:0/3202204316 wait complete. 2024-06-06T03:24:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.066+0000 7f15b5f34700 1 Processor -- start 2024-06-06T03:24:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.067+0000 7f15b5f34700 1 -- start start 2024-06-06T03:24:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.067+0000 7f15b5f34700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15b0101390 0x7f15b01999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.067+0000 7f15b5f34700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15b0101d50 0x7f15b0199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.067+0000 7f15b5f34700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15b0107400 0x7f15b01a4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.067+0000 7f15b5f34700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f15b0111540 con 0x7f15b0107400 2024-06-06T03:24:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.067+0000 7f15b5f34700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f15b01113c0 con 0x7f15b0101390 2024-06-06T03:24:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.067+0000 7f15b5f34700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f15b01116c0 con 0x7f15b0101d50 2024-06-06T03:24:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.067+0000 7f15affff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15b0107400 0x7f15b01a4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.067+0000 7f15affff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15b0107400 0x7f15b01a4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60866/0 (socket says 172.21.15.50:60866) 2024-06-06T03:24:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.067+0000 7f15affff700 1 -- 172.21.15.50:0/3417561664 learned_addr learned my addr 172.21.15.50:0/3417561664 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:24:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.067+0000 7f15af7fe700 1 --2- 172.21.15.50:0/3417561664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15b0101390 0x7f15b01999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.067+0000 7f15aeffd700 1 --2- 172.21.15.50:0/3417561664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15b0101d50 0x7f15b0199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.067+0000 7f15affff700 1 -- 172.21.15.50:0/3417561664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15b0101d50 msgr2=0x7f15b0199ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.067+0000 7f15affff700 1 --2- 172.21.15.50:0/3417561664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15b0101d50 0x7f15b0199ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.067+0000 7f15affff700 1 -- 172.21.15.50:0/3417561664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15b0101390 msgr2=0x7f15b01999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.067+0000 7f15affff700 1 --2- 172.21.15.50:0/3417561664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15b0101390 0x7f15b01999a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.067+0000 7f15affff700 1 -- 172.21.15.50:0/3417561664 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b01a4f60 con 0x7f15b0107400 2024-06-06T03:24:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.067+0000 7f15aeffd700 1 --2- 172.21.15.50:0/3417561664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15b0101d50 0x7f15b0199ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:24:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.067+0000 7f15af7fe700 1 --2- 172.21.15.50:0/3417561664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15b0101390 0x7f15b01999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:24:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.068+0000 7f15affff700 1 --2- 172.21.15.50:0/3417561664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15b0107400 0x7f15b01a4a20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f15a8007ee0 tx=0x7f15a800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.068+0000 7f15acff9700 1 -- 172.21.15.50:0/3417561664 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a800dbd0 con 0x7f15b0107400 2024-06-06T03:24:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.068+0000 7f15acff9700 1 -- 172.21.15.50:0/3417561664 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f15a800dd70 con 0x7f15b0107400 2024-06-06T03:24:50.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.068+0000 7f15b5f34700 1 -- 172.21.15.50:0/3417561664 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15b01a5190 con 0x7f15b0107400 2024-06-06T03:24:50.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.068+0000 7f15acff9700 1 -- 172.21.15.50:0/3417561664 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a8005a20 con 0x7f15b0107400 2024-06-06T03:24:50.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.068+0000 7f15b5f34700 1 -- 172.21.15.50:0/3417561664 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15b01a56f0 con 0x7f15b0107400 2024-06-06T03:24:50.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.069+0000 7f15b5f34700 1 -- 172.21.15.50:0/3417561664 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f15b0062ba0 con 0x7f15b0107400 2024-06-06T03:24:50.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.070+0000 7f15acff9700 1 -- 172.21.15.50:0/3417561664 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f15a801a020 con 0x7f15b0107400 2024-06-06T03:24:50.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.071+0000 7f15acff9700 1 --2- 172.21.15.50:0/3417561664 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f15980a2d30 0x7f15980a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:50.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.071+0000 7f15af7fe700 1 --2- 172.21.15.50:0/3417561664 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f15980a2d30 0x7f15980a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:50.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.071+0000 7f15acff9700 1 -- 172.21.15.50:0/3417561664 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f15a80cf410 con 0x7f15b0107400 2024-06-06T03:24:50.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.071+0000 7f15acff9700 1 --2- 172.21.15.50:0/3417561664 >> [v2:172.21.15.79:6824/2740366543,v1:172.21.15.79:6825/2740366543] conn(0x7f15980adf10 0x7f15980b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:50.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.071+0000 7f15acff9700 1 -- 172.21.15.50:0/3417561664 --> [v2:172.21.15.79:6824/2740366543,v1:172.21.15.79:6825/2740366543] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f15a8009390 con 0x7f15980adf10 2024-06-06T03:24:50.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.071+0000 7f15acff9700 1 -- 172.21.15.50:0/3417561664 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7f15a80cf7c0 con 0x7f15b0107400 2024-06-06T03:24:50.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.071+0000 7f15af7fe700 1 --2- 172.21.15.50:0/3417561664 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f15980a2d30 0x7f15980a51f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f15a0005e10 tx=0x7f15a0005d80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:50.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.072+0000 7f15aeffd700 1 --2- 172.21.15.50:0/3417561664 >> [v2:172.21.15.79:6824/2740366543,v1:172.21.15.79:6825/2740366543] conn(0x7f15980adf10 0x7f15980b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:50.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.072+0000 7f15aeffd700 1 --2- 172.21.15.50:0/3417561664 >> [v2:172.21.15.79:6824/2740366543,v1:172.21.15.79:6825/2740366543] conn(0x7f15980adf10 0x7f15980b03b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:50.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.073+0000 7f15acff9700 1 -- 172.21.15.50:0/3417561664 <== osd.10 v2:172.21.15.79:6824/2740366543 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f15a8009390 con 0x7f15980adf10 2024-06-06T03:24:50.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.089+0000 7f15b5f34700 1 -- 172.21.15.50:0/3417561664 --> [v2:172.21.15.79:6824/2740366543,v1:172.21.15.79:6825/2740366543] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f15b0063020 con 0x7f15980adf10 2024-06-06T03:24:50.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.090+0000 7f15acff9700 1 -- 172.21.15.50:0/3417561664 <== osd.10 v2:172.21.15.79:6824/2740366543 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f15b0063020 con 0x7f15980adf10 2024-06-06T03:24:50.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.090+0000 7f15b5f34700 1 -- 172.21.15.50:0/3417561664 >> [v2:172.21.15.79:6824/2740366543,v1:172.21.15.79:6825/2740366543] conn(0x7f15980adf10 msgr2=0x7f15980b03b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:50.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.090+0000 7f15b5f34700 1 --2- 172.21.15.50:0/3417561664 >> [v2:172.21.15.79:6824/2740366543,v1:172.21.15.79:6825/2740366543] conn(0x7f15980adf10 0x7f15980b03b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:50.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.090+0000 7f15b5f34700 1 -- 172.21.15.50:0/3417561664 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f15980a2d30 msgr2=0x7f15980a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:50.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.090+0000 7f15b5f34700 1 --2- 172.21.15.50:0/3417561664 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f15980a2d30 0x7f15980a51f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f15a0005e10 tx=0x7f15a0005d80 comp rx=0 tx=0).stop 2024-06-06T03:24:50.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.090+0000 7f15b5f34700 1 -- 172.21.15.50:0/3417561664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15b0107400 msgr2=0x7f15b01a4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:50.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.090+0000 7f15b5f34700 1 --2- 172.21.15.50:0/3417561664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15b0107400 0x7f15b01a4a20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f15a8007ee0 tx=0x7f15a800d3b0 comp rx=0 tx=0).stop 2024-06-06T03:24:50.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.091+0000 7f15affff700 1 -- 172.21.15.50:0/3417561664 reap_dead start 2024-06-06T03:24:50.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.091+0000 7f15b5f34700 1 -- 172.21.15.50:0/3417561664 shutdown_connections 2024-06-06T03:24:50.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.091+0000 7f15b5f34700 1 -- 172.21.15.50:0/3417561664 >> 172.21.15.50:0/3417561664 conn(0x7f15b0078340 msgr2=0x7f15b00fff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:50.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.091+0000 7f15b5f34700 1 -- 172.21.15.50:0/3417561664 shutdown_connections 2024-06-06T03:24:50.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.091+0000 7f15b5f34700 1 -- 172.21.15.50:0/3417561664 wait complete. 2024-06-06T03:24:50.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.369+0000 7f8f276e4700 1 -- 172.21.15.50:0/1569909492 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f8f2002dca0 con 0x7f8f2006b520 2024-06-06T03:24:50.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.370+0000 7f8f167fc700 1 -- 172.21.15.50:0/1569909492 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8f1009c250 con 0x7f8f2006b520 2024-06-06T03:24:50.370 INFO:teuthology.orchestra.run.smithi050.stdout:34359738467 2024-06-06T03:24:50.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.372+0000 7f8f276e4700 1 -- 172.21.15.50:0/1569909492 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8f0c0a2cb0 msgr2=0x7f8f0c0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:50.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.372+0000 7f8f276e4700 1 --2- 172.21.15.50:0/1569909492 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8f0c0a2cb0 0x7f8f0c0a5170 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8f200ffe40 tx=0x7f8f1c00b410 comp rx=0 tx=0).stop 2024-06-06T03:24:50.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.372+0000 7f8f276e4700 1 -- 172.21.15.50:0/1569909492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f2006b520 msgr2=0x7f8f2019ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:50.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.372+0000 7f8f276e4700 1 --2- 172.21.15.50:0/1569909492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f2006b520 0x7f8f2019ec80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8f1000d980 tx=0x7f8f1000dc90 comp rx=0 tx=0).stop 2024-06-06T03:24:50.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.372+0000 7f8f276e4700 1 -- 172.21.15.50:0/1569909492 shutdown_connections 2024-06-06T03:24:50.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.372+0000 7f8f276e4700 1 --2- 172.21.15.50:0/1569909492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f20108520 0x7f8f20198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:50.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.372+0000 7f8f276e4700 1 --2- 172.21.15.50:0/1569909492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f2006ab60 0x7f8f2019e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:50.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.372+0000 7f8f276e4700 1 --2- 172.21.15.50:0/1569909492 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8f0c0a2cb0 0x7f8f0c0a5170 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:50.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.372+0000 7f8f276e4700 1 --2- 172.21.15.50:0/1569909492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f2006b520 0x7f8f2019ec80 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:50.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.372+0000 7f8f276e4700 1 -- 172.21.15.50:0/1569909492 >> 172.21.15.50:0/1569909492 conn(0x7f8f20078340 msgr2=0x7f8f201004e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:50.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.372+0000 7f8f276e4700 1 -- 172.21.15.50:0/1569909492 shutdown_connections 2024-06-06T03:24:50.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:50.372+0000 7f8f276e4700 1 -- 172.21.15.50:0/1569909492 wait complete. 2024-06-06T03:24:50.562 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:50 smithi050 ceph-mon[32421]: pgmap v377: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:24:50.562 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:50 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1569909492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-06T03:24:50.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:50 smithi079 ceph-mon[35478]: pgmap v377: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:24:50.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:50 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/1569909492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-06T03:24:50.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:50 smithi122 ceph-mon[35759]: pgmap v377: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:24:50.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:50 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/1569909492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-06T03:24:52.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:52 smithi050 ceph-mon[32421]: pgmap v378: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-06T03:24:52.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:52 smithi079 ceph-mon[35478]: pgmap v378: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-06T03:24:52.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:52 smithi122 ceph-mon[35759]: pgmap v378: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-06T03:24:53.213 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:24:54.143 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:24:54.143 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:24:54.176 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738464 got 34359738467 for osd.0 2024-06-06T03:24:54.176 DEBUG:teuthology.parallel:result is None 2024-06-06T03:24:54.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:54 smithi050 ceph-mon[32421]: pgmap v379: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-06T03:24:54.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:54 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/4012176144' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-06T03:24:54.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:54 smithi079 ceph-mon[35478]: pgmap v379: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-06T03:24:54.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:54 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/4012176144' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-06T03:24:54.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:54 smithi122 ceph-mon[35759]: pgmap v379: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-06T03:24:54.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:54 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/4012176144' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-06T03:24:55.870 INFO:teuthology.orchestra.run.smithi050.stdout:309237645359 2024-06-06T03:24:55.870 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-06-06T03:24:56.691 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:56 smithi050 ceph-mon[32421]: pgmap v380: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:24:56.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:56 smithi079 ceph-mon[35478]: pgmap v380: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:24:56.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:56 smithi122 ceph-mon[35759]: pgmap v380: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:24:58.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.163+0000 7fb8bd1a4700 1 -- 172.21.15.50:0/642394640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8b8108500 msgr2=0x7fb8b81088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:58.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.163+0000 7fb8bd1a4700 1 --2- 172.21.15.50:0/642394640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8b8108500 0x7fb8b81088e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009990 tx=0x7fb8a8009ca0 comp rx=0 tx=0).stop 2024-06-06T03:24:58.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.163+0000 7fb8bd1a4700 1 -- 172.21.15.50:0/642394640 shutdown_connections 2024-06-06T03:24:58.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.163+0000 7fb8bd1a4700 1 --2- 172.21.15.50:0/642394640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8b806ab30 0x7fb8b810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:58.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.163+0000 7fb8bd1a4700 1 --2- 172.21.15.50:0/642394640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8b8108500 0x7fb8b81088e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:58.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.163+0000 7fb8bd1a4700 1 --2- 172.21.15.50:0/642394640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8b806a170 0x7fb8b806a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:58.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.163+0000 7fb8bd1a4700 1 -- 172.21.15.50:0/642394640 >> 172.21.15.50:0/642394640 conn(0x7fb8b8078340 msgr2=0x7fb8b8078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:58.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.163+0000 7fb8bd1a4700 1 -- 172.21.15.50:0/642394640 shutdown_connections 2024-06-06T03:24:58.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.163+0000 7fb8bd1a4700 1 -- 172.21.15.50:0/642394640 wait complete. 2024-06-06T03:24:58.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.164+0000 7fb8bd1a4700 1 Processor -- start 2024-06-06T03:24:58.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.164+0000 7fb8bd1a4700 1 -- start start 2024-06-06T03:24:58.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.164+0000 7fb8bd1a4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8b806a170 0x7fb8b8101460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:58.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.164+0000 7fb8bd1a4700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8b806ab30 0x7fb8b81019a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:58.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.164+0000 7fb8bd1a4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8b8108500 0x7fb8b8101ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:58.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.164+0000 7fb8bd1a4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b8112610 con 0x7fb8b8108500 2024-06-06T03:24:58.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.164+0000 7fb8bd1a4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b8112490 con 0x7fb8b806a170 2024-06-06T03:24:58.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.164+0000 7fb8bd1a4700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b8112790 con 0x7fb8b806ab30 2024-06-06T03:24:58.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.165+0000 7fb8b759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8b8108500 0x7fb8b8101ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:58.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.165+0000 7fb8b759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8b8108500 0x7fb8b8101ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52900/0 (socket says 172.21.15.50:52900) 2024-06-06T03:24:58.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.165+0000 7fb8b759e700 1 -- 172.21.15.50:0/2481494175 learned_addr learned my addr 172.21.15.50:0/2481494175 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:24:58.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.165+0000 7fb8b6d9d700 1 --2- 172.21.15.50:0/2481494175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8b806a170 0x7fb8b8101460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:58.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.165+0000 7fb8b659c700 1 --2- 172.21.15.50:0/2481494175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8b806ab30 0x7fb8b81019a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:58.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.165+0000 7fb8b759e700 1 -- 172.21.15.50:0/2481494175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8b806ab30 msgr2=0x7fb8b81019a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:58.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.165+0000 7fb8b759e700 1 --2- 172.21.15.50:0/2481494175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8b806ab30 0x7fb8b81019a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:58.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.165+0000 7fb8b759e700 1 -- 172.21.15.50:0/2481494175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8b806a170 msgr2=0x7fb8b8101460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:58.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.165+0000 7fb8b759e700 1 --2- 172.21.15.50:0/2481494175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8b806a170 0x7fb8b8101460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:58.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.165+0000 7fb8b759e700 1 -- 172.21.15.50:0/2481494175 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8b81a6f70 con 0x7fb8b8108500 2024-06-06T03:24:58.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.165+0000 7fb8b759e700 1 --2- 172.21.15.50:0/2481494175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8b8108500 0x7fb8b8101ee0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0007d70 tx=0x7fb8b000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:58.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.165+0000 7fb8affff700 1 -- 172.21.15.50:0/2481494175 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0016020 con 0x7fb8b8108500 2024-06-06T03:24:58.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.165+0000 7fb8bd1a4700 1 -- 172.21.15.50:0/2481494175 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8b81a7260 con 0x7fb8b8108500 2024-06-06T03:24:58.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.165+0000 7fb8affff700 1 -- 172.21.15.50:0/2481494175 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb8b000ac90 con 0x7fb8b8108500 2024-06-06T03:24:58.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.165+0000 7fb8affff700 1 -- 172.21.15.50:0/2481494175 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b00115e0 con 0x7fb8b8108500 2024-06-06T03:24:58.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.166+0000 7fb8bd1a4700 1 -- 172.21.15.50:0/2481494175 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8b81a77a0 con 0x7fb8b8108500 2024-06-06T03:24:58.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.166+0000 7fb8bd1a4700 1 -- 172.21.15.50:0/2481494175 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8b810a9e0 con 0x7fb8b8108500 2024-06-06T03:24:58.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.168+0000 7fb8affff700 1 -- 172.21.15.50:0/2481494175 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb8b0019020 con 0x7fb8b8108500 2024-06-06T03:24:58.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.168+0000 7fb8affff700 1 --2- 172.21.15.50:0/2481494175 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb8a40a2cb0 0x7fb8a40a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:58.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.169+0000 7fb8b6d9d700 1 --2- 172.21.15.50:0/2481494175 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb8a40a2cb0 0x7fb8a40a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:58.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.169+0000 7fb8affff700 1 -- 172.21.15.50:0/2481494175 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fb8b00cf810 con 0x7fb8b8108500 2024-06-06T03:24:58.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.169+0000 7fb8b6d9d700 1 --2- 172.21.15.50:0/2481494175 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb8a40a2cb0 0x7fb8a40a5170 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb8a80098e0 tx=0x7fb8a8005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:58.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.172+0000 7fb8affff700 1 -- 172.21.15.50:0/2481494175 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb8b0020020 con 0x7fb8b8108500 2024-06-06T03:24:58.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.386+0000 7fb8bd1a4700 1 -- 172.21.15.50:0/2481494175 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb8b8102990 con 0x7fb8b8108500 2024-06-06T03:24:58.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.386+0000 7fb8affff700 1 -- 172.21.15.50:0/2481494175 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb8b001ae40 con 0x7fb8b8108500 2024-06-06T03:24:58.388 INFO:teuthology.orchestra.run.smithi050.stdout:55834574943 2024-06-06T03:24:58.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.389+0000 7fb8bd1a4700 1 -- 172.21.15.50:0/2481494175 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb8a40a2cb0 msgr2=0x7fb8a40a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:58.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.389+0000 7fb8bd1a4700 1 --2- 172.21.15.50:0/2481494175 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb8a40a2cb0 0x7fb8a40a5170 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb8a80098e0 tx=0x7fb8a8005960 comp rx=0 tx=0).stop 2024-06-06T03:24:58.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.389+0000 7fb8bd1a4700 1 -- 172.21.15.50:0/2481494175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8b8108500 msgr2=0x7fb8b8101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:58.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.389+0000 7fb8bd1a4700 1 --2- 172.21.15.50:0/2481494175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8b8108500 0x7fb8b8101ee0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0007d70 tx=0x7fb8b000a340 comp rx=0 tx=0).stop 2024-06-06T03:24:58.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.389+0000 7fb8bd1a4700 1 -- 172.21.15.50:0/2481494175 shutdown_connections 2024-06-06T03:24:58.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.389+0000 7fb8bd1a4700 1 --2- 172.21.15.50:0/2481494175 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb8a40a2cb0 0x7fb8a40a5170 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:58.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.389+0000 7fb8bd1a4700 1 --2- 172.21.15.50:0/2481494175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8b8108500 0x7fb8b8101ee0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:58.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.389+0000 7fb8bd1a4700 1 --2- 172.21.15.50:0/2481494175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8b806a170 0x7fb8b8101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:58.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.389+0000 7fb8bd1a4700 1 --2- 172.21.15.50:0/2481494175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8b806ab30 0x7fb8b81019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:58.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.389+0000 7fb8bd1a4700 1 -- 172.21.15.50:0/2481494175 >> 172.21.15.50:0/2481494175 conn(0x7fb8b8078340 msgr2=0x7fb8b80ffe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:58.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.389+0000 7fb8bd1a4700 1 -- 172.21.15.50:0/2481494175 shutdown_connections 2024-06-06T03:24:58.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:58.389+0000 7fb8bd1a4700 1 -- 172.21.15.50:0/2481494175 wait complete. 2024-06-06T03:24:58.708 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:58 smithi050 ceph-mon[32421]: pgmap v381: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:24:58.708 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:24:58 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/2481494175' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-06T03:24:58.732 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:58 smithi122 ceph-mon[35759]: pgmap v381: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:24:58.733 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:24:58 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/2481494175' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-06T03:24:58.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:58 smithi079 ceph-mon[35478]: pgmap v381: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:24:58.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:24:58 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/2481494175' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-06T03:24:59.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.819+0000 7fe5874c6700 1 -- 172.21.15.50:0/248055363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5801027a0 msgr2=0x7fe580106020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:59.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.819+0000 7fe5874c6700 1 --2- 172.21.15.50:0/248055363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5801027a0 0x7fe580106020 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe5700099c0 tx=0x7fe570009cd0 comp rx=0 tx=0).stop 2024-06-06T03:24:59.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.819+0000 7fe5874c6700 1 -- 172.21.15.50:0/248055363 shutdown_connections 2024-06-06T03:24:59.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.819+0000 7fe5874c6700 1 --2- 172.21.15.50:0/248055363 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe580106750 0x7fe58010e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:59.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.819+0000 7fe5874c6700 1 --2- 172.21.15.50:0/248055363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe580101df0 0x7fe5801021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:59.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.819+0000 7fe5874c6700 1 --2- 172.21.15.50:0/248055363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5801027a0 0x7fe580106020 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:59.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.819+0000 7fe5874c6700 1 -- 172.21.15.50:0/248055363 >> 172.21.15.50:0/248055363 conn(0x7fe580077a00 msgr2=0x7fe5800fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:24:59.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.819+0000 7fe5874c6700 1 -- 172.21.15.50:0/248055363 shutdown_connections 2024-06-06T03:24:59.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.819+0000 7fe5874c6700 1 -- 172.21.15.50:0/248055363 wait complete. 2024-06-06T03:24:59.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.820+0000 7fe5874c6700 1 Processor -- start 2024-06-06T03:24:59.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.820+0000 7fe5874c6700 1 -- start start 2024-06-06T03:24:59.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.820+0000 7fe5874c6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe580101df0 0x7fe58019e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:59.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.820+0000 7fe5874c6700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5801027a0 0x7fe58019eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:59.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.820+0000 7fe5874c6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe580106750 0x7fe580198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:59.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.820+0000 7fe5874c6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe580111510 con 0x7fe580106750 2024-06-06T03:24:59.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.820+0000 7fe5874c6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe580111390 con 0x7fe580101df0 2024-06-06T03:24:59.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.820+0000 7fe5874c6700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe580111690 con 0x7fe5801027a0 2024-06-06T03:24:59.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.820+0000 7fe585a63700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe580106750 0x7fe580198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:59.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.820+0000 7fe585a63700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe580106750 0x7fe580198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52916/0 (socket says 172.21.15.50:52916) 2024-06-06T03:24:59.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.820+0000 7fe585a63700 1 -- 172.21.15.50:0/3317451493 learned_addr learned my addr 172.21.15.50:0/3317451493 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:24:59.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.820+0000 7fe584a61700 1 --2- 172.21.15.50:0/3317451493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5801027a0 0x7fe58019eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:59.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.820+0000 7fe585262700 1 --2- 172.21.15.50:0/3317451493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe580101df0 0x7fe58019e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:59.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.820+0000 7fe585a63700 1 -- 172.21.15.50:0/3317451493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5801027a0 msgr2=0x7fe58019eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:59.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.820+0000 7fe585a63700 1 --2- 172.21.15.50:0/3317451493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5801027a0 0x7fe58019eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:59.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.820+0000 7fe585a63700 1 -- 172.21.15.50:0/3317451493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe580101df0 msgr2=0x7fe58019e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:24:59.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.820+0000 7fe585a63700 1 --2- 172.21.15.50:0/3317451493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe580101df0 0x7fe58019e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:24:59.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.820+0000 7fe585a63700 1 -- 172.21.15.50:0/3317451493 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe580199080 con 0x7fe580106750 2024-06-06T03:24:59.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.820+0000 7fe585262700 1 --2- 172.21.15.50:0/3317451493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe580101df0 0x7fe58019e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:24:59.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.821+0000 7fe585a63700 1 --2- 172.21.15.50:0/3317451493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe580106750 0x7fe580198920 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe578007ee0 tx=0x7fe57800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:59.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.821+0000 7fe5767fc700 1 -- 172.21.15.50:0/3317451493 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57800dbd0 con 0x7fe580106750 2024-06-06T03:24:59.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.821+0000 7fe5767fc700 1 -- 172.21.15.50:0/3317451493 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe57800dd70 con 0x7fe580106750 2024-06-06T03:24:59.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.821+0000 7fe5874c6700 1 -- 172.21.15.50:0/3317451493 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe580199370 con 0x7fe580106750 2024-06-06T03:24:59.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.821+0000 7fe5767fc700 1 -- 172.21.15.50:0/3317451493 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe578005a20 con 0x7fe580106750 2024-06-06T03:24:59.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.821+0000 7fe5874c6700 1 -- 172.21.15.50:0/3317451493 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5801a5630 con 0x7fe580106750 2024-06-06T03:24:59.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.822+0000 7fe5874c6700 1 -- 172.21.15.50:0/3317451493 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe580199e50 con 0x7fe580106750 2024-06-06T03:24:59.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.823+0000 7fe5767fc700 1 -- 172.21.15.50:0/3317451493 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe57801a020 con 0x7fe580106750 2024-06-06T03:24:59.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.824+0000 7fe5767fc700 1 --2- 172.21.15.50:0/3317451493 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe56c0a2cb0 0x7fe56c0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:24:59.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.824+0000 7fe585262700 1 --2- 172.21.15.50:0/3317451493 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe56c0a2cb0 0x7fe56c0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:24:59.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.824+0000 7fe5767fc700 1 -- 172.21.15.50:0/3317451493 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fe5780cedd0 con 0x7fe580106750 2024-06-06T03:24:59.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.824+0000 7fe585262700 1 --2- 172.21.15.50:0/3317451493 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe56c0a2cb0 0x7fe56c0a5170 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe57c005fd0 tx=0x7fe57c005de0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:24:59.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:59.828+0000 7fe5767fc700 1 -- 172.21.15.50:0/3317451493 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe578010070 con 0x7fe580106750 2024-06-06T03:25:00.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:00.038+0000 7fe5874c6700 1 -- 172.21.15.50:0/3317451493 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fe5801a5830 con 0x7fe580106750 2024-06-06T03:25:00.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:00.038+0000 7fe5767fc700 1 -- 172.21.15.50:0/3317451493 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fe57809b7f0 con 0x7fe580106750 2024-06-06T03:25:00.039 INFO:teuthology.orchestra.run.smithi050.stdout:343597383725 2024-06-06T03:25:00.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:00.041+0000 7fe5874c6700 1 -- 172.21.15.50:0/3317451493 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe56c0a2cb0 msgr2=0x7fe56c0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:00.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:00.041+0000 7fe5874c6700 1 --2- 172.21.15.50:0/3317451493 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe56c0a2cb0 0x7fe56c0a5170 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe57c005fd0 tx=0x7fe57c005de0 comp rx=0 tx=0).stop 2024-06-06T03:25:00.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:00.041+0000 7fe5874c6700 1 -- 172.21.15.50:0/3317451493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe580106750 msgr2=0x7fe580198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:00.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:00.041+0000 7fe5874c6700 1 --2- 172.21.15.50:0/3317451493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe580106750 0x7fe580198920 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe578007ee0 tx=0x7fe57800d3b0 comp rx=0 tx=0).stop 2024-06-06T03:25:00.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:00.041+0000 7fe5874c6700 1 -- 172.21.15.50:0/3317451493 shutdown_connections 2024-06-06T03:25:00.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:00.041+0000 7fe5874c6700 1 --2- 172.21.15.50:0/3317451493 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe56c0a2cb0 0x7fe56c0a5170 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:00.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:00.041+0000 7fe5874c6700 1 --2- 172.21.15.50:0/3317451493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe580106750 0x7fe580198920 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:00.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:00.041+0000 7fe5874c6700 1 --2- 172.21.15.50:0/3317451493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe580101df0 0x7fe58019e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:00.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:00.041+0000 7fe5874c6700 1 --2- 172.21.15.50:0/3317451493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5801027a0 0x7fe58019eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:00.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:00.041+0000 7fe5874c6700 1 -- 172.21.15.50:0/3317451493 >> 172.21.15.50:0/3317451493 conn(0x7fe580077a00 msgr2=0x7fe580103df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:00.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:00.041+0000 7fe5874c6700 1 -- 172.21.15.50:0/3317451493 shutdown_connections 2024-06-06T03:25:00.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:00.041+0000 7fe5874c6700 1 -- 172.21.15.50:0/3317451493 wait complete. 2024-06-06T03:25:00.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:00 smithi050 ceph-mon[32421]: pgmap v382: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:25:00.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:00 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3317451493' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-06-06T03:25:00.812 INFO:tasks.cephadm.ceph_manager.ceph:need seq 343597383721 got 343597383725 for osd.11 2024-06-06T03:25:00.812 DEBUG:teuthology.parallel:result is None 2024-06-06T03:25:00.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:00 smithi079 ceph-mon[35478]: pgmap v382: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:25:00.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:00 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/3317451493' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-06-06T03:25:00.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:00 smithi122 ceph-mon[35759]: pgmap v382: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:25:00.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:00 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/3317451493' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-06-06T03:25:01.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.578+0000 7fab90f91700 1 -- 172.21.15.50:0/619102792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab8c103150 msgr2=0x7fab8c107140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:01.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.578+0000 7fab90f91700 1 --2- 172.21.15.50:0/619102792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab8c103150 0x7fab8c107140 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fab800099c0 tx=0x7fab80009cd0 comp rx=0 tx=0).stop 2024-06-06T03:25:01.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.579+0000 7fab90f91700 1 -- 172.21.15.50:0/619102792 shutdown_connections 2024-06-06T03:25:01.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.579+0000 7fab90f91700 1 --2- 172.21.15.50:0/619102792 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab8c107870 0x7fab8c10f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:01.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.579+0000 7fab90f91700 1 --2- 172.21.15.50:0/619102792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab8c1027a0 0x7fab8c102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:01.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.579+0000 7fab90f91700 1 --2- 172.21.15.50:0/619102792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab8c103150 0x7fab8c107140 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:01.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.579+0000 7fab90f91700 1 -- 172.21.15.50:0/619102792 >> 172.21.15.50:0/619102792 conn(0x7fab8c079570 msgr2=0x7fab8c079980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:01.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.579+0000 7fab90f91700 1 -- 172.21.15.50:0/619102792 shutdown_connections 2024-06-06T03:25:01.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.579+0000 7fab90f91700 1 -- 172.21.15.50:0/619102792 wait complete. 2024-06-06T03:25:01.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.579+0000 7fab90f91700 1 Processor -- start 2024-06-06T03:25:01.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.580+0000 7fab90f91700 1 -- start start 2024-06-06T03:25:01.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.580+0000 7fab90f91700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab8c1027a0 0x7fab8c19e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:01.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.580+0000 7fab90f91700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab8c103150 0x7fab8c19ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:01.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.580+0000 7fab90f91700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab8c107870 0x7fab8c198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:01.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.580+0000 7fab90f91700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c112650 con 0x7fab8c107870 2024-06-06T03:25:01.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.580+0000 7fab90f91700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c1124d0 con 0x7fab8c103150 2024-06-06T03:25:01.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.580+0000 7fab90f91700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c1127d0 con 0x7fab8c1027a0 2024-06-06T03:25:01.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.580+0000 7fab8ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab8c107870 0x7fab8c198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:01.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.580+0000 7fab8ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab8c107870 0x7fab8c198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52948/0 (socket says 172.21.15.50:52948) 2024-06-06T03:25:01.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.580+0000 7fab8ad9d700 1 -- 172.21.15.50:0/4233543671 learned_addr learned my addr 172.21.15.50:0/4233543671 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:01.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.580+0000 7fab8a59c700 1 --2- 172.21.15.50:0/4233543671 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab8c1027a0 0x7fab8c19e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:01.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.580+0000 7fab89d9b700 1 --2- 172.21.15.50:0/4233543671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab8c103150 0x7fab8c19ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:01.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.580+0000 7fab8ad9d700 1 -- 172.21.15.50:0/4233543671 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab8c1027a0 msgr2=0x7fab8c19e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:01.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.580+0000 7fab8ad9d700 1 --2- 172.21.15.50:0/4233543671 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab8c1027a0 0x7fab8c19e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:01.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.580+0000 7fab8ad9d700 1 -- 172.21.15.50:0/4233543671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab8c103150 msgr2=0x7fab8c19ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:01.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.580+0000 7fab8ad9d700 1 --2- 172.21.15.50:0/4233543671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab8c103150 0x7fab8c19ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:01.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.580+0000 7fab8ad9d700 1 -- 172.21.15.50:0/4233543671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab8c1990b0 con 0x7fab8c107870 2024-06-06T03:25:01.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.581+0000 7fab8ad9d700 1 --2- 172.21.15.50:0/4233543671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab8c107870 0x7fab8c198950 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fab84007ee0 tx=0x7fab8400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:01.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.581+0000 7fab7b7fe700 1 -- 172.21.15.50:0/4233543671 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab84004bb0 con 0x7fab8c107870 2024-06-06T03:25:01.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.581+0000 7fab7b7fe700 1 -- 172.21.15.50:0/4233543671 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fab84004d50 con 0x7fab8c107870 2024-06-06T03:25:01.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.581+0000 7fab90f91700 1 -- 172.21.15.50:0/4233543671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab8c1993a0 con 0x7fab8c107870 2024-06-06T03:25:01.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.581+0000 7fab7b7fe700 1 -- 172.21.15.50:0/4233543671 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab840058e0 con 0x7fab8c107870 2024-06-06T03:25:01.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.581+0000 7fab90f91700 1 -- 172.21.15.50:0/4233543671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab8c1a5610 con 0x7fab8c107870 2024-06-06T03:25:01.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.582+0000 7fab90f91700 1 -- 172.21.15.50:0/4233543671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab8c069180 con 0x7fab8c107870 2024-06-06T03:25:01.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.583+0000 7fab7b7fe700 1 -- 172.21.15.50:0/4233543671 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fab8401a020 con 0x7fab8c107870 2024-06-06T03:25:01.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.584+0000 7fab7b7fe700 1 --2- 172.21.15.50:0/4233543671 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fab740a2d30 0x7fab740a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:01.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.584+0000 7fab8a59c700 1 --2- 172.21.15.50:0/4233543671 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fab740a2d30 0x7fab740a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:01.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.584+0000 7fab7b7fe700 1 -- 172.21.15.50:0/4233543671 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fab840cf240 con 0x7fab8c107870 2024-06-06T03:25:01.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.585+0000 7fab8a59c700 1 --2- 172.21.15.50:0/4233543671 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fab740a2d30 0x7fab740a51f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fab7c005950 tx=0x7fab7c00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:01.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.588+0000 7fab7b7fe700 1 -- 172.21.15.50:0/4233543671 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fab84010070 con 0x7fab8c107870 2024-06-06T03:25:01.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.804+0000 7fab90f91700 1 -- 172.21.15.50:0/4233543671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fab8c199e30 con 0x7fab8c107870 2024-06-06T03:25:01.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.804+0000 7fab7b7fe700 1 -- 172.21.15.50:0/4233543671 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fab8409bcc0 con 0x7fab8c107870 2024-06-06T03:25:01.805 INFO:teuthology.orchestra.run.smithi050.stdout:77309411420 2024-06-06T03:25:01.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.807+0000 7fab90f91700 1 -- 172.21.15.50:0/4233543671 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fab740a2d30 msgr2=0x7fab740a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:01.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.807+0000 7fab90f91700 1 --2- 172.21.15.50:0/4233543671 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fab740a2d30 0x7fab740a51f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fab7c005950 tx=0x7fab7c00a300 comp rx=0 tx=0).stop 2024-06-06T03:25:01.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.807+0000 7fab90f91700 1 -- 172.21.15.50:0/4233543671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab8c107870 msgr2=0x7fab8c198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:01.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.807+0000 7fab90f91700 1 --2- 172.21.15.50:0/4233543671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab8c107870 0x7fab8c198950 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fab84007ee0 tx=0x7fab8400d3b0 comp rx=0 tx=0).stop 2024-06-06T03:25:01.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.807+0000 7fab90f91700 1 -- 172.21.15.50:0/4233543671 shutdown_connections 2024-06-06T03:25:01.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.807+0000 7fab90f91700 1 --2- 172.21.15.50:0/4233543671 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fab740a2d30 0x7fab740a51f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:01.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.807+0000 7fab90f91700 1 --2- 172.21.15.50:0/4233543671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab8c107870 0x7fab8c198950 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:01.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.807+0000 7fab90f91700 1 --2- 172.21.15.50:0/4233543671 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab8c1027a0 0x7fab8c19e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:01.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.807+0000 7fab90f91700 1 --2- 172.21.15.50:0/4233543671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab8c103150 0x7fab8c19ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:01.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.807+0000 7fab90f91700 1 -- 172.21.15.50:0/4233543671 >> 172.21.15.50:0/4233543671 conn(0x7fab8c079570 msgr2=0x7fab8c100610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:01.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.807+0000 7fab90f91700 1 -- 172.21.15.50:0/4233543671 shutdown_connections 2024-06-06T03:25:01.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.807+0000 7fab90f91700 1 -- 172.21.15.50:0/4233543671 wait complete. 2024-06-06T03:25:02.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.264+0000 7f6b41994700 1 -- 172.21.15.50:0/3078607025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b3c06b3c0 msgr2=0x7f6b3c10f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:02.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.264+0000 7f6b41994700 1 --2- 172.21.15.50:0/3078607025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b3c06b3c0 0x7f6b3c10f310 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6b3400b0a0 tx=0x7f6b3400b3b0 comp rx=0 tx=0).stop 2024-06-06T03:25:02.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.264+0000 7f6b41994700 1 -- 172.21.15.50:0/3078607025 shutdown_connections 2024-06-06T03:25:02.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.264+0000 7f6b41994700 1 --2- 172.21.15.50:0/3078607025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b3c06b3c0 0x7f6b3c10f310 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:02.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.264+0000 7f6b41994700 1 --2- 172.21.15.50:0/3078607025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b3c1084f0 0x7f6b3c1088d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:02.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.264+0000 7f6b41994700 1 --2- 172.21.15.50:0/3078607025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b3c06aa00 0x7f6b3c06ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:02.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.264+0000 7f6b41994700 1 -- 172.21.15.50:0/3078607025 >> 172.21.15.50:0/3078607025 conn(0x7f6b3c078300 msgr2=0x7f6b3c078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:02.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.264+0000 7f6b41994700 1 -- 172.21.15.50:0/3078607025 shutdown_connections 2024-06-06T03:25:02.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.264+0000 7f6b41994700 1 -- 172.21.15.50:0/3078607025 wait complete. 2024-06-06T03:25:02.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.265+0000 7f6b41994700 1 Processor -- start 2024-06-06T03:25:02.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.265+0000 7f6b41994700 1 -- start start 2024-06-06T03:25:02.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.265+0000 7f6b41994700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b3c06aa00 0x7f6b3c19e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:02.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.265+0000 7f6b41994700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b3c06b3c0 0x7f6b3c19ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:02.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.265+0000 7f6b41994700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b3c1084f0 0x7f6b3c198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:02.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.265+0000 7f6b41994700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3c112600 con 0x7f6b3c06b3c0 2024-06-06T03:25:02.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.265+0000 7f6b41994700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3c112480 con 0x7f6b3c1084f0 2024-06-06T03:25:02.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.265+0000 7f6b41994700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3c112780 con 0x7f6b3c06aa00 2024-06-06T03:25:02.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.265+0000 7f6b3a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b3c06b3c0 0x7f6b3c19ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:02.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.265+0000 7f6b3a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b3c06b3c0 0x7f6b3c19ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52936/0 (socket says 172.21.15.50:52936) 2024-06-06T03:25:02.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.265+0000 7f6b3a7fc700 1 -- 172.21.15.50:0/1557696964 learned_addr learned my addr 172.21.15.50:0/1557696964 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:02.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.265+0000 7f6b3affd700 1 --2- 172.21.15.50:0/1557696964 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b3c06aa00 0x7f6b3c19e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:02.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.265+0000 7f6b3b7fe700 1 --2- 172.21.15.50:0/1557696964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b3c1084f0 0x7f6b3c198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:02.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.266+0000 7f6b3a7fc700 1 -- 172.21.15.50:0/1557696964 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b3c06aa00 msgr2=0x7f6b3c19e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:02.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.266+0000 7f6b3a7fc700 1 --2- 172.21.15.50:0/1557696964 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b3c06aa00 0x7f6b3c19e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:02.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.266+0000 7f6b3a7fc700 1 -- 172.21.15.50:0/1557696964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b3c1084f0 msgr2=0x7f6b3c198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:02.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.266+0000 7f6b3a7fc700 1 --2- 172.21.15.50:0/1557696964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b3c1084f0 0x7f6b3c198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:02.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.266+0000 7f6b3a7fc700 1 -- 172.21.15.50:0/1557696964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b3c198fc0 con 0x7f6b3c06b3c0 2024-06-06T03:25:02.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.266+0000 7f6b3a7fc700 1 --2- 172.21.15.50:0/1557696964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b3c06b3c0 0x7f6b3c19ebe0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6b3000c9b0 tx=0x7f6b3000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:02.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.266+0000 7f6b40992700 1 -- 172.21.15.50:0/1557696964 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b30007b00 con 0x7f6b3c06b3c0 2024-06-06T03:25:02.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.266+0000 7f6b40992700 1 -- 172.21.15.50:0/1557696964 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6b3000ce50 con 0x7f6b3c06b3c0 2024-06-06T03:25:02.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.266+0000 7f6b41994700 1 -- 172.21.15.50:0/1557696964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b3c1992b0 con 0x7f6b3c06b3c0 2024-06-06T03:25:02.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.266+0000 7f6b40992700 1 -- 172.21.15.50:0/1557696964 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b30018660 con 0x7f6b3c06b3c0 2024-06-06T03:25:02.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.266+0000 7f6b41994700 1 -- 172.21.15.50:0/1557696964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b3c1a5570 con 0x7f6b3c06b3c0 2024-06-06T03:25:02.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.267+0000 7f6b41994700 1 -- 172.21.15.50:0/1557696964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b3c069180 con 0x7f6b3c06b3c0 2024-06-06T03:25:02.184 INFO:teuthology.orchestra.run.smithi050.stdout:163208757325 2024-06-06T03:25:02.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.268+0000 7f6b40992700 1 -- 172.21.15.50:0/1557696964 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6b3000f450 con 0x7f6b3c06b3c0 2024-06-06T03:25:02.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.269+0000 7f6b40992700 1 --2- 172.21.15.50:0/1557696964 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6b240a2d30 0x7f6b240a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:02.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.270+0000 7f6b40992700 1 -- 172.21.15.50:0/1557696964 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f6b300cf3c0 con 0x7f6b3c06b3c0 2024-06-06T03:25:02.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.270+0000 7f6b3affd700 1 --2- 172.21.15.50:0/1557696964 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6b240a2d30 0x7f6b240a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:02.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.271+0000 7f6b3affd700 1 --2- 172.21.15.50:0/1557696964 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6b240a2d30 0x7f6b240a51f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c1999a0 tx=0x7f6b2c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:02.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.277+0000 7f6b40992700 1 -- 172.21.15.50:0/1557696964 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6b30014030 con 0x7f6b3c06b3c0 2024-06-06T03:25:02.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.489+0000 7f6b41994700 1 -- 172.21.15.50:0/1557696964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f6b3c02dca0 con 0x7f6b3c06b3c0 2024-06-06T03:25:02.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.489+0000 7f6b40992700 1 -- 172.21.15.50:0/1557696964 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6b3009be80 con 0x7f6b3c06b3c0 2024-06-06T03:25:02.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.492+0000 7f6b41994700 1 -- 172.21.15.50:0/1557696964 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6b240a2d30 msgr2=0x7f6b240a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:02.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.492+0000 7f6b41994700 1 --2- 172.21.15.50:0/1557696964 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6b240a2d30 0x7f6b240a51f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c1999a0 tx=0x7f6b2c00b410 comp rx=0 tx=0).stop 2024-06-06T03:25:02.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.492+0000 7f6b41994700 1 -- 172.21.15.50:0/1557696964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b3c06b3c0 msgr2=0x7f6b3c19ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:02.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.492+0000 7f6b41994700 1 --2- 172.21.15.50:0/1557696964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b3c06b3c0 0x7f6b3c19ebe0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6b3000c9b0 tx=0x7f6b3000ccc0 comp rx=0 tx=0).stop 2024-06-06T03:25:02.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.492+0000 7f6b41994700 1 -- 172.21.15.50:0/1557696964 shutdown_connections 2024-06-06T03:25:02.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.492+0000 7f6b41994700 1 --2- 172.21.15.50:0/1557696964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b3c1084f0 0x7f6b3c198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:02.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.492+0000 7f6b41994700 1 --2- 172.21.15.50:0/1557696964 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b3c06aa00 0x7f6b3c19e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:02.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.492+0000 7f6b41994700 1 --2- 172.21.15.50:0/1557696964 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6b240a2d30 0x7f6b240a51f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:02.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.492+0000 7f6b41994700 1 --2- 172.21.15.50:0/1557696964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b3c06b3c0 0x7f6b3c19ebe0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:02.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.492+0000 7f6b41994700 1 -- 172.21.15.50:0/1557696964 >> 172.21.15.50:0/1557696964 conn(0x7f6b3c078300 msgr2=0x7f6b3c0ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:02.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.492+0000 7f6b41994700 1 -- 172.21.15.50:0/1557696964 shutdown_connections 2024-06-06T03:25:02.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:01.492+0000 7f6b41994700 1 -- 172.21.15.50:0/1557696964 wait complete. 2024-06-06T03:25:02.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:02 smithi050 ceph-mon[32421]: pgmap v383: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:25:02.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:02 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1557696964' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-06T03:25:02.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:02 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/4233543671' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-06T03:25:02.800 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411416 got 77309411420 for osd.2 2024-06-06T03:25:02.800 DEBUG:teuthology.parallel:result is None 2024-06-06T03:25:02.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:02 smithi079 ceph-mon[35478]: pgmap v383: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:25:02.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:02 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/1557696964' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-06T03:25:02.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:02 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/4233543671' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-06T03:25:02.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.850+0000 7f6e67102700 1 -- 172.21.15.50:0/2859537213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e60101d50 msgr2=0x7f6e6010e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:02.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.850+0000 7f6e67102700 1 --2- 172.21.15.50:0/2859537213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e60101d50 0x7f6e6010e240 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6e5800b0a0 tx=0x7f6e5800b3b0 comp rx=0 tx=0).stop 2024-06-06T03:25:02.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.850+0000 7f6e67102700 1 -- 172.21.15.50:0/2859537213 shutdown_connections 2024-06-06T03:25:02.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.850+0000 7f6e67102700 1 --2- 172.21.15.50:0/2859537213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e60101d50 0x7f6e6010e240 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:02.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.850+0000 7f6e67102700 1 --2- 172.21.15.50:0/2859537213 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e60107400 0x7f6e601077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:02.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.850+0000 7f6e67102700 1 --2- 172.21.15.50:0/2859537213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e60101390 0x7f6e60101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:02.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.850+0000 7f6e67102700 1 -- 172.21.15.50:0/2859537213 >> 172.21.15.50:0/2859537213 conn(0x7f6e60078340 msgr2=0x7f6e60078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:02.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.850+0000 7f6e67102700 1 -- 172.21.15.50:0/2859537213 shutdown_connections 2024-06-06T03:25:02.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.850+0000 7f6e67102700 1 -- 172.21.15.50:0/2859537213 wait complete. 2024-06-06T03:25:02.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.850+0000 7f6e67102700 1 Processor -- start 2024-06-06T03:25:02.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.850+0000 7f6e67102700 1 -- start start 2024-06-06T03:25:02.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.851+0000 7f6e67102700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e60101390 0x7f6e601998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:02.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.851+0000 7f6e67102700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e60101d50 0x7f6e60199e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:02.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.851+0000 7f6e67102700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e60107400 0x7f6e601a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:02.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.851+0000 7f6e67102700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6e60111540 con 0x7f6e60101d50 2024-06-06T03:25:02.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.851+0000 7f6e67102700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6e601113c0 con 0x7f6e60101390 2024-06-06T03:25:02.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.851+0000 7f6e67102700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6e601116c0 con 0x7f6e60107400 2024-06-06T03:25:02.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.851+0000 7f6e57fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e60101d50 0x7f6e60199e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:02.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.851+0000 7f6e57fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e60101d50 0x7f6e60199e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60900/0 (socket says 172.21.15.50:60900) 2024-06-06T03:25:02.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.851+0000 7f6e57fff700 1 -- 172.21.15.50:0/4012176144 learned_addr learned my addr 172.21.15.50:0/4012176144 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:02.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.851+0000 7f6e6569f700 1 --2- 172.21.15.50:0/4012176144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e60107400 0x7f6e601a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:02.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.851+0000 7f6e64e9e700 1 --2- 172.21.15.50:0/4012176144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e60101390 0x7f6e601998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:02.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.851+0000 7f6e57fff700 1 -- 172.21.15.50:0/4012176144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e60107400 msgr2=0x7f6e601a4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:02.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.851+0000 7f6e57fff700 1 --2- 172.21.15.50:0/4012176144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e60107400 0x7f6e601a4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:02.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.851+0000 7f6e57fff700 1 -- 172.21.15.50:0/4012176144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e60101390 msgr2=0x7f6e601998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:02.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.851+0000 7f6e57fff700 1 --2- 172.21.15.50:0/4012176144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e60101390 0x7f6e601998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:02.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.851+0000 7f6e57fff700 1 -- 172.21.15.50:0/4012176144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e601a4ea0 con 0x7f6e60101d50 2024-06-06T03:25:02.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.852+0000 7f6e57fff700 1 --2- 172.21.15.50:0/4012176144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e60101d50 0x7f6e60199e20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000c920 tx=0x7f6e5000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:02.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.852+0000 7f6e55ffb700 1 -- 172.21.15.50:0/4012176144 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e50004a30 con 0x7f6e60101d50 2024-06-06T03:25:02.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.852+0000 7f6e55ffb700 1 -- 172.21.15.50:0/4012176144 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6e500054d0 con 0x7f6e60101d50 2024-06-06T03:25:02.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.852+0000 7f6e55ffb700 1 -- 172.21.15.50:0/4012176144 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e50007c30 con 0x7f6e60101d50 2024-06-06T03:25:02.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.852+0000 7f6e67102700 1 -- 172.21.15.50:0/4012176144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e601a5130 con 0x7f6e60101d50 2024-06-06T03:25:02.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.852+0000 7f6e67102700 1 -- 172.21.15.50:0/4012176144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e601a5640 con 0x7f6e60101d50 2024-06-06T03:25:02.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.853+0000 7f6e67102700 1 -- 172.21.15.50:0/4012176144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e60069180 con 0x7f6e60101d50 2024-06-06T03:25:02.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.855+0000 7f6e55ffb700 1 -- 172.21.15.50:0/4012176144 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6e50004bd0 con 0x7f6e60101d50 2024-06-06T03:25:02.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.855+0000 7f6e55ffb700 1 --2- 172.21.15.50:0/4012176144 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6e480a2cb0 0x7f6e480a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:02.881 INFO:teuthology.orchestra.run.smithi050.stdout:107374182484 2024-06-06T03:25:02.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.855+0000 7f6e64e9e700 1 --2- 172.21.15.50:0/4012176144 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6e480a2cb0 0x7f6e480a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:02.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.855+0000 7f6e55ffb700 1 -- 172.21.15.50:0/4012176144 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f6e500cf160 con 0x7f6e60101d50 2024-06-06T03:25:02.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.856+0000 7f6e64e9e700 1 --2- 172.21.15.50:0/4012176144 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6e480a2cb0 0x7f6e480a5170 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c0045b0 tx=0x7f6e5c00b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:02.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:53.860+0000 7f6e55ffb700 1 -- 172.21.15.50:0/4012176144 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6e50014030 con 0x7f6e60101d50 2024-06-06T03:25:02.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:54.071+0000 7f6e67102700 1 -- 172.21.15.50:0/4012176144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f6e6002dca0 con 0x7f6e60101d50 2024-06-06T03:25:02.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:54.071+0000 7f6e55ffb700 1 -- 172.21.15.50:0/4012176144 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6e5009bb80 con 0x7f6e60101d50 2024-06-06T03:25:02.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:54.073+0000 7f6e67102700 1 -- 172.21.15.50:0/4012176144 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6e480a2cb0 msgr2=0x7f6e480a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:02.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:54.073+0000 7f6e67102700 1 --2- 172.21.15.50:0/4012176144 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6e480a2cb0 0x7f6e480a5170 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c0045b0 tx=0x7f6e5c00b3c0 comp rx=0 tx=0).stop 2024-06-06T03:25:02.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:54.073+0000 7f6e67102700 1 -- 172.21.15.50:0/4012176144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e60101d50 msgr2=0x7f6e60199e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:02.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:54.073+0000 7f6e67102700 1 --2- 172.21.15.50:0/4012176144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e60101d50 0x7f6e60199e20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000c920 tx=0x7f6e5000cc30 comp rx=0 tx=0).stop 2024-06-06T03:25:02.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:54.073+0000 7f6e67102700 1 -- 172.21.15.50:0/4012176144 shutdown_connections 2024-06-06T03:25:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:54.073+0000 7f6e67102700 1 --2- 172.21.15.50:0/4012176144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e60107400 0x7f6e601a4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:54.073+0000 7f6e67102700 1 --2- 172.21.15.50:0/4012176144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e60101390 0x7f6e601998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:54.073+0000 7f6e67102700 1 --2- 172.21.15.50:0/4012176144 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6e480a2cb0 0x7f6e480a5170 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:54.073+0000 7f6e67102700 1 --2- 172.21.15.50:0/4012176144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e60101d50 0x7f6e60199e20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:54.073+0000 7f6e67102700 1 -- 172.21.15.50:0/4012176144 >> 172.21.15.50:0/4012176144 conn(0x7f6e60078340 msgr2=0x7f6e600ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:54.073+0000 7f6e67102700 1 -- 172.21.15.50:0/4012176144 shutdown_connections 2024-06-06T03:25:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:24:54.073+0000 7f6e67102700 1 -- 172.21.15.50:0/4012176144 wait complete. 2024-06-06T03:25:02.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:02 smithi122 ceph-mon[35759]: pgmap v383: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:25:02.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:02 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/1557696964' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-06T03:25:02.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:02 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/4233543671' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-06T03:25:04.646 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:04 smithi050 ceph-mon[32421]: pgmap v384: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-06T03:25:04.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:04 smithi079 ceph-mon[35478]: pgmap v384: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-06T03:25:04.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:04 smithi122 ceph-mon[35759]: pgmap v384: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-06T03:25:05.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.072+0000 7fa41bdae700 1 -- 172.21.15.50:0/3026693529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa414108560 msgr2=0x7fa414108940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:05.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.072+0000 7fa41bdae700 1 --2- 172.21.15.50:0/3026693529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa414108560 0x7fa414108940 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa4100099c0 tx=0x7fa410009cd0 comp rx=0 tx=0).stop 2024-06-06T03:25:05.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.072+0000 7fa41bdae700 1 -- 172.21.15.50:0/3026693529 shutdown_connections 2024-06-06T03:25:05.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.072+0000 7fa41bdae700 1 --2- 172.21.15.50:0/3026693529 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4141013a0 0x7fa41410f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:05.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.072+0000 7fa41bdae700 1 --2- 172.21.15.50:0/3026693529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa414108560 0x7fa414108940 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:05.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.072+0000 7fa41bdae700 1 --2- 172.21.15.50:0/3026693529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4141009e0 0x7fa414100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:05.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.072+0000 7fa41bdae700 1 -- 172.21.15.50:0/3026693529 >> 172.21.15.50:0/3026693529 conn(0x7fa414077990 msgr2=0x7fa4140fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:05.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.072+0000 7fa41bdae700 1 -- 172.21.15.50:0/3026693529 shutdown_connections 2024-06-06T03:25:05.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.072+0000 7fa41bdae700 1 -- 172.21.15.50:0/3026693529 wait complete. 2024-06-06T03:25:05.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.073+0000 7fa41bdae700 1 Processor -- start 2024-06-06T03:25:05.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.073+0000 7fa41bdae700 1 -- start start 2024-06-06T03:25:05.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.073+0000 7fa41bdae700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4141009e0 0x7fa414101bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:05.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.073+0000 7fa41bdae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4141013a0 0x7fa414102100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:05.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.073+0000 7fa41bdae700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa414108560 0x7fa414102640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:05.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.073+0000 7fa41bdae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa4141126c0 con 0x7fa4141013a0 2024-06-06T03:25:05.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.073+0000 7fa41bdae700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa414112540 con 0x7fa414108560 2024-06-06T03:25:05.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.073+0000 7fa41bdae700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa414112840 con 0x7fa4141009e0 2024-06-06T03:25:05.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.073+0000 7fa419349700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4141013a0 0x7fa414102100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:05.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.073+0000 7fa419349700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4141013a0 0x7fa414102100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52980/0 (socket says 172.21.15.50:52980) 2024-06-06T03:25:05.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.073+0000 7fa419349700 1 -- 172.21.15.50:0/307618148 learned_addr learned my addr 172.21.15.50:0/307618148 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:05.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.073+0000 7fa419b4a700 1 --2- 172.21.15.50:0/307618148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4141009e0 0x7fa414101bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:05.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.073+0000 7fa41a34b700 1 --2- 172.21.15.50:0/307618148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa414108560 0x7fa414102640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:05.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.074+0000 7fa419349700 1 -- 172.21.15.50:0/307618148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4141009e0 msgr2=0x7fa414101bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:05.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.074+0000 7fa419349700 1 --2- 172.21.15.50:0/307618148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4141009e0 0x7fa414101bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:05.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.074+0000 7fa419349700 1 -- 172.21.15.50:0/307618148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa414108560 msgr2=0x7fa414102640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:05.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.074+0000 7fa419349700 1 --2- 172.21.15.50:0/307618148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa414108560 0x7fa414102640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:05.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.074+0000 7fa419349700 1 -- 172.21.15.50:0/307618148 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4141a7030 con 0x7fa4141013a0 2024-06-06T03:25:05.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.074+0000 7fa41a34b700 1 --2- 172.21.15.50:0/307618148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa414108560 0x7fa414102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:25:05.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.074+0000 7fa419349700 1 --2- 172.21.15.50:0/307618148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4141013a0 0x7fa414102100 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa40400d950 tx=0x7fa40400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:05.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.074+0000 7fa40affd700 1 -- 172.21.15.50:0/307618148 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa404016070 con 0x7fa4141013a0 2024-06-06T03:25:05.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.074+0000 7fa40affd700 1 -- 172.21.15.50:0/307618148 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa404009df0 con 0x7fa4141013a0 2024-06-06T03:25:05.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.074+0000 7fa41bdae700 1 -- 172.21.15.50:0/307618148 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4141a7320 con 0x7fa4141013a0 2024-06-06T03:25:05.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.074+0000 7fa40affd700 1 -- 172.21.15.50:0/307618148 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40400f3c0 con 0x7fa4141013a0 2024-06-06T03:25:05.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.074+0000 7fa41bdae700 1 -- 172.21.15.50:0/307618148 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4141a78b0 con 0x7fa4141013a0 2024-06-06T03:25:05.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.075+0000 7fa41bdae700 1 -- 172.21.15.50:0/307618148 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa41410a9f0 con 0x7fa4141013a0 2024-06-06T03:25:05.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.076+0000 7fa40affd700 1 -- 172.21.15.50:0/307618148 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa404019070 con 0x7fa4141013a0 2024-06-06T03:25:05.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.077+0000 7fa40affd700 1 --2- 172.21.15.50:0/307618148 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa4000a2d30 0x7fa4000a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:05.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.077+0000 7fa419b4a700 1 --2- 172.21.15.50:0/307618148 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa4000a2d30 0x7fa4000a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:05.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.077+0000 7fa40affd700 1 -- 172.21.15.50:0/307618148 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fa4040cf0c0 con 0x7fa4141013a0 2024-06-06T03:25:05.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.077+0000 7fa419b4a700 1 --2- 172.21.15.50:0/307618148 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa4000a2d30 0x7fa4000a51f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa410000c00 tx=0x7fa410005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:05.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.081+0000 7fa40affd700 1 -- 172.21.15.50:0/307618148 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa40409bb40 con 0x7fa4141013a0 2024-06-06T03:25:05.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.290+0000 7fa41bdae700 1 -- 172.21.15.50:0/307618148 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fa41410a3d0 con 0x7fa4141013a0 2024-06-06T03:25:05.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.290+0000 7fa40affd700 1 -- 172.21.15.50:0/307618148 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa40409b440 con 0x7fa4141013a0 2024-06-06T03:25:05.290 INFO:teuthology.orchestra.run.smithi050.stdout:219043332162 2024-06-06T03:25:05.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.294+0000 7fa41bdae700 1 -- 172.21.15.50:0/307618148 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa4000a2d30 msgr2=0x7fa4000a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:05.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.294+0000 7fa41bdae700 1 --2- 172.21.15.50:0/307618148 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa4000a2d30 0x7fa4000a51f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa410000c00 tx=0x7fa410005fb0 comp rx=0 tx=0).stop 2024-06-06T03:25:05.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.294+0000 7fa41bdae700 1 -- 172.21.15.50:0/307618148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4141013a0 msgr2=0x7fa414102100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:05.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.294+0000 7fa41bdae700 1 --2- 172.21.15.50:0/307618148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4141013a0 0x7fa414102100 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa40400d950 tx=0x7fa40400dc60 comp rx=0 tx=0).stop 2024-06-06T03:25:05.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.294+0000 7fa41bdae700 1 -- 172.21.15.50:0/307618148 shutdown_connections 2024-06-06T03:25:05.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.294+0000 7fa41bdae700 1 --2- 172.21.15.50:0/307618148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa414108560 0x7fa414102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:05.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.294+0000 7fa41bdae700 1 --2- 172.21.15.50:0/307618148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4141009e0 0x7fa414101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:05.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.294+0000 7fa41bdae700 1 --2- 172.21.15.50:0/307618148 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa4000a2d30 0x7fa4000a51f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:05.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.294+0000 7fa41bdae700 1 --2- 172.21.15.50:0/307618148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4141013a0 0x7fa414102100 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:05.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.294+0000 7fa41bdae700 1 -- 172.21.15.50:0/307618148 >> 172.21.15.50:0/307618148 conn(0x7fa414077990 msgr2=0x7fa4140ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:05.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.294+0000 7fa41bdae700 1 -- 172.21.15.50:0/307618148 shutdown_connections 2024-06-06T03:25:05.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.294+0000 7fa41bdae700 1 -- 172.21.15.50:0/307618148 wait complete. 2024-06-06T03:25:05.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.330+0000 7f8104cf3700 1 -- 172.21.15.50:0/1254238898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81001030f0 msgr2=0x7f8100107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:05.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.330+0000 7f8104cf3700 1 --2- 172.21.15.50:0/1254238898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81001030f0 0x7f8100107110 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f80f800b0d0 tx=0x7f80f800b3e0 comp rx=0 tx=0).stop 2024-06-06T03:25:05.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.331+0000 7f8104cf3700 1 -- 172.21.15.50:0/1254238898 shutdown_connections 2024-06-06T03:25:05.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.331+0000 7f8104cf3700 1 --2- 172.21.15.50:0/1254238898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8100107840 0x7f810010f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:05.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.331+0000 7f8104cf3700 1 --2- 172.21.15.50:0/1254238898 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8100102740 0x7f8100102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:05.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.331+0000 7f8104cf3700 1 --2- 172.21.15.50:0/1254238898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81001030f0 0x7f8100107110 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:05.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.331+0000 7f8104cf3700 1 -- 172.21.15.50:0/1254238898 >> 172.21.15.50:0/1254238898 conn(0x7f81000795f0 msgr2=0x7f8100079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:05.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.331+0000 7f8104cf3700 1 -- 172.21.15.50:0/1254238898 shutdown_connections 2024-06-06T03:25:05.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.331+0000 7f8104cf3700 1 -- 172.21.15.50:0/1254238898 wait complete. 2024-06-06T03:25:05.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.331+0000 7f8104cf3700 1 Processor -- start 2024-06-06T03:25:05.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.331+0000 7f8104cf3700 1 -- start start 2024-06-06T03:25:05.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.332+0000 7f8104cf3700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8100102740 0x7f810010beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:05.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.332+0000 7f8104cf3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81001030f0 0x7f810010c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:05.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.332+0000 7f8104cf3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8100107840 0x7f81001a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:05.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.332+0000 7f8104cf3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8100075a20 con 0x7f8100107840 2024-06-06T03:25:05.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.332+0000 7f8104cf3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f81000758a0 con 0x7f81001030f0 2024-06-06T03:25:05.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.332+0000 7f8104cf3700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8100075ba0 con 0x7f8100102740 2024-06-06T03:25:05.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.332+0000 7f80fed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8100107840 0x7f81001a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:05.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.332+0000 7f80fed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8100107840 0x7f81001a4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52990/0 (socket says 172.21.15.50:52990) 2024-06-06T03:25:05.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.332+0000 7f80fed9d700 1 -- 172.21.15.50:0/213033572 learned_addr learned my addr 172.21.15.50:0/213033572 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:05.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.332+0000 7f80fdd9b700 1 --2- 172.21.15.50:0/213033572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81001030f0 0x7f810010c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:05.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.332+0000 7f80fe59c700 1 --2- 172.21.15.50:0/213033572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8100102740 0x7f810010beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:05.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.332+0000 7f80fed9d700 1 -- 172.21.15.50:0/213033572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8100102740 msgr2=0x7f810010beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:05.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.332+0000 7f80fed9d700 1 --2- 172.21.15.50:0/213033572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8100102740 0x7f810010beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:05.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.332+0000 7f80fed9d700 1 -- 172.21.15.50:0/213033572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81001030f0 msgr2=0x7f810010c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:05.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.332+0000 7f80fed9d700 1 --2- 172.21.15.50:0/213033572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81001030f0 0x7f810010c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:05.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.332+0000 7f80fed9d700 1 -- 172.21.15.50:0/213033572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81001a53a0 con 0x7f8100107840 2024-06-06T03:25:05.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.332+0000 7f80fed9d700 1 --2- 172.21.15.50:0/213033572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8100107840 0x7f81001a4cd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f80f000d980 tx=0x7f80f000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:05.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.333+0000 7f80ef7fe700 1 -- 172.21.15.50:0/213033572 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f0017070 con 0x7f8100107840 2024-06-06T03:25:05.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.333+0000 7f8104cf3700 1 -- 172.21.15.50:0/213033572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81001a5690 con 0x7f8100107840 2024-06-06T03:25:05.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.333+0000 7f80ef7fe700 1 -- 172.21.15.50:0/213033572 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f80f0005020 con 0x7f8100107840 2024-06-06T03:25:05.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.333+0000 7f8104cf3700 1 -- 172.21.15.50:0/213033572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81001abd80 con 0x7f8100107840 2024-06-06T03:25:05.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.333+0000 7f80ef7fe700 1 -- 172.21.15.50:0/213033572 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f000fa90 con 0x7f8100107840 2024-06-06T03:25:05.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.334+0000 7f8104cf3700 1 -- 172.21.15.50:0/213033572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80e0005330 con 0x7f8100107840 2024-06-06T03:25:05.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.335+0000 7f80ef7fe700 1 -- 172.21.15.50:0/213033572 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f80f000fc30 con 0x7f8100107840 2024-06-06T03:25:05.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.336+0000 7f80ef7fe700 1 --2- 172.21.15.50:0/213033572 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f80e80a2d30 0x7f80e80a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:05.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.336+0000 7f80fe59c700 1 --2- 172.21.15.50:0/213033572 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f80e80a2d30 0x7f80e80a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:05.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.336+0000 7f80ef7fe700 1 -- 172.21.15.50:0/213033572 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f80f00cf4e0 con 0x7f8100107840 2024-06-06T03:25:05.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.336+0000 7f80fe59c700 1 --2- 172.21.15.50:0/213033572 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f80e80a2d30 0x7f80e80a51f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f80f4004630 tx=0x7f80f400b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:05.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.339+0000 7f80ef7fe700 1 -- 172.21.15.50:0/213033572 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f80f0020020 con 0x7f8100107840 2024-06-06T03:25:05.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:05 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/307618148' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-06-06T03:25:05.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.551+0000 7f8104cf3700 1 -- 172.21.15.50:0/213033572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f80e00058f0 con 0x7f8100107840 2024-06-06T03:25:05.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.551+0000 7f80ef7fe700 1 -- 172.21.15.50:0/213033572 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f80f009bfe0 con 0x7f8100107840 2024-06-06T03:25:05.551 INFO:teuthology.orchestra.run.smithi050.stdout:287762808888 2024-06-06T03:25:05.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.553+0000 7f8104cf3700 1 -- 172.21.15.50:0/213033572 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f80e80a2d30 msgr2=0x7f80e80a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:05.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.553+0000 7f8104cf3700 1 --2- 172.21.15.50:0/213033572 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f80e80a2d30 0x7f80e80a51f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f80f4004630 tx=0x7f80f400b3c0 comp rx=0 tx=0).stop 2024-06-06T03:25:05.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.553+0000 7f8104cf3700 1 -- 172.21.15.50:0/213033572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8100107840 msgr2=0x7f81001a4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:05.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.553+0000 7f8104cf3700 1 --2- 172.21.15.50:0/213033572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8100107840 0x7f81001a4cd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f80f000d980 tx=0x7f80f000dc90 comp rx=0 tx=0).stop 2024-06-06T03:25:05.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.553+0000 7f8104cf3700 1 -- 172.21.15.50:0/213033572 shutdown_connections 2024-06-06T03:25:05.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.553+0000 7f8104cf3700 1 --2- 172.21.15.50:0/213033572 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f80e80a2d30 0x7f80e80a51f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:05.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.553+0000 7f8104cf3700 1 --2- 172.21.15.50:0/213033572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8100107840 0x7f81001a4cd0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:05.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.553+0000 7f8104cf3700 1 --2- 172.21.15.50:0/213033572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8100102740 0x7f810010beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:05.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.553+0000 7f8104cf3700 1 --2- 172.21.15.50:0/213033572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81001030f0 0x7f810010c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:05.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.553+0000 7f8104cf3700 1 -- 172.21.15.50:0/213033572 >> 172.21.15.50:0/213033572 conn(0x7f81000795f0 msgr2=0x7f8100100350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:05.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.553+0000 7f8104cf3700 1 -- 172.21.15.50:0/213033572 shutdown_connections 2024-06-06T03:25:05.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:05.553+0000 7f8104cf3700 1 -- 172.21.15.50:0/213033572 wait complete. 2024-06-06T03:25:05.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:05 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/307618148' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-06-06T03:25:05.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:05 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/307618148' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-06-06T03:25:05.951 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182479 got 107374182484 for osd.3 2024-06-06T03:25:05.951 DEBUG:teuthology.parallel:result is None 2024-06-06T03:25:06.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.260+0000 7f9c5ba5f700 1 -- 172.21.15.50:0/3093554472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c54107420 msgr2=0x7f9c54107800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:06.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.260+0000 7f9c5ba5f700 1 --2- 172.21.15.50:0/3093554472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c54107420 0x7f9c54107800 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9c5000b0a0 tx=0x7f9c5000b3b0 comp rx=0 tx=0).stop 2024-06-06T03:25:06.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.260+0000 7f9c5ba5f700 1 -- 172.21.15.50:0/3093554472 shutdown_connections 2024-06-06T03:25:06.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.260+0000 7f9c5ba5f700 1 --2- 172.21.15.50:0/3093554472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c54102eb0 0x7f9c5410f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:06.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.260+0000 7f9c5ba5f700 1 --2- 172.21.15.50:0/3093554472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c54107420 0x7f9c54107800 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:06.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.260+0000 7f9c5ba5f700 1 --2- 172.21.15.50:0/3093554472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c54102510 0x7f9c54102970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:06.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.260+0000 7f9c5ba5f700 1 -- 172.21.15.50:0/3093554472 >> 172.21.15.50:0/3093554472 conn(0x7f9c540795f0 msgr2=0x7f9c54079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:06.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.260+0000 7f9c5ba5f700 1 -- 172.21.15.50:0/3093554472 shutdown_connections 2024-06-06T03:25:06.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.260+0000 7f9c5ba5f700 1 -- 172.21.15.50:0/3093554472 wait complete. 2024-06-06T03:25:06.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.261+0000 7f9c5ba5f700 1 Processor -- start 2024-06-06T03:25:06.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.261+0000 7f9c5ba5f700 1 -- start start 2024-06-06T03:25:06.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.261+0000 7f9c5ba5f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c54102510 0x7f9c5419e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:06.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.261+0000 7f9c5ba5f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c54102eb0 0x7f9c5419ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:06.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.261+0000 7f9c5ba5f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c54107420 0x7f9c54198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:06.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.261+0000 7f9c5ba5f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9c54112660 con 0x7f9c54107420 2024-06-06T03:25:06.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.261+0000 7f9c5ba5f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9c541124e0 con 0x7f9c54102eb0 2024-06-06T03:25:06.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.261+0000 7f9c5ba5f700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9c541127e0 con 0x7f9c54102510 2024-06-06T03:25:06.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.261+0000 7f9c59ffc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c54107420 0x7f9c54198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:06.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.261+0000 7f9c59ffc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c54107420 0x7f9c54198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53010/0 (socket says 172.21.15.50:53010) 2024-06-06T03:25:06.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.261+0000 7f9c59ffc700 1 -- 172.21.15.50:0/2741541900 learned_addr learned my addr 172.21.15.50:0/2741541900 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:06.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.261+0000 7f9c58ffa700 1 --2- 172.21.15.50:0/2741541900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c54102eb0 0x7f9c5419ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:06.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.262+0000 7f9c597fb700 1 --2- 172.21.15.50:0/2741541900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c54102510 0x7f9c5419e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:06.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.262+0000 7f9c59ffc700 1 -- 172.21.15.50:0/2741541900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c54102510 msgr2=0x7f9c5419e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:06.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.262+0000 7f9c59ffc700 1 --2- 172.21.15.50:0/2741541900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c54102510 0x7f9c5419e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:06.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.262+0000 7f9c59ffc700 1 -- 172.21.15.50:0/2741541900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c54102eb0 msgr2=0x7f9c5419ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:06.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.262+0000 7f9c59ffc700 1 --2- 172.21.15.50:0/2741541900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c54102eb0 0x7f9c5419ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:06.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.262+0000 7f9c59ffc700 1 -- 172.21.15.50:0/2741541900 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c541990c0 con 0x7f9c54107420 2024-06-06T03:25:06.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.262+0000 7f9c59ffc700 1 --2- 172.21.15.50:0/2741541900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c54107420 0x7f9c54198960 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c00c970 tx=0x7f9c4c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:06.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.262+0000 7f9c4a7fc700 1 -- 172.21.15.50:0/2741541900 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c004a30 con 0x7f9c54107420 2024-06-06T03:25:06.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.262+0000 7f9c4a7fc700 1 -- 172.21.15.50:0/2741541900 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9c4c0054d0 con 0x7f9c54107420 2024-06-06T03:25:06.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.262+0000 7f9c4a7fc700 1 -- 172.21.15.50:0/2741541900 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c00ec10 con 0x7f9c54107420 2024-06-06T03:25:06.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.262+0000 7f9c5ba5f700 1 -- 172.21.15.50:0/2741541900 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c541993b0 con 0x7f9c54107420 2024-06-06T03:25:06.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.262+0000 7f9c5ba5f700 1 -- 172.21.15.50:0/2741541900 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c541a5670 con 0x7f9c54107420 2024-06-06T03:25:06.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.263+0000 7f9c5ba5f700 1 -- 172.21.15.50:0/2741541900 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c54069180 con 0x7f9c54107420 2024-06-06T03:25:06.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.264+0000 7f9c4a7fc700 1 -- 172.21.15.50:0/2741541900 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9c4c005000 con 0x7f9c54107420 2024-06-06T03:25:06.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.265+0000 7f9c4a7fc700 1 --2- 172.21.15.50:0/2741541900 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9c400a2cb0 0x7f9c400a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:06.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.265+0000 7f9c597fb700 1 --2- 172.21.15.50:0/2741541900 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9c400a2cb0 0x7f9c400a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:06.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.265+0000 7f9c4a7fc700 1 -- 172.21.15.50:0/2741541900 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f9c4c0cf2d0 con 0x7f9c54107420 2024-06-06T03:25:06.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.266+0000 7f9c597fb700 1 --2- 172.21.15.50:0/2741541900 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9c400a2cb0 0x7f9c400a5170 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9c50009fd0 tx=0x7f9c5000b7b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:06.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.269+0000 7f9c4a7fc700 1 -- 172.21.15.50:0/2741541900 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9c4c014030 con 0x7f9c54107420 2024-06-06T03:25:06.479 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:06 smithi050 ceph-mon[32421]: pgmap v385: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-06-06T03:25:06.479 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:06 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/213033572' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-06-06T03:25:06.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.509+0000 7f9c5ba5f700 1 -- 172.21.15.50:0/2741541900 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9c5410aa50 con 0x7f9c54107420 2024-06-06T03:25:06.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.510+0000 7f9c4a7fc700 1 -- 172.21.15.50:0/2741541900 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9c4c0052f0 con 0x7f9c54107420 2024-06-06T03:25:06.510 INFO:teuthology.orchestra.run.smithi050.stdout:197568495689 2024-06-06T03:25:06.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.514+0000 7f9c5ba5f700 1 -- 172.21.15.50:0/2741541900 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9c400a2cb0 msgr2=0x7f9c400a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:06.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.514+0000 7f9c5ba5f700 1 --2- 172.21.15.50:0/2741541900 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9c400a2cb0 0x7f9c400a5170 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9c50009fd0 tx=0x7f9c5000b7b0 comp rx=0 tx=0).stop 2024-06-06T03:25:06.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.514+0000 7f9c5ba5f700 1 -- 172.21.15.50:0/2741541900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c54107420 msgr2=0x7f9c54198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:06.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.514+0000 7f9c5ba5f700 1 --2- 172.21.15.50:0/2741541900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c54107420 0x7f9c54198960 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c00c970 tx=0x7f9c4c00cc80 comp rx=0 tx=0).stop 2024-06-06T03:25:06.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.514+0000 7f9c5ba5f700 1 -- 172.21.15.50:0/2741541900 shutdown_connections 2024-06-06T03:25:06.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.514+0000 7f9c5ba5f700 1 --2- 172.21.15.50:0/2741541900 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9c400a2cb0 0x7f9c400a5170 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:06.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.514+0000 7f9c5ba5f700 1 --2- 172.21.15.50:0/2741541900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c54107420 0x7f9c54198960 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:06.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.514+0000 7f9c5ba5f700 1 --2- 172.21.15.50:0/2741541900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c54102510 0x7f9c5419e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:06.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.514+0000 7f9c5ba5f700 1 --2- 172.21.15.50:0/2741541900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c54102eb0 0x7f9c5419ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:06.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.514+0000 7f9c5ba5f700 1 -- 172.21.15.50:0/2741541900 >> 172.21.15.50:0/2741541900 conn(0x7f9c540795f0 msgr2=0x7f9c541006c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:06.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.514+0000 7f9c5ba5f700 1 -- 172.21.15.50:0/2741541900 shutdown_connections 2024-06-06T03:25:06.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.514+0000 7f9c5ba5f700 1 -- 172.21.15.50:0/2741541900 wait complete. 2024-06-06T03:25:06.518 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574938 got 55834574943 for osd.1 2024-06-06T03:25:06.518 DEBUG:teuthology.parallel:result is None 2024-06-06T03:25:06.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:06 smithi079 ceph-mon[35478]: pgmap v385: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-06-06T03:25:06.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:06 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/213033572' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-06-06T03:25:06.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:06 smithi122 ceph-mon[35759]: pgmap v385: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-06-06T03:25:06.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:06 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/213033572' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-06-06T03:25:07.236 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332158 got 219043332162 for osd.7 2024-06-06T03:25:07.236 DEBUG:teuthology.parallel:result is None 2024-06-06T03:25:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.408+0000 7fe205768700 1 -- 172.21.15.50:0/1469371866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe200102740 msgr2=0x7fe200102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.408+0000 7fe205768700 1 --2- 172.21.15.50:0/1469371866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe200102740 0x7fe200102b20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe1f00099c0 tx=0x7fe1f0009cd0 comp rx=0 tx=0).stop 2024-06-06T03:25:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.408+0000 7fe205768700 1 -- 172.21.15.50:0/1469371866 shutdown_connections 2024-06-06T03:25:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.408+0000 7fe205768700 1 --2- 172.21.15.50:0/1469371866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe200107840 0x7fe20010f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.408+0000 7fe205768700 1 --2- 172.21.15.50:0/1469371866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe200102740 0x7fe200102b20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.408+0000 7fe205768700 1 --2- 172.21.15.50:0/1469371866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2001030f0 0x7fe200107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.408+0000 7fe205768700 1 -- 172.21.15.50:0/1469371866 >> 172.21.15.50:0/1469371866 conn(0x7fe2000795f0 msgr2=0x7fe200079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.408+0000 7fe205768700 1 -- 172.21.15.50:0/1469371866 shutdown_connections 2024-06-06T03:25:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.408+0000 7fe205768700 1 -- 172.21.15.50:0/1469371866 wait complete. 2024-06-06T03:25:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.409+0000 7fe205768700 1 Processor -- start 2024-06-06T03:25:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.409+0000 7fe205768700 1 -- start start 2024-06-06T03:25:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.409+0000 7fe205768700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe200102740 0x7fe200074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.409+0000 7fe205768700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2001030f0 0x7fe200074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.409+0000 7fe205768700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe200107840 0x7fe200075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.409+0000 7fe205768700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe200112690 con 0x7fe2001030f0 2024-06-06T03:25:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.409+0000 7fe205768700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe200112510 con 0x7fe200102740 2024-06-06T03:25:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.409+0000 7fe205768700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe200112810 con 0x7fe200107840 2024-06-06T03:25:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.409+0000 7fe1f67fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2001030f0 0x7fe200074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.409+0000 7fe1f67fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2001030f0 0x7fe200074cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53026/0 (socket says 172.21.15.50:53026) 2024-06-06T03:25:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.409+0000 7fe1f67fc700 1 -- 172.21.15.50:0/3649895979 learned_addr learned my addr 172.21.15.50:0/3649895979 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.410+0000 7fe1ff7fe700 1 --2- 172.21.15.50:0/3649895979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe200107840 0x7fe200075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.410+0000 7fe1feffd700 1 --2- 172.21.15.50:0/3649895979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe200102740 0x7fe200074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.410+0000 7fe1f67fc700 1 -- 172.21.15.50:0/3649895979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe200107840 msgr2=0x7fe200075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.410+0000 7fe1f67fc700 1 --2- 172.21.15.50:0/3649895979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe200107840 0x7fe200075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.410+0000 7fe1f67fc700 1 -- 172.21.15.50:0/3649895979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe200102740 msgr2=0x7fe200074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.410+0000 7fe1f67fc700 1 --2- 172.21.15.50:0/3649895979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe200102740 0x7fe200074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:07.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.410+0000 7fe1f67fc700 1 -- 172.21.15.50:0/3649895979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2001a7090 con 0x7fe2001030f0 2024-06-06T03:25:07.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.410+0000 7fe1f67fc700 1 --2- 172.21.15.50:0/3649895979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2001030f0 0x7fe200074cd0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe1e800d950 tx=0x7fe1e800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:07.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.410+0000 7fe1fcff9700 1 -- 172.21.15.50:0/3649895979 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8016070 con 0x7fe2001030f0 2024-06-06T03:25:07.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.410+0000 7fe205768700 1 -- 172.21.15.50:0/3649895979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2001a7380 con 0x7fe2001030f0 2024-06-06T03:25:07.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.410+0000 7fe1fcff9700 1 -- 172.21.15.50:0/3649895979 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe1e800fd40 con 0x7fe2001030f0 2024-06-06T03:25:07.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.410+0000 7fe1fcff9700 1 -- 172.21.15.50:0/3649895979 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e800e3b0 con 0x7fe2001030f0 2024-06-06T03:25:07.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.410+0000 7fe205768700 1 -- 172.21.15.50:0/3649895979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2001a7910 con 0x7fe2001030f0 2024-06-06T03:25:07.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.411+0000 7fe205768700 1 -- 172.21.15.50:0/3649895979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe20010aa80 con 0x7fe2001030f0 2024-06-06T03:25:07.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.412+0000 7fe1fcff9700 1 -- 172.21.15.50:0/3649895979 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe1e8019070 con 0x7fe2001030f0 2024-06-06T03:25:07.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.413+0000 7fe1fcff9700 1 --2- 172.21.15.50:0/3649895979 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe1ec0a2cb0 0x7fe1ec0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:07.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.414+0000 7fe1feffd700 1 --2- 172.21.15.50:0/3649895979 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe1ec0a2cb0 0x7fe1ec0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:07.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.414+0000 7fe1fcff9700 1 -- 172.21.15.50:0/3649895979 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fe1e80ceff0 con 0x7fe2001030f0 2024-06-06T03:25:07.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.414+0000 7fe1feffd700 1 --2- 172.21.15.50:0/3649895979 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe1ec0a2cb0 0x7fe1ec0a5170 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0000c00 tx=0x7fe1f0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:07.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.418+0000 7fe1fcff9700 1 -- 172.21.15.50:0/3649895979 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe1e809ba30 con 0x7fe2001030f0 2024-06-06T03:25:07.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.626+0000 7fe205768700 1 -- 172.21.15.50:0/3649895979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fe200075cc0 con 0x7fe2001030f0 2024-06-06T03:25:07.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.626+0000 7fe1fcff9700 1 -- 172.21.15.50:0/3649895979 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe1e809b330 con 0x7fe2001030f0 2024-06-06T03:25:07.626 INFO:teuthology.orchestra.run.smithi050.stdout:253403070526 2024-06-06T03:25:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.628+0000 7fe205768700 1 -- 172.21.15.50:0/3649895979 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe1ec0a2cb0 msgr2=0x7fe1ec0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.628+0000 7fe205768700 1 --2- 172.21.15.50:0/3649895979 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe1ec0a2cb0 0x7fe1ec0a5170 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0000c00 tx=0x7fe1f0005fb0 comp rx=0 tx=0).stop 2024-06-06T03:25:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.628+0000 7fe205768700 1 -- 172.21.15.50:0/3649895979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2001030f0 msgr2=0x7fe200074cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.628+0000 7fe205768700 1 --2- 172.21.15.50:0/3649895979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2001030f0 0x7fe200074cd0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe1e800d950 tx=0x7fe1e800dc60 comp rx=0 tx=0).stop 2024-06-06T03:25:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.628+0000 7fe205768700 1 -- 172.21.15.50:0/3649895979 shutdown_connections 2024-06-06T03:25:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.628+0000 7fe205768700 1 --2- 172.21.15.50:0/3649895979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe200107840 0x7fe200075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.628+0000 7fe205768700 1 --2- 172.21.15.50:0/3649895979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe200102740 0x7fe200074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.628+0000 7fe205768700 1 --2- 172.21.15.50:0/3649895979 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe1ec0a2cb0 0x7fe1ec0a5170 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.628+0000 7fe205768700 1 --2- 172.21.15.50:0/3649895979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2001030f0 0x7fe200074cd0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.628+0000 7fe205768700 1 -- 172.21.15.50:0/3649895979 >> 172.21.15.50:0/3649895979 conn(0x7fe2000795f0 msgr2=0x7fe200100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.629+0000 7fe205768700 1 -- 172.21.15.50:0/3649895979 shutdown_connections 2024-06-06T03:25:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:07.629+0000 7fe205768700 1 -- 172.21.15.50:0/3649895979 wait complete. 2024-06-06T03:25:07.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:07 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/2741541900' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-06-06T03:25:07.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:07 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3340584818' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-06T03:25:07.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:07 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/2741541900' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-06-06T03:25:07.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:07 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/3340584818' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-06T03:25:07.853 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757320 got 163208757325 for osd.5 2024-06-06T03:25:07.853 DEBUG:teuthology.parallel:result is None 2024-06-06T03:25:07.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.700+0000 7fa1e346f700 1 -- 172.21.15.50:0/2201177808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1dc1085f0 msgr2=0x7fa1dc1089d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:07.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.700+0000 7fa1e346f700 1 --2- 172.21.15.50:0/2201177808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1dc1085f0 0x7fa1dc1089d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8009990 tx=0x7fa1d8009ca0 comp rx=0 tx=0).stop 2024-06-06T03:25:07.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.700+0000 7fa1e346f700 1 -- 172.21.15.50:0/2201177808 shutdown_connections 2024-06-06T03:25:07.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.700+0000 7fa1e346f700 1 --2- 172.21.15.50:0/2201177808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1dc102ea0 0x7fa1dc10f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:07.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.700+0000 7fa1e346f700 1 --2- 172.21.15.50:0/2201177808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1dc1085f0 0x7fa1dc1089d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:07.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.700+0000 7fa1e346f700 1 --2- 172.21.15.50:0/2201177808 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1dc1024e0 0x7fa1dc102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:07.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.700+0000 7fa1e346f700 1 -- 172.21.15.50:0/2201177808 >> 172.21.15.50:0/2201177808 conn(0x7fa1dc079640 msgr2=0x7fa1dc079a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:07.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.700+0000 7fa1e346f700 1 -- 172.21.15.50:0/2201177808 shutdown_connections 2024-06-06T03:25:07.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.700+0000 7fa1e346f700 1 -- 172.21.15.50:0/2201177808 wait complete. 2024-06-06T03:25:07.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.701+0000 7fa1e346f700 1 Processor -- start 2024-06-06T03:25:07.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.701+0000 7fa1e346f700 1 -- start start 2024-06-06T03:25:07.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.701+0000 7fa1e346f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1dc1024e0 0x7fa1dc19e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:07.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.701+0000 7fa1e346f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1dc102ea0 0x7fa1dc19ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:07.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.701+0000 7fa1e346f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1dc1085f0 0x7fa1dc1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:07.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.701+0000 7fa1e346f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa1dc112640 con 0x7fa1dc1024e0 2024-06-06T03:25:07.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.701+0000 7fa1e346f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa1dc1124c0 con 0x7fa1dc1085f0 2024-06-06T03:25:07.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.701+0000 7fa1e346f700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa1dc1127c0 con 0x7fa1dc102ea0 2024-06-06T03:25:07.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.701+0000 7fa1e120b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1dc1024e0 0x7fa1dc19e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:07.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.701+0000 7fa1e120b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1dc1024e0 0x7fa1dc19e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53018/0 (socket says 172.21.15.50:53018) 2024-06-06T03:25:07.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.701+0000 7fa1e120b700 1 -- 172.21.15.50:0/3340584818 learned_addr learned my addr 172.21.15.50:0/3340584818 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:07.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.701+0000 7fa1e1a0c700 1 --2- 172.21.15.50:0/3340584818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1dc1085f0 0x7fa1dc1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:07.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.701+0000 7fa1e0a0a700 1 --2- 172.21.15.50:0/3340584818 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1dc102ea0 0x7fa1dc19ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:07.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.702+0000 7fa1e120b700 1 -- 172.21.15.50:0/3340584818 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1dc102ea0 msgr2=0x7fa1dc19ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:07.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.702+0000 7fa1e120b700 1 --2- 172.21.15.50:0/3340584818 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1dc102ea0 0x7fa1dc19ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:07.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.702+0000 7fa1e120b700 1 -- 172.21.15.50:0/3340584818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1dc1085f0 msgr2=0x7fa1dc1989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:07.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.702+0000 7fa1e120b700 1 --2- 172.21.15.50:0/3340584818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1dc1085f0 0x7fa1dc1989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:07.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.702+0000 7fa1e120b700 1 -- 172.21.15.50:0/3340584818 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1dc199100 con 0x7fa1dc1024e0 2024-06-06T03:25:07.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.702+0000 7fa1e0a0a700 1 --2- 172.21.15.50:0/3340584818 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1dc102ea0 0x7fa1dc19ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:25:07.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.702+0000 7fa1e1a0c700 1 --2- 172.21.15.50:0/3340584818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1dc1085f0 0x7fa1dc1989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:25:07.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.702+0000 7fa1e120b700 1 --2- 172.21.15.50:0/3340584818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1dc1024e0 0x7fa1dc19e7e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8000c00 tx=0x7fa1d8003b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:07.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.702+0000 7fa1d27fc700 1 -- 172.21.15.50:0/3340584818 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8027070 con 0x7fa1dc1024e0 2024-06-06T03:25:07.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.702+0000 7fa1e346f700 1 -- 172.21.15.50:0/3340584818 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1dc199390 con 0x7fa1dc1024e0 2024-06-06T03:25:07.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.702+0000 7fa1d27fc700 1 -- 172.21.15.50:0/3340584818 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa1d800bdc0 con 0x7fa1dc1024e0 2024-06-06T03:25:07.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.702+0000 7fa1d27fc700 1 -- 172.21.15.50:0/3340584818 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d800f460 con 0x7fa1dc1024e0 2024-06-06T03:25:07.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.702+0000 7fa1e346f700 1 -- 172.21.15.50:0/3340584818 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1dc1a56b0 con 0x7fa1dc1024e0 2024-06-06T03:25:07.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.703+0000 7fa1e346f700 1 -- 172.21.15.50:0/3340584818 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1dc069180 con 0x7fa1dc1024e0 2024-06-06T03:25:07.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.704+0000 7fa1d27fc700 1 -- 172.21.15.50:0/3340584818 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa1d802a070 con 0x7fa1dc1024e0 2024-06-06T03:25:07.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.705+0000 7fa1d27fc700 1 --2- 172.21.15.50:0/3340584818 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa1c80a2cb0 0x7fa1c80a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:07.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.705+0000 7fa1e0a0a700 1 --2- 172.21.15.50:0/3340584818 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa1c80a2cb0 0x7fa1c80a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:07.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.705+0000 7fa1d27fc700 1 -- 172.21.15.50:0/3340584818 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fa1d80d0840 con 0x7fa1dc1024e0 2024-06-06T03:25:07.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.705+0000 7fa1e0a0a700 1 --2- 172.21.15.50:0/3340584818 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa1c80a2cb0 0x7fa1c80a5170 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc005fd0 tx=0x7fa1cc005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:07.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.708+0000 7fa1d27fc700 1 -- 172.21.15.50:0/3340584818 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa1d8013070 con 0x7fa1dc1024e0 2024-06-06T03:25:07.926 INFO:teuthology.orchestra.run.smithi050.stdout:141733920851 2024-06-06T03:25:07.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.920+0000 7fa1e346f700 1 -- 172.21.15.50:0/3340584818 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fa1dc02dca0 con 0x7fa1dc1024e0 2024-06-06T03:25:07.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.920+0000 7fa1d27fc700 1 -- 172.21.15.50:0/3340584818 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa1d809d350 con 0x7fa1dc1024e0 2024-06-06T03:25:07.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.923+0000 7fa1e346f700 1 -- 172.21.15.50:0/3340584818 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa1c80a2cb0 msgr2=0x7fa1c80a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.923+0000 7fa1e346f700 1 --2- 172.21.15.50:0/3340584818 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa1c80a2cb0 0x7fa1c80a5170 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc005fd0 tx=0x7fa1cc005ee0 comp rx=0 tx=0).stop 2024-06-06T03:25:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.923+0000 7fa1e346f700 1 -- 172.21.15.50:0/3340584818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1dc1024e0 msgr2=0x7fa1dc19e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.923+0000 7fa1e346f700 1 --2- 172.21.15.50:0/3340584818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1dc1024e0 0x7fa1dc19e7e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8000c00 tx=0x7fa1d8003b30 comp rx=0 tx=0).stop 2024-06-06T03:25:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.923+0000 7fa1e346f700 1 -- 172.21.15.50:0/3340584818 shutdown_connections 2024-06-06T03:25:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.923+0000 7fa1e346f700 1 --2- 172.21.15.50:0/3340584818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1dc1085f0 0x7fa1dc1989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.923+0000 7fa1e346f700 1 --2- 172.21.15.50:0/3340584818 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa1c80a2cb0 0x7fa1c80a5170 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.923+0000 7fa1e346f700 1 --2- 172.21.15.50:0/3340584818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1dc1024e0 0x7fa1dc19e7e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.923+0000 7fa1e346f700 1 --2- 172.21.15.50:0/3340584818 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1dc102ea0 0x7fa1dc19ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.923+0000 7fa1e346f700 1 -- 172.21.15.50:0/3340584818 >> 172.21.15.50:0/3340584818 conn(0x7fa1dc079640 msgr2=0x7fa1dc101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.923+0000 7fa1e346f700 1 -- 172.21.15.50:0/3340584818 shutdown_connections 2024-06-06T03:25:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:06.923+0000 7fa1e346f700 1 -- 172.21.15.50:0/3340584818 wait complete. 2024-06-06T03:25:07.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:07 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/2741541900' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-06-06T03:25:07.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:07 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/3340584818' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-06T03:25:08.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:08 smithi050 ceph-mon[32421]: pgmap v386: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:25:08.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:08 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3649895979' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-06-06T03:25:08.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:08 smithi079 ceph-mon[35478]: pgmap v386: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:25:08.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:08 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/3649895979' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-06-06T03:25:08.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:08 smithi122 ceph-mon[35759]: pgmap v386: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:25:08.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:08 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/3649895979' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-06-06T03:25:09.105 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495682 got 197568495689 for osd.6 2024-06-06T03:25:09.106 DEBUG:teuthology.parallel:result is None 2024-06-06T03:25:09.511 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808883 got 287762808888 for osd.9 2024-06-06T03:25:09.511 DEBUG:teuthology.parallel:result is None 2024-06-06T03:25:10.067 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:25:10.074 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920844 got 141733920851 for osd.4 2024-06-06T03:25:10.075 DEBUG:teuthology.parallel:result is None 2024-06-06T03:25:10.613 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070520 got 253403070526 for osd.8 2024-06-06T03:25:10.614 DEBUG:teuthology.parallel:result is None 2024-06-06T03:25:10.723 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:10 smithi050 ceph-mon[32421]: pgmap v387: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:25:10.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:10 smithi079 ceph-mon[35478]: pgmap v387: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:25:10.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:10 smithi122 ceph-mon[35759]: pgmap v387: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:25:12.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.407+0000 7f164bc41700 1 -- 172.21.15.50:0/498488136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f164406a170 msgr2=0x7f164406a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:12.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.407+0000 7f164bc41700 1 --2- 172.21.15.50:0/498488136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f164406a170 0x7f164406a5f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1634009990 tx=0x7f1634009ca0 comp rx=0 tx=0).stop 2024-06-06T03:25:12.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.407+0000 7f164bc41700 1 -- 172.21.15.50:0/498488136 shutdown_connections 2024-06-06T03:25:12.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.407+0000 7f164bc41700 1 --2- 172.21.15.50:0/498488136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f164406ab30 0x7f164410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:12.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.407+0000 7f164bc41700 1 --2- 172.21.15.50:0/498488136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1644108500 0x7f16441088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:12.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.407+0000 7f164bc41700 1 --2- 172.21.15.50:0/498488136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f164406a170 0x7f164406a5f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:12.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.407+0000 7f164bc41700 1 -- 172.21.15.50:0/498488136 >> 172.21.15.50:0/498488136 conn(0x7f1644078340 msgr2=0x7f1644078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:12.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.407+0000 7f164bc41700 1 -- 172.21.15.50:0/498488136 shutdown_connections 2024-06-06T03:25:12.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.407+0000 7f164bc41700 1 -- 172.21.15.50:0/498488136 wait complete. 2024-06-06T03:25:12.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.408+0000 7f164bc41700 1 Processor -- start 2024-06-06T03:25:12.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.408+0000 7f164bc41700 1 -- start start 2024-06-06T03:25:12.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.408+0000 7f164bc41700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f164406a170 0x7f1644101460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:12.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.408+0000 7f164bc41700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f164406ab30 0x7f16441019a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:12.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.408+0000 7f164bc41700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1644108500 0x7f1644101ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:12.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.408+0000 7f164bc41700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1644112760 con 0x7f164406ab30 2024-06-06T03:25:12.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.408+0000 7f164bc41700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f16441125e0 con 0x7f1644108500 2024-06-06T03:25:12.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.408+0000 7f164bc41700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f16441128e0 con 0x7f164406a170 2024-06-06T03:25:12.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.408+0000 7f16491dc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f164406ab30 0x7f16441019a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:12.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.408+0000 7f16491dc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f164406ab30 0x7f16441019a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53514/0 (socket says 172.21.15.50:53514) 2024-06-06T03:25:12.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.408+0000 7f16491dc700 1 -- 172.21.15.50:0/1938873394 learned_addr learned my addr 172.21.15.50:0/1938873394 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:12.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.408+0000 7f16499dd700 1 --2- 172.21.15.50:0/1938873394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f164406a170 0x7f1644101460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:12.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.408+0000 7f164a1de700 1 --2- 172.21.15.50:0/1938873394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1644108500 0x7f1644101ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:12.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.408+0000 7f16491dc700 1 -- 172.21.15.50:0/1938873394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f164406a170 msgr2=0x7f1644101460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:12.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.408+0000 7f16491dc700 1 --2- 172.21.15.50:0/1938873394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f164406a170 0x7f1644101460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:12.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.408+0000 7f16491dc700 1 -- 172.21.15.50:0/1938873394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1644108500 msgr2=0x7f1644101ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:12.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.408+0000 7f16491dc700 1 --2- 172.21.15.50:0/1938873394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1644108500 0x7f1644101ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:12.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.408+0000 7f16491dc700 1 -- 172.21.15.50:0/1938873394 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16441a71e0 con 0x7f164406ab30 2024-06-06T03:25:12.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.408+0000 7f16499dd700 1 --2- 172.21.15.50:0/1938873394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f164406a170 0x7f1644101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:25:12.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.408+0000 7f164a1de700 1 --2- 172.21.15.50:0/1938873394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1644108500 0x7f1644101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:25:12.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.409+0000 7f16491dc700 1 --2- 172.21.15.50:0/1938873394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f164406ab30 0x7f16441019a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1634000c00 tx=0x7f16340036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:12.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.409+0000 7f163affd700 1 -- 172.21.15.50:0/1938873394 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1634027070 con 0x7f164406ab30 2024-06-06T03:25:12.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.409+0000 7f164bc41700 1 -- 172.21.15.50:0/1938873394 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16441a7470 con 0x7f164406ab30 2024-06-06T03:25:12.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.409+0000 7f163affd700 1 -- 172.21.15.50:0/1938873394 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1634004090 con 0x7f164406ab30 2024-06-06T03:25:12.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.409+0000 7f164bc41700 1 -- 172.21.15.50:0/1938873394 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16441a7920 con 0x7f164406ab30 2024-06-06T03:25:12.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.409+0000 7f163affd700 1 -- 172.21.15.50:0/1938873394 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1634022e20 con 0x7f164406ab30 2024-06-06T03:25:12.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.410+0000 7f164bc41700 1 -- 172.21.15.50:0/1938873394 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1644069180 con 0x7f164406ab30 2024-06-06T03:25:12.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.411+0000 7f163affd700 1 -- 172.21.15.50:0/1938873394 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f163402a070 con 0x7f164406ab30 2024-06-06T03:25:12.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.412+0000 7f163affd700 1 --2- 172.21.15.50:0/1938873394 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f16300a2d30 0x7f16300a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:12.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.412+0000 7f16499dd700 1 --2- 172.21.15.50:0/1938873394 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f16300a2d30 0x7f16300a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:12.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.412+0000 7f163affd700 1 -- 172.21.15.50:0/1938873394 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f16340d0360 con 0x7f164406ab30 2024-06-06T03:25:12.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.413+0000 7f16499dd700 1 --2- 172.21.15.50:0/1938873394 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f16300a2d30 0x7f16300a51f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1640007900 tx=0x7f1640008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:12.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.416+0000 7f163affd700 1 -- 172.21.15.50:0/1938873394 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1634013070 con 0x7f164406ab30 2024-06-06T03:25:12.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.626+0000 7f164bc41700 1 -- 172.21.15.50:0/1938873394 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f164402dca0 con 0x7f164406ab30 2024-06-06T03:25:12.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.627+0000 7f163affd700 1 -- 172.21.15.50:0/1938873394 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f163409ce10 con 0x7f164406ab30 2024-06-06T03:25:12.626 INFO:teuthology.orchestra.run.smithi050.stdout:309237645363 2024-06-06T03:25:12.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.629+0000 7f164bc41700 1 -- 172.21.15.50:0/1938873394 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f16300a2d30 msgr2=0x7f16300a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:12.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.629+0000 7f164bc41700 1 --2- 172.21.15.50:0/1938873394 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f16300a2d30 0x7f16300a51f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1640007900 tx=0x7f1640008040 comp rx=0 tx=0).stop 2024-06-06T03:25:12.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.629+0000 7f164bc41700 1 -- 172.21.15.50:0/1938873394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f164406ab30 msgr2=0x7f16441019a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:12.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.629+0000 7f164bc41700 1 --2- 172.21.15.50:0/1938873394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f164406ab30 0x7f16441019a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1634000c00 tx=0x7f16340036f0 comp rx=0 tx=0).stop 2024-06-06T03:25:12.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.629+0000 7f164bc41700 1 -- 172.21.15.50:0/1938873394 shutdown_connections 2024-06-06T03:25:12.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.629+0000 7f164bc41700 1 --2- 172.21.15.50:0/1938873394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1644108500 0x7f1644101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:12.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.629+0000 7f164bc41700 1 --2- 172.21.15.50:0/1938873394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f164406a170 0x7f1644101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:12.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.629+0000 7f164bc41700 1 --2- 172.21.15.50:0/1938873394 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f16300a2d30 0x7f16300a51f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:12.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.629+0000 7f164bc41700 1 --2- 172.21.15.50:0/1938873394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f164406ab30 0x7f16441019a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:12.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.629+0000 7f164bc41700 1 -- 172.21.15.50:0/1938873394 >> 172.21.15.50:0/1938873394 conn(0x7f1644078340 msgr2=0x7f1644100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:12.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.629+0000 7f164bc41700 1 -- 172.21.15.50:0/1938873394 shutdown_connections 2024-06-06T03:25:12.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:12.629+0000 7f164bc41700 1 -- 172.21.15.50:0/1938873394 wait complete. 2024-06-06T03:25:13.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:12 smithi050 ceph-mon[32421]: pgmap v388: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:25:13.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:12 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:25:13.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:12 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:25:13.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:12 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1938873394' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-06-06T03:25:13.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:12 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:25:13.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:12 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:25:13.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:12 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:25:13.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:12 smithi079 ceph-mon[35478]: pgmap v388: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:25:13.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:12 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:25:13.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:12 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:25:13.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:12 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/1938873394' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-06-06T03:25:13.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:12 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:25:13.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:12 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:25:13.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:12 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:25:13.355 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645359 got 309237645363 for osd.10 2024-06-06T03:25:13.355 DEBUG:teuthology.parallel:result is None 2024-06-06T03:25:13.356 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-06-06T03:25:13.356 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-06-06T03:25:13.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:12 smithi122 ceph-mon[35759]: pgmap v388: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:25:13.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:12 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:25:13.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:12 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:25:13.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:12 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/1938873394' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-06-06T03:25:13.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:12 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:25:13.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:12 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:25:13.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:12 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:25:13.611 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:25:15.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:15 smithi050 ceph-mon[32421]: pgmap v389: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-06-06T03:25:15.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:15 smithi050 ceph-mon[32421]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-06-06T03:25:15.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:15 smithi079 ceph-mon[35478]: pgmap v389: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-06-06T03:25:15.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:15 smithi079 ceph-mon[35478]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-06-06T03:25:15.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:15 smithi122 ceph-mon[35759]: pgmap v389: 129 pgs: 129 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-06-06T03:25:15.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:15 smithi122 ceph-mon[35759]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-06-06T03:25:15.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.465+0000 7f4594523700 1 -- 172.21.15.50:0/2151478901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f458c101880 msgr2=0x7f458c10f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:15.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.465+0000 7f4594523700 1 --2- 172.21.15.50:0/2151478901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f458c101880 0x7f458c10f380 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f458400b0a0 tx=0x7f458400b3b0 comp rx=0 tx=0).stop 2024-06-06T03:25:15.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.465+0000 7f4594523700 1 -- 172.21.15.50:0/2151478901 shutdown_connections 2024-06-06T03:25:15.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.465+0000 7f4594523700 1 --2- 172.21.15.50:0/2151478901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f458c101880 0x7f458c10f380 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:15.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.465+0000 7f4594523700 1 --2- 172.21.15.50:0/2151478901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f458c108670 0x7f458c108a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:15.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.465+0000 7f4594523700 1 --2- 172.21.15.50:0/2151478901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f458c100ec0 0x7f458c101340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:15.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.465+0000 7f4594523700 1 -- 172.21.15.50:0/2151478901 >> 172.21.15.50:0/2151478901 conn(0x7f458c076600 msgr2=0x7f458c076a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:15.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.465+0000 7f4594523700 1 -- 172.21.15.50:0/2151478901 shutdown_connections 2024-06-06T03:25:15.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.465+0000 7f4594523700 1 -- 172.21.15.50:0/2151478901 wait complete. 2024-06-06T03:25:15.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.465+0000 7f4594523700 1 Processor -- start 2024-06-06T03:25:15.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.465+0000 7f4594523700 1 -- start start 2024-06-06T03:25:15.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.466+0000 7f4594523700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f458c100ec0 0x7f458c19e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:15.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.466+0000 7f4594523700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f458c101880 0x7f458c19ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:15.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.466+0000 7f4594523700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f458c108670 0x7f458c198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:15.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.466+0000 7f4594523700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f458c1126a0 con 0x7f458c108670 2024-06-06T03:25:15.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.466+0000 7f4594523700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f458c112520 con 0x7f458c100ec0 2024-06-06T03:25:15.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.466+0000 7f4594523700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f458c112820 con 0x7f458c101880 2024-06-06T03:25:15.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.466+0000 7f4592ac0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f458c108670 0x7f458c198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:15.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.466+0000 7f4591abe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f458c101880 0x7f458c19ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:15.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.466+0000 7f4591abe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f458c101880 0x7f458c19ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:47700/0 (socket says 172.21.15.50:47700) 2024-06-06T03:25:15.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.466+0000 7f4592ac0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f458c108670 0x7f458c198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53532/0 (socket says 172.21.15.50:53532) 2024-06-06T03:25:15.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.466+0000 7f4591abe700 1 -- 172.21.15.50:0/1973763022 learned_addr learned my addr 172.21.15.50:0/1973763022 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:15.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.466+0000 7f45922bf700 1 --2- 172.21.15.50:0/1973763022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f458c100ec0 0x7f458c19e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:15.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.466+0000 7f4592ac0700 1 -- 172.21.15.50:0/1973763022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f458c101880 msgr2=0x7f458c19ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:15.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.466+0000 7f4592ac0700 1 --2- 172.21.15.50:0/1973763022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f458c101880 0x7f458c19ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:15.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.466+0000 7f4592ac0700 1 -- 172.21.15.50:0/1973763022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f458c100ec0 msgr2=0x7f458c19e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:15.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.466+0000 7f4592ac0700 1 --2- 172.21.15.50:0/1973763022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f458c100ec0 0x7f458c19e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:15.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.466+0000 7f4592ac0700 1 -- 172.21.15.50:0/1973763022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f458c199080 con 0x7f458c108670 2024-06-06T03:25:15.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.466+0000 7f4592ac0700 1 --2- 172.21.15.50:0/1973763022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f458c108670 0x7f458c198920 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f458400b070 tx=0x7f4584004d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:15.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.467+0000 7f45837fe700 1 -- 172.21.15.50:0/1973763022 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4584021070 con 0x7f458c108670 2024-06-06T03:25:15.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.467+0000 7f4594523700 1 -- 172.21.15.50:0/1973763022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f458c199310 con 0x7f458c108670 2024-06-06T03:25:15.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.467+0000 7f45837fe700 1 -- 172.21.15.50:0/1973763022 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4584007b80 con 0x7f458c108670 2024-06-06T03:25:15.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.467+0000 7f45837fe700 1 -- 172.21.15.50:0/1973763022 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45840052a0 con 0x7f458c108670 2024-06-06T03:25:15.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.467+0000 7f4594523700 1 -- 172.21.15.50:0/1973763022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f458c1a55e0 con 0x7f458c108670 2024-06-06T03:25:15.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.468+0000 7f4594523700 1 -- 172.21.15.50:0/1973763022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f458c069180 con 0x7f458c108670 2024-06-06T03:25:15.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.469+0000 7f45837fe700 1 -- 172.21.15.50:0/1973763022 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4584024070 con 0x7f458c108670 2024-06-06T03:25:15.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.470+0000 7f45837fe700 1 --2- 172.21.15.50:0/1973763022 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f45780a2c20 0x7f45780a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:15.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.470+0000 7f45837fe700 1 -- 172.21.15.50:0/1973763022 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f45840d0320 con 0x7f458c108670 2024-06-06T03:25:15.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.470+0000 7f45922bf700 1 --2- 172.21.15.50:0/1973763022 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f45780a2c20 0x7f45780a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:15.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.470+0000 7f45922bf700 1 --2- 172.21.15.50:0/1973763022 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f45780a2c20 0x7f45780a50e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4588005950 tx=0x7f458800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:15.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.474+0000 7f45837fe700 1 -- 172.21.15.50:0/1973763022 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f458409d030 con 0x7f458c108670 2024-06-06T03:25:15.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.680+0000 7f4594523700 1 -- 172.21.15.50:0/1973763022 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f458c199e00 con 0x7f45780a2c20 2024-06-06T03:25:15.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.690+0000 7f45837fe700 1 -- 172.21.15.50:0/1973763022 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340812 (secure 0 0 0) 0x7f458c199e00 con 0x7f45780a2c20 2024-06-06T03:25:15.694 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:25:15.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.693+0000 7f4594523700 1 -- 172.21.15.50:0/1973763022 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f45780a2c20 msgr2=0x7f45780a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:15.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.693+0000 7f4594523700 1 --2- 172.21.15.50:0/1973763022 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f45780a2c20 0x7f45780a50e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4588005950 tx=0x7f458800a300 comp rx=0 tx=0).stop 2024-06-06T03:25:15.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.693+0000 7f4594523700 1 -- 172.21.15.50:0/1973763022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f458c108670 msgr2=0x7f458c198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:15.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.693+0000 7f4594523700 1 --2- 172.21.15.50:0/1973763022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f458c108670 0x7f458c198920 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f458400b070 tx=0x7f4584004d70 comp rx=0 tx=0).stop 2024-06-06T03:25:15.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.693+0000 7f4594523700 1 -- 172.21.15.50:0/1973763022 shutdown_connections 2024-06-06T03:25:15.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.693+0000 7f4594523700 1 --2- 172.21.15.50:0/1973763022 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f45780a2c20 0x7f45780a50e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:15.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.693+0000 7f4594523700 1 --2- 172.21.15.50:0/1973763022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f458c108670 0x7f458c198920 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:15.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.693+0000 7f4594523700 1 --2- 172.21.15.50:0/1973763022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f458c100ec0 0x7f458c19e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:15.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.693+0000 7f4594523700 1 --2- 172.21.15.50:0/1973763022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f458c101880 0x7f458c19ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:15.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.693+0000 7f4594523700 1 -- 172.21.15.50:0/1973763022 >> 172.21.15.50:0/1973763022 conn(0x7f458c076600 msgr2=0x7f458c0ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:15.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.693+0000 7f4594523700 1 -- 172.21.15.50:0/1973763022 shutdown_connections 2024-06-06T03:25:15.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:15.693+0000 7f4594523700 1 -- 172.21.15.50:0/1973763022 wait complete. 2024-06-06T03:25:15.698 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-06-06T03:25:16.418 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":390,"stamp":"2024-06-06T03:25:15.381617+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657062,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":748,"num_read_kb":491,"num_write":358,"num_write_kb":3063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":672,"ondisk_log_size":672,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374984,"kb_used_data":13312,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124566840,"statfs":{"total":1151940427776,"available":1151556444160,"internally_reserved":0,"allocated":13631488,"data_stored":8782907,"data_compressed":498432,"data_compressed_allocated":675840,"data_compressed_original":2850816,"omap_allocated":19141,"internal_metadata":370193723},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":390,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":42,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003447"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380924+0000","last_change":"2024-06-06T03:22:34.302364+0000","last_active":"2024-06-06T03:24:15.380924+0000","last_peered":"2024-06-06T03:24:15.380924+0000","last_clean":"2024-06-06T03:24:15.380924+0000","last_became_active":"2024-06-06T03:22:34.300403+0000","last_became_peered":"2024-06-06T03:22:34.300403+0000","last_unstale":"2024-06-06T03:24:15.380924+0000","last_undegraded":"2024-06-06T03:24:15.380924+0000","last_fullsized":"2024-06-06T03:24:15.380924+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:27:55.377346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"99'4","reported_seq":43,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.361468+0000","last_change":"2024-06-06T03:22:34.306188+0000","last_active":"2024-06-06T03:25:13.361468+0000","last_peered":"2024-06-06T03:25:13.361468+0000","last_clean":"2024-06-06T03:25:13.361468+0000","last_became_active":"2024-06-06T03:22:34.305705+0000","last_became_peered":"2024-06-06T03:22:34.305705+0000","last_unstale":"2024-06-06T03:25:13.361468+0000","last_undegraded":"2024-06-06T03:25:13.361468+0000","last_fullsized":"2024-06-06T03:25:13.361468+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:10:07.337989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369892+0000","last_change":"2024-06-06T03:22:34.303568+0000","last_active":"2024-06-06T03:25:13.369892+0000","last_peered":"2024-06-06T03:25:13.369892+0000","last_clean":"2024-06-06T03:25:13.369892+0000","last_became_active":"2024-06-06T03:22:34.303194+0000","last_became_peered":"2024-06-06T03:22:34.303194+0000","last_unstale":"2024-06-06T03:25:13.369892+0000","last_undegraded":"2024-06-06T03:25:13.369892+0000","last_fullsized":"2024-06-06T03:25:13.369892+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:40:46.387476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.356411+0000","last_change":"2024-06-06T03:22:34.303896+0000","last_active":"2024-06-06T03:25:13.356411+0000","last_peered":"2024-06-06T03:25:13.356411+0000","last_clean":"2024-06-06T03:25:13.356411+0000","last_became_active":"2024-06-06T03:22:34.303568+0000","last_became_peered":"2024-06-06T03:22:34.303568+0000","last_unstale":"2024-06-06T03:25:13.356411+0000","last_undegraded":"2024-06-06T03:25:13.356411+0000","last_fullsized":"2024-06-06T03:25:13.356411+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:24:20.160115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"99'4","reported_seq":43,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.358644+0000","last_change":"2024-06-06T03:22:34.289868+0000","last_active":"2024-06-06T03:25:13.358644+0000","last_peered":"2024-06-06T03:25:13.358644+0000","last_clean":"2024-06-06T03:25:13.358644+0000","last_became_active":"2024-06-06T03:22:34.289485+0000","last_became_peered":"2024-06-06T03:22:34.289485+0000","last_unstale":"2024-06-06T03:25:13.358644+0000","last_undegraded":"2024-06-06T03:25:13.358644+0000","last_fullsized":"2024-06-06T03:25:13.358644+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:28:58.226092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.347487+0000","last_change":"2024-06-06T03:22:34.304643+0000","last_active":"2024-06-06T03:25:13.347487+0000","last_peered":"2024-06-06T03:25:13.347487+0000","last_clean":"2024-06-06T03:25:13.347487+0000","last_became_active":"2024-06-06T03:22:34.303342+0000","last_became_peered":"2024-06-06T03:22:34.303342+0000","last_unstale":"2024-06-06T03:25:13.347487+0000","last_undegraded":"2024-06-06T03:25:13.347487+0000","last_fullsized":"2024-06-06T03:25:13.347487+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:28:27.838518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.368466+0000","last_change":"2024-06-06T03:22:34.304958+0000","last_active":"2024-06-06T03:25:13.368466+0000","last_peered":"2024-06-06T03:25:13.368466+0000","last_clean":"2024-06-06T03:25:13.368466+0000","last_became_active":"2024-06-06T03:22:34.304582+0000","last_became_peered":"2024-06-06T03:22:34.304582+0000","last_unstale":"2024-06-06T03:25:13.368466+0000","last_undegraded":"2024-06-06T03:25:13.368466+0000","last_fullsized":"2024-06-06T03:25:13.368466+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:08:56.304446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371907+0000","last_change":"2024-06-06T03:22:34.299883+0000","last_active":"2024-06-06T03:25:13.371907+0000","last_peered":"2024-06-06T03:25:13.371907+0000","last_clean":"2024-06-06T03:25:13.371907+0000","last_became_active":"2024-06-06T03:22:34.299568+0000","last_became_peered":"2024-06-06T03:22:34.299568+0000","last_unstale":"2024-06-06T03:25:13.371907+0000","last_undegraded":"2024-06-06T03:25:13.371907+0000","last_fullsized":"2024-06-06T03:25:13.371907+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:23:32.479592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369788+0000","last_change":"2024-06-06T03:22:34.303157+0000","last_active":"2024-06-06T03:25:13.369788+0000","last_peered":"2024-06-06T03:25:13.369788+0000","last_clean":"2024-06-06T03:25:13.369788+0000","last_became_active":"2024-06-06T03:22:34.302332+0000","last_became_peered":"2024-06-06T03:22:34.302332+0000","last_unstale":"2024-06-06T03:25:13.369788+0000","last_undegraded":"2024-06-06T03:25:13.369788+0000","last_fullsized":"2024-06-06T03:25:13.369788+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:27:32.420058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"99'16","reported_seq":61,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.352791+0000","last_change":"2024-06-06T03:23:14.517357+0000","last_active":"2024-06-06T03:25:13.352791+0000","last_peered":"2024-06-06T03:25:13.352791+0000","last_clean":"2024-06-06T03:25:13.352791+0000","last_became_active":"2024-06-06T03:23:14.516932+0000","last_became_peered":"2024-06-06T03:23:14.516932+0000","last_unstale":"2024-06-06T03:25:13.352791+0000","last_undegraded":"2024-06-06T03:25:13.352791+0000","last_fullsized":"2024-06-06T03:25:13.352791+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:23:43.907192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369989+0000","last_change":"2024-06-06T03:22:34.310010+0000","last_active":"2024-06-06T03:25:13.369989+0000","last_peered":"2024-06-06T03:25:13.369989+0000","last_clean":"2024-06-06T03:25:13.369989+0000","last_became_active":"2024-06-06T03:22:34.309636+0000","last_became_peered":"2024-06-06T03:22:34.309636+0000","last_unstale":"2024-06-06T03:25:13.369989+0000","last_undegraded":"2024-06-06T03:25:13.369989+0000","last_fullsized":"2024-06-06T03:25:13.369989+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:35:53.745050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.351414+0000","last_change":"2024-06-06T03:22:34.311364+0000","last_active":"2024-06-06T03:25:13.351414+0000","last_peered":"2024-06-06T03:25:13.351414+0000","last_clean":"2024-06-06T03:25:13.351414+0000","last_became_active":"2024-06-06T03:22:34.311003+0000","last_became_peered":"2024-06-06T03:22:34.311003+0000","last_unstale":"2024-06-06T03:25:13.351414+0000","last_undegraded":"2024-06-06T03:25:13.351414+0000","last_fullsized":"2024-06-06T03:25:13.351414+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:35:32.460362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.372924+0000","last_change":"2024-06-06T03:22:34.302843+0000","last_active":"2024-06-06T03:25:13.372924+0000","last_peered":"2024-06-06T03:25:13.372924+0000","last_clean":"2024-06-06T03:25:13.372924+0000","last_became_active":"2024-06-06T03:22:34.302581+0000","last_became_peered":"2024-06-06T03:22:34.302581+0000","last_unstale":"2024-06-06T03:25:13.372924+0000","last_undegraded":"2024-06-06T03:25:13.372924+0000","last_fullsized":"2024-06-06T03:25:13.372924+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:56:14.178848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.362752+0000","last_change":"2024-06-06T03:22:34.305792+0000","last_active":"2024-06-06T03:25:13.362752+0000","last_peered":"2024-06-06T03:25:13.362752+0000","last_clean":"2024-06-06T03:25:13.362752+0000","last_became_active":"2024-06-06T03:22:34.305389+0000","last_became_peered":"2024-06-06T03:22:34.305389+0000","last_unstale":"2024-06-06T03:25:13.362752+0000","last_undegraded":"2024-06-06T03:25:13.362752+0000","last_fullsized":"2024-06-06T03:25:13.362752+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:17:05.992382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369254+0000","last_change":"2024-06-06T03:22:34.298396+0000","last_active":"2024-06-06T03:25:13.369254+0000","last_peered":"2024-06-06T03:25:13.369254+0000","last_clean":"2024-06-06T03:25:13.369254+0000","last_became_active":"2024-06-06T03:22:34.297697+0000","last_became_peered":"2024-06-06T03:22:34.297697+0000","last_unstale":"2024-06-06T03:25:13.369254+0000","last_undegraded":"2024-06-06T03:25:13.369254+0000","last_fullsized":"2024-06-06T03:25:13.369254+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:24:07.143699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369399+0000","last_change":"2024-06-06T03:22:34.312801+0000","last_active":"2024-06-06T03:25:13.369399+0000","last_peered":"2024-06-06T03:25:13.369399+0000","last_clean":"2024-06-06T03:25:13.369399+0000","last_became_active":"2024-06-06T03:22:34.312206+0000","last_became_peered":"2024-06-06T03:22:34.312206+0000","last_unstale":"2024-06-06T03:25:13.369399+0000","last_undegraded":"2024-06-06T03:25:13.369399+0000","last_fullsized":"2024-06-06T03:25:13.369399+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:31:41.286548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380830+0000","last_change":"2024-06-06T03:22:34.303527+0000","last_active":"2024-06-06T03:24:15.380830+0000","last_peered":"2024-06-06T03:24:15.380830+0000","last_clean":"2024-06-06T03:24:15.380830+0000","last_became_active":"2024-06-06T03:22:34.302919+0000","last_became_peered":"2024-06-06T03:22:34.302919+0000","last_unstale":"2024-06-06T03:24:15.380830+0000","last_undegraded":"2024-06-06T03:24:15.380830+0000","last_fullsized":"2024-06-06T03:24:15.380830+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:41:44.128543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380751+0000","last_change":"2024-06-06T03:22:34.304801+0000","last_active":"2024-06-06T03:24:15.380751+0000","last_peered":"2024-06-06T03:24:15.380751+0000","last_clean":"2024-06-06T03:24:15.380751+0000","last_became_active":"2024-06-06T03:22:34.304463+0000","last_became_peered":"2024-06-06T03:22:34.304463+0000","last_unstale":"2024-06-06T03:24:15.380751+0000","last_undegraded":"2024-06-06T03:24:15.380751+0000","last_fullsized":"2024-06-06T03:24:15.380751+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:28:22.789816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973769+0000","last_change":"2024-06-06T03:22:34.290053+0000","last_active":"2024-06-06T03:24:14.973769+0000","last_peered":"2024-06-06T03:24:14.973769+0000","last_clean":"2024-06-06T03:24:14.973769+0000","last_became_active":"2024-06-06T03:22:34.289712+0000","last_became_peered":"2024-06-06T03:22:34.289712+0000","last_unstale":"2024-06-06T03:24:14.973769+0000","last_undegraded":"2024-06-06T03:24:14.973769+0000","last_fullsized":"2024-06-06T03:24:14.973769+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:12:02.296431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973398+0000","last_change":"2024-06-06T03:22:44.421722+0000","last_active":"2024-06-06T03:24:14.973398+0000","last_peered":"2024-06-06T03:24:14.973398+0000","last_clean":"2024-06-06T03:24:14.973398+0000","last_became_active":"2024-06-06T03:22:44.421215+0000","last_became_peered":"2024-06-06T03:22:44.421215+0000","last_unstale":"2024-06-06T03:24:14.973398+0000","last_undegraded":"2024-06-06T03:24:14.973398+0000","last_fullsized":"2024-06-06T03:24:14.973398+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:22:59.749839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"97'9","reported_seq":55,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.379751+0000","last_change":"2024-06-06T03:22:31.053826+0000","last_active":"2024-06-06T03:24:15.379751+0000","last_peered":"2024-06-06T03:24:15.379751+0000","last_clean":"2024-06-06T03:24:15.379751+0000","last_became_active":"2024-06-06T03:22:31.053537+0000","last_became_peered":"2024-06-06T03:22:31.053537+0000","last_unstale":"2024-06-06T03:24:15.379751+0000","last_undegraded":"2024-06-06T03:24:15.379751+0000","last_fullsized":"2024-06-06T03:24:15.379751+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:18:52.967104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371315+0000","last_change":"2024-06-06T03:22:34.291554+0000","last_active":"2024-06-06T03:25:13.371315+0000","last_peered":"2024-06-06T03:25:13.371315+0000","last_clean":"2024-06-06T03:25:13.371315+0000","last_became_active":"2024-06-06T03:22:34.290600+0000","last_became_peered":"2024-06-06T03:22:34.290600+0000","last_unstale":"2024-06-06T03:25:13.371315+0000","last_undegraded":"2024-06-06T03:25:13.371315+0000","last_fullsized":"2024-06-06T03:25:13.371315+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:03:32.860134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163376+0000","last_change":"2024-06-06T03:22:44.424337+0000","last_active":"2024-06-06T03:24:15.163376+0000","last_peered":"2024-06-06T03:24:15.163376+0000","last_clean":"2024-06-06T03:24:15.163376+0000","last_became_active":"2024-06-06T03:22:44.423919+0000","last_became_peered":"2024-06-06T03:22:44.423919+0000","last_unstale":"2024-06-06T03:24:15.163376+0000","last_undegraded":"2024-06-06T03:24:15.163376+0000","last_fullsized":"2024-06-06T03:24:15.163376+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:34:32.801117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"97'2","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.379810+0000","last_change":"2024-06-06T03:22:31.242326+0000","last_active":"2024-06-06T03:24:15.379810+0000","last_peered":"2024-06-06T03:24:15.379810+0000","last_clean":"2024-06-06T03:24:15.379810+0000","last_became_active":"2024-06-06T03:22:31.241960+0000","last_became_peered":"2024-06-06T03:22:31.241960+0000","last_unstale":"2024-06-06T03:24:15.379810+0000","last_undegraded":"2024-06-06T03:24:15.379810+0000","last_fullsized":"2024-06-06T03:24:15.379810+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:19:57.820119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369698+0000","last_change":"2024-06-06T03:22:34.303438+0000","last_active":"2024-06-06T03:25:13.369698+0000","last_peered":"2024-06-06T03:25:13.369698+0000","last_clean":"2024-06-06T03:25:13.369698+0000","last_became_active":"2024-06-06T03:22:34.302057+0000","last_became_peered":"2024-06-06T03:22:34.302057+0000","last_unstale":"2024-06-06T03:25:13.369698+0000","last_undegraded":"2024-06-06T03:25:13.369698+0000","last_fullsized":"2024-06-06T03:25:13.369698+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:52:20.508656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163601+0000","last_change":"2024-06-06T03:22:44.424732+0000","last_active":"2024-06-06T03:24:15.163601+0000","last_peered":"2024-06-06T03:24:15.163601+0000","last_clean":"2024-06-06T03:24:15.163601+0000","last_became_active":"2024-06-06T03:22:44.423906+0000","last_became_peered":"2024-06-06T03:22:44.423906+0000","last_unstale":"2024-06-06T03:24:15.163601+0000","last_undegraded":"2024-06-06T03:24:15.163601+0000","last_fullsized":"2024-06-06T03:24:15.163601+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:45:04.344747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"97'4","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700231+0000","last_change":"2024-06-06T03:22:31.057003+0000","last_active":"2024-06-06T03:24:14.700231+0000","last_peered":"2024-06-06T03:24:14.700231+0000","last_clean":"2024-06-06T03:24:14.700231+0000","last_became_active":"2024-06-06T03:22:31.056660+0000","last_became_peered":"2024-06-06T03:22:31.056660+0000","last_unstale":"2024-06-06T03:24:14.700231+0000","last_undegraded":"2024-06-06T03:24:14.700231+0000","last_fullsized":"2024-06-06T03:24:14.700231+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:44:16.726749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.367434+0000","last_change":"2024-06-06T03:22:34.306196+0000","last_active":"2024-06-06T03:25:13.367434+0000","last_peered":"2024-06-06T03:25:13.367434+0000","last_clean":"2024-06-06T03:25:13.367434+0000","last_became_active":"2024-06-06T03:22:34.304962+0000","last_became_peered":"2024-06-06T03:22:34.304962+0000","last_unstale":"2024-06-06T03:25:13.367434+0000","last_undegraded":"2024-06-06T03:25:13.367434+0000","last_fullsized":"2024-06-06T03:25:13.367434+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:25:04.990371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163359+0000","last_change":"2024-06-06T03:22:44.419624+0000","last_active":"2024-06-06T03:24:15.163359+0000","last_peered":"2024-06-06T03:24:15.163359+0000","last_clean":"2024-06-06T03:24:15.163359+0000","last_became_active":"2024-06-06T03:22:44.418713+0000","last_became_peered":"2024-06-06T03:22:44.418713+0000","last_unstale":"2024-06-06T03:24:15.163359+0000","last_undegraded":"2024-06-06T03:24:15.163359+0000","last_fullsized":"2024-06-06T03:24:15.163359+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:04:54.010364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'2","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700029+0000","last_change":"2024-06-06T03:22:31.059332+0000","last_active":"2024-06-06T03:24:14.700029+0000","last_peered":"2024-06-06T03:24:14.700029+0000","last_clean":"2024-06-06T03:24:14.700029+0000","last_became_active":"2024-06-06T03:22:31.058478+0000","last_became_peered":"2024-06-06T03:22:31.058478+0000","last_unstale":"2024-06-06T03:24:14.700029+0000","last_undegraded":"2024-06-06T03:24:14.700029+0000","last_fullsized":"2024-06-06T03:24:14.700029+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:24:46.452708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"99'15","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.373335+0000","last_change":"2024-06-06T03:22:34.301650+0000","last_active":"2024-06-06T03:25:13.373335+0000","last_peered":"2024-06-06T03:25:13.373335+0000","last_clean":"2024-06-06T03:25:13.373335+0000","last_became_active":"2024-06-06T03:22:34.301220+0000","last_became_peered":"2024-06-06T03:22:34.301220+0000","last_unstale":"2024-06-06T03:25:13.373335+0000","last_undegraded":"2024-06-06T03:25:13.373335+0000","last_fullsized":"2024-06-06T03:25:13.373335+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:43:07.396971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973501+0000","last_change":"2024-06-06T03:22:44.413406+0000","last_active":"2024-06-06T03:24:14.973501+0000","last_peered":"2024-06-06T03:24:14.973501+0000","last_clean":"2024-06-06T03:24:14.973501+0000","last_became_active":"2024-06-06T03:22:44.412977+0000","last_became_peered":"2024-06-06T03:22:44.412977+0000","last_unstale":"2024-06-06T03:24:14.973501+0000","last_undegraded":"2024-06-06T03:24:14.973501+0000","last_fullsized":"2024-06-06T03:24:14.973501+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:11:02.017352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"97'5","reported_seq":150,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:11.752558+0000","last_change":"2024-06-06T03:22:31.056091+0000","last_active":"2024-06-06T03:25:11.752558+0000","last_peered":"2024-06-06T03:25:11.752558+0000","last_clean":"2024-06-06T03:25:11.752558+0000","last_became_active":"2024-06-06T03:22:31.055184+0000","last_became_peered":"2024-06-06T03:22:31.055184+0000","last_unstale":"2024-06-06T03:25:11.752558+0000","last_undegraded":"2024-06-06T03:25:11.752558+0000","last_fullsized":"2024-06-06T03:25:11.752558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:32:37.761082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.357597+0000","last_change":"2024-06-06T03:22:34.305386+0000","last_active":"2024-06-06T03:25:13.357597+0000","last_peered":"2024-06-06T03:25:13.357597+0000","last_clean":"2024-06-06T03:25:13.357597+0000","last_became_active":"2024-06-06T03:22:34.304505+0000","last_became_peered":"2024-06-06T03:22:34.304505+0000","last_unstale":"2024-06-06T03:25:13.357597+0000","last_undegraded":"2024-06-06T03:25:13.357597+0000","last_fullsized":"2024-06-06T03:25:13.357597+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:34:31.800443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":35,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973587+0000","last_change":"2024-06-06T03:23:15.075519+0000","last_active":"2024-06-06T03:24:14.973587+0000","last_peered":"2024-06-06T03:24:14.973587+0000","last_clean":"2024-06-06T03:24:14.973587+0000","last_became_active":"2024-06-06T03:23:15.074970+0000","last_became_peered":"2024-06-06T03:23:15.074970+0000","last_unstale":"2024-06-06T03:24:14.973587+0000","last_undegraded":"2024-06-06T03:24:14.973587+0000","last_fullsized":"2024-06-06T03:24:14.973587+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:39:25.915175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.895888+0000","last_change":"2024-06-06T03:22:31.058530+0000","last_active":"2024-06-06T03:24:14.895888+0000","last_peered":"2024-06-06T03:24:14.895888+0000","last_clean":"2024-06-06T03:24:14.895888+0000","last_became_active":"2024-06-06T03:22:31.058185+0000","last_became_peered":"2024-06-06T03:22:31.058185+0000","last_unstale":"2024-06-06T03:24:14.895888+0000","last_undegraded":"2024-06-06T03:24:14.895888+0000","last_fullsized":"2024-06-06T03:24:14.895888+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:28:59.023322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.372958+0000","last_change":"2024-06-06T03:22:34.292995+0000","last_active":"2024-06-06T03:25:13.372958+0000","last_peered":"2024-06-06T03:25:13.372958+0000","last_clean":"2024-06-06T03:25:13.372958+0000","last_became_active":"2024-06-06T03:22:34.292625+0000","last_became_peered":"2024-06-06T03:22:34.292625+0000","last_unstale":"2024-06-06T03:25:13.372958+0000","last_undegraded":"2024-06-06T03:25:13.372958+0000","last_fullsized":"2024-06-06T03:25:13.372958+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:03:18.985660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380827+0000","last_change":"2024-06-06T03:22:44.417395+0000","last_active":"2024-06-06T03:24:15.380827+0000","last_peered":"2024-06-06T03:24:15.380827+0000","last_clean":"2024-06-06T03:24:15.380827+0000","last_became_active":"2024-06-06T03:22:44.416929+0000","last_became_peered":"2024-06-06T03:22:44.416929+0000","last_unstale":"2024-06-06T03:24:15.380827+0000","last_undegraded":"2024-06-06T03:24:15.380827+0000","last_fullsized":"2024-06-06T03:24:15.380827+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:28:09.548691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700631+0000","last_change":"2024-06-06T03:22:31.051163+0000","last_active":"2024-06-06T03:24:14.700631+0000","last_peered":"2024-06-06T03:24:14.700631+0000","last_clean":"2024-06-06T03:24:14.700631+0000","last_became_active":"2024-06-06T03:22:31.050800+0000","last_became_peered":"2024-06-06T03:22:31.050800+0000","last_unstale":"2024-06-06T03:24:14.700631+0000","last_undegraded":"2024-06-06T03:24:14.700631+0000","last_fullsized":"2024-06-06T03:24:14.700631+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:13:40.197723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.372748+0000","last_change":"2024-06-06T03:22:34.293586+0000","last_active":"2024-06-06T03:25:13.372748+0000","last_peered":"2024-06-06T03:25:13.372748+0000","last_clean":"2024-06-06T03:25:13.372748+0000","last_became_active":"2024-06-06T03:22:34.292651+0000","last_became_peered":"2024-06-06T03:22:34.292651+0000","last_unstale":"2024-06-06T03:25:13.372748+0000","last_undegraded":"2024-06-06T03:25:13.372748+0000","last_fullsized":"2024-06-06T03:25:13.372748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:11:16.221948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.698917+0000","last_change":"2024-06-06T03:22:44.415005+0000","last_active":"2024-06-06T03:24:14.698917+0000","last_peered":"2024-06-06T03:24:14.698917+0000","last_clean":"2024-06-06T03:24:14.698917+0000","last_became_active":"2024-06-06T03:22:44.414522+0000","last_became_peered":"2024-06-06T03:22:44.414522+0000","last_unstale":"2024-06-06T03:24:14.698917+0000","last_undegraded":"2024-06-06T03:24:14.698917+0000","last_fullsized":"2024-06-06T03:24:14.698917+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:36:03.240089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"97'1","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.370600+0000","last_change":"2024-06-06T03:22:31.056068+0000","last_active":"2024-06-06T03:24:15.370600+0000","last_peered":"2024-06-06T03:24:15.370600+0000","last_clean":"2024-06-06T03:24:15.370600+0000","last_became_active":"2024-06-06T03:22:31.055628+0000","last_became_peered":"2024-06-06T03:22:31.055628+0000","last_unstale":"2024-06-06T03:24:15.370600+0000","last_undegraded":"2024-06-06T03:24:15.370600+0000","last_fullsized":"2024-06-06T03:24:15.370600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:40:37.491491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380248+0000","last_change":"2024-06-06T03:22:34.300945+0000","last_active":"2024-06-06T03:24:15.380248+0000","last_peered":"2024-06-06T03:24:15.380248+0000","last_clean":"2024-06-06T03:24:15.380248+0000","last_became_active":"2024-06-06T03:22:34.300618+0000","last_became_peered":"2024-06-06T03:22:34.300618+0000","last_unstale":"2024-06-06T03:24:15.380248+0000","last_undegraded":"2024-06-06T03:24:15.380248+0000","last_fullsized":"2024-06-06T03:24:15.380248+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:32:39.875148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380716+0000","last_change":"2024-06-06T03:22:44.417759+0000","last_active":"2024-06-06T03:24:15.380716+0000","last_peered":"2024-06-06T03:24:15.380716+0000","last_clean":"2024-06-06T03:24:15.380716+0000","last_became_active":"2024-06-06T03:22:44.417335+0000","last_became_peered":"2024-06-06T03:22:44.417335+0000","last_unstale":"2024-06-06T03:24:15.380716+0000","last_undegraded":"2024-06-06T03:24:15.380716+0000","last_fullsized":"2024-06-06T03:24:15.380716+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:43:24.408740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"97'3","reported_seq":147,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:12.753242+0000","last_change":"2024-06-06T03:22:31.054351+0000","last_active":"2024-06-06T03:25:12.753242+0000","last_peered":"2024-06-06T03:25:12.753242+0000","last_clean":"2024-06-06T03:25:12.753242+0000","last_became_active":"2024-06-06T03:22:31.053954+0000","last_became_peered":"2024-06-06T03:22:31.053954+0000","last_unstale":"2024-06-06T03:25:12.753242+0000","last_undegraded":"2024-06-06T03:25:12.753242+0000","last_fullsized":"2024-06-06T03:25:12.753242+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:22:46.405507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.367722+0000","last_change":"2024-06-06T03:22:34.303208+0000","last_active":"2024-06-06T03:25:13.367722+0000","last_peered":"2024-06-06T03:25:13.367722+0000","last_clean":"2024-06-06T03:25:13.367722+0000","last_became_active":"2024-06-06T03:22:34.302882+0000","last_became_peered":"2024-06-06T03:22:34.302882+0000","last_unstale":"2024-06-06T03:25:13.367722+0000","last_undegraded":"2024-06-06T03:25:13.367722+0000","last_fullsized":"2024-06-06T03:25:13.367722+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:01:36.963056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380041+0000","last_change":"2024-06-06T03:22:44.418095+0000","last_active":"2024-06-06T03:24:15.380041+0000","last_peered":"2024-06-06T03:24:15.380041+0000","last_clean":"2024-06-06T03:24:15.380041+0000","last_became_active":"2024-06-06T03:22:44.417625+0000","last_became_peered":"2024-06-06T03:22:44.417625+0000","last_unstale":"2024-06-06T03:24:15.380041+0000","last_undegraded":"2024-06-06T03:24:15.380041+0000","last_fullsized":"2024-06-06T03:24:15.380041+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:20:53.859638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.701041+0000","last_change":"2024-06-06T03:22:31.057558+0000","last_active":"2024-06-06T03:24:14.701041+0000","last_peered":"2024-06-06T03:24:14.701041+0000","last_clean":"2024-06-06T03:24:14.701041+0000","last_became_active":"2024-06-06T03:22:31.057168+0000","last_became_peered":"2024-06-06T03:22:31.057168+0000","last_unstale":"2024-06-06T03:24:14.701041+0000","last_undegraded":"2024-06-06T03:24:14.701041+0000","last_fullsized":"2024-06-06T03:24:14.701041+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:33:59.019923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.373648+0000","last_change":"2024-06-06T03:22:34.299220+0000","last_active":"2024-06-06T03:25:13.373648+0000","last_peered":"2024-06-06T03:25:13.373648+0000","last_clean":"2024-06-06T03:25:13.373648+0000","last_became_active":"2024-06-06T03:22:34.298873+0000","last_became_peered":"2024-06-06T03:22:34.298873+0000","last_unstale":"2024-06-06T03:25:13.373648+0000","last_undegraded":"2024-06-06T03:25:13.373648+0000","last_fullsized":"2024-06-06T03:25:13.373648+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:31:53.501036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163660+0000","last_change":"2024-06-06T03:22:44.424792+0000","last_active":"2024-06-06T03:24:15.163660+0000","last_peered":"2024-06-06T03:24:15.163660+0000","last_clean":"2024-06-06T03:24:15.163660+0000","last_became_active":"2024-06-06T03:22:44.423973+0000","last_became_peered":"2024-06-06T03:22:44.423973+0000","last_unstale":"2024-06-06T03:24:15.163660+0000","last_undegraded":"2024-06-06T03:24:15.163660+0000","last_fullsized":"2024-06-06T03:24:15.163660+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:46:51.232764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"97'4","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.370511+0000","last_change":"2024-06-06T03:22:31.243885+0000","last_active":"2024-06-06T03:24:15.370511+0000","last_peered":"2024-06-06T03:24:15.370511+0000","last_clean":"2024-06-06T03:24:15.370511+0000","last_became_active":"2024-06-06T03:22:31.243367+0000","last_became_peered":"2024-06-06T03:22:31.243367+0000","last_unstale":"2024-06-06T03:24:15.370511+0000","last_undegraded":"2024-06-06T03:24:15.370511+0000","last_fullsized":"2024-06-06T03:24:15.370511+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:57:13.464974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.367835+0000","last_change":"2024-06-06T03:22:34.299247+0000","last_active":"2024-06-06T03:25:13.367835+0000","last_peered":"2024-06-06T03:25:13.367835+0000","last_clean":"2024-06-06T03:25:13.367835+0000","last_became_active":"2024-06-06T03:22:34.298538+0000","last_became_peered":"2024-06-06T03:22:34.298538+0000","last_unstale":"2024-06-06T03:25:13.367835+0000","last_undegraded":"2024-06-06T03:25:13.367835+0000","last_fullsized":"2024-06-06T03:25:13.367835+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:53:16.724575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380294+0000","last_change":"2024-06-06T03:22:44.423817+0000","last_active":"2024-06-06T03:24:15.380294+0000","last_peered":"2024-06-06T03:24:15.380294+0000","last_clean":"2024-06-06T03:24:15.380294+0000","last_became_active":"2024-06-06T03:22:44.423333+0000","last_became_peered":"2024-06-06T03:22:44.423333+0000","last_unstale":"2024-06-06T03:24:15.380294+0000","last_undegraded":"2024-06-06T03:24:15.380294+0000","last_fullsized":"2024-06-06T03:24:15.380294+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:22:46.174850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"99'36","reported_seq":289,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.755271+0000","last_change":"2024-06-06T03:22:31.056446+0000","last_active":"2024-06-06T03:25:13.755271+0000","last_peered":"2024-06-06T03:25:13.755271+0000","last_clean":"2024-06-06T03:25:13.755271+0000","last_became_active":"2024-06-06T03:22:31.056089+0000","last_became_peered":"2024-06-06T03:22:31.056089+0000","last_unstale":"2024-06-06T03:25:13.755271+0000","last_undegraded":"2024-06-06T03:25:13.755271+0000","last_fullsized":"2024-06-06T03:25:13.755271+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:11:37.705889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62319,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":208,"num_read_kb":165,"num_write":37,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.346439+0000","last_change":"2024-06-06T03:22:34.302229+0000","last_active":"2024-06-06T03:25:13.346439+0000","last_peered":"2024-06-06T03:25:13.346439+0000","last_clean":"2024-06-06T03:25:13.346439+0000","last_became_active":"2024-06-06T03:22:34.301877+0000","last_became_peered":"2024-06-06T03:22:34.301877+0000","last_unstale":"2024-06-06T03:25:13.346439+0000","last_undegraded":"2024-06-06T03:25:13.346439+0000","last_fullsized":"2024-06-06T03:25:13.346439+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:19:22.545435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.371635+0000","last_change":"2024-06-06T03:22:44.421024+0000","last_active":"2024-06-06T03:24:15.371635+0000","last_peered":"2024-06-06T03:24:15.371635+0000","last_clean":"2024-06-06T03:24:15.371635+0000","last_became_active":"2024-06-06T03:22:44.420502+0000","last_became_peered":"2024-06-06T03:22:44.420502+0000","last_unstale":"2024-06-06T03:24:15.371635+0000","last_undegraded":"2024-06-06T03:24:15.371635+0000","last_fullsized":"2024-06-06T03:24:15.371635+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:15:55.246032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"97'6","reported_seq":51,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973641+0000","last_change":"2024-06-06T03:22:31.054128+0000","last_active":"2024-06-06T03:24:14.973641+0000","last_peered":"2024-06-06T03:24:14.973641+0000","last_clean":"2024-06-06T03:24:14.973641+0000","last_became_active":"2024-06-06T03:22:31.053740+0000","last_became_peered":"2024-06-06T03:22:31.053740+0000","last_unstale":"2024-06-06T03:24:14.973641+0000","last_undegraded":"2024-06-06T03:24:14.973641+0000","last_fullsized":"2024-06-06T03:24:14.973641+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:12:21.494702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.368206+0000","last_change":"2024-06-06T03:22:34.297861+0000","last_active":"2024-06-06T03:25:13.368206+0000","last_peered":"2024-06-06T03:25:13.368206+0000","last_clean":"2024-06-06T03:25:13.368206+0000","last_became_active":"2024-06-06T03:22:34.297391+0000","last_became_peered":"2024-06-06T03:22:34.297391+0000","last_unstale":"2024-06-06T03:25:13.368206+0000","last_undegraded":"2024-06-06T03:25:13.368206+0000","last_fullsized":"2024-06-06T03:25:13.368206+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:10:33.973635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380551+0000","last_change":"2024-06-06T03:22:44.416087+0000","last_active":"2024-06-06T03:24:15.380551+0000","last_peered":"2024-06-06T03:24:15.380551+0000","last_clean":"2024-06-06T03:24:15.380551+0000","last_became_active":"2024-06-06T03:22:44.415646+0000","last_became_peered":"2024-06-06T03:22:44.415646+0000","last_unstale":"2024-06-06T03:24:15.380551+0000","last_undegraded":"2024-06-06T03:24:15.380551+0000","last_fullsized":"2024-06-06T03:24:15.380551+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:44:43.690830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.370474+0000","last_change":"2024-06-06T03:22:31.056814+0000","last_active":"2024-06-06T03:24:15.370474+0000","last_peered":"2024-06-06T03:24:15.370474+0000","last_clean":"2024-06-06T03:24:15.370474+0000","last_became_active":"2024-06-06T03:22:31.055183+0000","last_became_peered":"2024-06-06T03:22:31.055183+0000","last_unstale":"2024-06-06T03:24:15.370474+0000","last_undegraded":"2024-06-06T03:24:15.370474+0000","last_fullsized":"2024-06-06T03:24:15.370474+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:26:27.299068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"99'15","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371815+0000","last_change":"2024-06-06T03:22:34.311995+0000","last_active":"2024-06-06T03:25:13.371815+0000","last_peered":"2024-06-06T03:25:13.371815+0000","last_clean":"2024-06-06T03:25:13.371815+0000","last_became_active":"2024-06-06T03:22:34.311665+0000","last_became_peered":"2024-06-06T03:22:34.311665+0000","last_unstale":"2024-06-06T03:25:13.371815+0000","last_undegraded":"2024-06-06T03:25:13.371815+0000","last_fullsized":"2024-06-06T03:25:13.371815+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:53:10.539212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380693+0000","last_change":"2024-06-06T03:22:44.414170+0000","last_active":"2024-06-06T03:24:15.380693+0000","last_peered":"2024-06-06T03:24:15.380693+0000","last_clean":"2024-06-06T03:24:15.380693+0000","last_became_active":"2024-06-06T03:22:44.413635+0000","last_became_peered":"2024-06-06T03:22:44.413635+0000","last_unstale":"2024-06-06T03:24:15.380693+0000","last_undegraded":"2024-06-06T03:24:15.380693+0000","last_fullsized":"2024-06-06T03:24:15.380693+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:06:25.223810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"99'5","reported_seq":152,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.789132+0000","last_change":"2024-06-06T03:22:31.057846+0000","last_active":"2024-06-06T03:25:13.789132+0000","last_peered":"2024-06-06T03:25:13.789132+0000","last_clean":"2024-06-06T03:25:13.789132+0000","last_became_active":"2024-06-06T03:22:31.056635+0000","last_became_peered":"2024-06-06T03:22:31.056635+0000","last_unstale":"2024-06-06T03:25:13.789132+0000","last_undegraded":"2024-06-06T03:25:13.789132+0000","last_fullsized":"2024-06-06T03:25:13.789132+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:59:03.845722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.368520+0000","last_change":"2024-06-06T03:22:34.304832+0000","last_active":"2024-06-06T03:25:13.368520+0000","last_peered":"2024-06-06T03:25:13.368520+0000","last_clean":"2024-06-06T03:25:13.368520+0000","last_became_active":"2024-06-06T03:22:34.304494+0000","last_became_peered":"2024-06-06T03:22:34.304494+0000","last_unstale":"2024-06-06T03:25:13.368520+0000","last_undegraded":"2024-06-06T03:25:13.368520+0000","last_fullsized":"2024-06-06T03:25:13.368520+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:17:02.855580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.701044+0000","last_change":"2024-06-06T03:22:44.418561+0000","last_active":"2024-06-06T03:24:14.701044+0000","last_peered":"2024-06-06T03:24:14.701044+0000","last_clean":"2024-06-06T03:24:14.701044+0000","last_became_active":"2024-06-06T03:22:44.418050+0000","last_became_peered":"2024-06-06T03:22:44.418050+0000","last_unstale":"2024-06-06T03:24:14.701044+0000","last_undegraded":"2024-06-06T03:24:14.701044+0000","last_fullsized":"2024-06-06T03:24:14.701044+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:39:57.680990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"97'15","reported_seq":60,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.699578+0000","last_change":"2024-06-06T03:22:31.242981+0000","last_active":"2024-06-06T03:24:14.699578+0000","last_peered":"2024-06-06T03:24:14.699578+0000","last_clean":"2024-06-06T03:24:14.699578+0000","last_became_active":"2024-06-06T03:22:31.242448+0000","last_became_peered":"2024-06-06T03:22:31.242448+0000","last_unstale":"2024-06-06T03:24:14.699578+0000","last_undegraded":"2024-06-06T03:24:14.699578+0000","last_fullsized":"2024-06-06T03:24:14.699578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:18:25.855327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.372636+0000","last_change":"2024-06-06T03:22:34.300799+0000","last_active":"2024-06-06T03:25:13.372636+0000","last_peered":"2024-06-06T03:25:13.372636+0000","last_clean":"2024-06-06T03:25:13.372636+0000","last_became_active":"2024-06-06T03:22:34.300397+0000","last_became_peered":"2024-06-06T03:22:34.300397+0000","last_unstale":"2024-06-06T03:25:13.372636+0000","last_undegraded":"2024-06-06T03:25:13.372636+0000","last_fullsized":"2024-06-06T03:25:13.372636+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:55:31.621711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.371189+0000","last_change":"2024-06-06T03:22:44.418341+0000","last_active":"2024-06-06T03:24:15.371189+0000","last_peered":"2024-06-06T03:24:15.371189+0000","last_clean":"2024-06-06T03:24:15.371189+0000","last_became_active":"2024-06-06T03:22:44.417881+0000","last_became_peered":"2024-06-06T03:22:44.417881+0000","last_unstale":"2024-06-06T03:24:15.371189+0000","last_undegraded":"2024-06-06T03:24:15.371189+0000","last_fullsized":"2024-06-06T03:24:15.371189+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:43:13.869298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700063+0000","last_change":"2024-06-06T03:22:31.054749+0000","last_active":"2024-06-06T03:24:14.700063+0000","last_peered":"2024-06-06T03:24:14.700063+0000","last_clean":"2024-06-06T03:24:14.700063+0000","last_became_active":"2024-06-06T03:22:31.054180+0000","last_became_peered":"2024-06-06T03:22:31.054180+0000","last_unstale":"2024-06-06T03:24:14.700063+0000","last_undegraded":"2024-06-06T03:24:14.700063+0000","last_fullsized":"2024-06-06T03:24:14.700063+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:30:17.902778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380689+0000","last_change":"2024-06-06T03:22:34.299573+0000","last_active":"2024-06-06T03:24:15.380689+0000","last_peered":"2024-06-06T03:24:15.380689+0000","last_clean":"2024-06-06T03:24:15.380689+0000","last_became_active":"2024-06-06T03:22:34.299201+0000","last_became_peered":"2024-06-06T03:22:34.299201+0000","last_unstale":"2024-06-06T03:24:15.380689+0000","last_undegraded":"2024-06-06T03:24:15.380689+0000","last_fullsized":"2024-06-06T03:24:15.380689+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:02:47.043087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.699582+0000","last_change":"2024-06-06T03:22:44.409672+0000","last_active":"2024-06-06T03:24:14.699582+0000","last_peered":"2024-06-06T03:24:14.699582+0000","last_clean":"2024-06-06T03:24:14.699582+0000","last_became_active":"2024-06-06T03:22:44.409246+0000","last_became_peered":"2024-06-06T03:22:44.409246+0000","last_unstale":"2024-06-06T03:24:14.699582+0000","last_undegraded":"2024-06-06T03:24:14.699582+0000","last_fullsized":"2024-06-06T03:24:14.699582+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:44:49.481886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.379711+0000","last_change":"2024-06-06T03:22:31.243562+0000","last_active":"2024-06-06T03:24:15.379711+0000","last_peered":"2024-06-06T03:24:15.379711+0000","last_clean":"2024-06-06T03:24:15.379711+0000","last_became_active":"2024-06-06T03:22:31.243164+0000","last_became_peered":"2024-06-06T03:22:31.243164+0000","last_unstale":"2024-06-06T03:24:15.379711+0000","last_undegraded":"2024-06-06T03:24:15.379711+0000","last_fullsized":"2024-06-06T03:24:15.379711+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:04:46.877389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"99'4","reported_seq":43,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.360629+0000","last_change":"2024-06-06T03:22:34.300756+0000","last_active":"2024-06-06T03:25:13.360629+0000","last_peered":"2024-06-06T03:25:13.360629+0000","last_clean":"2024-06-06T03:25:13.360629+0000","last_became_active":"2024-06-06T03:22:34.300333+0000","last_became_peered":"2024-06-06T03:22:34.300333+0000","last_unstale":"2024-06-06T03:25:13.360629+0000","last_undegraded":"2024-06-06T03:25:13.360629+0000","last_fullsized":"2024-06-06T03:25:13.360629+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:29:37.174432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700803+0000","last_change":"2024-06-06T03:22:44.412741+0000","last_active":"2024-06-06T03:24:14.700803+0000","last_peered":"2024-06-06T03:24:14.700803+0000","last_clean":"2024-06-06T03:24:14.700803+0000","last_became_active":"2024-06-06T03:22:44.412263+0000","last_became_peered":"2024-06-06T03:22:44.412263+0000","last_unstale":"2024-06-06T03:24:14.700803+0000","last_undegraded":"2024-06-06T03:24:14.700803+0000","last_fullsized":"2024-06-06T03:24:14.700803+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:00:13.925279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"97'1","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700753+0000","last_change":"2024-06-06T03:22:31.055124+0000","last_active":"2024-06-06T03:24:14.700753+0000","last_peered":"2024-06-06T03:24:14.700753+0000","last_clean":"2024-06-06T03:24:14.700753+0000","last_became_active":"2024-06-06T03:22:31.054562+0000","last_became_peered":"2024-06-06T03:22:31.054562+0000","last_unstale":"2024-06-06T03:24:14.700753+0000","last_undegraded":"2024-06-06T03:24:14.700753+0000","last_fullsized":"2024-06-06T03:24:14.700753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:57:54.783815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.359691+0000","last_change":"2024-06-06T03:22:34.310893+0000","last_active":"2024-06-06T03:25:13.359691+0000","last_peered":"2024-06-06T03:25:13.359691+0000","last_clean":"2024-06-06T03:25:13.359691+0000","last_became_active":"2024-06-06T03:22:34.310510+0000","last_became_peered":"2024-06-06T03:22:34.310510+0000","last_unstale":"2024-06-06T03:25:13.359691+0000","last_undegraded":"2024-06-06T03:25:13.359691+0000","last_fullsized":"2024-06-06T03:25:13.359691+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:52:10.979031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":36,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.897745+0000","last_change":"2024-06-06T03:24:14.897222+0000","last_active":"2024-06-06T03:24:14.897745+0000","last_peered":"2024-06-06T03:24:14.897745+0000","last_clean":"2024-06-06T03:24:14.897745+0000","last_became_active":"2024-06-06T03:24:14.896620+0000","last_became_peered":"2024-06-06T03:24:14.896620+0000","last_unstale":"2024-06-06T03:24:14.897745+0000","last_undegraded":"2024-06-06T03:24:14.897745+0000","last_fullsized":"2024-06-06T03:24:14.897745+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:43:44.992240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8,10,0],"acting":[6,8,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371198+0000","last_change":"2024-06-06T03:22:34.294540+0000","last_active":"2024-06-06T03:25:13.371198+0000","last_peered":"2024-06-06T03:25:13.371198+0000","last_clean":"2024-06-06T03:25:13.371198+0000","last_became_active":"2024-06-06T03:22:34.294204+0000","last_became_peered":"2024-06-06T03:22:34.294204+0000","last_unstale":"2024-06-06T03:25:13.371198+0000","last_undegraded":"2024-06-06T03:25:13.371198+0000","last_fullsized":"2024-06-06T03:25:13.371198+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:16:39.386345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"99'5","reported_seq":148,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:12.786429+0000","last_change":"2024-06-06T03:22:31.242275+0000","last_active":"2024-06-06T03:25:12.786429+0000","last_peered":"2024-06-06T03:25:12.786429+0000","last_clean":"2024-06-06T03:25:12.786429+0000","last_became_active":"2024-06-06T03:22:31.241930+0000","last_became_peered":"2024-06-06T03:22:31.241930+0000","last_unstale":"2024-06-06T03:25:12.786429+0000","last_undegraded":"2024-06-06T03:25:12.786429+0000","last_fullsized":"2024-06-06T03:25:12.786429+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:46:16.407946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"97'1","reported_seq":30,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.701132+0000","last_change":"2024-06-06T03:22:44.416191+0000","last_active":"2024-06-06T03:24:14.701132+0000","last_peered":"2024-06-06T03:24:14.701132+0000","last_clean":"2024-06-06T03:24:14.701132+0000","last_became_active":"2024-06-06T03:22:44.415632+0000","last_became_peered":"2024-06-06T03:22:44.415632+0000","last_unstale":"2024-06-06T03:24:14.701132+0000","last_undegraded":"2024-06-06T03:24:14.701132+0000","last_fullsized":"2024-06-06T03:24:14.701132+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:10:48.995029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371311+0000","last_change":"2024-06-06T03:22:34.304567+0000","last_active":"2024-06-06T03:25:13.371311+0000","last_peered":"2024-06-06T03:25:13.371311+0000","last_clean":"2024-06-06T03:25:13.371311+0000","last_became_active":"2024-06-06T03:22:34.304183+0000","last_became_peered":"2024-06-06T03:22:34.304183+0000","last_unstale":"2024-06-06T03:25:13.371311+0000","last_undegraded":"2024-06-06T03:25:13.371311+0000","last_fullsized":"2024-06-06T03:25:13.371311+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:34:02.229528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"97'3","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163254+0000","last_change":"2024-06-06T03:22:31.056188+0000","last_active":"2024-06-06T03:24:15.163254+0000","last_peered":"2024-06-06T03:24:15.163254+0000","last_clean":"2024-06-06T03:24:15.163254+0000","last_became_active":"2024-06-06T03:22:31.055758+0000","last_became_peered":"2024-06-06T03:22:31.055758+0000","last_unstale":"2024-06-06T03:24:15.163254+0000","last_undegraded":"2024-06-06T03:24:15.163254+0000","last_fullsized":"2024-06-06T03:24:15.163254+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:35:51.016087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":367,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700355+0000","last_change":"2024-06-06T03:21:07.156236+0000","last_active":"2024-06-06T03:24:14.700355+0000","last_peered":"2024-06-06T03:24:14.700355+0000","last_clean":"2024-06-06T03:24:14.700355+0000","last_became_active":"2024-06-06T03:21:07.155807+0000","last_became_peered":"2024-06-06T03:21:07.155807+0000","last_unstale":"2024-06-06T03:24:14.700355+0000","last_undegraded":"2024-06-06T03:24:14.700355+0000","last_fullsized":"2024-06-06T03:24:14.700355+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:17:38.330402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:17:38.330402+0000","last_clean_scrub_stamp":"2024-06-06T03:17:38.330402+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:30:13.968755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.371740+0000","last_change":"2024-06-06T03:22:44.424693+0000","last_active":"2024-06-06T03:24:15.371740+0000","last_peered":"2024-06-06T03:24:15.371740+0000","last_clean":"2024-06-06T03:24:15.371740+0000","last_became_active":"2024-06-06T03:22:44.423607+0000","last_became_peered":"2024-06-06T03:22:44.423607+0000","last_unstale":"2024-06-06T03:24:15.371740+0000","last_undegraded":"2024-06-06T03:24:15.371740+0000","last_fullsized":"2024-06-06T03:24:15.371740+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:57:56.974785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.359317+0000","last_change":"2024-06-06T03:22:34.297940+0000","last_active":"2024-06-06T03:25:13.359317+0000","last_peered":"2024-06-06T03:25:13.359317+0000","last_clean":"2024-06-06T03:25:13.359317+0000","last_became_active":"2024-06-06T03:22:34.297597+0000","last_became_peered":"2024-06-06T03:22:34.297597+0000","last_unstale":"2024-06-06T03:25:13.359317+0000","last_undegraded":"2024-06-06T03:25:13.359317+0000","last_fullsized":"2024-06-06T03:25:13.359317+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:52:52.155070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700574+0000","last_change":"2024-06-06T03:22:31.055329+0000","last_active":"2024-06-06T03:24:14.700574+0000","last_peered":"2024-06-06T03:24:14.700574+0000","last_clean":"2024-06-06T03:24:14.700574+0000","last_became_active":"2024-06-06T03:22:31.054493+0000","last_became_peered":"2024-06-06T03:22:31.054493+0000","last_unstale":"2024-06-06T03:24:14.700574+0000","last_undegraded":"2024-06-06T03:24:14.700574+0000","last_fullsized":"2024-06-06T03:24:14.700574+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:45:32.068810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380440+0000","last_change":"2024-06-06T03:22:44.413560+0000","last_active":"2024-06-06T03:24:15.380440+0000","last_peered":"2024-06-06T03:24:15.380440+0000","last_clean":"2024-06-06T03:24:15.380440+0000","last_became_active":"2024-06-06T03:22:44.413100+0000","last_became_peered":"2024-06-06T03:22:44.413100+0000","last_unstale":"2024-06-06T03:24:15.380440+0000","last_undegraded":"2024-06-06T03:24:15.380440+0000","last_fullsized":"2024-06-06T03:24:15.380440+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:58:02.780671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"97'1","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380583+0000","last_change":"2024-06-06T03:23:14.515805+0000","last_active":"2024-06-06T03:24:15.380583+0000","last_peered":"2024-06-06T03:24:15.380583+0000","last_clean":"2024-06-06T03:24:15.380583+0000","last_became_active":"2024-06-06T03:23:14.515436+0000","last_became_peered":"2024-06-06T03:23:14.515436+0000","last_unstale":"2024-06-06T03:24:15.380583+0000","last_undegraded":"2024-06-06T03:24:15.380583+0000","last_fullsized":"2024-06-06T03:24:15.380583+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:59:16.246609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.364457+0000","last_change":"2024-06-06T03:22:34.294549+0000","last_active":"2024-06-06T03:25:13.364457+0000","last_peered":"2024-06-06T03:25:13.364457+0000","last_clean":"2024-06-06T03:25:13.364457+0000","last_became_active":"2024-06-06T03:22:34.294202+0000","last_became_peered":"2024-06-06T03:22:34.294202+0000","last_unstale":"2024-06-06T03:25:13.364457+0000","last_undegraded":"2024-06-06T03:25:13.364457+0000","last_fullsized":"2024-06-06T03:25:13.364457+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:55:59.823957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380133+0000","last_change":"2024-06-06T03:22:44.416890+0000","last_active":"2024-06-06T03:24:15.380133+0000","last_peered":"2024-06-06T03:24:15.380133+0000","last_clean":"2024-06-06T03:24:15.380133+0000","last_became_active":"2024-06-06T03:22:44.416473+0000","last_became_peered":"2024-06-06T03:22:44.416473+0000","last_unstale":"2024-06-06T03:24:15.380133+0000","last_undegraded":"2024-06-06T03:24:15.380133+0000","last_fullsized":"2024-06-06T03:24:15.380133+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:23:48.972196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"97'12","reported_seq":57,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.379741+0000","last_change":"2024-06-06T03:22:31.054481+0000","last_active":"2024-06-06T03:24:15.379741+0000","last_peered":"2024-06-06T03:24:15.379741+0000","last_clean":"2024-06-06T03:24:15.379741+0000","last_became_active":"2024-06-06T03:22:31.054173+0000","last_became_peered":"2024-06-06T03:22:31.054173+0000","last_unstale":"2024-06-06T03:24:15.379741+0000","last_undegraded":"2024-06-06T03:24:15.379741+0000","last_fullsized":"2024-06-06T03:24:15.379741+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:52:45.311149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.372630+0000","last_change":"2024-06-06T03:22:34.300211+0000","last_active":"2024-06-06T03:25:13.372630+0000","last_peered":"2024-06-06T03:25:13.372630+0000","last_clean":"2024-06-06T03:25:13.372630+0000","last_became_active":"2024-06-06T03:22:34.299870+0000","last_became_peered":"2024-06-06T03:22:34.299870+0000","last_unstale":"2024-06-06T03:25:13.372630+0000","last_undegraded":"2024-06-06T03:25:13.372630+0000","last_fullsized":"2024-06-06T03:25:13.372630+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:50:56.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973290+0000","last_change":"2024-06-06T03:22:44.414727+0000","last_active":"2024-06-06T03:24:14.973290+0000","last_peered":"2024-06-06T03:24:14.973290+0000","last_clean":"2024-06-06T03:24:14.973290+0000","last_became_active":"2024-06-06T03:22:44.414232+0000","last_became_peered":"2024-06-06T03:22:44.414232+0000","last_unstale":"2024-06-06T03:24:14.973290+0000","last_undegraded":"2024-06-06T03:24:14.973290+0000","last_fullsized":"2024-06-06T03:24:14.973290+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:26:21.540309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"97'4","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.164042+0000","last_change":"2024-06-06T03:22:31.178740+0000","last_active":"2024-06-06T03:24:15.164042+0000","last_peered":"2024-06-06T03:24:15.164042+0000","last_clean":"2024-06-06T03:24:15.164042+0000","last_became_active":"2024-06-06T03:22:31.178353+0000","last_became_peered":"2024-06-06T03:22:31.178353+0000","last_unstale":"2024-06-06T03:24:15.164042+0000","last_undegraded":"2024-06-06T03:24:15.164042+0000","last_fullsized":"2024-06-06T03:24:15.164042+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:56:50.159463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.368763+0000","last_change":"2024-06-06T03:22:34.298011+0000","last_active":"2024-06-06T03:25:13.368763+0000","last_peered":"2024-06-06T03:25:13.368763+0000","last_clean":"2024-06-06T03:25:13.368763+0000","last_became_active":"2024-06-06T03:22:34.297697+0000","last_became_peered":"2024-06-06T03:22:34.297697+0000","last_unstale":"2024-06-06T03:25:13.368763+0000","last_undegraded":"2024-06-06T03:25:13.368763+0000","last_fullsized":"2024-06-06T03:25:13.368763+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:01:38.606543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163829+0000","last_change":"2024-06-06T03:22:44.425675+0000","last_active":"2024-06-06T03:24:15.163829+0000","last_peered":"2024-06-06T03:24:15.163829+0000","last_clean":"2024-06-06T03:24:15.163829+0000","last_became_active":"2024-06-06T03:22:44.424023+0000","last_became_peered":"2024-06-06T03:22:44.424023+0000","last_unstale":"2024-06-06T03:24:15.163829+0000","last_undegraded":"2024-06-06T03:24:15.163829+0000","last_fullsized":"2024-06-06T03:24:15.163829+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:47:48.718771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"97'2","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.379742+0000","last_change":"2024-06-06T03:22:31.242360+0000","last_active":"2024-06-06T03:24:15.379742+0000","last_peered":"2024-06-06T03:24:15.379742+0000","last_clean":"2024-06-06T03:24:15.379742+0000","last_became_active":"2024-06-06T03:22:31.242015+0000","last_became_peered":"2024-06-06T03:22:31.242015+0000","last_unstale":"2024-06-06T03:24:15.379742+0000","last_undegraded":"2024-06-06T03:24:15.379742+0000","last_fullsized":"2024-06-06T03:24:15.379742+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:14:30.674106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"99'2","reported_seq":41,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.326018+0000","last_change":"2024-06-06T03:22:34.302980+0000","last_active":"2024-06-06T03:25:13.326018+0000","last_peered":"2024-06-06T03:25:13.326018+0000","last_clean":"2024-06-06T03:25:13.326018+0000","last_became_active":"2024-06-06T03:22:34.302625+0000","last_became_peered":"2024-06-06T03:22:34.302625+0000","last_unstale":"2024-06-06T03:25:13.326018+0000","last_undegraded":"2024-06-06T03:25:13.326018+0000","last_fullsized":"2024-06-06T03:25:13.326018+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:13:01.603365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380862+0000","last_change":"2024-06-06T03:22:44.423741+0000","last_active":"2024-06-06T03:24:15.380862+0000","last_peered":"2024-06-06T03:24:15.380862+0000","last_clean":"2024-06-06T03:24:15.380862+0000","last_became_active":"2024-06-06T03:22:44.423266+0000","last_became_peered":"2024-06-06T03:22:44.423266+0000","last_unstale":"2024-06-06T03:24:15.380862+0000","last_undegraded":"2024-06-06T03:24:15.380862+0000","last_fullsized":"2024-06-06T03:24:15.380862+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:09:19.324145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"97'3","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.379798+0000","last_change":"2024-06-06T03:22:31.052988+0000","last_active":"2024-06-06T03:24:15.379798+0000","last_peered":"2024-06-06T03:24:15.379798+0000","last_clean":"2024-06-06T03:24:15.379798+0000","last_became_active":"2024-06-06T03:22:31.052743+0000","last_became_peered":"2024-06-06T03:22:31.052743+0000","last_unstale":"2024-06-06T03:24:15.379798+0000","last_undegraded":"2024-06-06T03:24:15.379798+0000","last_fullsized":"2024-06-06T03:24:15.379798+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:31:45.176416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380330+0000","last_change":"2024-06-06T03:22:34.299991+0000","last_active":"2024-06-06T03:24:15.380330+0000","last_peered":"2024-06-06T03:24:15.380330+0000","last_clean":"2024-06-06T03:24:15.380330+0000","last_became_active":"2024-06-06T03:22:34.299659+0000","last_became_peered":"2024-06-06T03:22:34.299659+0000","last_unstale":"2024-06-06T03:24:15.380330+0000","last_undegraded":"2024-06-06T03:24:15.380330+0000","last_fullsized":"2024-06-06T03:24:15.380330+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:16:51.492749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"97'1","reported_seq":37,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163786+0000","last_change":"2024-06-06T03:23:15.027541+0000","last_active":"2024-06-06T03:24:15.163786+0000","last_peered":"2024-06-06T03:24:15.163786+0000","last_clean":"2024-06-06T03:24:15.163786+0000","last_became_active":"2024-06-06T03:23:15.026931+0000","last_became_peered":"2024-06-06T03:23:15.026931+0000","last_unstale":"2024-06-06T03:24:15.163786+0000","last_undegraded":"2024-06-06T03:24:15.163786+0000","last_fullsized":"2024-06-06T03:24:15.163786+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:47:44.197067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"97'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380367+0000","last_change":"2024-06-06T03:23:14.831383+0000","last_active":"2024-06-06T03:24:15.380367+0000","last_peered":"2024-06-06T03:24:15.380367+0000","last_clean":"2024-06-06T03:24:15.380367+0000","last_became_active":"2024-06-06T03:23:14.830948+0000","last_became_peered":"2024-06-06T03:23:14.830948+0000","last_unstale":"2024-06-06T03:24:15.380367+0000","last_undegraded":"2024-06-06T03:24:15.380367+0000","last_fullsized":"2024-06-06T03:24:15.380367+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:58:00.326112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.370110+0000","last_change":"2024-06-06T03:22:34.301842+0000","last_active":"2024-06-06T03:25:13.370110+0000","last_peered":"2024-06-06T03:25:13.370110+0000","last_clean":"2024-06-06T03:25:13.370110+0000","last_became_active":"2024-06-06T03:22:34.301513+0000","last_became_peered":"2024-06-06T03:22:34.301513+0000","last_unstale":"2024-06-06T03:25:13.370110+0000","last_undegraded":"2024-06-06T03:25:13.370110+0000","last_fullsized":"2024-06-06T03:25:13.370110+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:30:03.813861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163817+0000","last_change":"2024-06-06T03:22:44.419621+0000","last_active":"2024-06-06T03:24:15.163817+0000","last_peered":"2024-06-06T03:24:15.163817+0000","last_clean":"2024-06-06T03:24:15.163817+0000","last_became_active":"2024-06-06T03:22:44.419065+0000","last_became_peered":"2024-06-06T03:22:44.419065+0000","last_unstale":"2024-06-06T03:24:15.163817+0000","last_undegraded":"2024-06-06T03:24:15.163817+0000","last_fullsized":"2024-06-06T03:24:15.163817+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:10:49.762284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"97'4","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.699776+0000","last_change":"2024-06-06T03:22:31.056409+0000","last_active":"2024-06-06T03:24:14.699776+0000","last_peered":"2024-06-06T03:24:14.699776+0000","last_clean":"2024-06-06T03:24:14.699776+0000","last_became_active":"2024-06-06T03:22:31.055994+0000","last_became_peered":"2024-06-06T03:22:31.055994+0000","last_unstale":"2024-06-06T03:24:14.699776+0000","last_undegraded":"2024-06-06T03:24:14.699776+0000","last_fullsized":"2024-06-06T03:24:14.699776+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:09:00.784820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371522+0000","last_change":"2024-06-06T03:22:34.302238+0000","last_active":"2024-06-06T03:25:13.371522+0000","last_peered":"2024-06-06T03:25:13.371522+0000","last_clean":"2024-06-06T03:25:13.371522+0000","last_became_active":"2024-06-06T03:22:34.301869+0000","last_became_peered":"2024-06-06T03:22:34.301869+0000","last_unstale":"2024-06-06T03:25:13.371522+0000","last_undegraded":"2024-06-06T03:25:13.371522+0000","last_fullsized":"2024-06-06T03:25:13.371522+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:17:08.350692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380233+0000","last_change":"2024-06-06T03:22:44.414052+0000","last_active":"2024-06-06T03:24:15.380233+0000","last_peered":"2024-06-06T03:24:15.380233+0000","last_clean":"2024-06-06T03:24:15.380233+0000","last_became_active":"2024-06-06T03:22:44.413633+0000","last_became_peered":"2024-06-06T03:22:44.413633+0000","last_unstale":"2024-06-06T03:24:15.380233+0000","last_undegraded":"2024-06-06T03:24:15.380233+0000","last_fullsized":"2024-06-06T03:24:15.380233+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:41:16.942699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973931+0000","last_change":"2024-06-06T03:22:31.243570+0000","last_active":"2024-06-06T03:24:14.973931+0000","last_peered":"2024-06-06T03:24:14.973931+0000","last_clean":"2024-06-06T03:24:14.973931+0000","last_became_active":"2024-06-06T03:22:31.243194+0000","last_became_peered":"2024-06-06T03:22:31.243194+0000","last_unstale":"2024-06-06T03:24:14.973931+0000","last_undegraded":"2024-06-06T03:24:14.973931+0000","last_fullsized":"2024-06-06T03:24:14.973931+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:21:22.233139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.370634+0000","last_change":"2024-06-06T03:22:34.301665+0000","last_active":"2024-06-06T03:25:13.370634+0000","last_peered":"2024-06-06T03:25:13.370634+0000","last_clean":"2024-06-06T03:25:13.370634+0000","last_became_active":"2024-06-06T03:22:34.300967+0000","last_became_peered":"2024-06-06T03:22:34.300967+0000","last_unstale":"2024-06-06T03:25:13.370634+0000","last_undegraded":"2024-06-06T03:25:13.370634+0000","last_fullsized":"2024-06-06T03:25:13.370634+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:57:58.905488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":36,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.698608+0000","last_change":"2024-06-06T03:23:14.833267+0000","last_active":"2024-06-06T03:24:14.698608+0000","last_peered":"2024-06-06T03:24:14.698608+0000","last_clean":"2024-06-06T03:24:14.698608+0000","last_became_active":"2024-06-06T03:23:14.832760+0000","last_became_peered":"2024-06-06T03:23:14.832760+0000","last_unstale":"2024-06-06T03:24:14.698608+0000","last_undegraded":"2024-06-06T03:24:14.698608+0000","last_fullsized":"2024-06-06T03:24:14.698608+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:24:32.668781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'1","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.370535+0000","last_change":"2024-06-06T03:22:31.054686+0000","last_active":"2024-06-06T03:24:15.370535+0000","last_peered":"2024-06-06T03:24:15.370535+0000","last_clean":"2024-06-06T03:24:15.370535+0000","last_became_active":"2024-06-06T03:22:31.053219+0000","last_became_peered":"2024-06-06T03:22:31.053219+0000","last_unstale":"2024-06-06T03:24:15.370535+0000","last_undegraded":"2024-06-06T03:24:15.370535+0000","last_fullsized":"2024-06-06T03:24:15.370535+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:32:27.423208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.368737+0000","last_change":"2024-06-06T03:22:34.304916+0000","last_active":"2024-06-06T03:25:13.368737+0000","last_peered":"2024-06-06T03:25:13.368737+0000","last_clean":"2024-06-06T03:25:13.368737+0000","last_became_active":"2024-06-06T03:22:34.302442+0000","last_became_peered":"2024-06-06T03:22:34.302442+0000","last_unstale":"2024-06-06T03:25:13.368737+0000","last_undegraded":"2024-06-06T03:25:13.368737+0000","last_fullsized":"2024-06-06T03:25:13.368737+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:01:24.034386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.370747+0000","last_change":"2024-06-06T03:22:44.415478+0000","last_active":"2024-06-06T03:24:15.370747+0000","last_peered":"2024-06-06T03:24:15.370747+0000","last_clean":"2024-06-06T03:24:15.370747+0000","last_became_active":"2024-06-06T03:22:44.415007+0000","last_became_peered":"2024-06-06T03:22:44.415007+0000","last_unstale":"2024-06-06T03:24:15.370747+0000","last_undegraded":"2024-06-06T03:24:15.370747+0000","last_fullsized":"2024-06-06T03:24:15.370747+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:57:47.793481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'2","reported_seq":57,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700897+0000","last_change":"2024-06-06T03:23:14.521037+0000","last_active":"2024-06-06T03:24:14.700897+0000","last_peered":"2024-06-06T03:24:14.700897+0000","last_clean":"2024-06-06T03:24:14.700897+0000","last_became_active":"2024-06-06T03:23:14.517922+0000","last_became_peered":"2024-06-06T03:23:14.517922+0000","last_unstale":"2024-06-06T03:24:14.700897+0000","last_undegraded":"2024-06-06T03:24:14.700897+0000","last_fullsized":"2024-06-06T03:24:14.700897+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:12:46.222984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.370655+0000","last_change":"2024-06-06T03:22:34.305178+0000","last_active":"2024-06-06T03:25:13.370655+0000","last_peered":"2024-06-06T03:25:13.370655+0000","last_clean":"2024-06-06T03:25:13.370655+0000","last_became_active":"2024-06-06T03:22:34.302420+0000","last_became_peered":"2024-06-06T03:22:34.302420+0000","last_unstale":"2024-06-06T03:25:13.370655+0000","last_undegraded":"2024-06-06T03:25:13.370655+0000","last_fullsized":"2024-06-06T03:25:13.370655+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:22:08.736542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380543+0000","last_change":"2024-06-06T03:23:14.514756+0000","last_active":"2024-06-06T03:24:15.380543+0000","last_peered":"2024-06-06T03:24:15.380543+0000","last_clean":"2024-06-06T03:24:15.380543+0000","last_became_active":"2024-06-06T03:23:14.514325+0000","last_became_peered":"2024-06-06T03:23:14.514325+0000","last_unstale":"2024-06-06T03:24:15.380543+0000","last_undegraded":"2024-06-06T03:24:15.380543+0000","last_fullsized":"2024-06-06T03:24:15.380543+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:45:44.594836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973725+0000","last_change":"2024-06-06T03:22:34.298570+0000","last_active":"2024-06-06T03:24:14.973725+0000","last_peered":"2024-06-06T03:24:14.973725+0000","last_clean":"2024-06-06T03:24:14.973725+0000","last_became_active":"2024-06-06T03:22:34.298137+0000","last_became_peered":"2024-06-06T03:22:34.298137+0000","last_unstale":"2024-06-06T03:24:14.973725+0000","last_undegraded":"2024-06-06T03:24:14.973725+0000","last_fullsized":"2024-06-06T03:24:14.973725+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:07:25.290355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973429+0000","last_change":"2024-06-06T03:22:34.297750+0000","last_active":"2024-06-06T03:24:14.973429+0000","last_peered":"2024-06-06T03:24:14.973429+0000","last_clean":"2024-06-06T03:24:14.973429+0000","last_became_active":"2024-06-06T03:22:34.297264+0000","last_became_peered":"2024-06-06T03:22:34.297264+0000","last_unstale":"2024-06-06T03:24:14.973429+0000","last_undegraded":"2024-06-06T03:24:14.973429+0000","last_fullsized":"2024-06-06T03:24:14.973429+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:14:58.580044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"99'7","reported_seq":52,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.357808+0000","last_change":"2024-06-06T03:23:14.832804+0000","last_active":"2024-06-06T03:25:13.357808+0000","last_peered":"2024-06-06T03:25:13.357808+0000","last_clean":"2024-06-06T03:25:13.357808+0000","last_became_active":"2024-06-06T03:23:14.832448+0000","last_became_peered":"2024-06-06T03:23:14.832448+0000","last_unstale":"2024-06-06T03:25:13.357808+0000","last_undegraded":"2024-06-06T03:25:13.357808+0000","last_fullsized":"2024-06-06T03:25:13.357808+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:52:16.907033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"99'4","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.366112+0000","last_change":"2024-06-06T03:23:14.515841+0000","last_active":"2024-06-06T03:25:13.366112+0000","last_peered":"2024-06-06T03:25:13.366112+0000","last_clean":"2024-06-06T03:25:13.366112+0000","last_became_active":"2024-06-06T03:23:14.515331+0000","last_became_peered":"2024-06-06T03:23:14.515331+0000","last_unstale":"2024-06-06T03:25:13.366112+0000","last_undegraded":"2024-06-06T03:25:13.366112+0000","last_fullsized":"2024-06-06T03:25:13.366112+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:46:57.178054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380822+0000","last_change":"2024-06-06T03:22:34.299660+0000","last_active":"2024-06-06T03:24:15.380822+0000","last_peered":"2024-06-06T03:24:15.380822+0000","last_clean":"2024-06-06T03:24:15.380822+0000","last_became_active":"2024-06-06T03:22:34.298411+0000","last_became_peered":"2024-06-06T03:22:34.298411+0000","last_unstale":"2024-06-06T03:24:15.380822+0000","last_undegraded":"2024-06-06T03:24:15.380822+0000","last_fullsized":"2024-06-06T03:24:15.380822+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:29:16.170700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973842+0000","last_change":"2024-06-06T03:22:34.308110+0000","last_active":"2024-06-06T03:24:14.973842+0000","last_peered":"2024-06-06T03:24:14.973842+0000","last_clean":"2024-06-06T03:24:14.973842+0000","last_became_active":"2024-06-06T03:22:34.307637+0000","last_became_peered":"2024-06-06T03:22:34.307637+0000","last_unstale":"2024-06-06T03:24:14.973842+0000","last_undegraded":"2024-06-06T03:24:14.973842+0000","last_fullsized":"2024-06-06T03:24:14.973842+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:40:23.264509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"99'2","reported_seq":41,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.368343+0000","last_change":"2024-06-06T03:22:34.295494+0000","last_active":"2024-06-06T03:25:13.368343+0000","last_peered":"2024-06-06T03:25:13.368343+0000","last_clean":"2024-06-06T03:25:13.368343+0000","last_became_active":"2024-06-06T03:22:34.295101+0000","last_became_peered":"2024-06-06T03:22:34.295101+0000","last_unstale":"2024-06-06T03:25:13.368343+0000","last_undegraded":"2024-06-06T03:25:13.368343+0000","last_fullsized":"2024-06-06T03:25:13.368343+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:39:07.298053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.373117+0000","last_change":"2024-06-06T03:22:34.291312+0000","last_active":"2024-06-06T03:25:13.373117+0000","last_peered":"2024-06-06T03:25:13.373117+0000","last_clean":"2024-06-06T03:25:13.373117+0000","last_became_active":"2024-06-06T03:22:34.290971+0000","last_became_peered":"2024-06-06T03:22:34.290971+0000","last_unstale":"2024-06-06T03:25:13.373117+0000","last_undegraded":"2024-06-06T03:25:13.373117+0000","last_fullsized":"2024-06-06T03:25:13.373117+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:06:27.333831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.372533+0000","last_change":"2024-06-06T03:22:34.292000+0000","last_active":"2024-06-06T03:25:13.372533+0000","last_peered":"2024-06-06T03:25:13.372533+0000","last_clean":"2024-06-06T03:25:13.372533+0000","last_became_active":"2024-06-06T03:22:34.291500+0000","last_became_peered":"2024-06-06T03:22:34.291500+0000","last_unstale":"2024-06-06T03:25:13.372533+0000","last_undegraded":"2024-06-06T03:25:13.372533+0000","last_fullsized":"2024-06-06T03:25:13.372533+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:37:20.677107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369963+0000","last_change":"2024-06-06T03:22:34.303138+0000","last_active":"2024-06-06T03:25:13.369963+0000","last_peered":"2024-06-06T03:25:13.369963+0000","last_clean":"2024-06-06T03:25:13.369963+0000","last_became_active":"2024-06-06T03:22:34.302758+0000","last_became_peered":"2024-06-06T03:22:34.302758+0000","last_unstale":"2024-06-06T03:25:13.369963+0000","last_undegraded":"2024-06-06T03:25:13.369963+0000","last_fullsized":"2024-06-06T03:25:13.369963+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:34:18.516891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371585+0000","last_change":"2024-06-06T03:22:34.297035+0000","last_active":"2024-06-06T03:25:13.371585+0000","last_peered":"2024-06-06T03:25:13.371585+0000","last_clean":"2024-06-06T03:25:13.371585+0000","last_became_active":"2024-06-06T03:22:34.296706+0000","last_became_peered":"2024-06-06T03:22:34.296706+0000","last_unstale":"2024-06-06T03:25:13.371585+0000","last_undegraded":"2024-06-06T03:25:13.371585+0000","last_fullsized":"2024-06-06T03:25:13.371585+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:26:26.959215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380543+0000","last_change":"2024-06-06T03:22:34.296365+0000","last_active":"2024-06-06T03:24:15.380543+0000","last_peered":"2024-06-06T03:24:15.380543+0000","last_clean":"2024-06-06T03:24:15.380543+0000","last_became_active":"2024-06-06T03:22:34.296021+0000","last_became_peered":"2024-06-06T03:22:34.296021+0000","last_unstale":"2024-06-06T03:24:15.380543+0000","last_undegraded":"2024-06-06T03:24:15.380543+0000","last_fullsized":"2024-06-06T03:24:15.380543+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:40:33.183110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":384,"ondisk_log_size":384,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":249510,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66460,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":622,"num_read_kb":382,"num_write":175,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":199131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383728,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32252,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712900,"statfs":{"total":95995035648,"available":95962009600,"internally_reserved":0,"allocated":1097728,"data_stored":569692,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645364,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28232,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716920,"statfs":{"total":95995035648,"available":95966126080,"internally_reserved":0,"allocated":1245184,"data_stored":1223884,"data_compressed":68620,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808890,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28108,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717044,"statfs":{"total":95995035648,"available":95966253056,"internally_reserved":0,"allocated":1110016,"data_stored":569906,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070528,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1105920,"data_stored":569804,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332165,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32308,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712844,"statfs":{"total":95995035648,"available":95961952256,"internally_reserved":0,"allocated":1159168,"data_stored":1165875,"data_compressed":68620,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495691,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1089536,"data_stored":565082,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574947,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28148,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717004,"statfs":{"total":95995035648,"available":95966212096,"internally_reserved":0,"allocated":1159168,"data_stored":627311,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738473,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36424,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708728,"statfs":{"total":95995035648,"available":95957737472,"internally_reserved":0,"allocated":1114112,"data_stored":566470,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411423,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32336,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712816,"statfs":{"total":95995035648,"available":95961923584,"internally_reserved":0,"allocated":1179648,"data_stored":628412,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182489,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1101824,"data_stored":565276,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920853,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32252,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712900,"statfs":{"total":95995035648,"available":95962009600,"internally_reserved":0,"allocated":1101824,"data_stored":570263,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757328,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32320,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712832,"statfs":{"total":95995035648,"available":95961939968,"internally_reserved":0,"allocated":1167360,"data_stored":1160932,"data_compressed":68620,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34475,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34475,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":64428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-06T03:25:16.424 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-06-06T03:25:16.676 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:25:17.141 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:17 smithi050 ceph-mon[32421]: pgmap v390: 129 pgs: 129 active+clean; 642 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-06-06T03:25:17.142 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:17 smithi050 ceph-mon[32421]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T03:25:17.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:17 smithi079 ceph-mon[35478]: pgmap v390: 129 pgs: 129 active+clean; 642 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-06-06T03:25:17.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:17 smithi079 ceph-mon[35478]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T03:25:17.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:17 smithi122 ceph-mon[35759]: pgmap v390: 129 pgs: 129 active+clean; 642 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-06-06T03:25:17.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:17 smithi122 ceph-mon[35759]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T03:25:18.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.364+0000 7facdede2700 1 -- 172.21.15.50:0/2723602026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facd8107840 msgr2=0x7facd810f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:18.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.364+0000 7facdede2700 1 --2- 172.21.15.50:0/2723602026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facd8107840 0x7facd810f3c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7facd000b0d0 tx=0x7facd000b3e0 comp rx=0 tx=0).stop 2024-06-06T03:25:18.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.364+0000 7facdede2700 1 -- 172.21.15.50:0/2723602026 shutdown_connections 2024-06-06T03:25:18.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.364+0000 7facdede2700 1 --2- 172.21.15.50:0/2723602026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facd8107840 0x7facd810f3c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:18.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.364+0000 7facdede2700 1 --2- 172.21.15.50:0/2723602026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facd8102740 0x7facd8102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:18.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.364+0000 7facdede2700 1 --2- 172.21.15.50:0/2723602026 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facd81030f0 0x7facd8107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:18.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.364+0000 7facdede2700 1 -- 172.21.15.50:0/2723602026 >> 172.21.15.50:0/2723602026 conn(0x7facd80795f0 msgr2=0x7facd8079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:18.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.364+0000 7facdede2700 1 -- 172.21.15.50:0/2723602026 shutdown_connections 2024-06-06T03:25:18.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.365+0000 7facdede2700 1 -- 172.21.15.50:0/2723602026 wait complete. 2024-06-06T03:25:18.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.365+0000 7facdede2700 1 Processor -- start 2024-06-06T03:25:18.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.365+0000 7facdede2700 1 -- start start 2024-06-06T03:25:18.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.366+0000 7facdede2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facd8102740 0x7facd819e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:18.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.366+0000 7facdede2700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facd81030f0 0x7facd819ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:18.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.366+0000 7facdede2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facd8107840 0x7facd81988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:18.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.366+0000 7facdede2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7facd8112630 con 0x7facd8107840 2024-06-06T03:25:18.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.366+0000 7facdede2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7facd81124b0 con 0x7facd8102740 2024-06-06T03:25:18.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.366+0000 7facdede2700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7facd81127b0 con 0x7facd81030f0 2024-06-06T03:25:18.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.366+0000 7facdd37f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facd8107840 0x7facd81988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:18.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.366+0000 7facdd37f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facd8107840 0x7facd81988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38558/0 (socket says 172.21.15.50:38558) 2024-06-06T03:25:18.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.366+0000 7facdd37f700 1 -- 172.21.15.50:0/161311939 learned_addr learned my addr 172.21.15.50:0/161311939 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:18.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.366+0000 7facdcb7e700 1 --2- 172.21.15.50:0/161311939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facd8102740 0x7facd819e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:18.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.366+0000 7facd7fff700 1 --2- 172.21.15.50:0/161311939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facd81030f0 0x7facd819ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:18.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.366+0000 7facdd37f700 1 -- 172.21.15.50:0/161311939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facd81030f0 msgr2=0x7facd819ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:18.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.366+0000 7facdd37f700 1 --2- 172.21.15.50:0/161311939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facd81030f0 0x7facd819ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:18.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.366+0000 7facdd37f700 1 -- 172.21.15.50:0/161311939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facd8102740 msgr2=0x7facd819e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:18.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.366+0000 7facdd37f700 1 --2- 172.21.15.50:0/161311939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facd8102740 0x7facd819e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:18.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.366+0000 7facdd37f700 1 -- 172.21.15.50:0/161311939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd8199050 con 0x7facd8107840 2024-06-06T03:25:18.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.366+0000 7facdcb7e700 1 --2- 172.21.15.50:0/161311939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facd8102740 0x7facd819e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:25:18.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.367+0000 7facdd37f700 1 --2- 172.21.15.50:0/161311939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facd8107840 0x7facd81988f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7facd0009850 tx=0x7facd0007ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:18.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.367+0000 7facd5ffb700 1 -- 172.21.15.50:0/161311939 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd001f070 con 0x7facd8107840 2024-06-06T03:25:18.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.367+0000 7facdede2700 1 -- 172.21.15.50:0/161311939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facd81992e0 con 0x7facd8107840 2024-06-06T03:25:18.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.367+0000 7facd5ffb700 1 -- 172.21.15.50:0/161311939 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7facd0005520 con 0x7facd8107840 2024-06-06T03:25:18.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.367+0000 7facd5ffb700 1 -- 172.21.15.50:0/161311939 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd001b7d0 con 0x7facd8107840 2024-06-06T03:25:18.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.367+0000 7facdede2700 1 -- 172.21.15.50:0/161311939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facd81a5600 con 0x7facd8107840 2024-06-06T03:25:18.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.368+0000 7facdede2700 1 -- 172.21.15.50:0/161311939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facd8069180 con 0x7facd8107840 2024-06-06T03:25:18.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.370+0000 7facd5ffb700 1 -- 172.21.15.50:0/161311939 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7facd0022070 con 0x7facd8107840 2024-06-06T03:25:18.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.370+0000 7facd5ffb700 1 --2- 172.21.15.50:0/161311939 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7facc80a2ca0 0x7facc80a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:18.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.371+0000 7facd5ffb700 1 -- 172.21.15.50:0/161311939 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7facd000f020 con 0x7facd8107840 2024-06-06T03:25:18.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.371+0000 7facdcb7e700 1 --2- 172.21.15.50:0/161311939 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7facc80a2ca0 0x7facc80a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:18.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.371+0000 7facdcb7e700 1 --2- 172.21.15.50:0/161311939 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7facc80a2ca0 0x7facc80a5160 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7facd8199a30 tx=0x7faccc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:18.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.374+0000 7facd5ffb700 1 -- 172.21.15.50:0/161311939 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7facd0029020 con 0x7facd8107840 2024-06-06T03:25:18.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.577+0000 7facdede2700 1 -- 172.21.15.50:0/161311939 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7facd8199e20 con 0x7facc80a2ca0 2024-06-06T03:25:18.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.587+0000 7facd5ffb700 1 -- 172.21.15.50:0/161311939 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340839 (secure 0 0 0) 0x7facd8199e20 con 0x7facc80a2ca0 2024-06-06T03:25:18.590 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:25:18.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.590+0000 7facdede2700 1 -- 172.21.15.50:0/161311939 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7facc80a2ca0 msgr2=0x7facc80a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:18.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.590+0000 7facdede2700 1 --2- 172.21.15.50:0/161311939 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7facc80a2ca0 0x7facc80a5160 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7facd8199a30 tx=0x7faccc009260 comp rx=0 tx=0).stop 2024-06-06T03:25:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.590+0000 7facdede2700 1 -- 172.21.15.50:0/161311939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facd8107840 msgr2=0x7facd81988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.590+0000 7facdede2700 1 --2- 172.21.15.50:0/161311939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facd8107840 0x7facd81988f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7facd0009850 tx=0x7facd0007ad0 comp rx=0 tx=0).stop 2024-06-06T03:25:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.590+0000 7facdede2700 1 -- 172.21.15.50:0/161311939 shutdown_connections 2024-06-06T03:25:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.590+0000 7facdede2700 1 --2- 172.21.15.50:0/161311939 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7facc80a2ca0 0x7facc80a5160 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.590+0000 7facdede2700 1 --2- 172.21.15.50:0/161311939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facd8107840 0x7facd81988f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.590+0000 7facdede2700 1 --2- 172.21.15.50:0/161311939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facd8102740 0x7facd819e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.590+0000 7facdede2700 1 --2- 172.21.15.50:0/161311939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facd81030f0 0x7facd819ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.590+0000 7facdede2700 1 -- 172.21.15.50:0/161311939 >> 172.21.15.50:0/161311939 conn(0x7facd80795f0 msgr2=0x7facd8100530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.590+0000 7facdede2700 1 -- 172.21.15.50:0/161311939 shutdown_connections 2024-06-06T03:25:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:18.590+0000 7facdede2700 1 -- 172.21.15.50:0/161311939 wait complete. 2024-06-06T03:25:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-06-06T03:25:19.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:19 smithi079 ceph-mon[35478]: pgmap v391: 129 pgs: 129 active+clean; 642 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-06-06T03:25:19.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:19 smithi122 ceph-mon[35759]: pgmap v391: 129 pgs: 129 active+clean; 642 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-06-06T03:25:19.457 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:19 smithi050 ceph-mon[32421]: pgmap v391: 129 pgs: 129 active+clean; 642 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-06-06T03:25:19.490 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":391,"stamp":"2024-06-06T03:25:17.382303+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657062,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":748,"num_read_kb":491,"num_write":360,"num_write_kb":3063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":747,"ondisk_log_size":747,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374972,"kb_used_data":13312,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124566852,"statfs":{"total":1151940427776,"available":1151556456448,"internally_reserved":0,"allocated":13631488,"data_stored":8782907,"data_compressed":498432,"data_compressed_allocated":675840,"data_compressed_original":2850816,"omap_allocated":19141,"internal_metadata":370193723},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":390,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":32,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003467"},"pg_stats":[{"pgid":"3.3f","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.361304+0000","last_change":"2024-06-06T03:22:34.302364+0000","last_active":"2024-06-06T03:25:13.361304+0000","last_peered":"2024-06-06T03:25:13.361304+0000","last_clean":"2024-06-06T03:25:13.361304+0000","last_became_active":"2024-06-06T03:22:34.300403+0000","last_became_peered":"2024-06-06T03:22:34.300403+0000","last_unstale":"2024-06-06T03:25:13.361304+0000","last_undegraded":"2024-06-06T03:25:13.361304+0000","last_fullsized":"2024-06-06T03:25:13.361304+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:27:55.377346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"99'4","reported_seq":43,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.361468+0000","last_change":"2024-06-06T03:22:34.306188+0000","last_active":"2024-06-06T03:25:13.361468+0000","last_peered":"2024-06-06T03:25:13.361468+0000","last_clean":"2024-06-06T03:25:13.361468+0000","last_became_active":"2024-06-06T03:22:34.305705+0000","last_became_peered":"2024-06-06T03:22:34.305705+0000","last_unstale":"2024-06-06T03:25:13.361468+0000","last_undegraded":"2024-06-06T03:25:13.361468+0000","last_fullsized":"2024-06-06T03:25:13.361468+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:10:07.337989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369892+0000","last_change":"2024-06-06T03:22:34.303568+0000","last_active":"2024-06-06T03:25:13.369892+0000","last_peered":"2024-06-06T03:25:13.369892+0000","last_clean":"2024-06-06T03:25:13.369892+0000","last_became_active":"2024-06-06T03:22:34.303194+0000","last_became_peered":"2024-06-06T03:22:34.303194+0000","last_unstale":"2024-06-06T03:25:13.369892+0000","last_undegraded":"2024-06-06T03:25:13.369892+0000","last_fullsized":"2024-06-06T03:25:13.369892+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:40:46.387476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.356411+0000","last_change":"2024-06-06T03:22:34.303896+0000","last_active":"2024-06-06T03:25:13.356411+0000","last_peered":"2024-06-06T03:25:13.356411+0000","last_clean":"2024-06-06T03:25:13.356411+0000","last_became_active":"2024-06-06T03:22:34.303568+0000","last_became_peered":"2024-06-06T03:22:34.303568+0000","last_unstale":"2024-06-06T03:25:13.356411+0000","last_undegraded":"2024-06-06T03:25:13.356411+0000","last_fullsized":"2024-06-06T03:25:13.356411+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:24:20.160115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"99'4","reported_seq":43,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.358644+0000","last_change":"2024-06-06T03:22:34.289868+0000","last_active":"2024-06-06T03:25:13.358644+0000","last_peered":"2024-06-06T03:25:13.358644+0000","last_clean":"2024-06-06T03:25:13.358644+0000","last_became_active":"2024-06-06T03:22:34.289485+0000","last_became_peered":"2024-06-06T03:22:34.289485+0000","last_unstale":"2024-06-06T03:25:13.358644+0000","last_undegraded":"2024-06-06T03:25:13.358644+0000","last_fullsized":"2024-06-06T03:25:13.358644+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:28:58.226092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.347487+0000","last_change":"2024-06-06T03:22:34.304643+0000","last_active":"2024-06-06T03:25:13.347487+0000","last_peered":"2024-06-06T03:25:13.347487+0000","last_clean":"2024-06-06T03:25:13.347487+0000","last_became_active":"2024-06-06T03:22:34.303342+0000","last_became_peered":"2024-06-06T03:22:34.303342+0000","last_unstale":"2024-06-06T03:25:13.347487+0000","last_undegraded":"2024-06-06T03:25:13.347487+0000","last_fullsized":"2024-06-06T03:25:13.347487+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:28:27.838518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.368466+0000","last_change":"2024-06-06T03:22:34.304958+0000","last_active":"2024-06-06T03:25:13.368466+0000","last_peered":"2024-06-06T03:25:13.368466+0000","last_clean":"2024-06-06T03:25:13.368466+0000","last_became_active":"2024-06-06T03:22:34.304582+0000","last_became_peered":"2024-06-06T03:22:34.304582+0000","last_unstale":"2024-06-06T03:25:13.368466+0000","last_undegraded":"2024-06-06T03:25:13.368466+0000","last_fullsized":"2024-06-06T03:25:13.368466+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:08:56.304446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371907+0000","last_change":"2024-06-06T03:22:34.299883+0000","last_active":"2024-06-06T03:25:13.371907+0000","last_peered":"2024-06-06T03:25:13.371907+0000","last_clean":"2024-06-06T03:25:13.371907+0000","last_became_active":"2024-06-06T03:22:34.299568+0000","last_became_peered":"2024-06-06T03:22:34.299568+0000","last_unstale":"2024-06-06T03:25:13.371907+0000","last_undegraded":"2024-06-06T03:25:13.371907+0000","last_fullsized":"2024-06-06T03:25:13.371907+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:23:32.479592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369788+0000","last_change":"2024-06-06T03:22:34.303157+0000","last_active":"2024-06-06T03:25:13.369788+0000","last_peered":"2024-06-06T03:25:13.369788+0000","last_clean":"2024-06-06T03:25:13.369788+0000","last_became_active":"2024-06-06T03:22:34.302332+0000","last_became_peered":"2024-06-06T03:22:34.302332+0000","last_unstale":"2024-06-06T03:25:13.369788+0000","last_undegraded":"2024-06-06T03:25:13.369788+0000","last_fullsized":"2024-06-06T03:25:13.369788+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:27:32.420058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"99'16","reported_seq":61,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.352791+0000","last_change":"2024-06-06T03:23:14.517357+0000","last_active":"2024-06-06T03:25:13.352791+0000","last_peered":"2024-06-06T03:25:13.352791+0000","last_clean":"2024-06-06T03:25:13.352791+0000","last_became_active":"2024-06-06T03:23:14.516932+0000","last_became_peered":"2024-06-06T03:23:14.516932+0000","last_unstale":"2024-06-06T03:25:13.352791+0000","last_undegraded":"2024-06-06T03:25:13.352791+0000","last_fullsized":"2024-06-06T03:25:13.352791+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:23:43.907192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369989+0000","last_change":"2024-06-06T03:22:34.310010+0000","last_active":"2024-06-06T03:25:13.369989+0000","last_peered":"2024-06-06T03:25:13.369989+0000","last_clean":"2024-06-06T03:25:13.369989+0000","last_became_active":"2024-06-06T03:22:34.309636+0000","last_became_peered":"2024-06-06T03:22:34.309636+0000","last_unstale":"2024-06-06T03:25:13.369989+0000","last_undegraded":"2024-06-06T03:25:13.369989+0000","last_fullsized":"2024-06-06T03:25:13.369989+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:35:53.745050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.351414+0000","last_change":"2024-06-06T03:22:34.311364+0000","last_active":"2024-06-06T03:25:13.351414+0000","last_peered":"2024-06-06T03:25:13.351414+0000","last_clean":"2024-06-06T03:25:13.351414+0000","last_became_active":"2024-06-06T03:22:34.311003+0000","last_became_peered":"2024-06-06T03:22:34.311003+0000","last_unstale":"2024-06-06T03:25:13.351414+0000","last_undegraded":"2024-06-06T03:25:13.351414+0000","last_fullsized":"2024-06-06T03:25:13.351414+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:35:32.460362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.372924+0000","last_change":"2024-06-06T03:22:34.302843+0000","last_active":"2024-06-06T03:25:13.372924+0000","last_peered":"2024-06-06T03:25:13.372924+0000","last_clean":"2024-06-06T03:25:13.372924+0000","last_became_active":"2024-06-06T03:22:34.302581+0000","last_became_peered":"2024-06-06T03:22:34.302581+0000","last_unstale":"2024-06-06T03:25:13.372924+0000","last_undegraded":"2024-06-06T03:25:13.372924+0000","last_fullsized":"2024-06-06T03:25:13.372924+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:56:14.178848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.362752+0000","last_change":"2024-06-06T03:22:34.305792+0000","last_active":"2024-06-06T03:25:13.362752+0000","last_peered":"2024-06-06T03:25:13.362752+0000","last_clean":"2024-06-06T03:25:13.362752+0000","last_became_active":"2024-06-06T03:22:34.305389+0000","last_became_peered":"2024-06-06T03:22:34.305389+0000","last_unstale":"2024-06-06T03:25:13.362752+0000","last_undegraded":"2024-06-06T03:25:13.362752+0000","last_fullsized":"2024-06-06T03:25:13.362752+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:17:05.992382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369254+0000","last_change":"2024-06-06T03:22:34.298396+0000","last_active":"2024-06-06T03:25:13.369254+0000","last_peered":"2024-06-06T03:25:13.369254+0000","last_clean":"2024-06-06T03:25:13.369254+0000","last_became_active":"2024-06-06T03:22:34.297697+0000","last_became_peered":"2024-06-06T03:22:34.297697+0000","last_unstale":"2024-06-06T03:25:13.369254+0000","last_undegraded":"2024-06-06T03:25:13.369254+0000","last_fullsized":"2024-06-06T03:25:13.369254+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:24:07.143699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369399+0000","last_change":"2024-06-06T03:22:34.312801+0000","last_active":"2024-06-06T03:25:13.369399+0000","last_peered":"2024-06-06T03:25:13.369399+0000","last_clean":"2024-06-06T03:25:13.369399+0000","last_became_active":"2024-06-06T03:22:34.312206+0000","last_became_peered":"2024-06-06T03:22:34.312206+0000","last_unstale":"2024-06-06T03:25:13.369399+0000","last_undegraded":"2024-06-06T03:25:13.369399+0000","last_fullsized":"2024-06-06T03:25:13.369399+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:31:41.286548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.364965+0000","last_change":"2024-06-06T03:22:34.303527+0000","last_active":"2024-06-06T03:25:13.364965+0000","last_peered":"2024-06-06T03:25:13.364965+0000","last_clean":"2024-06-06T03:25:13.364965+0000","last_became_active":"2024-06-06T03:22:34.302919+0000","last_became_peered":"2024-06-06T03:22:34.302919+0000","last_unstale":"2024-06-06T03:25:13.364965+0000","last_undegraded":"2024-06-06T03:25:13.364965+0000","last_fullsized":"2024-06-06T03:25:13.364965+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:41:44.128543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.356298+0000","last_change":"2024-06-06T03:22:34.304801+0000","last_active":"2024-06-06T03:25:13.356298+0000","last_peered":"2024-06-06T03:25:13.356298+0000","last_clean":"2024-06-06T03:25:13.356298+0000","last_became_active":"2024-06-06T03:22:34.304463+0000","last_became_peered":"2024-06-06T03:22:34.304463+0000","last_unstale":"2024-06-06T03:25:13.356298+0000","last_undegraded":"2024-06-06T03:25:13.356298+0000","last_fullsized":"2024-06-06T03:25:13.356298+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:28:22.789816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973769+0000","last_change":"2024-06-06T03:22:34.290053+0000","last_active":"2024-06-06T03:24:14.973769+0000","last_peered":"2024-06-06T03:24:14.973769+0000","last_clean":"2024-06-06T03:24:14.973769+0000","last_became_active":"2024-06-06T03:22:34.289712+0000","last_became_peered":"2024-06-06T03:22:34.289712+0000","last_unstale":"2024-06-06T03:24:14.973769+0000","last_undegraded":"2024-06-06T03:24:14.973769+0000","last_fullsized":"2024-06-06T03:24:14.973769+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:12:02.296431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973398+0000","last_change":"2024-06-06T03:22:44.421722+0000","last_active":"2024-06-06T03:24:14.973398+0000","last_peered":"2024-06-06T03:24:14.973398+0000","last_clean":"2024-06-06T03:24:14.973398+0000","last_became_active":"2024-06-06T03:22:44.421215+0000","last_became_peered":"2024-06-06T03:22:44.421215+0000","last_unstale":"2024-06-06T03:24:14.973398+0000","last_undegraded":"2024-06-06T03:24:14.973398+0000","last_fullsized":"2024-06-06T03:24:14.973398+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:22:59.749839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"97'9","reported_seq":55,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.379751+0000","last_change":"2024-06-06T03:22:31.053826+0000","last_active":"2024-06-06T03:24:15.379751+0000","last_peered":"2024-06-06T03:24:15.379751+0000","last_clean":"2024-06-06T03:24:15.379751+0000","last_became_active":"2024-06-06T03:22:31.053537+0000","last_became_peered":"2024-06-06T03:22:31.053537+0000","last_unstale":"2024-06-06T03:24:15.379751+0000","last_undegraded":"2024-06-06T03:24:15.379751+0000","last_fullsized":"2024-06-06T03:24:15.379751+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:18:52.967104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371315+0000","last_change":"2024-06-06T03:22:34.291554+0000","last_active":"2024-06-06T03:25:13.371315+0000","last_peered":"2024-06-06T03:25:13.371315+0000","last_clean":"2024-06-06T03:25:13.371315+0000","last_became_active":"2024-06-06T03:22:34.290600+0000","last_became_peered":"2024-06-06T03:22:34.290600+0000","last_unstale":"2024-06-06T03:25:13.371315+0000","last_undegraded":"2024-06-06T03:25:13.371315+0000","last_fullsized":"2024-06-06T03:25:13.371315+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:03:32.860134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163376+0000","last_change":"2024-06-06T03:22:44.424337+0000","last_active":"2024-06-06T03:24:15.163376+0000","last_peered":"2024-06-06T03:24:15.163376+0000","last_clean":"2024-06-06T03:24:15.163376+0000","last_became_active":"2024-06-06T03:22:44.423919+0000","last_became_peered":"2024-06-06T03:22:44.423919+0000","last_unstale":"2024-06-06T03:24:15.163376+0000","last_undegraded":"2024-06-06T03:24:15.163376+0000","last_fullsized":"2024-06-06T03:24:15.163376+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:34:32.801117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"97'2","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.379810+0000","last_change":"2024-06-06T03:22:31.242326+0000","last_active":"2024-06-06T03:24:15.379810+0000","last_peered":"2024-06-06T03:24:15.379810+0000","last_clean":"2024-06-06T03:24:15.379810+0000","last_became_active":"2024-06-06T03:22:31.241960+0000","last_became_peered":"2024-06-06T03:22:31.241960+0000","last_unstale":"2024-06-06T03:24:15.379810+0000","last_undegraded":"2024-06-06T03:24:15.379810+0000","last_fullsized":"2024-06-06T03:24:15.379810+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:19:57.820119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369698+0000","last_change":"2024-06-06T03:22:34.303438+0000","last_active":"2024-06-06T03:25:13.369698+0000","last_peered":"2024-06-06T03:25:13.369698+0000","last_clean":"2024-06-06T03:25:13.369698+0000","last_became_active":"2024-06-06T03:22:34.302057+0000","last_became_peered":"2024-06-06T03:22:34.302057+0000","last_unstale":"2024-06-06T03:25:13.369698+0000","last_undegraded":"2024-06-06T03:25:13.369698+0000","last_fullsized":"2024-06-06T03:25:13.369698+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:52:20.508656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163601+0000","last_change":"2024-06-06T03:22:44.424732+0000","last_active":"2024-06-06T03:24:15.163601+0000","last_peered":"2024-06-06T03:24:15.163601+0000","last_clean":"2024-06-06T03:24:15.163601+0000","last_became_active":"2024-06-06T03:22:44.423906+0000","last_became_peered":"2024-06-06T03:22:44.423906+0000","last_unstale":"2024-06-06T03:24:15.163601+0000","last_undegraded":"2024-06-06T03:24:15.163601+0000","last_fullsized":"2024-06-06T03:24:15.163601+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:45:04.344747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"97'4","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700231+0000","last_change":"2024-06-06T03:22:31.057003+0000","last_active":"2024-06-06T03:24:14.700231+0000","last_peered":"2024-06-06T03:24:14.700231+0000","last_clean":"2024-06-06T03:24:14.700231+0000","last_became_active":"2024-06-06T03:22:31.056660+0000","last_became_peered":"2024-06-06T03:22:31.056660+0000","last_unstale":"2024-06-06T03:24:14.700231+0000","last_undegraded":"2024-06-06T03:24:14.700231+0000","last_fullsized":"2024-06-06T03:24:14.700231+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:44:16.726749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.367434+0000","last_change":"2024-06-06T03:22:34.306196+0000","last_active":"2024-06-06T03:25:13.367434+0000","last_peered":"2024-06-06T03:25:13.367434+0000","last_clean":"2024-06-06T03:25:13.367434+0000","last_became_active":"2024-06-06T03:22:34.304962+0000","last_became_peered":"2024-06-06T03:22:34.304962+0000","last_unstale":"2024-06-06T03:25:13.367434+0000","last_undegraded":"2024-06-06T03:25:13.367434+0000","last_fullsized":"2024-06-06T03:25:13.367434+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:25:04.990371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163359+0000","last_change":"2024-06-06T03:22:44.419624+0000","last_active":"2024-06-06T03:24:15.163359+0000","last_peered":"2024-06-06T03:24:15.163359+0000","last_clean":"2024-06-06T03:24:15.163359+0000","last_became_active":"2024-06-06T03:22:44.418713+0000","last_became_peered":"2024-06-06T03:22:44.418713+0000","last_unstale":"2024-06-06T03:24:15.163359+0000","last_undegraded":"2024-06-06T03:24:15.163359+0000","last_fullsized":"2024-06-06T03:24:15.163359+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:04:54.010364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'2","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700029+0000","last_change":"2024-06-06T03:22:31.059332+0000","last_active":"2024-06-06T03:24:14.700029+0000","last_peered":"2024-06-06T03:24:14.700029+0000","last_clean":"2024-06-06T03:24:14.700029+0000","last_became_active":"2024-06-06T03:22:31.058478+0000","last_became_peered":"2024-06-06T03:22:31.058478+0000","last_unstale":"2024-06-06T03:24:14.700029+0000","last_undegraded":"2024-06-06T03:24:14.700029+0000","last_fullsized":"2024-06-06T03:24:14.700029+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:24:46.452708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"99'15","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.373335+0000","last_change":"2024-06-06T03:22:34.301650+0000","last_active":"2024-06-06T03:25:13.373335+0000","last_peered":"2024-06-06T03:25:13.373335+0000","last_clean":"2024-06-06T03:25:13.373335+0000","last_became_active":"2024-06-06T03:22:34.301220+0000","last_became_peered":"2024-06-06T03:22:34.301220+0000","last_unstale":"2024-06-06T03:25:13.373335+0000","last_undegraded":"2024-06-06T03:25:13.373335+0000","last_fullsized":"2024-06-06T03:25:13.373335+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:43:07.396971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973501+0000","last_change":"2024-06-06T03:22:44.413406+0000","last_active":"2024-06-06T03:24:14.973501+0000","last_peered":"2024-06-06T03:24:14.973501+0000","last_clean":"2024-06-06T03:24:14.973501+0000","last_became_active":"2024-06-06T03:22:44.412977+0000","last_became_peered":"2024-06-06T03:22:44.412977+0000","last_unstale":"2024-06-06T03:24:14.973501+0000","last_undegraded":"2024-06-06T03:24:14.973501+0000","last_fullsized":"2024-06-06T03:24:14.973501+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:11:02.017352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"97'5","reported_seq":150,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:11.752558+0000","last_change":"2024-06-06T03:22:31.056091+0000","last_active":"2024-06-06T03:25:11.752558+0000","last_peered":"2024-06-06T03:25:11.752558+0000","last_clean":"2024-06-06T03:25:11.752558+0000","last_became_active":"2024-06-06T03:22:31.055184+0000","last_became_peered":"2024-06-06T03:22:31.055184+0000","last_unstale":"2024-06-06T03:25:11.752558+0000","last_undegraded":"2024-06-06T03:25:11.752558+0000","last_fullsized":"2024-06-06T03:25:11.752558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:32:37.761082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.357597+0000","last_change":"2024-06-06T03:22:34.305386+0000","last_active":"2024-06-06T03:25:13.357597+0000","last_peered":"2024-06-06T03:25:13.357597+0000","last_clean":"2024-06-06T03:25:13.357597+0000","last_became_active":"2024-06-06T03:22:34.304505+0000","last_became_peered":"2024-06-06T03:22:34.304505+0000","last_unstale":"2024-06-06T03:25:13.357597+0000","last_undegraded":"2024-06-06T03:25:13.357597+0000","last_fullsized":"2024-06-06T03:25:13.357597+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:34:31.800443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":35,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973587+0000","last_change":"2024-06-06T03:23:15.075519+0000","last_active":"2024-06-06T03:24:14.973587+0000","last_peered":"2024-06-06T03:24:14.973587+0000","last_clean":"2024-06-06T03:24:14.973587+0000","last_became_active":"2024-06-06T03:23:15.074970+0000","last_became_peered":"2024-06-06T03:23:15.074970+0000","last_unstale":"2024-06-06T03:24:14.973587+0000","last_undegraded":"2024-06-06T03:24:14.973587+0000","last_fullsized":"2024-06-06T03:24:14.973587+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:39:25.915175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.895888+0000","last_change":"2024-06-06T03:22:31.058530+0000","last_active":"2024-06-06T03:24:14.895888+0000","last_peered":"2024-06-06T03:24:14.895888+0000","last_clean":"2024-06-06T03:24:14.895888+0000","last_became_active":"2024-06-06T03:22:31.058185+0000","last_became_peered":"2024-06-06T03:22:31.058185+0000","last_unstale":"2024-06-06T03:24:14.895888+0000","last_undegraded":"2024-06-06T03:24:14.895888+0000","last_fullsized":"2024-06-06T03:24:14.895888+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:28:59.023322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.372958+0000","last_change":"2024-06-06T03:22:34.292995+0000","last_active":"2024-06-06T03:25:13.372958+0000","last_peered":"2024-06-06T03:25:13.372958+0000","last_clean":"2024-06-06T03:25:13.372958+0000","last_became_active":"2024-06-06T03:22:34.292625+0000","last_became_peered":"2024-06-06T03:22:34.292625+0000","last_unstale":"2024-06-06T03:25:13.372958+0000","last_undegraded":"2024-06-06T03:25:13.372958+0000","last_fullsized":"2024-06-06T03:25:13.372958+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:03:18.985660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380827+0000","last_change":"2024-06-06T03:22:44.417395+0000","last_active":"2024-06-06T03:24:15.380827+0000","last_peered":"2024-06-06T03:24:15.380827+0000","last_clean":"2024-06-06T03:24:15.380827+0000","last_became_active":"2024-06-06T03:22:44.416929+0000","last_became_peered":"2024-06-06T03:22:44.416929+0000","last_unstale":"2024-06-06T03:24:15.380827+0000","last_undegraded":"2024-06-06T03:24:15.380827+0000","last_fullsized":"2024-06-06T03:24:15.380827+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:28:09.548691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700631+0000","last_change":"2024-06-06T03:22:31.051163+0000","last_active":"2024-06-06T03:24:14.700631+0000","last_peered":"2024-06-06T03:24:14.700631+0000","last_clean":"2024-06-06T03:24:14.700631+0000","last_became_active":"2024-06-06T03:22:31.050800+0000","last_became_peered":"2024-06-06T03:22:31.050800+0000","last_unstale":"2024-06-06T03:24:14.700631+0000","last_undegraded":"2024-06-06T03:24:14.700631+0000","last_fullsized":"2024-06-06T03:24:14.700631+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:13:40.197723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.372748+0000","last_change":"2024-06-06T03:22:34.293586+0000","last_active":"2024-06-06T03:25:13.372748+0000","last_peered":"2024-06-06T03:25:13.372748+0000","last_clean":"2024-06-06T03:25:13.372748+0000","last_became_active":"2024-06-06T03:22:34.292651+0000","last_became_peered":"2024-06-06T03:22:34.292651+0000","last_unstale":"2024-06-06T03:25:13.372748+0000","last_undegraded":"2024-06-06T03:25:13.372748+0000","last_fullsized":"2024-06-06T03:25:13.372748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:11:16.221948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.698917+0000","last_change":"2024-06-06T03:22:44.415005+0000","last_active":"2024-06-06T03:24:14.698917+0000","last_peered":"2024-06-06T03:24:14.698917+0000","last_clean":"2024-06-06T03:24:14.698917+0000","last_became_active":"2024-06-06T03:22:44.414522+0000","last_became_peered":"2024-06-06T03:22:44.414522+0000","last_unstale":"2024-06-06T03:24:14.698917+0000","last_undegraded":"2024-06-06T03:24:14.698917+0000","last_fullsized":"2024-06-06T03:24:14.698917+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:36:03.240089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"97'1","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.370600+0000","last_change":"2024-06-06T03:22:31.056068+0000","last_active":"2024-06-06T03:24:15.370600+0000","last_peered":"2024-06-06T03:24:15.370600+0000","last_clean":"2024-06-06T03:24:15.370600+0000","last_became_active":"2024-06-06T03:22:31.055628+0000","last_became_peered":"2024-06-06T03:22:31.055628+0000","last_unstale":"2024-06-06T03:24:15.370600+0000","last_undegraded":"2024-06-06T03:24:15.370600+0000","last_fullsized":"2024-06-06T03:24:15.370600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:40:37.491491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.366436+0000","last_change":"2024-06-06T03:22:34.300945+0000","last_active":"2024-06-06T03:25:13.366436+0000","last_peered":"2024-06-06T03:25:13.366436+0000","last_clean":"2024-06-06T03:25:13.366436+0000","last_became_active":"2024-06-06T03:22:34.300618+0000","last_became_peered":"2024-06-06T03:22:34.300618+0000","last_unstale":"2024-06-06T03:25:13.366436+0000","last_undegraded":"2024-06-06T03:25:13.366436+0000","last_fullsized":"2024-06-06T03:25:13.366436+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:32:39.875148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380716+0000","last_change":"2024-06-06T03:22:44.417759+0000","last_active":"2024-06-06T03:24:15.380716+0000","last_peered":"2024-06-06T03:24:15.380716+0000","last_clean":"2024-06-06T03:24:15.380716+0000","last_became_active":"2024-06-06T03:22:44.417335+0000","last_became_peered":"2024-06-06T03:22:44.417335+0000","last_unstale":"2024-06-06T03:24:15.380716+0000","last_undegraded":"2024-06-06T03:24:15.380716+0000","last_fullsized":"2024-06-06T03:24:15.380716+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:43:24.408740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"97'3","reported_seq":147,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:12.753242+0000","last_change":"2024-06-06T03:22:31.054351+0000","last_active":"2024-06-06T03:25:12.753242+0000","last_peered":"2024-06-06T03:25:12.753242+0000","last_clean":"2024-06-06T03:25:12.753242+0000","last_became_active":"2024-06-06T03:22:31.053954+0000","last_became_peered":"2024-06-06T03:22:31.053954+0000","last_unstale":"2024-06-06T03:25:12.753242+0000","last_undegraded":"2024-06-06T03:25:12.753242+0000","last_fullsized":"2024-06-06T03:25:12.753242+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:22:46.405507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.367722+0000","last_change":"2024-06-06T03:22:34.303208+0000","last_active":"2024-06-06T03:25:13.367722+0000","last_peered":"2024-06-06T03:25:13.367722+0000","last_clean":"2024-06-06T03:25:13.367722+0000","last_became_active":"2024-06-06T03:22:34.302882+0000","last_became_peered":"2024-06-06T03:22:34.302882+0000","last_unstale":"2024-06-06T03:25:13.367722+0000","last_undegraded":"2024-06-06T03:25:13.367722+0000","last_fullsized":"2024-06-06T03:25:13.367722+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:01:36.963056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380041+0000","last_change":"2024-06-06T03:22:44.418095+0000","last_active":"2024-06-06T03:24:15.380041+0000","last_peered":"2024-06-06T03:24:15.380041+0000","last_clean":"2024-06-06T03:24:15.380041+0000","last_became_active":"2024-06-06T03:22:44.417625+0000","last_became_peered":"2024-06-06T03:22:44.417625+0000","last_unstale":"2024-06-06T03:24:15.380041+0000","last_undegraded":"2024-06-06T03:24:15.380041+0000","last_fullsized":"2024-06-06T03:24:15.380041+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:20:53.859638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.701041+0000","last_change":"2024-06-06T03:22:31.057558+0000","last_active":"2024-06-06T03:24:14.701041+0000","last_peered":"2024-06-06T03:24:14.701041+0000","last_clean":"2024-06-06T03:24:14.701041+0000","last_became_active":"2024-06-06T03:22:31.057168+0000","last_became_peered":"2024-06-06T03:22:31.057168+0000","last_unstale":"2024-06-06T03:24:14.701041+0000","last_undegraded":"2024-06-06T03:24:14.701041+0000","last_fullsized":"2024-06-06T03:24:14.701041+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:33:59.019923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.373648+0000","last_change":"2024-06-06T03:22:34.299220+0000","last_active":"2024-06-06T03:25:13.373648+0000","last_peered":"2024-06-06T03:25:13.373648+0000","last_clean":"2024-06-06T03:25:13.373648+0000","last_became_active":"2024-06-06T03:22:34.298873+0000","last_became_peered":"2024-06-06T03:22:34.298873+0000","last_unstale":"2024-06-06T03:25:13.373648+0000","last_undegraded":"2024-06-06T03:25:13.373648+0000","last_fullsized":"2024-06-06T03:25:13.373648+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:31:53.501036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163660+0000","last_change":"2024-06-06T03:22:44.424792+0000","last_active":"2024-06-06T03:24:15.163660+0000","last_peered":"2024-06-06T03:24:15.163660+0000","last_clean":"2024-06-06T03:24:15.163660+0000","last_became_active":"2024-06-06T03:22:44.423973+0000","last_became_peered":"2024-06-06T03:22:44.423973+0000","last_unstale":"2024-06-06T03:24:15.163660+0000","last_undegraded":"2024-06-06T03:24:15.163660+0000","last_fullsized":"2024-06-06T03:24:15.163660+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:46:51.232764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"97'4","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.370511+0000","last_change":"2024-06-06T03:22:31.243885+0000","last_active":"2024-06-06T03:24:15.370511+0000","last_peered":"2024-06-06T03:24:15.370511+0000","last_clean":"2024-06-06T03:24:15.370511+0000","last_became_active":"2024-06-06T03:22:31.243367+0000","last_became_peered":"2024-06-06T03:22:31.243367+0000","last_unstale":"2024-06-06T03:24:15.370511+0000","last_undegraded":"2024-06-06T03:24:15.370511+0000","last_fullsized":"2024-06-06T03:24:15.370511+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:57:13.464974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.367835+0000","last_change":"2024-06-06T03:22:34.299247+0000","last_active":"2024-06-06T03:25:13.367835+0000","last_peered":"2024-06-06T03:25:13.367835+0000","last_clean":"2024-06-06T03:25:13.367835+0000","last_became_active":"2024-06-06T03:22:34.298538+0000","last_became_peered":"2024-06-06T03:22:34.298538+0000","last_unstale":"2024-06-06T03:25:13.367835+0000","last_undegraded":"2024-06-06T03:25:13.367835+0000","last_fullsized":"2024-06-06T03:25:13.367835+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:53:16.724575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380294+0000","last_change":"2024-06-06T03:22:44.423817+0000","last_active":"2024-06-06T03:24:15.380294+0000","last_peered":"2024-06-06T03:24:15.380294+0000","last_clean":"2024-06-06T03:24:15.380294+0000","last_became_active":"2024-06-06T03:22:44.423333+0000","last_became_peered":"2024-06-06T03:22:44.423333+0000","last_unstale":"2024-06-06T03:24:15.380294+0000","last_undegraded":"2024-06-06T03:24:15.380294+0000","last_fullsized":"2024-06-06T03:24:15.380294+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:22:46.174850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"99'36","reported_seq":289,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.755271+0000","last_change":"2024-06-06T03:22:31.056446+0000","last_active":"2024-06-06T03:25:13.755271+0000","last_peered":"2024-06-06T03:25:13.755271+0000","last_clean":"2024-06-06T03:25:13.755271+0000","last_became_active":"2024-06-06T03:22:31.056089+0000","last_became_peered":"2024-06-06T03:22:31.056089+0000","last_unstale":"2024-06-06T03:25:13.755271+0000","last_undegraded":"2024-06-06T03:25:13.755271+0000","last_fullsized":"2024-06-06T03:25:13.755271+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:11:37.705889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62319,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":208,"num_read_kb":165,"num_write":37,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.346439+0000","last_change":"2024-06-06T03:22:34.302229+0000","last_active":"2024-06-06T03:25:13.346439+0000","last_peered":"2024-06-06T03:25:13.346439+0000","last_clean":"2024-06-06T03:25:13.346439+0000","last_became_active":"2024-06-06T03:22:34.301877+0000","last_became_peered":"2024-06-06T03:22:34.301877+0000","last_unstale":"2024-06-06T03:25:13.346439+0000","last_undegraded":"2024-06-06T03:25:13.346439+0000","last_fullsized":"2024-06-06T03:25:13.346439+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:19:22.545435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.371635+0000","last_change":"2024-06-06T03:22:44.421024+0000","last_active":"2024-06-06T03:24:15.371635+0000","last_peered":"2024-06-06T03:24:15.371635+0000","last_clean":"2024-06-06T03:24:15.371635+0000","last_became_active":"2024-06-06T03:22:44.420502+0000","last_became_peered":"2024-06-06T03:22:44.420502+0000","last_unstale":"2024-06-06T03:24:15.371635+0000","last_undegraded":"2024-06-06T03:24:15.371635+0000","last_fullsized":"2024-06-06T03:24:15.371635+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:15:55.246032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"97'6","reported_seq":51,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973641+0000","last_change":"2024-06-06T03:22:31.054128+0000","last_active":"2024-06-06T03:24:14.973641+0000","last_peered":"2024-06-06T03:24:14.973641+0000","last_clean":"2024-06-06T03:24:14.973641+0000","last_became_active":"2024-06-06T03:22:31.053740+0000","last_became_peered":"2024-06-06T03:22:31.053740+0000","last_unstale":"2024-06-06T03:24:14.973641+0000","last_undegraded":"2024-06-06T03:24:14.973641+0000","last_fullsized":"2024-06-06T03:24:14.973641+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:12:21.494702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.368206+0000","last_change":"2024-06-06T03:22:34.297861+0000","last_active":"2024-06-06T03:25:13.368206+0000","last_peered":"2024-06-06T03:25:13.368206+0000","last_clean":"2024-06-06T03:25:13.368206+0000","last_became_active":"2024-06-06T03:22:34.297391+0000","last_became_peered":"2024-06-06T03:22:34.297391+0000","last_unstale":"2024-06-06T03:25:13.368206+0000","last_undegraded":"2024-06-06T03:25:13.368206+0000","last_fullsized":"2024-06-06T03:25:13.368206+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:10:33.973635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380551+0000","last_change":"2024-06-06T03:22:44.416087+0000","last_active":"2024-06-06T03:24:15.380551+0000","last_peered":"2024-06-06T03:24:15.380551+0000","last_clean":"2024-06-06T03:24:15.380551+0000","last_became_active":"2024-06-06T03:22:44.415646+0000","last_became_peered":"2024-06-06T03:22:44.415646+0000","last_unstale":"2024-06-06T03:24:15.380551+0000","last_undegraded":"2024-06-06T03:24:15.380551+0000","last_fullsized":"2024-06-06T03:24:15.380551+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:44:43.690830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.370474+0000","last_change":"2024-06-06T03:22:31.056814+0000","last_active":"2024-06-06T03:24:15.370474+0000","last_peered":"2024-06-06T03:24:15.370474+0000","last_clean":"2024-06-06T03:24:15.370474+0000","last_became_active":"2024-06-06T03:22:31.055183+0000","last_became_peered":"2024-06-06T03:22:31.055183+0000","last_unstale":"2024-06-06T03:24:15.370474+0000","last_undegraded":"2024-06-06T03:24:15.370474+0000","last_fullsized":"2024-06-06T03:24:15.370474+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:26:27.299068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"99'15","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371815+0000","last_change":"2024-06-06T03:22:34.311995+0000","last_active":"2024-06-06T03:25:13.371815+0000","last_peered":"2024-06-06T03:25:13.371815+0000","last_clean":"2024-06-06T03:25:13.371815+0000","last_became_active":"2024-06-06T03:22:34.311665+0000","last_became_peered":"2024-06-06T03:22:34.311665+0000","last_unstale":"2024-06-06T03:25:13.371815+0000","last_undegraded":"2024-06-06T03:25:13.371815+0000","last_fullsized":"2024-06-06T03:25:13.371815+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:53:10.539212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380693+0000","last_change":"2024-06-06T03:22:44.414170+0000","last_active":"2024-06-06T03:24:15.380693+0000","last_peered":"2024-06-06T03:24:15.380693+0000","last_clean":"2024-06-06T03:24:15.380693+0000","last_became_active":"2024-06-06T03:22:44.413635+0000","last_became_peered":"2024-06-06T03:22:44.413635+0000","last_unstale":"2024-06-06T03:24:15.380693+0000","last_undegraded":"2024-06-06T03:24:15.380693+0000","last_fullsized":"2024-06-06T03:24:15.380693+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:06:25.223810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"99'5","reported_seq":152,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.789132+0000","last_change":"2024-06-06T03:22:31.057846+0000","last_active":"2024-06-06T03:25:13.789132+0000","last_peered":"2024-06-06T03:25:13.789132+0000","last_clean":"2024-06-06T03:25:13.789132+0000","last_became_active":"2024-06-06T03:22:31.056635+0000","last_became_peered":"2024-06-06T03:22:31.056635+0000","last_unstale":"2024-06-06T03:25:13.789132+0000","last_undegraded":"2024-06-06T03:25:13.789132+0000","last_fullsized":"2024-06-06T03:25:13.789132+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:59:03.845722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.368520+0000","last_change":"2024-06-06T03:22:34.304832+0000","last_active":"2024-06-06T03:25:13.368520+0000","last_peered":"2024-06-06T03:25:13.368520+0000","last_clean":"2024-06-06T03:25:13.368520+0000","last_became_active":"2024-06-06T03:22:34.304494+0000","last_became_peered":"2024-06-06T03:22:34.304494+0000","last_unstale":"2024-06-06T03:25:13.368520+0000","last_undegraded":"2024-06-06T03:25:13.368520+0000","last_fullsized":"2024-06-06T03:25:13.368520+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:17:02.855580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.701044+0000","last_change":"2024-06-06T03:22:44.418561+0000","last_active":"2024-06-06T03:24:14.701044+0000","last_peered":"2024-06-06T03:24:14.701044+0000","last_clean":"2024-06-06T03:24:14.701044+0000","last_became_active":"2024-06-06T03:22:44.418050+0000","last_became_peered":"2024-06-06T03:22:44.418050+0000","last_unstale":"2024-06-06T03:24:14.701044+0000","last_undegraded":"2024-06-06T03:24:14.701044+0000","last_fullsized":"2024-06-06T03:24:14.701044+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:39:57.680990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"97'15","reported_seq":60,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.699578+0000","last_change":"2024-06-06T03:22:31.242981+0000","last_active":"2024-06-06T03:24:14.699578+0000","last_peered":"2024-06-06T03:24:14.699578+0000","last_clean":"2024-06-06T03:24:14.699578+0000","last_became_active":"2024-06-06T03:22:31.242448+0000","last_became_peered":"2024-06-06T03:22:31.242448+0000","last_unstale":"2024-06-06T03:24:14.699578+0000","last_undegraded":"2024-06-06T03:24:14.699578+0000","last_fullsized":"2024-06-06T03:24:14.699578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:18:25.855327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.372636+0000","last_change":"2024-06-06T03:22:34.300799+0000","last_active":"2024-06-06T03:25:13.372636+0000","last_peered":"2024-06-06T03:25:13.372636+0000","last_clean":"2024-06-06T03:25:13.372636+0000","last_became_active":"2024-06-06T03:22:34.300397+0000","last_became_peered":"2024-06-06T03:22:34.300397+0000","last_unstale":"2024-06-06T03:25:13.372636+0000","last_undegraded":"2024-06-06T03:25:13.372636+0000","last_fullsized":"2024-06-06T03:25:13.372636+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:55:31.621711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.371189+0000","last_change":"2024-06-06T03:22:44.418341+0000","last_active":"2024-06-06T03:24:15.371189+0000","last_peered":"2024-06-06T03:24:15.371189+0000","last_clean":"2024-06-06T03:24:15.371189+0000","last_became_active":"2024-06-06T03:22:44.417881+0000","last_became_peered":"2024-06-06T03:22:44.417881+0000","last_unstale":"2024-06-06T03:24:15.371189+0000","last_undegraded":"2024-06-06T03:24:15.371189+0000","last_fullsized":"2024-06-06T03:24:15.371189+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:43:13.869298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700063+0000","last_change":"2024-06-06T03:22:31.054749+0000","last_active":"2024-06-06T03:24:14.700063+0000","last_peered":"2024-06-06T03:24:14.700063+0000","last_clean":"2024-06-06T03:24:14.700063+0000","last_became_active":"2024-06-06T03:22:31.054180+0000","last_became_peered":"2024-06-06T03:22:31.054180+0000","last_unstale":"2024-06-06T03:24:14.700063+0000","last_undegraded":"2024-06-06T03:24:14.700063+0000","last_fullsized":"2024-06-06T03:24:14.700063+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:30:17.902778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371538+0000","last_change":"2024-06-06T03:22:34.299573+0000","last_active":"2024-06-06T03:25:13.371538+0000","last_peered":"2024-06-06T03:25:13.371538+0000","last_clean":"2024-06-06T03:25:13.371538+0000","last_became_active":"2024-06-06T03:22:34.299201+0000","last_became_peered":"2024-06-06T03:22:34.299201+0000","last_unstale":"2024-06-06T03:25:13.371538+0000","last_undegraded":"2024-06-06T03:25:13.371538+0000","last_fullsized":"2024-06-06T03:25:13.371538+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:02:47.043087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.699582+0000","last_change":"2024-06-06T03:22:44.409672+0000","last_active":"2024-06-06T03:24:14.699582+0000","last_peered":"2024-06-06T03:24:14.699582+0000","last_clean":"2024-06-06T03:24:14.699582+0000","last_became_active":"2024-06-06T03:22:44.409246+0000","last_became_peered":"2024-06-06T03:22:44.409246+0000","last_unstale":"2024-06-06T03:24:14.699582+0000","last_undegraded":"2024-06-06T03:24:14.699582+0000","last_fullsized":"2024-06-06T03:24:14.699582+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:44:49.481886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.379711+0000","last_change":"2024-06-06T03:22:31.243562+0000","last_active":"2024-06-06T03:24:15.379711+0000","last_peered":"2024-06-06T03:24:15.379711+0000","last_clean":"2024-06-06T03:24:15.379711+0000","last_became_active":"2024-06-06T03:22:31.243164+0000","last_became_peered":"2024-06-06T03:22:31.243164+0000","last_unstale":"2024-06-06T03:24:15.379711+0000","last_undegraded":"2024-06-06T03:24:15.379711+0000","last_fullsized":"2024-06-06T03:24:15.379711+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:04:46.877389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"99'4","reported_seq":43,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.360629+0000","last_change":"2024-06-06T03:22:34.300756+0000","last_active":"2024-06-06T03:25:13.360629+0000","last_peered":"2024-06-06T03:25:13.360629+0000","last_clean":"2024-06-06T03:25:13.360629+0000","last_became_active":"2024-06-06T03:22:34.300333+0000","last_became_peered":"2024-06-06T03:22:34.300333+0000","last_unstale":"2024-06-06T03:25:13.360629+0000","last_undegraded":"2024-06-06T03:25:13.360629+0000","last_fullsized":"2024-06-06T03:25:13.360629+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:29:37.174432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700803+0000","last_change":"2024-06-06T03:22:44.412741+0000","last_active":"2024-06-06T03:24:14.700803+0000","last_peered":"2024-06-06T03:24:14.700803+0000","last_clean":"2024-06-06T03:24:14.700803+0000","last_became_active":"2024-06-06T03:22:44.412263+0000","last_became_peered":"2024-06-06T03:22:44.412263+0000","last_unstale":"2024-06-06T03:24:14.700803+0000","last_undegraded":"2024-06-06T03:24:14.700803+0000","last_fullsized":"2024-06-06T03:24:14.700803+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:00:13.925279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"97'1","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700753+0000","last_change":"2024-06-06T03:22:31.055124+0000","last_active":"2024-06-06T03:24:14.700753+0000","last_peered":"2024-06-06T03:24:14.700753+0000","last_clean":"2024-06-06T03:24:14.700753+0000","last_became_active":"2024-06-06T03:22:31.054562+0000","last_became_peered":"2024-06-06T03:22:31.054562+0000","last_unstale":"2024-06-06T03:24:14.700753+0000","last_undegraded":"2024-06-06T03:24:14.700753+0000","last_fullsized":"2024-06-06T03:24:14.700753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:57:54.783815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.359691+0000","last_change":"2024-06-06T03:22:34.310893+0000","last_active":"2024-06-06T03:25:13.359691+0000","last_peered":"2024-06-06T03:25:13.359691+0000","last_clean":"2024-06-06T03:25:13.359691+0000","last_became_active":"2024-06-06T03:22:34.310510+0000","last_became_peered":"2024-06-06T03:22:34.310510+0000","last_unstale":"2024-06-06T03:25:13.359691+0000","last_undegraded":"2024-06-06T03:25:13.359691+0000","last_fullsized":"2024-06-06T03:25:13.359691+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:52:10.979031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":36,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.897745+0000","last_change":"2024-06-06T03:24:14.897222+0000","last_active":"2024-06-06T03:24:14.897745+0000","last_peered":"2024-06-06T03:24:14.897745+0000","last_clean":"2024-06-06T03:24:14.897745+0000","last_became_active":"2024-06-06T03:24:14.896620+0000","last_became_peered":"2024-06-06T03:24:14.896620+0000","last_unstale":"2024-06-06T03:24:14.897745+0000","last_undegraded":"2024-06-06T03:24:14.897745+0000","last_fullsized":"2024-06-06T03:24:14.897745+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:43:44.992240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8,10,0],"acting":[6,8,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371198+0000","last_change":"2024-06-06T03:22:34.294540+0000","last_active":"2024-06-06T03:25:13.371198+0000","last_peered":"2024-06-06T03:25:13.371198+0000","last_clean":"2024-06-06T03:25:13.371198+0000","last_became_active":"2024-06-06T03:22:34.294204+0000","last_became_peered":"2024-06-06T03:22:34.294204+0000","last_unstale":"2024-06-06T03:25:13.371198+0000","last_undegraded":"2024-06-06T03:25:13.371198+0000","last_fullsized":"2024-06-06T03:25:13.371198+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:16:39.386345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"99'5","reported_seq":148,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:12.786429+0000","last_change":"2024-06-06T03:22:31.242275+0000","last_active":"2024-06-06T03:25:12.786429+0000","last_peered":"2024-06-06T03:25:12.786429+0000","last_clean":"2024-06-06T03:25:12.786429+0000","last_became_active":"2024-06-06T03:22:31.241930+0000","last_became_peered":"2024-06-06T03:22:31.241930+0000","last_unstale":"2024-06-06T03:25:12.786429+0000","last_undegraded":"2024-06-06T03:25:12.786429+0000","last_fullsized":"2024-06-06T03:25:12.786429+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:46:16.407946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"97'1","reported_seq":30,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.701132+0000","last_change":"2024-06-06T03:22:44.416191+0000","last_active":"2024-06-06T03:24:14.701132+0000","last_peered":"2024-06-06T03:24:14.701132+0000","last_clean":"2024-06-06T03:24:14.701132+0000","last_became_active":"2024-06-06T03:22:44.415632+0000","last_became_peered":"2024-06-06T03:22:44.415632+0000","last_unstale":"2024-06-06T03:24:14.701132+0000","last_undegraded":"2024-06-06T03:24:14.701132+0000","last_fullsized":"2024-06-06T03:24:14.701132+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:10:48.995029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371311+0000","last_change":"2024-06-06T03:22:34.304567+0000","last_active":"2024-06-06T03:25:13.371311+0000","last_peered":"2024-06-06T03:25:13.371311+0000","last_clean":"2024-06-06T03:25:13.371311+0000","last_became_active":"2024-06-06T03:22:34.304183+0000","last_became_peered":"2024-06-06T03:22:34.304183+0000","last_unstale":"2024-06-06T03:25:13.371311+0000","last_undegraded":"2024-06-06T03:25:13.371311+0000","last_fullsized":"2024-06-06T03:25:13.371311+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:34:02.229528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"97'3","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163254+0000","last_change":"2024-06-06T03:22:31.056188+0000","last_active":"2024-06-06T03:24:15.163254+0000","last_peered":"2024-06-06T03:24:15.163254+0000","last_clean":"2024-06-06T03:24:15.163254+0000","last_became_active":"2024-06-06T03:22:31.055758+0000","last_became_peered":"2024-06-06T03:22:31.055758+0000","last_unstale":"2024-06-06T03:24:15.163254+0000","last_undegraded":"2024-06-06T03:24:15.163254+0000","last_fullsized":"2024-06-06T03:24:15.163254+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:35:51.016087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":367,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700355+0000","last_change":"2024-06-06T03:21:07.156236+0000","last_active":"2024-06-06T03:24:14.700355+0000","last_peered":"2024-06-06T03:24:14.700355+0000","last_clean":"2024-06-06T03:24:14.700355+0000","last_became_active":"2024-06-06T03:21:07.155807+0000","last_became_peered":"2024-06-06T03:21:07.155807+0000","last_unstale":"2024-06-06T03:24:14.700355+0000","last_undegraded":"2024-06-06T03:24:14.700355+0000","last_fullsized":"2024-06-06T03:24:14.700355+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:17:38.330402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:17:38.330402+0000","last_clean_scrub_stamp":"2024-06-06T03:17:38.330402+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:30:13.968755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.371740+0000","last_change":"2024-06-06T03:22:44.424693+0000","last_active":"2024-06-06T03:24:15.371740+0000","last_peered":"2024-06-06T03:24:15.371740+0000","last_clean":"2024-06-06T03:24:15.371740+0000","last_became_active":"2024-06-06T03:22:44.423607+0000","last_became_peered":"2024-06-06T03:22:44.423607+0000","last_unstale":"2024-06-06T03:24:15.371740+0000","last_undegraded":"2024-06-06T03:24:15.371740+0000","last_fullsized":"2024-06-06T03:24:15.371740+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:57:56.974785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.359317+0000","last_change":"2024-06-06T03:22:34.297940+0000","last_active":"2024-06-06T03:25:13.359317+0000","last_peered":"2024-06-06T03:25:13.359317+0000","last_clean":"2024-06-06T03:25:13.359317+0000","last_became_active":"2024-06-06T03:22:34.297597+0000","last_became_peered":"2024-06-06T03:22:34.297597+0000","last_unstale":"2024-06-06T03:25:13.359317+0000","last_undegraded":"2024-06-06T03:25:13.359317+0000","last_fullsized":"2024-06-06T03:25:13.359317+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:52:52.155070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700574+0000","last_change":"2024-06-06T03:22:31.055329+0000","last_active":"2024-06-06T03:24:14.700574+0000","last_peered":"2024-06-06T03:24:14.700574+0000","last_clean":"2024-06-06T03:24:14.700574+0000","last_became_active":"2024-06-06T03:22:31.054493+0000","last_became_peered":"2024-06-06T03:22:31.054493+0000","last_unstale":"2024-06-06T03:24:14.700574+0000","last_undegraded":"2024-06-06T03:24:14.700574+0000","last_fullsized":"2024-06-06T03:24:14.700574+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:45:32.068810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380440+0000","last_change":"2024-06-06T03:22:44.413560+0000","last_active":"2024-06-06T03:24:15.380440+0000","last_peered":"2024-06-06T03:24:15.380440+0000","last_clean":"2024-06-06T03:24:15.380440+0000","last_became_active":"2024-06-06T03:22:44.413100+0000","last_became_peered":"2024-06-06T03:22:44.413100+0000","last_unstale":"2024-06-06T03:24:15.380440+0000","last_undegraded":"2024-06-06T03:24:15.380440+0000","last_fullsized":"2024-06-06T03:24:15.380440+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:58:02.780671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"97'1","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380583+0000","last_change":"2024-06-06T03:23:14.515805+0000","last_active":"2024-06-06T03:24:15.380583+0000","last_peered":"2024-06-06T03:24:15.380583+0000","last_clean":"2024-06-06T03:24:15.380583+0000","last_became_active":"2024-06-06T03:23:14.515436+0000","last_became_peered":"2024-06-06T03:23:14.515436+0000","last_unstale":"2024-06-06T03:24:15.380583+0000","last_undegraded":"2024-06-06T03:24:15.380583+0000","last_fullsized":"2024-06-06T03:24:15.380583+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:59:16.246609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.364457+0000","last_change":"2024-06-06T03:22:34.294549+0000","last_active":"2024-06-06T03:25:13.364457+0000","last_peered":"2024-06-06T03:25:13.364457+0000","last_clean":"2024-06-06T03:25:13.364457+0000","last_became_active":"2024-06-06T03:22:34.294202+0000","last_became_peered":"2024-06-06T03:22:34.294202+0000","last_unstale":"2024-06-06T03:25:13.364457+0000","last_undegraded":"2024-06-06T03:25:13.364457+0000","last_fullsized":"2024-06-06T03:25:13.364457+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:55:59.823957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380133+0000","last_change":"2024-06-06T03:22:44.416890+0000","last_active":"2024-06-06T03:24:15.380133+0000","last_peered":"2024-06-06T03:24:15.380133+0000","last_clean":"2024-06-06T03:24:15.380133+0000","last_became_active":"2024-06-06T03:22:44.416473+0000","last_became_peered":"2024-06-06T03:22:44.416473+0000","last_unstale":"2024-06-06T03:24:15.380133+0000","last_undegraded":"2024-06-06T03:24:15.380133+0000","last_fullsized":"2024-06-06T03:24:15.380133+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:23:48.972196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"99'13","reported_seq":58,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:38.164939+0000","last_change":"2024-06-06T03:22:31.054481+0000","last_active":"2024-06-06T03:24:38.164939+0000","last_peered":"2024-06-06T03:24:38.164939+0000","last_clean":"2024-06-06T03:24:38.164939+0000","last_became_active":"2024-06-06T03:22:31.054173+0000","last_became_peered":"2024-06-06T03:22:31.054173+0000","last_unstale":"2024-06-06T03:24:38.164939+0000","last_undegraded":"2024-06-06T03:24:38.164939+0000","last_fullsized":"2024-06-06T03:24:38.164939+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:52:45.311149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.372630+0000","last_change":"2024-06-06T03:22:34.300211+0000","last_active":"2024-06-06T03:25:13.372630+0000","last_peered":"2024-06-06T03:25:13.372630+0000","last_clean":"2024-06-06T03:25:13.372630+0000","last_became_active":"2024-06-06T03:22:34.299870+0000","last_became_peered":"2024-06-06T03:22:34.299870+0000","last_unstale":"2024-06-06T03:25:13.372630+0000","last_undegraded":"2024-06-06T03:25:13.372630+0000","last_fullsized":"2024-06-06T03:25:13.372630+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:50:56.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973290+0000","last_change":"2024-06-06T03:22:44.414727+0000","last_active":"2024-06-06T03:24:14.973290+0000","last_peered":"2024-06-06T03:24:14.973290+0000","last_clean":"2024-06-06T03:24:14.973290+0000","last_became_active":"2024-06-06T03:22:44.414232+0000","last_became_peered":"2024-06-06T03:22:44.414232+0000","last_unstale":"2024-06-06T03:24:14.973290+0000","last_undegraded":"2024-06-06T03:24:14.973290+0000","last_fullsized":"2024-06-06T03:24:14.973290+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:26:21.540309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"97'4","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.164042+0000","last_change":"2024-06-06T03:22:31.178740+0000","last_active":"2024-06-06T03:24:15.164042+0000","last_peered":"2024-06-06T03:24:15.164042+0000","last_clean":"2024-06-06T03:24:15.164042+0000","last_became_active":"2024-06-06T03:22:31.178353+0000","last_became_peered":"2024-06-06T03:22:31.178353+0000","last_unstale":"2024-06-06T03:24:15.164042+0000","last_undegraded":"2024-06-06T03:24:15.164042+0000","last_fullsized":"2024-06-06T03:24:15.164042+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:56:50.159463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.368763+0000","last_change":"2024-06-06T03:22:34.298011+0000","last_active":"2024-06-06T03:25:13.368763+0000","last_peered":"2024-06-06T03:25:13.368763+0000","last_clean":"2024-06-06T03:25:13.368763+0000","last_became_active":"2024-06-06T03:22:34.297697+0000","last_became_peered":"2024-06-06T03:22:34.297697+0000","last_unstale":"2024-06-06T03:25:13.368763+0000","last_undegraded":"2024-06-06T03:25:13.368763+0000","last_fullsized":"2024-06-06T03:25:13.368763+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:01:38.606543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163829+0000","last_change":"2024-06-06T03:22:44.425675+0000","last_active":"2024-06-06T03:24:15.163829+0000","last_peered":"2024-06-06T03:24:15.163829+0000","last_clean":"2024-06-06T03:24:15.163829+0000","last_became_active":"2024-06-06T03:22:44.424023+0000","last_became_peered":"2024-06-06T03:22:44.424023+0000","last_unstale":"2024-06-06T03:24:15.163829+0000","last_undegraded":"2024-06-06T03:24:15.163829+0000","last_fullsized":"2024-06-06T03:24:15.163829+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:47:48.718771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"97'2","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.379742+0000","last_change":"2024-06-06T03:22:31.242360+0000","last_active":"2024-06-06T03:24:15.379742+0000","last_peered":"2024-06-06T03:24:15.379742+0000","last_clean":"2024-06-06T03:24:15.379742+0000","last_became_active":"2024-06-06T03:22:31.242015+0000","last_became_peered":"2024-06-06T03:22:31.242015+0000","last_unstale":"2024-06-06T03:24:15.379742+0000","last_undegraded":"2024-06-06T03:24:15.379742+0000","last_fullsized":"2024-06-06T03:24:15.379742+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:14:30.674106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"99'2","reported_seq":41,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.326018+0000","last_change":"2024-06-06T03:22:34.302980+0000","last_active":"2024-06-06T03:25:13.326018+0000","last_peered":"2024-06-06T03:25:13.326018+0000","last_clean":"2024-06-06T03:25:13.326018+0000","last_became_active":"2024-06-06T03:22:34.302625+0000","last_became_peered":"2024-06-06T03:22:34.302625+0000","last_unstale":"2024-06-06T03:25:13.326018+0000","last_undegraded":"2024-06-06T03:25:13.326018+0000","last_fullsized":"2024-06-06T03:25:13.326018+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:13:01.603365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380862+0000","last_change":"2024-06-06T03:22:44.423741+0000","last_active":"2024-06-06T03:24:15.380862+0000","last_peered":"2024-06-06T03:24:15.380862+0000","last_clean":"2024-06-06T03:24:15.380862+0000","last_became_active":"2024-06-06T03:22:44.423266+0000","last_became_peered":"2024-06-06T03:22:44.423266+0000","last_unstale":"2024-06-06T03:24:15.380862+0000","last_undegraded":"2024-06-06T03:24:15.380862+0000","last_fullsized":"2024-06-06T03:24:15.380862+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:09:19.324145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"97'3","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.379798+0000","last_change":"2024-06-06T03:22:31.052988+0000","last_active":"2024-06-06T03:24:15.379798+0000","last_peered":"2024-06-06T03:24:15.379798+0000","last_clean":"2024-06-06T03:24:15.379798+0000","last_became_active":"2024-06-06T03:22:31.052743+0000","last_became_peered":"2024-06-06T03:22:31.052743+0000","last_unstale":"2024-06-06T03:24:15.379798+0000","last_undegraded":"2024-06-06T03:24:15.379798+0000","last_fullsized":"2024-06-06T03:24:15.379798+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:31:45.176416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.365872+0000","last_change":"2024-06-06T03:22:34.299991+0000","last_active":"2024-06-06T03:25:13.365872+0000","last_peered":"2024-06-06T03:25:13.365872+0000","last_clean":"2024-06-06T03:25:13.365872+0000","last_became_active":"2024-06-06T03:22:34.299659+0000","last_became_peered":"2024-06-06T03:22:34.299659+0000","last_unstale":"2024-06-06T03:25:13.365872+0000","last_undegraded":"2024-06-06T03:25:13.365872+0000","last_fullsized":"2024-06-06T03:25:13.365872+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:16:51.492749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"97'1","reported_seq":37,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163786+0000","last_change":"2024-06-06T03:23:15.027541+0000","last_active":"2024-06-06T03:24:15.163786+0000","last_peered":"2024-06-06T03:24:15.163786+0000","last_clean":"2024-06-06T03:24:15.163786+0000","last_became_active":"2024-06-06T03:23:15.026931+0000","last_became_peered":"2024-06-06T03:23:15.026931+0000","last_unstale":"2024-06-06T03:24:15.163786+0000","last_undegraded":"2024-06-06T03:24:15.163786+0000","last_fullsized":"2024-06-06T03:24:15.163786+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:47:44.197067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"97'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380367+0000","last_change":"2024-06-06T03:23:14.831383+0000","last_active":"2024-06-06T03:24:15.380367+0000","last_peered":"2024-06-06T03:24:15.380367+0000","last_clean":"2024-06-06T03:24:15.380367+0000","last_became_active":"2024-06-06T03:23:14.830948+0000","last_became_peered":"2024-06-06T03:23:14.830948+0000","last_unstale":"2024-06-06T03:24:15.380367+0000","last_undegraded":"2024-06-06T03:24:15.380367+0000","last_fullsized":"2024-06-06T03:24:15.380367+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:58:00.326112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.370110+0000","last_change":"2024-06-06T03:22:34.301842+0000","last_active":"2024-06-06T03:25:13.370110+0000","last_peered":"2024-06-06T03:25:13.370110+0000","last_clean":"2024-06-06T03:25:13.370110+0000","last_became_active":"2024-06-06T03:22:34.301513+0000","last_became_peered":"2024-06-06T03:22:34.301513+0000","last_unstale":"2024-06-06T03:25:13.370110+0000","last_undegraded":"2024-06-06T03:25:13.370110+0000","last_fullsized":"2024-06-06T03:25:13.370110+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:30:03.813861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163817+0000","last_change":"2024-06-06T03:22:44.419621+0000","last_active":"2024-06-06T03:24:15.163817+0000","last_peered":"2024-06-06T03:24:15.163817+0000","last_clean":"2024-06-06T03:24:15.163817+0000","last_became_active":"2024-06-06T03:22:44.419065+0000","last_became_peered":"2024-06-06T03:22:44.419065+0000","last_unstale":"2024-06-06T03:24:15.163817+0000","last_undegraded":"2024-06-06T03:24:15.163817+0000","last_fullsized":"2024-06-06T03:24:15.163817+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:10:49.762284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"97'4","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.699776+0000","last_change":"2024-06-06T03:22:31.056409+0000","last_active":"2024-06-06T03:24:14.699776+0000","last_peered":"2024-06-06T03:24:14.699776+0000","last_clean":"2024-06-06T03:24:14.699776+0000","last_became_active":"2024-06-06T03:22:31.055994+0000","last_became_peered":"2024-06-06T03:22:31.055994+0000","last_unstale":"2024-06-06T03:24:14.699776+0000","last_undegraded":"2024-06-06T03:24:14.699776+0000","last_fullsized":"2024-06-06T03:24:14.699776+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:09:00.784820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371522+0000","last_change":"2024-06-06T03:22:34.302238+0000","last_active":"2024-06-06T03:25:13.371522+0000","last_peered":"2024-06-06T03:25:13.371522+0000","last_clean":"2024-06-06T03:25:13.371522+0000","last_became_active":"2024-06-06T03:22:34.301869+0000","last_became_peered":"2024-06-06T03:22:34.301869+0000","last_unstale":"2024-06-06T03:25:13.371522+0000","last_undegraded":"2024-06-06T03:25:13.371522+0000","last_fullsized":"2024-06-06T03:25:13.371522+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:17:08.350692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380233+0000","last_change":"2024-06-06T03:22:44.414052+0000","last_active":"2024-06-06T03:24:15.380233+0000","last_peered":"2024-06-06T03:24:15.380233+0000","last_clean":"2024-06-06T03:24:15.380233+0000","last_became_active":"2024-06-06T03:22:44.413633+0000","last_became_peered":"2024-06-06T03:22:44.413633+0000","last_unstale":"2024-06-06T03:24:15.380233+0000","last_undegraded":"2024-06-06T03:24:15.380233+0000","last_fullsized":"2024-06-06T03:24:15.380233+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:41:16.942699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973931+0000","last_change":"2024-06-06T03:22:31.243570+0000","last_active":"2024-06-06T03:24:14.973931+0000","last_peered":"2024-06-06T03:24:14.973931+0000","last_clean":"2024-06-06T03:24:14.973931+0000","last_became_active":"2024-06-06T03:22:31.243194+0000","last_became_peered":"2024-06-06T03:22:31.243194+0000","last_unstale":"2024-06-06T03:24:14.973931+0000","last_undegraded":"2024-06-06T03:24:14.973931+0000","last_fullsized":"2024-06-06T03:24:14.973931+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:21:22.233139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.370634+0000","last_change":"2024-06-06T03:22:34.301665+0000","last_active":"2024-06-06T03:25:13.370634+0000","last_peered":"2024-06-06T03:25:13.370634+0000","last_clean":"2024-06-06T03:25:13.370634+0000","last_became_active":"2024-06-06T03:22:34.300967+0000","last_became_peered":"2024-06-06T03:22:34.300967+0000","last_unstale":"2024-06-06T03:25:13.370634+0000","last_undegraded":"2024-06-06T03:25:13.370634+0000","last_fullsized":"2024-06-06T03:25:13.370634+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:57:58.905488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":36,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.698608+0000","last_change":"2024-06-06T03:23:14.833267+0000","last_active":"2024-06-06T03:24:14.698608+0000","last_peered":"2024-06-06T03:24:14.698608+0000","last_clean":"2024-06-06T03:24:14.698608+0000","last_became_active":"2024-06-06T03:23:14.832760+0000","last_became_peered":"2024-06-06T03:23:14.832760+0000","last_unstale":"2024-06-06T03:24:14.698608+0000","last_undegraded":"2024-06-06T03:24:14.698608+0000","last_fullsized":"2024-06-06T03:24:14.698608+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:24:32.668781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'1","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.370535+0000","last_change":"2024-06-06T03:22:31.054686+0000","last_active":"2024-06-06T03:24:15.370535+0000","last_peered":"2024-06-06T03:24:15.370535+0000","last_clean":"2024-06-06T03:24:15.370535+0000","last_became_active":"2024-06-06T03:22:31.053219+0000","last_became_peered":"2024-06-06T03:22:31.053219+0000","last_unstale":"2024-06-06T03:24:15.370535+0000","last_undegraded":"2024-06-06T03:24:15.370535+0000","last_fullsized":"2024-06-06T03:24:15.370535+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:32:27.423208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.368737+0000","last_change":"2024-06-06T03:22:34.304916+0000","last_active":"2024-06-06T03:25:13.368737+0000","last_peered":"2024-06-06T03:25:13.368737+0000","last_clean":"2024-06-06T03:25:13.368737+0000","last_became_active":"2024-06-06T03:22:34.302442+0000","last_became_peered":"2024-06-06T03:22:34.302442+0000","last_unstale":"2024-06-06T03:25:13.368737+0000","last_undegraded":"2024-06-06T03:25:13.368737+0000","last_fullsized":"2024-06-06T03:25:13.368737+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:01:24.034386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.370747+0000","last_change":"2024-06-06T03:22:44.415478+0000","last_active":"2024-06-06T03:24:15.370747+0000","last_peered":"2024-06-06T03:24:15.370747+0000","last_clean":"2024-06-06T03:24:15.370747+0000","last_became_active":"2024-06-06T03:22:44.415007+0000","last_became_peered":"2024-06-06T03:22:44.415007+0000","last_unstale":"2024-06-06T03:24:15.370747+0000","last_undegraded":"2024-06-06T03:24:15.370747+0000","last_fullsized":"2024-06-06T03:24:15.370747+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:57:47.793481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'2","reported_seq":57,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700897+0000","last_change":"2024-06-06T03:23:14.521037+0000","last_active":"2024-06-06T03:24:14.700897+0000","last_peered":"2024-06-06T03:24:14.700897+0000","last_clean":"2024-06-06T03:24:14.700897+0000","last_became_active":"2024-06-06T03:23:14.517922+0000","last_became_peered":"2024-06-06T03:23:14.517922+0000","last_unstale":"2024-06-06T03:24:14.700897+0000","last_undegraded":"2024-06-06T03:24:14.700897+0000","last_fullsized":"2024-06-06T03:24:14.700897+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:12:46.222984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.370655+0000","last_change":"2024-06-06T03:22:34.305178+0000","last_active":"2024-06-06T03:25:13.370655+0000","last_peered":"2024-06-06T03:25:13.370655+0000","last_clean":"2024-06-06T03:25:13.370655+0000","last_became_active":"2024-06-06T03:22:34.302420+0000","last_became_peered":"2024-06-06T03:22:34.302420+0000","last_unstale":"2024-06-06T03:25:13.370655+0000","last_undegraded":"2024-06-06T03:25:13.370655+0000","last_fullsized":"2024-06-06T03:25:13.370655+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:22:08.736542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"99'9","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369693+0000","last_change":"2024-06-06T03:23:14.514756+0000","last_active":"2024-06-06T03:25:13.369693+0000","last_peered":"2024-06-06T03:25:13.369693+0000","last_clean":"2024-06-06T03:25:13.369693+0000","last_became_active":"2024-06-06T03:23:14.514325+0000","last_became_peered":"2024-06-06T03:23:14.514325+0000","last_unstale":"2024-06-06T03:25:13.369693+0000","last_undegraded":"2024-06-06T03:25:13.369693+0000","last_fullsized":"2024-06-06T03:25:13.369693+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:45:44.594836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973725+0000","last_change":"2024-06-06T03:22:34.298570+0000","last_active":"2024-06-06T03:24:14.973725+0000","last_peered":"2024-06-06T03:24:14.973725+0000","last_clean":"2024-06-06T03:24:14.973725+0000","last_became_active":"2024-06-06T03:22:34.298137+0000","last_became_peered":"2024-06-06T03:22:34.298137+0000","last_unstale":"2024-06-06T03:24:14.973725+0000","last_undegraded":"2024-06-06T03:24:14.973725+0000","last_fullsized":"2024-06-06T03:24:14.973725+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:07:25.290355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973429+0000","last_change":"2024-06-06T03:22:34.297750+0000","last_active":"2024-06-06T03:24:14.973429+0000","last_peered":"2024-06-06T03:24:14.973429+0000","last_clean":"2024-06-06T03:24:14.973429+0000","last_became_active":"2024-06-06T03:22:34.297264+0000","last_became_peered":"2024-06-06T03:22:34.297264+0000","last_unstale":"2024-06-06T03:24:14.973429+0000","last_undegraded":"2024-06-06T03:24:14.973429+0000","last_fullsized":"2024-06-06T03:24:14.973429+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:14:58.580044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"99'7","reported_seq":52,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.357808+0000","last_change":"2024-06-06T03:23:14.832804+0000","last_active":"2024-06-06T03:25:13.357808+0000","last_peered":"2024-06-06T03:25:13.357808+0000","last_clean":"2024-06-06T03:25:13.357808+0000","last_became_active":"2024-06-06T03:23:14.832448+0000","last_became_peered":"2024-06-06T03:23:14.832448+0000","last_unstale":"2024-06-06T03:25:13.357808+0000","last_undegraded":"2024-06-06T03:25:13.357808+0000","last_fullsized":"2024-06-06T03:25:13.357808+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:52:16.907033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"99'4","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.366112+0000","last_change":"2024-06-06T03:23:14.515841+0000","last_active":"2024-06-06T03:25:13.366112+0000","last_peered":"2024-06-06T03:25:13.366112+0000","last_clean":"2024-06-06T03:25:13.366112+0000","last_became_active":"2024-06-06T03:23:14.515331+0000","last_became_peered":"2024-06-06T03:23:14.515331+0000","last_unstale":"2024-06-06T03:25:13.366112+0000","last_undegraded":"2024-06-06T03:25:13.366112+0000","last_fullsized":"2024-06-06T03:25:13.366112+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:46:57.178054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371197+0000","last_change":"2024-06-06T03:22:34.299660+0000","last_active":"2024-06-06T03:25:13.371197+0000","last_peered":"2024-06-06T03:25:13.371197+0000","last_clean":"2024-06-06T03:25:13.371197+0000","last_became_active":"2024-06-06T03:22:34.298411+0000","last_became_peered":"2024-06-06T03:22:34.298411+0000","last_unstale":"2024-06-06T03:25:13.371197+0000","last_undegraded":"2024-06-06T03:25:13.371197+0000","last_fullsized":"2024-06-06T03:25:13.371197+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:29:16.170700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973842+0000","last_change":"2024-06-06T03:22:34.308110+0000","last_active":"2024-06-06T03:24:14.973842+0000","last_peered":"2024-06-06T03:24:14.973842+0000","last_clean":"2024-06-06T03:24:14.973842+0000","last_became_active":"2024-06-06T03:22:34.307637+0000","last_became_peered":"2024-06-06T03:22:34.307637+0000","last_unstale":"2024-06-06T03:24:14.973842+0000","last_undegraded":"2024-06-06T03:24:14.973842+0000","last_fullsized":"2024-06-06T03:24:14.973842+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:40:23.264509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"99'2","reported_seq":41,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.368343+0000","last_change":"2024-06-06T03:22:34.295494+0000","last_active":"2024-06-06T03:25:13.368343+0000","last_peered":"2024-06-06T03:25:13.368343+0000","last_clean":"2024-06-06T03:25:13.368343+0000","last_became_active":"2024-06-06T03:22:34.295101+0000","last_became_peered":"2024-06-06T03:22:34.295101+0000","last_unstale":"2024-06-06T03:25:13.368343+0000","last_undegraded":"2024-06-06T03:25:13.368343+0000","last_fullsized":"2024-06-06T03:25:13.368343+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:39:07.298053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.373117+0000","last_change":"2024-06-06T03:22:34.291312+0000","last_active":"2024-06-06T03:25:13.373117+0000","last_peered":"2024-06-06T03:25:13.373117+0000","last_clean":"2024-06-06T03:25:13.373117+0000","last_became_active":"2024-06-06T03:22:34.290971+0000","last_became_peered":"2024-06-06T03:22:34.290971+0000","last_unstale":"2024-06-06T03:25:13.373117+0000","last_undegraded":"2024-06-06T03:25:13.373117+0000","last_fullsized":"2024-06-06T03:25:13.373117+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:06:27.333831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.372533+0000","last_change":"2024-06-06T03:22:34.292000+0000","last_active":"2024-06-06T03:25:13.372533+0000","last_peered":"2024-06-06T03:25:13.372533+0000","last_clean":"2024-06-06T03:25:13.372533+0000","last_became_active":"2024-06-06T03:22:34.291500+0000","last_became_peered":"2024-06-06T03:22:34.291500+0000","last_unstale":"2024-06-06T03:25:13.372533+0000","last_undegraded":"2024-06-06T03:25:13.372533+0000","last_fullsized":"2024-06-06T03:25:13.372533+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:37:20.677107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369963+0000","last_change":"2024-06-06T03:22:34.303138+0000","last_active":"2024-06-06T03:25:13.369963+0000","last_peered":"2024-06-06T03:25:13.369963+0000","last_clean":"2024-06-06T03:25:13.369963+0000","last_became_active":"2024-06-06T03:22:34.302758+0000","last_became_peered":"2024-06-06T03:22:34.302758+0000","last_unstale":"2024-06-06T03:25:13.369963+0000","last_undegraded":"2024-06-06T03:25:13.369963+0000","last_fullsized":"2024-06-06T03:25:13.369963+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:34:18.516891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371585+0000","last_change":"2024-06-06T03:22:34.297035+0000","last_active":"2024-06-06T03:25:13.371585+0000","last_peered":"2024-06-06T03:25:13.371585+0000","last_clean":"2024-06-06T03:25:13.371585+0000","last_became_active":"2024-06-06T03:22:34.296706+0000","last_became_peered":"2024-06-06T03:22:34.296706+0000","last_unstale":"2024-06-06T03:25:13.371585+0000","last_undegraded":"2024-06-06T03:25:13.371585+0000","last_fullsized":"2024-06-06T03:25:13.371585+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:26:26.959215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371786+0000","last_change":"2024-06-06T03:22:34.296365+0000","last_active":"2024-06-06T03:25:13.371786+0000","last_peered":"2024-06-06T03:25:13.371786+0000","last_clean":"2024-06-06T03:25:13.371786+0000","last_became_active":"2024-06-06T03:22:34.296021+0000","last_became_peered":"2024-06-06T03:22:34.296021+0000","last_unstale":"2024-06-06T03:25:13.371786+0000","last_undegraded":"2024-06-06T03:25:13.371786+0000","last_fullsized":"2024-06-06T03:25:13.371786+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:40:33.183110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":458,"ondisk_log_size":458,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":249510,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66460,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":622,"num_read_kb":382,"num_write":177,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":199131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383729,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32248,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712904,"statfs":{"total":95995035648,"available":95962013696,"internally_reserved":0,"allocated":1097728,"data_stored":569692,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645364,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28232,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716920,"statfs":{"total":95995035648,"available":95966126080,"internally_reserved":0,"allocated":1245184,"data_stored":1223884,"data_compressed":68620,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808891,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1110016,"data_stored":569906,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070528,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1105920,"data_stored":569804,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332165,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32308,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712844,"statfs":{"total":95995035648,"available":95961952256,"internally_reserved":0,"allocated":1159168,"data_stored":1165875,"data_compressed":68620,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495691,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1089536,"data_stored":565082,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574947,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28148,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717004,"statfs":{"total":95995035648,"available":95966212096,"internally_reserved":0,"allocated":1159168,"data_stored":627311,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738473,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36424,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708728,"statfs":{"total":95995035648,"available":95957737472,"internally_reserved":0,"allocated":1114112,"data_stored":566470,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411423,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32336,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712816,"statfs":{"total":95995035648,"available":95961923584,"internally_reserved":0,"allocated":1179648,"data_stored":628412,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182489,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1101824,"data_stored":565276,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920853,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32252,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712900,"statfs":{"total":95995035648,"available":95962009600,"internally_reserved":0,"allocated":1101824,"data_stored":570263,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757328,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32320,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712832,"statfs":{"total":95995035648,"available":95961939968,"internally_reserved":0,"allocated":1167360,"data_stored":1160932,"data_compressed":68620,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34475,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34475,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":64428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-06T03:25:19.496 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-06-06T03:25:19.496 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-06-06T03:25:19.496 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-06-06T03:25:19.496 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph health --format=json 2024-06-06T03:25:19.752 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:25:20.127 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:20 smithi050 ceph-mon[32421]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T03:25:20.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:20 smithi079 ceph-mon[35478]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T03:25:20.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:20 smithi122 ceph-mon[35759]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T03:25:21.178 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:21 smithi050 ceph-mon[32421]: pgmap v392: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 8 op/s 2024-06-06T03:25:21.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:21 smithi079 ceph-mon[35478]: pgmap v392: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 8 op/s 2024-06-06T03:25:21.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:21 smithi122 ceph-mon[35759]: pgmap v392: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 8 op/s 2024-06-06T03:25:21.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.437+0000 7f371fc57700 1 -- 172.21.15.50:0/1930271038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3718107400 msgr2=0x7f37181077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.437+0000 7f371fc57700 1 --2- 172.21.15.50:0/1930271038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3718107400 0x7f37181077e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3714009990 tx=0x7f3714009ca0 comp rx=0 tx=0).stop 2024-06-06T03:25:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.437+0000 7f371fc57700 1 -- 172.21.15.50:0/1930271038 shutdown_connections 2024-06-06T03:25:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.437+0000 7f371fc57700 1 --2- 172.21.15.50:0/1930271038 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3718101d50 0x7f371810e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.437+0000 7f371fc57700 1 --2- 172.21.15.50:0/1930271038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3718107400 0x7f37181077e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.437+0000 7f371fc57700 1 --2- 172.21.15.50:0/1930271038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3718101390 0x7f3718101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.437+0000 7f371fc57700 1 -- 172.21.15.50:0/1930271038 >> 172.21.15.50:0/1930271038 conn(0x7f3718078340 msgr2=0x7f3718078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.438+0000 7f371fc57700 1 -- 172.21.15.50:0/1930271038 shutdown_connections 2024-06-06T03:25:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.438+0000 7f371fc57700 1 -- 172.21.15.50:0/1930271038 wait complete. 2024-06-06T03:25:21.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.438+0000 7f371fc57700 1 Processor -- start 2024-06-06T03:25:21.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.438+0000 7f371fc57700 1 -- start start 2024-06-06T03:25:21.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.439+0000 7f371fc57700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3718101390 0x7f3718103070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:21.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.439+0000 7f371fc57700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3718101d50 0x7f37181035b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:21.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.439+0000 7f371fc57700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3718107400 0x7f3718103af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:21.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.439+0000 7f371fc57700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3718111550 con 0x7f3718101d50 2024-06-06T03:25:21.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.439+0000 7f371fc57700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f37181113d0 con 0x7f3718101390 2024-06-06T03:25:21.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.439+0000 7f371fc57700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f37181116d0 con 0x7f3718107400 2024-06-06T03:25:21.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.439+0000 7f371d1f2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3718101d50 0x7f37181035b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:21.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.439+0000 7f371d1f2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3718101d50 0x7f37181035b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38584/0 (socket says 172.21.15.50:38584) 2024-06-06T03:25:21.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.439+0000 7f371d1f2700 1 -- 172.21.15.50:0/2175952237 learned_addr learned my addr 172.21.15.50:0/2175952237 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:21.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.439+0000 7f371e1f4700 1 --2- 172.21.15.50:0/2175952237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3718107400 0x7f3718103af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:21.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.439+0000 7f371d9f3700 1 --2- 172.21.15.50:0/2175952237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3718101390 0x7f3718103070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:21.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.439+0000 7f371d1f2700 1 -- 172.21.15.50:0/2175952237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3718107400 msgr2=0x7f3718103af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:21.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.439+0000 7f371d1f2700 1 --2- 172.21.15.50:0/2175952237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3718107400 0x7f3718103af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:21.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.439+0000 7f371d1f2700 1 -- 172.21.15.50:0/2175952237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3718101390 msgr2=0x7f3718103070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:21.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.439+0000 7f371d1f2700 1 --2- 172.21.15.50:0/2175952237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3718101390 0x7f3718103070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:21.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.439+0000 7f371d1f2700 1 -- 172.21.15.50:0/2175952237 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37181a70b0 con 0x7f3718101d50 2024-06-06T03:25:21.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.439+0000 7f371d9f3700 1 --2- 172.21.15.50:0/2175952237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3718101390 0x7f3718103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:25:21.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.439+0000 7f371d1f2700 1 --2- 172.21.15.50:0/2175952237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3718101d50 0x7f37181035b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f370c00d980 tx=0x7f370c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:21.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.439+0000 7f370affd700 1 -- 172.21.15.50:0/2175952237 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370c016070 con 0x7f3718101d50 2024-06-06T03:25:21.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.440+0000 7f370affd700 1 -- 172.21.15.50:0/2175952237 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f370c004830 con 0x7f3718101d50 2024-06-06T03:25:21.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.440+0000 7f371fc57700 1 -- 172.21.15.50:0/2175952237 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37181a73a0 con 0x7f3718101d50 2024-06-06T03:25:21.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.440+0000 7f370affd700 1 -- 172.21.15.50:0/2175952237 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370c0054b0 con 0x7f3718101d50 2024-06-06T03:25:21.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.440+0000 7f371fc57700 1 -- 172.21.15.50:0/2175952237 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37181a7930 con 0x7f3718101d50 2024-06-06T03:25:21.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.441+0000 7f371fc57700 1 -- 172.21.15.50:0/2175952237 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3718069180 con 0x7f3718101d50 2024-06-06T03:25:21.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.442+0000 7f370affd700 1 -- 172.21.15.50:0/2175952237 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f370c0049e0 con 0x7f3718101d50 2024-06-06T03:25:21.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.443+0000 7f370affd700 1 --2- 172.21.15.50:0/2175952237 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f37040a2ca0 0x7f37040a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:21.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.443+0000 7f371d9f3700 1 --2- 172.21.15.50:0/2175952237 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f37040a2ca0 0x7f37040a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:21.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.443+0000 7f370affd700 1 -- 172.21.15.50:0/2175952237 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f370c0cf610 con 0x7f3718101d50 2024-06-06T03:25:21.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.443+0000 7f371d9f3700 1 --2- 172.21.15.50:0/2175952237 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f37040a2ca0 0x7f37040a5160 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f371400b5c0 tx=0x7f3714005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:21.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.446+0000 7f370affd700 1 -- 172.21.15.50:0/2175952237 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f370c01f020 con 0x7f3718101d50 2024-06-06T03:25:21.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.700+0000 7f371fc57700 1 -- 172.21.15.50:0/2175952237 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3718104550 con 0x7f3718101d50 2024-06-06T03:25:21.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.700+0000 7f370affd700 1 -- 172.21.15.50:0/2175952237 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f370c09c1f0 con 0x7f3718101d50 2024-06-06T03:25:21.699 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:25:21.699 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-06-06T03:25:21.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.702+0000 7f371fc57700 1 -- 172.21.15.50:0/2175952237 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f37040a2ca0 msgr2=0x7f37040a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:21.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.702+0000 7f371fc57700 1 --2- 172.21.15.50:0/2175952237 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f37040a2ca0 0x7f37040a5160 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f371400b5c0 tx=0x7f3714005fb0 comp rx=0 tx=0).stop 2024-06-06T03:25:21.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.703+0000 7f371fc57700 1 -- 172.21.15.50:0/2175952237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3718101d50 msgr2=0x7f37181035b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:21.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.703+0000 7f371fc57700 1 --2- 172.21.15.50:0/2175952237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3718101d50 0x7f37181035b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f370c00d980 tx=0x7f370c00dc90 comp rx=0 tx=0).stop 2024-06-06T03:25:21.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.703+0000 7f371fc57700 1 -- 172.21.15.50:0/2175952237 shutdown_connections 2024-06-06T03:25:21.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.703+0000 7f371fc57700 1 --2- 172.21.15.50:0/2175952237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3718107400 0x7f3718103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:21.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.703+0000 7f371fc57700 1 --2- 172.21.15.50:0/2175952237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3718101390 0x7f3718103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:21.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.703+0000 7f371fc57700 1 --2- 172.21.15.50:0/2175952237 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f37040a2ca0 0x7f37040a5160 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:21.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.703+0000 7f371fc57700 1 --2- 172.21.15.50:0/2175952237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3718101d50 0x7f37181035b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:21.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.703+0000 7f371fc57700 1 -- 172.21.15.50:0/2175952237 >> 172.21.15.50:0/2175952237 conn(0x7f3718078340 msgr2=0x7f3718100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:21.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.703+0000 7f371fc57700 1 -- 172.21.15.50:0/2175952237 shutdown_connections 2024-06-06T03:25:21.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:21.703+0000 7f371fc57700 1 -- 172.21.15.50:0/2175952237 wait complete. 2024-06-06T03:25:22.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:22 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/2175952237' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-06T03:25:22.425 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:22 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/2175952237' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-06T03:25:22.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:22 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/2175952237' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-06T03:25:22.458 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-06-06T03:25:22.459 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T03:25:22.717 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:25:23.112 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:23 smithi050 ceph-mon[32421]: pgmap v393: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-06-06T03:25:23.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:23 smithi079 ceph-mon[35478]: pgmap v393: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-06-06T03:25:23.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:23 smithi122 ceph-mon[35759]: pgmap v393: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-06-06T03:25:24.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.438+0000 7f441e93f700 1 -- 172.21.15.50:0/1204929827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4418108520 msgr2=0x7f4418108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:24.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.438+0000 7f441e93f700 1 --2- 172.21.15.50:0/1204929827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4418108520 0x7f4418108900 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4408009990 tx=0x7f4408009ca0 comp rx=0 tx=0).stop 2024-06-06T03:25:24.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.439+0000 7f441e93f700 1 -- 172.21.15.50:0/1204929827 shutdown_connections 2024-06-06T03:25:24.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.439+0000 7f441e93f700 1 --2- 172.21.15.50:0/1204929827 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4418102ed0 0x7f441810f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:24.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.439+0000 7f441e93f700 1 --2- 172.21.15.50:0/1204929827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4418108520 0x7f4418108900 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:24.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.439+0000 7f441e93f700 1 --2- 172.21.15.50:0/1204929827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4418102510 0x7f4418102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:24.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.439+0000 7f441e93f700 1 -- 172.21.15.50:0/1204929827 >> 172.21.15.50:0/1204929827 conn(0x7f4418079640 msgr2=0x7f4418079a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:24.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.439+0000 7f441e93f700 1 -- 172.21.15.50:0/1204929827 shutdown_connections 2024-06-06T03:25:24.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.439+0000 7f441e93f700 1 -- 172.21.15.50:0/1204929827 wait complete. 2024-06-06T03:25:24.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.439+0000 7f441e93f700 1 Processor -- start 2024-06-06T03:25:24.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.440+0000 7f441e93f700 1 -- start start 2024-06-06T03:25:24.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.440+0000 7f441e93f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4418102510 0x7f4418074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:24.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.440+0000 7f441e93f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4418102ed0 0x7f4418074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:24.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.440+0000 7f441e93f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4418108520 0x7f4418075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:24.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.440+0000 7f441e93f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f44181126a0 con 0x7f4418102ed0 2024-06-06T03:25:24.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.440+0000 7f441e93f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4418112520 con 0x7f4418108520 2024-06-06T03:25:24.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.440+0000 7f441e93f700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4418112820 con 0x7f4418102510 2024-06-06T03:25:24.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.440+0000 7f44177fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4418102ed0 0x7f4418074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:24.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.440+0000 7f44177fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4418102ed0 0x7f4418074cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38606/0 (socket says 172.21.15.50:38606) 2024-06-06T03:25:24.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.440+0000 7f44177fe700 1 -- 172.21.15.50:0/3428860136 learned_addr learned my addr 172.21.15.50:0/3428860136 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:24.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.440+0000 7f4417fff700 1 --2- 172.21.15.50:0/3428860136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4418102510 0x7f4418074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:24.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.440+0000 7f441cedc700 1 --2- 172.21.15.50:0/3428860136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4418108520 0x7f4418075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:24.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.440+0000 7f44177fe700 1 -- 172.21.15.50:0/3428860136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4418102510 msgr2=0x7f4418074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:24.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.440+0000 7f44177fe700 1 --2- 172.21.15.50:0/3428860136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4418102510 0x7f4418074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:24.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.440+0000 7f44177fe700 1 -- 172.21.15.50:0/3428860136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4418108520 msgr2=0x7f4418075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:24.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.440+0000 7f44177fe700 1 --2- 172.21.15.50:0/3428860136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4418108520 0x7f4418075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:24.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.440+0000 7f44177fe700 1 -- 172.21.15.50:0/3428860136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44181a7080 con 0x7f4418102ed0 2024-06-06T03:25:24.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.441+0000 7f441cedc700 1 --2- 172.21.15.50:0/3428860136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4418108520 0x7f4418075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:25:24.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.441+0000 7f44177fe700 1 --2- 172.21.15.50:0/3428860136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4418102ed0 0x7f4418074cd0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f440c00d950 tx=0x7f440c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:24.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.441+0000 7f44157fa700 1 -- 172.21.15.50:0/3428860136 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f440c016070 con 0x7f4418102ed0 2024-06-06T03:25:24.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.441+0000 7f44157fa700 1 -- 172.21.15.50:0/3428860136 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f440c009df0 con 0x7f4418102ed0 2024-06-06T03:25:24.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.441+0000 7f441e93f700 1 -- 172.21.15.50:0/3428860136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44181a7370 con 0x7f4418102ed0 2024-06-06T03:25:24.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.441+0000 7f44157fa700 1 -- 172.21.15.50:0/3428860136 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f440c00f3c0 con 0x7f4418102ed0 2024-06-06T03:25:24.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.442+0000 7f441e93f700 1 -- 172.21.15.50:0/3428860136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44181a7900 con 0x7f4418102ed0 2024-06-06T03:25:24.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.443+0000 7f441e93f700 1 -- 172.21.15.50:0/3428860136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4418069180 con 0x7f4418102ed0 2024-06-06T03:25:24.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.443+0000 7f44157fa700 1 -- 172.21.15.50:0/3428860136 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f440c019070 con 0x7f4418102ed0 2024-06-06T03:25:24.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.444+0000 7f44157fa700 1 --2- 172.21.15.50:0/3428860136 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f44000a2ca0 0x7f44000a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:24.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.444+0000 7f4417fff700 1 --2- 172.21.15.50:0/3428860136 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f44000a2ca0 0x7f44000a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:24.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.444+0000 7f44157fa700 1 -- 172.21.15.50:0/3428860136 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f440c0cef90 con 0x7f4418102ed0 2024-06-06T03:25:24.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.445+0000 7f4417fff700 1 --2- 172.21.15.50:0/3428860136 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f44000a2ca0 0x7f44000a5160 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f440800b5c0 tx=0x7f4408005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:24.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.448+0000 7f44157fa700 1 -- 172.21.15.50:0/3428860136 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f440c09bb10 con 0x7f4418102ed0 2024-06-06T03:25:24.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.700+0000 7f441e93f700 1 -- 172.21.15.50:0/3428860136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f441802dca0 con 0x7f4418102ed0 2024-06-06T03:25:24.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.701+0000 7f44157fa700 1 -- 172.21.15.50:0/3428860136 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11855 (secure 0 0 0) 0x7f440c09b410 con 0x7f4418102ed0 2024-06-06T03:25:24.702 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:25:24.702 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1667847852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1667847852},{"type":"v1","addr":"172.21.15.50:6835","nonce":1667847852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/239971838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":239971838},{"type":"v1","addr":"172.21.15.50:6837","nonce":239971838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/2188134216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2188134216},{"type":"v1","addr":"172.21.15.50:6839","nonce":2188134216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/632572420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":632572420},{"type":"v1","addr":"172.21.15.50:6841","nonce":632572420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/864537078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":864537078},{"type":"v1","addr":"172.21.15.79:6833","nonce":864537078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/279268898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":279268898},{"type":"v1","addr":"172.21.15.79:6835","nonce":279268898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T03:22:36.202061+0000","modified":"2024-06-06T03:23:38.564714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24490,"mds_1":24472,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/57533154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":57533154},{"type":"v1","addr":"172.21.15.122:6833","nonce":57533154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/3286722213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3286722213},{"type":"v1","addr":"172.21.15.79:6837","nonce":3286722213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/768067336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":768067336},{"type":"v1","addr":"172.21.15.79:6839","nonce":768067336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.122:6835/2987597320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2987597320},{"type":"v1","addr":"172.21.15.122:6835","nonce":2987597320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":23,"addr":"172.21.15.122:6837/1604366318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1604366318},{"type":"v1","addr":"172.21.15.122:6837","nonce":1604366318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6839/4129732900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":4129732900},{"type":"v1","addr":"172.21.15.122:6839","nonce":4129732900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24472,24490,24466]},"id":1}]} 2024-06-06T03:25:24.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.703+0000 7f441e93f700 1 -- 172.21.15.50:0/3428860136 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f44000a2ca0 msgr2=0x7f44000a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:24.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.703+0000 7f441e93f700 1 --2- 172.21.15.50:0/3428860136 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f44000a2ca0 0x7f44000a5160 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f440800b5c0 tx=0x7f4408005fd0 comp rx=0 tx=0).stop 2024-06-06T03:25:24.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.703+0000 7f441e93f700 1 -- 172.21.15.50:0/3428860136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4418102ed0 msgr2=0x7f4418074cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:24.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.703+0000 7f441e93f700 1 --2- 172.21.15.50:0/3428860136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4418102ed0 0x7f4418074cd0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f440c00d950 tx=0x7f440c00dc60 comp rx=0 tx=0).stop 2024-06-06T03:25:24.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.703+0000 7f441e93f700 1 -- 172.21.15.50:0/3428860136 shutdown_connections 2024-06-06T03:25:24.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.703+0000 7f441e93f700 1 --2- 172.21.15.50:0/3428860136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4418108520 0x7f4418075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:24.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.703+0000 7f441e93f700 1 --2- 172.21.15.50:0/3428860136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4418102510 0x7f4418074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:24.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.703+0000 7f441e93f700 1 --2- 172.21.15.50:0/3428860136 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f44000a2ca0 0x7f44000a5160 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:24.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.703+0000 7f441e93f700 1 --2- 172.21.15.50:0/3428860136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4418102ed0 0x7f4418074cd0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:24.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.703+0000 7f441e93f700 1 -- 172.21.15.50:0/3428860136 >> 172.21.15.50:0/3428860136 conn(0x7f4418079640 msgr2=0x7f4418101240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:24.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.703+0000 7f441e93f700 1 -- 172.21.15.50:0/3428860136 shutdown_connections 2024-06-06T03:25:24.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:24.703+0000 7f441e93f700 1 -- 172.21.15.50:0/3428860136 wait complete. 2024-06-06T03:25:24.707 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 26 2024-06-06T03:25:25.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:25 smithi079 ceph-mon[35478]: pgmap v394: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-06-06T03:25:25.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:25 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/3428860136' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:25:25.418 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:25 smithi050 ceph-mon[32421]: pgmap v394: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-06-06T03:25:25.418 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:25 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3428860136' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:25:25.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:25 smithi122 ceph-mon[35759]: pgmap v394: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-06-06T03:25:25.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:25 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/3428860136' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:25:25.451 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T03:25:25.708 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:25:27.234 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:27 smithi050 ceph-mon[32421]: pgmap v395: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 7 op/s 2024-06-06T03:25:27.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:27 smithi079 ceph-mon[35478]: pgmap v395: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 7 op/s 2024-06-06T03:25:27.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:27 smithi122 ceph-mon[35759]: pgmap v395: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 7 op/s 2024-06-06T03:25:27.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.470+0000 7f7295e68700 1 -- 172.21.15.50:0/4023241352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72901030f0 msgr2=0x7f7290107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:27.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.470+0000 7f7295e68700 1 --2- 172.21.15.50:0/4023241352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72901030f0 0x7f7290107110 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f72780099c0 tx=0x7f7278009cd0 comp rx=0 tx=0).stop 2024-06-06T03:25:27.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.471+0000 7f7295e68700 1 -- 172.21.15.50:0/4023241352 shutdown_connections 2024-06-06T03:25:27.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.471+0000 7f7295e68700 1 --2- 172.21.15.50:0/4023241352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7290107840 0x7f729010f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:27.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.471+0000 7f7295e68700 1 --2- 172.21.15.50:0/4023241352 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7290102740 0x7f7290102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:27.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.471+0000 7f7295e68700 1 --2- 172.21.15.50:0/4023241352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72901030f0 0x7f7290107110 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:27.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.471+0000 7f7295e68700 1 -- 172.21.15.50:0/4023241352 >> 172.21.15.50:0/4023241352 conn(0x7f72900795f0 msgr2=0x7f7290079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:27.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.471+0000 7f7295e68700 1 -- 172.21.15.50:0/4023241352 shutdown_connections 2024-06-06T03:25:27.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.471+0000 7f7295e68700 1 -- 172.21.15.50:0/4023241352 wait complete. 2024-06-06T03:25:27.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.471+0000 7f7295e68700 1 Processor -- start 2024-06-06T03:25:27.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.471+0000 7f7295e68700 1 -- start start 2024-06-06T03:25:27.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.472+0000 7f7295e68700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7290102740 0x7f7290074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:27.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.472+0000 7f7295e68700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72901030f0 0x7f7290074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:27.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.472+0000 7f7295e68700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7290107840 0x7f7290075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:27.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.472+0000 7f7295e68700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7290112600 con 0x7f72901030f0 2024-06-06T03:25:27.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.472+0000 7f7295e68700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7290112480 con 0x7f7290107840 2024-06-06T03:25:27.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.472+0000 7f7295e68700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7290112780 con 0x7f7290102740 2024-06-06T03:25:27.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.472+0000 7f7286ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72901030f0 0x7f7290074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:27.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.472+0000 7f7286ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72901030f0 0x7f7290074cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38632/0 (socket says 172.21.15.50:38632) 2024-06-06T03:25:27.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.472+0000 7f7286ffd700 1 -- 172.21.15.50:0/2198851028 learned_addr learned my addr 172.21.15.50:0/2198851028 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:27.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.472+0000 7f728ffff700 1 --2- 172.21.15.50:0/2198851028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7290107840 0x7f7290075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:27.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.472+0000 7f728f7fe700 1 --2- 172.21.15.50:0/2198851028 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7290102740 0x7f7290074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:27.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.472+0000 7f7286ffd700 1 -- 172.21.15.50:0/2198851028 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7290102740 msgr2=0x7f7290074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:27.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.472+0000 7f7286ffd700 1 --2- 172.21.15.50:0/2198851028 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7290102740 0x7f7290074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:27.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.472+0000 7f7286ffd700 1 -- 172.21.15.50:0/2198851028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7290107840 msgr2=0x7f7290075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:27.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.472+0000 7f7286ffd700 1 --2- 172.21.15.50:0/2198851028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7290107840 0x7f7290075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.472+0000 7f7286ffd700 1 -- 172.21.15.50:0/2198851028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72901a7080 con 0x7f72901030f0 2024-06-06T03:25:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.472+0000 7f728ffff700 1 --2- 172.21.15.50:0/2198851028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7290107840 0x7f7290075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:25:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.472+0000 7f7286ffd700 1 --2- 172.21.15.50:0/2198851028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72901030f0 0x7f7290074cd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7278006010 tx=0x7f7278009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.472+0000 7f728d7fa700 1 -- 172.21.15.50:0/2198851028 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7278027070 con 0x7f72901030f0 2024-06-06T03:25:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.473+0000 7f7295e68700 1 -- 172.21.15.50:0/2198851028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72901a7310 con 0x7f72901030f0 2024-06-06T03:25:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.473+0000 7f728d7fa700 1 -- 172.21.15.50:0/2198851028 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7278003f50 con 0x7f72901030f0 2024-06-06T03:25:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.473+0000 7f728d7fa700 1 -- 172.21.15.50:0/2198851028 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7278022cd0 con 0x7f72901030f0 2024-06-06T03:25:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.473+0000 7f7295e68700 1 -- 172.21.15.50:0/2198851028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72901a77c0 con 0x7f72901030f0 2024-06-06T03:25:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.474+0000 7f7295e68700 1 -- 172.21.15.50:0/2198851028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7290069180 con 0x7f72901030f0 2024-06-06T03:25:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.475+0000 7f728d7fa700 1 -- 172.21.15.50:0/2198851028 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f727802a070 con 0x7f72901030f0 2024-06-06T03:25:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.475+0000 7f728d7fa700 1 --2- 172.21.15.50:0/2198851028 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f727c0a2c20 0x7f727c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.475+0000 7f728f7fe700 1 --2- 172.21.15.50:0/2198851028 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f727c0a2c20 0x7f727c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.475+0000 7f728d7fa700 1 -- 172.21.15.50:0/2198851028 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f72780d01d0 con 0x7f72901030f0 2024-06-06T03:25:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.476+0000 7f728f7fe700 1 --2- 172.21.15.50:0/2198851028 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f727c0a2c20 0x7f727c0a50e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7280005950 tx=0x7f728000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.480+0000 7f728d7fa700 1 -- 172.21.15.50:0/2198851028 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f727805e850 con 0x7f72901030f0 2024-06-06T03:25:27.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.732+0000 7f7295e68700 1 -- 172.21.15.50:0/2198851028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f729002dca0 con 0x7f72901030f0 2024-06-06T03:25:27.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.733+0000 7f728d7fa700 1 -- 172.21.15.50:0/2198851028 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11855 (secure 0 0 0) 0x7f7278013070 con 0x7f72901030f0 2024-06-06T03:25:27.733 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:25:27.734 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1667847852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1667847852},{"type":"v1","addr":"172.21.15.50:6835","nonce":1667847852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/239971838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":239971838},{"type":"v1","addr":"172.21.15.50:6837","nonce":239971838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/2188134216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2188134216},{"type":"v1","addr":"172.21.15.50:6839","nonce":2188134216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/632572420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":632572420},{"type":"v1","addr":"172.21.15.50:6841","nonce":632572420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/864537078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":864537078},{"type":"v1","addr":"172.21.15.79:6833","nonce":864537078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/279268898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":279268898},{"type":"v1","addr":"172.21.15.79:6835","nonce":279268898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T03:22:36.202061+0000","modified":"2024-06-06T03:23:38.564714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24490,"mds_1":24472,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/57533154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":57533154},{"type":"v1","addr":"172.21.15.122:6833","nonce":57533154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/3286722213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3286722213},{"type":"v1","addr":"172.21.15.79:6837","nonce":3286722213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/768067336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":768067336},{"type":"v1","addr":"172.21.15.79:6839","nonce":768067336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.122:6835/2987597320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2987597320},{"type":"v1","addr":"172.21.15.122:6835","nonce":2987597320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":23,"addr":"172.21.15.122:6837/1604366318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1604366318},{"type":"v1","addr":"172.21.15.122:6837","nonce":1604366318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6839/4129732900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":4129732900},{"type":"v1","addr":"172.21.15.122:6839","nonce":4129732900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24472,24490,24466]},"id":1}]} 2024-06-06T03:25:27.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.735+0000 7f7295e68700 1 -- 172.21.15.50:0/2198851028 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f727c0a2c20 msgr2=0x7f727c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:27.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.735+0000 7f7295e68700 1 --2- 172.21.15.50:0/2198851028 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f727c0a2c20 0x7f727c0a50e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7280005950 tx=0x7f728000b410 comp rx=0 tx=0).stop 2024-06-06T03:25:27.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.735+0000 7f7295e68700 1 -- 172.21.15.50:0/2198851028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72901030f0 msgr2=0x7f7290074cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:27.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.735+0000 7f7295e68700 1 --2- 172.21.15.50:0/2198851028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72901030f0 0x7f7290074cd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7278006010 tx=0x7f7278009f80 comp rx=0 tx=0).stop 2024-06-06T03:25:27.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.735+0000 7f7295e68700 1 -- 172.21.15.50:0/2198851028 shutdown_connections 2024-06-06T03:25:27.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.736+0000 7f7295e68700 1 --2- 172.21.15.50:0/2198851028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7290107840 0x7f7290075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:27.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.736+0000 7f7295e68700 1 --2- 172.21.15.50:0/2198851028 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7290102740 0x7f7290074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:27.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.736+0000 7f7295e68700 1 --2- 172.21.15.50:0/2198851028 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f727c0a2c20 0x7f727c0a50e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:27.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.736+0000 7f7295e68700 1 --2- 172.21.15.50:0/2198851028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72901030f0 0x7f7290074cd0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:27.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.736+0000 7f7295e68700 1 -- 172.21.15.50:0/2198851028 >> 172.21.15.50:0/2198851028 conn(0x7f72900795f0 msgr2=0x7f7290100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:27.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.736+0000 7f7295e68700 1 -- 172.21.15.50:0/2198851028 shutdown_connections 2024-06-06T03:25:27.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:27.736+0000 7f7295e68700 1 -- 172.21.15.50:0/2198851028 wait complete. 2024-06-06T03:25:27.741 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 26 2024-06-06T03:25:28.332 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:28 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/2198851028' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:25:28.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:28 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/2198851028' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:25:28.495 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:28 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/2198851028' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:25:28.526 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-06T03:25:28.779 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:25:29.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:29 smithi050 ceph-mon[32421]: pgmap v396: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-06-06T03:25:29.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:29 smithi079 ceph-mon[35478]: pgmap v396: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-06-06T03:25:29.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:29 smithi122 ceph-mon[35759]: pgmap v396: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-06-06T03:25:30.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.422+0000 7fe30c0ee700 1 -- 172.21.15.50:0/2101825647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe30406ac60 msgr2=0x7fe30406b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:30.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.422+0000 7fe30c0ee700 1 --2- 172.21.15.50:0/2101825647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe30406ac60 0x7fe30406b0e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe3000099c0 tx=0x7fe300009cd0 comp rx=0 tx=0).stop 2024-06-06T03:25:30.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.422+0000 7fe30c0ee700 1 -- 172.21.15.50:0/2101825647 shutdown_connections 2024-06-06T03:25:30.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.422+0000 7fe30c0ee700 1 --2- 172.21.15.50:0/2101825647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe30406b620 0x7fe30410f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:30.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.422+0000 7fe30c0ee700 1 --2- 172.21.15.50:0/2101825647 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe304108580 0x7fe304108960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:30.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.422+0000 7fe30c0ee700 1 --2- 172.21.15.50:0/2101825647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe30406ac60 0x7fe30406b0e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:30.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.422+0000 7fe30c0ee700 1 -- 172.21.15.50:0/2101825647 >> 172.21.15.50:0/2101825647 conn(0x7fe304078430 msgr2=0x7fe304078840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:30.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.422+0000 7fe30c0ee700 1 -- 172.21.15.50:0/2101825647 shutdown_connections 2024-06-06T03:25:30.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.422+0000 7fe30c0ee700 1 -- 172.21.15.50:0/2101825647 wait complete. 2024-06-06T03:25:30.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.423+0000 7fe30c0ee700 1 Processor -- start 2024-06-06T03:25:30.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.423+0000 7fe30c0ee700 1 -- start start 2024-06-06T03:25:30.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.423+0000 7fe30c0ee700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe30406ac60 0x7fe30419e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:30.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.423+0000 7fe30c0ee700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe30406b620 0x7fe30419ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:30.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.423+0000 7fe30c0ee700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe304108580 0x7fe304198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:30.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.423+0000 7fe30c0ee700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe304112690 con 0x7fe30406ac60 2024-06-06T03:25:30.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.423+0000 7fe30c0ee700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe304112510 con 0x7fe304108580 2024-06-06T03:25:30.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.423+0000 7fe30c0ee700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe304112810 con 0x7fe30406b620 2024-06-06T03:25:30.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.423+0000 7fe309e8a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe30406ac60 0x7fe30419e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:30.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.423+0000 7fe309e8a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe30406ac60 0x7fe30419e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53244/0 (socket says 172.21.15.50:53244) 2024-06-06T03:25:30.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.423+0000 7fe309e8a700 1 -- 172.21.15.50:0/2641515482 learned_addr learned my addr 172.21.15.50:0/2641515482 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:30.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.423+0000 7fe30a68b700 1 --2- 172.21.15.50:0/2641515482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe304108580 0x7fe304198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:30.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.423+0000 7fe309689700 1 --2- 172.21.15.50:0/2641515482 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe30406b620 0x7fe30419ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:30.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.424+0000 7fe309e8a700 1 -- 172.21.15.50:0/2641515482 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe30406b620 msgr2=0x7fe30419ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:30.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.424+0000 7fe309e8a700 1 --2- 172.21.15.50:0/2641515482 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe30406b620 0x7fe30419ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:30.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.424+0000 7fe309e8a700 1 -- 172.21.15.50:0/2641515482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe304108580 msgr2=0x7fe304198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:30.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.424+0000 7fe309e8a700 1 --2- 172.21.15.50:0/2641515482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe304108580 0x7fe304198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:30.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.424+0000 7fe309e8a700 1 -- 172.21.15.50:0/2641515482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3041990b0 con 0x7fe30406ac60 2024-06-06T03:25:30.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.424+0000 7fe309e8a700 1 --2- 172.21.15.50:0/2641515482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe30406ac60 0x7fe30419e740 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800c970 tx=0x7fe2f800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:30.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.424+0000 7fe2f6ffd700 1 -- 172.21.15.50:0/2641515482 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f80078d0 con 0x7fe30406ac60 2024-06-06T03:25:30.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.424+0000 7fe2f6ffd700 1 -- 172.21.15.50:0/2641515482 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe2f8018480 con 0x7fe30406ac60 2024-06-06T03:25:30.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.424+0000 7fe30c0ee700 1 -- 172.21.15.50:0/2641515482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3041993a0 con 0x7fe30406ac60 2024-06-06T03:25:30.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.424+0000 7fe2f6ffd700 1 -- 172.21.15.50:0/2641515482 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f800f6b0 con 0x7fe30406ac60 2024-06-06T03:25:30.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.424+0000 7fe30c0ee700 1 -- 172.21.15.50:0/2641515482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3041a5610 con 0x7fe30406ac60 2024-06-06T03:25:30.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.425+0000 7fe30c0ee700 1 -- 172.21.15.50:0/2641515482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe304069180 con 0x7fe30406ac60 2024-06-06T03:25:30.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.426+0000 7fe2f6ffd700 1 -- 172.21.15.50:0/2641515482 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe2f8018630 con 0x7fe30406ac60 2024-06-06T03:25:30.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.427+0000 7fe2f6ffd700 1 --2- 172.21.15.50:0/2641515482 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe2f00a2ca0 0x7fe2f00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:30.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.427+0000 7fe309689700 1 --2- 172.21.15.50:0/2641515482 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe2f00a2ca0 0x7fe2f00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:30.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.427+0000 7fe2f6ffd700 1 -- 172.21.15.50:0/2641515482 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fe2f80cf430 con 0x7fe30406ac60 2024-06-06T03:25:30.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.427+0000 7fe309689700 1 --2- 172.21.15.50:0/2641515482 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe2f00a2ca0 0x7fe2f00a5160 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe304078b10 tx=0x7fe300005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:30.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.431+0000 7fe2f6ffd700 1 -- 172.21.15.50:0/2641515482 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe2f809c040 con 0x7fe30406ac60 2024-06-06T03:25:30.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.639+0000 7fe30c0ee700 1 -- 172.21.15.50:0/2641515482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe304199e30 con 0x7fe30406ac60 2024-06-06T03:25:30.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.640+0000 7fe2f6ffd700 1 -- 172.21.15.50:0/2641515482 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+24653 (secure 0 0 0) 0x7fe2f809b940 con 0x7fe30406ac60 2024-06-06T03:25:30.641 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:25:30.641 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":99,"fsid":"b6263b26-23b2-11ef-bc9b-c7b262605968","created":"2024-06-06T03:14:19.062632+0000","modified":"2024-06-06T03:24:14.691472+0000","last_up_change":"2024-06-06T03:21:30.287918+0000","last_in_change":"2024-06-06T03:21:09.550417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T03:17:37.777608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T03:22:29.496859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T03:22:33.221878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-06T03:22:42.829873+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"eed8040f-a7b7-4d3b-8345-2022918097d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6803","nonce":2379528827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6805","nonce":2379528827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6809","nonce":2379528827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6807","nonce":2379528827}]},"public_addr":"172.21.15.50:6803/2379528827","cluster_addr":"172.21.15.50:6805/2379528827","heartbeat_back_addr":"172.21.15.50:6809/2379528827","heartbeat_front_addr":"172.21.15.50:6807/2379528827","state":["exists","up"]},{"osd":1,"uuid":"089ecb78-5e1e-4cdb-8fe0-5c1731ec9dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6801","nonce":3498354151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6803","nonce":3498354151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6807","nonce":3498354151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6805","nonce":3498354151}]},"public_addr":"172.21.15.79:6801/3498354151","cluster_addr":"172.21.15.79:6803/3498354151","heartbeat_back_addr":"172.21.15.79:6807/3498354151","heartbeat_front_addr":"172.21.15.79:6805/3498354151","state":["exists","up"]},{"osd":2,"uuid":"90599e3b-bf86-4a56-b03b-b051528a5b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6801","nonce":566397008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6803","nonce":566397008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6807","nonce":566397008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6805","nonce":566397008}]},"public_addr":"172.21.15.122:6801/566397008","cluster_addr":"172.21.15.122:6803/566397008","heartbeat_back_addr":"172.21.15.122:6807/566397008","heartbeat_front_addr":"172.21.15.122:6805/566397008","state":["exists","up"]},{"osd":3,"uuid":"fd295e6c-64cd-4164-83dc-4d32c2ae103a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6811","nonce":820123083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6813","nonce":820123083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6817","nonce":820123083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6815","nonce":820123083}]},"public_addr":"172.21.15.50:6811/820123083","cluster_addr":"172.21.15.50:6813/820123083","heartbeat_back_addr":"172.21.15.50:6817/820123083","heartbeat_front_addr":"172.21.15.50:6815/820123083","state":["exists","up"]},{"osd":4,"uuid":"4c854d90-5353-4f7c-b2f3-2af6216d799b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6809","nonce":1784117997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6811","nonce":1784117997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6815","nonce":1784117997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6813","nonce":1784117997}]},"public_addr":"172.21.15.79:6809/1784117997","cluster_addr":"172.21.15.79:6811/1784117997","heartbeat_back_addr":"172.21.15.79:6815/1784117997","heartbeat_front_addr":"172.21.15.79:6813/1784117997","state":["exists","up"]},{"osd":5,"uuid":"80041e10-a643-4338-b621-f882c7bc48b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6809","nonce":2755878218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6811","nonce":2755878218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6815","nonce":2755878218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6813","nonce":2755878218}]},"public_addr":"172.21.15.122:6809/2755878218","cluster_addr":"172.21.15.122:6811/2755878218","heartbeat_back_addr":"172.21.15.122:6815/2755878218","heartbeat_front_addr":"172.21.15.122:6813/2755878218","state":["exists","up"]},{"osd":6,"uuid":"9e15c6c3-bb4b-4c2b-bb7e-4653b10874d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6819","nonce":474595612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6821","nonce":474595612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6825","nonce":474595612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6823","nonce":474595612}]},"public_addr":"172.21.15.50:6819/474595612","cluster_addr":"172.21.15.50:6821/474595612","heartbeat_back_addr":"172.21.15.50:6825/474595612","heartbeat_front_addr":"172.21.15.50:6823/474595612","state":["exists","up"]},{"osd":7,"uuid":"62585bba-c540-4498-8768-b84183e19abd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6817","nonce":3504864579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6819","nonce":3504864579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6823","nonce":3504864579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6821","nonce":3504864579}]},"public_addr":"172.21.15.79:6817/3504864579","cluster_addr":"172.21.15.79:6819/3504864579","heartbeat_back_addr":"172.21.15.79:6823/3504864579","heartbeat_front_addr":"172.21.15.79:6821/3504864579","state":["exists","up"]},{"osd":8,"uuid":"7a272157-460a-4d4a-a63e-30436022ac7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6817","nonce":3484833116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6819","nonce":3484833116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6823","nonce":3484833116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6821","nonce":3484833116}]},"public_addr":"172.21.15.122:6817/3484833116","cluster_addr":"172.21.15.122:6819/3484833116","heartbeat_back_addr":"172.21.15.122:6823/3484833116","heartbeat_front_addr":"172.21.15.122:6821/3484833116","state":["exists","up"]},{"osd":9,"uuid":"7e768ff7-f78d-4a12-b863-4b692e0f4a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6827","nonce":2600273670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6829","nonce":2600273670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6833","nonce":2600273670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6831","nonce":2600273670}]},"public_addr":"172.21.15.50:6827/2600273670","cluster_addr":"172.21.15.50:6829/2600273670","heartbeat_back_addr":"172.21.15.50:6833/2600273670","heartbeat_front_addr":"172.21.15.50:6831/2600273670","state":["exists","up"]},{"osd":10,"uuid":"a42df29a-d88d-4401-878d-6c8f75f3f604","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6825","nonce":2740366543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6827","nonce":2740366543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6831","nonce":2740366543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6829","nonce":2740366543}]},"public_addr":"172.21.15.79:6825/2740366543","cluster_addr":"172.21.15.79:6827/2740366543","heartbeat_back_addr":"172.21.15.79:6831/2740366543","heartbeat_front_addr":"172.21.15.79:6829/2740366543","state":["exists","up"]},{"osd":11,"uuid":"35bcde30-49e4-49b9-a348-98d21a0d3cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6825","nonce":4160854238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6827","nonce":4160854238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6831","nonce":4160854238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6829","nonce":4160854238}]},"public_addr":"172.21.15.122:6825/4160854238","cluster_addr":"172.21.15.122:6827/4160854238","heartbeat_back_addr":"172.21.15.122:6831/4160854238","heartbeat_front_addr":"172.21.15.122:6829/4160854238","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:16:46.989554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:17:11.269759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:17:35.105846+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:00.940943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:26.284520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:51.064143+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:19:16.254750+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:19:42.841380+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:20:08.185133+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:20:34.700082+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:21:01.485278+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:21:27.938715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1311987652":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/1149897118":"2024-06-07T03:15:13.252241+0000","172.21.15.50:6800/2617801068":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/1068038293":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/4038080419":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/149912088":"2024-06-07T03:14:46.388744+0000","172.21.15.50:6801/2617801068":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/2963887224":"2024-06-07T03:14:46.388744+0000","172.21.15.50:6801/1311987652":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/2554563139":"2024-06-07T03:15:13.252241+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T03:25:30.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.643+0000 7fe30c0ee700 1 -- 172.21.15.50:0/2641515482 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe2f00a2ca0 msgr2=0x7fe2f00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:30.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.643+0000 7fe30c0ee700 1 --2- 172.21.15.50:0/2641515482 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe2f00a2ca0 0x7fe2f00a5160 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe304078b10 tx=0x7fe300005fb0 comp rx=0 tx=0).stop 2024-06-06T03:25:30.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.643+0000 7fe30c0ee700 1 -- 172.21.15.50:0/2641515482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe30406ac60 msgr2=0x7fe30419e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:30.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.643+0000 7fe30c0ee700 1 --2- 172.21.15.50:0/2641515482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe30406ac60 0x7fe30419e740 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800c970 tx=0x7fe2f800cc80 comp rx=0 tx=0).stop 2024-06-06T03:25:30.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.643+0000 7fe30c0ee700 1 -- 172.21.15.50:0/2641515482 shutdown_connections 2024-06-06T03:25:30.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.643+0000 7fe30c0ee700 1 --2- 172.21.15.50:0/2641515482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe304108580 0x7fe304198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:30.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.643+0000 7fe30c0ee700 1 --2- 172.21.15.50:0/2641515482 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe2f00a2ca0 0x7fe2f00a5160 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:30.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.643+0000 7fe30c0ee700 1 --2- 172.21.15.50:0/2641515482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe30406ac60 0x7fe30419e740 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:30.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.643+0000 7fe30c0ee700 1 --2- 172.21.15.50:0/2641515482 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe30406b620 0x7fe30419ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:30.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.643+0000 7fe30c0ee700 1 -- 172.21.15.50:0/2641515482 >> 172.21.15.50:0/2641515482 conn(0x7fe304078430 msgr2=0x7fe304100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:30.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.643+0000 7fe30c0ee700 1 -- 172.21.15.50:0/2641515482 shutdown_connections 2024-06-06T03:25:30.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:30.643+0000 7fe30c0ee700 1 -- 172.21.15.50:0/2641515482 wait complete. 2024-06-06T03:25:31.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:31 smithi079 ceph-mon[35478]: pgmap v397: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:25:31.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:31 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/2641515482' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:25:31.379 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:31 smithi050 ceph-mon[32421]: pgmap v397: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:25:31.379 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:31 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/2641515482' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:25:31.416 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T03:25:31.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:31 smithi122 ceph-mon[35759]: pgmap v397: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:25:31.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:31 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/2641515482' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:25:31.673 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:25:33.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:33 smithi079 ceph-mon[35478]: pgmap v398: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:25:33.392 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:33 smithi050 ceph-mon[32421]: pgmap v398: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:25:33.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.395+0000 7fe08b8d9700 1 -- 172.21.15.50:0/3419156538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0841085d0 msgr2=0x7fe0841089b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:33.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.395+0000 7fe08b8d9700 1 --2- 172.21.15.50:0/3419156538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0841085d0 0x7fe0841089b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe0800099c0 tx=0x7fe080009cd0 comp rx=0 tx=0).stop 2024-06-06T03:25:33.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.395+0000 7fe08b8d9700 1 -- 172.21.15.50:0/3419156538 shutdown_connections 2024-06-06T03:25:33.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.395+0000 7fe08b8d9700 1 --2- 172.21.15.50:0/3419156538 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe084102ef0 0x7fe08410f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:33.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.395+0000 7fe08b8d9700 1 --2- 172.21.15.50:0/3419156538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0841085d0 0x7fe0841089b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:33.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.395+0000 7fe08b8d9700 1 --2- 172.21.15.50:0/3419156538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe084102530 0x7fe0841029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:33.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.395+0000 7fe08b8d9700 1 -- 172.21.15.50:0/3419156538 >> 172.21.15.50:0/3419156538 conn(0x7fe084079640 msgr2=0x7fe084079a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:33.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.395+0000 7fe08b8d9700 1 -- 172.21.15.50:0/3419156538 shutdown_connections 2024-06-06T03:25:33.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.395+0000 7fe08b8d9700 1 -- 172.21.15.50:0/3419156538 wait complete. 2024-06-06T03:25:33.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.396+0000 7fe08b8d9700 1 Processor -- start 2024-06-06T03:25:33.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.396+0000 7fe08b8d9700 1 -- start start 2024-06-06T03:25:33.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.396+0000 7fe08b8d9700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe084102530 0x7fe084074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:33.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.396+0000 7fe08b8d9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe084102ef0 0x7fe084074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:33.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.396+0000 7fe08b8d9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0841085d0 0x7fe084075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:33.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.396+0000 7fe08b8d9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe0841126c0 con 0x7fe084102ef0 2024-06-06T03:25:33.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.396+0000 7fe08b8d9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe084112540 con 0x7fe0841085d0 2024-06-06T03:25:33.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.396+0000 7fe08b8d9700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe084112840 con 0x7fe084102530 2024-06-06T03:25:33.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.396+0000 7fe088e74700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe084102ef0 0x7fe084074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:33.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.396+0000 7fe088e74700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe084102ef0 0x7fe084074cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53258/0 (socket says 172.21.15.50:53258) 2024-06-06T03:25:33.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.396+0000 7fe088e74700 1 -- 172.21.15.50:0/422333887 learned_addr learned my addr 172.21.15.50:0/422333887 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:33.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.396+0000 7fe089675700 1 --2- 172.21.15.50:0/422333887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe084102530 0x7fe084074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:33.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.396+0000 7fe089e76700 1 --2- 172.21.15.50:0/422333887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0841085d0 0x7fe084075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:33.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.397+0000 7fe088e74700 1 -- 172.21.15.50:0/422333887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe084102530 msgr2=0x7fe084074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:33.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.397+0000 7fe088e74700 1 --2- 172.21.15.50:0/422333887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe084102530 0x7fe084074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:33.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.397+0000 7fe088e74700 1 -- 172.21.15.50:0/422333887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0841085d0 msgr2=0x7fe084075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:33.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.397+0000 7fe088e74700 1 --2- 172.21.15.50:0/422333887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0841085d0 0x7fe084075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:33.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.397+0000 7fe088e74700 1 -- 172.21.15.50:0/422333887 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0841a7040 con 0x7fe084102ef0 2024-06-06T03:25:33.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.397+0000 7fe088e74700 1 --2- 172.21.15.50:0/422333887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe084102ef0 0x7fe084074cd0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe07400c920 tx=0x7fe07400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:33.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.397+0000 7fe07a7fc700 1 -- 172.21.15.50:0/422333887 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe074004a30 con 0x7fe084102ef0 2024-06-06T03:25:33.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.397+0000 7fe08b8d9700 1 -- 172.21.15.50:0/422333887 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0841a7330 con 0x7fe084102ef0 2024-06-06T03:25:33.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.397+0000 7fe07a7fc700 1 -- 172.21.15.50:0/422333887 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0740054d0 con 0x7fe084102ef0 2024-06-06T03:25:33.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.397+0000 7fe07a7fc700 1 -- 172.21.15.50:0/422333887 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe074007bd0 con 0x7fe084102ef0 2024-06-06T03:25:33.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.397+0000 7fe08b8d9700 1 -- 172.21.15.50:0/422333887 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0841a78c0 con 0x7fe084102ef0 2024-06-06T03:25:33.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.398+0000 7fe08b8d9700 1 -- 172.21.15.50:0/422333887 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe08410aa60 con 0x7fe084102ef0 2024-06-06T03:25:33.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.399+0000 7fe07a7fc700 1 -- 172.21.15.50:0/422333887 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe074005000 con 0x7fe084102ef0 2024-06-06T03:25:33.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.400+0000 7fe07a7fc700 1 --2- 172.21.15.50:0/422333887 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe0700a2c20 0x7fe0700a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:33.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.400+0000 7fe089675700 1 --2- 172.21.15.50:0/422333887 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe0700a2c20 0x7fe0700a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:33.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.400+0000 7fe07a7fc700 1 -- 172.21.15.50:0/422333887 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fe0740cef30 con 0x7fe084102ef0 2024-06-06T03:25:33.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.400+0000 7fe089675700 1 --2- 172.21.15.50:0/422333887 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe0700a2c20 0x7fe0700a50e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe080009fd0 tx=0x7fe080005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:33.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.404+0000 7fe07a7fc700 1 -- 172.21.15.50:0/422333887 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe074014030 con 0x7fe084102ef0 2024-06-06T03:25:33.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:33 smithi122 ceph-mon[35759]: pgmap v398: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:25:33.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.660+0000 7fe08b8d9700 1 -- 172.21.15.50:0/422333887 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe08410a440 con 0x7fe084102ef0 2024-06-06T03:25:33.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.660+0000 7fe07a7fc700 1 -- 172.21.15.50:0/422333887 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11855 (secure 0 0 0) 0x7fe0740052f0 con 0x7fe084102ef0 2024-06-06T03:25:33.661 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:25:33.661 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1667847852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1667847852},{"type":"v1","addr":"172.21.15.50:6835","nonce":1667847852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/239971838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":239971838},{"type":"v1","addr":"172.21.15.50:6837","nonce":239971838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/2188134216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2188134216},{"type":"v1","addr":"172.21.15.50:6839","nonce":2188134216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/632572420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":632572420},{"type":"v1","addr":"172.21.15.50:6841","nonce":632572420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/864537078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":864537078},{"type":"v1","addr":"172.21.15.79:6833","nonce":864537078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/279268898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":279268898},{"type":"v1","addr":"172.21.15.79:6835","nonce":279268898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T03:22:36.202061+0000","modified":"2024-06-06T03:23:38.564714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24490,"mds_1":24472,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/57533154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":57533154},{"type":"v1","addr":"172.21.15.122:6833","nonce":57533154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/3286722213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3286722213},{"type":"v1","addr":"172.21.15.79:6837","nonce":3286722213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/768067336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":768067336},{"type":"v1","addr":"172.21.15.79:6839","nonce":768067336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.122:6835/2987597320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2987597320},{"type":"v1","addr":"172.21.15.122:6835","nonce":2987597320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":23,"addr":"172.21.15.122:6837/1604366318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1604366318},{"type":"v1","addr":"172.21.15.122:6837","nonce":1604366318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6839/4129732900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":4129732900},{"type":"v1","addr":"172.21.15.122:6839","nonce":4129732900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24472,24490,24466]},"id":1}]} 2024-06-06T03:25:33.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.663+0000 7fe08b8d9700 1 -- 172.21.15.50:0/422333887 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe0700a2c20 msgr2=0x7fe0700a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:33.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.663+0000 7fe08b8d9700 1 --2- 172.21.15.50:0/422333887 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe0700a2c20 0x7fe0700a50e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe080009fd0 tx=0x7fe080005fb0 comp rx=0 tx=0).stop 2024-06-06T03:25:33.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.663+0000 7fe08b8d9700 1 -- 172.21.15.50:0/422333887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe084102ef0 msgr2=0x7fe084074cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:33.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.663+0000 7fe08b8d9700 1 --2- 172.21.15.50:0/422333887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe084102ef0 0x7fe084074cd0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe07400c920 tx=0x7fe07400cc30 comp rx=0 tx=0).stop 2024-06-06T03:25:33.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.663+0000 7fe08b8d9700 1 -- 172.21.15.50:0/422333887 shutdown_connections 2024-06-06T03:25:33.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.663+0000 7fe08b8d9700 1 --2- 172.21.15.50:0/422333887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0841085d0 0x7fe084075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:33.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.663+0000 7fe08b8d9700 1 --2- 172.21.15.50:0/422333887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe084102530 0x7fe084074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:33.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.663+0000 7fe08b8d9700 1 --2- 172.21.15.50:0/422333887 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe0700a2c20 0x7fe0700a50e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:33.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.663+0000 7fe08b8d9700 1 --2- 172.21.15.50:0/422333887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe084102ef0 0x7fe084074cd0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:33.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.663+0000 7fe08b8d9700 1 -- 172.21.15.50:0/422333887 >> 172.21.15.50:0/422333887 conn(0x7fe084079640 msgr2=0x7fe084101200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:33.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.663+0000 7fe08b8d9700 1 -- 172.21.15.50:0/422333887 shutdown_connections 2024-06-06T03:25:33.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:33.663+0000 7fe08b8d9700 1 -- 172.21.15.50:0/422333887 wait complete. 2024-06-06T03:25:33.664 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 26 2024-06-06T03:25:34.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:34 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/422333887' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:25:34.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:34 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/422333887' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:25:34.368 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-06-06T03:22:36.202061+0000', 'modified': '2024-06-06T03:23:38.564714+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24490, 'mds_1': 24472, 'mds_2': 24466}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24427': {'gid': 24427, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.122:6833/57533154', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6832', 'nonce': 57533154}, {'type': 'v1', 'addr': '172.21.15.122:6833', 'nonce': 57533154}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24437': {'gid': 24437, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.79:6837/3286722213', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6836', 'nonce': 3286722213}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 3286722213}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24464': {'gid': 24464, 'name': 'b', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.79:6839/768067336', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6838', 'nonce': 768067336}, {'type': 'v1', 'addr': '172.21.15.79:6839', 'nonce': 768067336}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'f', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 24, 'addr': '172.21.15.122:6835/2987597320', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6834', 'nonce': 2987597320}, {'type': 'v1', 'addr': '172.21.15.122:6835', 'nonce': 2987597320}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'c', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 23, 'addr': '172.21.15.122:6837/1604366318', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6836', 'nonce': 1604366318}, {'type': 'v1', 'addr': '172.21.15.122:6837', 'nonce': 1604366318}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24490': {'gid': 24490, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.122:6839/4129732900', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6838', 'nonce': 4129732900}, {'type': 'v1', 'addr': '172.21.15.122:6839', 'nonce': 4129732900}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24490, 'qdb_cluster': [24472, 24490, 24466]} 2024-06-06T03:25:34.368 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-06-06T03:25:34.368 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.f status 2024-06-06T03:25:34.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:34 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/422333887' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:25:34.616 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:25:35.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:35 smithi079 ceph-mon[35478]: pgmap v399: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T03:25:35.405 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:35 smithi050 ceph-mon[32421]: pgmap v399: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T03:25:35.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:35 smithi122 ceph-mon[35759]: pgmap v399: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T03:25:36.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.219+0000 7f7b02657700 1 -- 172.21.15.50:0/3301765010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7afc101610 msgr2=0x7f7afc1019f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:36.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.219+0000 7f7b02657700 1 --2- 172.21.15.50:0/3301765010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7afc101610 0x7f7afc1019f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7aec0099c0 tx=0x7f7aec009cd0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.219+0000 7f7b02657700 1 -- 172.21.15.50:0/3301765010 shutdown_connections 2024-06-06T03:25:36.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.219+0000 7f7b02657700 1 --2- 172.21.15.50:0/3301765010 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7afc1066f0 0x7f7afc10e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.219+0000 7f7b02657700 1 --2- 172.21.15.50:0/3301765010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7afc101610 0x7f7afc1019f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.219+0000 7f7b02657700 1 --2- 172.21.15.50:0/3301765010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7afc101fc0 0x7f7afc106010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.219+0000 7f7b02657700 1 -- 172.21.15.50:0/3301765010 >> 172.21.15.50:0/3301765010 conn(0x7f7afc078430 msgr2=0x7f7afc078840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:36.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.219+0000 7f7b02657700 1 -- 172.21.15.50:0/3301765010 shutdown_connections 2024-06-06T03:25:36.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.219+0000 7f7b02657700 1 -- 172.21.15.50:0/3301765010 wait complete. 2024-06-06T03:25:36.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.220+0000 7f7b02657700 1 Processor -- start 2024-06-06T03:25:36.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.220+0000 7f7b02657700 1 -- start start 2024-06-06T03:25:36.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.220+0000 7f7b02657700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7afc101610 0x7f7afc19d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:36.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.220+0000 7f7b02657700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7afc101fc0 0x7f7afc19dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:36.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.220+0000 7f7b02657700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7afc1066f0 0x7f7afc1978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:36.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.220+0000 7f7b02657700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7afc111580 con 0x7f7afc101610 2024-06-06T03:25:36.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.220+0000 7f7b02657700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7afc111400 con 0x7f7afc1066f0 2024-06-06T03:25:36.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.220+0000 7f7b02657700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7afc111700 con 0x7f7afc101fc0 2024-06-06T03:25:36.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.221+0000 7f7afbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7afc101610 0x7f7afc19d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:36.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.221+0000 7f7afbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7afc101610 0x7f7afc19d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53264/0 (socket says 172.21.15.50:53264) 2024-06-06T03:25:36.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.221+0000 7f7afbfff700 1 -- 172.21.15.50:0/1989689008 learned_addr learned my addr 172.21.15.50:0/1989689008 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:36.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.221+0000 7f7b00bf4700 1 --2- 172.21.15.50:0/1989689008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7afc1066f0 0x7f7afc1978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:36.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.221+0000 7f7af3fff700 1 --2- 172.21.15.50:0/1989689008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7afc101fc0 0x7f7afc19dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:36.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.221+0000 7f7afbfff700 1 -- 172.21.15.50:0/1989689008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7afc101fc0 msgr2=0x7f7afc19dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:36.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.221+0000 7f7afbfff700 1 --2- 172.21.15.50:0/1989689008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7afc101fc0 0x7f7afc19dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.221+0000 7f7afbfff700 1 -- 172.21.15.50:0/1989689008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7afc1066f0 msgr2=0x7f7afc1978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:36.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.221+0000 7f7afbfff700 1 --2- 172.21.15.50:0/1989689008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7afc1066f0 0x7f7afc1978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.221+0000 7f7afbfff700 1 -- 172.21.15.50:0/1989689008 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7afc198000 con 0x7f7afc101610 2024-06-06T03:25:36.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.221+0000 7f7afbfff700 1 --2- 172.21.15.50:0/1989689008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7afc101610 0x7f7afc19d6e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7aec006010 tx=0x7f7aec0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:36.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.221+0000 7f7af9ffb700 1 -- 172.21.15.50:0/1989689008 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aec026070 con 0x7f7afc101610 2024-06-06T03:25:36.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.221+0000 7f7af9ffb700 1 -- 172.21.15.50:0/1989689008 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7aec00f460 con 0x7f7afc101610 2024-06-06T03:25:36.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.221+0000 7f7b02657700 1 -- 172.21.15.50:0/1989689008 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7afc198290 con 0x7f7afc101610 2024-06-06T03:25:36.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.221+0000 7f7af9ffb700 1 -- 172.21.15.50:0/1989689008 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aec009e60 con 0x7f7afc101610 2024-06-06T03:25:36.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.221+0000 7f7b02657700 1 -- 172.21.15.50:0/1989689008 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7afc06abc0 con 0x7f7afc101610 2024-06-06T03:25:36.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.224+0000 7f7af9ffb700 1 -- 172.21.15.50:0/1989689008 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7aec029070 con 0x7f7afc101610 2024-06-06T03:25:36.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.224+0000 7f7af9ffb700 1 --2- 172.21.15.50:0/1989689008 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7ae80a2c20 0x7f7ae80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:36.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.224+0000 7f7af9ffb700 1 -- 172.21.15.50:0/1989689008 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f7aec0cfbc0 con 0x7f7afc101610 2024-06-06T03:25:36.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.224+0000 7f7af3fff700 1 --2- 172.21.15.50:0/1989689008 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7ae80a2c20 0x7f7ae80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:36.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.225+0000 7f7af3fff700 1 --2- 172.21.15.50:0/1989689008 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7ae80a2c20 0x7f7ae80a50e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7afc106170 tx=0x7f7ae4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.225+0000 7f7b0cedab80 1 Processor -- start 2024-06-06T03:25:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.225+0000 7f7b0cedab80 1 -- start start 2024-06-06T03:25:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.225+0000 7f7b0cedab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec018035f0 0x55ec018039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.225+0000 7f7b0cedab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec01803f10 0x55ec017fd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.225+0000 7f7b0cedab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ec017fded0 0x55ec017fe2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.225+0000 7f7b0cedab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ec0174f7c0 con 0x55ec018035f0 2024-06-06T03:25:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.225+0000 7f7b0cedab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ec016f76d0 con 0x55ec017fded0 2024-06-06T03:25:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.225+0000 7f7b0cedab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ec0174b780 con 0x55ec01803f10 2024-06-06T03:25:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.226+0000 7f7afbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec018035f0 0x55ec018039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.226+0000 7f7afbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec018035f0 0x55ec018039d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53266/0 (socket says 172.21.15.50:53266) 2024-06-06T03:25:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.226+0000 7f7afbfff700 1 -- 172.21.15.50:0/3798498457 learned_addr learned my addr 172.21.15.50:0/3798498457 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.226+0000 7f7af3fff700 1 --2- 172.21.15.50:0/3798498457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec01803f10 0x55ec017fd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.226+0000 7f7b00bf4700 1 --2- 172.21.15.50:0/3798498457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ec017fded0 0x55ec017fe2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.226+0000 7f7afbfff700 1 -- 172.21.15.50:0/3798498457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec01803f10 msgr2=0x55ec017fd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:25:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.226+0000 7f7afbfff700 1 --2- 172.21.15.50:0/3798498457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec01803f10 0x55ec017fd990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.226+0000 7f7afbfff700 1 -- 172.21.15.50:0/3798498457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ec017fded0 msgr2=0x55ec017fe2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:25:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.226+0000 7f7afbfff700 1 --2- 172.21.15.50:0/3798498457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ec017fded0 0x55ec017fe2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.226+0000 7f7afbfff700 1 -- 172.21.15.50:0/3798498457 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec016edf00 con 0x55ec018035f0 2024-06-06T03:25:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.226+0000 7f7afbfff700 1 --2- 172.21.15.50:0/3798498457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec018035f0 0x55ec018039d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7aec09c0c0 tx=0x7f7aec09bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e694d5cbd070adfa server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.226+0000 7f7af27fc700 1 -- 172.21.15.50:0/3798498457 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aec09c830 con 0x55ec018035f0 2024-06-06T03:25:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.226+0000 7f7af27fc700 1 -- 172.21.15.50:0/3798498457 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7aec09c130 con 0x55ec018035f0 2024-06-06T03:25:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.226+0000 7f7af27fc700 1 -- 172.21.15.50:0/3798498457 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aec00f980 con 0x55ec018035f0 2024-06-06T03:25:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.227+0000 7f7b0cedab80 1 -- 172.21.15.50:0/3798498457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec018035f0 msgr2=0x55ec018039d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.227+0000 7f7b0cedab80 1 --2- 172.21.15.50:0/3798498457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec018035f0 0x55ec018039d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7aec09c0c0 tx=0x7f7aec09bf00 comp rx=0 tx=0).stop 2024-06-06T03:25:36.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.227+0000 7f7b0cedab80 1 -- 172.21.15.50:0/3798498457 shutdown_connections 2024-06-06T03:25:36.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.227+0000 7f7b0cedab80 1 --2- 172.21.15.50:0/3798498457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ec017fded0 0x55ec017fe2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.227+0000 7f7b0cedab80 1 --2- 172.21.15.50:0/3798498457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec018035f0 0x55ec018039d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.227+0000 7f7b0cedab80 1 --2- 172.21.15.50:0/3798498457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec01803f10 0x55ec017fd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.227+0000 7f7b0cedab80 1 -- 172.21.15.50:0/3798498457 >> 172.21.15.50:0/3798498457 conn(0x55ec01728c70 msgr2=0x55ec017f8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:36.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.227+0000 7f7b0cedab80 1 -- 172.21.15.50:0/3798498457 shutdown_connections 2024-06-06T03:25:36.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.227+0000 7f7b0cedab80 1 -- 172.21.15.50:0/3798498457 wait complete. 2024-06-06T03:25:36.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.228+0000 7f7b0cedab80 1 -- start start 2024-06-06T03:25:36.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.228+0000 7f7b0cedab80 1 Processor -- start 2024-06-06T03:25:36.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.228+0000 7f7b0cedab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec017fded0 0x55ec01809ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:36.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.228+0000 7f7b0cedab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ec018035f0 0x55ec01806fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:36.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.228+0000 7f7b0cedab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec01803f10 0x55ec018074e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.228+0000 7f7b0cedab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ec0180a6a0 con 0x55ec017fded0 2024-06-06T03:25:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.228+0000 7f7b0cedab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ec016efba0 con 0x55ec018035f0 2024-06-06T03:25:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.228+0000 7f7b0cedab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ec0180a820 con 0x55ec01803f10 2024-06-06T03:25:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.228+0000 7f7b0cedab80 10 client.0 _ll_register_callbacks cb 0x55ec016e98d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:25:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.228+0000 7f7afbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec017fded0 0x55ec01809ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.228+0000 7f7afbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec017fded0 0x55ec01809ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53272/0 (socket says 172.21.15.50:53272) 2024-06-06T03:25:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.228+0000 7f7afbfff700 1 -- 172.21.15.50:0/4038014561 learned_addr learned my addr 172.21.15.50:0/4038014561 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.228+0000 7f7b00bf4700 1 --2- 172.21.15.50:0/4038014561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec01803f10 0x55ec018074e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.228+0000 7f7af3fff700 1 --2- 172.21.15.50:0/4038014561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ec018035f0 0x55ec01806fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.228+0000 7f7afbfff700 1 -- 172.21.15.50:0/4038014561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec01803f10 msgr2=0x55ec018074e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:25:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.228+0000 7f7afbfff700 1 --2- 172.21.15.50:0/4038014561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec01803f10 0x55ec018074e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.228+0000 7f7afbfff700 1 -- 172.21.15.50:0/4038014561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ec018035f0 msgr2=0x55ec01806fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:25:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.228+0000 7f7afbfff700 1 --2- 172.21.15.50:0/4038014561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ec018035f0 0x55ec01806fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.228+0000 7f7afbfff700 1 -- 172.21.15.50:0/4038014561 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec0169e880 con 0x55ec017fded0 2024-06-06T03:25:36.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.229+0000 7f7af3fff700 1 --2- 172.21.15.50:0/4038014561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ec018035f0 0x55ec01806fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:25:36.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.229+0000 7f7afbfff700 1 --2- 172.21.15.50:0/4038014561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec017fded0 0x55ec01809ca0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7aec09be30 tx=0x7f7aec0a0620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c8885829bc8ffca server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:36.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.229+0000 7f7adb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:25:36.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.229+0000 7f7adb7fe700 1 -- 172.21.15.50:0/4038014561 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aec00f980 con 0x55ec017fded0 2024-06-06T03:25:36.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.229+0000 7f7adb7fe700 1 -- 172.21.15.50:0/4038014561 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f7aec09c390 con 0x55ec017fded0 2024-06-06T03:25:36.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.229+0000 7f7b0cedab80 1 -- 172.21.15.50:0/4038014561 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7aec09c130 con 0x55ec017fded0 2024-06-06T03:25:36.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.229+0000 7f7adb7fe700 1 -- 172.21.15.50:0/4038014561 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7aec00fb20 con 0x55ec017fded0 2024-06-06T03:25:36.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.229+0000 7f7b0cedab80 10 client.15063 fetch_fsmap learned FSMap version 26 2024-06-06T03:25:36.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.229+0000 7f7b0cedab80 1 -- 172.21.15.50:0/4038014561 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ec0180a6a0 con 0x55ec017fded0 2024-06-06T03:25:36.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.229+0000 7f7adb7fe700 1 -- 172.21.15.50:0/4038014561 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7aec09c130 con 0x55ec017fded0 2024-06-06T03:25:36.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.229+0000 7f7adb7fe700 1 -- 172.21.15.50:0/4038014561 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f7aec0bace0 con 0x55ec017fded0 2024-06-06T03:25:36.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.229+0000 7f7b0cedab80 10 client.15063 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T03:25:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.229+0000 7f7b0cedab80 10 client.15063 resolve_mds: resolved name 'f' to daemon mds.f 2024-06-06T03:25:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.230+0000 7f7b0cedab80 20 client.15063 populate_metadata read hostname 'smithi050' 2024-06-06T03:25:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.230+0000 7f7b0cedab80 1 --2- 172.21.15.50:0/4038014561 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55ec018173b0 0x55ec01818820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.230+0000 7f7b0cedab80 4 client.15063 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:25:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.230+0000 7f7b0cedab80 1 -- 172.21.15.50:0/4038014561 --> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec0175ccc0 con 0x55ec018173b0 2024-06-06T03:25:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.230+0000 7f7af3fff700 1 --2- 172.21.15.50:0/4038014561 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55ec018173b0 0x55ec01818820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.230+0000 7f7af3fff700 1 --2- 172.21.15.50:0/4038014561 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55ec018173b0 0x55ec01818820 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4e5f6768797fb4b2 server_cookie=cc12eaf9abb8fa70 in_seq=0 out_seq=0 2024-06-06T03:25:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.230+0000 7f7adb7fe700 10 client.15063 ms_handle_connect on v2:172.21.15.122:6834/2987597320 2024-06-06T03:25:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.231+0000 7f7adb7fe700 1 -- 172.21.15.50:0/4038014561 <== mds.2 v2:172.21.15.122:6834/2987597320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55ec0175ccc0 con 0x55ec018173b0 2024-06-06T03:25:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.231+0000 7f7adb7fe700 10 client.15063 handle_command_reply: tid=0 2024-06-06T03:25:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.231+0000 7f7b0cedab80 1 client.15063 shutdown 2024-06-06T03:25:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.231+0000 7f7b0cedab80 1 -- 172.21.15.50:0/4038014561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec017fded0 msgr2=0x55ec01809ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.231+0000 7f7b0cedab80 1 --2- 172.21.15.50:0/4038014561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec017fded0 0x55ec01809ca0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7aec09be30 tx=0x7f7aec0a0620 comp rx=0 tx=0).stop 2024-06-06T03:25:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.232+0000 7f7b0cedab80 1 -- 172.21.15.50:0/4038014561 shutdown_connections 2024-06-06T03:25:36.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.232+0000 7f7b0cedab80 1 --2- 172.21.15.50:0/4038014561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec01803f10 0x55ec018074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.232+0000 7f7b0cedab80 1 --2- 172.21.15.50:0/4038014561 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55ec018173b0 0x55ec01818820 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.232+0000 7f7b0cedab80 1 --2- 172.21.15.50:0/4038014561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec017fded0 0x55ec01809ca0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.232+0000 7f7b0cedab80 1 --2- 172.21.15.50:0/4038014561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ec018035f0 0x55ec01806fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.232+0000 7f7b0cedab80 1 -- 172.21.15.50:0/4038014561 >> 172.21.15.50:0/4038014561 conn(0x55ec01728c70 msgr2=0x55ec017f85a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:36.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.232+0000 7f7adb7fe700 0 client.15063 ms_handle_reset on v2:172.21.15.122:6834/2987597320 2024-06-06T03:25:36.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.232+0000 7f7b0cedab80 1 -- 172.21.15.50:0/4038014561 shutdown_connections 2024-06-06T03:25:36.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.232+0000 7f7b0cedab80 1 -- 172.21.15.50:0/4038014561 wait complete. 2024-06-06T03:25:36.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.232+0000 7f7b0cedab80 20 client.15063 trim_cache size 0 max 16384 2024-06-06T03:25:36.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.254+0000 7f7b0cedab80 1 Processor -- start 2024-06-06T03:25:36.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.254+0000 7f7b0cedab80 1 -- start start 2024-06-06T03:25:36.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.254+0000 7f7b0cedab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ec017fded0 0x55ec017fd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:36.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.254+0000 7f7b0cedab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec018035f0 0x55ec01804a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:36.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.254+0000 7f7b0cedab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec01803f10 0x55ec01821c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:36.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.254+0000 7f7b0cedab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ec01816b60 con 0x55ec01803f10 2024-06-06T03:25:36.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.254+0000 7f7b0cedab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ec01817230 con 0x55ec017fded0 2024-06-06T03:25:36.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.254+0000 7f7b0cedab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ec01817900 con 0x55ec018035f0 2024-06-06T03:25:36.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.255+0000 7f7b00bf4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec01803f10 0x55ec01821c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:36.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.255+0000 7f7afbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ec017fded0 0x55ec017fd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:36.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.255+0000 7f7b00bf4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec01803f10 0x55ec01821c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53276/0 (socket says 172.21.15.50:53276) 2024-06-06T03:25:36.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.255+0000 7f7b00bf4700 1 -- 172.21.15.50:0/746890686 learned_addr learned my addr 172.21.15.50:0/746890686 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:36.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.255+0000 7f7af3fff700 1 --2- 172.21.15.50:0/746890686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec018035f0 0x55ec01804a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:36.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.255+0000 7f7afbfff700 1 -- 172.21.15.50:0/746890686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec018035f0 msgr2=0x55ec01804a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:25:36.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.255+0000 7f7afbfff700 1 --2- 172.21.15.50:0/746890686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec018035f0 0x55ec01804a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.255+0000 7f7afbfff700 1 -- 172.21.15.50:0/746890686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec01803f10 msgr2=0x55ec01821c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:25:36.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.255+0000 7f7afbfff700 1 --2- 172.21.15.50:0/746890686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec01803f10 0x55ec01821c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.255+0000 7f7afbfff700 1 -- 172.21.15.50:0/746890686 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec01807ee0 con 0x55ec017fded0 2024-06-06T03:25:36.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.255+0000 7f7b00bf4700 1 --2- 172.21.15.50:0/746890686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec01803f10 0x55ec01821c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:25:36.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.255+0000 7f7afbfff700 1 --2- 172.21.15.50:0/746890686 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ec017fded0 0x55ec017fd990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7aec019fd0 tx=0x7f7aec09bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95aeae17a796be5f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:36.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.255+0000 7f7af1ffb700 1 -- 172.21.15.50:0/746890686 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aec00f980 con 0x55ec017fded0 2024-06-06T03:25:36.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.256+0000 7f7af1ffb700 1 -- 172.21.15.50:0/746890686 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7aec09c130 con 0x55ec017fded0 2024-06-06T03:25:36.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.256+0000 7f7af1ffb700 1 -- 172.21.15.50:0/746890686 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aec0bc040 con 0x55ec017fded0 2024-06-06T03:25:36.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.256+0000 7f7b0cedab80 1 -- 172.21.15.50:0/746890686 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ec017fded0 msgr2=0x55ec017fd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:36.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.256+0000 7f7b0cedab80 1 --2- 172.21.15.50:0/746890686 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ec017fded0 0x55ec017fd990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7aec019fd0 tx=0x7f7aec09bf00 comp rx=0 tx=0).stop 2024-06-06T03:25:36.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.256+0000 7f7b0cedab80 1 -- 172.21.15.50:0/746890686 shutdown_connections 2024-06-06T03:25:36.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.256+0000 7f7b0cedab80 1 --2- 172.21.15.50:0/746890686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec01803f10 0x55ec01821c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.256+0000 7f7b0cedab80 1 --2- 172.21.15.50:0/746890686 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ec017fded0 0x55ec017fd990 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.256+0000 7f7b0cedab80 1 --2- 172.21.15.50:0/746890686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec018035f0 0x55ec01804a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.256+0000 7f7b0cedab80 1 -- 172.21.15.50:0/746890686 >> 172.21.15.50:0/746890686 conn(0x55ec01728c70 msgr2=0x55ec018042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:36.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.257+0000 7f7b0cedab80 1 -- 172.21.15.50:0/746890686 shutdown_connections 2024-06-06T03:25:36.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.257+0000 7f7b0cedab80 1 -- 172.21.15.50:0/746890686 wait complete. 2024-06-06T03:25:36.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.257+0000 7f7b0cedab80 1 -- start start 2024-06-06T03:25:36.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.257+0000 7f7b0cedab80 1 Processor -- start 2024-06-06T03:25:36.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.257+0000 7f7b0cedab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec017fded0 0x55ec01822280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:36.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.257+0000 7f7b0cedab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec018035f0 0x55ec0181b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:36.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.257+0000 7f7b0cedab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ec01803f10 0x55ec0181bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:36.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.257+0000 7f7b0cedab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ec018186a0 con 0x55ec018035f0 2024-06-06T03:25:36.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.257+0000 7f7b0cedab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ec01817fd0 con 0x55ec01803f10 2024-06-06T03:25:36.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.257+0000 7f7b0cedab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ec01818d70 con 0x55ec017fded0 2024-06-06T03:25:36.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.257+0000 7f7b0cedab80 10 client.0 _ll_register_callbacks cb 0x55ec016e98d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:25:36.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.258+0000 7f7af3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec018035f0 0x55ec0181b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:36.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.258+0000 7f7af3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec018035f0 0x55ec0181b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53280/0 (socket says 172.21.15.50:53280) 2024-06-06T03:25:36.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.258+0000 7f7af3fff700 1 -- 172.21.15.50:0/1945335562 learned_addr learned my addr 172.21.15.50:0/1945335562 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:36.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.258+0000 7f7b00bf4700 1 --2- 172.21.15.50:0/1945335562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ec01803f10 0x55ec0181bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:36.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.258+0000 7f7afbfff700 1 --2- 172.21.15.50:0/1945335562 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec017fded0 0x55ec01822280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:36.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.258+0000 7f7af3fff700 1 -- 172.21.15.50:0/1945335562 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec017fded0 msgr2=0x55ec01822280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:25:36.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.258+0000 7f7af3fff700 1 --2- 172.21.15.50:0/1945335562 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec017fded0 0x55ec01822280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.258+0000 7f7af3fff700 1 -- 172.21.15.50:0/1945335562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ec01803f10 msgr2=0x55ec0181bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:25:36.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.258+0000 7f7af3fff700 1 --2- 172.21.15.50:0/1945335562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ec01803f10 0x55ec0181bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.258+0000 7f7af3fff700 1 -- 172.21.15.50:0/1945335562 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec0181c1f0 con 0x55ec018035f0 2024-06-06T03:25:36.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.258+0000 7f7af3fff700 1 --2- 172.21.15.50:0/1945335562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec018035f0 0x55ec0181b5e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x55ec01808570 tx=0x7f7ae40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c1fea267632387 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:36.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.258+0000 7f7adb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:25:36.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.258+0000 7f7adb7fe700 1 -- 172.21.15.50:0/1945335562 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4003be0 con 0x55ec018035f0 2024-06-06T03:25:36.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.258+0000 7f7b0cedab80 1 -- 172.21.15.50:0/1945335562 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7aec09c130 con 0x55ec018035f0 2024-06-06T03:25:36.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.258+0000 7f7adb7fe700 1 -- 172.21.15.50:0/1945335562 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f7ae4003d80 con 0x55ec018035f0 2024-06-06T03:25:36.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.259+0000 7f7adb7fe700 1 -- 172.21.15.50:0/1945335562 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7ae4038050 con 0x55ec018035f0 2024-06-06T03:25:36.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.259+0000 7f7b0cedab80 10 client.15069 fetch_fsmap learned FSMap version 26 2024-06-06T03:25:36.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.259+0000 7f7b0cedab80 1 -- 172.21.15.50:0/1945335562 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ec01882c40 con 0x55ec018035f0 2024-06-06T03:25:36.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.259+0000 7f7adb7fe700 1 -- 172.21.15.50:0/1945335562 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7aec09c130 con 0x55ec018035f0 2024-06-06T03:25:36.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.259+0000 7f7adb7fe700 1 -- 172.21.15.50:0/1945335562 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f7ae401c7a0 con 0x55ec018035f0 2024-06-06T03:25:36.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.259+0000 7f7b0cedab80 10 client.15069 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T03:25:36.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.259+0000 7f7b0cedab80 10 client.15069 resolve_mds: resolved name 'f' to daemon mds.f 2024-06-06T03:25:36.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.259+0000 7f7b0cedab80 20 client.15069 populate_metadata read hostname 'smithi050' 2024-06-06T03:25:36.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.259+0000 7f7b0cedab80 1 --2- 172.21.15.50:0/1945335562 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55ec01887770 0x55ec01886480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:36.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.259+0000 7f7b0cedab80 4 client.15069 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-06T03:25:36.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.259+0000 7f7b0cedab80 1 -- 172.21.15.50:0/1945335562 --> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] -- command(tid 0: {"prefix": "status"}) -- 0x55ec01757240 con 0x55ec01887770 2024-06-06T03:25:36.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.259+0000 7f7afbfff700 1 --2- 172.21.15.50:0/1945335562 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55ec01887770 0x55ec01886480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:36.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.260+0000 7f7afbfff700 1 --2- 172.21.15.50:0/1945335562 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55ec01887770 0x55ec01886480 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=da233d2f16822cd4 server_cookie=b80cb694351d8e68 in_seq=0 out_seq=0 2024-06-06T03:25:36.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.260+0000 7f7adb7fe700 10 client.15069 ms_handle_connect on v2:172.21.15.122:6834/2987597320 2024-06-06T03:25:36.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.260+0000 7f7adb7fe700 1 -- 172.21.15.50:0/1945335562 <== mds.2 v2:172.21.15.122:6834/2987597320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55ec01757240 con 0x55ec01887770 2024-06-06T03:25:36.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.260+0000 7f7adb7fe700 10 client.15069 handle_command_reply: tid=0 2024-06-06T03:25:36.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.260+0000 7f7b0cedab80 1 client.15069 shutdown 2024-06-06T03:25:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.260+0000 7f7b0cedab80 1 -- 172.21.15.50:0/1945335562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec018035f0 msgr2=0x55ec0181b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.260+0000 7f7b0cedab80 1 --2- 172.21.15.50:0/1945335562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec018035f0 0x55ec0181b5e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x55ec01808570 tx=0x7f7ae40047c0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.260+0000 7f7b0cedab80 1 -- 172.21.15.50:0/1945335562 shutdown_connections 2024-06-06T03:25:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.260+0000 7f7b0cedab80 1 --2- 172.21.15.50:0/1945335562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ec01803f10 0x55ec0181bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.260+0000 7f7b0cedab80 1 --2- 172.21.15.50:0/1945335562 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec017fded0 0x55ec01822280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.260+0000 7f7b0cedab80 1 --2- 172.21.15.50:0/1945335562 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55ec01887770 0x55ec01886480 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.260+0000 7f7b0cedab80 1 --2- 172.21.15.50:0/1945335562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec018035f0 0x55ec0181b5e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.260+0000 7f7adb7fe700 0 client.15069 ms_handle_reset on v2:172.21.15.122:6834/2987597320 2024-06-06T03:25:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.260+0000 7f7b0cedab80 1 -- 172.21.15.50:0/1945335562 >> 172.21.15.50:0/1945335562 conn(0x55ec01728c70 msgr2=0x55ec018042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.261+0000 7f7b0cedab80 1 -- 172.21.15.50:0/1945335562 shutdown_connections 2024-06-06T03:25:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.261+0000 7f7b0cedab80 1 -- 172.21.15.50:0/1945335562 wait complete. 2024-06-06T03:25:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.261+0000 7f7b0cedab80 20 client.15069 trim_cache size 0 max 16384 2024-06-06T03:25:36.266 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:25:36.266 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "b6263b26-23b2-11ef-bc9b-c7b262605968", 2024-06-06T03:25:36.266 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 2, 2024-06-06T03:25:36.266 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24466, 2024-06-06T03:25:36.266 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-06-06T03:25:36.266 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-06-06T03:25:36.266 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-06-06T03:25:36.266 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 123.681771002, 2024-06-06T03:25:36.266 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 26, 2024-06-06T03:25:36.267 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 99, 2024-06-06T03:25:36.267 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 97, 2024-06-06T03:25:36.267 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 212.86793712299999 2024-06-06T03:25:36.267 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:25:36.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.262+0000 7f7b02657700 1 -- 172.21.15.50:0/1989689008 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7ae80a2c20 msgr2=0x7f7ae80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:36.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.262+0000 7f7b02657700 1 --2- 172.21.15.50:0/1989689008 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7ae80a2c20 0x7f7ae80a50e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7afc106170 tx=0x7f7ae4009260 comp rx=0 tx=0).stop 2024-06-06T03:25:36.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.262+0000 7f7b02657700 1 -- 172.21.15.50:0/1989689008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7afc101610 msgr2=0x7f7afc19d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:36.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.262+0000 7f7b02657700 1 --2- 172.21.15.50:0/1989689008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7afc101610 0x7f7afc19d6e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7aec006010 tx=0x7f7aec0045e0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.262+0000 7f7b02657700 1 -- 172.21.15.50:0/1989689008 shutdown_connections 2024-06-06T03:25:36.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.262+0000 7f7b02657700 1 --2- 172.21.15.50:0/1989689008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7afc1066f0 0x7f7afc1978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.262+0000 7f7b02657700 1 --2- 172.21.15.50:0/1989689008 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7ae80a2c20 0x7f7ae80a50e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.262+0000 7f7b02657700 1 --2- 172.21.15.50:0/1989689008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7afc101610 0x7f7afc19d6e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.262+0000 7f7b02657700 1 --2- 172.21.15.50:0/1989689008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7afc101fc0 0x7f7afc19dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:36.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.262+0000 7f7b02657700 1 -- 172.21.15.50:0/1989689008 >> 172.21.15.50:0/1989689008 conn(0x7f7afc078430 msgr2=0x7f7afc100b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:36.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.262+0000 7f7b02657700 1 -- 172.21.15.50:0/1989689008 shutdown_connections 2024-06-06T03:25:36.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:36.262+0000 7f7b02657700 1 -- 172.21.15.50:0/1989689008 wait complete. 2024-06-06T03:25:37.047 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.c status 2024-06-06T03:25:37.302 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:25:37.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:37 smithi079 ceph-mon[35478]: pgmap v400: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-06-06T03:25:37.424 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:37 smithi050 ceph-mon[32421]: pgmap v400: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-06-06T03:25:37.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:37 smithi122 ceph-mon[35759]: pgmap v400: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-06-06T03:25:38.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.971+0000 7f6be890f700 1 -- 172.21.15.50:0/3551397857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be4101d50 msgr2=0x7f6be410e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:38.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.971+0000 7f6be890f700 1 --2- 172.21.15.50:0/3551397857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be4101d50 0x7f6be410e240 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc00b0a0 tx=0x7f6bdc00b3b0 comp rx=0 tx=0).stop 2024-06-06T03:25:38.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.971+0000 7f6be890f700 1 -- 172.21.15.50:0/3551397857 shutdown_connections 2024-06-06T03:25:38.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.971+0000 7f6be890f700 1 --2- 172.21.15.50:0/3551397857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be4101d50 0x7f6be410e240 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:38.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.971+0000 7f6be890f700 1 --2- 172.21.15.50:0/3551397857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be4107400 0x7f6be41077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:38.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.971+0000 7f6be890f700 1 --2- 172.21.15.50:0/3551397857 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6be4101390 0x7f6be4101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:38.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.971+0000 7f6be890f700 1 -- 172.21.15.50:0/3551397857 >> 172.21.15.50:0/3551397857 conn(0x7f6be4078340 msgr2=0x7f6be4078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:38.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.971+0000 7f6be890f700 1 -- 172.21.15.50:0/3551397857 shutdown_connections 2024-06-06T03:25:38.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.971+0000 7f6be890f700 1 -- 172.21.15.50:0/3551397857 wait complete. 2024-06-06T03:25:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.972+0000 7f6be890f700 1 Processor -- start 2024-06-06T03:25:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.972+0000 7f6be890f700 1 -- start start 2024-06-06T03:25:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.972+0000 7f6be890f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6be4101390 0x7f6be419d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.972+0000 7f6be890f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be4101d50 0x7f6be419dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.972+0000 7f6be890f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be4107400 0x7f6be41979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.972+0000 7f6be890f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6be4111620 con 0x7f6be4107400 2024-06-06T03:25:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.972+0000 7f6be890f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6be41114a0 con 0x7f6be4101d50 2024-06-06T03:25:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.972+0000 7f6be890f700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6be41117a0 con 0x7f6be4101390 2024-06-06T03:25:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.973+0000 7f6be2d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be4107400 0x7f6be41979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.973+0000 7f6be2d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be4107400 0x7f6be41979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39210/0 (socket says 172.21.15.50:39210) 2024-06-06T03:25:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.973+0000 7f6be2d9d700 1 -- 172.21.15.50:0/3156854428 learned_addr learned my addr 172.21.15.50:0/3156854428 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.973+0000 7f6be1d9b700 1 --2- 172.21.15.50:0/3156854428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be4101d50 0x7f6be419dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.973+0000 7f6be259c700 1 --2- 172.21.15.50:0/3156854428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6be4101390 0x7f6be419d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.973+0000 7f6be2d9d700 1 -- 172.21.15.50:0/3156854428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6be4101390 msgr2=0x7f6be419d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.973+0000 7f6be2d9d700 1 --2- 172.21.15.50:0/3156854428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6be4101390 0x7f6be419d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.973+0000 7f6be2d9d700 1 -- 172.21.15.50:0/3156854428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be4101d50 msgr2=0x7f6be419dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.973+0000 7f6be2d9d700 1 --2- 172.21.15.50:0/3156854428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be4101d50 0x7f6be419dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.973+0000 7f6be2d9d700 1 -- 172.21.15.50:0/3156854428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be4198120 con 0x7f6be4107400 2024-06-06T03:25:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.973+0000 7f6be1d9b700 1 --2- 172.21.15.50:0/3156854428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be4101d50 0x7f6be419dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:25:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.973+0000 7f6be2d9d700 1 --2- 172.21.15.50:0/3156854428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be4107400 0x7f6be41979c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc0062a0 tx=0x7f6bdc004ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:38.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.973+0000 7f6bd37fe700 1 -- 172.21.15.50:0/3156854428 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc021070 con 0x7f6be4107400 2024-06-06T03:25:38.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.973+0000 7f6be890f700 1 -- 172.21.15.50:0/3156854428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6be41983b0 con 0x7f6be4107400 2024-06-06T03:25:38.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.973+0000 7f6bd37fe700 1 -- 172.21.15.50:0/3156854428 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6bdc007d00 con 0x7f6be4107400 2024-06-06T03:25:38.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.973+0000 7f6bd37fe700 1 -- 172.21.15.50:0/3156854428 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc01d450 con 0x7f6be4107400 2024-06-06T03:25:38.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.974+0000 7f6be890f700 1 -- 172.21.15.50:0/3156854428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6be406a170 con 0x7f6be4107400 2024-06-06T03:25:38.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.976+0000 7f6bd37fe700 1 -- 172.21.15.50:0/3156854428 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6bdc003a00 con 0x7f6be4107400 2024-06-06T03:25:38.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.977+0000 7f6bd37fe700 1 --2- 172.21.15.50:0/3156854428 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6bcc0a2c20 0x7f6bcc0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:38.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.977+0000 7f6be259c700 1 --2- 172.21.15.50:0/3156854428 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6bcc0a2c20 0x7f6bcc0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:38.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.977+0000 7f6bd37fe700 1 -- 172.21.15.50:0/3156854428 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f6bdc0d0650 con 0x7f6be4107400 2024-06-06T03:25:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.978+0000 7f6be259c700 1 --2- 172.21.15.50:0/3156854428 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6bcc0a2c20 0x7f6bcc0a50e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4006fd0 tx=0x7f6bd4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.978+0000 7f6bf3192b80 1 Processor -- start 2024-06-06T03:25:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.978+0000 7f6bf3192b80 1 -- start start 2024-06-06T03:25:38.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.978+0000 7f6bf3192b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f9f733b5f0 0x55f9f733b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:38.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.978+0000 7f6bf3192b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9f733bf10 0x55f9f7335990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:38.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.978+0000 7f6bf3192b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9f7335ed0 0x55f9f73362f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:38.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.978+0000 7f6bf3192b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f9f72877c0 con 0x55f9f733bf10 2024-06-06T03:25:38.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.978+0000 7f6bf3192b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f9f722f6d0 con 0x55f9f7335ed0 2024-06-06T03:25:38.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.978+0000 7f6bf3192b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f9f7283780 con 0x55f9f733b5f0 2024-06-06T03:25:38.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.978+0000 7f6be1d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9f733bf10 0x55f9f7335990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:38.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.979+0000 7f6be1d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9f733bf10 0x55f9f7335990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39216/0 (socket says 172.21.15.50:39216) 2024-06-06T03:25:38.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.979+0000 7f6be1d9b700 1 -- 172.21.15.50:0/4145474302 learned_addr learned my addr 172.21.15.50:0/4145474302 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:38.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.979+0000 7f6be2d9d700 1 --2- 172.21.15.50:0/4145474302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9f7335ed0 0x55f9f73362f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:38.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.979+0000 7f6be259c700 1 --2- 172.21.15.50:0/4145474302 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f9f733b5f0 0x55f9f733b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:38.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.979+0000 7f6be1d9b700 1 -- 172.21.15.50:0/4145474302 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f9f733b5f0 msgr2=0x55f9f733b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:25:38.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.979+0000 7f6be1d9b700 1 --2- 172.21.15.50:0/4145474302 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f9f733b5f0 0x55f9f733b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:38.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.979+0000 7f6be1d9b700 1 -- 172.21.15.50:0/4145474302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9f7335ed0 msgr2=0x55f9f73362f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:25:38.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.979+0000 7f6be1d9b700 1 --2- 172.21.15.50:0/4145474302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9f7335ed0 0x55f9f73362f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:38.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.979+0000 7f6be1d9b700 1 -- 172.21.15.50:0/4145474302 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9f7225f00 con 0x55f9f733bf10 2024-06-06T03:25:38.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.979+0000 7f6be1d9b700 1 --2- 172.21.15.50:0/4145474302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9f733bf10 0x55f9f7335990 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8007870 tx=0x7f6bd8007b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ca2500d15f95f0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:38.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.979+0000 7f6bd0ff9700 1 -- 172.21.15.50:0/4145474302 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd80125f0 con 0x55f9f733bf10 2024-06-06T03:25:38.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.979+0000 7f6bd0ff9700 1 -- 172.21.15.50:0/4145474302 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6bd8018070 con 0x55f9f733bf10 2024-06-06T03:25:38.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.979+0000 7f6bd0ff9700 1 -- 172.21.15.50:0/4145474302 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8013b60 con 0x55f9f733bf10 2024-06-06T03:25:38.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.980+0000 7f6bf3192b80 1 -- 172.21.15.50:0/4145474302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9f733bf10 msgr2=0x55f9f7335990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:38.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.980+0000 7f6bf3192b80 1 --2- 172.21.15.50:0/4145474302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9f733bf10 0x55f9f7335990 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8007870 tx=0x7f6bd8007b80 comp rx=0 tx=0).stop 2024-06-06T03:25:38.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.980+0000 7f6bf3192b80 1 -- 172.21.15.50:0/4145474302 shutdown_connections 2024-06-06T03:25:38.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.980+0000 7f6bf3192b80 1 --2- 172.21.15.50:0/4145474302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9f7335ed0 0x55f9f73362f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:38.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.980+0000 7f6bf3192b80 1 --2- 172.21.15.50:0/4145474302 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f9f733b5f0 0x55f9f733b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:38.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.980+0000 7f6bf3192b80 1 --2- 172.21.15.50:0/4145474302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9f733bf10 0x55f9f7335990 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:38.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.980+0000 7f6bf3192b80 1 -- 172.21.15.50:0/4145474302 >> 172.21.15.50:0/4145474302 conn(0x55f9f7260c70 msgr2=0x55f9f7330800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:38.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.980+0000 7f6bf3192b80 1 -- 172.21.15.50:0/4145474302 shutdown_connections 2024-06-06T03:25:38.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.980+0000 7f6bf3192b80 1 -- 172.21.15.50:0/4145474302 wait complete. 2024-06-06T03:25:38.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.980+0000 7f6bf3192b80 1 -- start start 2024-06-06T03:25:38.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.981+0000 7f6bf3192b80 1 Processor -- start 2024-06-06T03:25:38.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.981+0000 7f6bf3192b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f9f7335ed0 0x55f9f7341c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:38.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.981+0000 7f6bf3192b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9f733b5f0 0x55f9f733ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:38.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.981+0000 7f6bf3192b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9f733bf10 0x55f9f733f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:38.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.981+0000 7f6bf3192b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f9f7342980 con 0x55f9f733b5f0 2024-06-06T03:25:38.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.981+0000 7f6bf3192b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f9f7227ba0 con 0x55f9f733bf10 2024-06-06T03:25:38.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.981+0000 7f6bf3192b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f9f7342b00 con 0x55f9f7335ed0 2024-06-06T03:25:38.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.981+0000 7f6bf3192b80 10 client.0 _ll_register_callbacks cb 0x55f9f72218d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:25:38.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.981+0000 7f6be1d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9f733b5f0 0x55f9f733ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:38.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.981+0000 7f6be1d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9f733b5f0 0x55f9f733ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39218/0 (socket says 172.21.15.50:39218) 2024-06-06T03:25:38.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.981+0000 7f6be1d9b700 1 -- 172.21.15.50:0/1222128439 learned_addr learned my addr 172.21.15.50:0/1222128439 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:38.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.981+0000 7f6be259c700 1 --2- 172.21.15.50:0/1222128439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f9f7335ed0 0x55f9f7341c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:38.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.981+0000 7f6be2d9d700 1 --2- 172.21.15.50:0/1222128439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9f733bf10 0x55f9f733f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:38.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.981+0000 7f6be1d9b700 1 -- 172.21.15.50:0/1222128439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f9f7335ed0 msgr2=0x55f9f7341c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:25:38.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.981+0000 7f6be1d9b700 1 --2- 172.21.15.50:0/1222128439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f9f7335ed0 0x55f9f7341c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:38.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.981+0000 7f6be1d9b700 1 -- 172.21.15.50:0/1222128439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9f733bf10 msgr2=0x55f9f733f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:25:38.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.981+0000 7f6be1d9b700 1 --2- 172.21.15.50:0/1222128439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9f733bf10 0x55f9f733f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:38.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.981+0000 7f6be1d9b700 1 -- 172.21.15.50:0/1222128439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9f71d6880 con 0x55f9f733b5f0 2024-06-06T03:25:38.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.981+0000 7f6be2d9d700 1 --2- 172.21.15.50:0/1222128439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9f733bf10 0x55f9f733f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:25:38.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.981+0000 7f6be1d9b700 1 --2- 172.21.15.50:0/1222128439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9f733b5f0 0x55f9f733ef60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6bd80048a0 tx=0x7f6bd8013ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bebc63f2099ccc70 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:38.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.981+0000 7f6bc9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:25:38.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.982+0000 7f6bc9ffb700 1 -- 172.21.15.50:0/1222128439 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd80074c0 con 0x55f9f733b5f0 2024-06-06T03:25:38.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.982+0000 7f6bc9ffb700 1 -- 172.21.15.50:0/1222128439 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f6bd80125f0 con 0x55f9f733b5f0 2024-06-06T03:25:38.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.982+0000 7f6bf3192b80 1 -- 172.21.15.50:0/1222128439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bd8018070 con 0x55f9f733b5f0 2024-06-06T03:25:38.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.982+0000 7f6bc9ffb700 1 -- 172.21.15.50:0/1222128439 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6bd8030050 con 0x55f9f733b5f0 2024-06-06T03:25:38.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.982+0000 7f6bf3192b80 10 client.15081 fetch_fsmap learned FSMap version 26 2024-06-06T03:25:38.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.982+0000 7f6bf3192b80 1 -- 172.21.15.50:0/1222128439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f9f734d260 con 0x55f9f733b5f0 2024-06-06T03:25:38.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.982+0000 7f6bc9ffb700 1 -- 172.21.15.50:0/1222128439 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6bd8018070 con 0x55f9f733b5f0 2024-06-06T03:25:38.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.982+0000 7f6bc9ffb700 1 -- 172.21.15.50:0/1222128439 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f6bd8027780 con 0x55f9f733b5f0 2024-06-06T03:25:38.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.982+0000 7f6bf3192b80 10 client.15081 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T03:25:38.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.982+0000 7f6bf3192b80 10 client.15081 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-06T03:25:38.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.982+0000 7f6bf3192b80 20 client.15081 populate_metadata read hostname 'smithi050' 2024-06-06T03:25:38.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.982+0000 7f6bf3192b80 1 --2- 172.21.15.50:0/1222128439 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55f9f734f4f0 0x55f9f7350960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:38.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.982+0000 7f6bf3192b80 4 client.15081 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:25:38.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.982+0000 7f6bf3192b80 1 -- 172.21.15.50:0/1222128439 --> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9f7294cc0 con 0x55f9f734f4f0 2024-06-06T03:25:38.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.983+0000 7f6be259c700 1 --2- 172.21.15.50:0/1222128439 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55f9f734f4f0 0x55f9f7350960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:38.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.983+0000 7f6be259c700 1 --2- 172.21.15.50:0/1222128439 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55f9f734f4f0 0x55f9f7350960 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cb84f6fd5ed67f07 server_cookie=f32a80ad0a258492 in_seq=0 out_seq=0 2024-06-06T03:25:38.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.983+0000 7f6bc9ffb700 10 client.15081 ms_handle_connect on v2:172.21.15.122:6836/1604366318 2024-06-06T03:25:38.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.984+0000 7f6bc9ffb700 1 -- 172.21.15.50:0/1222128439 <== mds.1 v2:172.21.15.122:6836/1604366318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55f9f7294cc0 con 0x55f9f734f4f0 2024-06-06T03:25:38.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.984+0000 7f6bc9ffb700 10 client.15081 handle_command_reply: tid=0 2024-06-06T03:25:38.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.984+0000 7f6bf3192b80 1 client.15081 shutdown 2024-06-06T03:25:38.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.984+0000 7f6bf3192b80 1 -- 172.21.15.50:0/1222128439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9f733b5f0 msgr2=0x55f9f733ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:38.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.984+0000 7f6bf3192b80 1 --2- 172.21.15.50:0/1222128439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9f733b5f0 0x55f9f733ef60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6bd80048a0 tx=0x7f6bd8013ae0 comp rx=0 tx=0).stop 2024-06-06T03:25:38.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.984+0000 7f6bf3192b80 1 -- 172.21.15.50:0/1222128439 shutdown_connections 2024-06-06T03:25:38.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.984+0000 7f6bf3192b80 1 --2- 172.21.15.50:0/1222128439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9f733bf10 0x55f9f733f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:38.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.984+0000 7f6bf3192b80 1 --2- 172.21.15.50:0/1222128439 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55f9f734f4f0 0x55f9f7350960 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:38.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.984+0000 7f6bf3192b80 1 --2- 172.21.15.50:0/1222128439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f9f7335ed0 0x55f9f7341c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:38.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.984+0000 7f6bf3192b80 1 --2- 172.21.15.50:0/1222128439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9f733b5f0 0x55f9f733ef60 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:38.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.984+0000 7f6bc9ffb700 0 client.15081 ms_handle_reset on v2:172.21.15.122:6836/1604366318 2024-06-06T03:25:38.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.984+0000 7f6bf3192b80 1 -- 172.21.15.50:0/1222128439 >> 172.21.15.50:0/1222128439 conn(0x55f9f7260c70 msgr2=0x55f9f7334980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:38.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.984+0000 7f6bf3192b80 1 -- 172.21.15.50:0/1222128439 shutdown_connections 2024-06-06T03:25:38.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.984+0000 7f6bf3192b80 1 -- 172.21.15.50:0/1222128439 wait complete. 2024-06-06T03:25:38.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:38.984+0000 7f6bf3192b80 20 client.15081 trim_cache size 0 max 16384 2024-06-06T03:25:39.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.006+0000 7f6bf3192b80 1 Processor -- start 2024-06-06T03:25:39.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.006+0000 7f6bf3192b80 1 -- start start 2024-06-06T03:25:39.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.006+0000 7f6bf3192b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9f7335ed0 0x55f9f7335990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:39.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.006+0000 7f6bf3192b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f9f733b5f0 0x55f9f7359dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:39.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.006+0000 7f6bf3192b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9f733bf10 0x55f9f735a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:39.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.006+0000 7f6bf3192b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f9f734eca0 con 0x55f9f733bf10 2024-06-06T03:25:39.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.006+0000 7f6bf3192b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f9f734f370 con 0x55f9f7335ed0 2024-06-06T03:25:39.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.006+0000 7f6bf3192b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f9f734fa40 con 0x55f9f733b5f0 2024-06-06T03:25:39.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.006+0000 7f6be2d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9f733bf10 0x55f9f735a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:39.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.006+0000 7f6be2d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9f733bf10 0x55f9f735a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39230/0 (socket says 172.21.15.50:39230) 2024-06-06T03:25:39.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.006+0000 7f6be2d9d700 1 -- 172.21.15.50:0/2916829955 learned_addr learned my addr 172.21.15.50:0/2916829955 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:39.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.007+0000 7f6be259c700 1 --2- 172.21.15.50:0/2916829955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9f7335ed0 0x55f9f7335990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:39.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.007+0000 7f6be2d9d700 1 -- 172.21.15.50:0/2916829955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f9f733b5f0 msgr2=0x55f9f7359dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:25:39.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.007+0000 7f6be1d9b700 1 --2- 172.21.15.50:0/2916829955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f9f733b5f0 0x55f9f7359dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:39.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.007+0000 7f6be2d9d700 1 --2- 172.21.15.50:0/2916829955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f9f733b5f0 0x55f9f7359dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:39.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.007+0000 7f6be2d9d700 1 -- 172.21.15.50:0/2916829955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9f7335ed0 msgr2=0x55f9f7335990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:25:39.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.007+0000 7f6be2d9d700 1 --2- 172.21.15.50:0/2916829955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9f7335ed0 0x55f9f7335990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:39.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.007+0000 7f6be2d9d700 1 -- 172.21.15.50:0/2916829955 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9f73317d0 con 0x55f9f733bf10 2024-06-06T03:25:39.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.007+0000 7f6be259c700 1 --2- 172.21.15.50:0/2916829955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9f7335ed0 0x55f9f7335990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:25:39.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.007+0000 7f6be2d9d700 1 --2- 172.21.15.50:0/2916829955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9f733bf10 0x55f9f735a300 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc09caf0 tx=0x7f6bdc004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3178031d3649736c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:39.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.007+0000 7f6bcbfff700 1 -- 172.21.15.50:0/2916829955 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc02a040 con 0x55f9f733bf10 2024-06-06T03:25:39.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.007+0000 7f6bcbfff700 1 -- 172.21.15.50:0/2916829955 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6bdc09cb60 con 0x55f9f733bf10 2024-06-06T03:25:39.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.007+0000 7f6bcbfff700 1 -- 172.21.15.50:0/2916829955 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc09aef0 con 0x55f9f733bf10 2024-06-06T03:25:39.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.008+0000 7f6bf3192b80 1 -- 172.21.15.50:0/2916829955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9f733bf10 msgr2=0x55f9f735a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:39.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.008+0000 7f6bf3192b80 1 --2- 172.21.15.50:0/2916829955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9f733bf10 0x55f9f735a300 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc09caf0 tx=0x7f6bdc004290 comp rx=0 tx=0).stop 2024-06-06T03:25:39.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.008+0000 7f6bf3192b80 1 -- 172.21.15.50:0/2916829955 shutdown_connections 2024-06-06T03:25:39.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.008+0000 7f6bf3192b80 1 --2- 172.21.15.50:0/2916829955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9f733bf10 0x55f9f735a300 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:39.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.008+0000 7f6bf3192b80 1 --2- 172.21.15.50:0/2916829955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9f7335ed0 0x55f9f7335990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:39.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.008+0000 7f6bf3192b80 1 --2- 172.21.15.50:0/2916829955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f9f733b5f0 0x55f9f7359dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.008+0000 7f6bf3192b80 1 -- 172.21.15.50:0/2916829955 >> 172.21.15.50:0/2916829955 conn(0x55f9f7260c70 msgr2=0x55f9f733d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.008+0000 7f6bf3192b80 1 -- 172.21.15.50:0/2916829955 shutdown_connections 2024-06-06T03:25:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.008+0000 7f6bf3192b80 1 -- 172.21.15.50:0/2916829955 wait complete. 2024-06-06T03:25:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.008+0000 7f6bf3192b80 1 -- start start 2024-06-06T03:25:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.008+0000 7f6bf3192b80 1 Processor -- start 2024-06-06T03:25:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.008+0000 7f6bf3192b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9f7335ed0 0x55f9f7359de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.008+0000 7f6bf3192b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f9f733b5f0 0x55f9f735a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.008+0000 7f6bf3192b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9f733bf10 0x55f9f7354d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.008+0000 7f6bf3192b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f9f73507e0 con 0x55f9f7335ed0 2024-06-06T03:25:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.008+0000 7f6bf3192b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f9f7350110 con 0x55f9f733bf10 2024-06-06T03:25:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.008+0000 7f6bf3192b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f9f7350eb0 con 0x55f9f733b5f0 2024-06-06T03:25:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.008+0000 7f6bf3192b80 10 client.0 _ll_register_callbacks cb 0x55f9f72218d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:25:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.008+0000 7f6be259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9f7335ed0 0x55f9f7359de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.009+0000 7f6be259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9f7335ed0 0x55f9f7359de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39234/0 (socket says 172.21.15.50:39234) 2024-06-06T03:25:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.009+0000 7f6be259c700 1 -- 172.21.15.50:0/863862527 learned_addr learned my addr 172.21.15.50:0/863862527 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.009+0000 7f6be1d9b700 1 --2- 172.21.15.50:0/863862527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f9f733b5f0 0x55f9f735a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.009+0000 7f6be2d9d700 1 --2- 172.21.15.50:0/863862527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9f733bf10 0x55f9f7354d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.009+0000 7f6be259c700 1 -- 172.21.15.50:0/863862527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f9f733b5f0 msgr2=0x55f9f735a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:25:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.009+0000 7f6be259c700 1 --2- 172.21.15.50:0/863862527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f9f733b5f0 0x55f9f735a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.009+0000 7f6be259c700 1 -- 172.21.15.50:0/863862527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9f733bf10 msgr2=0x55f9f7354d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:25:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.009+0000 7f6be259c700 1 --2- 172.21.15.50:0/863862527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9f733bf10 0x55f9f7354d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.009+0000 7f6be259c700 1 -- 172.21.15.50:0/863862527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9f7335bd0 con 0x55f9f7335ed0 2024-06-06T03:25:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.009+0000 7f6be2d9d700 1 --2- 172.21.15.50:0/863862527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9f733bf10 0x55f9f7354d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:25:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.009+0000 7f6be259c700 1 --2- 172.21.15.50:0/863862527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9f7335ed0 0x55f9f7359de0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55f9f7351160 tx=0x7f6bd4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1022cb147828291 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.009+0000 7f6bc9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:25:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.009+0000 7f6bc9ffb700 1 -- 172.21.15.50:0/863862527 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd4030470 con 0x55f9f7335ed0 2024-06-06T03:25:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.009+0000 7f6bc9ffb700 1 -- 172.21.15.50:0/863862527 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f6bd4030610 con 0x55f9f7335ed0 2024-06-06T03:25:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.009+0000 7f6bf3192b80 1 -- 172.21.15.50:0/863862527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bdc09cb60 con 0x55f9f7335ed0 2024-06-06T03:25:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.009+0000 7f6bc9ffb700 1 -- 172.21.15.50:0/863862527 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6bd4005a50 con 0x55f9f7335ed0 2024-06-06T03:25:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.009+0000 7f6bf3192b80 10 client.15087 fetch_fsmap learned FSMap version 26 2024-06-06T03:25:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.009+0000 7f6bf3192b80 1 -- 172.21.15.50:0/863862527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f9f73bb260 con 0x55f9f7335ed0 2024-06-06T03:25:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.010+0000 7f6bc9ffb700 1 -- 172.21.15.50:0/863862527 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6bdc09cb60 con 0x55f9f7335ed0 2024-06-06T03:25:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.010+0000 7f6bc9ffb700 1 -- 172.21.15.50:0/863862527 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f6bd4013070 con 0x55f9f7335ed0 2024-06-06T03:25:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.010+0000 7f6bf3192b80 10 client.15087 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T03:25:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.010+0000 7f6bf3192b80 10 client.15087 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-06T03:25:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.010+0000 7f6bf3192b80 20 client.15087 populate_metadata read hostname 'smithi050' 2024-06-06T03:25:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.010+0000 7f6bf3192b80 1 --2- 172.21.15.50:0/863862527 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55f9f73bfe80 0x55f9f73beb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.010+0000 7f6bf3192b80 4 client.15087 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-06T03:25:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.010+0000 7f6bf3192b80 1 -- 172.21.15.50:0/863862527 --> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] -- command(tid 0: {"prefix": "status"}) -- 0x55f9f728f240 con 0x55f9f73bfe80 2024-06-06T03:25:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.010+0000 7f6be1d9b700 1 --2- 172.21.15.50:0/863862527 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55f9f73bfe80 0x55f9f73beb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:39.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.011+0000 7f6be1d9b700 1 --2- 172.21.15.50:0/863862527 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55f9f73bfe80 0x55f9f73beb90 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=27d86e48c4ffa6a0 server_cookie=d4d554f0302509d3 in_seq=0 out_seq=0 2024-06-06T03:25:39.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.011+0000 7f6bc9ffb700 10 client.15087 ms_handle_connect on v2:172.21.15.122:6836/1604366318 2024-06-06T03:25:39.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.011+0000 7f6bc9ffb700 1 -- 172.21.15.50:0/863862527 <== mds.1 v2:172.21.15.122:6836/1604366318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55f9f728f240 con 0x55f9f73bfe80 2024-06-06T03:25:39.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.011+0000 7f6bc9ffb700 10 client.15087 handle_command_reply: tid=0 2024-06-06T03:25:39.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.011+0000 7f6bf3192b80 1 client.15087 shutdown 2024-06-06T03:25:39.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.011+0000 7f6bf3192b80 1 -- 172.21.15.50:0/863862527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9f7335ed0 msgr2=0x55f9f7359de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:39.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.011+0000 7f6bf3192b80 1 --2- 172.21.15.50:0/863862527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9f7335ed0 0x55f9f7359de0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55f9f7351160 tx=0x7f6bd4004750 comp rx=0 tx=0).stop 2024-06-06T03:25:39.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.011+0000 7f6bf3192b80 1 -- 172.21.15.50:0/863862527 shutdown_connections 2024-06-06T03:25:39.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.011+0000 7f6bf3192b80 1 --2- 172.21.15.50:0/863862527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9f733bf10 0x55f9f7354d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:39.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.011+0000 7f6bf3192b80 1 --2- 172.21.15.50:0/863862527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9f7335ed0 0x55f9f7359de0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:39.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.011+0000 7f6bf3192b80 1 --2- 172.21.15.50:0/863862527 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55f9f73bfe80 0x55f9f73beb90 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:39.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.011+0000 7f6bf3192b80 1 --2- 172.21.15.50:0/863862527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f9f733b5f0 0x55f9f735a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:39.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.011+0000 7f6bf3192b80 1 -- 172.21.15.50:0/863862527 >> 172.21.15.50:0/863862527 conn(0x55f9f7260c70 msgr2=0x55f9f733c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:39.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.011+0000 7f6bc9ffb700 0 client.15087 ms_handle_reset on v2:172.21.15.122:6836/1604366318 2024-06-06T03:25:39.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.011+0000 7f6bf3192b80 1 -- 172.21.15.50:0/863862527 shutdown_connections 2024-06-06T03:25:39.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.011+0000 7f6bf3192b80 1 -- 172.21.15.50:0/863862527 wait complete. 2024-06-06T03:25:39.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.011+0000 7f6bf3192b80 20 client.15087 trim_cache size 0 max 16384 2024-06-06T03:25:39.017 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:25:39.017 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "b6263b26-23b2-11ef-bc9b-c7b262605968", 2024-06-06T03:25:39.017 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 1, 2024-06-06T03:25:39.017 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24472, 2024-06-06T03:25:39.017 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-06-06T03:25:39.017 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-06-06T03:25:39.017 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-06-06T03:25:39.018 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 127.438086817, 2024-06-06T03:25:39.018 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 26, 2024-06-06T03:25:39.018 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 99, 2024-06-06T03:25:39.018 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 97, 2024-06-06T03:25:39.018 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 212.76803562699999 2024-06-06T03:25:39.018 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:25:39.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.012+0000 7f6be890f700 1 -- 172.21.15.50:0/3156854428 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6bcc0a2c20 msgr2=0x7f6bcc0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:39.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.012+0000 7f6be890f700 1 --2- 172.21.15.50:0/3156854428 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6bcc0a2c20 0x7f6bcc0a50e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4006fd0 tx=0x7f6bd4008040 comp rx=0 tx=0).stop 2024-06-06T03:25:39.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.012+0000 7f6be890f700 1 -- 172.21.15.50:0/3156854428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be4107400 msgr2=0x7f6be41979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:39.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.012+0000 7f6be890f700 1 --2- 172.21.15.50:0/3156854428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be4107400 0x7f6be41979c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc0062a0 tx=0x7f6bdc004ed0 comp rx=0 tx=0).stop 2024-06-06T03:25:39.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.012+0000 7f6be890f700 1 -- 172.21.15.50:0/3156854428 shutdown_connections 2024-06-06T03:25:39.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.012+0000 7f6be890f700 1 --2- 172.21.15.50:0/3156854428 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6bcc0a2c20 0x7f6bcc0a50e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:39.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.012+0000 7f6be890f700 1 --2- 172.21.15.50:0/3156854428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be4107400 0x7f6be41979c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:39.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.012+0000 7f6be890f700 1 --2- 172.21.15.50:0/3156854428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6be4101390 0x7f6be419d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:39.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.012+0000 7f6be890f700 1 --2- 172.21.15.50:0/3156854428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be4101d50 0x7f6be419dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:39.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.012+0000 7f6be890f700 1 -- 172.21.15.50:0/3156854428 >> 172.21.15.50:0/3156854428 conn(0x7f6be4078340 msgr2=0x7f6be41000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:39.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.012+0000 7f6be890f700 1 -- 172.21.15.50:0/3156854428 shutdown_connections 2024-06-06T03:25:39.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:39.012+0000 7f6be890f700 1 -- 172.21.15.50:0/3156854428 wait complete. 2024-06-06T03:25:39.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:39 smithi050 ceph-mon[32421]: pgmap v401: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:25:39.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:39 smithi079 ceph-mon[35478]: pgmap v401: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:25:39.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:39 smithi122 ceph-mon[35759]: pgmap v401: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:25:39.708 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.i status 2024-06-06T03:25:39.964 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:25:41.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:41 smithi079 ceph-mon[35478]: pgmap v402: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:25:41.414 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:41 smithi050 ceph-mon[32421]: pgmap v402: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:25:41.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:41 smithi122 ceph-mon[35759]: pgmap v402: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:25:41.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.841+0000 7f44332d0700 1 -- 172.21.15.50:0/3091347094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f442c1030f0 msgr2=0x7f442c107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:41.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.841+0000 7f44332d0700 1 --2- 172.21.15.50:0/3091347094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f442c1030f0 0x7f442c107110 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f441c0099c0 tx=0x7f441c009cd0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.841+0000 7f44332d0700 1 -- 172.21.15.50:0/3091347094 shutdown_connections 2024-06-06T03:25:41.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.841+0000 7f44332d0700 1 --2- 172.21.15.50:0/3091347094 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f442c107840 0x7f442c10f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.841+0000 7f44332d0700 1 --2- 172.21.15.50:0/3091347094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f442c102740 0x7f442c102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.841+0000 7f44332d0700 1 --2- 172.21.15.50:0/3091347094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f442c1030f0 0x7f442c107110 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.841+0000 7f44332d0700 1 -- 172.21.15.50:0/3091347094 >> 172.21.15.50:0/3091347094 conn(0x7f442c0795f0 msgr2=0x7f442c079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:41.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.841+0000 7f44332d0700 1 -- 172.21.15.50:0/3091347094 shutdown_connections 2024-06-06T03:25:41.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.841+0000 7f44332d0700 1 -- 172.21.15.50:0/3091347094 wait complete. 2024-06-06T03:25:41.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.842+0000 7f44332d0700 1 Processor -- start 2024-06-06T03:25:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.842+0000 7f44332d0700 1 -- start start 2024-06-06T03:25:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.842+0000 7f44332d0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f442c102740 0x7f442c19e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.842+0000 7f44332d0700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f442c1030f0 0x7f442c19ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.842+0000 7f44332d0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f442c107840 0x7f442c1988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.842+0000 7f44332d0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f442c112600 con 0x7f442c107840 2024-06-06T03:25:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.842+0000 7f44332d0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f442c112480 con 0x7f442c102740 2024-06-06T03:25:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.842+0000 7f44332d0700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f442c112780 con 0x7f442c1030f0 2024-06-06T03:25:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.842+0000 7f443186d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f442c107840 0x7f442c1988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.842+0000 7f443186d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f442c107840 0x7f442c1988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39254/0 (socket says 172.21.15.50:39254) 2024-06-06T03:25:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.842+0000 7f443186d700 1 -- 172.21.15.50:0/3102937222 learned_addr learned my addr 172.21.15.50:0/3102937222 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.842+0000 7f443086b700 1 --2- 172.21.15.50:0/3102937222 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f442c1030f0 0x7f442c19ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.842+0000 7f443106c700 1 --2- 172.21.15.50:0/3102937222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f442c102740 0x7f442c19e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.842+0000 7f443186d700 1 -- 172.21.15.50:0/3102937222 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f442c1030f0 msgr2=0x7f442c19ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.842+0000 7f443186d700 1 --2- 172.21.15.50:0/3102937222 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f442c1030f0 0x7f442c19ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.842+0000 7f443186d700 1 -- 172.21.15.50:0/3102937222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f442c102740 msgr2=0x7f442c19e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:41.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.842+0000 7f443186d700 1 --2- 172.21.15.50:0/3102937222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f442c102740 0x7f442c19e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.842+0000 7f443186d700 1 -- 172.21.15.50:0/3102937222 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f442c199040 con 0x7f442c107840 2024-06-06T03:25:41.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.843+0000 7f443186d700 1 --2- 172.21.15.50:0/3102937222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f442c107840 0x7f442c1988e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f442400ef30 tx=0x7f442400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:41.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.843+0000 7f44227fc700 1 -- 172.21.15.50:0/3102937222 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44240092e0 con 0x7f442c107840 2024-06-06T03:25:41.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.843+0000 7f44227fc700 1 -- 172.21.15.50:0/3102937222 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4424004bb0 con 0x7f442c107840 2024-06-06T03:25:41.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.843+0000 7f44332d0700 1 -- 172.21.15.50:0/3102937222 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f442c1992d0 con 0x7f442c107840 2024-06-06T03:25:41.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.843+0000 7f44227fc700 1 -- 172.21.15.50:0/3102937222 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4424004060 con 0x7f442c107840 2024-06-06T03:25:41.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.843+0000 7f44332d0700 1 -- 172.21.15.50:0/3102937222 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f442c1a55f0 con 0x7f442c107840 2024-06-06T03:25:41.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.845+0000 7f44227fc700 1 -- 172.21.15.50:0/3102937222 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f442401b030 con 0x7f442c107840 2024-06-06T03:25:41.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.846+0000 7f44227fc700 1 --2- 172.21.15.50:0/3102937222 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f44180a2ca0 0x7f44180a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:41.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.846+0000 7f443106c700 1 --2- 172.21.15.50:0/3102937222 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f44180a2ca0 0x7f44180a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:41.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.846+0000 7f44227fc700 1 -- 172.21.15.50:0/3102937222 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f44240cef20 con 0x7f442c107840 2024-06-06T03:25:41.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.847+0000 7f443106c700 1 --2- 172.21.15.50:0/3102937222 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f44180a2ca0 0x7f44180a5160 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4428005950 tx=0x7f4428005ed0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:41.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.847+0000 7f443db53b80 1 Processor -- start 2024-06-06T03:25:41.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.847+0000 7f443db53b80 1 -- start start 2024-06-06T03:25:41.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.848+0000 7f443db53b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d794ef10 0x5646d794f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:41.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.848+0000 7f443db53b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646d794f830 0x5646d7949210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:41.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.848+0000 7f443db53b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5646d7949750 0x5646d7949b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.848+0000 7f443db53b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5646d783bf10 con 0x5646d7949750 2024-06-06T03:25:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.848+0000 7f443db53b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5646d789a800 con 0x5646d794ef10 2024-06-06T03:25:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.848+0000 7f443db53b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5646d7802410 con 0x5646d794f830 2024-06-06T03:25:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.848+0000 7f443186d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5646d7949750 0x5646d7949b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.848+0000 7f443186d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5646d7949750 0x5646d7949b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39260/0 (socket says 172.21.15.50:39260) 2024-06-06T03:25:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.848+0000 7f443186d700 1 -- 172.21.15.50:0/2506512270 learned_addr learned my addr 172.21.15.50:0/2506512270 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.848+0000 7f443106c700 1 --2- 172.21.15.50:0/2506512270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d794ef10 0x5646d794f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.848+0000 7f443086b700 1 --2- 172.21.15.50:0/2506512270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646d794f830 0x5646d7949210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.848+0000 7f443186d700 1 -- 172.21.15.50:0/2506512270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646d794f830 msgr2=0x5646d7949210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:25:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.848+0000 7f443186d700 1 --2- 172.21.15.50:0/2506512270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646d794f830 0x5646d7949210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.848+0000 7f443186d700 1 -- 172.21.15.50:0/2506512270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d794ef10 msgr2=0x5646d794f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:25:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.848+0000 7f443186d700 1 --2- 172.21.15.50:0/2506512270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d794ef10 0x5646d794f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.848+0000 7f443186d700 1 -- 172.21.15.50:0/2506512270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646d77e9880 con 0x5646d7949750 2024-06-06T03:25:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.848+0000 7f443086b700 1 --2- 172.21.15.50:0/2506512270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646d794f830 0x5646d7949210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:25:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.848+0000 7f443106c700 1 --2- 172.21.15.50:0/2506512270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d794ef10 0x5646d794f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:25:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.848+0000 7f443186d700 1 --2- 172.21.15.50:0/2506512270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5646d7949750 0x5646d7949b70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4424097e00 tx=0x7f442409ae10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c309ea3a73d3cfb server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.848+0000 7f44177fe700 1 -- 172.21.15.50:0/2506512270 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442409bb30 con 0x5646d7949750 2024-06-06T03:25:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.849+0000 7f44177fe700 1 -- 172.21.15.50:0/2506512270 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f442409b430 con 0x5646d7949750 2024-06-06T03:25:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.849+0000 7f44177fe700 1 -- 172.21.15.50:0/2506512270 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44240a3de0 con 0x5646d7949750 2024-06-06T03:25:41.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.849+0000 7f443db53b80 1 -- 172.21.15.50:0/2506512270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5646d7949750 msgr2=0x5646d7949b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:41.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.849+0000 7f443db53b80 1 --2- 172.21.15.50:0/2506512270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5646d7949750 0x5646d7949b70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4424097e00 tx=0x7f442409ae10 comp rx=0 tx=0).stop 2024-06-06T03:25:41.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.849+0000 7f443db53b80 1 -- 172.21.15.50:0/2506512270 shutdown_connections 2024-06-06T03:25:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.849+0000 7f443db53b80 1 --2- 172.21.15.50:0/2506512270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5646d7949750 0x5646d7949b70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.849+0000 7f443db53b80 1 --2- 172.21.15.50:0/2506512270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d794ef10 0x5646d794f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.849+0000 7f443db53b80 1 --2- 172.21.15.50:0/2506512270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646d794f830 0x5646d7949210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.849+0000 7f443db53b80 1 -- 172.21.15.50:0/2506512270 >> 172.21.15.50:0/2506512270 conn(0x5646d7876030 msgr2=0x5646d79441d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.849+0000 7f443db53b80 1 -- 172.21.15.50:0/2506512270 shutdown_connections 2024-06-06T03:25:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.849+0000 7f443db53b80 1 -- 172.21.15.50:0/2506512270 wait complete. 2024-06-06T03:25:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.850+0000 7f443db53b80 1 -- start start 2024-06-06T03:25:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.850+0000 7f443db53b80 1 Processor -- start 2024-06-06T03:25:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.850+0000 7f443db53b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646d7949750 0x5646d7955570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.850+0000 7f443db53b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5646d794ef10 0x5646d7952870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.850+0000 7f443db53b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d794f830 0x5646d7952db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.850+0000 7f443db53b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5646d783af70 con 0x5646d794ef10 2024-06-06T03:25:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.850+0000 7f443db53b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5646d78967c0 con 0x5646d794f830 2024-06-06T03:25:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.850+0000 7f443db53b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5646d7956210 con 0x5646d7949750 2024-06-06T03:25:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.850+0000 7f443db53b80 10 client.0 _ll_register_callbacks cb 0x5646d7830560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:25:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.850+0000 7f443086b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5646d794ef10 0x5646d7952870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.850+0000 7f443086b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5646d794ef10 0x5646d7952870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39272/0 (socket says 172.21.15.50:39272) 2024-06-06T03:25:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.850+0000 7f443086b700 1 -- 172.21.15.50:0/101995980 learned_addr learned my addr 172.21.15.50:0/101995980 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.850+0000 7f443106c700 1 --2- 172.21.15.50:0/101995980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646d7949750 0x5646d7955570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.850+0000 7f443186d700 1 --2- 172.21.15.50:0/101995980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d794f830 0x5646d7952db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.851+0000 7f443086b700 1 -- 172.21.15.50:0/101995980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646d7949750 msgr2=0x5646d7955570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:25:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.851+0000 7f443086b700 1 --2- 172.21.15.50:0/101995980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646d7949750 0x5646d7955570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.851+0000 7f443086b700 1 -- 172.21.15.50:0/101995980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d794f830 msgr2=0x5646d7952db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:25:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.851+0000 7f443086b700 1 --2- 172.21.15.50:0/101995980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d794f830 0x5646d7952db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.851+0000 7f443086b700 1 -- 172.21.15.50:0/101995980 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646d7860700 con 0x5646d794ef10 2024-06-06T03:25:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.851+0000 7f443086b700 1 --2- 172.21.15.50:0/101995980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5646d794ef10 0x5646d7952870 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f441c00b580 tx=0x7f441c005c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf31996645d93026 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.851+0000 7f4414ff9700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:25:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.851+0000 7f4414ff9700 1 -- 172.21.15.50:0/101995980 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c003bd0 con 0x5646d794ef10 2024-06-06T03:25:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.851+0000 7f4414ff9700 1 -- 172.21.15.50:0/101995980 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f441c003d70 con 0x5646d794ef10 2024-06-06T03:25:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.851+0000 7f443db53b80 1 -- 172.21.15.50:0/101995980 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f442409b430 con 0x5646d794ef10 2024-06-06T03:25:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.851+0000 7f4414ff9700 1 -- 172.21.15.50:0/101995980 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f441c031050 con 0x5646d794ef10 2024-06-06T03:25:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.851+0000 7f443db53b80 10 client.15099 fetch_fsmap learned FSMap version 26 2024-06-06T03:25:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.851+0000 7f443db53b80 1 -- 172.21.15.50:0/101995980 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5646d7960980 con 0x5646d794ef10 2024-06-06T03:25:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.852+0000 7f4414ff9700 1 -- 172.21.15.50:0/101995980 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f442409b430 con 0x5646d794ef10 2024-06-06T03:25:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.852+0000 7f4414ff9700 1 -- 172.21.15.50:0/101995980 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f441c00f6c0 con 0x5646d794ef10 2024-06-06T03:25:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.852+0000 7f443db53b80 10 client.15099 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T03:25:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.852+0000 7f443db53b80 10 client.15099 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-06T03:25:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.852+0000 7f443db53b80 20 client.15099 populate_metadata read hostname 'smithi050' 2024-06-06T03:25:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.852+0000 7f443db53b80 1 --2- 172.21.15.50:0/101995980 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5646d7962fb0 0x5646d7964420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.852+0000 7f443db53b80 4 client.15099 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:25:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.852+0000 7f443db53b80 1 -- 172.21.15.50:0/101995980 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646d78a7d00 con 0x5646d7962fb0 2024-06-06T03:25:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.852+0000 7f443106c700 1 --2- 172.21.15.50:0/101995980 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5646d7962fb0 0x5646d7964420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:41.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.853+0000 7f443106c700 1 --2- 172.21.15.50:0/101995980 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5646d7962fb0 0x5646d7964420 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad48ec8ce82346b2 server_cookie=e601d0906a43f956 in_seq=0 out_seq=0 2024-06-06T03:25:41.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.853+0000 7f4414ff9700 10 client.15099 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:25:41.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.853+0000 7f4414ff9700 1 -- 172.21.15.50:0/101995980 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5646d78a7d00 con 0x5646d7962fb0 2024-06-06T03:25:41.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.853+0000 7f4414ff9700 10 client.15099 handle_command_reply: tid=0 2024-06-06T03:25:41.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.854+0000 7f443db53b80 1 client.15099 shutdown 2024-06-06T03:25:41.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.854+0000 7f443db53b80 1 -- 172.21.15.50:0/101995980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5646d794ef10 msgr2=0x5646d7952870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:41.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.854+0000 7f443db53b80 1 --2- 172.21.15.50:0/101995980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5646d794ef10 0x5646d7952870 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f441c00b580 tx=0x7f441c005c20 comp rx=0 tx=0).stop 2024-06-06T03:25:41.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.854+0000 7f443db53b80 1 -- 172.21.15.50:0/101995980 shutdown_connections 2024-06-06T03:25:41.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.854+0000 7f443db53b80 1 --2- 172.21.15.50:0/101995980 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5646d7962fb0 0x5646d7964420 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.854+0000 7f443db53b80 1 --2- 172.21.15.50:0/101995980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d794f830 0x5646d7952db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.854+0000 7f4414ff9700 0 client.15099 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:25:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.854+0000 7f443db53b80 1 --2- 172.21.15.50:0/101995980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646d7949750 0x5646d7955570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.854+0000 7f443db53b80 1 --2- 172.21.15.50:0/101995980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5646d794ef10 0x5646d7952870 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.854+0000 7f443db53b80 1 -- 172.21.15.50:0/101995980 >> 172.21.15.50:0/101995980 conn(0x5646d7876030 msgr2=0x5646d79436b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.854+0000 7f443db53b80 1 -- 172.21.15.50:0/101995980 shutdown_connections 2024-06-06T03:25:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.854+0000 7f443db53b80 1 -- 172.21.15.50:0/101995980 wait complete. 2024-06-06T03:25:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.854+0000 7f443db53b80 20 client.15099 trim_cache size 0 max 16384 2024-06-06T03:25:41.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.876+0000 7f443db53b80 1 Processor -- start 2024-06-06T03:25:41.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.876+0000 7f443db53b80 1 -- start start 2024-06-06T03:25:41.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.876+0000 7f443db53b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5646d7949750 0x5646d7949210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:41.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.876+0000 7f443db53b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d794ef10 0x5646d7950320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:41.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.876+0000 7f443db53b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646d794f830 0x5646d7943e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:41.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.876+0000 7f443db53b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5646d7962760 con 0x5646d7949750 2024-06-06T03:25:41.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.876+0000 7f443db53b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5646d7962e30 con 0x5646d794ef10 2024-06-06T03:25:41.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.876+0000 7f443db53b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5646d7963500 con 0x5646d794f830 2024-06-06T03:25:41.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.876+0000 7f443106c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5646d7949750 0x5646d7949210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:41.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.876+0000 7f443106c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5646d7949750 0x5646d7949210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39284/0 (socket says 172.21.15.50:39284) 2024-06-06T03:25:41.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.876+0000 7f443106c700 1 -- 172.21.15.50:0/3762442149 learned_addr learned my addr 172.21.15.50:0/3762442149 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:41.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.876+0000 7f443106c700 1 -- 172.21.15.50:0/3762442149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646d794f830 msgr2=0x5646d7943e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:25:41.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.876+0000 7f443106c700 1 --2- 172.21.15.50:0/3762442149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646d794f830 0x5646d7943e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.876+0000 7f443106c700 1 -- 172.21.15.50:0/3762442149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d794ef10 msgr2=0x5646d7950320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:25:41.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.876+0000 7f443106c700 1 --2- 172.21.15.50:0/3762442149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d794ef10 0x5646d7950320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.876+0000 7f443106c700 1 -- 172.21.15.50:0/3762442149 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646d7950de0 con 0x5646d7949750 2024-06-06T03:25:41.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.877+0000 7f443106c700 1 --2- 172.21.15.50:0/3762442149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5646d7949750 0x5646d7949210 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f442800edd0 tx=0x7f4428011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c386a1cc69d8cc server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:41.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.877+0000 7f4416ffd700 1 -- 172.21.15.50:0/3762442149 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4428010e10 con 0x5646d7949750 2024-06-06T03:25:41.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.877+0000 7f4416ffd700 1 -- 172.21.15.50:0/3762442149 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f442801e8e0 con 0x5646d7949750 2024-06-06T03:25:41.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.877+0000 7f4416ffd700 1 -- 172.21.15.50:0/3762442149 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44280299d0 con 0x5646d7949750 2024-06-06T03:25:41.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.877+0000 7f443db53b80 1 -- 172.21.15.50:0/3762442149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5646d7949750 msgr2=0x5646d7949210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:41.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.877+0000 7f443db53b80 1 --2- 172.21.15.50:0/3762442149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5646d7949750 0x5646d7949210 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f442800edd0 tx=0x7f4428011000 comp rx=0 tx=0).stop 2024-06-06T03:25:41.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.877+0000 7f443db53b80 1 -- 172.21.15.50:0/3762442149 shutdown_connections 2024-06-06T03:25:41.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.877+0000 7f443db53b80 1 --2- 172.21.15.50:0/3762442149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646d794f830 0x5646d7943e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.877+0000 7f443db53b80 1 --2- 172.21.15.50:0/3762442149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5646d7949750 0x5646d7949210 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.877+0000 7f443db53b80 1 --2- 172.21.15.50:0/3762442149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d794ef10 0x5646d7950320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.877+0000 7f443db53b80 1 -- 172.21.15.50:0/3762442149 >> 172.21.15.50:0/3762442149 conn(0x5646d7876030 msgr2=0x5646d794fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:41.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.877+0000 7f443db53b80 1 -- 172.21.15.50:0/3762442149 shutdown_connections 2024-06-06T03:25:41.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.877+0000 7f443db53b80 1 -- 172.21.15.50:0/3762442149 wait complete. 2024-06-06T03:25:41.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.878+0000 7f443db53b80 1 -- start start 2024-06-06T03:25:41.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.878+0000 7f443db53b80 1 Processor -- start 2024-06-06T03:25:41.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.878+0000 7f443db53b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d7949750 0x5646d796d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:41.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.878+0000 7f443db53b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5646d794ef10 0x5646d796dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:41.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.878+0000 7f443db53b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646d794f830 0x5646d7968850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:41.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.878+0000 7f443db53b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5646d79642a0 con 0x5646d794ef10 2024-06-06T03:25:41.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.878+0000 7f443db53b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5646d7963bd0 con 0x5646d7949750 2024-06-06T03:25:41.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.878+0000 7f443db53b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5646d7964970 con 0x5646d794f830 2024-06-06T03:25:41.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.878+0000 7f443db53b80 10 client.0 _ll_register_callbacks cb 0x5646d7830560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:25:41.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.878+0000 7f443086b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5646d794ef10 0x5646d796dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:41.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.878+0000 7f443086b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5646d794ef10 0x5646d796dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39286/0 (socket says 172.21.15.50:39286) 2024-06-06T03:25:41.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.878+0000 7f443086b700 1 -- 172.21.15.50:0/3702492811 learned_addr learned my addr 172.21.15.50:0/3702492811 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:41.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.878+0000 7f443106c700 1 --2- 172.21.15.50:0/3702492811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d7949750 0x5646d796d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:41.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.879+0000 7f443186d700 1 --2- 172.21.15.50:0/3702492811 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646d794f830 0x5646d7968850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:41.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.879+0000 7f443086b700 1 -- 172.21.15.50:0/3702492811 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646d794f830 msgr2=0x5646d7968850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:25:41.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.879+0000 7f443086b700 1 --2- 172.21.15.50:0/3702492811 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646d794f830 0x5646d7968850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.879+0000 7f443086b700 1 -- 172.21.15.50:0/3702492811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d7949750 msgr2=0x5646d796d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:25:41.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.879+0000 7f443086b700 1 --2- 172.21.15.50:0/3702492811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d7949750 0x5646d796d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.879+0000 7f443086b700 1 -- 172.21.15.50:0/3702492811 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646d796e500 con 0x5646d794ef10 2024-06-06T03:25:41.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.879+0000 7f443106c700 1 --2- 172.21.15.50:0/3702492811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d7949750 0x5646d796d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:25:41.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.879+0000 7f443086b700 1 --2- 172.21.15.50:0/3702492811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5646d794ef10 0x5646d796dde0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f441c023430 tx=0x7f441c010f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2348590238766811 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:41.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.879+0000 7f4414ff9700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:25:41.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.879+0000 7f4414ff9700 1 -- 172.21.15.50:0/3702492811 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c039070 con 0x5646d794ef10 2024-06-06T03:25:41.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.879+0000 7f4414ff9700 1 -- 172.21.15.50:0/3702492811 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f441c0039d0 con 0x5646d794ef10 2024-06-06T03:25:41.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.879+0000 7f443db53b80 1 -- 172.21.15.50:0/3702492811 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f442801e8e0 con 0x5646d794ef10 2024-06-06T03:25:41.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.879+0000 7f4414ff9700 1 -- 172.21.15.50:0/3702492811 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f441c042050 con 0x5646d794ef10 2024-06-06T03:25:41.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.879+0000 7f443db53b80 10 client.15105 fetch_fsmap learned FSMap version 26 2024-06-06T03:25:41.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.879+0000 7f443db53b80 1 -- 172.21.15.50:0/3702492811 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5646d79ceea0 con 0x5646d794ef10 2024-06-06T03:25:41.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.880+0000 7f4414ff9700 1 -- 172.21.15.50:0/3702492811 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f442801e8e0 con 0x5646d794ef10 2024-06-06T03:25:41.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.880+0000 7f4414ff9700 1 -- 172.21.15.50:0/3702492811 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f441c03c020 con 0x5646d794ef10 2024-06-06T03:25:41.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.880+0000 7f443db53b80 10 client.15105 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T03:25:41.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.880+0000 7f443db53b80 10 client.15105 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-06T03:25:41.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.880+0000 7f443db53b80 20 client.15105 populate_metadata read hostname 'smithi050' 2024-06-06T03:25:41.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.880+0000 7f443db53b80 1 --2- 172.21.15.50:0/3702492811 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5646d7962fb0 0x5646d79d2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:41.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.880+0000 7f443db53b80 4 client.15105 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-06T03:25:41.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.880+0000 7f443db53b80 1 -- 172.21.15.50:0/3702492811 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "status"}) -- 0x5646d78a2280 con 0x5646d7962fb0 2024-06-06T03:25:41.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.880+0000 7f443106c700 1 --2- 172.21.15.50:0/3702492811 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5646d7962fb0 0x5646d79d2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:41.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.881+0000 7f443106c700 1 --2- 172.21.15.50:0/3702492811 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5646d7962fb0 0x5646d79d2570 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32e6527192c4a0d1 server_cookie=38b400c7006ecbfc in_seq=0 out_seq=0 2024-06-06T03:25:41.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.881+0000 7f4414ff9700 10 client.15105 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:25:41.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.881+0000 7f4414ff9700 1 -- 172.21.15.50:0/3702492811 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5646d78a2280 con 0x5646d7962fb0 2024-06-06T03:25:41.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.881+0000 7f4414ff9700 10 client.15105 handle_command_reply: tid=0 2024-06-06T03:25:41.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.881+0000 7f443db53b80 1 client.15105 shutdown 2024-06-06T03:25:41.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.881+0000 7f443db53b80 1 -- 172.21.15.50:0/3702492811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5646d794ef10 msgr2=0x5646d796dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:41.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.881+0000 7f443db53b80 1 --2- 172.21.15.50:0/3702492811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5646d794ef10 0x5646d796dde0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f441c023430 tx=0x7f441c010f90 comp rx=0 tx=0).stop 2024-06-06T03:25:41.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.881+0000 7f443db53b80 1 -- 172.21.15.50:0/3702492811 shutdown_connections 2024-06-06T03:25:41.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.881+0000 7f443db53b80 1 --2- 172.21.15.50:0/3702492811 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5646d7962fb0 0x5646d79d2570 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.881+0000 7f443db53b80 1 --2- 172.21.15.50:0/3702492811 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5646d794f830 0x5646d7968850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.881+0000 7f443db53b80 1 --2- 172.21.15.50:0/3702492811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d7949750 0x5646d796d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.881+0000 7f443db53b80 1 --2- 172.21.15.50:0/3702492811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5646d794ef10 0x5646d796dde0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.881+0000 7f443db53b80 1 -- 172.21.15.50:0/3702492811 >> 172.21.15.50:0/3702492811 conn(0x5646d7876030 msgr2=0x5646d7952120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:41.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.881+0000 7f4414ff9700 0 client.15105 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:25:41.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.881+0000 7f443db53b80 1 -- 172.21.15.50:0/3702492811 shutdown_connections 2024-06-06T03:25:41.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.881+0000 7f443db53b80 1 -- 172.21.15.50:0/3702492811 wait complete. 2024-06-06T03:25:41.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.881+0000 7f443db53b80 20 client.15105 trim_cache size 0 max 16384 2024-06-06T03:25:41.887 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:25:41.887 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "b6263b26-23b2-11ef-bc9b-c7b262605968", 2024-06-06T03:25:41.887 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-06-06T03:25:41.887 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24490, 2024-06-06T03:25:41.887 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-06-06T03:25:41.887 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-06-06T03:25:41.887 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-06-06T03:25:41.887 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 185.59218045399999, 2024-06-06T03:25:41.888 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 26, 2024-06-06T03:25:41.888 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 99, 2024-06-06T03:25:41.888 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 97, 2024-06-06T03:25:41.888 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 209.91696838799999 2024-06-06T03:25:41.888 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:25:41.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.882+0000 7f44332d0700 1 -- 172.21.15.50:0/3102937222 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f44180a2ca0 msgr2=0x7f44180a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:41.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.882+0000 7f44332d0700 1 --2- 172.21.15.50:0/3102937222 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f44180a2ca0 0x7f44180a5160 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4428005950 tx=0x7f4428005ed0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.882+0000 7f44332d0700 1 -- 172.21.15.50:0/3102937222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f442c107840 msgr2=0x7f442c1988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:41.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.882+0000 7f44332d0700 1 --2- 172.21.15.50:0/3102937222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f442c107840 0x7f442c1988e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f442400ef30 tx=0x7f442400c3a0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.882+0000 7f44332d0700 1 -- 172.21.15.50:0/3102937222 shutdown_connections 2024-06-06T03:25:41.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.882+0000 7f44332d0700 1 --2- 172.21.15.50:0/3102937222 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f44180a2ca0 0x7f44180a5160 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.882+0000 7f44332d0700 1 --2- 172.21.15.50:0/3102937222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f442c107840 0x7f442c1988e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.882+0000 7f44332d0700 1 --2- 172.21.15.50:0/3102937222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f442c102740 0x7f442c19e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.882+0000 7f44332d0700 1 --2- 172.21.15.50:0/3102937222 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f442c1030f0 0x7f442c19ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:41.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.882+0000 7f44332d0700 1 -- 172.21.15.50:0/3102937222 >> 172.21.15.50:0/3102937222 conn(0x7f442c0795f0 msgr2=0x7f442c100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:41.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.882+0000 7f44332d0700 1 -- 172.21.15.50:0/3102937222 shutdown_connections 2024-06-06T03:25:41.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:41.882+0000 7f44332d0700 1 -- 172.21.15.50:0/3102937222 wait complete. 2024-06-06T03:25:42.659 INFO:tasks.cephadm:Setup complete, yielding 2024-06-06T03:25:42.659 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-06-06T03:25:42.669 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi050.front.sepia.ceph.com 2024-06-06T03:25:42.669 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch status' 2024-06-06T03:25:42.921 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:25:43.324 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:43 smithi050 ceph-mon[32421]: pgmap v403: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:25:43.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:43 smithi079 ceph-mon[35478]: pgmap v403: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:25:43.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:43 smithi122 ceph-mon[35759]: pgmap v403: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:25:44.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.660+0000 7f1e574f2700 1 -- 172.21.15.50:0/4193774727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e501058b0 msgr2=0x7f1e50107ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:44.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.660+0000 7f1e574f2700 1 --2- 172.21.15.50:0/4193774727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e501058b0 0x7f1e50107ca0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1e40009990 tx=0x7f1e40009ca0 comp rx=0 tx=0).stop 2024-06-06T03:25:44.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.660+0000 7f1e574f2700 1 -- 172.21.15.50:0/4193774727 shutdown_connections 2024-06-06T03:25:44.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.660+0000 7f1e574f2700 1 --2- 172.21.15.50:0/4193774727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e501081e0 0x7f1e5010a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:44.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.660+0000 7f1e574f2700 1 --2- 172.21.15.50:0/4193774727 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e50102f80 0x7f1e50105370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:44.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.660+0000 7f1e574f2700 1 --2- 172.21.15.50:0/4193774727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e501058b0 0x7f1e50107ca0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:44.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.660+0000 7f1e574f2700 1 -- 172.21.15.50:0/4193774727 >> 172.21.15.50:0/4193774727 conn(0x7f1e500fc990 msgr2=0x7f1e500fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:44.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.660+0000 7f1e574f2700 1 -- 172.21.15.50:0/4193774727 shutdown_connections 2024-06-06T03:25:44.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.660+0000 7f1e574f2700 1 -- 172.21.15.50:0/4193774727 wait complete. 2024-06-06T03:25:44.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.661+0000 7f1e574f2700 1 Processor -- start 2024-06-06T03:25:44.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.661+0000 7f1e574f2700 1 -- start start 2024-06-06T03:25:44.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.661+0000 7f1e574f2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e50102f80 0x7f1e5019a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:44.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.661+0000 7f1e574f2700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e501058b0 0x7f1e5019ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:44.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.661+0000 7f1e574f2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e501081e0 0x7f1e501a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:44.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.661+0000 7f1e574f2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5010dfb0 con 0x7f1e501081e0 2024-06-06T03:25:44.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.661+0000 7f1e574f2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5010de30 con 0x7f1e50102f80 2024-06-06T03:25:44.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.661+0000 7f1e574f2700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5010e130 con 0x7f1e501058b0 2024-06-06T03:25:44.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.661+0000 7f1e55a8f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e501081e0 0x7f1e501a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:44.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.661+0000 7f1e55a8f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e501081e0 0x7f1e501a1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39310/0 (socket says 172.21.15.50:39310) 2024-06-06T03:25:44.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.661+0000 7f1e5528e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e50102f80 0x7f1e5019a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:44.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.661+0000 7f1e55a8f700 1 -- 172.21.15.50:0/3310145355 learned_addr learned my addr 172.21.15.50:0/3310145355 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:44.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.662+0000 7f1e54a8d700 1 --2- 172.21.15.50:0/3310145355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e501058b0 0x7f1e5019ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:44.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.662+0000 7f1e55a8f700 1 -- 172.21.15.50:0/3310145355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e501058b0 msgr2=0x7f1e5019ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:44.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.662+0000 7f1e55a8f700 1 --2- 172.21.15.50:0/3310145355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e501058b0 0x7f1e5019ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:44.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.662+0000 7f1e55a8f700 1 -- 172.21.15.50:0/3310145355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e50102f80 msgr2=0x7f1e5019a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:44.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.662+0000 7f1e55a8f700 1 --2- 172.21.15.50:0/3310145355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e50102f80 0x7f1e5019a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:44.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.662+0000 7f1e55a8f700 1 -- 172.21.15.50:0/3310145355 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e501a2520 con 0x7f1e501081e0 2024-06-06T03:25:44.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.662+0000 7f1e5528e700 1 --2- 172.21.15.50:0/3310145355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e50102f80 0x7f1e5019a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:25:44.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.662+0000 7f1e55a8f700 1 --2- 172.21.15.50:0/3310145355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e501081e0 0x7f1e501a1e80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1e4800e9a0 tx=0x7f1e4800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:44.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.662+0000 7f1e467fc700 1 -- 172.21.15.50:0/3310145355 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4800cbd0 con 0x7f1e501081e0 2024-06-06T03:25:44.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.662+0000 7f1e467fc700 1 -- 172.21.15.50:0/3310145355 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1e4800ee90 con 0x7f1e501081e0 2024-06-06T03:25:44.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.662+0000 7f1e574f2700 1 -- 172.21.15.50:0/3310145355 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e501a2810 con 0x7f1e501081e0 2024-06-06T03:25:44.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.662+0000 7f1e467fc700 1 -- 172.21.15.50:0/3310145355 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e480055b0 con 0x7f1e501081e0 2024-06-06T03:25:44.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.662+0000 7f1e574f2700 1 -- 172.21.15.50:0/3310145355 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e501a2d50 con 0x7f1e501081e0 2024-06-06T03:25:44.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.663+0000 7f1e574f2700 1 -- 172.21.15.50:0/3310145355 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e50069180 con 0x7f1e501081e0 2024-06-06T03:25:44.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.665+0000 7f1e467fc700 1 -- 172.21.15.50:0/3310145355 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1e48004750 con 0x7f1e501081e0 2024-06-06T03:25:44.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.665+0000 7f1e467fc700 1 --2- 172.21.15.50:0/3310145355 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f1e3c0a2ca0 0x7f1e3c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:44.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.665+0000 7f1e5528e700 1 --2- 172.21.15.50:0/3310145355 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f1e3c0a2ca0 0x7f1e3c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:44.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.665+0000 7f1e467fc700 1 -- 172.21.15.50:0/3310145355 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f1e480cf7c0 con 0x7f1e501081e0 2024-06-06T03:25:44.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.666+0000 7f1e5528e700 1 --2- 172.21.15.50:0/3310145355 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f1e3c0a2ca0 0x7f1e3c0a5160 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c003e30 tx=0x7f1e4c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:44.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.669+0000 7f1e467fc700 1 -- 172.21.15.50:0/3310145355 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1e48053850 con 0x7f1e501081e0 2024-06-06T03:25:44.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.892+0000 7f1e574f2700 1 -- 172.21.15.50:0/3310145355 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f1e500628d0 con 0x7f1e3c0a2ca0 2024-06-06T03:25:44.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.894+0000 7f1e467fc700 1 -- 172.21.15.50:0/3310145355 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f1e500628d0 con 0x7f1e3c0a2ca0 2024-06-06T03:25:44.893 INFO:teuthology.orchestra.run.smithi050.stdout:Backend: cephadm 2024-06-06T03:25:44.894 INFO:teuthology.orchestra.run.smithi050.stdout:Available: Yes 2024-06-06T03:25:44.894 INFO:teuthology.orchestra.run.smithi050.stdout:Paused: No 2024-06-06T03:25:44.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.896+0000 7f1e574f2700 1 -- 172.21.15.50:0/3310145355 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f1e3c0a2ca0 msgr2=0x7f1e3c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:44.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.896+0000 7f1e574f2700 1 --2- 172.21.15.50:0/3310145355 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f1e3c0a2ca0 0x7f1e3c0a5160 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c003e30 tx=0x7f1e4c00b040 comp rx=0 tx=0).stop 2024-06-06T03:25:44.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.896+0000 7f1e574f2700 1 -- 172.21.15.50:0/3310145355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e501081e0 msgr2=0x7f1e501a1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:44.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.896+0000 7f1e574f2700 1 --2- 172.21.15.50:0/3310145355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e501081e0 0x7f1e501a1e80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1e4800e9a0 tx=0x7f1e4800ecb0 comp rx=0 tx=0).stop 2024-06-06T03:25:44.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.896+0000 7f1e574f2700 1 -- 172.21.15.50:0/3310145355 shutdown_connections 2024-06-06T03:25:44.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.896+0000 7f1e574f2700 1 --2- 172.21.15.50:0/3310145355 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f1e3c0a2ca0 0x7f1e3c0a5160 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:44.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.896+0000 7f1e574f2700 1 --2- 172.21.15.50:0/3310145355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e501081e0 0x7f1e501a1e80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:44.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.896+0000 7f1e574f2700 1 --2- 172.21.15.50:0/3310145355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e50102f80 0x7f1e5019a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:44.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.896+0000 7f1e574f2700 1 --2- 172.21.15.50:0/3310145355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e501058b0 0x7f1e5019ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:44.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.896+0000 7f1e574f2700 1 -- 172.21.15.50:0/3310145355 >> 172.21.15.50:0/3310145355 conn(0x7f1e500fc990 msgr2=0x7f1e50102870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:44.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.896+0000 7f1e574f2700 1 -- 172.21.15.50:0/3310145355 shutdown_connections 2024-06-06T03:25:44.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:44.896+0000 7f1e574f2700 1 -- 172.21.15.50:0/3310145355 wait complete. 2024-06-06T03:25:45.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:45 smithi079 ceph-mon[35478]: pgmap v404: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T03:25:45.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:45 smithi122 ceph-mon[35759]: pgmap v404: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T03:25:45.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:45 smithi050 ceph-mon[32421]: pgmap v404: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T03:25:45.644 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch ps' 2024-06-06T03:25:45.894 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:25:46.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:46 smithi079 ceph-mon[35478]: from='client.15111 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:25:46.352 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:46 smithi050 ceph-mon[32421]: from='client.15111 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:25:46.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:46 smithi122 ceph-mon[35759]: from='client.15111 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:25:47.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:47 smithi050 ceph-mon[32421]: pgmap v405: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-06-06T03:25:47.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:47 smithi079 ceph-mon[35478]: pgmap v405: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-06-06T03:25:47.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:47 smithi122 ceph-mon[35759]: pgmap v405: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-06-06T03:25:47.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.585+0000 7fe850dae700 1 -- 172.21.15.50:0/678895474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe84c1025f0 msgr2=0x7fe84c102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:47.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.585+0000 7fe850dae700 1 --2- 172.21.15.50:0/678895474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe84c1025f0 0x7fe84c102a50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe8400099c0 tx=0x7fe840009cd0 comp rx=0 tx=0).stop 2024-06-06T03:25:47.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.585+0000 7fe850dae700 1 -- 172.21.15.50:0/678895474 shutdown_connections 2024-06-06T03:25:47.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.585+0000 7fe850dae700 1 --2- 172.21.15.50:0/678895474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe84c102f90 0x7fe84c109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:47.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.585+0000 7fe850dae700 1 --2- 172.21.15.50:0/678895474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe84c1013f0 0x7fe84c101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:47.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.585+0000 7fe850dae700 1 --2- 172.21.15.50:0/678895474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe84c1025f0 0x7fe84c102a50 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:47.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.585+0000 7fe850dae700 1 -- 172.21.15.50:0/678895474 >> 172.21.15.50:0/678895474 conn(0x7fe84c0fc990 msgr2=0x7fe84c0fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:47.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.585+0000 7fe850dae700 1 -- 172.21.15.50:0/678895474 shutdown_connections 2024-06-06T03:25:47.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.585+0000 7fe850dae700 1 -- 172.21.15.50:0/678895474 wait complete. 2024-06-06T03:25:47.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.586+0000 7fe850dae700 1 Processor -- start 2024-06-06T03:25:47.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.586+0000 7fe850dae700 1 -- start start 2024-06-06T03:25:47.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.586+0000 7fe850dae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe84c1013f0 0x7fe84c105380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:47.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.586+0000 7fe850dae700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe84c1025f0 0x7fe84c1039d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:47.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.586+0000 7fe850dae700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe84c102f90 0x7fe84c103f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:47.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.586+0000 7fe850dae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe84c10ce70 con 0x7fe84c1013f0 2024-06-06T03:25:47.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.586+0000 7fe850dae700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe84c10ccf0 con 0x7fe84c102f90 2024-06-06T03:25:47.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.586+0000 7fe850dae700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe84c10cff0 con 0x7fe84c1025f0 2024-06-06T03:25:47.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.586+0000 7fe84a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe84c1013f0 0x7fe84c105380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:47.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.587+0000 7fe84a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe84c1013f0 0x7fe84c105380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39328/0 (socket says 172.21.15.50:39328) 2024-06-06T03:25:47.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.587+0000 7fe84a59c700 1 -- 172.21.15.50:0/1268074477 learned_addr learned my addr 172.21.15.50:0/1268074477 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:47.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.587+0000 7fe849d9b700 1 --2- 172.21.15.50:0/1268074477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe84c1025f0 0x7fe84c1039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:47.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.587+0000 7fe84ad9d700 1 --2- 172.21.15.50:0/1268074477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe84c102f90 0x7fe84c103f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:47.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.587+0000 7fe84a59c700 1 -- 172.21.15.50:0/1268074477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe84c1025f0 msgr2=0x7fe84c1039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:47.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.587+0000 7fe84a59c700 1 --2- 172.21.15.50:0/1268074477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe84c1025f0 0x7fe84c1039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:47.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.587+0000 7fe84a59c700 1 -- 172.21.15.50:0/1268074477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe84c102f90 msgr2=0x7fe84c103f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:47.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.587+0000 7fe84a59c700 1 --2- 172.21.15.50:0/1268074477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe84c102f90 0x7fe84c103f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:47.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.587+0000 7fe84a59c700 1 -- 172.21.15.50:0/1268074477 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe84c1047c0 con 0x7fe84c1013f0 2024-06-06T03:25:47.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.587+0000 7fe84ad9d700 1 --2- 172.21.15.50:0/1268074477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe84c102f90 0x7fe84c103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:25:47.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.587+0000 7fe84a59c700 1 --2- 172.21.15.50:0/1268074477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe84c1013f0 0x7fe84c105380 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe83c00e970 tx=0x7fe83c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:47.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.587+0000 7fe83b7fe700 1 -- 172.21.15.50:0/1268074477 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83c00cbd0 con 0x7fe84c1013f0 2024-06-06T03:25:47.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.587+0000 7fe850dae700 1 -- 172.21.15.50:0/1268074477 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe84c1a27f0 con 0x7fe84c1013f0 2024-06-06T03:25:47.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.587+0000 7fe83b7fe700 1 -- 172.21.15.50:0/1268074477 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe83c0044d0 con 0x7fe84c1013f0 2024-06-06T03:25:47.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.587+0000 7fe83b7fe700 1 -- 172.21.15.50:0/1268074477 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83c003da0 con 0x7fe84c1013f0 2024-06-06T03:25:47.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.587+0000 7fe850dae700 1 -- 172.21.15.50:0/1268074477 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe84c1a2d30 con 0x7fe84c1013f0 2024-06-06T03:25:47.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.589+0000 7fe850dae700 1 -- 172.21.15.50:0/1268074477 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe84c069180 con 0x7fe84c1013f0 2024-06-06T03:25:47.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.590+0000 7fe83b7fe700 1 -- 172.21.15.50:0/1268074477 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe83c003f40 con 0x7fe84c1013f0 2024-06-06T03:25:47.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.591+0000 7fe83b7fe700 1 --2- 172.21.15.50:0/1268074477 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe8340a2c20 0x7fe8340a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:47.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.591+0000 7fe849d9b700 1 --2- 172.21.15.50:0/1268074477 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe8340a2c20 0x7fe8340a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:47.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.591+0000 7fe83b7fe700 1 -- 172.21.15.50:0/1268074477 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fe83c0cf6b0 con 0x7fe84c1013f0 2024-06-06T03:25:47.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.591+0000 7fe849d9b700 1 --2- 172.21.15.50:0/1268074477 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe8340a2c20 0x7fe8340a50e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe840000c00 tx=0x7fe840005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:47.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.595+0000 7fe83b7fe700 1 -- 172.21.15.50:0/1268074477 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe83c09c290 con 0x7fe84c1013f0 2024-06-06T03:25:47.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.815+0000 7fe850dae700 1 -- 172.21.15.50:0/1268074477 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fe84c06a880 con 0x7fe8340a2c20 2024-06-06T03:25:47.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.829+0000 7fe83b7fe700 1 -- 172.21.15.50:0/1268074477 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7fe84c06a880 con 0x7fe8340a2c20 2024-06-06T03:25:47.828 INFO:teuthology.orchestra.run.smithi050.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-06T03:25:47.828 INFO:teuthology.orchestra.run.smithi050.stdout:mds.a smithi050 running (3m) 35s ago 3m 13.6M - 19.0.0-2946-g3d89accf b045ac545f82 624c20db84ee 2024-06-06T03:25:47.828 INFO:teuthology.orchestra.run.smithi050.stdout:mds.b smithi079 running (3m) 70s ago 3m 18.5M - 19.0.0-2946-g3d89accf b045ac545f82 4aa3980a15ca 2024-06-06T03:25:47.828 INFO:teuthology.orchestra.run.smithi050.stdout:mds.c smithi122 running (3m) 70s ago 3m 18.7M - 19.0.0-2946-g3d89accf b045ac545f82 ebf5370b21a8 2024-06-06T03:25:47.828 INFO:teuthology.orchestra.run.smithi050.stdout:mds.d smithi050 running (3m) 35s ago 3m 14.5M - 19.0.0-2946-g3d89accf b045ac545f82 af5d27ce8633 2024-06-06T03:25:47.828 INFO:teuthology.orchestra.run.smithi050.stdout:mds.e smithi079 running (3m) 70s ago 3m 14.5M - 19.0.0-2946-g3d89accf b045ac545f82 099ff0774819 2024-06-06T03:25:47.828 INFO:teuthology.orchestra.run.smithi050.stdout:mds.f smithi122 running (3m) 70s ago 3m 17.8M - 19.0.0-2946-g3d89accf b045ac545f82 7166a28c57a1 2024-06-06T03:25:47.829 INFO:teuthology.orchestra.run.smithi050.stdout:mds.g smithi050 running (3m) 35s ago 3m 14.4M - 19.0.0-2946-g3d89accf b045ac545f82 8a7835e5a2ab 2024-06-06T03:25:47.829 INFO:teuthology.orchestra.run.smithi050.stdout:mds.h smithi079 running (3m) 70s ago 3m 17.5M - 19.0.0-2946-g3d89accf b045ac545f82 ad37c9a33c0d 2024-06-06T03:25:47.829 INFO:teuthology.orchestra.run.smithi050.stdout:mds.i smithi122 running (3m) 70s ago 3m 26.5M - 19.0.0-2946-g3d89accf b045ac545f82 fdbaaaa092f7 2024-06-06T03:25:47.829 INFO:teuthology.orchestra.run.smithi050.stdout:mds.j smithi050 running (3m) 35s ago 3m 14.5M - 19.0.0-2946-g3d89accf b045ac545f82 29b68f57afbb 2024-06-06T03:25:47.829 INFO:teuthology.orchestra.run.smithi050.stdout:mds.k smithi079 running (3m) 70s ago 3m 14.6M - 19.0.0-2946-g3d89accf b045ac545f82 ffda9cce8184 2024-06-06T03:25:47.829 INFO:teuthology.orchestra.run.smithi050.stdout:mds.l smithi122 running (4m) 70s ago 4m 20.0M - 19.0.0-2946-g3d89accf b045ac545f82 12f963a3dbd1 2024-06-06T03:25:47.829 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.x smithi050 *:9283,8765 running (11m) 35s ago 11m 518M - 19.0.0-2946-g3d89accf b045ac545f82 aec415784ccd 2024-06-06T03:25:47.829 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.y smithi079 *:8443,8765 running (9m) 70s ago 9m 453M - 19.0.0-2946-g3d89accf b045ac545f82 512ba03023ae 2024-06-06T03:25:47.829 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.z smithi122 *:8443,8765 running (9m) 70s ago 9m 454M - 19.0.0-2946-g3d89accf b045ac545f82 192ca4dae596 2024-06-06T03:25:47.829 INFO:teuthology.orchestra.run.smithi050.stdout:mon.a smithi050 running (11m) 35s ago 11m 50.0M 2048M 19.0.0-2946-g3d89accf b045ac545f82 b4c44489782c 2024-06-06T03:25:47.829 INFO:teuthology.orchestra.run.smithi050.stdout:mon.b smithi079 running (9m) 70s ago 9m 41.9M 2048M 19.0.0-2946-g3d89accf b045ac545f82 186ca630d878 2024-06-06T03:25:47.829 INFO:teuthology.orchestra.run.smithi050.stdout:mon.c smithi122 running (9m) 70s ago 9m 39.8M 2048M 19.0.0-2946-g3d89accf b045ac545f82 ef50acc7ae04 2024-06-06T03:25:47.829 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0 smithi050 running (9m) 35s ago 9m 58.2M 4273M 19.0.0-2946-g3d89accf b045ac545f82 07b05038d353 2024-06-06T03:25:47.829 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1 smithi079 running (8m) 70s ago 8m 47.6M 4272M 19.0.0-2946-g3d89accf b045ac545f82 8179071c39bc 2024-06-06T03:25:47.830 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2 smithi122 running (8m) 70s ago 8m 60.1M 4272M 19.0.0-2946-g3d89accf b045ac545f82 03cdbf692bdf 2024-06-06T03:25:47.830 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3 smithi050 running (7m) 35s ago 7m 45.3M 4273M 19.0.0-2946-g3d89accf b045ac545f82 b8fdc02d8d35 2024-06-06T03:25:47.830 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4 smithi079 running (7m) 70s ago 7m 57.2M 4272M 19.0.0-2946-g3d89accf b045ac545f82 47695248837a 2024-06-06T03:25:47.830 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5 smithi122 running (7m) 70s ago 7m 57.1M 4272M 19.0.0-2946-g3d89accf b045ac545f82 378ee619c73f 2024-06-06T03:25:47.830 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6 smithi050 running (6m) 35s ago 6m 53.8M 4273M 19.0.0-2946-g3d89accf b045ac545f82 e081103a6ae6 2024-06-06T03:25:47.830 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7 smithi079 running (6m) 70s ago 6m 55.4M 4272M 19.0.0-2946-g3d89accf b045ac545f82 14abe7e808e0 2024-06-06T03:25:47.830 INFO:teuthology.orchestra.run.smithi050.stdout:osd.8 smithi122 running (5m) 70s ago 5m 46.7M 4272M 19.0.0-2946-g3d89accf b045ac545f82 365868d1b89b 2024-06-06T03:25:47.830 INFO:teuthology.orchestra.run.smithi050.stdout:osd.9 smithi050 running (5m) 35s ago 5m 41.8M 4273M 19.0.0-2946-g3d89accf b045ac545f82 6227cb3a6be4 2024-06-06T03:25:47.830 INFO:teuthology.orchestra.run.smithi050.stdout:osd.10 smithi079 running (4m) 70s ago 4m 44.3M 4272M 19.0.0-2946-g3d89accf b045ac545f82 d43231e5bd63 2024-06-06T03:25:47.830 INFO:teuthology.orchestra.run.smithi050.stdout:osd.11 smithi122 running (4m) 70s ago 4m 53.8M 4272M 19.0.0-2946-g3d89accf b045ac545f82 ab61ba736531 2024-06-06T03:25:47.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.831+0000 7fe850dae700 1 -- 172.21.15.50:0/1268074477 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe8340a2c20 msgr2=0x7fe8340a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:47.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.831+0000 7fe850dae700 1 --2- 172.21.15.50:0/1268074477 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe8340a2c20 0x7fe8340a50e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe840000c00 tx=0x7fe840005fb0 comp rx=0 tx=0).stop 2024-06-06T03:25:47.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.831+0000 7fe850dae700 1 -- 172.21.15.50:0/1268074477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe84c1013f0 msgr2=0x7fe84c105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:47.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.831+0000 7fe850dae700 1 --2- 172.21.15.50:0/1268074477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe84c1013f0 0x7fe84c105380 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe83c00e970 tx=0x7fe83c00ec80 comp rx=0 tx=0).stop 2024-06-06T03:25:47.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.831+0000 7fe850dae700 1 -- 172.21.15.50:0/1268074477 shutdown_connections 2024-06-06T03:25:47.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.831+0000 7fe850dae700 1 --2- 172.21.15.50:0/1268074477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe84c102f90 0x7fe84c103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:47.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.831+0000 7fe850dae700 1 --2- 172.21.15.50:0/1268074477 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe8340a2c20 0x7fe8340a50e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:47.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.831+0000 7fe850dae700 1 --2- 172.21.15.50:0/1268074477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe84c1013f0 0x7fe84c105380 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:47.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.831+0000 7fe850dae700 1 --2- 172.21.15.50:0/1268074477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe84c1025f0 0x7fe84c1039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:47.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.831+0000 7fe850dae700 1 -- 172.21.15.50:0/1268074477 >> 172.21.15.50:0/1268074477 conn(0x7fe84c0fc990 msgr2=0x7fe84c06a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:47.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.832+0000 7fe850dae700 1 -- 172.21.15.50:0/1268074477 shutdown_connections 2024-06-06T03:25:47.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:47.832+0000 7fe850dae700 1 -- 172.21.15.50:0/1268074477 wait complete. 2024-06-06T03:25:48.537 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch ls' 2024-06-06T03:25:48.789 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:25:49.246 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:49 smithi050 ceph-mon[32421]: pgmap v406: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:25:49.246 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:49 smithi050 ceph-mon[32421]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:25:49.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:49 smithi079 ceph-mon[35478]: pgmap v406: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:25:49.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:49 smithi079 ceph-mon[35478]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:25:49.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:49 smithi122 ceph-mon[35759]: pgmap v406: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:25:49.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:49 smithi122 ceph-mon[35759]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:25:50.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.424+0000 7f6dacc85700 1 -- 172.21.15.50:0/973773256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6da8104080 msgr2=0x7f6da810a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:50.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.424+0000 7f6dacc85700 1 --2- 172.21.15.50:0/973773256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6da8104080 0x7f6da810a930 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6da000b0d0 tx=0x7f6da000b3e0 comp rx=0 tx=0).stop 2024-06-06T03:25:50.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.424+0000 7f6dacc85700 1 -- 172.21.15.50:0/973773256 shutdown_connections 2024-06-06T03:25:50.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.424+0000 7f6dacc85700 1 --2- 172.21.15.50:0/973773256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6da8104080 0x7f6da810a930 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:50.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.424+0000 7f6dacc85700 1 --2- 172.21.15.50:0/973773256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6da81024e0 0x7f6da8102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:50.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.424+0000 7f6dacc85700 1 --2- 172.21.15.50:0/973773256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6da81036e0 0x7f6da8103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:50.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.424+0000 7f6dacc85700 1 -- 172.21.15.50:0/973773256 >> 172.21.15.50:0/973773256 conn(0x7f6da80fda80 msgr2=0x7f6da80ffec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:50.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.424+0000 7f6dacc85700 1 -- 172.21.15.50:0/973773256 shutdown_connections 2024-06-06T03:25:50.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.424+0000 7f6dacc85700 1 -- 172.21.15.50:0/973773256 wait complete. 2024-06-06T03:25:50.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.425+0000 7f6dacc85700 1 Processor -- start 2024-06-06T03:25:50.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.425+0000 7f6dacc85700 1 -- start start 2024-06-06T03:25:50.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.425+0000 7f6dacc85700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6da81024e0 0x7f6da8076230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:50.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.425+0000 7f6dacc85700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6da81036e0 0x7f6da8074880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:50.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.425+0000 7f6dacc85700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6da8104080 0x7f6da8074dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:50.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.425+0000 7f6dacc85700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6da810dfd0 con 0x7f6da8104080 2024-06-06T03:25:50.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.425+0000 7f6dacc85700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6da810de50 con 0x7f6da81036e0 2024-06-06T03:25:50.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.425+0000 7f6dacc85700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6da810e150 con 0x7f6da81024e0 2024-06-06T03:25:50.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.425+0000 7f6da6d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6da8104080 0x7f6da8074dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:50.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.425+0000 7f6da6d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6da8104080 0x7f6da8074dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51418/0 (socket says 172.21.15.50:51418) 2024-06-06T03:25:50.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.425+0000 7f6da6d9d700 1 -- 172.21.15.50:0/1241182439 learned_addr learned my addr 172.21.15.50:0/1241182439 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:50.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.425+0000 7f6da659c700 1 --2- 172.21.15.50:0/1241182439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6da81024e0 0x7f6da8076230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:50.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.426+0000 7f6d9ffff700 1 --2- 172.21.15.50:0/1241182439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6da81036e0 0x7f6da8074880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.426+0000 7f6da6d9d700 1 -- 172.21.15.50:0/1241182439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6da81024e0 msgr2=0x7f6da8076230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.426+0000 7f6da6d9d700 1 --2- 172.21.15.50:0/1241182439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6da81024e0 0x7f6da8076230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.426+0000 7f6da6d9d700 1 -- 172.21.15.50:0/1241182439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6da81036e0 msgr2=0x7f6da8074880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.426+0000 7f6da6d9d700 1 --2- 172.21.15.50:0/1241182439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6da81036e0 0x7f6da8074880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.426+0000 7f6da6d9d700 1 -- 172.21.15.50:0/1241182439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da8075670 con 0x7f6da8104080 2024-06-06T03:25:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.426+0000 7f6da6d9d700 1 --2- 172.21.15.50:0/1241182439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6da8104080 0x7f6da8074dc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6da0004c80 tx=0x7f6da0004cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.426+0000 7f6d9f7fe700 1 -- 172.21.15.50:0/1241182439 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da001f030 con 0x7f6da8104080 2024-06-06T03:25:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.426+0000 7f6d9f7fe700 1 -- 172.21.15.50:0/1241182439 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6da0005040 con 0x7f6da8104080 2024-06-06T03:25:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.426+0000 7f6d9f7fe700 1 -- 172.21.15.50:0/1241182439 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da001b690 con 0x7f6da8104080 2024-06-06T03:25:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.426+0000 7f6dacc85700 1 -- 172.21.15.50:0/1241182439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6da81a2740 con 0x7f6da8104080 2024-06-06T03:25:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.426+0000 7f6dacc85700 1 -- 172.21.15.50:0/1241182439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6da81a2b90 con 0x7f6da8104080 2024-06-06T03:25:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.427+0000 7f6dacc85700 1 -- 172.21.15.50:0/1241182439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6da8069180 con 0x7f6da8104080 2024-06-06T03:25:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.429+0000 7f6d9f7fe700 1 -- 172.21.15.50:0/1241182439 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6da0022030 con 0x7f6da8104080 2024-06-06T03:25:50.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.429+0000 7f6d9f7fe700 1 --2- 172.21.15.50:0/1241182439 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6d940a2ca0 0x7f6d940a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:50.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.429+0000 7f6da659c700 1 --2- 172.21.15.50:0/1241182439 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6d940a2ca0 0x7f6d940a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:50.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.429+0000 7f6d9f7fe700 1 -- 172.21.15.50:0/1241182439 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f6da000f020 con 0x7f6da8104080 2024-06-06T03:25:50.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.430+0000 7f6da659c700 1 --2- 172.21.15.50:0/1241182439 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6d940a2ca0 0x7f6d940a5160 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6da8103540 tx=0x7f6d9800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:50.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.433+0000 7f6d9f7fe700 1 -- 172.21.15.50:0/1241182439 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6da0029020 con 0x7f6da8104080 2024-06-06T03:25:50.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.646+0000 7f6dacc85700 1 -- 172.21.15.50:0/1241182439 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f6da80628d0 con 0x7f6d940a2ca0 2024-06-06T03:25:50.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.652+0000 7f6d9f7fe700 1 -- 172.21.15.50:0/1241182439 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f6da80628d0 con 0x7f6d940a2ca0 2024-06-06T03:25:50.651 INFO:teuthology.orchestra.run.smithi050.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-06-06T03:25:50.651 INFO:teuthology.orchestra.run.smithi050.stdout:mds.all 12/12 73s ago 4m smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi079=b;smithi079=e;smithi079=h;smithi079=k;smithi122=c;smithi122=f;smithi122=i;smithi122=l;count:12 2024-06-06T03:25:50.651 INFO:teuthology.orchestra.run.smithi050.stdout:mgr 3/3 73s ago 9m smithi050=x;smithi079=y;smithi122=z;count:3 2024-06-06T03:25:50.651 INFO:teuthology.orchestra.run.smithi050.stdout:mon 3/3 73s ago 9m smithi050:172.21.15.50=a;smithi079:172.21.15.79=b;smithi122:172.21.15.122=c;count:3 2024-06-06T03:25:50.651 INFO:teuthology.orchestra.run.smithi050.stdout:osd 12 73s ago - 2024-06-06T03:25:50.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.654+0000 7f6dacc85700 1 -- 172.21.15.50:0/1241182439 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6d940a2ca0 msgr2=0x7f6d940a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:50.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.654+0000 7f6dacc85700 1 --2- 172.21.15.50:0/1241182439 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6d940a2ca0 0x7f6d940a5160 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6da8103540 tx=0x7f6d9800b410 comp rx=0 tx=0).stop 2024-06-06T03:25:50.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.654+0000 7f6dacc85700 1 -- 172.21.15.50:0/1241182439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6da8104080 msgr2=0x7f6da8074dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:50.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.654+0000 7f6dacc85700 1 --2- 172.21.15.50:0/1241182439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6da8104080 0x7f6da8074dc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6da0004c80 tx=0x7f6da0004cb0 comp rx=0 tx=0).stop 2024-06-06T03:25:50.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.654+0000 7f6dacc85700 1 -- 172.21.15.50:0/1241182439 shutdown_connections 2024-06-06T03:25:50.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.654+0000 7f6dacc85700 1 --2- 172.21.15.50:0/1241182439 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6d940a2ca0 0x7f6d940a5160 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:50.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.654+0000 7f6dacc85700 1 --2- 172.21.15.50:0/1241182439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6da8104080 0x7f6da8074dc0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:50.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.654+0000 7f6dacc85700 1 --2- 172.21.15.50:0/1241182439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6da81024e0 0x7f6da8076230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:50.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.654+0000 7f6dacc85700 1 --2- 172.21.15.50:0/1241182439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6da81036e0 0x7f6da8074880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:50.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.654+0000 7f6dacc85700 1 -- 172.21.15.50:0/1241182439 >> 172.21.15.50:0/1241182439 conn(0x7f6da80fda80 msgr2=0x7f6da8106a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:50.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.654+0000 7f6dacc85700 1 -- 172.21.15.50:0/1241182439 shutdown_connections 2024-06-06T03:25:50.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:50.654+0000 7f6dacc85700 1 -- 172.21.15.50:0/1241182439 wait complete. 2024-06-06T03:25:51.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:51 smithi050 ceph-mon[32421]: pgmap v407: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:25:51.306 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch host ls' 2024-06-06T03:25:51.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:51 smithi079 ceph-mon[35478]: pgmap v407: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:25:51.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:51 smithi122 ceph-mon[35759]: pgmap v407: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:25:51.556 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:25:52.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:52 smithi079 ceph-mon[35478]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:25:52.368 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:52 smithi050 ceph-mon[32421]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:25:52.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:52 smithi122 ceph-mon[35759]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:25:53.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:53 smithi050 ceph-mon[32421]: pgmap v408: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:25:53.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.252+0000 7f4602049700 1 -- 172.21.15.50:0/3284866954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45fc101d60 msgr2=0x7f45fc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:53.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.252+0000 7f4602049700 1 --2- 172.21.15.50:0/3284866954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45fc101d60 0x7f45fc1021c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f45e40099c0 tx=0x7f45e4009cd0 comp rx=0 tx=0).stop 2024-06-06T03:25:53.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.252+0000 7f4602049700 1 -- 172.21.15.50:0/3284866954 shutdown_connections 2024-06-06T03:25:53.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.252+0000 7f4602049700 1 --2- 172.21.15.50:0/3284866954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45fc102700 0x7f45fc108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:53.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.252+0000 7f4602049700 1 --2- 172.21.15.50:0/3284866954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45fc100b60 0x7f45fc100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:53.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.252+0000 7f4602049700 1 --2- 172.21.15.50:0/3284866954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45fc101d60 0x7f45fc1021c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:53.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.252+0000 7f4602049700 1 -- 172.21.15.50:0/3284866954 >> 172.21.15.50:0/3284866954 conn(0x7f45fc0fc120 msgr2=0x7f45fc0fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:53.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.252+0000 7f4602049700 1 -- 172.21.15.50:0/3284866954 shutdown_connections 2024-06-06T03:25:53.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.252+0000 7f4602049700 1 -- 172.21.15.50:0/3284866954 wait complete. 2024-06-06T03:25:53.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.253+0000 7f4602049700 1 Processor -- start 2024-06-06T03:25:53.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.253+0000 7f4602049700 1 -- start start 2024-06-06T03:25:53.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.253+0000 7f4602049700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45fc100b60 0x7f45fc104af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:53.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.253+0000 7f4602049700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45fc101d60 0x7f45fc103140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:53.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.254+0000 7f4602049700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45fc102700 0x7f45fc103680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:53.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.254+0000 7f4602049700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc10ce60 con 0x7f45fc100b60 2024-06-06T03:25:53.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.254+0000 7f4602049700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc10cce0 con 0x7f45fc101d60 2024-06-06T03:25:53.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.254+0000 7f4602049700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc10cfe0 con 0x7f45fc102700 2024-06-06T03:25:53.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.254+0000 7f45fb7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45fc100b60 0x7f45fc104af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:53.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.254+0000 7f45f2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45fc101d60 0x7f45fc103140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:53.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.254+0000 7f45f2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45fc101d60 0x7f45fc103140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:43056/0 (socket says 172.21.15.50:43056) 2024-06-06T03:25:53.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.254+0000 7f45f2ffd700 1 -- 172.21.15.50:0/1216577156 learned_addr learned my addr 172.21.15.50:0/1216577156 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:53.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.254+0000 7f45fbfff700 1 --2- 172.21.15.50:0/1216577156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45fc102700 0x7f45fc103680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:53.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.254+0000 7f45f2ffd700 1 -- 172.21.15.50:0/1216577156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45fc102700 msgr2=0x7f45fc103680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:53.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.254+0000 7f45f2ffd700 1 --2- 172.21.15.50:0/1216577156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45fc102700 0x7f45fc103680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:53.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.254+0000 7f45f2ffd700 1 -- 172.21.15.50:0/1216577156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45fc100b60 msgr2=0x7f45fc104af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:53.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.254+0000 7f45f2ffd700 1 --2- 172.21.15.50:0/1216577156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45fc100b60 0x7f45fc104af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:53.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.254+0000 7f45f2ffd700 1 -- 172.21.15.50:0/1216577156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45fc103f30 con 0x7f45fc101d60 2024-06-06T03:25:53.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.254+0000 7f45fb7fe700 1 --2- 172.21.15.50:0/1216577156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45fc100b60 0x7f45fc104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:25:53.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.254+0000 7f45f2ffd700 1 --2- 172.21.15.50:0/1216577156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45fc101d60 0x7f45fc103140 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f45e4006010 tx=0x7f45e40047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:53.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.255+0000 7f45f97fa700 1 -- 172.21.15.50:0/1216577156 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e4027070 con 0x7f45fc101d60 2024-06-06T03:25:53.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.255+0000 7f45f97fa700 1 -- 172.21.15.50:0/1216577156 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f45e4004050 con 0x7f45fc101d60 2024-06-06T03:25:53.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.255+0000 7f4602049700 1 -- 172.21.15.50:0/1216577156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45fc1a2740 con 0x7f45fc101d60 2024-06-06T03:25:53.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.255+0000 7f45f97fa700 1 -- 172.21.15.50:0/1216577156 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e4022cf0 con 0x7f45fc101d60 2024-06-06T03:25:53.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.255+0000 7f4602049700 1 -- 172.21.15.50:0/1216577156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45fc1a2b90 con 0x7f45fc101d60 2024-06-06T03:25:53.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.256+0000 7f4602049700 1 -- 172.21.15.50:0/1216577156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45fc069180 con 0x7f45fc101d60 2024-06-06T03:25:53.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.258+0000 7f45f97fa700 1 -- 172.21.15.50:0/1216577156 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f45e402a070 con 0x7f45fc101d60 2024-06-06T03:25:53.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.258+0000 7f45f97fa700 1 --2- 172.21.15.50:0/1216577156 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f45e80a2ca0 0x7f45e80a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:53.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.258+0000 7f45f97fa700 1 -- 172.21.15.50:0/1216577156 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f45e40d0220 con 0x7f45fc101d60 2024-06-06T03:25:53.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.259+0000 7f45fb7fe700 1 --2- 172.21.15.50:0/1216577156 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f45e80a2ca0 0x7f45e80a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:53.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.259+0000 7f45fb7fe700 1 --2- 172.21.15.50:0/1216577156 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f45e80a2ca0 0x7f45e80a5160 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f45fc101bc0 tx=0x7f45ec00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:53.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.261+0000 7f45f97fa700 1 -- 172.21.15.50:0/1216577156 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f45e4013070 con 0x7f45fc101d60 2024-06-06T03:25:53.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:53 smithi079 ceph-mon[35478]: pgmap v408: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:25:53.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:53 smithi122 ceph-mon[35759]: pgmap v408: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:25:53.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.476+0000 7f4602049700 1 -- 172.21.15.50:0/1216577156 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f45fc0fe340 con 0x7f45e80a2ca0 2024-06-06T03:25:53.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.478+0000 7f45f97fa700 1 -- 172.21.15.50:0/1216577156 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f45fc0fe340 con 0x7f45e80a2ca0 2024-06-06T03:25:53.477 INFO:teuthology.orchestra.run.smithi050.stdout:HOST ADDR LABELS STATUS 2024-06-06T03:25:53.477 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050 172.21.15.50 2024-06-06T03:25:53.477 INFO:teuthology.orchestra.run.smithi050.stdout:smithi079 172.21.15.79 2024-06-06T03:25:53.477 INFO:teuthology.orchestra.run.smithi050.stdout:smithi122 172.21.15.122 2024-06-06T03:25:53.477 INFO:teuthology.orchestra.run.smithi050.stdout:3 hosts in cluster 2024-06-06T03:25:53.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.480+0000 7f4602049700 1 -- 172.21.15.50:0/1216577156 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f45e80a2ca0 msgr2=0x7f45e80a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:53.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.480+0000 7f4602049700 1 --2- 172.21.15.50:0/1216577156 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f45e80a2ca0 0x7f45e80a5160 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f45fc101bc0 tx=0x7f45ec00b410 comp rx=0 tx=0).stop 2024-06-06T03:25:53.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.480+0000 7f4602049700 1 -- 172.21.15.50:0/1216577156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45fc101d60 msgr2=0x7f45fc103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:53.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.480+0000 7f4602049700 1 --2- 172.21.15.50:0/1216577156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45fc101d60 0x7f45fc103140 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f45e4006010 tx=0x7f45e40047b0 comp rx=0 tx=0).stop 2024-06-06T03:25:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.480+0000 7f4602049700 1 -- 172.21.15.50:0/1216577156 shutdown_connections 2024-06-06T03:25:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.480+0000 7f4602049700 1 --2- 172.21.15.50:0/1216577156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45fc102700 0x7f45fc103680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.480+0000 7f4602049700 1 --2- 172.21.15.50:0/1216577156 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f45e80a2ca0 0x7f45e80a5160 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.480+0000 7f4602049700 1 --2- 172.21.15.50:0/1216577156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45fc100b60 0x7f45fc104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.480+0000 7f4602049700 1 --2- 172.21.15.50:0/1216577156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45fc101d60 0x7f45fc103140 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.480+0000 7f4602049700 1 -- 172.21.15.50:0/1216577156 >> 172.21.15.50:0/1216577156 conn(0x7f45fc0fc120 msgr2=0x7f45fc0fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.480+0000 7f4602049700 1 -- 172.21.15.50:0/1216577156 shutdown_connections 2024-06-06T03:25:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:53.480+0000 7f4602049700 1 -- 172.21.15.50:0/1216577156 wait complete. 2024-06-06T03:25:54.207 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch device ls' 2024-06-06T03:25:54.462 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:25:55.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:55 smithi050 ceph-mon[32421]: pgmap v409: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T03:25:55.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:55 smithi050 ceph-mon[32421]: from='client.24806 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:25:55.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:55 smithi079 ceph-mon[35478]: pgmap v409: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T03:25:55.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:55 smithi079 ceph-mon[35478]: from='client.24806 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:25:55.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:55 smithi122 ceph-mon[35759]: pgmap v409: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T03:25:55.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:55 smithi122 ceph-mon[35759]: from='client.24806 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:25:56.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.147+0000 7ff805e1d700 1 -- 172.21.15.50:0/2290025265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8001024f0 msgr2=0x7ff800102910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:56.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.147+0000 7ff805e1d700 1 --2- 172.21.15.50:0/2290025265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8001024f0 0x7ff800102910 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00099c0 tx=0x7ff7f0009cd0 comp rx=0 tx=0).stop 2024-06-06T03:25:56.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.148+0000 7ff805e1d700 1 -- 172.21.15.50:0/2290025265 shutdown_connections 2024-06-06T03:25:56.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.148+0000 7ff805e1d700 1 --2- 172.21.15.50:0/2290025265 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff800104090 0x7ff80010a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:56.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.148+0000 7ff805e1d700 1 --2- 172.21.15.50:0/2290025265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8001024f0 0x7ff800102910 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:56.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.148+0000 7ff805e1d700 1 --2- 172.21.15.50:0/2290025265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8001036f0 0x7ff800103b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:56.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.148+0000 7ff805e1d700 1 -- 172.21.15.50:0/2290025265 >> 172.21.15.50:0/2290025265 conn(0x7ff8000fda90 msgr2=0x7ff8000ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:56.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.148+0000 7ff805e1d700 1 -- 172.21.15.50:0/2290025265 shutdown_connections 2024-06-06T03:25:56.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.148+0000 7ff805e1d700 1 -- 172.21.15.50:0/2290025265 wait complete. 2024-06-06T03:25:56.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.148+0000 7ff805e1d700 1 Processor -- start 2024-06-06T03:25:56.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.148+0000 7ff805e1d700 1 -- start start 2024-06-06T03:25:56.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.148+0000 7ff805e1d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8001024f0 0x7ff80019a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:56.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.149+0000 7ff805e1d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8001036f0 0x7ff80019ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:56.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.149+0000 7ff805e1d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff800104090 0x7ff8001a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:56.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.149+0000 7ff805e1d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff80010dff0 con 0x7ff8001024f0 2024-06-06T03:25:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.149+0000 7ff805e1d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff80010de70 con 0x7ff8001036f0 2024-06-06T03:25:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.149+0000 7ff805e1d700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff80010e170 con 0x7ff800104090 2024-06-06T03:25:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.149+0000 7ff7ff7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8001024f0 0x7ff80019a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.149+0000 7ff7ff7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8001024f0 0x7ff80019a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51446/0 (socket says 172.21.15.50:51446) 2024-06-06T03:25:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.149+0000 7ff7ff7fe700 1 -- 172.21.15.50:0/3471658231 learned_addr learned my addr 172.21.15.50:0/3471658231 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.149+0000 7ff7fffff700 1 --2- 172.21.15.50:0/3471658231 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff800104090 0x7ff8001a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.149+0000 7ff7feffd700 1 --2- 172.21.15.50:0/3471658231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8001036f0 0x7ff80019ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.149+0000 7ff7ff7fe700 1 -- 172.21.15.50:0/3471658231 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff800104090 msgr2=0x7ff8001a1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.149+0000 7ff7ff7fe700 1 --2- 172.21.15.50:0/3471658231 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff800104090 0x7ff8001a1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.149+0000 7ff7ff7fe700 1 -- 172.21.15.50:0/3471658231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8001036f0 msgr2=0x7ff80019ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.149+0000 7ff7ff7fe700 1 --2- 172.21.15.50:0/3471658231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8001036f0 0x7ff80019ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.149+0000 7ff7ff7fe700 1 -- 172.21.15.50:0/3471658231 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8001a2560 con 0x7ff8001024f0 2024-06-06T03:25:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.149+0000 7ff7fffff700 1 --2- 172.21.15.50:0/3471658231 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff800104090 0x7ff8001a1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:25:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.149+0000 7ff7ff7fe700 1 --2- 172.21.15.50:0/3471658231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8001024f0 0x7ff80019a900 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0005b10 tx=0x7ff7f0009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.149+0000 7ff7fcff9700 1 -- 172.21.15.50:0/3471658231 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0027070 con 0x7ff8001024f0 2024-06-06T03:25:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.149+0000 7ff7fcff9700 1 -- 172.21.15.50:0/3471658231 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff7f00040d0 con 0x7ff8001024f0 2024-06-06T03:25:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.149+0000 7ff805e1d700 1 -- 172.21.15.50:0/3471658231 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8001a27f0 con 0x7ff8001024f0 2024-06-06T03:25:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.150+0000 7ff7fcff9700 1 -- 172.21.15.50:0/3471658231 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0022d50 con 0x7ff8001024f0 2024-06-06T03:25:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.150+0000 7ff805e1d700 1 -- 172.21.15.50:0/3471658231 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8001a2d20 con 0x7ff8001024f0 2024-06-06T03:25:56.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.150+0000 7ff805e1d700 1 -- 172.21.15.50:0/3471658231 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff800069180 con 0x7ff8001024f0 2024-06-06T03:25:56.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.152+0000 7ff7fcff9700 1 -- 172.21.15.50:0/3471658231 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff7f002a070 con 0x7ff8001024f0 2024-06-06T03:25:56.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.153+0000 7ff7fcff9700 1 --2- 172.21.15.50:0/3471658231 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff7e80a2ca0 0x7ff7e80a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:56.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.153+0000 7ff7fcff9700 1 -- 172.21.15.50:0/3471658231 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7ff7f00d0780 con 0x7ff8001024f0 2024-06-06T03:25:56.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.153+0000 7ff7feffd700 1 --2- 172.21.15.50:0/3471658231 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff7e80a2ca0 0x7ff7e80a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:56.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.153+0000 7ff7feffd700 1 --2- 172.21.15.50:0/3471658231 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff7e80a2ca0 0x7ff7e80a5160 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff7f400bbd0 tx=0x7ff7f400b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:56.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.156+0000 7ff7fcff9700 1 -- 172.21.15.50:0/3471658231 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff7f0031070 con 0x7ff8001024f0 2024-06-06T03:25:56.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.370+0000 7ff805e1d700 1 -- 172.21.15.50:0/3471658231 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7ff80010a650 con 0x7ff7e80a2ca0 2024-06-06T03:25:56.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.372+0000 7ff7fcff9700 1 -- 172.21.15.50:0/3471658231 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7ff80010a650 con 0x7ff7e80a2ca0 2024-06-06T03:25:56.371 INFO:teuthology.orchestra.run.smithi050.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-06-06T03:25:56.371 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513001F480DGN 447G No 5m ago Has a FileSystem, LVM detected 2024-06-06T03:25:56.371 INFO:teuthology.orchestra.run.smithi050.stdout:smithi079 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204013G400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-06-06T03:25:56.371 INFO:teuthology.orchestra.run.smithi050.stdout:smithi122 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204010U400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-06-06T03:25:56.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.374+0000 7ff805e1d700 1 -- 172.21.15.50:0/3471658231 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff7e80a2ca0 msgr2=0x7ff7e80a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:56.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.374+0000 7ff805e1d700 1 --2- 172.21.15.50:0/3471658231 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff7e80a2ca0 0x7ff7e80a5160 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff7f400bbd0 tx=0x7ff7f400b5b0 comp rx=0 tx=0).stop 2024-06-06T03:25:56.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.374+0000 7ff805e1d700 1 -- 172.21.15.50:0/3471658231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8001024f0 msgr2=0x7ff80019a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:56.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.374+0000 7ff805e1d700 1 --2- 172.21.15.50:0/3471658231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8001024f0 0x7ff80019a900 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0005b10 tx=0x7ff7f0009580 comp rx=0 tx=0).stop 2024-06-06T03:25:56.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.374+0000 7ff805e1d700 1 -- 172.21.15.50:0/3471658231 shutdown_connections 2024-06-06T03:25:56.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.374+0000 7ff805e1d700 1 --2- 172.21.15.50:0/3471658231 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff800104090 0x7ff8001a1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:56.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.374+0000 7ff805e1d700 1 --2- 172.21.15.50:0/3471658231 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff7e80a2ca0 0x7ff7e80a5160 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:56.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.374+0000 7ff805e1d700 1 --2- 172.21.15.50:0/3471658231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8001024f0 0x7ff80019a900 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:56.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.374+0000 7ff805e1d700 1 --2- 172.21.15.50:0/3471658231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8001036f0 0x7ff80019ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:56.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.374+0000 7ff805e1d700 1 -- 172.21.15.50:0/3471658231 >> 172.21.15.50:0/3471658231 conn(0x7ff8000fda90 msgr2=0x7ff800108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:56.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.374+0000 7ff805e1d700 1 -- 172.21.15.50:0/3471658231 shutdown_connections 2024-06-06T03:25:56.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:56.374+0000 7ff805e1d700 1 -- 172.21.15.50:0/3471658231 wait complete. 2024-06-06T03:25:57.091 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-06-06T03:25:57.101 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi050.front.sepia.ceph.com 2024-06-06T03:25:57.101 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- bash -c 'ceph fs dump' 2024-06-06T03:25:57.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:57 smithi079 ceph-mon[35478]: pgmap v410: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-06-06T03:25:57.360 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:25:57.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:57 smithi122 ceph-mon[35759]: pgmap v410: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-06-06T03:25:57.482 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:57 smithi050 ceph-mon[32421]: pgmap v410: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-06-06T03:25:58.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:58 smithi079 ceph-mon[35478]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:25:58.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:58 smithi122 ceph-mon[35759]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:25:58.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:58 smithi050 ceph-mon[32421]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T03:25:59.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.116+0000 7fa6885c3700 1 -- 172.21.15.50:0/1426388680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa680102f90 msgr2=0x7fa680109840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:59.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.116+0000 7fa6885c3700 1 --2- 172.21.15.50:0/1426388680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa680102f90 0x7fa680109840 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa67800b0d0 tx=0x7fa67800b3e0 comp rx=0 tx=0).stop 2024-06-06T03:25:59.116 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:25:59 smithi050 ceph-mon[32421]: pgmap v411: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:25:59.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.116+0000 7fa6885c3700 1 -- 172.21.15.50:0/1426388680 shutdown_connections 2024-06-06T03:25:59.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.116+0000 7fa6885c3700 1 --2- 172.21.15.50:0/1426388680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa680102f90 0x7fa680109840 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:59.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.116+0000 7fa6885c3700 1 --2- 172.21.15.50:0/1426388680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6801013f0 0x7fa680101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:59.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.116+0000 7fa6885c3700 1 --2- 172.21.15.50:0/1426388680 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa6801025f0 0x7fa680102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:59.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.116+0000 7fa6885c3700 1 -- 172.21.15.50:0/1426388680 >> 172.21.15.50:0/1426388680 conn(0x7fa6800fc990 msgr2=0x7fa6800fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:59.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.116+0000 7fa6885c3700 1 -- 172.21.15.50:0/1426388680 shutdown_connections 2024-06-06T03:25:59.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.116+0000 7fa6885c3700 1 -- 172.21.15.50:0/1426388680 wait complete. 2024-06-06T03:25:59.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.116+0000 7fa6885c3700 1 Processor -- start 2024-06-06T03:25:59.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.117+0000 7fa6885c3700 1 -- start start 2024-06-06T03:25:59.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.117+0000 7fa6885c3700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa6801013f0 0x7fa680105380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:59.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.117+0000 7fa6885c3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6801025f0 0x7fa6801039d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:59.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.117+0000 7fa6885c3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa680102f90 0x7fa680103f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:59.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.117+0000 7fa6885c3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa68010ce80 con 0x7fa680102f90 2024-06-06T03:25:59.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.117+0000 7fa6885c3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa68010cd00 con 0x7fa6801025f0 2024-06-06T03:25:59.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.117+0000 7fa6885c3700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa68010d000 con 0x7fa6801013f0 2024-06-06T03:25:59.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.117+0000 7fa686b60700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa680102f90 0x7fa680103f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:59.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.117+0000 7fa686b60700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa680102f90 0x7fa680103f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41620/0 (socket says 172.21.15.50:41620) 2024-06-06T03:25:59.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.117+0000 7fa686b60700 1 -- 172.21.15.50:0/3373041678 learned_addr learned my addr 172.21.15.50:0/3373041678 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:25:59.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.117+0000 7fa68635f700 1 --2- 172.21.15.50:0/3373041678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa6801013f0 0x7fa680105380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:59.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.117+0000 7fa685b5e700 1 --2- 172.21.15.50:0/3373041678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6801025f0 0x7fa6801039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:59.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.117+0000 7fa686b60700 1 -- 172.21.15.50:0/3373041678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa6801013f0 msgr2=0x7fa680105380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:59.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.117+0000 7fa686b60700 1 --2- 172.21.15.50:0/3373041678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa6801013f0 0x7fa680105380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:59.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.117+0000 7fa686b60700 1 -- 172.21.15.50:0/3373041678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6801025f0 msgr2=0x7fa6801039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:59.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.117+0000 7fa686b60700 1 --2- 172.21.15.50:0/3373041678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6801025f0 0x7fa6801039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:59.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.117+0000 7fa686b60700 1 -- 172.21.15.50:0/3373041678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6801047c0 con 0x7fa680102f90 2024-06-06T03:25:59.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.118+0000 7fa686b60700 1 --2- 172.21.15.50:0/3373041678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa680102f90 0x7fa680103f10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa67800d010 tx=0x7fa678007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:59.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.118+0000 7fa6777fe700 1 -- 172.21.15.50:0/3373041678 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa678021070 con 0x7fa680102f90 2024-06-06T03:25:59.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.118+0000 7fa6777fe700 1 -- 172.21.15.50:0/3373041678 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa67801db00 con 0x7fa680102f90 2024-06-06T03:25:59.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.118+0000 7fa6885c3700 1 -- 172.21.15.50:0/3373041678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6801a26e0 con 0x7fa680102f90 2024-06-06T03:25:59.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.118+0000 7fa6777fe700 1 -- 172.21.15.50:0/3373041678 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67801bb50 con 0x7fa680102f90 2024-06-06T03:25:59.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.118+0000 7fa6885c3700 1 -- 172.21.15.50:0/3373041678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6801a2b40 con 0x7fa680102f90 2024-06-06T03:25:59.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.119+0000 7fa6885c3700 1 -- 172.21.15.50:0/3373041678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa680069180 con 0x7fa680102f90 2024-06-06T03:25:59.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.120+0000 7fa6777fe700 1 -- 172.21.15.50:0/3373041678 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa678024070 con 0x7fa680102f90 2024-06-06T03:25:59.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.121+0000 7fa6777fe700 1 --2- 172.21.15.50:0/3373041678 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa66c0a2c20 0x7fa66c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:25:59.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.121+0000 7fa68635f700 1 --2- 172.21.15.50:0/3373041678 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa66c0a2c20 0x7fa66c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:25:59.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.121+0000 7fa6777fe700 1 -- 172.21.15.50:0/3373041678 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fa6780d0c90 con 0x7fa680102f90 2024-06-06T03:25:59.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.121+0000 7fa68635f700 1 --2- 172.21.15.50:0/3373041678 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa66c0a2c20 0x7fa66c0a50e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa680102450 tx=0x7fa67c00a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:25:59.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.124+0000 7fa6777fe700 1 -- 172.21.15.50:0/3373041678 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa67809d900 con 0x7fa680102f90 2024-06-06T03:25:59.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:25:59 smithi079 ceph-mon[35478]: pgmap v411: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:25:59.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.376+0000 7fa6885c3700 1 -- 172.21.15.50:0/3373041678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fa6801a2f50 con 0x7fa680102f90 2024-06-06T03:25:59.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.377+0000 7fa6777fe700 1 -- 172.21.15.50:0/3373041678 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+3040 (secure 0 0 0) 0x7fa67809d200 con 0x7fa680102f90 2024-06-06T03:25:59.376 INFO:teuthology.orchestra.run.smithi050.stdout:e26 2024-06-06T03:25:59.376 INFO:teuthology.orchestra.run.smithi050.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-06T03:25:59.376 INFO:teuthology.orchestra.run.smithi050.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-06T03:25:59.376 INFO:teuthology.orchestra.run.smithi050.stdout:legacy client fscid: 1 2024-06-06T03:25:59.376 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:25:59.376 INFO:teuthology.orchestra.run.smithi050.stdout:Filesystem 'cephfs' (1) 2024-06-06T03:25:59.376 INFO:teuthology.orchestra.run.smithi050.stdout:fs_name cephfs 2024-06-06T03:25:59.376 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 26 2024-06-06T03:25:59.376 INFO:teuthology.orchestra.run.smithi050.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-06-06T03:25:59.376 INFO:teuthology.orchestra.run.smithi050.stdout:created 2024-06-06T03:22:36.202061+0000 2024-06-06T03:25:59.376 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2024-06-06T03:23:38.564714+0000 2024-06-06T03:25:59.376 INFO:teuthology.orchestra.run.smithi050.stdout:tableserver 0 2024-06-06T03:25:59.377 INFO:teuthology.orchestra.run.smithi050.stdout:root 0 2024-06-06T03:25:59.377 INFO:teuthology.orchestra.run.smithi050.stdout:session_timeout 300 2024-06-06T03:25:59.377 INFO:teuthology.orchestra.run.smithi050.stdout:session_autoclose 300 2024-06-06T03:25:59.377 INFO:teuthology.orchestra.run.smithi050.stdout:max_file_size 1099511627776 2024-06-06T03:25:59.377 INFO:teuthology.orchestra.run.smithi050.stdout:max_xattr_size 65536 2024-06-06T03:25:59.377 INFO:teuthology.orchestra.run.smithi050.stdout:required_client_features {} 2024-06-06T03:25:59.377 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure 0 2024-06-06T03:25:59.377 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure_osd_epoch 0 2024-06-06T03:25:59.377 INFO:teuthology.orchestra.run.smithi050.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-06T03:25:59.377 INFO:teuthology.orchestra.run.smithi050.stdout:max_mds 3 2024-06-06T03:25:59.377 INFO:teuthology.orchestra.run.smithi050.stdout:in 0,1,2 2024-06-06T03:25:59.377 INFO:teuthology.orchestra.run.smithi050.stdout:up {0=24490,1=24472,2=24466} 2024-06-06T03:25:59.377 INFO:teuthology.orchestra.run.smithi050.stdout:failed 2024-06-06T03:25:59.378 INFO:teuthology.orchestra.run.smithi050.stdout:damaged 2024-06-06T03:25:59.378 INFO:teuthology.orchestra.run.smithi050.stdout:stopped 2024-06-06T03:25:59.378 INFO:teuthology.orchestra.run.smithi050.stdout:data_pools [3,4] 2024-06-06T03:25:59.378 INFO:teuthology.orchestra.run.smithi050.stdout:metadata_pool 2 2024-06-06T03:25:59.378 INFO:teuthology.orchestra.run.smithi050.stdout:inline_data disabled 2024-06-06T03:25:59.378 INFO:teuthology.orchestra.run.smithi050.stdout:balancer 2024-06-06T03:25:59.378 INFO:teuthology.orchestra.run.smithi050.stdout:bal_rank_mask -1 2024-06-06T03:25:59.378 INFO:teuthology.orchestra.run.smithi050.stdout:standby_count_wanted 0 2024-06-06T03:25:59.378 INFO:teuthology.orchestra.run.smithi050.stdout:qdb_cluster leader: 24490 members: 24472,24490,24466 2024-06-06T03:25:59.378 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.i{0:24490} state up:active seq 8 addr [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T03:25:59.378 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b{0:24464} state up:standby-replay seq 1 addr [v2:172.21.15.79:6838/768067336,v1:172.21.15.79:6839/768067336] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T03:25:59.378 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.c{1:24472} state up:active seq 23 addr [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T03:25:59.378 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.h{1:24437} state up:standby-replay seq 1 addr [v2:172.21.15.79:6836/3286722213,v1:172.21.15.79:6837/3286722213] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T03:25:59.378 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.f{2:24466} state up:active seq 24 addr [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T03:25:59.379 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.l{2:24427} state up:standby-replay seq 1 addr [v2:172.21.15.122:6832/57533154,v1:172.21.15.122:6833/57533154] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T03:25:59.379 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:25:59.379 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:25:59.379 INFO:teuthology.orchestra.run.smithi050.stdout:Standby daemons: 2024-06-06T03:25:59.379 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:25:59.379 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.j{-1:14553} state up:standby seq 1 addr [v2:172.21.15.50:6834/1667847852,v1:172.21.15.50:6835/1667847852] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T03:25:59.379 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.d{-1:14565} state up:standby seq 1 addr [v2:172.21.15.50:6836/239971838,v1:172.21.15.50:6837/239971838] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T03:25:59.379 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.g{-1:14604} state up:standby seq 1 addr [v2:172.21.15.50:6838/2188134216,v1:172.21.15.50:6839/2188134216] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T03:25:59.379 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a{-1:14616} state up:standby seq 1 addr [v2:172.21.15.50:6840/632572420,v1:172.21.15.50:6841/632572420] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T03:25:59.379 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.k{-1:24389} state up:standby seq 1 addr [v2:172.21.15.79:6832/864537078,v1:172.21.15.79:6833/864537078] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T03:25:59.379 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.e{-1:24410} state up:standby seq 1 addr [v2:172.21.15.79:6834/279268898,v1:172.21.15.79:6835/279268898] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T03:25:59.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.380+0000 7fa6885c3700 1 -- 172.21.15.50:0/3373041678 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa66c0a2c20 msgr2=0x7fa66c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:59.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.380+0000 7fa6885c3700 1 --2- 172.21.15.50:0/3373041678 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa66c0a2c20 0x7fa66c0a50e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa680102450 tx=0x7fa67c00a3b0 comp rx=0 tx=0).stop 2024-06-06T03:25:59.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.380+0000 7fa6885c3700 1 -- 172.21.15.50:0/3373041678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa680102f90 msgr2=0x7fa680103f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:25:59.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.380+0000 7fa6885c3700 1 --2- 172.21.15.50:0/3373041678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa680102f90 0x7fa680103f10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa67800d010 tx=0x7fa678007a20 comp rx=0 tx=0).stop 2024-06-06T03:25:59.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.380+0000 7fa6885c3700 1 -- 172.21.15.50:0/3373041678 shutdown_connections 2024-06-06T03:25:59.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.380+0000 7fa6885c3700 1 --2- 172.21.15.50:0/3373041678 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa66c0a2c20 0x7fa66c0a50e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:59.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.380+0000 7fa6885c3700 1 --2- 172.21.15.50:0/3373041678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa680102f90 0x7fa680103f10 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:59.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.380+0000 7fa6885c3700 1 --2- 172.21.15.50:0/3373041678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa6801013f0 0x7fa680105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:59.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.380+0000 7fa6885c3700 1 --2- 172.21.15.50:0/3373041678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6801025f0 0x7fa6801039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:25:59.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.380+0000 7fa6885c3700 1 -- 172.21.15.50:0/3373041678 >> 172.21.15.50:0/3373041678 conn(0x7fa6800fc990 msgr2=0x7fa6800fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:25:59.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.380+0000 7fa6885c3700 1 -- 172.21.15.50:0/3373041678 shutdown_connections 2024-06-06T03:25:59.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:25:59.380+0000 7fa6885c3700 1 -- 172.21.15.50:0/3373041678 wait complete. 2024-06-06T03:25:59.381 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 26 2024-06-06T03:25:59.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:25:59 smithi122 ceph-mon[35759]: pgmap v411: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:26:00.073 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- bash -c 'ceph osd dump' 2024-06-06T03:26:00.327 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:26:00.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:00 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/3373041678' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-06T03:26:00.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:00 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3373041678' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-06T03:26:00.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:00 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/3373041678' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-06T03:26:01.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:01 smithi122 ceph-mon[35759]: pgmap v412: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:26:01.475 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:01 smithi050 ceph-mon[32421]: pgmap v412: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:26:01.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:01 smithi079 ceph-mon[35478]: pgmap v412: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:26:02.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.033+0000 7fc85aeaf700 1 -- 172.21.15.50:0/2478735286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc854102f50 msgr2=0x7fc854105340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:02.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.033+0000 7fc85aeaf700 1 --2- 172.21.15.50:0/2478735286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc854102f50 0x7fc854105340 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc848009990 tx=0x7fc848009ca0 comp rx=0 tx=0).stop 2024-06-06T03:26:02.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.033+0000 7fc85aeaf700 1 -- 172.21.15.50:0/2478735286 shutdown_connections 2024-06-06T03:26:02.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.033+0000 7fc85aeaf700 1 --2- 172.21.15.50:0/2478735286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8541081b0 0x7fc85410a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:02.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.033+0000 7fc85aeaf700 1 --2- 172.21.15.50:0/2478735286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc854102f50 0x7fc854105340 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:02.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.033+0000 7fc85aeaf700 1 --2- 172.21.15.50:0/2478735286 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc854105880 0x7fc854107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:02.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.033+0000 7fc85aeaf700 1 -- 172.21.15.50:0/2478735286 >> 172.21.15.50:0/2478735286 conn(0x7fc8540fc960 msgr2=0x7fc8540feda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:02.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.033+0000 7fc85aeaf700 1 -- 172.21.15.50:0/2478735286 shutdown_connections 2024-06-06T03:26:02.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.033+0000 7fc85aeaf700 1 -- 172.21.15.50:0/2478735286 wait complete. 2024-06-06T03:26:02.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.034+0000 7fc85aeaf700 1 Processor -- start 2024-06-06T03:26:02.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.034+0000 7fc85aeaf700 1 -- start start 2024-06-06T03:26:02.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.034+0000 7fc85aeaf700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc854102f50 0x7fc85419a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:02.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.034+0000 7fc85aeaf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc854105880 0x7fc85419ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:02.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.034+0000 7fc85aeaf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8541081b0 0x7fc8541a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:02.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.034+0000 7fc85aeaf700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc85410dfc0 con 0x7fc854105880 2024-06-06T03:26:02.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.034+0000 7fc85aeaf700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc85410de40 con 0x7fc8541081b0 2024-06-06T03:26:02.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.034+0000 7fc85aeaf700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc85410e140 con 0x7fc854102f50 2024-06-06T03:26:02.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.034+0000 7fc853fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc854105880 0x7fc85419ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:02.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.034+0000 7fc853fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc854105880 0x7fc85419ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41644/0 (socket says 172.21.15.50:41644) 2024-06-06T03:26:02.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.034+0000 7fc853fff700 1 -- 172.21.15.50:0/3942250252 learned_addr learned my addr 172.21.15.50:0/3942250252 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:02.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.035+0000 7fc85944c700 1 --2- 172.21.15.50:0/3942250252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8541081b0 0x7fc8541a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:02.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.035+0000 7fc858c4b700 1 --2- 172.21.15.50:0/3942250252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc854102f50 0x7fc85419a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:02.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.035+0000 7fc853fff700 1 -- 172.21.15.50:0/3942250252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc854102f50 msgr2=0x7fc85419a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:02.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.035+0000 7fc853fff700 1 --2- 172.21.15.50:0/3942250252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc854102f50 0x7fc85419a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:02.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.035+0000 7fc853fff700 1 -- 172.21.15.50:0/3942250252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8541081b0 msgr2=0x7fc8541a1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:02.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.035+0000 7fc853fff700 1 --2- 172.21.15.50:0/3942250252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8541081b0 0x7fc8541a1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:02.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.035+0000 7fc853fff700 1 -- 172.21.15.50:0/3942250252 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8541a2540 con 0x7fc854105880 2024-06-06T03:26:02.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.035+0000 7fc853fff700 1 --2- 172.21.15.50:0/3942250252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc854105880 0x7fc85419ae20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc84000b560 tx=0x7fc84000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:02.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.035+0000 7fc851ffb700 1 -- 172.21.15.50:0/3942250252 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc840015020 con 0x7fc854105880 2024-06-06T03:26:02.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.035+0000 7fc851ffb700 1 -- 172.21.15.50:0/3942250252 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc840011ce0 con 0x7fc854105880 2024-06-06T03:26:02.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.035+0000 7fc851ffb700 1 -- 172.21.15.50:0/3942250252 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc840010cb0 con 0x7fc854105880 2024-06-06T03:26:02.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.036+0000 7fc85aeaf700 1 -- 172.21.15.50:0/3942250252 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8541a2830 con 0x7fc854105880 2024-06-06T03:26:02.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.036+0000 7fc85aeaf700 1 -- 172.21.15.50:0/3942250252 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8541a2d20 con 0x7fc854105880 2024-06-06T03:26:02.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.037+0000 7fc85aeaf700 1 -- 172.21.15.50:0/3942250252 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc854069180 con 0x7fc854105880 2024-06-06T03:26:02.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.038+0000 7fc851ffb700 1 -- 172.21.15.50:0/3942250252 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc840018020 con 0x7fc854105880 2024-06-06T03:26:02.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.039+0000 7fc851ffb700 1 --2- 172.21.15.50:0/3942250252 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc8440a2c20 0x7fc8440a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:02.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.039+0000 7fc858c4b700 1 --2- 172.21.15.50:0/3942250252 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc8440a2c20 0x7fc8440a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:02.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.039+0000 7fc851ffb700 1 -- 172.21.15.50:0/3942250252 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fc8400ce910 con 0x7fc854105880 2024-06-06T03:26:02.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.039+0000 7fc858c4b700 1 --2- 172.21.15.50:0/3942250252 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc8440a2c20 0x7fc8440a50e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc84800b5c0 tx=0x7fc848003850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:02.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.044+0000 7fc851ffb700 1 -- 172.21.15.50:0/3942250252 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc84001f030 con 0x7fc854105880 2024-06-06T03:26:02.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.250+0000 7fc85aeaf700 1 -- 172.21.15.50:0/3942250252 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fc8540630a0 con 0x7fc854105880 2024-06-06T03:26:02.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.250+0000 7fc851ffb700 1 -- 172.21.15.50:0/3942250252 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v99) ==== 56+0+5611 (secure 0 0 0) 0x7fc84009b490 con 0x7fc854105880 2024-06-06T03:26:02.250 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 99 2024-06-06T03:26:02.251 INFO:teuthology.orchestra.run.smithi050.stdout:fsid b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:26:02.251 INFO:teuthology.orchestra.run.smithi050.stdout:created 2024-06-06T03:14:19.062632+0000 2024-06-06T03:26:02.251 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2024-06-06T03:24:14.691472+0000 2024-06-06T03:26:02.251 INFO:teuthology.orchestra.run.smithi050.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-06-06T03:26:02.251 INFO:teuthology.orchestra.run.smithi050.stdout:crush_version 27 2024-06-06T03:26:02.251 INFO:teuthology.orchestra.run.smithi050.stdout:full_ratio 0.95 2024-06-06T03:26:02.251 INFO:teuthology.orchestra.run.smithi050.stdout:backfillfull_ratio 0.9 2024-06-06T03:26:02.251 INFO:teuthology.orchestra.run.smithi050.stdout:nearfull_ratio 0.85 2024-06-06T03:26:02.251 INFO:teuthology.orchestra.run.smithi050.stdout:require_min_compat_client luminous 2024-06-06T03:26:02.251 INFO:teuthology.orchestra.run.smithi050.stdout:min_compat_client luminous 2024-06-06T03:26:02.251 INFO:teuthology.orchestra.run.smithi050.stdout:require_osd_release squid 2024-06-06T03:26:02.251 INFO:teuthology.orchestra.run.smithi050.stdout:stretch_mode_enabled false 2024-06-06T03:26:02.251 INFO:teuthology.orchestra.run.smithi050.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-06-06T03:26:02.252 INFO:teuthology.orchestra.run.smithi050.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 88 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-06-06T03:26:02.252 INFO:teuthology.orchestra.run.smithi050.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 88 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-06-06T03:26:02.252 INFO:teuthology.orchestra.run.smithi050.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 95 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-06-06T03:26:02.252 INFO:teuthology.orchestra.run.smithi050.stdout:max_osd 12 2024-06-06T03:26:02.252 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0 up in weight 1 up_from 8 up_thru 96 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6802/2379528827,v1:172.21.15.50:6803/2379528827] [v2:172.21.15.50:6804/2379528827,v1:172.21.15.50:6805/2379528827] exists,up eed8040f-a7b7-4d3b-8345-2022918097d3 2024-06-06T03:26:02.252 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1 up in weight 1 up_from 13 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6800/3498354151,v1:172.21.15.79:6801/3498354151] [v2:172.21.15.79:6802/3498354151,v1:172.21.15.79:6803/3498354151] exists,up 089ecb78-5e1e-4cdb-8fe0-5c1731ec9dce 2024-06-06T03:26:02.252 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2 up in weight 1 up_from 18 up_thru 96 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6800/566397008,v1:172.21.15.122:6801/566397008] [v2:172.21.15.122:6802/566397008,v1:172.21.15.122:6803/566397008] exists,up 90599e3b-bf86-4a56-b03b-b051528a5b60 2024-06-06T03:26:02.252 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3 up in weight 1 up_from 25 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6810/820123083,v1:172.21.15.50:6811/820123083] [v2:172.21.15.50:6812/820123083,v1:172.21.15.50:6813/820123083] exists,up fd295e6c-64cd-4164-83dc-4d32c2ae103a 2024-06-06T03:26:02.252 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4 up in weight 1 up_from 33 up_thru 96 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6808/1784117997,v1:172.21.15.79:6809/1784117997] [v2:172.21.15.79:6810/1784117997,v1:172.21.15.79:6811/1784117997] exists,up 4c854d90-5353-4f7c-b2f3-2af6216d799b 2024-06-06T03:26:02.252 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5 up in weight 1 up_from 38 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6808/2755878218,v1:172.21.15.122:6809/2755878218] [v2:172.21.15.122:6810/2755878218,v1:172.21.15.122:6811/2755878218] exists,up 80041e10-a643-4338-b621-f882c7bc48b4 2024-06-06T03:26:02.252 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6 up in weight 1 up_from 46 up_thru 98 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6818/474595612,v1:172.21.15.50:6819/474595612] [v2:172.21.15.50:6820/474595612,v1:172.21.15.50:6821/474595612] exists,up 9e15c6c3-bb4b-4c2b-bb7e-4653b10874d2 2024-06-06T03:26:02.252 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7 up in weight 1 up_from 51 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6816/3504864579,v1:172.21.15.79:6817/3504864579] [v2:172.21.15.79:6818/3504864579,v1:172.21.15.79:6819/3504864579] exists,up 62585bba-c540-4498-8768-b84183e19abd 2024-06-06T03:26:02.252 INFO:teuthology.orchestra.run.smithi050.stdout:osd.8 up in weight 1 up_from 59 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6816/3484833116,v1:172.21.15.122:6817/3484833116] [v2:172.21.15.122:6818/3484833116,v1:172.21.15.122:6819/3484833116] exists,up 7a272157-460a-4d4a-a63e-30436022ac7b 2024-06-06T03:26:02.252 INFO:teuthology.orchestra.run.smithi050.stdout:osd.9 up in weight 1 up_from 67 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6826/2600273670,v1:172.21.15.50:6827/2600273670] [v2:172.21.15.50:6828/2600273670,v1:172.21.15.50:6829/2600273670] exists,up 7e768ff7-f78d-4a12-b863-4b692e0f4a0b 2024-06-06T03:26:02.252 INFO:teuthology.orchestra.run.smithi050.stdout:osd.10 up in weight 1 up_from 72 up_thru 96 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6824/2740366543,v1:172.21.15.79:6825/2740366543] [v2:172.21.15.79:6826/2740366543,v1:172.21.15.79:6827/2740366543] exists,up a42df29a-d88d-4401-878d-6c8f75f3f604 2024-06-06T03:26:02.253 INFO:teuthology.orchestra.run.smithi050.stdout:osd.11 up in weight 1 up_from 80 up_thru 96 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6824/4160854238,v1:172.21.15.122:6825/4160854238] [v2:172.21.15.122:6826/4160854238,v1:172.21.15.122:6827/4160854238] exists,up 35bcde30-49e4-49b9-a348-98d21a0d3cc4 2024-06-06T03:26:02.253 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 2.5 [8,11] 2024-06-06T03:26:02.253 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 2.a [2,11] 2024-06-06T03:26:02.253 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 2.e [2,4] 2024-06-06T03:26:02.253 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 3.20 [5,9] 2024-06-06T03:26:02.253 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 3.23 [4,8] 2024-06-06T03:26:02.253 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 3.24 [4,9] 2024-06-06T03:26:02.253 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 3.36 [4,9] 2024-06-06T03:26:02.253 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 4.7 [5,8] 2024-06-06T03:26:02.253 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 4.b [9,8] 2024-06-06T03:26:02.253 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 4.c [9,10] 2024-06-06T03:26:02.253 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 4.1c [9,8] 2024-06-06T03:26:02.253 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:6800/1311987652 expires 2024-06-07T03:15:13.252241+0000 2024-06-06T03:26:02.254 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:0/1149897118 expires 2024-06-07T03:15:13.252241+0000 2024-06-06T03:26:02.254 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:6800/2617801068 expires 2024-06-07T03:14:46.388744+0000 2024-06-06T03:26:02.254 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:0/1068038293 expires 2024-06-07T03:14:46.388744+0000 2024-06-06T03:26:02.254 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:0/4038080419 expires 2024-06-07T03:15:13.252241+0000 2024-06-06T03:26:02.254 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:0/149912088 expires 2024-06-07T03:14:46.388744+0000 2024-06-06T03:26:02.254 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:6801/2617801068 expires 2024-06-07T03:14:46.388744+0000 2024-06-06T03:26:02.254 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:0/2963887224 expires 2024-06-07T03:14:46.388744+0000 2024-06-06T03:26:02.254 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:6801/1311987652 expires 2024-06-07T03:15:13.252241+0000 2024-06-06T03:26:02.254 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:0/2554563139 expires 2024-06-07T03:15:13.252241+0000 2024-06-06T03:26:02.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.253+0000 7fc85aeaf700 1 -- 172.21.15.50:0/3942250252 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc8440a2c20 msgr2=0x7fc8440a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:02.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.253+0000 7fc85aeaf700 1 --2- 172.21.15.50:0/3942250252 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc8440a2c20 0x7fc8440a50e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc84800b5c0 tx=0x7fc848003850 comp rx=0 tx=0).stop 2024-06-06T03:26:02.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.253+0000 7fc85aeaf700 1 -- 172.21.15.50:0/3942250252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc854105880 msgr2=0x7fc85419ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:02.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.253+0000 7fc85aeaf700 1 --2- 172.21.15.50:0/3942250252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc854105880 0x7fc85419ae20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc84000b560 tx=0x7fc84000b870 comp rx=0 tx=0).stop 2024-06-06T03:26:02.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.253+0000 7fc85aeaf700 1 -- 172.21.15.50:0/3942250252 shutdown_connections 2024-06-06T03:26:02.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.253+0000 7fc85aeaf700 1 --2- 172.21.15.50:0/3942250252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8541081b0 0x7fc8541a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:02.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.253+0000 7fc85aeaf700 1 --2- 172.21.15.50:0/3942250252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc854102f50 0x7fc85419a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:02.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.253+0000 7fc85aeaf700 1 --2- 172.21.15.50:0/3942250252 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc8440a2c20 0x7fc8440a50e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:02.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.253+0000 7fc85aeaf700 1 --2- 172.21.15.50:0/3942250252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc854105880 0x7fc85419ae20 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:02.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.253+0000 7fc85aeaf700 1 -- 172.21.15.50:0/3942250252 >> 172.21.15.50:0/3942250252 conn(0x7fc8540fc960 msgr2=0x7fc854102670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:02.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.253+0000 7fc85aeaf700 1 -- 172.21.15.50:0/3942250252 shutdown_connections 2024-06-06T03:26:02.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:02.253+0000 7fc85aeaf700 1 -- 172.21.15.50:0/3942250252 wait complete. 2024-06-06T03:26:02.921 INFO:teuthology.run_tasks:Running task fs.ready... 2024-06-06T03:26:02.933 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T03:26:03.184 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:26:03.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:03 smithi050 ceph-mon[32421]: pgmap v413: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:26:03.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:03 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3942250252' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-06-06T03:26:03.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:03 smithi122 ceph-mon[35759]: pgmap v413: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:26:03.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:03 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/3942250252' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-06-06T03:26:03.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:03 smithi079 ceph-mon[35478]: pgmap v413: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:26:03.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:03 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/3942250252' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-06-06T03:26:04.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.896+0000 7fed6f2ec700 1 -- 172.21.15.50:0/584804845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed68107840 msgr2=0x7fed6810f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:04.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.896+0000 7fed6f2ec700 1 --2- 172.21.15.50:0/584804845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed68107840 0x7fed6810f3c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fed600099c0 tx=0x7fed60009cd0 comp rx=0 tx=0).stop 2024-06-06T03:26:04.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.896+0000 7fed6f2ec700 1 -- 172.21.15.50:0/584804845 shutdown_connections 2024-06-06T03:26:04.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.896+0000 7fed6f2ec700 1 --2- 172.21.15.50:0/584804845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed68107840 0x7fed6810f3c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:04.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.896+0000 7fed6f2ec700 1 --2- 172.21.15.50:0/584804845 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed68102740 0x7fed68102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:04.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.896+0000 7fed6f2ec700 1 --2- 172.21.15.50:0/584804845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed681030f0 0x7fed68107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:04.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.896+0000 7fed6f2ec700 1 -- 172.21.15.50:0/584804845 >> 172.21.15.50:0/584804845 conn(0x7fed680795f0 msgr2=0x7fed68079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:04.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.896+0000 7fed6f2ec700 1 -- 172.21.15.50:0/584804845 shutdown_connections 2024-06-06T03:26:04.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.896+0000 7fed6f2ec700 1 -- 172.21.15.50:0/584804845 wait complete. 2024-06-06T03:26:04.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.897+0000 7fed6f2ec700 1 Processor -- start 2024-06-06T03:26:04.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.897+0000 7fed6f2ec700 1 -- start start 2024-06-06T03:26:04.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.897+0000 7fed6f2ec700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed68102740 0x7fed6819e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:04.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.897+0000 7fed6f2ec700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed681030f0 0x7fed6819eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:04.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.897+0000 7fed6f2ec700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed68107840 0x7fed68198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:04.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.897+0000 7fed6f2ec700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fed68112690 con 0x7fed68102740 2024-06-06T03:26:04.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.897+0000 7fed6f2ec700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fed68112510 con 0x7fed68107840 2024-06-06T03:26:04.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.897+0000 7fed6f2ec700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fed68112810 con 0x7fed681030f0 2024-06-06T03:26:04.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.897+0000 7fed6d088700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed68102740 0x7fed6819e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:04.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.898+0000 7fed6d088700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed68102740 0x7fed6819e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41666/0 (socket says 172.21.15.50:41666) 2024-06-06T03:26:04.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.898+0000 7fed6d088700 1 -- 172.21.15.50:0/3231044377 learned_addr learned my addr 172.21.15.50:0/3231044377 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:04.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.898+0000 7fed6d889700 1 --2- 172.21.15.50:0/3231044377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed68107840 0x7fed68198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:04.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.898+0000 7fed6c887700 1 --2- 172.21.15.50:0/3231044377 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed681030f0 0x7fed6819eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:04.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.898+0000 7fed6d088700 1 -- 172.21.15.50:0/3231044377 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed681030f0 msgr2=0x7fed6819eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:04.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.898+0000 7fed6d088700 1 --2- 172.21.15.50:0/3231044377 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed681030f0 0x7fed6819eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:04.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.898+0000 7fed6d088700 1 -- 172.21.15.50:0/3231044377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed68107840 msgr2=0x7fed68198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:04.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.898+0000 7fed6d088700 1 --2- 172.21.15.50:0/3231044377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed68107840 0x7fed68198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:04.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.898+0000 7fed6d088700 1 -- 172.21.15.50:0/3231044377 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed681990d0 con 0x7fed68102740 2024-06-06T03:26:04.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.898+0000 7fed6d088700 1 --2- 172.21.15.50:0/3231044377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed68102740 0x7fed6819e760 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fed5c00ba50 tx=0x7fed5c00bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:04.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.898+0000 7fed667fc700 1 -- 172.21.15.50:0/3231044377 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed5c019070 con 0x7fed68102740 2024-06-06T03:26:04.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.898+0000 7fed667fc700 1 -- 172.21.15.50:0/3231044377 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fed5c014440 con 0x7fed68102740 2024-06-06T03:26:04.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.898+0000 7fed6f2ec700 1 -- 172.21.15.50:0/3231044377 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed681993c0 con 0x7fed68102740 2024-06-06T03:26:04.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.898+0000 7fed667fc700 1 -- 172.21.15.50:0/3231044377 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed5c00ce60 con 0x7fed68102740 2024-06-06T03:26:04.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.899+0000 7fed6f2ec700 1 -- 172.21.15.50:0/3231044377 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed681a5630 con 0x7fed68102740 2024-06-06T03:26:04.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.899+0000 7fed6f2ec700 1 -- 172.21.15.50:0/3231044377 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed6810aa80 con 0x7fed68102740 2024-06-06T03:26:04.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.900+0000 7fed667fc700 1 -- 172.21.15.50:0/3231044377 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fed5c01c070 con 0x7fed68102740 2024-06-06T03:26:04.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.901+0000 7fed667fc700 1 --2- 172.21.15.50:0/3231044377 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fed580a2c20 0x7fed580a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:04.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.901+0000 7fed6c887700 1 --2- 172.21.15.50:0/3231044377 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fed580a2c20 0x7fed580a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:04.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.901+0000 7fed667fc700 1 -- 172.21.15.50:0/3231044377 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fed5c0ce810 con 0x7fed68102740 2024-06-06T03:26:04.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.901+0000 7fed6c887700 1 --2- 172.21.15.50:0/3231044377 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fed580a2c20 0x7fed580a50e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fed54005fd0 tx=0x7fed5400a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:04.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:04.906+0000 7fed667fc700 1 -- 172.21.15.50:0/3231044377 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fed5c09b3f0 con 0x7fed68102740 2024-06-06T03:26:05.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:05.158+0000 7fed6f2ec700 1 -- 172.21.15.50:0/3231044377 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed68199e50 con 0x7fed68102740 2024-06-06T03:26:05.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:05.159+0000 7fed667fc700 1 -- 172.21.15.50:0/3231044377 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11855 (secure 0 0 0) 0x7fed5c09acf0 con 0x7fed68102740 2024-06-06T03:26:05.159 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:26:05.159 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1667847852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1667847852},{"type":"v1","addr":"172.21.15.50:6835","nonce":1667847852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/239971838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":239971838},{"type":"v1","addr":"172.21.15.50:6837","nonce":239971838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/2188134216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2188134216},{"type":"v1","addr":"172.21.15.50:6839","nonce":2188134216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/632572420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":632572420},{"type":"v1","addr":"172.21.15.50:6841","nonce":632572420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/864537078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":864537078},{"type":"v1","addr":"172.21.15.79:6833","nonce":864537078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/279268898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":279268898},{"type":"v1","addr":"172.21.15.79:6835","nonce":279268898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T03:22:36.202061+0000","modified":"2024-06-06T03:23:38.564714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24490,"mds_1":24472,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/57533154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":57533154},{"type":"v1","addr":"172.21.15.122:6833","nonce":57533154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/3286722213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3286722213},{"type":"v1","addr":"172.21.15.79:6837","nonce":3286722213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/768067336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":768067336},{"type":"v1","addr":"172.21.15.79:6839","nonce":768067336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.122:6835/2987597320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2987597320},{"type":"v1","addr":"172.21.15.122:6835","nonce":2987597320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":23,"addr":"172.21.15.122:6837/1604366318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1604366318},{"type":"v1","addr":"172.21.15.122:6837","nonce":1604366318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6839/4129732900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":4129732900},{"type":"v1","addr":"172.21.15.122:6839","nonce":4129732900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24472,24490,24466]},"id":1}]} 2024-06-06T03:26:05.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:05.161+0000 7fed6f2ec700 1 -- 172.21.15.50:0/3231044377 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fed580a2c20 msgr2=0x7fed580a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:05.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:05.161+0000 7fed6f2ec700 1 --2- 172.21.15.50:0/3231044377 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fed580a2c20 0x7fed580a50e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fed54005fd0 tx=0x7fed5400a560 comp rx=0 tx=0).stop 2024-06-06T03:26:05.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:05.161+0000 7fed6f2ec700 1 -- 172.21.15.50:0/3231044377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed68102740 msgr2=0x7fed6819e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:05.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:05.161+0000 7fed6f2ec700 1 --2- 172.21.15.50:0/3231044377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed68102740 0x7fed6819e760 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fed5c00ba50 tx=0x7fed5c00bd60 comp rx=0 tx=0).stop 2024-06-06T03:26:05.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:05.161+0000 7fed6f2ec700 1 -- 172.21.15.50:0/3231044377 shutdown_connections 2024-06-06T03:26:05.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:05.161+0000 7fed6f2ec700 1 --2- 172.21.15.50:0/3231044377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed68107840 0x7fed68198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:05.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:05.161+0000 7fed6f2ec700 1 --2- 172.21.15.50:0/3231044377 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fed580a2c20 0x7fed580a50e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:05.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:05.161+0000 7fed6f2ec700 1 --2- 172.21.15.50:0/3231044377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed68102740 0x7fed6819e760 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:05.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:05.161+0000 7fed6f2ec700 1 --2- 172.21.15.50:0/3231044377 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed681030f0 0x7fed6819eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:05.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:05.161+0000 7fed6f2ec700 1 -- 172.21.15.50:0/3231044377 >> 172.21.15.50:0/3231044377 conn(0x7fed680795f0 msgr2=0x7fed68100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:05.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:05.162+0000 7fed6f2ec700 1 -- 172.21.15.50:0/3231044377 shutdown_connections 2024-06-06T03:26:05.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:05.162+0000 7fed6f2ec700 1 -- 172.21.15.50:0/3231044377 wait complete. 2024-06-06T03:26:05.162 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 26 2024-06-06T03:26:05.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:05 smithi122 ceph-mon[35759]: pgmap v414: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T03:26:05.477 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:05 smithi050 ceph-mon[32421]: pgmap v414: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T03:26:05.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:05 smithi079 ceph-mon[35478]: pgmap v414: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T03:26:05.798 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T03:26:06.049 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:26:06.409 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:06 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3231044377' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:26:06.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:06 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/3231044377' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:26:06.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:06 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/3231044377' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:26:07.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:07 smithi122 ceph-mon[35759]: pgmap v415: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-06-06T03:26:07.458 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:07 smithi050 ceph-mon[32421]: pgmap v415: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-06-06T03:26:07.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:07 smithi079 ceph-mon[35478]: pgmap v415: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-06-06T03:26:07.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.699+0000 7f4d88062700 1 -- 172.21.15.50:0/3580985018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d80103120 msgr2=0x7f4d80107130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:07.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.699+0000 7f4d88062700 1 --2- 172.21.15.50:0/3580985018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d80103120 0x7f4d80107130 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4d740099c0 tx=0x7f4d74009cd0 comp rx=0 tx=0).stop 2024-06-06T03:26:07.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.699+0000 7f4d88062700 1 -- 172.21.15.50:0/3580985018 shutdown_connections 2024-06-06T03:26:07.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.699+0000 7f4d88062700 1 --2- 172.21.15.50:0/3580985018 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d80107860 0x7f4d8010f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:07.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.699+0000 7f4d88062700 1 --2- 172.21.15.50:0/3580985018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d80102770 0x7f4d80102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:07.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.699+0000 7f4d88062700 1 --2- 172.21.15.50:0/3580985018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d80103120 0x7f4d80107130 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:07.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.699+0000 7f4d88062700 1 -- 172.21.15.50:0/3580985018 >> 172.21.15.50:0/3580985018 conn(0x7f4d80079600 msgr2=0x7f4d80079a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:07.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.699+0000 7f4d88062700 1 -- 172.21.15.50:0/3580985018 shutdown_connections 2024-06-06T03:26:07.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.699+0000 7f4d88062700 1 -- 172.21.15.50:0/3580985018 wait complete. 2024-06-06T03:26:07.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.700+0000 7f4d88062700 1 Processor -- start 2024-06-06T03:26:07.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.700+0000 7f4d88062700 1 -- start start 2024-06-06T03:26:07.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.700+0000 7f4d88062700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d80102770 0x7f4d8019e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:07.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.700+0000 7f4d88062700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d80103120 0x7f4d8019ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:07.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.700+0000 7f4d88062700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d80107860 0x7f4d80198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:07.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.700+0000 7f4d88062700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4d80112690 con 0x7f4d80102770 2024-06-06T03:26:07.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.700+0000 7f4d88062700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4d80112510 con 0x7f4d80103120 2024-06-06T03:26:07.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.700+0000 7f4d88062700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4d80112810 con 0x7f4d80107860 2024-06-06T03:26:07.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.700+0000 7f4d85dfe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d80102770 0x7f4d8019e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:07.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.700+0000 7f4d85dfe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d80102770 0x7f4d8019e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41692/0 (socket says 172.21.15.50:41692) 2024-06-06T03:26:07.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.700+0000 7f4d85dfe700 1 -- 172.21.15.50:0/4273102303 learned_addr learned my addr 172.21.15.50:0/4273102303 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:07.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.701+0000 7f4d855fd700 1 --2- 172.21.15.50:0/4273102303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d80103120 0x7f4d8019ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:07.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.701+0000 7f4d865ff700 1 --2- 172.21.15.50:0/4273102303 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d80107860 0x7f4d80198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:07.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.701+0000 7f4d85dfe700 1 -- 172.21.15.50:0/4273102303 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d80107860 msgr2=0x7f4d80198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:07.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.701+0000 7f4d85dfe700 1 --2- 172.21.15.50:0/4273102303 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d80107860 0x7f4d80198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:07.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.701+0000 7f4d85dfe700 1 -- 172.21.15.50:0/4273102303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d80103120 msgr2=0x7f4d8019ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:07.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.701+0000 7f4d85dfe700 1 --2- 172.21.15.50:0/4273102303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d80103120 0x7f4d8019ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:07.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.701+0000 7f4d85dfe700 1 -- 172.21.15.50:0/4273102303 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d801990b0 con 0x7f4d80102770 2024-06-06T03:26:07.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.701+0000 7f4d865ff700 1 --2- 172.21.15.50:0/4273102303 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d80107860 0x7f4d80198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:26:07.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.701+0000 7f4d85dfe700 1 --2- 172.21.15.50:0/4273102303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d80102770 0x7f4d8019e790 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c00d950 tx=0x7f4d7c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:07.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.701+0000 7f4d72ffd700 1 -- 172.21.15.50:0/4273102303 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c016070 con 0x7f4d80102770 2024-06-06T03:26:07.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.701+0000 7f4d88062700 1 -- 172.21.15.50:0/4273102303 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d801993a0 con 0x7f4d80102770 2024-06-06T03:26:07.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.701+0000 7f4d72ffd700 1 -- 172.21.15.50:0/4273102303 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4d7c009df0 con 0x7f4d80102770 2024-06-06T03:26:07.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.701+0000 7f4d72ffd700 1 -- 172.21.15.50:0/4273102303 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c00f3c0 con 0x7f4d80102770 2024-06-06T03:26:07.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.701+0000 7f4d88062700 1 -- 172.21.15.50:0/4273102303 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d801a5660 con 0x7f4d80102770 2024-06-06T03:26:07.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.702+0000 7f4d88062700 1 -- 172.21.15.50:0/4273102303 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d80069180 con 0x7f4d80102770 2024-06-06T03:26:07.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.703+0000 7f4d72ffd700 1 -- 172.21.15.50:0/4273102303 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4d7c019070 con 0x7f4d80102770 2024-06-06T03:26:07.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.704+0000 7f4d72ffd700 1 --2- 172.21.15.50:0/4273102303 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4d6c0a2c20 0x7f4d6c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:07.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.704+0000 7f4d855fd700 1 --2- 172.21.15.50:0/4273102303 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4d6c0a2c20 0x7f4d6c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:07.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.704+0000 7f4d72ffd700 1 -- 172.21.15.50:0/4273102303 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f4d7c0cefd0 con 0x7f4d80102770 2024-06-06T03:26:07.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.705+0000 7f4d855fd700 1 --2- 172.21.15.50:0/4273102303 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4d6c0a2c20 0x7f4d6c0a50e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4d80102160 tx=0x7f4d74005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:07.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.709+0000 7f4d72ffd700 1 -- 172.21.15.50:0/4273102303 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4d7c09bbb0 con 0x7f4d80102770 2024-06-06T03:26:07.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.962+0000 7f4d88062700 1 -- 172.21.15.50:0/4273102303 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d8002dca0 con 0x7f4d80102770 2024-06-06T03:26:07.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.963+0000 7f4d72ffd700 1 -- 172.21.15.50:0/4273102303 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11855 (secure 0 0 0) 0x7f4d7c09b4b0 con 0x7f4d80102770 2024-06-06T03:26:07.963 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:26:07.963 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1667847852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1667847852},{"type":"v1","addr":"172.21.15.50:6835","nonce":1667847852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/239971838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":239971838},{"type":"v1","addr":"172.21.15.50:6837","nonce":239971838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/2188134216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2188134216},{"type":"v1","addr":"172.21.15.50:6839","nonce":2188134216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/632572420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":632572420},{"type":"v1","addr":"172.21.15.50:6841","nonce":632572420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/864537078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":864537078},{"type":"v1","addr":"172.21.15.79:6833","nonce":864537078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/279268898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":279268898},{"type":"v1","addr":"172.21.15.79:6835","nonce":279268898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T03:22:36.202061+0000","modified":"2024-06-06T03:23:38.564714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24490,"mds_1":24472,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/57533154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":57533154},{"type":"v1","addr":"172.21.15.122:6833","nonce":57533154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/3286722213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3286722213},{"type":"v1","addr":"172.21.15.79:6837","nonce":3286722213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/768067336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":768067336},{"type":"v1","addr":"172.21.15.79:6839","nonce":768067336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.122:6835/2987597320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2987597320},{"type":"v1","addr":"172.21.15.122:6835","nonce":2987597320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":23,"addr":"172.21.15.122:6837/1604366318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1604366318},{"type":"v1","addr":"172.21.15.122:6837","nonce":1604366318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6839/4129732900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":4129732900},{"type":"v1","addr":"172.21.15.122:6839","nonce":4129732900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24472,24490,24466]},"id":1}]} 2024-06-06T03:26:07.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.965+0000 7f4d88062700 1 -- 172.21.15.50:0/4273102303 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4d6c0a2c20 msgr2=0x7f4d6c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:07.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.965+0000 7f4d88062700 1 --2- 172.21.15.50:0/4273102303 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4d6c0a2c20 0x7f4d6c0a50e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4d80102160 tx=0x7f4d74005fb0 comp rx=0 tx=0).stop 2024-06-06T03:26:07.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.965+0000 7f4d88062700 1 -- 172.21.15.50:0/4273102303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d80102770 msgr2=0x7f4d8019e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:07.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.965+0000 7f4d88062700 1 --2- 172.21.15.50:0/4273102303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d80102770 0x7f4d8019e790 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c00d950 tx=0x7f4d7c00dc60 comp rx=0 tx=0).stop 2024-06-06T03:26:07.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.966+0000 7f4d88062700 1 -- 172.21.15.50:0/4273102303 shutdown_connections 2024-06-06T03:26:07.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.966+0000 7f4d88062700 1 --2- 172.21.15.50:0/4273102303 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d80107860 0x7f4d80198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:07.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.966+0000 7f4d88062700 1 --2- 172.21.15.50:0/4273102303 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4d6c0a2c20 0x7f4d6c0a50e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:07.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.966+0000 7f4d88062700 1 --2- 172.21.15.50:0/4273102303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d80102770 0x7f4d8019e790 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:07.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.966+0000 7f4d88062700 1 --2- 172.21.15.50:0/4273102303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d80103120 0x7f4d8019ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:07.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.966+0000 7f4d88062700 1 -- 172.21.15.50:0/4273102303 >> 172.21.15.50:0/4273102303 conn(0x7f4d80079600 msgr2=0x7f4d80100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:07.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.966+0000 7f4d88062700 1 -- 172.21.15.50:0/4273102303 shutdown_connections 2024-06-06T03:26:07.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:07.966+0000 7f4d88062700 1 -- 172.21.15.50:0/4273102303 wait complete. 2024-06-06T03:26:07.967 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 26 2024-06-06T03:26:08.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:08 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/4273102303' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:26:08.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:08 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/4273102303' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:26:08.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:08 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/4273102303' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:26:08.624 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-06T03:26:08.889 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:26:09.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:09 smithi050 ceph-mon[32421]: pgmap v416: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:26:09.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:09 smithi122 ceph-mon[35759]: pgmap v416: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:26:09.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:09 smithi079 ceph-mon[35478]: pgmap v416: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:26:10.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.650+0000 7f99e37b7700 1 -- 172.21.15.50:0/303597124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99dc1074b0 msgr2=0x7f99dc06ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:10.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.650+0000 7f99e37b7700 1 --2- 172.21.15.50:0/303597124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99dc1074b0 0x7f99dc06ac00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f99d8009990 tx=0x7f99d8009ca0 comp rx=0 tx=0).stop 2024-06-06T03:26:10.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.650+0000 7f99e37b7700 1 -- 172.21.15.50:0/303597124 shutdown_connections 2024-06-06T03:26:10.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.650+0000 7f99e37b7700 1 --2- 172.21.15.50:0/303597124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99dc104f20 0x7f99dc1053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:10.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.650+0000 7f99e37b7700 1 --2- 172.21.15.50:0/303597124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99dc1074b0 0x7f99dc06ac00 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:10.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.650+0000 7f99e37b7700 1 --2- 172.21.15.50:0/303597124 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99dc06b140 0x7f99dc06b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:10.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.650+0000 7f99e37b7700 1 -- 172.21.15.50:0/303597124 >> 172.21.15.50:0/303597124 conn(0x7f99dc0773e0 msgr2=0x7f99dc0777f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:10.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.650+0000 7f99e37b7700 1 -- 172.21.15.50:0/303597124 shutdown_connections 2024-06-06T03:26:10.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.650+0000 7f99e37b7700 1 -- 172.21.15.50:0/303597124 wait complete. 2024-06-06T03:26:10.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.650+0000 7f99e37b7700 1 Processor -- start 2024-06-06T03:26:10.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.650+0000 7f99e37b7700 1 -- start start 2024-06-06T03:26:10.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.651+0000 7f99e37b7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99dc06b140 0x7f99dc19f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:10.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.651+0000 7f99e37b7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99dc104f20 0x7f99dc19f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:10.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.651+0000 7f99e37b7700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99dc1074b0 0x7f99dc1a39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:10.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.651+0000 7f99e37b7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc118c40 con 0x7f99dc06b140 2024-06-06T03:26:10.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.651+0000 7f99e37b7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc118ac0 con 0x7f99dc104f20 2024-06-06T03:26:10.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.651+0000 7f99e37b7700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc118dc0 con 0x7f99dc1074b0 2024-06-06T03:26:10.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.651+0000 7f99e1553700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99dc06b140 0x7f99dc19f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:10.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.651+0000 7f99e1553700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99dc06b140 0x7f99dc19f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38482/0 (socket says 172.21.15.50:38482) 2024-06-06T03:26:10.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.651+0000 7f99e1553700 1 -- 172.21.15.50:0/4025750729 learned_addr learned my addr 172.21.15.50:0/4025750729 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:10.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.651+0000 7f99e0d52700 1 --2- 172.21.15.50:0/4025750729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99dc104f20 0x7f99dc19f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:10.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.651+0000 7f99e1d54700 1 --2- 172.21.15.50:0/4025750729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99dc1074b0 0x7f99dc1a39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:10.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.651+0000 7f99e1553700 1 -- 172.21.15.50:0/4025750729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99dc1074b0 msgr2=0x7f99dc1a39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:10.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.651+0000 7f99e1553700 1 --2- 172.21.15.50:0/4025750729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99dc1074b0 0x7f99dc1a39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:10.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.651+0000 7f99e1553700 1 -- 172.21.15.50:0/4025750729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99dc104f20 msgr2=0x7f99dc19f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:10.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.651+0000 7f99e1553700 1 --2- 172.21.15.50:0/4025750729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99dc104f20 0x7f99dc19f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:10.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.651+0000 7f99e1553700 1 -- 172.21.15.50:0/4025750729 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99dc1a40e0 con 0x7f99dc06b140 2024-06-06T03:26:10.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.651+0000 7f99e1553700 1 --2- 172.21.15.50:0/4025750729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99dc06b140 0x7f99dc19f0d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f99d80057f0 tx=0x7f99d8005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:10.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.652+0000 7f99d27fc700 1 -- 172.21.15.50:0/4025750729 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d8027070 con 0x7f99dc06b140 2024-06-06T03:26:10.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.652+0000 7f99e37b7700 1 -- 172.21.15.50:0/4025750729 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99dc1a4370 con 0x7f99dc06b140 2024-06-06T03:26:10.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.652+0000 7f99d27fc700 1 -- 172.21.15.50:0/4025750729 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f99d800fc60 con 0x7f99dc06b140 2024-06-06T03:26:10.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.652+0000 7f99d27fc700 1 -- 172.21.15.50:0/4025750729 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d8022cd0 con 0x7f99dc06b140 2024-06-06T03:26:10.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.652+0000 7f99e37b7700 1 -- 172.21.15.50:0/4025750729 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99dc1abc50 con 0x7f99dc06b140 2024-06-06T03:26:10.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.653+0000 7f99e37b7700 1 -- 172.21.15.50:0/4025750729 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99dc069180 con 0x7f99dc06b140 2024-06-06T03:26:10.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.654+0000 7f99d27fc700 1 -- 172.21.15.50:0/4025750729 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f99d802a070 con 0x7f99dc06b140 2024-06-06T03:26:10.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.655+0000 7f99d27fc700 1 --2- 172.21.15.50:0/4025750729 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f99c80a2c20 0x7f99c80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:10.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.655+0000 7f99e0d52700 1 --2- 172.21.15.50:0/4025750729 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f99c80a2c20 0x7f99c80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:10.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.655+0000 7f99d27fc700 1 -- 172.21.15.50:0/4025750729 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f99d80d0490 con 0x7f99dc06b140 2024-06-06T03:26:10.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.655+0000 7f99e0d52700 1 --2- 172.21.15.50:0/4025750729 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f99c80a2c20 0x7f99c80a50e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f99dc077b20 tx=0x7f99cc00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:10.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.658+0000 7f99d27fc700 1 -- 172.21.15.50:0/4025750729 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f99d8031080 con 0x7f99dc06b140 2024-06-06T03:26:10.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.867+0000 7f99e37b7700 1 -- 172.21.15.50:0/4025750729 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f99dc1a0430 con 0x7f99dc06b140 2024-06-06T03:26:10.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.868+0000 7f99d27fc700 1 -- 172.21.15.50:0/4025750729 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+24653 (secure 0 0 0) 0x7f99dc1a0430 con 0x7f99dc06b140 2024-06-06T03:26:10.868 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:26:10.869 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":99,"fsid":"b6263b26-23b2-11ef-bc9b-c7b262605968","created":"2024-06-06T03:14:19.062632+0000","modified":"2024-06-06T03:24:14.691472+0000","last_up_change":"2024-06-06T03:21:30.287918+0000","last_in_change":"2024-06-06T03:21:09.550417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T03:17:37.777608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T03:22:29.496859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T03:22:33.221878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-06T03:22:42.829873+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"eed8040f-a7b7-4d3b-8345-2022918097d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6803","nonce":2379528827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6805","nonce":2379528827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6809","nonce":2379528827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6807","nonce":2379528827}]},"public_addr":"172.21.15.50:6803/2379528827","cluster_addr":"172.21.15.50:6805/2379528827","heartbeat_back_addr":"172.21.15.50:6809/2379528827","heartbeat_front_addr":"172.21.15.50:6807/2379528827","state":["exists","up"]},{"osd":1,"uuid":"089ecb78-5e1e-4cdb-8fe0-5c1731ec9dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6801","nonce":3498354151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6803","nonce":3498354151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6807","nonce":3498354151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6805","nonce":3498354151}]},"public_addr":"172.21.15.79:6801/3498354151","cluster_addr":"172.21.15.79:6803/3498354151","heartbeat_back_addr":"172.21.15.79:6807/3498354151","heartbeat_front_addr":"172.21.15.79:6805/3498354151","state":["exists","up"]},{"osd":2,"uuid":"90599e3b-bf86-4a56-b03b-b051528a5b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6801","nonce":566397008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6803","nonce":566397008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6807","nonce":566397008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6805","nonce":566397008}]},"public_addr":"172.21.15.122:6801/566397008","cluster_addr":"172.21.15.122:6803/566397008","heartbeat_back_addr":"172.21.15.122:6807/566397008","heartbeat_front_addr":"172.21.15.122:6805/566397008","state":["exists","up"]},{"osd":3,"uuid":"fd295e6c-64cd-4164-83dc-4d32c2ae103a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6811","nonce":820123083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6813","nonce":820123083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6817","nonce":820123083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6815","nonce":820123083}]},"public_addr":"172.21.15.50:6811/820123083","cluster_addr":"172.21.15.50:6813/820123083","heartbeat_back_addr":"172.21.15.50:6817/820123083","heartbeat_front_addr":"172.21.15.50:6815/820123083","state":["exists","up"]},{"osd":4,"uuid":"4c854d90-5353-4f7c-b2f3-2af6216d799b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6809","nonce":1784117997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6811","nonce":1784117997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6815","nonce":1784117997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6813","nonce":1784117997}]},"public_addr":"172.21.15.79:6809/1784117997","cluster_addr":"172.21.15.79:6811/1784117997","heartbeat_back_addr":"172.21.15.79:6815/1784117997","heartbeat_front_addr":"172.21.15.79:6813/1784117997","state":["exists","up"]},{"osd":5,"uuid":"80041e10-a643-4338-b621-f882c7bc48b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6809","nonce":2755878218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6811","nonce":2755878218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6815","nonce":2755878218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6813","nonce":2755878218}]},"public_addr":"172.21.15.122:6809/2755878218","cluster_addr":"172.21.15.122:6811/2755878218","heartbeat_back_addr":"172.21.15.122:6815/2755878218","heartbeat_front_addr":"172.21.15.122:6813/2755878218","state":["exists","up"]},{"osd":6,"uuid":"9e15c6c3-bb4b-4c2b-bb7e-4653b10874d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6819","nonce":474595612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6821","nonce":474595612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6825","nonce":474595612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6823","nonce":474595612}]},"public_addr":"172.21.15.50:6819/474595612","cluster_addr":"172.21.15.50:6821/474595612","heartbeat_back_addr":"172.21.15.50:6825/474595612","heartbeat_front_addr":"172.21.15.50:6823/474595612","state":["exists","up"]},{"osd":7,"uuid":"62585bba-c540-4498-8768-b84183e19abd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6817","nonce":3504864579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6819","nonce":3504864579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6823","nonce":3504864579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6821","nonce":3504864579}]},"public_addr":"172.21.15.79:6817/3504864579","cluster_addr":"172.21.15.79:6819/3504864579","heartbeat_back_addr":"172.21.15.79:6823/3504864579","heartbeat_front_addr":"172.21.15.79:6821/3504864579","state":["exists","up"]},{"osd":8,"uuid":"7a272157-460a-4d4a-a63e-30436022ac7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6817","nonce":3484833116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6819","nonce":3484833116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6823","nonce":3484833116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6821","nonce":3484833116}]},"public_addr":"172.21.15.122:6817/3484833116","cluster_addr":"172.21.15.122:6819/3484833116","heartbeat_back_addr":"172.21.15.122:6823/3484833116","heartbeat_front_addr":"172.21.15.122:6821/3484833116","state":["exists","up"]},{"osd":9,"uuid":"7e768ff7-f78d-4a12-b863-4b692e0f4a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6827","nonce":2600273670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6829","nonce":2600273670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6833","nonce":2600273670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6831","nonce":2600273670}]},"public_addr":"172.21.15.50:6827/2600273670","cluster_addr":"172.21.15.50:6829/2600273670","heartbeat_back_addr":"172.21.15.50:6833/2600273670","heartbeat_front_addr":"172.21.15.50:6831/2600273670","state":["exists","up"]},{"osd":10,"uuid":"a42df29a-d88d-4401-878d-6c8f75f3f604","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6825","nonce":2740366543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6827","nonce":2740366543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6831","nonce":2740366543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6829","nonce":2740366543}]},"public_addr":"172.21.15.79:6825/2740366543","cluster_addr":"172.21.15.79:6827/2740366543","heartbeat_back_addr":"172.21.15.79:6831/2740366543","heartbeat_front_addr":"172.21.15.79:6829/2740366543","state":["exists","up"]},{"osd":11,"uuid":"35bcde30-49e4-49b9-a348-98d21a0d3cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6825","nonce":4160854238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6827","nonce":4160854238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6831","nonce":4160854238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6829","nonce":4160854238}]},"public_addr":"172.21.15.122:6825/4160854238","cluster_addr":"172.21.15.122:6827/4160854238","heartbeat_back_addr":"172.21.15.122:6831/4160854238","heartbeat_front_addr":"172.21.15.122:6829/4160854238","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:16:46.989554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:17:11.269759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:17:35.105846+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:00.940943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:26.284520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:51.064143+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:19:16.254750+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:19:42.841380+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:20:08.185133+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:20:34.700082+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:21:01.485278+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:21:27.938715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1311987652":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/1149897118":"2024-06-07T03:15:13.252241+0000","172.21.15.50:6800/2617801068":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/1068038293":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/4038080419":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/149912088":"2024-06-07T03:14:46.388744+0000","172.21.15.50:6801/2617801068":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/2963887224":"2024-06-07T03:14:46.388744+0000","172.21.15.50:6801/1311987652":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/2554563139":"2024-06-07T03:15:13.252241+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T03:26:10.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.871+0000 7f99e37b7700 1 -- 172.21.15.50:0/4025750729 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f99c80a2c20 msgr2=0x7f99c80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:10.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.871+0000 7f99e37b7700 1 --2- 172.21.15.50:0/4025750729 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f99c80a2c20 0x7f99c80a50e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f99dc077b20 tx=0x7f99cc00a300 comp rx=0 tx=0).stop 2024-06-06T03:26:10.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.871+0000 7f99e37b7700 1 -- 172.21.15.50:0/4025750729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99dc06b140 msgr2=0x7f99dc19f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:10.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.871+0000 7f99e37b7700 1 --2- 172.21.15.50:0/4025750729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99dc06b140 0x7f99dc19f0d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f99d80057f0 tx=0x7f99d8005ef0 comp rx=0 tx=0).stop 2024-06-06T03:26:10.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.871+0000 7f99e37b7700 1 -- 172.21.15.50:0/4025750729 shutdown_connections 2024-06-06T03:26:10.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.871+0000 7f99e37b7700 1 --2- 172.21.15.50:0/4025750729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99dc1074b0 0x7f99dc1a39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:10.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.871+0000 7f99e37b7700 1 --2- 172.21.15.50:0/4025750729 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f99c80a2c20 0x7f99c80a50e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:10.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.871+0000 7f99e37b7700 1 --2- 172.21.15.50:0/4025750729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99dc06b140 0x7f99dc19f0d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:10.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.871+0000 7f99e37b7700 1 --2- 172.21.15.50:0/4025750729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99dc104f20 0x7f99dc19f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:10.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.871+0000 7f99e37b7700 1 -- 172.21.15.50:0/4025750729 >> 172.21.15.50:0/4025750729 conn(0x7f99dc0773e0 msgr2=0x7f99dc102d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:10.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.871+0000 7f99e37b7700 1 -- 172.21.15.50:0/4025750729 shutdown_connections 2024-06-06T03:26:10.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:10.871+0000 7f99e37b7700 1 -- 172.21.15.50:0/4025750729 wait complete. 2024-06-06T03:26:11.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:11 smithi122 ceph-mon[35759]: pgmap v417: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:26:11.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:11 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/4025750729' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:26:11.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:11 smithi050 ceph-mon[32421]: pgmap v417: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:26:11.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:11 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/4025750729' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:26:11.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:11 smithi079 ceph-mon[35478]: pgmap v417: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:26:11.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:11 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/4025750729' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:26:11.647 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-06-06T03:22:36.202061+0000', 'modified': '2024-06-06T03:23:38.564714+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24490, 'mds_1': 24472, 'mds_2': 24466}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24427': {'gid': 24427, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.122:6833/57533154', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6832', 'nonce': 57533154}, {'type': 'v1', 'addr': '172.21.15.122:6833', 'nonce': 57533154}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24437': {'gid': 24437, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.79:6837/3286722213', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6836', 'nonce': 3286722213}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 3286722213}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24464': {'gid': 24464, 'name': 'b', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.79:6839/768067336', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6838', 'nonce': 768067336}, {'type': 'v1', 'addr': '172.21.15.79:6839', 'nonce': 768067336}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'f', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 24, 'addr': '172.21.15.122:6835/2987597320', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6834', 'nonce': 2987597320}, {'type': 'v1', 'addr': '172.21.15.122:6835', 'nonce': 2987597320}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'c', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 23, 'addr': '172.21.15.122:6837/1604366318', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6836', 'nonce': 1604366318}, {'type': 'v1', 'addr': '172.21.15.122:6837', 'nonce': 1604366318}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24490': {'gid': 24490, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.122:6839/4129732900', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6838', 'nonce': 4129732900}, {'type': 'v1', 'addr': '172.21.15.122:6839', 'nonce': 4129732900}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24490, 'qdb_cluster': [24472, 24490, 24466]} 2024-06-06T03:26:11.647 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-06-06T03:26:11.647 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.f status 2024-06-06T03:26:11.900 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:26:13.359 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:13 smithi050 ceph-mon[32421]: pgmap v418: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:26:13.359 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:13 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:26:13.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:13 smithi122 ceph-mon[35759]: pgmap v418: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:26:13.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:13 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:26:13.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:13 smithi079 ceph-mon[35478]: pgmap v418: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:26:13.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:13 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:26:13.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.607+0000 7facbcc8b700 1 -- 172.21.15.50:0/112105686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facb81085c0 msgr2=0x7facb81089a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:13.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.607+0000 7facbcc8b700 1 --2- 172.21.15.50:0/112105686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facb81085c0 0x7facb81089a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7faca80099c0 tx=0x7faca8009cd0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.607+0000 7facbcc8b700 1 -- 172.21.15.50:0/112105686 shutdown_connections 2024-06-06T03:26:13.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.607+0000 7facbcc8b700 1 --2- 172.21.15.50:0/112105686 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facb8102ee0 0x7facb810f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.607+0000 7facbcc8b700 1 --2- 172.21.15.50:0/112105686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facb81085c0 0x7facb81089a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.607+0000 7facbcc8b700 1 --2- 172.21.15.50:0/112105686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facb8102520 0x7facb81029a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.607+0000 7facbcc8b700 1 -- 172.21.15.50:0/112105686 >> 172.21.15.50:0/112105686 conn(0x7facb8079680 msgr2=0x7facb8079a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:13.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.608+0000 7facbcc8b700 1 -- 172.21.15.50:0/112105686 shutdown_connections 2024-06-06T03:26:13.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.608+0000 7facbcc8b700 1 -- 172.21.15.50:0/112105686 wait complete. 2024-06-06T03:26:13.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.609+0000 7facbcc8b700 1 Processor -- start 2024-06-06T03:26:13.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.609+0000 7facbcc8b700 1 -- start start 2024-06-06T03:26:13.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.609+0000 7facbcc8b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facb8102520 0x7facb819e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:13.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.609+0000 7facbcc8b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facb8102ee0 0x7facb819ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:13.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.609+0000 7facbcc8b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facb81085c0 0x7facb81989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:13.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.609+0000 7facbcc8b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7facb81126b0 con 0x7facb81085c0 2024-06-06T03:26:13.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.609+0000 7facbcc8b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7facb8112530 con 0x7facb8102520 2024-06-06T03:26:13.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.609+0000 7facbcc8b700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7facb8112830 con 0x7facb8102ee0 2024-06-06T03:26:13.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.609+0000 7facb5d9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facb8102ee0 0x7facb819ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:13.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.609+0000 7facb5d9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facb8102ee0 0x7facb819ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:46916/0 (socket says 172.21.15.50:46916) 2024-06-06T03:26:13.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.609+0000 7facb5d9b700 1 -- 172.21.15.50:0/3175515398 learned_addr learned my addr 172.21.15.50:0/3175515398 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:13.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.609+0000 7facb659c700 1 --2- 172.21.15.50:0/3175515398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facb8102520 0x7facb819e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:13.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.609+0000 7facb6d9d700 1 --2- 172.21.15.50:0/3175515398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facb81085c0 0x7facb81989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:13.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.610+0000 7facb5d9b700 1 -- 172.21.15.50:0/3175515398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facb8102520 msgr2=0x7facb819e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:13.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.610+0000 7facb5d9b700 1 --2- 172.21.15.50:0/3175515398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facb8102520 0x7facb819e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.610+0000 7facb5d9b700 1 -- 172.21.15.50:0/3175515398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facb81085c0 msgr2=0x7facb81989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:13.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.610+0000 7facb5d9b700 1 --2- 172.21.15.50:0/3175515398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facb81085c0 0x7facb81989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.610+0000 7facb5d9b700 1 -- 172.21.15.50:0/3175515398 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb8199110 con 0x7facb8102ee0 2024-06-06T03:26:13.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.610+0000 7facb6d9d700 1 --2- 172.21.15.50:0/3175515398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facb81085c0 0x7facb81989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:26:13.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.610+0000 7facb5d9b700 1 --2- 172.21.15.50:0/3175515398 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facb8102ee0 0x7facb819ed30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7facac00e9a0 tx=0x7facac00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:13.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.610+0000 7faca77fe700 1 -- 172.21.15.50:0/3175515398 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facac00cbd0 con 0x7facb8102ee0 2024-06-06T03:26:13.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.610+0000 7faca77fe700 1 -- 172.21.15.50:0/3175515398 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7facac00cd70 con 0x7facb8102ee0 2024-06-06T03:26:13.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.610+0000 7facbcc8b700 1 -- 172.21.15.50:0/3175515398 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facb8199400 con 0x7facb8102ee0 2024-06-06T03:26:13.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.610+0000 7faca77fe700 1 -- 172.21.15.50:0/3175515398 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facac018680 con 0x7facb8102ee0 2024-06-06T03:26:13.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.610+0000 7facbcc8b700 1 -- 172.21.15.50:0/3175515398 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facb80746c0 con 0x7facb8102ee0 2024-06-06T03:26:13.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.613+0000 7faca77fe700 1 -- 172.21.15.50:0/3175515398 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7facac0188e0 con 0x7facb8102ee0 2024-06-06T03:26:13.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.614+0000 7faca77fe700 1 --2- 172.21.15.50:0/3175515398 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7faca00a2ca0 0x7faca00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:13.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.614+0000 7faca77fe700 1 -- 172.21.15.50:0/3175515398 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7facac0cf5d0 con 0x7facb8102ee0 2024-06-06T03:26:13.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.614+0000 7facb659c700 1 --2- 172.21.15.50:0/3175515398 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7faca00a2ca0 0x7faca00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:13.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.615+0000 7facb659c700 1 --2- 172.21.15.50:0/3175515398 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7faca00a2ca0 0x7faca00a5160 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7faca8000c00 tx=0x7faca8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:13.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.615+0000 7facc750eb80 1 Processor -- start 2024-06-06T03:26:13.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.615+0000 7facc750eb80 1 -- start start 2024-06-06T03:26:13.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.615+0000 7facc750eb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad9cd98f10 0x55ad9cd992f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:13.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.615+0000 7facc750eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad9cd99830 0x55ad9cd93210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:13.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.615+0000 7facc750eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad9cd93750 0x55ad9cd93b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:13.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.615+0000 7facc750eb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ad9cc85f10 con 0x55ad9cd98f10 2024-06-06T03:26:13.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.615+0000 7facc750eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ad9cce4800 con 0x55ad9cd99830 2024-06-06T03:26:13.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.615+0000 7facc750eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ad9cc4c410 con 0x55ad9cd93750 2024-06-06T03:26:13.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.615+0000 7facb659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad9cd98f10 0x55ad9cd992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:13.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.615+0000 7facb659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad9cd98f10 0x55ad9cd992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38510/0 (socket says 172.21.15.50:38510) 2024-06-06T03:26:13.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.615+0000 7facb659c700 1 -- 172.21.15.50:0/56755850 learned_addr learned my addr 172.21.15.50:0/56755850 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:13.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.616+0000 7facb6d9d700 1 --2- 172.21.15.50:0/56755850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad9cd93750 0x55ad9cd93b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:13.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.616+0000 7facb5d9b700 1 --2- 172.21.15.50:0/56755850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad9cd99830 0x55ad9cd93210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:13.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.616+0000 7facb659c700 1 -- 172.21.15.50:0/56755850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad9cd93750 msgr2=0x55ad9cd93b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:13.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.616+0000 7facb659c700 1 --2- 172.21.15.50:0/56755850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad9cd93750 0x55ad9cd93b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.616+0000 7facb659c700 1 -- 172.21.15.50:0/56755850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad9cd99830 msgr2=0x55ad9cd93210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:13.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.616+0000 7facb659c700 1 --2- 172.21.15.50:0/56755850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad9cd99830 0x55ad9cd93210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.616+0000 7facb659c700 1 -- 172.21.15.50:0/56755850 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad9cc33880 con 0x55ad9cd98f10 2024-06-06T03:26:13.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.616+0000 7facb659c700 1 --2- 172.21.15.50:0/56755850 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad9cd98f10 0x55ad9cd992f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7faca80099c0 tx=0x7faca8020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff7893280c2c1b65 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:13.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.616+0000 7faca4ff9700 1 -- 172.21.15.50:0/56755850 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca8009e60 con 0x55ad9cd98f10 2024-06-06T03:26:13.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.616+0000 7faca4ff9700 1 -- 172.21.15.50:0/56755850 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faca80045b0 con 0x55ad9cd98f10 2024-06-06T03:26:13.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.616+0000 7faca4ff9700 1 -- 172.21.15.50:0/56755850 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca8024700 con 0x55ad9cd98f10 2024-06-06T03:26:13.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.617+0000 7facc750eb80 1 -- 172.21.15.50:0/56755850 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad9cd98f10 msgr2=0x55ad9cd992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:13.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.617+0000 7facc750eb80 1 --2- 172.21.15.50:0/56755850 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad9cd98f10 0x55ad9cd992f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7faca80099c0 tx=0x7faca8020000 comp rx=0 tx=0).stop 2024-06-06T03:26:13.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.617+0000 7facc750eb80 1 -- 172.21.15.50:0/56755850 shutdown_connections 2024-06-06T03:26:13.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.617+0000 7facc750eb80 1 --2- 172.21.15.50:0/56755850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad9cd93750 0x55ad9cd93b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.617+0000 7facc750eb80 1 --2- 172.21.15.50:0/56755850 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad9cd98f10 0x55ad9cd992f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.617+0000 7facc750eb80 1 --2- 172.21.15.50:0/56755850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad9cd99830 0x55ad9cd93210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.617+0000 7facc750eb80 1 -- 172.21.15.50:0/56755850 >> 172.21.15.50:0/56755850 conn(0x55ad9ccc0030 msgr2=0x55ad9cd8e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:13.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.617+0000 7facc750eb80 1 -- 172.21.15.50:0/56755850 shutdown_connections 2024-06-06T03:26:13.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.617+0000 7facc750eb80 1 -- 172.21.15.50:0/56755850 wait complete. 2024-06-06T03:26:13.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.618+0000 7facc750eb80 1 -- start start 2024-06-06T03:26:13.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.618+0000 7facc750eb80 1 Processor -- start 2024-06-06T03:26:13.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.618+0000 7facc750eb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad9cd93750 0x55ad9cd9f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:13.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.618+0000 7facc750eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad9cd98f10 0x55ad9cd9c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:13.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.618+0000 7facc750eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad9cd99830 0x55ad9cd9ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:13.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.618+0000 7facc750eb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ad9cc84f70 con 0x55ad9cd93750 2024-06-06T03:26:13.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.618+0000 7facc750eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ad9cce07c0 con 0x55ad9cd99830 2024-06-06T03:26:13.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.618+0000 7facc750eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ad9cda0150 con 0x55ad9cd98f10 2024-06-06T03:26:13.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.618+0000 7facc750eb80 10 client.0 _ll_register_callbacks cb 0x55ad9cc7a560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:26:13.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.618+0000 7facb659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad9cd93750 0x55ad9cd9f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:13.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.618+0000 7facb659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad9cd93750 0x55ad9cd9f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38516/0 (socket says 172.21.15.50:38516) 2024-06-06T03:26:13.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.618+0000 7facb659c700 1 -- 172.21.15.50:0/3227310992 learned_addr learned my addr 172.21.15.50:0/3227310992 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:13.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.618+0000 7facb5d9b700 1 --2- 172.21.15.50:0/3227310992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad9cd98f10 0x55ad9cd9c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:13.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.618+0000 7facb6d9d700 1 --2- 172.21.15.50:0/3227310992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad9cd99830 0x55ad9cd9ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:13.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.618+0000 7facb659c700 1 -- 172.21.15.50:0/3227310992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad9cd98f10 msgr2=0x55ad9cd9c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:13.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.618+0000 7facb659c700 1 --2- 172.21.15.50:0/3227310992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad9cd98f10 0x55ad9cd9c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.618+0000 7facb659c700 1 -- 172.21.15.50:0/3227310992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad9cd99830 msgr2=0x55ad9cd9ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:13.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.618+0000 7facb659c700 1 --2- 172.21.15.50:0/3227310992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad9cd99830 0x55ad9cd9ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.618+0000 7facb659c700 1 -- 172.21.15.50:0/3227310992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad9ccaa700 con 0x55ad9cd93750 2024-06-06T03:26:13.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.619+0000 7facb659c700 1 --2- 172.21.15.50:0/3227310992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad9cd93750 0x55ad9cd9f5c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7faca8009d10 tx=0x7faca8024cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=768c366e84640949 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:13.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.619+0000 7fac9dffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:26:13.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.619+0000 7fac9dffb700 1 -- 172.21.15.50:0/3227310992 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca803c060 con 0x55ad9cd93750 2024-06-06T03:26:13.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.619+0000 7fac9dffb700 1 -- 172.21.15.50:0/3227310992 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7faca8005250 con 0x55ad9cd93750 2024-06-06T03:26:13.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.619+0000 7facc750eb80 1 -- 172.21.15.50:0/3227310992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faca80045b0 con 0x55ad9cd93750 2024-06-06T03:26:13.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.619+0000 7fac9dffb700 1 -- 172.21.15.50:0/3227310992 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7faca8043050 con 0x55ad9cd93750 2024-06-06T03:26:13.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.619+0000 7facc750eb80 10 client.15177 fetch_fsmap learned FSMap version 26 2024-06-06T03:26:13.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.619+0000 7facc750eb80 1 -- 172.21.15.50:0/3227310992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ad9cdaa900 con 0x55ad9cd93750 2024-06-06T03:26:13.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.619+0000 7fac9dffb700 1 -- 172.21.15.50:0/3227310992 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faca80045b0 con 0x55ad9cd93750 2024-06-06T03:26:13.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.619+0000 7fac9dffb700 1 -- 172.21.15.50:0/3227310992 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7faca8005450 con 0x55ad9cd93750 2024-06-06T03:26:13.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.620+0000 7facc750eb80 10 client.15177 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T03:26:13.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.620+0000 7facc750eb80 10 client.15177 resolve_mds: resolved name 'f' to daemon mds.f 2024-06-06T03:26:13.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.620+0000 7facc750eb80 20 client.15177 populate_metadata read hostname 'smithi050' 2024-06-06T03:26:13.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.620+0000 7facc750eb80 1 --2- 172.21.15.50:0/3227310992 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55ad9cdabc50 0x55ad9cdaddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:13.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.620+0000 7facc750eb80 4 client.15177 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:26:13.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.620+0000 7facc750eb80 1 -- 172.21.15.50:0/3227310992 --> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad9ccf1d00 con 0x55ad9cdabc50 2024-06-06T03:26:13.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.620+0000 7facb5d9b700 1 --2- 172.21.15.50:0/3227310992 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55ad9cdabc50 0x55ad9cdaddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:13.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.620+0000 7fac9dffb700 10 client.15177 ms_handle_connect on v2:172.21.15.122:6834/2987597320 2024-06-06T03:26:13.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.620+0000 7facb5d9b700 1 --2- 172.21.15.50:0/3227310992 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55ad9cdabc50 0x55ad9cdaddb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c67ab48929dda6ae server_cookie=cf8a60e74d99decb in_seq=0 out_seq=0 2024-06-06T03:26:13.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.621+0000 7fac9dffb700 1 -- 172.21.15.50:0/3227310992 <== mds.2 v2:172.21.15.122:6834/2987597320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55ad9ccf1d00 con 0x55ad9cdabc50 2024-06-06T03:26:13.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.621+0000 7fac9dffb700 10 client.15177 handle_command_reply: tid=0 2024-06-06T03:26:13.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.621+0000 7facc750eb80 1 client.15177 shutdown 2024-06-06T03:26:13.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.621+0000 7facc750eb80 1 -- 172.21.15.50:0/3227310992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad9cd93750 msgr2=0x55ad9cd9f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:13.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.621+0000 7facc750eb80 1 --2- 172.21.15.50:0/3227310992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad9cd93750 0x55ad9cd9f5c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7faca8009d10 tx=0x7faca8024cb0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.622+0000 7facc750eb80 1 -- 172.21.15.50:0/3227310992 shutdown_connections 2024-06-06T03:26:13.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.622+0000 7facc750eb80 1 --2- 172.21.15.50:0/3227310992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad9cd99830 0x55ad9cd9ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.622+0000 7facc750eb80 1 --2- 172.21.15.50:0/3227310992 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55ad9cdabc50 0x55ad9cdaddb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.622+0000 7facc750eb80 1 --2- 172.21.15.50:0/3227310992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad9cd93750 0x55ad9cd9f5c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.622+0000 7facc750eb80 1 --2- 172.21.15.50:0/3227310992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad9cd98f10 0x55ad9cd9c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.622+0000 7facc750eb80 1 -- 172.21.15.50:0/3227310992 >> 172.21.15.50:0/3227310992 conn(0x55ad9ccc0030 msgr2=0x55ad9cd8d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:13.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.622+0000 7fac9dffb700 0 client.15177 ms_handle_reset on v2:172.21.15.122:6834/2987597320 2024-06-06T03:26:13.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.622+0000 7facc750eb80 1 -- 172.21.15.50:0/3227310992 shutdown_connections 2024-06-06T03:26:13.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.622+0000 7facc750eb80 1 -- 172.21.15.50:0/3227310992 wait complete. 2024-06-06T03:26:13.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.622+0000 7facc750eb80 20 client.15177 trim_cache size 0 max 16384 2024-06-06T03:26:13.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.643+0000 7facc750eb80 1 Processor -- start 2024-06-06T03:26:13.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.643+0000 7facc750eb80 1 -- start start 2024-06-06T03:26:13.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.644+0000 7facc750eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad9cd93750 0x55ad9cd93210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:13.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.644+0000 7facc750eb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad9cd98f10 0x55ad9cd9a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.644+0000 7facc750eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad9cd99830 0x55ad9cd9e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.644+0000 7facc750eb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ad9cdac0f0 con 0x55ad9cd98f10 2024-06-06T03:26:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.644+0000 7facc750eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ad9cdac7c0 con 0x55ad9cd93750 2024-06-06T03:26:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.644+0000 7facc750eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ad9cdace90 con 0x55ad9cd99830 2024-06-06T03:26:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.644+0000 7facb5d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad9cd98f10 0x55ad9cd9a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.644+0000 7facb6d9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad9cd99830 0x55ad9cd9e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.644+0000 7facb5d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad9cd98f10 0x55ad9cd9a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38518/0 (socket says 172.21.15.50:38518) 2024-06-06T03:26:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.644+0000 7facb5d9b700 1 -- 172.21.15.50:0/4056359798 learned_addr learned my addr 172.21.15.50:0/4056359798 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.644+0000 7facb659c700 1 --2- 172.21.15.50:0/4056359798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad9cd93750 0x55ad9cd93210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.644+0000 7facb5d9b700 1 -- 172.21.15.50:0/4056359798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad9cd99830 msgr2=0x55ad9cd9e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.644+0000 7facb5d9b700 1 --2- 172.21.15.50:0/4056359798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad9cd99830 0x55ad9cd9e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.644+0000 7facb5d9b700 1 -- 172.21.15.50:0/4056359798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad9cd93750 msgr2=0x55ad9cd93210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.644+0000 7facb5d9b700 1 --2- 172.21.15.50:0/4056359798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad9cd93750 0x55ad9cd93210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.644+0000 7facb5d9b700 1 -- 172.21.15.50:0/4056359798 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad9cda0150 con 0x55ad9cd98f10 2024-06-06T03:26:13.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.644+0000 7facb6d9d700 1 --2- 172.21.15.50:0/4056359798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad9cd99830 0x55ad9cd9e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:26:13.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.644+0000 7facb5d9b700 1 --2- 172.21.15.50:0/4056359798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad9cd98f10 0x55ad9cd9a4a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7facac00c5b0 tx=0x7facac009790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc67736765f92775 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:13.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.645+0000 7fac9ffff700 1 -- 172.21.15.50:0/4056359798 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facac0b9070 con 0x55ad9cd98f10 2024-06-06T03:26:13.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.645+0000 7fac9ffff700 1 -- 172.21.15.50:0/4056359798 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7facac09bab0 con 0x55ad9cd98f10 2024-06-06T03:26:13.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.645+0000 7fac9ffff700 1 -- 172.21.15.50:0/4056359798 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facac09bf70 con 0x55ad9cd98f10 2024-06-06T03:26:13.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.645+0000 7facc750eb80 1 -- 172.21.15.50:0/4056359798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad9cd98f10 msgr2=0x55ad9cd9a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:13.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.645+0000 7facc750eb80 1 --2- 172.21.15.50:0/4056359798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad9cd98f10 0x55ad9cd9a4a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7facac00c5b0 tx=0x7facac009790 comp rx=0 tx=0).stop 2024-06-06T03:26:13.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.645+0000 7facc750eb80 1 -- 172.21.15.50:0/4056359798 shutdown_connections 2024-06-06T03:26:13.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.645+0000 7facc750eb80 1 --2- 172.21.15.50:0/4056359798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad9cd99830 0x55ad9cd9e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.645+0000 7facc750eb80 1 --2- 172.21.15.50:0/4056359798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad9cd93750 0x55ad9cd93210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.645+0000 7facc750eb80 1 --2- 172.21.15.50:0/4056359798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad9cd98f10 0x55ad9cd9a4a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.645+0000 7facc750eb80 1 -- 172.21.15.50:0/4056359798 >> 172.21.15.50:0/4056359798 conn(0x55ad9ccc0030 msgr2=0x55ad9cd9e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:13.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.646+0000 7facc750eb80 1 -- 172.21.15.50:0/4056359798 shutdown_connections 2024-06-06T03:26:13.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.646+0000 7facc750eb80 1 -- 172.21.15.50:0/4056359798 wait complete. 2024-06-06T03:26:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.646+0000 7facc750eb80 1 -- start start 2024-06-06T03:26:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.646+0000 7facc750eb80 1 Processor -- start 2024-06-06T03:26:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.646+0000 7facc750eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad9cd93750 0x55ad9cdb0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.646+0000 7facc750eb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad9cd99830 0x55ad9cdb1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.646+0000 7facc750eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad9cdb1a60 0x55ad9cdb5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.646+0000 7facc750eb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ad9cdadc30 con 0x55ad9cd99830 2024-06-06T03:26:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.646+0000 7facc750eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ad9cdad560 con 0x55ad9cdb1a60 2024-06-06T03:26:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.646+0000 7facc750eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ad9cdae300 con 0x55ad9cd93750 2024-06-06T03:26:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.646+0000 7facc750eb80 10 client.0 _ll_register_callbacks cb 0x55ad9cc7a560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:26:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.646+0000 7facb659c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad9cd93750 0x55ad9cdb0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.646+0000 7facb5d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad9cd99830 0x55ad9cdb1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.646+0000 7facb659c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad9cd93750 0x55ad9cdb0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:46950/0 (socket says 172.21.15.50:46950) 2024-06-06T03:26:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.647+0000 7facb659c700 1 -- 172.21.15.50:0/3004707227 learned_addr learned my addr 172.21.15.50:0/3004707227 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:13.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.647+0000 7facb6d9d700 1 --2- 172.21.15.50:0/3004707227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad9cdb1a60 0x55ad9cdb5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:13.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.647+0000 7facb659c700 1 -- 172.21.15.50:0/3004707227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad9cdb1a60 msgr2=0x55ad9cdb5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:13.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.647+0000 7facb659c700 1 --2- 172.21.15.50:0/3004707227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad9cdb1a60 0x55ad9cdb5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.647+0000 7facb659c700 1 -- 172.21.15.50:0/3004707227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad9cd99830 msgr2=0x55ad9cdb1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:13.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.647+0000 7facb659c700 1 --2- 172.21.15.50:0/3004707227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad9cd99830 0x55ad9cdb1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.647+0000 7facb659c700 1 -- 172.21.15.50:0/3004707227 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad9cdb5d80 con 0x55ad9cd93750 2024-06-06T03:26:13.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.647+0000 7facb6d9d700 1 --2- 172.21.15.50:0/3004707227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad9cdb1a60 0x55ad9cdb5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:26:13.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.647+0000 7facb659c700 1 --2- 172.21.15.50:0/3004707227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad9cd93750 0x55ad9cdb0fe0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faca8009e60 tx=0x7faca8009e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=387b6d1afc83180a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:13.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.647+0000 7fac9dffb700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:26:13.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.647+0000 7fac9dffb700 1 -- 172.21.15.50:0/3004707227 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca803c050 con 0x55ad9cd93750 2024-06-06T03:26:13.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.647+0000 7facc750eb80 1 -- 172.21.15.50:0/3004707227 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facac09bab0 con 0x55ad9cd93750 2024-06-06T03:26:13.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.647+0000 7fac9dffb700 1 -- 172.21.15.50:0/3004707227 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7faca800bc50 con 0x55ad9cd93750 2024-06-06T03:26:13.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.647+0000 7fac9dffb700 1 -- 172.21.15.50:0/3004707227 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7faca800be90 con 0x55ad9cd93750 2024-06-06T03:26:13.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.647+0000 7facc750eb80 10 client.24904 fetch_fsmap learned FSMap version 26 2024-06-06T03:26:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.647+0000 7facc750eb80 1 -- 172.21.15.50:0/3004707227 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ad9ce189b0 con 0x55ad9cd93750 2024-06-06T03:26:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.648+0000 7fac9dffb700 1 -- 172.21.15.50:0/3004707227 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7facac09bab0 con 0x55ad9cd93750 2024-06-06T03:26:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.648+0000 7fac9dffb700 1 -- 172.21.15.50:0/3004707227 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7faca8004810 con 0x55ad9cd93750 2024-06-06T03:26:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.648+0000 7facc750eb80 10 client.24904 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T03:26:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.648+0000 7facc750eb80 10 client.24904 resolve_mds: resolved name 'f' to daemon mds.f 2024-06-06T03:26:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.648+0000 7facc750eb80 20 client.24904 populate_metadata read hostname 'smithi050' 2024-06-06T03:26:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.648+0000 7facc750eb80 1 --2- 172.21.15.50:0/3004707227 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55ad9ce1d2c0 0x55ad9ce1bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.648+0000 7facc750eb80 4 client.24904 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-06T03:26:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.648+0000 7facc750eb80 1 -- 172.21.15.50:0/3004707227 --> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] -- command(tid 0: {"prefix": "status"}) -- 0x55ad9ccec280 con 0x55ad9ce1d2c0 2024-06-06T03:26:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.648+0000 7facb5d9b700 1 --2- 172.21.15.50:0/3004707227 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55ad9ce1d2c0 0x55ad9ce1bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.648+0000 7facb5d9b700 1 --2- 172.21.15.50:0/3004707227 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55ad9ce1d2c0 0x55ad9ce1bfd0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d1ab061a9f92bab7 server_cookie=bb4c273d9c1adf3c in_seq=0 out_seq=0 2024-06-06T03:26:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.648+0000 7fac9dffb700 10 client.24904 ms_handle_connect on v2:172.21.15.122:6834/2987597320 2024-06-06T03:26:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.649+0000 7fac9dffb700 1 -- 172.21.15.50:0/3004707227 <== mds.2 v2:172.21.15.122:6834/2987597320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55ad9ccec280 con 0x55ad9ce1d2c0 2024-06-06T03:26:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.649+0000 7fac9dffb700 10 client.24904 handle_command_reply: tid=0 2024-06-06T03:26:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.649+0000 7facc750eb80 1 client.24904 shutdown 2024-06-06T03:26:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.649+0000 7facc750eb80 1 -- 172.21.15.50:0/3004707227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad9cd93750 msgr2=0x55ad9cdb0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.649+0000 7facc750eb80 1 --2- 172.21.15.50:0/3004707227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad9cd93750 0x55ad9cdb0fe0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faca8009e60 tx=0x7faca8009e90 comp rx=0 tx=0).stop 2024-06-06T03:26:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.649+0000 7facc750eb80 1 -- 172.21.15.50:0/3004707227 shutdown_connections 2024-06-06T03:26:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.649+0000 7facc750eb80 1 --2- 172.21.15.50:0/3004707227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad9cdb1a60 0x55ad9cdb5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.649+0000 7facc750eb80 1 --2- 172.21.15.50:0/3004707227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad9cd93750 0x55ad9cdb0fe0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.649+0000 7facc750eb80 1 --2- 172.21.15.50:0/3004707227 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55ad9ce1d2c0 0x55ad9ce1bfd0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.649+0000 7facc750eb80 1 --2- 172.21.15.50:0/3004707227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad9cd99830 0x55ad9cdb1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.649+0000 7fac9dffb700 0 client.24904 ms_handle_reset on v2:172.21.15.122:6834/2987597320 2024-06-06T03:26:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.649+0000 7facc750eb80 1 -- 172.21.15.50:0/3004707227 >> 172.21.15.50:0/3004707227 conn(0x55ad9ccc0030 msgr2=0x55ad9cd9e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.649+0000 7facc750eb80 1 -- 172.21.15.50:0/3004707227 shutdown_connections 2024-06-06T03:26:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.649+0000 7facc750eb80 1 -- 172.21.15.50:0/3004707227 wait complete. 2024-06-06T03:26:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.649+0000 7facc750eb80 20 client.24904 trim_cache size 0 max 16384 2024-06-06T03:26:13.655 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:26:13.655 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "b6263b26-23b2-11ef-bc9b-c7b262605968", 2024-06-06T03:26:13.655 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 2, 2024-06-06T03:26:13.655 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24466, 2024-06-06T03:26:13.655 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-06-06T03:26:13.655 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-06-06T03:26:13.655 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-06-06T03:26:13.655 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 161.07048607600001, 2024-06-06T03:26:13.655 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 26, 2024-06-06T03:26:13.655 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 99, 2024-06-06T03:26:13.656 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 97, 2024-06-06T03:26:13.656 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 250.25665668299999 2024-06-06T03:26:13.656 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:26:13.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.650+0000 7facbcc8b700 1 -- 172.21.15.50:0/3175515398 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7faca00a2ca0 msgr2=0x7faca00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:13.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.650+0000 7facbcc8b700 1 --2- 172.21.15.50:0/3175515398 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7faca00a2ca0 0x7faca00a5160 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7faca8000c00 tx=0x7faca8005fb0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.650+0000 7facbcc8b700 1 -- 172.21.15.50:0/3175515398 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facb8102ee0 msgr2=0x7facb819ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:13.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.650+0000 7facbcc8b700 1 --2- 172.21.15.50:0/3175515398 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facb8102ee0 0x7facb819ed30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7facac00e9a0 tx=0x7facac00ecb0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.650+0000 7facbcc8b700 1 -- 172.21.15.50:0/3175515398 shutdown_connections 2024-06-06T03:26:13.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.650+0000 7facbcc8b700 1 --2- 172.21.15.50:0/3175515398 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7faca00a2ca0 0x7faca00a5160 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.650+0000 7facbcc8b700 1 --2- 172.21.15.50:0/3175515398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facb81085c0 0x7facb81989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.650+0000 7facbcc8b700 1 --2- 172.21.15.50:0/3175515398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facb8102520 0x7facb819e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.650+0000 7facbcc8b700 1 --2- 172.21.15.50:0/3175515398 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facb8102ee0 0x7facb819ed30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:13.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.650+0000 7facbcc8b700 1 -- 172.21.15.50:0/3175515398 >> 172.21.15.50:0/3175515398 conn(0x7facb8079680 msgr2=0x7facb81011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:13.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.650+0000 7facbcc8b700 1 -- 172.21.15.50:0/3175515398 shutdown_connections 2024-06-06T03:26:13.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:13.650+0000 7facbcc8b700 1 -- 172.21.15.50:0/3175515398 wait complete. 2024-06-06T03:26:14.380 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.c status 2024-06-06T03:26:14.640 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:26:14.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:26:14.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:14 smithi122 ceph-mon[35759]: pgmap v419: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T03:26:14.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:26:14.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:26:14.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:26:14.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:26:14.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:14 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:26:14.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:26:14.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:14 smithi050 ceph-mon[32421]: pgmap v419: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T03:26:14.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:26:14.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:26:14.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:26:14.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:26:14.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:14 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:26:14.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:26:14.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:14 smithi079 ceph-mon[35478]: pgmap v419: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T03:26:14.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:26:14.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:26:14.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:26:14.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:26:14.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:14 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:26:15.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:15 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:26:15.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:15 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:26:15.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:15 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:26:15.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:15 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:26:15.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:15 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:26:15.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:15 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:26:15.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:26:15.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:26:15.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:26:16.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.351+0000 7f3876277700 1 -- 172.21.15.50:0/2913120583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38701073f0 msgr2=0x7f38701077d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:16.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.351+0000 7f3876277700 1 --2- 172.21.15.50:0/2913120583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38701073f0 0x7f38701077d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3860009990 tx=0x7f3860009ca0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.351+0000 7f3876277700 1 -- 172.21.15.50:0/2913120583 shutdown_connections 2024-06-06T03:26:16.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.351+0000 7f3876277700 1 --2- 172.21.15.50:0/2913120583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3870101d40 0x7f387010e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.351+0000 7f3876277700 1 --2- 172.21.15.50:0/2913120583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38701073f0 0x7f38701077d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.351+0000 7f3876277700 1 --2- 172.21.15.50:0/2913120583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3870101380 0x7f3870101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.351+0000 7f3876277700 1 -- 172.21.15.50:0/2913120583 >> 172.21.15.50:0/2913120583 conn(0x7f3870078300 msgr2=0x7f3870078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:16.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.351+0000 7f3876277700 1 -- 172.21.15.50:0/2913120583 shutdown_connections 2024-06-06T03:26:16.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.351+0000 7f3876277700 1 -- 172.21.15.50:0/2913120583 wait complete. 2024-06-06T03:26:16.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.352+0000 7f3876277700 1 Processor -- start 2024-06-06T03:26:16.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.352+0000 7f3876277700 1 -- start start 2024-06-06T03:26:16.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.352+0000 7f3876277700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3870101380 0x7f3870103060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:16.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.352+0000 7f3876277700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3870101d40 0x7f38701035a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:16.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.352+0000 7f3876277700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38701073f0 0x7f3870103ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:16.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.352+0000 7f3876277700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3870111510 con 0x7f38701073f0 2024-06-06T03:26:16.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.352+0000 7f3876277700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3870111390 con 0x7f3870101d40 2024-06-06T03:26:16.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.352+0000 7f3876277700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3870111690 con 0x7f3870101380 2024-06-06T03:26:16.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.352+0000 7f3874814700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38701073f0 0x7f3870103ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:16.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.352+0000 7f3874814700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38701073f0 0x7f3870103ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38544/0 (socket says 172.21.15.50:38544) 2024-06-06T03:26:16.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.352+0000 7f3874814700 1 -- 172.21.15.50:0/3100713131 learned_addr learned my addr 172.21.15.50:0/3100713131 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:16.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.353+0000 7f3867fff700 1 --2- 172.21.15.50:0/3100713131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3870101d40 0x7f38701035a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:16.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.353+0000 7f386ffff700 1 --2- 172.21.15.50:0/3100713131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3870101380 0x7f3870103060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:16.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.353+0000 7f3874814700 1 -- 172.21.15.50:0/3100713131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3870101380 msgr2=0x7f3870103060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:16.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.353+0000 7f3874814700 1 --2- 172.21.15.50:0/3100713131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3870101380 0x7f3870103060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.353+0000 7f3874814700 1 -- 172.21.15.50:0/3100713131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3870101d40 msgr2=0x7f38701035a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:16.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.353+0000 7f3874814700 1 --2- 172.21.15.50:0/3100713131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3870101d40 0x7f38701035a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.353+0000 7f3874814700 1 -- 172.21.15.50:0/3100713131 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38701a7070 con 0x7f38701073f0 2024-06-06T03:26:16.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.353+0000 7f3874814700 1 --2- 172.21.15.50:0/3100713131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38701073f0 0x7f3870103ae0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3868007ee0 tx=0x7f386800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:16.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.353+0000 7f386dffb700 1 -- 172.21.15.50:0/3100713131 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3868004bb0 con 0x7f38701073f0 2024-06-06T03:26:16.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.353+0000 7f386dffb700 1 -- 172.21.15.50:0/3100713131 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3868004d50 con 0x7f38701073f0 2024-06-06T03:26:16.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.353+0000 7f3876277700 1 -- 172.21.15.50:0/3100713131 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38701a7360 con 0x7f38701073f0 2024-06-06T03:26:16.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.353+0000 7f386dffb700 1 -- 172.21.15.50:0/3100713131 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38680058e0 con 0x7f38701073f0 2024-06-06T03:26:16.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.353+0000 7f3876277700 1 -- 172.21.15.50:0/3100713131 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38701a7850 con 0x7f38701073f0 2024-06-06T03:26:16.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.356+0000 7f386dffb700 1 -- 172.21.15.50:0/3100713131 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f386801a020 con 0x7f38701073f0 2024-06-06T03:26:16.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.356+0000 7f386dffb700 1 --2- 172.21.15.50:0/3100713131 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f385c0a2c20 0x7f385c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:16.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.357+0000 7f386ffff700 1 --2- 172.21.15.50:0/3100713131 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f385c0a2c20 0x7f385c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:16.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.357+0000 7f386dffb700 1 -- 172.21.15.50:0/3100713131 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f38680ceaa0 con 0x7f38701073f0 2024-06-06T03:26:16.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.357+0000 7f386ffff700 1 --2- 172.21.15.50:0/3100713131 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f385c0a2c20 0x7f385c0a50e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f386000b5c0 tx=0x7f3860005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:16.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.357+0000 7f3880afab80 1 Processor -- start 2024-06-06T03:26:16.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.357+0000 7f3880afab80 1 -- start start 2024-06-06T03:26:16.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.357+0000 7f3880afab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b6209bf10 0x562b6209c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:16.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.357+0000 7f3880afab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b6209c830 0x562b62096210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:16.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.357+0000 7f3880afab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b62096750 0x562b62096b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:16.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.357+0000 7f3880afab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562b61f88f10 con 0x562b6209c830 2024-06-06T03:26:16.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.357+0000 7f3880afab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562b61fe7800 con 0x562b6209bf10 2024-06-06T03:26:16.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.357+0000 7f3880afab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562b61f4f410 con 0x562b62096750 2024-06-06T03:26:16.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.358+0000 7f3867fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b6209c830 0x562b62096210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:16.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.358+0000 7f3867fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b6209c830 0x562b62096210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38546/0 (socket says 172.21.15.50:38546) 2024-06-06T03:26:16.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.358+0000 7f3867fff700 1 -- 172.21.15.50:0/2772686720 learned_addr learned my addr 172.21.15.50:0/2772686720 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:16.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.358+0000 7f386ffff700 1 --2- 172.21.15.50:0/2772686720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b6209bf10 0x562b6209c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:16.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.358+0000 7f3874814700 1 --2- 172.21.15.50:0/2772686720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b62096750 0x562b62096b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:16.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.358+0000 7f3867fff700 1 -- 172.21.15.50:0/2772686720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b62096750 msgr2=0x562b62096b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:16.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.358+0000 7f3867fff700 1 --2- 172.21.15.50:0/2772686720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b62096750 0x562b62096b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.358+0000 7f3867fff700 1 -- 172.21.15.50:0/2772686720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b6209bf10 msgr2=0x562b6209c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:16.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.358+0000 7f3867fff700 1 --2- 172.21.15.50:0/2772686720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b6209bf10 0x562b6209c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.358+0000 7f3867fff700 1 -- 172.21.15.50:0/2772686720 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b61f36880 con 0x562b6209c830 2024-06-06T03:26:16.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.358+0000 7f3867fff700 1 --2- 172.21.15.50:0/2772686720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b6209c830 0x562b62096210 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f385800bcf0 tx=0x7f38580103d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4313809c6177ab server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:16.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.358+0000 7f38667fc700 1 -- 172.21.15.50:0/2772686720 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3858010dc0 con 0x562b6209c830 2024-06-06T03:26:16.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.358+0000 7f38667fc700 1 -- 172.21.15.50:0/2772686720 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f38580044e0 con 0x562b6209c830 2024-06-06T03:26:16.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.358+0000 7f38667fc700 1 -- 172.21.15.50:0/2772686720 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38580052f0 con 0x562b6209c830 2024-06-06T03:26:16.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.359+0000 7f3880afab80 1 -- 172.21.15.50:0/2772686720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b6209c830 msgr2=0x562b62096210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:16.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.359+0000 7f3880afab80 1 --2- 172.21.15.50:0/2772686720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b6209c830 0x562b62096210 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f385800bcf0 tx=0x7f38580103d0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.359+0000 7f3880afab80 1 -- 172.21.15.50:0/2772686720 shutdown_connections 2024-06-06T03:26:16.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.359+0000 7f3880afab80 1 --2- 172.21.15.50:0/2772686720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b62096750 0x562b62096b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.359+0000 7f3880afab80 1 --2- 172.21.15.50:0/2772686720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b6209bf10 0x562b6209c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.359+0000 7f3880afab80 1 --2- 172.21.15.50:0/2772686720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b6209c830 0x562b62096210 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.359+0000 7f3880afab80 1 -- 172.21.15.50:0/2772686720 >> 172.21.15.50:0/2772686720 conn(0x562b61fc3030 msgr2=0x562b620911d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:16.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.359+0000 7f3880afab80 1 -- 172.21.15.50:0/2772686720 shutdown_connections 2024-06-06T03:26:16.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.359+0000 7f3880afab80 1 -- 172.21.15.50:0/2772686720 wait complete. 2024-06-06T03:26:16.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.359+0000 7f3880afab80 1 -- start start 2024-06-06T03:26:16.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.360+0000 7f3880afab80 1 Processor -- start 2024-06-06T03:26:16.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.360+0000 7f3880afab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b62096750 0x562b620a2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:16.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.360+0000 7f3880afab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b6209bf10 0x562b6209f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:16.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.360+0000 7f3880afab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b6209c830 0x562b6209fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:16.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.360+0000 7f3880afab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562b61f87f70 con 0x562b62096750 2024-06-06T03:26:16.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.360+0000 7f3880afab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562b61fe37c0 con 0x562b6209c830 2024-06-06T03:26:16.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.360+0000 7f3880afab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562b620a3210 con 0x562b6209bf10 2024-06-06T03:26:16.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.360+0000 7f3880afab80 10 client.0 _ll_register_callbacks cb 0x562b61f7d560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:26:16.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.360+0000 7f386ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b62096750 0x562b620a2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:16.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.360+0000 7f386ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b62096750 0x562b620a2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38560/0 (socket says 172.21.15.50:38560) 2024-06-06T03:26:16.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.360+0000 7f386ffff700 1 -- 172.21.15.50:0/2838554037 learned_addr learned my addr 172.21.15.50:0/2838554037 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:16.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.360+0000 7f3867fff700 1 --2- 172.21.15.50:0/2838554037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b6209bf10 0x562b6209f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:16.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.360+0000 7f3874814700 1 --2- 172.21.15.50:0/2838554037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b6209c830 0x562b6209fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:16.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.361+0000 7f386ffff700 1 -- 172.21.15.50:0/2838554037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b6209bf10 msgr2=0x562b6209f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:16.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.361+0000 7f386ffff700 1 --2- 172.21.15.50:0/2838554037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b6209bf10 0x562b6209f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.361+0000 7f386ffff700 1 -- 172.21.15.50:0/2838554037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b6209c830 msgr2=0x562b6209fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:16.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.361+0000 7f386ffff700 1 --2- 172.21.15.50:0/2838554037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b6209c830 0x562b6209fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.361+0000 7f386ffff700 1 -- 172.21.15.50:0/2838554037 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b61fad700 con 0x562b62096750 2024-06-06T03:26:16.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.361+0000 7f386ffff700 1 --2- 172.21.15.50:0/2838554037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b62096750 0x562b620a2570 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3860009990 tx=0x7f3860009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3fffc2c860c7030 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:16.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.361+0000 7f384f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:26:16.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.361+0000 7f384f7fe700 1 -- 172.21.15.50:0/2838554037 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3860024d30 con 0x562b62096750 2024-06-06T03:26:16.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.361+0000 7f384f7fe700 1 -- 172.21.15.50:0/2838554037 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f386000f460 con 0x562b62096750 2024-06-06T03:26:16.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.361+0000 7f3880afab80 1 -- 172.21.15.50:0/2838554037 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38580044e0 con 0x562b62096750 2024-06-06T03:26:16.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.361+0000 7f384f7fe700 1 -- 172.21.15.50:0/2838554037 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f386003d050 con 0x562b62096750 2024-06-06T03:26:16.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.361+0000 7f3880afab80 10 client.15195 fetch_fsmap learned FSMap version 26 2024-06-06T03:26:16.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.361+0000 7f3880afab80 1 -- 172.21.15.50:0/2838554037 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562b620ad970 con 0x562b62096750 2024-06-06T03:26:16.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.361+0000 7f384f7fe700 1 -- 172.21.15.50:0/2838554037 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f38580044e0 con 0x562b62096750 2024-06-06T03:26:16.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.362+0000 7f384f7fe700 1 -- 172.21.15.50:0/2838554037 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f386002f580 con 0x562b62096750 2024-06-06T03:26:16.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.362+0000 7f3880afab80 10 client.15195 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T03:26:16.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.362+0000 7f3880afab80 10 client.15195 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-06T03:26:16.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.362+0000 7f3880afab80 20 client.15195 populate_metadata read hostname 'smithi050' 2024-06-06T03:26:16.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.362+0000 7f3880afab80 1 --2- 172.21.15.50:0/2838554037 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x562b620afff0 0x562b620b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:16.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.362+0000 7f3880afab80 4 client.15195 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:26:16.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.362+0000 7f3880afab80 1 -- 172.21.15.50:0/2838554037 --> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b61ff4d00 con 0x562b620afff0 2024-06-06T03:26:16.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.362+0000 7f3867fff700 1 --2- 172.21.15.50:0/2838554037 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x562b620afff0 0x562b620b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.362+0000 7f384f7fe700 10 client.15195 ms_handle_connect on v2:172.21.15.122:6836/1604366318 2024-06-06T03:26:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.362+0000 7f3867fff700 1 --2- 172.21.15.50:0/2838554037 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x562b620afff0 0x562b620b1460 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=860d58ff14688bc2 server_cookie=ea39de32d171d47d in_seq=0 out_seq=0 2024-06-06T03:26:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.363+0000 7f384f7fe700 1 -- 172.21.15.50:0/2838554037 <== mds.1 v2:172.21.15.122:6836/1604366318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x562b61ff4d00 con 0x562b620afff0 2024-06-06T03:26:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.363+0000 7f384f7fe700 10 client.15195 handle_command_reply: tid=0 2024-06-06T03:26:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.363+0000 7f3880afab80 1 client.15195 shutdown 2024-06-06T03:26:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.363+0000 7f3880afab80 1 -- 172.21.15.50:0/2838554037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b62096750 msgr2=0x562b620a2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.363+0000 7f3880afab80 1 --2- 172.21.15.50:0/2838554037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b62096750 0x562b620a2570 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3860009990 tx=0x7f3860009310 comp rx=0 tx=0).stop 2024-06-06T03:26:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.363+0000 7f3880afab80 1 -- 172.21.15.50:0/2838554037 shutdown_connections 2024-06-06T03:26:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.363+0000 7f3880afab80 1 --2- 172.21.15.50:0/2838554037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b6209c830 0x562b6209fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.363+0000 7f3880afab80 1 --2- 172.21.15.50:0/2838554037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b62096750 0x562b620a2570 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.363+0000 7f3880afab80 1 --2- 172.21.15.50:0/2838554037 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x562b620afff0 0x562b620b1460 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.364+0000 7f384f7fe700 0 client.15195 ms_handle_reset on v2:172.21.15.122:6836/1604366318 2024-06-06T03:26:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.363+0000 7f3880afab80 1 --2- 172.21.15.50:0/2838554037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b6209bf10 0x562b6209f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.364+0000 7f3880afab80 1 -- 172.21.15.50:0/2838554037 >> 172.21.15.50:0/2838554037 conn(0x562b61fc3030 msgr2=0x562b620906b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:16.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.364+0000 7f3880afab80 1 -- 172.21.15.50:0/2838554037 shutdown_connections 2024-06-06T03:26:16.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.364+0000 7f3880afab80 1 -- 172.21.15.50:0/2838554037 wait complete. 2024-06-06T03:26:16.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.364+0000 7f3880afab80 20 client.15195 trim_cache size 0 max 16384 2024-06-06T03:26:16.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.386+0000 7f3880afab80 1 Processor -- start 2024-06-06T03:26:16.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.386+0000 7f3880afab80 1 -- start start 2024-06-06T03:26:16.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.386+0000 7f3880afab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b62096750 0x562b620af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:16.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.386+0000 7f3880afab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b6209bf10 0x562b62090e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:16.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.386+0000 7f3880afab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b6209c830 0x562b62091370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:16.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.386+0000 7f3880afab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562b620af7a0 con 0x562b62096750 2024-06-06T03:26:16.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.386+0000 7f3880afab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562b620afe70 con 0x562b6209bf10 2024-06-06T03:26:16.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.386+0000 7f3880afab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562b620b0540 con 0x562b6209c830 2024-06-06T03:26:16.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.386+0000 7f386ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b62096750 0x562b620af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:16.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.386+0000 7f386ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b62096750 0x562b620af1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38574/0 (socket says 172.21.15.50:38574) 2024-06-06T03:26:16.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.386+0000 7f386ffff700 1 -- 172.21.15.50:0/591658547 learned_addr learned my addr 172.21.15.50:0/591658547 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:16.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.387+0000 7f3867fff700 1 --2- 172.21.15.50:0/591658547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b6209bf10 0x562b62090e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:16.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.387+0000 7f386ffff700 1 -- 172.21.15.50:0/591658547 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b6209c830 msgr2=0x562b62091370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:16.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.387+0000 7f386ffff700 1 --2- 172.21.15.50:0/591658547 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b6209c830 0x562b62091370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.387+0000 7f386ffff700 1 -- 172.21.15.50:0/591658547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b6209bf10 msgr2=0x562b62090e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:16.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.387+0000 7f386ffff700 1 --2- 172.21.15.50:0/591658547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b6209bf10 0x562b62090e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.387+0000 7f386ffff700 1 -- 172.21.15.50:0/591658547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b6209a2f0 con 0x562b62096750 2024-06-06T03:26:16.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.387+0000 7f386ffff700 1 --2- 172.21.15.50:0/591658547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b62096750 0x562b620af1a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3860009ce0 tx=0x7f386002fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4af5b07f682a6b server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:16.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.387+0000 7f3865ffb700 1 -- 172.21.15.50:0/591658547 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3860045020 con 0x562b62096750 2024-06-06T03:26:16.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.387+0000 7f3865ffb700 1 -- 172.21.15.50:0/591658547 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3860034070 con 0x562b62096750 2024-06-06T03:26:16.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.387+0000 7f3865ffb700 1 -- 172.21.15.50:0/591658547 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38600177f0 con 0x562b62096750 2024-06-06T03:26:16.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.388+0000 7f3880afab80 1 -- 172.21.15.50:0/591658547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b62096750 msgr2=0x562b620af1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:16.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.388+0000 7f3880afab80 1 --2- 172.21.15.50:0/591658547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b62096750 0x562b620af1a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3860009ce0 tx=0x7f386002fda0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.388+0000 7f3880afab80 1 -- 172.21.15.50:0/591658547 shutdown_connections 2024-06-06T03:26:16.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.388+0000 7f3880afab80 1 --2- 172.21.15.50:0/591658547 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b6209c830 0x562b62091370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.388+0000 7f3880afab80 1 --2- 172.21.15.50:0/591658547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b62096750 0x562b620af1a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.388+0000 7f3880afab80 1 --2- 172.21.15.50:0/591658547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b6209bf10 0x562b62090e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.388+0000 7f3880afab80 1 -- 172.21.15.50:0/591658547 >> 172.21.15.50:0/591658547 conn(0x562b61fc3030 msgr2=0x562b6209e180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:16.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.388+0000 7f3880afab80 1 -- 172.21.15.50:0/591658547 shutdown_connections 2024-06-06T03:26:16.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.388+0000 7f3880afab80 1 -- 172.21.15.50:0/591658547 wait complete. 2024-06-06T03:26:16.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.388+0000 7f3880afab80 1 -- start start 2024-06-06T03:26:16.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.388+0000 7f3880afab80 1 Processor -- start 2024-06-06T03:26:16.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.389+0000 7f3880afab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b62096750 0x562b620ba8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:16.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.389+0000 7f3880afab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b6209bf10 0x562b620bae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:16.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.389+0000 7f3880afab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b6209c830 0x562b620b5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:16.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.389+0000 7f3880afab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562b620b12e0 con 0x562b6209bf10 2024-06-06T03:26:16.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.389+0000 7f3880afab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562b620b0c10 con 0x562b62096750 2024-06-06T03:26:16.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.389+0000 7f3880afab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562b620b19b0 con 0x562b6209c830 2024-06-06T03:26:16.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.389+0000 7f3880afab80 10 client.0 _ll_register_callbacks cb 0x562b61f7d560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:26:16.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.389+0000 7f3867fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b6209bf10 0x562b620bae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:16.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.389+0000 7f3867fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b6209bf10 0x562b620bae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38586/0 (socket says 172.21.15.50:38586) 2024-06-06T03:26:16.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.389+0000 7f3867fff700 1 -- 172.21.15.50:0/2603847604 learned_addr learned my addr 172.21.15.50:0/2603847604 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.389+0000 7f386ffff700 1 --2- 172.21.15.50:0/2603847604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b62096750 0x562b620ba8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.389+0000 7f3874814700 1 --2- 172.21.15.50:0/2603847604 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b6209c830 0x562b620b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.389+0000 7f3867fff700 1 -- 172.21.15.50:0/2603847604 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b6209c830 msgr2=0x562b620b5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.389+0000 7f3867fff700 1 --2- 172.21.15.50:0/2603847604 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b6209c830 0x562b620b5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.389+0000 7f3867fff700 1 -- 172.21.15.50:0/2603847604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b62096750 msgr2=0x562b620ba8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.389+0000 7f3867fff700 1 --2- 172.21.15.50:0/2603847604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b62096750 0x562b620ba8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.389+0000 7f3867fff700 1 -- 172.21.15.50:0/2603847604 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b620bb520 con 0x562b6209bf10 2024-06-06T03:26:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.389+0000 7f386ffff700 1 --2- 172.21.15.50:0/2603847604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b62096750 0x562b620ba8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:26:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.389+0000 7f3867fff700 1 --2- 172.21.15.50:0/2603847604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b6209bf10 0x562b620bae20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f385800bcf0 tx=0x7f3858005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a2c42a636fce1f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.389+0000 7f384f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:26:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.390+0000 7f384f7fe700 1 -- 172.21.15.50:0/2603847604 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385802c030 con 0x562b6209bf10 2024-06-06T03:26:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.390+0000 7f384f7fe700 1 -- 172.21.15.50:0/2603847604 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f3858004710 con 0x562b6209bf10 2024-06-06T03:26:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.390+0000 7f3880afab80 1 -- 172.21.15.50:0/2603847604 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3860034070 con 0x562b6209bf10 2024-06-06T03:26:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.390+0000 7f384f7fe700 1 -- 172.21.15.50:0/2603847604 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3858039050 con 0x562b6209bf10 2024-06-06T03:26:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.390+0000 7f3880afab80 10 client.15201 fetch_fsmap learned FSMap version 26 2024-06-06T03:26:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.390+0000 7f3880afab80 1 -- 172.21.15.50:0/2603847604 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562b6211bec0 con 0x562b6209bf10 2024-06-06T03:26:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.390+0000 7f384f7fe700 1 -- 172.21.15.50:0/2603847604 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3860034070 con 0x562b6209bf10 2024-06-06T03:26:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.390+0000 7f384f7fe700 1 -- 172.21.15.50:0/2603847604 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f3858011440 con 0x562b6209bf10 2024-06-06T03:26:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.390+0000 7f3880afab80 10 client.15201 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T03:26:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.390+0000 7f3880afab80 10 client.15201 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-06T03:26:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.390+0000 7f3880afab80 20 client.15201 populate_metadata read hostname 'smithi050' 2024-06-06T03:26:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.390+0000 7f3880afab80 1 --2- 172.21.15.50:0/2603847604 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x562b621207a0 0x562b6211f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.390+0000 7f3880afab80 4 client.15201 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-06T03:26:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.390+0000 7f3880afab80 1 -- 172.21.15.50:0/2603847604 --> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] -- command(tid 0: {"prefix": "status"}) -- 0x562b61fef280 con 0x562b621207a0 2024-06-06T03:26:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.391+0000 7f386ffff700 1 --2- 172.21.15.50:0/2603847604 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x562b621207a0 0x562b6211f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.391+0000 7f386ffff700 1 --2- 172.21.15.50:0/2603847604 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x562b621207a0 0x562b6211f4b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d76d4de53478624e server_cookie=b4be986cc71a9d19 in_seq=0 out_seq=0 2024-06-06T03:26:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.391+0000 7f384f7fe700 10 client.15201 ms_handle_connect on v2:172.21.15.122:6836/1604366318 2024-06-06T03:26:16.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.391+0000 7f384f7fe700 1 -- 172.21.15.50:0/2603847604 <== mds.1 v2:172.21.15.122:6836/1604366318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x562b61fef280 con 0x562b621207a0 2024-06-06T03:26:16.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.391+0000 7f384f7fe700 10 client.15201 handle_command_reply: tid=0 2024-06-06T03:26:16.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.391+0000 7f3880afab80 1 client.15201 shutdown 2024-06-06T03:26:16.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.391+0000 7f3880afab80 1 -- 172.21.15.50:0/2603847604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b6209bf10 msgr2=0x562b620bae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:16.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.391+0000 7f3880afab80 1 --2- 172.21.15.50:0/2603847604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b6209bf10 0x562b620bae20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f385800bcf0 tx=0x7f3858005d50 comp rx=0 tx=0).stop 2024-06-06T03:26:16.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.391+0000 7f3880afab80 1 -- 172.21.15.50:0/2603847604 shutdown_connections 2024-06-06T03:26:16.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.391+0000 7f3880afab80 1 --2- 172.21.15.50:0/2603847604 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x562b621207a0 0x562b6211f4b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.391+0000 7f384f7fe700 0 client.15201 ms_handle_reset on v2:172.21.15.122:6836/1604366318 2024-06-06T03:26:16.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.391+0000 7f3880afab80 1 --2- 172.21.15.50:0/2603847604 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b6209c830 0x562b620b5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.391+0000 7f3880afab80 1 --2- 172.21.15.50:0/2603847604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b62096750 0x562b620ba8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.391+0000 7f3880afab80 1 --2- 172.21.15.50:0/2603847604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b6209bf10 0x562b620bae20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.391+0000 7f3880afab80 1 -- 172.21.15.50:0/2603847604 >> 172.21.15.50:0/2603847604 conn(0x562b61fc3030 msgr2=0x562b6209ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:16.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.391+0000 7f3880afab80 1 -- 172.21.15.50:0/2603847604 shutdown_connections 2024-06-06T03:26:16.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.392+0000 7f3880afab80 1 -- 172.21.15.50:0/2603847604 wait complete. 2024-06-06T03:26:16.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.392+0000 7f3880afab80 20 client.15201 trim_cache size 0 max 16384 2024-06-06T03:26:16.397 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:26:16.397 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "b6263b26-23b2-11ef-bc9b-c7b262605968", 2024-06-06T03:26:16.397 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 1, 2024-06-06T03:26:16.397 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24472, 2024-06-06T03:26:16.397 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-06-06T03:26:16.397 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-06-06T03:26:16.397 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-06-06T03:26:16.397 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 164.81818206599999, 2024-06-06T03:26:16.397 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 26, 2024-06-06T03:26:16.398 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 99, 2024-06-06T03:26:16.398 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 97, 2024-06-06T03:26:16.398 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 250.14813029000001 2024-06-06T03:26:16.398 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:26:16.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.392+0000 7f3876277700 1 -- 172.21.15.50:0/3100713131 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f385c0a2c20 msgr2=0x7f385c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:16.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.392+0000 7f3876277700 1 --2- 172.21.15.50:0/3100713131 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f385c0a2c20 0x7f385c0a50e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f386000b5c0 tx=0x7f3860005960 comp rx=0 tx=0).stop 2024-06-06T03:26:16.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.392+0000 7f3876277700 1 -- 172.21.15.50:0/3100713131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38701073f0 msgr2=0x7f3870103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:16.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.392+0000 7f3876277700 1 --2- 172.21.15.50:0/3100713131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38701073f0 0x7f3870103ae0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3868007ee0 tx=0x7f386800d3b0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.392+0000 7f3876277700 1 -- 172.21.15.50:0/3100713131 shutdown_connections 2024-06-06T03:26:16.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.392+0000 7f3876277700 1 --2- 172.21.15.50:0/3100713131 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f385c0a2c20 0x7f385c0a50e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.392+0000 7f3876277700 1 --2- 172.21.15.50:0/3100713131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38701073f0 0x7f3870103ae0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.392+0000 7f3876277700 1 --2- 172.21.15.50:0/3100713131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3870101380 0x7f3870103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.392+0000 7f3876277700 1 --2- 172.21.15.50:0/3100713131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3870101d40 0x7f38701035a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:16.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.392+0000 7f3876277700 1 -- 172.21.15.50:0/3100713131 >> 172.21.15.50:0/3100713131 conn(0x7f3870078300 msgr2=0x7f387006ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:16.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.392+0000 7f3876277700 1 -- 172.21.15.50:0/3100713131 shutdown_connections 2024-06-06T03:26:16.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:16.392+0000 7f3876277700 1 -- 172.21.15.50:0/3100713131 wait complete. 2024-06-06T03:26:16.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:16 smithi122 ceph-mon[35759]: pgmap v420: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-06-06T03:26:17.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:16 smithi050 ceph-mon[32421]: pgmap v420: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-06-06T03:26:17.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:16 smithi079 ceph-mon[35478]: pgmap v420: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-06-06T03:26:17.160 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.i status 2024-06-06T03:26:17.415 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:26:18.917 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:18 smithi050 ceph-mon[32421]: pgmap v421: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:26:18.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:18 smithi122 ceph-mon[35759]: pgmap v421: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:26:19.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:18 smithi079 ceph-mon[35478]: pgmap v421: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:26:19.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.164+0000 7f343df8c700 1 -- 172.21.15.50:0/886372371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3438102ea0 msgr2=0x7f343810f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:19.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.164+0000 7f343df8c700 1 --2- 172.21.15.50:0/886372371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3438102ea0 0x7f343810f380 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3430009990 tx=0x7f3430009ca0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.164+0000 7f343df8c700 1 -- 172.21.15.50:0/886372371 shutdown_connections 2024-06-06T03:26:19.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.164+0000 7f343df8c700 1 --2- 172.21.15.50:0/886372371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3438102ea0 0x7f343810f380 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.164+0000 7f343df8c700 1 --2- 172.21.15.50:0/886372371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34381085f0 0x7f34381089d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.164+0000 7f343df8c700 1 --2- 172.21.15.50:0/886372371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34381024e0 0x7f3438102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.164+0000 7f343df8c700 1 -- 172.21.15.50:0/886372371 >> 172.21.15.50:0/886372371 conn(0x7f3438079640 msgr2=0x7f3438079a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:19.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.164+0000 7f343df8c700 1 -- 172.21.15.50:0/886372371 shutdown_connections 2024-06-06T03:26:19.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.164+0000 7f343df8c700 1 -- 172.21.15.50:0/886372371 wait complete. 2024-06-06T03:26:19.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.165+0000 7f343df8c700 1 Processor -- start 2024-06-06T03:26:19.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.165+0000 7f343df8c700 1 -- start start 2024-06-06T03:26:19.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.166+0000 7f343df8c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34381024e0 0x7f3438074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:19.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.166+0000 7f343df8c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3438102ea0 0x7f3438074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:19.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.166+0000 7f343df8c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34381085f0 0x7f3438075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:19.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.166+0000 7f343df8c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f34381126c0 con 0x7f34381024e0 2024-06-06T03:26:19.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.166+0000 7f343df8c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3438112540 con 0x7f34381085f0 2024-06-06T03:26:19.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.166+0000 7f343df8c700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3438112840 con 0x7f3438102ea0 2024-06-06T03:26:19.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.166+0000 7f34377fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34381024e0 0x7f3438074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:19.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.166+0000 7f34377fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34381024e0 0x7f3438074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59320/0 (socket says 172.21.15.50:59320) 2024-06-06T03:26:19.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.166+0000 7f34377fe700 1 -- 172.21.15.50:0/3093661923 learned_addr learned my addr 172.21.15.50:0/3093661923 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:19.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.166+0000 7f3437fff700 1 --2- 172.21.15.50:0/3093661923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34381085f0 0x7f3438075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:19.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.166+0000 7f342effd700 1 --2- 172.21.15.50:0/3093661923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3438102ea0 0x7f3438074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:19.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.166+0000 7f34377fe700 1 -- 172.21.15.50:0/3093661923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3438102ea0 msgr2=0x7f3438074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:19.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.166+0000 7f34377fe700 1 --2- 172.21.15.50:0/3093661923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3438102ea0 0x7f3438074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.166+0000 7f34377fe700 1 -- 172.21.15.50:0/3093661923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34381085f0 msgr2=0x7f3438075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:19.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.166+0000 7f34377fe700 1 --2- 172.21.15.50:0/3093661923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34381085f0 0x7f3438075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.166+0000 7f34377fe700 1 -- 172.21.15.50:0/3093661923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34381a6fe0 con 0x7f34381024e0 2024-06-06T03:26:19.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.166+0000 7f34377fe700 1 --2- 172.21.15.50:0/3093661923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34381024e0 0x7f3438074790 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3428007e20 tx=0x7f342800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:19.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.166+0000 7f34357fa700 1 -- 172.21.15.50:0/3093661923 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3428016020 con 0x7f34381024e0 2024-06-06T03:26:19.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.166+0000 7f34357fa700 1 -- 172.21.15.50:0/3093661923 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f342800ae00 con 0x7f34381024e0 2024-06-06T03:26:19.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.166+0000 7f34357fa700 1 -- 172.21.15.50:0/3093661923 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3428011700 con 0x7f34381024e0 2024-06-06T03:26:19.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.166+0000 7f343df8c700 1 -- 172.21.15.50:0/3093661923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34381a72d0 con 0x7f34381024e0 2024-06-06T03:26:19.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.167+0000 7f343df8c700 1 -- 172.21.15.50:0/3093661923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34381a7860 con 0x7f34381024e0 2024-06-06T03:26:19.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.170+0000 7f34357fa700 1 -- 172.21.15.50:0/3093661923 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3428019020 con 0x7f34381024e0 2024-06-06T03:26:19.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.170+0000 7f34357fa700 1 --2- 172.21.15.50:0/3093661923 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f34240a2ca0 0x7f34240a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:19.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.170+0000 7f34357fa700 1 -- 172.21.15.50:0/3093661923 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f34280cf130 con 0x7f34381024e0 2024-06-06T03:26:19.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.170+0000 7f342effd700 1 --2- 172.21.15.50:0/3093661923 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f34240a2ca0 0x7f34240a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:19.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.171+0000 7f344880fb80 1 Processor -- start 2024-06-06T03:26:19.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.171+0000 7f342effd700 1 --2- 172.21.15.50:0/3093661923 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f34240a2ca0 0x7f34240a5160 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3420006fd0 tx=0x7f3420008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:19.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.171+0000 7f344880fb80 1 -- start start 2024-06-06T03:26:19.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.171+0000 7f344880fb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562549624f10 0x5625496252f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:19.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.171+0000 7f344880fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562549625830 0x56254961f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:19.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.171+0000 7f344880fb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56254961f750 0x56254961fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:19.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.171+0000 7f344880fb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562549511f10 con 0x56254961f750 2024-06-06T03:26:19.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.171+0000 7f344880fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562549570800 con 0x562549625830 2024-06-06T03:26:19.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.171+0000 7f344880fb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5625494d8410 con 0x562549624f10 2024-06-06T03:26:19.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.171+0000 7f34377fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562549624f10 0x5625496252f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:19.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.171+0000 7f3437fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56254961f750 0x56254961fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:19.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.171+0000 7f34377fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562549624f10 0x5625496252f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:39118/0 (socket says 172.21.15.50:39118) 2024-06-06T03:26:19.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.171+0000 7f34377fe700 1 -- 172.21.15.50:0/1005340577 learned_addr learned my addr 172.21.15.50:0/1005340577 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:19.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.171+0000 7f342effd700 1 --2- 172.21.15.50:0/1005340577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562549625830 0x56254961f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:19.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.172+0000 7f3437fff700 1 -- 172.21.15.50:0/1005340577 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562549624f10 msgr2=0x5625496252f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:19.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.172+0000 7f3437fff700 1 --2- 172.21.15.50:0/1005340577 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562549624f10 0x5625496252f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.172+0000 7f3437fff700 1 -- 172.21.15.50:0/1005340577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562549625830 msgr2=0x56254961f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:19.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.172+0000 7f3437fff700 1 --2- 172.21.15.50:0/1005340577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562549625830 0x56254961f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.172+0000 7f3437fff700 1 -- 172.21.15.50:0/1005340577 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625494bf880 con 0x56254961f750 2024-06-06T03:26:19.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.172+0000 7f34377fe700 1 --2- 172.21.15.50:0/1005340577 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562549624f10 0x5625496252f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:26:19.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.172+0000 7f3437fff700 1 --2- 172.21.15.50:0/1005340577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56254961f750 0x56254961fb70 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f34300098e0 tx=0x7f3430005c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ae845e742f561a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:19.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.172+0000 7f342dffb700 1 -- 172.21.15.50:0/1005340577 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3430027070 con 0x56254961f750 2024-06-06T03:26:19.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.172+0000 7f342dffb700 1 -- 172.21.15.50:0/1005340577 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3430005070 con 0x56254961f750 2024-06-06T03:26:19.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.172+0000 7f342dffb700 1 -- 172.21.15.50:0/1005340577 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f343000bb70 con 0x56254961f750 2024-06-06T03:26:19.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.173+0000 7f344880fb80 1 -- 172.21.15.50:0/1005340577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56254961f750 msgr2=0x56254961fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:19.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.173+0000 7f344880fb80 1 --2- 172.21.15.50:0/1005340577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56254961f750 0x56254961fb70 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f34300098e0 tx=0x7f3430005c40 comp rx=0 tx=0).stop 2024-06-06T03:26:19.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.173+0000 7f344880fb80 1 -- 172.21.15.50:0/1005340577 shutdown_connections 2024-06-06T03:26:19.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.173+0000 7f344880fb80 1 --2- 172.21.15.50:0/1005340577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56254961f750 0x56254961fb70 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.173+0000 7f344880fb80 1 --2- 172.21.15.50:0/1005340577 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562549624f10 0x5625496252f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.173+0000 7f344880fb80 1 --2- 172.21.15.50:0/1005340577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562549625830 0x56254961f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.173+0000 7f344880fb80 1 -- 172.21.15.50:0/1005340577 >> 172.21.15.50:0/1005340577 conn(0x56254954c030 msgr2=0x56254961a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:19.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.173+0000 7f344880fb80 1 -- 172.21.15.50:0/1005340577 shutdown_connections 2024-06-06T03:26:19.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.173+0000 7f344880fb80 1 -- 172.21.15.50:0/1005340577 wait complete. 2024-06-06T03:26:19.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.173+0000 7f344880fb80 1 -- start start 2024-06-06T03:26:19.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.174+0000 7f344880fb80 1 Processor -- start 2024-06-06T03:26:19.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.174+0000 7f344880fb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56254961f750 0x56254962b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:19.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.174+0000 7f344880fb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562549624f10 0x562549628930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:19.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.174+0000 7f344880fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562549625830 0x562549628e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:19.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.174+0000 7f344880fb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562549510f70 con 0x562549624f10 2024-06-06T03:26:19.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.174+0000 7f344880fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56254956c7c0 con 0x562549625830 2024-06-06T03:26:19.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.174+0000 7f344880fb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56254962c1b0 con 0x56254961f750 2024-06-06T03:26:19.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.174+0000 7f344880fb80 10 client.0 _ll_register_callbacks cb 0x562549506560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:26:19.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.174+0000 7f342effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562549624f10 0x562549628930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:19.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.174+0000 7f342effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562549624f10 0x562549628930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59342/0 (socket says 172.21.15.50:59342) 2024-06-06T03:26:19.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.174+0000 7f342effd700 1 -- 172.21.15.50:0/570684723 learned_addr learned my addr 172.21.15.50:0/570684723 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:19.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.174+0000 7f34377fe700 1 --2- 172.21.15.50:0/570684723 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56254961f750 0x56254962b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:19.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.174+0000 7f3437fff700 1 --2- 172.21.15.50:0/570684723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562549625830 0x562549628e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:19.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.174+0000 7f342effd700 1 -- 172.21.15.50:0/570684723 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56254961f750 msgr2=0x56254962b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:19.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.174+0000 7f342effd700 1 --2- 172.21.15.50:0/570684723 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56254961f750 0x56254962b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.174+0000 7f342effd700 1 -- 172.21.15.50:0/570684723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562549625830 msgr2=0x562549628e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:19.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.174+0000 7f342effd700 1 --2- 172.21.15.50:0/570684723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562549625830 0x562549628e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.174+0000 7f342effd700 1 -- 172.21.15.50:0/570684723 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562549536700 con 0x562549624f10 2024-06-06T03:26:19.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.174+0000 7f3437fff700 1 --2- 172.21.15.50:0/570684723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562549625830 0x562549628e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:26:19.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.175+0000 7f342effd700 1 --2- 172.21.15.50:0/570684723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562549624f10 0x562549628930 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f342000de50 tx=0x7f3420004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9ce646453101db server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:19.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.175+0000 7f3416ffd700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:26:19.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.175+0000 7f3416ffd700 1 -- 172.21.15.50:0/570684723 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3420024020 con 0x562549624f10 2024-06-06T03:26:19.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.175+0000 7f3416ffd700 1 -- 172.21.15.50:0/570684723 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f342000f040 con 0x562549624f10 2024-06-06T03:26:19.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.175+0000 7f344880fb80 1 -- 172.21.15.50:0/570684723 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3430005070 con 0x562549624f10 2024-06-06T03:26:19.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.175+0000 7f3416ffd700 1 -- 172.21.15.50:0/570684723 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f342002f050 con 0x562549624f10 2024-06-06T03:26:19.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.175+0000 7f344880fb80 10 client.15213 fetch_fsmap learned FSMap version 26 2024-06-06T03:26:19.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.175+0000 7f344880fb80 1 -- 172.21.15.50:0/570684723 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562549636a40 con 0x562549624f10 2024-06-06T03:26:19.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.175+0000 7f3416ffd700 1 -- 172.21.15.50:0/570684723 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3430005070 con 0x562549624f10 2024-06-06T03:26:19.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.176+0000 7f3416ffd700 1 -- 172.21.15.50:0/570684723 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f3420013070 con 0x562549624f10 2024-06-06T03:26:19.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.176+0000 7f344880fb80 10 client.15213 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T03:26:19.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.176+0000 7f344880fb80 10 client.15213 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-06T03:26:19.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.176+0000 7f344880fb80 20 client.15213 populate_metadata read hostname 'smithi050' 2024-06-06T03:26:19.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.176+0000 7f344880fb80 1 --2- 172.21.15.50:0/570684723 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5625496390e0 0x56254963a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:19.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.176+0000 7f344880fb80 4 client.15213 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:26:19.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.176+0000 7f344880fb80 1 -- 172.21.15.50:0/570684723 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56254957dd00 con 0x5625496390e0 2024-06-06T03:26:19.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.176+0000 7f34377fe700 1 --2- 172.21.15.50:0/570684723 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5625496390e0 0x56254963a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:19.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.176+0000 7f34377fe700 1 --2- 172.21.15.50:0/570684723 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5625496390e0 0x56254963a550 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22ada0d35f7d1cdc server_cookie=7aeb6805fe48ea10 in_seq=0 out_seq=0 2024-06-06T03:26:19.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.176+0000 7f3416ffd700 10 client.15213 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:26:19.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.177+0000 7f3416ffd700 1 -- 172.21.15.50:0/570684723 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x56254957dd00 con 0x5625496390e0 2024-06-06T03:26:19.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.177+0000 7f3416ffd700 10 client.15213 handle_command_reply: tid=0 2024-06-06T03:26:19.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.177+0000 7f344880fb80 1 client.15213 shutdown 2024-06-06T03:26:19.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.177+0000 7f344880fb80 1 -- 172.21.15.50:0/570684723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562549624f10 msgr2=0x562549628930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:19.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.177+0000 7f344880fb80 1 --2- 172.21.15.50:0/570684723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562549624f10 0x562549628930 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f342000de50 tx=0x7f3420004860 comp rx=0 tx=0).stop 2024-06-06T03:26:19.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.177+0000 7f344880fb80 1 -- 172.21.15.50:0/570684723 shutdown_connections 2024-06-06T03:26:19.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.177+0000 7f344880fb80 1 --2- 172.21.15.50:0/570684723 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5625496390e0 0x56254963a550 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.177+0000 7f344880fb80 1 --2- 172.21.15.50:0/570684723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562549625830 0x562549628e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.177+0000 7f344880fb80 1 --2- 172.21.15.50:0/570684723 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56254961f750 0x56254962b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.177+0000 7f344880fb80 1 --2- 172.21.15.50:0/570684723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562549624f10 0x562549628930 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.177+0000 7f344880fb80 1 -- 172.21.15.50:0/570684723 >> 172.21.15.50:0/570684723 conn(0x56254954c030 msgr2=0x5625496196b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:19.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.177+0000 7f3416ffd700 0 client.15213 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:26:19.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.178+0000 7f344880fb80 1 -- 172.21.15.50:0/570684723 shutdown_connections 2024-06-06T03:26:19.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.178+0000 7f344880fb80 1 -- 172.21.15.50:0/570684723 wait complete. 2024-06-06T03:26:19.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.178+0000 7f344880fb80 20 client.15213 trim_cache size 0 max 16384 2024-06-06T03:26:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.200+0000 7f344880fb80 1 Processor -- start 2024-06-06T03:26:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.200+0000 7f344880fb80 1 -- start start 2024-06-06T03:26:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.200+0000 7f344880fb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56254961f750 0x56254961f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.200+0000 7f344880fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562549624f10 0x562549626560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.200+0000 7f344880fb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562549625830 0x562549627890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.200+0000 7f344880fb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562549638890 con 0x562549625830 2024-06-06T03:26:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.200+0000 7f344880fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562549638f60 con 0x562549624f10 2024-06-06T03:26:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.200+0000 7f344880fb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562549639630 con 0x56254961f750 2024-06-06T03:26:19.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.200+0000 7f3437fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562549625830 0x562549627890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:19.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.200+0000 7f3437fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562549625830 0x562549627890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59356/0 (socket says 172.21.15.50:59356) 2024-06-06T03:26:19.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.200+0000 7f3437fff700 1 -- 172.21.15.50:0/940909376 learned_addr learned my addr 172.21.15.50:0/940909376 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:19.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.200+0000 7f34377fe700 1 --2- 172.21.15.50:0/940909376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56254961f750 0x56254961f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:19.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.200+0000 7f342effd700 1 --2- 172.21.15.50:0/940909376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562549624f10 0x562549626560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:19.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.201+0000 7f3437fff700 1 -- 172.21.15.50:0/940909376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56254961f750 msgr2=0x56254961f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:19.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.201+0000 7f3437fff700 1 --2- 172.21.15.50:0/940909376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56254961f750 0x56254961f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.201+0000 7f3437fff700 1 -- 172.21.15.50:0/940909376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562549624f10 msgr2=0x562549626560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:19.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.201+0000 7f3437fff700 1 --2- 172.21.15.50:0/940909376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562549624f10 0x562549626560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.201+0000 7f3437fff700 1 -- 172.21.15.50:0/940909376 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562549625630 con 0x562549625830 2024-06-06T03:26:19.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.201+0000 7f3437fff700 1 --2- 172.21.15.50:0/940909376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562549625830 0x562549627890 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3430000c00 tx=0x7f34300039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66a15f1a3e90d5 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:19.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.201+0000 7f342d7fa700 1 -- 172.21.15.50:0/940909376 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3430027040 con 0x562549625830 2024-06-06T03:26:19.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.201+0000 7f342d7fa700 1 -- 172.21.15.50:0/940909376 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3430003dd0 con 0x562549625830 2024-06-06T03:26:19.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.201+0000 7f342d7fa700 1 -- 172.21.15.50:0/940909376 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f343000bc90 con 0x562549625830 2024-06-06T03:26:19.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.202+0000 7f344880fb80 1 -- 172.21.15.50:0/940909376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562549625830 msgr2=0x562549627890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:19.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.202+0000 7f344880fb80 1 --2- 172.21.15.50:0/940909376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562549625830 0x562549627890 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3430000c00 tx=0x7f34300039e0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.202+0000 7f344880fb80 1 -- 172.21.15.50:0/940909376 shutdown_connections 2024-06-06T03:26:19.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.202+0000 7f344880fb80 1 --2- 172.21.15.50:0/940909376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562549625830 0x562549627890 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.202+0000 7f344880fb80 1 --2- 172.21.15.50:0/940909376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56254961f750 0x56254961f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.202+0000 7f344880fb80 1 --2- 172.21.15.50:0/940909376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562549624f10 0x562549626560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.202+0000 7f344880fb80 1 -- 172.21.15.50:0/940909376 >> 172.21.15.50:0/940909376 conn(0x56254954c030 msgr2=0x5625496281e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.202+0000 7f344880fb80 1 -- 172.21.15.50:0/940909376 shutdown_connections 2024-06-06T03:26:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.202+0000 7f344880fb80 1 -- 172.21.15.50:0/940909376 wait complete. 2024-06-06T03:26:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.202+0000 7f344880fb80 1 -- start start 2024-06-06T03:26:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.202+0000 7f344880fb80 1 Processor -- start 2024-06-06T03:26:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.202+0000 7f344880fb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56254961f750 0x562549643f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.203+0000 7f344880fb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562549624f10 0x562549619200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.203+0000 7f344880fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562549625830 0x562549619740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.203+0000 7f344880fb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56254963a3d0 con 0x56254961f750 2024-06-06T03:26:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.203+0000 7f344880fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562549639d00 con 0x562549625830 2024-06-06T03:26:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.203+0000 7f344880fb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56254963aaa0 con 0x562549624f10 2024-06-06T03:26:19.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.203+0000 7f344880fb80 10 client.0 _ll_register_callbacks cb 0x562549506560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:26:19.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.203+0000 7f34377fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56254961f750 0x562549643f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:19.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.203+0000 7f34377fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56254961f750 0x562549643f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59372/0 (socket says 172.21.15.50:59372) 2024-06-06T03:26:19.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.203+0000 7f34377fe700 1 -- 172.21.15.50:0/135570818 learned_addr learned my addr 172.21.15.50:0/135570818 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:19.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.203+0000 7f3437fff700 1 --2- 172.21.15.50:0/135570818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562549625830 0x562549619740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:19.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.203+0000 7f342effd700 1 --2- 172.21.15.50:0/135570818 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562549624f10 0x562549619200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:19.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.203+0000 7f34377fe700 1 -- 172.21.15.50:0/135570818 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562549624f10 msgr2=0x562549619200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:19.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.203+0000 7f34377fe700 1 --2- 172.21.15.50:0/135570818 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562549624f10 0x562549619200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.203+0000 7f34377fe700 1 -- 172.21.15.50:0/135570818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562549625830 msgr2=0x562549619740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:19.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.203+0000 7f34377fe700 1 --2- 172.21.15.50:0/135570818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562549625830 0x562549619740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.203+0000 7f34377fe700 1 -- 172.21.15.50:0/135570818 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562549619d30 con 0x56254961f750 2024-06-06T03:26:19.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.203+0000 7f34377fe700 1 --2- 172.21.15.50:0/135570818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56254961f750 0x562549643f50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f34280ccc20 tx=0x7f34280cc780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc28df07ee2de03 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:19.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.203+0000 7f3416ffd700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:26:19.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.203+0000 7f3416ffd700 1 -- 172.21.15.50:0/135570818 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3428099910 con 0x56254961f750 2024-06-06T03:26:19.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.203+0000 7f3416ffd700 1 -- 172.21.15.50:0/135570818 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f3428012af0 con 0x56254961f750 2024-06-06T03:26:19.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.203+0000 7f344880fb80 1 -- 172.21.15.50:0/135570818 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3430003dd0 con 0x56254961f750 2024-06-06T03:26:19.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.203+0000 7f3416ffd700 1 -- 172.21.15.50:0/135570818 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f34280a3df0 con 0x56254961f750 2024-06-06T03:26:19.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.204+0000 7f344880fb80 10 client.15219 fetch_fsmap learned FSMap version 26 2024-06-06T03:26:19.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.204+0000 7f344880fb80 1 -- 172.21.15.50:0/135570818 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562549642820 con 0x56254961f750 2024-06-06T03:26:19.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.204+0000 7f3416ffd700 1 -- 172.21.15.50:0/135570818 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3430003dd0 con 0x56254961f750 2024-06-06T03:26:19.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.204+0000 7f3416ffd700 1 -- 172.21.15.50:0/135570818 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f3428023060 con 0x56254961f750 2024-06-06T03:26:19.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.204+0000 7f344880fb80 10 client.15219 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T03:26:19.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.204+0000 7f344880fb80 10 client.15219 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-06T03:26:19.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.204+0000 7f344880fb80 20 client.15219 populate_metadata read hostname 'smithi050' 2024-06-06T03:26:19.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.204+0000 7f344880fb80 1 --2- 172.21.15.50:0/135570818 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5625496a9360 0x5625496a8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:19.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.204+0000 7f344880fb80 4 client.15219 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-06T03:26:19.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.204+0000 7f344880fb80 1 -- 172.21.15.50:0/135570818 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "status"}) -- 0x562549578280 con 0x5625496a9360 2024-06-06T03:26:19.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.204+0000 7f342effd700 1 --2- 172.21.15.50:0/135570818 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5625496a9360 0x5625496a8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:19.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.205+0000 7f342effd700 1 --2- 172.21.15.50:0/135570818 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5625496a9360 0x5625496a8070 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22159f64ead126cf server_cookie=866555c2b42fa71f in_seq=0 out_seq=0 2024-06-06T03:26:19.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.205+0000 7f3416ffd700 10 client.15219 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:26:19.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.205+0000 7f3416ffd700 1 -- 172.21.15.50:0/135570818 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x562549578280 con 0x5625496a9360 2024-06-06T03:26:19.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.205+0000 7f3416ffd700 10 client.15219 handle_command_reply: tid=0 2024-06-06T03:26:19.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.205+0000 7f344880fb80 1 client.15219 shutdown 2024-06-06T03:26:19.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.205+0000 7f344880fb80 1 -- 172.21.15.50:0/135570818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56254961f750 msgr2=0x562549643f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:19.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.205+0000 7f344880fb80 1 --2- 172.21.15.50:0/135570818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56254961f750 0x562549643f50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f34280ccc20 tx=0x7f34280cc780 comp rx=0 tx=0).stop 2024-06-06T03:26:19.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.205+0000 7f344880fb80 1 -- 172.21.15.50:0/135570818 shutdown_connections 2024-06-06T03:26:19.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.205+0000 7f344880fb80 1 --2- 172.21.15.50:0/135570818 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5625496a9360 0x5625496a8070 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.205+0000 7f344880fb80 1 --2- 172.21.15.50:0/135570818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562549625830 0x562549619740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.205+0000 7f344880fb80 1 --2- 172.21.15.50:0/135570818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56254961f750 0x562549643f50 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.205+0000 7f344880fb80 1 --2- 172.21.15.50:0/135570818 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562549624f10 0x562549619200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.205+0000 7f3416ffd700 0 client.15219 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:26:19.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.205+0000 7f344880fb80 1 -- 172.21.15.50:0/135570818 >> 172.21.15.50:0/135570818 conn(0x56254954c030 msgr2=0x5625496242d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:19.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.205+0000 7f344880fb80 1 -- 172.21.15.50:0/135570818 shutdown_connections 2024-06-06T03:26:19.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.205+0000 7f344880fb80 1 -- 172.21.15.50:0/135570818 wait complete. 2024-06-06T03:26:19.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.205+0000 7f344880fb80 20 client.15219 trim_cache size 0 max 16384 2024-06-06T03:26:19.211 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:26:19.211 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "b6263b26-23b2-11ef-bc9b-c7b262605968", 2024-06-06T03:26:19.212 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-06-06T03:26:19.212 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24490, 2024-06-06T03:26:19.212 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-06-06T03:26:19.212 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-06-06T03:26:19.212 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-06-06T03:26:19.212 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 222.91612439599999, 2024-06-06T03:26:19.213 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 26, 2024-06-06T03:26:19.213 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 99, 2024-06-06T03:26:19.213 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 97, 2024-06-06T03:26:19.213 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 247.24092957600001 2024-06-06T03:26:19.213 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:26:19.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.206+0000 7f343df8c700 1 -- 172.21.15.50:0/3093661923 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f34240a2ca0 msgr2=0x7f34240a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:19.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.206+0000 7f343df8c700 1 --2- 172.21.15.50:0/3093661923 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f34240a2ca0 0x7f34240a5160 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3420006fd0 tx=0x7f3420008040 comp rx=0 tx=0).stop 2024-06-06T03:26:19.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.206+0000 7f343df8c700 1 -- 172.21.15.50:0/3093661923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34381024e0 msgr2=0x7f3438074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:19.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.206+0000 7f343df8c700 1 --2- 172.21.15.50:0/3093661923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34381024e0 0x7f3438074790 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3428007e20 tx=0x7f342800a340 comp rx=0 tx=0).stop 2024-06-06T03:26:19.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.206+0000 7f343df8c700 1 -- 172.21.15.50:0/3093661923 shutdown_connections 2024-06-06T03:26:19.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.206+0000 7f343df8c700 1 --2- 172.21.15.50:0/3093661923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34381085f0 0x7f3438075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.206+0000 7f343df8c700 1 --2- 172.21.15.50:0/3093661923 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f34240a2ca0 0x7f34240a5160 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.206+0000 7f343df8c700 1 --2- 172.21.15.50:0/3093661923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34381024e0 0x7f3438074790 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.206+0000 7f343df8c700 1 --2- 172.21.15.50:0/3093661923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3438102ea0 0x7f3438074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:19.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.206+0000 7f343df8c700 1 -- 172.21.15.50:0/3093661923 >> 172.21.15.50:0/3093661923 conn(0x7f3438079640 msgr2=0x7f3438100ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:19.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.206+0000 7f343df8c700 1 -- 172.21.15.50:0/3093661923 shutdown_connections 2024-06-06T03:26:19.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:19.206+0000 7f343df8c700 1 -- 172.21.15.50:0/3093661923 wait complete. 2024-06-06T03:26:19.867 INFO:teuthology.run_tasks:Running task sequential... 2024-06-06T03:26:19.877 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-06-06T03:26:19.877 INFO:teuthology.task.sequential:In sequential, running task print... 2024-06-06T03:26:19.878 INFO:teuthology.task.print:Enabling mgr modules 2024-06-06T03:26:19.878 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-06-06T03:26:19.908 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-06-06T03:26:19.908 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-06-06T03:26:19.908 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-06-06T03:26:19.909 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-06T03:26:19.909 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-06T03:26:19.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T03:26:19.909 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-06-06T03:26:19.927 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-06-06T03:26:19.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T03:26:19.928 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-06T03:26:19.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T03:26:19.998 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2024-06-06T03:26:20.107 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-06-06T03:26:20.107 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs ls 2024-06-06T03:26:20.359 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:26:20.732 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:20 smithi050 ceph-mon[32421]: pgmap v422: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:26:20.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:20 smithi122 ceph-mon[35759]: pgmap v422: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:26:21.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:20 smithi079 ceph-mon[35478]: pgmap v422: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:26:22.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.058+0000 7fdff6ee3700 1 -- 172.21.15.50:0/3350652041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdff0101d50 msgr2=0x7fdff010e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:22.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.058+0000 7fdff6ee3700 1 --2- 172.21.15.50:0/3350652041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdff0101d50 0x7fdff010e240 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800b0a0 tx=0x7fdfe800b3b0 comp rx=0 tx=0).stop 2024-06-06T03:26:22.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.058+0000 7fdff6ee3700 1 -- 172.21.15.50:0/3350652041 shutdown_connections 2024-06-06T03:26:22.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.058+0000 7fdff6ee3700 1 --2- 172.21.15.50:0/3350652041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdff0101d50 0x7fdff010e240 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:22.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.058+0000 7fdff6ee3700 1 --2- 172.21.15.50:0/3350652041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdff0107400 0x7fdff01077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:22.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.058+0000 7fdff6ee3700 1 --2- 172.21.15.50:0/3350652041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdff0101390 0x7fdff0101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:22.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.058+0000 7fdff6ee3700 1 -- 172.21.15.50:0/3350652041 >> 172.21.15.50:0/3350652041 conn(0x7fdff0078340 msgr2=0x7fdff0078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:22.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.058+0000 7fdff6ee3700 1 -- 172.21.15.50:0/3350652041 shutdown_connections 2024-06-06T03:26:22.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.058+0000 7fdff6ee3700 1 -- 172.21.15.50:0/3350652041 wait complete. 2024-06-06T03:26:22.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.059+0000 7fdff6ee3700 1 Processor -- start 2024-06-06T03:26:22.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.059+0000 7fdff6ee3700 1 -- start start 2024-06-06T03:26:22.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.059+0000 7fdff6ee3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdff0101390 0x7fdff019e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:22.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.059+0000 7fdff6ee3700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdff0101d50 0x7fdff019ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:22.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.059+0000 7fdff6ee3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdff0107400 0x7fdff0196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:22.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.060+0000 7fdff6ee3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdff0111520 con 0x7fdff0101390 2024-06-06T03:26:22.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.060+0000 7fdff6ee3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdff01113a0 con 0x7fdff0107400 2024-06-06T03:26:22.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.060+0000 7fdff6ee3700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdff01116a0 con 0x7fdff0101d50 2024-06-06T03:26:22.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.060+0000 7fdff4c7f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdff0101390 0x7fdff019e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:22.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.060+0000 7fdff4c7f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdff0101390 0x7fdff019e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59398/0 (socket says 172.21.15.50:59398) 2024-06-06T03:26:22.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.060+0000 7fdff4c7f700 1 -- 172.21.15.50:0/4157500044 learned_addr learned my addr 172.21.15.50:0/4157500044 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:22.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.060+0000 7fdff5480700 1 --2- 172.21.15.50:0/4157500044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdff0107400 0x7fdff0196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:22.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.060+0000 7fdfeffff700 1 --2- 172.21.15.50:0/4157500044 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdff0101d50 0x7fdff019ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:22.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.060+0000 7fdff4c7f700 1 -- 172.21.15.50:0/4157500044 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdff0101d50 msgr2=0x7fdff019ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:22.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.060+0000 7fdff4c7f700 1 --2- 172.21.15.50:0/4157500044 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdff0101d50 0x7fdff019ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:22.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.060+0000 7fdff4c7f700 1 -- 172.21.15.50:0/4157500044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdff0107400 msgr2=0x7fdff0196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:22.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.060+0000 7fdff4c7f700 1 --2- 172.21.15.50:0/4157500044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdff0107400 0x7fdff0196a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:22.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.060+0000 7fdff4c7f700 1 -- 172.21.15.50:0/4157500044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff0197350 con 0x7fdff0101390 2024-06-06T03:26:22.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.060+0000 7fdff4c7f700 1 --2- 172.21.15.50:0/4157500044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdff0101390 0x7fdff019e780 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdfe000e9a0 tx=0x7fdfe000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:22.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.060+0000 7fdfedffb700 1 -- 172.21.15.50:0/4157500044 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe000cbd0 con 0x7fdff0101390 2024-06-06T03:26:22.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.060+0000 7fdff6ee3700 1 -- 172.21.15.50:0/4157500044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdff0197640 con 0x7fdff0101390 2024-06-06T03:26:22.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.060+0000 7fdfedffb700 1 -- 172.21.15.50:0/4157500044 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdfe000cd70 con 0x7fdff0101390 2024-06-06T03:26:22.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.061+0000 7fdfedffb700 1 -- 172.21.15.50:0/4157500044 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe0018680 con 0x7fdff0101390 2024-06-06T03:26:22.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.061+0000 7fdff6ee3700 1 -- 172.21.15.50:0/4157500044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdff01b4400 con 0x7fdff0101390 2024-06-06T03:26:22.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.062+0000 7fdff6ee3700 1 -- 172.21.15.50:0/4157500044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdff0102ab0 con 0x7fdff0101390 2024-06-06T03:26:22.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.063+0000 7fdfedffb700 1 -- 172.21.15.50:0/4157500044 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fdfe0010430 con 0x7fdff0101390 2024-06-06T03:26:22.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.064+0000 7fdfedffb700 1 --2- 172.21.15.50:0/4157500044 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fdfd80a2ca0 0x7fdfd80a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:22.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.064+0000 7fdfeffff700 1 --2- 172.21.15.50:0/4157500044 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fdfd80a2ca0 0x7fdfd80a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:22.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.064+0000 7fdfedffb700 1 -- 172.21.15.50:0/4157500044 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fdfe00cf500 con 0x7fdff0101390 2024-06-06T03:26:22.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.064+0000 7fdfeffff700 1 --2- 172.21.15.50:0/4157500044 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fdfd80a2ca0 0x7fdfd80a5160 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4005ea0 tx=0x7fdfe4005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:22.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.069+0000 7fdfedffb700 1 -- 172.21.15.50:0/4157500044 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fdfe009c0e0 con 0x7fdff0101390 2024-06-06T03:26:22.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.320+0000 7fdff6ee3700 1 -- 172.21.15.50:0/4157500044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fdff01b4660 con 0x7fdff0101390 2024-06-06T03:26:22.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.321+0000 7fdfedffb700 1 -- 172.21.15.50:0/4157500044 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) ==== 53+0+88 (secure 0 0 0) 0x7fdfe009b9e0 con 0x7fdff0101390 2024-06-06T03:26:22.321 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-06-06T03:26:22.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.323+0000 7fdff6ee3700 1 -- 172.21.15.50:0/4157500044 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fdfd80a2ca0 msgr2=0x7fdfd80a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:22.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.323+0000 7fdff6ee3700 1 --2- 172.21.15.50:0/4157500044 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fdfd80a2ca0 0x7fdfd80a5160 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4005ea0 tx=0x7fdfe4005e30 comp rx=0 tx=0).stop 2024-06-06T03:26:22.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.323+0000 7fdff6ee3700 1 -- 172.21.15.50:0/4157500044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdff0101390 msgr2=0x7fdff019e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:22.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.323+0000 7fdff6ee3700 1 --2- 172.21.15.50:0/4157500044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdff0101390 0x7fdff019e780 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdfe000e9a0 tx=0x7fdfe000ecb0 comp rx=0 tx=0).stop 2024-06-06T03:26:22.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.323+0000 7fdff6ee3700 1 -- 172.21.15.50:0/4157500044 shutdown_connections 2024-06-06T03:26:22.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.323+0000 7fdff6ee3700 1 --2- 172.21.15.50:0/4157500044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdff0107400 0x7fdff0196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:22.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.323+0000 7fdff6ee3700 1 --2- 172.21.15.50:0/4157500044 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fdfd80a2ca0 0x7fdfd80a5160 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:22.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.323+0000 7fdff6ee3700 1 --2- 172.21.15.50:0/4157500044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdff0101390 0x7fdff019e780 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:22.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.323+0000 7fdff6ee3700 1 --2- 172.21.15.50:0/4157500044 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdff0101d50 0x7fdff019ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:22.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.323+0000 7fdff6ee3700 1 -- 172.21.15.50:0/4157500044 >> 172.21.15.50:0/4157500044 conn(0x7fdff0078340 msgr2=0x7fdff006a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:22.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.323+0000 7fdff6ee3700 1 -- 172.21.15.50:0/4157500044 shutdown_connections 2024-06-06T03:26:22.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:22.323+0000 7fdff6ee3700 1 -- 172.21.15.50:0/4157500044 wait complete. 2024-06-06T03:26:22.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:22 smithi122 ceph-mon[35759]: pgmap v423: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:26:22.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:22 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/4157500044' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-06T03:26:22.998 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:22 smithi050 ceph-mon[32421]: pgmap v423: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:26:22.998 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:22 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/4157500044' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-06T03:26:23.034 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-06T03:26:23.034 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-06T03:26:23.034 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-06-06T03:26:23.034 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-06T03:26:23.034 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-06T03:26:23.034 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-06T03:26:23.034 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-06T03:26:23.034 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-06T03:26:23.034 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-06T03:26:23.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T03:26:23.035 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-06-06T03:26:23.052 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-06T03:26:23.052 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-06T03:26:23.052 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-06-06T03:26:23.052 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-06-06T03:26:23.052 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-06-06T03:26:23.052 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-06-06T03:26:23.052 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-06T03:26:23.052 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-06-06T03:26:23.052 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-06-06T03:26:23.052 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-06T03:26:23.052 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-06-06T03:26:23.053 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-06-06T03:26:23.053 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-06T03:26:23.053 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-06-06T03:26:23.053 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-06-06T03:26:23.053 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-06-06T03:26:23.053 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 41988sec preferred_lft 41988sec 2024-06-06T03:26:23.053 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link noprefixroute 2024-06-06T03:26:23.053 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-06-06T03:26:23.053 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-06T03:26:23.053 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-06-06T03:26:23.053 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-06-06T03:26:23.053 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-06-06T03:26:23.054 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-06T03:26:23.054 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-06-06T03:26:23.054 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add name ceph-brx type bridge 2024-06-06T03:26:23.054 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr flush dev ceph-brx 2024-06-06T03:26:23.054 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set ceph-brx up 2024-06-06T03:26:23.054 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-06-06T03:26:23.054 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-06-06T03:26:23.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:22 smithi079 ceph-mon[35478]: pgmap v423: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:26:23.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:22 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/4157500044' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-06T03:26:23.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-06T03:26:23.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-06T03:26:23.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T03:26:23.201 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-06T03:26:23.227 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-06-06T03:26:23.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T03:26:23.229 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-06-06T03:26:23.286 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-06-06T03:26:23.286 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-06T03:26:23.286 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-06-06T03:26:23.287 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-06-06T03:26:23.287 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-06T03:26:23.287 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-06T03:26:23.287 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-06-06T03:26:23.287 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-06-06T03:26:23.287 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-06-06T03:26:23.287 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-06-06T03:26:23.287 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-06-06T03:26:23.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-06T03:26:23.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-06T03:26:23.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T03:26:23.419 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-06-06T03:26:23.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T03:26:23.435 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list-id 2024-06-06T03:26:23.490 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-06T03:26:23.490 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-06-06T03:26:23.490 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-06T03:26:23.490 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-06-06T03:26:23.490 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-06-06T03:26:23.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-06T03:26:23.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-06T03:26:23.611 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-06-06T03:26:23.611 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-06T03:26:23.611 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-06-06T03:26:23.611 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-06-06T03:26:23.611 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-06-06T03:26:23.611 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-06-06T03:26:23.611 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-06-06T03:26:23.611 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-06-06T03:26:23.611 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-06-06T03:26:23.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-06T03:26:23.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-06T03:26:23.732 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-06T03:26:23.732 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-06-06T03:26:23.732 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-06-06T03:26:23.733 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set dev brx.0 master ceph-brx 2024-06-06T03:26:23.733 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-06-06T03:26:23.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-06T03:26:23.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-06T03:26:23.812 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-06-06T03:26:23.812 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-06T03:26:23.812 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-06T03:26:23.828 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-06T03:26:23.828 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-06T03:26:23.828 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-06T03:26:23.883 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2024-06-06T03:26:23.950 DEBUG:teuthology.orchestra.run.smithi050:> cat /proc/self/mounts | awk '{print $2}' 2024-06-06T03:26:24.006 INFO:teuthology.orchestra.run.smithi050.stdout:/proc 2024-06-06T03:26:24.006 INFO:teuthology.orchestra.run.smithi050.stdout:/sys 2024-06-06T03:26:24.006 INFO:teuthology.orchestra.run.smithi050.stdout:/dev 2024-06-06T03:26:24.007 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/security 2024-06-06T03:26:24.007 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/shm 2024-06-06T03:26:24.007 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/pts 2024-06-06T03:26:24.007 INFO:teuthology.orchestra.run.smithi050.stdout:/run 2024-06-06T03:26:24.007 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/cgroup 2024-06-06T03:26:24.007 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/pstore 2024-06-06T03:26:24.007 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/bpf 2024-06-06T03:26:24.007 INFO:teuthology.orchestra.run.smithi050.stdout:/ 2024-06-06T03:26:24.007 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/selinux 2024-06-06T03:26:24.007 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2024-06-06T03:26:24.007 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/debug 2024-06-06T03:26:24.007 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/mqueue 2024-06-06T03:26:24.007 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/tracing 2024-06-06T03:26:24.007 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/hugepages 2024-06-06T03:26:24.008 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-06T03:26:24.008 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/fuse/connections 2024-06-06T03:26:24.008 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/config 2024-06-06T03:26:24.008 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-sysctl.service 2024-06-06T03:26:24.008 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-06T03:26:24.008 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/nfs/rpc_pipefs 2024-06-06T03:26:24.008 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/1000 2024-06-06T03:26:24.008 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph 2024-06-06T03:26:24.008 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay 2024-06-06T03:26:24.008 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/55475d8de65bb5675e341d66de7fbd12fecbd8312fb56fc0a659485d49e94c25/merged 2024-06-06T03:26:24.008 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/ff8c55fbe961acbd6027329a72b4757abb0d888c4c4e25bca39bc2c85f77560b/merged 2024-06-06T03:26:24.008 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/0 2024-06-06T03:26:24.008 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2024-06-06T03:26:24.009 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/e9df8d70483ed98265a611823834b052f5b21544d2cf5ba63451e95dc98bd332/merged 2024-06-06T03:26:24.009 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/64a70138420bd382a3a7641d0af8bbea78863030ece29d1c0bad415cc648659a/merged 2024-06-06T03:26:24.009 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/1daec0589c743b85cdd39f49dbc6723597e793604d588352aff4792c0ce2983c/merged 2024-06-06T03:26:24.009 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/8cea9c4a8ea1b6ae4dfa58693269e3f57a77cd5c94c5b2db50cfb963c4adce0e/merged 2024-06-06T03:26:24.009 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/f25fcc4a07433479657db56d79139ec762e0ff1e1c0ba6e3fc85084350be0fba/merged 2024-06-06T03:26:24.009 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/4eeb14e018357eee6e3629d4e906965e49b7bd6673b60301a46cc40ca93507f1/merged 2024-06-06T03:26:24.009 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/b82976c82aa2d7cca9d3a2c8a813ba195334bdcc33d1fb19950c84f4117e68c2/merged 2024-06-06T03:26:24.009 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/3f40688c26007f9f8656bddf2a15dd1ca5087f85532e22ea84834329eb331d1e/merged 2024-06-06T03:26:24.009 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns 2024-06-06T03:26:24.009 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-06T03:26:24.009 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-06T03:26:24.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T03:26:24.010 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2024-06-06T03:26:24.063 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-06T03:26:24.063 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df --client_fs=cephfs) 2024-06-06T03:26:24.105 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2024-06-06T03:26:24.130 DEBUG:teuthology.orchestra.run.smithi050:> cat /proc/self/mounts | awk '{print $2}' 2024-06-06T03:26:24.188 INFO:teuthology.orchestra.run.smithi050.stdout:/proc 2024-06-06T03:26:24.188 INFO:teuthology.orchestra.run.smithi050.stdout:/sys 2024-06-06T03:26:24.188 INFO:teuthology.orchestra.run.smithi050.stdout:/dev 2024-06-06T03:26:24.189 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/security 2024-06-06T03:26:24.189 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/shm 2024-06-06T03:26:24.189 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/pts 2024-06-06T03:26:24.189 INFO:teuthology.orchestra.run.smithi050.stdout:/run 2024-06-06T03:26:24.189 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/cgroup 2024-06-06T03:26:24.189 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/pstore 2024-06-06T03:26:24.189 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/bpf 2024-06-06T03:26:24.189 INFO:teuthology.orchestra.run.smithi050.stdout:/ 2024-06-06T03:26:24.189 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/selinux 2024-06-06T03:26:24.189 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2024-06-06T03:26:24.189 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/debug 2024-06-06T03:26:24.189 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/mqueue 2024-06-06T03:26:24.189 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/tracing 2024-06-06T03:26:24.190 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/hugepages 2024-06-06T03:26:24.190 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-06T03:26:24.190 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/fuse/connections 2024-06-06T03:26:24.190 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/config 2024-06-06T03:26:24.190 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-sysctl.service 2024-06-06T03:26:24.190 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-06T03:26:24.190 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/nfs/rpc_pipefs 2024-06-06T03:26:24.190 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/1000 2024-06-06T03:26:24.190 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph 2024-06-06T03:26:24.190 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay 2024-06-06T03:26:24.190 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/55475d8de65bb5675e341d66de7fbd12fecbd8312fb56fc0a659485d49e94c25/merged 2024-06-06T03:26:24.190 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/ff8c55fbe961acbd6027329a72b4757abb0d888c4c4e25bca39bc2c85f77560b/merged 2024-06-06T03:26:24.190 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/0 2024-06-06T03:26:24.190 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2024-06-06T03:26:24.191 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/e9df8d70483ed98265a611823834b052f5b21544d2cf5ba63451e95dc98bd332/merged 2024-06-06T03:26:24.191 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/64a70138420bd382a3a7641d0af8bbea78863030ece29d1c0bad415cc648659a/merged 2024-06-06T03:26:24.191 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/1daec0589c743b85cdd39f49dbc6723597e793604d588352aff4792c0ce2983c/merged 2024-06-06T03:26:24.191 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/8cea9c4a8ea1b6ae4dfa58693269e3f57a77cd5c94c5b2db50cfb963c4adce0e/merged 2024-06-06T03:26:24.191 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/f25fcc4a07433479657db56d79139ec762e0ff1e1c0ba6e3fc85084350be0fba/merged 2024-06-06T03:26:24.191 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/4eeb14e018357eee6e3629d4e906965e49b7bd6673b60301a46cc40ca93507f1/merged 2024-06-06T03:26:24.191 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/b82976c82aa2d7cca9d3a2c8a813ba195334bdcc33d1fb19950c84f4117e68c2/merged 2024-06-06T03:26:24.191 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/3f40688c26007f9f8656bddf2a15dd1ca5087f85532e22ea84834329eb331d1e/merged 2024-06-06T03:26:24.191 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns 2024-06-06T03:26:24.191 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-06T03:26:24.191 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-06T03:26:24.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T03:26:24.192 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2024-06-06T03:26:24.192 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:2024-06-06T03:26:24.190+0000 7f9fca321480 -1 init, newargv = 0x55ceaab928b0 newargc=15 2024-06-06T03:26:24.193 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[90997]: starting ceph client 2024-06-06T03:26:24.205 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[90997]: starting fuse 2024-06-06T03:26:24.209 INFO:teuthology.orchestra.run.smithi050.stdout:119 2024-06-06T03:26:24.209 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [119] 2024-06-06T03:26:24.209 DEBUG:teuthology.orchestra.run.smithi050:> sudo stdin-killer -- python3 -c ' 2024-06-06T03:26:24.209 DEBUG:teuthology.orchestra.run.smithi050:> import glob 2024-06-06T03:26:24.209 DEBUG:teuthology.orchestra.run.smithi050:> import re 2024-06-06T03:26:24.209 DEBUG:teuthology.orchestra.run.smithi050:> import os 2024-06-06T03:26:24.210 DEBUG:teuthology.orchestra.run.smithi050:> import subprocess 2024-06-06T03:26:24.210 DEBUG:teuthology.orchestra.run.smithi050:> 2024-06-06T03:26:24.210 DEBUG:teuthology.orchestra.run.smithi050:> def _find_admin_socket(client_name): 2024-06-06T03:26:24.210 DEBUG:teuthology.orchestra.run.smithi050:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-06-06T03:26:24.210 DEBUG:teuthology.orchestra.run.smithi050:> files = glob.glob(asok_path) 2024-06-06T03:26:24.210 DEBUG:teuthology.orchestra.run.smithi050:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-06-06T03:26:24.210 DEBUG:teuthology.orchestra.run.smithi050:> 2024-06-06T03:26:24.210 DEBUG:teuthology.orchestra.run.smithi050:> # Given a non-glob path, it better be there 2024-06-06T03:26:24.210 DEBUG:teuthology.orchestra.run.smithi050:> if "*" not in asok_path: 2024-06-06T03:26:24.210 DEBUG:teuthology.orchestra.run.smithi050:> assert(len(files) == 1) 2024-06-06T03:26:24.210 DEBUG:teuthology.orchestra.run.smithi050:> return files[0] 2024-06-06T03:26:24.210 DEBUG:teuthology.orchestra.run.smithi050:> 2024-06-06T03:26:24.210 DEBUG:teuthology.orchestra.run.smithi050:> for f in files: 2024-06-06T03:26:24.210 DEBUG:teuthology.orchestra.run.smithi050:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-06T03:26:24.211 DEBUG:teuthology.orchestra.run.smithi050:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-06T03:26:24.211 DEBUG:teuthology.orchestra.run.smithi050:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-06T03:26:24.211 DEBUG:teuthology.orchestra.run.smithi050:> contents = proc_f.read() 2024-06-06T03:26:24.211 DEBUG:teuthology.orchestra.run.smithi050:> if mountpoint in contents: 2024-06-06T03:26:24.211 DEBUG:teuthology.orchestra.run.smithi050:> return f 2024-06-06T03:26:24.211 DEBUG:teuthology.orchestra.run.smithi050:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-06T03:26:24.211 DEBUG:teuthology.orchestra.run.smithi050:> 2024-06-06T03:26:24.211 DEBUG:teuthology.orchestra.run.smithi050:> print(_find_admin_socket("client.0")) 2024-06-06T03:26:24.211 DEBUG:teuthology.orchestra.run.smithi050:> ' 2024-06-06T03:26:24.331 INFO:teuthology.orchestra.run.smithi050.stdout:/var/run/ceph/ceph-client.0.90997.asok 2024-06-06T03:26:24.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-06T03:26:24.342 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.90997.asok 2024-06-06T03:26:24.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T03:26:24.342 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.90997.asok status 2024-06-06T03:26:24.482 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:26:24.482 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": { 2024-06-06T03:26:24.482 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-06T03:26:24.482 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-06T03:26:24.482 INFO:teuthology.orchestra.run.smithi050.stdout: "entity_id": "0", 2024-06-06T03:26:24.482 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": "smithi050", 2024-06-06T03:26:24.482 INFO:teuthology.orchestra.run.smithi050.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-06-06T03:26:24.482 INFO:teuthology.orchestra.run.smithi050.stdout: "pid": "90997", 2024-06-06T03:26:24.482 INFO:teuthology.orchestra.run.smithi050.stdout: "root": "/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df" 2024-06-06T03:26:24.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:26:24.483 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_count": 0, 2024-06-06T03:26:24.483 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_pinned_count": 0, 2024-06-06T03:26:24.483 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 15231, 2024-06-06T03:26:24.483 INFO:teuthology.orchestra.run.smithi050.stdout: "inst": { 2024-06-06T03:26:24.483 INFO:teuthology.orchestra.run.smithi050.stdout: "name": { 2024-06-06T03:26:24.483 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "client", 2024-06-06T03:26:24.483 INFO:teuthology.orchestra.run.smithi050.stdout: "num": 15231 2024-06-06T03:26:24.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:26:24.483 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2024-06-06T03:26:24.483 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-06-06T03:26:24.483 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2024-06-06T03:26:24.483 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3580081391 2024-06-06T03:26:24.483 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:26:24.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:26:24.484 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2024-06-06T03:26:24.484 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-06-06T03:26:24.484 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2024-06-06T03:26:24.484 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3580081391 2024-06-06T03:26:24.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:26:24.484 INFO:teuthology.orchestra.run.smithi050.stdout: "inst_str": "client.15231 192.168.0.1:0/3580081391", 2024-06-06T03:26:24.484 INFO:teuthology.orchestra.run.smithi050.stdout: "addr_str": "192.168.0.1:0/3580081391", 2024-06-06T03:26:24.484 INFO:teuthology.orchestra.run.smithi050.stdout: "inode_count": 5, 2024-06-06T03:26:24.484 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_epoch": 26, 2024-06-06T03:26:24.484 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch": 99, 2024-06-06T03:26:24.484 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch_barrier": 0, 2024-06-06T03:26:24.484 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklisted": false, 2024-06-06T03:26:24.484 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs" 2024-06-06T03:26:24.484 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:26:24.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T03:26:24.491 DEBUG:teuthology.orchestra.run.smithi050:> stat --file-system '--printf=%T 2024-06-06T03:26:24.491 DEBUG:teuthology.orchestra.run.smithi050:> ' -- /home/ubuntu/cephtest/mnt.0 2024-06-06T03:26:24.507 INFO:teuthology.orchestra.run.smithi050.stdout:fuseblk 2024-06-06T03:26:24.507 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-06-06T03:26:24.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T03:26:24.508 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-06T03:26:24.576 INFO:teuthology.run_tasks:Running task exec... 2024-06-06T03:26:24.593 INFO:teuthology.task.exec:Executing custom commands... 2024-06-06T03:26:24.593 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi050.front.sepia.ceph.com 2024-06-06T03:26:24.594 DEBUG:teuthology.orchestra.run.smithi050:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-06-06T03:26:24.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.725+0000 7f4df1e53640 1 -- 172.21.15.50:0/294894368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dec107790 msgr2=0x7f4dec109be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:24.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.725+0000 7f4df1e53640 1 --2- 172.21.15.50:0/294894368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dec107790 0x7f4dec109be0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4de4009ca0 tx=0x7f4de402a8c0 comp rx=0 tx=0).stop 2024-06-06T03:26:24.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.725+0000 7f4df1e53640 1 -- 172.21.15.50:0/294894368 shutdown_connections 2024-06-06T03:26:24.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.725+0000 7f4df1e53640 1 --2- 172.21.15.50:0/294894368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dec107790 0x7f4dec109be0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:24.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.725+0000 7f4df1e53640 1 --2- 172.21.15.50:0/294894368 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4dec104e60 0x7f4dec107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:24.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.725+0000 7f4df1e53640 1 --2- 172.21.15.50:0/294894368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dec102530 0x7f4dec104920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:24.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.725+0000 7f4df1e53640 1 -- 172.21.15.50:0/294894368 >> 172.21.15.50:0/294894368 conn(0x7f4dec0fbf20 msgr2=0x7f4dec0fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:24.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.725+0000 7f4df1e53640 1 -- 172.21.15.50:0/294894368 shutdown_connections 2024-06-06T03:26:24.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.725+0000 7f4df1e53640 1 -- 172.21.15.50:0/294894368 wait complete. 2024-06-06T03:26:24.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.726+0000 7f4df1e53640 1 Processor -- start 2024-06-06T03:26:24.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.726+0000 7f4df1e53640 1 -- start start 2024-06-06T03:26:24.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.726+0000 7f4df1e53640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dec102530 0x7f4dec199d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:24.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.726+0000 7f4df1e53640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4dec104e60 0x7f4dec19a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:24.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.726+0000 7f4df1e53640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dec107790 0x7f4dec1a1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:24.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.726+0000 7f4df1e53640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec10d570 con 0x7f4dec107790 2024-06-06T03:26:24.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.726+0000 7f4df1e53640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec10d3f0 con 0x7f4dec102530 2024-06-06T03:26:24.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.726+0000 7f4df1e53640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec10d6f0 con 0x7f4dec104e60 2024-06-06T03:26:24.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.726+0000 7f4debfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dec107790 0x7f4dec1a1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:24.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.726+0000 7f4debfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dec107790 0x7f4dec1a1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59402/0 (socket says 172.21.15.50:59402) 2024-06-06T03:26:24.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.726+0000 7f4debfff640 1 -- 172.21.15.50:0/3558173047 learned_addr learned my addr 172.21.15.50:0/3558173047 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:24.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.727+0000 7f4deb7fe640 1 --2- 172.21.15.50:0/3558173047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dec102530 0x7f4dec199d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:24.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.727+0000 7f4de2ffd640 1 --2- 172.21.15.50:0/3558173047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4dec104e60 0x7f4dec19a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:24.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.727+0000 7f4debfff640 1 -- 172.21.15.50:0/3558173047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4dec104e60 msgr2=0x7f4dec19a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:24.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.727+0000 7f4debfff640 1 --2- 172.21.15.50:0/3558173047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4dec104e60 0x7f4dec19a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:24.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.727+0000 7f4debfff640 1 -- 172.21.15.50:0/3558173047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dec102530 msgr2=0x7f4dec199d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:24.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.727+0000 7f4debfff640 1 --2- 172.21.15.50:0/3558173047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dec102530 0x7f4dec199d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:24.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.727+0000 7f4debfff640 1 -- 172.21.15.50:0/3558173047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dec1a1910 con 0x7f4dec107790 2024-06-06T03:26:24.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.727+0000 7f4deb7fe640 1 --2- 172.21.15.50:0/3558173047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dec102530 0x7f4dec199d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:26:24.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.727+0000 7f4debfff640 1 --2- 172.21.15.50:0/3558173047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dec107790 0x7f4dec1a1270 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4de4031970 tx=0x7f4de4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:24.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.727+0000 7f4de97fa640 1 -- 172.21.15.50:0/3558173047 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de4004040 con 0x7f4dec107790 2024-06-06T03:26:24.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.727+0000 7f4de97fa640 1 -- 172.21.15.50:0/3558173047 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4de4004690 con 0x7f4dec107790 2024-06-06T03:26:24.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.727+0000 7f4df1e53640 1 -- 172.21.15.50:0/3558173047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dec1a1ba0 con 0x7f4dec107790 2024-06-06T03:26:24.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.727+0000 7f4de97fa640 1 -- 172.21.15.50:0/3558173047 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de4030c60 con 0x7f4dec107790 2024-06-06T03:26:24.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.727+0000 7f4df1e53640 1 -- 172.21.15.50:0/3558173047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dec1a2140 con 0x7f4dec107790 2024-06-06T03:26:24.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.728+0000 7f4df1e53640 1 -- 172.21.15.50:0/3558173047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dec109280 con 0x7f4dec107790 2024-06-06T03:26:24.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.729+0000 7f4de97fa640 1 -- 172.21.15.50:0/3558173047 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4de40041e0 con 0x7f4dec107790 2024-06-06T03:26:24.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.730+0000 7f4de97fa640 1 --2- 172.21.15.50:0/3558173047 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4dd80a2cb0 0x7f4dd80a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:24.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.730+0000 7f4de97fa640 1 -- 172.21.15.50:0/3558173047 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f4de40f0b10 con 0x7f4dec107790 2024-06-06T03:26:24.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.730+0000 7f4deb7fe640 1 --2- 172.21.15.50:0/3558173047 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4dd80a2cb0 0x7f4dd80a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:24.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.731+0000 7f4deb7fe640 1 --2- 172.21.15.50:0/3558173047 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4dd80a2cb0 0x7f4dd80a5170 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4dec19b1d0 tx=0x7f4ddc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:24.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.734+0000 7f4de97fa640 1 -- 172.21.15.50:0/3558173047 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4de40bd6f0 con 0x7f4dec107790 2024-06-06T03:26:24.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:24 smithi122 ceph-mon[35759]: pgmap v424: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T03:26:24.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:24.957+0000 7f4df1e53640 1 -- 172.21.15.50:0/3558173047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f4dec02d2e0 con 0x7f4dec107790 2024-06-06T03:26:25.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:24 smithi050 ceph-mon[32421]: pgmap v424: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T03:26:25.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:24 smithi079 ceph-mon[35478]: pgmap v424: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T03:26:25.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.655+0000 7f4de97fa640 1 -- 172.21.15.50:0/3558173047 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v27) ==== 117+0+0 (secure 0 0 0) 0x7f4de40bcff0 con 0x7f4dec107790 2024-06-06T03:26:25.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.659+0000 7f4df1e53640 1 -- 172.21.15.50:0/3558173047 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4dd80a2cb0 msgr2=0x7f4dd80a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:25.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.659+0000 7f4df1e53640 1 --2- 172.21.15.50:0/3558173047 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4dd80a2cb0 0x7f4dd80a5170 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4dec19b1d0 tx=0x7f4ddc005f90 comp rx=0 tx=0).stop 2024-06-06T03:26:25.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.659+0000 7f4df1e53640 1 -- 172.21.15.50:0/3558173047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dec107790 msgr2=0x7f4dec1a1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:25.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.659+0000 7f4df1e53640 1 --2- 172.21.15.50:0/3558173047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dec107790 0x7f4dec1a1270 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4de4031970 tx=0x7f4de4003ba0 comp rx=0 tx=0).stop 2024-06-06T03:26:25.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.659+0000 7f4df1e53640 1 -- 172.21.15.50:0/3558173047 shutdown_connections 2024-06-06T03:26:25.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.659+0000 7f4df1e53640 1 --2- 172.21.15.50:0/3558173047 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4dd80a2cb0 0x7f4dd80a5170 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:25.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.659+0000 7f4df1e53640 1 --2- 172.21.15.50:0/3558173047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dec107790 0x7f4dec1a1270 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:25.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.659+0000 7f4df1e53640 1 --2- 172.21.15.50:0/3558173047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4dec104e60 0x7f4dec19a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:25.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.659+0000 7f4df1e53640 1 --2- 172.21.15.50:0/3558173047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dec102530 0x7f4dec199d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:25.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.659+0000 7f4df1e53640 1 -- 172.21.15.50:0/3558173047 >> 172.21.15.50:0/3558173047 conn(0x7f4dec0fbf20 msgr2=0x7f4dec101b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:25.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.659+0000 7f4df1e53640 1 -- 172.21.15.50:0/3558173047 shutdown_connections 2024-06-06T03:26:25.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.659+0000 7f4df1e53640 1 -- 172.21.15.50:0/3558173047 wait complete. 2024-06-06T03:26:25.671 INFO:teuthology.run_tasks:Running task check-counter... 2024-06-06T03:26:25.682 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-06-06T03:26:25.722 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-06T03:26:25.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.834+0000 7f6a39cb3640 1 -- 172.21.15.50:0/500861119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a341019f0 msgr2=0x7f6a34101e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:25.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.834+0000 7f6a39cb3640 1 --2- 172.21.15.50:0/500861119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a341019f0 0x7f6a34101e10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6a24009900 tx=0x7f6a2402a410 comp rx=0 tx=0).stop 2024-06-06T03:26:25.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.834+0000 7f6a39cb3640 1 -- 172.21.15.50:0/500861119 shutdown_connections 2024-06-06T03:26:25.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.834+0000 7f6a39cb3640 1 --2- 172.21.15.50:0/500861119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a341035a0 0x7f6a34109e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:25.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.834+0000 7f6a39cb3640 1 --2- 172.21.15.50:0/500861119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a34102be0 0x7f6a34103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:25.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.834+0000 7f6a39cb3640 1 --2- 172.21.15.50:0/500861119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a341019f0 0x7f6a34101e10 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:25.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.834+0000 7f6a39cb3640 1 -- 172.21.15.50:0/500861119 >> 172.21.15.50:0/500861119 conn(0x7f6a340fcf80 msgr2=0x7f6a340ff3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:25.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.834+0000 7f6a39cb3640 1 -- 172.21.15.50:0/500861119 shutdown_connections 2024-06-06T03:26:25.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.834+0000 7f6a39cb3640 1 -- 172.21.15.50:0/500861119 wait complete. 2024-06-06T03:26:25.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.835+0000 7f6a39cb3640 1 Processor -- start 2024-06-06T03:26:25.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.835+0000 7f6a39cb3640 1 -- start start 2024-06-06T03:26:25.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.835+0000 7f6a39cb3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a341019f0 0x7f6a34197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:25.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.835+0000 7f6a39cb3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a34102be0 0x7f6a341981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:25.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.835+0000 7f6a39cb3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a341035a0 0x7f6a3419f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:25.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.835+0000 7f6a39cb3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3410d4f0 con 0x7f6a34102be0 2024-06-06T03:26:25.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.835+0000 7f6a39cb3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3410d370 con 0x7f6a341019f0 2024-06-06T03:26:25.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.835+0000 7f6a39cb3640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3410d670 con 0x7f6a341035a0 2024-06-06T03:26:25.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.835+0000 7f6a2affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a34102be0 0x7f6a341981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:25.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.835+0000 7f6a2affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a34102be0 0x7f6a341981c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59424/0 (socket says 172.21.15.50:59424) 2024-06-06T03:26:25.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.835+0000 7f6a2affd640 1 -- 172.21.15.50:0/1901170143 learned_addr learned my addr 172.21.15.50:0/1901170143 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:25.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.836+0000 7f6a337fe640 1 --2- 172.21.15.50:0/1901170143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a341019f0 0x7f6a34197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:25.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.836+0000 7f6a33fff640 1 --2- 172.21.15.50:0/1901170143 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a341035a0 0x7f6a3419f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:25.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.836+0000 7f6a2affd640 1 -- 172.21.15.50:0/1901170143 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a341035a0 msgr2=0x7f6a3419f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:25.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.836+0000 7f6a2affd640 1 --2- 172.21.15.50:0/1901170143 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a341035a0 0x7f6a3419f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:25.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.836+0000 7f6a2affd640 1 -- 172.21.15.50:0/1901170143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a341019f0 msgr2=0x7f6a34197c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:25.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.836+0000 7f6a2affd640 1 --2- 172.21.15.50:0/1901170143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a341019f0 0x7f6a34197c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:25.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.836+0000 7f6a2affd640 1 -- 172.21.15.50:0/1901170143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a3419f890 con 0x7f6a34102be0 2024-06-06T03:26:25.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.836+0000 7f6a33fff640 1 --2- 172.21.15.50:0/1901170143 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a341035a0 0x7f6a3419f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:26:25.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.836+0000 7f6a2affd640 1 --2- 172.21.15.50:0/1901170143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a34102be0 0x7f6a341981c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c00d950 tx=0x7f6a1c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:25.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.836+0000 7f6a317fa640 1 -- 172.21.15.50:0/1901170143 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c017070 con 0x7f6a34102be0 2024-06-06T03:26:25.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.836+0000 7f6a39cb3640 1 -- 172.21.15.50:0/1901170143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a3419fb80 con 0x7f6a34102be0 2024-06-06T03:26:25.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.836+0000 7f6a317fa640 1 -- 172.21.15.50:0/1901170143 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6a1c009c30 con 0x7f6a34102be0 2024-06-06T03:26:25.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.836+0000 7f6a317fa640 1 -- 172.21.15.50:0/1901170143 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c00f620 con 0x7f6a34102be0 2024-06-06T03:26:25.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.836+0000 7f6a39cb3640 1 -- 172.21.15.50:0/1901170143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a341a00a0 con 0x7f6a34102be0 2024-06-06T03:26:25.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.837+0000 7f6a39cb3640 1 -- 172.21.15.50:0/1901170143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a34108d80 con 0x7f6a34102be0 2024-06-06T03:26:25.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.838+0000 7f6a317fa640 1 -- 172.21.15.50:0/1901170143 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6a1c0109a0 con 0x7f6a34102be0 2024-06-06T03:26:25.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.839+0000 7f6a317fa640 1 --2- 172.21.15.50:0/1901170143 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6a200a2b90 0x7f6a200a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:25.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.839+0000 7f6a317fa640 1 -- 172.21.15.50:0/1901170143 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f6a1c0cf0a0 con 0x7f6a34102be0 2024-06-06T03:26:25.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.839+0000 7f6a337fe640 1 --2- 172.21.15.50:0/1901170143 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6a200a2b90 0x7f6a200a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:25.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.840+0000 7f6a337fe640 1 --2- 172.21.15.50:0/1901170143 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6a200a2b90 0x7f6a200a5050 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6a24004770 tx=0x7f6a24000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:25.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:25.844+0000 7f6a317fa640 1 -- 172.21.15.50:0/1901170143 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6a1c009de0 con 0x7f6a34102be0 2024-06-06T03:26:25.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:25 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/3558173047' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-06-06T03:26:26.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:25 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3558173047' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-06-06T03:26:26.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.029+0000 7f6a39cb3640 1 -- 172.21.15.50:0/1901170143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a340625a0 con 0x7f6a34102be0 2024-06-06T03:26:26.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.031+0000 7f6a317fa640 1 -- 172.21.15.50:0/1901170143 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+24653 (secure 0 0 0) 0x7f6a1c09bc80 con 0x7f6a34102be0 2024-06-06T03:26:26.031 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:26:26.031 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":99,"fsid":"b6263b26-23b2-11ef-bc9b-c7b262605968","created":"2024-06-06T03:14:19.062632+0000","modified":"2024-06-06T03:24:14.691472+0000","last_up_change":"2024-06-06T03:21:30.287918+0000","last_in_change":"2024-06-06T03:21:09.550417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T03:17:37.777608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T03:22:29.496859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T03:22:33.221878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-06T03:22:42.829873+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"eed8040f-a7b7-4d3b-8345-2022918097d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6803","nonce":2379528827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6805","nonce":2379528827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6809","nonce":2379528827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6807","nonce":2379528827}]},"public_addr":"172.21.15.50:6803/2379528827","cluster_addr":"172.21.15.50:6805/2379528827","heartbeat_back_addr":"172.21.15.50:6809/2379528827","heartbeat_front_addr":"172.21.15.50:6807/2379528827","state":["exists","up"]},{"osd":1,"uuid":"089ecb78-5e1e-4cdb-8fe0-5c1731ec9dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6801","nonce":3498354151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6803","nonce":3498354151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6807","nonce":3498354151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6805","nonce":3498354151}]},"public_addr":"172.21.15.79:6801/3498354151","cluster_addr":"172.21.15.79:6803/3498354151","heartbeat_back_addr":"172.21.15.79:6807/3498354151","heartbeat_front_addr":"172.21.15.79:6805/3498354151","state":["exists","up"]},{"osd":2,"uuid":"90599e3b-bf86-4a56-b03b-b051528a5b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6801","nonce":566397008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6803","nonce":566397008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6807","nonce":566397008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6805","nonce":566397008}]},"public_addr":"172.21.15.122:6801/566397008","cluster_addr":"172.21.15.122:6803/566397008","heartbeat_back_addr":"172.21.15.122:6807/566397008","heartbeat_front_addr":"172.21.15.122:6805/566397008","state":["exists","up"]},{"osd":3,"uuid":"fd295e6c-64cd-4164-83dc-4d32c2ae103a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6811","nonce":820123083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6813","nonce":820123083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6817","nonce":820123083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6815","nonce":820123083}]},"public_addr":"172.21.15.50:6811/820123083","cluster_addr":"172.21.15.50:6813/820123083","heartbeat_back_addr":"172.21.15.50:6817/820123083","heartbeat_front_addr":"172.21.15.50:6815/820123083","state":["exists","up"]},{"osd":4,"uuid":"4c854d90-5353-4f7c-b2f3-2af6216d799b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6809","nonce":1784117997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6811","nonce":1784117997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6815","nonce":1784117997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6813","nonce":1784117997}]},"public_addr":"172.21.15.79:6809/1784117997","cluster_addr":"172.21.15.79:6811/1784117997","heartbeat_back_addr":"172.21.15.79:6815/1784117997","heartbeat_front_addr":"172.21.15.79:6813/1784117997","state":["exists","up"]},{"osd":5,"uuid":"80041e10-a643-4338-b621-f882c7bc48b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6809","nonce":2755878218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6811","nonce":2755878218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6815","nonce":2755878218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6813","nonce":2755878218}]},"public_addr":"172.21.15.122:6809/2755878218","cluster_addr":"172.21.15.122:6811/2755878218","heartbeat_back_addr":"172.21.15.122:6815/2755878218","heartbeat_front_addr":"172.21.15.122:6813/2755878218","state":["exists","up"]},{"osd":6,"uuid":"9e15c6c3-bb4b-4c2b-bb7e-4653b10874d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6819","nonce":474595612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6821","nonce":474595612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6825","nonce":474595612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6823","nonce":474595612}]},"public_addr":"172.21.15.50:6819/474595612","cluster_addr":"172.21.15.50:6821/474595612","heartbeat_back_addr":"172.21.15.50:6825/474595612","heartbeat_front_addr":"172.21.15.50:6823/474595612","state":["exists","up"]},{"osd":7,"uuid":"62585bba-c540-4498-8768-b84183e19abd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6817","nonce":3504864579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6819","nonce":3504864579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6823","nonce":3504864579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6821","nonce":3504864579}]},"public_addr":"172.21.15.79:6817/3504864579","cluster_addr":"172.21.15.79:6819/3504864579","heartbeat_back_addr":"172.21.15.79:6823/3504864579","heartbeat_front_addr":"172.21.15.79:6821/3504864579","state":["exists","up"]},{"osd":8,"uuid":"7a272157-460a-4d4a-a63e-30436022ac7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6817","nonce":3484833116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6819","nonce":3484833116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6823","nonce":3484833116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6821","nonce":3484833116}]},"public_addr":"172.21.15.122:6817/3484833116","cluster_addr":"172.21.15.122:6819/3484833116","heartbeat_back_addr":"172.21.15.122:6823/3484833116","heartbeat_front_addr":"172.21.15.122:6821/3484833116","state":["exists","up"]},{"osd":9,"uuid":"7e768ff7-f78d-4a12-b863-4b692e0f4a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6827","nonce":2600273670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6829","nonce":2600273670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6833","nonce":2600273670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6831","nonce":2600273670}]},"public_addr":"172.21.15.50:6827/2600273670","cluster_addr":"172.21.15.50:6829/2600273670","heartbeat_back_addr":"172.21.15.50:6833/2600273670","heartbeat_front_addr":"172.21.15.50:6831/2600273670","state":["exists","up"]},{"osd":10,"uuid":"a42df29a-d88d-4401-878d-6c8f75f3f604","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6825","nonce":2740366543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6827","nonce":2740366543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6831","nonce":2740366543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6829","nonce":2740366543}]},"public_addr":"172.21.15.79:6825/2740366543","cluster_addr":"172.21.15.79:6827/2740366543","heartbeat_back_addr":"172.21.15.79:6831/2740366543","heartbeat_front_addr":"172.21.15.79:6829/2740366543","state":["exists","up"]},{"osd":11,"uuid":"35bcde30-49e4-49b9-a348-98d21a0d3cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6825","nonce":4160854238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6827","nonce":4160854238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6831","nonce":4160854238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6829","nonce":4160854238}]},"public_addr":"172.21.15.122:6825/4160854238","cluster_addr":"172.21.15.122:6827/4160854238","heartbeat_back_addr":"172.21.15.122:6831/4160854238","heartbeat_front_addr":"172.21.15.122:6829/4160854238","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:16:46.989554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:17:11.269759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:17:35.105846+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:00.940943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:26.284520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:51.064143+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:19:16.254750+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:19:42.841380+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:20:08.185133+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:20:34.700082+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:21:01.485278+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:21:27.938715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1311987652":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/1149897118":"2024-06-07T03:15:13.252241+0000","172.21.15.50:6800/2617801068":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/1068038293":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/4038080419":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/149912088":"2024-06-07T03:14:46.388744+0000","172.21.15.50:6801/2617801068":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/2963887224":"2024-06-07T03:14:46.388744+0000","172.21.15.50:6801/1311987652":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/2554563139":"2024-06-07T03:15:13.252241+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T03:26:26.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.033+0000 7f6a39cb3640 1 -- 172.21.15.50:0/1901170143 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6a200a2b90 msgr2=0x7f6a200a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:26.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.033+0000 7f6a39cb3640 1 --2- 172.21.15.50:0/1901170143 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6a200a2b90 0x7f6a200a5050 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6a24004770 tx=0x7f6a24000bc0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.033+0000 7f6a39cb3640 1 -- 172.21.15.50:0/1901170143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a34102be0 msgr2=0x7f6a341981c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:26.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.033+0000 7f6a39cb3640 1 --2- 172.21.15.50:0/1901170143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a34102be0 0x7f6a341981c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c00d950 tx=0x7f6a1c00de10 comp rx=0 tx=0).stop 2024-06-06T03:26:26.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.033+0000 7f6a39cb3640 1 -- 172.21.15.50:0/1901170143 shutdown_connections 2024-06-06T03:26:26.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.033+0000 7f6a39cb3640 1 --2- 172.21.15.50:0/1901170143 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6a200a2b90 0x7f6a200a5050 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.033+0000 7f6a39cb3640 1 --2- 172.21.15.50:0/1901170143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a34102be0 0x7f6a341981c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.033+0000 7f6a39cb3640 1 --2- 172.21.15.50:0/1901170143 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a341035a0 0x7f6a3419f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.033+0000 7f6a39cb3640 1 --2- 172.21.15.50:0/1901170143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a341019f0 0x7f6a34197c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.033+0000 7f6a39cb3640 1 -- 172.21.15.50:0/1901170143 >> 172.21.15.50:0/1901170143 conn(0x7f6a340fcf80 msgr2=0x7f6a34105f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:26.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.033+0000 7f6a39cb3640 1 -- 172.21.15.50:0/1901170143 shutdown_connections 2024-06-06T03:26:26.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.033+0000 7f6a39cb3640 1 -- 172.21.15.50:0/1901170143 wait complete. 2024-06-06T03:26:26.045 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-06T03:17:37.777608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-06T03:22:29.496859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-06T03:22:33.221878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-06-06T03:22:42.829873+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-06-06T03:26:26.045 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-06T03:26:26.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:25 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/3558173047' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-06-06T03:26:26.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.153+0000 7f7e205d5640 1 -- 172.21.15.50:0/3613655953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e18100900 msgr2=0x7f7e18100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:26.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.153+0000 7f7e205d5640 1 --2- 172.21.15.50:0/3613655953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e18100900 0x7f7e18100d20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7e08009900 tx=0x7f7e0802a410 comp rx=0 tx=0).stop 2024-06-06T03:26:26.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.153+0000 7f7e205d5640 1 -- 172.21.15.50:0/3613655953 shutdown_connections 2024-06-06T03:26:26.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.153+0000 7f7e205d5640 1 --2- 172.21.15.50:0/3613655953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e181024b0 0x7f7e18108d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.153+0000 7f7e205d5640 1 --2- 172.21.15.50:0/3613655953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e18101af0 0x7f7e18101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.153+0000 7f7e205d5640 1 --2- 172.21.15.50:0/3613655953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e18100900 0x7f7e18100d20 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.153+0000 7f7e205d5640 1 -- 172.21.15.50:0/3613655953 >> 172.21.15.50:0/3613655953 conn(0x7f7e180fbe90 msgr2=0x7f7e180fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:26.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.153+0000 7f7e205d5640 1 -- 172.21.15.50:0/3613655953 shutdown_connections 2024-06-06T03:26:26.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.153+0000 7f7e205d5640 1 -- 172.21.15.50:0/3613655953 wait complete. 2024-06-06T03:26:26.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.154+0000 7f7e205d5640 1 Processor -- start 2024-06-06T03:26:26.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.154+0000 7f7e205d5640 1 -- start start 2024-06-06T03:26:26.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.154+0000 7f7e205d5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e18100900 0x7f7e18197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:26.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.154+0000 7f7e205d5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e18101af0 0x7f7e18198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:26.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.154+0000 7f7e205d5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e181024b0 0x7f7e1819f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:26.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.154+0000 7f7e205d5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1810c420 con 0x7f7e18100900 2024-06-06T03:26:26.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.154+0000 7f7e205d5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1810c2a0 con 0x7f7e181024b0 2024-06-06T03:26:26.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.154+0000 7f7e205d5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1810c5a0 con 0x7f7e18101af0 2024-06-06T03:26:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.154+0000 7f7e1e371640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e18100900 0x7f7e18197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.154+0000 7f7e1e371640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e18100900 0x7f7e18197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59448/0 (socket says 172.21.15.50:59448) 2024-06-06T03:26:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.154+0000 7f7e1e371640 1 -- 172.21.15.50:0/1243134677 learned_addr learned my addr 172.21.15.50:0/1243134677 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.154+0000 7f7e1eb72640 1 --2- 172.21.15.50:0/1243134677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e181024b0 0x7f7e1819f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.154+0000 7f7e1db70640 1 --2- 172.21.15.50:0/1243134677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e18101af0 0x7f7e18198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.154+0000 7f7e1e371640 1 -- 172.21.15.50:0/1243134677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e18101af0 msgr2=0x7f7e18198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.154+0000 7f7e1e371640 1 --2- 172.21.15.50:0/1243134677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e18101af0 0x7f7e18198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.154+0000 7f7e1e371640 1 -- 172.21.15.50:0/1243134677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e181024b0 msgr2=0x7f7e1819f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.154+0000 7f7e1e371640 1 --2- 172.21.15.50:0/1243134677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e181024b0 0x7f7e1819f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.154+0000 7f7e1e371640 1 -- 172.21.15.50:0/1243134677 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e1819f900 con 0x7f7e18100900 2024-06-06T03:26:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.154+0000 7f7e1db70640 1 --2- 172.21.15.50:0/1243134677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e18101af0 0x7f7e18198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:26:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.154+0000 7f7e1e371640 1 --2- 172.21.15.50:0/1243134677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e18100900 0x7f7e18197cf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7e080314e0 tx=0x7f7e080042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.155+0000 7f7e177fe640 1 -- 172.21.15.50:0/1243134677 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0803f030 con 0x7f7e18100900 2024-06-06T03:26:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.155+0000 7f7e177fe640 1 -- 172.21.15.50:0/1243134677 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7e08003cb0 con 0x7f7e18100900 2024-06-06T03:26:26.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.155+0000 7f7e205d5640 1 -- 172.21.15.50:0/1243134677 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e1819fb90 con 0x7f7e18100900 2024-06-06T03:26:26.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.155+0000 7f7e177fe640 1 -- 172.21.15.50:0/1243134677 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e08035070 con 0x7f7e18100900 2024-06-06T03:26:26.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.155+0000 7f7e205d5640 1 -- 172.21.15.50:0/1243134677 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e181a00d0 con 0x7f7e18100900 2024-06-06T03:26:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.156+0000 7f7e205d5640 1 -- 172.21.15.50:0/1243134677 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e181a02a0 con 0x7f7e18100900 2024-06-06T03:26:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.158+0000 7f7e177fe640 1 -- 172.21.15.50:0/1243134677 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7e08042030 con 0x7f7e18100900 2024-06-06T03:26:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.158+0000 7f7e177fe640 1 --2- 172.21.15.50:0/1243134677 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7e000a2c10 0x7f7e000a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.159+0000 7f7e1db70640 1 --2- 172.21.15.50:0/1243134677 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7e000a2c10 0x7f7e000a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.159+0000 7f7e177fe640 1 -- 172.21.15.50:0/1243134677 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f7e080efdf0 con 0x7f7e18100900 2024-06-06T03:26:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.159+0000 7f7e1db70640 1 --2- 172.21.15.50:0/1243134677 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7e000a2c10 0x7f7e000a50d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c005c40 tx=0x7f7e0c0082f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:26.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.161+0000 7f7e177fe640 1 -- 172.21.15.50:0/1243134677 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7e080bc9d0 con 0x7f7e18100900 2024-06-06T03:26:26.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.350+0000 7f7e205d5640 1 -- 172.21.15.50:0/1243134677 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7e181a0470 con 0x7f7e18100900 2024-06-06T03:26:26.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.350+0000 7f7e177fe640 1 -- 172.21.15.50:0/1243134677 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v99) ==== 93+0+10 (secure 0 0 0) 0x7f7e080bc2d0 con 0x7f7e18100900 2024-06-06T03:26:26.349 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-06-06T03:26:26.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.353+0000 7f7e205d5640 1 -- 172.21.15.50:0/1243134677 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7e000a2c10 msgr2=0x7f7e000a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:26.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.353+0000 7f7e205d5640 1 --2- 172.21.15.50:0/1243134677 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7e000a2c10 0x7f7e000a50d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c005c40 tx=0x7f7e0c0082f0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.353+0000 7f7e205d5640 1 -- 172.21.15.50:0/1243134677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e18100900 msgr2=0x7f7e18197cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:26.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.353+0000 7f7e205d5640 1 --2- 172.21.15.50:0/1243134677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e18100900 0x7f7e18197cf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7e080314e0 tx=0x7f7e080042e0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.353+0000 7f7e205d5640 1 -- 172.21.15.50:0/1243134677 shutdown_connections 2024-06-06T03:26:26.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.353+0000 7f7e205d5640 1 --2- 172.21.15.50:0/1243134677 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7e000a2c10 0x7f7e000a50d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.353+0000 7f7e205d5640 1 --2- 172.21.15.50:0/1243134677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e181024b0 0x7f7e1819f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.353+0000 7f7e205d5640 1 --2- 172.21.15.50:0/1243134677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e18101af0 0x7f7e18198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.353+0000 7f7e205d5640 1 --2- 172.21.15.50:0/1243134677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e18100900 0x7f7e18197cf0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.353+0000 7f7e205d5640 1 -- 172.21.15.50:0/1243134677 >> 172.21.15.50:0/1243134677 conn(0x7f7e180fbe90 msgr2=0x7f7e1806a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:26.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.353+0000 7f7e205d5640 1 -- 172.21.15.50:0/1243134677 shutdown_connections 2024-06-06T03:26:26.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.353+0000 7f7e205d5640 1 -- 172.21.15.50:0/1243134677 wait complete. 2024-06-06T03:26:26.363 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-06T03:26:26.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.472+0000 7f6037d68640 1 -- 172.21.15.50:0/3720272576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6030101af0 msgr2=0x7f6030101f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:26.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.472+0000 7f6037d68640 1 --2- 172.21.15.50:0/3720272576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6030101af0 0x7f6030101f70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6020009900 tx=0x7f602002a410 comp rx=0 tx=0).stop 2024-06-06T03:26:26.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.472+0000 7f6037d68640 1 -- 172.21.15.50:0/3720272576 shutdown_connections 2024-06-06T03:26:26.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.472+0000 7f6037d68640 1 --2- 172.21.15.50:0/3720272576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6030101af0 0x7f6030101f70 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.472+0000 7f6037d68640 1 --2- 172.21.15.50:0/3720272576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60301024b0 0x7f6030108d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.472+0000 7f6037d68640 1 --2- 172.21.15.50:0/3720272576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6030100900 0x7f6030100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.472+0000 7f6037d68640 1 -- 172.21.15.50:0/3720272576 >> 172.21.15.50:0/3720272576 conn(0x7f60300fbe90 msgr2=0x7f60300fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:26.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.472+0000 7f6037d68640 1 -- 172.21.15.50:0/3720272576 shutdown_connections 2024-06-06T03:26:26.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.472+0000 7f6037d68640 1 -- 172.21.15.50:0/3720272576 wait complete. 2024-06-06T03:26:26.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.472+0000 7f6037d68640 1 Processor -- start 2024-06-06T03:26:26.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.472+0000 7f6037d68640 1 -- start start 2024-06-06T03:26:26.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.473+0000 7f6037d68640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6030100900 0x7f6030104890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:26.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.473+0000 7f6037d68640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6030101af0 0x7f6030102ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:26.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.473+0000 7f6037d68640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60301024b0 0x7f6030103410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:26.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.473+0000 7f6037d68640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f603010c490 con 0x7f60301024b0 2024-06-06T03:26:26.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.473+0000 7f6037d68640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f603010c310 con 0x7f6030100900 2024-06-06T03:26:26.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.473+0000 7f6037d68640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f603010c610 con 0x7f6030101af0 2024-06-06T03:26:26.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.473+0000 7f6036305640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60301024b0 0x7f6030103410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:26.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.473+0000 7f6036305640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60301024b0 0x7f6030103410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59454/0 (socket says 172.21.15.50:59454) 2024-06-06T03:26:26.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.473+0000 7f6036305640 1 -- 172.21.15.50:0/2523315355 learned_addr learned my addr 172.21.15.50:0/2523315355 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:26.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.473+0000 7f6035b04640 1 --2- 172.21.15.50:0/2523315355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6030100900 0x7f6030104890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:26.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.473+0000 7f6035303640 1 --2- 172.21.15.50:0/2523315355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6030101af0 0x7f6030102ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:26.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.473+0000 7f6036305640 1 -- 172.21.15.50:0/2523315355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6030101af0 msgr2=0x7f6030102ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:26.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.473+0000 7f6036305640 1 --2- 172.21.15.50:0/2523315355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6030101af0 0x7f6030102ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.473+0000 7f6036305640 1 -- 172.21.15.50:0/2523315355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6030100900 msgr2=0x7f6030104890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:26.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.473+0000 7f6036305640 1 --2- 172.21.15.50:0/2523315355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6030100900 0x7f6030104890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.473+0000 7f6036305640 1 -- 172.21.15.50:0/2523315355 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6030103ca0 con 0x7f60301024b0 2024-06-06T03:26:26.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.473+0000 7f6035b04640 1 --2- 172.21.15.50:0/2523315355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6030100900 0x7f6030104890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:26:26.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.473+0000 7f6036305640 1 --2- 172.21.15.50:0/2523315355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60301024b0 0x7f6030103410 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f602800b970 tx=0x7f602800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:26.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.473+0000 7f6026ffd640 1 -- 172.21.15.50:0/2523315355 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6028019070 con 0x7f60301024b0 2024-06-06T03:26:26.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.473+0000 7f6026ffd640 1 -- 172.21.15.50:0/2523315355 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6028014440 con 0x7f60301024b0 2024-06-06T03:26:26.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.473+0000 7f6037d68640 1 -- 172.21.15.50:0/2523315355 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60301a1e00 con 0x7f60301024b0 2024-06-06T03:26:26.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.473+0000 7f6026ffd640 1 -- 172.21.15.50:0/2523315355 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60280075d0 con 0x7f60301024b0 2024-06-06T03:26:26.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.473+0000 7f6037d68640 1 -- 172.21.15.50:0/2523315355 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60301a2260 con 0x7f60301024b0 2024-06-06T03:26:26.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.475+0000 7f6037d68640 1 -- 172.21.15.50:0/2523315355 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60301a2580 con 0x7f60301024b0 2024-06-06T03:26:26.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.476+0000 7f6026ffd640 1 -- 172.21.15.50:0/2523315355 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f602801c070 con 0x7f60301024b0 2024-06-06T03:26:26.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.476+0000 7f6026ffd640 1 --2- 172.21.15.50:0/2523315355 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f601c0a2b90 0x7f601c0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:26.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.477+0000 7f6035b04640 1 --2- 172.21.15.50:0/2523315355 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f601c0a2b90 0x7f601c0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:26.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.477+0000 7f6026ffd640 1 -- 172.21.15.50:0/2523315355 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f60280ceeb0 con 0x7f60301024b0 2024-06-06T03:26:26.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.477+0000 7f6035b04640 1 --2- 172.21.15.50:0/2523315355 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f601c0a2b90 0x7f601c0a5050 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f602c005d00 tx=0x7f602c005ef0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:26.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.480+0000 7f6026ffd640 1 -- 172.21.15.50:0/2523315355 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f60280fd850 con 0x7f60301024b0 2024-06-06T03:26:26.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.665+0000 7f6037d68640 1 -- 172.21.15.50:0/2523315355 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f60301a2910 con 0x7f60301024b0 2024-06-06T03:26:26.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.666+0000 7f6026ffd640 1 -- 172.21.15.50:0/2523315355 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v99) ==== 104+0+11 (secure 0 0 0) 0x7f602809ba90 con 0x7f60301024b0 2024-06-06T03:26:26.665 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-06-06T03:26:26.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.668+0000 7f6037d68640 1 -- 172.21.15.50:0/2523315355 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f601c0a2b90 msgr2=0x7f601c0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:26.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.668+0000 7f6037d68640 1 --2- 172.21.15.50:0/2523315355 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f601c0a2b90 0x7f601c0a5050 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f602c005d00 tx=0x7f602c005ef0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.668+0000 7f6037d68640 1 -- 172.21.15.50:0/2523315355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60301024b0 msgr2=0x7f6030103410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:26.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.668+0000 7f6037d68640 1 --2- 172.21.15.50:0/2523315355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60301024b0 0x7f6030103410 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f602800b970 tx=0x7f602800be30 comp rx=0 tx=0).stop 2024-06-06T03:26:26.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.668+0000 7f6037d68640 1 -- 172.21.15.50:0/2523315355 shutdown_connections 2024-06-06T03:26:26.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.668+0000 7f6037d68640 1 --2- 172.21.15.50:0/2523315355 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f601c0a2b90 0x7f601c0a5050 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.668+0000 7f6037d68640 1 --2- 172.21.15.50:0/2523315355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60301024b0 0x7f6030103410 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.668+0000 7f6037d68640 1 --2- 172.21.15.50:0/2523315355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6030101af0 0x7f6030102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.668+0000 7f6037d68640 1 --2- 172.21.15.50:0/2523315355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6030100900 0x7f6030104890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.668+0000 7f6037d68640 1 -- 172.21.15.50:0/2523315355 >> 172.21.15.50:0/2523315355 conn(0x7f60300fbe90 msgr2=0x7f603006a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:26.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.668+0000 7f6037d68640 1 -- 172.21.15.50:0/2523315355 shutdown_connections 2024-06-06T03:26:26.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.668+0000 7f6037d68640 1 -- 172.21.15.50:0/2523315355 wait complete. 2024-06-06T03:26:26.678 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-06T03:26:26.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.786+0000 7fe48daee640 1 -- 172.21.15.50:0/2814905671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe488102480 msgr2=0x7fe488104870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:26.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.786+0000 7fe48daee640 1 --2- 172.21.15.50:0/2814905671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe488102480 0x7fe488104870 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe478009900 tx=0x7fe47802a410 comp rx=0 tx=0).stop 2024-06-06T03:26:26.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.786+0000 7fe48daee640 1 -- 172.21.15.50:0/2814905671 shutdown_connections 2024-06-06T03:26:26.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.786+0000 7fe48daee640 1 --2- 172.21.15.50:0/2814905671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe4881076e0 0x7fe488109b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.786+0000 7fe48daee640 1 --2- 172.21.15.50:0/2814905671 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe488104db0 0x7fe4881071a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.786+0000 7fe48daee640 1 --2- 172.21.15.50:0/2814905671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe488102480 0x7fe488104870 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.786+0000 7fe48daee640 1 -- 172.21.15.50:0/2814905671 >> 172.21.15.50:0/2814905671 conn(0x7fe4880fbe90 msgr2=0x7fe4880fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:26.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.786+0000 7fe48daee640 1 -- 172.21.15.50:0/2814905671 shutdown_connections 2024-06-06T03:26:26.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.786+0000 7fe48daee640 1 -- 172.21.15.50:0/2814905671 wait complete. 2024-06-06T03:26:26.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.787+0000 7fe48daee640 1 Processor -- start 2024-06-06T03:26:26.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.787+0000 7fe48daee640 1 -- start start 2024-06-06T03:26:26.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.787+0000 7fe48daee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe488102480 0x7fe488197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:26.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.787+0000 7fe48daee640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe488104db0 0x7fe488198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:26.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.787+0000 7fe48daee640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4881076e0 0x7fe48819f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:26.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.787+0000 7fe48daee640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe48810d560 con 0x7fe4881076e0 2024-06-06T03:26:26.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.787+0000 7fe48daee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe48810d3e0 con 0x7fe488102480 2024-06-06T03:26:26.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.787+0000 7fe48daee640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe48810d6e0 con 0x7fe488104db0 2024-06-06T03:26:26.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.787+0000 7fe487fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4881076e0 0x7fe48819f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:26.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.788+0000 7fe487fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4881076e0 0x7fe48819f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59470/0 (socket says 172.21.15.50:59470) 2024-06-06T03:26:26.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.788+0000 7fe487fff640 1 -- 172.21.15.50:0/467647283 learned_addr learned my addr 172.21.15.50:0/467647283 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:26.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.788+0000 7fe4877fe640 1 --2- 172.21.15.50:0/467647283 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe488102480 0x7fe488197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:26.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.788+0000 7fe486ffd640 1 --2- 172.21.15.50:0/467647283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe488104db0 0x7fe488198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:26.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.788+0000 7fe487fff640 1 -- 172.21.15.50:0/467647283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe488104db0 msgr2=0x7fe488198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:26.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.788+0000 7fe487fff640 1 --2- 172.21.15.50:0/467647283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe488104db0 0x7fe488198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.788+0000 7fe487fff640 1 -- 172.21.15.50:0/467647283 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe488102480 msgr2=0x7fe488197cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:26.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.788+0000 7fe487fff640 1 --2- 172.21.15.50:0/467647283 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe488102480 0x7fe488197cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.788+0000 7fe487fff640 1 -- 172.21.15.50:0/467647283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe48819f900 con 0x7fe4881076e0 2024-06-06T03:26:26.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.788+0000 7fe487fff640 1 --2- 172.21.15.50:0/467647283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4881076e0 0x7fe48819f260 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe48000eaa0 tx=0x7fe48000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:26.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.788+0000 7fe484ff9640 1 -- 172.21.15.50:0/467647283 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe48000cdb0 con 0x7fe4881076e0 2024-06-06T03:26:26.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.788+0000 7fe484ff9640 1 -- 172.21.15.50:0/467647283 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe480005020 con 0x7fe4881076e0 2024-06-06T03:26:26.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.788+0000 7fe48daee640 1 -- 172.21.15.50:0/467647283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe48819fbf0 con 0x7fe4881076e0 2024-06-06T03:26:26.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.788+0000 7fe484ff9640 1 -- 172.21.15.50:0/467647283 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4800116d0 con 0x7fe4881076e0 2024-06-06T03:26:26.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.788+0000 7fe48daee640 1 -- 172.21.15.50:0/467647283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4881a0140 con 0x7fe4881076e0 2024-06-06T03:26:26.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.789+0000 7fe48daee640 1 -- 172.21.15.50:0/467647283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4880fd980 con 0x7fe4881076e0 2024-06-06T03:26:26.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.791+0000 7fe484ff9640 1 -- 172.21.15.50:0/467647283 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe4800051d0 con 0x7fe4881076e0 2024-06-06T03:26:26.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.791+0000 7fe484ff9640 1 --2- 172.21.15.50:0/467647283 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe4700a2c10 0x7fe4700a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:26.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.791+0000 7fe484ff9640 1 -- 172.21.15.50:0/467647283 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fe4800cf930 con 0x7fe4881076e0 2024-06-06T03:26:26.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.791+0000 7fe4877fe640 1 --2- 172.21.15.50:0/467647283 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe4700a2c10 0x7fe4700a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:26.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.792+0000 7fe4877fe640 1 --2- 172.21.15.50:0/467647283 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe4700a2c10 0x7fe4700a50d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe4881991c0 tx=0x7fe478000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:26.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.795+0000 7fe484ff9640 1 -- 172.21.15.50:0/467647283 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe480016030 con 0x7fe4881076e0 2024-06-06T03:26:26.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:26 smithi122 ceph-mon[35759]: pgmap v425: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 85 B/s wr, 7 op/s 2024-06-06T03:26:26.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:26 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/3558173047' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-06-06T03:26:26.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:26 smithi122 ceph-mon[35759]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:26:26.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:26 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/1901170143' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:26:26.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:26 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/1243134677' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-06T03:26:26.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.978+0000 7fe48daee640 1 -- 172.21.15.50:0/467647283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe48802d530 con 0x7fe4881076e0 2024-06-06T03:26:26.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.978+0000 7fe484ff9640 1 -- 172.21.15.50:0/467647283 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v99) ==== 100+0+11 (secure 0 0 0) 0x7fe48009bf40 con 0x7fe4881076e0 2024-06-06T03:26:26.977 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-06-06T03:26:26.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.980+0000 7fe48daee640 1 -- 172.21.15.50:0/467647283 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe4700a2c10 msgr2=0x7fe4700a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:26.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.980+0000 7fe48daee640 1 --2- 172.21.15.50:0/467647283 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe4700a2c10 0x7fe4700a50d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe4881991c0 tx=0x7fe478000bc0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.980+0000 7fe48daee640 1 -- 172.21.15.50:0/467647283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4881076e0 msgr2=0x7fe48819f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:26.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.980+0000 7fe48daee640 1 --2- 172.21.15.50:0/467647283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4881076e0 0x7fe48819f260 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe48000eaa0 tx=0x7fe48000ef60 comp rx=0 tx=0).stop 2024-06-06T03:26:26.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.980+0000 7fe48daee640 1 -- 172.21.15.50:0/467647283 shutdown_connections 2024-06-06T03:26:26.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.980+0000 7fe48daee640 1 --2- 172.21.15.50:0/467647283 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe4700a2c10 0x7fe4700a50d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.980+0000 7fe48daee640 1 --2- 172.21.15.50:0/467647283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4881076e0 0x7fe48819f260 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.980+0000 7fe48daee640 1 --2- 172.21.15.50:0/467647283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe488104db0 0x7fe488198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.980+0000 7fe48daee640 1 --2- 172.21.15.50:0/467647283 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe488102480 0x7fe488197cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:26.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.980+0000 7fe48daee640 1 -- 172.21.15.50:0/467647283 >> 172.21.15.50:0/467647283 conn(0x7fe4880fbe90 msgr2=0x7fe488102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:26.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.980+0000 7fe48daee640 1 -- 172.21.15.50:0/467647283 shutdown_connections 2024-06-06T03:26:26.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:26.980+0000 7fe48daee640 1 -- 172.21.15.50:0/467647283 wait complete. 2024-06-06T03:26:26.989 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:26 smithi050 ceph-mon[32421]: pgmap v425: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 85 B/s wr, 7 op/s 2024-06-06T03:26:26.989 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:26 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3558173047' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-06-06T03:26:26.989 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:26 smithi050 ceph-mon[32421]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:26:26.989 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:26 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1901170143' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:26:26.989 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:26 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1243134677' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-06T03:26:26.990 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-06-06T03:26:27.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.099+0000 7fd3665ed640 1 -- 172.21.15.50:0/755280233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd360101a00 msgr2=0x7fd360101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:27.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.099+0000 7fd3665ed640 1 --2- 172.21.15.50:0/755280233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd360101a00 0x7fd360101e20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd350009900 tx=0x7fd35002a410 comp rx=0 tx=0).stop 2024-06-06T03:26:27.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.099+0000 7fd3665ed640 1 -- 172.21.15.50:0/755280233 shutdown_connections 2024-06-06T03:26:27.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.099+0000 7fd3665ed640 1 --2- 172.21.15.50:0/755280233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3601035b0 0x7fd360109e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:27.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.099+0000 7fd3665ed640 1 --2- 172.21.15.50:0/755280233 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd360102bf0 0x7fd360103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:27.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.099+0000 7fd3665ed640 1 --2- 172.21.15.50:0/755280233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd360101a00 0x7fd360101e20 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:27.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.099+0000 7fd3665ed640 1 -- 172.21.15.50:0/755280233 >> 172.21.15.50:0/755280233 conn(0x7fd3600fcf70 msgr2=0x7fd3600ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:27.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.099+0000 7fd3665ed640 1 -- 172.21.15.50:0/755280233 shutdown_connections 2024-06-06T03:26:27.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.099+0000 7fd3665ed640 1 -- 172.21.15.50:0/755280233 wait complete. 2024-06-06T03:26:27.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.099+0000 7fd3665ed640 1 Processor -- start 2024-06-06T03:26:27.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.099+0000 7fd3665ed640 1 -- start start 2024-06-06T03:26:27.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.100+0000 7fd3665ed640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd360101a00 0x7fd360197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:27.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.100+0000 7fd3665ed640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd360102bf0 0x7fd360198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:27.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.100+0000 7fd3665ed640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3601035b0 0x7fd36019f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:27.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.100+0000 7fd3665ed640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd36010d580 con 0x7fd360102bf0 2024-06-06T03:26:27.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.100+0000 7fd3665ed640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd36010d400 con 0x7fd3601035b0 2024-06-06T03:26:27.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.100+0000 7fd3665ed640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd36010d700 con 0x7fd360101a00 2024-06-06T03:26:27.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.100+0000 7fd35f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd360102bf0 0x7fd360198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:27.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.100+0000 7fd35f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd360102bf0 0x7fd360198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59480/0 (socket says 172.21.15.50:59480) 2024-06-06T03:26:27.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.100+0000 7fd35f7fe640 1 -- 172.21.15.50:0/2250346932 learned_addr learned my addr 172.21.15.50:0/2250346932 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:27.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.100+0000 7fd364b8a640 1 --2- 172.21.15.50:0/2250346932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3601035b0 0x7fd36019f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:27.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.100+0000 7fd35ffff640 1 --2- 172.21.15.50:0/2250346932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd360101a00 0x7fd360197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:27.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.100+0000 7fd35f7fe640 1 -- 172.21.15.50:0/2250346932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd360101a00 msgr2=0x7fd360197cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:27.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.100+0000 7fd35f7fe640 1 --2- 172.21.15.50:0/2250346932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd360101a00 0x7fd360197cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:27.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.100+0000 7fd35f7fe640 1 -- 172.21.15.50:0/2250346932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3601035b0 msgr2=0x7fd36019f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:27.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.100+0000 7fd35f7fe640 1 --2- 172.21.15.50:0/2250346932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3601035b0 0x7fd36019f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:27.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.100+0000 7fd35f7fe640 1 -- 172.21.15.50:0/2250346932 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd36019f900 con 0x7fd360102bf0 2024-06-06T03:26:27.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.100+0000 7fd364b8a640 1 --2- 172.21.15.50:0/2250346932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3601035b0 0x7fd36019f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:26:27.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.100+0000 7fd35ffff640 1 --2- 172.21.15.50:0/2250346932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd360101a00 0x7fd360197cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:26:27.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.100+0000 7fd35f7fe640 1 --2- 172.21.15.50:0/2250346932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd360102bf0 0x7fd360198230 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd35400b4a0 tx=0x7fd35400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:27.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.101+0000 7fd35d7fa640 1 -- 172.21.15.50:0/2250346932 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd354014070 con 0x7fd360102bf0 2024-06-06T03:26:27.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.101+0000 7fd35d7fa640 1 -- 172.21.15.50:0/2250346932 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd354010ac0 con 0x7fd360102bf0 2024-06-06T03:26:27.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.101+0000 7fd3665ed640 1 -- 172.21.15.50:0/2250346932 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd36019fbf0 con 0x7fd360102bf0 2024-06-06T03:26:27.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.101+0000 7fd35d7fa640 1 -- 172.21.15.50:0/2250346932 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd354017c30 con 0x7fd360102bf0 2024-06-06T03:26:27.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.101+0000 7fd3665ed640 1 -- 172.21.15.50:0/2250346932 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3601a0140 con 0x7fd360102bf0 2024-06-06T03:26:27.103 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:26 smithi079 ceph-mon[35478]: pgmap v425: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 85 B/s wr, 7 op/s 2024-06-06T03:26:27.103 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:26 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/3558173047' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-06-06T03:26:27.103 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:26 smithi079 ceph-mon[35478]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:26:27.103 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:26 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/1901170143' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:26:27.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:26 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/1243134677' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-06T03:26:27.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.102+0000 7fd3665ed640 1 -- 172.21.15.50:0/2250346932 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd360108de0 con 0x7fd360102bf0 2024-06-06T03:26:27.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.103+0000 7fd35d7fa640 1 -- 172.21.15.50:0/2250346932 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd354017070 con 0x7fd360102bf0 2024-06-06T03:26:27.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.103+0000 7fd35d7fa640 1 --2- 172.21.15.50:0/2250346932 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd3480a2b90 0x7fd3480a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:27.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.104+0000 7fd35d7fa640 1 -- 172.21.15.50:0/2250346932 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fd3540cebd0 con 0x7fd360102bf0 2024-06-06T03:26:27.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.104+0000 7fd35ffff640 1 --2- 172.21.15.50:0/2250346932 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd3480a2b90 0x7fd3480a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:27.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.104+0000 7fd35ffff640 1 --2- 172.21.15.50:0/2250346932 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd3480a2b90 0x7fd3480a5050 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd350000c00 tx=0x7fd3500314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:27.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.107+0000 7fd35d7fa640 1 -- 172.21.15.50:0/2250346932 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd35409b7b0 con 0x7fd360102bf0 2024-06-06T03:26:27.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.291+0000 7fd3665ed640 1 -- 172.21.15.50:0/2250346932 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fd36002d530 con 0x7fd360102bf0 2024-06-06T03:26:27.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.291+0000 7fd35d7fa640 1 -- 172.21.15.50:0/2250346932 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v99) ==== 103+0+11 (secure 0 0 0) 0x7fd35409b0b0 con 0x7fd360102bf0 2024-06-06T03:26:27.290 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-06-06T03:26:27.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.293+0000 7fd3665ed640 1 -- 172.21.15.50:0/2250346932 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd3480a2b90 msgr2=0x7fd3480a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:27.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.293+0000 7fd3665ed640 1 --2- 172.21.15.50:0/2250346932 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd3480a2b90 0x7fd3480a5050 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd350000c00 tx=0x7fd3500314a0 comp rx=0 tx=0).stop 2024-06-06T03:26:27.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.293+0000 7fd3665ed640 1 -- 172.21.15.50:0/2250346932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd360102bf0 msgr2=0x7fd360198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:27.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.293+0000 7fd3665ed640 1 --2- 172.21.15.50:0/2250346932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd360102bf0 0x7fd360198230 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd35400b4a0 tx=0x7fd35400b960 comp rx=0 tx=0).stop 2024-06-06T03:26:27.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.293+0000 7fd3665ed640 1 -- 172.21.15.50:0/2250346932 shutdown_connections 2024-06-06T03:26:27.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.293+0000 7fd3665ed640 1 --2- 172.21.15.50:0/2250346932 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd3480a2b90 0x7fd3480a5050 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:27.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.293+0000 7fd3665ed640 1 --2- 172.21.15.50:0/2250346932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd360102bf0 0x7fd360198230 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:27.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.293+0000 7fd3665ed640 1 --2- 172.21.15.50:0/2250346932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3601035b0 0x7fd36019f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:27.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.293+0000 7fd3665ed640 1 --2- 172.21.15.50:0/2250346932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd360101a00 0x7fd360197cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:27.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.293+0000 7fd3665ed640 1 -- 172.21.15.50:0/2250346932 >> 172.21.15.50:0/2250346932 conn(0x7fd3600fcf70 msgr2=0x7fd360105fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:27.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.293+0000 7fd3665ed640 1 -- 172.21.15.50:0/2250346932 shutdown_connections 2024-06-06T03:26:27.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:27.293+0000 7fd3665ed640 1 -- 172.21.15.50:0/2250346932 wait complete. 2024-06-06T03:26:27.303 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-06-06T03:26:27.303 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T03:26:27.553 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:26:27.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:27 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/2523315355' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-06T03:26:27.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:27 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/467647283' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-06T03:26:27.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:27 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/2250346932' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-06T03:26:27.996 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:27 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/2523315355' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-06T03:26:27.997 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:27 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/467647283' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-06T03:26:27.997 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:27 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/2250346932' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-06T03:26:28.000 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:27 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/2523315355' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-06T03:26:28.000 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:27 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/467647283' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-06T03:26:28.000 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:27 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/2250346932' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-06T03:26:28.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:28 smithi122 ceph-mon[35759]: pgmap v426: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-06T03:26:28.942 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:28 smithi050 ceph-mon[32421]: pgmap v426: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-06T03:26:29.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:28 smithi079 ceph-mon[35478]: pgmap v426: 129 pgs: 129 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-06T03:26:29.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.306+0000 7f99b9162700 1 -- 172.21.15.50:0/2985071636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99b41024e0 msgr2=0x7f99b4102940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:29.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.306+0000 7f99b9162700 1 --2- 172.21.15.50:0/2985071636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99b41024e0 0x7f99b4102940 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f999c009990 tx=0x7f999c009ca0 comp rx=0 tx=0).stop 2024-06-06T03:26:29.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.306+0000 7f99b9162700 1 -- 172.21.15.50:0/2985071636 shutdown_connections 2024-06-06T03:26:29.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.306+0000 7f99b9162700 1 --2- 172.21.15.50:0/2985071636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99b4102e80 0x7f99b410f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:29.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.306+0000 7f99b9162700 1 --2- 172.21.15.50:0/2985071636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99b41084f0 0x7f99b41088d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:29.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.306+0000 7f99b9162700 1 --2- 172.21.15.50:0/2985071636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99b41024e0 0x7f99b4102940 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:29.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.306+0000 7f99b9162700 1 -- 172.21.15.50:0/2985071636 >> 172.21.15.50:0/2985071636 conn(0x7f99b4079530 msgr2=0x7f99b4079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:29.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.306+0000 7f99b9162700 1 -- 172.21.15.50:0/2985071636 shutdown_connections 2024-06-06T03:26:29.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.306+0000 7f99b9162700 1 -- 172.21.15.50:0/2985071636 wait complete. 2024-06-06T03:26:29.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.307+0000 7f99b9162700 1 Processor -- start 2024-06-06T03:26:29.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.307+0000 7f99b9162700 1 -- start start 2024-06-06T03:26:29.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.307+0000 7f99b9162700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99b41024e0 0x7f99b4074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:29.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.307+0000 7f99b9162700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99b4102e80 0x7f99b4074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:29.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.307+0000 7f99b9162700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99b41084f0 0x7f99b4075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:29.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.307+0000 7f99b9162700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f99b4112620 con 0x7f99b4102e80 2024-06-06T03:26:29.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.307+0000 7f99b9162700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f99b41124a0 con 0x7f99b41024e0 2024-06-06T03:26:29.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.307+0000 7f99b9162700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f99b41127a0 con 0x7f99b41084f0 2024-06-06T03:26:29.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.307+0000 7f99b259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99b4102e80 0x7f99b4074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:29.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.307+0000 7f99b259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99b4102e80 0x7f99b4074cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58168/0 (socket says 172.21.15.50:58168) 2024-06-06T03:26:29.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.307+0000 7f99b259c700 1 -- 172.21.15.50:0/12450449 learned_addr learned my addr 172.21.15.50:0/12450449 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:29.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.307+0000 7f99b2d9d700 1 --2- 172.21.15.50:0/12450449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99b41024e0 0x7f99b4074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:29.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.308+0000 7f99b359e700 1 --2- 172.21.15.50:0/12450449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99b41084f0 0x7f99b4075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:29.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.308+0000 7f99b259c700 1 -- 172.21.15.50:0/12450449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99b41084f0 msgr2=0x7f99b4075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:29.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.308+0000 7f99b259c700 1 --2- 172.21.15.50:0/12450449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99b41084f0 0x7f99b4075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:29.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.308+0000 7f99b259c700 1 -- 172.21.15.50:0/12450449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99b41024e0 msgr2=0x7f99b4074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:29.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.308+0000 7f99b259c700 1 --2- 172.21.15.50:0/12450449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99b41024e0 0x7f99b4074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:29.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.308+0000 7f99b259c700 1 -- 172.21.15.50:0/12450449 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b41a7080 con 0x7f99b4102e80 2024-06-06T03:26:29.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.308+0000 7f99b259c700 1 --2- 172.21.15.50:0/12450449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99b4102e80 0x7f99b4074cd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f999c000c00 tx=0x7f999c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:29.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.308+0000 7f99abfff700 1 -- 172.21.15.50:0/12450449 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c027070 con 0x7f99b4102e80 2024-06-06T03:26:29.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.308+0000 7f99b9162700 1 -- 172.21.15.50:0/12450449 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99b41a7310 con 0x7f99b4102e80 2024-06-06T03:26:29.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.308+0000 7f99abfff700 1 -- 172.21.15.50:0/12450449 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f999c022470 con 0x7f99b4102e80 2024-06-06T03:26:29.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.308+0000 7f99b9162700 1 -- 172.21.15.50:0/12450449 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99b41a77c0 con 0x7f99b4102e80 2024-06-06T03:26:29.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.308+0000 7f99abfff700 1 -- 172.21.15.50:0/12450449 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c017650 con 0x7f99b4102e80 2024-06-06T03:26:29.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.309+0000 7f99b9162700 1 -- 172.21.15.50:0/12450449 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99b4069180 con 0x7f99b4102e80 2024-06-06T03:26:29.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.310+0000 7f99abfff700 1 -- 172.21.15.50:0/12450449 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f999c02a070 con 0x7f99b4102e80 2024-06-06T03:26:29.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.311+0000 7f99abfff700 1 --2- 172.21.15.50:0/12450449 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f99a00a2ca0 0x7f99a00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:29.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.311+0000 7f99abfff700 1 -- 172.21.15.50:0/12450449 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f999c0d0650 con 0x7f99b4102e80 2024-06-06T03:26:29.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.311+0000 7f99b2d9d700 1 --2- 172.21.15.50:0/12450449 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f99a00a2ca0 0x7f99a00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:29.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.311+0000 7f99b2d9d700 1 --2- 172.21.15.50:0/12450449 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f99a00a2ca0 0x7f99a00a5160 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009550 tx=0x7f99a40091b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:29.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.314+0000 7f99abfff700 1 -- 172.21.15.50:0/12450449 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f999c013070 con 0x7f99b4102e80 2024-06-06T03:26:29.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.571+0000 7f99b9162700 1 -- 172.21.15.50:0/12450449 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99b402dca0 con 0x7f99b4102e80 2024-06-06T03:26:29.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.572+0000 7f99abfff700 1 -- 172.21.15.50:0/12450449 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11855 (secure 0 0 0) 0x7f999c09d260 con 0x7f99b4102e80 2024-06-06T03:26:29.571 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:26:29.571 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1667847852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1667847852},{"type":"v1","addr":"172.21.15.50:6835","nonce":1667847852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/239971838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":239971838},{"type":"v1","addr":"172.21.15.50:6837","nonce":239971838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/2188134216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2188134216},{"type":"v1","addr":"172.21.15.50:6839","nonce":2188134216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/632572420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":632572420},{"type":"v1","addr":"172.21.15.50:6841","nonce":632572420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/864537078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":864537078},{"type":"v1","addr":"172.21.15.79:6833","nonce":864537078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/279268898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":279268898},{"type":"v1","addr":"172.21.15.79:6835","nonce":279268898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T03:22:36.202061+0000","modified":"2024-06-06T03:26:24.959500+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24490,"mds_1":24472,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/57533154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":57533154},{"type":"v1","addr":"172.21.15.122:6833","nonce":57533154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/3286722213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3286722213},{"type":"v1","addr":"172.21.15.79:6837","nonce":3286722213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/768067336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":768067336},{"type":"v1","addr":"172.21.15.79:6839","nonce":768067336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.122:6835/2987597320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2987597320},{"type":"v1","addr":"172.21.15.122:6835","nonce":2987597320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":23,"addr":"172.21.15.122:6837/1604366318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1604366318},{"type":"v1","addr":"172.21.15.122:6837","nonce":1604366318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6839/4129732900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":4129732900},{"type":"v1","addr":"172.21.15.122:6839","nonce":4129732900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24466,24472,24490]},"id":1}]} 2024-06-06T03:26:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.574+0000 7f99b9162700 1 -- 172.21.15.50:0/12450449 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f99a00a2ca0 msgr2=0x7f99a00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.574+0000 7f99b9162700 1 --2- 172.21.15.50:0/12450449 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f99a00a2ca0 0x7f99a00a5160 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009550 tx=0x7f99a40091b0 comp rx=0 tx=0).stop 2024-06-06T03:26:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.574+0000 7f99b9162700 1 -- 172.21.15.50:0/12450449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99b4102e80 msgr2=0x7f99b4074cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.574+0000 7f99b9162700 1 --2- 172.21.15.50:0/12450449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99b4102e80 0x7f99b4074cd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f999c000c00 tx=0x7f999c0047b0 comp rx=0 tx=0).stop 2024-06-06T03:26:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.574+0000 7f99b9162700 1 -- 172.21.15.50:0/12450449 shutdown_connections 2024-06-06T03:26:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.574+0000 7f99b9162700 1 --2- 172.21.15.50:0/12450449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99b41084f0 0x7f99b4075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.574+0000 7f99b9162700 1 --2- 172.21.15.50:0/12450449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99b41024e0 0x7f99b4074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.574+0000 7f99b9162700 1 --2- 172.21.15.50:0/12450449 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f99a00a2ca0 0x7f99a00a5160 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.574+0000 7f99b9162700 1 --2- 172.21.15.50:0/12450449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99b4102e80 0x7f99b4074cd0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:29.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.574+0000 7f99b9162700 1 -- 172.21.15.50:0/12450449 >> 172.21.15.50:0/12450449 conn(0x7f99b4079530 msgr2=0x7f99b4100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:29.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.574+0000 7f99b9162700 1 -- 172.21.15.50:0/12450449 shutdown_connections 2024-06-06T03:26:29.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:29.574+0000 7f99b9162700 1 -- 172.21.15.50:0/12450449 wait complete. 2024-06-06T03:26:29.574 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 27 2024-06-06T03:26:29.884 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:29 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/12450449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:26:29.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:29 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/12450449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:26:30.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:29 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/12450449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:26:30.306 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-06-06T03:26:30.306 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-06-06T03:26:30.307 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-06T03:26:30.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.416+0000 7f273eb9e640 1 -- 172.21.15.50:0/3782259835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27381035c0 msgr2=0x7f2738109e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:30.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.416+0000 7f273eb9e640 1 --2- 172.21.15.50:0/3782259835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27381035c0 0x7f2738109e50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2730009ca0 tx=0x7f273002a8c0 comp rx=0 tx=0).stop 2024-06-06T03:26:30.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.416+0000 7f273eb9e640 1 -- 172.21.15.50:0/3782259835 shutdown_connections 2024-06-06T03:26:30.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.416+0000 7f273eb9e640 1 --2- 172.21.15.50:0/3782259835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27381035c0 0x7f2738109e50 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:30.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.416+0000 7f273eb9e640 1 --2- 172.21.15.50:0/3782259835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2738102c00 0x7f2738103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:30.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.417+0000 7f273eb9e640 1 --2- 172.21.15.50:0/3782259835 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2738101a10 0x7f2738101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:30.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.417+0000 7f273eb9e640 1 -- 172.21.15.50:0/3782259835 >> 172.21.15.50:0/3782259835 conn(0x7f27380fcfa0 msgr2=0x7f27380ff3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:30.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.417+0000 7f273eb9e640 1 -- 172.21.15.50:0/3782259835 shutdown_connections 2024-06-06T03:26:30.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.417+0000 7f273eb9e640 1 -- 172.21.15.50:0/3782259835 wait complete. 2024-06-06T03:26:30.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.417+0000 7f273eb9e640 1 Processor -- start 2024-06-06T03:26:30.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.417+0000 7f273eb9e640 1 -- start start 2024-06-06T03:26:30.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.417+0000 7f273eb9e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2738101a10 0x7f2738199d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:30.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.417+0000 7f273eb9e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2738102c00 0x7f273819a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:30.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.417+0000 7f273eb9e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27381035c0 0x7f27381a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:30.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.417+0000 7f273eb9e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f273810d520 con 0x7f2738102c00 2024-06-06T03:26:30.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.417+0000 7f273eb9e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f273810d3a0 con 0x7f2738101a10 2024-06-06T03:26:30.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.417+0000 7f273eb9e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f273810d6a0 con 0x7f27381035c0 2024-06-06T03:26:30.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.418+0000 7f2737fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2738102c00 0x7f273819a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:30.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.418+0000 7f2737fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2738102c00 0x7f273819a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58180/0 (socket says 172.21.15.50:58180) 2024-06-06T03:26:30.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.418+0000 7f273c93a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2738101a10 0x7f2738199d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:30.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.418+0000 7f2737fff640 1 -- 172.21.15.50:0/2016164318 learned_addr learned my addr 172.21.15.50:0/2016164318 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:30.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.418+0000 7f273d13b640 1 --2- 172.21.15.50:0/2016164318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27381035c0 0x7f27381a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:30.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.418+0000 7f2737fff640 1 -- 172.21.15.50:0/2016164318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27381035c0 msgr2=0x7f27381a1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:30.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.418+0000 7f2737fff640 1 --2- 172.21.15.50:0/2016164318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27381035c0 0x7f27381a1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:30.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.418+0000 7f2737fff640 1 -- 172.21.15.50:0/2016164318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2738101a10 msgr2=0x7f2738199d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:30.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.418+0000 7f2737fff640 1 --2- 172.21.15.50:0/2016164318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2738101a10 0x7f2738199d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:30.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.418+0000 7f2737fff640 1 -- 172.21.15.50:0/2016164318 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27381a1980 con 0x7f2738102c00 2024-06-06T03:26:30.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.418+0000 7f2737fff640 1 --2- 172.21.15.50:0/2016164318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2738102c00 0x7f273819a2a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f272400c920 tx=0x7f272400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:30.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.418+0000 7f2735ffb640 1 -- 172.21.15.50:0/2016164318 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2724007c70 con 0x7f2738102c00 2024-06-06T03:26:30.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.418+0000 7f2735ffb640 1 -- 172.21.15.50:0/2016164318 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2724007e10 con 0x7f2738102c00 2024-06-06T03:26:30.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.418+0000 7f273eb9e640 1 -- 172.21.15.50:0/2016164318 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27381a1c70 con 0x7f2738102c00 2024-06-06T03:26:30.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.418+0000 7f2735ffb640 1 -- 172.21.15.50:0/2016164318 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2724018820 con 0x7f2738102c00 2024-06-06T03:26:30.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.418+0000 7f273eb9e640 1 -- 172.21.15.50:0/2016164318 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27381a21c0 con 0x7f2738102c00 2024-06-06T03:26:30.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.419+0000 7f273eb9e640 1 -- 172.21.15.50:0/2016164318 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27381a2450 con 0x7f2738102c00 2024-06-06T03:26:30.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.421+0000 7f2735ffb640 1 -- 172.21.15.50:0/2016164318 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f27240189c0 con 0x7f2738102c00 2024-06-06T03:26:30.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.421+0000 7f2735ffb640 1 --2- 172.21.15.50:0/2016164318 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f27280a2c10 0x7f27280a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:30.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.421+0000 7f273c93a640 1 --2- 172.21.15.50:0/2016164318 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f27280a2c10 0x7f27280a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:30.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.421+0000 7f2735ffb640 1 -- 172.21.15.50:0/2016164318 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f27240cf3b0 con 0x7f2738102c00 2024-06-06T03:26:30.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.422+0000 7f273c93a640 1 --2- 172.21.15.50:0/2016164318 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f27280a2c10 0x7f27280a50d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f272c005fd0 tx=0x7f272c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:30.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.426+0000 7f2735ffb640 1 -- 172.21.15.50:0/2016164318 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2724014030 con 0x7f2738102c00 2024-06-06T03:26:30.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.609+0000 7f273eb9e640 1 -- 172.21.15.50:0/2016164318 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f27381a2620 con 0x7f27280a2c10 2024-06-06T03:26:30.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.619+0000 7f2735ffb640 1 -- 172.21.15.50:0/2016164318 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340748 (secure 0 0 0) 0x7f27381a2620 con 0x7f27280a2c10 2024-06-06T03:26:30.621 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:26:30.624 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-06-06T03:26:30.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.622+0000 7f273eb9e640 1 -- 172.21.15.50:0/2016164318 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f27280a2c10 msgr2=0x7f27280a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:30.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.622+0000 7f273eb9e640 1 --2- 172.21.15.50:0/2016164318 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f27280a2c10 0x7f27280a50d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f272c005fd0 tx=0x7f272c00b410 comp rx=0 tx=0).stop 2024-06-06T03:26:30.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.622+0000 7f273eb9e640 1 -- 172.21.15.50:0/2016164318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2738102c00 msgr2=0x7f273819a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:30.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.622+0000 7f273eb9e640 1 --2- 172.21.15.50:0/2016164318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2738102c00 0x7f273819a2a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f272400c920 tx=0x7f272400cde0 comp rx=0 tx=0).stop 2024-06-06T03:26:30.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.622+0000 7f273eb9e640 1 -- 172.21.15.50:0/2016164318 shutdown_connections 2024-06-06T03:26:30.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.622+0000 7f273eb9e640 1 --2- 172.21.15.50:0/2016164318 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f27280a2c10 0x7f27280a50d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:30.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.622+0000 7f273eb9e640 1 --2- 172.21.15.50:0/2016164318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2738102c00 0x7f273819a2a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:30.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.622+0000 7f273eb9e640 1 --2- 172.21.15.50:0/2016164318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27381035c0 0x7f27381a1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:30.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.622+0000 7f273eb9e640 1 --2- 172.21.15.50:0/2016164318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2738101a10 0x7f2738199d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:30.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.622+0000 7f273eb9e640 1 -- 172.21.15.50:0/2016164318 >> 172.21.15.50:0/2016164318 conn(0x7f27380fcfa0 msgr2=0x7f2738073bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:30.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.622+0000 7f273eb9e640 1 -- 172.21.15.50:0/2016164318 shutdown_connections 2024-06-06T03:26:30.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.622+0000 7f273eb9e640 1 -- 172.21.15.50:0/2016164318 wait complete. 2024-06-06T03:26:30.632 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":427,"stamp":"2024-06-06T03:26:29.401942+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662852,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":1202,"num_read_kb":724,"num_write":371,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":798,"ondisk_log_size":798,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":379120,"kb_used_data":13328,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124562704,"statfs":{"total":1151940427776,"available":1151552208896,"internally_reserved":0,"allocated":13647872,"data_stored":8800526,"data_compressed":498432,"data_compressed_allocated":675840,"data_compressed_original":2850816,"omap_allocated":19141,"internal_metadata":374453563},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5790,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":53,"num_write":11,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002990"},"pg_stats":[{"pgid":"3.3f","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.361304+0000","last_change":"2024-06-06T03:22:34.302364+0000","last_active":"2024-06-06T03:25:13.361304+0000","last_peered":"2024-06-06T03:25:13.361304+0000","last_clean":"2024-06-06T03:25:13.361304+0000","last_became_active":"2024-06-06T03:22:34.300403+0000","last_became_peered":"2024-06-06T03:22:34.300403+0000","last_unstale":"2024-06-06T03:25:13.361304+0000","last_undegraded":"2024-06-06T03:25:13.361304+0000","last_fullsized":"2024-06-06T03:25:13.361304+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:27:55.377346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"99'4","reported_seq":43,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.361468+0000","last_change":"2024-06-06T03:22:34.306188+0000","last_active":"2024-06-06T03:25:13.361468+0000","last_peered":"2024-06-06T03:25:13.361468+0000","last_clean":"2024-06-06T03:25:13.361468+0000","last_became_active":"2024-06-06T03:22:34.305705+0000","last_became_peered":"2024-06-06T03:22:34.305705+0000","last_unstale":"2024-06-06T03:25:13.361468+0000","last_undegraded":"2024-06-06T03:25:13.361468+0000","last_fullsized":"2024-06-06T03:25:13.361468+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:10:07.337989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369892+0000","last_change":"2024-06-06T03:22:34.303568+0000","last_active":"2024-06-06T03:25:13.369892+0000","last_peered":"2024-06-06T03:25:13.369892+0000","last_clean":"2024-06-06T03:25:13.369892+0000","last_became_active":"2024-06-06T03:22:34.303194+0000","last_became_peered":"2024-06-06T03:22:34.303194+0000","last_unstale":"2024-06-06T03:25:13.369892+0000","last_undegraded":"2024-06-06T03:25:13.369892+0000","last_fullsized":"2024-06-06T03:25:13.369892+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:40:46.387476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.356411+0000","last_change":"2024-06-06T03:22:34.303896+0000","last_active":"2024-06-06T03:25:13.356411+0000","last_peered":"2024-06-06T03:25:13.356411+0000","last_clean":"2024-06-06T03:25:13.356411+0000","last_became_active":"2024-06-06T03:22:34.303568+0000","last_became_peered":"2024-06-06T03:22:34.303568+0000","last_unstale":"2024-06-06T03:25:13.356411+0000","last_undegraded":"2024-06-06T03:25:13.356411+0000","last_fullsized":"2024-06-06T03:25:13.356411+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:24:20.160115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"99'4","reported_seq":43,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.358644+0000","last_change":"2024-06-06T03:22:34.289868+0000","last_active":"2024-06-06T03:25:13.358644+0000","last_peered":"2024-06-06T03:25:13.358644+0000","last_clean":"2024-06-06T03:25:13.358644+0000","last_became_active":"2024-06-06T03:22:34.289485+0000","last_became_peered":"2024-06-06T03:22:34.289485+0000","last_unstale":"2024-06-06T03:25:13.358644+0000","last_undegraded":"2024-06-06T03:25:13.358644+0000","last_fullsized":"2024-06-06T03:25:13.358644+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:28:58.226092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.347487+0000","last_change":"2024-06-06T03:22:34.304643+0000","last_active":"2024-06-06T03:25:13.347487+0000","last_peered":"2024-06-06T03:25:13.347487+0000","last_clean":"2024-06-06T03:25:13.347487+0000","last_became_active":"2024-06-06T03:22:34.303342+0000","last_became_peered":"2024-06-06T03:22:34.303342+0000","last_unstale":"2024-06-06T03:25:13.347487+0000","last_undegraded":"2024-06-06T03:25:13.347487+0000","last_fullsized":"2024-06-06T03:25:13.347487+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:28:27.838518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.368466+0000","last_change":"2024-06-06T03:22:34.304958+0000","last_active":"2024-06-06T03:25:13.368466+0000","last_peered":"2024-06-06T03:25:13.368466+0000","last_clean":"2024-06-06T03:25:13.368466+0000","last_became_active":"2024-06-06T03:22:34.304582+0000","last_became_peered":"2024-06-06T03:22:34.304582+0000","last_unstale":"2024-06-06T03:25:13.368466+0000","last_undegraded":"2024-06-06T03:25:13.368466+0000","last_fullsized":"2024-06-06T03:25:13.368466+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:08:56.304446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371907+0000","last_change":"2024-06-06T03:22:34.299883+0000","last_active":"2024-06-06T03:25:13.371907+0000","last_peered":"2024-06-06T03:25:13.371907+0000","last_clean":"2024-06-06T03:25:13.371907+0000","last_became_active":"2024-06-06T03:22:34.299568+0000","last_became_peered":"2024-06-06T03:22:34.299568+0000","last_unstale":"2024-06-06T03:25:13.371907+0000","last_undegraded":"2024-06-06T03:25:13.371907+0000","last_fullsized":"2024-06-06T03:25:13.371907+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:23:32.479592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369788+0000","last_change":"2024-06-06T03:22:34.303157+0000","last_active":"2024-06-06T03:25:13.369788+0000","last_peered":"2024-06-06T03:25:13.369788+0000","last_clean":"2024-06-06T03:25:13.369788+0000","last_became_active":"2024-06-06T03:22:34.302332+0000","last_became_peered":"2024-06-06T03:22:34.302332+0000","last_unstale":"2024-06-06T03:25:13.369788+0000","last_undegraded":"2024-06-06T03:25:13.369788+0000","last_fullsized":"2024-06-06T03:25:13.369788+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:27:32.420058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"99'16","reported_seq":61,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.352791+0000","last_change":"2024-06-06T03:23:14.517357+0000","last_active":"2024-06-06T03:25:13.352791+0000","last_peered":"2024-06-06T03:25:13.352791+0000","last_clean":"2024-06-06T03:25:13.352791+0000","last_became_active":"2024-06-06T03:23:14.516932+0000","last_became_peered":"2024-06-06T03:23:14.516932+0000","last_unstale":"2024-06-06T03:25:13.352791+0000","last_undegraded":"2024-06-06T03:25:13.352791+0000","last_fullsized":"2024-06-06T03:25:13.352791+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:23:43.907192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369989+0000","last_change":"2024-06-06T03:22:34.310010+0000","last_active":"2024-06-06T03:25:13.369989+0000","last_peered":"2024-06-06T03:25:13.369989+0000","last_clean":"2024-06-06T03:25:13.369989+0000","last_became_active":"2024-06-06T03:22:34.309636+0000","last_became_peered":"2024-06-06T03:22:34.309636+0000","last_unstale":"2024-06-06T03:25:13.369989+0000","last_undegraded":"2024-06-06T03:25:13.369989+0000","last_fullsized":"2024-06-06T03:25:13.369989+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:35:53.745050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.351414+0000","last_change":"2024-06-06T03:22:34.311364+0000","last_active":"2024-06-06T03:25:13.351414+0000","last_peered":"2024-06-06T03:25:13.351414+0000","last_clean":"2024-06-06T03:25:13.351414+0000","last_became_active":"2024-06-06T03:22:34.311003+0000","last_became_peered":"2024-06-06T03:22:34.311003+0000","last_unstale":"2024-06-06T03:25:13.351414+0000","last_undegraded":"2024-06-06T03:25:13.351414+0000","last_fullsized":"2024-06-06T03:25:13.351414+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:35:32.460362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.372924+0000","last_change":"2024-06-06T03:22:34.302843+0000","last_active":"2024-06-06T03:25:13.372924+0000","last_peered":"2024-06-06T03:25:13.372924+0000","last_clean":"2024-06-06T03:25:13.372924+0000","last_became_active":"2024-06-06T03:22:34.302581+0000","last_became_peered":"2024-06-06T03:22:34.302581+0000","last_unstale":"2024-06-06T03:25:13.372924+0000","last_undegraded":"2024-06-06T03:25:13.372924+0000","last_fullsized":"2024-06-06T03:25:13.372924+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:56:14.178848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.362752+0000","last_change":"2024-06-06T03:22:34.305792+0000","last_active":"2024-06-06T03:25:13.362752+0000","last_peered":"2024-06-06T03:25:13.362752+0000","last_clean":"2024-06-06T03:25:13.362752+0000","last_became_active":"2024-06-06T03:22:34.305389+0000","last_became_peered":"2024-06-06T03:22:34.305389+0000","last_unstale":"2024-06-06T03:25:13.362752+0000","last_undegraded":"2024-06-06T03:25:13.362752+0000","last_fullsized":"2024-06-06T03:25:13.362752+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:17:05.992382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369254+0000","last_change":"2024-06-06T03:22:34.298396+0000","last_active":"2024-06-06T03:25:13.369254+0000","last_peered":"2024-06-06T03:25:13.369254+0000","last_clean":"2024-06-06T03:25:13.369254+0000","last_became_active":"2024-06-06T03:22:34.297697+0000","last_became_peered":"2024-06-06T03:22:34.297697+0000","last_unstale":"2024-06-06T03:25:13.369254+0000","last_undegraded":"2024-06-06T03:25:13.369254+0000","last_fullsized":"2024-06-06T03:25:13.369254+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:24:07.143699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369399+0000","last_change":"2024-06-06T03:22:34.312801+0000","last_active":"2024-06-06T03:25:13.369399+0000","last_peered":"2024-06-06T03:25:13.369399+0000","last_clean":"2024-06-06T03:25:13.369399+0000","last_became_active":"2024-06-06T03:22:34.312206+0000","last_became_peered":"2024-06-06T03:22:34.312206+0000","last_unstale":"2024-06-06T03:25:13.369399+0000","last_undegraded":"2024-06-06T03:25:13.369399+0000","last_fullsized":"2024-06-06T03:25:13.369399+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:31:41.286548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.364965+0000","last_change":"2024-06-06T03:22:34.303527+0000","last_active":"2024-06-06T03:25:13.364965+0000","last_peered":"2024-06-06T03:25:13.364965+0000","last_clean":"2024-06-06T03:25:13.364965+0000","last_became_active":"2024-06-06T03:22:34.302919+0000","last_became_peered":"2024-06-06T03:22:34.302919+0000","last_unstale":"2024-06-06T03:25:13.364965+0000","last_undegraded":"2024-06-06T03:25:13.364965+0000","last_fullsized":"2024-06-06T03:25:13.364965+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:41:44.128543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.356298+0000","last_change":"2024-06-06T03:22:34.304801+0000","last_active":"2024-06-06T03:25:13.356298+0000","last_peered":"2024-06-06T03:25:13.356298+0000","last_clean":"2024-06-06T03:25:13.356298+0000","last_became_active":"2024-06-06T03:22:34.304463+0000","last_became_peered":"2024-06-06T03:22:34.304463+0000","last_unstale":"2024-06-06T03:25:13.356298+0000","last_undegraded":"2024-06-06T03:25:13.356298+0000","last_fullsized":"2024-06-06T03:25:13.356298+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:28:22.789816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.365052+0000","last_change":"2024-06-06T03:22:34.290053+0000","last_active":"2024-06-06T03:25:13.365052+0000","last_peered":"2024-06-06T03:25:13.365052+0000","last_clean":"2024-06-06T03:25:13.365052+0000","last_became_active":"2024-06-06T03:22:34.289712+0000","last_became_peered":"2024-06-06T03:22:34.289712+0000","last_unstale":"2024-06-06T03:25:13.365052+0000","last_undegraded":"2024-06-06T03:25:13.365052+0000","last_fullsized":"2024-06-06T03:25:13.365052+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:12:02.296431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973398+0000","last_change":"2024-06-06T03:22:44.421722+0000","last_active":"2024-06-06T03:24:14.973398+0000","last_peered":"2024-06-06T03:24:14.973398+0000","last_clean":"2024-06-06T03:24:14.973398+0000","last_became_active":"2024-06-06T03:22:44.421215+0000","last_became_peered":"2024-06-06T03:22:44.421215+0000","last_unstale":"2024-06-06T03:24:14.973398+0000","last_undegraded":"2024-06-06T03:24:14.973398+0000","last_fullsized":"2024-06-06T03:24:14.973398+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:22:59.749839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"97'9","reported_seq":55,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.379751+0000","last_change":"2024-06-06T03:22:31.053826+0000","last_active":"2024-06-06T03:24:15.379751+0000","last_peered":"2024-06-06T03:24:15.379751+0000","last_clean":"2024-06-06T03:24:15.379751+0000","last_became_active":"2024-06-06T03:22:31.053537+0000","last_became_peered":"2024-06-06T03:22:31.053537+0000","last_unstale":"2024-06-06T03:24:15.379751+0000","last_undegraded":"2024-06-06T03:24:15.379751+0000","last_fullsized":"2024-06-06T03:24:15.379751+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:18:52.967104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371315+0000","last_change":"2024-06-06T03:22:34.291554+0000","last_active":"2024-06-06T03:25:13.371315+0000","last_peered":"2024-06-06T03:25:13.371315+0000","last_clean":"2024-06-06T03:25:13.371315+0000","last_became_active":"2024-06-06T03:22:34.290600+0000","last_became_peered":"2024-06-06T03:22:34.290600+0000","last_unstale":"2024-06-06T03:25:13.371315+0000","last_undegraded":"2024-06-06T03:25:13.371315+0000","last_fullsized":"2024-06-06T03:25:13.371315+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:03:32.860134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163376+0000","last_change":"2024-06-06T03:22:44.424337+0000","last_active":"2024-06-06T03:24:15.163376+0000","last_peered":"2024-06-06T03:24:15.163376+0000","last_clean":"2024-06-06T03:24:15.163376+0000","last_became_active":"2024-06-06T03:22:44.423919+0000","last_became_peered":"2024-06-06T03:22:44.423919+0000","last_unstale":"2024-06-06T03:24:15.163376+0000","last_undegraded":"2024-06-06T03:24:15.163376+0000","last_fullsized":"2024-06-06T03:24:15.163376+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:34:32.801117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"97'2","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.379810+0000","last_change":"2024-06-06T03:22:31.242326+0000","last_active":"2024-06-06T03:24:15.379810+0000","last_peered":"2024-06-06T03:24:15.379810+0000","last_clean":"2024-06-06T03:24:15.379810+0000","last_became_active":"2024-06-06T03:22:31.241960+0000","last_became_peered":"2024-06-06T03:22:31.241960+0000","last_unstale":"2024-06-06T03:24:15.379810+0000","last_undegraded":"2024-06-06T03:24:15.379810+0000","last_fullsized":"2024-06-06T03:24:15.379810+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:19:57.820119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369698+0000","last_change":"2024-06-06T03:22:34.303438+0000","last_active":"2024-06-06T03:25:13.369698+0000","last_peered":"2024-06-06T03:25:13.369698+0000","last_clean":"2024-06-06T03:25:13.369698+0000","last_became_active":"2024-06-06T03:22:34.302057+0000","last_became_peered":"2024-06-06T03:22:34.302057+0000","last_unstale":"2024-06-06T03:25:13.369698+0000","last_undegraded":"2024-06-06T03:25:13.369698+0000","last_fullsized":"2024-06-06T03:25:13.369698+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:52:20.508656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163601+0000","last_change":"2024-06-06T03:22:44.424732+0000","last_active":"2024-06-06T03:24:15.163601+0000","last_peered":"2024-06-06T03:24:15.163601+0000","last_clean":"2024-06-06T03:24:15.163601+0000","last_became_active":"2024-06-06T03:22:44.423906+0000","last_became_peered":"2024-06-06T03:22:44.423906+0000","last_unstale":"2024-06-06T03:24:15.163601+0000","last_undegraded":"2024-06-06T03:24:15.163601+0000","last_fullsized":"2024-06-06T03:24:15.163601+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:45:04.344747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"97'4","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700231+0000","last_change":"2024-06-06T03:22:31.057003+0000","last_active":"2024-06-06T03:24:14.700231+0000","last_peered":"2024-06-06T03:24:14.700231+0000","last_clean":"2024-06-06T03:24:14.700231+0000","last_became_active":"2024-06-06T03:22:31.056660+0000","last_became_peered":"2024-06-06T03:22:31.056660+0000","last_unstale":"2024-06-06T03:24:14.700231+0000","last_undegraded":"2024-06-06T03:24:14.700231+0000","last_fullsized":"2024-06-06T03:24:14.700231+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:44:16.726749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.367434+0000","last_change":"2024-06-06T03:22:34.306196+0000","last_active":"2024-06-06T03:25:13.367434+0000","last_peered":"2024-06-06T03:25:13.367434+0000","last_clean":"2024-06-06T03:25:13.367434+0000","last_became_active":"2024-06-06T03:22:34.304962+0000","last_became_peered":"2024-06-06T03:22:34.304962+0000","last_unstale":"2024-06-06T03:25:13.367434+0000","last_undegraded":"2024-06-06T03:25:13.367434+0000","last_fullsized":"2024-06-06T03:25:13.367434+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:25:04.990371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163359+0000","last_change":"2024-06-06T03:22:44.419624+0000","last_active":"2024-06-06T03:24:15.163359+0000","last_peered":"2024-06-06T03:24:15.163359+0000","last_clean":"2024-06-06T03:24:15.163359+0000","last_became_active":"2024-06-06T03:22:44.418713+0000","last_became_peered":"2024-06-06T03:22:44.418713+0000","last_unstale":"2024-06-06T03:24:15.163359+0000","last_undegraded":"2024-06-06T03:24:15.163359+0000","last_fullsized":"2024-06-06T03:24:15.163359+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:04:54.010364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'2","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700029+0000","last_change":"2024-06-06T03:22:31.059332+0000","last_active":"2024-06-06T03:24:14.700029+0000","last_peered":"2024-06-06T03:24:14.700029+0000","last_clean":"2024-06-06T03:24:14.700029+0000","last_became_active":"2024-06-06T03:22:31.058478+0000","last_became_peered":"2024-06-06T03:22:31.058478+0000","last_unstale":"2024-06-06T03:24:14.700029+0000","last_undegraded":"2024-06-06T03:24:14.700029+0000","last_fullsized":"2024-06-06T03:24:14.700029+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:24:46.452708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"99'15","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.373335+0000","last_change":"2024-06-06T03:22:34.301650+0000","last_active":"2024-06-06T03:25:13.373335+0000","last_peered":"2024-06-06T03:25:13.373335+0000","last_clean":"2024-06-06T03:25:13.373335+0000","last_became_active":"2024-06-06T03:22:34.301220+0000","last_became_peered":"2024-06-06T03:22:34.301220+0000","last_unstale":"2024-06-06T03:25:13.373335+0000","last_undegraded":"2024-06-06T03:25:13.373335+0000","last_fullsized":"2024-06-06T03:25:13.373335+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:43:07.396971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973578+0000","last_change":"2024-06-06T03:22:44.413406+0000","last_active":"2024-06-06T03:24:14.973578+0000","last_peered":"2024-06-06T03:24:14.973578+0000","last_clean":"2024-06-06T03:24:14.973578+0000","last_became_active":"2024-06-06T03:22:44.412977+0000","last_became_peered":"2024-06-06T03:22:44.412977+0000","last_unstale":"2024-06-06T03:24:14.973578+0000","last_undegraded":"2024-06-06T03:24:14.973578+0000","last_fullsized":"2024-06-06T03:24:14.973578+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:11:02.017352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"99'6","reported_seq":227,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:26:26.863327+0000","last_change":"2024-06-06T03:22:31.056091+0000","last_active":"2024-06-06T03:26:26.863327+0000","last_peered":"2024-06-06T03:26:26.863327+0000","last_clean":"2024-06-06T03:26:26.863327+0000","last_became_active":"2024-06-06T03:22:31.055184+0000","last_became_peered":"2024-06-06T03:22:31.055184+0000","last_unstale":"2024-06-06T03:26:26.863327+0000","last_undegraded":"2024-06-06T03:26:26.863327+0000","last_fullsized":"2024-06-06T03:26:26.863327+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:32:37.761082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.357597+0000","last_change":"2024-06-06T03:22:34.305386+0000","last_active":"2024-06-06T03:25:13.357597+0000","last_peered":"2024-06-06T03:25:13.357597+0000","last_clean":"2024-06-06T03:25:13.357597+0000","last_became_active":"2024-06-06T03:22:34.304505+0000","last_became_peered":"2024-06-06T03:22:34.304505+0000","last_unstale":"2024-06-06T03:25:13.357597+0000","last_undegraded":"2024-06-06T03:25:13.357597+0000","last_fullsized":"2024-06-06T03:25:13.357597+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:34:31.800443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":36,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973665+0000","last_change":"2024-06-06T03:23:15.075519+0000","last_active":"2024-06-06T03:24:14.973665+0000","last_peered":"2024-06-06T03:24:14.973665+0000","last_clean":"2024-06-06T03:24:14.973665+0000","last_became_active":"2024-06-06T03:23:15.074970+0000","last_became_peered":"2024-06-06T03:23:15.074970+0000","last_unstale":"2024-06-06T03:24:14.973665+0000","last_undegraded":"2024-06-06T03:24:14.973665+0000","last_fullsized":"2024-06-06T03:24:14.973665+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:39:25.915175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.895888+0000","last_change":"2024-06-06T03:22:31.058530+0000","last_active":"2024-06-06T03:24:14.895888+0000","last_peered":"2024-06-06T03:24:14.895888+0000","last_clean":"2024-06-06T03:24:14.895888+0000","last_became_active":"2024-06-06T03:22:31.058185+0000","last_became_peered":"2024-06-06T03:22:31.058185+0000","last_unstale":"2024-06-06T03:24:14.895888+0000","last_undegraded":"2024-06-06T03:24:14.895888+0000","last_fullsized":"2024-06-06T03:24:14.895888+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:28:59.023322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.372958+0000","last_change":"2024-06-06T03:22:34.292995+0000","last_active":"2024-06-06T03:25:13.372958+0000","last_peered":"2024-06-06T03:25:13.372958+0000","last_clean":"2024-06-06T03:25:13.372958+0000","last_became_active":"2024-06-06T03:22:34.292625+0000","last_became_peered":"2024-06-06T03:22:34.292625+0000","last_unstale":"2024-06-06T03:25:13.372958+0000","last_undegraded":"2024-06-06T03:25:13.372958+0000","last_fullsized":"2024-06-06T03:25:13.372958+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:03:18.985660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380827+0000","last_change":"2024-06-06T03:22:44.417395+0000","last_active":"2024-06-06T03:24:15.380827+0000","last_peered":"2024-06-06T03:24:15.380827+0000","last_clean":"2024-06-06T03:24:15.380827+0000","last_became_active":"2024-06-06T03:22:44.416929+0000","last_became_peered":"2024-06-06T03:22:44.416929+0000","last_unstale":"2024-06-06T03:24:15.380827+0000","last_undegraded":"2024-06-06T03:24:15.380827+0000","last_fullsized":"2024-06-06T03:24:15.380827+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:28:09.548691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700631+0000","last_change":"2024-06-06T03:22:31.051163+0000","last_active":"2024-06-06T03:24:14.700631+0000","last_peered":"2024-06-06T03:24:14.700631+0000","last_clean":"2024-06-06T03:24:14.700631+0000","last_became_active":"2024-06-06T03:22:31.050800+0000","last_became_peered":"2024-06-06T03:22:31.050800+0000","last_unstale":"2024-06-06T03:24:14.700631+0000","last_undegraded":"2024-06-06T03:24:14.700631+0000","last_fullsized":"2024-06-06T03:24:14.700631+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:13:40.197723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.372748+0000","last_change":"2024-06-06T03:22:34.293586+0000","last_active":"2024-06-06T03:25:13.372748+0000","last_peered":"2024-06-06T03:25:13.372748+0000","last_clean":"2024-06-06T03:25:13.372748+0000","last_became_active":"2024-06-06T03:22:34.292651+0000","last_became_peered":"2024-06-06T03:22:34.292651+0000","last_unstale":"2024-06-06T03:25:13.372748+0000","last_undegraded":"2024-06-06T03:25:13.372748+0000","last_fullsized":"2024-06-06T03:25:13.372748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:11:16.221948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.698917+0000","last_change":"2024-06-06T03:22:44.415005+0000","last_active":"2024-06-06T03:24:14.698917+0000","last_peered":"2024-06-06T03:24:14.698917+0000","last_clean":"2024-06-06T03:24:14.698917+0000","last_became_active":"2024-06-06T03:22:44.414522+0000","last_became_peered":"2024-06-06T03:22:44.414522+0000","last_unstale":"2024-06-06T03:24:14.698917+0000","last_undegraded":"2024-06-06T03:24:14.698917+0000","last_fullsized":"2024-06-06T03:24:14.698917+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:36:03.240089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"97'1","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.370600+0000","last_change":"2024-06-06T03:22:31.056068+0000","last_active":"2024-06-06T03:24:15.370600+0000","last_peered":"2024-06-06T03:24:15.370600+0000","last_clean":"2024-06-06T03:24:15.370600+0000","last_became_active":"2024-06-06T03:22:31.055628+0000","last_became_peered":"2024-06-06T03:22:31.055628+0000","last_unstale":"2024-06-06T03:24:15.370600+0000","last_undegraded":"2024-06-06T03:24:15.370600+0000","last_fullsized":"2024-06-06T03:24:15.370600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:40:37.491491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.366436+0000","last_change":"2024-06-06T03:22:34.300945+0000","last_active":"2024-06-06T03:25:13.366436+0000","last_peered":"2024-06-06T03:25:13.366436+0000","last_clean":"2024-06-06T03:25:13.366436+0000","last_became_active":"2024-06-06T03:22:34.300618+0000","last_became_peered":"2024-06-06T03:22:34.300618+0000","last_unstale":"2024-06-06T03:25:13.366436+0000","last_undegraded":"2024-06-06T03:25:13.366436+0000","last_fullsized":"2024-06-06T03:25:13.366436+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:32:39.875148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380716+0000","last_change":"2024-06-06T03:22:44.417759+0000","last_active":"2024-06-06T03:24:15.380716+0000","last_peered":"2024-06-06T03:24:15.380716+0000","last_clean":"2024-06-06T03:24:15.380716+0000","last_became_active":"2024-06-06T03:22:44.417335+0000","last_became_peered":"2024-06-06T03:22:44.417335+0000","last_unstale":"2024-06-06T03:24:15.380716+0000","last_undegraded":"2024-06-06T03:24:15.380716+0000","last_fullsized":"2024-06-06T03:24:15.380716+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:43:24.408740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"99'4","reported_seq":223,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:26:27.864216+0000","last_change":"2024-06-06T03:22:31.054351+0000","last_active":"2024-06-06T03:26:27.864216+0000","last_peered":"2024-06-06T03:26:27.864216+0000","last_clean":"2024-06-06T03:26:27.864216+0000","last_became_active":"2024-06-06T03:22:31.053954+0000","last_became_peered":"2024-06-06T03:22:31.053954+0000","last_unstale":"2024-06-06T03:26:27.864216+0000","last_undegraded":"2024-06-06T03:26:27.864216+0000","last_fullsized":"2024-06-06T03:26:27.864216+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:22:46.405507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":174,"num_read_kb":174,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.367722+0000","last_change":"2024-06-06T03:22:34.303208+0000","last_active":"2024-06-06T03:25:13.367722+0000","last_peered":"2024-06-06T03:25:13.367722+0000","last_clean":"2024-06-06T03:25:13.367722+0000","last_became_active":"2024-06-06T03:22:34.302882+0000","last_became_peered":"2024-06-06T03:22:34.302882+0000","last_unstale":"2024-06-06T03:25:13.367722+0000","last_undegraded":"2024-06-06T03:25:13.367722+0000","last_fullsized":"2024-06-06T03:25:13.367722+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:01:36.963056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380041+0000","last_change":"2024-06-06T03:22:44.418095+0000","last_active":"2024-06-06T03:24:15.380041+0000","last_peered":"2024-06-06T03:24:15.380041+0000","last_clean":"2024-06-06T03:24:15.380041+0000","last_became_active":"2024-06-06T03:22:44.417625+0000","last_became_peered":"2024-06-06T03:22:44.417625+0000","last_unstale":"2024-06-06T03:24:15.380041+0000","last_undegraded":"2024-06-06T03:24:15.380041+0000","last_fullsized":"2024-06-06T03:24:15.380041+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:20:53.859638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.701041+0000","last_change":"2024-06-06T03:22:31.057558+0000","last_active":"2024-06-06T03:24:14.701041+0000","last_peered":"2024-06-06T03:24:14.701041+0000","last_clean":"2024-06-06T03:24:14.701041+0000","last_became_active":"2024-06-06T03:22:31.057168+0000","last_became_peered":"2024-06-06T03:22:31.057168+0000","last_unstale":"2024-06-06T03:24:14.701041+0000","last_undegraded":"2024-06-06T03:24:14.701041+0000","last_fullsized":"2024-06-06T03:24:14.701041+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:33:59.019923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.373648+0000","last_change":"2024-06-06T03:22:34.299220+0000","last_active":"2024-06-06T03:25:13.373648+0000","last_peered":"2024-06-06T03:25:13.373648+0000","last_clean":"2024-06-06T03:25:13.373648+0000","last_became_active":"2024-06-06T03:22:34.298873+0000","last_became_peered":"2024-06-06T03:22:34.298873+0000","last_unstale":"2024-06-06T03:25:13.373648+0000","last_undegraded":"2024-06-06T03:25:13.373648+0000","last_fullsized":"2024-06-06T03:25:13.373648+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:31:53.501036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163660+0000","last_change":"2024-06-06T03:22:44.424792+0000","last_active":"2024-06-06T03:24:15.163660+0000","last_peered":"2024-06-06T03:24:15.163660+0000","last_clean":"2024-06-06T03:24:15.163660+0000","last_became_active":"2024-06-06T03:22:44.423973+0000","last_became_peered":"2024-06-06T03:22:44.423973+0000","last_unstale":"2024-06-06T03:24:15.163660+0000","last_undegraded":"2024-06-06T03:24:15.163660+0000","last_fullsized":"2024-06-06T03:24:15.163660+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:46:51.232764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"97'4","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.370511+0000","last_change":"2024-06-06T03:22:31.243885+0000","last_active":"2024-06-06T03:24:15.370511+0000","last_peered":"2024-06-06T03:24:15.370511+0000","last_clean":"2024-06-06T03:24:15.370511+0000","last_became_active":"2024-06-06T03:22:31.243367+0000","last_became_peered":"2024-06-06T03:22:31.243367+0000","last_unstale":"2024-06-06T03:24:15.370511+0000","last_undegraded":"2024-06-06T03:24:15.370511+0000","last_fullsized":"2024-06-06T03:24:15.370511+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:57:13.464974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.367835+0000","last_change":"2024-06-06T03:22:34.299247+0000","last_active":"2024-06-06T03:25:13.367835+0000","last_peered":"2024-06-06T03:25:13.367835+0000","last_clean":"2024-06-06T03:25:13.367835+0000","last_became_active":"2024-06-06T03:22:34.298538+0000","last_became_peered":"2024-06-06T03:22:34.298538+0000","last_unstale":"2024-06-06T03:25:13.367835+0000","last_undegraded":"2024-06-06T03:25:13.367835+0000","last_fullsized":"2024-06-06T03:25:13.367835+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:53:16.724575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380294+0000","last_change":"2024-06-06T03:22:44.423817+0000","last_active":"2024-06-06T03:24:15.380294+0000","last_peered":"2024-06-06T03:24:15.380294+0000","last_clean":"2024-06-06T03:24:15.380294+0000","last_became_active":"2024-06-06T03:22:44.423333+0000","last_became_peered":"2024-06-06T03:22:44.423333+0000","last_unstale":"2024-06-06T03:24:15.380294+0000","last_undegraded":"2024-06-06T03:24:15.380294+0000","last_fullsized":"2024-06-06T03:24:15.380294+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:22:46.174850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"99'39","reported_seq":444,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:26:28.866133+0000","last_change":"2024-06-06T03:22:31.056446+0000","last_active":"2024-06-06T03:26:28.866133+0000","last_peered":"2024-06-06T03:26:28.866133+0000","last_clean":"2024-06-06T03:26:28.866133+0000","last_became_active":"2024-06-06T03:22:31.056089+0000","last_became_peered":"2024-06-06T03:22:31.056089+0000","last_unstale":"2024-06-06T03:26:28.866133+0000","last_undegraded":"2024-06-06T03:26:28.866133+0000","last_fullsized":"2024-06-06T03:26:28.866133+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:11:37.705889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67125,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":360,"num_read_kb":246,"num_write":40,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.346439+0000","last_change":"2024-06-06T03:22:34.302229+0000","last_active":"2024-06-06T03:25:13.346439+0000","last_peered":"2024-06-06T03:25:13.346439+0000","last_clean":"2024-06-06T03:25:13.346439+0000","last_became_active":"2024-06-06T03:22:34.301877+0000","last_became_peered":"2024-06-06T03:22:34.301877+0000","last_unstale":"2024-06-06T03:25:13.346439+0000","last_undegraded":"2024-06-06T03:25:13.346439+0000","last_fullsized":"2024-06-06T03:25:13.346439+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:19:22.545435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.371635+0000","last_change":"2024-06-06T03:22:44.421024+0000","last_active":"2024-06-06T03:24:15.371635+0000","last_peered":"2024-06-06T03:24:15.371635+0000","last_clean":"2024-06-06T03:24:15.371635+0000","last_became_active":"2024-06-06T03:22:44.420502+0000","last_became_peered":"2024-06-06T03:22:44.420502+0000","last_unstale":"2024-06-06T03:24:15.371635+0000","last_undegraded":"2024-06-06T03:24:15.371635+0000","last_fullsized":"2024-06-06T03:24:15.371635+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:15:55.246032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"97'6","reported_seq":51,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973641+0000","last_change":"2024-06-06T03:22:31.054128+0000","last_active":"2024-06-06T03:24:14.973641+0000","last_peered":"2024-06-06T03:24:14.973641+0000","last_clean":"2024-06-06T03:24:14.973641+0000","last_became_active":"2024-06-06T03:22:31.053740+0000","last_became_peered":"2024-06-06T03:22:31.053740+0000","last_unstale":"2024-06-06T03:24:14.973641+0000","last_undegraded":"2024-06-06T03:24:14.973641+0000","last_fullsized":"2024-06-06T03:24:14.973641+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:12:21.494702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.368206+0000","last_change":"2024-06-06T03:22:34.297861+0000","last_active":"2024-06-06T03:25:13.368206+0000","last_peered":"2024-06-06T03:25:13.368206+0000","last_clean":"2024-06-06T03:25:13.368206+0000","last_became_active":"2024-06-06T03:22:34.297391+0000","last_became_peered":"2024-06-06T03:22:34.297391+0000","last_unstale":"2024-06-06T03:25:13.368206+0000","last_undegraded":"2024-06-06T03:25:13.368206+0000","last_fullsized":"2024-06-06T03:25:13.368206+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:10:33.973635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380551+0000","last_change":"2024-06-06T03:22:44.416087+0000","last_active":"2024-06-06T03:24:15.380551+0000","last_peered":"2024-06-06T03:24:15.380551+0000","last_clean":"2024-06-06T03:24:15.380551+0000","last_became_active":"2024-06-06T03:22:44.415646+0000","last_became_peered":"2024-06-06T03:22:44.415646+0000","last_unstale":"2024-06-06T03:24:15.380551+0000","last_undegraded":"2024-06-06T03:24:15.380551+0000","last_fullsized":"2024-06-06T03:24:15.380551+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:44:43.690830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.370474+0000","last_change":"2024-06-06T03:22:31.056814+0000","last_active":"2024-06-06T03:24:15.370474+0000","last_peered":"2024-06-06T03:24:15.370474+0000","last_clean":"2024-06-06T03:24:15.370474+0000","last_became_active":"2024-06-06T03:22:31.055183+0000","last_became_peered":"2024-06-06T03:22:31.055183+0000","last_unstale":"2024-06-06T03:24:15.370474+0000","last_undegraded":"2024-06-06T03:24:15.370474+0000","last_fullsized":"2024-06-06T03:24:15.370474+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:26:27.299068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"99'15","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371815+0000","last_change":"2024-06-06T03:22:34.311995+0000","last_active":"2024-06-06T03:25:13.371815+0000","last_peered":"2024-06-06T03:25:13.371815+0000","last_clean":"2024-06-06T03:25:13.371815+0000","last_became_active":"2024-06-06T03:22:34.311665+0000","last_became_peered":"2024-06-06T03:22:34.311665+0000","last_unstale":"2024-06-06T03:25:13.371815+0000","last_undegraded":"2024-06-06T03:25:13.371815+0000","last_fullsized":"2024-06-06T03:25:13.371815+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:53:10.539212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380693+0000","last_change":"2024-06-06T03:22:44.414170+0000","last_active":"2024-06-06T03:24:15.380693+0000","last_peered":"2024-06-06T03:24:15.380693+0000","last_clean":"2024-06-06T03:24:15.380693+0000","last_became_active":"2024-06-06T03:22:44.413635+0000","last_became_peered":"2024-06-06T03:22:44.413635+0000","last_unstale":"2024-06-06T03:24:15.380693+0000","last_undegraded":"2024-06-06T03:24:15.380693+0000","last_fullsized":"2024-06-06T03:24:15.380693+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:06:25.223810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"99'6","reported_seq":229,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:26:27.918261+0000","last_change":"2024-06-06T03:22:31.057846+0000","last_active":"2024-06-06T03:26:27.918261+0000","last_peered":"2024-06-06T03:26:27.918261+0000","last_clean":"2024-06-06T03:26:27.918261+0000","last_became_active":"2024-06-06T03:22:31.056635+0000","last_became_peered":"2024-06-06T03:22:31.056635+0000","last_unstale":"2024-06-06T03:26:27.918261+0000","last_undegraded":"2024-06-06T03:26:27.918261+0000","last_fullsized":"2024-06-06T03:26:27.918261+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:59:03.845722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1611,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":180,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.368520+0000","last_change":"2024-06-06T03:22:34.304832+0000","last_active":"2024-06-06T03:25:13.368520+0000","last_peered":"2024-06-06T03:25:13.368520+0000","last_clean":"2024-06-06T03:25:13.368520+0000","last_became_active":"2024-06-06T03:22:34.304494+0000","last_became_peered":"2024-06-06T03:22:34.304494+0000","last_unstale":"2024-06-06T03:25:13.368520+0000","last_undegraded":"2024-06-06T03:25:13.368520+0000","last_fullsized":"2024-06-06T03:25:13.368520+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:17:02.855580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.701044+0000","last_change":"2024-06-06T03:22:44.418561+0000","last_active":"2024-06-06T03:24:14.701044+0000","last_peered":"2024-06-06T03:24:14.701044+0000","last_clean":"2024-06-06T03:24:14.701044+0000","last_became_active":"2024-06-06T03:22:44.418050+0000","last_became_peered":"2024-06-06T03:22:44.418050+0000","last_unstale":"2024-06-06T03:24:14.701044+0000","last_undegraded":"2024-06-06T03:24:14.701044+0000","last_fullsized":"2024-06-06T03:24:14.701044+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:39:57.680990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"97'15","reported_seq":60,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.699578+0000","last_change":"2024-06-06T03:22:31.242981+0000","last_active":"2024-06-06T03:24:14.699578+0000","last_peered":"2024-06-06T03:24:14.699578+0000","last_clean":"2024-06-06T03:24:14.699578+0000","last_became_active":"2024-06-06T03:22:31.242448+0000","last_became_peered":"2024-06-06T03:22:31.242448+0000","last_unstale":"2024-06-06T03:24:14.699578+0000","last_undegraded":"2024-06-06T03:24:14.699578+0000","last_fullsized":"2024-06-06T03:24:14.699578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:18:25.855327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.372636+0000","last_change":"2024-06-06T03:22:34.300799+0000","last_active":"2024-06-06T03:25:13.372636+0000","last_peered":"2024-06-06T03:25:13.372636+0000","last_clean":"2024-06-06T03:25:13.372636+0000","last_became_active":"2024-06-06T03:22:34.300397+0000","last_became_peered":"2024-06-06T03:22:34.300397+0000","last_unstale":"2024-06-06T03:25:13.372636+0000","last_undegraded":"2024-06-06T03:25:13.372636+0000","last_fullsized":"2024-06-06T03:25:13.372636+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:55:31.621711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.371189+0000","last_change":"2024-06-06T03:22:44.418341+0000","last_active":"2024-06-06T03:24:15.371189+0000","last_peered":"2024-06-06T03:24:15.371189+0000","last_clean":"2024-06-06T03:24:15.371189+0000","last_became_active":"2024-06-06T03:22:44.417881+0000","last_became_peered":"2024-06-06T03:22:44.417881+0000","last_unstale":"2024-06-06T03:24:15.371189+0000","last_undegraded":"2024-06-06T03:24:15.371189+0000","last_fullsized":"2024-06-06T03:24:15.371189+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:43:13.869298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700063+0000","last_change":"2024-06-06T03:22:31.054749+0000","last_active":"2024-06-06T03:24:14.700063+0000","last_peered":"2024-06-06T03:24:14.700063+0000","last_clean":"2024-06-06T03:24:14.700063+0000","last_became_active":"2024-06-06T03:22:31.054180+0000","last_became_peered":"2024-06-06T03:22:31.054180+0000","last_unstale":"2024-06-06T03:24:14.700063+0000","last_undegraded":"2024-06-06T03:24:14.700063+0000","last_fullsized":"2024-06-06T03:24:14.700063+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:30:17.902778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371538+0000","last_change":"2024-06-06T03:22:34.299573+0000","last_active":"2024-06-06T03:25:13.371538+0000","last_peered":"2024-06-06T03:25:13.371538+0000","last_clean":"2024-06-06T03:25:13.371538+0000","last_became_active":"2024-06-06T03:22:34.299201+0000","last_became_peered":"2024-06-06T03:22:34.299201+0000","last_unstale":"2024-06-06T03:25:13.371538+0000","last_undegraded":"2024-06-06T03:25:13.371538+0000","last_fullsized":"2024-06-06T03:25:13.371538+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:02:47.043087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.699582+0000","last_change":"2024-06-06T03:22:44.409672+0000","last_active":"2024-06-06T03:24:14.699582+0000","last_peered":"2024-06-06T03:24:14.699582+0000","last_clean":"2024-06-06T03:24:14.699582+0000","last_became_active":"2024-06-06T03:22:44.409246+0000","last_became_peered":"2024-06-06T03:22:44.409246+0000","last_unstale":"2024-06-06T03:24:14.699582+0000","last_undegraded":"2024-06-06T03:24:14.699582+0000","last_fullsized":"2024-06-06T03:24:14.699582+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:44:49.481886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.379711+0000","last_change":"2024-06-06T03:22:31.243562+0000","last_active":"2024-06-06T03:24:15.379711+0000","last_peered":"2024-06-06T03:24:15.379711+0000","last_clean":"2024-06-06T03:24:15.379711+0000","last_became_active":"2024-06-06T03:22:31.243164+0000","last_became_peered":"2024-06-06T03:22:31.243164+0000","last_unstale":"2024-06-06T03:24:15.379711+0000","last_undegraded":"2024-06-06T03:24:15.379711+0000","last_fullsized":"2024-06-06T03:24:15.379711+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:04:46.877389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"99'4","reported_seq":43,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.360629+0000","last_change":"2024-06-06T03:22:34.300756+0000","last_active":"2024-06-06T03:25:13.360629+0000","last_peered":"2024-06-06T03:25:13.360629+0000","last_clean":"2024-06-06T03:25:13.360629+0000","last_became_active":"2024-06-06T03:22:34.300333+0000","last_became_peered":"2024-06-06T03:22:34.300333+0000","last_unstale":"2024-06-06T03:25:13.360629+0000","last_undegraded":"2024-06-06T03:25:13.360629+0000","last_fullsized":"2024-06-06T03:25:13.360629+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:29:37.174432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700803+0000","last_change":"2024-06-06T03:22:44.412741+0000","last_active":"2024-06-06T03:24:14.700803+0000","last_peered":"2024-06-06T03:24:14.700803+0000","last_clean":"2024-06-06T03:24:14.700803+0000","last_became_active":"2024-06-06T03:22:44.412263+0000","last_became_peered":"2024-06-06T03:22:44.412263+0000","last_unstale":"2024-06-06T03:24:14.700803+0000","last_undegraded":"2024-06-06T03:24:14.700803+0000","last_fullsized":"2024-06-06T03:24:14.700803+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:00:13.925279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"97'1","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700753+0000","last_change":"2024-06-06T03:22:31.055124+0000","last_active":"2024-06-06T03:24:14.700753+0000","last_peered":"2024-06-06T03:24:14.700753+0000","last_clean":"2024-06-06T03:24:14.700753+0000","last_became_active":"2024-06-06T03:22:31.054562+0000","last_became_peered":"2024-06-06T03:22:31.054562+0000","last_unstale":"2024-06-06T03:24:14.700753+0000","last_undegraded":"2024-06-06T03:24:14.700753+0000","last_fullsized":"2024-06-06T03:24:14.700753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:57:54.783815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.359691+0000","last_change":"2024-06-06T03:22:34.310893+0000","last_active":"2024-06-06T03:25:13.359691+0000","last_peered":"2024-06-06T03:25:13.359691+0000","last_clean":"2024-06-06T03:25:13.359691+0000","last_became_active":"2024-06-06T03:22:34.310510+0000","last_became_peered":"2024-06-06T03:22:34.310510+0000","last_unstale":"2024-06-06T03:25:13.359691+0000","last_undegraded":"2024-06-06T03:25:13.359691+0000","last_fullsized":"2024-06-06T03:25:13.359691+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:52:10.979031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":36,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.897745+0000","last_change":"2024-06-06T03:24:14.897222+0000","last_active":"2024-06-06T03:24:14.897745+0000","last_peered":"2024-06-06T03:24:14.897745+0000","last_clean":"2024-06-06T03:24:14.897745+0000","last_became_active":"2024-06-06T03:24:14.896620+0000","last_became_peered":"2024-06-06T03:24:14.896620+0000","last_unstale":"2024-06-06T03:24:14.897745+0000","last_undegraded":"2024-06-06T03:24:14.897745+0000","last_fullsized":"2024-06-06T03:24:14.897745+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:43:44.992240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8,10,0],"acting":[6,8,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371198+0000","last_change":"2024-06-06T03:22:34.294540+0000","last_active":"2024-06-06T03:25:13.371198+0000","last_peered":"2024-06-06T03:25:13.371198+0000","last_clean":"2024-06-06T03:25:13.371198+0000","last_became_active":"2024-06-06T03:22:34.294204+0000","last_became_peered":"2024-06-06T03:22:34.294204+0000","last_unstale":"2024-06-06T03:25:13.371198+0000","last_undegraded":"2024-06-06T03:25:13.371198+0000","last_fullsized":"2024-06-06T03:25:13.371198+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:16:39.386345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"99'6","reported_seq":224,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:26:26.915520+0000","last_change":"2024-06-06T03:22:31.242275+0000","last_active":"2024-06-06T03:26:26.915520+0000","last_peered":"2024-06-06T03:26:26.915520+0000","last_clean":"2024-06-06T03:26:26.915520+0000","last_became_active":"2024-06-06T03:22:31.241930+0000","last_became_peered":"2024-06-06T03:22:31.241930+0000","last_unstale":"2024-06-06T03:26:26.915520+0000","last_undegraded":"2024-06-06T03:26:26.915520+0000","last_fullsized":"2024-06-06T03:26:26.915520+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:46:16.407946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"97'1","reported_seq":30,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.701132+0000","last_change":"2024-06-06T03:22:44.416191+0000","last_active":"2024-06-06T03:24:14.701132+0000","last_peered":"2024-06-06T03:24:14.701132+0000","last_clean":"2024-06-06T03:24:14.701132+0000","last_became_active":"2024-06-06T03:22:44.415632+0000","last_became_peered":"2024-06-06T03:22:44.415632+0000","last_unstale":"2024-06-06T03:24:14.701132+0000","last_undegraded":"2024-06-06T03:24:14.701132+0000","last_fullsized":"2024-06-06T03:24:14.701132+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:10:48.995029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371311+0000","last_change":"2024-06-06T03:22:34.304567+0000","last_active":"2024-06-06T03:25:13.371311+0000","last_peered":"2024-06-06T03:25:13.371311+0000","last_clean":"2024-06-06T03:25:13.371311+0000","last_became_active":"2024-06-06T03:22:34.304183+0000","last_became_peered":"2024-06-06T03:22:34.304183+0000","last_unstale":"2024-06-06T03:25:13.371311+0000","last_undegraded":"2024-06-06T03:25:13.371311+0000","last_fullsized":"2024-06-06T03:25:13.371311+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:34:02.229528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"97'3","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163254+0000","last_change":"2024-06-06T03:22:31.056188+0000","last_active":"2024-06-06T03:24:15.163254+0000","last_peered":"2024-06-06T03:24:15.163254+0000","last_clean":"2024-06-06T03:24:15.163254+0000","last_became_active":"2024-06-06T03:22:31.055758+0000","last_became_peered":"2024-06-06T03:22:31.055758+0000","last_unstale":"2024-06-06T03:24:15.163254+0000","last_undegraded":"2024-06-06T03:24:15.163254+0000","last_fullsized":"2024-06-06T03:24:15.163254+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:35:51.016087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":368,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700465+0000","last_change":"2024-06-06T03:21:07.156236+0000","last_active":"2024-06-06T03:24:14.700465+0000","last_peered":"2024-06-06T03:24:14.700465+0000","last_clean":"2024-06-06T03:24:14.700465+0000","last_became_active":"2024-06-06T03:21:07.155807+0000","last_became_peered":"2024-06-06T03:21:07.155807+0000","last_unstale":"2024-06-06T03:24:14.700465+0000","last_undegraded":"2024-06-06T03:24:14.700465+0000","last_fullsized":"2024-06-06T03:24:14.700465+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:17:38.330402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:17:38.330402+0000","last_clean_scrub_stamp":"2024-06-06T03:17:38.330402+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:30:13.968755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.371740+0000","last_change":"2024-06-06T03:22:44.424693+0000","last_active":"2024-06-06T03:24:15.371740+0000","last_peered":"2024-06-06T03:24:15.371740+0000","last_clean":"2024-06-06T03:24:15.371740+0000","last_became_active":"2024-06-06T03:22:44.423607+0000","last_became_peered":"2024-06-06T03:22:44.423607+0000","last_unstale":"2024-06-06T03:24:15.371740+0000","last_undegraded":"2024-06-06T03:24:15.371740+0000","last_fullsized":"2024-06-06T03:24:15.371740+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:57:56.974785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.359317+0000","last_change":"2024-06-06T03:22:34.297940+0000","last_active":"2024-06-06T03:25:13.359317+0000","last_peered":"2024-06-06T03:25:13.359317+0000","last_clean":"2024-06-06T03:25:13.359317+0000","last_became_active":"2024-06-06T03:22:34.297597+0000","last_became_peered":"2024-06-06T03:22:34.297597+0000","last_unstale":"2024-06-06T03:25:13.359317+0000","last_undegraded":"2024-06-06T03:25:13.359317+0000","last_fullsized":"2024-06-06T03:25:13.359317+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:52:52.155070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700574+0000","last_change":"2024-06-06T03:22:31.055329+0000","last_active":"2024-06-06T03:24:14.700574+0000","last_peered":"2024-06-06T03:24:14.700574+0000","last_clean":"2024-06-06T03:24:14.700574+0000","last_became_active":"2024-06-06T03:22:31.054493+0000","last_became_peered":"2024-06-06T03:22:31.054493+0000","last_unstale":"2024-06-06T03:24:14.700574+0000","last_undegraded":"2024-06-06T03:24:14.700574+0000","last_fullsized":"2024-06-06T03:24:14.700574+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:45:32.068810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380440+0000","last_change":"2024-06-06T03:22:44.413560+0000","last_active":"2024-06-06T03:24:15.380440+0000","last_peered":"2024-06-06T03:24:15.380440+0000","last_clean":"2024-06-06T03:24:15.380440+0000","last_became_active":"2024-06-06T03:22:44.413100+0000","last_became_peered":"2024-06-06T03:22:44.413100+0000","last_unstale":"2024-06-06T03:24:15.380440+0000","last_undegraded":"2024-06-06T03:24:15.380440+0000","last_fullsized":"2024-06-06T03:24:15.380440+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:58:02.780671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"97'1","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380639+0000","last_change":"2024-06-06T03:23:14.515805+0000","last_active":"2024-06-06T03:24:15.380639+0000","last_peered":"2024-06-06T03:24:15.380639+0000","last_clean":"2024-06-06T03:24:15.380639+0000","last_became_active":"2024-06-06T03:23:14.515436+0000","last_became_peered":"2024-06-06T03:23:14.515436+0000","last_unstale":"2024-06-06T03:24:15.380639+0000","last_undegraded":"2024-06-06T03:24:15.380639+0000","last_fullsized":"2024-06-06T03:24:15.380639+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:59:16.246609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.364457+0000","last_change":"2024-06-06T03:22:34.294549+0000","last_active":"2024-06-06T03:25:13.364457+0000","last_peered":"2024-06-06T03:25:13.364457+0000","last_clean":"2024-06-06T03:25:13.364457+0000","last_became_active":"2024-06-06T03:22:34.294202+0000","last_became_peered":"2024-06-06T03:22:34.294202+0000","last_unstale":"2024-06-06T03:25:13.364457+0000","last_undegraded":"2024-06-06T03:25:13.364457+0000","last_fullsized":"2024-06-06T03:25:13.364457+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:55:59.823957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380133+0000","last_change":"2024-06-06T03:22:44.416890+0000","last_active":"2024-06-06T03:24:15.380133+0000","last_peered":"2024-06-06T03:24:15.380133+0000","last_clean":"2024-06-06T03:24:15.380133+0000","last_became_active":"2024-06-06T03:22:44.416473+0000","last_became_peered":"2024-06-06T03:22:44.416473+0000","last_unstale":"2024-06-06T03:24:15.380133+0000","last_undegraded":"2024-06-06T03:24:15.380133+0000","last_fullsized":"2024-06-06T03:24:15.380133+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:23:48.972196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"99'14","reported_seq":59,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:14.317576+0000","last_change":"2024-06-06T03:22:31.054481+0000","last_active":"2024-06-06T03:25:14.317576+0000","last_peered":"2024-06-06T03:25:14.317576+0000","last_clean":"2024-06-06T03:25:14.317576+0000","last_became_active":"2024-06-06T03:22:31.054173+0000","last_became_peered":"2024-06-06T03:22:31.054173+0000","last_unstale":"2024-06-06T03:25:14.317576+0000","last_undegraded":"2024-06-06T03:25:14.317576+0000","last_fullsized":"2024-06-06T03:25:14.317576+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:52:45.311149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.372630+0000","last_change":"2024-06-06T03:22:34.300211+0000","last_active":"2024-06-06T03:25:13.372630+0000","last_peered":"2024-06-06T03:25:13.372630+0000","last_clean":"2024-06-06T03:25:13.372630+0000","last_became_active":"2024-06-06T03:22:34.299870+0000","last_became_peered":"2024-06-06T03:22:34.299870+0000","last_unstale":"2024-06-06T03:25:13.372630+0000","last_undegraded":"2024-06-06T03:25:13.372630+0000","last_fullsized":"2024-06-06T03:25:13.372630+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:50:56.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973290+0000","last_change":"2024-06-06T03:22:44.414727+0000","last_active":"2024-06-06T03:24:14.973290+0000","last_peered":"2024-06-06T03:24:14.973290+0000","last_clean":"2024-06-06T03:24:14.973290+0000","last_became_active":"2024-06-06T03:22:44.414232+0000","last_became_peered":"2024-06-06T03:22:44.414232+0000","last_unstale":"2024-06-06T03:24:14.973290+0000","last_undegraded":"2024-06-06T03:24:14.973290+0000","last_fullsized":"2024-06-06T03:24:14.973290+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:26:21.540309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"97'4","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.164042+0000","last_change":"2024-06-06T03:22:31.178740+0000","last_active":"2024-06-06T03:24:15.164042+0000","last_peered":"2024-06-06T03:24:15.164042+0000","last_clean":"2024-06-06T03:24:15.164042+0000","last_became_active":"2024-06-06T03:22:31.178353+0000","last_became_peered":"2024-06-06T03:22:31.178353+0000","last_unstale":"2024-06-06T03:24:15.164042+0000","last_undegraded":"2024-06-06T03:24:15.164042+0000","last_fullsized":"2024-06-06T03:24:15.164042+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:56:50.159463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.368763+0000","last_change":"2024-06-06T03:22:34.298011+0000","last_active":"2024-06-06T03:25:13.368763+0000","last_peered":"2024-06-06T03:25:13.368763+0000","last_clean":"2024-06-06T03:25:13.368763+0000","last_became_active":"2024-06-06T03:22:34.297697+0000","last_became_peered":"2024-06-06T03:22:34.297697+0000","last_unstale":"2024-06-06T03:25:13.368763+0000","last_undegraded":"2024-06-06T03:25:13.368763+0000","last_fullsized":"2024-06-06T03:25:13.368763+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:01:38.606543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163829+0000","last_change":"2024-06-06T03:22:44.425675+0000","last_active":"2024-06-06T03:24:15.163829+0000","last_peered":"2024-06-06T03:24:15.163829+0000","last_clean":"2024-06-06T03:24:15.163829+0000","last_became_active":"2024-06-06T03:22:44.424023+0000","last_became_peered":"2024-06-06T03:22:44.424023+0000","last_unstale":"2024-06-06T03:24:15.163829+0000","last_undegraded":"2024-06-06T03:24:15.163829+0000","last_fullsized":"2024-06-06T03:24:15.163829+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:47:48.718771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"97'2","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.379742+0000","last_change":"2024-06-06T03:22:31.242360+0000","last_active":"2024-06-06T03:24:15.379742+0000","last_peered":"2024-06-06T03:24:15.379742+0000","last_clean":"2024-06-06T03:24:15.379742+0000","last_became_active":"2024-06-06T03:22:31.242015+0000","last_became_peered":"2024-06-06T03:22:31.242015+0000","last_unstale":"2024-06-06T03:24:15.379742+0000","last_undegraded":"2024-06-06T03:24:15.379742+0000","last_fullsized":"2024-06-06T03:24:15.379742+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:14:30.674106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"99'2","reported_seq":41,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.326018+0000","last_change":"2024-06-06T03:22:34.302980+0000","last_active":"2024-06-06T03:25:13.326018+0000","last_peered":"2024-06-06T03:25:13.326018+0000","last_clean":"2024-06-06T03:25:13.326018+0000","last_became_active":"2024-06-06T03:22:34.302625+0000","last_became_peered":"2024-06-06T03:22:34.302625+0000","last_unstale":"2024-06-06T03:25:13.326018+0000","last_undegraded":"2024-06-06T03:25:13.326018+0000","last_fullsized":"2024-06-06T03:25:13.326018+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:13:01.603365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380862+0000","last_change":"2024-06-06T03:22:44.423741+0000","last_active":"2024-06-06T03:24:15.380862+0000","last_peered":"2024-06-06T03:24:15.380862+0000","last_clean":"2024-06-06T03:24:15.380862+0000","last_became_active":"2024-06-06T03:22:44.423266+0000","last_became_peered":"2024-06-06T03:22:44.423266+0000","last_unstale":"2024-06-06T03:24:15.380862+0000","last_undegraded":"2024-06-06T03:24:15.380862+0000","last_fullsized":"2024-06-06T03:24:15.380862+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:09:19.324145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"97'3","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.379798+0000","last_change":"2024-06-06T03:22:31.052988+0000","last_active":"2024-06-06T03:24:15.379798+0000","last_peered":"2024-06-06T03:24:15.379798+0000","last_clean":"2024-06-06T03:24:15.379798+0000","last_became_active":"2024-06-06T03:22:31.052743+0000","last_became_peered":"2024-06-06T03:22:31.052743+0000","last_unstale":"2024-06-06T03:24:15.379798+0000","last_undegraded":"2024-06-06T03:24:15.379798+0000","last_fullsized":"2024-06-06T03:24:15.379798+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:31:45.176416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.365872+0000","last_change":"2024-06-06T03:22:34.299991+0000","last_active":"2024-06-06T03:25:13.365872+0000","last_peered":"2024-06-06T03:25:13.365872+0000","last_clean":"2024-06-06T03:25:13.365872+0000","last_became_active":"2024-06-06T03:22:34.299659+0000","last_became_peered":"2024-06-06T03:22:34.299659+0000","last_unstale":"2024-06-06T03:25:13.365872+0000","last_undegraded":"2024-06-06T03:25:13.365872+0000","last_fullsized":"2024-06-06T03:25:13.365872+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:16:51.492749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"97'1","reported_seq":37,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163786+0000","last_change":"2024-06-06T03:23:15.027541+0000","last_active":"2024-06-06T03:24:15.163786+0000","last_peered":"2024-06-06T03:24:15.163786+0000","last_clean":"2024-06-06T03:24:15.163786+0000","last_became_active":"2024-06-06T03:23:15.026931+0000","last_became_peered":"2024-06-06T03:23:15.026931+0000","last_unstale":"2024-06-06T03:24:15.163786+0000","last_undegraded":"2024-06-06T03:24:15.163786+0000","last_fullsized":"2024-06-06T03:24:15.163786+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:47:44.197067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"99'2","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:25.895366+0000","last_change":"2024-06-06T03:23:14.831383+0000","last_active":"2024-06-06T03:25:25.895366+0000","last_peered":"2024-06-06T03:25:25.895366+0000","last_clean":"2024-06-06T03:25:25.895366+0000","last_became_active":"2024-06-06T03:23:14.830948+0000","last_became_peered":"2024-06-06T03:23:14.830948+0000","last_unstale":"2024-06-06T03:25:25.895366+0000","last_undegraded":"2024-06-06T03:25:25.895366+0000","last_fullsized":"2024-06-06T03:25:25.895366+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:58:00.326112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.370110+0000","last_change":"2024-06-06T03:22:34.301842+0000","last_active":"2024-06-06T03:25:13.370110+0000","last_peered":"2024-06-06T03:25:13.370110+0000","last_clean":"2024-06-06T03:25:13.370110+0000","last_became_active":"2024-06-06T03:22:34.301513+0000","last_became_peered":"2024-06-06T03:22:34.301513+0000","last_unstale":"2024-06-06T03:25:13.370110+0000","last_undegraded":"2024-06-06T03:25:13.370110+0000","last_fullsized":"2024-06-06T03:25:13.370110+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:30:03.813861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163817+0000","last_change":"2024-06-06T03:22:44.419621+0000","last_active":"2024-06-06T03:24:15.163817+0000","last_peered":"2024-06-06T03:24:15.163817+0000","last_clean":"2024-06-06T03:24:15.163817+0000","last_became_active":"2024-06-06T03:22:44.419065+0000","last_became_peered":"2024-06-06T03:22:44.419065+0000","last_unstale":"2024-06-06T03:24:15.163817+0000","last_undegraded":"2024-06-06T03:24:15.163817+0000","last_fullsized":"2024-06-06T03:24:15.163817+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:10:49.762284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"97'4","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.699776+0000","last_change":"2024-06-06T03:22:31.056409+0000","last_active":"2024-06-06T03:24:14.699776+0000","last_peered":"2024-06-06T03:24:14.699776+0000","last_clean":"2024-06-06T03:24:14.699776+0000","last_became_active":"2024-06-06T03:22:31.055994+0000","last_became_peered":"2024-06-06T03:22:31.055994+0000","last_unstale":"2024-06-06T03:24:14.699776+0000","last_undegraded":"2024-06-06T03:24:14.699776+0000","last_fullsized":"2024-06-06T03:24:14.699776+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:09:00.784820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371522+0000","last_change":"2024-06-06T03:22:34.302238+0000","last_active":"2024-06-06T03:25:13.371522+0000","last_peered":"2024-06-06T03:25:13.371522+0000","last_clean":"2024-06-06T03:25:13.371522+0000","last_became_active":"2024-06-06T03:22:34.301869+0000","last_became_peered":"2024-06-06T03:22:34.301869+0000","last_unstale":"2024-06-06T03:25:13.371522+0000","last_undegraded":"2024-06-06T03:25:13.371522+0000","last_fullsized":"2024-06-06T03:25:13.371522+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:17:08.350692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380233+0000","last_change":"2024-06-06T03:22:44.414052+0000","last_active":"2024-06-06T03:24:15.380233+0000","last_peered":"2024-06-06T03:24:15.380233+0000","last_clean":"2024-06-06T03:24:15.380233+0000","last_became_active":"2024-06-06T03:22:44.413633+0000","last_became_peered":"2024-06-06T03:22:44.413633+0000","last_unstale":"2024-06-06T03:24:15.380233+0000","last_undegraded":"2024-06-06T03:24:15.380233+0000","last_fullsized":"2024-06-06T03:24:15.380233+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:41:16.942699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973931+0000","last_change":"2024-06-06T03:22:31.243570+0000","last_active":"2024-06-06T03:24:14.973931+0000","last_peered":"2024-06-06T03:24:14.973931+0000","last_clean":"2024-06-06T03:24:14.973931+0000","last_became_active":"2024-06-06T03:22:31.243194+0000","last_became_peered":"2024-06-06T03:22:31.243194+0000","last_unstale":"2024-06-06T03:24:14.973931+0000","last_undegraded":"2024-06-06T03:24:14.973931+0000","last_fullsized":"2024-06-06T03:24:14.973931+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:21:22.233139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.370634+0000","last_change":"2024-06-06T03:22:34.301665+0000","last_active":"2024-06-06T03:25:13.370634+0000","last_peered":"2024-06-06T03:25:13.370634+0000","last_clean":"2024-06-06T03:25:13.370634+0000","last_became_active":"2024-06-06T03:22:34.300967+0000","last_became_peered":"2024-06-06T03:22:34.300967+0000","last_unstale":"2024-06-06T03:25:13.370634+0000","last_undegraded":"2024-06-06T03:25:13.370634+0000","last_fullsized":"2024-06-06T03:25:13.370634+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:57:58.905488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":36,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.698608+0000","last_change":"2024-06-06T03:23:14.833267+0000","last_active":"2024-06-06T03:24:14.698608+0000","last_peered":"2024-06-06T03:24:14.698608+0000","last_clean":"2024-06-06T03:24:14.698608+0000","last_became_active":"2024-06-06T03:23:14.832760+0000","last_became_peered":"2024-06-06T03:23:14.832760+0000","last_unstale":"2024-06-06T03:24:14.698608+0000","last_undegraded":"2024-06-06T03:24:14.698608+0000","last_fullsized":"2024-06-06T03:24:14.698608+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:24:32.668781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'1","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.370535+0000","last_change":"2024-06-06T03:22:31.054686+0000","last_active":"2024-06-06T03:24:15.370535+0000","last_peered":"2024-06-06T03:24:15.370535+0000","last_clean":"2024-06-06T03:24:15.370535+0000","last_became_active":"2024-06-06T03:22:31.053219+0000","last_became_peered":"2024-06-06T03:22:31.053219+0000","last_unstale":"2024-06-06T03:24:15.370535+0000","last_undegraded":"2024-06-06T03:24:15.370535+0000","last_fullsized":"2024-06-06T03:24:15.370535+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:32:27.423208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.368737+0000","last_change":"2024-06-06T03:22:34.304916+0000","last_active":"2024-06-06T03:25:13.368737+0000","last_peered":"2024-06-06T03:25:13.368737+0000","last_clean":"2024-06-06T03:25:13.368737+0000","last_became_active":"2024-06-06T03:22:34.302442+0000","last_became_peered":"2024-06-06T03:22:34.302442+0000","last_unstale":"2024-06-06T03:25:13.368737+0000","last_undegraded":"2024-06-06T03:25:13.368737+0000","last_fullsized":"2024-06-06T03:25:13.368737+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:01:24.034386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.370747+0000","last_change":"2024-06-06T03:22:44.415478+0000","last_active":"2024-06-06T03:24:15.370747+0000","last_peered":"2024-06-06T03:24:15.370747+0000","last_clean":"2024-06-06T03:24:15.370747+0000","last_became_active":"2024-06-06T03:22:44.415007+0000","last_became_peered":"2024-06-06T03:22:44.415007+0000","last_unstale":"2024-06-06T03:24:15.370747+0000","last_undegraded":"2024-06-06T03:24:15.370747+0000","last_fullsized":"2024-06-06T03:24:15.370747+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:57:47.793481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'2","reported_seq":57,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700897+0000","last_change":"2024-06-06T03:23:14.521037+0000","last_active":"2024-06-06T03:24:14.700897+0000","last_peered":"2024-06-06T03:24:14.700897+0000","last_clean":"2024-06-06T03:24:14.700897+0000","last_became_active":"2024-06-06T03:23:14.517922+0000","last_became_peered":"2024-06-06T03:23:14.517922+0000","last_unstale":"2024-06-06T03:24:14.700897+0000","last_undegraded":"2024-06-06T03:24:14.700897+0000","last_fullsized":"2024-06-06T03:24:14.700897+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:12:46.222984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.370655+0000","last_change":"2024-06-06T03:22:34.305178+0000","last_active":"2024-06-06T03:25:13.370655+0000","last_peered":"2024-06-06T03:25:13.370655+0000","last_clean":"2024-06-06T03:25:13.370655+0000","last_became_active":"2024-06-06T03:22:34.302420+0000","last_became_peered":"2024-06-06T03:22:34.302420+0000","last_unstale":"2024-06-06T03:25:13.370655+0000","last_undegraded":"2024-06-06T03:25:13.370655+0000","last_fullsized":"2024-06-06T03:25:13.370655+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:22:08.736542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"99'9","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369693+0000","last_change":"2024-06-06T03:23:14.514756+0000","last_active":"2024-06-06T03:25:13.369693+0000","last_peered":"2024-06-06T03:25:13.369693+0000","last_clean":"2024-06-06T03:25:13.369693+0000","last_became_active":"2024-06-06T03:23:14.514325+0000","last_became_peered":"2024-06-06T03:23:14.514325+0000","last_unstale":"2024-06-06T03:25:13.369693+0000","last_undegraded":"2024-06-06T03:25:13.369693+0000","last_fullsized":"2024-06-06T03:25:13.369693+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:45:44.594836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"99'12","reported_seq":51,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369056+0000","last_change":"2024-06-06T03:22:34.298570+0000","last_active":"2024-06-06T03:25:13.369056+0000","last_peered":"2024-06-06T03:25:13.369056+0000","last_clean":"2024-06-06T03:25:13.369056+0000","last_became_active":"2024-06-06T03:22:34.298137+0000","last_became_peered":"2024-06-06T03:22:34.298137+0000","last_unstale":"2024-06-06T03:25:13.369056+0000","last_undegraded":"2024-06-06T03:25:13.369056+0000","last_fullsized":"2024-06-06T03:25:13.369056+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:07:25.290355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.362822+0000","last_change":"2024-06-06T03:22:34.297750+0000","last_active":"2024-06-06T03:25:13.362822+0000","last_peered":"2024-06-06T03:25:13.362822+0000","last_clean":"2024-06-06T03:25:13.362822+0000","last_became_active":"2024-06-06T03:22:34.297264+0000","last_became_peered":"2024-06-06T03:22:34.297264+0000","last_unstale":"2024-06-06T03:25:13.362822+0000","last_undegraded":"2024-06-06T03:25:13.362822+0000","last_fullsized":"2024-06-06T03:25:13.362822+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:14:58.580044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"99'7","reported_seq":52,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.357808+0000","last_change":"2024-06-06T03:23:14.832804+0000","last_active":"2024-06-06T03:25:13.357808+0000","last_peered":"2024-06-06T03:25:13.357808+0000","last_clean":"2024-06-06T03:25:13.357808+0000","last_became_active":"2024-06-06T03:23:14.832448+0000","last_became_peered":"2024-06-06T03:23:14.832448+0000","last_unstale":"2024-06-06T03:25:13.357808+0000","last_undegraded":"2024-06-06T03:25:13.357808+0000","last_fullsized":"2024-06-06T03:25:13.357808+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:52:16.907033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"99'4","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.366112+0000","last_change":"2024-06-06T03:23:14.515841+0000","last_active":"2024-06-06T03:25:13.366112+0000","last_peered":"2024-06-06T03:25:13.366112+0000","last_clean":"2024-06-06T03:25:13.366112+0000","last_became_active":"2024-06-06T03:23:14.515331+0000","last_became_peered":"2024-06-06T03:23:14.515331+0000","last_unstale":"2024-06-06T03:25:13.366112+0000","last_undegraded":"2024-06-06T03:25:13.366112+0000","last_fullsized":"2024-06-06T03:25:13.366112+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:46:57.178054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371197+0000","last_change":"2024-06-06T03:22:34.299660+0000","last_active":"2024-06-06T03:25:13.371197+0000","last_peered":"2024-06-06T03:25:13.371197+0000","last_clean":"2024-06-06T03:25:13.371197+0000","last_became_active":"2024-06-06T03:22:34.298411+0000","last_became_peered":"2024-06-06T03:22:34.298411+0000","last_unstale":"2024-06-06T03:25:13.371197+0000","last_undegraded":"2024-06-06T03:25:13.371197+0000","last_fullsized":"2024-06-06T03:25:13.371197+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:29:16.170700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"99'15","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.351954+0000","last_change":"2024-06-06T03:22:34.308110+0000","last_active":"2024-06-06T03:25:13.351954+0000","last_peered":"2024-06-06T03:25:13.351954+0000","last_clean":"2024-06-06T03:25:13.351954+0000","last_became_active":"2024-06-06T03:22:34.307637+0000","last_became_peered":"2024-06-06T03:22:34.307637+0000","last_unstale":"2024-06-06T03:25:13.351954+0000","last_undegraded":"2024-06-06T03:25:13.351954+0000","last_fullsized":"2024-06-06T03:25:13.351954+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:40:23.264509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"99'2","reported_seq":41,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.368343+0000","last_change":"2024-06-06T03:22:34.295494+0000","last_active":"2024-06-06T03:25:13.368343+0000","last_peered":"2024-06-06T03:25:13.368343+0000","last_clean":"2024-06-06T03:25:13.368343+0000","last_became_active":"2024-06-06T03:22:34.295101+0000","last_became_peered":"2024-06-06T03:22:34.295101+0000","last_unstale":"2024-06-06T03:25:13.368343+0000","last_undegraded":"2024-06-06T03:25:13.368343+0000","last_fullsized":"2024-06-06T03:25:13.368343+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:39:07.298053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.373117+0000","last_change":"2024-06-06T03:22:34.291312+0000","last_active":"2024-06-06T03:25:13.373117+0000","last_peered":"2024-06-06T03:25:13.373117+0000","last_clean":"2024-06-06T03:25:13.373117+0000","last_became_active":"2024-06-06T03:22:34.290971+0000","last_became_peered":"2024-06-06T03:22:34.290971+0000","last_unstale":"2024-06-06T03:25:13.373117+0000","last_undegraded":"2024-06-06T03:25:13.373117+0000","last_fullsized":"2024-06-06T03:25:13.373117+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:06:27.333831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.372533+0000","last_change":"2024-06-06T03:22:34.292000+0000","last_active":"2024-06-06T03:25:13.372533+0000","last_peered":"2024-06-06T03:25:13.372533+0000","last_clean":"2024-06-06T03:25:13.372533+0000","last_became_active":"2024-06-06T03:22:34.291500+0000","last_became_peered":"2024-06-06T03:22:34.291500+0000","last_unstale":"2024-06-06T03:25:13.372533+0000","last_undegraded":"2024-06-06T03:25:13.372533+0000","last_fullsized":"2024-06-06T03:25:13.372533+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:37:20.677107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369963+0000","last_change":"2024-06-06T03:22:34.303138+0000","last_active":"2024-06-06T03:25:13.369963+0000","last_peered":"2024-06-06T03:25:13.369963+0000","last_clean":"2024-06-06T03:25:13.369963+0000","last_became_active":"2024-06-06T03:22:34.302758+0000","last_became_peered":"2024-06-06T03:22:34.302758+0000","last_unstale":"2024-06-06T03:25:13.369963+0000","last_undegraded":"2024-06-06T03:25:13.369963+0000","last_fullsized":"2024-06-06T03:25:13.369963+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:34:18.516891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371585+0000","last_change":"2024-06-06T03:22:34.297035+0000","last_active":"2024-06-06T03:25:13.371585+0000","last_peered":"2024-06-06T03:25:13.371585+0000","last_clean":"2024-06-06T03:25:13.371585+0000","last_became_active":"2024-06-06T03:22:34.296706+0000","last_became_peered":"2024-06-06T03:22:34.296706+0000","last_unstale":"2024-06-06T03:25:13.371585+0000","last_undegraded":"2024-06-06T03:25:13.371585+0000","last_fullsized":"2024-06-06T03:25:13.371585+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:26:26.959215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371786+0000","last_change":"2024-06-06T03:22:34.296365+0000","last_active":"2024-06-06T03:25:13.371786+0000","last_peered":"2024-06-06T03:25:13.371786+0000","last_clean":"2024-06-06T03:25:13.371786+0000","last_became_active":"2024-06-06T03:22:34.296021+0000","last_became_peered":"2024-06-06T03:22:34.296021+0000","last_unstale":"2024-06-06T03:25:13.371786+0000","last_undegraded":"2024-06-06T03:25:13.371786+0000","last_fullsized":"2024-06-06T03:25:13.371786+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:40:33.183110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":249510,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72250,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":1076,"num_read_kb":615,"num_write":188,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":216750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383743,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32248,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712904,"statfs":{"total":95995035648,"available":95962013696,"internally_reserved":0,"allocated":1097728,"data_stored":569692,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645379,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28236,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716916,"statfs":{"total":95995035648,"available":95966121984,"internally_reserved":0,"allocated":1249280,"data_stored":1229182,"data_compressed":68620,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808905,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1110016,"data_stored":569906,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070542,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1105920,"data_stored":569804,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332180,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32308,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712844,"statfs":{"total":95995035648,"available":95961952256,"internally_reserved":0,"allocated":1159168,"data_stored":1166859,"data_compressed":68620,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495706,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36400,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708752,"statfs":{"total":95995035648,"available":95957762048,"internally_reserved":0,"allocated":1089536,"data_stored":565082,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574962,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28152,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717000,"statfs":{"total":95995035648,"available":95966208000,"internally_reserved":0,"allocated":1163264,"data_stored":632117,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738487,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36424,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708728,"statfs":{"total":95995035648,"available":95957737472,"internally_reserved":0,"allocated":1114112,"data_stored":566470,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411438,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36496,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708656,"statfs":{"total":95995035648,"available":95957663744,"internally_reserved":0,"allocated":1187840,"data_stored":633959,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182504,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1101824,"data_stored":565276,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920868,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32252,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712900,"statfs":{"total":95995035648,"available":95962009600,"internally_reserved":0,"allocated":1101824,"data_stored":570755,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757343,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32316,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712836,"statfs":{"total":95995035648,"available":95961944064,"internally_reserved":0,"allocated":1167360,"data_stored":1161424,"data_compressed":68620,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34475,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34475,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-06T03:26:30.638 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-06T03:26:30.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.779+0000 7fa7b21c8640 1 -- 172.21.15.50:0/1566333443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7ac1008e0 msgr2=0x7fa7ac100d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:30.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.779+0000 7fa7b21c8640 1 --2- 172.21.15.50:0/1566333443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7ac1008e0 0x7fa7ac100d00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa79c009900 tx=0x7fa79c02a410 comp rx=0 tx=0).stop 2024-06-06T03:26:30.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.779+0000 7fa7b21c8640 1 -- 172.21.15.50:0/1566333443 shutdown_connections 2024-06-06T03:26:30.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.779+0000 7fa7b21c8640 1 --2- 172.21.15.50:0/1566333443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7ac102490 0x7fa7ac108d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:30.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.779+0000 7fa7b21c8640 1 --2- 172.21.15.50:0/1566333443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7ac101ad0 0x7fa7ac101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:30.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.779+0000 7fa7b21c8640 1 --2- 172.21.15.50:0/1566333443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7ac1008e0 0x7fa7ac100d00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:30.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.779+0000 7fa7b21c8640 1 -- 172.21.15.50:0/1566333443 >> 172.21.15.50:0/1566333443 conn(0x7fa7ac0fbe50 msgr2=0x7fa7ac0fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:30.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.779+0000 7fa7b21c8640 1 -- 172.21.15.50:0/1566333443 shutdown_connections 2024-06-06T03:26:30.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.779+0000 7fa7b21c8640 1 -- 172.21.15.50:0/1566333443 wait complete. 2024-06-06T03:26:30.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.779+0000 7fa7b21c8640 1 Processor -- start 2024-06-06T03:26:30.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.779+0000 7fa7b21c8640 1 -- start start 2024-06-06T03:26:30.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.780+0000 7fa7b21c8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7ac1008e0 0x7fa7ac197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:30.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.780+0000 7fa7b21c8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7ac101ad0 0x7fa7ac198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:30.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.780+0000 7fa7b21c8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7ac102490 0x7fa7ac19f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:30.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.780+0000 7fa7b21c8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac10d570 con 0x7fa7ac1008e0 2024-06-06T03:26:30.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.780+0000 7fa7b21c8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac10d3f0 con 0x7fa7ac101ad0 2024-06-06T03:26:30.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.780+0000 7fa7b21c8640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac10d6f0 con 0x7fa7ac102490 2024-06-06T03:26:30.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.780+0000 7fa7ab7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7ac1008e0 0x7fa7ac197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:30.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.780+0000 7fa7ab7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7ac1008e0 0x7fa7ac197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58186/0 (socket says 172.21.15.50:58186) 2024-06-06T03:26:30.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.780+0000 7fa7ab7fe640 1 -- 172.21.15.50:0/2854518548 learned_addr learned my addr 172.21.15.50:0/2854518548 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:30.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.780+0000 7fa7abfff640 1 --2- 172.21.15.50:0/2854518548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7ac102490 0x7fa7ac19f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:30.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.780+0000 7fa7ab7fe640 1 -- 172.21.15.50:0/2854518548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7ac102490 msgr2=0x7fa7ac19f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:30.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.780+0000 7fa7ab7fe640 1 --2- 172.21.15.50:0/2854518548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7ac102490 0x7fa7ac19f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:30.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.780+0000 7fa7aaffd640 1 --2- 172.21.15.50:0/2854518548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7ac101ad0 0x7fa7ac198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:30.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.780+0000 7fa7ab7fe640 1 -- 172.21.15.50:0/2854518548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7ac101ad0 msgr2=0x7fa7ac198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:30.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.780+0000 7fa7ab7fe640 1 --2- 172.21.15.50:0/2854518548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7ac101ad0 0x7fa7ac198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:30.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.780+0000 7fa7ab7fe640 1 -- 172.21.15.50:0/2854518548 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7ac19f900 con 0x7fa7ac1008e0 2024-06-06T03:26:30.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.780+0000 7fa7abfff640 1 --2- 172.21.15.50:0/2854518548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7ac102490 0x7fa7ac19f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:26:30.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.780+0000 7fa7ab7fe640 1 --2- 172.21.15.50:0/2854518548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7ac1008e0 0x7fa7ac197cf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa79c009230 tx=0x7fa79c004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:30.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.780+0000 7fa7a8ff9640 1 -- 172.21.15.50:0/2854518548 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c03f030 con 0x7fa7ac1008e0 2024-06-06T03:26:30.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.780+0000 7fa7a8ff9640 1 -- 172.21.15.50:0/2854518548 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa79c003cb0 con 0x7fa7ac1008e0 2024-06-06T03:26:30.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.780+0000 7fa7b21c8640 1 -- 172.21.15.50:0/2854518548 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7ac19fb90 con 0x7fa7ac1008e0 2024-06-06T03:26:30.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.780+0000 7fa7a8ff9640 1 -- 172.21.15.50:0/2854518548 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c035070 con 0x7fa7ac1008e0 2024-06-06T03:26:30.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.781+0000 7fa7b21c8640 1 -- 172.21.15.50:0/2854518548 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7ac1a00d0 con 0x7fa7ac1008e0 2024-06-06T03:26:30.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.782+0000 7fa7b21c8640 1 -- 172.21.15.50:0/2854518548 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7ac107cd0 con 0x7fa7ac1008e0 2024-06-06T03:26:30.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.783+0000 7fa7a8ff9640 1 -- 172.21.15.50:0/2854518548 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa79c042030 con 0x7fa7ac1008e0 2024-06-06T03:26:30.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.784+0000 7fa7a8ff9640 1 --2- 172.21.15.50:0/2854518548 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa7940a2c10 0x7fa7940a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:30.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.784+0000 7fa7aaffd640 1 --2- 172.21.15.50:0/2854518548 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa7940a2c10 0x7fa7940a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:30.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.784+0000 7fa7a8ff9640 1 -- 172.21.15.50:0/2854518548 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fa79c0efb70 con 0x7fa7ac1008e0 2024-06-06T03:26:30.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.784+0000 7fa7aaffd640 1 --2- 172.21.15.50:0/2854518548 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa7940a2c10 0x7fa7940a50d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa7a00058c0 tx=0x7fa7a0005c60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:30.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.788+0000 7fa7a8ff9640 1 -- 172.21.15.50:0/2854518548 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa79c0bc6f0 con 0x7fa7ac1008e0 2024-06-06T03:26:30.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:30 smithi122 ceph-mon[35759]: pgmap v427: 129 pgs: 129 active+clean; 647 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-06-06T03:26:30.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.969+0000 7fa7b21c8640 1 -- 172.21.15.50:0/2854518548 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa7ac061de0 con 0x7fa7940a2c10 2024-06-06T03:26:30.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.979+0000 7fa7a8ff9640 1 -- 172.21.15.50:0/2854518548 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340748 (secure 0 0 0) 0x7fa7ac061de0 con 0x7fa7940a2c10 2024-06-06T03:26:30.981 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:26:30.983 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-06-06T03:26:30.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.983+0000 7fa7b21c8640 1 -- 172.21.15.50:0/2854518548 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa7940a2c10 msgr2=0x7fa7940a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:30.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.983+0000 7fa7b21c8640 1 --2- 172.21.15.50:0/2854518548 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa7940a2c10 0x7fa7940a50d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa7a00058c0 tx=0x7fa7a0005c60 comp rx=0 tx=0).stop 2024-06-06T03:26:30.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.983+0000 7fa7b21c8640 1 -- 172.21.15.50:0/2854518548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7ac1008e0 msgr2=0x7fa7ac197cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:30.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.983+0000 7fa7b21c8640 1 --2- 172.21.15.50:0/2854518548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7ac1008e0 0x7fa7ac197cf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa79c009230 tx=0x7fa79c004340 comp rx=0 tx=0).stop 2024-06-06T03:26:30.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.983+0000 7fa7b21c8640 1 -- 172.21.15.50:0/2854518548 shutdown_connections 2024-06-06T03:26:30.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.983+0000 7fa7b21c8640 1 --2- 172.21.15.50:0/2854518548 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa7940a2c10 0x7fa7940a50d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:30.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.983+0000 7fa7b21c8640 1 --2- 172.21.15.50:0/2854518548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7ac102490 0x7fa7ac19f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:30.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.983+0000 7fa7b21c8640 1 --2- 172.21.15.50:0/2854518548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7ac101ad0 0x7fa7ac198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:30.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.983+0000 7fa7b21c8640 1 --2- 172.21.15.50:0/2854518548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7ac1008e0 0x7fa7ac197cf0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:30.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.983+0000 7fa7b21c8640 1 -- 172.21.15.50:0/2854518548 >> 172.21.15.50:0/2854518548 conn(0x7fa7ac0fbe50 msgr2=0x7fa7ac104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:30.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.983+0000 7fa7b21c8640 1 -- 172.21.15.50:0/2854518548 shutdown_connections 2024-06-06T03:26:30.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:30.983+0000 7fa7b21c8640 1 -- 172.21.15.50:0/2854518548 wait complete. 2024-06-06T03:26:30.992 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:30 smithi050 ceph-mon[32421]: pgmap v427: 129 pgs: 129 active+clean; 647 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-06-06T03:26:30.993 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":427,"stamp":"2024-06-06T03:26:29.401942+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662852,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":1202,"num_read_kb":724,"num_write":371,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":798,"ondisk_log_size":798,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":379120,"kb_used_data":13328,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124562704,"statfs":{"total":1151940427776,"available":1151552208896,"internally_reserved":0,"allocated":13647872,"data_stored":8800526,"data_compressed":498432,"data_compressed_allocated":675840,"data_compressed_original":2850816,"omap_allocated":19141,"internal_metadata":374453563},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5790,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":53,"num_write":11,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002990"},"pg_stats":[{"pgid":"3.3f","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.361304+0000","last_change":"2024-06-06T03:22:34.302364+0000","last_active":"2024-06-06T03:25:13.361304+0000","last_peered":"2024-06-06T03:25:13.361304+0000","last_clean":"2024-06-06T03:25:13.361304+0000","last_became_active":"2024-06-06T03:22:34.300403+0000","last_became_peered":"2024-06-06T03:22:34.300403+0000","last_unstale":"2024-06-06T03:25:13.361304+0000","last_undegraded":"2024-06-06T03:25:13.361304+0000","last_fullsized":"2024-06-06T03:25:13.361304+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:27:55.377346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"99'4","reported_seq":43,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.361468+0000","last_change":"2024-06-06T03:22:34.306188+0000","last_active":"2024-06-06T03:25:13.361468+0000","last_peered":"2024-06-06T03:25:13.361468+0000","last_clean":"2024-06-06T03:25:13.361468+0000","last_became_active":"2024-06-06T03:22:34.305705+0000","last_became_peered":"2024-06-06T03:22:34.305705+0000","last_unstale":"2024-06-06T03:25:13.361468+0000","last_undegraded":"2024-06-06T03:25:13.361468+0000","last_fullsized":"2024-06-06T03:25:13.361468+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:10:07.337989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369892+0000","last_change":"2024-06-06T03:22:34.303568+0000","last_active":"2024-06-06T03:25:13.369892+0000","last_peered":"2024-06-06T03:25:13.369892+0000","last_clean":"2024-06-06T03:25:13.369892+0000","last_became_active":"2024-06-06T03:22:34.303194+0000","last_became_peered":"2024-06-06T03:22:34.303194+0000","last_unstale":"2024-06-06T03:25:13.369892+0000","last_undegraded":"2024-06-06T03:25:13.369892+0000","last_fullsized":"2024-06-06T03:25:13.369892+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:40:46.387476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.356411+0000","last_change":"2024-06-06T03:22:34.303896+0000","last_active":"2024-06-06T03:25:13.356411+0000","last_peered":"2024-06-06T03:25:13.356411+0000","last_clean":"2024-06-06T03:25:13.356411+0000","last_became_active":"2024-06-06T03:22:34.303568+0000","last_became_peered":"2024-06-06T03:22:34.303568+0000","last_unstale":"2024-06-06T03:25:13.356411+0000","last_undegraded":"2024-06-06T03:25:13.356411+0000","last_fullsized":"2024-06-06T03:25:13.356411+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:24:20.160115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"99'4","reported_seq":43,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.358644+0000","last_change":"2024-06-06T03:22:34.289868+0000","last_active":"2024-06-06T03:25:13.358644+0000","last_peered":"2024-06-06T03:25:13.358644+0000","last_clean":"2024-06-06T03:25:13.358644+0000","last_became_active":"2024-06-06T03:22:34.289485+0000","last_became_peered":"2024-06-06T03:22:34.289485+0000","last_unstale":"2024-06-06T03:25:13.358644+0000","last_undegraded":"2024-06-06T03:25:13.358644+0000","last_fullsized":"2024-06-06T03:25:13.358644+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:28:58.226092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.347487+0000","last_change":"2024-06-06T03:22:34.304643+0000","last_active":"2024-06-06T03:25:13.347487+0000","last_peered":"2024-06-06T03:25:13.347487+0000","last_clean":"2024-06-06T03:25:13.347487+0000","last_became_active":"2024-06-06T03:22:34.303342+0000","last_became_peered":"2024-06-06T03:22:34.303342+0000","last_unstale":"2024-06-06T03:25:13.347487+0000","last_undegraded":"2024-06-06T03:25:13.347487+0000","last_fullsized":"2024-06-06T03:25:13.347487+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:28:27.838518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.368466+0000","last_change":"2024-06-06T03:22:34.304958+0000","last_active":"2024-06-06T03:25:13.368466+0000","last_peered":"2024-06-06T03:25:13.368466+0000","last_clean":"2024-06-06T03:25:13.368466+0000","last_became_active":"2024-06-06T03:22:34.304582+0000","last_became_peered":"2024-06-06T03:22:34.304582+0000","last_unstale":"2024-06-06T03:25:13.368466+0000","last_undegraded":"2024-06-06T03:25:13.368466+0000","last_fullsized":"2024-06-06T03:25:13.368466+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:08:56.304446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371907+0000","last_change":"2024-06-06T03:22:34.299883+0000","last_active":"2024-06-06T03:25:13.371907+0000","last_peered":"2024-06-06T03:25:13.371907+0000","last_clean":"2024-06-06T03:25:13.371907+0000","last_became_active":"2024-06-06T03:22:34.299568+0000","last_became_peered":"2024-06-06T03:22:34.299568+0000","last_unstale":"2024-06-06T03:25:13.371907+0000","last_undegraded":"2024-06-06T03:25:13.371907+0000","last_fullsized":"2024-06-06T03:25:13.371907+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:23:32.479592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369788+0000","last_change":"2024-06-06T03:22:34.303157+0000","last_active":"2024-06-06T03:25:13.369788+0000","last_peered":"2024-06-06T03:25:13.369788+0000","last_clean":"2024-06-06T03:25:13.369788+0000","last_became_active":"2024-06-06T03:22:34.302332+0000","last_became_peered":"2024-06-06T03:22:34.302332+0000","last_unstale":"2024-06-06T03:25:13.369788+0000","last_undegraded":"2024-06-06T03:25:13.369788+0000","last_fullsized":"2024-06-06T03:25:13.369788+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:27:32.420058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"99'16","reported_seq":61,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.352791+0000","last_change":"2024-06-06T03:23:14.517357+0000","last_active":"2024-06-06T03:25:13.352791+0000","last_peered":"2024-06-06T03:25:13.352791+0000","last_clean":"2024-06-06T03:25:13.352791+0000","last_became_active":"2024-06-06T03:23:14.516932+0000","last_became_peered":"2024-06-06T03:23:14.516932+0000","last_unstale":"2024-06-06T03:25:13.352791+0000","last_undegraded":"2024-06-06T03:25:13.352791+0000","last_fullsized":"2024-06-06T03:25:13.352791+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:23:43.907192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369989+0000","last_change":"2024-06-06T03:22:34.310010+0000","last_active":"2024-06-06T03:25:13.369989+0000","last_peered":"2024-06-06T03:25:13.369989+0000","last_clean":"2024-06-06T03:25:13.369989+0000","last_became_active":"2024-06-06T03:22:34.309636+0000","last_became_peered":"2024-06-06T03:22:34.309636+0000","last_unstale":"2024-06-06T03:25:13.369989+0000","last_undegraded":"2024-06-06T03:25:13.369989+0000","last_fullsized":"2024-06-06T03:25:13.369989+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:35:53.745050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.351414+0000","last_change":"2024-06-06T03:22:34.311364+0000","last_active":"2024-06-06T03:25:13.351414+0000","last_peered":"2024-06-06T03:25:13.351414+0000","last_clean":"2024-06-06T03:25:13.351414+0000","last_became_active":"2024-06-06T03:22:34.311003+0000","last_became_peered":"2024-06-06T03:22:34.311003+0000","last_unstale":"2024-06-06T03:25:13.351414+0000","last_undegraded":"2024-06-06T03:25:13.351414+0000","last_fullsized":"2024-06-06T03:25:13.351414+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:35:32.460362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.372924+0000","last_change":"2024-06-06T03:22:34.302843+0000","last_active":"2024-06-06T03:25:13.372924+0000","last_peered":"2024-06-06T03:25:13.372924+0000","last_clean":"2024-06-06T03:25:13.372924+0000","last_became_active":"2024-06-06T03:22:34.302581+0000","last_became_peered":"2024-06-06T03:22:34.302581+0000","last_unstale":"2024-06-06T03:25:13.372924+0000","last_undegraded":"2024-06-06T03:25:13.372924+0000","last_fullsized":"2024-06-06T03:25:13.372924+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:56:14.178848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.362752+0000","last_change":"2024-06-06T03:22:34.305792+0000","last_active":"2024-06-06T03:25:13.362752+0000","last_peered":"2024-06-06T03:25:13.362752+0000","last_clean":"2024-06-06T03:25:13.362752+0000","last_became_active":"2024-06-06T03:22:34.305389+0000","last_became_peered":"2024-06-06T03:22:34.305389+0000","last_unstale":"2024-06-06T03:25:13.362752+0000","last_undegraded":"2024-06-06T03:25:13.362752+0000","last_fullsized":"2024-06-06T03:25:13.362752+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:17:05.992382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369254+0000","last_change":"2024-06-06T03:22:34.298396+0000","last_active":"2024-06-06T03:25:13.369254+0000","last_peered":"2024-06-06T03:25:13.369254+0000","last_clean":"2024-06-06T03:25:13.369254+0000","last_became_active":"2024-06-06T03:22:34.297697+0000","last_became_peered":"2024-06-06T03:22:34.297697+0000","last_unstale":"2024-06-06T03:25:13.369254+0000","last_undegraded":"2024-06-06T03:25:13.369254+0000","last_fullsized":"2024-06-06T03:25:13.369254+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:24:07.143699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369399+0000","last_change":"2024-06-06T03:22:34.312801+0000","last_active":"2024-06-06T03:25:13.369399+0000","last_peered":"2024-06-06T03:25:13.369399+0000","last_clean":"2024-06-06T03:25:13.369399+0000","last_became_active":"2024-06-06T03:22:34.312206+0000","last_became_peered":"2024-06-06T03:22:34.312206+0000","last_unstale":"2024-06-06T03:25:13.369399+0000","last_undegraded":"2024-06-06T03:25:13.369399+0000","last_fullsized":"2024-06-06T03:25:13.369399+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:31:41.286548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.364965+0000","last_change":"2024-06-06T03:22:34.303527+0000","last_active":"2024-06-06T03:25:13.364965+0000","last_peered":"2024-06-06T03:25:13.364965+0000","last_clean":"2024-06-06T03:25:13.364965+0000","last_became_active":"2024-06-06T03:22:34.302919+0000","last_became_peered":"2024-06-06T03:22:34.302919+0000","last_unstale":"2024-06-06T03:25:13.364965+0000","last_undegraded":"2024-06-06T03:25:13.364965+0000","last_fullsized":"2024-06-06T03:25:13.364965+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:41:44.128543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.356298+0000","last_change":"2024-06-06T03:22:34.304801+0000","last_active":"2024-06-06T03:25:13.356298+0000","last_peered":"2024-06-06T03:25:13.356298+0000","last_clean":"2024-06-06T03:25:13.356298+0000","last_became_active":"2024-06-06T03:22:34.304463+0000","last_became_peered":"2024-06-06T03:22:34.304463+0000","last_unstale":"2024-06-06T03:25:13.356298+0000","last_undegraded":"2024-06-06T03:25:13.356298+0000","last_fullsized":"2024-06-06T03:25:13.356298+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:28:22.789816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.365052+0000","last_change":"2024-06-06T03:22:34.290053+0000","last_active":"2024-06-06T03:25:13.365052+0000","last_peered":"2024-06-06T03:25:13.365052+0000","last_clean":"2024-06-06T03:25:13.365052+0000","last_became_active":"2024-06-06T03:22:34.289712+0000","last_became_peered":"2024-06-06T03:22:34.289712+0000","last_unstale":"2024-06-06T03:25:13.365052+0000","last_undegraded":"2024-06-06T03:25:13.365052+0000","last_fullsized":"2024-06-06T03:25:13.365052+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:12:02.296431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973398+0000","last_change":"2024-06-06T03:22:44.421722+0000","last_active":"2024-06-06T03:24:14.973398+0000","last_peered":"2024-06-06T03:24:14.973398+0000","last_clean":"2024-06-06T03:24:14.973398+0000","last_became_active":"2024-06-06T03:22:44.421215+0000","last_became_peered":"2024-06-06T03:22:44.421215+0000","last_unstale":"2024-06-06T03:24:14.973398+0000","last_undegraded":"2024-06-06T03:24:14.973398+0000","last_fullsized":"2024-06-06T03:24:14.973398+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:22:59.749839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"97'9","reported_seq":55,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.379751+0000","last_change":"2024-06-06T03:22:31.053826+0000","last_active":"2024-06-06T03:24:15.379751+0000","last_peered":"2024-06-06T03:24:15.379751+0000","last_clean":"2024-06-06T03:24:15.379751+0000","last_became_active":"2024-06-06T03:22:31.053537+0000","last_became_peered":"2024-06-06T03:22:31.053537+0000","last_unstale":"2024-06-06T03:24:15.379751+0000","last_undegraded":"2024-06-06T03:24:15.379751+0000","last_fullsized":"2024-06-06T03:24:15.379751+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:18:52.967104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371315+0000","last_change":"2024-06-06T03:22:34.291554+0000","last_active":"2024-06-06T03:25:13.371315+0000","last_peered":"2024-06-06T03:25:13.371315+0000","last_clean":"2024-06-06T03:25:13.371315+0000","last_became_active":"2024-06-06T03:22:34.290600+0000","last_became_peered":"2024-06-06T03:22:34.290600+0000","last_unstale":"2024-06-06T03:25:13.371315+0000","last_undegraded":"2024-06-06T03:25:13.371315+0000","last_fullsized":"2024-06-06T03:25:13.371315+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:03:32.860134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163376+0000","last_change":"2024-06-06T03:22:44.424337+0000","last_active":"2024-06-06T03:24:15.163376+0000","last_peered":"2024-06-06T03:24:15.163376+0000","last_clean":"2024-06-06T03:24:15.163376+0000","last_became_active":"2024-06-06T03:22:44.423919+0000","last_became_peered":"2024-06-06T03:22:44.423919+0000","last_unstale":"2024-06-06T03:24:15.163376+0000","last_undegraded":"2024-06-06T03:24:15.163376+0000","last_fullsized":"2024-06-06T03:24:15.163376+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:34:32.801117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"97'2","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.379810+0000","last_change":"2024-06-06T03:22:31.242326+0000","last_active":"2024-06-06T03:24:15.379810+0000","last_peered":"2024-06-06T03:24:15.379810+0000","last_clean":"2024-06-06T03:24:15.379810+0000","last_became_active":"2024-06-06T03:22:31.241960+0000","last_became_peered":"2024-06-06T03:22:31.241960+0000","last_unstale":"2024-06-06T03:24:15.379810+0000","last_undegraded":"2024-06-06T03:24:15.379810+0000","last_fullsized":"2024-06-06T03:24:15.379810+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:19:57.820119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369698+0000","last_change":"2024-06-06T03:22:34.303438+0000","last_active":"2024-06-06T03:25:13.369698+0000","last_peered":"2024-06-06T03:25:13.369698+0000","last_clean":"2024-06-06T03:25:13.369698+0000","last_became_active":"2024-06-06T03:22:34.302057+0000","last_became_peered":"2024-06-06T03:22:34.302057+0000","last_unstale":"2024-06-06T03:25:13.369698+0000","last_undegraded":"2024-06-06T03:25:13.369698+0000","last_fullsized":"2024-06-06T03:25:13.369698+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:52:20.508656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163601+0000","last_change":"2024-06-06T03:22:44.424732+0000","last_active":"2024-06-06T03:24:15.163601+0000","last_peered":"2024-06-06T03:24:15.163601+0000","last_clean":"2024-06-06T03:24:15.163601+0000","last_became_active":"2024-06-06T03:22:44.423906+0000","last_became_peered":"2024-06-06T03:22:44.423906+0000","last_unstale":"2024-06-06T03:24:15.163601+0000","last_undegraded":"2024-06-06T03:24:15.163601+0000","last_fullsized":"2024-06-06T03:24:15.163601+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:45:04.344747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"97'4","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700231+0000","last_change":"2024-06-06T03:22:31.057003+0000","last_active":"2024-06-06T03:24:14.700231+0000","last_peered":"2024-06-06T03:24:14.700231+0000","last_clean":"2024-06-06T03:24:14.700231+0000","last_became_active":"2024-06-06T03:22:31.056660+0000","last_became_peered":"2024-06-06T03:22:31.056660+0000","last_unstale":"2024-06-06T03:24:14.700231+0000","last_undegraded":"2024-06-06T03:24:14.700231+0000","last_fullsized":"2024-06-06T03:24:14.700231+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:44:16.726749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.367434+0000","last_change":"2024-06-06T03:22:34.306196+0000","last_active":"2024-06-06T03:25:13.367434+0000","last_peered":"2024-06-06T03:25:13.367434+0000","last_clean":"2024-06-06T03:25:13.367434+0000","last_became_active":"2024-06-06T03:22:34.304962+0000","last_became_peered":"2024-06-06T03:22:34.304962+0000","last_unstale":"2024-06-06T03:25:13.367434+0000","last_undegraded":"2024-06-06T03:25:13.367434+0000","last_fullsized":"2024-06-06T03:25:13.367434+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:25:04.990371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163359+0000","last_change":"2024-06-06T03:22:44.419624+0000","last_active":"2024-06-06T03:24:15.163359+0000","last_peered":"2024-06-06T03:24:15.163359+0000","last_clean":"2024-06-06T03:24:15.163359+0000","last_became_active":"2024-06-06T03:22:44.418713+0000","last_became_peered":"2024-06-06T03:22:44.418713+0000","last_unstale":"2024-06-06T03:24:15.163359+0000","last_undegraded":"2024-06-06T03:24:15.163359+0000","last_fullsized":"2024-06-06T03:24:15.163359+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:04:54.010364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'2","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700029+0000","last_change":"2024-06-06T03:22:31.059332+0000","last_active":"2024-06-06T03:24:14.700029+0000","last_peered":"2024-06-06T03:24:14.700029+0000","last_clean":"2024-06-06T03:24:14.700029+0000","last_became_active":"2024-06-06T03:22:31.058478+0000","last_became_peered":"2024-06-06T03:22:31.058478+0000","last_unstale":"2024-06-06T03:24:14.700029+0000","last_undegraded":"2024-06-06T03:24:14.700029+0000","last_fullsized":"2024-06-06T03:24:14.700029+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:24:46.452708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"99'15","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.373335+0000","last_change":"2024-06-06T03:22:34.301650+0000","last_active":"2024-06-06T03:25:13.373335+0000","last_peered":"2024-06-06T03:25:13.373335+0000","last_clean":"2024-06-06T03:25:13.373335+0000","last_became_active":"2024-06-06T03:22:34.301220+0000","last_became_peered":"2024-06-06T03:22:34.301220+0000","last_unstale":"2024-06-06T03:25:13.373335+0000","last_undegraded":"2024-06-06T03:25:13.373335+0000","last_fullsized":"2024-06-06T03:25:13.373335+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:43:07.396971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973578+0000","last_change":"2024-06-06T03:22:44.413406+0000","last_active":"2024-06-06T03:24:14.973578+0000","last_peered":"2024-06-06T03:24:14.973578+0000","last_clean":"2024-06-06T03:24:14.973578+0000","last_became_active":"2024-06-06T03:22:44.412977+0000","last_became_peered":"2024-06-06T03:22:44.412977+0000","last_unstale":"2024-06-06T03:24:14.973578+0000","last_undegraded":"2024-06-06T03:24:14.973578+0000","last_fullsized":"2024-06-06T03:24:14.973578+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:11:02.017352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"99'6","reported_seq":227,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:26:26.863327+0000","last_change":"2024-06-06T03:22:31.056091+0000","last_active":"2024-06-06T03:26:26.863327+0000","last_peered":"2024-06-06T03:26:26.863327+0000","last_clean":"2024-06-06T03:26:26.863327+0000","last_became_active":"2024-06-06T03:22:31.055184+0000","last_became_peered":"2024-06-06T03:22:31.055184+0000","last_unstale":"2024-06-06T03:26:26.863327+0000","last_undegraded":"2024-06-06T03:26:26.863327+0000","last_fullsized":"2024-06-06T03:26:26.863327+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:32:37.761082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.357597+0000","last_change":"2024-06-06T03:22:34.305386+0000","last_active":"2024-06-06T03:25:13.357597+0000","last_peered":"2024-06-06T03:25:13.357597+0000","last_clean":"2024-06-06T03:25:13.357597+0000","last_became_active":"2024-06-06T03:22:34.304505+0000","last_became_peered":"2024-06-06T03:22:34.304505+0000","last_unstale":"2024-06-06T03:25:13.357597+0000","last_undegraded":"2024-06-06T03:25:13.357597+0000","last_fullsized":"2024-06-06T03:25:13.357597+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:34:31.800443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":36,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973665+0000","last_change":"2024-06-06T03:23:15.075519+0000","last_active":"2024-06-06T03:24:14.973665+0000","last_peered":"2024-06-06T03:24:14.973665+0000","last_clean":"2024-06-06T03:24:14.973665+0000","last_became_active":"2024-06-06T03:23:15.074970+0000","last_became_peered":"2024-06-06T03:23:15.074970+0000","last_unstale":"2024-06-06T03:24:14.973665+0000","last_undegraded":"2024-06-06T03:24:14.973665+0000","last_fullsized":"2024-06-06T03:24:14.973665+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:39:25.915175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.895888+0000","last_change":"2024-06-06T03:22:31.058530+0000","last_active":"2024-06-06T03:24:14.895888+0000","last_peered":"2024-06-06T03:24:14.895888+0000","last_clean":"2024-06-06T03:24:14.895888+0000","last_became_active":"2024-06-06T03:22:31.058185+0000","last_became_peered":"2024-06-06T03:22:31.058185+0000","last_unstale":"2024-06-06T03:24:14.895888+0000","last_undegraded":"2024-06-06T03:24:14.895888+0000","last_fullsized":"2024-06-06T03:24:14.895888+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:28:59.023322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.372958+0000","last_change":"2024-06-06T03:22:34.292995+0000","last_active":"2024-06-06T03:25:13.372958+0000","last_peered":"2024-06-06T03:25:13.372958+0000","last_clean":"2024-06-06T03:25:13.372958+0000","last_became_active":"2024-06-06T03:22:34.292625+0000","last_became_peered":"2024-06-06T03:22:34.292625+0000","last_unstale":"2024-06-06T03:25:13.372958+0000","last_undegraded":"2024-06-06T03:25:13.372958+0000","last_fullsized":"2024-06-06T03:25:13.372958+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:03:18.985660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380827+0000","last_change":"2024-06-06T03:22:44.417395+0000","last_active":"2024-06-06T03:24:15.380827+0000","last_peered":"2024-06-06T03:24:15.380827+0000","last_clean":"2024-06-06T03:24:15.380827+0000","last_became_active":"2024-06-06T03:22:44.416929+0000","last_became_peered":"2024-06-06T03:22:44.416929+0000","last_unstale":"2024-06-06T03:24:15.380827+0000","last_undegraded":"2024-06-06T03:24:15.380827+0000","last_fullsized":"2024-06-06T03:24:15.380827+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:28:09.548691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700631+0000","last_change":"2024-06-06T03:22:31.051163+0000","last_active":"2024-06-06T03:24:14.700631+0000","last_peered":"2024-06-06T03:24:14.700631+0000","last_clean":"2024-06-06T03:24:14.700631+0000","last_became_active":"2024-06-06T03:22:31.050800+0000","last_became_peered":"2024-06-06T03:22:31.050800+0000","last_unstale":"2024-06-06T03:24:14.700631+0000","last_undegraded":"2024-06-06T03:24:14.700631+0000","last_fullsized":"2024-06-06T03:24:14.700631+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:13:40.197723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.372748+0000","last_change":"2024-06-06T03:22:34.293586+0000","last_active":"2024-06-06T03:25:13.372748+0000","last_peered":"2024-06-06T03:25:13.372748+0000","last_clean":"2024-06-06T03:25:13.372748+0000","last_became_active":"2024-06-06T03:22:34.292651+0000","last_became_peered":"2024-06-06T03:22:34.292651+0000","last_unstale":"2024-06-06T03:25:13.372748+0000","last_undegraded":"2024-06-06T03:25:13.372748+0000","last_fullsized":"2024-06-06T03:25:13.372748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:11:16.221948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.698917+0000","last_change":"2024-06-06T03:22:44.415005+0000","last_active":"2024-06-06T03:24:14.698917+0000","last_peered":"2024-06-06T03:24:14.698917+0000","last_clean":"2024-06-06T03:24:14.698917+0000","last_became_active":"2024-06-06T03:22:44.414522+0000","last_became_peered":"2024-06-06T03:22:44.414522+0000","last_unstale":"2024-06-06T03:24:14.698917+0000","last_undegraded":"2024-06-06T03:24:14.698917+0000","last_fullsized":"2024-06-06T03:24:14.698917+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:36:03.240089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"97'1","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.370600+0000","last_change":"2024-06-06T03:22:31.056068+0000","last_active":"2024-06-06T03:24:15.370600+0000","last_peered":"2024-06-06T03:24:15.370600+0000","last_clean":"2024-06-06T03:24:15.370600+0000","last_became_active":"2024-06-06T03:22:31.055628+0000","last_became_peered":"2024-06-06T03:22:31.055628+0000","last_unstale":"2024-06-06T03:24:15.370600+0000","last_undegraded":"2024-06-06T03:24:15.370600+0000","last_fullsized":"2024-06-06T03:24:15.370600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:40:37.491491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.366436+0000","last_change":"2024-06-06T03:22:34.300945+0000","last_active":"2024-06-06T03:25:13.366436+0000","last_peered":"2024-06-06T03:25:13.366436+0000","last_clean":"2024-06-06T03:25:13.366436+0000","last_became_active":"2024-06-06T03:22:34.300618+0000","last_became_peered":"2024-06-06T03:22:34.300618+0000","last_unstale":"2024-06-06T03:25:13.366436+0000","last_undegraded":"2024-06-06T03:25:13.366436+0000","last_fullsized":"2024-06-06T03:25:13.366436+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:32:39.875148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380716+0000","last_change":"2024-06-06T03:22:44.417759+0000","last_active":"2024-06-06T03:24:15.380716+0000","last_peered":"2024-06-06T03:24:15.380716+0000","last_clean":"2024-06-06T03:24:15.380716+0000","last_became_active":"2024-06-06T03:22:44.417335+0000","last_became_peered":"2024-06-06T03:22:44.417335+0000","last_unstale":"2024-06-06T03:24:15.380716+0000","last_undegraded":"2024-06-06T03:24:15.380716+0000","last_fullsized":"2024-06-06T03:24:15.380716+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:43:24.408740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"99'4","reported_seq":223,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:26:27.864216+0000","last_change":"2024-06-06T03:22:31.054351+0000","last_active":"2024-06-06T03:26:27.864216+0000","last_peered":"2024-06-06T03:26:27.864216+0000","last_clean":"2024-06-06T03:26:27.864216+0000","last_became_active":"2024-06-06T03:22:31.053954+0000","last_became_peered":"2024-06-06T03:22:31.053954+0000","last_unstale":"2024-06-06T03:26:27.864216+0000","last_undegraded":"2024-06-06T03:26:27.864216+0000","last_fullsized":"2024-06-06T03:26:27.864216+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:22:46.405507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":174,"num_read_kb":174,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.367722+0000","last_change":"2024-06-06T03:22:34.303208+0000","last_active":"2024-06-06T03:25:13.367722+0000","last_peered":"2024-06-06T03:25:13.367722+0000","last_clean":"2024-06-06T03:25:13.367722+0000","last_became_active":"2024-06-06T03:22:34.302882+0000","last_became_peered":"2024-06-06T03:22:34.302882+0000","last_unstale":"2024-06-06T03:25:13.367722+0000","last_undegraded":"2024-06-06T03:25:13.367722+0000","last_fullsized":"2024-06-06T03:25:13.367722+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:01:36.963056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380041+0000","last_change":"2024-06-06T03:22:44.418095+0000","last_active":"2024-06-06T03:24:15.380041+0000","last_peered":"2024-06-06T03:24:15.380041+0000","last_clean":"2024-06-06T03:24:15.380041+0000","last_became_active":"2024-06-06T03:22:44.417625+0000","last_became_peered":"2024-06-06T03:22:44.417625+0000","last_unstale":"2024-06-06T03:24:15.380041+0000","last_undegraded":"2024-06-06T03:24:15.380041+0000","last_fullsized":"2024-06-06T03:24:15.380041+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:20:53.859638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.701041+0000","last_change":"2024-06-06T03:22:31.057558+0000","last_active":"2024-06-06T03:24:14.701041+0000","last_peered":"2024-06-06T03:24:14.701041+0000","last_clean":"2024-06-06T03:24:14.701041+0000","last_became_active":"2024-06-06T03:22:31.057168+0000","last_became_peered":"2024-06-06T03:22:31.057168+0000","last_unstale":"2024-06-06T03:24:14.701041+0000","last_undegraded":"2024-06-06T03:24:14.701041+0000","last_fullsized":"2024-06-06T03:24:14.701041+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:33:59.019923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.373648+0000","last_change":"2024-06-06T03:22:34.299220+0000","last_active":"2024-06-06T03:25:13.373648+0000","last_peered":"2024-06-06T03:25:13.373648+0000","last_clean":"2024-06-06T03:25:13.373648+0000","last_became_active":"2024-06-06T03:22:34.298873+0000","last_became_peered":"2024-06-06T03:22:34.298873+0000","last_unstale":"2024-06-06T03:25:13.373648+0000","last_undegraded":"2024-06-06T03:25:13.373648+0000","last_fullsized":"2024-06-06T03:25:13.373648+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:31:53.501036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163660+0000","last_change":"2024-06-06T03:22:44.424792+0000","last_active":"2024-06-06T03:24:15.163660+0000","last_peered":"2024-06-06T03:24:15.163660+0000","last_clean":"2024-06-06T03:24:15.163660+0000","last_became_active":"2024-06-06T03:22:44.423973+0000","last_became_peered":"2024-06-06T03:22:44.423973+0000","last_unstale":"2024-06-06T03:24:15.163660+0000","last_undegraded":"2024-06-06T03:24:15.163660+0000","last_fullsized":"2024-06-06T03:24:15.163660+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:46:51.232764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"97'4","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.370511+0000","last_change":"2024-06-06T03:22:31.243885+0000","last_active":"2024-06-06T03:24:15.370511+0000","last_peered":"2024-06-06T03:24:15.370511+0000","last_clean":"2024-06-06T03:24:15.370511+0000","last_became_active":"2024-06-06T03:22:31.243367+0000","last_became_peered":"2024-06-06T03:22:31.243367+0000","last_unstale":"2024-06-06T03:24:15.370511+0000","last_undegraded":"2024-06-06T03:24:15.370511+0000","last_fullsized":"2024-06-06T03:24:15.370511+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:57:13.464974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.367835+0000","last_change":"2024-06-06T03:22:34.299247+0000","last_active":"2024-06-06T03:25:13.367835+0000","last_peered":"2024-06-06T03:25:13.367835+0000","last_clean":"2024-06-06T03:25:13.367835+0000","last_became_active":"2024-06-06T03:22:34.298538+0000","last_became_peered":"2024-06-06T03:22:34.298538+0000","last_unstale":"2024-06-06T03:25:13.367835+0000","last_undegraded":"2024-06-06T03:25:13.367835+0000","last_fullsized":"2024-06-06T03:25:13.367835+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:53:16.724575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380294+0000","last_change":"2024-06-06T03:22:44.423817+0000","last_active":"2024-06-06T03:24:15.380294+0000","last_peered":"2024-06-06T03:24:15.380294+0000","last_clean":"2024-06-06T03:24:15.380294+0000","last_became_active":"2024-06-06T03:22:44.423333+0000","last_became_peered":"2024-06-06T03:22:44.423333+0000","last_unstale":"2024-06-06T03:24:15.380294+0000","last_undegraded":"2024-06-06T03:24:15.380294+0000","last_fullsized":"2024-06-06T03:24:15.380294+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:22:46.174850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"99'39","reported_seq":444,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:26:28.866133+0000","last_change":"2024-06-06T03:22:31.056446+0000","last_active":"2024-06-06T03:26:28.866133+0000","last_peered":"2024-06-06T03:26:28.866133+0000","last_clean":"2024-06-06T03:26:28.866133+0000","last_became_active":"2024-06-06T03:22:31.056089+0000","last_became_peered":"2024-06-06T03:22:31.056089+0000","last_unstale":"2024-06-06T03:26:28.866133+0000","last_undegraded":"2024-06-06T03:26:28.866133+0000","last_fullsized":"2024-06-06T03:26:28.866133+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:11:37.705889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67125,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":360,"num_read_kb":246,"num_write":40,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.346439+0000","last_change":"2024-06-06T03:22:34.302229+0000","last_active":"2024-06-06T03:25:13.346439+0000","last_peered":"2024-06-06T03:25:13.346439+0000","last_clean":"2024-06-06T03:25:13.346439+0000","last_became_active":"2024-06-06T03:22:34.301877+0000","last_became_peered":"2024-06-06T03:22:34.301877+0000","last_unstale":"2024-06-06T03:25:13.346439+0000","last_undegraded":"2024-06-06T03:25:13.346439+0000","last_fullsized":"2024-06-06T03:25:13.346439+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:19:22.545435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.371635+0000","last_change":"2024-06-06T03:22:44.421024+0000","last_active":"2024-06-06T03:24:15.371635+0000","last_peered":"2024-06-06T03:24:15.371635+0000","last_clean":"2024-06-06T03:24:15.371635+0000","last_became_active":"2024-06-06T03:22:44.420502+0000","last_became_peered":"2024-06-06T03:22:44.420502+0000","last_unstale":"2024-06-06T03:24:15.371635+0000","last_undegraded":"2024-06-06T03:24:15.371635+0000","last_fullsized":"2024-06-06T03:24:15.371635+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:15:55.246032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"97'6","reported_seq":51,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973641+0000","last_change":"2024-06-06T03:22:31.054128+0000","last_active":"2024-06-06T03:24:14.973641+0000","last_peered":"2024-06-06T03:24:14.973641+0000","last_clean":"2024-06-06T03:24:14.973641+0000","last_became_active":"2024-06-06T03:22:31.053740+0000","last_became_peered":"2024-06-06T03:22:31.053740+0000","last_unstale":"2024-06-06T03:24:14.973641+0000","last_undegraded":"2024-06-06T03:24:14.973641+0000","last_fullsized":"2024-06-06T03:24:14.973641+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:12:21.494702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.368206+0000","last_change":"2024-06-06T03:22:34.297861+0000","last_active":"2024-06-06T03:25:13.368206+0000","last_peered":"2024-06-06T03:25:13.368206+0000","last_clean":"2024-06-06T03:25:13.368206+0000","last_became_active":"2024-06-06T03:22:34.297391+0000","last_became_peered":"2024-06-06T03:22:34.297391+0000","last_unstale":"2024-06-06T03:25:13.368206+0000","last_undegraded":"2024-06-06T03:25:13.368206+0000","last_fullsized":"2024-06-06T03:25:13.368206+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:10:33.973635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380551+0000","last_change":"2024-06-06T03:22:44.416087+0000","last_active":"2024-06-06T03:24:15.380551+0000","last_peered":"2024-06-06T03:24:15.380551+0000","last_clean":"2024-06-06T03:24:15.380551+0000","last_became_active":"2024-06-06T03:22:44.415646+0000","last_became_peered":"2024-06-06T03:22:44.415646+0000","last_unstale":"2024-06-06T03:24:15.380551+0000","last_undegraded":"2024-06-06T03:24:15.380551+0000","last_fullsized":"2024-06-06T03:24:15.380551+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:44:43.690830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.370474+0000","last_change":"2024-06-06T03:22:31.056814+0000","last_active":"2024-06-06T03:24:15.370474+0000","last_peered":"2024-06-06T03:24:15.370474+0000","last_clean":"2024-06-06T03:24:15.370474+0000","last_became_active":"2024-06-06T03:22:31.055183+0000","last_became_peered":"2024-06-06T03:22:31.055183+0000","last_unstale":"2024-06-06T03:24:15.370474+0000","last_undegraded":"2024-06-06T03:24:15.370474+0000","last_fullsized":"2024-06-06T03:24:15.370474+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:26:27.299068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"99'15","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371815+0000","last_change":"2024-06-06T03:22:34.311995+0000","last_active":"2024-06-06T03:25:13.371815+0000","last_peered":"2024-06-06T03:25:13.371815+0000","last_clean":"2024-06-06T03:25:13.371815+0000","last_became_active":"2024-06-06T03:22:34.311665+0000","last_became_peered":"2024-06-06T03:22:34.311665+0000","last_unstale":"2024-06-06T03:25:13.371815+0000","last_undegraded":"2024-06-06T03:25:13.371815+0000","last_fullsized":"2024-06-06T03:25:13.371815+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:53:10.539212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380693+0000","last_change":"2024-06-06T03:22:44.414170+0000","last_active":"2024-06-06T03:24:15.380693+0000","last_peered":"2024-06-06T03:24:15.380693+0000","last_clean":"2024-06-06T03:24:15.380693+0000","last_became_active":"2024-06-06T03:22:44.413635+0000","last_became_peered":"2024-06-06T03:22:44.413635+0000","last_unstale":"2024-06-06T03:24:15.380693+0000","last_undegraded":"2024-06-06T03:24:15.380693+0000","last_fullsized":"2024-06-06T03:24:15.380693+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:06:25.223810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"99'6","reported_seq":229,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:26:27.918261+0000","last_change":"2024-06-06T03:22:31.057846+0000","last_active":"2024-06-06T03:26:27.918261+0000","last_peered":"2024-06-06T03:26:27.918261+0000","last_clean":"2024-06-06T03:26:27.918261+0000","last_became_active":"2024-06-06T03:22:31.056635+0000","last_became_peered":"2024-06-06T03:22:31.056635+0000","last_unstale":"2024-06-06T03:26:27.918261+0000","last_undegraded":"2024-06-06T03:26:27.918261+0000","last_fullsized":"2024-06-06T03:26:27.918261+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:59:03.845722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1611,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":180,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.368520+0000","last_change":"2024-06-06T03:22:34.304832+0000","last_active":"2024-06-06T03:25:13.368520+0000","last_peered":"2024-06-06T03:25:13.368520+0000","last_clean":"2024-06-06T03:25:13.368520+0000","last_became_active":"2024-06-06T03:22:34.304494+0000","last_became_peered":"2024-06-06T03:22:34.304494+0000","last_unstale":"2024-06-06T03:25:13.368520+0000","last_undegraded":"2024-06-06T03:25:13.368520+0000","last_fullsized":"2024-06-06T03:25:13.368520+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:17:02.855580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.701044+0000","last_change":"2024-06-06T03:22:44.418561+0000","last_active":"2024-06-06T03:24:14.701044+0000","last_peered":"2024-06-06T03:24:14.701044+0000","last_clean":"2024-06-06T03:24:14.701044+0000","last_became_active":"2024-06-06T03:22:44.418050+0000","last_became_peered":"2024-06-06T03:22:44.418050+0000","last_unstale":"2024-06-06T03:24:14.701044+0000","last_undegraded":"2024-06-06T03:24:14.701044+0000","last_fullsized":"2024-06-06T03:24:14.701044+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:39:57.680990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"97'15","reported_seq":60,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.699578+0000","last_change":"2024-06-06T03:22:31.242981+0000","last_active":"2024-06-06T03:24:14.699578+0000","last_peered":"2024-06-06T03:24:14.699578+0000","last_clean":"2024-06-06T03:24:14.699578+0000","last_became_active":"2024-06-06T03:22:31.242448+0000","last_became_peered":"2024-06-06T03:22:31.242448+0000","last_unstale":"2024-06-06T03:24:14.699578+0000","last_undegraded":"2024-06-06T03:24:14.699578+0000","last_fullsized":"2024-06-06T03:24:14.699578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:18:25.855327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.372636+0000","last_change":"2024-06-06T03:22:34.300799+0000","last_active":"2024-06-06T03:25:13.372636+0000","last_peered":"2024-06-06T03:25:13.372636+0000","last_clean":"2024-06-06T03:25:13.372636+0000","last_became_active":"2024-06-06T03:22:34.300397+0000","last_became_peered":"2024-06-06T03:22:34.300397+0000","last_unstale":"2024-06-06T03:25:13.372636+0000","last_undegraded":"2024-06-06T03:25:13.372636+0000","last_fullsized":"2024-06-06T03:25:13.372636+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:55:31.621711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.371189+0000","last_change":"2024-06-06T03:22:44.418341+0000","last_active":"2024-06-06T03:24:15.371189+0000","last_peered":"2024-06-06T03:24:15.371189+0000","last_clean":"2024-06-06T03:24:15.371189+0000","last_became_active":"2024-06-06T03:22:44.417881+0000","last_became_peered":"2024-06-06T03:22:44.417881+0000","last_unstale":"2024-06-06T03:24:15.371189+0000","last_undegraded":"2024-06-06T03:24:15.371189+0000","last_fullsized":"2024-06-06T03:24:15.371189+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:43:13.869298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700063+0000","last_change":"2024-06-06T03:22:31.054749+0000","last_active":"2024-06-06T03:24:14.700063+0000","last_peered":"2024-06-06T03:24:14.700063+0000","last_clean":"2024-06-06T03:24:14.700063+0000","last_became_active":"2024-06-06T03:22:31.054180+0000","last_became_peered":"2024-06-06T03:22:31.054180+0000","last_unstale":"2024-06-06T03:24:14.700063+0000","last_undegraded":"2024-06-06T03:24:14.700063+0000","last_fullsized":"2024-06-06T03:24:14.700063+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:30:17.902778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371538+0000","last_change":"2024-06-06T03:22:34.299573+0000","last_active":"2024-06-06T03:25:13.371538+0000","last_peered":"2024-06-06T03:25:13.371538+0000","last_clean":"2024-06-06T03:25:13.371538+0000","last_became_active":"2024-06-06T03:22:34.299201+0000","last_became_peered":"2024-06-06T03:22:34.299201+0000","last_unstale":"2024-06-06T03:25:13.371538+0000","last_undegraded":"2024-06-06T03:25:13.371538+0000","last_fullsized":"2024-06-06T03:25:13.371538+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:02:47.043087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.699582+0000","last_change":"2024-06-06T03:22:44.409672+0000","last_active":"2024-06-06T03:24:14.699582+0000","last_peered":"2024-06-06T03:24:14.699582+0000","last_clean":"2024-06-06T03:24:14.699582+0000","last_became_active":"2024-06-06T03:22:44.409246+0000","last_became_peered":"2024-06-06T03:22:44.409246+0000","last_unstale":"2024-06-06T03:24:14.699582+0000","last_undegraded":"2024-06-06T03:24:14.699582+0000","last_fullsized":"2024-06-06T03:24:14.699582+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:44:49.481886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.379711+0000","last_change":"2024-06-06T03:22:31.243562+0000","last_active":"2024-06-06T03:24:15.379711+0000","last_peered":"2024-06-06T03:24:15.379711+0000","last_clean":"2024-06-06T03:24:15.379711+0000","last_became_active":"2024-06-06T03:22:31.243164+0000","last_became_peered":"2024-06-06T03:22:31.243164+0000","last_unstale":"2024-06-06T03:24:15.379711+0000","last_undegraded":"2024-06-06T03:24:15.379711+0000","last_fullsized":"2024-06-06T03:24:15.379711+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:04:46.877389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"99'4","reported_seq":43,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.360629+0000","last_change":"2024-06-06T03:22:34.300756+0000","last_active":"2024-06-06T03:25:13.360629+0000","last_peered":"2024-06-06T03:25:13.360629+0000","last_clean":"2024-06-06T03:25:13.360629+0000","last_became_active":"2024-06-06T03:22:34.300333+0000","last_became_peered":"2024-06-06T03:22:34.300333+0000","last_unstale":"2024-06-06T03:25:13.360629+0000","last_undegraded":"2024-06-06T03:25:13.360629+0000","last_fullsized":"2024-06-06T03:25:13.360629+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:29:37.174432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700803+0000","last_change":"2024-06-06T03:22:44.412741+0000","last_active":"2024-06-06T03:24:14.700803+0000","last_peered":"2024-06-06T03:24:14.700803+0000","last_clean":"2024-06-06T03:24:14.700803+0000","last_became_active":"2024-06-06T03:22:44.412263+0000","last_became_peered":"2024-06-06T03:22:44.412263+0000","last_unstale":"2024-06-06T03:24:14.700803+0000","last_undegraded":"2024-06-06T03:24:14.700803+0000","last_fullsized":"2024-06-06T03:24:14.700803+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:00:13.925279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"97'1","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700753+0000","last_change":"2024-06-06T03:22:31.055124+0000","last_active":"2024-06-06T03:24:14.700753+0000","last_peered":"2024-06-06T03:24:14.700753+0000","last_clean":"2024-06-06T03:24:14.700753+0000","last_became_active":"2024-06-06T03:22:31.054562+0000","last_became_peered":"2024-06-06T03:22:31.054562+0000","last_unstale":"2024-06-06T03:24:14.700753+0000","last_undegraded":"2024-06-06T03:24:14.700753+0000","last_fullsized":"2024-06-06T03:24:14.700753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:57:54.783815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.359691+0000","last_change":"2024-06-06T03:22:34.310893+0000","last_active":"2024-06-06T03:25:13.359691+0000","last_peered":"2024-06-06T03:25:13.359691+0000","last_clean":"2024-06-06T03:25:13.359691+0000","last_became_active":"2024-06-06T03:22:34.310510+0000","last_became_peered":"2024-06-06T03:22:34.310510+0000","last_unstale":"2024-06-06T03:25:13.359691+0000","last_undegraded":"2024-06-06T03:25:13.359691+0000","last_fullsized":"2024-06-06T03:25:13.359691+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:52:10.979031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":36,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.897745+0000","last_change":"2024-06-06T03:24:14.897222+0000","last_active":"2024-06-06T03:24:14.897745+0000","last_peered":"2024-06-06T03:24:14.897745+0000","last_clean":"2024-06-06T03:24:14.897745+0000","last_became_active":"2024-06-06T03:24:14.896620+0000","last_became_peered":"2024-06-06T03:24:14.896620+0000","last_unstale":"2024-06-06T03:24:14.897745+0000","last_undegraded":"2024-06-06T03:24:14.897745+0000","last_fullsized":"2024-06-06T03:24:14.897745+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:43:44.992240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8,10,0],"acting":[6,8,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371198+0000","last_change":"2024-06-06T03:22:34.294540+0000","last_active":"2024-06-06T03:25:13.371198+0000","last_peered":"2024-06-06T03:25:13.371198+0000","last_clean":"2024-06-06T03:25:13.371198+0000","last_became_active":"2024-06-06T03:22:34.294204+0000","last_became_peered":"2024-06-06T03:22:34.294204+0000","last_unstale":"2024-06-06T03:25:13.371198+0000","last_undegraded":"2024-06-06T03:25:13.371198+0000","last_fullsized":"2024-06-06T03:25:13.371198+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:16:39.386345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"99'6","reported_seq":224,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:26:26.915520+0000","last_change":"2024-06-06T03:22:31.242275+0000","last_active":"2024-06-06T03:26:26.915520+0000","last_peered":"2024-06-06T03:26:26.915520+0000","last_clean":"2024-06-06T03:26:26.915520+0000","last_became_active":"2024-06-06T03:22:31.241930+0000","last_became_peered":"2024-06-06T03:22:31.241930+0000","last_unstale":"2024-06-06T03:26:26.915520+0000","last_undegraded":"2024-06-06T03:26:26.915520+0000","last_fullsized":"2024-06-06T03:26:26.915520+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:46:16.407946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"97'1","reported_seq":30,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.701132+0000","last_change":"2024-06-06T03:22:44.416191+0000","last_active":"2024-06-06T03:24:14.701132+0000","last_peered":"2024-06-06T03:24:14.701132+0000","last_clean":"2024-06-06T03:24:14.701132+0000","last_became_active":"2024-06-06T03:22:44.415632+0000","last_became_peered":"2024-06-06T03:22:44.415632+0000","last_unstale":"2024-06-06T03:24:14.701132+0000","last_undegraded":"2024-06-06T03:24:14.701132+0000","last_fullsized":"2024-06-06T03:24:14.701132+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:10:48.995029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371311+0000","last_change":"2024-06-06T03:22:34.304567+0000","last_active":"2024-06-06T03:25:13.371311+0000","last_peered":"2024-06-06T03:25:13.371311+0000","last_clean":"2024-06-06T03:25:13.371311+0000","last_became_active":"2024-06-06T03:22:34.304183+0000","last_became_peered":"2024-06-06T03:22:34.304183+0000","last_unstale":"2024-06-06T03:25:13.371311+0000","last_undegraded":"2024-06-06T03:25:13.371311+0000","last_fullsized":"2024-06-06T03:25:13.371311+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:34:02.229528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"97'3","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163254+0000","last_change":"2024-06-06T03:22:31.056188+0000","last_active":"2024-06-06T03:24:15.163254+0000","last_peered":"2024-06-06T03:24:15.163254+0000","last_clean":"2024-06-06T03:24:15.163254+0000","last_became_active":"2024-06-06T03:22:31.055758+0000","last_became_peered":"2024-06-06T03:22:31.055758+0000","last_unstale":"2024-06-06T03:24:15.163254+0000","last_undegraded":"2024-06-06T03:24:15.163254+0000","last_fullsized":"2024-06-06T03:24:15.163254+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:35:51.016087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":368,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700465+0000","last_change":"2024-06-06T03:21:07.156236+0000","last_active":"2024-06-06T03:24:14.700465+0000","last_peered":"2024-06-06T03:24:14.700465+0000","last_clean":"2024-06-06T03:24:14.700465+0000","last_became_active":"2024-06-06T03:21:07.155807+0000","last_became_peered":"2024-06-06T03:21:07.155807+0000","last_unstale":"2024-06-06T03:24:14.700465+0000","last_undegraded":"2024-06-06T03:24:14.700465+0000","last_fullsized":"2024-06-06T03:24:14.700465+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:17:38.330402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:17:38.330402+0000","last_clean_scrub_stamp":"2024-06-06T03:17:38.330402+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:30:13.968755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.371740+0000","last_change":"2024-06-06T03:22:44.424693+0000","last_active":"2024-06-06T03:24:15.371740+0000","last_peered":"2024-06-06T03:24:15.371740+0000","last_clean":"2024-06-06T03:24:15.371740+0000","last_became_active":"2024-06-06T03:22:44.423607+0000","last_became_peered":"2024-06-06T03:22:44.423607+0000","last_unstale":"2024-06-06T03:24:15.371740+0000","last_undegraded":"2024-06-06T03:24:15.371740+0000","last_fullsized":"2024-06-06T03:24:15.371740+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:57:56.974785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.359317+0000","last_change":"2024-06-06T03:22:34.297940+0000","last_active":"2024-06-06T03:25:13.359317+0000","last_peered":"2024-06-06T03:25:13.359317+0000","last_clean":"2024-06-06T03:25:13.359317+0000","last_became_active":"2024-06-06T03:22:34.297597+0000","last_became_peered":"2024-06-06T03:22:34.297597+0000","last_unstale":"2024-06-06T03:25:13.359317+0000","last_undegraded":"2024-06-06T03:25:13.359317+0000","last_fullsized":"2024-06-06T03:25:13.359317+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:52:52.155070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700574+0000","last_change":"2024-06-06T03:22:31.055329+0000","last_active":"2024-06-06T03:24:14.700574+0000","last_peered":"2024-06-06T03:24:14.700574+0000","last_clean":"2024-06-06T03:24:14.700574+0000","last_became_active":"2024-06-06T03:22:31.054493+0000","last_became_peered":"2024-06-06T03:22:31.054493+0000","last_unstale":"2024-06-06T03:24:14.700574+0000","last_undegraded":"2024-06-06T03:24:14.700574+0000","last_fullsized":"2024-06-06T03:24:14.700574+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:45:32.068810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380440+0000","last_change":"2024-06-06T03:22:44.413560+0000","last_active":"2024-06-06T03:24:15.380440+0000","last_peered":"2024-06-06T03:24:15.380440+0000","last_clean":"2024-06-06T03:24:15.380440+0000","last_became_active":"2024-06-06T03:22:44.413100+0000","last_became_peered":"2024-06-06T03:22:44.413100+0000","last_unstale":"2024-06-06T03:24:15.380440+0000","last_undegraded":"2024-06-06T03:24:15.380440+0000","last_fullsized":"2024-06-06T03:24:15.380440+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:58:02.780671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"97'1","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380639+0000","last_change":"2024-06-06T03:23:14.515805+0000","last_active":"2024-06-06T03:24:15.380639+0000","last_peered":"2024-06-06T03:24:15.380639+0000","last_clean":"2024-06-06T03:24:15.380639+0000","last_became_active":"2024-06-06T03:23:14.515436+0000","last_became_peered":"2024-06-06T03:23:14.515436+0000","last_unstale":"2024-06-06T03:24:15.380639+0000","last_undegraded":"2024-06-06T03:24:15.380639+0000","last_fullsized":"2024-06-06T03:24:15.380639+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:59:16.246609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.364457+0000","last_change":"2024-06-06T03:22:34.294549+0000","last_active":"2024-06-06T03:25:13.364457+0000","last_peered":"2024-06-06T03:25:13.364457+0000","last_clean":"2024-06-06T03:25:13.364457+0000","last_became_active":"2024-06-06T03:22:34.294202+0000","last_became_peered":"2024-06-06T03:22:34.294202+0000","last_unstale":"2024-06-06T03:25:13.364457+0000","last_undegraded":"2024-06-06T03:25:13.364457+0000","last_fullsized":"2024-06-06T03:25:13.364457+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:55:59.823957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380133+0000","last_change":"2024-06-06T03:22:44.416890+0000","last_active":"2024-06-06T03:24:15.380133+0000","last_peered":"2024-06-06T03:24:15.380133+0000","last_clean":"2024-06-06T03:24:15.380133+0000","last_became_active":"2024-06-06T03:22:44.416473+0000","last_became_peered":"2024-06-06T03:22:44.416473+0000","last_unstale":"2024-06-06T03:24:15.380133+0000","last_undegraded":"2024-06-06T03:24:15.380133+0000","last_fullsized":"2024-06-06T03:24:15.380133+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:23:48.972196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"99'14","reported_seq":59,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:14.317576+0000","last_change":"2024-06-06T03:22:31.054481+0000","last_active":"2024-06-06T03:25:14.317576+0000","last_peered":"2024-06-06T03:25:14.317576+0000","last_clean":"2024-06-06T03:25:14.317576+0000","last_became_active":"2024-06-06T03:22:31.054173+0000","last_became_peered":"2024-06-06T03:22:31.054173+0000","last_unstale":"2024-06-06T03:25:14.317576+0000","last_undegraded":"2024-06-06T03:25:14.317576+0000","last_fullsized":"2024-06-06T03:25:14.317576+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:52:45.311149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.372630+0000","last_change":"2024-06-06T03:22:34.300211+0000","last_active":"2024-06-06T03:25:13.372630+0000","last_peered":"2024-06-06T03:25:13.372630+0000","last_clean":"2024-06-06T03:25:13.372630+0000","last_became_active":"2024-06-06T03:22:34.299870+0000","last_became_peered":"2024-06-06T03:22:34.299870+0000","last_unstale":"2024-06-06T03:25:13.372630+0000","last_undegraded":"2024-06-06T03:25:13.372630+0000","last_fullsized":"2024-06-06T03:25:13.372630+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:50:56.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973290+0000","last_change":"2024-06-06T03:22:44.414727+0000","last_active":"2024-06-06T03:24:14.973290+0000","last_peered":"2024-06-06T03:24:14.973290+0000","last_clean":"2024-06-06T03:24:14.973290+0000","last_became_active":"2024-06-06T03:22:44.414232+0000","last_became_peered":"2024-06-06T03:22:44.414232+0000","last_unstale":"2024-06-06T03:24:14.973290+0000","last_undegraded":"2024-06-06T03:24:14.973290+0000","last_fullsized":"2024-06-06T03:24:14.973290+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:26:21.540309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"97'4","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.164042+0000","last_change":"2024-06-06T03:22:31.178740+0000","last_active":"2024-06-06T03:24:15.164042+0000","last_peered":"2024-06-06T03:24:15.164042+0000","last_clean":"2024-06-06T03:24:15.164042+0000","last_became_active":"2024-06-06T03:22:31.178353+0000","last_became_peered":"2024-06-06T03:22:31.178353+0000","last_unstale":"2024-06-06T03:24:15.164042+0000","last_undegraded":"2024-06-06T03:24:15.164042+0000","last_fullsized":"2024-06-06T03:24:15.164042+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:56:50.159463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.368763+0000","last_change":"2024-06-06T03:22:34.298011+0000","last_active":"2024-06-06T03:25:13.368763+0000","last_peered":"2024-06-06T03:25:13.368763+0000","last_clean":"2024-06-06T03:25:13.368763+0000","last_became_active":"2024-06-06T03:22:34.297697+0000","last_became_peered":"2024-06-06T03:22:34.297697+0000","last_unstale":"2024-06-06T03:25:13.368763+0000","last_undegraded":"2024-06-06T03:25:13.368763+0000","last_fullsized":"2024-06-06T03:25:13.368763+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:01:38.606543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163829+0000","last_change":"2024-06-06T03:22:44.425675+0000","last_active":"2024-06-06T03:24:15.163829+0000","last_peered":"2024-06-06T03:24:15.163829+0000","last_clean":"2024-06-06T03:24:15.163829+0000","last_became_active":"2024-06-06T03:22:44.424023+0000","last_became_peered":"2024-06-06T03:22:44.424023+0000","last_unstale":"2024-06-06T03:24:15.163829+0000","last_undegraded":"2024-06-06T03:24:15.163829+0000","last_fullsized":"2024-06-06T03:24:15.163829+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:47:48.718771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"97'2","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.379742+0000","last_change":"2024-06-06T03:22:31.242360+0000","last_active":"2024-06-06T03:24:15.379742+0000","last_peered":"2024-06-06T03:24:15.379742+0000","last_clean":"2024-06-06T03:24:15.379742+0000","last_became_active":"2024-06-06T03:22:31.242015+0000","last_became_peered":"2024-06-06T03:22:31.242015+0000","last_unstale":"2024-06-06T03:24:15.379742+0000","last_undegraded":"2024-06-06T03:24:15.379742+0000","last_fullsized":"2024-06-06T03:24:15.379742+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:14:30.674106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"99'2","reported_seq":41,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.326018+0000","last_change":"2024-06-06T03:22:34.302980+0000","last_active":"2024-06-06T03:25:13.326018+0000","last_peered":"2024-06-06T03:25:13.326018+0000","last_clean":"2024-06-06T03:25:13.326018+0000","last_became_active":"2024-06-06T03:22:34.302625+0000","last_became_peered":"2024-06-06T03:22:34.302625+0000","last_unstale":"2024-06-06T03:25:13.326018+0000","last_undegraded":"2024-06-06T03:25:13.326018+0000","last_fullsized":"2024-06-06T03:25:13.326018+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:13:01.603365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380862+0000","last_change":"2024-06-06T03:22:44.423741+0000","last_active":"2024-06-06T03:24:15.380862+0000","last_peered":"2024-06-06T03:24:15.380862+0000","last_clean":"2024-06-06T03:24:15.380862+0000","last_became_active":"2024-06-06T03:22:44.423266+0000","last_became_peered":"2024-06-06T03:22:44.423266+0000","last_unstale":"2024-06-06T03:24:15.380862+0000","last_undegraded":"2024-06-06T03:24:15.380862+0000","last_fullsized":"2024-06-06T03:24:15.380862+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:09:19.324145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"97'3","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.379798+0000","last_change":"2024-06-06T03:22:31.052988+0000","last_active":"2024-06-06T03:24:15.379798+0000","last_peered":"2024-06-06T03:24:15.379798+0000","last_clean":"2024-06-06T03:24:15.379798+0000","last_became_active":"2024-06-06T03:22:31.052743+0000","last_became_peered":"2024-06-06T03:22:31.052743+0000","last_unstale":"2024-06-06T03:24:15.379798+0000","last_undegraded":"2024-06-06T03:24:15.379798+0000","last_fullsized":"2024-06-06T03:24:15.379798+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:31:45.176416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.365872+0000","last_change":"2024-06-06T03:22:34.299991+0000","last_active":"2024-06-06T03:25:13.365872+0000","last_peered":"2024-06-06T03:25:13.365872+0000","last_clean":"2024-06-06T03:25:13.365872+0000","last_became_active":"2024-06-06T03:22:34.299659+0000","last_became_peered":"2024-06-06T03:22:34.299659+0000","last_unstale":"2024-06-06T03:25:13.365872+0000","last_undegraded":"2024-06-06T03:25:13.365872+0000","last_fullsized":"2024-06-06T03:25:13.365872+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:16:51.492749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"97'1","reported_seq":37,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163786+0000","last_change":"2024-06-06T03:23:15.027541+0000","last_active":"2024-06-06T03:24:15.163786+0000","last_peered":"2024-06-06T03:24:15.163786+0000","last_clean":"2024-06-06T03:24:15.163786+0000","last_became_active":"2024-06-06T03:23:15.026931+0000","last_became_peered":"2024-06-06T03:23:15.026931+0000","last_unstale":"2024-06-06T03:24:15.163786+0000","last_undegraded":"2024-06-06T03:24:15.163786+0000","last_fullsized":"2024-06-06T03:24:15.163786+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:47:44.197067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"99'2","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:25.895366+0000","last_change":"2024-06-06T03:23:14.831383+0000","last_active":"2024-06-06T03:25:25.895366+0000","last_peered":"2024-06-06T03:25:25.895366+0000","last_clean":"2024-06-06T03:25:25.895366+0000","last_became_active":"2024-06-06T03:23:14.830948+0000","last_became_peered":"2024-06-06T03:23:14.830948+0000","last_unstale":"2024-06-06T03:25:25.895366+0000","last_undegraded":"2024-06-06T03:25:25.895366+0000","last_fullsized":"2024-06-06T03:25:25.895366+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:58:00.326112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.370110+0000","last_change":"2024-06-06T03:22:34.301842+0000","last_active":"2024-06-06T03:25:13.370110+0000","last_peered":"2024-06-06T03:25:13.370110+0000","last_clean":"2024-06-06T03:25:13.370110+0000","last_became_active":"2024-06-06T03:22:34.301513+0000","last_became_peered":"2024-06-06T03:22:34.301513+0000","last_unstale":"2024-06-06T03:25:13.370110+0000","last_undegraded":"2024-06-06T03:25:13.370110+0000","last_fullsized":"2024-06-06T03:25:13.370110+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:30:03.813861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163817+0000","last_change":"2024-06-06T03:22:44.419621+0000","last_active":"2024-06-06T03:24:15.163817+0000","last_peered":"2024-06-06T03:24:15.163817+0000","last_clean":"2024-06-06T03:24:15.163817+0000","last_became_active":"2024-06-06T03:22:44.419065+0000","last_became_peered":"2024-06-06T03:22:44.419065+0000","last_unstale":"2024-06-06T03:24:15.163817+0000","last_undegraded":"2024-06-06T03:24:15.163817+0000","last_fullsized":"2024-06-06T03:24:15.163817+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:10:49.762284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"97'4","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.699776+0000","last_change":"2024-06-06T03:22:31.056409+0000","last_active":"2024-06-06T03:24:14.699776+0000","last_peered":"2024-06-06T03:24:14.699776+0000","last_clean":"2024-06-06T03:24:14.699776+0000","last_became_active":"2024-06-06T03:22:31.055994+0000","last_became_peered":"2024-06-06T03:22:31.055994+0000","last_unstale":"2024-06-06T03:24:14.699776+0000","last_undegraded":"2024-06-06T03:24:14.699776+0000","last_fullsized":"2024-06-06T03:24:14.699776+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:09:00.784820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371522+0000","last_change":"2024-06-06T03:22:34.302238+0000","last_active":"2024-06-06T03:25:13.371522+0000","last_peered":"2024-06-06T03:25:13.371522+0000","last_clean":"2024-06-06T03:25:13.371522+0000","last_became_active":"2024-06-06T03:22:34.301869+0000","last_became_peered":"2024-06-06T03:22:34.301869+0000","last_unstale":"2024-06-06T03:25:13.371522+0000","last_undegraded":"2024-06-06T03:25:13.371522+0000","last_fullsized":"2024-06-06T03:25:13.371522+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:17:08.350692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380233+0000","last_change":"2024-06-06T03:22:44.414052+0000","last_active":"2024-06-06T03:24:15.380233+0000","last_peered":"2024-06-06T03:24:15.380233+0000","last_clean":"2024-06-06T03:24:15.380233+0000","last_became_active":"2024-06-06T03:22:44.413633+0000","last_became_peered":"2024-06-06T03:22:44.413633+0000","last_unstale":"2024-06-06T03:24:15.380233+0000","last_undegraded":"2024-06-06T03:24:15.380233+0000","last_fullsized":"2024-06-06T03:24:15.380233+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:41:16.942699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973931+0000","last_change":"2024-06-06T03:22:31.243570+0000","last_active":"2024-06-06T03:24:14.973931+0000","last_peered":"2024-06-06T03:24:14.973931+0000","last_clean":"2024-06-06T03:24:14.973931+0000","last_became_active":"2024-06-06T03:22:31.243194+0000","last_became_peered":"2024-06-06T03:22:31.243194+0000","last_unstale":"2024-06-06T03:24:14.973931+0000","last_undegraded":"2024-06-06T03:24:14.973931+0000","last_fullsized":"2024-06-06T03:24:14.973931+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:21:22.233139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.370634+0000","last_change":"2024-06-06T03:22:34.301665+0000","last_active":"2024-06-06T03:25:13.370634+0000","last_peered":"2024-06-06T03:25:13.370634+0000","last_clean":"2024-06-06T03:25:13.370634+0000","last_became_active":"2024-06-06T03:22:34.300967+0000","last_became_peered":"2024-06-06T03:22:34.300967+0000","last_unstale":"2024-06-06T03:25:13.370634+0000","last_undegraded":"2024-06-06T03:25:13.370634+0000","last_fullsized":"2024-06-06T03:25:13.370634+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:57:58.905488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":36,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.698608+0000","last_change":"2024-06-06T03:23:14.833267+0000","last_active":"2024-06-06T03:24:14.698608+0000","last_peered":"2024-06-06T03:24:14.698608+0000","last_clean":"2024-06-06T03:24:14.698608+0000","last_became_active":"2024-06-06T03:23:14.832760+0000","last_became_peered":"2024-06-06T03:23:14.832760+0000","last_unstale":"2024-06-06T03:24:14.698608+0000","last_undegraded":"2024-06-06T03:24:14.698608+0000","last_fullsized":"2024-06-06T03:24:14.698608+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:24:32.668781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'1","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.370535+0000","last_change":"2024-06-06T03:22:31.054686+0000","last_active":"2024-06-06T03:24:15.370535+0000","last_peered":"2024-06-06T03:24:15.370535+0000","last_clean":"2024-06-06T03:24:15.370535+0000","last_became_active":"2024-06-06T03:22:31.053219+0000","last_became_peered":"2024-06-06T03:22:31.053219+0000","last_unstale":"2024-06-06T03:24:15.370535+0000","last_undegraded":"2024-06-06T03:24:15.370535+0000","last_fullsized":"2024-06-06T03:24:15.370535+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:32:27.423208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.368737+0000","last_change":"2024-06-06T03:22:34.304916+0000","last_active":"2024-06-06T03:25:13.368737+0000","last_peered":"2024-06-06T03:25:13.368737+0000","last_clean":"2024-06-06T03:25:13.368737+0000","last_became_active":"2024-06-06T03:22:34.302442+0000","last_became_peered":"2024-06-06T03:22:34.302442+0000","last_unstale":"2024-06-06T03:25:13.368737+0000","last_undegraded":"2024-06-06T03:25:13.368737+0000","last_fullsized":"2024-06-06T03:25:13.368737+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:01:24.034386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.370747+0000","last_change":"2024-06-06T03:22:44.415478+0000","last_active":"2024-06-06T03:24:15.370747+0000","last_peered":"2024-06-06T03:24:15.370747+0000","last_clean":"2024-06-06T03:24:15.370747+0000","last_became_active":"2024-06-06T03:22:44.415007+0000","last_became_peered":"2024-06-06T03:22:44.415007+0000","last_unstale":"2024-06-06T03:24:15.370747+0000","last_undegraded":"2024-06-06T03:24:15.370747+0000","last_fullsized":"2024-06-06T03:24:15.370747+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:57:47.793481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'2","reported_seq":57,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700897+0000","last_change":"2024-06-06T03:23:14.521037+0000","last_active":"2024-06-06T03:24:14.700897+0000","last_peered":"2024-06-06T03:24:14.700897+0000","last_clean":"2024-06-06T03:24:14.700897+0000","last_became_active":"2024-06-06T03:23:14.517922+0000","last_became_peered":"2024-06-06T03:23:14.517922+0000","last_unstale":"2024-06-06T03:24:14.700897+0000","last_undegraded":"2024-06-06T03:24:14.700897+0000","last_fullsized":"2024-06-06T03:24:14.700897+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:12:46.222984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.370655+0000","last_change":"2024-06-06T03:22:34.305178+0000","last_active":"2024-06-06T03:25:13.370655+0000","last_peered":"2024-06-06T03:25:13.370655+0000","last_clean":"2024-06-06T03:25:13.370655+0000","last_became_active":"2024-06-06T03:22:34.302420+0000","last_became_peered":"2024-06-06T03:22:34.302420+0000","last_unstale":"2024-06-06T03:25:13.370655+0000","last_undegraded":"2024-06-06T03:25:13.370655+0000","last_fullsized":"2024-06-06T03:25:13.370655+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:22:08.736542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"99'9","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369693+0000","last_change":"2024-06-06T03:23:14.514756+0000","last_active":"2024-06-06T03:25:13.369693+0000","last_peered":"2024-06-06T03:25:13.369693+0000","last_clean":"2024-06-06T03:25:13.369693+0000","last_became_active":"2024-06-06T03:23:14.514325+0000","last_became_peered":"2024-06-06T03:23:14.514325+0000","last_unstale":"2024-06-06T03:25:13.369693+0000","last_undegraded":"2024-06-06T03:25:13.369693+0000","last_fullsized":"2024-06-06T03:25:13.369693+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:45:44.594836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"99'12","reported_seq":51,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369056+0000","last_change":"2024-06-06T03:22:34.298570+0000","last_active":"2024-06-06T03:25:13.369056+0000","last_peered":"2024-06-06T03:25:13.369056+0000","last_clean":"2024-06-06T03:25:13.369056+0000","last_became_active":"2024-06-06T03:22:34.298137+0000","last_became_peered":"2024-06-06T03:22:34.298137+0000","last_unstale":"2024-06-06T03:25:13.369056+0000","last_undegraded":"2024-06-06T03:25:13.369056+0000","last_fullsized":"2024-06-06T03:25:13.369056+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:07:25.290355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.362822+0000","last_change":"2024-06-06T03:22:34.297750+0000","last_active":"2024-06-06T03:25:13.362822+0000","last_peered":"2024-06-06T03:25:13.362822+0000","last_clean":"2024-06-06T03:25:13.362822+0000","last_became_active":"2024-06-06T03:22:34.297264+0000","last_became_peered":"2024-06-06T03:22:34.297264+0000","last_unstale":"2024-06-06T03:25:13.362822+0000","last_undegraded":"2024-06-06T03:25:13.362822+0000","last_fullsized":"2024-06-06T03:25:13.362822+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:14:58.580044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"99'7","reported_seq":52,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.357808+0000","last_change":"2024-06-06T03:23:14.832804+0000","last_active":"2024-06-06T03:25:13.357808+0000","last_peered":"2024-06-06T03:25:13.357808+0000","last_clean":"2024-06-06T03:25:13.357808+0000","last_became_active":"2024-06-06T03:23:14.832448+0000","last_became_peered":"2024-06-06T03:23:14.832448+0000","last_unstale":"2024-06-06T03:25:13.357808+0000","last_undegraded":"2024-06-06T03:25:13.357808+0000","last_fullsized":"2024-06-06T03:25:13.357808+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:52:16.907033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"99'4","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.366112+0000","last_change":"2024-06-06T03:23:14.515841+0000","last_active":"2024-06-06T03:25:13.366112+0000","last_peered":"2024-06-06T03:25:13.366112+0000","last_clean":"2024-06-06T03:25:13.366112+0000","last_became_active":"2024-06-06T03:23:14.515331+0000","last_became_peered":"2024-06-06T03:23:14.515331+0000","last_unstale":"2024-06-06T03:25:13.366112+0000","last_undegraded":"2024-06-06T03:25:13.366112+0000","last_fullsized":"2024-06-06T03:25:13.366112+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:46:57.178054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371197+0000","last_change":"2024-06-06T03:22:34.299660+0000","last_active":"2024-06-06T03:25:13.371197+0000","last_peered":"2024-06-06T03:25:13.371197+0000","last_clean":"2024-06-06T03:25:13.371197+0000","last_became_active":"2024-06-06T03:22:34.298411+0000","last_became_peered":"2024-06-06T03:22:34.298411+0000","last_unstale":"2024-06-06T03:25:13.371197+0000","last_undegraded":"2024-06-06T03:25:13.371197+0000","last_fullsized":"2024-06-06T03:25:13.371197+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:29:16.170700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"99'15","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.351954+0000","last_change":"2024-06-06T03:22:34.308110+0000","last_active":"2024-06-06T03:25:13.351954+0000","last_peered":"2024-06-06T03:25:13.351954+0000","last_clean":"2024-06-06T03:25:13.351954+0000","last_became_active":"2024-06-06T03:22:34.307637+0000","last_became_peered":"2024-06-06T03:22:34.307637+0000","last_unstale":"2024-06-06T03:25:13.351954+0000","last_undegraded":"2024-06-06T03:25:13.351954+0000","last_fullsized":"2024-06-06T03:25:13.351954+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:40:23.264509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"99'2","reported_seq":41,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.368343+0000","last_change":"2024-06-06T03:22:34.295494+0000","last_active":"2024-06-06T03:25:13.368343+0000","last_peered":"2024-06-06T03:25:13.368343+0000","last_clean":"2024-06-06T03:25:13.368343+0000","last_became_active":"2024-06-06T03:22:34.295101+0000","last_became_peered":"2024-06-06T03:22:34.295101+0000","last_unstale":"2024-06-06T03:25:13.368343+0000","last_undegraded":"2024-06-06T03:25:13.368343+0000","last_fullsized":"2024-06-06T03:25:13.368343+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:39:07.298053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.373117+0000","last_change":"2024-06-06T03:22:34.291312+0000","last_active":"2024-06-06T03:25:13.373117+0000","last_peered":"2024-06-06T03:25:13.373117+0000","last_clean":"2024-06-06T03:25:13.373117+0000","last_became_active":"2024-06-06T03:22:34.290971+0000","last_became_peered":"2024-06-06T03:22:34.290971+0000","last_unstale":"2024-06-06T03:25:13.373117+0000","last_undegraded":"2024-06-06T03:25:13.373117+0000","last_fullsized":"2024-06-06T03:25:13.373117+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:06:27.333831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.372533+0000","last_change":"2024-06-06T03:22:34.292000+0000","last_active":"2024-06-06T03:25:13.372533+0000","last_peered":"2024-06-06T03:25:13.372533+0000","last_clean":"2024-06-06T03:25:13.372533+0000","last_became_active":"2024-06-06T03:22:34.291500+0000","last_became_peered":"2024-06-06T03:22:34.291500+0000","last_unstale":"2024-06-06T03:25:13.372533+0000","last_undegraded":"2024-06-06T03:25:13.372533+0000","last_fullsized":"2024-06-06T03:25:13.372533+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:37:20.677107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369963+0000","last_change":"2024-06-06T03:22:34.303138+0000","last_active":"2024-06-06T03:25:13.369963+0000","last_peered":"2024-06-06T03:25:13.369963+0000","last_clean":"2024-06-06T03:25:13.369963+0000","last_became_active":"2024-06-06T03:22:34.302758+0000","last_became_peered":"2024-06-06T03:22:34.302758+0000","last_unstale":"2024-06-06T03:25:13.369963+0000","last_undegraded":"2024-06-06T03:25:13.369963+0000","last_fullsized":"2024-06-06T03:25:13.369963+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:34:18.516891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371585+0000","last_change":"2024-06-06T03:22:34.297035+0000","last_active":"2024-06-06T03:25:13.371585+0000","last_peered":"2024-06-06T03:25:13.371585+0000","last_clean":"2024-06-06T03:25:13.371585+0000","last_became_active":"2024-06-06T03:22:34.296706+0000","last_became_peered":"2024-06-06T03:22:34.296706+0000","last_unstale":"2024-06-06T03:25:13.371585+0000","last_undegraded":"2024-06-06T03:25:13.371585+0000","last_fullsized":"2024-06-06T03:25:13.371585+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:26:26.959215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371786+0000","last_change":"2024-06-06T03:22:34.296365+0000","last_active":"2024-06-06T03:25:13.371786+0000","last_peered":"2024-06-06T03:25:13.371786+0000","last_clean":"2024-06-06T03:25:13.371786+0000","last_became_active":"2024-06-06T03:22:34.296021+0000","last_became_peered":"2024-06-06T03:22:34.296021+0000","last_unstale":"2024-06-06T03:25:13.371786+0000","last_undegraded":"2024-06-06T03:25:13.371786+0000","last_fullsized":"2024-06-06T03:25:13.371786+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:40:33.183110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":249510,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72250,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":1076,"num_read_kb":615,"num_write":188,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":216750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383743,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32248,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712904,"statfs":{"total":95995035648,"available":95962013696,"internally_reserved":0,"allocated":1097728,"data_stored":569692,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645379,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28236,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716916,"statfs":{"total":95995035648,"available":95966121984,"internally_reserved":0,"allocated":1249280,"data_stored":1229182,"data_compressed":68620,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808905,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1110016,"data_stored":569906,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070542,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1105920,"data_stored":569804,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332180,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32308,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712844,"statfs":{"total":95995035648,"available":95961952256,"internally_reserved":0,"allocated":1159168,"data_stored":1166859,"data_compressed":68620,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495706,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36400,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708752,"statfs":{"total":95995035648,"available":95957762048,"internally_reserved":0,"allocated":1089536,"data_stored":565082,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574962,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28152,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717000,"statfs":{"total":95995035648,"available":95966208000,"internally_reserved":0,"allocated":1163264,"data_stored":632117,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738487,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36424,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708728,"statfs":{"total":95995035648,"available":95957737472,"internally_reserved":0,"allocated":1114112,"data_stored":566470,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411438,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36496,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708656,"statfs":{"total":95995035648,"available":95957663744,"internally_reserved":0,"allocated":1187840,"data_stored":633959,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182504,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1101824,"data_stored":565276,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920868,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32252,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712900,"statfs":{"total":95995035648,"available":95962009600,"internally_reserved":0,"allocated":1101824,"data_stored":570755,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757343,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32316,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712836,"statfs":{"total":95995035648,"available":95961944064,"internally_reserved":0,"allocated":1167360,"data_stored":1161424,"data_compressed":68620,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34475,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34475,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-06T03:26:30.998 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-06-06T03:26:30.998 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-06T03:26:31.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:30 smithi079 ceph-mon[35478]: pgmap v427: 129 pgs: 129 active+clean; 647 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-06-06T03:26:31.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.139+0000 7f1774d14640 1 -- 172.21.15.50:0/1815234914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1770102490 msgr2=0x7f1770108d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:31.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.139+0000 7f1774d14640 1 --2- 172.21.15.50:0/1815234914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1770102490 0x7f1770108d20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1768009ca0 tx=0x7f176802a8c0 comp rx=0 tx=0).stop 2024-06-06T03:26:31.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.139+0000 7f1774d14640 1 -- 172.21.15.50:0/1815234914 shutdown_connections 2024-06-06T03:26:31.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.139+0000 7f1774d14640 1 --2- 172.21.15.50:0/1815234914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1770102490 0x7f1770108d20 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:31.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.139+0000 7f1774d14640 1 --2- 172.21.15.50:0/1815234914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1770101ad0 0x7f1770101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:31.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.139+0000 7f1774d14640 1 --2- 172.21.15.50:0/1815234914 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17701008e0 0x7f1770100d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:31.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.139+0000 7f1774d14640 1 -- 172.21.15.50:0/1815234914 >> 172.21.15.50:0/1815234914 conn(0x7f17700fbe50 msgr2=0x7f17700fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:31.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.139+0000 7f1774d14640 1 -- 172.21.15.50:0/1815234914 shutdown_connections 2024-06-06T03:26:31.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.139+0000 7f1774d14640 1 -- 172.21.15.50:0/1815234914 wait complete. 2024-06-06T03:26:31.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.140+0000 7f1774d14640 1 Processor -- start 2024-06-06T03:26:31.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.140+0000 7f1774d14640 1 -- start start 2024-06-06T03:26:31.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.140+0000 7f1774d14640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17701008e0 0x7f1770197bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:31.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.140+0000 7f1774d14640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1770101ad0 0x7f17701980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:31.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.140+0000 7f1774d14640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1770102490 0x7f177019f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:31.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.140+0000 7f1774d14640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f177010d530 con 0x7f1770102490 2024-06-06T03:26:31.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.140+0000 7f1774d14640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f177010d3b0 con 0x7f1770101ad0 2024-06-06T03:26:31.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.140+0000 7f1774d14640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f177010d6b0 con 0x7f17701008e0 2024-06-06T03:26:31.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.140+0000 7f176ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1770102490 0x7f177019f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:31.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.140+0000 7f176ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1770102490 0x7f177019f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58206/0 (socket says 172.21.15.50:58206) 2024-06-06T03:26:31.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.140+0000 7f176ed9d640 1 -- 172.21.15.50:0/1018270013 learned_addr learned my addr 172.21.15.50:0/1018270013 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:31.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.140+0000 7f176e59c640 1 --2- 172.21.15.50:0/1018270013 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17701008e0 0x7f1770197bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:31.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.140+0000 7f176dd9b640 1 --2- 172.21.15.50:0/1018270013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1770101ad0 0x7f17701980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:31.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.140+0000 7f176ed9d640 1 -- 172.21.15.50:0/1018270013 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17701008e0 msgr2=0x7f1770197bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:31.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.140+0000 7f176ed9d640 1 --2- 172.21.15.50:0/1018270013 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17701008e0 0x7f1770197bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:31.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.140+0000 7f176ed9d640 1 -- 172.21.15.50:0/1018270013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1770101ad0 msgr2=0x7f17701980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:31.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.140+0000 7f176ed9d640 1 --2- 172.21.15.50:0/1018270013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1770101ad0 0x7f17701980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:31.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.140+0000 7f176ed9d640 1 -- 172.21.15.50:0/1018270013 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f177019f7d0 con 0x7f1770102490 2024-06-06T03:26:31.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.141+0000 7f176e59c640 1 --2- 172.21.15.50:0/1018270013 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17701008e0 0x7f1770197bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:26:31.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.141+0000 7f176dd9b640 1 --2- 172.21.15.50:0/1018270013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1770101ad0 0x7f17701980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:26:31.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.141+0000 7f176ed9d640 1 --2- 172.21.15.50:0/1018270013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1770102490 0x7f177019f160 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1768009dc0 tx=0x7f1768003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:31.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.141+0000 7f175f7fe640 1 -- 172.21.15.50:0/1018270013 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1768032ec0 con 0x7f1770102490 2024-06-06T03:26:31.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.141+0000 7f175f7fe640 1 -- 172.21.15.50:0/1018270013 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f17680044f0 con 0x7f1770102490 2024-06-06T03:26:31.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.141+0000 7f1774d14640 1 -- 172.21.15.50:0/1018270013 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f177019fa60 con 0x7f1770102490 2024-06-06T03:26:31.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.141+0000 7f175f7fe640 1 -- 172.21.15.50:0/1018270013 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1768030d40 con 0x7f1770102490 2024-06-06T03:26:31.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.141+0000 7f1774d14640 1 -- 172.21.15.50:0/1018270013 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f177019ffb0 con 0x7f1770102490 2024-06-06T03:26:31.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.142+0000 7f1774d14640 1 -- 172.21.15.50:0/1018270013 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1770107c80 con 0x7f1770102490 2024-06-06T03:26:31.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.143+0000 7f175f7fe640 1 -- 172.21.15.50:0/1018270013 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1768004040 con 0x7f1770102490 2024-06-06T03:26:31.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.144+0000 7f175f7fe640 1 --2- 172.21.15.50:0/1018270013 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f17580a2d30 0x7f17580a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:31.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.144+0000 7f176e59c640 1 --2- 172.21.15.50:0/1018270013 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f17580a2d30 0x7f17580a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:31.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.144+0000 7f175f7fe640 1 -- 172.21.15.50:0/1018270013 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f17680f0a90 con 0x7f1770102490 2024-06-06T03:26:31.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.144+0000 7f176e59c640 1 --2- 172.21.15.50:0/1018270013 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f17580a2d30 0x7f17580a51f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1770101930 tx=0x7f1760005e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:31.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.148+0000 7f175f7fe640 1 -- 172.21.15.50:0/1018270013 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f17680bd610 con 0x7f1770102490 2024-06-06T03:26:31.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.329+0000 7f1774d14640 1 -- 172.21.15.50:0/1018270013 --> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1770061de0 con 0x7f17580a2d30 2024-06-06T03:26:31.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.339+0000 7f175f7fe640 1 -- 172.21.15.50:0/1018270013 <== mgr.14152 v2:172.21.15.50:6800/1779941165 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340748 (secure 0 0 0) 0x7f1770061de0 con 0x7f17580a2d30 2024-06-06T03:26:31.341 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:26:31.344 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-06-06T03:26:31.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.342+0000 7f1774d14640 1 -- 172.21.15.50:0/1018270013 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f17580a2d30 msgr2=0x7f17580a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:31.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.342+0000 7f1774d14640 1 --2- 172.21.15.50:0/1018270013 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f17580a2d30 0x7f17580a51f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1770101930 tx=0x7f1760005e70 comp rx=0 tx=0).stop 2024-06-06T03:26:31.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.342+0000 7f1774d14640 1 -- 172.21.15.50:0/1018270013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1770102490 msgr2=0x7f177019f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:31.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.342+0000 7f1774d14640 1 --2- 172.21.15.50:0/1018270013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1770102490 0x7f177019f160 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1768009dc0 tx=0x7f1768003ba0 comp rx=0 tx=0).stop 2024-06-06T03:26:31.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.342+0000 7f1774d14640 1 -- 172.21.15.50:0/1018270013 shutdown_connections 2024-06-06T03:26:31.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.342+0000 7f1774d14640 1 --2- 172.21.15.50:0/1018270013 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f17580a2d30 0x7f17580a51f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:31.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.342+0000 7f1774d14640 1 --2- 172.21.15.50:0/1018270013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1770102490 0x7f177019f160 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:31.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.342+0000 7f1774d14640 1 --2- 172.21.15.50:0/1018270013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1770101ad0 0x7f17701980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:31.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.342+0000 7f1774d14640 1 --2- 172.21.15.50:0/1018270013 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17701008e0 0x7f1770197bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:31.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.342+0000 7f1774d14640 1 -- 172.21.15.50:0/1018270013 >> 172.21.15.50:0/1018270013 conn(0x7f17700fbe50 msgr2=0x7f1770104e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:31.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.342+0000 7f1774d14640 1 -- 172.21.15.50:0/1018270013 shutdown_connections 2024-06-06T03:26:31.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:31.342+0000 7f1774d14640 1 -- 172.21.15.50:0/1018270013 wait complete. 2024-06-06T03:26:31.353 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":427,"stamp":"2024-06-06T03:26:29.401942+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662852,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":1202,"num_read_kb":724,"num_write":371,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":798,"ondisk_log_size":798,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":379120,"kb_used_data":13328,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124562704,"statfs":{"total":1151940427776,"available":1151552208896,"internally_reserved":0,"allocated":13647872,"data_stored":8800526,"data_compressed":498432,"data_compressed_allocated":675840,"data_compressed_original":2850816,"omap_allocated":19141,"internal_metadata":374453563},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5790,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":53,"num_write":11,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002990"},"pg_stats":[{"pgid":"3.3f","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.361304+0000","last_change":"2024-06-06T03:22:34.302364+0000","last_active":"2024-06-06T03:25:13.361304+0000","last_peered":"2024-06-06T03:25:13.361304+0000","last_clean":"2024-06-06T03:25:13.361304+0000","last_became_active":"2024-06-06T03:22:34.300403+0000","last_became_peered":"2024-06-06T03:22:34.300403+0000","last_unstale":"2024-06-06T03:25:13.361304+0000","last_undegraded":"2024-06-06T03:25:13.361304+0000","last_fullsized":"2024-06-06T03:25:13.361304+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:27:55.377346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"99'4","reported_seq":43,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.361468+0000","last_change":"2024-06-06T03:22:34.306188+0000","last_active":"2024-06-06T03:25:13.361468+0000","last_peered":"2024-06-06T03:25:13.361468+0000","last_clean":"2024-06-06T03:25:13.361468+0000","last_became_active":"2024-06-06T03:22:34.305705+0000","last_became_peered":"2024-06-06T03:22:34.305705+0000","last_unstale":"2024-06-06T03:25:13.361468+0000","last_undegraded":"2024-06-06T03:25:13.361468+0000","last_fullsized":"2024-06-06T03:25:13.361468+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:10:07.337989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369892+0000","last_change":"2024-06-06T03:22:34.303568+0000","last_active":"2024-06-06T03:25:13.369892+0000","last_peered":"2024-06-06T03:25:13.369892+0000","last_clean":"2024-06-06T03:25:13.369892+0000","last_became_active":"2024-06-06T03:22:34.303194+0000","last_became_peered":"2024-06-06T03:22:34.303194+0000","last_unstale":"2024-06-06T03:25:13.369892+0000","last_undegraded":"2024-06-06T03:25:13.369892+0000","last_fullsized":"2024-06-06T03:25:13.369892+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:40:46.387476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.356411+0000","last_change":"2024-06-06T03:22:34.303896+0000","last_active":"2024-06-06T03:25:13.356411+0000","last_peered":"2024-06-06T03:25:13.356411+0000","last_clean":"2024-06-06T03:25:13.356411+0000","last_became_active":"2024-06-06T03:22:34.303568+0000","last_became_peered":"2024-06-06T03:22:34.303568+0000","last_unstale":"2024-06-06T03:25:13.356411+0000","last_undegraded":"2024-06-06T03:25:13.356411+0000","last_fullsized":"2024-06-06T03:25:13.356411+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:24:20.160115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"99'4","reported_seq":43,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.358644+0000","last_change":"2024-06-06T03:22:34.289868+0000","last_active":"2024-06-06T03:25:13.358644+0000","last_peered":"2024-06-06T03:25:13.358644+0000","last_clean":"2024-06-06T03:25:13.358644+0000","last_became_active":"2024-06-06T03:22:34.289485+0000","last_became_peered":"2024-06-06T03:22:34.289485+0000","last_unstale":"2024-06-06T03:25:13.358644+0000","last_undegraded":"2024-06-06T03:25:13.358644+0000","last_fullsized":"2024-06-06T03:25:13.358644+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:28:58.226092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.347487+0000","last_change":"2024-06-06T03:22:34.304643+0000","last_active":"2024-06-06T03:25:13.347487+0000","last_peered":"2024-06-06T03:25:13.347487+0000","last_clean":"2024-06-06T03:25:13.347487+0000","last_became_active":"2024-06-06T03:22:34.303342+0000","last_became_peered":"2024-06-06T03:22:34.303342+0000","last_unstale":"2024-06-06T03:25:13.347487+0000","last_undegraded":"2024-06-06T03:25:13.347487+0000","last_fullsized":"2024-06-06T03:25:13.347487+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:28:27.838518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.368466+0000","last_change":"2024-06-06T03:22:34.304958+0000","last_active":"2024-06-06T03:25:13.368466+0000","last_peered":"2024-06-06T03:25:13.368466+0000","last_clean":"2024-06-06T03:25:13.368466+0000","last_became_active":"2024-06-06T03:22:34.304582+0000","last_became_peered":"2024-06-06T03:22:34.304582+0000","last_unstale":"2024-06-06T03:25:13.368466+0000","last_undegraded":"2024-06-06T03:25:13.368466+0000","last_fullsized":"2024-06-06T03:25:13.368466+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:08:56.304446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371907+0000","last_change":"2024-06-06T03:22:34.299883+0000","last_active":"2024-06-06T03:25:13.371907+0000","last_peered":"2024-06-06T03:25:13.371907+0000","last_clean":"2024-06-06T03:25:13.371907+0000","last_became_active":"2024-06-06T03:22:34.299568+0000","last_became_peered":"2024-06-06T03:22:34.299568+0000","last_unstale":"2024-06-06T03:25:13.371907+0000","last_undegraded":"2024-06-06T03:25:13.371907+0000","last_fullsized":"2024-06-06T03:25:13.371907+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:23:32.479592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369788+0000","last_change":"2024-06-06T03:22:34.303157+0000","last_active":"2024-06-06T03:25:13.369788+0000","last_peered":"2024-06-06T03:25:13.369788+0000","last_clean":"2024-06-06T03:25:13.369788+0000","last_became_active":"2024-06-06T03:22:34.302332+0000","last_became_peered":"2024-06-06T03:22:34.302332+0000","last_unstale":"2024-06-06T03:25:13.369788+0000","last_undegraded":"2024-06-06T03:25:13.369788+0000","last_fullsized":"2024-06-06T03:25:13.369788+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:27:32.420058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"99'16","reported_seq":61,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.352791+0000","last_change":"2024-06-06T03:23:14.517357+0000","last_active":"2024-06-06T03:25:13.352791+0000","last_peered":"2024-06-06T03:25:13.352791+0000","last_clean":"2024-06-06T03:25:13.352791+0000","last_became_active":"2024-06-06T03:23:14.516932+0000","last_became_peered":"2024-06-06T03:23:14.516932+0000","last_unstale":"2024-06-06T03:25:13.352791+0000","last_undegraded":"2024-06-06T03:25:13.352791+0000","last_fullsized":"2024-06-06T03:25:13.352791+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:23:43.907192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369989+0000","last_change":"2024-06-06T03:22:34.310010+0000","last_active":"2024-06-06T03:25:13.369989+0000","last_peered":"2024-06-06T03:25:13.369989+0000","last_clean":"2024-06-06T03:25:13.369989+0000","last_became_active":"2024-06-06T03:22:34.309636+0000","last_became_peered":"2024-06-06T03:22:34.309636+0000","last_unstale":"2024-06-06T03:25:13.369989+0000","last_undegraded":"2024-06-06T03:25:13.369989+0000","last_fullsized":"2024-06-06T03:25:13.369989+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:35:53.745050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.351414+0000","last_change":"2024-06-06T03:22:34.311364+0000","last_active":"2024-06-06T03:25:13.351414+0000","last_peered":"2024-06-06T03:25:13.351414+0000","last_clean":"2024-06-06T03:25:13.351414+0000","last_became_active":"2024-06-06T03:22:34.311003+0000","last_became_peered":"2024-06-06T03:22:34.311003+0000","last_unstale":"2024-06-06T03:25:13.351414+0000","last_undegraded":"2024-06-06T03:25:13.351414+0000","last_fullsized":"2024-06-06T03:25:13.351414+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:35:32.460362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.372924+0000","last_change":"2024-06-06T03:22:34.302843+0000","last_active":"2024-06-06T03:25:13.372924+0000","last_peered":"2024-06-06T03:25:13.372924+0000","last_clean":"2024-06-06T03:25:13.372924+0000","last_became_active":"2024-06-06T03:22:34.302581+0000","last_became_peered":"2024-06-06T03:22:34.302581+0000","last_unstale":"2024-06-06T03:25:13.372924+0000","last_undegraded":"2024-06-06T03:25:13.372924+0000","last_fullsized":"2024-06-06T03:25:13.372924+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:56:14.178848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.362752+0000","last_change":"2024-06-06T03:22:34.305792+0000","last_active":"2024-06-06T03:25:13.362752+0000","last_peered":"2024-06-06T03:25:13.362752+0000","last_clean":"2024-06-06T03:25:13.362752+0000","last_became_active":"2024-06-06T03:22:34.305389+0000","last_became_peered":"2024-06-06T03:22:34.305389+0000","last_unstale":"2024-06-06T03:25:13.362752+0000","last_undegraded":"2024-06-06T03:25:13.362752+0000","last_fullsized":"2024-06-06T03:25:13.362752+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:17:05.992382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369254+0000","last_change":"2024-06-06T03:22:34.298396+0000","last_active":"2024-06-06T03:25:13.369254+0000","last_peered":"2024-06-06T03:25:13.369254+0000","last_clean":"2024-06-06T03:25:13.369254+0000","last_became_active":"2024-06-06T03:22:34.297697+0000","last_became_peered":"2024-06-06T03:22:34.297697+0000","last_unstale":"2024-06-06T03:25:13.369254+0000","last_undegraded":"2024-06-06T03:25:13.369254+0000","last_fullsized":"2024-06-06T03:25:13.369254+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:24:07.143699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369399+0000","last_change":"2024-06-06T03:22:34.312801+0000","last_active":"2024-06-06T03:25:13.369399+0000","last_peered":"2024-06-06T03:25:13.369399+0000","last_clean":"2024-06-06T03:25:13.369399+0000","last_became_active":"2024-06-06T03:22:34.312206+0000","last_became_peered":"2024-06-06T03:22:34.312206+0000","last_unstale":"2024-06-06T03:25:13.369399+0000","last_undegraded":"2024-06-06T03:25:13.369399+0000","last_fullsized":"2024-06-06T03:25:13.369399+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:31:41.286548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.364965+0000","last_change":"2024-06-06T03:22:34.303527+0000","last_active":"2024-06-06T03:25:13.364965+0000","last_peered":"2024-06-06T03:25:13.364965+0000","last_clean":"2024-06-06T03:25:13.364965+0000","last_became_active":"2024-06-06T03:22:34.302919+0000","last_became_peered":"2024-06-06T03:22:34.302919+0000","last_unstale":"2024-06-06T03:25:13.364965+0000","last_undegraded":"2024-06-06T03:25:13.364965+0000","last_fullsized":"2024-06-06T03:25:13.364965+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:41:44.128543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.356298+0000","last_change":"2024-06-06T03:22:34.304801+0000","last_active":"2024-06-06T03:25:13.356298+0000","last_peered":"2024-06-06T03:25:13.356298+0000","last_clean":"2024-06-06T03:25:13.356298+0000","last_became_active":"2024-06-06T03:22:34.304463+0000","last_became_peered":"2024-06-06T03:22:34.304463+0000","last_unstale":"2024-06-06T03:25:13.356298+0000","last_undegraded":"2024-06-06T03:25:13.356298+0000","last_fullsized":"2024-06-06T03:25:13.356298+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:28:22.789816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.365052+0000","last_change":"2024-06-06T03:22:34.290053+0000","last_active":"2024-06-06T03:25:13.365052+0000","last_peered":"2024-06-06T03:25:13.365052+0000","last_clean":"2024-06-06T03:25:13.365052+0000","last_became_active":"2024-06-06T03:22:34.289712+0000","last_became_peered":"2024-06-06T03:22:34.289712+0000","last_unstale":"2024-06-06T03:25:13.365052+0000","last_undegraded":"2024-06-06T03:25:13.365052+0000","last_fullsized":"2024-06-06T03:25:13.365052+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:12:02.296431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973398+0000","last_change":"2024-06-06T03:22:44.421722+0000","last_active":"2024-06-06T03:24:14.973398+0000","last_peered":"2024-06-06T03:24:14.973398+0000","last_clean":"2024-06-06T03:24:14.973398+0000","last_became_active":"2024-06-06T03:22:44.421215+0000","last_became_peered":"2024-06-06T03:22:44.421215+0000","last_unstale":"2024-06-06T03:24:14.973398+0000","last_undegraded":"2024-06-06T03:24:14.973398+0000","last_fullsized":"2024-06-06T03:24:14.973398+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:22:59.749839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"97'9","reported_seq":55,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.379751+0000","last_change":"2024-06-06T03:22:31.053826+0000","last_active":"2024-06-06T03:24:15.379751+0000","last_peered":"2024-06-06T03:24:15.379751+0000","last_clean":"2024-06-06T03:24:15.379751+0000","last_became_active":"2024-06-06T03:22:31.053537+0000","last_became_peered":"2024-06-06T03:22:31.053537+0000","last_unstale":"2024-06-06T03:24:15.379751+0000","last_undegraded":"2024-06-06T03:24:15.379751+0000","last_fullsized":"2024-06-06T03:24:15.379751+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:18:52.967104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371315+0000","last_change":"2024-06-06T03:22:34.291554+0000","last_active":"2024-06-06T03:25:13.371315+0000","last_peered":"2024-06-06T03:25:13.371315+0000","last_clean":"2024-06-06T03:25:13.371315+0000","last_became_active":"2024-06-06T03:22:34.290600+0000","last_became_peered":"2024-06-06T03:22:34.290600+0000","last_unstale":"2024-06-06T03:25:13.371315+0000","last_undegraded":"2024-06-06T03:25:13.371315+0000","last_fullsized":"2024-06-06T03:25:13.371315+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:03:32.860134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163376+0000","last_change":"2024-06-06T03:22:44.424337+0000","last_active":"2024-06-06T03:24:15.163376+0000","last_peered":"2024-06-06T03:24:15.163376+0000","last_clean":"2024-06-06T03:24:15.163376+0000","last_became_active":"2024-06-06T03:22:44.423919+0000","last_became_peered":"2024-06-06T03:22:44.423919+0000","last_unstale":"2024-06-06T03:24:15.163376+0000","last_undegraded":"2024-06-06T03:24:15.163376+0000","last_fullsized":"2024-06-06T03:24:15.163376+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:34:32.801117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"97'2","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.379810+0000","last_change":"2024-06-06T03:22:31.242326+0000","last_active":"2024-06-06T03:24:15.379810+0000","last_peered":"2024-06-06T03:24:15.379810+0000","last_clean":"2024-06-06T03:24:15.379810+0000","last_became_active":"2024-06-06T03:22:31.241960+0000","last_became_peered":"2024-06-06T03:22:31.241960+0000","last_unstale":"2024-06-06T03:24:15.379810+0000","last_undegraded":"2024-06-06T03:24:15.379810+0000","last_fullsized":"2024-06-06T03:24:15.379810+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:19:57.820119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369698+0000","last_change":"2024-06-06T03:22:34.303438+0000","last_active":"2024-06-06T03:25:13.369698+0000","last_peered":"2024-06-06T03:25:13.369698+0000","last_clean":"2024-06-06T03:25:13.369698+0000","last_became_active":"2024-06-06T03:22:34.302057+0000","last_became_peered":"2024-06-06T03:22:34.302057+0000","last_unstale":"2024-06-06T03:25:13.369698+0000","last_undegraded":"2024-06-06T03:25:13.369698+0000","last_fullsized":"2024-06-06T03:25:13.369698+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:52:20.508656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163601+0000","last_change":"2024-06-06T03:22:44.424732+0000","last_active":"2024-06-06T03:24:15.163601+0000","last_peered":"2024-06-06T03:24:15.163601+0000","last_clean":"2024-06-06T03:24:15.163601+0000","last_became_active":"2024-06-06T03:22:44.423906+0000","last_became_peered":"2024-06-06T03:22:44.423906+0000","last_unstale":"2024-06-06T03:24:15.163601+0000","last_undegraded":"2024-06-06T03:24:15.163601+0000","last_fullsized":"2024-06-06T03:24:15.163601+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:45:04.344747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"97'4","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700231+0000","last_change":"2024-06-06T03:22:31.057003+0000","last_active":"2024-06-06T03:24:14.700231+0000","last_peered":"2024-06-06T03:24:14.700231+0000","last_clean":"2024-06-06T03:24:14.700231+0000","last_became_active":"2024-06-06T03:22:31.056660+0000","last_became_peered":"2024-06-06T03:22:31.056660+0000","last_unstale":"2024-06-06T03:24:14.700231+0000","last_undegraded":"2024-06-06T03:24:14.700231+0000","last_fullsized":"2024-06-06T03:24:14.700231+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:44:16.726749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.367434+0000","last_change":"2024-06-06T03:22:34.306196+0000","last_active":"2024-06-06T03:25:13.367434+0000","last_peered":"2024-06-06T03:25:13.367434+0000","last_clean":"2024-06-06T03:25:13.367434+0000","last_became_active":"2024-06-06T03:22:34.304962+0000","last_became_peered":"2024-06-06T03:22:34.304962+0000","last_unstale":"2024-06-06T03:25:13.367434+0000","last_undegraded":"2024-06-06T03:25:13.367434+0000","last_fullsized":"2024-06-06T03:25:13.367434+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:25:04.990371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163359+0000","last_change":"2024-06-06T03:22:44.419624+0000","last_active":"2024-06-06T03:24:15.163359+0000","last_peered":"2024-06-06T03:24:15.163359+0000","last_clean":"2024-06-06T03:24:15.163359+0000","last_became_active":"2024-06-06T03:22:44.418713+0000","last_became_peered":"2024-06-06T03:22:44.418713+0000","last_unstale":"2024-06-06T03:24:15.163359+0000","last_undegraded":"2024-06-06T03:24:15.163359+0000","last_fullsized":"2024-06-06T03:24:15.163359+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:04:54.010364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'2","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700029+0000","last_change":"2024-06-06T03:22:31.059332+0000","last_active":"2024-06-06T03:24:14.700029+0000","last_peered":"2024-06-06T03:24:14.700029+0000","last_clean":"2024-06-06T03:24:14.700029+0000","last_became_active":"2024-06-06T03:22:31.058478+0000","last_became_peered":"2024-06-06T03:22:31.058478+0000","last_unstale":"2024-06-06T03:24:14.700029+0000","last_undegraded":"2024-06-06T03:24:14.700029+0000","last_fullsized":"2024-06-06T03:24:14.700029+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:24:46.452708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"99'15","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.373335+0000","last_change":"2024-06-06T03:22:34.301650+0000","last_active":"2024-06-06T03:25:13.373335+0000","last_peered":"2024-06-06T03:25:13.373335+0000","last_clean":"2024-06-06T03:25:13.373335+0000","last_became_active":"2024-06-06T03:22:34.301220+0000","last_became_peered":"2024-06-06T03:22:34.301220+0000","last_unstale":"2024-06-06T03:25:13.373335+0000","last_undegraded":"2024-06-06T03:25:13.373335+0000","last_fullsized":"2024-06-06T03:25:13.373335+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:43:07.396971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973578+0000","last_change":"2024-06-06T03:22:44.413406+0000","last_active":"2024-06-06T03:24:14.973578+0000","last_peered":"2024-06-06T03:24:14.973578+0000","last_clean":"2024-06-06T03:24:14.973578+0000","last_became_active":"2024-06-06T03:22:44.412977+0000","last_became_peered":"2024-06-06T03:22:44.412977+0000","last_unstale":"2024-06-06T03:24:14.973578+0000","last_undegraded":"2024-06-06T03:24:14.973578+0000","last_fullsized":"2024-06-06T03:24:14.973578+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:11:02.017352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"99'6","reported_seq":227,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:26:26.863327+0000","last_change":"2024-06-06T03:22:31.056091+0000","last_active":"2024-06-06T03:26:26.863327+0000","last_peered":"2024-06-06T03:26:26.863327+0000","last_clean":"2024-06-06T03:26:26.863327+0000","last_became_active":"2024-06-06T03:22:31.055184+0000","last_became_peered":"2024-06-06T03:22:31.055184+0000","last_unstale":"2024-06-06T03:26:26.863327+0000","last_undegraded":"2024-06-06T03:26:26.863327+0000","last_fullsized":"2024-06-06T03:26:26.863327+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:32:37.761082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.357597+0000","last_change":"2024-06-06T03:22:34.305386+0000","last_active":"2024-06-06T03:25:13.357597+0000","last_peered":"2024-06-06T03:25:13.357597+0000","last_clean":"2024-06-06T03:25:13.357597+0000","last_became_active":"2024-06-06T03:22:34.304505+0000","last_became_peered":"2024-06-06T03:22:34.304505+0000","last_unstale":"2024-06-06T03:25:13.357597+0000","last_undegraded":"2024-06-06T03:25:13.357597+0000","last_fullsized":"2024-06-06T03:25:13.357597+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:34:31.800443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":36,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973665+0000","last_change":"2024-06-06T03:23:15.075519+0000","last_active":"2024-06-06T03:24:14.973665+0000","last_peered":"2024-06-06T03:24:14.973665+0000","last_clean":"2024-06-06T03:24:14.973665+0000","last_became_active":"2024-06-06T03:23:15.074970+0000","last_became_peered":"2024-06-06T03:23:15.074970+0000","last_unstale":"2024-06-06T03:24:14.973665+0000","last_undegraded":"2024-06-06T03:24:14.973665+0000","last_fullsized":"2024-06-06T03:24:14.973665+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:39:25.915175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.895888+0000","last_change":"2024-06-06T03:22:31.058530+0000","last_active":"2024-06-06T03:24:14.895888+0000","last_peered":"2024-06-06T03:24:14.895888+0000","last_clean":"2024-06-06T03:24:14.895888+0000","last_became_active":"2024-06-06T03:22:31.058185+0000","last_became_peered":"2024-06-06T03:22:31.058185+0000","last_unstale":"2024-06-06T03:24:14.895888+0000","last_undegraded":"2024-06-06T03:24:14.895888+0000","last_fullsized":"2024-06-06T03:24:14.895888+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:28:59.023322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.372958+0000","last_change":"2024-06-06T03:22:34.292995+0000","last_active":"2024-06-06T03:25:13.372958+0000","last_peered":"2024-06-06T03:25:13.372958+0000","last_clean":"2024-06-06T03:25:13.372958+0000","last_became_active":"2024-06-06T03:22:34.292625+0000","last_became_peered":"2024-06-06T03:22:34.292625+0000","last_unstale":"2024-06-06T03:25:13.372958+0000","last_undegraded":"2024-06-06T03:25:13.372958+0000","last_fullsized":"2024-06-06T03:25:13.372958+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:03:18.985660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380827+0000","last_change":"2024-06-06T03:22:44.417395+0000","last_active":"2024-06-06T03:24:15.380827+0000","last_peered":"2024-06-06T03:24:15.380827+0000","last_clean":"2024-06-06T03:24:15.380827+0000","last_became_active":"2024-06-06T03:22:44.416929+0000","last_became_peered":"2024-06-06T03:22:44.416929+0000","last_unstale":"2024-06-06T03:24:15.380827+0000","last_undegraded":"2024-06-06T03:24:15.380827+0000","last_fullsized":"2024-06-06T03:24:15.380827+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:28:09.548691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700631+0000","last_change":"2024-06-06T03:22:31.051163+0000","last_active":"2024-06-06T03:24:14.700631+0000","last_peered":"2024-06-06T03:24:14.700631+0000","last_clean":"2024-06-06T03:24:14.700631+0000","last_became_active":"2024-06-06T03:22:31.050800+0000","last_became_peered":"2024-06-06T03:22:31.050800+0000","last_unstale":"2024-06-06T03:24:14.700631+0000","last_undegraded":"2024-06-06T03:24:14.700631+0000","last_fullsized":"2024-06-06T03:24:14.700631+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:13:40.197723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.372748+0000","last_change":"2024-06-06T03:22:34.293586+0000","last_active":"2024-06-06T03:25:13.372748+0000","last_peered":"2024-06-06T03:25:13.372748+0000","last_clean":"2024-06-06T03:25:13.372748+0000","last_became_active":"2024-06-06T03:22:34.292651+0000","last_became_peered":"2024-06-06T03:22:34.292651+0000","last_unstale":"2024-06-06T03:25:13.372748+0000","last_undegraded":"2024-06-06T03:25:13.372748+0000","last_fullsized":"2024-06-06T03:25:13.372748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:11:16.221948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.698917+0000","last_change":"2024-06-06T03:22:44.415005+0000","last_active":"2024-06-06T03:24:14.698917+0000","last_peered":"2024-06-06T03:24:14.698917+0000","last_clean":"2024-06-06T03:24:14.698917+0000","last_became_active":"2024-06-06T03:22:44.414522+0000","last_became_peered":"2024-06-06T03:22:44.414522+0000","last_unstale":"2024-06-06T03:24:14.698917+0000","last_undegraded":"2024-06-06T03:24:14.698917+0000","last_fullsized":"2024-06-06T03:24:14.698917+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:36:03.240089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"97'1","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.370600+0000","last_change":"2024-06-06T03:22:31.056068+0000","last_active":"2024-06-06T03:24:15.370600+0000","last_peered":"2024-06-06T03:24:15.370600+0000","last_clean":"2024-06-06T03:24:15.370600+0000","last_became_active":"2024-06-06T03:22:31.055628+0000","last_became_peered":"2024-06-06T03:22:31.055628+0000","last_unstale":"2024-06-06T03:24:15.370600+0000","last_undegraded":"2024-06-06T03:24:15.370600+0000","last_fullsized":"2024-06-06T03:24:15.370600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:40:37.491491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.366436+0000","last_change":"2024-06-06T03:22:34.300945+0000","last_active":"2024-06-06T03:25:13.366436+0000","last_peered":"2024-06-06T03:25:13.366436+0000","last_clean":"2024-06-06T03:25:13.366436+0000","last_became_active":"2024-06-06T03:22:34.300618+0000","last_became_peered":"2024-06-06T03:22:34.300618+0000","last_unstale":"2024-06-06T03:25:13.366436+0000","last_undegraded":"2024-06-06T03:25:13.366436+0000","last_fullsized":"2024-06-06T03:25:13.366436+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:32:39.875148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380716+0000","last_change":"2024-06-06T03:22:44.417759+0000","last_active":"2024-06-06T03:24:15.380716+0000","last_peered":"2024-06-06T03:24:15.380716+0000","last_clean":"2024-06-06T03:24:15.380716+0000","last_became_active":"2024-06-06T03:22:44.417335+0000","last_became_peered":"2024-06-06T03:22:44.417335+0000","last_unstale":"2024-06-06T03:24:15.380716+0000","last_undegraded":"2024-06-06T03:24:15.380716+0000","last_fullsized":"2024-06-06T03:24:15.380716+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:43:24.408740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"99'4","reported_seq":223,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:26:27.864216+0000","last_change":"2024-06-06T03:22:31.054351+0000","last_active":"2024-06-06T03:26:27.864216+0000","last_peered":"2024-06-06T03:26:27.864216+0000","last_clean":"2024-06-06T03:26:27.864216+0000","last_became_active":"2024-06-06T03:22:31.053954+0000","last_became_peered":"2024-06-06T03:22:31.053954+0000","last_unstale":"2024-06-06T03:26:27.864216+0000","last_undegraded":"2024-06-06T03:26:27.864216+0000","last_fullsized":"2024-06-06T03:26:27.864216+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:22:46.405507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":174,"num_read_kb":174,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.367722+0000","last_change":"2024-06-06T03:22:34.303208+0000","last_active":"2024-06-06T03:25:13.367722+0000","last_peered":"2024-06-06T03:25:13.367722+0000","last_clean":"2024-06-06T03:25:13.367722+0000","last_became_active":"2024-06-06T03:22:34.302882+0000","last_became_peered":"2024-06-06T03:22:34.302882+0000","last_unstale":"2024-06-06T03:25:13.367722+0000","last_undegraded":"2024-06-06T03:25:13.367722+0000","last_fullsized":"2024-06-06T03:25:13.367722+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:01:36.963056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380041+0000","last_change":"2024-06-06T03:22:44.418095+0000","last_active":"2024-06-06T03:24:15.380041+0000","last_peered":"2024-06-06T03:24:15.380041+0000","last_clean":"2024-06-06T03:24:15.380041+0000","last_became_active":"2024-06-06T03:22:44.417625+0000","last_became_peered":"2024-06-06T03:22:44.417625+0000","last_unstale":"2024-06-06T03:24:15.380041+0000","last_undegraded":"2024-06-06T03:24:15.380041+0000","last_fullsized":"2024-06-06T03:24:15.380041+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:20:53.859638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.701041+0000","last_change":"2024-06-06T03:22:31.057558+0000","last_active":"2024-06-06T03:24:14.701041+0000","last_peered":"2024-06-06T03:24:14.701041+0000","last_clean":"2024-06-06T03:24:14.701041+0000","last_became_active":"2024-06-06T03:22:31.057168+0000","last_became_peered":"2024-06-06T03:22:31.057168+0000","last_unstale":"2024-06-06T03:24:14.701041+0000","last_undegraded":"2024-06-06T03:24:14.701041+0000","last_fullsized":"2024-06-06T03:24:14.701041+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:33:59.019923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.373648+0000","last_change":"2024-06-06T03:22:34.299220+0000","last_active":"2024-06-06T03:25:13.373648+0000","last_peered":"2024-06-06T03:25:13.373648+0000","last_clean":"2024-06-06T03:25:13.373648+0000","last_became_active":"2024-06-06T03:22:34.298873+0000","last_became_peered":"2024-06-06T03:22:34.298873+0000","last_unstale":"2024-06-06T03:25:13.373648+0000","last_undegraded":"2024-06-06T03:25:13.373648+0000","last_fullsized":"2024-06-06T03:25:13.373648+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:31:53.501036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163660+0000","last_change":"2024-06-06T03:22:44.424792+0000","last_active":"2024-06-06T03:24:15.163660+0000","last_peered":"2024-06-06T03:24:15.163660+0000","last_clean":"2024-06-06T03:24:15.163660+0000","last_became_active":"2024-06-06T03:22:44.423973+0000","last_became_peered":"2024-06-06T03:22:44.423973+0000","last_unstale":"2024-06-06T03:24:15.163660+0000","last_undegraded":"2024-06-06T03:24:15.163660+0000","last_fullsized":"2024-06-06T03:24:15.163660+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:46:51.232764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"97'4","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.370511+0000","last_change":"2024-06-06T03:22:31.243885+0000","last_active":"2024-06-06T03:24:15.370511+0000","last_peered":"2024-06-06T03:24:15.370511+0000","last_clean":"2024-06-06T03:24:15.370511+0000","last_became_active":"2024-06-06T03:22:31.243367+0000","last_became_peered":"2024-06-06T03:22:31.243367+0000","last_unstale":"2024-06-06T03:24:15.370511+0000","last_undegraded":"2024-06-06T03:24:15.370511+0000","last_fullsized":"2024-06-06T03:24:15.370511+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:57:13.464974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.367835+0000","last_change":"2024-06-06T03:22:34.299247+0000","last_active":"2024-06-06T03:25:13.367835+0000","last_peered":"2024-06-06T03:25:13.367835+0000","last_clean":"2024-06-06T03:25:13.367835+0000","last_became_active":"2024-06-06T03:22:34.298538+0000","last_became_peered":"2024-06-06T03:22:34.298538+0000","last_unstale":"2024-06-06T03:25:13.367835+0000","last_undegraded":"2024-06-06T03:25:13.367835+0000","last_fullsized":"2024-06-06T03:25:13.367835+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:53:16.724575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380294+0000","last_change":"2024-06-06T03:22:44.423817+0000","last_active":"2024-06-06T03:24:15.380294+0000","last_peered":"2024-06-06T03:24:15.380294+0000","last_clean":"2024-06-06T03:24:15.380294+0000","last_became_active":"2024-06-06T03:22:44.423333+0000","last_became_peered":"2024-06-06T03:22:44.423333+0000","last_unstale":"2024-06-06T03:24:15.380294+0000","last_undegraded":"2024-06-06T03:24:15.380294+0000","last_fullsized":"2024-06-06T03:24:15.380294+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:22:46.174850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"99'39","reported_seq":444,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:26:28.866133+0000","last_change":"2024-06-06T03:22:31.056446+0000","last_active":"2024-06-06T03:26:28.866133+0000","last_peered":"2024-06-06T03:26:28.866133+0000","last_clean":"2024-06-06T03:26:28.866133+0000","last_became_active":"2024-06-06T03:22:31.056089+0000","last_became_peered":"2024-06-06T03:22:31.056089+0000","last_unstale":"2024-06-06T03:26:28.866133+0000","last_undegraded":"2024-06-06T03:26:28.866133+0000","last_fullsized":"2024-06-06T03:26:28.866133+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:11:37.705889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67125,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":360,"num_read_kb":246,"num_write":40,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.346439+0000","last_change":"2024-06-06T03:22:34.302229+0000","last_active":"2024-06-06T03:25:13.346439+0000","last_peered":"2024-06-06T03:25:13.346439+0000","last_clean":"2024-06-06T03:25:13.346439+0000","last_became_active":"2024-06-06T03:22:34.301877+0000","last_became_peered":"2024-06-06T03:22:34.301877+0000","last_unstale":"2024-06-06T03:25:13.346439+0000","last_undegraded":"2024-06-06T03:25:13.346439+0000","last_fullsized":"2024-06-06T03:25:13.346439+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:19:22.545435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.371635+0000","last_change":"2024-06-06T03:22:44.421024+0000","last_active":"2024-06-06T03:24:15.371635+0000","last_peered":"2024-06-06T03:24:15.371635+0000","last_clean":"2024-06-06T03:24:15.371635+0000","last_became_active":"2024-06-06T03:22:44.420502+0000","last_became_peered":"2024-06-06T03:22:44.420502+0000","last_unstale":"2024-06-06T03:24:15.371635+0000","last_undegraded":"2024-06-06T03:24:15.371635+0000","last_fullsized":"2024-06-06T03:24:15.371635+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:15:55.246032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"97'6","reported_seq":51,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973641+0000","last_change":"2024-06-06T03:22:31.054128+0000","last_active":"2024-06-06T03:24:14.973641+0000","last_peered":"2024-06-06T03:24:14.973641+0000","last_clean":"2024-06-06T03:24:14.973641+0000","last_became_active":"2024-06-06T03:22:31.053740+0000","last_became_peered":"2024-06-06T03:22:31.053740+0000","last_unstale":"2024-06-06T03:24:14.973641+0000","last_undegraded":"2024-06-06T03:24:14.973641+0000","last_fullsized":"2024-06-06T03:24:14.973641+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:12:21.494702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.368206+0000","last_change":"2024-06-06T03:22:34.297861+0000","last_active":"2024-06-06T03:25:13.368206+0000","last_peered":"2024-06-06T03:25:13.368206+0000","last_clean":"2024-06-06T03:25:13.368206+0000","last_became_active":"2024-06-06T03:22:34.297391+0000","last_became_peered":"2024-06-06T03:22:34.297391+0000","last_unstale":"2024-06-06T03:25:13.368206+0000","last_undegraded":"2024-06-06T03:25:13.368206+0000","last_fullsized":"2024-06-06T03:25:13.368206+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:10:33.973635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380551+0000","last_change":"2024-06-06T03:22:44.416087+0000","last_active":"2024-06-06T03:24:15.380551+0000","last_peered":"2024-06-06T03:24:15.380551+0000","last_clean":"2024-06-06T03:24:15.380551+0000","last_became_active":"2024-06-06T03:22:44.415646+0000","last_became_peered":"2024-06-06T03:22:44.415646+0000","last_unstale":"2024-06-06T03:24:15.380551+0000","last_undegraded":"2024-06-06T03:24:15.380551+0000","last_fullsized":"2024-06-06T03:24:15.380551+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:44:43.690830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.370474+0000","last_change":"2024-06-06T03:22:31.056814+0000","last_active":"2024-06-06T03:24:15.370474+0000","last_peered":"2024-06-06T03:24:15.370474+0000","last_clean":"2024-06-06T03:24:15.370474+0000","last_became_active":"2024-06-06T03:22:31.055183+0000","last_became_peered":"2024-06-06T03:22:31.055183+0000","last_unstale":"2024-06-06T03:24:15.370474+0000","last_undegraded":"2024-06-06T03:24:15.370474+0000","last_fullsized":"2024-06-06T03:24:15.370474+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:26:27.299068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"99'15","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371815+0000","last_change":"2024-06-06T03:22:34.311995+0000","last_active":"2024-06-06T03:25:13.371815+0000","last_peered":"2024-06-06T03:25:13.371815+0000","last_clean":"2024-06-06T03:25:13.371815+0000","last_became_active":"2024-06-06T03:22:34.311665+0000","last_became_peered":"2024-06-06T03:22:34.311665+0000","last_unstale":"2024-06-06T03:25:13.371815+0000","last_undegraded":"2024-06-06T03:25:13.371815+0000","last_fullsized":"2024-06-06T03:25:13.371815+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:53:10.539212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380693+0000","last_change":"2024-06-06T03:22:44.414170+0000","last_active":"2024-06-06T03:24:15.380693+0000","last_peered":"2024-06-06T03:24:15.380693+0000","last_clean":"2024-06-06T03:24:15.380693+0000","last_became_active":"2024-06-06T03:22:44.413635+0000","last_became_peered":"2024-06-06T03:22:44.413635+0000","last_unstale":"2024-06-06T03:24:15.380693+0000","last_undegraded":"2024-06-06T03:24:15.380693+0000","last_fullsized":"2024-06-06T03:24:15.380693+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:06:25.223810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"99'6","reported_seq":229,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:26:27.918261+0000","last_change":"2024-06-06T03:22:31.057846+0000","last_active":"2024-06-06T03:26:27.918261+0000","last_peered":"2024-06-06T03:26:27.918261+0000","last_clean":"2024-06-06T03:26:27.918261+0000","last_became_active":"2024-06-06T03:22:31.056635+0000","last_became_peered":"2024-06-06T03:22:31.056635+0000","last_unstale":"2024-06-06T03:26:27.918261+0000","last_undegraded":"2024-06-06T03:26:27.918261+0000","last_fullsized":"2024-06-06T03:26:27.918261+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:59:03.845722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1611,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":180,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.368520+0000","last_change":"2024-06-06T03:22:34.304832+0000","last_active":"2024-06-06T03:25:13.368520+0000","last_peered":"2024-06-06T03:25:13.368520+0000","last_clean":"2024-06-06T03:25:13.368520+0000","last_became_active":"2024-06-06T03:22:34.304494+0000","last_became_peered":"2024-06-06T03:22:34.304494+0000","last_unstale":"2024-06-06T03:25:13.368520+0000","last_undegraded":"2024-06-06T03:25:13.368520+0000","last_fullsized":"2024-06-06T03:25:13.368520+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:17:02.855580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.701044+0000","last_change":"2024-06-06T03:22:44.418561+0000","last_active":"2024-06-06T03:24:14.701044+0000","last_peered":"2024-06-06T03:24:14.701044+0000","last_clean":"2024-06-06T03:24:14.701044+0000","last_became_active":"2024-06-06T03:22:44.418050+0000","last_became_peered":"2024-06-06T03:22:44.418050+0000","last_unstale":"2024-06-06T03:24:14.701044+0000","last_undegraded":"2024-06-06T03:24:14.701044+0000","last_fullsized":"2024-06-06T03:24:14.701044+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:39:57.680990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"97'15","reported_seq":60,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.699578+0000","last_change":"2024-06-06T03:22:31.242981+0000","last_active":"2024-06-06T03:24:14.699578+0000","last_peered":"2024-06-06T03:24:14.699578+0000","last_clean":"2024-06-06T03:24:14.699578+0000","last_became_active":"2024-06-06T03:22:31.242448+0000","last_became_peered":"2024-06-06T03:22:31.242448+0000","last_unstale":"2024-06-06T03:24:14.699578+0000","last_undegraded":"2024-06-06T03:24:14.699578+0000","last_fullsized":"2024-06-06T03:24:14.699578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:18:25.855327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.372636+0000","last_change":"2024-06-06T03:22:34.300799+0000","last_active":"2024-06-06T03:25:13.372636+0000","last_peered":"2024-06-06T03:25:13.372636+0000","last_clean":"2024-06-06T03:25:13.372636+0000","last_became_active":"2024-06-06T03:22:34.300397+0000","last_became_peered":"2024-06-06T03:22:34.300397+0000","last_unstale":"2024-06-06T03:25:13.372636+0000","last_undegraded":"2024-06-06T03:25:13.372636+0000","last_fullsized":"2024-06-06T03:25:13.372636+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:55:31.621711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.371189+0000","last_change":"2024-06-06T03:22:44.418341+0000","last_active":"2024-06-06T03:24:15.371189+0000","last_peered":"2024-06-06T03:24:15.371189+0000","last_clean":"2024-06-06T03:24:15.371189+0000","last_became_active":"2024-06-06T03:22:44.417881+0000","last_became_peered":"2024-06-06T03:22:44.417881+0000","last_unstale":"2024-06-06T03:24:15.371189+0000","last_undegraded":"2024-06-06T03:24:15.371189+0000","last_fullsized":"2024-06-06T03:24:15.371189+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:43:13.869298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700063+0000","last_change":"2024-06-06T03:22:31.054749+0000","last_active":"2024-06-06T03:24:14.700063+0000","last_peered":"2024-06-06T03:24:14.700063+0000","last_clean":"2024-06-06T03:24:14.700063+0000","last_became_active":"2024-06-06T03:22:31.054180+0000","last_became_peered":"2024-06-06T03:22:31.054180+0000","last_unstale":"2024-06-06T03:24:14.700063+0000","last_undegraded":"2024-06-06T03:24:14.700063+0000","last_fullsized":"2024-06-06T03:24:14.700063+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:30:17.902778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371538+0000","last_change":"2024-06-06T03:22:34.299573+0000","last_active":"2024-06-06T03:25:13.371538+0000","last_peered":"2024-06-06T03:25:13.371538+0000","last_clean":"2024-06-06T03:25:13.371538+0000","last_became_active":"2024-06-06T03:22:34.299201+0000","last_became_peered":"2024-06-06T03:22:34.299201+0000","last_unstale":"2024-06-06T03:25:13.371538+0000","last_undegraded":"2024-06-06T03:25:13.371538+0000","last_fullsized":"2024-06-06T03:25:13.371538+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:02:47.043087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.699582+0000","last_change":"2024-06-06T03:22:44.409672+0000","last_active":"2024-06-06T03:24:14.699582+0000","last_peered":"2024-06-06T03:24:14.699582+0000","last_clean":"2024-06-06T03:24:14.699582+0000","last_became_active":"2024-06-06T03:22:44.409246+0000","last_became_peered":"2024-06-06T03:22:44.409246+0000","last_unstale":"2024-06-06T03:24:14.699582+0000","last_undegraded":"2024-06-06T03:24:14.699582+0000","last_fullsized":"2024-06-06T03:24:14.699582+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:44:49.481886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.379711+0000","last_change":"2024-06-06T03:22:31.243562+0000","last_active":"2024-06-06T03:24:15.379711+0000","last_peered":"2024-06-06T03:24:15.379711+0000","last_clean":"2024-06-06T03:24:15.379711+0000","last_became_active":"2024-06-06T03:22:31.243164+0000","last_became_peered":"2024-06-06T03:22:31.243164+0000","last_unstale":"2024-06-06T03:24:15.379711+0000","last_undegraded":"2024-06-06T03:24:15.379711+0000","last_fullsized":"2024-06-06T03:24:15.379711+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:04:46.877389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"99'4","reported_seq":43,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.360629+0000","last_change":"2024-06-06T03:22:34.300756+0000","last_active":"2024-06-06T03:25:13.360629+0000","last_peered":"2024-06-06T03:25:13.360629+0000","last_clean":"2024-06-06T03:25:13.360629+0000","last_became_active":"2024-06-06T03:22:34.300333+0000","last_became_peered":"2024-06-06T03:22:34.300333+0000","last_unstale":"2024-06-06T03:25:13.360629+0000","last_undegraded":"2024-06-06T03:25:13.360629+0000","last_fullsized":"2024-06-06T03:25:13.360629+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:29:37.174432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700803+0000","last_change":"2024-06-06T03:22:44.412741+0000","last_active":"2024-06-06T03:24:14.700803+0000","last_peered":"2024-06-06T03:24:14.700803+0000","last_clean":"2024-06-06T03:24:14.700803+0000","last_became_active":"2024-06-06T03:22:44.412263+0000","last_became_peered":"2024-06-06T03:22:44.412263+0000","last_unstale":"2024-06-06T03:24:14.700803+0000","last_undegraded":"2024-06-06T03:24:14.700803+0000","last_fullsized":"2024-06-06T03:24:14.700803+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:00:13.925279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"97'1","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700753+0000","last_change":"2024-06-06T03:22:31.055124+0000","last_active":"2024-06-06T03:24:14.700753+0000","last_peered":"2024-06-06T03:24:14.700753+0000","last_clean":"2024-06-06T03:24:14.700753+0000","last_became_active":"2024-06-06T03:22:31.054562+0000","last_became_peered":"2024-06-06T03:22:31.054562+0000","last_unstale":"2024-06-06T03:24:14.700753+0000","last_undegraded":"2024-06-06T03:24:14.700753+0000","last_fullsized":"2024-06-06T03:24:14.700753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:57:54.783815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.359691+0000","last_change":"2024-06-06T03:22:34.310893+0000","last_active":"2024-06-06T03:25:13.359691+0000","last_peered":"2024-06-06T03:25:13.359691+0000","last_clean":"2024-06-06T03:25:13.359691+0000","last_became_active":"2024-06-06T03:22:34.310510+0000","last_became_peered":"2024-06-06T03:22:34.310510+0000","last_unstale":"2024-06-06T03:25:13.359691+0000","last_undegraded":"2024-06-06T03:25:13.359691+0000","last_fullsized":"2024-06-06T03:25:13.359691+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:52:10.979031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":36,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.897745+0000","last_change":"2024-06-06T03:24:14.897222+0000","last_active":"2024-06-06T03:24:14.897745+0000","last_peered":"2024-06-06T03:24:14.897745+0000","last_clean":"2024-06-06T03:24:14.897745+0000","last_became_active":"2024-06-06T03:24:14.896620+0000","last_became_peered":"2024-06-06T03:24:14.896620+0000","last_unstale":"2024-06-06T03:24:14.897745+0000","last_undegraded":"2024-06-06T03:24:14.897745+0000","last_fullsized":"2024-06-06T03:24:14.897745+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:43:44.992240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8,10,0],"acting":[6,8,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371198+0000","last_change":"2024-06-06T03:22:34.294540+0000","last_active":"2024-06-06T03:25:13.371198+0000","last_peered":"2024-06-06T03:25:13.371198+0000","last_clean":"2024-06-06T03:25:13.371198+0000","last_became_active":"2024-06-06T03:22:34.294204+0000","last_became_peered":"2024-06-06T03:22:34.294204+0000","last_unstale":"2024-06-06T03:25:13.371198+0000","last_undegraded":"2024-06-06T03:25:13.371198+0000","last_fullsized":"2024-06-06T03:25:13.371198+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:16:39.386345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"99'6","reported_seq":224,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:26:26.915520+0000","last_change":"2024-06-06T03:22:31.242275+0000","last_active":"2024-06-06T03:26:26.915520+0000","last_peered":"2024-06-06T03:26:26.915520+0000","last_clean":"2024-06-06T03:26:26.915520+0000","last_became_active":"2024-06-06T03:22:31.241930+0000","last_became_peered":"2024-06-06T03:22:31.241930+0000","last_unstale":"2024-06-06T03:26:26.915520+0000","last_undegraded":"2024-06-06T03:26:26.915520+0000","last_fullsized":"2024-06-06T03:26:26.915520+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:46:16.407946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"97'1","reported_seq":30,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.701132+0000","last_change":"2024-06-06T03:22:44.416191+0000","last_active":"2024-06-06T03:24:14.701132+0000","last_peered":"2024-06-06T03:24:14.701132+0000","last_clean":"2024-06-06T03:24:14.701132+0000","last_became_active":"2024-06-06T03:22:44.415632+0000","last_became_peered":"2024-06-06T03:22:44.415632+0000","last_unstale":"2024-06-06T03:24:14.701132+0000","last_undegraded":"2024-06-06T03:24:14.701132+0000","last_fullsized":"2024-06-06T03:24:14.701132+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:10:48.995029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371311+0000","last_change":"2024-06-06T03:22:34.304567+0000","last_active":"2024-06-06T03:25:13.371311+0000","last_peered":"2024-06-06T03:25:13.371311+0000","last_clean":"2024-06-06T03:25:13.371311+0000","last_became_active":"2024-06-06T03:22:34.304183+0000","last_became_peered":"2024-06-06T03:22:34.304183+0000","last_unstale":"2024-06-06T03:25:13.371311+0000","last_undegraded":"2024-06-06T03:25:13.371311+0000","last_fullsized":"2024-06-06T03:25:13.371311+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:34:02.229528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"97'3","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163254+0000","last_change":"2024-06-06T03:22:31.056188+0000","last_active":"2024-06-06T03:24:15.163254+0000","last_peered":"2024-06-06T03:24:15.163254+0000","last_clean":"2024-06-06T03:24:15.163254+0000","last_became_active":"2024-06-06T03:22:31.055758+0000","last_became_peered":"2024-06-06T03:22:31.055758+0000","last_unstale":"2024-06-06T03:24:15.163254+0000","last_undegraded":"2024-06-06T03:24:15.163254+0000","last_fullsized":"2024-06-06T03:24:15.163254+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:35:51.016087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":368,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700465+0000","last_change":"2024-06-06T03:21:07.156236+0000","last_active":"2024-06-06T03:24:14.700465+0000","last_peered":"2024-06-06T03:24:14.700465+0000","last_clean":"2024-06-06T03:24:14.700465+0000","last_became_active":"2024-06-06T03:21:07.155807+0000","last_became_peered":"2024-06-06T03:21:07.155807+0000","last_unstale":"2024-06-06T03:24:14.700465+0000","last_undegraded":"2024-06-06T03:24:14.700465+0000","last_fullsized":"2024-06-06T03:24:14.700465+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:17:38.330402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:17:38.330402+0000","last_clean_scrub_stamp":"2024-06-06T03:17:38.330402+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:30:13.968755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.371740+0000","last_change":"2024-06-06T03:22:44.424693+0000","last_active":"2024-06-06T03:24:15.371740+0000","last_peered":"2024-06-06T03:24:15.371740+0000","last_clean":"2024-06-06T03:24:15.371740+0000","last_became_active":"2024-06-06T03:22:44.423607+0000","last_became_peered":"2024-06-06T03:22:44.423607+0000","last_unstale":"2024-06-06T03:24:15.371740+0000","last_undegraded":"2024-06-06T03:24:15.371740+0000","last_fullsized":"2024-06-06T03:24:15.371740+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:57:56.974785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.359317+0000","last_change":"2024-06-06T03:22:34.297940+0000","last_active":"2024-06-06T03:25:13.359317+0000","last_peered":"2024-06-06T03:25:13.359317+0000","last_clean":"2024-06-06T03:25:13.359317+0000","last_became_active":"2024-06-06T03:22:34.297597+0000","last_became_peered":"2024-06-06T03:22:34.297597+0000","last_unstale":"2024-06-06T03:25:13.359317+0000","last_undegraded":"2024-06-06T03:25:13.359317+0000","last_fullsized":"2024-06-06T03:25:13.359317+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:52:52.155070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700574+0000","last_change":"2024-06-06T03:22:31.055329+0000","last_active":"2024-06-06T03:24:14.700574+0000","last_peered":"2024-06-06T03:24:14.700574+0000","last_clean":"2024-06-06T03:24:14.700574+0000","last_became_active":"2024-06-06T03:22:31.054493+0000","last_became_peered":"2024-06-06T03:22:31.054493+0000","last_unstale":"2024-06-06T03:24:14.700574+0000","last_undegraded":"2024-06-06T03:24:14.700574+0000","last_fullsized":"2024-06-06T03:24:14.700574+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:45:32.068810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380440+0000","last_change":"2024-06-06T03:22:44.413560+0000","last_active":"2024-06-06T03:24:15.380440+0000","last_peered":"2024-06-06T03:24:15.380440+0000","last_clean":"2024-06-06T03:24:15.380440+0000","last_became_active":"2024-06-06T03:22:44.413100+0000","last_became_peered":"2024-06-06T03:22:44.413100+0000","last_unstale":"2024-06-06T03:24:15.380440+0000","last_undegraded":"2024-06-06T03:24:15.380440+0000","last_fullsized":"2024-06-06T03:24:15.380440+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:58:02.780671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"97'1","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380639+0000","last_change":"2024-06-06T03:23:14.515805+0000","last_active":"2024-06-06T03:24:15.380639+0000","last_peered":"2024-06-06T03:24:15.380639+0000","last_clean":"2024-06-06T03:24:15.380639+0000","last_became_active":"2024-06-06T03:23:14.515436+0000","last_became_peered":"2024-06-06T03:23:14.515436+0000","last_unstale":"2024-06-06T03:24:15.380639+0000","last_undegraded":"2024-06-06T03:24:15.380639+0000","last_fullsized":"2024-06-06T03:24:15.380639+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:59:16.246609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.364457+0000","last_change":"2024-06-06T03:22:34.294549+0000","last_active":"2024-06-06T03:25:13.364457+0000","last_peered":"2024-06-06T03:25:13.364457+0000","last_clean":"2024-06-06T03:25:13.364457+0000","last_became_active":"2024-06-06T03:22:34.294202+0000","last_became_peered":"2024-06-06T03:22:34.294202+0000","last_unstale":"2024-06-06T03:25:13.364457+0000","last_undegraded":"2024-06-06T03:25:13.364457+0000","last_fullsized":"2024-06-06T03:25:13.364457+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:55:59.823957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380133+0000","last_change":"2024-06-06T03:22:44.416890+0000","last_active":"2024-06-06T03:24:15.380133+0000","last_peered":"2024-06-06T03:24:15.380133+0000","last_clean":"2024-06-06T03:24:15.380133+0000","last_became_active":"2024-06-06T03:22:44.416473+0000","last_became_peered":"2024-06-06T03:22:44.416473+0000","last_unstale":"2024-06-06T03:24:15.380133+0000","last_undegraded":"2024-06-06T03:24:15.380133+0000","last_fullsized":"2024-06-06T03:24:15.380133+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:23:48.972196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"99'14","reported_seq":59,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:14.317576+0000","last_change":"2024-06-06T03:22:31.054481+0000","last_active":"2024-06-06T03:25:14.317576+0000","last_peered":"2024-06-06T03:25:14.317576+0000","last_clean":"2024-06-06T03:25:14.317576+0000","last_became_active":"2024-06-06T03:22:31.054173+0000","last_became_peered":"2024-06-06T03:22:31.054173+0000","last_unstale":"2024-06-06T03:25:14.317576+0000","last_undegraded":"2024-06-06T03:25:14.317576+0000","last_fullsized":"2024-06-06T03:25:14.317576+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:52:45.311149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.372630+0000","last_change":"2024-06-06T03:22:34.300211+0000","last_active":"2024-06-06T03:25:13.372630+0000","last_peered":"2024-06-06T03:25:13.372630+0000","last_clean":"2024-06-06T03:25:13.372630+0000","last_became_active":"2024-06-06T03:22:34.299870+0000","last_became_peered":"2024-06-06T03:22:34.299870+0000","last_unstale":"2024-06-06T03:25:13.372630+0000","last_undegraded":"2024-06-06T03:25:13.372630+0000","last_fullsized":"2024-06-06T03:25:13.372630+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:50:56.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973290+0000","last_change":"2024-06-06T03:22:44.414727+0000","last_active":"2024-06-06T03:24:14.973290+0000","last_peered":"2024-06-06T03:24:14.973290+0000","last_clean":"2024-06-06T03:24:14.973290+0000","last_became_active":"2024-06-06T03:22:44.414232+0000","last_became_peered":"2024-06-06T03:22:44.414232+0000","last_unstale":"2024-06-06T03:24:14.973290+0000","last_undegraded":"2024-06-06T03:24:14.973290+0000","last_fullsized":"2024-06-06T03:24:14.973290+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:26:21.540309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"97'4","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.164042+0000","last_change":"2024-06-06T03:22:31.178740+0000","last_active":"2024-06-06T03:24:15.164042+0000","last_peered":"2024-06-06T03:24:15.164042+0000","last_clean":"2024-06-06T03:24:15.164042+0000","last_became_active":"2024-06-06T03:22:31.178353+0000","last_became_peered":"2024-06-06T03:22:31.178353+0000","last_unstale":"2024-06-06T03:24:15.164042+0000","last_undegraded":"2024-06-06T03:24:15.164042+0000","last_fullsized":"2024-06-06T03:24:15.164042+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:56:50.159463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.368763+0000","last_change":"2024-06-06T03:22:34.298011+0000","last_active":"2024-06-06T03:25:13.368763+0000","last_peered":"2024-06-06T03:25:13.368763+0000","last_clean":"2024-06-06T03:25:13.368763+0000","last_became_active":"2024-06-06T03:22:34.297697+0000","last_became_peered":"2024-06-06T03:22:34.297697+0000","last_unstale":"2024-06-06T03:25:13.368763+0000","last_undegraded":"2024-06-06T03:25:13.368763+0000","last_fullsized":"2024-06-06T03:25:13.368763+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:01:38.606543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163829+0000","last_change":"2024-06-06T03:22:44.425675+0000","last_active":"2024-06-06T03:24:15.163829+0000","last_peered":"2024-06-06T03:24:15.163829+0000","last_clean":"2024-06-06T03:24:15.163829+0000","last_became_active":"2024-06-06T03:22:44.424023+0000","last_became_peered":"2024-06-06T03:22:44.424023+0000","last_unstale":"2024-06-06T03:24:15.163829+0000","last_undegraded":"2024-06-06T03:24:15.163829+0000","last_fullsized":"2024-06-06T03:24:15.163829+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:47:48.718771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"97'2","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.379742+0000","last_change":"2024-06-06T03:22:31.242360+0000","last_active":"2024-06-06T03:24:15.379742+0000","last_peered":"2024-06-06T03:24:15.379742+0000","last_clean":"2024-06-06T03:24:15.379742+0000","last_became_active":"2024-06-06T03:22:31.242015+0000","last_became_peered":"2024-06-06T03:22:31.242015+0000","last_unstale":"2024-06-06T03:24:15.379742+0000","last_undegraded":"2024-06-06T03:24:15.379742+0000","last_fullsized":"2024-06-06T03:24:15.379742+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:14:30.674106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"99'2","reported_seq":41,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.326018+0000","last_change":"2024-06-06T03:22:34.302980+0000","last_active":"2024-06-06T03:25:13.326018+0000","last_peered":"2024-06-06T03:25:13.326018+0000","last_clean":"2024-06-06T03:25:13.326018+0000","last_became_active":"2024-06-06T03:22:34.302625+0000","last_became_peered":"2024-06-06T03:22:34.302625+0000","last_unstale":"2024-06-06T03:25:13.326018+0000","last_undegraded":"2024-06-06T03:25:13.326018+0000","last_fullsized":"2024-06-06T03:25:13.326018+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:13:01.603365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380862+0000","last_change":"2024-06-06T03:22:44.423741+0000","last_active":"2024-06-06T03:24:15.380862+0000","last_peered":"2024-06-06T03:24:15.380862+0000","last_clean":"2024-06-06T03:24:15.380862+0000","last_became_active":"2024-06-06T03:22:44.423266+0000","last_became_peered":"2024-06-06T03:22:44.423266+0000","last_unstale":"2024-06-06T03:24:15.380862+0000","last_undegraded":"2024-06-06T03:24:15.380862+0000","last_fullsized":"2024-06-06T03:24:15.380862+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:09:19.324145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"97'3","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.379798+0000","last_change":"2024-06-06T03:22:31.052988+0000","last_active":"2024-06-06T03:24:15.379798+0000","last_peered":"2024-06-06T03:24:15.379798+0000","last_clean":"2024-06-06T03:24:15.379798+0000","last_became_active":"2024-06-06T03:22:31.052743+0000","last_became_peered":"2024-06-06T03:22:31.052743+0000","last_unstale":"2024-06-06T03:24:15.379798+0000","last_undegraded":"2024-06-06T03:24:15.379798+0000","last_fullsized":"2024-06-06T03:24:15.379798+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:31:45.176416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.365872+0000","last_change":"2024-06-06T03:22:34.299991+0000","last_active":"2024-06-06T03:25:13.365872+0000","last_peered":"2024-06-06T03:25:13.365872+0000","last_clean":"2024-06-06T03:25:13.365872+0000","last_became_active":"2024-06-06T03:22:34.299659+0000","last_became_peered":"2024-06-06T03:22:34.299659+0000","last_unstale":"2024-06-06T03:25:13.365872+0000","last_undegraded":"2024-06-06T03:25:13.365872+0000","last_fullsized":"2024-06-06T03:25:13.365872+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:16:51.492749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"97'1","reported_seq":37,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163786+0000","last_change":"2024-06-06T03:23:15.027541+0000","last_active":"2024-06-06T03:24:15.163786+0000","last_peered":"2024-06-06T03:24:15.163786+0000","last_clean":"2024-06-06T03:24:15.163786+0000","last_became_active":"2024-06-06T03:23:15.026931+0000","last_became_peered":"2024-06-06T03:23:15.026931+0000","last_unstale":"2024-06-06T03:24:15.163786+0000","last_undegraded":"2024-06-06T03:24:15.163786+0000","last_fullsized":"2024-06-06T03:24:15.163786+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:47:44.197067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"99'2","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:25.895366+0000","last_change":"2024-06-06T03:23:14.831383+0000","last_active":"2024-06-06T03:25:25.895366+0000","last_peered":"2024-06-06T03:25:25.895366+0000","last_clean":"2024-06-06T03:25:25.895366+0000","last_became_active":"2024-06-06T03:23:14.830948+0000","last_became_peered":"2024-06-06T03:23:14.830948+0000","last_unstale":"2024-06-06T03:25:25.895366+0000","last_undegraded":"2024-06-06T03:25:25.895366+0000","last_fullsized":"2024-06-06T03:25:25.895366+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:58:00.326112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.370110+0000","last_change":"2024-06-06T03:22:34.301842+0000","last_active":"2024-06-06T03:25:13.370110+0000","last_peered":"2024-06-06T03:25:13.370110+0000","last_clean":"2024-06-06T03:25:13.370110+0000","last_became_active":"2024-06-06T03:22:34.301513+0000","last_became_peered":"2024-06-06T03:22:34.301513+0000","last_unstale":"2024-06-06T03:25:13.370110+0000","last_undegraded":"2024-06-06T03:25:13.370110+0000","last_fullsized":"2024-06-06T03:25:13.370110+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:30:03.813861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.163817+0000","last_change":"2024-06-06T03:22:44.419621+0000","last_active":"2024-06-06T03:24:15.163817+0000","last_peered":"2024-06-06T03:24:15.163817+0000","last_clean":"2024-06-06T03:24:15.163817+0000","last_became_active":"2024-06-06T03:22:44.419065+0000","last_became_peered":"2024-06-06T03:22:44.419065+0000","last_unstale":"2024-06-06T03:24:15.163817+0000","last_undegraded":"2024-06-06T03:24:15.163817+0000","last_fullsized":"2024-06-06T03:24:15.163817+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:10:49.762284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"97'4","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.699776+0000","last_change":"2024-06-06T03:22:31.056409+0000","last_active":"2024-06-06T03:24:14.699776+0000","last_peered":"2024-06-06T03:24:14.699776+0000","last_clean":"2024-06-06T03:24:14.699776+0000","last_became_active":"2024-06-06T03:22:31.055994+0000","last_became_peered":"2024-06-06T03:22:31.055994+0000","last_unstale":"2024-06-06T03:24:14.699776+0000","last_undegraded":"2024-06-06T03:24:14.699776+0000","last_fullsized":"2024-06-06T03:24:14.699776+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:09:00.784820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371522+0000","last_change":"2024-06-06T03:22:34.302238+0000","last_active":"2024-06-06T03:25:13.371522+0000","last_peered":"2024-06-06T03:25:13.371522+0000","last_clean":"2024-06-06T03:25:13.371522+0000","last_became_active":"2024-06-06T03:22:34.301869+0000","last_became_peered":"2024-06-06T03:22:34.301869+0000","last_unstale":"2024-06-06T03:25:13.371522+0000","last_undegraded":"2024-06-06T03:25:13.371522+0000","last_fullsized":"2024-06-06T03:25:13.371522+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:17:08.350692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.380233+0000","last_change":"2024-06-06T03:22:44.414052+0000","last_active":"2024-06-06T03:24:15.380233+0000","last_peered":"2024-06-06T03:24:15.380233+0000","last_clean":"2024-06-06T03:24:15.380233+0000","last_became_active":"2024-06-06T03:22:44.413633+0000","last_became_peered":"2024-06-06T03:22:44.413633+0000","last_unstale":"2024-06-06T03:24:15.380233+0000","last_undegraded":"2024-06-06T03:24:15.380233+0000","last_fullsized":"2024-06-06T03:24:15.380233+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:41:16.942699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.973931+0000","last_change":"2024-06-06T03:22:31.243570+0000","last_active":"2024-06-06T03:24:14.973931+0000","last_peered":"2024-06-06T03:24:14.973931+0000","last_clean":"2024-06-06T03:24:14.973931+0000","last_became_active":"2024-06-06T03:22:31.243194+0000","last_became_peered":"2024-06-06T03:22:31.243194+0000","last_unstale":"2024-06-06T03:24:14.973931+0000","last_undegraded":"2024-06-06T03:24:14.973931+0000","last_fullsized":"2024-06-06T03:24:14.973931+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:21:22.233139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.370634+0000","last_change":"2024-06-06T03:22:34.301665+0000","last_active":"2024-06-06T03:25:13.370634+0000","last_peered":"2024-06-06T03:25:13.370634+0000","last_clean":"2024-06-06T03:25:13.370634+0000","last_became_active":"2024-06-06T03:22:34.300967+0000","last_became_peered":"2024-06-06T03:22:34.300967+0000","last_unstale":"2024-06-06T03:25:13.370634+0000","last_undegraded":"2024-06-06T03:25:13.370634+0000","last_fullsized":"2024-06-06T03:25:13.370634+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:57:58.905488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":36,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.698608+0000","last_change":"2024-06-06T03:23:14.833267+0000","last_active":"2024-06-06T03:24:14.698608+0000","last_peered":"2024-06-06T03:24:14.698608+0000","last_clean":"2024-06-06T03:24:14.698608+0000","last_became_active":"2024-06-06T03:23:14.832760+0000","last_became_peered":"2024-06-06T03:23:14.832760+0000","last_unstale":"2024-06-06T03:24:14.698608+0000","last_undegraded":"2024-06-06T03:24:14.698608+0000","last_fullsized":"2024-06-06T03:24:14.698608+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:24:32.668781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'1","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.370535+0000","last_change":"2024-06-06T03:22:31.054686+0000","last_active":"2024-06-06T03:24:15.370535+0000","last_peered":"2024-06-06T03:24:15.370535+0000","last_clean":"2024-06-06T03:24:15.370535+0000","last_became_active":"2024-06-06T03:22:31.053219+0000","last_became_peered":"2024-06-06T03:22:31.053219+0000","last_unstale":"2024-06-06T03:24:15.370535+0000","last_undegraded":"2024-06-06T03:24:15.370535+0000","last_fullsized":"2024-06-06T03:24:15.370535+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:32:27.423208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.368737+0000","last_change":"2024-06-06T03:22:34.304916+0000","last_active":"2024-06-06T03:25:13.368737+0000","last_peered":"2024-06-06T03:25:13.368737+0000","last_clean":"2024-06-06T03:25:13.368737+0000","last_became_active":"2024-06-06T03:22:34.302442+0000","last_became_peered":"2024-06-06T03:22:34.302442+0000","last_unstale":"2024-06-06T03:25:13.368737+0000","last_undegraded":"2024-06-06T03:25:13.368737+0000","last_fullsized":"2024-06-06T03:25:13.368737+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:01:24.034386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:15.370747+0000","last_change":"2024-06-06T03:22:44.415478+0000","last_active":"2024-06-06T03:24:15.370747+0000","last_peered":"2024-06-06T03:24:15.370747+0000","last_clean":"2024-06-06T03:24:15.370747+0000","last_became_active":"2024-06-06T03:22:44.415007+0000","last_became_peered":"2024-06-06T03:22:44.415007+0000","last_unstale":"2024-06-06T03:24:15.370747+0000","last_undegraded":"2024-06-06T03:24:15.370747+0000","last_fullsized":"2024-06-06T03:24:15.370747+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:43.393026+0000","last_clean_scrub_stamp":"2024-06-06T03:22:43.393026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:57:47.793481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'2","reported_seq":57,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:24:14.700897+0000","last_change":"2024-06-06T03:23:14.521037+0000","last_active":"2024-06-06T03:24:14.700897+0000","last_peered":"2024-06-06T03:24:14.700897+0000","last_clean":"2024-06-06T03:24:14.700897+0000","last_became_active":"2024-06-06T03:23:14.517922+0000","last_became_peered":"2024-06-06T03:23:14.517922+0000","last_unstale":"2024-06-06T03:24:14.700897+0000","last_undegraded":"2024-06-06T03:24:14.700897+0000","last_fullsized":"2024-06-06T03:24:14.700897+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:30.038940+0000","last_clean_scrub_stamp":"2024-06-06T03:22:30.038940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:12:46.222984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.370655+0000","last_change":"2024-06-06T03:22:34.305178+0000","last_active":"2024-06-06T03:25:13.370655+0000","last_peered":"2024-06-06T03:25:13.370655+0000","last_clean":"2024-06-06T03:25:13.370655+0000","last_became_active":"2024-06-06T03:22:34.302420+0000","last_became_peered":"2024-06-06T03:22:34.302420+0000","last_unstale":"2024-06-06T03:25:13.370655+0000","last_undegraded":"2024-06-06T03:25:13.370655+0000","last_fullsized":"2024-06-06T03:25:13.370655+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:22:08.736542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"99'9","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369693+0000","last_change":"2024-06-06T03:23:14.514756+0000","last_active":"2024-06-06T03:25:13.369693+0000","last_peered":"2024-06-06T03:25:13.369693+0000","last_clean":"2024-06-06T03:25:13.369693+0000","last_became_active":"2024-06-06T03:23:14.514325+0000","last_became_peered":"2024-06-06T03:23:14.514325+0000","last_unstale":"2024-06-06T03:25:13.369693+0000","last_undegraded":"2024-06-06T03:25:13.369693+0000","last_fullsized":"2024-06-06T03:25:13.369693+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:45:44.594836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"99'12","reported_seq":51,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369056+0000","last_change":"2024-06-06T03:22:34.298570+0000","last_active":"2024-06-06T03:25:13.369056+0000","last_peered":"2024-06-06T03:25:13.369056+0000","last_clean":"2024-06-06T03:25:13.369056+0000","last_became_active":"2024-06-06T03:22:34.298137+0000","last_became_peered":"2024-06-06T03:22:34.298137+0000","last_unstale":"2024-06-06T03:25:13.369056+0000","last_undegraded":"2024-06-06T03:25:13.369056+0000","last_fullsized":"2024-06-06T03:25:13.369056+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:07:25.290355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.362822+0000","last_change":"2024-06-06T03:22:34.297750+0000","last_active":"2024-06-06T03:25:13.362822+0000","last_peered":"2024-06-06T03:25:13.362822+0000","last_clean":"2024-06-06T03:25:13.362822+0000","last_became_active":"2024-06-06T03:22:34.297264+0000","last_became_peered":"2024-06-06T03:22:34.297264+0000","last_unstale":"2024-06-06T03:25:13.362822+0000","last_undegraded":"2024-06-06T03:25:13.362822+0000","last_fullsized":"2024-06-06T03:25:13.362822+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:14:58.580044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"99'7","reported_seq":52,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.357808+0000","last_change":"2024-06-06T03:23:14.832804+0000","last_active":"2024-06-06T03:25:13.357808+0000","last_peered":"2024-06-06T03:25:13.357808+0000","last_clean":"2024-06-06T03:25:13.357808+0000","last_became_active":"2024-06-06T03:23:14.832448+0000","last_became_peered":"2024-06-06T03:23:14.832448+0000","last_unstale":"2024-06-06T03:25:13.357808+0000","last_undegraded":"2024-06-06T03:25:13.357808+0000","last_fullsized":"2024-06-06T03:25:13.357808+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:52:16.907033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"99'4","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.366112+0000","last_change":"2024-06-06T03:23:14.515841+0000","last_active":"2024-06-06T03:25:13.366112+0000","last_peered":"2024-06-06T03:25:13.366112+0000","last_clean":"2024-06-06T03:25:13.366112+0000","last_became_active":"2024-06-06T03:23:14.515331+0000","last_became_peered":"2024-06-06T03:23:14.515331+0000","last_unstale":"2024-06-06T03:25:13.366112+0000","last_undegraded":"2024-06-06T03:25:13.366112+0000","last_fullsized":"2024-06-06T03:25:13.366112+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:46:57.178054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371197+0000","last_change":"2024-06-06T03:22:34.299660+0000","last_active":"2024-06-06T03:25:13.371197+0000","last_peered":"2024-06-06T03:25:13.371197+0000","last_clean":"2024-06-06T03:25:13.371197+0000","last_became_active":"2024-06-06T03:22:34.298411+0000","last_became_peered":"2024-06-06T03:22:34.298411+0000","last_unstale":"2024-06-06T03:25:13.371197+0000","last_undegraded":"2024-06-06T03:25:13.371197+0000","last_fullsized":"2024-06-06T03:25:13.371197+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:29:16.170700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"99'15","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.351954+0000","last_change":"2024-06-06T03:22:34.308110+0000","last_active":"2024-06-06T03:25:13.351954+0000","last_peered":"2024-06-06T03:25:13.351954+0000","last_clean":"2024-06-06T03:25:13.351954+0000","last_became_active":"2024-06-06T03:22:34.307637+0000","last_became_peered":"2024-06-06T03:22:34.307637+0000","last_unstale":"2024-06-06T03:25:13.351954+0000","last_undegraded":"2024-06-06T03:25:13.351954+0000","last_fullsized":"2024-06-06T03:25:13.351954+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:40:23.264509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"99'2","reported_seq":41,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.368343+0000","last_change":"2024-06-06T03:22:34.295494+0000","last_active":"2024-06-06T03:25:13.368343+0000","last_peered":"2024-06-06T03:25:13.368343+0000","last_clean":"2024-06-06T03:25:13.368343+0000","last_became_active":"2024-06-06T03:22:34.295101+0000","last_became_peered":"2024-06-06T03:22:34.295101+0000","last_unstale":"2024-06-06T03:25:13.368343+0000","last_undegraded":"2024-06-06T03:25:13.368343+0000","last_fullsized":"2024-06-06T03:25:13.368343+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:39:07.298053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.373117+0000","last_change":"2024-06-06T03:22:34.291312+0000","last_active":"2024-06-06T03:25:13.373117+0000","last_peered":"2024-06-06T03:25:13.373117+0000","last_clean":"2024-06-06T03:25:13.373117+0000","last_became_active":"2024-06-06T03:22:34.290971+0000","last_became_peered":"2024-06-06T03:22:34.290971+0000","last_unstale":"2024-06-06T03:25:13.373117+0000","last_undegraded":"2024-06-06T03:25:13.373117+0000","last_fullsized":"2024-06-06T03:25:13.373117+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:06:27.333831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.372533+0000","last_change":"2024-06-06T03:22:34.292000+0000","last_active":"2024-06-06T03:25:13.372533+0000","last_peered":"2024-06-06T03:25:13.372533+0000","last_clean":"2024-06-06T03:25:13.372533+0000","last_became_active":"2024-06-06T03:22:34.291500+0000","last_became_peered":"2024-06-06T03:22:34.291500+0000","last_unstale":"2024-06-06T03:25:13.372533+0000","last_undegraded":"2024-06-06T03:25:13.372533+0000","last_fullsized":"2024-06-06T03:25:13.372533+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:37:20.677107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.369963+0000","last_change":"2024-06-06T03:22:34.303138+0000","last_active":"2024-06-06T03:25:13.369963+0000","last_peered":"2024-06-06T03:25:13.369963+0000","last_clean":"2024-06-06T03:25:13.369963+0000","last_became_active":"2024-06-06T03:22:34.302758+0000","last_became_peered":"2024-06-06T03:22:34.302758+0000","last_unstale":"2024-06-06T03:25:13.369963+0000","last_undegraded":"2024-06-06T03:25:13.369963+0000","last_fullsized":"2024-06-06T03:25:13.369963+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:34:18.516891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371585+0000","last_change":"2024-06-06T03:22:34.297035+0000","last_active":"2024-06-06T03:25:13.371585+0000","last_peered":"2024-06-06T03:25:13.371585+0000","last_clean":"2024-06-06T03:25:13.371585+0000","last_became_active":"2024-06-06T03:22:34.296706+0000","last_became_peered":"2024-06-06T03:22:34.296706+0000","last_unstale":"2024-06-06T03:25:13.371585+0000","last_undegraded":"2024-06-06T03:25:13.371585+0000","last_fullsized":"2024-06-06T03:25:13.371585+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:26:26.959215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-06T03:25:13.371786+0000","last_change":"2024-06-06T03:22:34.296365+0000","last_active":"2024-06-06T03:25:13.371786+0000","last_peered":"2024-06-06T03:25:13.371786+0000","last_clean":"2024-06-06T03:25:13.371786+0000","last_became_active":"2024-06-06T03:22:34.296021+0000","last_became_peered":"2024-06-06T03:22:34.296021+0000","last_unstale":"2024-06-06T03:25:13.371786+0000","last_undegraded":"2024-06-06T03:25:13.371786+0000","last_fullsized":"2024-06-06T03:25:13.371786+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T03:22:33.272078+0000","last_clean_scrub_stamp":"2024-06-06T03:22:33.272078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:40:33.183110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":249510,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72250,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":1076,"num_read_kb":615,"num_write":188,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":216750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383743,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32248,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712904,"statfs":{"total":95995035648,"available":95962013696,"internally_reserved":0,"allocated":1097728,"data_stored":569692,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645379,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28236,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716916,"statfs":{"total":95995035648,"available":95966121984,"internally_reserved":0,"allocated":1249280,"data_stored":1229182,"data_compressed":68620,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808905,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1110016,"data_stored":569906,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070542,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1105920,"data_stored":569804,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332180,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32308,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712844,"statfs":{"total":95995035648,"available":95961952256,"internally_reserved":0,"allocated":1159168,"data_stored":1166859,"data_compressed":68620,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495706,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36400,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708752,"statfs":{"total":95995035648,"available":95957762048,"internally_reserved":0,"allocated":1089536,"data_stored":565082,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574962,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28152,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717000,"statfs":{"total":95995035648,"available":95966208000,"internally_reserved":0,"allocated":1163264,"data_stored":632117,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738487,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36424,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708728,"statfs":{"total":95995035648,"available":95957737472,"internally_reserved":0,"allocated":1114112,"data_stored":566470,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411438,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36496,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708656,"statfs":{"total":95995035648,"available":95957663744,"internally_reserved":0,"allocated":1187840,"data_stored":633959,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182504,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1101824,"data_stored":565276,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920868,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32252,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712900,"statfs":{"total":95995035648,"available":95962009600,"internally_reserved":0,"allocated":1101824,"data_stored":570755,"data_compressed":32508,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757343,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32316,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712836,"statfs":{"total":95995035648,"available":95961944064,"internally_reserved":0,"allocated":1167360,"data_stored":1161424,"data_compressed":68620,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34475,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34475,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36112,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-06T03:26:31.360 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T03:26:31.640 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:26:31.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:31 smithi122 ceph-mon[35759]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T03:26:31.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:31 smithi122 ceph-mon[35759]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T03:26:32.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:31 smithi050 ceph-mon[32421]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T03:26:32.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:31 smithi050 ceph-mon[32421]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T03:26:32.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:31 smithi079 ceph-mon[35478]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T03:26:32.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:31 smithi079 ceph-mon[35478]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T03:26:32.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:32 smithi122 ceph-mon[35759]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T03:26:32.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:32 smithi122 ceph-mon[35759]: pgmap v428: 129 pgs: 129 active+clean; 647 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-06-06T03:26:33.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:32 smithi050 ceph-mon[32421]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T03:26:33.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:32 smithi050 ceph-mon[32421]: pgmap v428: 129 pgs: 129 active+clean; 647 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-06-06T03:26:33.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:32 smithi079 ceph-mon[35478]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T03:26:33.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:32 smithi079 ceph-mon[35478]: pgmap v428: 129 pgs: 129 active+clean; 647 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-06-06T03:26:33.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.431+0000 7f8d733b8700 1 -- 172.21.15.50:0/3529513548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d6c100e30 msgr2=0x7f8d6c1012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:33.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.431+0000 7f8d733b8700 1 --2- 172.21.15.50:0/3529513548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d6c100e30 0x7f8d6c1012b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009990 tx=0x7f8d5c009ca0 comp rx=0 tx=0).stop 2024-06-06T03:26:33.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.431+0000 7f8d733b8700 1 -- 172.21.15.50:0/3529513548 shutdown_connections 2024-06-06T03:26:33.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.431+0000 7f8d733b8700 1 --2- 172.21.15.50:0/3529513548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d6c1017f0 0x7f8d6c10f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:33.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.431+0000 7f8d733b8700 1 --2- 172.21.15.50:0/3529513548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d6c107550 0x7f8d6c107930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:33.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.431+0000 7f8d733b8700 1 --2- 172.21.15.50:0/3529513548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d6c100e30 0x7f8d6c1012b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:33.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.431+0000 7f8d733b8700 1 -- 172.21.15.50:0/3529513548 >> 172.21.15.50:0/3529513548 conn(0x7f8d6c0766b0 msgr2=0x7f8d6c076ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:33.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.431+0000 7f8d733b8700 1 -- 172.21.15.50:0/3529513548 shutdown_connections 2024-06-06T03:26:33.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.431+0000 7f8d733b8700 1 -- 172.21.15.50:0/3529513548 wait complete. 2024-06-06T03:26:33.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.432+0000 7f8d733b8700 1 Processor -- start 2024-06-06T03:26:33.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.432+0000 7f8d733b8700 1 -- start start 2024-06-06T03:26:33.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.432+0000 7f8d733b8700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d6c100e30 0x7f8d6c19e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:33.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.432+0000 7f8d733b8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d6c1017f0 0x7f8d6c19ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:33.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.432+0000 7f8d733b8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d6c107550 0x7f8d6c198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:33.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.432+0000 7f8d733b8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c1127b0 con 0x7f8d6c107550 2024-06-06T03:26:33.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.432+0000 7f8d733b8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c112630 con 0x7f8d6c1017f0 2024-06-06T03:26:33.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.432+0000 7f8d733b8700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c112930 con 0x7f8d6c100e30 2024-06-06T03:26:33.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.432+0000 7f8d71955700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d6c107550 0x7f8d6c198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:33.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.432+0000 7f8d71955700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d6c107550 0x7f8d6c198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58210/0 (socket says 172.21.15.50:58210) 2024-06-06T03:26:33.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.432+0000 7f8d71955700 1 -- 172.21.15.50:0/1156612627 learned_addr learned my addr 172.21.15.50:0/1156612627 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:33.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.432+0000 7f8d70953700 1 --2- 172.21.15.50:0/1156612627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d6c1017f0 0x7f8d6c19ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:33.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.432+0000 7f8d71154700 1 --2- 172.21.15.50:0/1156612627 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d6c100e30 0x7f8d6c19e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:33.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.433+0000 7f8d71955700 1 -- 172.21.15.50:0/1156612627 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d6c100e30 msgr2=0x7f8d6c19e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:33.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.433+0000 7f8d71955700 1 --2- 172.21.15.50:0/1156612627 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d6c100e30 0x7f8d6c19e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:33.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.433+0000 7f8d71955700 1 -- 172.21.15.50:0/1156612627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d6c1017f0 msgr2=0x7f8d6c19ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:33.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.433+0000 7f8d71955700 1 --2- 172.21.15.50:0/1156612627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d6c1017f0 0x7f8d6c19ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:33.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.433+0000 7f8d71955700 1 -- 172.21.15.50:0/1156612627 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6c199290 con 0x7f8d6c107550 2024-06-06T03:26:33.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.433+0000 7f8d71154700 1 --2- 172.21.15.50:0/1156612627 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d6c100e30 0x7f8d6c19e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:26:33.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.433+0000 7f8d71955700 1 --2- 172.21.15.50:0/1156612627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d6c107550 0x7f8d6c198b30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8d6400b970 tx=0x7f8d6400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:33.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.433+0000 7f8d627fc700 1 -- 172.21.15.50:0/1156612627 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d64019070 con 0x7f8d6c107550 2024-06-06T03:26:33.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.433+0000 7f8d627fc700 1 -- 172.21.15.50:0/1156612627 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8d6400cde0 con 0x7f8d6c107550 2024-06-06T03:26:33.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.433+0000 7f8d733b8700 1 -- 172.21.15.50:0/1156612627 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d6c199580 con 0x7f8d6c107550 2024-06-06T03:26:33.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.433+0000 7f8d627fc700 1 -- 172.21.15.50:0/1156612627 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d64007370 con 0x7f8d6c107550 2024-06-06T03:26:33.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.433+0000 7f8d733b8700 1 -- 172.21.15.50:0/1156612627 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d6c1a57f0 con 0x7f8d6c107550 2024-06-06T03:26:33.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.434+0000 7f8d733b8700 1 -- 172.21.15.50:0/1156612627 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d6c069180 con 0x7f8d6c107550 2024-06-06T03:26:33.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.435+0000 7f8d627fc700 1 -- 172.21.15.50:0/1156612627 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8d6401c070 con 0x7f8d6c107550 2024-06-06T03:26:33.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.436+0000 7f8d627fc700 1 --2- 172.21.15.50:0/1156612627 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8d580a2ca0 0x7f8d580a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:33.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.436+0000 7f8d71154700 1 --2- 172.21.15.50:0/1156612627 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8d580a2ca0 0x7f8d580a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:33.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.436+0000 7f8d627fc700 1 -- 172.21.15.50:0/1156612627 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f8d640ce8b0 con 0x7f8d6c107550 2024-06-06T03:26:33.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.437+0000 7f8d71154700 1 --2- 172.21.15.50:0/1156612627 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8d580a2ca0 0x7f8d580a5160 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c077c30 tx=0x7f8d68008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:33.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.441+0000 7f8d627fc700 1 -- 172.21.15.50:0/1156612627 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8d6409b430 con 0x7f8d6c107550 2024-06-06T03:26:33.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.692+0000 7f8d733b8700 1 -- 172.21.15.50:0/1156612627 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d6c199fd0 con 0x7f8d6c107550 2024-06-06T03:26:33.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.693+0000 7f8d627fc700 1 -- 172.21.15.50:0/1156612627 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11855 (secure 0 0 0) 0x7f8d6409ad30 con 0x7f8d6c107550 2024-06-06T03:26:33.692 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:26:33.692 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1667847852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1667847852},{"type":"v1","addr":"172.21.15.50:6835","nonce":1667847852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/239971838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":239971838},{"type":"v1","addr":"172.21.15.50:6837","nonce":239971838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/2188134216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2188134216},{"type":"v1","addr":"172.21.15.50:6839","nonce":2188134216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/632572420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":632572420},{"type":"v1","addr":"172.21.15.50:6841","nonce":632572420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/864537078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":864537078},{"type":"v1","addr":"172.21.15.79:6833","nonce":864537078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/279268898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":279268898},{"type":"v1","addr":"172.21.15.79:6835","nonce":279268898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T03:22:36.202061+0000","modified":"2024-06-06T03:26:24.959500+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24490,"mds_1":24472,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/57533154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":57533154},{"type":"v1","addr":"172.21.15.122:6833","nonce":57533154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/3286722213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3286722213},{"type":"v1","addr":"172.21.15.79:6837","nonce":3286722213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/768067336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":768067336},{"type":"v1","addr":"172.21.15.79:6839","nonce":768067336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.122:6835/2987597320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2987597320},{"type":"v1","addr":"172.21.15.122:6835","nonce":2987597320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":23,"addr":"172.21.15.122:6837/1604366318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1604366318},{"type":"v1","addr":"172.21.15.122:6837","nonce":1604366318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6839/4129732900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":4129732900},{"type":"v1","addr":"172.21.15.122:6839","nonce":4129732900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24466,24472,24490]},"id":1}]} 2024-06-06T03:26:33.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.695+0000 7f8d733b8700 1 -- 172.21.15.50:0/1156612627 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8d580a2ca0 msgr2=0x7f8d580a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:33.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.695+0000 7f8d733b8700 1 --2- 172.21.15.50:0/1156612627 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8d580a2ca0 0x7f8d580a5160 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c077c30 tx=0x7f8d68008040 comp rx=0 tx=0).stop 2024-06-06T03:26:33.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.695+0000 7f8d733b8700 1 -- 172.21.15.50:0/1156612627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d6c107550 msgr2=0x7f8d6c198b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:33.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.695+0000 7f8d733b8700 1 --2- 172.21.15.50:0/1156612627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d6c107550 0x7f8d6c198b30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8d6400b970 tx=0x7f8d6400bc80 comp rx=0 tx=0).stop 2024-06-06T03:26:33.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.695+0000 7f8d733b8700 1 -- 172.21.15.50:0/1156612627 shutdown_connections 2024-06-06T03:26:33.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.695+0000 7f8d733b8700 1 --2- 172.21.15.50:0/1156612627 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8d580a2ca0 0x7f8d580a5160 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:33.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.695+0000 7f8d733b8700 1 --2- 172.21.15.50:0/1156612627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d6c107550 0x7f8d6c198b30 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:33.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.695+0000 7f8d733b8700 1 --2- 172.21.15.50:0/1156612627 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d6c100e30 0x7f8d6c19e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:33.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.695+0000 7f8d733b8700 1 --2- 172.21.15.50:0/1156612627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d6c1017f0 0x7f8d6c19ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:33.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.695+0000 7f8d733b8700 1 -- 172.21.15.50:0/1156612627 >> 172.21.15.50:0/1156612627 conn(0x7f8d6c0766b0 msgr2=0x7f8d6c0ff9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:33.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.695+0000 7f8d733b8700 1 -- 172.21.15.50:0/1156612627 shutdown_connections 2024-06-06T03:26:33.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:33.695+0000 7f8d733b8700 1 -- 172.21.15.50:0/1156612627 wait complete. 2024-06-06T03:26:33.695 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 27 2024-06-06T03:26:34.432 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-06T03:26:34.692 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:26:34.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:34 smithi122 ceph-mon[35759]: pgmap v429: 129 pgs: 129 active+clean; 647 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-06-06T03:26:34.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:34 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/1156612627' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:26:34.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:34 smithi050 ceph-mon[32421]: pgmap v429: 129 pgs: 129 active+clean; 647 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-06-06T03:26:34.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:34 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1156612627' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:26:35.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:34 smithi079 ceph-mon[35478]: pgmap v429: 129 pgs: 129 active+clean; 647 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-06-06T03:26:35.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:34 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/1156612627' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:26:36.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.441+0000 7fca1ff80700 1 -- 172.21.15.50:0/1345999763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca18102030 msgr2=0x7fca18105ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:36.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.441+0000 7fca1ff80700 1 --2- 172.21.15.50:0/1345999763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca18102030 0x7fca18105ff0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fca080099c0 tx=0x7fca08009cd0 comp rx=0 tx=0).stop 2024-06-06T03:26:36.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.441+0000 7fca1ff80700 1 -- 172.21.15.50:0/1345999763 shutdown_connections 2024-06-06T03:26:36.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.441+0000 7fca1ff80700 1 --2- 172.21.15.50:0/1345999763 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca181066d0 0x7fca1810e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:36.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.441+0000 7fca1ff80700 1 --2- 172.21.15.50:0/1345999763 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca18101680 0x7fca18101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:36.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.441+0000 7fca1ff80700 1 --2- 172.21.15.50:0/1345999763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca18102030 0x7fca18105ff0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:36.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.441+0000 7fca1ff80700 1 -- 172.21.15.50:0/1345999763 >> 172.21.15.50:0/1345999763 conn(0x7fca180773e0 msgr2=0x7fca180777f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:36.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.441+0000 7fca1ff80700 1 -- 172.21.15.50:0/1345999763 shutdown_connections 2024-06-06T03:26:36.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.441+0000 7fca1ff80700 1 -- 172.21.15.50:0/1345999763 wait complete. 2024-06-06T03:26:36.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.442+0000 7fca1ff80700 1 Processor -- start 2024-06-06T03:26:36.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.442+0000 7fca1ff80700 1 -- start start 2024-06-06T03:26:36.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.442+0000 7fca1ff80700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca18101680 0x7fca1819e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:36.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.442+0000 7fca1ff80700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca18102030 0x7fca18196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:36.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.442+0000 7fca1ff80700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca181066d0 0x7fca18196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:36.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.442+0000 7fca1ff80700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fca18111540 con 0x7fca181066d0 2024-06-06T03:26:36.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.442+0000 7fca1ff80700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fca181113c0 con 0x7fca18102030 2024-06-06T03:26:36.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.442+0000 7fca1ff80700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fca181116c0 con 0x7fca18101680 2024-06-06T03:26:36.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.442+0000 7fca1dd1c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca18101680 0x7fca1819e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:36.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.442+0000 7fca1e51d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca181066d0 0x7fca18196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:36.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.442+0000 7fca1dd1c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca18101680 0x7fca1819e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:55998/0 (socket says 172.21.15.50:55998) 2024-06-06T03:26:36.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.442+0000 7fca1dd1c700 1 -- 172.21.15.50:0/707031940 learned_addr learned my addr 172.21.15.50:0/707031940 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:36.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.442+0000 7fca1d51b700 1 --2- 172.21.15.50:0/707031940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca18102030 0x7fca18196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:36.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.443+0000 7fca1dd1c700 1 -- 172.21.15.50:0/707031940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca18102030 msgr2=0x7fca18196a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:36.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.443+0000 7fca1dd1c700 1 --2- 172.21.15.50:0/707031940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca18102030 0x7fca18196a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:36.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.443+0000 7fca1dd1c700 1 -- 172.21.15.50:0/707031940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca181066d0 msgr2=0x7fca18196f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:36.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.443+0000 7fca1dd1c700 1 --2- 172.21.15.50:0/707031940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca181066d0 0x7fca18196f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:36.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.443+0000 7fca1dd1c700 1 -- 172.21.15.50:0/707031940 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca18197490 con 0x7fca18101680 2024-06-06T03:26:36.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.443+0000 7fca1e51d700 1 --2- 172.21.15.50:0/707031940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca181066d0 0x7fca18196f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:26:36.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.443+0000 7fca1dd1c700 1 --2- 172.21.15.50:0/707031940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca18101680 0x7fca1819e7b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fca140060b0 tx=0x7fca1400d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:36.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.443+0000 7fca0effd700 1 -- 172.21.15.50:0/707031940 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1401a070 con 0x7fca18101680 2024-06-06T03:26:36.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.443+0000 7fca0effd700 1 -- 172.21.15.50:0/707031940 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fca1400dd20 con 0x7fca18101680 2024-06-06T03:26:36.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.443+0000 7fca1ff80700 1 -- 172.21.15.50:0/707031940 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca18197780 con 0x7fca18101680 2024-06-06T03:26:36.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.443+0000 7fca0effd700 1 -- 172.21.15.50:0/707031940 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca14014600 con 0x7fca18101680 2024-06-06T03:26:36.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.443+0000 7fca1ff80700 1 -- 172.21.15.50:0/707031940 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca181b4420 con 0x7fca18101680 2024-06-06T03:26:36.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.444+0000 7fca1ff80700 1 -- 172.21.15.50:0/707031940 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca18102ad0 con 0x7fca18101680 2024-06-06T03:26:36.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.446+0000 7fca0effd700 1 -- 172.21.15.50:0/707031940 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fca1401d070 con 0x7fca18101680 2024-06-06T03:26:36.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.446+0000 7fca0effd700 1 --2- 172.21.15.50:0/707031940 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fca040a2c20 0x7fca040a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:36.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.446+0000 7fca1d51b700 1 --2- 172.21.15.50:0/707031940 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fca040a2c20 0x7fca040a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:36.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.446+0000 7fca0effd700 1 -- 172.21.15.50:0/707031940 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fca140cf0f0 con 0x7fca18101680 2024-06-06T03:26:36.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.447+0000 7fca1d51b700 1 --2- 172.21.15.50:0/707031940 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fca040a2c20 0x7fca040a50e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fca08000c00 tx=0x7fca08005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:36.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.450+0000 7fca0effd700 1 -- 172.21.15.50:0/707031940 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fca14010070 con 0x7fca18101680 2024-06-06T03:26:36.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.657+0000 7fca1ff80700 1 -- 172.21.15.50:0/707031940 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca18069180 con 0x7fca18101680 2024-06-06T03:26:36.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.659+0000 7fca0effd700 1 -- 172.21.15.50:0/707031940 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+24653 (secure 0 0 0) 0x7fca18069180 con 0x7fca18101680 2024-06-06T03:26:36.658 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:26:36.658 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":99,"fsid":"b6263b26-23b2-11ef-bc9b-c7b262605968","created":"2024-06-06T03:14:19.062632+0000","modified":"2024-06-06T03:24:14.691472+0000","last_up_change":"2024-06-06T03:21:30.287918+0000","last_in_change":"2024-06-06T03:21:09.550417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T03:17:37.777608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T03:22:29.496859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T03:22:33.221878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-06T03:22:42.829873+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"eed8040f-a7b7-4d3b-8345-2022918097d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6803","nonce":2379528827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6805","nonce":2379528827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6809","nonce":2379528827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6807","nonce":2379528827}]},"public_addr":"172.21.15.50:6803/2379528827","cluster_addr":"172.21.15.50:6805/2379528827","heartbeat_back_addr":"172.21.15.50:6809/2379528827","heartbeat_front_addr":"172.21.15.50:6807/2379528827","state":["exists","up"]},{"osd":1,"uuid":"089ecb78-5e1e-4cdb-8fe0-5c1731ec9dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6801","nonce":3498354151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6803","nonce":3498354151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6807","nonce":3498354151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6805","nonce":3498354151}]},"public_addr":"172.21.15.79:6801/3498354151","cluster_addr":"172.21.15.79:6803/3498354151","heartbeat_back_addr":"172.21.15.79:6807/3498354151","heartbeat_front_addr":"172.21.15.79:6805/3498354151","state":["exists","up"]},{"osd":2,"uuid":"90599e3b-bf86-4a56-b03b-b051528a5b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6801","nonce":566397008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6803","nonce":566397008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6807","nonce":566397008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6805","nonce":566397008}]},"public_addr":"172.21.15.122:6801/566397008","cluster_addr":"172.21.15.122:6803/566397008","heartbeat_back_addr":"172.21.15.122:6807/566397008","heartbeat_front_addr":"172.21.15.122:6805/566397008","state":["exists","up"]},{"osd":3,"uuid":"fd295e6c-64cd-4164-83dc-4d32c2ae103a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6811","nonce":820123083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6813","nonce":820123083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6817","nonce":820123083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6815","nonce":820123083}]},"public_addr":"172.21.15.50:6811/820123083","cluster_addr":"172.21.15.50:6813/820123083","heartbeat_back_addr":"172.21.15.50:6817/820123083","heartbeat_front_addr":"172.21.15.50:6815/820123083","state":["exists","up"]},{"osd":4,"uuid":"4c854d90-5353-4f7c-b2f3-2af6216d799b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6809","nonce":1784117997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6811","nonce":1784117997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6815","nonce":1784117997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6813","nonce":1784117997}]},"public_addr":"172.21.15.79:6809/1784117997","cluster_addr":"172.21.15.79:6811/1784117997","heartbeat_back_addr":"172.21.15.79:6815/1784117997","heartbeat_front_addr":"172.21.15.79:6813/1784117997","state":["exists","up"]},{"osd":5,"uuid":"80041e10-a643-4338-b621-f882c7bc48b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6809","nonce":2755878218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6811","nonce":2755878218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6815","nonce":2755878218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6813","nonce":2755878218}]},"public_addr":"172.21.15.122:6809/2755878218","cluster_addr":"172.21.15.122:6811/2755878218","heartbeat_back_addr":"172.21.15.122:6815/2755878218","heartbeat_front_addr":"172.21.15.122:6813/2755878218","state":["exists","up"]},{"osd":6,"uuid":"9e15c6c3-bb4b-4c2b-bb7e-4653b10874d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6819","nonce":474595612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6821","nonce":474595612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6825","nonce":474595612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6823","nonce":474595612}]},"public_addr":"172.21.15.50:6819/474595612","cluster_addr":"172.21.15.50:6821/474595612","heartbeat_back_addr":"172.21.15.50:6825/474595612","heartbeat_front_addr":"172.21.15.50:6823/474595612","state":["exists","up"]},{"osd":7,"uuid":"62585bba-c540-4498-8768-b84183e19abd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6817","nonce":3504864579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6819","nonce":3504864579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6823","nonce":3504864579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6821","nonce":3504864579}]},"public_addr":"172.21.15.79:6817/3504864579","cluster_addr":"172.21.15.79:6819/3504864579","heartbeat_back_addr":"172.21.15.79:6823/3504864579","heartbeat_front_addr":"172.21.15.79:6821/3504864579","state":["exists","up"]},{"osd":8,"uuid":"7a272157-460a-4d4a-a63e-30436022ac7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6817","nonce":3484833116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6819","nonce":3484833116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6823","nonce":3484833116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6821","nonce":3484833116}]},"public_addr":"172.21.15.122:6817/3484833116","cluster_addr":"172.21.15.122:6819/3484833116","heartbeat_back_addr":"172.21.15.122:6823/3484833116","heartbeat_front_addr":"172.21.15.122:6821/3484833116","state":["exists","up"]},{"osd":9,"uuid":"7e768ff7-f78d-4a12-b863-4b692e0f4a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6827","nonce":2600273670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6829","nonce":2600273670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6833","nonce":2600273670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6831","nonce":2600273670}]},"public_addr":"172.21.15.50:6827/2600273670","cluster_addr":"172.21.15.50:6829/2600273670","heartbeat_back_addr":"172.21.15.50:6833/2600273670","heartbeat_front_addr":"172.21.15.50:6831/2600273670","state":["exists","up"]},{"osd":10,"uuid":"a42df29a-d88d-4401-878d-6c8f75f3f604","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6825","nonce":2740366543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6827","nonce":2740366543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6831","nonce":2740366543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6829","nonce":2740366543}]},"public_addr":"172.21.15.79:6825/2740366543","cluster_addr":"172.21.15.79:6827/2740366543","heartbeat_back_addr":"172.21.15.79:6831/2740366543","heartbeat_front_addr":"172.21.15.79:6829/2740366543","state":["exists","up"]},{"osd":11,"uuid":"35bcde30-49e4-49b9-a348-98d21a0d3cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6825","nonce":4160854238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6827","nonce":4160854238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6831","nonce":4160854238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6829","nonce":4160854238}]},"public_addr":"172.21.15.122:6825/4160854238","cluster_addr":"172.21.15.122:6827/4160854238","heartbeat_back_addr":"172.21.15.122:6831/4160854238","heartbeat_front_addr":"172.21.15.122:6829/4160854238","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:16:46.989554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:17:11.269759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:17:35.105846+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:00.940943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:26.284520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:51.064143+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:19:16.254750+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:19:42.841380+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:20:08.185133+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:20:34.700082+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:21:01.485278+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:21:27.938715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1311987652":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/1149897118":"2024-06-07T03:15:13.252241+0000","172.21.15.50:6800/2617801068":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/1068038293":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/4038080419":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/149912088":"2024-06-07T03:14:46.388744+0000","172.21.15.50:6801/2617801068":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/2963887224":"2024-06-07T03:14:46.388744+0000","172.21.15.50:6801/1311987652":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/2554563139":"2024-06-07T03:15:13.252241+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T03:26:36.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.661+0000 7fca1ff80700 1 -- 172.21.15.50:0/707031940 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fca040a2c20 msgr2=0x7fca040a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:36.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.661+0000 7fca1ff80700 1 --2- 172.21.15.50:0/707031940 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fca040a2c20 0x7fca040a50e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fca08000c00 tx=0x7fca08005fb0 comp rx=0 tx=0).stop 2024-06-06T03:26:36.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.661+0000 7fca1ff80700 1 -- 172.21.15.50:0/707031940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca18101680 msgr2=0x7fca1819e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:36.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.661+0000 7fca1ff80700 1 --2- 172.21.15.50:0/707031940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca18101680 0x7fca1819e7b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fca140060b0 tx=0x7fca1400d3b0 comp rx=0 tx=0).stop 2024-06-06T03:26:36.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.661+0000 7fca1ff80700 1 -- 172.21.15.50:0/707031940 shutdown_connections 2024-06-06T03:26:36.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.661+0000 7fca1ff80700 1 --2- 172.21.15.50:0/707031940 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fca040a2c20 0x7fca040a50e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:36.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.661+0000 7fca1ff80700 1 --2- 172.21.15.50:0/707031940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca181066d0 0x7fca18196f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:36.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.661+0000 7fca1ff80700 1 --2- 172.21.15.50:0/707031940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca18101680 0x7fca1819e7b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:36.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.661+0000 7fca1ff80700 1 --2- 172.21.15.50:0/707031940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca18102030 0x7fca18196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:36.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.661+0000 7fca1ff80700 1 -- 172.21.15.50:0/707031940 >> 172.21.15.50:0/707031940 conn(0x7fca180773e0 msgr2=0x7fca180ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:36.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.661+0000 7fca1ff80700 1 -- 172.21.15.50:0/707031940 shutdown_connections 2024-06-06T03:26:36.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:36.661+0000 7fca1ff80700 1 -- 172.21.15.50:0/707031940 wait complete. 2024-06-06T03:26:36.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:36 smithi050 ceph-mon[32421]: pgmap v430: 129 pgs: 129 active+clean; 647 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-06-06T03:26:36.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:36 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/707031940' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:26:37.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:36 smithi079 ceph-mon[35478]: pgmap v430: 129 pgs: 129 active+clean; 647 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-06-06T03:26:37.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:36 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/707031940' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:26:37.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:36 smithi122 ceph-mon[35759]: pgmap v430: 129 pgs: 129 active+clean; 647 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-06-06T03:26:37.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:36 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/707031940' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:26:37.434 DEBUG:tasks.fwd_scrub:Yielding 2024-06-06T03:26:37.435 INFO:teuthology.run_tasks:Running task background_exec... 2024-06-06T03:26:37.445 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi050.front.sepia.ceph.com 2024-06-06T03:26:37.445 DEBUG:teuthology.orchestra.run.smithi050:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-06-06T03:26:37.446 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-06-06T03:26:37.446 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-06T03:26:37.446 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-06-06T03:26:37.448 INFO:teuthology.run_tasks:Running task workunit... 2024-06-06T03:26:37.470 INFO:tasks.workunit:Pulling workunits from ref 3d746ca5346f34eef7e826a1eb71e59e02b682ae 2024-06-06T03:26:37.470 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-06-06T03:26:37.470 INFO:tasks.workunit:timeout=3h 2024-06-06T03:26:37.470 INFO:tasks.workunit:cleanup=True 2024-06-06T03:26:37.471 DEBUG:teuthology.orchestra.run.smithi050:> stat -- /home/ubuntu/cephtest/mnt.0 2024-06-06T03:26:37.489 INFO:teuthology.orchestra.run.smithi050.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-06-06T03:26:37.489 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-06-06T03:26:37.489 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 77h/119d Inode: 1 Links: 2 2024-06-06T03:26:37.489 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T03:26:37.489 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:fusefs_t:s0 2024-06-06T03:26:37.489 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-06-06 03:23:44.285312321 +0000 2024-06-06T03:26:37.489 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-06-06 03:23:44.285312321 +0000 2024-06-06T03:26:37.489 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-06-06 03:26:24.574338432 +0000 2024-06-06T03:26:37.490 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2024-06-06T03:26:37.490 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-06-06T03:26:37.490 DEBUG:teuthology.orchestra.run.smithi050:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-06-06T03:26:37.563 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 3d746ca5346f34eef7e826a1eb71e59e02b682ae 2024-06-06T03:26:37.619 INFO:tasks.workunit.client.0.smithi050.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-06-06T03:26:37.705 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:26:38.934 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:38 smithi050 ceph-mon[32421]: pgmap v431: 129 pgs: 129 active+clean; 647 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1023 B/s wr, 6 op/s 2024-06-06T03:26:39.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:38 smithi079 ceph-mon[35478]: pgmap v431: 129 pgs: 129 active+clean; 647 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1023 B/s wr, 6 op/s 2024-06-06T03:26:39.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:38 smithi122 ceph-mon[35759]: pgmap v431: 129 pgs: 129 active+clean; 647 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1023 B/s wr, 6 op/s 2024-06-06T03:26:39.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.483+0000 7f6b19bf8700 1 -- 172.21.15.50:0/4002030327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b14107850 msgr2=0x7f6b1410f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:39.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.483+0000 7f6b19bf8700 1 --2- 172.21.15.50:0/4002030327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b14107850 0x7f6b1410f3d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c00b0d0 tx=0x7f6b0c00b3e0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.483+0000 7f6b19bf8700 1 -- 172.21.15.50:0/4002030327 shutdown_connections 2024-06-06T03:26:39.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.483+0000 7f6b19bf8700 1 --2- 172.21.15.50:0/4002030327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b14107850 0x7f6b1410f3d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.483+0000 7f6b19bf8700 1 --2- 172.21.15.50:0/4002030327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b1406ae80 0x7f6b1406b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.483+0000 7f6b19bf8700 1 --2- 172.21.15.50:0/4002030327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b1406b830 0x7f6b14107120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.483+0000 7f6b19bf8700 1 -- 172.21.15.50:0/4002030327 >> 172.21.15.50:0/4002030327 conn(0x7f6b14078400 msgr2=0x7f6b14078810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:39.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.483+0000 7f6b19bf8700 1 -- 172.21.15.50:0/4002030327 shutdown_connections 2024-06-06T03:26:39.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.483+0000 7f6b19bf8700 1 -- 172.21.15.50:0/4002030327 wait complete. 2024-06-06T03:26:39.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.483+0000 7f6b19bf8700 1 Processor -- start 2024-06-06T03:26:39.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.484+0000 7f6b19bf8700 1 -- start start 2024-06-06T03:26:39.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.484+0000 7f6b19bf8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b1406ae80 0x7f6b1419e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:39.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.484+0000 7f6b19bf8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b1406b830 0x7f6b1419ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:39.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.484+0000 7f6b19bf8700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b14107850 0x7f6b14198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:39.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.484+0000 7f6b19bf8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6b14112620 con 0x7f6b1406b830 2024-06-06T03:26:39.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.484+0000 7f6b19bf8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6b141124a0 con 0x7f6b1406ae80 2024-06-06T03:26:39.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.484+0000 7f6b19bf8700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6b141127a0 con 0x7f6b14107850 2024-06-06T03:26:39.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.484+0000 7f6b12ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b1406b830 0x7f6b1419ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:39.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.484+0000 7f6b12ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b1406b830 0x7f6b1419ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52182/0 (socket says 172.21.15.50:52182) 2024-06-06T03:26:39.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.484+0000 7f6b12ffd700 1 -- 172.21.15.50:0/2910851048 learned_addr learned my addr 172.21.15.50:0/2910851048 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:39.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.484+0000 7f6b137fe700 1 --2- 172.21.15.50:0/2910851048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b1406ae80 0x7f6b1419e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:39.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.484+0000 7f6b13fff700 1 --2- 172.21.15.50:0/2910851048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b14107850 0x7f6b14198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:39.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.484+0000 7f6b12ffd700 1 -- 172.21.15.50:0/2910851048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b14107850 msgr2=0x7f6b14198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:39.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.484+0000 7f6b12ffd700 1 --2- 172.21.15.50:0/2910851048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b14107850 0x7f6b14198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.484+0000 7f6b12ffd700 1 -- 172.21.15.50:0/2910851048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b1406ae80 msgr2=0x7f6b1419e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:39.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.484+0000 7f6b12ffd700 1 --2- 172.21.15.50:0/2910851048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b1406ae80 0x7f6b1419e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.484+0000 7f6b12ffd700 1 -- 172.21.15.50:0/2910851048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b14199020 con 0x7f6b1406b830 2024-06-06T03:26:39.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.484+0000 7f6b137fe700 1 --2- 172.21.15.50:0/2910851048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b1406ae80 0x7f6b1419e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:26:39.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.485+0000 7f6b12ffd700 1 --2- 172.21.15.50:0/2910851048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b1406b830 0x7f6b1419ec00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6b0800e9a0 tx=0x7f6b0800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:39.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.485+0000 7f6b10ff9700 1 -- 172.21.15.50:0/2910851048 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0800cbd0 con 0x7f6b1406b830 2024-06-06T03:26:39.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.485+0000 7f6b19bf8700 1 -- 172.21.15.50:0/2910851048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b14199310 con 0x7f6b1406b830 2024-06-06T03:26:39.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.485+0000 7f6b10ff9700 1 -- 172.21.15.50:0/2910851048 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6b0800cd70 con 0x7f6b1406b830 2024-06-06T03:26:39.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.485+0000 7f6b10ff9700 1 -- 172.21.15.50:0/2910851048 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b08018750 con 0x7f6b1406b830 2024-06-06T03:26:39.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.485+0000 7f6b19bf8700 1 -- 172.21.15.50:0/2910851048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b141a5520 con 0x7f6b1406b830 2024-06-06T03:26:39.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.487+0000 7f6b10ff9700 1 -- 172.21.15.50:0/2910851048 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6b08010430 con 0x7f6b1406b830 2024-06-06T03:26:39.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.488+0000 7f6b10ff9700 1 --2- 172.21.15.50:0/2910851048 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6afc0a2c20 0x7f6afc0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:39.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.488+0000 7f6b10ff9700 1 -- 172.21.15.50:0/2910851048 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f6b080cf730 con 0x7f6b1406b830 2024-06-06T03:26:39.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.488+0000 7f6b137fe700 1 --2- 172.21.15.50:0/2910851048 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6afc0a2c20 0x7f6afc0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:39.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.489+0000 7f6b137fe700 1 --2- 172.21.15.50:0/2910851048 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6afc0a2c20 0x7f6afc0a50e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6b04009cb0 tx=0x7f6b04009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:39.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.489+0000 7f6b2447bb80 1 Processor -- start 2024-06-06T03:26:39.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.490+0000 7f6b2447bb80 1 -- start start 2024-06-06T03:26:39.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.490+0000 7f6b2447bb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562e6631fe0 0x5562e66323c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:39.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.490+0000 7f6b2447bb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562e6632900 0x5562e662c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:39.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.490+0000 7f6b2447bb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562e662c820 0x5562e662cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:39.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.490+0000 7f6b2447bb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5562e651efe0 con 0x5562e6631fe0 2024-06-06T03:26:39.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.490+0000 7f6b2447bb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5562e657d8d0 con 0x5562e6632900 2024-06-06T03:26:39.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.490+0000 7f6b2447bb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5562e64e54e0 con 0x5562e662c820 2024-06-06T03:26:39.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.490+0000 7f6b137fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562e6631fe0 0x5562e66323c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:39.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.490+0000 7f6b137fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562e6631fe0 0x5562e66323c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52188/0 (socket says 172.21.15.50:52188) 2024-06-06T03:26:39.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.490+0000 7f6b137fe700 1 -- 172.21.15.50:0/2195314307 learned_addr learned my addr 172.21.15.50:0/2195314307 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:39.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.490+0000 7f6b13fff700 1 --2- 172.21.15.50:0/2195314307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562e662c820 0x5562e662cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:39.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.490+0000 7f6b12ffd700 1 --2- 172.21.15.50:0/2195314307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562e6632900 0x5562e662c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:39.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.490+0000 7f6b137fe700 1 -- 172.21.15.50:0/2195314307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562e662c820 msgr2=0x5562e662cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:39.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.490+0000 7f6b137fe700 1 --2- 172.21.15.50:0/2195314307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562e662c820 0x5562e662cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.490+0000 7f6b137fe700 1 -- 172.21.15.50:0/2195314307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562e6632900 msgr2=0x5562e662c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:39.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.490+0000 7f6b137fe700 1 --2- 172.21.15.50:0/2195314307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562e6632900 0x5562e662c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.491+0000 7f6b137fe700 1 -- 172.21.15.50:0/2195314307 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562e64cc950 con 0x5562e6631fe0 2024-06-06T03:26:39.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.491+0000 7f6b137fe700 1 --2- 172.21.15.50:0/2195314307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562e6631fe0 0x5562e66323c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6b04011fb0 tx=0x7f6b04014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9712db00d18737cc server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:39.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.491+0000 7f6af9ffb700 1 -- 172.21.15.50:0/2195314307 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b04025070 con 0x5562e6631fe0 2024-06-06T03:26:39.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.491+0000 7f6af9ffb700 1 -- 172.21.15.50:0/2195314307 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6b04016070 con 0x5562e6631fe0 2024-06-06T03:26:39.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.491+0000 7f6af9ffb700 1 -- 172.21.15.50:0/2195314307 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b04012a60 con 0x5562e6631fe0 2024-06-06T03:26:39.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.492+0000 7f6b2447bb80 1 -- 172.21.15.50:0/2195314307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562e6631fe0 msgr2=0x5562e66323c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:39.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.492+0000 7f6b2447bb80 1 --2- 172.21.15.50:0/2195314307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562e6631fe0 0x5562e66323c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6b04011fb0 tx=0x7f6b04014000 comp rx=0 tx=0).stop 2024-06-06T03:26:39.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.492+0000 7f6b2447bb80 1 -- 172.21.15.50:0/2195314307 shutdown_connections 2024-06-06T03:26:39.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.492+0000 7f6b2447bb80 1 --2- 172.21.15.50:0/2195314307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562e662c820 0x5562e662cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.492+0000 7f6b2447bb80 1 --2- 172.21.15.50:0/2195314307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562e6631fe0 0x5562e66323c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.492+0000 7f6b2447bb80 1 --2- 172.21.15.50:0/2195314307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562e6632900 0x5562e662c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.492+0000 7f6b2447bb80 1 -- 172.21.15.50:0/2195314307 >> 172.21.15.50:0/2195314307 conn(0x5562e6559100 msgr2=0x5562e66272a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:39.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.492+0000 7f6b2447bb80 1 -- 172.21.15.50:0/2195314307 shutdown_connections 2024-06-06T03:26:39.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.492+0000 7f6b2447bb80 1 -- 172.21.15.50:0/2195314307 wait complete. 2024-06-06T03:26:39.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.492+0000 7f6b2447bb80 1 -- start start 2024-06-06T03:26:39.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.493+0000 7f6b2447bb80 1 Processor -- start 2024-06-06T03:26:39.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.493+0000 7f6b2447bb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562e662c820 0x5562e6638700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:39.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.493+0000 7f6b2447bb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562e6631fe0 0x5562e6635a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:39.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.493+0000 7f6b2447bb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562e6632900 0x5562e6635f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:39.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.493+0000 7f6b2447bb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5562e651e040 con 0x5562e6632900 2024-06-06T03:26:39.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.493+0000 7f6b2447bb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5562e6579890 con 0x5562e662c820 2024-06-06T03:26:39.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.493+0000 7f6b2447bb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5562e66392e0 con 0x5562e6631fe0 2024-06-06T03:26:39.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.493+0000 7f6b13fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562e6632900 0x5562e6635f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:39.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.493+0000 7f6b12ffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562e6631fe0 0x5562e6635a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:39.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.493+0000 7f6b13fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562e6632900 0x5562e6635f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52198/0 (socket says 172.21.15.50:52198) 2024-06-06T03:26:39.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.493+0000 7f6b13fff700 1 -- 172.21.15.50:0/1463781931 learned_addr learned my addr 172.21.15.50:0/1463781931 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:39.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.493+0000 7f6b137fe700 1 --2- 172.21.15.50:0/1463781931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562e662c820 0x5562e6638700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:39.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.493+0000 7f6b2447bb80 10 client.0 _ll_register_callbacks cb 0x5562e6513630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:26:39.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.494+0000 7f6b12ffd700 1 -- 172.21.15.50:0/1463781931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562e662c820 msgr2=0x5562e6638700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:39.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.494+0000 7f6b12ffd700 1 --2- 172.21.15.50:0/1463781931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562e662c820 0x5562e6638700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.494+0000 7f6b12ffd700 1 -- 172.21.15.50:0/1463781931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562e6632900 msgr2=0x5562e6635f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:39.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.494+0000 7f6b12ffd700 1 --2- 172.21.15.50:0/1463781931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562e6632900 0x5562e6635f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.494+0000 7f6b12ffd700 1 -- 172.21.15.50:0/1463781931 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562e65437d0 con 0x5562e6631fe0 2024-06-06T03:26:39.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.494+0000 7f6b13fff700 1 --2- 172.21.15.50:0/1463781931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562e6632900 0x5562e6635f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:26:39.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.494+0000 7f6b12ffd700 1 --2- 172.21.15.50:0/1463781931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562e6631fe0 0x5562e6635a00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6b08000c00 tx=0x7f6b0809b5e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1a97d9e1649f3b1 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:39.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.494+0000 7f6af2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:26:39.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.494+0000 7f6af2ffd700 1 -- 172.21.15.50:0/1463781931 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0809ff60 con 0x5562e6631fe0 2024-06-06T03:26:39.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.494+0000 7f6af2ffd700 1 -- 172.21.15.50:0/1463781931 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f6b08010a00 con 0x5562e6631fe0 2024-06-06T03:26:39.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.494+0000 7f6b2447bb80 1 -- 172.21.15.50:0/1463781931 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b04016070 con 0x5562e6631fe0 2024-06-06T03:26:39.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.494+0000 7f6af2ffd700 1 -- 172.21.15.50:0/1463781931 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6b080a4820 con 0x5562e6631fe0 2024-06-06T03:26:39.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.494+0000 7f6b2447bb80 10 client.24979 fetch_fsmap learned FSMap version 27 2024-06-06T03:26:39.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.494+0000 7f6b2447bb80 1 -- 172.21.15.50:0/1463781931 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5562e6643b50 con 0x5562e6631fe0 2024-06-06T03:26:39.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.494+0000 7f6af2ffd700 1 -- 172.21.15.50:0/1463781931 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6b04016070 con 0x5562e6631fe0 2024-06-06T03:26:39.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.495+0000 7f6af2ffd700 1 -- 172.21.15.50:0/1463781931 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6b08097900 con 0x5562e6631fe0 2024-06-06T03:26:39.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.495+0000 7f6b2447bb80 10 client.24979 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:26:39.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.495+0000 7f6b2447bb80 10 client.24979 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:26:39.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.495+0000 7f6b2447bb80 20 client.24979 populate_metadata read hostname 'smithi050' 2024-06-06T03:26:39.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.495+0000 7f6b2447bb80 1 --2- 172.21.15.50:0/1463781931 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5562e66460e0 0x5562e6648500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:39.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.495+0000 7f6b2447bb80 4 client.24979 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:26:39.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.495+0000 7f6b2447bb80 1 -- 172.21.15.50:0/1463781931 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5562e658add0 con 0x5562e66460e0 2024-06-06T03:26:39.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.495+0000 7f6b137fe700 1 --2- 172.21.15.50:0/1463781931 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5562e66460e0 0x5562e6648500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:39.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.495+0000 7f6b137fe700 1 --2- 172.21.15.50:0/1463781931 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5562e66460e0 0x5562e6648500 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=966c2782d37ddab5 server_cookie=c1e9a1d89b5de97a in_seq=0 out_seq=0 2024-06-06T03:26:39.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.495+0000 7f6af2ffd700 10 client.24979 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:26:39.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.496+0000 7f6af2ffd700 1 -- 172.21.15.50:0/1463781931 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5562e658add0 con 0x5562e66460e0 2024-06-06T03:26:39.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.496+0000 7f6af2ffd700 10 client.24979 handle_command_reply: tid=0 2024-06-06T03:26:39.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.496+0000 7f6b2447bb80 1 client.24979 shutdown 2024-06-06T03:26:39.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.496+0000 7f6b2447bb80 1 -- 172.21.15.50:0/1463781931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562e6631fe0 msgr2=0x5562e6635a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:39.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.496+0000 7f6b2447bb80 1 --2- 172.21.15.50:0/1463781931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562e6631fe0 0x5562e6635a00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6b08000c00 tx=0x7f6b0809b5e0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.496+0000 7f6b2447bb80 1 -- 172.21.15.50:0/1463781931 shutdown_connections 2024-06-06T03:26:39.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.496+0000 7f6b2447bb80 1 --2- 172.21.15.50:0/1463781931 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5562e66460e0 0x5562e6648500 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.496+0000 7f6b2447bb80 1 --2- 172.21.15.50:0/1463781931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562e6632900 0x5562e6635f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.496+0000 7f6b2447bb80 1 --2- 172.21.15.50:0/1463781931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562e662c820 0x5562e6638700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.496+0000 7f6b2447bb80 1 --2- 172.21.15.50:0/1463781931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562e6631fe0 0x5562e6635a00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.497+0000 7f6b2447bb80 1 -- 172.21.15.50:0/1463781931 >> 172.21.15.50:0/1463781931 conn(0x5562e6559100 msgr2=0x5562e6626780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:39.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.497+0000 7f6af2ffd700 0 client.24979 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:26:39.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.497+0000 7f6b2447bb80 1 -- 172.21.15.50:0/1463781931 shutdown_connections 2024-06-06T03:26:39.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.497+0000 7f6b2447bb80 1 -- 172.21.15.50:0/1463781931 wait complete. 2024-06-06T03:26:39.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.497+0000 7f6b2447bb80 20 client.24979 trim_cache size 0 max 16384 2024-06-06T03:26:39.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.518+0000 7f6b2447bb80 1 Processor -- start 2024-06-06T03:26:39.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.518+0000 7f6b2447bb80 1 -- start start 2024-06-06T03:26:39.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.518+0000 7f6b2447bb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562e662c820 0x5562e662c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:39.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.518+0000 7f6b2447bb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562e6631fe0 0x5562e6638240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:39.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.518+0000 7f6b2447bb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562e6632900 0x5562e6626f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:39.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.519+0000 7f6b2447bb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6b141b0aa0 con 0x5562e6632900 2024-06-06T03:26:39.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.519+0000 7f6b2447bb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6b141ae330 con 0x5562e6631fe0 2024-06-06T03:26:39.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.519+0000 7f6b2447bb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6b141ac180 con 0x5562e662c820 2024-06-06T03:26:39.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.519+0000 7f6b13fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562e6632900 0x5562e6626f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:39.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.519+0000 7f6b13fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562e6632900 0x5562e6626f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52208/0 (socket says 172.21.15.50:52208) 2024-06-06T03:26:39.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.519+0000 7f6b13fff700 1 -- 172.21.15.50:0/2855523893 learned_addr learned my addr 172.21.15.50:0/2855523893 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:39.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.519+0000 7f6b12ffd700 1 --2- 172.21.15.50:0/2855523893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562e6631fe0 0x5562e6638240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:39.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.519+0000 7f6b137fe700 1 --2- 172.21.15.50:0/2855523893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562e662c820 0x5562e662c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:39.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.519+0000 7f6b13fff700 1 -- 172.21.15.50:0/2855523893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562e662c820 msgr2=0x5562e662c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:39.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.519+0000 7f6b13fff700 1 --2- 172.21.15.50:0/2855523893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562e662c820 0x5562e662c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.519+0000 7f6b13fff700 1 -- 172.21.15.50:0/2855523893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562e6631fe0 msgr2=0x5562e6638240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:39.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.519+0000 7f6b13fff700 1 --2- 172.21.15.50:0/2855523893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562e6631fe0 0x5562e6638240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.519+0000 7f6b13fff700 1 -- 172.21.15.50:0/2855523893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562e6623890 con 0x5562e6632900 2024-06-06T03:26:39.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.519+0000 7f6b13fff700 1 --2- 172.21.15.50:0/2855523893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562e6632900 0x5562e6626f00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c00bd40 tx=0x7f6b0c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9505f82921e1e16 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:39.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.519+0000 7f6af97fa700 1 -- 172.21.15.50:0/2855523893 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c004a50 con 0x5562e6632900 2024-06-06T03:26:39.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.519+0000 7f6af97fa700 1 -- 172.21.15.50:0/2855523893 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6b0c004bf0 con 0x5562e6632900 2024-06-06T03:26:39.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.519+0000 7f6af97fa700 1 -- 172.21.15.50:0/2855523893 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c026920 con 0x5562e6632900 2024-06-06T03:26:39.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.520+0000 7f6b2447bb80 1 -- 172.21.15.50:0/2855523893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562e6632900 msgr2=0x5562e6626f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:39.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.520+0000 7f6b2447bb80 1 --2- 172.21.15.50:0/2855523893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562e6632900 0x5562e6626f00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c00bd40 tx=0x7f6b0c00bd70 comp rx=0 tx=0).stop 2024-06-06T03:26:39.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.520+0000 7f6b2447bb80 1 -- 172.21.15.50:0/2855523893 shutdown_connections 2024-06-06T03:26:39.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.520+0000 7f6b2447bb80 1 --2- 172.21.15.50:0/2855523893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562e6632900 0x5562e6626f00 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.520+0000 7f6b2447bb80 1 --2- 172.21.15.50:0/2855523893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562e662c820 0x5562e662c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.520+0000 7f6b2447bb80 1 --2- 172.21.15.50:0/2855523893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562e6631fe0 0x5562e6638240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.520+0000 7f6b2447bb80 1 -- 172.21.15.50:0/2855523893 >> 172.21.15.50:0/2855523893 conn(0x5562e6559100 msgr2=0x5562e6634a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:39.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.520+0000 7f6b2447bb80 1 -- 172.21.15.50:0/2855523893 shutdown_connections 2024-06-06T03:26:39.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.520+0000 7f6b2447bb80 1 -- 172.21.15.50:0/2855523893 wait complete. 2024-06-06T03:26:39.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.520+0000 7f6b2447bb80 1 -- start start 2024-06-06T03:26:39.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.521+0000 7f6b2447bb80 1 Processor -- start 2024-06-06T03:26:39.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.521+0000 7f6b2447bb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562e662c820 0x5562e663eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:39.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.521+0000 7f6b2447bb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562e6631fe0 0x5562e664d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:39.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.521+0000 7f6b2447bb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562e6632900 0x5562e664dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:39.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.521+0000 7f6b2447bb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6b141ac7f0 con 0x5562e6632900 2024-06-06T03:26:39.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.521+0000 7f6b2447bb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6b141adc60 con 0x5562e6631fe0 2024-06-06T03:26:39.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.521+0000 7f6b2447bb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6b141acec0 con 0x5562e662c820 2024-06-06T03:26:39.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.521+0000 7f6b2447bb80 10 client.0 _ll_register_callbacks cb 0x5562e6513630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:26:39.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.521+0000 7f6b13fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562e6632900 0x5562e664dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:39.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.521+0000 7f6b13fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562e6632900 0x5562e664dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52214/0 (socket says 172.21.15.50:52214) 2024-06-06T03:26:39.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.521+0000 7f6b13fff700 1 -- 172.21.15.50:0/1968476565 learned_addr learned my addr 172.21.15.50:0/1968476565 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:39.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.521+0000 7f6b12ffd700 1 --2- 172.21.15.50:0/1968476565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562e6631fe0 0x5562e664d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:39.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.521+0000 7f6b137fe700 1 --2- 172.21.15.50:0/1968476565 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562e662c820 0x5562e663eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:39.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.521+0000 7f6b13fff700 1 -- 172.21.15.50:0/1968476565 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562e662c820 msgr2=0x5562e663eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:39.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.521+0000 7f6b13fff700 1 --2- 172.21.15.50:0/1968476565 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562e662c820 0x5562e663eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.521+0000 7f6b13fff700 1 -- 172.21.15.50:0/1968476565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562e6631fe0 msgr2=0x5562e664d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:39.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.521+0000 7f6b13fff700 1 --2- 172.21.15.50:0/1968476565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562e6631fe0 0x5562e664d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.521+0000 7f6b13fff700 1 -- 172.21.15.50:0/1968476565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562e664e1e0 con 0x5562e6632900 2024-06-06T03:26:39.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.521+0000 7f6b137fe700 1 --2- 172.21.15.50:0/1968476565 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562e662c820 0x5562e663eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:26:39.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.521+0000 7f6b12ffd700 1 --2- 172.21.15.50:0/1968476565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562e6631fe0 0x5562e664d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:26:39.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.522+0000 7f6b13fff700 1 --2- 172.21.15.50:0/1968476565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562e6632900 0x5562e664dba0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c00b0d0 tx=0x7f6b0c007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105cd0233956658d server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:39.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.522+0000 7f6af2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:26:39.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.522+0000 7f6af2ffd700 1 -- 172.21.15.50:0/1968476565 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c035060 con 0x5562e6632900 2024-06-06T03:26:39.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.522+0000 7f6b2447bb80 1 -- 172.21.15.50:0/1968476565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b0c004bf0 con 0x5562e6632900 2024-06-06T03:26:39.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.522+0000 7f6af2ffd700 1 -- 172.21.15.50:0/1968476565 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f6b0c026930 con 0x5562e6632900 2024-06-06T03:26:39.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.522+0000 7f6af2ffd700 1 -- 172.21.15.50:0/1968476565 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6b0c02c050 con 0x5562e6632900 2024-06-06T03:26:39.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.522+0000 7f6b2447bb80 10 client.15321 fetch_fsmap learned FSMap version 27 2024-06-06T03:26:39.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.522+0000 7f6b2447bb80 1 -- 172.21.15.50:0/1968476565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5562e66b50b0 con 0x5562e6632900 2024-06-06T03:26:39.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.522+0000 7f6af2ffd700 1 -- 172.21.15.50:0/1968476565 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6b0c004bf0 con 0x5562e6632900 2024-06-06T03:26:39.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.522+0000 7f6af2ffd700 1 -- 172.21.15.50:0/1968476565 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6b0c011070 con 0x5562e6632900 2024-06-06T03:26:39.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.522+0000 7f6b2447bb80 10 client.15321 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:26:39.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.522+0000 7f6b2447bb80 10 client.15321 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:26:39.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.523+0000 7f6b2447bb80 20 client.15321 populate_metadata read hostname 'smithi050' 2024-06-06T03:26:39.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.523+0000 7f6b2447bb80 1 --2- 172.21.15.50:0/1968476565 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5562e66b56e0 0x5562e66b7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:39.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.523+0000 7f6b2447bb80 4 client.15321 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-06T03:26:39.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.523+0000 7f6b2447bb80 1 -- 172.21.15.50:0/1968476565 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5562e6585350 con 0x5562e66b56e0 2024-06-06T03:26:39.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.523+0000 7f6b137fe700 1 --2- 172.21.15.50:0/1968476565 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5562e66b56e0 0x5562e66b7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:39.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.523+0000 7f6b137fe700 1 --2- 172.21.15.50:0/1968476565 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5562e66b56e0 0x5562e66b7b00 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f0a5664a334c4d1 server_cookie=985c4efc471c7251 in_seq=0 out_seq=0 2024-06-06T03:26:39.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.523+0000 7f6af2ffd700 10 client.15321 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:26:39.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.524+0000 7f6af2ffd700 1 -- 172.21.15.50:0/1968476565 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5562e6585350 con 0x5562e66b56e0 2024-06-06T03:26:39.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.524+0000 7f6af2ffd700 10 client.15321 handle_command_reply: tid=0 2024-06-06T03:26:39.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.524+0000 7f6b2447bb80 1 client.15321 shutdown 2024-06-06T03:26:39.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.525+0000 7f6b2447bb80 1 -- 172.21.15.50:0/1968476565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562e6632900 msgr2=0x5562e664dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:39.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.525+0000 7f6b2447bb80 1 --2- 172.21.15.50:0/1968476565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562e6632900 0x5562e664dba0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c00b0d0 tx=0x7f6b0c007800 comp rx=0 tx=0).stop 2024-06-06T03:26:39.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.525+0000 7f6b2447bb80 1 -- 172.21.15.50:0/1968476565 shutdown_connections 2024-06-06T03:26:39.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.525+0000 7f6b2447bb80 1 --2- 172.21.15.50:0/1968476565 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5562e66b56e0 0x5562e66b7b00 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.525+0000 7f6b2447bb80 1 --2- 172.21.15.50:0/1968476565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562e6632900 0x5562e664dba0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.525+0000 7f6b2447bb80 1 --2- 172.21.15.50:0/1968476565 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562e662c820 0x5562e663eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.525+0000 7f6af2ffd700 0 client.15321 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:26:39.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.525+0000 7f6b2447bb80 1 --2- 172.21.15.50:0/1968476565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562e6631fe0 0x5562e664d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.525+0000 7f6b2447bb80 1 -- 172.21.15.50:0/1968476565 >> 172.21.15.50:0/1968476565 conn(0x5562e6559100 msgr2=0x5562e6635240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:39.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.525+0000 7f6b2447bb80 1 -- 172.21.15.50:0/1968476565 shutdown_connections 2024-06-06T03:26:39.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.525+0000 7f6b2447bb80 1 -- 172.21.15.50:0/1968476565 wait complete. 2024-06-06T03:26:39.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.525+0000 7f6b2447bb80 20 client.15321 trim_cache size 0 max 16384 2024-06-06T03:26:39.529 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:26:39.529 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-06-06T03:26:39.529 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "4ccb4d5c-61d0-4b15-a8ff-9cee2ab89956", 2024-06-06T03:26:39.529 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-06-06T03:26:39.529 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:26:39.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.526+0000 7f6b19bf8700 1 -- 172.21.15.50:0/2910851048 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6afc0a2c20 msgr2=0x7f6afc0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:39.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.526+0000 7f6b19bf8700 1 --2- 172.21.15.50:0/2910851048 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6afc0a2c20 0x7f6afc0a50e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6b04009cb0 tx=0x7f6b04009260 comp rx=0 tx=0).stop 2024-06-06T03:26:39.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.526+0000 7f6b19bf8700 1 -- 172.21.15.50:0/2910851048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b1406b830 msgr2=0x7f6b1419ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:39.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.526+0000 7f6b19bf8700 1 --2- 172.21.15.50:0/2910851048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b1406b830 0x7f6b1419ec00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6b0800e9a0 tx=0x7f6b0800ed60 comp rx=0 tx=0).stop 2024-06-06T03:26:39.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.526+0000 7f6b19bf8700 1 -- 172.21.15.50:0/2910851048 shutdown_connections 2024-06-06T03:26:39.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.526+0000 7f6b19bf8700 1 --2- 172.21.15.50:0/2910851048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b14107850 0x7f6b14198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.526+0000 7f6b19bf8700 1 --2- 172.21.15.50:0/2910851048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b1406ae80 0x7f6b1419e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.526+0000 7f6b19bf8700 1 --2- 172.21.15.50:0/2910851048 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6afc0a2c20 0x7f6afc0a50e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.526+0000 7f6b19bf8700 1 --2- 172.21.15.50:0/2910851048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b1406b830 0x7f6b1419ec00 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:39.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.526+0000 7f6b19bf8700 1 -- 172.21.15.50:0/2910851048 >> 172.21.15.50:0/2910851048 conn(0x7f6b14078400 msgr2=0x7f6b140ff4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:39.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.526+0000 7f6b19bf8700 1 -- 172.21.15.50:0/2910851048 shutdown_connections 2024-06-06T03:26:39.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:39.526+0000 7f6b19bf8700 1 -- 172.21.15.50:0/2910851048 wait complete. 2024-06-06T03:26:40.302 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-06T03:26:40.606 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:26:40.853 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:40 smithi050 ceph-mon[32421]: pgmap v432: 129 pgs: 129 active+clean; 653 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-06-06T03:26:40.853 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:40 smithi050 ceph-mon[32421]: scrub queued for path: / 2024-06-06T03:26:40.853 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:40 smithi050 ceph-mon[32421]: scrub summary: idle+waiting paths [/] 2024-06-06T03:26:40.853 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:40 smithi050 ceph-mon[32421]: scrub summary: active paths [/] 2024-06-06T03:26:40.853 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:40 smithi050 ceph-mon[32421]: scrub summary: idle+waiting paths [/] 2024-06-06T03:26:41.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:40 smithi079 ceph-mon[35478]: pgmap v432: 129 pgs: 129 active+clean; 653 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-06-06T03:26:41.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:40 smithi079 ceph-mon[35478]: scrub queued for path: / 2024-06-06T03:26:41.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:40 smithi079 ceph-mon[35478]: scrub summary: idle+waiting paths [/] 2024-06-06T03:26:41.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:40 smithi079 ceph-mon[35478]: scrub summary: active paths [/] 2024-06-06T03:26:41.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:40 smithi079 ceph-mon[35478]: scrub summary: idle+waiting paths [/] 2024-06-06T03:26:41.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:40 smithi122 ceph-mon[35759]: pgmap v432: 129 pgs: 129 active+clean; 653 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-06-06T03:26:41.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:40 smithi122 ceph-mon[35759]: scrub queued for path: / 2024-06-06T03:26:41.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:40 smithi122 ceph-mon[35759]: scrub summary: idle+waiting paths [/] 2024-06-06T03:26:41.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:40 smithi122 ceph-mon[35759]: scrub summary: active paths [/] 2024-06-06T03:26:41.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:40 smithi122 ceph-mon[35759]: scrub summary: idle+waiting paths [/] 2024-06-06T03:26:42.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.326+0000 7fb8a10a0700 1 -- 172.21.15.50:0/1451433011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb89c107400 msgr2=0x7fb89c1077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:42.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.326+0000 7fb8a10a0700 1 --2- 172.21.15.50:0/1451433011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb89c107400 0x7fb89c1077e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb88c00b0a0 tx=0x7fb88c00b3b0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.326+0000 7fb8a10a0700 1 -- 172.21.15.50:0/1451433011 shutdown_connections 2024-06-06T03:26:42.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.326+0000 7fb8a10a0700 1 --2- 172.21.15.50:0/1451433011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb89c101d50 0x7fb89c10e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.326+0000 7fb8a10a0700 1 --2- 172.21.15.50:0/1451433011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb89c107400 0x7fb89c1077e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.326+0000 7fb8a10a0700 1 --2- 172.21.15.50:0/1451433011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb89c101390 0x7fb89c101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.326+0000 7fb8a10a0700 1 -- 172.21.15.50:0/1451433011 >> 172.21.15.50:0/1451433011 conn(0x7fb89c078340 msgr2=0x7fb89c078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:42.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.326+0000 7fb8a10a0700 1 -- 172.21.15.50:0/1451433011 shutdown_connections 2024-06-06T03:26:42.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.326+0000 7fb8a10a0700 1 -- 172.21.15.50:0/1451433011 wait complete. 2024-06-06T03:26:42.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.327+0000 7fb8a10a0700 1 Processor -- start 2024-06-06T03:26:42.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.327+0000 7fb8a10a0700 1 -- start start 2024-06-06T03:26:42.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.328+0000 7fb8a10a0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb89c101390 0x7fb89c19e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:42.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.328+0000 7fb8a10a0700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb89c101d50 0x7fb89c19ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:42.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.328+0000 7fb8a10a0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb89c107400 0x7fb89c198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:42.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.328+0000 7fb8a10a0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb89c1115a0 con 0x7fb89c107400 2024-06-06T03:26:42.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.328+0000 7fb8a10a0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb89c111420 con 0x7fb89c101390 2024-06-06T03:26:42.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.328+0000 7fb8a10a0700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb89c111720 con 0x7fb89c101d50 2024-06-06T03:26:42.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.328+0000 7fb89b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb89c107400 0x7fb89c198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:42.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.328+0000 7fb89b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb89c107400 0x7fb89c198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52224/0 (socket says 172.21.15.50:52224) 2024-06-06T03:26:42.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.328+0000 7fb89b59e700 1 -- 172.21.15.50:0/307381351 learned_addr learned my addr 172.21.15.50:0/307381351 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:42.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.328+0000 7fb89ad9d700 1 --2- 172.21.15.50:0/307381351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb89c101390 0x7fb89c19e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:42.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.328+0000 7fb89a59c700 1 --2- 172.21.15.50:0/307381351 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb89c101d50 0x7fb89c19ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:42.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.328+0000 7fb89b59e700 1 -- 172.21.15.50:0/307381351 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb89c101d50 msgr2=0x7fb89c19ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:42.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.328+0000 7fb89b59e700 1 --2- 172.21.15.50:0/307381351 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb89c101d50 0x7fb89c19ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.328+0000 7fb89b59e700 1 -- 172.21.15.50:0/307381351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb89c101390 msgr2=0x7fb89c19e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:42.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.328+0000 7fb89b59e700 1 --2- 172.21.15.50:0/307381351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb89c101390 0x7fb89c19e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.328+0000 7fb89b59e700 1 -- 172.21.15.50:0/307381351 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb89c199170 con 0x7fb89c107400 2024-06-06T03:26:42.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.328+0000 7fb89a59c700 1 --2- 172.21.15.50:0/307381351 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb89c101d50 0x7fb89c19ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:26:42.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.328+0000 7fb89ad9d700 1 --2- 172.21.15.50:0/307381351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb89c101390 0x7fb89c19e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:26:42.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.328+0000 7fb89b59e700 1 --2- 172.21.15.50:0/307381351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb89c107400 0x7fb89c198a10 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb89400b550 tx=0x7fb89400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:42.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.328+0000 7fb893fff700 1 -- 172.21.15.50:0/307381351 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb894015020 con 0x7fb89c107400 2024-06-06T03:26:42.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.328+0000 7fb8a10a0700 1 -- 172.21.15.50:0/307381351 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb89c199460 con 0x7fb89c107400 2024-06-06T03:26:42.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.328+0000 7fb893fff700 1 -- 172.21.15.50:0/307381351 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb894011ce0 con 0x7fb89c107400 2024-06-06T03:26:42.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.329+0000 7fb893fff700 1 -- 172.21.15.50:0/307381351 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb894010cb0 con 0x7fb89c107400 2024-06-06T03:26:42.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.329+0000 7fb8a10a0700 1 -- 172.21.15.50:0/307381351 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb89c1a56d0 con 0x7fb89c107400 2024-06-06T03:26:42.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.331+0000 7fb893fff700 1 -- 172.21.15.50:0/307381351 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb894018020 con 0x7fb89c107400 2024-06-06T03:26:42.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.331+0000 7fb893fff700 1 --2- 172.21.15.50:0/307381351 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb8880a2c20 0x7fb8880a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:42.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.332+0000 7fb893fff700 1 -- 172.21.15.50:0/307381351 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fb8940cec30 con 0x7fb89c107400 2024-06-06T03:26:42.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.332+0000 7fb89ad9d700 1 --2- 172.21.15.50:0/307381351 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb8880a2c20 0x7fb8880a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:42.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.332+0000 7fb89ad9d700 1 --2- 172.21.15.50:0/307381351 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb8880a2c20 0x7fb8880a50e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb88c0062a0 tx=0x7fb88c006230 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:42.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.332+0000 7fb8ab923b80 1 Processor -- start 2024-06-06T03:26:42.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.332+0000 7fb8ab923b80 1 -- start start 2024-06-06T03:26:42.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.332+0000 7fb8ab923b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e04889640 0x558e04889a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:42.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.332+0000 7fb8ab923b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e04889f60 0x558e048839e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:42.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.332+0000 7fb8ab923b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e04883f20 0x558e04884340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:42.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.332+0000 7fb8ab923b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558e047d5810 con 0x558e04889640 2024-06-06T03:26:42.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.332+0000 7fb8ab923b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558e0477d720 con 0x558e04889f60 2024-06-06T03:26:42.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.332+0000 7fb8ab923b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558e047d17d0 con 0x558e04883f20 2024-06-06T03:26:42.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.333+0000 7fb89ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e04889640 0x558e04889a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:42.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.333+0000 7fb89ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e04889640 0x558e04889a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52234/0 (socket says 172.21.15.50:52234) 2024-06-06T03:26:42.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.333+0000 7fb89ad9d700 1 -- 172.21.15.50:0/3169052509 learned_addr learned my addr 172.21.15.50:0/3169052509 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:42.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.333+0000 7fb89a59c700 1 --2- 172.21.15.50:0/3169052509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e04889f60 0x558e048839e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:42.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.333+0000 7fb89b59e700 1 --2- 172.21.15.50:0/3169052509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e04883f20 0x558e04884340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:42.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.333+0000 7fb89ad9d700 1 -- 172.21.15.50:0/3169052509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e04883f20 msgr2=0x558e04884340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:42.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.333+0000 7fb89ad9d700 1 --2- 172.21.15.50:0/3169052509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e04883f20 0x558e04884340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.333+0000 7fb89ad9d700 1 -- 172.21.15.50:0/3169052509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e04889f60 msgr2=0x558e048839e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:42.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.333+0000 7fb89ad9d700 1 --2- 172.21.15.50:0/3169052509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e04889f60 0x558e048839e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.333+0000 7fb89ad9d700 1 -- 172.21.15.50:0/3169052509 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e04773f50 con 0x558e04889640 2024-06-06T03:26:42.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.333+0000 7fb89b59e700 1 --2- 172.21.15.50:0/3169052509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e04883f20 0x558e04884340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:26:42.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.333+0000 7fb89a59c700 1 --2- 172.21.15.50:0/3169052509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e04889f60 0x558e048839e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:26:42.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.333+0000 7fb89ad9d700 1 --2- 172.21.15.50:0/3169052509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e04889640 0x558e04889a20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb88c009d30 tx=0x7fb88c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a9e9241f6b7b5d server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:42.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.333+0000 7fb8917fa700 1 -- 172.21.15.50:0/3169052509 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb88c007cd0 con 0x558e04889640 2024-06-06T03:26:42.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.333+0000 7fb8917fa700 1 -- 172.21.15.50:0/3169052509 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb88c02d070 con 0x558e04889640 2024-06-06T03:26:42.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.333+0000 7fb8917fa700 1 -- 172.21.15.50:0/3169052509 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb88c005260 con 0x558e04889640 2024-06-06T03:26:42.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.334+0000 7fb8ab923b80 1 -- 172.21.15.50:0/3169052509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e04889640 msgr2=0x558e04889a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:42.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.334+0000 7fb8ab923b80 1 --2- 172.21.15.50:0/3169052509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e04889640 0x558e04889a20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb88c009d30 tx=0x7fb88c01c000 comp rx=0 tx=0).stop 2024-06-06T03:26:42.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.334+0000 7fb8ab923b80 1 -- 172.21.15.50:0/3169052509 shutdown_connections 2024-06-06T03:26:42.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.334+0000 7fb8ab923b80 1 --2- 172.21.15.50:0/3169052509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e04883f20 0x558e04884340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.334+0000 7fb8ab923b80 1 --2- 172.21.15.50:0/3169052509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e04889640 0x558e04889a20 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.334+0000 7fb8ab923b80 1 --2- 172.21.15.50:0/3169052509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e04889f60 0x558e048839e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.334+0000 7fb8ab923b80 1 -- 172.21.15.50:0/3169052509 >> 172.21.15.50:0/3169052509 conn(0x558e047aecc0 msgr2=0x558e0487e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:42.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.334+0000 7fb8ab923b80 1 -- 172.21.15.50:0/3169052509 shutdown_connections 2024-06-06T03:26:42.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.334+0000 7fb8ab923b80 1 -- 172.21.15.50:0/3169052509 wait complete. 2024-06-06T03:26:42.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.335+0000 7fb8ab923b80 1 -- start start 2024-06-06T03:26:42.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.335+0000 7fb8ab923b80 1 Processor -- start 2024-06-06T03:26:42.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.335+0000 7fb8ab923b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e04883f20 0x558e0488fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:42.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.335+0000 7fb8ab923b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e04889640 0x558e0488cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:42.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.335+0000 7fb8ab923b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e04889f60 0x558e0488d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:42.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.335+0000 7fb8ab923b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558e04890970 con 0x558e04883f20 2024-06-06T03:26:42.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.335+0000 7fb8ab923b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558e04775bf0 con 0x558e04889640 2024-06-06T03:26:42.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.335+0000 7fb8ab923b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558e04890af0 con 0x558e04889f60 2024-06-06T03:26:42.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.335+0000 7fb8ab923b80 10 client.0 _ll_register_callbacks cb 0x558e0476f920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:26:42.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.335+0000 7fb89ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e04883f20 0x558e0488fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:42.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.335+0000 7fb89ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e04883f20 0x558e0488fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52238/0 (socket says 172.21.15.50:52238) 2024-06-06T03:26:42.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.335+0000 7fb89ad9d700 1 -- 172.21.15.50:0/1142393788 learned_addr learned my addr 172.21.15.50:0/1142393788 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:42.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.335+0000 7fb89a59c700 1 --2- 172.21.15.50:0/1142393788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e04889640 0x558e0488cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:42.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.336+0000 7fb89b59e700 1 --2- 172.21.15.50:0/1142393788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e04889f60 0x558e0488d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:42.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.336+0000 7fb89a59c700 1 -- 172.21.15.50:0/1142393788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e04889f60 msgr2=0x558e0488d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:42.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.336+0000 7fb89a59c700 1 --2- 172.21.15.50:0/1142393788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e04889f60 0x558e0488d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.336+0000 7fb89a59c700 1 -- 172.21.15.50:0/1142393788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e04883f20 msgr2=0x558e0488fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:42.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.336+0000 7fb89a59c700 1 --2- 172.21.15.50:0/1142393788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e04883f20 0x558e0488fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.336+0000 7fb89a59c700 1 -- 172.21.15.50:0/1142393788 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e047248d0 con 0x558e04889640 2024-06-06T03:26:42.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.336+0000 7fb89b59e700 1 --2- 172.21.15.50:0/1142393788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e04889f60 0x558e0488d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:26:42.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.336+0000 7fb89ad9d700 1 --2- 172.21.15.50:0/1142393788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e04883f20 0x558e0488fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:26:42.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.336+0000 7fb89a59c700 1 --2- 172.21.15.50:0/1142393788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e04889640 0x558e0488cfd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb884005fd0 tx=0x7fb884010af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91af8ace70c82c2c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:42.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.336+0000 7fb8827fc700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:26:42.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.336+0000 7fb8827fc700 1 -- 172.21.15.50:0/1142393788 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb884004220 con 0x558e04889640 2024-06-06T03:26:42.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.336+0000 7fb8827fc700 1 -- 172.21.15.50:0/1142393788 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fb8840043c0 con 0x558e04889640 2024-06-06T03:26:42.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.336+0000 7fb8ab923b80 1 -- 172.21.15.50:0/1142393788 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb88c02d070 con 0x558e04889640 2024-06-06T03:26:42.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.336+0000 7fb8827fc700 1 -- 172.21.15.50:0/1142393788 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb884024050 con 0x558e04889640 2024-06-06T03:26:42.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.336+0000 7fb8ab923b80 10 client.24968 fetch_fsmap learned FSMap version 27 2024-06-06T03:26:42.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.337+0000 7fb8ab923b80 1 -- 172.21.15.50:0/1142393788 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558e0489f680 con 0x558e04889640 2024-06-06T03:26:42.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.337+0000 7fb8827fc700 1 -- 172.21.15.50:0/1142393788 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb88c02d070 con 0x558e04889640 2024-06-06T03:26:42.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.337+0000 7fb8827fc700 1 -- 172.21.15.50:0/1142393788 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fb884003aa0 con 0x558e04889640 2024-06-06T03:26:42.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.337+0000 7fb8ab923b80 10 client.24968 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:26:42.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.337+0000 7fb8ab923b80 10 client.24968 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:26:42.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.337+0000 7fb8ab923b80 20 client.24968 populate_metadata read hostname 'smithi050' 2024-06-06T03:26:42.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.337+0000 7fb8ab923b80 1 --2- 172.21.15.50:0/1142393788 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x558e048a1cc0 0x558e048a40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:42.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.337+0000 7fb8ab923b80 4 client.24968 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:26:42.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.337+0000 7fb8ab923b80 1 -- 172.21.15.50:0/1142393788 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e047e2d10 con 0x558e048a1cc0 2024-06-06T03:26:42.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.337+0000 7fb89ad9d700 1 --2- 172.21.15.50:0/1142393788 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x558e048a1cc0 0x558e048a40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:42.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.338+0000 7fb89ad9d700 1 --2- 172.21.15.50:0/1142393788 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x558e048a1cc0 0x558e048a40b0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b09ce3ef56003415 server_cookie=93df99522a19aaed in_seq=0 out_seq=0 2024-06-06T03:26:42.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.338+0000 7fb8827fc700 10 client.24968 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:26:42.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.338+0000 7fb8827fc700 1 -- 172.21.15.50:0/1142393788 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x558e047e2d10 con 0x558e048a1cc0 2024-06-06T03:26:42.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.338+0000 7fb8827fc700 10 client.24968 handle_command_reply: tid=0 2024-06-06T03:26:42.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.338+0000 7fb8ab923b80 1 client.24968 shutdown 2024-06-06T03:26:42.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.339+0000 7fb8ab923b80 1 -- 172.21.15.50:0/1142393788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e04889640 msgr2=0x558e0488cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:42.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.339+0000 7fb8ab923b80 1 --2- 172.21.15.50:0/1142393788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e04889640 0x558e0488cfd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb884005fd0 tx=0x7fb884010af0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.339+0000 7fb8ab923b80 1 -- 172.21.15.50:0/1142393788 shutdown_connections 2024-06-06T03:26:42.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.339+0000 7fb8ab923b80 1 --2- 172.21.15.50:0/1142393788 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x558e048a1cc0 0x558e048a40b0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.339+0000 7fb8ab923b80 1 --2- 172.21.15.50:0/1142393788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e04889f60 0x558e0488d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.339+0000 7fb8827fc700 0 client.24968 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:26:42.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.339+0000 7fb8ab923b80 1 --2- 172.21.15.50:0/1142393788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e04883f20 0x558e0488fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.339+0000 7fb8ab923b80 1 --2- 172.21.15.50:0/1142393788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e04889640 0x558e0488cfd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.339+0000 7fb8ab923b80 1 -- 172.21.15.50:0/1142393788 >> 172.21.15.50:0/1142393788 conn(0x558e047aecc0 msgr2=0x558e048829d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:42.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.339+0000 7fb8ab923b80 1 -- 172.21.15.50:0/1142393788 shutdown_connections 2024-06-06T03:26:42.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.339+0000 7fb8ab923b80 1 -- 172.21.15.50:0/1142393788 wait complete. 2024-06-06T03:26:42.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.339+0000 7fb8ab923b80 20 client.24968 trim_cache size 0 max 16384 2024-06-06T03:26:42.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.360+0000 7fb8ab923b80 1 Processor -- start 2024-06-06T03:26:42.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.360+0000 7fb8ab923b80 1 -- start start 2024-06-06T03:26:42.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.360+0000 7fb8ab923b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e04883f20 0x558e048839e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:42.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.360+0000 7fb8ab923b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e04889640 0x558e0488bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:42.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.360+0000 7fb8ab923b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e04889f60 0x558e0488aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:42.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.360+0000 7fb8ab923b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb89c1ae870 con 0x558e04889f60 2024-06-06T03:26:42.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.360+0000 7fb8ab923b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb89c1ac100 con 0x558e04883f20 2024-06-06T03:26:42.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.360+0000 7fb8ab923b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb89c1a9f70 con 0x558e04889640 2024-06-06T03:26:42.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.361+0000 7fb89b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e04889f60 0x558e0488aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:42.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.361+0000 7fb89b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e04889f60 0x558e0488aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52246/0 (socket says 172.21.15.50:52246) 2024-06-06T03:26:42.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.361+0000 7fb89b59e700 1 -- 172.21.15.50:0/3745498909 learned_addr learned my addr 172.21.15.50:0/3745498909 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:42.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.361+0000 7fb89ad9d700 1 --2- 172.21.15.50:0/3745498909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e04883f20 0x558e048839e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:42.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.361+0000 7fb89a59c700 1 --2- 172.21.15.50:0/3745498909 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e04889640 0x558e0488bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:42.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.361+0000 7fb89b59e700 1 -- 172.21.15.50:0/3745498909 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e04889640 msgr2=0x558e0488bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:42.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.361+0000 7fb89b59e700 1 --2- 172.21.15.50:0/3745498909 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e04889640 0x558e0488bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.361+0000 7fb89b59e700 1 -- 172.21.15.50:0/3745498909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e04883f20 msgr2=0x558e048839e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:42.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.361+0000 7fb89b59e700 1 --2- 172.21.15.50:0/3745498909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e04883f20 0x558e048839e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.361+0000 7fb89b59e700 1 -- 172.21.15.50:0/3745498909 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e0488cda0 con 0x558e04889f60 2024-06-06T03:26:42.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.361+0000 7fb89b59e700 1 --2- 172.21.15.50:0/3745498909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e04889f60 0x558e0488aa50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb894097a80 tx=0x7fb8940bb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ecab45f20eac60 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:42.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.361+0000 7fb890ff9700 1 -- 172.21.15.50:0/3745498909 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8940b4070 con 0x558e04889f60 2024-06-06T03:26:42.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.361+0000 7fb890ff9700 1 -- 172.21.15.50:0/3745498909 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb894009280 con 0x558e04889f60 2024-06-06T03:26:42.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.361+0000 7fb890ff9700 1 -- 172.21.15.50:0/3745498909 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89409f0d0 con 0x558e04889f60 2024-06-06T03:26:42.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.362+0000 7fb8ab923b80 1 -- 172.21.15.50:0/3745498909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e04889f60 msgr2=0x558e0488aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:42.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.362+0000 7fb8ab923b80 1 --2- 172.21.15.50:0/3745498909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e04889f60 0x558e0488aa50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb894097a80 tx=0x7fb8940bb040 comp rx=0 tx=0).stop 2024-06-06T03:26:42.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.362+0000 7fb8ab923b80 1 -- 172.21.15.50:0/3745498909 shutdown_connections 2024-06-06T03:26:42.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.362+0000 7fb8ab923b80 1 --2- 172.21.15.50:0/3745498909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e04889f60 0x558e0488aa50 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.362+0000 7fb8ab923b80 1 --2- 172.21.15.50:0/3745498909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e04883f20 0x558e048839e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.362+0000 7fb8ab923b80 1 --2- 172.21.15.50:0/3745498909 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e04889640 0x558e0488bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.362+0000 7fb8ab923b80 1 -- 172.21.15.50:0/3745498909 >> 172.21.15.50:0/3745498909 conn(0x558e047aecc0 msgr2=0x558e0488a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:42.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.362+0000 7fb8ab923b80 1 -- 172.21.15.50:0/3745498909 shutdown_connections 2024-06-06T03:26:42.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.362+0000 7fb8ab923b80 1 -- 172.21.15.50:0/3745498909 wait complete. 2024-06-06T03:26:42.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.363+0000 7fb8ab923b80 1 -- start start 2024-06-06T03:26:42.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.363+0000 7fb8ab923b80 1 Processor -- start 2024-06-06T03:26:42.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.363+0000 7fb8ab923b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e04883f20 0x558e0489a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:42.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.363+0000 7fb8ab923b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e04889640 0x558e0489a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:42.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.363+0000 7fb8ab923b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e04889f60 0x558e04897240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:42.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.363+0000 7fb8ab923b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb89c1aa5c0 con 0x558e04883f20 2024-06-06T03:26:42.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.363+0000 7fb8ab923b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb89c1aba30 con 0x558e04889640 2024-06-06T03:26:42.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.363+0000 7fb8ab923b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb89c1aac90 con 0x558e04889f60 2024-06-06T03:26:42.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.363+0000 7fb8ab923b80 10 client.0 _ll_register_callbacks cb 0x558e0476f920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:26:42.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.363+0000 7fb89ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e04883f20 0x558e0489a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:42.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.363+0000 7fb89ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e04883f20 0x558e0489a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52260/0 (socket says 172.21.15.50:52260) 2024-06-06T03:26:42.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.363+0000 7fb89b59e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e04889f60 0x558e04897240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:42.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.363+0000 7fb89ad9d700 1 -- 172.21.15.50:0/1822841187 learned_addr learned my addr 172.21.15.50:0/1822841187 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:42.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.363+0000 7fb89a59c700 1 --2- 172.21.15.50:0/1822841187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e04889640 0x558e0489a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:42.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.364+0000 7fb89ad9d700 1 -- 172.21.15.50:0/1822841187 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e04889f60 msgr2=0x558e04897240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:42.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.364+0000 7fb89ad9d700 1 --2- 172.21.15.50:0/1822841187 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e04889f60 0x558e04897240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.364+0000 7fb89ad9d700 1 -- 172.21.15.50:0/1822841187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e04889640 msgr2=0x558e0489a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:42.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.364+0000 7fb89ad9d700 1 --2- 172.21.15.50:0/1822841187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e04889640 0x558e0489a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.364+0000 7fb89ad9d700 1 -- 172.21.15.50:0/1822841187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e04897780 con 0x558e04883f20 2024-06-06T03:26:42.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.364+0000 7fb89ad9d700 1 --2- 172.21.15.50:0/1822841187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e04883f20 0x558e0489a270 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb88c00b0a0 tx=0x7fb88c009470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=351038522382f76e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:42.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.364+0000 7fb8827fc700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:26:42.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.364+0000 7fb8827fc700 1 -- 172.21.15.50:0/1822841187 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb88c028820 con 0x558e04883f20 2024-06-06T03:26:42.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.364+0000 7fb8ab923b80 1 -- 172.21.15.50:0/1822841187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb894009280 con 0x558e04883f20 2024-06-06T03:26:42.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.364+0000 7fb8827fc700 1 -- 172.21.15.50:0/1822841187 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fb88c0289c0 con 0x558e04883f20 2024-06-06T03:26:42.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.364+0000 7fb8827fc700 1 -- 172.21.15.50:0/1822841187 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb88c028bc0 con 0x558e04883f20 2024-06-06T03:26:42.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.364+0000 7fb8ab923b80 10 client.15339 fetch_fsmap learned FSMap version 27 2024-06-06T03:26:42.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.364+0000 7fb8ab923b80 1 -- 172.21.15.50:0/1822841187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558e0490d070 con 0x558e04883f20 2024-06-06T03:26:42.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.364+0000 7fb8827fc700 1 -- 172.21.15.50:0/1822841187 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb894009280 con 0x558e04883f20 2024-06-06T03:26:42.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.365+0000 7fb8827fc700 1 -- 172.21.15.50:0/1822841187 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fb88c011070 con 0x558e04883f20 2024-06-06T03:26:42.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.365+0000 7fb8ab923b80 10 client.15339 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:26:42.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.365+0000 7fb8ab923b80 10 client.15339 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:26:42.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.365+0000 7fb8ab923b80 20 client.15339 populate_metadata read hostname 'smithi050' 2024-06-06T03:26:42.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.365+0000 7fb8ab923b80 1 --2- 172.21.15.50:0/1822841187 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x558e048a1cc0 0x558e0490f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:42.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.365+0000 7fb8ab923b80 4 client.15339 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-06T03:26:42.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.365+0000 7fb8ab923b80 1 -- 172.21.15.50:0/1822841187 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558e047dd290 con 0x558e048a1cc0 2024-06-06T03:26:42.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.365+0000 7fb89a59c700 1 --2- 172.21.15.50:0/1822841187 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x558e048a1cc0 0x558e0490f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:42.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.365+0000 7fb8827fc700 10 client.15339 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:26:42.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.365+0000 7fb89a59c700 1 --2- 172.21.15.50:0/1822841187 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x558e048a1cc0 0x558e0490f2b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a62d7ba64f6e67a1 server_cookie=c4db4f8d2120940 in_seq=0 out_seq=0 2024-06-06T03:26:42.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.366+0000 7fb8827fc700 1 -- 172.21.15.50:0/1822841187 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x558e047dd290 con 0x558e048a1cc0 2024-06-06T03:26:42.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.366+0000 7fb8827fc700 10 client.15339 handle_command_reply: tid=0 2024-06-06T03:26:42.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.366+0000 7fb8ab923b80 1 client.15339 shutdown 2024-06-06T03:26:42.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.366+0000 7fb8ab923b80 1 -- 172.21.15.50:0/1822841187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e04883f20 msgr2=0x558e0489a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:42.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.366+0000 7fb8ab923b80 1 --2- 172.21.15.50:0/1822841187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e04883f20 0x558e0489a270 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb88c00b0a0 tx=0x7fb88c009470 comp rx=0 tx=0).stop 2024-06-06T03:26:42.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.366+0000 7fb8ab923b80 1 -- 172.21.15.50:0/1822841187 shutdown_connections 2024-06-06T03:26:42.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.366+0000 7fb8ab923b80 1 --2- 172.21.15.50:0/1822841187 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x558e048a1cc0 0x558e0490f2b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.366+0000 7fb8ab923b80 1 --2- 172.21.15.50:0/1822841187 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558e04889f60 0x558e04897240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.366+0000 7fb8ab923b80 1 --2- 172.21.15.50:0/1822841187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e04883f20 0x558e0489a270 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.366+0000 7fb8827fc700 0 client.15339 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:26:42.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.366+0000 7fb8ab923b80 1 --2- 172.21.15.50:0/1822841187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e04889640 0x558e0489a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.366+0000 7fb8ab923b80 1 -- 172.21.15.50:0/1822841187 >> 172.21.15.50:0/1822841187 conn(0x558e047aecc0 msgr2=0x558e0488a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:42.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.366+0000 7fb8ab923b80 1 -- 172.21.15.50:0/1822841187 shutdown_connections 2024-06-06T03:26:42.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.366+0000 7fb8ab923b80 1 -- 172.21.15.50:0/1822841187 wait complete. 2024-06-06T03:26:42.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.366+0000 7fb8ab923b80 20 client.15339 trim_cache size 0 max 16384 2024-06-06T03:26:42.373 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:26:42.373 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-06T03:26:42.373 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2024-06-06T03:26:42.373 INFO:teuthology.orchestra.run.smithi050.stdout: "4ccb4d5c-61d0-4b15-a8ff-9cee2ab89956": { 2024-06-06T03:26:42.373 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2024-06-06T03:26:42.373 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "4ccb4d5c-61d0-4b15-a8ff-9cee2ab89956", 2024-06-06T03:26:42.374 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "recursive,force" 2024-06-06T03:26:42.374 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:26:42.374 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:26:42.374 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:26:42.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.367+0000 7fb8a10a0700 1 -- 172.21.15.50:0/307381351 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb8880a2c20 msgr2=0x7fb8880a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:42.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.367+0000 7fb8a10a0700 1 --2- 172.21.15.50:0/307381351 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb8880a2c20 0x7fb8880a50e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb88c0062a0 tx=0x7fb88c006230 comp rx=0 tx=0).stop 2024-06-06T03:26:42.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.367+0000 7fb8a10a0700 1 -- 172.21.15.50:0/307381351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb89c107400 msgr2=0x7fb89c198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:42.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.367+0000 7fb8a10a0700 1 --2- 172.21.15.50:0/307381351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb89c107400 0x7fb89c198a10 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb89400b550 tx=0x7fb89400b910 comp rx=0 tx=0).stop 2024-06-06T03:26:42.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.367+0000 7fb8a10a0700 1 -- 172.21.15.50:0/307381351 shutdown_connections 2024-06-06T03:26:42.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.367+0000 7fb8a10a0700 1 --2- 172.21.15.50:0/307381351 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb8880a2c20 0x7fb8880a50e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.367+0000 7fb8a10a0700 1 --2- 172.21.15.50:0/307381351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb89c107400 0x7fb89c198a10 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.367+0000 7fb8a10a0700 1 --2- 172.21.15.50:0/307381351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb89c101390 0x7fb89c19e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.367+0000 7fb8a10a0700 1 --2- 172.21.15.50:0/307381351 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb89c101d50 0x7fb89c19ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:42.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.367+0000 7fb8a10a0700 1 -- 172.21.15.50:0/307381351 >> 172.21.15.50:0/307381351 conn(0x7fb89c078340 msgr2=0x7fb89c100730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:42.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.367+0000 7fb8a10a0700 1 -- 172.21.15.50:0/307381351 shutdown_connections 2024-06-06T03:26:42.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:26:42.367+0000 7fb8a10a0700 1 -- 172.21.15.50:0/307381351 wait complete. 2024-06-06T03:26:43.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:42 smithi050 ceph-mon[32421]: pgmap v433: 129 pgs: 129 active+clean; 653 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 5 op/s 2024-06-06T03:26:43.084 INFO:tasks.cephfs.filesystem:scrub status for tag:4ccb4d5c-61d0-4b15-a8ff-9cee2ab89956 - {'path': '/', 'tag': '4ccb4d5c-61d0-4b15-a8ff-9cee2ab89956', 'options': 'recursive,force'} 2024-06-06T03:26:43.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:42 smithi079 ceph-mon[35478]: pgmap v433: 129 pgs: 129 active+clean; 653 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 5 op/s 2024-06-06T03:26:43.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:42 smithi122 ceph-mon[35759]: pgmap v433: 129 pgs: 129 active+clean; 653 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 5 op/s 2024-06-06T03:26:45.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:44 smithi050 ceph-mon[32421]: pgmap v434: 129 pgs: 129 active+clean; 653 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 5 op/s 2024-06-06T03:26:45.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:44 smithi079 ceph-mon[35478]: pgmap v434: 129 pgs: 129 active+clean; 653 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 5 op/s 2024-06-06T03:26:45.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:44 smithi122 ceph-mon[35759]: pgmap v434: 129 pgs: 129 active+clean; 653 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 5 op/s 2024-06-06T03:26:47.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:46 smithi050 ceph-mon[32421]: pgmap v435: 129 pgs: 129 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 7 op/s 2024-06-06T03:26:47.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:46 smithi079 ceph-mon[35478]: pgmap v435: 129 pgs: 129 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 7 op/s 2024-06-06T03:26:47.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:46 smithi122 ceph-mon[35759]: pgmap v435: 129 pgs: 129 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 7 op/s 2024-06-06T03:26:49.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:48 smithi050 ceph-mon[32421]: pgmap v436: 129 pgs: 129 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 5 op/s 2024-06-06T03:26:49.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:48 smithi079 ceph-mon[35478]: pgmap v436: 129 pgs: 129 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 5 op/s 2024-06-06T03:26:49.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:48 smithi122 ceph-mon[35759]: pgmap v436: 129 pgs: 129 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 5 op/s 2024-06-06T03:26:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.601+0000 7fe77a309640 1 -- 172.21.15.50:0/2928418261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe774101a00 msgr2=0x7fe774101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.601+0000 7fe77a309640 1 --2- 172.21.15.50:0/2928418261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe774101a00 0x7fe774101e20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe764009900 tx=0x7fe76402a410 comp rx=0 tx=0).stop 2024-06-06T03:26:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.602+0000 7fe77a309640 1 -- 172.21.15.50:0/2928418261 shutdown_connections 2024-06-06T03:26:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.602+0000 7fe77a309640 1 --2- 172.21.15.50:0/2928418261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7741035b0 0x7fe774109e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.602+0000 7fe77a309640 1 --2- 172.21.15.50:0/2928418261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe774102bf0 0x7fe774103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.602+0000 7fe77a309640 1 --2- 172.21.15.50:0/2928418261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe774101a00 0x7fe774101e20 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.602+0000 7fe77a309640 1 -- 172.21.15.50:0/2928418261 >> 172.21.15.50:0/2928418261 conn(0x7fe7740fcf90 msgr2=0x7fe7740ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.602+0000 7fe77a309640 1 -- 172.21.15.50:0/2928418261 shutdown_connections 2024-06-06T03:26:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.602+0000 7fe77a309640 1 -- 172.21.15.50:0/2928418261 wait complete. 2024-06-06T03:26:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.602+0000 7fe77a309640 1 Processor -- start 2024-06-06T03:26:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.602+0000 7fe77a309640 1 -- start start 2024-06-06T03:26:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.603+0000 7fe77a309640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe774101a00 0x7fe774197b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.603+0000 7fe77a309640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe774102bf0 0x7fe7741980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.603+0000 7fe77a309640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7741035b0 0x7fe77419f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.603+0000 7fe77a309640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe77410d500 con 0x7fe774101a00 2024-06-06T03:26:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.603+0000 7fe77a309640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe77410d380 con 0x7fe774102bf0 2024-06-06T03:26:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.603+0000 7fe77a309640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe77410d680 con 0x7fe7741035b0 2024-06-06T03:26:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.603+0000 7fe773fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe774101a00 0x7fe774197b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.603+0000 7fe773fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe774101a00 0x7fe774197b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53722/0 (socket says 172.21.15.50:53722) 2024-06-06T03:26:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.603+0000 7fe773fff640 1 -- 172.21.15.50:0/2294952833 learned_addr learned my addr 172.21.15.50:0/2294952833 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.603+0000 7fe7737fe640 1 --2- 172.21.15.50:0/2294952833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe774102bf0 0x7fe7741980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.603+0000 7fe773fff640 1 -- 172.21.15.50:0/2294952833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7741035b0 msgr2=0x7fe77419f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.603+0000 7fe773fff640 1 --2- 172.21.15.50:0/2294952833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7741035b0 0x7fe77419f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.603+0000 7fe773fff640 1 -- 172.21.15.50:0/2294952833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe774102bf0 msgr2=0x7fe7741980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.603+0000 7fe773fff640 1 --2- 172.21.15.50:0/2294952833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe774102bf0 0x7fe7741980b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.603+0000 7fe773fff640 1 -- 172.21.15.50:0/2294952833 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe77419f790 con 0x7fe774101a00 2024-06-06T03:26:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.603+0000 7fe773fff640 1 --2- 172.21.15.50:0/2294952833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe774101a00 0x7fe774197b70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe7640314e0 tx=0x7fe764031a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:50.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.604+0000 7fe7717fa640 1 -- 172.21.15.50:0/2294952833 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76403f030 con 0x7fe774101a00 2024-06-06T03:26:50.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.604+0000 7fe7717fa640 1 -- 172.21.15.50:0/2294952833 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe7640044b0 con 0x7fe774101a00 2024-06-06T03:26:50.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.604+0000 7fe7717fa640 1 -- 172.21.15.50:0/2294952833 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe764035070 con 0x7fe774101a00 2024-06-06T03:26:50.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.604+0000 7fe77a309640 1 -- 172.21.15.50:0/2294952833 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe77419fa20 con 0x7fe774101a00 2024-06-06T03:26:50.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.604+0000 7fe77a309640 1 -- 172.21.15.50:0/2294952833 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe77419fec0 con 0x7fe774101a00 2024-06-06T03:26:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.607+0000 7fe7717fa640 1 -- 172.21.15.50:0/2294952833 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe764042030 con 0x7fe774101a00 2024-06-06T03:26:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.607+0000 7fe77d013740 1 Processor -- start 2024-06-06T03:26:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.607+0000 7fe77d013740 1 -- start start 2024-06-06T03:26:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.607+0000 7fe77d013740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d94b6420 0x5610d94b6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.607+0000 7fe77d013740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610d94b6e10 0x5610d94bb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.607+0000 7fe77d013740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5610d94bbf80 0x5610d94be410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.607+0000 7fe77d013740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5610d94154f0 con 0x5610d94b6420 2024-06-06T03:26:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.607+0000 7fe77d013740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5610d93b3870 con 0x5610d94b6e10 2024-06-06T03:26:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.607+0000 7fe77d013740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5610d94114b0 con 0x5610d94bbf80 2024-06-06T03:26:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.607+0000 7fe7788a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d94b6420 0x5610d94b6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.607+0000 7fe7788a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d94b6420 0x5610d94b6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53732/0 (socket says 172.21.15.50:53732) 2024-06-06T03:26:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.607+0000 7fe7788a6640 1 -- 172.21.15.50:0/2784196685 learned_addr learned my addr 172.21.15.50:0/2784196685 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.608+0000 7fe7737fe640 1 --2- 172.21.15.50:0/2784196685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5610d94bbf80 0x5610d94be410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.608+0000 7fe773fff640 1 --2- 172.21.15.50:0/2784196685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610d94b6e10 0x5610d94bb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.608+0000 7fe7788a6640 1 -- 172.21.15.50:0/2784196685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5610d94bbf80 msgr2=0x5610d94be410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.608+0000 7fe7788a6640 1 --2- 172.21.15.50:0/2784196685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5610d94bbf80 0x5610d94be410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.608+0000 7fe7788a6640 1 -- 172.21.15.50:0/2784196685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610d94b6e10 msgr2=0x5610d94bb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.608+0000 7fe7788a6640 1 --2- 172.21.15.50:0/2784196685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610d94b6e10 0x5610d94bb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.608+0000 7fe7788a6640 1 -- 172.21.15.50:0/2784196685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610d93cf9b0 con 0x5610d94b6420 2024-06-06T03:26:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.608+0000 7fe7717fa640 1 --2- 172.21.15.50:0/2294952833 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe75c0a2cb0 0x7fe75c0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.608+0000 7fe7737fe640 1 --2- 172.21.15.50:0/2784196685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5610d94bbf80 0x5610d94be410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:26:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.608+0000 7fe773fff640 1 --2- 172.21.15.50:0/2294952833 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe75c0a2cb0 0x7fe75c0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.608+0000 7fe7788a6640 1 --2- 172.21.15.50:0/2784196685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d94b6420 0x5610d94b6840 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe76c009d80 tx=0x7fe76c00e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62537da7a570b605 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.608+0000 7fe7717fa640 1 -- 172.21.15.50:0/2294952833 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fe7640ef990 con 0x7fe774101a00 2024-06-06T03:26:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.608+0000 7fe75a7fc640 1 -- 172.21.15.50:0/2784196685 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76c016070 con 0x5610d94b6420 2024-06-06T03:26:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.608+0000 7fe75a7fc640 1 -- 172.21.15.50:0/2784196685 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe76c005020 con 0x5610d94b6420 2024-06-06T03:26:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.608+0000 7fe75a7fc640 1 -- 172.21.15.50:0/2784196685 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76c0116d0 con 0x5610d94b6420 2024-06-06T03:26:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.609+0000 7fe77d013740 1 -- 172.21.15.50:0/2784196685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d94b6420 msgr2=0x5610d94b6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.609+0000 7fe773fff640 1 --2- 172.21.15.50:0/2294952833 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe75c0a2cb0 0x7fe75c0a5170 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe7640ed480 tx=0x7fe764039f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.609+0000 7fe77d013740 1 --2- 172.21.15.50:0/2784196685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d94b6420 0x5610d94b6840 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe76c009d80 tx=0x7fe76c00e6c0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.609+0000 7fe77d013740 1 -- 172.21.15.50:0/2784196685 shutdown_connections 2024-06-06T03:26:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.609+0000 7fe77d013740 1 --2- 172.21.15.50:0/2784196685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5610d94bbf80 0x5610d94be410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.609+0000 7fe77d013740 1 --2- 172.21.15.50:0/2784196685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610d94b6e10 0x5610d94bb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.609+0000 7fe77d013740 1 --2- 172.21.15.50:0/2784196685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d94b6420 0x5610d94b6840 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.609+0000 7fe77d013740 1 -- 172.21.15.50:0/2784196685 >> 172.21.15.50:0/2784196685 conn(0x5610d94ad680 msgr2=0x5610d94ada80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.609+0000 7fe77d013740 1 -- 172.21.15.50:0/2784196685 shutdown_connections 2024-06-06T03:26:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.609+0000 7fe77d013740 1 -- 172.21.15.50:0/2784196685 wait complete. 2024-06-06T03:26:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.609+0000 7fe77d013740 1 -- start start 2024-06-06T03:26:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.610+0000 7fe77d013740 1 Processor -- start 2024-06-06T03:26:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.610+0000 7fe77d013740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5610d94b6420 0x5610d94c0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.610+0000 7fe77d013740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d94b6e10 0x5610d94c0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.610+0000 7fe77d013740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610d94bbf80 0x5610d94c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.610+0000 7fe77d013740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5610d94bef30 con 0x5610d94b6e10 2024-06-06T03:26:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.610+0000 7fe77d013740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5610d939eae0 con 0x5610d94bbf80 2024-06-06T03:26:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.610+0000 7fe77d013740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5610d94bf0b0 con 0x5610d94b6420 2024-06-06T03:26:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.610+0000 7fe77d013740 10 client.0 _ll_register_callbacks cb 0x5610d93d79b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:26:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.610+0000 7fe7737fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d94b6e10 0x5610d94c0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.610+0000 7fe7737fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d94b6e10 0x5610d94c0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53742/0 (socket says 172.21.15.50:53742) 2024-06-06T03:26:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.610+0000 7fe7737fe640 1 -- 172.21.15.50:0/287941659 learned_addr learned my addr 172.21.15.50:0/287941659 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:50.618 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.610+0000 7fe7788a6640 1 --2- 172.21.15.50:0/287941659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610d94bbf80 0x5610d94c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:50.618 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.610+0000 7fe7788a6640 1 --2- 172.21.15.50:0/287941659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5610d94b6420 0x5610d94c0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:50.618 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.610+0000 7fe7737fe640 1 -- 172.21.15.50:0/287941659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5610d94b6420 msgr2=0x5610d94c0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:50.618 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.610+0000 7fe7737fe640 1 --2- 172.21.15.50:0/287941659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5610d94b6420 0x5610d94c0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.618 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.610+0000 7fe7737fe640 1 -- 172.21.15.50:0/287941659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610d94bbf80 msgr2=0x5610d94c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:50.618 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.610+0000 7fe7737fe640 1 --2- 172.21.15.50:0/287941659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610d94bbf80 0x5610d94c7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.618 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.610+0000 7fe7737fe640 1 -- 172.21.15.50:0/287941659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610d9129210 con 0x5610d94b6e10 2024-06-06T03:26:50.618 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.611+0000 7fe7737fe640 1 --2- 172.21.15.50:0/287941659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d94b6e10 0x5610d94c0bb0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe7680124a0 tx=0x7fe768012960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab49c3b042aba78 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:50.618 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.611+0000 7fe7537fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:26:50.618 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.611+0000 7fe7537fe640 1 -- 172.21.15.50:0/287941659 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe768004220 con 0x5610d94b6e10 2024-06-06T03:26:50.618 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.611+0000 7fe7537fe640 1 -- 172.21.15.50:0/287941659 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fe7680043c0 con 0x5610d94b6e10 2024-06-06T03:26:50.618 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.611+0000 7fe77d013740 1 -- 172.21.15.50:0/287941659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe76c005020 con 0x5610d94b6e10 2024-06-06T03:26:50.618 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.611+0000 7fe7537fe640 1 -- 172.21.15.50:0/287941659 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe7680106c0 con 0x5610d94b6e10 2024-06-06T03:26:50.619 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.611+0000 7fe77d013740 10 client.15351 fetch_fsmap learned FSMap version 27 2024-06-06T03:26:50.619 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.611+0000 7fe77d013740 1 -- 172.21.15.50:0/287941659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5610d91f5620 con 0x5610d94b6e10 2024-06-06T03:26:50.619 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.611+0000 7fe7537fe640 1 -- 172.21.15.50:0/287941659 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe76c005020 con 0x5610d94b6e10 2024-06-06T03:26:50.619 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.611+0000 7fe7537fe640 1 -- 172.21.15.50:0/287941659 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fe76800f040 con 0x5610d94b6e10 2024-06-06T03:26:50.619 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.611+0000 7fe77d013740 10 client.15351 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:26:50.619 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.611+0000 7fe77d013740 10 client.15351 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:26:50.619 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.611+0000 7fe77d013740 20 client.15351 populate_metadata read hostname 'smithi050' 2024-06-06T03:26:50.619 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.611+0000 7fe77d013740 1 --2- 172.21.15.50:0/287941659 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5610d94cc5f0 0x5610d94cea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:50.619 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.611+0000 7fe77d013740 4 client.15351 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:26:50.619 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.611+0000 7fe77d013740 1 -- 172.21.15.50:0/287941659 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5610d9428f10 con 0x5610d94cc5f0 2024-06-06T03:26:50.619 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.612+0000 7fe7788a6640 1 --2- 172.21.15.50:0/287941659 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5610d94cc5f0 0x5610d94cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:50.619 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.612+0000 7fe7537fe640 10 client.15351 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:26:50.619 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.612+0000 7fe7788a6640 1 --2- 172.21.15.50:0/287941659 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5610d94cc5f0 0x5610d94cea10 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc970d710f8e6a12 server_cookie=5b1c78ebe81d1c46 in_seq=0 out_seq=0 2024-06-06T03:26:50.620 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.613+0000 7fe7537fe640 1 -- 172.21.15.50:0/287941659 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5610d9428f10 con 0x5610d94cc5f0 2024-06-06T03:26:50.620 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.613+0000 7fe7537fe640 10 client.15351 handle_command_reply: tid=0 2024-06-06T03:26:50.620 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.613+0000 7fe77d013740 1 client.15351 shutdown 2024-06-06T03:26:50.620 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.613+0000 7fe77d013740 1 -- 172.21.15.50:0/287941659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d94b6e10 msgr2=0x5610d94c0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:50.620 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.613+0000 7fe77d013740 1 --2- 172.21.15.50:0/287941659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d94b6e10 0x5610d94c0bb0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe7680124a0 tx=0x7fe768012960 comp rx=0 tx=0).stop 2024-06-06T03:26:50.620 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.613+0000 7fe77d013740 1 -- 172.21.15.50:0/287941659 shutdown_connections 2024-06-06T03:26:50.620 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.613+0000 7fe77d013740 1 --2- 172.21.15.50:0/287941659 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5610d94cc5f0 0x5610d94cea10 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.620 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.613+0000 7fe77d013740 1 --2- 172.21.15.50:0/287941659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d94b6e10 0x5610d94c0bb0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.620 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.613+0000 7fe77d013740 1 --2- 172.21.15.50:0/287941659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610d94bbf80 0x5610d94c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.620 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.613+0000 7fe7537fe640 0 client.15351 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:26:50.620 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.613+0000 7fe77d013740 1 --2- 172.21.15.50:0/287941659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5610d94b6420 0x5610d94c0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.621 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.613+0000 7fe77d013740 1 -- 172.21.15.50:0/287941659 >> 172.21.15.50:0/287941659 conn(0x5610d94ad680 msgr2=0x5610d94ac7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:50.621 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.613+0000 7fe77d013740 1 -- 172.21.15.50:0/287941659 shutdown_connections 2024-06-06T03:26:50.621 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.613+0000 7fe77d013740 1 -- 172.21.15.50:0/287941659 wait complete. 2024-06-06T03:26:50.621 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.613+0000 7fe77d013740 20 client.15351 trim_cache size 0 max 16384 2024-06-06T03:26:50.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.629+0000 7fe77d013740 1 Processor -- start 2024-06-06T03:26:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.629+0000 7fe77d013740 1 -- start start 2024-06-06T03:26:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.629+0000 7fe77d013740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5610d94b6420 0x5610d94c0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.629+0000 7fe77d013740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610d94b6e10 0x5610d94c0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.629+0000 7fe77d013740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d94bbf80 0x5610d94c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.629+0000 7fe77d013740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe7741aab10 con 0x5610d94bbf80 2024-06-06T03:26:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.629+0000 7fe77d013740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe7741a83e0 con 0x5610d94b6e10 2024-06-06T03:26:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.629+0000 7fe77d013740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe7741a6230 con 0x5610d94b6420 2024-06-06T03:26:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.629+0000 7fe7788a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d94bbf80 0x5610d94c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.629+0000 7fe7788a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d94bbf80 0x5610d94c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53754/0 (socket says 172.21.15.50:53754) 2024-06-06T03:26:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.629+0000 7fe7788a6640 1 -- 172.21.15.50:0/475924239 learned_addr learned my addr 172.21.15.50:0/475924239 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:50.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.629+0000 7fe7737fe640 1 --2- 172.21.15.50:0/475924239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610d94b6e10 0x5610d94c0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:50.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.629+0000 7fe7788a6640 1 --2- 172.21.15.50:0/475924239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5610d94b6420 0x5610d94c0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:50.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.629+0000 7fe7788a6640 1 -- 172.21.15.50:0/475924239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5610d94b6420 msgr2=0x5610d94c0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:50.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.629+0000 7fe7788a6640 1 --2- 172.21.15.50:0/475924239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5610d94b6420 0x5610d94c0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.629+0000 7fe7788a6640 1 -- 172.21.15.50:0/475924239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610d94b6e10 msgr2=0x5610d94c0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:50.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.629+0000 7fe7788a6640 1 --2- 172.21.15.50:0/475924239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610d94b6e10 0x5610d94c0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.629+0000 7fe7788a6640 1 -- 172.21.15.50:0/475924239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610d94b76a0 con 0x5610d94bbf80 2024-06-06T03:26:50.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.630+0000 7fe7788a6640 1 --2- 172.21.15.50:0/475924239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d94bbf80 0x5610d94c7bb0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe76c00e700 tx=0x7fe76c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e8d48a3c1035ccf server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:50.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.630+0000 7fe759ffb640 1 -- 172.21.15.50:0/475924239 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76c016040 con 0x5610d94bbf80 2024-06-06T03:26:50.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.630+0000 7fe759ffb640 1 -- 172.21.15.50:0/475924239 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe76c004040 con 0x5610d94bbf80 2024-06-06T03:26:50.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.630+0000 7fe759ffb640 1 -- 172.21.15.50:0/475924239 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76c02a350 con 0x5610d94bbf80 2024-06-06T03:26:50.636 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.630+0000 7fe77d013740 1 -- 172.21.15.50:0/475924239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d94bbf80 msgr2=0x5610d94c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:50.637 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.630+0000 7fe77d013740 1 --2- 172.21.15.50:0/475924239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d94bbf80 0x5610d94c7bb0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe76c00e700 tx=0x7fe76c009f90 comp rx=0 tx=0).stop 2024-06-06T03:26:50.637 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.630+0000 7fe77d013740 1 -- 172.21.15.50:0/475924239 shutdown_connections 2024-06-06T03:26:50.637 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.630+0000 7fe77d013740 1 --2- 172.21.15.50:0/475924239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d94bbf80 0x5610d94c7bb0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.637 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.630+0000 7fe77d013740 1 --2- 172.21.15.50:0/475924239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610d94b6e10 0x5610d94c0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.637 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.630+0000 7fe77d013740 1 --2- 172.21.15.50:0/475924239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5610d94b6420 0x5610d94c0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.637 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.630+0000 7fe77d013740 1 -- 172.21.15.50:0/475924239 >> 172.21.15.50:0/475924239 conn(0x5610d94ad680 msgr2=0x5610d94bb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:50.637 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.630+0000 7fe77d013740 1 -- 172.21.15.50:0/475924239 shutdown_connections 2024-06-06T03:26:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.631+0000 7fe77d013740 1 -- 172.21.15.50:0/475924239 wait complete. 2024-06-06T03:26:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.631+0000 7fe77d013740 1 -- start start 2024-06-06T03:26:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.631+0000 7fe77d013740 1 Processor -- start 2024-06-06T03:26:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.631+0000 7fe77d013740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5610d94b6420 0x5610d94c4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.631+0000 7fe77d013740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d94b6e10 0x5610d94c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.631+0000 7fe77d013740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610d94bbf80 0x5610d95352e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.631+0000 7fe77d013740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe7741a68a0 con 0x5610d94b6e10 2024-06-06T03:26:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.631+0000 7fe77d013740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe7741a7d10 con 0x5610d94bbf80 2024-06-06T03:26:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.631+0000 7fe77d013740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe7741a6f70 con 0x5610d94b6420 2024-06-06T03:26:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.631+0000 7fe77d013740 10 client.0 _ll_register_callbacks cb 0x7fe768009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:26:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.631+0000 7fe7737fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d94b6e10 0x5610d94c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.631+0000 7fe7737fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d94b6e10 0x5610d94c4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53766/0 (socket says 172.21.15.50:53766) 2024-06-06T03:26:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.631+0000 7fe7737fe640 1 -- 172.21.15.50:0/2993523020 learned_addr learned my addr 172.21.15.50:0/2993523020 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:26:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.632+0000 7fe7788a6640 1 --2- 172.21.15.50:0/2993523020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610d94bbf80 0x5610d95352e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.632+0000 7fe7788a6640 1 --2- 172.21.15.50:0/2993523020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5610d94b6420 0x5610d94c4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.632+0000 7fe7737fe640 1 -- 172.21.15.50:0/2993523020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5610d94b6420 msgr2=0x5610d94c4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.632+0000 7fe7737fe640 1 --2- 172.21.15.50:0/2993523020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5610d94b6420 0x5610d94c4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.632+0000 7fe7737fe640 1 -- 172.21.15.50:0/2993523020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610d94bbf80 msgr2=0x5610d95352e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:26:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.632+0000 7fe7737fe640 1 --2- 172.21.15.50:0/2993523020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610d94bbf80 0x5610d95352e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.632+0000 7fe7737fe640 1 -- 172.21.15.50:0/2993523020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610d9535820 con 0x5610d94b6e10 2024-06-06T03:26:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.632+0000 7fe7788a6640 1 --2- 172.21.15.50:0/2993523020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5610d94b6420 0x5610d94c4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:26:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.632+0000 7fe7737fe640 1 --2- 172.21.15.50:0/2993523020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d94b6e10 0x5610d94c4f40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x5610d94c1b50 tx=0x7fe768004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=933fb27ea8c2b6a6 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:26:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.632+0000 7fe7537fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:26:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.632+0000 7fe7537fe640 1 -- 172.21.15.50:0/2993523020 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe768012e60 con 0x5610d94b6e10 2024-06-06T03:26:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.632+0000 7fe7537fe640 1 -- 172.21.15.50:0/2993523020 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fe768010c70 con 0x5610d94b6e10 2024-06-06T03:26:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.632+0000 7fe77d013740 1 -- 172.21.15.50:0/2993523020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe76c004040 con 0x5610d94b6e10 2024-06-06T03:26:50.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.632+0000 7fe7537fe640 1 -- 172.21.15.50:0/2993523020 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe768004480 con 0x5610d94b6e10 2024-06-06T03:26:50.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.632+0000 7fe77d013740 10 client.15357 fetch_fsmap learned FSMap version 27 2024-06-06T03:26:50.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.632+0000 7fe77d013740 1 -- 172.21.15.50:0/2993523020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5610d9536a60 con 0x5610d94b6e10 2024-06-06T03:26:50.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.632+0000 7fe7537fe640 1 -- 172.21.15.50:0/2993523020 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe76c004040 con 0x5610d94b6e10 2024-06-06T03:26:50.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.633+0000 7fe7537fe640 1 -- 172.21.15.50:0/2993523020 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fe76802a5e0 con 0x5610d94b6e10 2024-06-06T03:26:50.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.633+0000 7fe77d013740 10 client.15357 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:26:50.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.633+0000 7fe77d013740 10 client.15357 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:26:50.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.633+0000 7fe77d013740 20 client.15357 populate_metadata read hostname 'smithi050' 2024-06-06T03:26:50.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.633+0000 7fe77d013740 1 --2- 172.21.15.50:0/2993523020 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5610d95374c0 0x5610d95398e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:26:50.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.633+0000 7fe77d013740 4 client.15357 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:26:50.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.633+0000 7fe77d013740 1 -- 172.21.15.50:0/2993523020 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5610d9422c20 con 0x5610d95374c0 2024-06-06T03:26:50.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.633+0000 7fe7788a6640 1 --2- 172.21.15.50:0/2993523020 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5610d95374c0 0x5610d95398e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:26:50.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.633+0000 7fe7788a6640 1 --2- 172.21.15.50:0/2993523020 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5610d95374c0 0x5610d95398e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a493b95b2aa6efb server_cookie=ad000e9b09804873 in_seq=0 out_seq=0 2024-06-06T03:26:50.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.633+0000 7fe7537fe640 10 client.15357 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:26:50.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.648+0000 7fe7537fe640 1 -- 172.21.15.50:0/2993523020 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5610d9422c20 con 0x5610d95374c0 2024-06-06T03:26:50.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.648+0000 7fe7537fe640 10 client.15357 handle_command_reply: tid=0 2024-06-06T03:26:50.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.648+0000 7fe77d013740 1 client.15357 shutdown 2024-06-06T03:26:50.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.648+0000 7fe77d013740 1 -- 172.21.15.50:0/2993523020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d94b6e10 msgr2=0x5610d94c4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:50.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.648+0000 7fe77d013740 1 --2- 172.21.15.50:0/2993523020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d94b6e10 0x5610d94c4f40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x5610d94c1b50 tx=0x7fe768004290 comp rx=0 tx=0).stop 2024-06-06T03:26:50.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.648+0000 7fe77d013740 1 -- 172.21.15.50:0/2993523020 shutdown_connections 2024-06-06T03:26:50.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.648+0000 7fe77d013740 1 --2- 172.21.15.50:0/2993523020 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5610d95374c0 0x5610d95398e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.648+0000 7fe77d013740 1 --2- 172.21.15.50:0/2993523020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d94b6e10 0x5610d94c4f40 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.648+0000 7fe77d013740 1 --2- 172.21.15.50:0/2993523020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5610d94bbf80 0x5610d95352e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.648+0000 7fe77d013740 1 --2- 172.21.15.50:0/2993523020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5610d94b6420 0x5610d94c4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.648+0000 7fe7537fe640 0 client.15357 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:26:50.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.648+0000 7fe77d013740 1 -- 172.21.15.50:0/2993523020 >> 172.21.15.50:0/2993523020 conn(0x5610d94ad680 msgr2=0x5610d94c0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:50.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.648+0000 7fe77d013740 1 -- 172.21.15.50:0/2993523020 shutdown_connections 2024-06-06T03:26:50.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.648+0000 7fe77d013740 1 -- 172.21.15.50:0/2993523020 wait complete. 2024-06-06T03:26:50.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.648+0000 7fe77d013740 20 client.15357 trim_cache size 0 max 16384 2024-06-06T03:26:50.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:26:50.650 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:26:50.650 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:26:50.650 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.649+0000 7fe77a309640 1 -- 172.21.15.50:0/2294952833 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe75c0a2cb0 msgr2=0x7fe75c0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:50.651 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.649+0000 7fe77a309640 1 --2- 172.21.15.50:0/2294952833 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe75c0a2cb0 0x7fe75c0a5170 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe7640ed480 tx=0x7fe764039f90 comp rx=0 tx=0).stop 2024-06-06T03:26:50.651 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.649+0000 7fe77a309640 1 -- 172.21.15.50:0/2294952833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe774101a00 msgr2=0x7fe774197b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:26:50.651 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.649+0000 7fe77a309640 1 --2- 172.21.15.50:0/2294952833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe774101a00 0x7fe774197b70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe7640314e0 tx=0x7fe764031a30 comp rx=0 tx=0).stop 2024-06-06T03:26:50.651 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.649+0000 7fe77a309640 1 -- 172.21.15.50:0/2294952833 shutdown_connections 2024-06-06T03:26:50.651 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.649+0000 7fe77a309640 1 --2- 172.21.15.50:0/2294952833 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe75c0a2cb0 0x7fe75c0a5170 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.651 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.649+0000 7fe77a309640 1 --2- 172.21.15.50:0/2294952833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7741035b0 0x7fe77419f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.651 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.649+0000 7fe77a309640 1 --2- 172.21.15.50:0/2294952833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe774102bf0 0x7fe7741980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.651 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.649+0000 7fe77a309640 1 --2- 172.21.15.50:0/2294952833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe774101a00 0x7fe774197b70 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:26:50.651 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.649+0000 7fe77a309640 1 -- 172.21.15.50:0/2294952833 >> 172.21.15.50:0/2294952833 conn(0x7fe7740fcf90 msgr2=0x7fe774105ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:26:50.652 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.649+0000 7fe77a309640 1 -- 172.21.15.50:0/2294952833 shutdown_connections 2024-06-06T03:26:50.652 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:26:50.649+0000 7fe77a309640 1 -- 172.21.15.50:0/2294952833 wait complete. 2024-06-06T03:26:51.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:50 smithi050 ceph-mon[32421]: pgmap v437: 129 pgs: 129 active+clean; 659 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-06-06T03:26:51.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:50 smithi079 ceph-mon[35478]: pgmap v437: 129 pgs: 129 active+clean; 659 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-06-06T03:26:51.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:50 smithi122 ceph-mon[35759]: pgmap v437: 129 pgs: 129 active+clean; 659 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-06-06T03:26:53.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:52 smithi050 ceph-mon[32421]: pgmap v438: 129 pgs: 129 active+clean; 659 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 5 op/s 2024-06-06T03:26:53.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:52 smithi050 ceph-mon[32421]: scrub summary: idle 2024-06-06T03:26:53.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:52 smithi079 ceph-mon[35478]: pgmap v438: 129 pgs: 129 active+clean; 659 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 5 op/s 2024-06-06T03:26:53.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:52 smithi079 ceph-mon[35478]: scrub summary: idle 2024-06-06T03:26:53.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:52 smithi122 ceph-mon[35759]: pgmap v438: 129 pgs: 129 active+clean; 659 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 5 op/s 2024-06-06T03:26:53.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:52 smithi122 ceph-mon[35759]: scrub summary: idle 2024-06-06T03:26:55.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:54 smithi050 ceph-mon[32421]: pgmap v439: 129 pgs: 129 active+clean; 659 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-06-06T03:26:55.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:54 smithi079 ceph-mon[35478]: pgmap v439: 129 pgs: 129 active+clean; 659 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-06-06T03:26:55.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:54 smithi122 ceph-mon[35759]: pgmap v439: 129 pgs: 129 active+clean; 659 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-06-06T03:26:57.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:56 smithi050 ceph-mon[32421]: pgmap v440: 129 pgs: 129 active+clean; 664 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-06-06T03:26:57.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:56 smithi079 ceph-mon[35478]: pgmap v440: 129 pgs: 129 active+clean; 664 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-06-06T03:26:57.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:56 smithi122 ceph-mon[35759]: pgmap v440: 129 pgs: 129 active+clean; 664 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-06-06T03:26:58.983 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:26:58 smithi122 ceph-mon[35759]: pgmap v441: 129 pgs: 129 active+clean; 664 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-06-06T03:26:59.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:26:58 smithi050 ceph-mon[32421]: pgmap v441: 129 pgs: 129 active+clean; 664 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-06-06T03:26:59.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:26:58 smithi079 ceph-mon[35478]: pgmap v441: 129 pgs: 129 active+clean; 664 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-06-06T03:27:01.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:00 smithi050 ceph-mon[32421]: pgmap v442: 129 pgs: 129 active+clean; 664 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.4 KiB/s wr, 12 op/s 2024-06-06T03:27:01.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:00 smithi079 ceph-mon[35478]: pgmap v442: 129 pgs: 129 active+clean; 664 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.4 KiB/s wr, 12 op/s 2024-06-06T03:27:01.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:00 smithi122 ceph-mon[35759]: pgmap v442: 129 pgs: 129 active+clean; 664 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.4 KiB/s wr, 12 op/s 2024-06-06T03:27:03.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:02 smithi050 ceph-mon[32421]: pgmap v443: 129 pgs: 129 active+clean; 664 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-06-06T03:27:03.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:02 smithi079 ceph-mon[35478]: pgmap v443: 129 pgs: 129 active+clean; 664 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-06-06T03:27:03.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:02 smithi122 ceph-mon[35759]: pgmap v443: 129 pgs: 129 active+clean; 664 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-06-06T03:27:03.757 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.752+0000 7fa88997e640 1 -- 172.21.15.50:0/263023945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa884101ba0 msgr2=0x7fa884102020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:03.757 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.752+0000 7fa88997e640 1 --2- 172.21.15.50:0/263023945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa884101ba0 0x7fa884102020 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa86c009900 tx=0x7fa86c02a410 comp rx=0 tx=0).stop 2024-06-06T03:27:03.757 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.753+0000 7fa88997e640 1 -- 172.21.15.50:0/263023945 shutdown_connections 2024-06-06T03:27:03.757 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.753+0000 7fa88997e640 1 --2- 172.21.15.50:0/263023945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa884102560 0x7fa884108df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.757 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.753+0000 7fa88997e640 1 --2- 172.21.15.50:0/263023945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa884101ba0 0x7fa884102020 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.757 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.753+0000 7fa88997e640 1 --2- 172.21.15.50:0/263023945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8841009b0 0x7fa884100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.753+0000 7fa88997e640 1 -- 172.21.15.50:0/263023945 >> 172.21.15.50:0/263023945 conn(0x7fa8840fbf20 msgr2=0x7fa8840fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.753+0000 7fa88997e640 1 -- 172.21.15.50:0/263023945 shutdown_connections 2024-06-06T03:27:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.753+0000 7fa88997e640 1 -- 172.21.15.50:0/263023945 wait complete. 2024-06-06T03:27:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.753+0000 7fa88997e640 1 Processor -- start 2024-06-06T03:27:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.753+0000 7fa88997e640 1 -- start start 2024-06-06T03:27:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.754+0000 7fa88997e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8841009b0 0x7fa884197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.754+0000 7fa88997e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa884101ba0 0x7fa8841980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.754+0000 7fa88997e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa884102560 0x7fa88419f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.754+0000 7fa88997e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa88410d590 con 0x7fa8841009b0 2024-06-06T03:27:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.754+0000 7fa88997e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa88410d410 con 0x7fa884102560 2024-06-06T03:27:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.754+0000 7fa88997e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa88410d710 con 0x7fa884101ba0 2024-06-06T03:27:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.754+0000 7fa882ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8841009b0 0x7fa884197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.754+0000 7fa882ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8841009b0 0x7fa884197b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44602/0 (socket says 172.21.15.50:44602) 2024-06-06T03:27:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.754+0000 7fa882ffd640 1 -- 172.21.15.50:0/1994383294 learned_addr learned my addr 172.21.15.50:0/1994383294 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.754+0000 7fa8837fe640 1 --2- 172.21.15.50:0/1994383294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa884102560 0x7fa88419f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.754+0000 7fa8827fc640 1 --2- 172.21.15.50:0/1994383294 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa884101ba0 0x7fa8841980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.754+0000 7fa882ffd640 1 -- 172.21.15.50:0/1994383294 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa884101ba0 msgr2=0x7fa8841980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.754+0000 7fa882ffd640 1 --2- 172.21.15.50:0/1994383294 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa884101ba0 0x7fa8841980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.754+0000 7fa882ffd640 1 -- 172.21.15.50:0/1994383294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa884102560 msgr2=0x7fa88419f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.754+0000 7fa882ffd640 1 --2- 172.21.15.50:0/1994383294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa884102560 0x7fa88419f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.754+0000 7fa882ffd640 1 -- 172.21.15.50:0/1994383294 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa88419f780 con 0x7fa8841009b0 2024-06-06T03:27:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.754+0000 7fa8827fc640 1 --2- 172.21.15.50:0/1994383294 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa884101ba0 0x7fa8841980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:27:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.754+0000 7fa8837fe640 1 --2- 172.21.15.50:0/1994383294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa884102560 0x7fa88419f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:27:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.754+0000 7fa882ffd640 1 --2- 172.21.15.50:0/1994383294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8841009b0 0x7fa884197b60 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa87400ebc0 tx=0x7fa87400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.754+0000 7fa88897c640 1 -- 172.21.15.50:0/1994383294 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa874003b70 con 0x7fa8841009b0 2024-06-06T03:27:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.755+0000 7fa88997e640 1 -- 172.21.15.50:0/1994383294 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa88419fa70 con 0x7fa8841009b0 2024-06-06T03:27:03.760 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.755+0000 7fa88897c640 1 -- 172.21.15.50:0/1994383294 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa874003d10 con 0x7fa8841009b0 2024-06-06T03:27:03.760 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.755+0000 7fa88897c640 1 -- 172.21.15.50:0/1994383294 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa874019820 con 0x7fa8841009b0 2024-06-06T03:27:03.760 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.755+0000 7fa88997e640 1 -- 172.21.15.50:0/1994383294 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8841a0010 con 0x7fa8841009b0 2024-06-06T03:27:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.757+0000 7fa88897c640 1 -- 172.21.15.50:0/1994383294 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa8740199c0 con 0x7fa8841009b0 2024-06-06T03:27:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.757+0000 7fa88c76a740 1 Processor -- start 2024-06-06T03:27:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.758+0000 7fa88c76a740 1 -- start start 2024-06-06T03:27:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.758+0000 7fa88c76a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ebe05a010 0x556ebe05a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.758+0000 7fa88c76a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ebe05aa00 0x556ebe05f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.758+0000 7fa88c76a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556ebe05fb70 0x556ebe062000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.758+0000 7fa88c76a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556ebdfbd4f0 con 0x556ebe05fb70 2024-06-06T03:27:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.758+0000 7fa88c76a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556ebdf5b870 con 0x556ebe05a010 2024-06-06T03:27:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.758+0000 7fa88c76a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556ebdfb94b0 con 0x556ebe05aa00 2024-06-06T03:27:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.758+0000 7fa8827fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556ebe05fb70 0x556ebe062000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.758+0000 7fa8827fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556ebe05fb70 0x556ebe062000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44610/0 (socket says 172.21.15.50:44610) 2024-06-06T03:27:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.758+0000 7fa8827fc640 1 -- 172.21.15.50:0/690411194 learned_addr learned my addr 172.21.15.50:0/690411194 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.758+0000 7fa8837fe640 1 --2- 172.21.15.50:0/690411194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ebe05a010 0x556ebe05a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.758+0000 7fa882ffd640 1 --2- 172.21.15.50:0/690411194 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ebe05aa00 0x556ebe05f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.758+0000 7fa88897c640 1 --2- 172.21.15.50:0/1994383294 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa8700a2c30 0x7fa8700a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.758+0000 7fa8827fc640 1 -- 172.21.15.50:0/690411194 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ebe05aa00 msgr2=0x556ebe05f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.758+0000 7fa8827fc640 1 --2- 172.21.15.50:0/690411194 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ebe05aa00 0x556ebe05f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.758+0000 7fa8827fc640 1 -- 172.21.15.50:0/690411194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ebe05a010 msgr2=0x556ebe05a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.758+0000 7fa8827fc640 1 --2- 172.21.15.50:0/690411194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ebe05a010 0x556ebe05a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.758+0000 7fa8827fc640 1 -- 172.21.15.50:0/690411194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ebdf779b0 con 0x556ebe05fb70 2024-06-06T03:27:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.758+0000 7fa8837fe640 1 --2- 172.21.15.50:0/690411194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ebe05a010 0x556ebe05a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:27:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.759+0000 7fa8837fe640 1 --2- 172.21.15.50:0/1994383294 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa8700a2c30 0x7fa8700a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.759+0000 7fa88897c640 1 -- 172.21.15.50:0/1994383294 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fa8740cfe10 con 0x7fa8841009b0 2024-06-06T03:27:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.759+0000 7fa8827fc640 1 --2- 172.21.15.50:0/690411194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556ebe05fb70 0x556ebe062000 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa86c006010 tx=0x7fa86c032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a02fb7a4b8d1fb7 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:03.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.759+0000 7fa8837fe640 1 --2- 172.21.15.50:0/1994383294 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa8700a2c30 0x7fa8700a50f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x556ebe05b260 tx=0x7fa87c0046c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:03.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.759+0000 7fa879ffb640 1 -- 172.21.15.50:0/690411194 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86c03f070 con 0x556ebe05fb70 2024-06-06T03:27:03.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.759+0000 7fa879ffb640 1 -- 172.21.15.50:0/690411194 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa86c004030 con 0x556ebe05fb70 2024-06-06T03:27:03.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.759+0000 7fa879ffb640 1 -- 172.21.15.50:0/690411194 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86c035070 con 0x556ebe05fb70 2024-06-06T03:27:03.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.760+0000 7fa88c76a740 1 -- 172.21.15.50:0/690411194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556ebe05fb70 msgr2=0x556ebe062000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:03.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.760+0000 7fa88c76a740 1 --2- 172.21.15.50:0/690411194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556ebe05fb70 0x556ebe062000 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa86c006010 tx=0x7fa86c032c10 comp rx=0 tx=0).stop 2024-06-06T03:27:03.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.760+0000 7fa88c76a740 1 -- 172.21.15.50:0/690411194 shutdown_connections 2024-06-06T03:27:03.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.760+0000 7fa88c76a740 1 --2- 172.21.15.50:0/690411194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556ebe05fb70 0x556ebe062000 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.760+0000 7fa88c76a740 1 --2- 172.21.15.50:0/690411194 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ebe05aa00 0x556ebe05f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.760+0000 7fa88c76a740 1 --2- 172.21.15.50:0/690411194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ebe05a010 0x556ebe05a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.760+0000 7fa88c76a740 1 -- 172.21.15.50:0/690411194 >> 172.21.15.50:0/690411194 conn(0x556ebe055680 msgr2=0x556ebe055a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:03.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.760+0000 7fa88c76a740 1 -- 172.21.15.50:0/690411194 shutdown_connections 2024-06-06T03:27:03.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.760+0000 7fa88c76a740 1 -- 172.21.15.50:0/690411194 wait complete. 2024-06-06T03:27:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.760+0000 7fa88c76a740 1 -- start start 2024-06-06T03:27:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.760+0000 7fa88c76a740 1 Processor -- start 2024-06-06T03:27:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.761+0000 7fa88c76a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556ebe05a010 0x556ebe064160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.761+0000 7fa88c76a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ebe05aa00 0x556ebe0646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.761+0000 7fa88c76a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ebe05fb70 0x556ebe06b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.761+0000 7fa88c76a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556ebe062ac0 con 0x556ebe05a010 2024-06-06T03:27:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.761+0000 7fa88c76a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556ebdf46ae0 con 0x556ebe05aa00 2024-06-06T03:27:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.761+0000 7fa88c76a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556ebe062c40 con 0x556ebe05fb70 2024-06-06T03:27:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.761+0000 7fa88c76a740 10 client.0 _ll_register_callbacks cb 0x556ebdf7f9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.761+0000 7fa882ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556ebe05a010 0x556ebe064160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.761+0000 7fa882ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556ebe05a010 0x556ebe064160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44624/0 (socket says 172.21.15.50:44624) 2024-06-06T03:27:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.761+0000 7fa882ffd640 1 -- 172.21.15.50:0/2433902936 learned_addr learned my addr 172.21.15.50:0/2433902936 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.761+0000 7fa882ffd640 1 -- 172.21.15.50:0/2433902936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ebe05fb70 msgr2=0x556ebe06b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:03.770 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.761+0000 7fa8827fc640 1 --2- 172.21.15.50:0/2433902936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ebe05aa00 0x556ebe0646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:03.770 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.761+0000 7fa882ffd640 1 --2- 172.21.15.50:0/2433902936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ebe05fb70 0x556ebe06b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.770 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.761+0000 7fa882ffd640 1 -- 172.21.15.50:0/2433902936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ebe05aa00 msgr2=0x556ebe0646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:03.770 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.761+0000 7fa882ffd640 1 --2- 172.21.15.50:0/2433902936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ebe05aa00 0x556ebe0646a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.770 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.761+0000 7fa882ffd640 1 -- 172.21.15.50:0/2433902936 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ebdcd1210 con 0x556ebe05a010 2024-06-06T03:27:03.770 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.761+0000 7fa882ffd640 1 --2- 172.21.15.50:0/2433902936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556ebe05a010 0x556ebe064160 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa874098c60 tx=0x7fa874009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469692b374999164 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:03.770 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.761+0000 7fa862ffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:27:03.770 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.761+0000 7fa862ffd640 1 -- 172.21.15.50:0/2433902936 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8740a4f00 con 0x556ebe05a010 2024-06-06T03:27:03.770 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.762+0000 7fa862ffd640 1 -- 172.21.15.50:0/2433902936 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fa87409c4f0 con 0x556ebe05a010 2024-06-06T03:27:03.770 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.762+0000 7fa88c76a740 1 -- 172.21.15.50:0/2433902936 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa86c004030 con 0x556ebe05a010 2024-06-06T03:27:03.770 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.762+0000 7fa862ffd640 1 -- 172.21.15.50:0/2433902936 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa87409c990 con 0x556ebe05a010 2024-06-06T03:27:03.770 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.762+0000 7fa88c76a740 10 client.15369 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:03.771 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.762+0000 7fa88c76a740 1 -- 172.21.15.50:0/2433902936 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556ebdd9d620 con 0x556ebe05a010 2024-06-06T03:27:03.771 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.762+0000 7fa862ffd640 1 -- 172.21.15.50:0/2433902936 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa86c004030 con 0x556ebe05a010 2024-06-06T03:27:03.771 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.762+0000 7fa862ffd640 1 -- 172.21.15.50:0/2433902936 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fa8740a01b0 con 0x556ebe05a010 2024-06-06T03:27:03.771 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.762+0000 7fa88c76a740 10 client.15369 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:03.771 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.762+0000 7fa88c76a740 10 client.15369 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:27:03.771 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.762+0000 7fa88c76a740 20 client.15369 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:03.771 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.762+0000 7fa88c76a740 1 --2- 172.21.15.50:0/2433902936 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x556ebe06ffc0 0x556ebe072450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:03.771 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.762+0000 7fa88c76a740 4 client.15369 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:27:03.771 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.762+0000 7fa88c76a740 1 -- 172.21.15.50:0/2433902936 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ebdfd0f10 con 0x556ebe06ffc0 2024-06-06T03:27:03.771 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.762+0000 7fa8827fc640 1 --2- 172.21.15.50:0/2433902936 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x556ebe06ffc0 0x556ebe072450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:03.771 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.763+0000 7fa862ffd640 10 client.15369 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:03.771 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.763+0000 7fa8827fc640 1 --2- 172.21.15.50:0/2433902936 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x556ebe06ffc0 0x556ebe072450 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e9c20e4ddf7644e server_cookie=8540836d07e918bc in_seq=0 out_seq=0 2024-06-06T03:27:03.771 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.764+0000 7fa862ffd640 1 -- 172.21.15.50:0/2433902936 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x556ebdfd0f10 con 0x556ebe06ffc0 2024-06-06T03:27:03.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.764+0000 7fa862ffd640 10 client.15369 handle_command_reply: tid=0 2024-06-06T03:27:03.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.764+0000 7fa88c76a740 1 client.15369 shutdown 2024-06-06T03:27:03.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.764+0000 7fa88c76a740 1 -- 172.21.15.50:0/2433902936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556ebe05a010 msgr2=0x556ebe064160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:03.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.764+0000 7fa88c76a740 1 --2- 172.21.15.50:0/2433902936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556ebe05a010 0x556ebe064160 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa874098c60 tx=0x7fa874009a50 comp rx=0 tx=0).stop 2024-06-06T03:27:03.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.764+0000 7fa88c76a740 1 -- 172.21.15.50:0/2433902936 shutdown_connections 2024-06-06T03:27:03.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.764+0000 7fa88c76a740 1 --2- 172.21.15.50:0/2433902936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ebe05fb70 0x556ebe06b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.764+0000 7fa88c76a740 1 --2- 172.21.15.50:0/2433902936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ebe05aa00 0x556ebe0646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.764+0000 7fa88c76a740 1 --2- 172.21.15.50:0/2433902936 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x556ebe06ffc0 0x556ebe072450 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.764+0000 7fa88c76a740 1 --2- 172.21.15.50:0/2433902936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556ebe05a010 0x556ebe064160 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.764+0000 7fa88c76a740 1 -- 172.21.15.50:0/2433902936 >> 172.21.15.50:0/2433902936 conn(0x556ebe055680 msgr2=0x556ebe0547e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:03.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.764+0000 7fa862ffd640 0 client.15369 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:03.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.764+0000 7fa88c76a740 1 -- 172.21.15.50:0/2433902936 shutdown_connections 2024-06-06T03:27:03.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.764+0000 7fa88c76a740 1 -- 172.21.15.50:0/2433902936 wait complete. 2024-06-06T03:27:03.773 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.764+0000 7fa88c76a740 20 client.15369 trim_cache size 0 max 16384 2024-06-06T03:27:03.780 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.779+0000 7fa88c76a740 1 Processor -- start 2024-06-06T03:27:03.780 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.779+0000 7fa88c76a740 1 -- start start 2024-06-06T03:27:03.780 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.780+0000 7fa88c76a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ebe05a010 0x556ebe058670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:03.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.780+0000 7fa88c76a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556ebe05aa00 0x556ebe06b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:03.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.780+0000 7fa88c76a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ebe05fb70 0x556ebe058bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:03.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.780+0000 7fa88c76a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa8841acc10 con 0x556ebe05aa00 2024-06-06T03:27:03.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.780+0000 7fa88c76a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa8841aa4e0 con 0x556ebe05a010 2024-06-06T03:27:03.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.780+0000 7fa88c76a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa8841a8330 con 0x556ebe05fb70 2024-06-06T03:27:03.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.780+0000 7fa8827fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556ebe05aa00 0x556ebe06b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:03.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.780+0000 7fa8827fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556ebe05aa00 0x556ebe06b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44630/0 (socket says 172.21.15.50:44630) 2024-06-06T03:27:03.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.780+0000 7fa8827fc640 1 -- 172.21.15.50:0/172772525 learned_addr learned my addr 172.21.15.50:0/172772525 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:03.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.780+0000 7fa882ffd640 1 --2- 172.21.15.50:0/172772525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ebe05a010 0x556ebe058670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:03.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.780+0000 7fa8827fc640 1 -- 172.21.15.50:0/172772525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ebe05fb70 msgr2=0x556ebe058bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:03.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.780+0000 7fa8827fc640 1 --2- 172.21.15.50:0/172772525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ebe05fb70 0x556ebe058bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.780+0000 7fa8827fc640 1 -- 172.21.15.50:0/172772525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ebe05a010 msgr2=0x556ebe058670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:03.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.780+0000 7fa8827fc640 1 --2- 172.21.15.50:0/172772525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ebe05a010 0x556ebe058670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.780+0000 7fa8827fc640 1 -- 172.21.15.50:0/172772525 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ebe063580 con 0x556ebe05aa00 2024-06-06T03:27:03.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.780+0000 7fa882ffd640 1 --2- 172.21.15.50:0/172772525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ebe05a010 0x556ebe058670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:27:03.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.780+0000 7fa8827fc640 1 --2- 172.21.15.50:0/172772525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556ebe05aa00 0x556ebe06b6a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa86c005c40 tx=0x7fa86c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=159635de1afc83f7 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:03.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.780+0000 7fa8797fa640 1 -- 172.21.15.50:0/172772525 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86c051070 con 0x556ebe05aa00 2024-06-06T03:27:03.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.780+0000 7fa8797fa640 1 -- 172.21.15.50:0/172772525 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa86c004240 con 0x556ebe05aa00 2024-06-06T03:27:03.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.780+0000 7fa8797fa640 1 -- 172.21.15.50:0/172772525 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86c035040 con 0x556ebe05aa00 2024-06-06T03:27:03.785 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.781+0000 7fa88c76a740 1 -- 172.21.15.50:0/172772525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556ebe05aa00 msgr2=0x556ebe06b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:03.785 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.781+0000 7fa88c76a740 1 --2- 172.21.15.50:0/172772525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556ebe05aa00 0x556ebe06b6a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa86c005c40 tx=0x7fa86c02a410 comp rx=0 tx=0).stop 2024-06-06T03:27:03.786 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.781+0000 7fa88c76a740 1 -- 172.21.15.50:0/172772525 shutdown_connections 2024-06-06T03:27:03.786 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.781+0000 7fa88c76a740 1 --2- 172.21.15.50:0/172772525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556ebe05aa00 0x556ebe06b6a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.786 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.781+0000 7fa88c76a740 1 --2- 172.21.15.50:0/172772525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ebe05fb70 0x556ebe058bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.786 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.781+0000 7fa88c76a740 1 --2- 172.21.15.50:0/172772525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ebe05a010 0x556ebe058670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.786 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.781+0000 7fa88c76a740 1 -- 172.21.15.50:0/172772525 >> 172.21.15.50:0/172772525 conn(0x556ebe055680 msgr2=0x556ebe05f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:03.786 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.781+0000 7fa88c76a740 1 -- 172.21.15.50:0/172772525 shutdown_connections 2024-06-06T03:27:03.786 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.781+0000 7fa88c76a740 1 -- 172.21.15.50:0/172772525 wait complete. 2024-06-06T03:27:03.786 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.781+0000 7fa88c76a740 1 -- start start 2024-06-06T03:27:03.786 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.782+0000 7fa88c76a740 1 Processor -- start 2024-06-06T03:27:03.786 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.782+0000 7fa88c76a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556ebe05a010 0x556ebe0684d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:03.786 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.782+0000 7fa88c76a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ebe05aa00 0x556ebe068a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:03.787 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.782+0000 7fa88c76a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ebe05fb70 0x556ebe0d8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:03.787 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.782+0000 7fa88c76a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa8841a89a0 con 0x556ebe05a010 2024-06-06T03:27:03.787 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.782+0000 7fa88c76a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa8841a9e10 con 0x556ebe05fb70 2024-06-06T03:27:03.787 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.782+0000 7fa88c76a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa8841a9070 con 0x556ebe05aa00 2024-06-06T03:27:03.787 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.782+0000 7fa88c76a740 10 client.0 _ll_register_callbacks cb 0x7fa87400eec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:03.787 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.782+0000 7fa882ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556ebe05a010 0x556ebe0684d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:03.787 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.782+0000 7fa882ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556ebe05a010 0x556ebe0684d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44646/0 (socket says 172.21.15.50:44646) 2024-06-06T03:27:03.787 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.782+0000 7fa882ffd640 1 -- 172.21.15.50:0/2976914036 learned_addr learned my addr 172.21.15.50:0/2976914036 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:03.787 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.782+0000 7fa8837fe640 1 --2- 172.21.15.50:0/2976914036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ebe05fb70 0x556ebe0d8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:03.787 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.782+0000 7fa882ffd640 1 -- 172.21.15.50:0/2976914036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ebe05aa00 msgr2=0x556ebe068a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:03.788 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.782+0000 7fa8827fc640 1 --2- 172.21.15.50:0/2976914036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ebe05aa00 0x556ebe068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:03.788 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.782+0000 7fa882ffd640 1 --2- 172.21.15.50:0/2976914036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ebe05aa00 0x556ebe068a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.788 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.782+0000 7fa882ffd640 1 -- 172.21.15.50:0/2976914036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ebe05fb70 msgr2=0x556ebe0d8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:03.788 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.782+0000 7fa882ffd640 1 --2- 172.21.15.50:0/2976914036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ebe05fb70 0x556ebe0d8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.788 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.782+0000 7fa882ffd640 1 -- 172.21.15.50:0/2976914036 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ebe0d92b0 con 0x556ebe05a010 2024-06-06T03:27:03.788 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.782+0000 7fa8837fe640 1 --2- 172.21.15.50:0/2976914036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ebe05fb70 0x556ebe0d8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:27:03.788 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.782+0000 7fa8827fc640 1 --2- 172.21.15.50:0/2976914036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ebe05aa00 0x556ebe068a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:27:03.788 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.782+0000 7fa882ffd640 1 --2- 172.21.15.50:0/2976914036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556ebe05a010 0x556ebe0684d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa87400cfd0 tx=0x7fa8740bc440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f846e4920b789902 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:03.788 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.782+0000 7fa862ffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:27:03.788 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.783+0000 7fa862ffd640 1 -- 172.21.15.50:0/2976914036 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8740a4f00 con 0x556ebe05a010 2024-06-06T03:27:03.788 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.783+0000 7fa862ffd640 1 -- 172.21.15.50:0/2976914036 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fa8740a0180 con 0x556ebe05a010 2024-06-06T03:27:03.788 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.783+0000 7fa88c76a740 1 -- 172.21.15.50:0/2976914036 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa86c004240 con 0x556ebe05a010 2024-06-06T03:27:03.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.783+0000 7fa862ffd640 1 -- 172.21.15.50:0/2976914036 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa87409c700 con 0x556ebe05a010 2024-06-06T03:27:03.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.783+0000 7fa88c76a740 10 client.15375 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:03.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.783+0000 7fa88c76a740 1 -- 172.21.15.50:0/2976914036 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556ebe0da4a0 con 0x556ebe05a010 2024-06-06T03:27:03.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.783+0000 7fa862ffd640 1 -- 172.21.15.50:0/2976914036 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa86c004240 con 0x556ebe05a010 2024-06-06T03:27:03.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.783+0000 7fa862ffd640 1 -- 172.21.15.50:0/2976914036 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fa874097fe0 con 0x556ebe05a010 2024-06-06T03:27:03.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.783+0000 7fa88c76a740 10 client.15375 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:03.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.783+0000 7fa88c76a740 10 client.15375 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:27:03.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.783+0000 7fa88c76a740 20 client.15375 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:03.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.783+0000 7fa88c76a740 1 --2- 172.21.15.50:0/2976914036 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x556ebe0dac10 0x556ebe0dd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:03.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.783+0000 7fa88c76a740 4 client.15375 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:27:03.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.783+0000 7fa88c76a740 1 -- 172.21.15.50:0/2976914036 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556ebdfcac20 con 0x556ebe0dac10 2024-06-06T03:27:03.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.783+0000 7fa8827fc640 1 --2- 172.21.15.50:0/2976914036 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x556ebe0dac10 0x556ebe0dd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:03.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.784+0000 7fa862ffd640 10 client.15375 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:03.790 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.784+0000 7fa8827fc640 1 --2- 172.21.15.50:0/2976914036 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x556ebe0dac10 0x556ebe0dd000 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ae249e5513b9322 server_cookie=161a191d3e65b35a in_seq=0 out_seq=0 2024-06-06T03:27:03.792 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.791+0000 7fa862ffd640 1 -- 172.21.15.50:0/2976914036 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x556ebdfcac20 con 0x556ebe0dac10 2024-06-06T03:27:03.792 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.791+0000 7fa862ffd640 10 client.15375 handle_command_reply: tid=0 2024-06-06T03:27:03.792 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.791+0000 7fa88c76a740 1 client.15375 shutdown 2024-06-06T03:27:03.792 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.791+0000 7fa88c76a740 1 -- 172.21.15.50:0/2976914036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556ebe05a010 msgr2=0x556ebe0684d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:03.792 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.791+0000 7fa88c76a740 1 --2- 172.21.15.50:0/2976914036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556ebe05a010 0x556ebe0684d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa87400cfd0 tx=0x7fa8740bc440 comp rx=0 tx=0).stop 2024-06-06T03:27:03.792 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.791+0000 7fa88c76a740 1 -- 172.21.15.50:0/2976914036 shutdown_connections 2024-06-06T03:27:03.792 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.791+0000 7fa88c76a740 1 --2- 172.21.15.50:0/2976914036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ebe05fb70 0x556ebe0d8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.792 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.791+0000 7fa88c76a740 1 --2- 172.21.15.50:0/2976914036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ebe05aa00 0x556ebe068a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.792 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.791+0000 7fa88c76a740 1 --2- 172.21.15.50:0/2976914036 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x556ebe0dac10 0x556ebe0dd000 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.792 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.791+0000 7fa88c76a740 1 --2- 172.21.15.50:0/2976914036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556ebe05a010 0x556ebe0684d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.792 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.791+0000 7fa862ffd640 0 client.15375 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:03.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.791+0000 7fa88c76a740 1 -- 172.21.15.50:0/2976914036 >> 172.21.15.50:0/2976914036 conn(0x556ebe055680 msgr2=0x556ebe05bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:03.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.791+0000 7fa88c76a740 1 -- 172.21.15.50:0/2976914036 shutdown_connections 2024-06-06T03:27:03.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.792+0000 7fa88c76a740 1 -- 172.21.15.50:0/2976914036 wait complete. 2024-06-06T03:27:03.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.792+0000 7fa88c76a740 20 client.15375 trim_cache size 0 max 16384 2024-06-06T03:27:03.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:27:03.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:27:03.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:27:03.794 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.792+0000 7fa88997e640 1 -- 172.21.15.50:0/1994383294 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa8700a2c30 msgr2=0x7fa8700a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:03.794 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.792+0000 7fa88997e640 1 --2- 172.21.15.50:0/1994383294 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa8700a2c30 0x7fa8700a50f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x556ebe05b260 tx=0x7fa87c0046c0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.794 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.792+0000 7fa88997e640 1 -- 172.21.15.50:0/1994383294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8841009b0 msgr2=0x7fa884197b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:03.794 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.792+0000 7fa88997e640 1 --2- 172.21.15.50:0/1994383294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8841009b0 0x7fa884197b60 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa87400ebc0 tx=0x7fa87400c6a0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.794 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.792+0000 7fa88997e640 1 -- 172.21.15.50:0/1994383294 shutdown_connections 2024-06-06T03:27:03.794 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.792+0000 7fa88997e640 1 --2- 172.21.15.50:0/1994383294 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa8700a2c30 0x7fa8700a50f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.794 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.792+0000 7fa88997e640 1 --2- 172.21.15.50:0/1994383294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa884102560 0x7fa88419f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.795 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.792+0000 7fa88997e640 1 --2- 172.21.15.50:0/1994383294 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa884101ba0 0x7fa8841980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.795 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.792+0000 7fa88997e640 1 --2- 172.21.15.50:0/1994383294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8841009b0 0x7fa884197b60 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:03.795 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.792+0000 7fa88997e640 1 -- 172.21.15.50:0/1994383294 >> 172.21.15.50:0/1994383294 conn(0x7fa8840fbf20 msgr2=0x7fa884104e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:03.795 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.792+0000 7fa88997e640 1 -- 172.21.15.50:0/1994383294 shutdown_connections 2024-06-06T03:27:03.795 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:03.792+0000 7fa88997e640 1 -- 172.21.15.50:0/1994383294 wait complete. 2024-06-06T03:27:05.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:04 smithi050 ceph-mon[32421]: pgmap v444: 129 pgs: 129 active+clean; 664 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-06-06T03:27:05.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:04 smithi079 ceph-mon[35478]: pgmap v444: 129 pgs: 129 active+clean; 664 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-06-06T03:27:05.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:04 smithi122 ceph-mon[35759]: pgmap v444: 129 pgs: 129 active+clean; 664 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-06-06T03:27:07.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:06 smithi050 ceph-mon[32421]: pgmap v445: 129 pgs: 129 active+clean; 667 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-06-06T03:27:07.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:06 smithi079 ceph-mon[35478]: pgmap v445: 129 pgs: 129 active+clean; 667 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-06-06T03:27:07.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:06 smithi122 ceph-mon[35759]: pgmap v445: 129 pgs: 129 active+clean; 667 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-06-06T03:27:09.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:08 smithi050 ceph-mon[32421]: pgmap v446: 129 pgs: 129 active+clean; 667 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-06-06T03:27:09.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:08 smithi079 ceph-mon[35478]: pgmap v446: 129 pgs: 129 active+clean; 667 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-06-06T03:27:09.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:08 smithi122 ceph-mon[35759]: pgmap v446: 129 pgs: 129 active+clean; 667 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-06-06T03:27:11.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:10 smithi050 ceph-mon[32421]: pgmap v447: 129 pgs: 129 active+clean; 667 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2024-06-06T03:27:11.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:10 smithi079 ceph-mon[35478]: pgmap v447: 129 pgs: 129 active+clean; 667 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2024-06-06T03:27:11.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:10 smithi122 ceph-mon[35759]: pgmap v447: 129 pgs: 129 active+clean; 667 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2024-06-06T03:27:13.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:12 smithi050 ceph-mon[32421]: pgmap v448: 129 pgs: 129 active+clean; 667 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-06-06T03:27:13.085 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-06T03:27:13.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:12 smithi079 ceph-mon[35478]: pgmap v448: 129 pgs: 129 active+clean; 667 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-06-06T03:27:13.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:12 smithi122 ceph-mon[35759]: pgmap v448: 129 pgs: 129 active+clean; 667 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-06-06T03:27:13.344 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:27:14.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:14 smithi050 ceph-mon[32421]: pgmap v449: 129 pgs: 129 active+clean; 667 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 6 op/s 2024-06-06T03:27:15.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:14 smithi079 ceph-mon[35478]: pgmap v449: 129 pgs: 129 active+clean; 667 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 6 op/s 2024-06-06T03:27:15.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.176+0000 7fda183e6700 1 -- 172.21.15.50:0/2747011793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda101027a0 msgr2=0x7fda10102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:15.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.176+0000 7fda183e6700 1 --2- 172.21.15.50:0/2747011793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda101027a0 0x7fda10102b80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0099c0 tx=0x7fda0c009cd0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.176+0000 7fda183e6700 1 -- 172.21.15.50:0/2747011793 shutdown_connections 2024-06-06T03:27:15.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.176+0000 7fda183e6700 1 --2- 172.21.15.50:0/2747011793 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda10107870 0x7fda1010f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.176+0000 7fda183e6700 1 --2- 172.21.15.50:0/2747011793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda101027a0 0x7fda10102b80 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.176+0000 7fda183e6700 1 --2- 172.21.15.50:0/2747011793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda10103150 0x7fda10107140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.176+0000 7fda183e6700 1 -- 172.21.15.50:0/2747011793 >> 172.21.15.50:0/2747011793 conn(0x7fda10079520 msgr2=0x7fda10079930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:15.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.176+0000 7fda183e6700 1 -- 172.21.15.50:0/2747011793 shutdown_connections 2024-06-06T03:27:15.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.176+0000 7fda183e6700 1 -- 172.21.15.50:0/2747011793 wait complete. 2024-06-06T03:27:15.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.177+0000 7fda183e6700 1 Processor -- start 2024-06-06T03:27:15.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.177+0000 7fda183e6700 1 -- start start 2024-06-06T03:27:15.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.177+0000 7fda183e6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda101027a0 0x7fda10074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:15.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.177+0000 7fda183e6700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda10103150 0x7fda10074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:15.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.177+0000 7fda183e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda10107870 0x7fda10075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:15.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.177+0000 7fda183e6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fda10112640 con 0x7fda101027a0 2024-06-06T03:27:15.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.177+0000 7fda183e6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fda101124c0 con 0x7fda10107870 2024-06-06T03:27:15.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.177+0000 7fda183e6700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fda101127c0 con 0x7fda10103150 2024-06-06T03:27:15.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.178+0000 7fda15981700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda10103150 0x7fda10074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:15.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.178+0000 7fda16182700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda101027a0 0x7fda10074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:15.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.178+0000 7fda16182700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda101027a0 0x7fda10074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53440/0 (socket says 172.21.15.50:53440) 2024-06-06T03:27:15.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.178+0000 7fda16182700 1 -- 172.21.15.50:0/1366912699 learned_addr learned my addr 172.21.15.50:0/1366912699 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:15.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.178+0000 7fda16983700 1 --2- 172.21.15.50:0/1366912699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda10107870 0x7fda10075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:15.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.178+0000 7fda16983700 1 -- 172.21.15.50:0/1366912699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda10103150 msgr2=0x7fda10074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:15.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.178+0000 7fda16983700 1 --2- 172.21.15.50:0/1366912699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda10103150 0x7fda10074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.178+0000 7fda16983700 1 -- 172.21.15.50:0/1366912699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda101027a0 msgr2=0x7fda10074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:15.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.178+0000 7fda16983700 1 --2- 172.21.15.50:0/1366912699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda101027a0 0x7fda10074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.178+0000 7fda16983700 1 -- 172.21.15.50:0/1366912699 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda101ab420 con 0x7fda10107870 2024-06-06T03:27:15.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.179+0000 7fda16983700 1 --2- 172.21.15.50:0/1366912699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda10107870 0x7fda10075210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fda0800efc0 tx=0x7fda0800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:15.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.179+0000 7fda077fe700 1 -- 172.21.15.50:0/1366912699 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda080092e0 con 0x7fda10107870 2024-06-06T03:27:15.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.179+0000 7fda077fe700 1 -- 172.21.15.50:0/1366912699 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fda08004bb0 con 0x7fda10107870 2024-06-06T03:27:15.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.179+0000 7fda183e6700 1 -- 172.21.15.50:0/1366912699 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda101ab6b0 con 0x7fda10107870 2024-06-06T03:27:15.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.179+0000 7fda077fe700 1 -- 172.21.15.50:0/1366912699 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda08004280 con 0x7fda10107870 2024-06-06T03:27:15.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.179+0000 7fda183e6700 1 -- 172.21.15.50:0/1366912699 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda101abba0 con 0x7fda10107870 2024-06-06T03:27:15.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:14 smithi122 ceph-mon[35759]: pgmap v449: 129 pgs: 129 active+clean; 667 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 6 op/s 2024-06-06T03:27:15.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.182+0000 7fda077fe700 1 -- 172.21.15.50:0/1366912699 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fda0801b030 con 0x7fda10107870 2024-06-06T03:27:15.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.183+0000 7fda22c69b80 1 Processor -- start 2024-06-06T03:27:15.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.183+0000 7fda22c69b80 1 -- start start 2024-06-06T03:27:15.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.183+0000 7fda077fe700 1 --2- 172.21.15.50:0/1366912699 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd9fc0a2c20 0x7fd9fc0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:15.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.183+0000 7fda22c69b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb31bcdf60 0x55bb31bce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:15.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.184+0000 7fda077fe700 1 -- 172.21.15.50:0/1366912699 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fda080ceea0 con 0x7fda10107870 2024-06-06T03:27:15.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.184+0000 7fda15981700 1 --2- 172.21.15.50:0/1366912699 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd9fc0a2c20 0x7fd9fc0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:15.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.184+0000 7fda22c69b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb31bce880 0x55bb31bc8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:15.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.184+0000 7fda22c69b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb31bc87a0 0x55bb31bc8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:15.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.184+0000 7fda16182700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb31bcdf60 0x55bb31bce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:15.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.184+0000 7fda22c69b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55bb31abaf60 con 0x55bb31bce880 2024-06-06T03:27:15.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.184+0000 7fda22c69b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bb31b19850 con 0x55bb31bc87a0 2024-06-06T03:27:15.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.184+0000 7fda22c69b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bb31a81460 con 0x55bb31bcdf60 2024-06-06T03:27:15.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.184+0000 7fda16182700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb31bcdf60 0x55bb31bce340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:41112/0 (socket says 172.21.15.50:41112) 2024-06-06T03:27:15.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.184+0000 7fda16182700 1 -- 172.21.15.50:0/2603314354 learned_addr learned my addr 172.21.15.50:0/2603314354 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:15.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.184+0000 7fda16983700 1 --2- 172.21.15.50:0/2603314354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb31bc87a0 0x55bb31bc8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:15.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.184+0000 7fda16182700 1 -- 172.21.15.50:0/2603314354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb31bc87a0 msgr2=0x55bb31bc8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:15.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.184+0000 7fda16182700 1 --2- 172.21.15.50:0/2603314354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb31bc87a0 0x55bb31bc8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.184+0000 7fda16182700 1 -- 172.21.15.50:0/2603314354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb31bce880 msgr2=0x55bb31bc8260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:27:15.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.185+0000 7fda15981700 1 --2- 172.21.15.50:0/2603314354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb31bce880 0x55bb31bc8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:15.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.185+0000 7fda16182700 1 --2- 172.21.15.50:0/2603314354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb31bce880 0x55bb31bc8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.185+0000 7fda16182700 1 -- 172.21.15.50:0/2603314354 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb31a688d0 con 0x55bb31bcdf60 2024-06-06T03:27:15.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.185+0000 7fda15981700 1 --2- 172.21.15.50:0/2603314354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb31bce880 0x55bb31bc8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:27:15.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.185+0000 7fda16182700 1 --2- 172.21.15.50:0/2603314354 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb31bcdf60 0x55bb31bce340 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fda0c000c00 tx=0x7fda0c005bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4aefedae6ffc5368 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:15.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.185+0000 7fda15981700 1 --2- 172.21.15.50:0/1366912699 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd9fc0a2c20 0x7fd9fc0a50e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fda10075f50 tx=0x7fda00015760 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:15.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.185+0000 7fda04d70700 1 -- 172.21.15.50:0/2603314354 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0c028070 con 0x55bb31bcdf60 2024-06-06T03:27:15.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.185+0000 7fda04d70700 1 -- 172.21.15.50:0/2603314354 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fda0c0037c0 con 0x55bb31bcdf60 2024-06-06T03:27:15.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.185+0000 7fda04d70700 1 -- 172.21.15.50:0/2603314354 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0c00b9f0 con 0x55bb31bcdf60 2024-06-06T03:27:15.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.186+0000 7fda22c69b80 1 -- 172.21.15.50:0/2603314354 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb31bcdf60 msgr2=0x55bb31bce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:15.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.186+0000 7fda22c69b80 1 --2- 172.21.15.50:0/2603314354 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb31bcdf60 0x55bb31bce340 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fda0c000c00 tx=0x7fda0c005bc0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.186+0000 7fda22c69b80 1 -- 172.21.15.50:0/2603314354 shutdown_connections 2024-06-06T03:27:15.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.186+0000 7fda22c69b80 1 --2- 172.21.15.50:0/2603314354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb31bc87a0 0x55bb31bc8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.186+0000 7fda22c69b80 1 --2- 172.21.15.50:0/2603314354 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb31bcdf60 0x55bb31bce340 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.186+0000 7fda22c69b80 1 --2- 172.21.15.50:0/2603314354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb31bce880 0x55bb31bc8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.186+0000 7fda22c69b80 1 -- 172.21.15.50:0/2603314354 >> 172.21.15.50:0/2603314354 conn(0x55bb31af5080 msgr2=0x55bb31bc3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:15.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.187+0000 7fda22c69b80 1 -- 172.21.15.50:0/2603314354 shutdown_connections 2024-06-06T03:27:15.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.187+0000 7fda22c69b80 1 -- 172.21.15.50:0/2603314354 wait complete. 2024-06-06T03:27:15.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.187+0000 7fda22c69b80 1 -- start start 2024-06-06T03:27:15.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.187+0000 7fda22c69b80 1 Processor -- start 2024-06-06T03:27:15.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.188+0000 7fda22c69b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb31bc87a0 0x55bb31bd45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:15.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.188+0000 7fda22c69b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb31bcdf60 0x55bb31bd1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:15.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.188+0000 7fda22c69b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb31bce880 0x55bb31bd1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:15.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.188+0000 7fda22c69b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55bb31ab9fc0 con 0x55bb31bce880 2024-06-06T03:27:15.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.188+0000 7fda22c69b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bb31b15810 con 0x55bb31bc87a0 2024-06-06T03:27:15.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.188+0000 7fda22c69b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bb31bd5200 con 0x55bb31bcdf60 2024-06-06T03:27:15.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.188+0000 7fda16182700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb31bc87a0 0x55bb31bd45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:15.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.188+0000 7fda16182700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb31bc87a0 0x55bb31bd45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:43170/0 (socket says 172.21.15.50:43170) 2024-06-06T03:27:15.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.188+0000 7fda16182700 1 -- 172.21.15.50:0/2070010248 learned_addr learned my addr 172.21.15.50:0/2070010248 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:15.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.188+0000 7fda22c69b80 10 client.0 _ll_register_callbacks cb 0x55bb31aaf5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:15.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.188+0000 7fda16983700 1 --2- 172.21.15.50:0/2070010248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb31bce880 0x55bb31bd1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:15.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.188+0000 7fda15981700 1 --2- 172.21.15.50:0/2070010248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb31bcdf60 0x55bb31bd1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:15.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.188+0000 7fda16182700 1 -- 172.21.15.50:0/2070010248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb31bcdf60 msgr2=0x55bb31bd1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:15.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.188+0000 7fda16182700 1 --2- 172.21.15.50:0/2070010248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb31bcdf60 0x55bb31bd1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.188+0000 7fda16182700 1 -- 172.21.15.50:0/2070010248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb31bce880 msgr2=0x55bb31bd1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:15.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.188+0000 7fda16182700 1 --2- 172.21.15.50:0/2070010248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb31bce880 0x55bb31bd1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.188+0000 7fda16182700 1 -- 172.21.15.50:0/2070010248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb31adf750 con 0x55bb31bc87a0 2024-06-06T03:27:15.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.188+0000 7fda16182700 1 --2- 172.21.15.50:0/2070010248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb31bc87a0 0x55bb31bd45b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0098e0 tx=0x7fda0c009cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c657e3504ecef48 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:15.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.188+0000 7fd9f9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:27:15.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.189+0000 7fd9f9ffb700 1 -- 172.21.15.50:0/2070010248 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0c028070 con 0x55bb31bc87a0 2024-06-06T03:27:15.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.189+0000 7fda22c69b80 1 -- 172.21.15.50:0/2070010248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda0c0037c0 con 0x55bb31bc87a0 2024-06-06T03:27:15.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.189+0000 7fd9f9ffb700 1 -- 172.21.15.50:0/2070010248 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fda0c00b990 con 0x55bb31bc87a0 2024-06-06T03:27:15.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.189+0000 7fd9f9ffb700 1 -- 172.21.15.50:0/2070010248 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fda0c03b050 con 0x55bb31bc87a0 2024-06-06T03:27:15.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.189+0000 7fda22c69b80 10 client.25010 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:15.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.189+0000 7fda22c69b80 1 -- 172.21.15.50:0/2070010248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bb31bdf6d0 con 0x55bb31bc87a0 2024-06-06T03:27:15.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.189+0000 7fd9f9ffb700 1 -- 172.21.15.50:0/2070010248 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fda0c0037c0 con 0x55bb31bc87a0 2024-06-06T03:27:15.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.189+0000 7fd9f9ffb700 1 -- 172.21.15.50:0/2070010248 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fda0c023a80 con 0x55bb31bc87a0 2024-06-06T03:27:15.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.189+0000 7fda22c69b80 10 client.25010 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:15.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.189+0000 7fda22c69b80 10 client.25010 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:27:15.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.189+0000 7fda22c69b80 20 client.25010 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:15.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.189+0000 7fda22c69b80 1 --2- 172.21.15.50:0/2070010248 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bb31bf2ca0 0x55bb31bf5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:15.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.189+0000 7fda22c69b80 4 client.25010 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:27:15.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.189+0000 7fda22c69b80 1 -- 172.21.15.50:0/2070010248 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb31b26d50 con 0x55bb31bf2ca0 2024-06-06T03:27:15.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.190+0000 7fda15981700 1 --2- 172.21.15.50:0/2070010248 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bb31bf2ca0 0x55bb31bf5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:15.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.190+0000 7fda15981700 1 --2- 172.21.15.50:0/2070010248 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bb31bf2ca0 0x55bb31bf5140 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ae251e9b557dfe0 server_cookie=8a24bc68bb0a48f3 in_seq=0 out_seq=0 2024-06-06T03:27:15.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.190+0000 7fd9f9ffb700 10 client.25010 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:15.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.191+0000 7fd9f9ffb700 1 -- 172.21.15.50:0/2070010248 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55bb31b26d50 con 0x55bb31bf2ca0 2024-06-06T03:27:15.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.191+0000 7fd9f9ffb700 10 client.25010 handle_command_reply: tid=0 2024-06-06T03:27:15.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.191+0000 7fda22c69b80 1 client.25010 shutdown 2024-06-06T03:27:15.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.191+0000 7fda22c69b80 1 -- 172.21.15.50:0/2070010248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb31bc87a0 msgr2=0x55bb31bd45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:15.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.191+0000 7fda22c69b80 1 --2- 172.21.15.50:0/2070010248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb31bc87a0 0x55bb31bd45b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0098e0 tx=0x7fda0c009cd0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.191+0000 7fda22c69b80 1 -- 172.21.15.50:0/2070010248 shutdown_connections 2024-06-06T03:27:15.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.191+0000 7fda22c69b80 1 --2- 172.21.15.50:0/2070010248 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bb31bf2ca0 0x55bb31bf5140 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.191+0000 7fda22c69b80 1 --2- 172.21.15.50:0/2070010248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb31bce880 0x55bb31bd1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.191+0000 7fda22c69b80 1 --2- 172.21.15.50:0/2070010248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb31bc87a0 0x55bb31bd45b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.191+0000 7fda22c69b80 1 --2- 172.21.15.50:0/2070010248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb31bcdf60 0x55bb31bd1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.191+0000 7fda22c69b80 1 -- 172.21.15.50:0/2070010248 >> 172.21.15.50:0/2070010248 conn(0x55bb31af5080 msgr2=0x55bb31bc2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:15.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.191+0000 7fd9f9ffb700 0 client.25010 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:15.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.191+0000 7fda22c69b80 1 -- 172.21.15.50:0/2070010248 shutdown_connections 2024-06-06T03:27:15.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.191+0000 7fda22c69b80 1 -- 172.21.15.50:0/2070010248 wait complete. 2024-06-06T03:27:15.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.191+0000 7fda22c69b80 20 client.25010 trim_cache size 0 max 16384 2024-06-06T03:27:15.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.235+0000 7fda22c69b80 1 Processor -- start 2024-06-06T03:27:15.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.235+0000 7fda22c69b80 1 -- start start 2024-06-06T03:27:15.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.236+0000 7fda22c69b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb31bc87a0 0x55bb31bc8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:15.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.236+0000 7fda22c69b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb31bcdf60 0x55bb31bd1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:15.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.236+0000 7fda22c69b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb31bce880 0x55bb31bcf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:15.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.236+0000 7fda22c69b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fda101a19e0 con 0x55bb31bce880 2024-06-06T03:27:15.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.236+0000 7fda22c69b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fda1019f270 con 0x55bb31bcdf60 2024-06-06T03:27:15.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.236+0000 7fda22c69b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fda1019d0c0 con 0x55bb31bc87a0 2024-06-06T03:27:15.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.236+0000 7fda15981700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb31bcdf60 0x55bb31bd1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:15.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.236+0000 7fda15981700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb31bcdf60 0x55bb31bd1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:43184/0 (socket says 172.21.15.50:43184) 2024-06-06T03:27:15.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.236+0000 7fda16983700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb31bce880 0x55bb31bcf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:15.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.236+0000 7fda15981700 1 -- 172.21.15.50:0/1211591920 learned_addr learned my addr 172.21.15.50:0/1211591920 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:15.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.236+0000 7fda16182700 1 --2- 172.21.15.50:0/1211591920 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb31bc87a0 0x55bb31bc8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:15.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.236+0000 7fda16182700 1 -- 172.21.15.50:0/1211591920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb31bcdf60 msgr2=0x55bb31bd1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:15.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.236+0000 7fda16182700 1 --2- 172.21.15.50:0/1211591920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb31bcdf60 0x55bb31bd1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.236+0000 7fda16182700 1 -- 172.21.15.50:0/1211591920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb31bce880 msgr2=0x55bb31bcf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:15.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.236+0000 7fda16182700 1 --2- 172.21.15.50:0/1211591920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb31bce880 0x55bb31bcf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.236+0000 7fda16182700 1 -- 172.21.15.50:0/1211591920 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb31bcfe70 con 0x55bb31bc87a0 2024-06-06T03:27:15.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.236+0000 7fda16983700 1 --2- 172.21.15.50:0/1211591920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb31bce880 0x55bb31bcf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:27:15.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.237+0000 7fda16182700 1 --2- 172.21.15.50:0/1211591920 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb31bc87a0 0x55bb31bc8260 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fda0c009990 tx=0x7fda0c005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26c9bbe8f1793770 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:15.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.237+0000 7fd9fbfff700 1 -- 172.21.15.50:0/1211591920 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0c055070 con 0x55bb31bc87a0 2024-06-06T03:27:15.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.237+0000 7fd9fbfff700 1 -- 172.21.15.50:0/1211591920 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fda0c029040 con 0x55bb31bc87a0 2024-06-06T03:27:15.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.237+0000 7fd9fbfff700 1 -- 172.21.15.50:0/1211591920 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0c028040 con 0x55bb31bc87a0 2024-06-06T03:27:15.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.238+0000 7fda22c69b80 1 -- 172.21.15.50:0/1211591920 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb31bc87a0 msgr2=0x55bb31bc8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:15.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.238+0000 7fda22c69b80 1 --2- 172.21.15.50:0/1211591920 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb31bc87a0 0x55bb31bc8260 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fda0c009990 tx=0x7fda0c005800 comp rx=0 tx=0).stop 2024-06-06T03:27:15.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.238+0000 7fda22c69b80 1 -- 172.21.15.50:0/1211591920 shutdown_connections 2024-06-06T03:27:15.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.238+0000 7fda22c69b80 1 --2- 172.21.15.50:0/1211591920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb31bce880 0x55bb31bcf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.238+0000 7fda22c69b80 1 --2- 172.21.15.50:0/1211591920 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb31bc87a0 0x55bb31bc8260 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.238+0000 7fda22c69b80 1 --2- 172.21.15.50:0/1211591920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb31bcdf60 0x55bb31bd1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.238+0000 7fda22c69b80 1 -- 172.21.15.50:0/1211591920 >> 172.21.15.50:0/1211591920 conn(0x55bb31af5080 msgr2=0x55bb31bd3970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:15.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.238+0000 7fda22c69b80 1 -- 172.21.15.50:0/1211591920 shutdown_connections 2024-06-06T03:27:15.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.238+0000 7fda22c69b80 1 -- 172.21.15.50:0/1211591920 wait complete. 2024-06-06T03:27:15.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.238+0000 7fda22c69b80 1 -- start start 2024-06-06T03:27:15.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.239+0000 7fda22c69b80 1 Processor -- start 2024-06-06T03:27:15.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.239+0000 7fda22c69b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb31bc87a0 0x55bb31bda820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:15.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.239+0000 7fda22c69b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb31bcdf60 0x55bb31bdad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.239+0000 7fda22c69b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb31bce880 0x55bb31bfa120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.239+0000 7fda22c69b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fda1019d730 con 0x55bb31bcdf60 2024-06-06T03:27:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.239+0000 7fda22c69b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fda1019eba0 con 0x55bb31bc87a0 2024-06-06T03:27:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.239+0000 7fda22c69b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fda1019de00 con 0x55bb31bce880 2024-06-06T03:27:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.239+0000 7fda22c69b80 10 client.0 _ll_register_callbacks cb 0x55bb31aaf5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.239+0000 7fda16182700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb31bc87a0 0x55bb31bda820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.239+0000 7fda16983700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb31bce880 0x55bb31bfa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.239+0000 7fda16182700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb31bc87a0 0x55bb31bda820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:43198/0 (socket says 172.21.15.50:43198) 2024-06-06T03:27:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.239+0000 7fda16182700 1 -- 172.21.15.50:0/3750406443 learned_addr learned my addr 172.21.15.50:0/3750406443 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.239+0000 7fda15981700 1 --2- 172.21.15.50:0/3750406443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb31bcdf60 0x55bb31bdad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.240+0000 7fda16983700 1 -- 172.21.15.50:0/3750406443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb31bc87a0 msgr2=0x55bb31bda820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.240+0000 7fda16983700 1 --2- 172.21.15.50:0/3750406443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb31bc87a0 0x55bb31bda820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.240+0000 7fda16983700 1 -- 172.21.15.50:0/3750406443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb31bcdf60 msgr2=0x55bb31bdad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.240+0000 7fda16983700 1 --2- 172.21.15.50:0/3750406443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb31bcdf60 0x55bb31bdad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.240+0000 7fda16983700 1 -- 172.21.15.50:0/3750406443 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb31bfa930 con 0x55bb31bce880 2024-06-06T03:27:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.240+0000 7fda16983700 1 --2- 172.21.15.50:0/3750406443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb31bce880 0x55bb31bfa120 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fda080cc670 tx=0x7fda08009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=457b68c63c4ae91a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.240+0000 7fd9f9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:27:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.240+0000 7fd9f9ffb700 1 -- 172.21.15.50:0/3750406443 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda08012340 con 0x55bb31bce880 2024-06-06T03:27:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.240+0000 7fda22c69b80 1 -- 172.21.15.50:0/3750406443 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda0c029040 con 0x55bb31bce880 2024-06-06T03:27:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.240+0000 7fd9f9ffb700 1 -- 172.21.15.50:0/3750406443 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fda08004d60 con 0x55bb31bce880 2024-06-06T03:27:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.240+0000 7fd9f9ffb700 1 -- 172.21.15.50:0/3750406443 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fda080a3ff0 con 0x55bb31bce880 2024-06-06T03:27:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.240+0000 7fda22c69b80 10 client.25030 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:15.245 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:27:15.245 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2024-06-06T03:27:15.245 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-06-06T03:27:15.245 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:27:15.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.240+0000 7fda22c69b80 1 -- 172.21.15.50:0/3750406443 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bb31bdf950 con 0x55bb31bce880 2024-06-06T03:27:15.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.240+0000 7fd9f9ffb700 1 -- 172.21.15.50:0/3750406443 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fda0c029040 con 0x55bb31bce880 2024-06-06T03:27:15.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.241+0000 7fd9f9ffb700 1 -- 172.21.15.50:0/3750406443 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fda080bb0b0 con 0x55bb31bce880 2024-06-06T03:27:15.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.241+0000 7fda22c69b80 10 client.25030 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:15.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.241+0000 7fda22c69b80 10 client.25030 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:27:15.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.241+0000 7fda22c69b80 20 client.25030 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:15.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.241+0000 7fda22c69b80 1 --2- 172.21.15.50:0/3750406443 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bb31be0010 0x55bb31be2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:15.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.241+0000 7fda22c69b80 4 client.25030 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-06T03:27:15.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.241+0000 7fda22c69b80 1 -- 172.21.15.50:0/3750406443 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bb31b212d0 con 0x55bb31be0010 2024-06-06T03:27:15.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.241+0000 7fda16182700 1 --2- 172.21.15.50:0/3750406443 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bb31be0010 0x55bb31be2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:15.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.242+0000 7fda16182700 1 --2- 172.21.15.50:0/3750406443 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bb31be0010 0x55bb31be2430 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f9a47a71545dc2d server_cookie=739e0f0b4d64faaa in_seq=0 out_seq=0 2024-06-06T03:27:15.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.242+0000 7fd9f9ffb700 10 client.25030 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:15.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.242+0000 7fd9f9ffb700 1 -- 172.21.15.50:0/3750406443 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55bb31b212d0 con 0x55bb31be0010 2024-06-06T03:27:15.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.242+0000 7fd9f9ffb700 10 client.25030 handle_command_reply: tid=0 2024-06-06T03:27:15.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.242+0000 7fda22c69b80 1 client.25030 shutdown 2024-06-06T03:27:15.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.242+0000 7fda22c69b80 1 -- 172.21.15.50:0/3750406443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb31bce880 msgr2=0x55bb31bfa120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.242+0000 7fda22c69b80 1 --2- 172.21.15.50:0/3750406443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb31bce880 0x55bb31bfa120 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fda080cc670 tx=0x7fda08009f70 comp rx=0 tx=0).stop 2024-06-06T03:27:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.242+0000 7fda22c69b80 1 -- 172.21.15.50:0/3750406443 shutdown_connections 2024-06-06T03:27:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.242+0000 7fda22c69b80 1 --2- 172.21.15.50:0/3750406443 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bb31be0010 0x55bb31be2430 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.242+0000 7fda22c69b80 1 --2- 172.21.15.50:0/3750406443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb31bce880 0x55bb31bfa120 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.242+0000 7fd9f9ffb700 0 client.25030 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.242+0000 7fda22c69b80 1 --2- 172.21.15.50:0/3750406443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb31bc87a0 0x55bb31bda820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.242+0000 7fda22c69b80 1 --2- 172.21.15.50:0/3750406443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb31bcdf60 0x55bb31bdad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.242+0000 7fda22c69b80 1 -- 172.21.15.50:0/3750406443 >> 172.21.15.50:0/3750406443 conn(0x55bb31af5080 msgr2=0x55bb31bd3970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.242+0000 7fda22c69b80 1 -- 172.21.15.50:0/3750406443 shutdown_connections 2024-06-06T03:27:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.242+0000 7fda22c69b80 1 -- 172.21.15.50:0/3750406443 wait complete. 2024-06-06T03:27:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.242+0000 7fda22c69b80 20 client.25030 trim_cache size 0 max 16384 2024-06-06T03:27:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.243+0000 7fda183e6700 1 -- 172.21.15.50:0/1366912699 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd9fc0a2c20 msgr2=0x7fd9fc0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.243+0000 7fda183e6700 1 --2- 172.21.15.50:0/1366912699 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd9fc0a2c20 0x7fd9fc0a50e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fda10075f50 tx=0x7fda00015760 comp rx=0 tx=0).stop 2024-06-06T03:27:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.243+0000 7fda183e6700 1 -- 172.21.15.50:0/1366912699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda10107870 msgr2=0x7fda10075210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:15.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.243+0000 7fda183e6700 1 --2- 172.21.15.50:0/1366912699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda10107870 0x7fda10075210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fda0800efc0 tx=0x7fda0800c3a0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.243+0000 7fda183e6700 1 -- 172.21.15.50:0/1366912699 shutdown_connections 2024-06-06T03:27:15.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.243+0000 7fda183e6700 1 --2- 172.21.15.50:0/1366912699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda10107870 0x7fda10075210 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.243+0000 7fda183e6700 1 --2- 172.21.15.50:0/1366912699 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd9fc0a2c20 0x7fd9fc0a50e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.243+0000 7fda183e6700 1 --2- 172.21.15.50:0/1366912699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda101027a0 0x7fda10074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.243+0000 7fda183e6700 1 --2- 172.21.15.50:0/1366912699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda10103150 0x7fda10074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:15.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.243+0000 7fda183e6700 1 -- 172.21.15.50:0/1366912699 >> 172.21.15.50:0/1366912699 conn(0x7fda10079520 msgr2=0x7fda10100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:15.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.243+0000 7fda183e6700 1 -- 172.21.15.50:0/1366912699 shutdown_connections 2024-06-06T03:27:15.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:15.243+0000 7fda183e6700 1 -- 172.21.15.50:0/1366912699 wait complete. 2024-06-06T03:27:16.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:15 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:27:16.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:15 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:27:16.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:15 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:27:16.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:15 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:27:16.074 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-06T03:27:16.075 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T03:27:16.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:27:16.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:27:16.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:27:16.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:15 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:27:16.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:15 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:27:16.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:15 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:27:16.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:15 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:27:16.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:15 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:27:16.340 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:27:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.887+0000 7f403ce72640 1 -- 172.21.15.50:0/2727319062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4038104dd0 msgr2=0x7f40381071c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.887+0000 7f403ce72640 1 --2- 172.21.15.50:0/2727319062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4038104dd0 0x7f40381071c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f402c009900 tx=0x7f402c02a410 comp rx=0 tx=0).stop 2024-06-06T03:27:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.887+0000 7f403ce72640 1 -- 172.21.15.50:0/2727319062 shutdown_connections 2024-06-06T03:27:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.887+0000 7f403ce72640 1 --2- 172.21.15.50:0/2727319062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4038104dd0 0x7f40381071c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.887+0000 7f403ce72640 1 --2- 172.21.15.50:0/2727319062 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4038107700 0x7f4038109b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.887+0000 7f403ce72640 1 --2- 172.21.15.50:0/2727319062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40381024a0 0x7f4038104890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.887+0000 7f403ce72640 1 -- 172.21.15.50:0/2727319062 >> 172.21.15.50:0/2727319062 conn(0x7f40380fbeb0 msgr2=0x7f40380fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.887+0000 7f403ce72640 1 -- 172.21.15.50:0/2727319062 shutdown_connections 2024-06-06T03:27:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.887+0000 7f403ce72640 1 -- 172.21.15.50:0/2727319062 wait complete. 2024-06-06T03:27:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.888+0000 7f403ce72640 1 Processor -- start 2024-06-06T03:27:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.888+0000 7f403ce72640 1 -- start start 2024-06-06T03:27:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.888+0000 7f403ce72640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40381024a0 0x7f4038197ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.888+0000 7f403ce72640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4038104dd0 0x7f40381980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.888+0000 7f403ce72640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4038107700 0x7f403819f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.888+0000 7f403ce72640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f403810d550 con 0x7f4038107700 2024-06-06T03:27:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.888+0000 7f403ce72640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f403810d3d0 con 0x7f4038104dd0 2024-06-06T03:27:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.888+0000 7f403ce72640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f403810d6d0 con 0x7f40381024a0 2024-06-06T03:27:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.888+0000 7f4036d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4038107700 0x7f403819f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.888+0000 7f4036d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4038107700 0x7f403819f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53480/0 (socket says 172.21.15.50:53480) 2024-06-06T03:27:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.888+0000 7f4036d9d640 1 -- 172.21.15.50:0/2801069945 learned_addr learned my addr 172.21.15.50:0/2801069945 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.888+0000 7f4035d9b640 1 --2- 172.21.15.50:0/2801069945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4038104dd0 0x7f40381980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.888+0000 7f403659c640 1 --2- 172.21.15.50:0/2801069945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40381024a0 0x7f4038197ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.889+0000 7f4036d9d640 1 -- 172.21.15.50:0/2801069945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40381024a0 msgr2=0x7f4038197ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.889+0000 7f4036d9d640 1 --2- 172.21.15.50:0/2801069945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40381024a0 0x7f4038197ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.889+0000 7f4036d9d640 1 -- 172.21.15.50:0/2801069945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4038104dd0 msgr2=0x7f40381980e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.889+0000 7f4036d9d640 1 --2- 172.21.15.50:0/2801069945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4038104dd0 0x7f40381980e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.889+0000 7f4036d9d640 1 -- 172.21.15.50:0/2801069945 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f403819f7c0 con 0x7f4038107700 2024-06-06T03:27:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.889+0000 7f403659c640 1 --2- 172.21.15.50:0/2801069945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40381024a0 0x7f4038197ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:27:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.889+0000 7f4036d9d640 1 --2- 172.21.15.50:0/2801069945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4038107700 0x7f403819f150 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f403000eb10 tx=0x7f403000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.889+0000 7f40277fe640 1 -- 172.21.15.50:0/2801069945 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4030004b20 con 0x7f4038107700 2024-06-06T03:27:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.889+0000 7f403ce72640 1 -- 172.21.15.50:0/2801069945 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f403819fab0 con 0x7f4038107700 2024-06-06T03:27:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.889+0000 7f40277fe640 1 -- 172.21.15.50:0/2801069945 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4030004cc0 con 0x7f4038107700 2024-06-06T03:27:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.889+0000 7f40277fe640 1 -- 172.21.15.50:0/2801069945 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4030010690 con 0x7f4038107700 2024-06-06T03:27:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.889+0000 7f403ce72640 1 -- 172.21.15.50:0/2801069945 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f403819ffd0 con 0x7f4038107700 2024-06-06T03:27:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.892+0000 7f40277fe640 1 -- 172.21.15.50:0/2801069945 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4030005000 con 0x7f4038107700 2024-06-06T03:27:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.892+0000 7f403fb80740 1 Processor -- start 2024-06-06T03:27:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.892+0000 7f403fb80740 1 -- start start 2024-06-06T03:27:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.892+0000 7f403fb80740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb188bc420 0x55bb188bc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.892+0000 7f403fb80740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb188bce10 0x55bb188c1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.892+0000 7f403fb80740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb188c1f80 0x55bb188c4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.892+0000 7f403fb80740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55bb1881b4f0 con 0x55bb188bc420 2024-06-06T03:27:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.892+0000 7f403fb80740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bb187b9870 con 0x55bb188bce10 2024-06-06T03:27:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.892+0000 7f403fb80740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bb188174b0 con 0x55bb188c1f80 2024-06-06T03:27:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.892+0000 7f4035d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb188bc420 0x55bb188bc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.892+0000 7f4035d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb188bc420 0x55bb188bc840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53492/0 (socket says 172.21.15.50:53492) 2024-06-06T03:27:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.892+0000 7f4035d9b640 1 -- 172.21.15.50:0/793982414 learned_addr learned my addr 172.21.15.50:0/793982414 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.892+0000 7f40277fe640 1 --2- 172.21.15.50:0/2801069945 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f40200a2c30 0x7f40200a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.892+0000 7f403659c640 1 --2- 172.21.15.50:0/793982414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb188bce10 0x55bb188c1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.893+0000 7f4035d9b640 1 --2- 172.21.15.50:0/793982414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb188c1f80 0x55bb188c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.893+0000 7f4036d9d640 1 --2- 172.21.15.50:0/2801069945 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f40200a2c30 0x7f40200a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.893+0000 7f4035d9b640 1 -- 172.21.15.50:0/793982414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb188c1f80 msgr2=0x55bb188c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.893+0000 7f40277fe640 1 -- 172.21.15.50:0/2801069945 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f40300cfa60 con 0x7f4038107700 2024-06-06T03:27:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.893+0000 7f4035d9b640 1 --2- 172.21.15.50:0/793982414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb188c1f80 0x55bb188c4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.893+0000 7f4035d9b640 1 -- 172.21.15.50:0/793982414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb188bce10 msgr2=0x55bb188c1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.893+0000 7f4035d9b640 1 --2- 172.21.15.50:0/793982414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb188bce10 0x55bb188c1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.893+0000 7f4035d9b640 1 -- 172.21.15.50:0/793982414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb187d59b0 con 0x55bb188bc420 2024-06-06T03:27:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.893+0000 7f403659c640 1 --2- 172.21.15.50:0/793982414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb188bce10 0x55bb188c1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:27:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.893+0000 7f4035d9b640 1 --2- 172.21.15.50:0/793982414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb188bc420 0x55bb188bc840 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f402c009900 tx=0x7f402c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcdf0b543b4852da server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.893+0000 7f4036d9d640 1 --2- 172.21.15.50:0/2801069945 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f40200a2c30 0x7f40200a50f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4030020000 tx=0x7f40300bc040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.893+0000 7f4024ff9640 1 -- 172.21.15.50:0/793982414 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402c035070 con 0x55bb188bc420 2024-06-06T03:27:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.893+0000 7f4024ff9640 1 -- 172.21.15.50:0/793982414 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f402c031780 con 0x55bb188bc420 2024-06-06T03:27:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.893+0000 7f4024ff9640 1 -- 172.21.15.50:0/793982414 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402c003d70 con 0x55bb188bc420 2024-06-06T03:27:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.894+0000 7f403fb80740 1 -- 172.21.15.50:0/793982414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb188bc420 msgr2=0x55bb188bc840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.894+0000 7f403fb80740 1 --2- 172.21.15.50:0/793982414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb188bc420 0x55bb188bc840 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f402c009900 tx=0x7f402c005fd0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.894+0000 7f403fb80740 1 -- 172.21.15.50:0/793982414 shutdown_connections 2024-06-06T03:27:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.894+0000 7f403fb80740 1 --2- 172.21.15.50:0/793982414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb188c1f80 0x55bb188c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.894+0000 7f403fb80740 1 --2- 172.21.15.50:0/793982414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb188bce10 0x55bb188c1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.894+0000 7f403fb80740 1 --2- 172.21.15.50:0/793982414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb188bc420 0x55bb188bc840 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.894+0000 7f403fb80740 1 -- 172.21.15.50:0/793982414 >> 172.21.15.50:0/793982414 conn(0x55bb188b3680 msgr2=0x55bb188b3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.894+0000 7f403fb80740 1 -- 172.21.15.50:0/793982414 shutdown_connections 2024-06-06T03:27:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.894+0000 7f403fb80740 1 -- 172.21.15.50:0/793982414 wait complete. 2024-06-06T03:27:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.894+0000 7f403fb80740 1 -- start start 2024-06-06T03:27:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.895+0000 7f403fb80740 1 Processor -- start 2024-06-06T03:27:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.895+0000 7f403fb80740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb188bc420 0x55bb188c6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.895+0000 7f403fb80740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb188bce10 0x55bb188c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.895+0000 7f403fb80740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb188c1f80 0x55bb188cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.895+0000 7f403fb80740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55bb188c4ed0 con 0x55bb188c1f80 2024-06-06T03:27:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.895+0000 7f403fb80740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bb187a4ae0 con 0x55bb188bce10 2024-06-06T03:27:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.895+0000 7f403fb80740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bb188c5050 con 0x55bb188bc420 2024-06-06T03:27:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.895+0000 7f403fb80740 10 client.0 _ll_register_callbacks cb 0x55bb187dd9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.895+0000 7f4035d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb188c1f80 0x55bb188cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.895+0000 7f4035d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb188c1f80 0x55bb188cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53506/0 (socket says 172.21.15.50:53506) 2024-06-06T03:27:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.895+0000 7f4035d9b640 1 -- 172.21.15.50:0/4229756060 learned_addr learned my addr 172.21.15.50:0/4229756060 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.895+0000 7f4035d9b640 1 --2- 172.21.15.50:0/4229756060 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb188bc420 0x55bb188c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.895+0000 7f403659c640 1 --2- 172.21.15.50:0/4229756060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb188bce10 0x55bb188c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.895+0000 7f4035d9b640 1 -- 172.21.15.50:0/4229756060 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb188bc420 msgr2=0x55bb188c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.895+0000 7f4035d9b640 1 --2- 172.21.15.50:0/4229756060 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb188bc420 0x55bb188c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.895+0000 7f4035d9b640 1 -- 172.21.15.50:0/4229756060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb188bce10 msgr2=0x55bb188c6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.895+0000 7f4035d9b640 1 --2- 172.21.15.50:0/4229756060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb188bce10 0x55bb188c6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.895+0000 7f4035d9b640 1 -- 172.21.15.50:0/4229756060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb1852f210 con 0x55bb188c1f80 2024-06-06T03:27:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.895+0000 7f4035d9b640 1 --2- 172.21.15.50:0/4229756060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb188c1f80 0x55bb188cdc40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f402c0314e0 tx=0x7f402c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b5025f468ba127 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.896+0000 7f401dffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:27:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.896+0000 7f401dffb640 1 -- 172.21.15.50:0/4229756060 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402c035070 con 0x55bb188c1f80 2024-06-06T03:27:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.896+0000 7f401dffb640 1 -- 172.21.15.50:0/4229756060 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f402c004130 con 0x55bb188c1f80 2024-06-06T03:27:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.896+0000 7f403fb80740 1 -- 172.21.15.50:0/4229756060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f402c031780 con 0x55bb188c1f80 2024-06-06T03:27:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.896+0000 7f401dffb640 1 -- 172.21.15.50:0/4229756060 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f402c004330 con 0x55bb188c1f80 2024-06-06T03:27:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.896+0000 7f403fb80740 10 client.15402 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.896+0000 7f403fb80740 1 -- 172.21.15.50:0/4229756060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bb185fb620 con 0x55bb188c1f80 2024-06-06T03:27:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.896+0000 7f401dffb640 1 -- 172.21.15.50:0/4229756060 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f402c031780 con 0x55bb188c1f80 2024-06-06T03:27:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.896+0000 7f401dffb640 1 -- 172.21.15.50:0/4229756060 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f402c048040 con 0x55bb188c1f80 2024-06-06T03:27:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.896+0000 7f403fb80740 10 client.15402 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.896+0000 7f403fb80740 10 client.15402 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:27:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.896+0000 7f403fb80740 20 client.15402 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.896+0000 7f403fb80740 1 --2- 172.21.15.50:0/4229756060 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bb188d2130 0x55bb188d4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.896+0000 7f403fb80740 4 client.15402 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:27:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.896+0000 7f403fb80740 1 -- 172.21.15.50:0/4229756060 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb1882ef10 con 0x55bb188d2130 2024-06-06T03:27:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.897+0000 7f403659c640 1 --2- 172.21.15.50:0/4229756060 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bb188d2130 0x55bb188d4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.897+0000 7f403659c640 1 --2- 172.21.15.50:0/4229756060 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bb188d2130 0x55bb188d4520 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9a5c8beffa88fd4 server_cookie=cd769e3c9746163b in_seq=0 out_seq=0 2024-06-06T03:27:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.897+0000 7f401dffb640 10 client.15402 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:16.902 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.898+0000 7f401dffb640 1 -- 172.21.15.50:0/4229756060 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55bb1882ef10 con 0x55bb188d2130 2024-06-06T03:27:16.903 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.898+0000 7f401dffb640 10 client.15402 handle_command_reply: tid=0 2024-06-06T03:27:16.903 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.898+0000 7f403fb80740 1 client.15402 shutdown 2024-06-06T03:27:16.903 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.898+0000 7f403fb80740 1 -- 172.21.15.50:0/4229756060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb188c1f80 msgr2=0x55bb188cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:16.903 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.898+0000 7f403fb80740 1 --2- 172.21.15.50:0/4229756060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb188c1f80 0x55bb188cdc40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f402c0314e0 tx=0x7f402c005850 comp rx=0 tx=0).stop 2024-06-06T03:27:16.903 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.898+0000 7f403fb80740 1 -- 172.21.15.50:0/4229756060 shutdown_connections 2024-06-06T03:27:16.903 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.898+0000 7f403fb80740 1 --2- 172.21.15.50:0/4229756060 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bb188d2130 0x55bb188d4520 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.903 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.898+0000 7f403fb80740 1 --2- 172.21.15.50:0/4229756060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb188c1f80 0x55bb188cdc40 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.903 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.898+0000 7f403fb80740 1 --2- 172.21.15.50:0/4229756060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb188bce10 0x55bb188c6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.903 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.898+0000 7f401dffb640 0 client.15402 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:16.903 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.898+0000 7f403fb80740 1 --2- 172.21.15.50:0/4229756060 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb188bc420 0x55bb188c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.903 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.898+0000 7f403fb80740 1 -- 172.21.15.50:0/4229756060 >> 172.21.15.50:0/4229756060 conn(0x55bb188b3680 msgr2=0x55bb188b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:16.903 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.898+0000 7f403fb80740 1 -- 172.21.15.50:0/4229756060 shutdown_connections 2024-06-06T03:27:16.903 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.898+0000 7f403fb80740 1 -- 172.21.15.50:0/4229756060 wait complete. 2024-06-06T03:27:16.904 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.898+0000 7f403fb80740 20 client.15402 trim_cache size 0 max 16384 2024-06-06T03:27:16.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.914+0000 7f403fb80740 1 Processor -- start 2024-06-06T03:27:16.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.914+0000 7f403fb80740 1 -- start start 2024-06-06T03:27:16.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.914+0000 7f403fb80740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb188bc420 0x55bb188b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:16.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.914+0000 7f403fb80740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb188bce10 0x55bb188cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.914+0000 7f403fb80740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb188c1f80 0x55bb188b6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.914+0000 7f403fb80740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f40381aab10 con 0x55bb188bc420 2024-06-06T03:27:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.914+0000 7f403fb80740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f40381a83e0 con 0x55bb188c1f80 2024-06-06T03:27:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.914+0000 7f403fb80740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f40381a6230 con 0x55bb188bce10 2024-06-06T03:27:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.914+0000 7f4035d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb188bc420 0x55bb188b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.914+0000 7f4035d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb188bc420 0x55bb188b2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53516/0 (socket says 172.21.15.50:53516) 2024-06-06T03:27:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.914+0000 7f4035d9b640 1 -- 172.21.15.50:0/2648828832 learned_addr learned my addr 172.21.15.50:0/2648828832 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.914+0000 7f403659c640 1 --2- 172.21.15.50:0/2648828832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb188bce10 0x55bb188cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.914+0000 7f4035d9b640 1 --2- 172.21.15.50:0/2648828832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb188c1f80 0x55bb188b6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.915+0000 7f4035d9b640 1 -- 172.21.15.50:0/2648828832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb188bce10 msgr2=0x55bb188cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.915+0000 7f4035d9b640 1 --2- 172.21.15.50:0/2648828832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb188bce10 0x55bb188cdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.915+0000 7f4035d9b640 1 -- 172.21.15.50:0/2648828832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb188c1f80 msgr2=0x55bb188b6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.915+0000 7f4035d9b640 1 --2- 172.21.15.50:0/2648828832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb188c1f80 0x55bb188b6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.915+0000 7f4035d9b640 1 -- 172.21.15.50:0/2648828832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb188bc800 con 0x55bb188bc420 2024-06-06T03:27:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.915+0000 7f4035d9b640 1 --2- 172.21.15.50:0/2648828832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb188bc420 0x55bb188b2f60 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f402c004720 tx=0x7f402c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb077f788668e314 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.915+0000 7f401ffff640 1 -- 172.21.15.50:0/2648828832 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402c035070 con 0x55bb188bc420 2024-06-06T03:27:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.915+0000 7f401ffff640 1 -- 172.21.15.50:0/2648828832 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f402c060070 con 0x55bb188bc420 2024-06-06T03:27:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.915+0000 7f401ffff640 1 -- 172.21.15.50:0/2648828832 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402c003710 con 0x55bb188bc420 2024-06-06T03:27:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.916+0000 7f403fb80740 1 -- 172.21.15.50:0/2648828832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb188bc420 msgr2=0x55bb188b2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.916+0000 7f403fb80740 1 --2- 172.21.15.50:0/2648828832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb188bc420 0x55bb188b2f60 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f402c004720 tx=0x7f402c005fd0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.916+0000 7f403fb80740 1 -- 172.21.15.50:0/2648828832 shutdown_connections 2024-06-06T03:27:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.916+0000 7f403fb80740 1 --2- 172.21.15.50:0/2648828832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb188c1f80 0x55bb188b6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.916+0000 7f403fb80740 1 --2- 172.21.15.50:0/2648828832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb188bce10 0x55bb188cdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.916+0000 7f403fb80740 1 --2- 172.21.15.50:0/2648828832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb188bc420 0x55bb188b2f60 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.916+0000 7f403fb80740 1 -- 172.21.15.50:0/2648828832 >> 172.21.15.50:0/2648828832 conn(0x55bb188b3680 msgr2=0x55bb188be130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.916+0000 7f403fb80740 1 -- 172.21.15.50:0/2648828832 shutdown_connections 2024-06-06T03:27:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.916+0000 7f403fb80740 1 -- 172.21.15.50:0/2648828832 wait complete. 2024-06-06T03:27:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.916+0000 7f403fb80740 1 -- start start 2024-06-06T03:27:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.916+0000 7f403fb80740 1 Processor -- start 2024-06-06T03:27:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.916+0000 7f403fb80740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb188bc420 0x55bb188cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.916+0000 7f403fb80740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb188bce10 0x55bb188cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.916+0000 7f403fb80740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb188c1f80 0x55bb188cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.916+0000 7f403fb80740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f40381a68a0 con 0x55bb188bc420 2024-06-06T03:27:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.916+0000 7f403fb80740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f40381a7d10 con 0x55bb188bce10 2024-06-06T03:27:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.916+0000 7f403fb80740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f40381a6f70 con 0x55bb188c1f80 2024-06-06T03:27:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.916+0000 7f403fb80740 10 client.0 _ll_register_callbacks cb 0x7f40280095d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.916+0000 7f4035d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb188bc420 0x55bb188cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.916+0000 7f4035d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb188bc420 0x55bb188cadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53524/0 (socket says 172.21.15.50:53524) 2024-06-06T03:27:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.916+0000 7f4035d9b640 1 -- 172.21.15.50:0/1570229305 learned_addr learned my addr 172.21.15.50:0/1570229305 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.917+0000 7f403659c640 1 --2- 172.21.15.50:0/1570229305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb188bce10 0x55bb188cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.917+0000 7f4035d9b640 1 --2- 172.21.15.50:0/1570229305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb188c1f80 0x55bb188cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.917+0000 7f4035d9b640 1 -- 172.21.15.50:0/1570229305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb188c1f80 msgr2=0x55bb188cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.917+0000 7f4035d9b640 1 --2- 172.21.15.50:0/1570229305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb188c1f80 0x55bb188cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.917+0000 7f4035d9b640 1 -- 172.21.15.50:0/1570229305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb188bce10 msgr2=0x55bb188cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.917+0000 7f4035d9b640 1 --2- 172.21.15.50:0/1570229305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb188bce10 0x55bb188cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.917+0000 7f4035d9b640 1 -- 172.21.15.50:0/1570229305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb188cc890 con 0x55bb188bc420 2024-06-06T03:27:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.917+0000 7f403659c640 1 --2- 172.21.15.50:0/1570229305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb188bce10 0x55bb188cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:27:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.917+0000 7f4035d9b640 1 --2- 172.21.15.50:0/1570229305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb188bc420 0x55bb188cadf0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f402c009900 tx=0x7f402c059580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d1fc4acecfc243 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.917+0000 7f401dffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:27:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.917+0000 7f401dffb640 1 -- 172.21.15.50:0/1570229305 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402c035030 con 0x55bb188bc420 2024-06-06T03:27:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.917+0000 7f401dffb640 1 -- 172.21.15.50:0/1570229305 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f402c0038a0 con 0x55bb188bc420 2024-06-06T03:27:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.917+0000 7f403fb80740 1 -- 172.21.15.50:0/1570229305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f402c060070 con 0x55bb188bc420 2024-06-06T03:27:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.917+0000 7f401dffb640 1 -- 172.21.15.50:0/1570229305 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f402c005850 con 0x55bb188bc420 2024-06-06T03:27:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.917+0000 7f403fb80740 10 client.15408 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.917+0000 7f403fb80740 1 -- 172.21.15.50:0/1570229305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bb188cdba0 con 0x55bb188bc420 2024-06-06T03:27:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.918+0000 7f401dffb640 1 -- 172.21.15.50:0/1570229305 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f402c060070 con 0x55bb188bc420 2024-06-06T03:27:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.918+0000 7f401dffb640 1 -- 172.21.15.50:0/1570229305 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f402c03d9e0 con 0x55bb188bc420 2024-06-06T03:27:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.918+0000 7f403fb80740 10 client.15408 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.918+0000 7f403fb80740 10 client.15408 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:27:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.918+0000 7f403fb80740 20 client.15408 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.918+0000 7f403fb80740 1 --2- 172.21.15.50:0/1570229305 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bb1893cea0 0x55bb1893f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.918+0000 7f403fb80740 4 client.15408 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:27:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.918+0000 7f403fb80740 1 -- 172.21.15.50:0/1570229305 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bb18828c20 con 0x55bb1893cea0 2024-06-06T03:27:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.918+0000 7f403659c640 1 --2- 172.21.15.50:0/1570229305 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bb1893cea0 0x55bb1893f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.919+0000 7f401dffb640 10 client.15408 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.919+0000 7f403659c640 1 --2- 172.21.15.50:0/1570229305 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bb1893cea0 0x55bb1893f2c0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7b31b53a0c459d8 server_cookie=27f273409d0ffe6b in_seq=0 out_seq=0 2024-06-06T03:27:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.925+0000 7f401dffb640 1 -- 172.21.15.50:0/1570229305 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55bb18828c20 con 0x55bb1893cea0 2024-06-06T03:27:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.925+0000 7f401dffb640 10 client.15408 handle_command_reply: tid=0 2024-06-06T03:27:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.925+0000 7f403fb80740 1 client.15408 shutdown 2024-06-06T03:27:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.925+0000 7f403fb80740 1 -- 172.21.15.50:0/1570229305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb188bc420 msgr2=0x55bb188cadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.925+0000 7f403fb80740 1 --2- 172.21.15.50:0/1570229305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb188bc420 0x55bb188cadf0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f402c009900 tx=0x7f402c059580 comp rx=0 tx=0).stop 2024-06-06T03:27:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.925+0000 7f403fb80740 1 -- 172.21.15.50:0/1570229305 shutdown_connections 2024-06-06T03:27:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.925+0000 7f403fb80740 1 --2- 172.21.15.50:0/1570229305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb188c1f80 0x55bb188cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.925+0000 7f403fb80740 1 --2- 172.21.15.50:0/1570229305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb188bce10 0x55bb188cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.925+0000 7f403fb80740 1 --2- 172.21.15.50:0/1570229305 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bb1893cea0 0x55bb1893f2c0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.925+0000 7f403fb80740 1 --2- 172.21.15.50:0/1570229305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb188bc420 0x55bb188cadf0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.925+0000 7f401dffb640 0 client.15408 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.925+0000 7f403fb80740 1 -- 172.21.15.50:0/1570229305 >> 172.21.15.50:0/1570229305 conn(0x55bb188b3680 msgr2=0x55bb188b6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.925+0000 7f403fb80740 1 -- 172.21.15.50:0/1570229305 shutdown_connections 2024-06-06T03:27:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.925+0000 7f403fb80740 1 -- 172.21.15.50:0/1570229305 wait complete. 2024-06-06T03:27:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.925+0000 7f403fb80740 20 client.15408 trim_cache size 0 max 16384 2024-06-06T03:27:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:27:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:27:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:27:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.926+0000 7f403ce72640 1 -- 172.21.15.50:0/2801069945 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f40200a2c30 msgr2=0x7f40200a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.926+0000 7f403ce72640 1 --2- 172.21.15.50:0/2801069945 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f40200a2c30 0x7f40200a50f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4030020000 tx=0x7f40300bc040 comp rx=0 tx=0).stop 2024-06-06T03:27:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.926+0000 7f403ce72640 1 -- 172.21.15.50:0/2801069945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4038107700 msgr2=0x7f403819f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.926+0000 7f403ce72640 1 --2- 172.21.15.50:0/2801069945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4038107700 0x7f403819f150 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f403000eb10 tx=0x7f403000c2d0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.926+0000 7f403ce72640 1 -- 172.21.15.50:0/2801069945 shutdown_connections 2024-06-06T03:27:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.926+0000 7f403ce72640 1 --2- 172.21.15.50:0/2801069945 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f40200a2c30 0x7f40200a50f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.926+0000 7f403ce72640 1 --2- 172.21.15.50:0/2801069945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4038107700 0x7f403819f150 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.926+0000 7f403ce72640 1 --2- 172.21.15.50:0/2801069945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4038104dd0 0x7f40381980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.926+0000 7f403ce72640 1 --2- 172.21.15.50:0/2801069945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40381024a0 0x7f4038197ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.926+0000 7f403ce72640 1 -- 172.21.15.50:0/2801069945 >> 172.21.15.50:0/2801069945 conn(0x7f40380fbeb0 msgr2=0x7f4038102e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.926+0000 7f403ce72640 1 -- 172.21.15.50:0/2801069945 shutdown_connections 2024-06-06T03:27:16.928 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:16.926+0000 7f403ce72640 1 -- 172.21.15.50:0/2801069945 wait complete. 2024-06-06T03:27:17.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:16 smithi050 ceph-mon[32421]: pgmap v450: 129 pgs: 129 active+clean; 667 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 682 B/s wr, 8 op/s 2024-06-06T03:27:17.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:16 smithi079 ceph-mon[35478]: pgmap v450: 129 pgs: 129 active+clean; 667 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 682 B/s wr, 8 op/s 2024-06-06T03:27:17.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:16 smithi122 ceph-mon[35759]: pgmap v450: 129 pgs: 129 active+clean; 667 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 682 B/s wr, 8 op/s 2024-06-06T03:27:18.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.191+0000 7ff916d56700 1 -- 172.21.15.50:0/335894744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff910101d40 msgr2=0x7ff91010e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:18.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.191+0000 7ff916d56700 1 --2- 172.21.15.50:0/335894744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff910101d40 0x7ff91010e230 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff90800b0a0 tx=0x7ff90800b3b0 comp rx=0 tx=0).stop 2024-06-06T03:27:18.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.191+0000 7ff916d56700 1 -- 172.21.15.50:0/335894744 shutdown_connections 2024-06-06T03:27:18.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.191+0000 7ff916d56700 1 --2- 172.21.15.50:0/335894744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff910101d40 0x7ff91010e230 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:18.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.191+0000 7ff916d56700 1 --2- 172.21.15.50:0/335894744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9101073f0 0x7ff9101077d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:18.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.191+0000 7ff916d56700 1 --2- 172.21.15.50:0/335894744 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff910101380 0x7ff910101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:18.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.191+0000 7ff916d56700 1 -- 172.21.15.50:0/335894744 >> 172.21.15.50:0/335894744 conn(0x7ff910078300 msgr2=0x7ff910078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:18.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.191+0000 7ff916d56700 1 -- 172.21.15.50:0/335894744 shutdown_connections 2024-06-06T03:27:18.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.191+0000 7ff916d56700 1 -- 172.21.15.50:0/335894744 wait complete. 2024-06-06T03:27:18.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.192+0000 7ff916d56700 1 Processor -- start 2024-06-06T03:27:18.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.192+0000 7ff916d56700 1 -- start start 2024-06-06T03:27:18.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.192+0000 7ff916d56700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff910101380 0x7ff91019e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:18.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.193+0000 7ff916d56700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff910101d40 0x7ff91019ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:18.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.193+0000 7ff916d56700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9101073f0 0x7ff910198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:18.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.193+0000 7ff916d56700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff910111590 con 0x7ff910101d40 2024-06-06T03:27:18.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.193+0000 7ff916d56700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff910111410 con 0x7ff9101073f0 2024-06-06T03:27:18.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.193+0000 7ff916d56700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff910111710 con 0x7ff910101380 2024-06-06T03:27:18.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.193+0000 7ff90ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff910101d40 0x7ff91019ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:18.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.193+0000 7ff90ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff910101d40 0x7ff91019ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40484/0 (socket says 172.21.15.50:40484) 2024-06-06T03:27:18.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.193+0000 7ff90ffff700 1 -- 172.21.15.50:0/2927893133 learned_addr learned my addr 172.21.15.50:0/2927893133 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:18.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.193+0000 7ff9152f3700 1 --2- 172.21.15.50:0/2927893133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9101073f0 0x7ff910198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:18.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.193+0000 7ff914af2700 1 --2- 172.21.15.50:0/2927893133 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff910101380 0x7ff91019e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:18.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.193+0000 7ff90ffff700 1 -- 172.21.15.50:0/2927893133 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff910101380 msgr2=0x7ff91019e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:18.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.193+0000 7ff90ffff700 1 --2- 172.21.15.50:0/2927893133 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff910101380 0x7ff91019e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:18.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.193+0000 7ff90ffff700 1 -- 172.21.15.50:0/2927893133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9101073f0 msgr2=0x7ff910198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:18.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.193+0000 7ff90ffff700 1 --2- 172.21.15.50:0/2927893133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9101073f0 0x7ff910198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:18.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.193+0000 7ff90ffff700 1 -- 172.21.15.50:0/2927893133 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9101990b0 con 0x7ff910101d40 2024-06-06T03:27:18.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.193+0000 7ff90ffff700 1 --2- 172.21.15.50:0/2927893133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff910101d40 0x7ff91019ecd0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc00d980 tx=0x7ff8fc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:18.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.194+0000 7ff90dffb700 1 -- 172.21.15.50:0/2927893133 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc017070 con 0x7ff910101d40 2024-06-06T03:27:18.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.194+0000 7ff90dffb700 1 -- 172.21.15.50:0/2927893133 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff8fc005020 con 0x7ff910101d40 2024-06-06T03:27:18.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.194+0000 7ff916d56700 1 -- 172.21.15.50:0/2927893133 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9101993a0 con 0x7ff910101d40 2024-06-06T03:27:18.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.194+0000 7ff90dffb700 1 -- 172.21.15.50:0/2927893133 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc009b50 con 0x7ff910101d40 2024-06-06T03:27:18.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.194+0000 7ff916d56700 1 -- 172.21.15.50:0/2927893133 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9101a5660 con 0x7ff910101d40 2024-06-06T03:27:18.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.195+0000 7ff916d56700 1 -- 172.21.15.50:0/2927893133 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff910069180 con 0x7ff910101d40 2024-06-06T03:27:18.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.196+0000 7ff90dffb700 1 -- 172.21.15.50:0/2927893133 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff8fc009cf0 con 0x7ff910101d40 2024-06-06T03:27:18.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.197+0000 7ff90dffb700 1 --2- 172.21.15.50:0/2927893133 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff9000a2c20 0x7ff9000a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:18.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.197+0000 7ff914af2700 1 --2- 172.21.15.50:0/2927893133 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff9000a2c20 0x7ff9000a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:18.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.197+0000 7ff90dffb700 1 -- 172.21.15.50:0/2927893133 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7ff8fc0cf390 con 0x7ff910101d40 2024-06-06T03:27:18.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.197+0000 7ff914af2700 1 --2- 172.21.15.50:0/2927893133 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff9000a2c20 0x7ff9000a50e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff910199a90 tx=0x7ff90400b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:18.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.202+0000 7ff90dffb700 1 -- 172.21.15.50:0/2927893133 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff8fc020020 con 0x7ff910101d40 2024-06-06T03:27:18.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.484+0000 7ff916d56700 1 -- 172.21.15.50:0/2927893133 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9101a5830 con 0x7ff910101d40 2024-06-06T03:27:18.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.485+0000 7ff90dffb700 1 -- 172.21.15.50:0/2927893133 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11855 (secure 0 0 0) 0x7ff8fc09bf10 con 0x7ff910101d40 2024-06-06T03:27:18.484 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:27:18.485 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1667847852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1667847852},{"type":"v1","addr":"172.21.15.50:6835","nonce":1667847852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/239971838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":239971838},{"type":"v1","addr":"172.21.15.50:6837","nonce":239971838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/2188134216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2188134216},{"type":"v1","addr":"172.21.15.50:6839","nonce":2188134216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/632572420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":632572420},{"type":"v1","addr":"172.21.15.50:6841","nonce":632572420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/864537078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":864537078},{"type":"v1","addr":"172.21.15.79:6833","nonce":864537078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/279268898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":279268898},{"type":"v1","addr":"172.21.15.79:6835","nonce":279268898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T03:22:36.202061+0000","modified":"2024-06-06T03:26:24.959500+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24490,"mds_1":24472,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/57533154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":57533154},{"type":"v1","addr":"172.21.15.122:6833","nonce":57533154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/3286722213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3286722213},{"type":"v1","addr":"172.21.15.79:6837","nonce":3286722213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/768067336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":768067336},{"type":"v1","addr":"172.21.15.79:6839","nonce":768067336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.122:6835/2987597320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2987597320},{"type":"v1","addr":"172.21.15.122:6835","nonce":2987597320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":23,"addr":"172.21.15.122:6837/1604366318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1604366318},{"type":"v1","addr":"172.21.15.122:6837","nonce":1604366318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6839/4129732900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":4129732900},{"type":"v1","addr":"172.21.15.122:6839","nonce":4129732900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24466,24472,24490]},"id":1}]} 2024-06-06T03:27:18.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.488+0000 7ff916d56700 1 -- 172.21.15.50:0/2927893133 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff9000a2c20 msgr2=0x7ff9000a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:18.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.488+0000 7ff916d56700 1 --2- 172.21.15.50:0/2927893133 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff9000a2c20 0x7ff9000a50e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff910199a90 tx=0x7ff90400b5b0 comp rx=0 tx=0).stop 2024-06-06T03:27:18.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.488+0000 7ff916d56700 1 -- 172.21.15.50:0/2927893133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff910101d40 msgr2=0x7ff91019ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:18.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.488+0000 7ff916d56700 1 --2- 172.21.15.50:0/2927893133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff910101d40 0x7ff91019ecd0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc00d980 tx=0x7ff8fc00dc90 comp rx=0 tx=0).stop 2024-06-06T03:27:18.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.488+0000 7ff916d56700 1 -- 172.21.15.50:0/2927893133 shutdown_connections 2024-06-06T03:27:18.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.488+0000 7ff916d56700 1 --2- 172.21.15.50:0/2927893133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9101073f0 0x7ff910198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:18.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.488+0000 7ff916d56700 1 --2- 172.21.15.50:0/2927893133 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff910101380 0x7ff91019e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:18.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.488+0000 7ff916d56700 1 --2- 172.21.15.50:0/2927893133 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff9000a2c20 0x7ff9000a50e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:18.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.488+0000 7ff916d56700 1 --2- 172.21.15.50:0/2927893133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff910101d40 0x7ff91019ecd0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:18.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.488+0000 7ff916d56700 1 -- 172.21.15.50:0/2927893133 >> 172.21.15.50:0/2927893133 conn(0x7ff910078300 msgr2=0x7ff910100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:18.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.488+0000 7ff916d56700 1 -- 172.21.15.50:0/2927893133 shutdown_connections 2024-06-06T03:27:18.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:18.488+0000 7ff916d56700 1 -- 172.21.15.50:0/2927893133 wait complete. 2024-06-06T03:27:18.488 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 27 2024-06-06T03:27:18.743 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:18 smithi050 ceph-mon[32421]: pgmap v451: 129 pgs: 129 active+clean; 667 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-06-06T03:27:18.743 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:18 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/2927893133' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:27:19.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:18 smithi079 ceph-mon[35478]: pgmap v451: 129 pgs: 129 active+clean; 667 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-06-06T03:27:19.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:18 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/2927893133' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:27:19.167 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-06-06T03:27:19.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:18 smithi122 ceph-mon[35759]: pgmap v451: 129 pgs: 129 active+clean; 667 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-06-06T03:27:19.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:18 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/2927893133' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:27:19.433 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:27:20.899 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:20 smithi050 ceph-mon[32421]: pgmap v452: 129 pgs: 129 active+clean; 668 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 8 op/s 2024-06-06T03:27:21.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:20 smithi079 ceph-mon[35478]: pgmap v452: 129 pgs: 129 active+clean; 668 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 8 op/s 2024-06-06T03:27:21.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.132+0000 7fba76fb0700 1 -- 172.21.15.50:0/2488038345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba70107470 msgr2=0x7fba70107850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:21.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.132+0000 7fba76fb0700 1 --2- 172.21.15.50:0/2488038345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba70107470 0x7fba70107850 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fba64009990 tx=0x7fba64009ca0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.132+0000 7fba76fb0700 1 -- 172.21.15.50:0/2488038345 shutdown_connections 2024-06-06T03:27:21.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.132+0000 7fba76fb0700 1 --2- 172.21.15.50:0/2488038345 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba70101e80 0x7fba7010e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.132+0000 7fba76fb0700 1 --2- 172.21.15.50:0/2488038345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba70107470 0x7fba70107850 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.132+0000 7fba76fb0700 1 --2- 172.21.15.50:0/2488038345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba701014c0 0x7fba70101940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.132+0000 7fba76fb0700 1 -- 172.21.15.50:0/2488038345 >> 172.21.15.50:0/2488038345 conn(0x7fba700772a0 msgr2=0x7fba700776b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:21.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.132+0000 7fba76fb0700 1 -- 172.21.15.50:0/2488038345 shutdown_connections 2024-06-06T03:27:21.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.133+0000 7fba76fb0700 1 -- 172.21.15.50:0/2488038345 wait complete. 2024-06-06T03:27:21.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.133+0000 7fba76fb0700 1 Processor -- start 2024-06-06T03:27:21.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.133+0000 7fba76fb0700 1 -- start start 2024-06-06T03:27:21.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.134+0000 7fba76fb0700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba701014c0 0x7fba70199a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:21.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.134+0000 7fba76fb0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba70101e80 0x7fba70199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:21.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.134+0000 7fba76fb0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba70107470 0x7fba701a4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:21.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.134+0000 7fba76fb0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fba70111580 con 0x7fba70107470 2024-06-06T03:27:21.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.134+0000 7fba76fb0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fba70111400 con 0x7fba70101e80 2024-06-06T03:27:21.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.134+0000 7fba76fb0700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fba70111700 con 0x7fba701014c0 2024-06-06T03:27:21.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.134+0000 7fba7554d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba70107470 0x7fba701a4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:21.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.134+0000 7fba7554d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba70107470 0x7fba701a4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40502/0 (socket says 172.21.15.50:40502) 2024-06-06T03:27:21.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.134+0000 7fba7554d700 1 -- 172.21.15.50:0/2759303786 learned_addr learned my addr 172.21.15.50:0/2759303786 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:21.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.134+0000 7fba74d4c700 1 --2- 172.21.15.50:0/2759303786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba701014c0 0x7fba70199a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:21.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.134+0000 7fba6ffff700 1 --2- 172.21.15.50:0/2759303786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba70101e80 0x7fba70199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:21.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.134+0000 7fba7554d700 1 -- 172.21.15.50:0/2759303786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba701014c0 msgr2=0x7fba70199a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:21.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.134+0000 7fba7554d700 1 --2- 172.21.15.50:0/2759303786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba701014c0 0x7fba70199a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.134+0000 7fba7554d700 1 -- 172.21.15.50:0/2759303786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba70101e80 msgr2=0x7fba70199f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:21.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.134+0000 7fba7554d700 1 --2- 172.21.15.50:0/2759303786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba70101e80 0x7fba70199f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.134+0000 7fba7554d700 1 -- 172.21.15.50:0/2759303786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba701a5000 con 0x7fba70107470 2024-06-06T03:27:21.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.134+0000 7fba6ffff700 1 --2- 172.21.15.50:0/2759303786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba70101e80 0x7fba70199f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:27:21.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.134+0000 7fba74d4c700 1 --2- 172.21.15.50:0/2759303786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba701014c0 0x7fba70199a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:27:21.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.134+0000 7fba7554d700 1 --2- 172.21.15.50:0/2759303786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba70107470 0x7fba701a4ac0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fba68007ee0 tx=0x7fba6800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:21.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.135+0000 7fba6dffb700 1 -- 172.21.15.50:0/2759303786 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6800ddd0 con 0x7fba70107470 2024-06-06T03:27:21.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.135+0000 7fba6dffb700 1 -- 172.21.15.50:0/2759303786 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fba68004020 con 0x7fba70107470 2024-06-06T03:27:21.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.135+0000 7fba6dffb700 1 -- 172.21.15.50:0/2759303786 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba68015660 con 0x7fba70107470 2024-06-06T03:27:21.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.135+0000 7fba76fb0700 1 -- 172.21.15.50:0/2759303786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba701a5230 con 0x7fba70107470 2024-06-06T03:27:21.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.135+0000 7fba76fb0700 1 -- 172.21.15.50:0/2759303786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba701a5680 con 0x7fba70107470 2024-06-06T03:27:21.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.138+0000 7fba6dffb700 1 -- 172.21.15.50:0/2759303786 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fba68003a00 con 0x7fba70107470 2024-06-06T03:27:21.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.139+0000 7fba6dffb700 1 --2- 172.21.15.50:0/2759303786 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fba600a2c20 0x7fba600a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:21.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.139+0000 7fba81833b80 1 Processor -- start 2024-06-06T03:27:21.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.139+0000 7fba74d4c700 1 --2- 172.21.15.50:0/2759303786 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fba600a2c20 0x7fba600a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:21.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.139+0000 7fba6dffb700 1 -- 172.21.15.50:0/2759303786 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fba680cee30 con 0x7fba70107470 2024-06-06T03:27:21.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.139+0000 7fba81833b80 1 -- start start 2024-06-06T03:27:21.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.140+0000 7fba81833b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623b40ea370 0x5623b40ea750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:21.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.140+0000 7fba81833b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623b40eac90 0x5623b40e4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:21.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.140+0000 7fba81833b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623b40e4bb0 0x5623b40e4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:21.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.140+0000 7fba81833b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5623b3fd2f60 con 0x5623b40eac90 2024-06-06T03:27:21.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.140+0000 7fba81833b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5623b4031850 con 0x5623b40ea370 2024-06-06T03:27:21.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.140+0000 7fba81833b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5623b3f99460 con 0x5623b40e4bb0 2024-06-06T03:27:21.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.140+0000 7fba6ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623b40eac90 0x5623b40e4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:21.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.140+0000 7fba74d4c700 1 --2- 172.21.15.50:0/2759303786 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fba600a2c20 0x7fba600a50e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fba64006010 tx=0x7fba6401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:21.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.140+0000 7fba6ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623b40eac90 0x5623b40e4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40508/0 (socket says 172.21.15.50:40508) 2024-06-06T03:27:21.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.140+0000 7fba6ffff700 1 -- 172.21.15.50:0/4162976630 learned_addr learned my addr 172.21.15.50:0/4162976630 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:21.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.140+0000 7fba74d4c700 1 --2- 172.21.15.50:0/4162976630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623b40ea370 0x5623b40ea750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:21.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.140+0000 7fba7554d700 1 --2- 172.21.15.50:0/4162976630 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623b40e4bb0 0x5623b40e4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:21.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.140+0000 7fba6ffff700 1 -- 172.21.15.50:0/4162976630 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623b40e4bb0 msgr2=0x5623b40e4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:21.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.140+0000 7fba6ffff700 1 --2- 172.21.15.50:0/4162976630 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623b40e4bb0 0x5623b40e4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.140+0000 7fba6ffff700 1 -- 172.21.15.50:0/4162976630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623b40ea370 msgr2=0x5623b40ea750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:21.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.140+0000 7fba6ffff700 1 --2- 172.21.15.50:0/4162976630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623b40ea370 0x5623b40ea750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.140+0000 7fba6ffff700 1 -- 172.21.15.50:0/4162976630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623b3f808d0 con 0x5623b40eac90 2024-06-06T03:27:21.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.140+0000 7fba6ffff700 1 --2- 172.21.15.50:0/4162976630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623b40eac90 0x5623b40e4670 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fba5c009c70 tx=0x7fba5c009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e289df0488fd7f4f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:21.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.141+0000 7fba5affd700 1 -- 172.21.15.50:0/4162976630 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5c016070 con 0x5623b40eac90 2024-06-06T03:27:21.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.141+0000 7fba5affd700 1 -- 172.21.15.50:0/4162976630 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fba5c004ce0 con 0x5623b40eac90 2024-06-06T03:27:21.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.141+0000 7fba5affd700 1 -- 172.21.15.50:0/4162976630 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5c005530 con 0x5623b40eac90 2024-06-06T03:27:21.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.141+0000 7fba81833b80 1 -- 172.21.15.50:0/4162976630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623b40eac90 msgr2=0x5623b40e4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:21.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.141+0000 7fba81833b80 1 --2- 172.21.15.50:0/4162976630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623b40eac90 0x5623b40e4670 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fba5c009c70 tx=0x7fba5c009f80 comp rx=0 tx=0).stop 2024-06-06T03:27:21.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.142+0000 7fba81833b80 1 -- 172.21.15.50:0/4162976630 shutdown_connections 2024-06-06T03:27:21.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.142+0000 7fba81833b80 1 --2- 172.21.15.50:0/4162976630 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623b40e4bb0 0x5623b40e4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.142+0000 7fba81833b80 1 --2- 172.21.15.50:0/4162976630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623b40ea370 0x5623b40ea750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.142+0000 7fba81833b80 1 --2- 172.21.15.50:0/4162976630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623b40eac90 0x5623b40e4670 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.142+0000 7fba81833b80 1 -- 172.21.15.50:0/4162976630 >> 172.21.15.50:0/4162976630 conn(0x5623b400d080 msgr2=0x5623b40db220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:21.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.142+0000 7fba81833b80 1 -- 172.21.15.50:0/4162976630 shutdown_connections 2024-06-06T03:27:21.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.142+0000 7fba81833b80 1 -- 172.21.15.50:0/4162976630 wait complete. 2024-06-06T03:27:21.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.142+0000 7fba81833b80 1 -- start start 2024-06-06T03:27:21.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.142+0000 7fba81833b80 1 Processor -- start 2024-06-06T03:27:21.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.143+0000 7fba81833b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623b40e4bb0 0x5623b40f0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:21.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.143+0000 7fba81833b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623b40ea370 0x5623b40edd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:21.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.143+0000 7fba81833b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623b40eac90 0x5623b40ee280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:21.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.143+0000 7fba81833b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5623b3fd1fc0 con 0x5623b40eac90 2024-06-06T03:27:21.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.143+0000 7fba81833b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5623b402d810 con 0x5623b40ea370 2024-06-06T03:27:21.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.143+0000 7fba81833b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5623b40f1670 con 0x5623b40e4bb0 2024-06-06T03:27:21.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.143+0000 7fba81833b80 10 client.0 _ll_register_callbacks cb 0x5623b3fc75b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:21.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.143+0000 7fba6ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623b40ea370 0x5623b40edd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:21.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.143+0000 7fba7554d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623b40eac90 0x5623b40ee280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:21.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.143+0000 7fba6ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623b40ea370 0x5623b40edd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:34280/0 (socket says 172.21.15.50:34280) 2024-06-06T03:27:21.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.143+0000 7fba6ffff700 1 -- 172.21.15.50:0/3772486779 learned_addr learned my addr 172.21.15.50:0/3772486779 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:21.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.143+0000 7fba74d4c700 1 --2- 172.21.15.50:0/3772486779 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623b40e4bb0 0x5623b40f0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:21.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.143+0000 7fba7554d700 1 -- 172.21.15.50:0/3772486779 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623b40e4bb0 msgr2=0x5623b40f0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:21.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.143+0000 7fba7554d700 1 --2- 172.21.15.50:0/3772486779 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623b40e4bb0 0x5623b40f0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.143+0000 7fba7554d700 1 -- 172.21.15.50:0/3772486779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623b40ea370 msgr2=0x5623b40edd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:21.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.143+0000 7fba7554d700 1 --2- 172.21.15.50:0/3772486779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623b40ea370 0x5623b40edd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.143+0000 7fba7554d700 1 -- 172.21.15.50:0/3772486779 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623b3ff7750 con 0x5623b40eac90 2024-06-06T03:27:21.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.143+0000 7fba74d4c700 1 --2- 172.21.15.50:0/3772486779 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623b40e4bb0 0x5623b40f0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:27:21.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.143+0000 7fba7554d700 1 --2- 172.21.15.50:0/3772486779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623b40eac90 0x5623b40ee280 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fba6809afb0 tx=0x7fba6809baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33449bdf6d9924fe server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:21.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.143+0000 7fba4ffff700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:27:21.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.144+0000 7fba4ffff700 1 -- 172.21.15.50:0/3772486779 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba68097920 con 0x5623b40eac90 2024-06-06T03:27:21.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.144+0000 7fba4ffff700 1 -- 172.21.15.50:0/3772486779 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fba6809b510 con 0x5623b40eac90 2024-06-06T03:27:21.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.144+0000 7fba81833b80 1 -- 172.21.15.50:0/3772486779 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba5c004ce0 con 0x5623b40eac90 2024-06-06T03:27:21.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.144+0000 7fba4ffff700 1 -- 172.21.15.50:0/3772486779 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fba68097ac0 con 0x5623b40eac90 2024-06-06T03:27:21.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.144+0000 7fba81833b80 10 client.15426 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:21.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.144+0000 7fba81833b80 1 -- 172.21.15.50:0/3772486779 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5623b40fbe30 con 0x5623b40eac90 2024-06-06T03:27:21.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.144+0000 7fba4ffff700 1 -- 172.21.15.50:0/3772486779 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fba5c004ce0 con 0x5623b40eac90 2024-06-06T03:27:21.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.144+0000 7fba4ffff700 1 -- 172.21.15.50:0/3772486779 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fba680a3a90 con 0x5623b40eac90 2024-06-06T03:27:21.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.144+0000 7fba81833b80 10 client.15426 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:21.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.144+0000 7fba81833b80 10 client.15426 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-06-06T03:27:21.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.144+0000 7fba81833b80 20 client.15426 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:21.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.145+0000 7fba81833b80 1 --2- 172.21.15.50:0/3772486779 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x5623b40fe300 0x5623b4100760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:21.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.145+0000 7fba81833b80 4 client.15426 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:27:21.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.145+0000 7fba81833b80 1 -- 172.21.15.50:0/3772486779 --> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623b403ed50 con 0x5623b40fe300 2024-06-06T03:27:21.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.145+0000 7fba74d4c700 1 --2- 172.21.15.50:0/3772486779 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x5623b40fe300 0x5623b4100760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:21.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.145+0000 7fba4ffff700 10 client.15426 ms_handle_connect on v2:172.21.15.122:6834/2987597320 2024-06-06T03:27:21.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.145+0000 7fba74d4c700 1 --2- 172.21.15.50:0/3772486779 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x5623b40fe300 0x5623b4100760 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4218ba214265faef server_cookie=4a1c5be5ef3a951a in_seq=0 out_seq=0 2024-06-06T03:27:21.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.146+0000 7fba4ffff700 1 -- 172.21.15.50:0/3772486779 <== mds.2 v2:172.21.15.122:6834/2987597320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5623b403ed50 con 0x5623b40fe300 2024-06-06T03:27:21.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.146+0000 7fba4ffff700 10 client.15426 handle_command_reply: tid=0 2024-06-06T03:27:21.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.146+0000 7fba81833b80 1 client.15426 shutdown 2024-06-06T03:27:21.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.146+0000 7fba81833b80 1 -- 172.21.15.50:0/3772486779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623b40eac90 msgr2=0x5623b40ee280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:21.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.146+0000 7fba81833b80 1 --2- 172.21.15.50:0/3772486779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623b40eac90 0x5623b40ee280 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fba6809afb0 tx=0x7fba6809baf0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.146+0000 7fba81833b80 1 -- 172.21.15.50:0/3772486779 shutdown_connections 2024-06-06T03:27:21.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.146+0000 7fba81833b80 1 --2- 172.21.15.50:0/3772486779 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x5623b40fe300 0x5623b4100760 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.146+0000 7fba81833b80 1 --2- 172.21.15.50:0/3772486779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623b40eac90 0x5623b40ee280 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.146+0000 7fba81833b80 1 --2- 172.21.15.50:0/3772486779 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623b40e4bb0 0x5623b40f0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.146+0000 7fba81833b80 1 --2- 172.21.15.50:0/3772486779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623b40ea370 0x5623b40edd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.146+0000 7fba4ffff700 0 client.15426 ms_handle_reset on v2:172.21.15.122:6834/2987597320 2024-06-06T03:27:21.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.146+0000 7fba81833b80 1 -- 172.21.15.50:0/3772486779 >> 172.21.15.50:0/3772486779 conn(0x5623b400d080 msgr2=0x5623b40da700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:21.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.147+0000 7fba81833b80 1 -- 172.21.15.50:0/3772486779 shutdown_connections 2024-06-06T03:27:21.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.147+0000 7fba81833b80 1 -- 172.21.15.50:0/3772486779 wait complete. 2024-06-06T03:27:21.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.147+0000 7fba81833b80 20 client.15426 trim_cache size 0 max 16384 2024-06-06T03:27:21.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.163+0000 7fba81833b80 1 Processor -- start 2024-06-06T03:27:21.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.163+0000 7fba81833b80 1 -- start start 2024-06-06T03:27:21.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.163+0000 7fba81833b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623b40e4bb0 0x5623b40eb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:21.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.163+0000 7fba81833b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623b40ea370 0x5623b40dae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:21.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.163+0000 7fba81833b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623b40eac90 0x5623b40db3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:21.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.163+0000 7fba81833b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fba701ae910 con 0x5623b40e4bb0 2024-06-06T03:27:21.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.163+0000 7fba81833b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fba701ac1a0 con 0x5623b40ea370 2024-06-06T03:27:21.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.163+0000 7fba81833b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fba701aa010 con 0x5623b40eac90 2024-06-06T03:27:21.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.163+0000 7fba74d4c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623b40e4bb0 0x5623b40eb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:21.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.163+0000 7fba74d4c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623b40e4bb0 0x5623b40eb780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40516/0 (socket says 172.21.15.50:40516) 2024-06-06T03:27:21.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.163+0000 7fba74d4c700 1 -- 172.21.15.50:0/1838207668 learned_addr learned my addr 172.21.15.50:0/1838207668 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:21.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.163+0000 7fba6ffff700 1 --2- 172.21.15.50:0/1838207668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623b40ea370 0x5623b40dae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:21.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.163+0000 7fba7554d700 1 --2- 172.21.15.50:0/1838207668 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623b40eac90 0x5623b40db3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:21.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.164+0000 7fba74d4c700 1 -- 172.21.15.50:0/1838207668 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623b40eac90 msgr2=0x5623b40db3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:21.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.164+0000 7fba74d4c700 1 --2- 172.21.15.50:0/1838207668 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623b40eac90 0x5623b40db3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.164+0000 7fba74d4c700 1 -- 172.21.15.50:0/1838207668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623b40ea370 msgr2=0x5623b40dae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:21.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.164+0000 7fba74d4c700 1 --2- 172.21.15.50:0/1838207668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623b40ea370 0x5623b40dae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.164+0000 7fba74d4c700 1 -- 172.21.15.50:0/1838207668 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623b40ebcc0 con 0x5623b40e4bb0 2024-06-06T03:27:21.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.164+0000 7fba6ffff700 1 --2- 172.21.15.50:0/1838207668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623b40ea370 0x5623b40dae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:27:21.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.164+0000 7fba74d4c700 1 --2- 172.21.15.50:0/1838207668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623b40e4bb0 0x5623b40eb780 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fba64000c00 tx=0x7fba6401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711e2c2ea3564d37 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:21.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.164+0000 7fba5a7fc700 1 -- 172.21.15.50:0/1838207668 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba64023ad0 con 0x5623b40e4bb0 2024-06-06T03:27:21.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.164+0000 7fba5a7fc700 1 -- 172.21.15.50:0/1838207668 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fba64023c70 con 0x5623b40e4bb0 2024-06-06T03:27:21.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.164+0000 7fba5a7fc700 1 -- 172.21.15.50:0/1838207668 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6402f680 con 0x5623b40e4bb0 2024-06-06T03:27:21.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.165+0000 7fba81833b80 1 -- 172.21.15.50:0/1838207668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623b40e4bb0 msgr2=0x5623b40eb780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:21.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.165+0000 7fba81833b80 1 --2- 172.21.15.50:0/1838207668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623b40e4bb0 0x5623b40eb780 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fba64000c00 tx=0x7fba6401e000 comp rx=0 tx=0).stop 2024-06-06T03:27:21.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.165+0000 7fba81833b80 1 -- 172.21.15.50:0/1838207668 shutdown_connections 2024-06-06T03:27:21.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.165+0000 7fba81833b80 1 --2- 172.21.15.50:0/1838207668 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623b40eac90 0x5623b40db3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.165+0000 7fba81833b80 1 --2- 172.21.15.50:0/1838207668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623b40e4bb0 0x5623b40eb780 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.165+0000 7fba81833b80 1 --2- 172.21.15.50:0/1838207668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623b40ea370 0x5623b40dae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.165+0000 7fba81833b80 1 -- 172.21.15.50:0/1838207668 >> 172.21.15.50:0/1838207668 conn(0x5623b400d080 msgr2=0x5623b40eb070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:21.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.166+0000 7fba81833b80 1 -- 172.21.15.50:0/1838207668 shutdown_connections 2024-06-06T03:27:21.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.166+0000 7fba81833b80 1 -- 172.21.15.50:0/1838207668 wait complete. 2024-06-06T03:27:21.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.166+0000 7fba81833b80 1 -- start start 2024-06-06T03:27:21.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.166+0000 7fba81833b80 1 Processor -- start 2024-06-06T03:27:21.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.166+0000 7fba81833b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623b40e4bb0 0x5623b40f7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:21.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.166+0000 7fba81833b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623b40ea370 0x5623b4105a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:21.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.166+0000 7fba81833b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623b40eac90 0x5623b4105fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:21.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.167+0000 7fba81833b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fba701aa660 con 0x5623b40ea370 2024-06-06T03:27:21.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.167+0000 7fba81833b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fba701abad0 con 0x5623b40e4bb0 2024-06-06T03:27:21.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.167+0000 7fba81833b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fba701aad30 con 0x5623b40eac90 2024-06-06T03:27:21.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.167+0000 7fba81833b80 10 client.0 _ll_register_callbacks cb 0x5623b3fc75b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:21.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.167+0000 7fba6ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623b40ea370 0x5623b4105a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:21.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.167+0000 7fba6ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623b40ea370 0x5623b4105a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40518/0 (socket says 172.21.15.50:40518) 2024-06-06T03:27:21.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.167+0000 7fba6ffff700 1 -- 172.21.15.50:0/169044281 learned_addr learned my addr 172.21.15.50:0/169044281 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:21.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.167+0000 7fba74d4c700 1 --2- 172.21.15.50:0/169044281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623b40e4bb0 0x5623b40f7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:21.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.167+0000 7fba7554d700 1 --2- 172.21.15.50:0/169044281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623b40eac90 0x5623b4105fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:21.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.167+0000 7fba6ffff700 1 -- 172.21.15.50:0/169044281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623b40eac90 msgr2=0x5623b4105fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:21.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.167+0000 7fba6ffff700 1 --2- 172.21.15.50:0/169044281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623b40eac90 0x5623b4105fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.167+0000 7fba6ffff700 1 -- 172.21.15.50:0/169044281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623b40e4bb0 msgr2=0x5623b40f7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:21.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.167+0000 7fba6ffff700 1 --2- 172.21.15.50:0/169044281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623b40e4bb0 0x5623b40f7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.167+0000 7fba6ffff700 1 -- 172.21.15.50:0/169044281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623b4106810 con 0x5623b40ea370 2024-06-06T03:27:21.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.167+0000 7fba74d4c700 1 --2- 172.21.15.50:0/169044281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623b40e4bb0 0x5623b40f7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:27:21.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.167+0000 7fba6ffff700 1 --2- 172.21.15.50:0/169044281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623b40ea370 0x5623b4105a50 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fba5c00f010 tx=0x7fba5c0053d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46693cda349073d6 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:21.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.167+0000 7fba4ffff700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:27:21.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.168+0000 7fba4ffff700 1 -- 172.21.15.50:0/169044281 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5c016040 con 0x5623b40ea370 2024-06-06T03:27:21.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.168+0000 7fba4ffff700 1 -- 172.21.15.50:0/169044281 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fba5c004910 con 0x5623b40ea370 2024-06-06T03:27:21.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.168+0000 7fba81833b80 1 -- 172.21.15.50:0/169044281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba64023c70 con 0x5623b40ea370 2024-06-06T03:27:21.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.168+0000 7fba4ffff700 1 -- 172.21.15.50:0/169044281 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fba5c004b10 con 0x5623b40ea370 2024-06-06T03:27:21.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.168+0000 7fba81833b80 10 client.15432 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:21.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.168+0000 7fba81833b80 1 -- 172.21.15.50:0/169044281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5623b4169100 con 0x5623b40ea370 2024-06-06T03:27:21.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.168+0000 7fba4ffff700 1 -- 172.21.15.50:0/169044281 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fba64023c70 con 0x5623b40ea370 2024-06-06T03:27:21.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.168+0000 7fba4ffff700 1 -- 172.21.15.50:0/169044281 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fba5c00f040 con 0x5623b40ea370 2024-06-06T03:27:21.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.168+0000 7fba81833b80 10 client.15432 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:21.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.168+0000 7fba81833b80 10 client.15432 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-06-06T03:27:21.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.168+0000 7fba81833b80 20 client.15432 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:21.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.169+0000 7fba81833b80 1 --2- 172.21.15.50:0/169044281 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x5623b4169600 0x5623b416ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:21.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.169+0000 7fba81833b80 4 client.15432 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:27:21.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.169+0000 7fba81833b80 1 -- 172.21.15.50:0/169044281 --> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5623b40392d0 con 0x5623b4169600 2024-06-06T03:27:21.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.169+0000 7fba74d4c700 1 --2- 172.21.15.50:0/169044281 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x5623b4169600 0x5623b416ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:21.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.169+0000 7fba74d4c700 1 --2- 172.21.15.50:0/169044281 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x5623b4169600 0x5623b416ba20 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bee30e435df17b01 server_cookie=4aa165332971ace4 in_seq=0 out_seq=0 2024-06-06T03:27:21.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.169+0000 7fba4ffff700 10 client.15432 ms_handle_connect on v2:172.21.15.122:6834/2987597320 2024-06-06T03:27:21.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.170+0000 7fba4ffff700 1 -- 172.21.15.50:0/169044281 <== mds.2 v2:172.21.15.122:6834/2987597320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5623b40392d0 con 0x5623b4169600 2024-06-06T03:27:21.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.170+0000 7fba4ffff700 10 client.15432 handle_command_reply: tid=0 2024-06-06T03:27:21.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.170+0000 7fba81833b80 1 client.15432 shutdown 2024-06-06T03:27:21.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.170+0000 7fba81833b80 1 -- 172.21.15.50:0/169044281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623b40ea370 msgr2=0x5623b4105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:21.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.170+0000 7fba81833b80 1 --2- 172.21.15.50:0/169044281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623b40ea370 0x5623b4105a50 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fba5c00f010 tx=0x7fba5c0053d0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.170+0000 7fba81833b80 1 -- 172.21.15.50:0/169044281 shutdown_connections 2024-06-06T03:27:21.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.170+0000 7fba81833b80 1 --2- 172.21.15.50:0/169044281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623b40eac90 0x5623b4105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.170+0000 7fba81833b80 1 --2- 172.21.15.50:0/169044281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623b40e4bb0 0x5623b40f7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.170+0000 7fba81833b80 1 --2- 172.21.15.50:0/169044281 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x5623b4169600 0x5623b416ba20 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.170+0000 7fba81833b80 1 --2- 172.21.15.50:0/169044281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623b40ea370 0x5623b4105a50 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.170+0000 7fba81833b80 1 -- 172.21.15.50:0/169044281 >> 172.21.15.50:0/169044281 conn(0x5623b400d080 msgr2=0x5623b40ec520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:21.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.170+0000 7fba4ffff700 0 client.15432 ms_handle_reset on v2:172.21.15.122:6834/2987597320 2024-06-06T03:27:21.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.170+0000 7fba81833b80 1 -- 172.21.15.50:0/169044281 shutdown_connections 2024-06-06T03:27:21.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.170+0000 7fba81833b80 1 -- 172.21.15.50:0/169044281 wait complete. 2024-06-06T03:27:21.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.170+0000 7fba81833b80 20 client.15432 trim_cache size 0 max 16384 2024-06-06T03:27:21.174 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:27:21.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.171+0000 7fba76fb0700 1 -- 172.21.15.50:0/2759303786 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fba600a2c20 msgr2=0x7fba600a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:21.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.171+0000 7fba76fb0700 1 --2- 172.21.15.50:0/2759303786 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fba600a2c20 0x7fba600a50e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fba64006010 tx=0x7fba6401a040 comp rx=0 tx=0).stop 2024-06-06T03:27:21.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.171+0000 7fba76fb0700 1 -- 172.21.15.50:0/2759303786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba70107470 msgr2=0x7fba701a4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:21.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.171+0000 7fba76fb0700 1 --2- 172.21.15.50:0/2759303786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba70107470 0x7fba701a4ac0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fba68007ee0 tx=0x7fba6800d3b0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.171+0000 7fba76fb0700 1 -- 172.21.15.50:0/2759303786 shutdown_connections 2024-06-06T03:27:21.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.171+0000 7fba76fb0700 1 --2- 172.21.15.50:0/2759303786 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fba600a2c20 0x7fba600a50e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.171+0000 7fba76fb0700 1 --2- 172.21.15.50:0/2759303786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba70107470 0x7fba701a4ac0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.171+0000 7fba76fb0700 1 --2- 172.21.15.50:0/2759303786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba701014c0 0x7fba70199a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.171+0000 7fba76fb0700 1 --2- 172.21.15.50:0/2759303786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba70101e80 0x7fba70199f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:21.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.171+0000 7fba76fb0700 1 -- 172.21.15.50:0/2759303786 >> 172.21.15.50:0/2759303786 conn(0x7fba700772a0 msgr2=0x7fba700ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:21.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.172+0000 7fba76fb0700 1 -- 172.21.15.50:0/2759303786 shutdown_connections 2024-06-06T03:27:21.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:21.172+0000 7fba76fb0700 1 -- 172.21.15.50:0/2759303786 wait complete. 2024-06-06T03:27:21.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:20 smithi122 ceph-mon[35759]: pgmap v452: 129 pgs: 129 active+clean; 668 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 8 op/s 2024-06-06T03:27:21.970 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-06-06T03:27:22.242 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:27:23.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:22 smithi050 ceph-mon[32421]: pgmap v453: 129 pgs: 129 active+clean; 668 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-06-06T03:27:23.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:22 smithi079 ceph-mon[35478]: pgmap v453: 129 pgs: 129 active+clean; 668 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-06-06T03:27:23.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:22 smithi122 ceph-mon[35759]: pgmap v453: 129 pgs: 129 active+clean; 668 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-06-06T03:27:24.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.105+0000 7fbcd1531700 1 -- 172.21.15.50:0/1175172912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbccc108500 msgr2=0x7fbccc1088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:24.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.105+0000 7fbcd1531700 1 --2- 172.21.15.50:0/1175172912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbccc108500 0x7fbccc1088e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc009990 tx=0x7fbcbc009ca0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.105+0000 7fbcd1531700 1 -- 172.21.15.50:0/1175172912 shutdown_connections 2024-06-06T03:27:24.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.105+0000 7fbcd1531700 1 --2- 172.21.15.50:0/1175172912 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbccc06ab30 0x7fbccc10f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.105+0000 7fbcd1531700 1 --2- 172.21.15.50:0/1175172912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbccc108500 0x7fbccc1088e0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.105+0000 7fbcd1531700 1 --2- 172.21.15.50:0/1175172912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbccc06a170 0x7fbccc06a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.105+0000 7fbcd1531700 1 -- 172.21.15.50:0/1175172912 >> 172.21.15.50:0/1175172912 conn(0x7fbccc078340 msgr2=0x7fbccc078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:24.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.105+0000 7fbcd1531700 1 -- 172.21.15.50:0/1175172912 shutdown_connections 2024-06-06T03:27:24.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.105+0000 7fbcd1531700 1 -- 172.21.15.50:0/1175172912 wait complete. 2024-06-06T03:27:24.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.106+0000 7fbcd1531700 1 Processor -- start 2024-06-06T03:27:24.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.106+0000 7fbcd1531700 1 -- start start 2024-06-06T03:27:24.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.106+0000 7fbcd1531700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbccc06a170 0x7fbccc101460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:24.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.106+0000 7fbcd1531700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbccc06ab30 0x7fbccc1019a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:24.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.106+0000 7fbcd1531700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbccc108500 0x7fbccc101ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:24.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.106+0000 7fbcd1531700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbccc112610 con 0x7fbccc108500 2024-06-06T03:27:24.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.106+0000 7fbcd1531700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbccc112490 con 0x7fbccc06a170 2024-06-06T03:27:24.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.106+0000 7fbcd1531700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbccc112790 con 0x7fbccc06ab30 2024-06-06T03:27:24.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.107+0000 7fbccb7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbccc108500 0x7fbccc101ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:24.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.107+0000 7fbccb7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbccc108500 0x7fbccc101ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40550/0 (socket says 172.21.15.50:40550) 2024-06-06T03:27:24.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.107+0000 7fbccb7fe700 1 -- 172.21.15.50:0/2685604842 learned_addr learned my addr 172.21.15.50:0/2685604842 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:24.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.107+0000 7fbcca7fc700 1 --2- 172.21.15.50:0/2685604842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbccc06ab30 0x7fbccc1019a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:24.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.107+0000 7fbccaffd700 1 --2- 172.21.15.50:0/2685604842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbccc06a170 0x7fbccc101460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:24.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.107+0000 7fbccb7fe700 1 -- 172.21.15.50:0/2685604842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbccc06ab30 msgr2=0x7fbccc1019a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:24.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.107+0000 7fbccb7fe700 1 --2- 172.21.15.50:0/2685604842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbccc06ab30 0x7fbccc1019a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.107+0000 7fbccb7fe700 1 -- 172.21.15.50:0/2685604842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbccc06a170 msgr2=0x7fbccc101460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:24.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.107+0000 7fbccb7fe700 1 --2- 172.21.15.50:0/2685604842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbccc06a170 0x7fbccc101460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.107+0000 7fbccb7fe700 1 -- 172.21.15.50:0/2685604842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbccc1a6fc0 con 0x7fbccc108500 2024-06-06T03:27:24.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.107+0000 7fbccb7fe700 1 --2- 172.21.15.50:0/2685604842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbccc108500 0x7fbccc101ee0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4007d70 tx=0x7fbcc400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:24.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.107+0000 7fbcb3fff700 1 -- 172.21.15.50:0/2685604842 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4016020 con 0x7fbccc108500 2024-06-06T03:27:24.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.107+0000 7fbcd1531700 1 -- 172.21.15.50:0/2685604842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbccc1a72b0 con 0x7fbccc108500 2024-06-06T03:27:24.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.107+0000 7fbcb3fff700 1 -- 172.21.15.50:0/2685604842 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbcc400ad40 con 0x7fbccc108500 2024-06-06T03:27:24.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.107+0000 7fbcb3fff700 1 -- 172.21.15.50:0/2685604842 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc40115e0 con 0x7fbccc108500 2024-06-06T03:27:24.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.108+0000 7fbcd1531700 1 -- 172.21.15.50:0/2685604842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbccc1a7840 con 0x7fbccc108500 2024-06-06T03:27:24.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.110+0000 7fbcb3fff700 1 -- 172.21.15.50:0/2685604842 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbcc4019020 con 0x7fbccc108500 2024-06-06T03:27:24.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.111+0000 7fbcb3fff700 1 --2- 172.21.15.50:0/2685604842 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbcb40a2c20 0x7fbcb40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:24.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.111+0000 7fbccaffd700 1 --2- 172.21.15.50:0/2685604842 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbcb40a2c20 0x7fbcb40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:24.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.111+0000 7fbcb3fff700 1 -- 172.21.15.50:0/2685604842 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fbcc40cf2b0 con 0x7fbccc108500 2024-06-06T03:27:24.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.111+0000 7fbccaffd700 1 --2- 172.21.15.50:0/2685604842 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbcb40a2c20 0x7fbcb40a50e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc006010 tx=0x7fbcbc01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:24.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.112+0000 7fbcdbdb4b80 1 Processor -- start 2024-06-06T03:27:24.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.112+0000 7fbcdbdb4b80 1 -- start start 2024-06-06T03:27:24.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.112+0000 7fbcdbdb4b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d8762d640 0x560d8762da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:24.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.112+0000 7fbcdbdb4b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8762df60 0x560d876279e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:24.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.112+0000 7fbcdbdb4b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d87627f20 0x560d87628340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:24.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.112+0000 7fbcdbdb4b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560d87579810 con 0x560d8762df60 2024-06-06T03:27:24.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.112+0000 7fbcdbdb4b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560d87521720 con 0x560d8762d640 2024-06-06T03:27:24.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.112+0000 7fbcdbdb4b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560d875757d0 con 0x560d87627f20 2024-06-06T03:27:24.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.112+0000 7fbcca7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8762df60 0x560d876279e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:24.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.112+0000 7fbcca7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8762df60 0x560d876279e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40556/0 (socket says 172.21.15.50:40556) 2024-06-06T03:27:24.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.112+0000 7fbcca7fc700 1 -- 172.21.15.50:0/2941275239 learned_addr learned my addr 172.21.15.50:0/2941275239 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:24.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.112+0000 7fbccaffd700 1 --2- 172.21.15.50:0/2941275239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d8762d640 0x560d8762da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:24.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.113+0000 7fbccb7fe700 1 --2- 172.21.15.50:0/2941275239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d87627f20 0x560d87628340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:24.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.113+0000 7fbcca7fc700 1 -- 172.21.15.50:0/2941275239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d87627f20 msgr2=0x560d87628340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:24.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.113+0000 7fbcca7fc700 1 --2- 172.21.15.50:0/2941275239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d87627f20 0x560d87628340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.113+0000 7fbcca7fc700 1 -- 172.21.15.50:0/2941275239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d8762d640 msgr2=0x560d8762da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:24.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.113+0000 7fbcca7fc700 1 --2- 172.21.15.50:0/2941275239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d8762d640 0x560d8762da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.113+0000 7fbcca7fc700 1 -- 172.21.15.50:0/2941275239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d87517f50 con 0x560d8762df60 2024-06-06T03:27:24.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.113+0000 7fbcca7fc700 1 --2- 172.21.15.50:0/2941275239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8762df60 0x560d876279e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fbcc000ac40 tx=0x7fbcc000af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea63d24ad5a6c72 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:24.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.113+0000 7fbcb17fa700 1 -- 172.21.15.50:0/2941275239 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc001d070 con 0x560d8762df60 2024-06-06T03:27:24.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.113+0000 7fbcb17fa700 1 -- 172.21.15.50:0/2941275239 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbcc000fde0 con 0x560d8762df60 2024-06-06T03:27:24.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.113+0000 7fbcb17fa700 1 -- 172.21.15.50:0/2941275239 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc0010850 con 0x560d8762df60 2024-06-06T03:27:24.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.114+0000 7fbcdbdb4b80 1 -- 172.21.15.50:0/2941275239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8762df60 msgr2=0x560d876279e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:24.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.114+0000 7fbcdbdb4b80 1 --2- 172.21.15.50:0/2941275239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8762df60 0x560d876279e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fbcc000ac40 tx=0x7fbcc000af50 comp rx=0 tx=0).stop 2024-06-06T03:27:24.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.114+0000 7fbcdbdb4b80 1 -- 172.21.15.50:0/2941275239 shutdown_connections 2024-06-06T03:27:24.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.114+0000 7fbcdbdb4b80 1 --2- 172.21.15.50:0/2941275239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d87627f20 0x560d87628340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.114+0000 7fbcdbdb4b80 1 --2- 172.21.15.50:0/2941275239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d8762d640 0x560d8762da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.114+0000 7fbcdbdb4b80 1 --2- 172.21.15.50:0/2941275239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8762df60 0x560d876279e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.114+0000 7fbcdbdb4b80 1 -- 172.21.15.50:0/2941275239 >> 172.21.15.50:0/2941275239 conn(0x560d87552cc0 msgr2=0x560d87622850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:24.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.114+0000 7fbcdbdb4b80 1 -- 172.21.15.50:0/2941275239 shutdown_connections 2024-06-06T03:27:24.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.114+0000 7fbcdbdb4b80 1 -- 172.21.15.50:0/2941275239 wait complete. 2024-06-06T03:27:24.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.114+0000 7fbcdbdb4b80 1 -- start start 2024-06-06T03:27:24.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.115+0000 7fbcdbdb4b80 1 Processor -- start 2024-06-06T03:27:24.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.115+0000 7fbcdbdb4b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d87627f20 0x560d87633ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:24.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.115+0000 7fbcdbdb4b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8762d640 0x560d87630fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:24.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.115+0000 7fbcdbdb4b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d8762df60 0x560d87631520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:24.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.115+0000 7fbcdbdb4b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560d876349d0 con 0x560d8762d640 2024-06-06T03:27:24.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.115+0000 7fbcdbdb4b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560d87519bf0 con 0x560d8762df60 2024-06-06T03:27:24.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.115+0000 7fbcdbdb4b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560d87634b50 con 0x560d87627f20 2024-06-06T03:27:24.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.115+0000 7fbcdbdb4b80 10 client.0 _ll_register_callbacks cb 0x560d87513920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:24.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.115+0000 7fbcca7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8762d640 0x560d87630fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:24.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.115+0000 7fbcca7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8762d640 0x560d87630fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40560/0 (socket says 172.21.15.50:40560) 2024-06-06T03:27:24.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.115+0000 7fbcca7fc700 1 -- 172.21.15.50:0/2352002326 learned_addr learned my addr 172.21.15.50:0/2352002326 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:24.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.115+0000 7fbccaffd700 1 --2- 172.21.15.50:0/2352002326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d87627f20 0x560d87633ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:24.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.115+0000 7fbccb7fe700 1 --2- 172.21.15.50:0/2352002326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d8762df60 0x560d87631520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:24.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.116+0000 7fbcca7fc700 1 -- 172.21.15.50:0/2352002326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d87627f20 msgr2=0x560d87633ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:24.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.116+0000 7fbcca7fc700 1 --2- 172.21.15.50:0/2352002326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d87627f20 0x560d87633ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.116+0000 7fbcca7fc700 1 -- 172.21.15.50:0/2352002326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d8762df60 msgr2=0x560d87631520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:24.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.116+0000 7fbcca7fc700 1 --2- 172.21.15.50:0/2352002326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d8762df60 0x560d87631520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.116+0000 7fbcca7fc700 1 -- 172.21.15.50:0/2352002326 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d874c88d0 con 0x560d8762d640 2024-06-06T03:27:24.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.116+0000 7fbccaffd700 1 --2- 172.21.15.50:0/2352002326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d87627f20 0x560d87633ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:27:24.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.116+0000 7fbccb7fe700 1 --2- 172.21.15.50:0/2352002326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d8762df60 0x560d87631520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:27:24.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.116+0000 7fbcca7fc700 1 --2- 172.21.15.50:0/2352002326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8762d640 0x560d87630fe0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbcc000a840 tx=0x7fbcc00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a9450c2b45c133 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:24.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.116+0000 7fbcaeff5700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:27:24.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.116+0000 7fbcaeff5700 1 -- 172.21.15.50:0/2352002326 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc001d040 con 0x560d8762d640 2024-06-06T03:27:24.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.116+0000 7fbcaeff5700 1 -- 172.21.15.50:0/2352002326 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fbcc0018440 con 0x560d8762d640 2024-06-06T03:27:24.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.116+0000 7fbcdbdb4b80 1 -- 172.21.15.50:0/2352002326 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcc000fde0 con 0x560d8762d640 2024-06-06T03:27:24.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.116+0000 7fbcaeff5700 1 -- 172.21.15.50:0/2352002326 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbcc0031050 con 0x560d8762d640 2024-06-06T03:27:24.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.116+0000 7fbcdbdb4b80 10 client.15444 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:24.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.116+0000 7fbcdbdb4b80 1 -- 172.21.15.50:0/2352002326 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560d8763f2e0 con 0x560d8762d640 2024-06-06T03:27:24.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.116+0000 7fbcaeff5700 1 -- 172.21.15.50:0/2352002326 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbcc000fde0 con 0x560d8762d640 2024-06-06T03:27:24.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.117+0000 7fbcaeff5700 1 -- 172.21.15.50:0/2352002326 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fbcc0020030 con 0x560d8762d640 2024-06-06T03:27:24.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.117+0000 7fbcdbdb4b80 10 client.15444 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:24.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.117+0000 7fbcdbdb4b80 10 client.15444 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-06-06T03:27:24.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.117+0000 7fbcdbdb4b80 20 client.15444 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:24.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.117+0000 7fbcdbdb4b80 1 --2- 172.21.15.50:0/2352002326 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x560d876417b0 0x560d87643ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:24.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.117+0000 7fbcdbdb4b80 4 client.15444 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:27:24.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.117+0000 7fbcdbdb4b80 1 -- 172.21.15.50:0/2352002326 --> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d87586d10 con 0x560d876417b0 2024-06-06T03:27:24.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.117+0000 7fbccaffd700 1 --2- 172.21.15.50:0/2352002326 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x560d876417b0 0x560d87643ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:24.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.117+0000 7fbccaffd700 1 --2- 172.21.15.50:0/2352002326 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x560d876417b0 0x560d87643ba0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c85831390ab1c378 server_cookie=57c1aebf7a69e278 in_seq=0 out_seq=0 2024-06-06T03:27:24.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.117+0000 7fbcaeff5700 10 client.15444 ms_handle_connect on v2:172.21.15.122:6836/1604366318 2024-06-06T03:27:24.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.118+0000 7fbcaeff5700 1 -- 172.21.15.50:0/2352002326 <== mds.1 v2:172.21.15.122:6836/1604366318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x560d87586d10 con 0x560d876417b0 2024-06-06T03:27:24.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.118+0000 7fbcaeff5700 10 client.15444 handle_command_reply: tid=0 2024-06-06T03:27:24.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.118+0000 7fbcdbdb4b80 1 client.15444 shutdown 2024-06-06T03:27:24.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.118+0000 7fbcdbdb4b80 1 -- 172.21.15.50:0/2352002326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8762d640 msgr2=0x560d87630fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:24.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.118+0000 7fbcdbdb4b80 1 --2- 172.21.15.50:0/2352002326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8762d640 0x560d87630fe0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbcc000a840 tx=0x7fbcc00057f0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.119+0000 7fbcdbdb4b80 1 -- 172.21.15.50:0/2352002326 shutdown_connections 2024-06-06T03:27:24.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.119+0000 7fbcdbdb4b80 1 --2- 172.21.15.50:0/2352002326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d8762df60 0x560d87631520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.119+0000 7fbcdbdb4b80 1 --2- 172.21.15.50:0/2352002326 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x560d876417b0 0x560d87643ba0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.119+0000 7fbcdbdb4b80 1 --2- 172.21.15.50:0/2352002326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d87627f20 0x560d87633ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.119+0000 7fbcaeff5700 0 client.15444 ms_handle_reset on v2:172.21.15.122:6836/1604366318 2024-06-06T03:27:24.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.119+0000 7fbcdbdb4b80 1 --2- 172.21.15.50:0/2352002326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8762d640 0x560d87630fe0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.119+0000 7fbcdbdb4b80 1 -- 172.21.15.50:0/2352002326 >> 172.21.15.50:0/2352002326 conn(0x560d87552cc0 msgr2=0x560d876269d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:24.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.119+0000 7fbcdbdb4b80 1 -- 172.21.15.50:0/2352002326 shutdown_connections 2024-06-06T03:27:24.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.119+0000 7fbcdbdb4b80 1 -- 172.21.15.50:0/2352002326 wait complete. 2024-06-06T03:27:24.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.119+0000 7fbcdbdb4b80 20 client.15444 trim_cache size 0 max 16384 2024-06-06T03:27:24.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.150+0000 7fbcdbdb4b80 1 Processor -- start 2024-06-06T03:27:24.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.150+0000 7fbcdbdb4b80 1 -- start start 2024-06-06T03:27:24.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.151+0000 7fbcdbdb4b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d87627f20 0x560d876279e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:24.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.151+0000 7fbcdbdb4b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d8762d640 0x560d8762e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:24.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.151+0000 7fbcdbdb4b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8762df60 0x560d8762e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:24.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.151+0000 7fbcdbdb4b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbccc1b2c70 con 0x560d8762df60 2024-06-06T03:27:24.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.151+0000 7fbcdbdb4b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbccc1b0500 con 0x560d87627f20 2024-06-06T03:27:24.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.151+0000 7fbcdbdb4b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbccc1ae350 con 0x560d8762d640 2024-06-06T03:27:24.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.151+0000 7fbccb7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8762df60 0x560d8762e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:24.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.151+0000 7fbccb7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8762df60 0x560d8762e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40572/0 (socket says 172.21.15.50:40572) 2024-06-06T03:27:24.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.151+0000 7fbccb7fe700 1 -- 172.21.15.50:0/3832494577 learned_addr learned my addr 172.21.15.50:0/3832494577 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:24.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.151+0000 7fbccaffd700 1 --2- 172.21.15.50:0/3832494577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d87627f20 0x560d876279e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:24.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.151+0000 7fbccb7fe700 1 -- 172.21.15.50:0/3832494577 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d8762d640 msgr2=0x560d8762e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:24.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.151+0000 7fbccb7fe700 1 --2- 172.21.15.50:0/3832494577 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d8762d640 0x560d8762e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.151+0000 7fbccb7fe700 1 -- 172.21.15.50:0/3832494577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d87627f20 msgr2=0x560d876279e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:24.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.151+0000 7fbccb7fe700 1 --2- 172.21.15.50:0/3832494577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d87627f20 0x560d876279e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.151+0000 7fbccb7fe700 1 -- 172.21.15.50:0/3832494577 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d8762ee80 con 0x560d8762df60 2024-06-06T03:27:24.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.151+0000 7fbccaffd700 1 --2- 172.21.15.50:0/3832494577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d87627f20 0x560d876279e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:27:24.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.151+0000 7fbccb7fe700 1 --2- 172.21.15.50:0/3832494577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8762df60 0x560d8762e940 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40cca30 tx=0x7fbcc4012f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188a8a85fceef78f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:24.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.151+0000 7fbcb0ff9700 1 -- 172.21.15.50:0/3832494577 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc40b4070 con 0x560d8762df60 2024-06-06T03:27:24.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.152+0000 7fbcb0ff9700 1 -- 172.21.15.50:0/3832494577 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbcc409b790 con 0x560d8762df60 2024-06-06T03:27:24.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.152+0000 7fbcb0ff9700 1 -- 172.21.15.50:0/3832494577 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc409b9f0 con 0x560d8762df60 2024-06-06T03:27:24.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.152+0000 7fbcdbdb4b80 1 -- 172.21.15.50:0/3832494577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8762df60 msgr2=0x560d8762e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:24.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.152+0000 7fbcdbdb4b80 1 --2- 172.21.15.50:0/3832494577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8762df60 0x560d8762e940 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40cca30 tx=0x7fbcc4012f90 comp rx=0 tx=0).stop 2024-06-06T03:27:24.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.152+0000 7fbcdbdb4b80 1 -- 172.21.15.50:0/3832494577 shutdown_connections 2024-06-06T03:27:24.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.152+0000 7fbcdbdb4b80 1 --2- 172.21.15.50:0/3832494577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8762df60 0x560d8762e940 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.152+0000 7fbcdbdb4b80 1 --2- 172.21.15.50:0/3832494577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d87627f20 0x560d876279e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.152+0000 7fbcdbdb4b80 1 --2- 172.21.15.50:0/3832494577 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d8762d640 0x560d8762e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.152+0000 7fbcdbdb4b80 1 -- 172.21.15.50:0/3832494577 >> 172.21.15.50:0/3832494577 conn(0x560d87552cc0 msgr2=0x560d8762f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:24.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.152+0000 7fbcdbdb4b80 1 -- 172.21.15.50:0/3832494577 shutdown_connections 2024-06-06T03:27:24.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.153+0000 7fbcdbdb4b80 1 -- 172.21.15.50:0/3832494577 wait complete. 2024-06-06T03:27:24.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.153+0000 7fbcdbdb4b80 1 -- start start 2024-06-06T03:27:24.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.153+0000 7fbcdbdb4b80 1 Processor -- start 2024-06-06T03:27:24.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.153+0000 7fbcdbdb4b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d87627f20 0x560d8763a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:24.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.153+0000 7fbcdbdb4b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d8762d640 0x560d87648900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:24.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.153+0000 7fbcdbdb4b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d8762df60 0x560d87648e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:24.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.153+0000 7fbcdbdb4b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbccc1ae9c0 con 0x560d87627f20 2024-06-06T03:27:24.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.153+0000 7fbcdbdb4b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbccc1afe30 con 0x560d8762df60 2024-06-06T03:27:24.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.153+0000 7fbcdbdb4b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbccc1af090 con 0x560d8762d640 2024-06-06T03:27:24.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.153+0000 7fbcdbdb4b80 10 client.0 _ll_register_callbacks cb 0x560d87513920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:24.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.153+0000 7fbccaffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d87627f20 0x560d8763a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:24.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.153+0000 7fbccaffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d87627f20 0x560d8763a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40574/0 (socket says 172.21.15.50:40574) 2024-06-06T03:27:24.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.153+0000 7fbccaffd700 1 -- 172.21.15.50:0/2905854703 learned_addr learned my addr 172.21.15.50:0/2905854703 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:24.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.154+0000 7fbcca7fc700 1 --2- 172.21.15.50:0/2905854703 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d8762d640 0x560d87648900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:24.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.154+0000 7fbccaffd700 1 -- 172.21.15.50:0/2905854703 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d8762d640 msgr2=0x560d87648900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:24.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.154+0000 7fbccaffd700 1 --2- 172.21.15.50:0/2905854703 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d8762d640 0x560d87648900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.154+0000 7fbccaffd700 1 -- 172.21.15.50:0/2905854703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d8762df60 msgr2=0x560d87648e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:24.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.154+0000 7fbccb7fe700 1 --2- 172.21.15.50:0/2905854703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d8762df60 0x560d87648e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:24.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.154+0000 7fbccaffd700 1 --2- 172.21.15.50:0/2905854703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d8762df60 0x560d87648e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.154+0000 7fbccaffd700 1 -- 172.21.15.50:0/2905854703 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d876494f0 con 0x560d87627f20 2024-06-06T03:27:24.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.154+0000 7fbcca7fc700 1 --2- 172.21.15.50:0/2905854703 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d8762d640 0x560d87648900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:27:24.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.154+0000 7fbccb7fe700 1 --2- 172.21.15.50:0/2905854703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d8762df60 0x560d87648e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:27:24.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.154+0000 7fbccaffd700 1 --2- 172.21.15.50:0/2905854703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d87627f20 0x560d8763a450 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc009720 tx=0x7fbcbc009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aceed69134d8f77d server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:24.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.154+0000 7fbcaeff5700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:27:24.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.154+0000 7fbcaeff5700 1 -- 172.21.15.50:0/2905854703 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc00fe60 con 0x560d87627f20 2024-06-06T03:27:24.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.154+0000 7fbcaeff5700 1 -- 172.21.15.50:0/2905854703 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fbcbc03a620 con 0x560d87627f20 2024-06-06T03:27:24.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.154+0000 7fbcdbdb4b80 1 -- 172.21.15.50:0/2905854703 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcc409b790 con 0x560d87627f20 2024-06-06T03:27:24.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.154+0000 7fbcaeff5700 1 -- 172.21.15.50:0/2905854703 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbcbc043050 con 0x560d87627f20 2024-06-06T03:27:24.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.154+0000 7fbcdbdb4b80 10 client.15450 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:24.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.154+0000 7fbcdbdb4b80 1 -- 172.21.15.50:0/2905854703 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560d876abfd0 con 0x560d87627f20 2024-06-06T03:27:24.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.155+0000 7fbcaeff5700 1 -- 172.21.15.50:0/2905854703 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbcc409b790 con 0x560d87627f20 2024-06-06T03:27:24.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.155+0000 7fbcaeff5700 1 -- 172.21.15.50:0/2905854703 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fbcbc023760 con 0x560d87627f20 2024-06-06T03:27:24.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.155+0000 7fbcdbdb4b80 10 client.15450 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:24.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.155+0000 7fbcdbdb4b80 10 client.15450 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-06-06T03:27:24.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.155+0000 7fbcdbdb4b80 20 client.15450 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:24.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.155+0000 7fbcdbdb4b80 1 --2- 172.21.15.50:0/2905854703 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x560d876417b0 0x560d876ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:24.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.155+0000 7fbcdbdb4b80 4 client.15450 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:27:24.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.155+0000 7fbcdbdb4b80 1 -- 172.21.15.50:0/2905854703 --> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560d87581290 con 0x560d876417b0 2024-06-06T03:27:24.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.155+0000 7fbcca7fc700 1 --2- 172.21.15.50:0/2905854703 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x560d876417b0 0x560d876ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:24.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.156+0000 7fbcca7fc700 1 --2- 172.21.15.50:0/2905854703 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x560d876417b0 0x560d876ae6a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8aa7f39806358bb5 server_cookie=c118b8e777c90b9 in_seq=0 out_seq=0 2024-06-06T03:27:24.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.156+0000 7fbcaeff5700 10 client.15450 ms_handle_connect on v2:172.21.15.122:6836/1604366318 2024-06-06T03:27:24.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.156+0000 7fbcaeff5700 1 -- 172.21.15.50:0/2905854703 <== mds.1 v2:172.21.15.122:6836/1604366318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560d87581290 con 0x560d876417b0 2024-06-06T03:27:24.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.156+0000 7fbcaeff5700 10 client.15450 handle_command_reply: tid=0 2024-06-06T03:27:24.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.156+0000 7fbcdbdb4b80 1 client.15450 shutdown 2024-06-06T03:27:24.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.156+0000 7fbcdbdb4b80 1 -- 172.21.15.50:0/2905854703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d87627f20 msgr2=0x560d8763a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:24.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.156+0000 7fbcdbdb4b80 1 --2- 172.21.15.50:0/2905854703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d87627f20 0x560d8763a450 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc009720 tx=0x7fbcbc009ca0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.156+0000 7fbcdbdb4b80 1 -- 172.21.15.50:0/2905854703 shutdown_connections 2024-06-06T03:27:24.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.156+0000 7fbcdbdb4b80 1 --2- 172.21.15.50:0/2905854703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d8762df60 0x560d87648e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.156+0000 7fbcdbdb4b80 1 --2- 172.21.15.50:0/2905854703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d87627f20 0x560d8763a450 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.156+0000 7fbcdbdb4b80 1 --2- 172.21.15.50:0/2905854703 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x560d876417b0 0x560d876ae6a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.156+0000 7fbcdbdb4b80 1 --2- 172.21.15.50:0/2905854703 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d8762d640 0x560d87648900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.156+0000 7fbcdbdb4b80 1 -- 172.21.15.50:0/2905854703 >> 172.21.15.50:0/2905854703 conn(0x560d87552cc0 msgr2=0x560d8762f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:24.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.156+0000 7fbcaeff5700 0 client.15450 ms_handle_reset on v2:172.21.15.122:6836/1604366318 2024-06-06T03:27:24.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.157+0000 7fbcdbdb4b80 1 -- 172.21.15.50:0/2905854703 shutdown_connections 2024-06-06T03:27:24.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.157+0000 7fbcdbdb4b80 1 -- 172.21.15.50:0/2905854703 wait complete. 2024-06-06T03:27:24.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.157+0000 7fbcdbdb4b80 20 client.15450 trim_cache size 0 max 16384 2024-06-06T03:27:24.162 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:27:24.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.157+0000 7fbcd1531700 1 -- 172.21.15.50:0/2685604842 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbcb40a2c20 msgr2=0x7fbcb40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:24.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.157+0000 7fbcd1531700 1 --2- 172.21.15.50:0/2685604842 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbcb40a2c20 0x7fbcb40a50e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc006010 tx=0x7fbcbc01a040 comp rx=0 tx=0).stop 2024-06-06T03:27:24.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.157+0000 7fbcd1531700 1 -- 172.21.15.50:0/2685604842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbccc108500 msgr2=0x7fbccc101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:24.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.157+0000 7fbcd1531700 1 --2- 172.21.15.50:0/2685604842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbccc108500 0x7fbccc101ee0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4007d70 tx=0x7fbcc400a340 comp rx=0 tx=0).stop 2024-06-06T03:27:24.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.157+0000 7fbcd1531700 1 -- 172.21.15.50:0/2685604842 shutdown_connections 2024-06-06T03:27:24.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.157+0000 7fbcd1531700 1 --2- 172.21.15.50:0/2685604842 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbcb40a2c20 0x7fbcb40a50e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.157+0000 7fbcd1531700 1 --2- 172.21.15.50:0/2685604842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbccc108500 0x7fbccc101ee0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.158+0000 7fbcd1531700 1 --2- 172.21.15.50:0/2685604842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbccc06a170 0x7fbccc101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.158+0000 7fbcd1531700 1 --2- 172.21.15.50:0/2685604842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbccc06ab30 0x7fbccc1019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:24.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.158+0000 7fbcd1531700 1 -- 172.21.15.50:0/2685604842 >> 172.21.15.50:0/2685604842 conn(0x7fbccc078340 msgr2=0x7fbccc0ffef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:24.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.158+0000 7fbcd1531700 1 -- 172.21.15.50:0/2685604842 shutdown_connections 2024-06-06T03:27:24.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:24.158+0000 7fbcd1531700 1 -- 172.21.15.50:0/2685604842 wait complete. 2024-06-06T03:27:25.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:24 smithi050 ceph-mon[32421]: pgmap v454: 129 pgs: 129 active+clean; 668 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-06-06T03:27:25.058 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-06-06T03:27:25.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:24 smithi079 ceph-mon[35478]: pgmap v454: 129 pgs: 129 active+clean; 668 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-06-06T03:27:25.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:24 smithi122 ceph-mon[35759]: pgmap v454: 129 pgs: 129 active+clean; 668 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-06-06T03:27:25.325 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:27:27.061 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:26 smithi050 ceph-mon[32421]: pgmap v455: 129 pgs: 129 active+clean; 668 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-06-06T03:27:27.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:26 smithi079 ceph-mon[35478]: pgmap v455: 129 pgs: 129 active+clean; 668 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-06-06T03:27:27.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:26 smithi122 ceph-mon[35759]: pgmap v455: 129 pgs: 129 active+clean; 668 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-06-06T03:27:27.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.216+0000 7f985500d700 1 -- 172.21.15.50:0/585899892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9850107400 msgr2=0x7f98501077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:27.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.216+0000 7f985500d700 1 --2- 172.21.15.50:0/585899892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9850107400 0x7f98501077e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9840009990 tx=0x7f9840009ca0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.216+0000 7f985500d700 1 -- 172.21.15.50:0/585899892 shutdown_connections 2024-06-06T03:27:27.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.216+0000 7f985500d700 1 --2- 172.21.15.50:0/585899892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9850101d50 0x7f985010e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.216+0000 7f985500d700 1 --2- 172.21.15.50:0/585899892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9850107400 0x7f98501077e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.216+0000 7f985500d700 1 --2- 172.21.15.50:0/585899892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9850101390 0x7f9850101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.216+0000 7f985500d700 1 -- 172.21.15.50:0/585899892 >> 172.21.15.50:0/585899892 conn(0x7f9850078340 msgr2=0x7f9850078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:27.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.216+0000 7f985500d700 1 -- 172.21.15.50:0/585899892 shutdown_connections 2024-06-06T03:27:27.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.216+0000 7f985500d700 1 -- 172.21.15.50:0/585899892 wait complete. 2024-06-06T03:27:27.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.217+0000 7f985500d700 1 Processor -- start 2024-06-06T03:27:27.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.217+0000 7f985500d700 1 -- start start 2024-06-06T03:27:27.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.217+0000 7f985500d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9850101390 0x7f985010e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:27.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.217+0000 7f985500d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9850101d50 0x7f985010a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:27.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.217+0000 7f985500d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9850107400 0x7f985010a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:27.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.218+0000 7f985500d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9850111520 con 0x7f9850107400 2024-06-06T03:27:27.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.218+0000 7f985500d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f98501113a0 con 0x7f9850101d50 2024-06-06T03:27:27.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.218+0000 7f985500d700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f98501116a0 con 0x7f9850101390 2024-06-06T03:27:27.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.218+0000 7f984f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9850107400 0x7f985010a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:27.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.218+0000 7f984ed9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9850101390 0x7f985010e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:27.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.218+0000 7f984ed9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9850101390 0x7f985010e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:38978/0 (socket says 172.21.15.50:38978) 2024-06-06T03:27:27.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.218+0000 7f984ed9d700 1 -- 172.21.15.50:0/3011173629 learned_addr learned my addr 172.21.15.50:0/3011173629 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:27.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.218+0000 7f984e59c700 1 --2- 172.21.15.50:0/3011173629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9850101d50 0x7f985010a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:27.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.218+0000 7f984ed9d700 1 -- 172.21.15.50:0/3011173629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9850101d50 msgr2=0x7f985010a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:27.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.218+0000 7f984ed9d700 1 --2- 172.21.15.50:0/3011173629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9850101d50 0x7f985010a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.218+0000 7f984ed9d700 1 -- 172.21.15.50:0/3011173629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9850107400 msgr2=0x7f985010a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:27.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.218+0000 7f984ed9d700 1 --2- 172.21.15.50:0/3011173629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9850107400 0x7f985010a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.218+0000 7f984ed9d700 1 -- 172.21.15.50:0/3011173629 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f985010aee0 con 0x7f9850101390 2024-06-06T03:27:27.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.218+0000 7f984e59c700 1 --2- 172.21.15.50:0/3011173629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9850101d50 0x7f985010a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:27:27.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.218+0000 7f984ed9d700 1 --2- 172.21.15.50:0/3011173629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9850101390 0x7f985010e030 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9840000c00 tx=0x7f9840003a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:27.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.219+0000 7f9837fff700 1 -- 172.21.15.50:0/3011173629 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9840027070 con 0x7f9850101390 2024-06-06T03:27:27.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.219+0000 7f985500d700 1 -- 172.21.15.50:0/3011173629 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98501ab6c0 con 0x7f9850101390 2024-06-06T03:27:27.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.219+0000 7f9837fff700 1 -- 172.21.15.50:0/3011173629 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f984000bdc0 con 0x7f9850101390 2024-06-06T03:27:27.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.219+0000 7f9837fff700 1 -- 172.21.15.50:0/3011173629 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9840022cd0 con 0x7f9850101390 2024-06-06T03:27:27.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.219+0000 7f985500d700 1 -- 172.21.15.50:0/3011173629 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98501abb70 con 0x7f9850101390 2024-06-06T03:27:27.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.222+0000 7f9837fff700 1 -- 172.21.15.50:0/3011173629 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f984002a070 con 0x7f9850101390 2024-06-06T03:27:27.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.223+0000 7f9837fff700 1 --2- 172.21.15.50:0/3011173629 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f98380a2ca0 0x7f98380a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:27.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.223+0000 7f984e59c700 1 --2- 172.21.15.50:0/3011173629 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f98380a2ca0 0x7f98380a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:27.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.223+0000 7f9837fff700 1 -- 172.21.15.50:0/3011173629 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f98400d0130 con 0x7f9850101390 2024-06-06T03:27:27.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.224+0000 7f985f890b80 1 Processor -- start 2024-06-06T03:27:27.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.224+0000 7f985f890b80 1 -- start start 2024-06-06T03:27:27.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.224+0000 7f984e59c700 1 --2- 172.21.15.50:0/3011173629 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f98380a2ca0 0x7f98380a5160 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f985010b890 tx=0x7f984400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:27.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.224+0000 7f985f890b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561202613f60 0x561202614340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:27.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.224+0000 7f985f890b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561202614880 0x56120260e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:27.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.224+0000 7f985f890b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56120260e7a0 0x56120260ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:27.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.224+0000 7f985f890b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561202500f60 con 0x561202614880 2024-06-06T03:27:27.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.224+0000 7f985f890b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56120255f850 con 0x56120260e7a0 2024-06-06T03:27:27.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.224+0000 7f985f890b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5612024c7460 con 0x561202613f60 2024-06-06T03:27:27.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.224+0000 7f984e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561202614880 0x56120260e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:27.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.224+0000 7f984e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561202614880 0x56120260e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40598/0 (socket says 172.21.15.50:40598) 2024-06-06T03:27:27.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.224+0000 7f984e59c700 1 -- 172.21.15.50:0/3116415672 learned_addr learned my addr 172.21.15.50:0/3116415672 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:27.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.224+0000 7f984ed9d700 1 --2- 172.21.15.50:0/3116415672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561202613f60 0x561202614340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:27.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.224+0000 7f984f59e700 1 --2- 172.21.15.50:0/3116415672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56120260e7a0 0x56120260ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:27.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.225+0000 7f984f59e700 1 -- 172.21.15.50:0/3116415672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561202613f60 msgr2=0x561202614340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:27.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.225+0000 7f984f59e700 1 --2- 172.21.15.50:0/3116415672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561202613f60 0x561202614340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.225+0000 7f984f59e700 1 -- 172.21.15.50:0/3116415672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561202614880 msgr2=0x56120260e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:27.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.225+0000 7f984f59e700 1 --2- 172.21.15.50:0/3116415672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561202614880 0x56120260e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.225+0000 7f984f59e700 1 -- 172.21.15.50:0/3116415672 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612024ae8d0 con 0x56120260e7a0 2024-06-06T03:27:27.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.225+0000 7f984ed9d700 1 --2- 172.21.15.50:0/3116415672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561202613f60 0x561202614340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:27:27.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.225+0000 7f984f59e700 1 --2- 172.21.15.50:0/3116415672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56120260e7a0 0x56120260ebc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9848003e80 tx=0x7f9848009ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8cf9d6ba9959693 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:27.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.225+0000 7f98357fa700 1 -- 172.21.15.50:0/3116415672 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9848004bb0 con 0x56120260e7a0 2024-06-06T03:27:27.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.225+0000 7f98357fa700 1 -- 172.21.15.50:0/3116415672 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9848004820 con 0x56120260e7a0 2024-06-06T03:27:27.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.225+0000 7f98357fa700 1 -- 172.21.15.50:0/3116415672 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9848007cf0 con 0x56120260e7a0 2024-06-06T03:27:27.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.226+0000 7f985f890b80 1 -- 172.21.15.50:0/3116415672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56120260e7a0 msgr2=0x56120260ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:27.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.226+0000 7f985f890b80 1 --2- 172.21.15.50:0/3116415672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56120260e7a0 0x56120260ebc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9848003e80 tx=0x7f9848009ba0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.226+0000 7f985f890b80 1 -- 172.21.15.50:0/3116415672 shutdown_connections 2024-06-06T03:27:27.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.226+0000 7f985f890b80 1 --2- 172.21.15.50:0/3116415672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56120260e7a0 0x56120260ebc0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.226+0000 7f985f890b80 1 --2- 172.21.15.50:0/3116415672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561202613f60 0x561202614340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.226+0000 7f985f890b80 1 --2- 172.21.15.50:0/3116415672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561202614880 0x56120260e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.226+0000 7f985f890b80 1 -- 172.21.15.50:0/3116415672 >> 172.21.15.50:0/3116415672 conn(0x56120253b080 msgr2=0x561202609220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:27.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.226+0000 7f985f890b80 1 -- 172.21.15.50:0/3116415672 shutdown_connections 2024-06-06T03:27:27.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.226+0000 7f985f890b80 1 -- 172.21.15.50:0/3116415672 wait complete. 2024-06-06T03:27:27.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.226+0000 7f985f890b80 1 -- start start 2024-06-06T03:27:27.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.226+0000 7f985f890b80 1 Processor -- start 2024-06-06T03:27:27.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.227+0000 7f985f890b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56120260e7a0 0x56120261a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:27.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.227+0000 7f985f890b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561202613f60 0x561202617930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:27.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.227+0000 7f985f890b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561202614880 0x561202617e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:27.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.227+0000 7f985f890b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5612024fffc0 con 0x561202613f60 2024-06-06T03:27:27.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.227+0000 7f985f890b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56120255b810 con 0x56120260e7a0 2024-06-06T03:27:27.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.227+0000 7f985f890b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56120261b260 con 0x561202614880 2024-06-06T03:27:27.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.227+0000 7f984e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561202613f60 0x561202617930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:27.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.227+0000 7f984ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56120260e7a0 0x56120261a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:27.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.227+0000 7f984e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561202613f60 0x561202617930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40604/0 (socket says 172.21.15.50:40604) 2024-06-06T03:27:27.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.227+0000 7f984e59c700 1 -- 172.21.15.50:0/1912051615 learned_addr learned my addr 172.21.15.50:0/1912051615 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:27.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.227+0000 7f984f59e700 1 --2- 172.21.15.50:0/1912051615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561202614880 0x561202617e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:27.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.227+0000 7f985f890b80 10 client.0 _ll_register_callbacks cb 0x5612024f55b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:27.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.227+0000 7f984ed9d700 1 -- 172.21.15.50:0/1912051615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561202614880 msgr2=0x561202617e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:27.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.227+0000 7f984ed9d700 1 --2- 172.21.15.50:0/1912051615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561202614880 0x561202617e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.227+0000 7f984ed9d700 1 -- 172.21.15.50:0/1912051615 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561202613f60 msgr2=0x561202617930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:27.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.227+0000 7f984ed9d700 1 --2- 172.21.15.50:0/1912051615 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561202613f60 0x561202617930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.228+0000 7f984ed9d700 1 -- 172.21.15.50:0/1912051615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561202525750 con 0x56120260e7a0 2024-06-06T03:27:27.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.228+0000 7f984e59c700 1 --2- 172.21.15.50:0/1912051615 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561202613f60 0x561202617930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:27:27.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.228+0000 7f984ed9d700 1 --2- 172.21.15.50:0/1912051615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56120260e7a0 0x56120261a630 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9840098aa0 tx=0x7f9840022750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47e1329083f9df99 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:27.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.228+0000 7f9832ff5700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:27:27.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.228+0000 7f9832ff5700 1 -- 172.21.15.50:0/1912051615 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9840085dd0 con 0x56120260e7a0 2024-06-06T03:27:27.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.228+0000 7f9832ff5700 1 -- 172.21.15.50:0/1912051615 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f98400a4d90 con 0x56120260e7a0 2024-06-06T03:27:27.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.228+0000 7f985f890b80 1 -- 172.21.15.50:0/1912051615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9848004820 con 0x56120260e7a0 2024-06-06T03:27:27.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.228+0000 7f9832ff5700 1 -- 172.21.15.50:0/1912051615 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f984009cd40 con 0x56120260e7a0 2024-06-06T03:27:27.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.228+0000 7f985f890b80 10 client.25076 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:27.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.228+0000 7f985f890b80 1 -- 172.21.15.50:0/1912051615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561202625980 con 0x56120260e7a0 2024-06-06T03:27:27.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.229+0000 7f9832ff5700 1 -- 172.21.15.50:0/1912051615 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f984009c640 con 0x56120260e7a0 2024-06-06T03:27:27.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.230+0000 7f9832ff5700 1 -- 172.21.15.50:0/1912051615 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f9840061b90 con 0x56120260e7a0 2024-06-06T03:27:27.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.230+0000 7f985f890b80 10 client.25076 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:27.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.230+0000 7f985f890b80 10 client.25076 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:27:27.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.230+0000 7f985f890b80 20 client.25076 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:27.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.230+0000 7f985f890b80 1 --2- 172.21.15.50:0/1912051615 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561202628030 0x56120262a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:27.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.230+0000 7f985f890b80 4 client.25076 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:27:27.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.230+0000 7f985f890b80 1 -- 172.21.15.50:0/1912051615 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9848004820 con 0x561202628030 2024-06-06T03:27:27.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.230+0000 7f984e59c700 1 --2- 172.21.15.50:0/1912051615 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561202628030 0x56120262a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:27.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.231+0000 7f9832ff5700 10 client.25076 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:27.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.231+0000 7f984e59c700 1 --2- 172.21.15.50:0/1912051615 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561202628030 0x56120262a490 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c24b282b1f4af537 server_cookie=64542b10125f51c8 in_seq=0 out_seq=0 2024-06-06T03:27:27.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.231+0000 7f9832ff5700 1 -- 172.21.15.50:0/1912051615 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x7f9848004820 con 0x561202628030 2024-06-06T03:27:27.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.231+0000 7f9832ff5700 10 client.25076 handle_command_reply: tid=0 2024-06-06T03:27:27.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.232+0000 7f985f890b80 1 client.25076 shutdown 2024-06-06T03:27:27.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.232+0000 7f985f890b80 1 -- 172.21.15.50:0/1912051615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56120260e7a0 msgr2=0x56120261a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:27.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.232+0000 7f985f890b80 1 --2- 172.21.15.50:0/1912051615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56120260e7a0 0x56120261a630 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9840098aa0 tx=0x7f9840022750 comp rx=0 tx=0).stop 2024-06-06T03:27:27.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.232+0000 7f985f890b80 1 -- 172.21.15.50:0/1912051615 shutdown_connections 2024-06-06T03:27:27.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.232+0000 7f985f890b80 1 --2- 172.21.15.50:0/1912051615 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561202628030 0x56120262a490 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.232+0000 7f985f890b80 1 --2- 172.21.15.50:0/1912051615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561202614880 0x561202617e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.232+0000 7f985f890b80 1 --2- 172.21.15.50:0/1912051615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56120260e7a0 0x56120261a630 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.232+0000 7f985f890b80 1 --2- 172.21.15.50:0/1912051615 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561202613f60 0x561202617930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.232+0000 7f9832ff5700 0 client.25076 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:27.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.232+0000 7f985f890b80 1 -- 172.21.15.50:0/1912051615 >> 172.21.15.50:0/1912051615 conn(0x56120253b080 msgr2=0x561202608700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:27.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.233+0000 7f985f890b80 1 -- 172.21.15.50:0/1912051615 shutdown_connections 2024-06-06T03:27:27.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.233+0000 7f985f890b80 1 -- 172.21.15.50:0/1912051615 wait complete. 2024-06-06T03:27:27.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.233+0000 7f985f890b80 20 client.25076 trim_cache size 0 max 16384 2024-06-06T03:27:27.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.264+0000 7f985f890b80 1 Processor -- start 2024-06-06T03:27:27.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.264+0000 7f985f890b80 1 -- start start 2024-06-06T03:27:27.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.264+0000 7f985f890b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120260e7a0 0x56120260e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:27.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.264+0000 7f985f890b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561202613f60 0x5612026154f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:27.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.264+0000 7f985f890b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561202614880 0x561202616930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:27.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.264+0000 7f985f890b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f98501b6ee0 con 0x56120260e7a0 2024-06-06T03:27:27.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.264+0000 7f985f890b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f98501b4770 con 0x561202613f60 2024-06-06T03:27:27.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.264+0000 7f985f890b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f98501b2670 con 0x561202614880 2024-06-06T03:27:27.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.264+0000 7f984ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120260e7a0 0x56120260e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:27.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.264+0000 7f984ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120260e7a0 0x56120260e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40618/0 (socket says 172.21.15.50:40618) 2024-06-06T03:27:27.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.264+0000 7f984ed9d700 1 -- 172.21.15.50:0/106419428 learned_addr learned my addr 172.21.15.50:0/106419428 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:27.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.264+0000 7f984e59c700 1 --2- 172.21.15.50:0/106419428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561202613f60 0x5612026154f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:27.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.264+0000 7f984f59e700 1 --2- 172.21.15.50:0/106419428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561202614880 0x561202616930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:27.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.264+0000 7f984ed9d700 1 -- 172.21.15.50:0/106419428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561202614880 msgr2=0x561202616930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:27.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.265+0000 7f984ed9d700 1 --2- 172.21.15.50:0/106419428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561202614880 0x561202616930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.265+0000 7f984ed9d700 1 -- 172.21.15.50:0/106419428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561202613f60 msgr2=0x5612026154f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:27.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.265+0000 7f984ed9d700 1 --2- 172.21.15.50:0/106419428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561202613f60 0x5612026154f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.265+0000 7f984ed9d700 1 -- 172.21.15.50:0/106419428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56120260ad20 con 0x56120260e7a0 2024-06-06T03:27:27.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.265+0000 7f984f59e700 1 --2- 172.21.15.50:0/106419428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561202614880 0x561202616930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:27:27.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.265+0000 7f984ed9d700 1 --2- 172.21.15.50:0/106419428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120260e7a0 0x56120260e260 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9840099010 tx=0x7f9840005c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=660ff8052c89f161 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:27.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.265+0000 7f9834ff9700 1 -- 172.21.15.50:0/106419428 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9840085dd0 con 0x56120260e7a0 2024-06-06T03:27:27.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.265+0000 7f9834ff9700 1 -- 172.21.15.50:0/106419428 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f984009c640 con 0x56120260e7a0 2024-06-06T03:27:27.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.265+0000 7f9834ff9700 1 -- 172.21.15.50:0/106419428 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98400a4ff0 con 0x56120260e7a0 2024-06-06T03:27:27.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.266+0000 7f985f890b80 1 -- 172.21.15.50:0/106419428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120260e7a0 msgr2=0x56120260e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:27.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.266+0000 7f985f890b80 1 --2- 172.21.15.50:0/106419428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120260e7a0 0x56120260e260 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9840099010 tx=0x7f9840005c40 comp rx=0 tx=0).stop 2024-06-06T03:27:27.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.266+0000 7f985f890b80 1 -- 172.21.15.50:0/106419428 shutdown_connections 2024-06-06T03:27:27.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.266+0000 7f985f890b80 1 --2- 172.21.15.50:0/106419428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561202614880 0x561202616930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.266+0000 7f985f890b80 1 --2- 172.21.15.50:0/106419428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120260e7a0 0x56120260e260 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.266+0000 7f985f890b80 1 --2- 172.21.15.50:0/106419428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561202613f60 0x5612026154f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.266+0000 7f985f890b80 1 -- 172.21.15.50:0/106419428 >> 172.21.15.50:0/106419428 conn(0x56120253b080 msgr2=0x561202616220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:27.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.266+0000 7f985f890b80 1 -- 172.21.15.50:0/106419428 shutdown_connections 2024-06-06T03:27:27.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.267+0000 7f985f890b80 1 -- 172.21.15.50:0/106419428 wait complete. 2024-06-06T03:27:27.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.267+0000 7f985f890b80 1 -- start start 2024-06-06T03:27:27.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.267+0000 7f985f890b80 1 Processor -- start 2024-06-06T03:27:27.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.267+0000 7f985f890b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56120260e7a0 0x5612026304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:27.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.267+0000 7f985f890b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561202613f60 0x561202620520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:27.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.267+0000 7f985f890b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561202614880 0x561202620a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:27.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.267+0000 7f985f890b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f98501b2c30 con 0x561202613f60 2024-06-06T03:27:27.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.267+0000 7f985f890b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f98501b40a0 con 0x561202614880 2024-06-06T03:27:27.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.267+0000 7f985f890b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f98501b3300 con 0x56120260e7a0 2024-06-06T03:27:27.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.267+0000 7f985f890b80 10 client.0 _ll_register_callbacks cb 0x5612024f55b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:27.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.268+0000 7f984e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561202613f60 0x561202620520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:27.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.268+0000 7f984e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561202613f60 0x561202620520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40628/0 (socket says 172.21.15.50:40628) 2024-06-06T03:27:27.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.268+0000 7f984e59c700 1 -- 172.21.15.50:0/3539309049 learned_addr learned my addr 172.21.15.50:0/3539309049 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:27.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.268+0000 7f984ed9d700 1 --2- 172.21.15.50:0/3539309049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56120260e7a0 0x5612026304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:27.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.268+0000 7f984f59e700 1 --2- 172.21.15.50:0/3539309049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561202614880 0x561202620a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:27.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.268+0000 7f984e59c700 1 -- 172.21.15.50:0/3539309049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56120260e7a0 msgr2=0x5612026304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:27.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.268+0000 7f984e59c700 1 --2- 172.21.15.50:0/3539309049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56120260e7a0 0x5612026304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.268+0000 7f984e59c700 1 -- 172.21.15.50:0/3539309049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561202614880 msgr2=0x561202620a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:27.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.268+0000 7f984e59c700 1 --2- 172.21.15.50:0/3539309049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561202614880 0x561202620a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.268+0000 7f984e59c700 1 -- 172.21.15.50:0/3539309049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56120262ed50 con 0x561202613f60 2024-06-06T03:27:27.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.268+0000 7f984e59c700 1 --2- 172.21.15.50:0/3539309049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561202613f60 0x561202620520 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x56120262ad00 tx=0x7f98440047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1f6e688c98206d server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:27.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.268+0000 7f9832ff5700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:27:27.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.268+0000 7f9832ff5700 1 -- 172.21.15.50:0/3539309049 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9844004220 con 0x561202613f60 2024-06-06T03:27:27.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.268+0000 7f9832ff5700 1 -- 172.21.15.50:0/3539309049 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f98440043c0 con 0x561202613f60 2024-06-06T03:27:27.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.268+0000 7f985f890b80 1 -- 172.21.15.50:0/3539309049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f984009c640 con 0x561202613f60 2024-06-06T03:27:27.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.269+0000 7f9832ff5700 1 -- 172.21.15.50:0/3539309049 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9844003680 con 0x561202613f60 2024-06-06T03:27:27.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.269+0000 7f985f890b80 10 client.15468 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:27.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.269+0000 7f985f890b80 1 -- 172.21.15.50:0/3539309049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561202691f60 con 0x561202613f60 2024-06-06T03:27:27.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.269+0000 7f9832ff5700 1 -- 172.21.15.50:0/3539309049 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f984009c640 con 0x561202613f60 2024-06-06T03:27:27.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.270+0000 7f9832ff5700 1 -- 172.21.15.50:0/3539309049 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f9844003820 con 0x561202613f60 2024-06-06T03:27:27.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.270+0000 7f985f890b80 10 client.15468 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:27.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.270+0000 7f985f890b80 10 client.15468 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:27:27.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.270+0000 7f985f890b80 20 client.15468 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:27.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.270+0000 7f985f890b80 1 --2- 172.21.15.50:0/3539309049 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561202692640 0x561202694a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:27.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.270+0000 7f985f890b80 4 client.15468 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:27:27.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.270+0000 7f985f890b80 1 -- 172.21.15.50:0/3539309049 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56120256cd50 con 0x561202692640 2024-06-06T03:27:27.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.270+0000 7f984ed9d700 1 --2- 172.21.15.50:0/3539309049 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561202692640 0x561202694a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:27.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.270+0000 7f9832ff5700 10 client.15468 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:27.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.270+0000 7f984ed9d700 1 --2- 172.21.15.50:0/3539309049 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561202692640 0x561202694a60 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce361e494d27c1c2 server_cookie=e1fd67d9ff684cf6 in_seq=0 out_seq=0 2024-06-06T03:27:27.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.271+0000 7f9832ff5700 1 -- 172.21.15.50:0/3539309049 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56120256cd50 con 0x561202692640 2024-06-06T03:27:27.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.271+0000 7f9832ff5700 10 client.15468 handle_command_reply: tid=0 2024-06-06T03:27:27.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.271+0000 7f985f890b80 1 client.15468 shutdown 2024-06-06T03:27:27.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.271+0000 7f985f890b80 1 -- 172.21.15.50:0/3539309049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561202613f60 msgr2=0x561202620520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:27.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.271+0000 7f985f890b80 1 --2- 172.21.15.50:0/3539309049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561202613f60 0x561202620520 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x56120262ad00 tx=0x7f98440047c0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.271+0000 7f985f890b80 1 -- 172.21.15.50:0/3539309049 shutdown_connections 2024-06-06T03:27:27.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.271+0000 7f985f890b80 1 --2- 172.21.15.50:0/3539309049 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561202692640 0x561202694a60 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.271+0000 7f985f890b80 1 --2- 172.21.15.50:0/3539309049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561202614880 0x561202620a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.271+0000 7f9832ff5700 0 client.15468 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:27.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.271+0000 7f985f890b80 1 --2- 172.21.15.50:0/3539309049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56120260e7a0 0x5612026304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.271+0000 7f985f890b80 1 --2- 172.21.15.50:0/3539309049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561202613f60 0x561202620520 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.271+0000 7f985f890b80 1 -- 172.21.15.50:0/3539309049 >> 172.21.15.50:0/3539309049 conn(0x56120253b080 msgr2=0x561202619160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:27.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.272+0000 7f985f890b80 1 -- 172.21.15.50:0/3539309049 shutdown_connections 2024-06-06T03:27:27.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.272+0000 7f985f890b80 1 -- 172.21.15.50:0/3539309049 wait complete. 2024-06-06T03:27:27.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.272+0000 7f985f890b80 20 client.15468 trim_cache size 0 max 16384 2024-06-06T03:27:27.274 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:27:27.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.272+0000 7f985500d700 1 -- 172.21.15.50:0/3011173629 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f98380a2ca0 msgr2=0x7f98380a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:27.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.272+0000 7f985500d700 1 --2- 172.21.15.50:0/3011173629 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f98380a2ca0 0x7f98380a5160 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f985010b890 tx=0x7f984400b410 comp rx=0 tx=0).stop 2024-06-06T03:27:27.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.272+0000 7f985500d700 1 -- 172.21.15.50:0/3011173629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9850101390 msgr2=0x7f985010e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:27.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.272+0000 7f985500d700 1 --2- 172.21.15.50:0/3011173629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9850101390 0x7f985010e030 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9840000c00 tx=0x7f9840003a80 comp rx=0 tx=0).stop 2024-06-06T03:27:27.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.273+0000 7f985500d700 1 -- 172.21.15.50:0/3011173629 shutdown_connections 2024-06-06T03:27:27.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.273+0000 7f985500d700 1 --2- 172.21.15.50:0/3011173629 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f98380a2ca0 0x7f98380a5160 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.273+0000 7f985500d700 1 --2- 172.21.15.50:0/3011173629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9850107400 0x7f985010a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.273+0000 7f985500d700 1 --2- 172.21.15.50:0/3011173629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9850101390 0x7f985010e030 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.273+0000 7f985500d700 1 --2- 172.21.15.50:0/3011173629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9850101d50 0x7f985010a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:27.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.273+0000 7f985500d700 1 -- 172.21.15.50:0/3011173629 >> 172.21.15.50:0/3011173629 conn(0x7f9850078340 msgr2=0x7f98500fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:27.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.273+0000 7f985500d700 1 -- 172.21.15.50:0/3011173629 shutdown_connections 2024-06-06T03:27:27.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:27.273+0000 7f985500d700 1 -- 172.21.15.50:0/3011173629 wait complete. 2024-06-06T03:27:29.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:28 smithi079 ceph-mon[35478]: pgmap v456: 129 pgs: 129 active+clean; 668 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-06-06T03:27:29.102 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-06T03:27:29.103 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-06-06T03:27:29.127 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:28 smithi050 ceph-mon[32421]: pgmap v456: 129 pgs: 129 active+clean; 668 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-06-06T03:27:29.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:28 smithi122 ceph-mon[35759]: pgmap v456: 129 pgs: 129 active+clean; 668 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-06-06T03:27:29.410 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:27:30.049 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.047+0000 7f9f0a2ee640 1 -- 172.21.15.50:0/352029161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f041076e0 msgr2=0x7f9f04109b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.047+0000 7f9f0a2ee640 1 --2- 172.21.15.50:0/352029161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f041076e0 0x7f9f04109b30 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9efc009ca0 tx=0x7f9efc02a8c0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.047+0000 7f9f0a2ee640 1 -- 172.21.15.50:0/352029161 shutdown_connections 2024-06-06T03:27:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.047+0000 7f9f0a2ee640 1 --2- 172.21.15.50:0/352029161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f041076e0 0x7f9f04109b30 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.047+0000 7f9f0a2ee640 1 --2- 172.21.15.50:0/352029161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f04104db0 0x7f9f041071a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.047+0000 7f9f0a2ee640 1 --2- 172.21.15.50:0/352029161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f04102480 0x7f9f04104870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.047+0000 7f9f0a2ee640 1 -- 172.21.15.50:0/352029161 >> 172.21.15.50:0/352029161 conn(0x7f9f040fbe70 msgr2=0x7f9f040fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.047+0000 7f9f0a2ee640 1 -- 172.21.15.50:0/352029161 shutdown_connections 2024-06-06T03:27:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.047+0000 7f9f0a2ee640 1 -- 172.21.15.50:0/352029161 wait complete. 2024-06-06T03:27:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.048+0000 7f9f0a2ee640 1 Processor -- start 2024-06-06T03:27:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.048+0000 7f9f0a2ee640 1 -- start start 2024-06-06T03:27:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.048+0000 7f9f0a2ee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f04102480 0x7f9f04197b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.048+0000 7f9f0a2ee640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f04104db0 0x7f9f041980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.048+0000 7f9f0a2ee640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f041076e0 0x7f9f0419f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.048+0000 7f9f0a2ee640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0410d530 con 0x7f9f041076e0 2024-06-06T03:27:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.048+0000 7f9f0a2ee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0410d3b0 con 0x7f9f04102480 2024-06-06T03:27:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.048+0000 7f9f0a2ee640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0410d6b0 con 0x7f9f04104db0 2024-06-06T03:27:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.048+0000 7f9f0888b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f041076e0 0x7f9f0419f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.048+0000 7f9f0888b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f041076e0 0x7f9f0419f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40662/0 (socket says 172.21.15.50:40662) 2024-06-06T03:27:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.048+0000 7f9f0888b640 1 -- 172.21.15.50:0/709131250 learned_addr learned my addr 172.21.15.50:0/709131250 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.048+0000 7f9f03fff640 1 --2- 172.21.15.50:0/709131250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f04102480 0x7f9f04197b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.049+0000 7f9f037fe640 1 --2- 172.21.15.50:0/709131250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f04104db0 0x7f9f041980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.049+0000 7f9f0888b640 1 -- 172.21.15.50:0/709131250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f04104db0 msgr2=0x7f9f041980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.049+0000 7f9f0888b640 1 --2- 172.21.15.50:0/709131250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f04104db0 0x7f9f041980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.049+0000 7f9f0888b640 1 -- 172.21.15.50:0/709131250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f04102480 msgr2=0x7f9f04197b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.049+0000 7f9f0888b640 1 --2- 172.21.15.50:0/709131250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f04102480 0x7f9f04197b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.049+0000 7f9f0888b640 1 -- 172.21.15.50:0/709131250 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f0419f790 con 0x7f9f041076e0 2024-06-06T03:27:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.049+0000 7f9f037fe640 1 --2- 172.21.15.50:0/709131250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f04104db0 0x7f9f041980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:27:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.049+0000 7f9f0888b640 1 --2- 172.21.15.50:0/709131250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f041076e0 0x7f9f0419f120 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9efc031970 tx=0x7f9efc003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.049+0000 7f9f017fa640 1 -- 172.21.15.50:0/709131250 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9efc004040 con 0x7f9f041076e0 2024-06-06T03:27:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.049+0000 7f9f0a2ee640 1 -- 172.21.15.50:0/709131250 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f0419fa20 con 0x7f9f041076e0 2024-06-06T03:27:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.049+0000 7f9f017fa640 1 -- 172.21.15.50:0/709131250 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9efc004690 con 0x7f9f041076e0 2024-06-06T03:27:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.049+0000 7f9f017fa640 1 -- 172.21.15.50:0/709131250 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9efc030c60 con 0x7f9f041076e0 2024-06-06T03:27:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.049+0000 7f9f0a2ee640 1 -- 172.21.15.50:0/709131250 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f0419ffc0 con 0x7f9f041076e0 2024-06-06T03:27:30.055 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.052+0000 7f9f0cff6740 1 Processor -- start 2024-06-06T03:27:30.055 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.053+0000 7f9f017fa640 1 -- 172.21.15.50:0/709131250 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9efc0041e0 con 0x7f9f041076e0 2024-06-06T03:27:30.055 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.053+0000 7f9f0cff6740 1 -- start start 2024-06-06T03:27:30.055 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.053+0000 7f9f0cff6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f7575c420 0x561f7575c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:30.055 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.053+0000 7f9f0cff6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f7575ce10 0x561f75761910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:30.056 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.053+0000 7f9f0cff6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f75761f80 0x561f75764410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:30.056 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.053+0000 7f9f0cff6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561f756bb4f0 con 0x561f75761f80 2024-06-06T03:27:30.056 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.053+0000 7f9f0cff6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561f75659870 con 0x561f7575c420 2024-06-06T03:27:30.056 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.053+0000 7f9f0cff6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561f756b74b0 con 0x561f7575ce10 2024-06-06T03:27:30.056 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.053+0000 7f9f037fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f75761f80 0x561f75764410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:30.056 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.053+0000 7f9f037fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f75761f80 0x561f75764410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40668/0 (socket says 172.21.15.50:40668) 2024-06-06T03:27:30.056 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.053+0000 7f9f037fe640 1 -- 172.21.15.50:0/3299021355 learned_addr learned my addr 172.21.15.50:0/3299021355 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:30.056 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.053+0000 7f9f03fff640 1 --2- 172.21.15.50:0/3299021355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f7575ce10 0x561f75761910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:30.056 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.053+0000 7f9f037fe640 1 --2- 172.21.15.50:0/3299021355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f7575c420 0x561f7575c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:30.056 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.054+0000 7f9f037fe640 1 -- 172.21.15.50:0/3299021355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f7575ce10 msgr2=0x561f75761910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:30.056 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.054+0000 7f9f037fe640 1 --2- 172.21.15.50:0/3299021355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f7575ce10 0x561f75761910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.054+0000 7f9f037fe640 1 -- 172.21.15.50:0/3299021355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f7575c420 msgr2=0x561f7575c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.054+0000 7f9f037fe640 1 --2- 172.21.15.50:0/3299021355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f7575c420 0x561f7575c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.054+0000 7f9f037fe640 1 -- 172.21.15.50:0/3299021355 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f756759b0 con 0x561f75761f80 2024-06-06T03:27:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.054+0000 7f9f017fa640 1 --2- 172.21.15.50:0/709131250 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9eec0a2c30 0x7f9eec0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.054+0000 7f9f037fe640 1 --2- 172.21.15.50:0/3299021355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f75761f80 0x561f75764410 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x561f7575d670 tx=0x7f9ef400b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63cceed0377326bd server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.054+0000 7f9f03fff640 1 --2- 172.21.15.50:0/709131250 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9eec0a2c30 0x7f9eec0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.054+0000 7f9f017fa640 1 -- 172.21.15.50:0/709131250 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f9efc0f0b10 con 0x7f9f041076e0 2024-06-06T03:27:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.054+0000 7f9eea7fc640 1 -- 172.21.15.50:0/3299021355 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef4004220 con 0x561f75761f80 2024-06-06T03:27:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.054+0000 7f9eea7fc640 1 -- 172.21.15.50:0/3299021355 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9ef4017070 con 0x561f75761f80 2024-06-06T03:27:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.054+0000 7f9eea7fc640 1 -- 172.21.15.50:0/3299021355 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef4004b20 con 0x561f75761f80 2024-06-06T03:27:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.055+0000 7f9f0cff6740 1 -- 172.21.15.50:0/3299021355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f75761f80 msgr2=0x561f75764410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.055+0000 7f9f0cff6740 1 --2- 172.21.15.50:0/3299021355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f75761f80 0x561f75764410 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x561f7575d670 tx=0x7f9ef400b420 comp rx=0 tx=0).stop 2024-06-06T03:27:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.055+0000 7f9f03fff640 1 --2- 172.21.15.50:0/709131250 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9eec0a2c30 0x7f9eec0a50f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x561f7575d210 tx=0x7f9ef8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.055+0000 7f9f0cff6740 1 -- 172.21.15.50:0/3299021355 shutdown_connections 2024-06-06T03:27:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.055+0000 7f9f0cff6740 1 --2- 172.21.15.50:0/3299021355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f75761f80 0x561f75764410 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.055+0000 7f9f0cff6740 1 --2- 172.21.15.50:0/3299021355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f7575ce10 0x561f75761910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.055+0000 7f9f0cff6740 1 --2- 172.21.15.50:0/3299021355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f7575c420 0x561f7575c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.055+0000 7f9f0cff6740 1 -- 172.21.15.50:0/3299021355 >> 172.21.15.50:0/3299021355 conn(0x561f75753680 msgr2=0x561f75753a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.055+0000 7f9f0cff6740 1 -- 172.21.15.50:0/3299021355 shutdown_connections 2024-06-06T03:27:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.055+0000 7f9f0cff6740 1 -- 172.21.15.50:0/3299021355 wait complete. 2024-06-06T03:27:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.055+0000 7f9f0cff6740 1 -- start start 2024-06-06T03:27:30.062 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.056+0000 7f9f0cff6740 1 Processor -- start 2024-06-06T03:27:30.062 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.056+0000 7f9f0cff6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f7575c420 0x561f75766700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:30.062 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.056+0000 7f9f0cff6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f7575ce10 0x561f75766c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:30.062 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.056+0000 7f9f0cff6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f75761f80 0x561f7576dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:30.062 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.056+0000 7f9f0cff6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561f75764f30 con 0x561f7575ce10 2024-06-06T03:27:30.062 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.056+0000 7f9f0cff6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561f75644ae0 con 0x561f75761f80 2024-06-06T03:27:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.056+0000 7f9f0cff6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561f757650b0 con 0x561f7575c420 2024-06-06T03:27:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.056+0000 7f9f037fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f7575ce10 0x561f75766c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.056+0000 7f9f0cff6740 10 client.0 _ll_register_callbacks cb 0x561f7567d9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.056+0000 7f9f037fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f7575ce10 0x561f75766c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40672/0 (socket says 172.21.15.50:40672) 2024-06-06T03:27:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.056+0000 7f9f037fe640 1 -- 172.21.15.50:0/580889541 learned_addr learned my addr 172.21.15.50:0/580889541 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.056+0000 7f9f03fff640 1 --2- 172.21.15.50:0/580889541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f7575c420 0x561f75766700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.056+0000 7f9f0888b640 1 --2- 172.21.15.50:0/580889541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f75761f80 0x561f7576dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.056+0000 7f9f037fe640 1 -- 172.21.15.50:0/580889541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f7575c420 msgr2=0x561f75766700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.056+0000 7f9f037fe640 1 --2- 172.21.15.50:0/580889541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f7575c420 0x561f75766700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.056+0000 7f9f037fe640 1 -- 172.21.15.50:0/580889541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f75761f80 msgr2=0x561f7576dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.056+0000 7f9f037fe640 1 --2- 172.21.15.50:0/580889541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f75761f80 0x561f7576dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.056+0000 7f9f037fe640 1 -- 172.21.15.50:0/580889541 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f753cf210 con 0x561f7575ce10 2024-06-06T03:27:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.056+0000 7f9f03fff640 1 --2- 172.21.15.50:0/580889541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f7575c420 0x561f75766700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:27:30.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.057+0000 7f9f0888b640 1 --2- 172.21.15.50:0/580889541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f75761f80 0x561f7576dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:27:30.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.057+0000 7f9f037fe640 1 --2- 172.21.15.50:0/580889541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f7575ce10 0x561f75766c40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4004610 tx=0x7f9ef400e8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee01873e14a99831 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:30.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.057+0000 7f9ee37fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:27:30.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.057+0000 7f9ee37fe640 1 -- 172.21.15.50:0/580889541 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef4013530 con 0x561f7575ce10 2024-06-06T03:27:30.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.057+0000 7f9f0cff6740 1 -- 172.21.15.50:0/580889541 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ef4017070 con 0x561f7575ce10 2024-06-06T03:27:30.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.057+0000 7f9ee37fe640 1 -- 172.21.15.50:0/580889541 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f9ef400ed20 con 0x561f7575ce10 2024-06-06T03:27:30.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.057+0000 7f9ee37fe640 1 -- 172.21.15.50:0/580889541 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9ef4033050 con 0x561f7575ce10 2024-06-06T03:27:30.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.057+0000 7f9f0cff6740 10 client.15480 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:30.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.057+0000 7f9f0cff6740 1 -- 172.21.15.50:0/580889541 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561f7549b620 con 0x561f7575ce10 2024-06-06T03:27:30.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.057+0000 7f9ee37fe640 1 -- 172.21.15.50:0/580889541 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9ef4017070 con 0x561f7575ce10 2024-06-06T03:27:30.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.058+0000 7f9ee37fe640 1 -- 172.21.15.50:0/580889541 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f9ef400f040 con 0x561f7575ce10 2024-06-06T03:27:30.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.058+0000 7f9f0cff6740 10 client.15480 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:30.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.058+0000 7f9f0cff6740 10 client.15480 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:27:30.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.058+0000 7f9f0cff6740 20 client.15480 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:30.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.058+0000 7f9f0cff6740 1 --2- 172.21.15.50:0/580889541 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561f757729c0 0x561f75774de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.058+0000 7f9f0cff6740 4 client.15480 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:27:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.058+0000 7f9f0cff6740 1 -- 172.21.15.50:0/580889541 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f756cef10 con 0x561f757729c0 2024-06-06T03:27:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.058+0000 7f9f03fff640 1 --2- 172.21.15.50:0/580889541 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561f757729c0 0x561f75774de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.058+0000 7f9f03fff640 1 --2- 172.21.15.50:0/580889541 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561f757729c0 0x561f75774de0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9502d62986a57d7 server_cookie=4d1e0dd02bc2c3d3 in_seq=0 out_seq=0 2024-06-06T03:27:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.058+0000 7f9ee37fe640 10 client.15480 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.059+0000 7f9ee37fe640 1 -- 172.21.15.50:0/580889541 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x561f756cef10 con 0x561f757729c0 2024-06-06T03:27:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.059+0000 7f9ee37fe640 10 client.15480 handle_command_reply: tid=0 2024-06-06T03:27:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.059+0000 7f9f0cff6740 1 client.15480 shutdown 2024-06-06T03:27:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.060+0000 7f9f0cff6740 1 -- 172.21.15.50:0/580889541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f7575ce10 msgr2=0x561f75766c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.060+0000 7f9f0cff6740 1 --2- 172.21.15.50:0/580889541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f7575ce10 0x561f75766c40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4004610 tx=0x7f9ef400e8f0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.060+0000 7f9f0cff6740 1 -- 172.21.15.50:0/580889541 shutdown_connections 2024-06-06T03:27:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.060+0000 7f9f0cff6740 1 --2- 172.21.15.50:0/580889541 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561f757729c0 0x561f75774de0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.060+0000 7f9f0cff6740 1 --2- 172.21.15.50:0/580889541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f7575ce10 0x561f75766c40 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.060+0000 7f9f0cff6740 1 --2- 172.21.15.50:0/580889541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f75761f80 0x561f7576dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.060+0000 7f9f0cff6740 1 --2- 172.21.15.50:0/580889541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f7575c420 0x561f75766700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.060+0000 7f9f0cff6740 1 -- 172.21.15.50:0/580889541 >> 172.21.15.50:0/580889541 conn(0x561f75753680 msgr2=0x561f757527e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.060+0000 7f9ee37fe640 0 client.15480 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.060+0000 7f9f0cff6740 1 -- 172.21.15.50:0/580889541 shutdown_connections 2024-06-06T03:27:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.060+0000 7f9f0cff6740 1 -- 172.21.15.50:0/580889541 wait complete. 2024-06-06T03:27:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.060+0000 7f9f0cff6740 20 client.15480 trim_cache size 0 max 16384 2024-06-06T03:27:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.078+0000 7f9f0cff6740 1 Processor -- start 2024-06-06T03:27:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.078+0000 7f9f0cff6740 1 -- start start 2024-06-06T03:27:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.078+0000 7f9f0cff6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f7575c420 0x561f75766700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.078+0000 7f9f0cff6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f75761f80 0x561f75766c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.078+0000 7f9f0cff6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f7576dc40 0x561f7575e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.078+0000 7f9f0cff6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9f041aab00 con 0x561f7576dc40 2024-06-06T03:27:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.078+0000 7f9f0cff6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9f041a83d0 con 0x561f7575c420 2024-06-06T03:27:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.078+0000 7f9f0cff6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9f041a6220 con 0x561f75761f80 2024-06-06T03:27:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.079+0000 7f9f0888b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f7576dc40 0x561f7575e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.079+0000 7f9f0888b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f7576dc40 0x561f7575e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40684/0 (socket says 172.21.15.50:40684) 2024-06-06T03:27:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.079+0000 7f9f0888b640 1 -- 172.21.15.50:0/67483918 learned_addr learned my addr 172.21.15.50:0/67483918 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.079+0000 7f9f037fe640 1 --2- 172.21.15.50:0/67483918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f75761f80 0x561f75766c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.079+0000 7f9f03fff640 1 --2- 172.21.15.50:0/67483918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f7575c420 0x561f75766700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.079+0000 7f9f0888b640 1 -- 172.21.15.50:0/67483918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f75761f80 msgr2=0x561f75766c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.079+0000 7f9f0888b640 1 --2- 172.21.15.50:0/67483918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f75761f80 0x561f75766c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.079+0000 7f9f0888b640 1 -- 172.21.15.50:0/67483918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f7575c420 msgr2=0x561f75766700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.079+0000 7f9f0888b640 1 --2- 172.21.15.50:0/67483918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f7575c420 0x561f75766700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.079+0000 7f9f0888b640 1 -- 172.21.15.50:0/67483918 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f757534b0 con 0x561f7576dc40 2024-06-06T03:27:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.079+0000 7f9f0888b640 1 --2- 172.21.15.50:0/67483918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f7576dc40 0x561f7575e090 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9efc0bcf80 tx=0x7f9efc0bcb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a21626ea3059d8b server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.079+0000 7f9ee9ffb640 1 -- 172.21.15.50:0/67483918 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9efc004840 con 0x561f7576dc40 2024-06-06T03:27:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.079+0000 7f9ee9ffb640 1 -- 172.21.15.50:0/67483918 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9efc036030 con 0x561f7576dc40 2024-06-06T03:27:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.079+0000 7f9ee9ffb640 1 -- 172.21.15.50:0/67483918 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9efc0c13a0 con 0x561f7576dc40 2024-06-06T03:27:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.080+0000 7f9f0cff6740 1 -- 172.21.15.50:0/67483918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f7576dc40 msgr2=0x561f7575e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.080+0000 7f9f0cff6740 1 --2- 172.21.15.50:0/67483918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f7576dc40 0x561f7575e090 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9efc0bcf80 tx=0x7f9efc0bcb30 comp rx=0 tx=0).stop 2024-06-06T03:27:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.080+0000 7f9f0cff6740 1 -- 172.21.15.50:0/67483918 shutdown_connections 2024-06-06T03:27:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.080+0000 7f9f0cff6740 1 --2- 172.21.15.50:0/67483918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f7576dc40 0x561f7575e090 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.080+0000 7f9f0cff6740 1 --2- 172.21.15.50:0/67483918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f75761f80 0x561f75766c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.080+0000 7f9f0cff6740 1 --2- 172.21.15.50:0/67483918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f7575c420 0x561f75766700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.080+0000 7f9f0cff6740 1 -- 172.21.15.50:0/67483918 >> 172.21.15.50:0/67483918 conn(0x561f75753680 msgr2=0x561f75765d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.080+0000 7f9f0cff6740 1 -- 172.21.15.50:0/67483918 shutdown_connections 2024-06-06T03:27:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.080+0000 7f9f0cff6740 1 -- 172.21.15.50:0/67483918 wait complete. 2024-06-06T03:27:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.080+0000 7f9f0cff6740 1 -- start start 2024-06-06T03:27:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.081+0000 7f9f0cff6740 1 Processor -- start 2024-06-06T03:27:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.081+0000 7f9f0cff6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f7575c420 0x561f7576a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.081+0000 7f9f0cff6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f75761f80 0x561f7576a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.081+0000 7f9f0cff6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f7576dc40 0x561f757db670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.081+0000 7f9f0888b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f7576dc40 0x561f757db670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.082+0000 7f9f0888b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f7576dc40 0x561f757db670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40686/0 (socket says 172.21.15.50:40686) 2024-06-06T03:27:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.082+0000 7f9f0888b640 1 -- 172.21.15.50:0/53469546 learned_addr learned my addr 172.21.15.50:0/53469546 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.082+0000 7f9f03fff640 1 --2- 172.21.15.50:0/53469546 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f7575c420 0x561f7576a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.081+0000 7f9f037fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f75761f80 0x561f7576a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.082+0000 7f9f0cff6740 1 -- 172.21.15.50:0/53469546 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9f041a6890 con 0x561f7576dc40 2024-06-06T03:27:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.082+0000 7f9f0cff6740 1 -- 172.21.15.50:0/53469546 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9f041a7d00 con 0x561f75761f80 2024-06-06T03:27:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.082+0000 7f9f0cff6740 1 -- 172.21.15.50:0/53469546 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9f041a6f60 con 0x561f7575c420 2024-06-06T03:27:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.082+0000 7f9f0888b640 1 -- 172.21.15.50:0/53469546 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f7575c420 msgr2=0x561f7576a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.082+0000 7f9f0888b640 1 --2- 172.21.15.50:0/53469546 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f7575c420 0x561f7576a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.082+0000 7f9f0888b640 1 -- 172.21.15.50:0/53469546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f75761f80 msgr2=0x561f7576a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.082+0000 7f9f0888b640 1 --2- 172.21.15.50:0/53469546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f75761f80 0x561f7576a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.082+0000 7f9f0888b640 1 -- 172.21.15.50:0/53469546 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f7574f0f0 con 0x561f7576dc40 2024-06-06T03:27:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.082+0000 7f9f0cff6740 10 client.0 _ll_register_callbacks cb 0x7f9ef400be60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.082+0000 7f9f0888b640 1 --2- 172.21.15.50:0/53469546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f7576dc40 0x561f757db670 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9efc0c5730 tx=0x7f9efc0b8c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3d8dd9bd63fce0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.082+0000 7f9ee37fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:27:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.082+0000 7f9f0cff6740 1 -- 172.21.15.50:0/53469546 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9efc036030 con 0x561f7576dc40 2024-06-06T03:27:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.082+0000 7f9ee37fe640 1 -- 172.21.15.50:0/53469546 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9efc087060 con 0x561f7576dc40 2024-06-06T03:27:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.083+0000 7f9ee37fe640 1 -- 172.21.15.50:0/53469546 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f9efc0b9660 con 0x561f7576dc40 2024-06-06T03:27:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.083+0000 7f9ee37fe640 1 -- 172.21.15.50:0/53469546 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9efc0dd0d0 con 0x561f7576dc40 2024-06-06T03:27:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.083+0000 7f9f0cff6740 10 client.15486 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.083+0000 7f9f0cff6740 1 -- 172.21.15.50:0/53469546 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({fsmap=27}) -- 0x561f757dc7e0 con 0x561f7576dc40 2024-06-06T03:27:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.083+0000 7f9ee37fe640 1 -- 172.21.15.50:0/53469546 <== mon.0 v2:172.21.15.50:3300/0 4 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f9efc0c57d0 con 0x561f7576dc40 2024-06-06T03:27:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.083+0000 7f9f0cff6740 10 client.15486 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.083+0000 7f9f0cff6740 10 client.15486 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:27:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.083+0000 7f9f0cff6740 20 client.15486 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.083+0000 7f9f0cff6740 1 --2- 172.21.15.50:0/53469546 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561f757dcf80 0x561f757df3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.083+0000 7f9f0cff6740 4 client.15486 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:27:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.083+0000 7f9f0cff6740 1 -- 172.21.15.50:0/53469546 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f9efc036030 con 0x561f757dcf80 2024-06-06T03:27:30.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.083+0000 7f9f03fff640 1 --2- 172.21.15.50:0/53469546 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561f757dcf80 0x561f757df3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:30.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.084+0000 7f9f03fff640 1 --2- 172.21.15.50:0/53469546 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561f757dcf80 0x561f757df3a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d57b49944c4dade5 server_cookie=ab2602756c419336 in_seq=0 out_seq=0 2024-06-06T03:27:30.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.084+0000 7f9ee37fe640 10 client.15486 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.088+0000 7f9ee37fe640 1 -- 172.21.15.50:0/53469546 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x7f9efc036030 con 0x561f757dcf80 2024-06-06T03:27:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.088+0000 7f9ee37fe640 10 client.15486 handle_command_reply: tid=0 2024-06-06T03:27:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.088+0000 7f9f0cff6740 1 client.15486 shutdown 2024-06-06T03:27:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.088+0000 7f9f0cff6740 1 -- 172.21.15.50:0/53469546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f7576dc40 msgr2=0x561f757db670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.088+0000 7f9f0cff6740 1 --2- 172.21.15.50:0/53469546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f7576dc40 0x561f757db670 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9efc0c5730 tx=0x7f9efc0b8c30 comp rx=0 tx=0).stop 2024-06-06T03:27:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.088+0000 7f9f0cff6740 1 -- 172.21.15.50:0/53469546 shutdown_connections 2024-06-06T03:27:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.088+0000 7f9f0cff6740 1 --2- 172.21.15.50:0/53469546 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561f757dcf80 0x561f757df3a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.088+0000 7f9f0cff6740 1 --2- 172.21.15.50:0/53469546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f7576dc40 0x561f757db670 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.088+0000 7f9ee37fe640 0 client.15486 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:30.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.088+0000 7f9f0cff6740 1 --2- 172.21.15.50:0/53469546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f75761f80 0x561f7576a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.088+0000 7f9f0cff6740 1 --2- 172.21.15.50:0/53469546 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f7575c420 0x561f7576a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.088+0000 7f9f0cff6740 1 -- 172.21.15.50:0/53469546 >> 172.21.15.50:0/53469546 conn(0x561f75753680 msgr2=0x561f75756590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:30.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.088+0000 7f9f0cff6740 1 -- 172.21.15.50:0/53469546 shutdown_connections 2024-06-06T03:27:30.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.088+0000 7f9f0cff6740 1 -- 172.21.15.50:0/53469546 wait complete. 2024-06-06T03:27:30.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.088+0000 7f9f0cff6740 20 client.15486 trim_cache size 0 max 16384 2024-06-06T03:27:30.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:27:30.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:27:30.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:27:30.093 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.089+0000 7f9f0a2ee640 1 -- 172.21.15.50:0/709131250 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9eec0a2c30 msgr2=0x7f9eec0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:30.093 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.089+0000 7f9f0a2ee640 1 --2- 172.21.15.50:0/709131250 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9eec0a2c30 0x7f9eec0a50f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x561f7575d210 tx=0x7f9ef8005f90 comp rx=0 tx=0).stop 2024-06-06T03:27:30.093 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.089+0000 7f9f0a2ee640 1 -- 172.21.15.50:0/709131250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f041076e0 msgr2=0x7f9f0419f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:30.093 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.089+0000 7f9f0a2ee640 1 --2- 172.21.15.50:0/709131250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f041076e0 0x7f9f0419f120 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9efc031970 tx=0x7f9efc003ba0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.093 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.089+0000 7f9f0a2ee640 1 -- 172.21.15.50:0/709131250 shutdown_connections 2024-06-06T03:27:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.089+0000 7f9f0a2ee640 1 --2- 172.21.15.50:0/709131250 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9eec0a2c30 0x7f9eec0a50f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.089+0000 7f9f0a2ee640 1 --2- 172.21.15.50:0/709131250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f041076e0 0x7f9f0419f120 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.089+0000 7f9f0a2ee640 1 --2- 172.21.15.50:0/709131250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f04104db0 0x7f9f041980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.089+0000 7f9f0a2ee640 1 --2- 172.21.15.50:0/709131250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f04102480 0x7f9f04197b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.089+0000 7f9f0a2ee640 1 -- 172.21.15.50:0/709131250 >> 172.21.15.50:0/709131250 conn(0x7f9f040fbe70 msgr2=0x7f9f04102dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.089+0000 7f9f0a2ee640 1 -- 172.21.15.50:0/709131250 shutdown_connections 2024-06-06T03:27:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:30.089+0000 7f9f0a2ee640 1 -- 172.21.15.50:0/709131250 wait complete. 2024-06-06T03:27:30.881 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:30 smithi050 ceph-mon[32421]: pgmap v457: 129 pgs: 129 active+clean; 668 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 8 op/s 2024-06-06T03:27:31.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:30 smithi079 ceph-mon[35478]: pgmap v457: 129 pgs: 129 active+clean; 668 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 8 op/s 2024-06-06T03:27:31.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:30 smithi122 ceph-mon[35759]: pgmap v457: 129 pgs: 129 active+clean; 668 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 8 op/s 2024-06-06T03:27:31.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.432+0000 7f73fdaa5700 1 -- 172.21.15.50:0/2446710150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f810ef40 msgr2=0x7f73f8111330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:31.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.432+0000 7f73fdaa5700 1 --2- 172.21.15.50:0/2446710150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f810ef40 0x7f73f8111330 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f73f000b0a0 tx=0x7f73f000b3b0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.432+0000 7f73fdaa5700 1 -- 172.21.15.50:0/2446710150 shutdown_connections 2024-06-06T03:27:31.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.432+0000 7f73fdaa5700 1 --2- 172.21.15.50:0/2446710150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f810ef40 0x7f73f8111330 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.432+0000 7f73fdaa5700 1 --2- 172.21.15.50:0/2446710150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f73f806a1a0 0x7f73f806a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.432+0000 7f73fdaa5700 1 --2- 172.21.15.50:0/2446710150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73f806aac0 0x7f73f810ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.432+0000 7f73fdaa5700 1 -- 172.21.15.50:0/2446710150 >> 172.21.15.50:0/2446710150 conn(0x7f73f8078340 msgr2=0x7f73f8078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:31.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.432+0000 7f73fdaa5700 1 -- 172.21.15.50:0/2446710150 shutdown_connections 2024-06-06T03:27:31.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.432+0000 7f73fdaa5700 1 -- 172.21.15.50:0/2446710150 wait complete. 2024-06-06T03:27:31.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.433+0000 7f73fdaa5700 1 Processor -- start 2024-06-06T03:27:31.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.433+0000 7f73fdaa5700 1 -- start start 2024-06-06T03:27:31.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.434+0000 7f73fdaa5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73f806a1a0 0x7f73f819ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:31.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.434+0000 7f73fdaa5700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f73f806aac0 0x7f73f819b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:31.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.434+0000 7f73fdaa5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f810ef40 0x7f73f819f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:31.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.434+0000 7f73fdaa5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f73f8114850 con 0x7f73f810ef40 2024-06-06T03:27:31.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.434+0000 7f73fdaa5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f73f81146d0 con 0x7f73f806a1a0 2024-06-06T03:27:31.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.434+0000 7f73fdaa5700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f73f81149d0 con 0x7f73f806aac0 2024-06-06T03:27:31.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.434+0000 7f73f6ffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f73f806aac0 0x7f73f819b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:31.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.434+0000 7f73f6ffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f73f806aac0 0x7f73f819b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:46576/0 (socket says 172.21.15.50:46576) 2024-06-06T03:27:31.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.434+0000 7f73f6ffd700 1 -- 172.21.15.50:0/3596983884 learned_addr learned my addr 172.21.15.50:0/3596983884 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:31.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.434+0000 7f73f7fff700 1 --2- 172.21.15.50:0/3596983884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f810ef40 0x7f73f819f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:31.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.434+0000 7f73f77fe700 1 --2- 172.21.15.50:0/3596983884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73f806a1a0 0x7f73f819ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:31.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.434+0000 7f73f6ffd700 1 -- 172.21.15.50:0/3596983884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73f806a1a0 msgr2=0x7f73f819ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:31.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.434+0000 7f73f6ffd700 1 --2- 172.21.15.50:0/3596983884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73f806a1a0 0x7f73f819ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.434+0000 7f73f6ffd700 1 -- 172.21.15.50:0/3596983884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f810ef40 msgr2=0x7f73f819f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:31.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.434+0000 7f73f6ffd700 1 --2- 172.21.15.50:0/3596983884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f810ef40 0x7f73f819f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.434+0000 7f73f6ffd700 1 -- 172.21.15.50:0/3596983884 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73f819fdb0 con 0x7f73f806aac0 2024-06-06T03:27:31.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.435+0000 7f73f6ffd700 1 --2- 172.21.15.50:0/3596983884 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f73f806aac0 0x7f73f819b2e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00d950 tx=0x7f73ec00dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:31.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.435+0000 7f73f4ff9700 1 -- 172.21.15.50:0/3596983884 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec016070 con 0x7f73f806aac0 2024-06-06T03:27:31.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.435+0000 7f73f4ff9700 1 -- 172.21.15.50:0/3596983884 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f73ec009df0 con 0x7f73f806aac0 2024-06-06T03:27:31.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.435+0000 7f73fdaa5700 1 -- 172.21.15.50:0/3596983884 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73f81a00a0 con 0x7f73f806aac0 2024-06-06T03:27:31.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.435+0000 7f73fdaa5700 1 -- 172.21.15.50:0/3596983884 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73f81a7920 con 0x7f73f806aac0 2024-06-06T03:27:31.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.435+0000 7f73f4ff9700 1 -- 172.21.15.50:0/3596983884 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec00f3c0 con 0x7f73f806aac0 2024-06-06T03:27:31.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.438+0000 7f73f4ff9700 1 -- 172.21.15.50:0/3596983884 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f73ec019070 con 0x7f73f806aac0 2024-06-06T03:27:31.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.439+0000 7f73f4ff9700 1 --2- 172.21.15.50:0/3596983884 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f73e00a2d20 0x7f73e00a51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:31.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.439+0000 7f7408328b80 1 Processor -- start 2024-06-06T03:27:31.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.440+0000 7f73f4ff9700 1 -- 172.21.15.50:0/3596983884 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f73ec0cef10 con 0x7f73f806aac0 2024-06-06T03:27:31.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.440+0000 7f73f77fe700 1 --2- 172.21.15.50:0/3596983884 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f73e00a2d20 0x7f73e00a51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:31.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.440+0000 7f7408328b80 1 -- start start 2024-06-06T03:27:31.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.440+0000 7f7408328b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a6670de20 0x562a6670e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:31.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.440+0000 7f7408328b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a6670e740 0x562a66709270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:31.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.440+0000 7f7408328b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a667097b0 0x562a66709bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:31.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.440+0000 7f7408328b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562a66652890 con 0x562a6670de20 2024-06-06T03:27:31.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.440+0000 7f7408328b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562a665fa7a0 con 0x562a6670e740 2024-06-06T03:27:31.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.440+0000 7f7408328b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562a6664e850 con 0x562a667097b0 2024-06-06T03:27:31.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.440+0000 7f73f77fe700 1 --2- 172.21.15.50:0/3596983884 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f73e00a2d20 0x7f73e00a51e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f73e8009bf0 tx=0x7f73e8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:31.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.440+0000 7f73f77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a6670de20 0x562a6670e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:31.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.440+0000 7f73f77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a6670de20 0x562a6670e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40714/0 (socket says 172.21.15.50:40714) 2024-06-06T03:27:31.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.440+0000 7f73f77fe700 1 -- 172.21.15.50:0/540682313 learned_addr learned my addr 172.21.15.50:0/540682313 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:31.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.440+0000 7f73f7fff700 1 --2- 172.21.15.50:0/540682313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a667097b0 0x562a66709bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:31.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.440+0000 7f73f6ffd700 1 --2- 172.21.15.50:0/540682313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a6670e740 0x562a66709270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:31.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.441+0000 7f73f7fff700 1 -- 172.21.15.50:0/540682313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a6670e740 msgr2=0x562a66709270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:31.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.441+0000 7f73f7fff700 1 --2- 172.21.15.50:0/540682313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a6670e740 0x562a66709270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.441+0000 7f73f7fff700 1 -- 172.21.15.50:0/540682313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a6670de20 msgr2=0x562a6670e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:31.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.441+0000 7f73f7fff700 1 --2- 172.21.15.50:0/540682313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a6670de20 0x562a6670e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.441+0000 7f73f7fff700 1 -- 172.21.15.50:0/540682313 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a665f0fd0 con 0x562a667097b0 2024-06-06T03:27:31.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.441+0000 7f73f77fe700 1 --2- 172.21.15.50:0/540682313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a6670de20 0x562a6670e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:27:31.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.441+0000 7f73f7fff700 1 --2- 172.21.15.50:0/540682313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a667097b0 0x562a66709bf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f73f000d010 tx=0x7f73f0009e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d480320706ab757c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:31.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.441+0000 7f73ddffb700 1 -- 172.21.15.50:0/540682313 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f000bcb0 con 0x562a667097b0 2024-06-06T03:27:31.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.441+0000 7f73ddffb700 1 -- 172.21.15.50:0/540682313 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f73f00074e0 con 0x562a667097b0 2024-06-06T03:27:31.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.441+0000 7f73ddffb700 1 -- 172.21.15.50:0/540682313 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f0005260 con 0x562a667097b0 2024-06-06T03:27:31.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.442+0000 7f7408328b80 1 -- 172.21.15.50:0/540682313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a667097b0 msgr2=0x562a66709bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:31.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.442+0000 7f7408328b80 1 --2- 172.21.15.50:0/540682313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a667097b0 0x562a66709bf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f73f000d010 tx=0x7f73f0009e20 comp rx=0 tx=0).stop 2024-06-06T03:27:31.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.442+0000 7f7408328b80 1 -- 172.21.15.50:0/540682313 shutdown_connections 2024-06-06T03:27:31.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.442+0000 7f7408328b80 1 --2- 172.21.15.50:0/540682313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a667097b0 0x562a66709bf0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.442+0000 7f7408328b80 1 --2- 172.21.15.50:0/540682313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a6670de20 0x562a6670e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.442+0000 7f7408328b80 1 --2- 172.21.15.50:0/540682313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a6670e740 0x562a66709270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.442+0000 7f7408328b80 1 -- 172.21.15.50:0/540682313 >> 172.21.15.50:0/540682313 conn(0x562a6662bd40 msgr2=0x562a666fb8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:31.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.443+0000 7f7408328b80 1 -- 172.21.15.50:0/540682313 shutdown_connections 2024-06-06T03:27:31.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.443+0000 7f7408328b80 1 -- 172.21.15.50:0/540682313 wait complete. 2024-06-06T03:27:31.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.443+0000 7f7408328b80 1 -- start start 2024-06-06T03:27:31.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.444+0000 7f7408328b80 1 Processor -- start 2024-06-06T03:27:31.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.444+0000 7f7408328b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a667097b0 0x562a66715570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:31.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.444+0000 7f7408328b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a6670de20 0x562a667128e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:31.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.444+0000 7f73f6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a6670de20 0x562a667128e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:31.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.444+0000 7f73f6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a6670de20 0x562a667128e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40726/0 (socket says 172.21.15.50:40726) 2024-06-06T03:27:31.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.444+0000 7f73f6ffd700 1 -- 172.21.15.50:0/1114700579 learned_addr learned my addr 172.21.15.50:0/1114700579 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:31.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.444+0000 7f7408328b80 1 --2- 172.21.15.50:0/1114700579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a6670e740 0x562a66712e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:31.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.444+0000 7f7408328b80 1 -- 172.21.15.50:0/1114700579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562a66716220 con 0x562a6670de20 2024-06-06T03:27:31.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.444+0000 7f7408328b80 1 -- 172.21.15.50:0/1114700579 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562a665f2c70 con 0x562a667097b0 2024-06-06T03:27:31.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.444+0000 7f7408328b80 1 -- 172.21.15.50:0/1114700579 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562a667163a0 con 0x562a6670e740 2024-06-06T03:27:31.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.444+0000 7f73f77fe700 1 --2- 172.21.15.50:0/1114700579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a667097b0 0x562a66715570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:31.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.444+0000 7f7408328b80 10 client.0 _ll_register_callbacks cb 0x562a665ec9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:31.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.445+0000 7f73f7fff700 1 --2- 172.21.15.50:0/1114700579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a6670e740 0x562a66712e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:31.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.445+0000 7f73f6ffd700 1 -- 172.21.15.50:0/1114700579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a6670e740 msgr2=0x562a66712e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:31.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.445+0000 7f73f6ffd700 1 --2- 172.21.15.50:0/1114700579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a6670e740 0x562a66712e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.445+0000 7f73f6ffd700 1 -- 172.21.15.50:0/1114700579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a667097b0 msgr2=0x562a66715570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:31.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.445+0000 7f73f6ffd700 1 --2- 172.21.15.50:0/1114700579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a667097b0 0x562a66715570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.445+0000 7f73f6ffd700 1 -- 172.21.15.50:0/1114700579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a665a1950 con 0x562a6670de20 2024-06-06T03:27:31.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.445+0000 7f73f6ffd700 1 --2- 172.21.15.50:0/1114700579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a6670de20 0x562a667128e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f73ec09b320 tx=0x7f73ec09afe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5064b5b14617b2df server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:31.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.445+0000 7f73d6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:27:31.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.445+0000 7f73d6ffd700 1 -- 172.21.15.50:0/1114700579 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec020040 con 0x562a6670de20 2024-06-06T03:27:31.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.445+0000 7f7408328b80 1 -- 172.21.15.50:0/1114700579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73f00074e0 con 0x562a6670de20 2024-06-06T03:27:31.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.445+0000 7f73d6ffd700 1 -- 172.21.15.50:0/1114700579 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f73ec09b7f0 con 0x562a6670de20 2024-06-06T03:27:31.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.445+0000 7f73d6ffd700 1 -- 172.21.15.50:0/1114700579 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f73ec0a4000 con 0x562a6670de20 2024-06-06T03:27:31.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.445+0000 7f7408328b80 10 client.15498 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:31.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.445+0000 7f7408328b80 1 -- 172.21.15.50:0/1114700579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562a667209a0 con 0x562a6670de20 2024-06-06T03:27:31.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.446+0000 7f73d6ffd700 1 -- 172.21.15.50:0/1114700579 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f73f00074e0 con 0x562a6670de20 2024-06-06T03:27:31.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.446+0000 7f73d6ffd700 1 -- 172.21.15.50:0/1114700579 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f73ec09a7e0 con 0x562a6670de20 2024-06-06T03:27:31.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.446+0000 7f7408328b80 10 client.15498 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:31.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.446+0000 7f7408328b80 10 client.15498 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:27:31.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.446+0000 7f7408328b80 20 client.15498 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:31.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.446+0000 7f7408328b80 1 --2- 172.21.15.50:0/1114700579 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562a66722e70 0x562a66725260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:31.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.446+0000 7f7408328b80 4 client.15498 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:27:31.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.446+0000 7f7408328b80 1 -- 172.21.15.50:0/1114700579 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a6665fd90 con 0x562a66722e70 2024-06-06T03:27:31.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.446+0000 7f73f77fe700 1 --2- 172.21.15.50:0/1114700579 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562a66722e70 0x562a66725260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:31.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.447+0000 7f73d6ffd700 10 client.15498 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:31.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.447+0000 7f73f77fe700 1 --2- 172.21.15.50:0/1114700579 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562a66722e70 0x562a66725260 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20015e91f3ca6eaf server_cookie=ef824767e636a3e0 in_seq=0 out_seq=0 2024-06-06T03:27:31.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.448+0000 7f73d6ffd700 1 -- 172.21.15.50:0/1114700579 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x562a6665fd90 con 0x562a66722e70 2024-06-06T03:27:31.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.448+0000 7f73d6ffd700 10 client.15498 handle_command_reply: tid=0 2024-06-06T03:27:31.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.448+0000 7f7408328b80 1 client.15498 shutdown 2024-06-06T03:27:31.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.448+0000 7f7408328b80 1 -- 172.21.15.50:0/1114700579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a6670de20 msgr2=0x562a667128e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:31.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.448+0000 7f7408328b80 1 --2- 172.21.15.50:0/1114700579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a6670de20 0x562a667128e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f73ec09b320 tx=0x7f73ec09afe0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.448+0000 7f7408328b80 1 -- 172.21.15.50:0/1114700579 shutdown_connections 2024-06-06T03:27:31.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.448+0000 7f7408328b80 1 --2- 172.21.15.50:0/1114700579 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562a66722e70 0x562a66725260 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.448+0000 7f7408328b80 1 --2- 172.21.15.50:0/1114700579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a6670e740 0x562a66712e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.448+0000 7f7408328b80 1 --2- 172.21.15.50:0/1114700579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a667097b0 0x562a66715570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.448+0000 7f7408328b80 1 --2- 172.21.15.50:0/1114700579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a6670de20 0x562a667128e0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.448+0000 7f7408328b80 1 -- 172.21.15.50:0/1114700579 >> 172.21.15.50:0/1114700579 conn(0x562a6662bd40 msgr2=0x562a666fb670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:31.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.448+0000 7f73d6ffd700 0 client.15498 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:31.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.448+0000 7f7408328b80 1 -- 172.21.15.50:0/1114700579 shutdown_connections 2024-06-06T03:27:31.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.448+0000 7f7408328b80 1 -- 172.21.15.50:0/1114700579 wait complete. 2024-06-06T03:27:31.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.449+0000 7f7408328b80 20 client.15498 trim_cache size 0 max 16384 2024-06-06T03:27:31.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.469+0000 7f7408328b80 1 Processor -- start 2024-06-06T03:27:31.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.470+0000 7f7408328b80 1 -- start start 2024-06-06T03:27:31.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.470+0000 7f7408328b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a6662bd40 0x562a667120b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:31.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.470+0000 7f7408328b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a667097b0 0x562a6670b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:31.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.470+0000 7f7408328b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a6670e740 0x562a6670be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:31.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.470+0000 7f7408328b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f73f81ae7b0 con 0x562a6662bd40 2024-06-06T03:27:31.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.470+0000 7f7408328b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f73f81ac040 con 0x562a667097b0 2024-06-06T03:27:31.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.470+0000 7f7408328b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f73f81a9fb0 con 0x562a6670e740 2024-06-06T03:27:31.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.470+0000 7f73f7fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a6670e740 0x562a6670be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:31.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.470+0000 7f73f7fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a6670e740 0x562a6670be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:46606/0 (socket says 172.21.15.50:46606) 2024-06-06T03:27:31.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.470+0000 7f73f7fff700 1 -- 172.21.15.50:0/2621369629 learned_addr learned my addr 172.21.15.50:0/2621369629 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:31.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.470+0000 7f73f7fff700 1 -- 172.21.15.50:0/2621369629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a667097b0 msgr2=0x562a6670b930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:27:31.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.470+0000 7f73f7fff700 1 --2- 172.21.15.50:0/2621369629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a667097b0 0x562a6670b930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.470+0000 7f73f7fff700 1 -- 172.21.15.50:0/2621369629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a6662bd40 msgr2=0x562a667120b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:31.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.470+0000 7f73f7fff700 1 --2- 172.21.15.50:0/2621369629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a6662bd40 0x562a667120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.471+0000 7f73f7fff700 1 -- 172.21.15.50:0/2621369629 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a6670c3b0 con 0x562a6670e740 2024-06-06T03:27:31.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.471+0000 7f73f7fff700 1 --2- 172.21.15.50:0/2621369629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a6670e740 0x562a6670be70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f73f0006190 tx=0x7f73f0007e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1994bd8b01fd4712 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:31.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.471+0000 7f73dd7fa700 1 -- 172.21.15.50:0/2621369629 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f0003a00 con 0x562a6670e740 2024-06-06T03:27:31.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.471+0000 7f73dd7fa700 1 -- 172.21.15.50:0/2621369629 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f73f002a070 con 0x562a6670e740 2024-06-06T03:27:31.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.471+0000 7f73dd7fa700 1 -- 172.21.15.50:0/2621369629 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f00052a0 con 0x562a6670e740 2024-06-06T03:27:31.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.472+0000 7f7408328b80 1 -- 172.21.15.50:0/2621369629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a6670e740 msgr2=0x562a6670be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:31.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.472+0000 7f7408328b80 1 --2- 172.21.15.50:0/2621369629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a6670e740 0x562a6670be70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f73f0006190 tx=0x7f73f0007e40 comp rx=0 tx=0).stop 2024-06-06T03:27:31.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.472+0000 7f7408328b80 1 -- 172.21.15.50:0/2621369629 shutdown_connections 2024-06-06T03:27:31.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.472+0000 7f7408328b80 1 --2- 172.21.15.50:0/2621369629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a6670e740 0x562a6670be70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.472+0000 7f7408328b80 1 --2- 172.21.15.50:0/2621369629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a6662bd40 0x562a667120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.472+0000 7f7408328b80 1 --2- 172.21.15.50:0/2621369629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a667097b0 0x562a6670b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.472+0000 7f7408328b80 1 -- 172.21.15.50:0/2621369629 >> 172.21.15.50:0/2621369629 conn(0x562a666f59a0 msgr2=0x562a667002e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:31.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.472+0000 7f7408328b80 1 -- 172.21.15.50:0/2621369629 shutdown_connections 2024-06-06T03:27:31.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.472+0000 7f7408328b80 1 -- 172.21.15.50:0/2621369629 wait complete. 2024-06-06T03:27:31.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.473+0000 7f7408328b80 1 -- start start 2024-06-06T03:27:31.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.473+0000 7f7408328b80 1 Processor -- start 2024-06-06T03:27:31.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.473+0000 7f7408328b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a6662bd40 0x562a6671ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:31.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.473+0000 7f7408328b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a667097b0 0x562a6671bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:31.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.473+0000 7f7408328b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a6670e740 0x562a667167f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:31.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.473+0000 7f7408328b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f73f81aa500 con 0x562a667097b0 2024-06-06T03:27:31.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.473+0000 7f7408328b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f73f81ab970 con 0x562a6662bd40 2024-06-06T03:27:31.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.473+0000 7f7408328b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f73f81aabd0 con 0x562a6670e740 2024-06-06T03:27:31.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.474+0000 7f7408328b80 10 client.0 _ll_register_callbacks cb 0x562a665ec9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:31.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.474+0000 7f73f7fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a6670e740 0x562a667167f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:31.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.474+0000 7f73f7fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a6670e740 0x562a667167f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:46618/0 (socket says 172.21.15.50:46618) 2024-06-06T03:27:31.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.474+0000 7f73f7fff700 1 -- 172.21.15.50:0/3964262872 learned_addr learned my addr 172.21.15.50:0/3964262872 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:31.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.474+0000 7f73f6ffd700 1 --2- 172.21.15.50:0/3964262872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a667097b0 0x562a6671bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:31.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.474+0000 7f73f77fe700 1 --2- 172.21.15.50:0/3964262872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a6662bd40 0x562a6671ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:31.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.474+0000 7f73f7fff700 1 -- 172.21.15.50:0/3964262872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a6662bd40 msgr2=0x562a6671ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:31.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.474+0000 7f73f7fff700 1 --2- 172.21.15.50:0/3964262872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a6662bd40 0x562a6671ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.474+0000 7f73f7fff700 1 -- 172.21.15.50:0/3964262872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a667097b0 msgr2=0x562a6671bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:31.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.474+0000 7f73f7fff700 1 --2- 172.21.15.50:0/3964262872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a667097b0 0x562a6671bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.474+0000 7f73f7fff700 1 -- 172.21.15.50:0/3964262872 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a66717000 con 0x562a6670e740 2024-06-06T03:27:31.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.474+0000 7f73f7fff700 1 --2- 172.21.15.50:0/3964262872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a6670e740 0x562a667167f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f73f0009e60 tx=0x7f73f0007cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58652d5a5375ccee server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:31.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.474+0000 7f73d6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:27:31.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.475+0000 7f73d6ffd700 1 -- 172.21.15.50:0/3964262872 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f00076a0 con 0x562a6670e740 2024-06-06T03:27:31.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.475+0000 7f7408328b80 1 -- 172.21.15.50:0/3964262872 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73f002a070 con 0x562a6670e740 2024-06-06T03:27:31.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.475+0000 7f73d6ffd700 1 -- 172.21.15.50:0/3964262872 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f73f0007840 con 0x562a6670e740 2024-06-06T03:27:31.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.475+0000 7f73d6ffd700 1 -- 172.21.15.50:0/3964262872 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f73f0040050 con 0x562a6670e740 2024-06-06T03:27:31.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.475+0000 7f7408328b80 10 client.25132 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:31.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.475+0000 7f7408328b80 1 -- 172.21.15.50:0/3964262872 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562a6678e770 con 0x562a6670e740 2024-06-06T03:27:31.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.475+0000 7f73d6ffd700 1 -- 172.21.15.50:0/3964262872 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f73f002a070 con 0x562a6670e740 2024-06-06T03:27:31.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.475+0000 7f73d6ffd700 1 -- 172.21.15.50:0/3964262872 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f73f0011070 con 0x562a6670e740 2024-06-06T03:27:31.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.475+0000 7f7408328b80 10 client.25132 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:31.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.475+0000 7f7408328b80 10 client.25132 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:27:31.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.475+0000 7f7408328b80 20 client.25132 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:31.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.475+0000 7f7408328b80 1 --2- 172.21.15.50:0/3964262872 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562a6678e940 0x562a66790d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:31.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.476+0000 7f7408328b80 4 client.25132 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-06T03:27:31.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.476+0000 7f7408328b80 1 -- 172.21.15.50:0/3964262872 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562a6665a310 con 0x562a6678e940 2024-06-06T03:27:31.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.476+0000 7f73f77fe700 1 --2- 172.21.15.50:0/3964262872 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562a6678e940 0x562a66790d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:31.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.476+0000 7f73d6ffd700 10 client.25132 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:31.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.476+0000 7f73f77fe700 1 --2- 172.21.15.50:0/3964262872 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562a6678e940 0x562a66790d30 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef9c0c429d655aa3 server_cookie=e1ac030d414c4260 in_seq=0 out_seq=0 2024-06-06T03:27:31.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.477+0000 7f73d6ffd700 1 -- 172.21.15.50:0/3964262872 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562a6665a310 con 0x562a6678e940 2024-06-06T03:27:31.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.477+0000 7f73d6ffd700 10 client.25132 handle_command_reply: tid=0 2024-06-06T03:27:31.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.477+0000 7f7408328b80 1 client.25132 shutdown 2024-06-06T03:27:31.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.478+0000 7f7408328b80 1 -- 172.21.15.50:0/3964262872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a6670e740 msgr2=0x562a667167f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:31.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.478+0000 7f7408328b80 1 --2- 172.21.15.50:0/3964262872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a6670e740 0x562a667167f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f73f0009e60 tx=0x7f73f0007cf0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.478+0000 7f7408328b80 1 -- 172.21.15.50:0/3964262872 shutdown_connections 2024-06-06T03:27:31.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.478+0000 7f7408328b80 1 --2- 172.21.15.50:0/3964262872 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562a6678e940 0x562a66790d30 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.478+0000 7f7408328b80 1 --2- 172.21.15.50:0/3964262872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a6670e740 0x562a667167f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.478+0000 7f7408328b80 1 --2- 172.21.15.50:0/3964262872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a6662bd40 0x562a6671ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.478+0000 7f7408328b80 1 --2- 172.21.15.50:0/3964262872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a667097b0 0x562a6671bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.478+0000 7f73d6ffd700 0 client.25132 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:31.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.478+0000 7f7408328b80 1 -- 172.21.15.50:0/3964262872 >> 172.21.15.50:0/3964262872 conn(0x562a666f59a0 msgr2=0x562a6670ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:31.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.478+0000 7f7408328b80 1 -- 172.21.15.50:0/3964262872 shutdown_connections 2024-06-06T03:27:31.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.479+0000 7f7408328b80 1 -- 172.21.15.50:0/3964262872 wait complete. 2024-06-06T03:27:31.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.479+0000 7f7408328b80 20 client.25132 trim_cache size 0 max 16384 2024-06-06T03:27:31.481 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:27:31.481 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-06-06T03:27:31.481 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "2a5f624d-5095-4bf6-a1ae-e9e1937a06e4", 2024-06-06T03:27:31.481 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-06-06T03:27:31.481 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:27:31.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.479+0000 7f73fdaa5700 1 -- 172.21.15.50:0/3596983884 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f73e00a2d20 msgr2=0x7f73e00a51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:31.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.479+0000 7f73fdaa5700 1 --2- 172.21.15.50:0/3596983884 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f73e00a2d20 0x7f73e00a51e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f73e8009bf0 tx=0x7f73e8009260 comp rx=0 tx=0).stop 2024-06-06T03:27:31.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.479+0000 7f73fdaa5700 1 -- 172.21.15.50:0/3596983884 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f73f806aac0 msgr2=0x7f73f819b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:31.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.479+0000 7f73fdaa5700 1 --2- 172.21.15.50:0/3596983884 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f73f806aac0 0x7f73f819b2e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00d950 tx=0x7f73ec00dc60 comp rx=0 tx=0).stop 2024-06-06T03:27:31.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.479+0000 7f73fdaa5700 1 -- 172.21.15.50:0/3596983884 shutdown_connections 2024-06-06T03:27:31.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.479+0000 7f73fdaa5700 1 --2- 172.21.15.50:0/3596983884 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f73e00a2d20 0x7f73e00a51e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.479+0000 7f73fdaa5700 1 --2- 172.21.15.50:0/3596983884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f810ef40 0x7f73f819f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.479+0000 7f73fdaa5700 1 --2- 172.21.15.50:0/3596983884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73f806a1a0 0x7f73f819ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.479+0000 7f73fdaa5700 1 --2- 172.21.15.50:0/3596983884 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f73f806aac0 0x7f73f819b2e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:31.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.480+0000 7f73fdaa5700 1 -- 172.21.15.50:0/3596983884 >> 172.21.15.50:0/3596983884 conn(0x7f73f8078340 msgr2=0x7f73f8110490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:31.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.480+0000 7f73fdaa5700 1 -- 172.21.15.50:0/3596983884 shutdown_connections 2024-06-06T03:27:31.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:31.480+0000 7f73fdaa5700 1 -- 172.21.15.50:0/3596983884 wait complete. 2024-06-06T03:27:32.304 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-06T03:27:32.634 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:27:33.024 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:32 smithi050 ceph-mon[32421]: pgmap v458: 129 pgs: 129 active+clean; 668 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-06-06T03:27:33.024 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:32 smithi050 ceph-mon[32421]: scrub queued for path: / 2024-06-06T03:27:33.024 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:32 smithi050 ceph-mon[32421]: scrub summary: idle+waiting paths [/] 2024-06-06T03:27:33.024 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:32 smithi050 ceph-mon[32421]: scrub summary: active paths [/] 2024-06-06T03:27:33.024 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:32 smithi050 ceph-mon[32421]: scrub summary: idle+waiting paths [/] 2024-06-06T03:27:33.024 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:32 smithi050 ceph-mon[32421]: scrub summary: idle 2024-06-06T03:27:33.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:32 smithi079 ceph-mon[35478]: pgmap v458: 129 pgs: 129 active+clean; 668 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-06-06T03:27:33.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:32 smithi079 ceph-mon[35478]: scrub queued for path: / 2024-06-06T03:27:33.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:32 smithi079 ceph-mon[35478]: scrub summary: idle+waiting paths [/] 2024-06-06T03:27:33.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:32 smithi079 ceph-mon[35478]: scrub summary: active paths [/] 2024-06-06T03:27:33.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:32 smithi079 ceph-mon[35478]: scrub summary: idle+waiting paths [/] 2024-06-06T03:27:33.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:32 smithi079 ceph-mon[35478]: scrub summary: idle 2024-06-06T03:27:33.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:32 smithi122 ceph-mon[35759]: pgmap v458: 129 pgs: 129 active+clean; 668 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-06-06T03:27:33.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:32 smithi122 ceph-mon[35759]: scrub queued for path: / 2024-06-06T03:27:33.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:32 smithi122 ceph-mon[35759]: scrub summary: idle+waiting paths [/] 2024-06-06T03:27:33.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:32 smithi122 ceph-mon[35759]: scrub summary: active paths [/] 2024-06-06T03:27:33.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:32 smithi122 ceph-mon[35759]: scrub summary: idle+waiting paths [/] 2024-06-06T03:27:33.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:32 smithi122 ceph-mon[35759]: scrub summary: idle 2024-06-06T03:27:34.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.569+0000 7fb71c68c700 1 -- 172.21.15.50:0/3008892187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb714101d30 msgr2=0x7fb71410e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:34.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.569+0000 7fb71c68c700 1 --2- 172.21.15.50:0/3008892187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb714101d30 0x7fb71410e210 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00b0a0 tx=0x7fb70c00b3b0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.570+0000 7fb71c68c700 1 -- 172.21.15.50:0/3008892187 shutdown_connections 2024-06-06T03:27:34.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.570+0000 7fb71c68c700 1 --2- 172.21.15.50:0/3008892187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb714101d30 0x7fb71410e210 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.570+0000 7fb71c68c700 1 --2- 172.21.15.50:0/3008892187 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7141073d0 0x7fb7141077b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.570+0000 7fb71c68c700 1 --2- 172.21.15.50:0/3008892187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb714101390 0x7fb7141017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.570+0000 7fb71c68c700 1 -- 172.21.15.50:0/3008892187 >> 172.21.15.50:0/3008892187 conn(0x7fb7140782c0 msgr2=0x7fb7140786d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:34.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.570+0000 7fb71c68c700 1 -- 172.21.15.50:0/3008892187 shutdown_connections 2024-06-06T03:27:34.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.570+0000 7fb71c68c700 1 -- 172.21.15.50:0/3008892187 wait complete. 2024-06-06T03:27:34.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.571+0000 7fb71c68c700 1 Processor -- start 2024-06-06T03:27:34.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.571+0000 7fb71c68c700 1 -- start start 2024-06-06T03:27:34.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.571+0000 7fb71c68c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb714101390 0x7fb7141997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:34.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.571+0000 7fb71c68c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb714101d30 0x7fb714199ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:34.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.571+0000 7fb71c68c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7141073d0 0x7fb7141a4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:34.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.571+0000 7fb71ac29700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7141073d0 0x7fb7141a4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:34.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.571+0000 7fb71a428700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb714101390 0x7fb7141997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:34.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.571+0000 7fb719c27700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb714101d30 0x7fb714199ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:34.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.571+0000 7fb71a428700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb714101390 0x7fb7141997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:46630/0 (socket says 172.21.15.50:46630) 2024-06-06T03:27:34.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.571+0000 7fb71a428700 1 -- 172.21.15.50:0/2306594132 learned_addr learned my addr 172.21.15.50:0/2306594132 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:34.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.571+0000 7fb71c68c700 1 -- 172.21.15.50:0/2306594132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb714111520 con 0x7fb7141073d0 2024-06-06T03:27:34.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.572+0000 7fb71c68c700 1 -- 172.21.15.50:0/2306594132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb7141113a0 con 0x7fb714101d30 2024-06-06T03:27:34.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.572+0000 7fb71c68c700 1 -- 172.21.15.50:0/2306594132 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb7141116a0 con 0x7fb714101390 2024-06-06T03:27:34.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.572+0000 7fb71a428700 1 -- 172.21.15.50:0/2306594132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb714101d30 msgr2=0x7fb714199ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:34.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.572+0000 7fb71a428700 1 --2- 172.21.15.50:0/2306594132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb714101d30 0x7fb714199ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.572+0000 7fb71a428700 1 -- 172.21.15.50:0/2306594132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7141073d0 msgr2=0x7fb7141a4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:34.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.572+0000 7fb71a428700 1 --2- 172.21.15.50:0/2306594132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7141073d0 0x7fb7141a4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.572+0000 7fb71a428700 1 -- 172.21.15.50:0/2306594132 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7141a4d60 con 0x7fb714101390 2024-06-06T03:27:34.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.572+0000 7fb71a428700 1 --2- 172.21.15.50:0/2306594132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb714101390 0x7fb7141997a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb71000bf20 tx=0x7fb71000dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:34.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.573+0000 7fb70b7fe700 1 -- 172.21.15.50:0/2306594132 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb710012c90 con 0x7fb714101390 2024-06-06T03:27:34.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.573+0000 7fb70b7fe700 1 -- 172.21.15.50:0/2306594132 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb710012e30 con 0x7fb714101390 2024-06-06T03:27:34.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.573+0000 7fb71c68c700 1 -- 172.21.15.50:0/2306594132 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7141975f0 con 0x7fb714101390 2024-06-06T03:27:34.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.573+0000 7fb70b7fe700 1 -- 172.21.15.50:0/2306594132 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb710009840 con 0x7fb714101390 2024-06-06T03:27:34.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.573+0000 7fb71c68c700 1 -- 172.21.15.50:0/2306594132 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb714197b80 con 0x7fb714101390 2024-06-06T03:27:34.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.576+0000 7fb70b7fe700 1 -- 172.21.15.50:0/2306594132 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb7100099e0 con 0x7fb714101390 2024-06-06T03:27:34.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.577+0000 7fb70b7fe700 1 --2- 172.21.15.50:0/2306594132 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb7000a2d20 0x7fb7000a51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:34.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.578+0000 7fb70b7fe700 1 -- 172.21.15.50:0/2306594132 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fb7100d33e0 con 0x7fb714101390 2024-06-06T03:27:34.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.578+0000 7fb719c27700 1 --2- 172.21.15.50:0/2306594132 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb7000a2d20 0x7fb7000a51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:34.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.578+0000 7fb726f0fb80 1 Processor -- start 2024-06-06T03:27:34.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.579+0000 7fb719c27700 1 --2- 172.21.15.50:0/2306594132 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb7000a2d20 0x7fb7000a51e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb714078770 tx=0x7fb70400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:34.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.579+0000 7fb726f0fb80 1 -- start start 2024-06-06T03:27:34.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.579+0000 7fb726f0fb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556637be5f60 0x556637be6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:34.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.579+0000 7fb726f0fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556637be6880 0x556637be0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:34.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.579+0000 7fb726f0fb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556637be07a0 0x556637be0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:34.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.579+0000 7fb726f0fb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556637ad2f60 con 0x556637be5f60 2024-06-06T03:27:34.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.579+0000 7fb726f0fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556637b31850 con 0x556637be6880 2024-06-06T03:27:34.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.579+0000 7fb71a428700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556637be5f60 0x556637be6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:34.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.579+0000 7fb71a428700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556637be5f60 0x556637be6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40780/0 (socket says 172.21.15.50:40780) 2024-06-06T03:27:34.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.579+0000 7fb726f0fb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556637a99460 con 0x556637be07a0 2024-06-06T03:27:34.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.579+0000 7fb71a428700 1 -- 172.21.15.50:0/2691983169 learned_addr learned my addr 172.21.15.50:0/2691983169 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:34.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.579+0000 7fb71ac29700 1 --2- 172.21.15.50:0/2691983169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556637be07a0 0x556637be0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:34.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.579+0000 7fb719c27700 1 --2- 172.21.15.50:0/2691983169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556637be6880 0x556637be0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:34.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.580+0000 7fb71ac29700 1 -- 172.21.15.50:0/2691983169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556637be6880 msgr2=0x556637be0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:34.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.580+0000 7fb71ac29700 1 --2- 172.21.15.50:0/2691983169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556637be6880 0x556637be0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.580+0000 7fb71ac29700 1 -- 172.21.15.50:0/2691983169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556637be5f60 msgr2=0x556637be6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:34.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.580+0000 7fb71ac29700 1 --2- 172.21.15.50:0/2691983169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556637be5f60 0x556637be6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.580+0000 7fb71ac29700 1 -- 172.21.15.50:0/2691983169 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556637a808d0 con 0x556637be07a0 2024-06-06T03:27:34.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.580+0000 7fb71a428700 1 --2- 172.21.15.50:0/2691983169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556637be5f60 0x556637be6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:27:34.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.580+0000 7fb71ac29700 1 --2- 172.21.15.50:0/2691983169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556637be07a0 0x556637be0bc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb70c0062a0 tx=0x7fb70c009180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc07c3fc938c9052 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:34.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.580+0000 7fb708ff9700 1 -- 172.21.15.50:0/2691983169 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70c020070 con 0x556637be07a0 2024-06-06T03:27:34.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.580+0000 7fb708ff9700 1 -- 172.21.15.50:0/2691983169 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb70c003c00 con 0x556637be07a0 2024-06-06T03:27:34.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.580+0000 7fb708ff9700 1 -- 172.21.15.50:0/2691983169 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70c0052a0 con 0x556637be07a0 2024-06-06T03:27:34.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.581+0000 7fb726f0fb80 1 -- 172.21.15.50:0/2691983169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556637be07a0 msgr2=0x556637be0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:34.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.581+0000 7fb726f0fb80 1 --2- 172.21.15.50:0/2691983169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556637be07a0 0x556637be0bc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb70c0062a0 tx=0x7fb70c009180 comp rx=0 tx=0).stop 2024-06-06T03:27:34.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.581+0000 7fb726f0fb80 1 -- 172.21.15.50:0/2691983169 shutdown_connections 2024-06-06T03:27:34.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.581+0000 7fb726f0fb80 1 --2- 172.21.15.50:0/2691983169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556637be07a0 0x556637be0bc0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.581+0000 7fb726f0fb80 1 --2- 172.21.15.50:0/2691983169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556637be5f60 0x556637be6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.581+0000 7fb726f0fb80 1 --2- 172.21.15.50:0/2691983169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556637be6880 0x556637be0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.581+0000 7fb726f0fb80 1 -- 172.21.15.50:0/2691983169 >> 172.21.15.50:0/2691983169 conn(0x556637b0d080 msgr2=0x556637bdb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:34.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.581+0000 7fb726f0fb80 1 -- 172.21.15.50:0/2691983169 shutdown_connections 2024-06-06T03:27:34.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.581+0000 7fb726f0fb80 1 -- 172.21.15.50:0/2691983169 wait complete. 2024-06-06T03:27:34.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.582+0000 7fb726f0fb80 1 -- start start 2024-06-06T03:27:34.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.582+0000 7fb726f0fb80 1 Processor -- start 2024-06-06T03:27:34.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.582+0000 7fb726f0fb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556637be07a0 0x556637bec5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:34.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.582+0000 7fb726f0fb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556637be5f60 0x556637be98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:34.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.582+0000 7fb726f0fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556637be6880 0x556637be9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:34.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.582+0000 7fb726f0fb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556637ad1fc0 con 0x556637be07a0 2024-06-06T03:27:34.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.582+0000 7fb726f0fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556637b2d810 con 0x556637be6880 2024-06-06T03:27:34.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.582+0000 7fb726f0fb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556637bed200 con 0x556637be5f60 2024-06-06T03:27:34.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.582+0000 7fb726f0fb80 10 client.0 _ll_register_callbacks cb 0x556637ac75b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:34.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.583+0000 7fb71a428700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556637be07a0 0x556637bec5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:34.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.583+0000 7fb71ac29700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556637be6880 0x556637be9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:34.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.583+0000 7fb719c27700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556637be5f60 0x556637be98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:34.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.583+0000 7fb71a428700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556637be07a0 0x556637bec5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40790/0 (socket says 172.21.15.50:40790) 2024-06-06T03:27:34.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.583+0000 7fb71ac29700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556637be6880 0x556637be9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:52736/0 (socket says 172.21.15.50:52736) 2024-06-06T03:27:34.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.583+0000 7fb71a428700 1 -- 172.21.15.50:0/3197679639 learned_addr learned my addr 172.21.15.50:0/3197679639 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:34.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.583+0000 7fb719c27700 1 -- 172.21.15.50:0/3197679639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556637be6880 msgr2=0x556637be9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:34.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.583+0000 7fb719c27700 1 --2- 172.21.15.50:0/3197679639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556637be6880 0x556637be9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.583+0000 7fb719c27700 1 -- 172.21.15.50:0/3197679639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556637be07a0 msgr2=0x556637bec5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:34.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.583+0000 7fb719c27700 1 --2- 172.21.15.50:0/3197679639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556637be07a0 0x556637bec5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.583+0000 7fb719c27700 1 -- 172.21.15.50:0/3197679639 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556637af7750 con 0x556637be5f60 2024-06-06T03:27:34.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.583+0000 7fb71ac29700 1 --2- 172.21.15.50:0/3197679639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556637be6880 0x556637be9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:27:34.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.583+0000 7fb71a428700 1 --2- 172.21.15.50:0/3197679639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556637be07a0 0x556637bec5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:27:34.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.583+0000 7fb719c27700 1 --2- 172.21.15.50:0/3197679639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556637be5f60 0x556637be98c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb704005950 tx=0x7fb7040047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=179285d14ad53ce4 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:34.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.583+0000 7fb6fdffb700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:27:34.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.584+0000 7fb6fdffb700 1 -- 172.21.15.50:0/3197679639 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb704004a30 con 0x556637be5f60 2024-06-06T03:27:34.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.584+0000 7fb726f0fb80 1 -- 172.21.15.50:0/3197679639 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb70c003c00 con 0x556637be5f60 2024-06-06T03:27:34.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.584+0000 7fb6fdffb700 1 -- 172.21.15.50:0/3197679639 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fb704004bd0 con 0x556637be5f60 2024-06-06T03:27:34.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.584+0000 7fb6fdffb700 1 -- 172.21.15.50:0/3197679639 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb704030050 con 0x556637be5f60 2024-06-06T03:27:34.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.584+0000 7fb726f0fb80 10 client.25144 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:34.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.584+0000 7fb726f0fb80 1 -- 172.21.15.50:0/3197679639 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556637bf7830 con 0x556637be5f60 2024-06-06T03:27:34.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.584+0000 7fb6fdffb700 1 -- 172.21.15.50:0/3197679639 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb704023070 con 0x556637be5f60 2024-06-06T03:27:34.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.585+0000 7fb6fdffb700 1 -- 172.21.15.50:0/3197679639 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fb70401f6d0 con 0x556637be5f60 2024-06-06T03:27:34.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.585+0000 7fb726f0fb80 10 client.25144 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:34.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.585+0000 7fb726f0fb80 10 client.25144 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:27:34.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.585+0000 7fb726f0fb80 20 client.25144 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:34.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.585+0000 7fb726f0fb80 1 --2- 172.21.15.50:0/3197679639 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x556637bf9e70 0x556637bfc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:34.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.585+0000 7fb726f0fb80 4 client.25144 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:27:34.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.585+0000 7fb726f0fb80 1 -- 172.21.15.50:0/3197679639 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb70c003c00 con 0x556637bf9e70 2024-06-06T03:27:34.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.586+0000 7fb71a428700 1 --2- 172.21.15.50:0/3197679639 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x556637bf9e70 0x556637bfc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:34.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.586+0000 7fb71a428700 1 --2- 172.21.15.50:0/3197679639 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x556637bf9e70 0x556637bfc260 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ace8d2951f11dc9f server_cookie=299d5fa68f70879d in_seq=0 out_seq=0 2024-06-06T03:27:34.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.586+0000 7fb6fdffb700 10 client.25144 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:34.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.587+0000 7fb6fdffb700 1 -- 172.21.15.50:0/3197679639 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x7fb70c003c00 con 0x556637bf9e70 2024-06-06T03:27:34.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.587+0000 7fb6fdffb700 10 client.25144 handle_command_reply: tid=0 2024-06-06T03:27:34.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.587+0000 7fb726f0fb80 1 client.25144 shutdown 2024-06-06T03:27:34.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.587+0000 7fb726f0fb80 1 -- 172.21.15.50:0/3197679639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556637be5f60 msgr2=0x556637be98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:34.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.587+0000 7fb726f0fb80 1 --2- 172.21.15.50:0/3197679639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556637be5f60 0x556637be98c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb704005950 tx=0x7fb7040047c0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.587+0000 7fb726f0fb80 1 -- 172.21.15.50:0/3197679639 shutdown_connections 2024-06-06T03:27:34.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.587+0000 7fb726f0fb80 1 --2- 172.21.15.50:0/3197679639 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x556637bf9e70 0x556637bfc260 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.587+0000 7fb726f0fb80 1 --2- 172.21.15.50:0/3197679639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556637be6880 0x556637be9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.587+0000 7fb726f0fb80 1 --2- 172.21.15.50:0/3197679639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556637be07a0 0x556637bec5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.587+0000 7fb6fdffb700 0 client.25144 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:34.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.587+0000 7fb726f0fb80 1 --2- 172.21.15.50:0/3197679639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556637be5f60 0x556637be98c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.587+0000 7fb726f0fb80 1 -- 172.21.15.50:0/3197679639 >> 172.21.15.50:0/3197679639 conn(0x556637b0d080 msgr2=0x556637bda700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:34.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.587+0000 7fb726f0fb80 1 -- 172.21.15.50:0/3197679639 shutdown_connections 2024-06-06T03:27:34.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.587+0000 7fb726f0fb80 1 -- 172.21.15.50:0/3197679639 wait complete. 2024-06-06T03:27:34.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.588+0000 7fb726f0fb80 20 client.25144 trim_cache size 0 max 16384 2024-06-06T03:27:34.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.628+0000 7fb726f0fb80 1 Processor -- start 2024-06-06T03:27:34.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.628+0000 7fb726f0fb80 1 -- start start 2024-06-06T03:27:34.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.628+0000 7fb726f0fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556637be07a0 0x556637be0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:34.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.628+0000 7fb726f0fb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556637be5f60 0x556637be7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:34.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.629+0000 7fb726f0fb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556637be6880 0x556637bdae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:34.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.629+0000 7fb726f0fb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb7141ae5d0 con 0x556637be5f60 2024-06-06T03:27:34.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.629+0000 7fb726f0fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb7141abe60 con 0x556637be07a0 2024-06-06T03:27:34.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.629+0000 7fb726f0fb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb7141a9cb0 con 0x556637be6880 2024-06-06T03:27:34.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.629+0000 7fb719c27700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556637be5f60 0x556637be7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:34.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.629+0000 7fb719c27700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556637be5f60 0x556637be7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40796/0 (socket says 172.21.15.50:40796) 2024-06-06T03:27:34.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.629+0000 7fb719c27700 1 -- 172.21.15.50:0/1366393536 learned_addr learned my addr 172.21.15.50:0/1366393536 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:34.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.629+0000 7fb71a428700 1 --2- 172.21.15.50:0/1366393536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556637be07a0 0x556637be0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:34.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.629+0000 7fb71ac29700 1 --2- 172.21.15.50:0/1366393536 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556637be6880 0x556637bdae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:34.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.629+0000 7fb719c27700 1 -- 172.21.15.50:0/1366393536 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556637be6880 msgr2=0x556637bdae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:34.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.629+0000 7fb719c27700 1 --2- 172.21.15.50:0/1366393536 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556637be6880 0x556637bdae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.629+0000 7fb719c27700 1 -- 172.21.15.50:0/1366393536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556637be07a0 msgr2=0x556637be0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:34.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.629+0000 7fb719c27700 1 --2- 172.21.15.50:0/1366393536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556637be07a0 0x556637be0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.629+0000 7fb719c27700 1 -- 172.21.15.50:0/1366393536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556637bdc9a0 con 0x556637be5f60 2024-06-06T03:27:34.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.629+0000 7fb719c27700 1 --2- 172.21.15.50:0/1366393536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556637be5f60 0x556637be7450 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb704004790 tx=0x7fb70400b520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d082b0782617d10e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:34.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.630+0000 7fb6fffff700 1 -- 172.21.15.50:0/1366393536 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70401f840 con 0x556637be5f60 2024-06-06T03:27:34.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.630+0000 7fb6fffff700 1 -- 172.21.15.50:0/1366393536 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb704023050 con 0x556637be5f60 2024-06-06T03:27:34.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.630+0000 7fb6fffff700 1 -- 172.21.15.50:0/1366393536 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70401e6e0 con 0x556637be5f60 2024-06-06T03:27:34.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.631+0000 7fb726f0fb80 1 -- 172.21.15.50:0/1366393536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556637be5f60 msgr2=0x556637be7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:34.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.631+0000 7fb726f0fb80 1 --2- 172.21.15.50:0/1366393536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556637be5f60 0x556637be7450 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb704004790 tx=0x7fb70400b520 comp rx=0 tx=0).stop 2024-06-06T03:27:34.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.631+0000 7fb726f0fb80 1 -- 172.21.15.50:0/1366393536 shutdown_connections 2024-06-06T03:27:34.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.631+0000 7fb726f0fb80 1 --2- 172.21.15.50:0/1366393536 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556637be6880 0x556637bdae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.631+0000 7fb726f0fb80 1 --2- 172.21.15.50:0/1366393536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556637be07a0 0x556637be0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.631+0000 7fb726f0fb80 1 --2- 172.21.15.50:0/1366393536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556637be5f60 0x556637be7450 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.631+0000 7fb726f0fb80 1 -- 172.21.15.50:0/1366393536 >> 172.21.15.50:0/1366393536 conn(0x556637b0d080 msgr2=0x556637be6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:34.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.631+0000 7fb726f0fb80 1 -- 172.21.15.50:0/1366393536 shutdown_connections 2024-06-06T03:27:34.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.631+0000 7fb726f0fb80 1 -- 172.21.15.50:0/1366393536 wait complete. 2024-06-06T03:27:34.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.631+0000 7fb726f0fb80 1 -- start start 2024-06-06T03:27:34.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.632+0000 7fb726f0fb80 1 Processor -- start 2024-06-06T03:27:34.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.632+0000 7fb726f0fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556637be07a0 0x556637bf24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:34.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.632+0000 7fb726f0fb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556637be5f60 0x556637bf2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:34.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.632+0000 7fb726f0fb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556637be6880 0x556637bef4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:34.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.632+0000 7fb726f0fb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb7141aa320 con 0x556637be5f60 2024-06-06T03:27:34.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.632+0000 7fb726f0fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb7141ab790 con 0x556637be07a0 2024-06-06T03:27:34.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.632+0000 7fb726f0fb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb7141aa9f0 con 0x556637be6880 2024-06-06T03:27:34.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.632+0000 7fb726f0fb80 10 client.0 _ll_register_callbacks cb 0x556637be1130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:34.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.632+0000 7fb719c27700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556637be5f60 0x556637bf2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:34.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.632+0000 7fb719c27700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556637be5f60 0x556637bf2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40798/0 (socket says 172.21.15.50:40798) 2024-06-06T03:27:34.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.632+0000 7fb719c27700 1 -- 172.21.15.50:0/2655286494 learned_addr learned my addr 172.21.15.50:0/2655286494 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:34.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.632+0000 7fb71a428700 1 --2- 172.21.15.50:0/2655286494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556637be07a0 0x556637bf24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:34.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.633+0000 7fb719c27700 1 -- 172.21.15.50:0/2655286494 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556637be6880 msgr2=0x556637bef4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:34.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.633+0000 7fb719c27700 1 --2- 172.21.15.50:0/2655286494 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556637be6880 0x556637bef4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.633+0000 7fb719c27700 1 -- 172.21.15.50:0/2655286494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556637be07a0 msgr2=0x556637bf24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:34.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.633+0000 7fb719c27700 1 --2- 172.21.15.50:0/2655286494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556637be07a0 0x556637bf24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.633+0000 7fb719c27700 1 -- 172.21.15.50:0/2655286494 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556637befa00 con 0x556637be5f60 2024-06-06T03:27:34.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.633+0000 7fb719c27700 1 --2- 172.21.15.50:0/2655286494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556637be5f60 0x556637bf2a30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb70401faa0 tx=0x7fb704010ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653d69aeb0d68808 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:34.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.633+0000 7fb6fdffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:27:34.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.633+0000 7fb6fdffb700 1 -- 172.21.15.50:0/2655286494 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb704045020 con 0x556637be5f60 2024-06-06T03:27:34.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.633+0000 7fb6fdffb700 1 -- 172.21.15.50:0/2655286494 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fb704004bd0 con 0x556637be5f60 2024-06-06T03:27:34.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.633+0000 7fb726f0fb80 1 -- 172.21.15.50:0/2655286494 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb704023050 con 0x556637be5f60 2024-06-06T03:27:34.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.634+0000 7fb6fdffb700 1 -- 172.21.15.50:0/2655286494 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb704050050 con 0x556637be5f60 2024-06-06T03:27:34.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.634+0000 7fb726f0fb80 10 client.15519 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:34.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.634+0000 7fb726f0fb80 1 -- 172.21.15.50:0/2655286494 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556637c6d8e0 con 0x556637be5f60 2024-06-06T03:27:34.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.634+0000 7fb6fdffb700 1 -- 172.21.15.50:0/2655286494 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb704004dd0 con 0x556637be5f60 2024-06-06T03:27:34.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.634+0000 7fb6fdffb700 1 -- 172.21.15.50:0/2655286494 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fb704033070 con 0x556637be5f60 2024-06-06T03:27:34.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.634+0000 7fb726f0fb80 10 client.15519 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:34.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.634+0000 7fb726f0fb80 10 client.15519 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:27:34.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.634+0000 7fb726f0fb80 20 client.15519 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:34.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.634+0000 7fb726f0fb80 1 --2- 172.21.15.50:0/2655286494 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x556637c6df20 0x556637c70340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:34.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.634+0000 7fb726f0fb80 4 client.15519 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-06T03:27:34.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.634+0000 7fb726f0fb80 1 -- 172.21.15.50:0/2655286494 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fb704023050 con 0x556637c6df20 2024-06-06T03:27:34.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.634+0000 7fb71a428700 1 --2- 172.21.15.50:0/2655286494 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x556637c6df20 0x556637c70340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:34.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.635+0000 7fb6fdffb700 10 client.15519 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:34.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.635+0000 7fb71a428700 1 --2- 172.21.15.50:0/2655286494 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x556637c6df20 0x556637c70340 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bbd899a62352a73 server_cookie=12d8dde96c3ef6fb in_seq=0 out_seq=0 2024-06-06T03:27:34.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.636+0000 7fb6fdffb700 1 -- 172.21.15.50:0/2655286494 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7fb704023050 con 0x556637c6df20 2024-06-06T03:27:34.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.636+0000 7fb6fdffb700 10 client.15519 handle_command_reply: tid=0 2024-06-06T03:27:34.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.636+0000 7fb726f0fb80 1 client.15519 shutdown 2024-06-06T03:27:34.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.636+0000 7fb726f0fb80 1 -- 172.21.15.50:0/2655286494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556637be5f60 msgr2=0x556637bf2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:34.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.636+0000 7fb726f0fb80 1 --2- 172.21.15.50:0/2655286494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556637be5f60 0x556637bf2a30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb70401faa0 tx=0x7fb704010ad0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.636+0000 7fb726f0fb80 1 -- 172.21.15.50:0/2655286494 shutdown_connections 2024-06-06T03:27:34.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.636+0000 7fb726f0fb80 1 --2- 172.21.15.50:0/2655286494 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x556637c6df20 0x556637c70340 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.636+0000 7fb6fdffb700 0 client.15519 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:34.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.636+0000 7fb726f0fb80 1 --2- 172.21.15.50:0/2655286494 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556637be6880 0x556637bef4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.636+0000 7fb726f0fb80 1 --2- 172.21.15.50:0/2655286494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556637be07a0 0x556637bf24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.636+0000 7fb726f0fb80 1 --2- 172.21.15.50:0/2655286494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556637be5f60 0x556637bf2a30 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.636+0000 7fb726f0fb80 1 -- 172.21.15.50:0/2655286494 >> 172.21.15.50:0/2655286494 conn(0x556637b0d080 msgr2=0x556637beb0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:34.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.636+0000 7fb726f0fb80 1 -- 172.21.15.50:0/2655286494 shutdown_connections 2024-06-06T03:27:34.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.636+0000 7fb726f0fb80 1 -- 172.21.15.50:0/2655286494 wait complete. 2024-06-06T03:27:34.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.637+0000 7fb726f0fb80 20 client.15519 trim_cache size 0 max 16384 2024-06-06T03:27:34.639 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:27:34.640 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2024-06-06T03:27:34.640 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-06-06T03:27:34.640 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:27:34.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.637+0000 7fb71c68c700 1 -- 172.21.15.50:0/2306594132 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb7000a2d20 msgr2=0x7fb7000a51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:34.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.637+0000 7fb71c68c700 1 --2- 172.21.15.50:0/2306594132 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb7000a2d20 0x7fb7000a51e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb714078770 tx=0x7fb70400b410 comp rx=0 tx=0).stop 2024-06-06T03:27:34.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.637+0000 7fb71c68c700 1 -- 172.21.15.50:0/2306594132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb714101390 msgr2=0x7fb7141997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:34.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.637+0000 7fb71c68c700 1 --2- 172.21.15.50:0/2306594132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb714101390 0x7fb7141997a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb71000bf20 tx=0x7fb71000dc30 comp rx=0 tx=0).stop 2024-06-06T03:27:34.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.637+0000 7fb71c68c700 1 -- 172.21.15.50:0/2306594132 shutdown_connections 2024-06-06T03:27:34.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.637+0000 7fb71c68c700 1 --2- 172.21.15.50:0/2306594132 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb7000a2d20 0x7fb7000a51e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.637+0000 7fb71c68c700 1 --2- 172.21.15.50:0/2306594132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7141073d0 0x7fb7141a4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.637+0000 7fb71c68c700 1 --2- 172.21.15.50:0/2306594132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb714101390 0x7fb7141997a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.637+0000 7fb71c68c700 1 --2- 172.21.15.50:0/2306594132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb714101d30 0x7fb714199ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:34.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.638+0000 7fb71c68c700 1 -- 172.21.15.50:0/2306594132 >> 172.21.15.50:0/2306594132 conn(0x7fb7140782c0 msgr2=0x7fb7140ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:34.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.638+0000 7fb71c68c700 1 -- 172.21.15.50:0/2306594132 shutdown_connections 2024-06-06T03:27:34.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:34.638+0000 7fb71c68c700 1 -- 172.21.15.50:0/2306594132 wait complete. 2024-06-06T03:27:35.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:34 smithi050 ceph-mon[32421]: pgmap v459: 129 pgs: 129 active+clean; 668 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 5 op/s 2024-06-06T03:27:35.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:34 smithi079 ceph-mon[35478]: pgmap v459: 129 pgs: 129 active+clean; 668 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 5 op/s 2024-06-06T03:27:35.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:34 smithi122 ceph-mon[35759]: pgmap v459: 129 pgs: 129 active+clean; 668 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 5 op/s 2024-06-06T03:27:35.561 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-06T03:27:35.561 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T03:27:35.832 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:27:37.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:36 smithi079 ceph-mon[35478]: pgmap v460: 129 pgs: 129 active+clean; 669 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 8 op/s 2024-06-06T03:27:37.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:36 smithi122 ceph-mon[35759]: pgmap v460: 129 pgs: 129 active+clean; 669 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 8 op/s 2024-06-06T03:27:37.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:36 smithi050 ceph-mon[32421]: pgmap v460: 129 pgs: 129 active+clean; 669 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 8 op/s 2024-06-06T03:27:39.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:38 smithi079 ceph-mon[35478]: pgmap v461: 129 pgs: 129 active+clean; 669 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-06T03:27:39.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:38 smithi122 ceph-mon[35759]: pgmap v461: 129 pgs: 129 active+clean; 669 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-06T03:27:39.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:38 smithi050 ceph-mon[32421]: pgmap v461: 129 pgs: 129 active+clean; 669 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-06T03:27:41.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:40 smithi079 ceph-mon[35478]: pgmap v462: 129 pgs: 129 active+clean; 669 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 255 B/s wr, 8 op/s 2024-06-06T03:27:41.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:40 smithi122 ceph-mon[35759]: pgmap v462: 129 pgs: 129 active+clean; 669 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 255 B/s wr, 8 op/s 2024-06-06T03:27:41.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:40 smithi050 ceph-mon[32421]: pgmap v462: 129 pgs: 129 active+clean; 669 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 255 B/s wr, 8 op/s 2024-06-06T03:27:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.979+0000 7f4fdb3a1700 1 -- 172.21.15.50:0/3964485768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fd4108b00 msgr2=0x7f4fd410f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.979+0000 7f4fdb3a1700 1 --2- 172.21.15.50:0/3964485768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fd4108b00 0x7f4fd410f480 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00b0d0 tx=0x7f4fcc00b3e0 comp rx=0 tx=0).stop 2024-06-06T03:27:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.980+0000 7f4fdb3a1700 1 -- 172.21.15.50:0/3964485768 shutdown_connections 2024-06-06T03:27:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.980+0000 7f4fdb3a1700 1 --2- 172.21.15.50:0/3964485768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fd4108b00 0x7f4fd410f480 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.980+0000 7f4fdb3a1700 1 --2- 172.21.15.50:0/3964485768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fd41035e0 0x7f4fd41039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.980+0000 7f4fdb3a1700 1 --2- 172.21.15.50:0/3964485768 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4fd4103f90 0x7f4fd41083d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.980+0000 7f4fdb3a1700 1 -- 172.21.15.50:0/3964485768 >> 172.21.15.50:0/3964485768 conn(0x7f4fd40fcd70 msgr2=0x7f4fd40ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.980+0000 7f4fdb3a1700 1 -- 172.21.15.50:0/3964485768 shutdown_connections 2024-06-06T03:27:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.980+0000 7f4fdb3a1700 1 -- 172.21.15.50:0/3964485768 wait complete. 2024-06-06T03:27:41.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.980+0000 7f4fdb3a1700 1 Processor -- start 2024-06-06T03:27:41.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.980+0000 7f4fdb3a1700 1 -- start start 2024-06-06T03:27:41.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.981+0000 7f4fdb3a1700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4fd41035e0 0x7f4fd419e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:41.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.981+0000 7f4fdb3a1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fd4103f90 0x7f4fd419ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:41.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.981+0000 7f4fdb3a1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fd4108b00 0x7f4fd4198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:41.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.981+0000 7f4fdb3a1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd41126a0 con 0x7f4fd4108b00 2024-06-06T03:27:41.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.981+0000 7f4fdb3a1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd4112520 con 0x7f4fd4103f90 2024-06-06T03:27:41.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.981+0000 7f4fdb3a1700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd4112820 con 0x7f4fd41035e0 2024-06-06T03:27:41.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.981+0000 7f4fd9b9e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fd4103f90 0x7f4fd419ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:41.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.981+0000 7f4fda39f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4fd41035e0 0x7f4fd419e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:41.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.981+0000 7f4fda39f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4fd41035e0 0x7f4fd419e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:33452/0 (socket says 172.21.15.50:33452) 2024-06-06T03:27:41.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.981+0000 7f4fda39f700 1 -- 172.21.15.50:0/1097816254 learned_addr learned my addr 172.21.15.50:0/1097816254 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:41.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.981+0000 7f4fd9b9e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fd4103f90 0x7f4fd419ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:45802/0 (socket says 172.21.15.50:45802) 2024-06-06T03:27:41.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.981+0000 7f4fdaba0700 1 --2- 172.21.15.50:0/1097816254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fd4108b00 0x7f4fd4198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:41.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.982+0000 7f4fdaba0700 1 -- 172.21.15.50:0/1097816254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4fd41035e0 msgr2=0x7f4fd419e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:41.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.982+0000 7f4fdaba0700 1 --2- 172.21.15.50:0/1097816254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4fd41035e0 0x7f4fd419e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:41.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.982+0000 7f4fdaba0700 1 -- 172.21.15.50:0/1097816254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fd4103f90 msgr2=0x7f4fd419ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:41.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.982+0000 7f4fdaba0700 1 --2- 172.21.15.50:0/1097816254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fd4103f90 0x7f4fd419ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:41.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.982+0000 7f4fdaba0700 1 -- 172.21.15.50:0/1097816254 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd41990c0 con 0x7f4fd4108b00 2024-06-06T03:27:41.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.982+0000 7f4fdaba0700 1 --2- 172.21.15.50:0/1097816254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fd4108b00 0x7f4fd4198960 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00b0d0 tx=0x7f4fcc007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:41.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.982+0000 7f4fcb7fe700 1 -- 172.21.15.50:0/1097816254 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc007e60 con 0x7f4fd4108b00 2024-06-06T03:27:41.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.982+0000 7f4fcb7fe700 1 -- 172.21.15.50:0/1097816254 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4fcc003c00 con 0x7f4fd4108b00 2024-06-06T03:27:41.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.982+0000 7f4fcb7fe700 1 -- 172.21.15.50:0/1097816254 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc01de60 con 0x7f4fd4108b00 2024-06-06T03:27:41.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.983+0000 7f4fdb3a1700 1 -- 172.21.15.50:0/1097816254 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fd4199350 con 0x7f4fd4108b00 2024-06-06T03:27:41.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.983+0000 7f4fdb3a1700 1 -- 172.21.15.50:0/1097816254 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fd4101170 con 0x7f4fd4108b00 2024-06-06T03:27:41.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.984+0000 7f4fdb3a1700 1 -- 172.21.15.50:0/1097816254 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fd406a9b0 con 0x7f4fd4108b00 2024-06-06T03:27:41.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.985+0000 7f4fcb7fe700 1 -- 172.21.15.50:0/1097816254 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4fcc01d470 con 0x7f4fd4108b00 2024-06-06T03:27:41.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.986+0000 7f4fcb7fe700 1 --2- 172.21.15.50:0/1097816254 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4fc00a2ca0 0x7f4fc00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:41.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.986+0000 7f4fcb7fe700 1 -- 172.21.15.50:0/1097816254 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f4fcc00f020 con 0x7f4fd4108b00 2024-06-06T03:27:41.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.986+0000 7f4fda39f700 1 --2- 172.21.15.50:0/1097816254 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4fc00a2ca0 0x7f4fc00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:41.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.987+0000 7f4fda39f700 1 --2- 172.21.15.50:0/1097816254 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4fc00a2ca0 0x7f4fc00a5160 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4199aa0 tx=0x7f4fd0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:41.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:41.991+0000 7f4fcb7fe700 1 -- 172.21.15.50:0/1097816254 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4fcc09c9a0 con 0x7f4fd4108b00 2024-06-06T03:27:42.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:42.408+0000 7f4fdb3a1700 1 -- 172.21.15.50:0/1097816254 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4fd4069180 con 0x7f4fd4108b00 2024-06-06T03:27:42.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:42.409+0000 7f4fcb7fe700 1 -- 172.21.15.50:0/1097816254 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11855 (secure 0 0 0) 0x7f4fcc09c2a0 con 0x7f4fd4108b00 2024-06-06T03:27:42.409 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:27:42.409 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1667847852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1667847852},{"type":"v1","addr":"172.21.15.50:6835","nonce":1667847852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/239971838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":239971838},{"type":"v1","addr":"172.21.15.50:6837","nonce":239971838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/2188134216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2188134216},{"type":"v1","addr":"172.21.15.50:6839","nonce":2188134216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/632572420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":632572420},{"type":"v1","addr":"172.21.15.50:6841","nonce":632572420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/864537078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":864537078},{"type":"v1","addr":"172.21.15.79:6833","nonce":864537078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/279268898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":279268898},{"type":"v1","addr":"172.21.15.79:6835","nonce":279268898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T03:22:36.202061+0000","modified":"2024-06-06T03:26:24.959500+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24490,"mds_1":24472,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/57533154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":57533154},{"type":"v1","addr":"172.21.15.122:6833","nonce":57533154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/3286722213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3286722213},{"type":"v1","addr":"172.21.15.79:6837","nonce":3286722213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/768067336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":768067336},{"type":"v1","addr":"172.21.15.79:6839","nonce":768067336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.122:6835/2987597320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2987597320},{"type":"v1","addr":"172.21.15.122:6835","nonce":2987597320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":23,"addr":"172.21.15.122:6837/1604366318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1604366318},{"type":"v1","addr":"172.21.15.122:6837","nonce":1604366318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6839/4129732900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":4129732900},{"type":"v1","addr":"172.21.15.122:6839","nonce":4129732900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24466,24472,24490]},"id":1}]} 2024-06-06T03:27:42.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:42.412+0000 7f4fdb3a1700 1 -- 172.21.15.50:0/1097816254 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4fc00a2ca0 msgr2=0x7f4fc00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:42.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:42.412+0000 7f4fdb3a1700 1 --2- 172.21.15.50:0/1097816254 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4fc00a2ca0 0x7f4fc00a5160 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4199aa0 tx=0x7f4fd0009260 comp rx=0 tx=0).stop 2024-06-06T03:27:42.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:42.412+0000 7f4fdb3a1700 1 -- 172.21.15.50:0/1097816254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fd4108b00 msgr2=0x7f4fd4198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:42.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:42.412+0000 7f4fdb3a1700 1 --2- 172.21.15.50:0/1097816254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fd4108b00 0x7f4fd4198960 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00b0d0 tx=0x7f4fcc007a20 comp rx=0 tx=0).stop 2024-06-06T03:27:42.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:42.412+0000 7f4fdb3a1700 1 -- 172.21.15.50:0/1097816254 shutdown_connections 2024-06-06T03:27:42.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:42.412+0000 7f4fdb3a1700 1 --2- 172.21.15.50:0/1097816254 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4fc00a2ca0 0x7f4fc00a5160 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:42.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:42.412+0000 7f4fdb3a1700 1 --2- 172.21.15.50:0/1097816254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fd4108b00 0x7f4fd4198960 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:42.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:42.412+0000 7f4fdb3a1700 1 --2- 172.21.15.50:0/1097816254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4fd41035e0 0x7f4fd419e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:42.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:42.412+0000 7f4fdb3a1700 1 --2- 172.21.15.50:0/1097816254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fd4103f90 0x7f4fd419ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:42.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:42.412+0000 7f4fdb3a1700 1 -- 172.21.15.50:0/1097816254 >> 172.21.15.50:0/1097816254 conn(0x7f4fd40fcd70 msgr2=0x7f4fd40fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:42.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:42.412+0000 7f4fdb3a1700 1 -- 172.21.15.50:0/1097816254 shutdown_connections 2024-06-06T03:27:42.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:42.412+0000 7f4fdb3a1700 1 -- 172.21.15.50:0/1097816254 wait complete. 2024-06-06T03:27:42.414 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 27 2024-06-06T03:27:43.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:42 smithi050 ceph-mon[32421]: pgmap v463: 129 pgs: 129 active+clean; 669 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-06T03:27:43.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:42 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1097816254' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:27:43.066 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-06-06T03:27:43.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:42 smithi079 ceph-mon[35478]: pgmap v463: 129 pgs: 129 active+clean; 669 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-06T03:27:43.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:42 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/1097816254' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:27:43.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:42 smithi122 ceph-mon[35759]: pgmap v463: 129 pgs: 129 active+clean; 669 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-06T03:27:43.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:42 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/1097816254' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:27:43.230 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.230+0000 7fbe6d9a9640 1 -- 172.21.15.50:0/197807339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe68100900 msgr2=0x7fbe68100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:43.230 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.230+0000 7fbe6d9a9640 1 --2- 172.21.15.50:0/197807339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe68100900 0x7fbe68100d20 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fbe58009900 tx=0x7fbe5802a410 comp rx=0 tx=0).stop 2024-06-06T03:27:43.231 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.230+0000 7fbe6d9a9640 1 -- 172.21.15.50:0/197807339 shutdown_connections 2024-06-06T03:27:43.231 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.230+0000 7fbe6d9a9640 1 --2- 172.21.15.50:0/197807339 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe681024b0 0x7fbe68108d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.231 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.230+0000 7fbe6d9a9640 1 --2- 172.21.15.50:0/197807339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe68101af0 0x7fbe68101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.231 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.230+0000 7fbe6d9a9640 1 --2- 172.21.15.50:0/197807339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe68100900 0x7fbe68100d20 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.231 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.230+0000 7fbe6d9a9640 1 -- 172.21.15.50:0/197807339 >> 172.21.15.50:0/197807339 conn(0x7fbe680fbe70 msgr2=0x7fbe680fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:43.231 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.231+0000 7fbe6d9a9640 1 -- 172.21.15.50:0/197807339 shutdown_connections 2024-06-06T03:27:43.231 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.231+0000 7fbe6d9a9640 1 -- 172.21.15.50:0/197807339 wait complete. 2024-06-06T03:27:43.233 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.231+0000 7fbe6d9a9640 1 Processor -- start 2024-06-06T03:27:43.233 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.231+0000 7fbe6d9a9640 1 -- start start 2024-06-06T03:27:43.233 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.232+0000 7fbe6d9a9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe68100900 0x7fbe681957b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:43.233 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.232+0000 7fbe6d9a9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe68101af0 0x7fbe68195cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:43.233 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.232+0000 7fbe6d9a9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe681024b0 0x7fbe6819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:43.233 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.232+0000 7fbe5ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe68101af0 0x7fbe68195cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:43.233 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.232+0000 7fbe5ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe68101af0 0x7fbe68195cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38942/0 (socket says 172.21.15.50:38942) 2024-06-06T03:27:43.234 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.232+0000 7fbe5ffff640 1 -- 172.21.15.50:0/3449774683 learned_addr learned my addr 172.21.15.50:0/3449774683 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:43.234 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.232+0000 7fbe6d9a9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6810b380 con 0x7fbe68101af0 2024-06-06T03:27:43.234 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.232+0000 7fbe66ffd640 1 --2- 172.21.15.50:0/3449774683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe68100900 0x7fbe681957b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:43.234 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.232+0000 7fbe6d9a9640 1 -- 172.21.15.50:0/3449774683 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6810b200 con 0x7fbe681024b0 2024-06-06T03:27:43.234 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.232+0000 7fbe6d9a9640 1 -- 172.21.15.50:0/3449774683 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6810b500 con 0x7fbe68100900 2024-06-06T03:27:43.234 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.232+0000 7fbe677fe640 1 --2- 172.21.15.50:0/3449774683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe681024b0 0x7fbe6819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:43.234 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.233+0000 7fbe5ffff640 1 -- 172.21.15.50:0/3449774683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe68100900 msgr2=0x7fbe681957b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:43.234 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.233+0000 7fbe5ffff640 1 --2- 172.21.15.50:0/3449774683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe68100900 0x7fbe681957b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.234 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.233+0000 7fbe5ffff640 1 -- 172.21.15.50:0/3449774683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe681024b0 msgr2=0x7fbe6819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:43.234 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.233+0000 7fbe5ffff640 1 --2- 172.21.15.50:0/3449774683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe681024b0 0x7fbe6819cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.234 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.233+0000 7fbe5ffff640 1 -- 172.21.15.50:0/3449774683 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe6819d3d0 con 0x7fbe68101af0 2024-06-06T03:27:43.234 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.233+0000 7fbe66ffd640 1 --2- 172.21.15.50:0/3449774683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe68100900 0x7fbe681957b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:27:43.234 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.233+0000 7fbe5ffff640 1 --2- 172.21.15.50:0/3449774683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe68101af0 0x7fbe68195cf0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fbe50010ad0 tx=0x7fbe50010f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:43.235 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.233+0000 7fbe6c9a7640 1 -- 172.21.15.50:0/3449774683 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5000eb70 con 0x7fbe68101af0 2024-06-06T03:27:43.235 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.233+0000 7fbe6c9a7640 1 -- 172.21.15.50:0/3449774683 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbe5001a070 con 0x7fbe68101af0 2024-06-06T03:27:43.235 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.234+0000 7fbe6c9a7640 1 -- 172.21.15.50:0/3449774683 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe500095f0 con 0x7fbe68101af0 2024-06-06T03:27:43.235 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.234+0000 7fbe6d9a9640 1 -- 172.21.15.50:0/3449774683 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe6819d6c0 con 0x7fbe68101af0 2024-06-06T03:27:43.237 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.237+0000 7fbe6c9a7640 1 -- 172.21.15.50:0/3449774683 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbe50015410 con 0x7fbe68101af0 2024-06-06T03:27:43.237 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.237+0000 7fbe6d9a9640 1 -- 172.21.15.50:0/3449774683 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe6819dc60 con 0x7fbe68101af0 2024-06-06T03:27:43.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.239+0000 7fbe6c9a7640 1 --2- 172.21.15.50:0/3449774683 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbe540a2cb0 0x7fbe540a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:43.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.240+0000 7fbe66ffd640 1 --2- 172.21.15.50:0/3449774683 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbe540a2cb0 0x7fbe540a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:43.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.240+0000 7fbe6c9a7640 1 -- 172.21.15.50:0/3449774683 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fbe500d2170 con 0x7fbe68101af0 2024-06-06T03:27:43.240 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.240+0000 7fbe66ffd640 1 --2- 172.21.15.50:0/3449774683 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbe540a2cb0 0x7fbe540a5170 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbe5802a930 tx=0x7fbe58000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:43.242 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.241+0000 7fbe7079a740 1 Processor -- start 2024-06-06T03:27:43.242 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.241+0000 7fbe7079a740 1 -- start start 2024-06-06T03:27:43.242 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.241+0000 7fbe7079a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566c9d63010 0x5566c9d63430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:43.242 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.241+0000 7fbe7079a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5566c9d63a00 0x5566c9d68500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:43.242 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.241+0000 7fbe7079a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5566c9d68b70 0x5566c9d6b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:43.242 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.241+0000 7fbe7079a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5566c9cc64f0 con 0x5566c9d63a00 2024-06-06T03:27:43.242 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.241+0000 7fbe7079a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5566c9c64870 con 0x5566c9d68b70 2024-06-06T03:27:43.242 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.241+0000 7fbe7079a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5566c9cc24b0 con 0x5566c9d63010 2024-06-06T03:27:43.242 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.242+0000 7fbe5ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5566c9d63a00 0x5566c9d68500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:43.242 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.242+0000 7fbe66ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566c9d63010 0x5566c9d63430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:43.242 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.242+0000 7fbe66ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566c9d63010 0x5566c9d63430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:33472/0 (socket says 172.21.15.50:33472) 2024-06-06T03:27:43.242 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.242+0000 7fbe66ffd640 1 -- 172.21.15.50:0/1975153425 learned_addr learned my addr 172.21.15.50:0/1975153425 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:43.243 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.242+0000 7fbe677fe640 1 --2- 172.21.15.50:0/1975153425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5566c9d68b70 0x5566c9d6b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:43.243 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.242+0000 7fbe66ffd640 1 -- 172.21.15.50:0/1975153425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5566c9d68b70 msgr2=0x5566c9d6b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:43.243 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.242+0000 7fbe66ffd640 1 --2- 172.21.15.50:0/1975153425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5566c9d68b70 0x5566c9d6b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.243 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.242+0000 7fbe66ffd640 1 -- 172.21.15.50:0/1975153425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5566c9d63a00 msgr2=0x5566c9d68500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:43.243 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.242+0000 7fbe66ffd640 1 --2- 172.21.15.50:0/1975153425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5566c9d63a00 0x5566c9d68500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.243 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.242+0000 7fbe66ffd640 1 -- 172.21.15.50:0/1975153425 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566c9c809b0 con 0x5566c9d63010 2024-06-06T03:27:43.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.242+0000 7fbe66ffd640 1 --2- 172.21.15.50:0/1975153425 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566c9d63010 0x5566c9d63430 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbe58004650 tx=0x7fbe5803d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=951a16acf327797e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:43.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.243+0000 7fbe5dffb640 1 -- 172.21.15.50:0/1975153425 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5804d070 con 0x5566c9d63010 2024-06-06T03:27:43.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.243+0000 7fbe5dffb640 1 -- 172.21.15.50:0/1975153425 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbe580035f0 con 0x5566c9d63010 2024-06-06T03:27:43.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.243+0000 7fbe5dffb640 1 -- 172.21.15.50:0/1975153425 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe58035040 con 0x5566c9d63010 2024-06-06T03:27:43.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.244+0000 7fbe7079a740 1 -- 172.21.15.50:0/1975153425 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566c9d63010 msgr2=0x5566c9d63430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:43.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.244+0000 7fbe7079a740 1 --2- 172.21.15.50:0/1975153425 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566c9d63010 0x5566c9d63430 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbe58004650 tx=0x7fbe5803d000 comp rx=0 tx=0).stop 2024-06-06T03:27:43.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.244+0000 7fbe7079a740 1 -- 172.21.15.50:0/1975153425 shutdown_connections 2024-06-06T03:27:43.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.244+0000 7fbe7079a740 1 --2- 172.21.15.50:0/1975153425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5566c9d63a00 0x5566c9d68500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.244+0000 7fbe7079a740 1 --2- 172.21.15.50:0/1975153425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5566c9d68b70 0x5566c9d6b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.244+0000 7fbe7079a740 1 --2- 172.21.15.50:0/1975153425 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566c9d63010 0x5566c9d63430 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.244+0000 7fbe7079a740 1 -- 172.21.15.50:0/1975153425 >> 172.21.15.50:0/1975153425 conn(0x5566c9d5e680 msgr2=0x5566c9d5ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:43.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.244+0000 7fbe7079a740 1 -- 172.21.15.50:0/1975153425 shutdown_connections 2024-06-06T03:27:43.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.244+0000 7fbe7079a740 1 -- 172.21.15.50:0/1975153425 wait complete. 2024-06-06T03:27:43.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.244+0000 7fbe7079a740 1 -- start start 2024-06-06T03:27:43.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.245+0000 7fbe7079a740 1 Processor -- start 2024-06-06T03:27:43.249 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.245+0000 7fbe7079a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566c9d63010 0x5566c9d6d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.245+0000 7fbe7079a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5566c9d63a00 0x5566c9d6d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.245+0000 7fbe7079a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5566c9d68b70 0x5566c9d74760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.245+0000 7fbe66ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566c9d63010 0x5566c9d6d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.245+0000 7fbe66ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566c9d63010 0x5566c9d6d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:33480/0 (socket says 172.21.15.50:33480) 2024-06-06T03:27:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.245+0000 7fbe66ffd640 1 -- 172.21.15.50:0/3897537725 learned_addr learned my addr 172.21.15.50:0/3897537725 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.245+0000 7fbe7079a740 1 -- 172.21.15.50:0/3897537725 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5566c9d6bac0 con 0x5566c9d68b70 2024-06-06T03:27:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.245+0000 7fbe677fe640 1 --2- 172.21.15.50:0/3897537725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5566c9d68b70 0x5566c9d74760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.245+0000 7fbe7079a740 1 -- 172.21.15.50:0/3897537725 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5566c9c4fae0 con 0x5566c9d63a00 2024-06-06T03:27:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.245+0000 7fbe7079a740 1 -- 172.21.15.50:0/3897537725 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5566c9d6bc40 con 0x5566c9d63010 2024-06-06T03:27:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.245+0000 7fbe5ffff640 1 --2- 172.21.15.50:0/3897537725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5566c9d63a00 0x5566c9d6d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.245+0000 7fbe7079a740 10 client.0 _ll_register_callbacks cb 0x5566c9c889b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.246+0000 7fbe66ffd640 1 -- 172.21.15.50:0/3897537725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5566c9d63a00 msgr2=0x5566c9d6d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.246+0000 7fbe66ffd640 1 --2- 172.21.15.50:0/3897537725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5566c9d63a00 0x5566c9d6d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.246+0000 7fbe66ffd640 1 -- 172.21.15.50:0/3897537725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5566c9d68b70 msgr2=0x5566c9d74760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.246+0000 7fbe66ffd640 1 --2- 172.21.15.50:0/3897537725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5566c9d68b70 0x5566c9d74760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.246+0000 7fbe66ffd640 1 -- 172.21.15.50:0/3897537725 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566c99da210 con 0x5566c9d63010 2024-06-06T03:27:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.246+0000 7fbe5ffff640 1 --2- 172.21.15.50:0/3897537725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5566c9d63a00 0x5566c9d6d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:27:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.246+0000 7fbe677fe640 1 --2- 172.21.15.50:0/3897537725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5566c9d68b70 0x5566c9d74760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:27:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.246+0000 7fbe66ffd640 1 --2- 172.21.15.50:0/3897537725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566c9d63010 0x5566c9d6d250 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbe58009230 tx=0x7fbe58003840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea7cb7e61a2b9d25 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.246+0000 7fbe46ffd640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:27:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.246+0000 7fbe46ffd640 1 -- 172.21.15.50:0/3897537725 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5805a020 con 0x5566c9d63010 2024-06-06T03:27:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.246+0000 7fbe7079a740 1 -- 172.21.15.50:0/3897537725 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe580035f0 con 0x5566c9d63010 2024-06-06T03:27:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.246+0000 7fbe46ffd640 1 -- 172.21.15.50:0/3897537725 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fbe58004b70 con 0x5566c9d63010 2024-06-06T03:27:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.247+0000 7fbe46ffd640 1 -- 172.21.15.50:0/3897537725 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbe58065050 con 0x5566c9d63010 2024-06-06T03:27:43.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.247+0000 7fbe7079a740 10 client.25165 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:43.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.247+0000 7fbe7079a740 1 -- 172.21.15.50:0/3897537725 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5566c9aa6620 con 0x5566c9d63010 2024-06-06T03:27:43.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.247+0000 7fbe46ffd640 1 -- 172.21.15.50:0/3897537725 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbe580035f0 con 0x5566c9d63010 2024-06-06T03:27:43.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.247+0000 7fbe46ffd640 1 -- 172.21.15.50:0/3897537725 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fbe580524e0 con 0x5566c9d63010 2024-06-06T03:27:43.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.247+0000 7fbe7079a740 10 client.25165 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:43.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.247+0000 7fbe7079a740 10 client.25165 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:27:43.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.247+0000 7fbe7079a740 20 client.25165 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:43.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.247+0000 7fbe7079a740 1 --2- 172.21.15.50:0/3897537725 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5566c9d79110 0x5566c9d7b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:43.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.247+0000 7fbe7079a740 4 client.25165 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:27:43.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.247+0000 7fbe7079a740 1 -- 172.21.15.50:0/3897537725 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5566c9cd9f10 con 0x5566c9d79110 2024-06-06T03:27:43.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.247+0000 7fbe5ffff640 1 --2- 172.21.15.50:0/3897537725 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5566c9d79110 0x5566c9d7b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:43.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.248+0000 7fbe5ffff640 1 --2- 172.21.15.50:0/3897537725 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5566c9d79110 0x5566c9d7b5b0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9608c0a5d949577 server_cookie=1f7105496c6085a6 in_seq=0 out_seq=0 2024-06-06T03:27:43.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.248+0000 7fbe46ffd640 10 client.25165 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:43.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.249+0000 7fbe46ffd640 1 -- 172.21.15.50:0/3897537725 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5566c9cd9f10 con 0x5566c9d79110 2024-06-06T03:27:43.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.249+0000 7fbe46ffd640 10 client.25165 handle_command_reply: tid=0 2024-06-06T03:27:43.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.249+0000 7fbe7079a740 1 client.25165 shutdown 2024-06-06T03:27:43.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.249+0000 7fbe7079a740 1 -- 172.21.15.50:0/3897537725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566c9d63010 msgr2=0x5566c9d6d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:43.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.249+0000 7fbe7079a740 1 --2- 172.21.15.50:0/3897537725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566c9d63010 0x5566c9d6d250 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbe58009230 tx=0x7fbe58003840 comp rx=0 tx=0).stop 2024-06-06T03:27:43.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.249+0000 7fbe7079a740 1 -- 172.21.15.50:0/3897537725 shutdown_connections 2024-06-06T03:27:43.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.249+0000 7fbe7079a740 1 --2- 172.21.15.50:0/3897537725 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5566c9d79110 0x5566c9d7b5b0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.249+0000 7fbe7079a740 1 --2- 172.21.15.50:0/3897537725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5566c9d68b70 0x5566c9d74760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.249+0000 7fbe46ffd640 0 client.25165 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:43.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.249+0000 7fbe7079a740 1 --2- 172.21.15.50:0/3897537725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5566c9d63a00 0x5566c9d6d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.249+0000 7fbe7079a740 1 --2- 172.21.15.50:0/3897537725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566c9d63010 0x5566c9d6d250 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.249+0000 7fbe7079a740 1 -- 172.21.15.50:0/3897537725 >> 172.21.15.50:0/3897537725 conn(0x5566c9d5e680 msgr2=0x5566c9d5d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:43.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.249+0000 7fbe7079a740 1 -- 172.21.15.50:0/3897537725 shutdown_connections 2024-06-06T03:27:43.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.249+0000 7fbe7079a740 1 -- 172.21.15.50:0/3897537725 wait complete. 2024-06-06T03:27:43.254 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.249+0000 7fbe7079a740 20 client.25165 trim_cache size 0 max 16384 2024-06-06T03:27:43.280 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.281+0000 7fbe7079a740 1 Processor -- start 2024-06-06T03:27:43.280 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.281+0000 7fbe7079a740 1 -- start start 2024-06-06T03:27:43.281 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.281+0000 7fbe7079a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5566c9d5e680 0x5566c9d61590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.281+0000 7fbe7079a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5566c9d63010 0x5566c9d74720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.281+0000 7fbe7079a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566c9d63a00 0x5566c9d61ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.281+0000 7fbe66ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5566c9d5e680 0x5566c9d61590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.281+0000 7fbe7079a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbe681aaa10 con 0x5566c9d5e680 2024-06-06T03:27:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.281+0000 7fbe7079a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbe681a82e0 con 0x5566c9d63010 2024-06-06T03:27:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.281+0000 7fbe7079a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbe681a6130 con 0x5566c9d63a00 2024-06-06T03:27:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.281+0000 7fbe66ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5566c9d5e680 0x5566c9d61590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38970/0 (socket says 172.21.15.50:38970) 2024-06-06T03:27:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.281+0000 7fbe66ffd640 1 -- 172.21.15.50:0/2478761501 learned_addr learned my addr 172.21.15.50:0/2478761501 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.282+0000 7fbe677fe640 1 --2- 172.21.15.50:0/2478761501 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566c9d63a00 0x5566c9d61ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.282+0000 7fbe66ffd640 1 -- 172.21.15.50:0/2478761501 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566c9d63a00 msgr2=0x5566c9d61ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.282+0000 7fbe66ffd640 1 --2- 172.21.15.50:0/2478761501 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566c9d63a00 0x5566c9d61ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.282+0000 7fbe66ffd640 1 -- 172.21.15.50:0/2478761501 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5566c9d63010 msgr2=0x5566c9d74720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.282+0000 7fbe66ffd640 1 --2- 172.21.15.50:0/2478761501 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5566c9d63010 0x5566c9d74720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.282+0000 7fbe66ffd640 1 -- 172.21.15.50:0/2478761501 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566c9d67f50 con 0x5566c9d5e680 2024-06-06T03:27:43.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.282+0000 7fbe66ffd640 1 --2- 172.21.15.50:0/2478761501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5566c9d5e680 0x5566c9d61590 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fbe58005380 tx=0x7fbe58009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc0ea424fa3dc37f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:43.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.282+0000 7fbe5d7fa640 1 -- 172.21.15.50:0/2478761501 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe58040070 con 0x5566c9d5e680 2024-06-06T03:27:43.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.282+0000 7fbe5d7fa640 1 -- 172.21.15.50:0/2478761501 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbe58004e20 con 0x5566c9d5e680 2024-06-06T03:27:43.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.282+0000 7fbe5d7fa640 1 -- 172.21.15.50:0/2478761501 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5805a070 con 0x5566c9d5e680 2024-06-06T03:27:43.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.283+0000 7fbe7079a740 1 -- 172.21.15.50:0/2478761501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5566c9d5e680 msgr2=0x5566c9d61590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:43.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.283+0000 7fbe7079a740 1 --2- 172.21.15.50:0/2478761501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5566c9d5e680 0x5566c9d61590 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fbe58005380 tx=0x7fbe58009680 comp rx=0 tx=0).stop 2024-06-06T03:27:43.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.283+0000 7fbe7079a740 1 -- 172.21.15.50:0/2478761501 shutdown_connections 2024-06-06T03:27:43.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.283+0000 7fbe7079a740 1 --2- 172.21.15.50:0/2478761501 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566c9d63a00 0x5566c9d61ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.283+0000 7fbe7079a740 1 --2- 172.21.15.50:0/2478761501 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5566c9d63010 0x5566c9d74720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.283+0000 7fbe7079a740 1 --2- 172.21.15.50:0/2478761501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5566c9d5e680 0x5566c9d61590 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.283+0000 7fbe7079a740 1 -- 172.21.15.50:0/2478761501 >> 172.21.15.50:0/2478761501 conn(0x5566c9d68640 msgr2=0x5566c9d6ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:43.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.283+0000 7fbe7079a740 1 -- 172.21.15.50:0/2478761501 shutdown_connections 2024-06-06T03:27:43.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.283+0000 7fbe7079a740 1 -- 172.21.15.50:0/2478761501 wait complete. 2024-06-06T03:27:43.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.284+0000 7fbe7079a740 1 -- start start 2024-06-06T03:27:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.284+0000 7fbe7079a740 1 Processor -- start 2024-06-06T03:27:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.284+0000 7fbe7079a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566c9d63010 0x5566c9d71a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.284+0000 7fbe7079a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5566c9d63a00 0x5566c9d71fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.284+0000 7fbe7079a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5566c9d68b70 0x5566c9d72ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.284+0000 7fbe7079a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbe681a67a0 con 0x5566c9d63a00 2024-06-06T03:27:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.284+0000 7fbe7079a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbe681a7c10 con 0x5566c9d68b70 2024-06-06T03:27:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.284+0000 7fbe7079a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbe681a6e70 con 0x5566c9d63010 2024-06-06T03:27:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.284+0000 7fbe7079a740 10 client.0 _ll_register_callbacks cb 0x7fbe500d1070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.285+0000 7fbe66ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566c9d63010 0x5566c9d71a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.285+0000 7fbe5ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5566c9d63a00 0x5566c9d71fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.285+0000 7fbe66ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566c9d63010 0x5566c9d71a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:33500/0 (socket says 172.21.15.50:33500) 2024-06-06T03:27:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.285+0000 7fbe66ffd640 1 -- 172.21.15.50:0/1499384006 learned_addr learned my addr 172.21.15.50:0/1499384006 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.285+0000 7fbe677fe640 1 --2- 172.21.15.50:0/1499384006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5566c9d68b70 0x5566c9d72ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.285+0000 7fbe677fe640 1 -- 172.21.15.50:0/1499384006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566c9d63010 msgr2=0x5566c9d71a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:43.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.285+0000 7fbe677fe640 1 --2- 172.21.15.50:0/1499384006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566c9d63010 0x5566c9d71a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.285+0000 7fbe677fe640 1 -- 172.21.15.50:0/1499384006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5566c9d63a00 msgr2=0x5566c9d71fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:43.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.285+0000 7fbe677fe640 1 --2- 172.21.15.50:0/1499384006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5566c9d63a00 0x5566c9d71fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.285+0000 7fbe677fe640 1 -- 172.21.15.50:0/1499384006 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566c9d734d0 con 0x5566c9d68b70 2024-06-06T03:27:43.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.285+0000 7fbe5ffff640 1 --2- 172.21.15.50:0/1499384006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5566c9d63a00 0x5566c9d71fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:27:43.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.285+0000 7fbe677fe640 1 --2- 172.21.15.50:0/1499384006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5566c9d68b70 0x5566c9d72ee0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x5566c9d5a050 tx=0x7fbe6001ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21a2a569f3a972cb server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:43.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.285+0000 7fbe46ffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:27:43.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.285+0000 7fbe46ffd640 1 -- 172.21.15.50:0/1499384006 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe60022070 con 0x5566c9d68b70 2024-06-06T03:27:43.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.285+0000 7fbe7079a740 1 -- 172.21.15.50:0/1499384006 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe58004e20 con 0x5566c9d68b70 2024-06-06T03:27:43.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.285+0000 7fbe46ffd640 1 -- 172.21.15.50:0/1499384006 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fbe60003970 con 0x5566c9d68b70 2024-06-06T03:27:43.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.286+0000 7fbe46ffd640 1 -- 172.21.15.50:0/1499384006 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbe60003bb0 con 0x5566c9d68b70 2024-06-06T03:27:43.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.286+0000 7fbe7079a740 10 client.25151 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:43.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.286+0000 7fbe7079a740 1 -- 172.21.15.50:0/1499384006 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5566c9d748a0 con 0x5566c9d68b70 2024-06-06T03:27:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.286+0000 7fbe46ffd640 1 -- 172.21.15.50:0/1499384006 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbe58004e20 con 0x5566c9d68b70 2024-06-06T03:27:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.287+0000 7fbe46ffd640 1 -- 172.21.15.50:0/1499384006 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fbe60005020 con 0x5566c9d68b70 2024-06-06T03:27:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.287+0000 7fbe7079a740 10 client.25151 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:43.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.287+0000 7fbe7079a740 10 client.25151 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:27:43.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.287+0000 7fbe7079a740 20 client.25151 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:43.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.287+0000 7fbe7079a740 1 --2- 172.21.15.50:0/1499384006 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5566c9d79110 0x5566c9de64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:43.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.287+0000 7fbe7079a740 4 client.25151 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:27:43.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.287+0000 7fbe7079a740 1 -- 172.21.15.50:0/1499384006 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5566c9cd3c20 con 0x5566c9d79110 2024-06-06T03:27:43.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.287+0000 7fbe66ffd640 1 --2- 172.21.15.50:0/1499384006 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5566c9d79110 0x5566c9de64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:43.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.288+0000 7fbe66ffd640 1 --2- 172.21.15.50:0/1499384006 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5566c9d79110 0x5566c9de64f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82eb2b32af17a5ee server_cookie=360315bab103b3c2 in_seq=0 out_seq=0 2024-06-06T03:27:43.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.288+0000 7fbe46ffd640 10 client.25151 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:43.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.292+0000 7fbe46ffd640 1 -- 172.21.15.50:0/1499384006 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5566c9cd3c20 con 0x5566c9d79110 2024-06-06T03:27:43.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.292+0000 7fbe46ffd640 10 client.25151 handle_command_reply: tid=0 2024-06-06T03:27:43.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.292+0000 7fbe7079a740 1 client.25151 shutdown 2024-06-06T03:27:43.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.292+0000 7fbe7079a740 1 -- 172.21.15.50:0/1499384006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5566c9d68b70 msgr2=0x5566c9d72ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:43.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.292+0000 7fbe7079a740 1 --2- 172.21.15.50:0/1499384006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5566c9d68b70 0x5566c9d72ee0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x5566c9d5a050 tx=0x7fbe6001ca40 comp rx=0 tx=0).stop 2024-06-06T03:27:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.292+0000 7fbe7079a740 1 -- 172.21.15.50:0/1499384006 shutdown_connections 2024-06-06T03:27:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.292+0000 7fbe7079a740 1 --2- 172.21.15.50:0/1499384006 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5566c9d79110 0x5566c9de64f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.292+0000 7fbe7079a740 1 --2- 172.21.15.50:0/1499384006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5566c9d63a00 0x5566c9d71fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.292+0000 7fbe7079a740 1 --2- 172.21.15.50:0/1499384006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5566c9d68b70 0x5566c9d72ee0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.292+0000 7fbe7079a740 1 --2- 172.21.15.50:0/1499384006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5566c9d63010 0x5566c9d71a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.292+0000 7fbe7079a740 1 -- 172.21.15.50:0/1499384006 >> 172.21.15.50:0/1499384006 conn(0x5566c9d68640 msgr2=0x5566c9d61590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.292+0000 7fbe46ffd640 0 client.25151 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.292+0000 7fbe7079a740 1 -- 172.21.15.50:0/1499384006 shutdown_connections 2024-06-06T03:27:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.292+0000 7fbe7079a740 1 -- 172.21.15.50:0/1499384006 wait complete. 2024-06-06T03:27:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.293+0000 7fbe7079a740 20 client.25151 trim_cache size 0 max 16384 2024-06-06T03:27:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:27:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:27:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:27:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.293+0000 7fbe6d9a9640 1 -- 172.21.15.50:0/3449774683 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbe540a2cb0 msgr2=0x7fbe540a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.293+0000 7fbe6d9a9640 1 --2- 172.21.15.50:0/3449774683 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbe540a2cb0 0x7fbe540a5170 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbe5802a930 tx=0x7fbe58000bc0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.293+0000 7fbe6d9a9640 1 -- 172.21.15.50:0/3449774683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe68101af0 msgr2=0x7fbe68195cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.293+0000 7fbe6d9a9640 1 --2- 172.21.15.50:0/3449774683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe68101af0 0x7fbe68195cf0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fbe50010ad0 tx=0x7fbe50010f90 comp rx=0 tx=0).stop 2024-06-06T03:27:43.295 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.293+0000 7fbe6d9a9640 1 -- 172.21.15.50:0/3449774683 shutdown_connections 2024-06-06T03:27:43.295 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.293+0000 7fbe6d9a9640 1 --2- 172.21.15.50:0/3449774683 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbe540a2cb0 0x7fbe540a5170 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.295 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.293+0000 7fbe6d9a9640 1 --2- 172.21.15.50:0/3449774683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe68101af0 0x7fbe68195cf0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.295 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.293+0000 7fbe6d9a9640 1 --2- 172.21.15.50:0/3449774683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe681024b0 0x7fbe6819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.295 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.293+0000 7fbe6d9a9640 1 --2- 172.21.15.50:0/3449774683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe68100900 0x7fbe681957b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:43.295 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.293+0000 7fbe6d9a9640 1 -- 172.21.15.50:0/3449774683 >> 172.21.15.50:0/3449774683 conn(0x7fbe680fbe70 msgr2=0x7fbe68104d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:43.295 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.293+0000 7fbe6d9a9640 1 -- 172.21.15.50:0/3449774683 shutdown_connections 2024-06-06T03:27:43.297 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:43.293+0000 7fbe6d9a9640 1 -- 172.21.15.50:0/3449774683 wait complete. 2024-06-06T03:27:43.367 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:27:44.923 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:44 smithi050 ceph-mon[32421]: pgmap v464: 129 pgs: 129 active+clean; 669 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-06T03:27:45.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:44 smithi079 ceph-mon[35478]: pgmap v464: 129 pgs: 129 active+clean; 669 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-06T03:27:45.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:44 smithi122 ceph-mon[35759]: pgmap v464: 129 pgs: 129 active+clean; 669 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-06T03:27:45.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.288+0000 7f04a12f4700 1 -- 172.21.15.50:0/350687265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f049c101d50 msgr2=0x7f049c10e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:45.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.288+0000 7f04a12f4700 1 --2- 172.21.15.50:0/350687265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f049c101d50 0x7f049c10e240 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f049400b0a0 tx=0x7f049400b3b0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.288+0000 7f04a12f4700 1 -- 172.21.15.50:0/350687265 shutdown_connections 2024-06-06T03:27:45.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.288+0000 7f04a12f4700 1 --2- 172.21.15.50:0/350687265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f049c101d50 0x7f049c10e240 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.288+0000 7f04a12f4700 1 --2- 172.21.15.50:0/350687265 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f049c107400 0x7f049c1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.288+0000 7f04a12f4700 1 --2- 172.21.15.50:0/350687265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f049c101390 0x7f049c101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.288+0000 7f04a12f4700 1 -- 172.21.15.50:0/350687265 >> 172.21.15.50:0/350687265 conn(0x7f049c078340 msgr2=0x7f049c078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:45.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.288+0000 7f04a12f4700 1 -- 172.21.15.50:0/350687265 shutdown_connections 2024-06-06T03:27:45.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.288+0000 7f04a12f4700 1 -- 172.21.15.50:0/350687265 wait complete. 2024-06-06T03:27:45.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.289+0000 7f04a12f4700 1 Processor -- start 2024-06-06T03:27:45.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.290+0000 7f04a12f4700 1 -- start start 2024-06-06T03:27:45.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.290+0000 7f04a12f4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f049c101390 0x7f049c1a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:45.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.290+0000 7f04a12f4700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f049c101d50 0x7f049c1a0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:45.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.290+0000 7f04a12f4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f049c107400 0x7f049c19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:45.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.290+0000 7f04a12f4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f049c110450 con 0x7f049c101390 2024-06-06T03:27:45.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.290+0000 7f04a12f4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f049c1102d0 con 0x7f049c107400 2024-06-06T03:27:45.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.290+0000 7f04a12f4700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f049c1105d0 con 0x7f049c101d50 2024-06-06T03:27:45.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.290+0000 7f049affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f049c101390 0x7f049c1a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:45.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.290+0000 7f049affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f049c101390 0x7f049c1a0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38998/0 (socket says 172.21.15.50:38998) 2024-06-06T03:27:45.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.290+0000 7f049affd700 1 -- 172.21.15.50:0/79780771 learned_addr learned my addr 172.21.15.50:0/79780771 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:45.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.290+0000 7f049b7fe700 1 --2- 172.21.15.50:0/79780771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f049c107400 0x7f049c19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:45.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.290+0000 7f049a7fc700 1 --2- 172.21.15.50:0/79780771 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f049c101d50 0x7f049c1a0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:45.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.290+0000 7f049affd700 1 -- 172.21.15.50:0/79780771 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f049c101d50 msgr2=0x7f049c1a0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:45.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.290+0000 7f049affd700 1 --2- 172.21.15.50:0/79780771 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f049c101d50 0x7f049c1a0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.290+0000 7f049affd700 1 -- 172.21.15.50:0/79780771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f049c107400 msgr2=0x7f049c19ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:45.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.290+0000 7f049affd700 1 --2- 172.21.15.50:0/79780771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f049c107400 0x7f049c19ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.291+0000 7f049affd700 1 -- 172.21.15.50:0/79780771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f049c19b260 con 0x7f049c101390 2024-06-06T03:27:45.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.291+0000 7f049affd700 1 --2- 172.21.15.50:0/79780771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f049c101390 0x7f049c1a0940 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f048c00d980 tx=0x7f048c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:45.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.291+0000 7f0483fff700 1 -- 172.21.15.50:0/79780771 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c017070 con 0x7f049c101390 2024-06-06T03:27:45.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.291+0000 7f04a12f4700 1 -- 172.21.15.50:0/79780771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f049c19b550 con 0x7f049c101390 2024-06-06T03:27:45.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.291+0000 7f0483fff700 1 -- 172.21.15.50:0/79780771 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f048c004830 con 0x7f049c101390 2024-06-06T03:27:45.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.291+0000 7f0483fff700 1 -- 172.21.15.50:0/79780771 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c005440 con 0x7f049c101390 2024-06-06T03:27:45.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.291+0000 7f04a12f4700 1 -- 172.21.15.50:0/79780771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f049c1a7810 con 0x7f049c101390 2024-06-06T03:27:45.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.295+0000 7f0483fff700 1 -- 172.21.15.50:0/79780771 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f048c0055e0 con 0x7f049c101390 2024-06-06T03:27:45.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.295+0000 7f04abb77b80 1 Processor -- start 2024-06-06T03:27:45.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.295+0000 7f04abb77b80 1 -- start start 2024-06-06T03:27:45.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.295+0000 7f04abb77b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd7cd54f60 0x55fd7cd55340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:45.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.296+0000 7f04abb77b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd7cd55880 0x55fd7cd4f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:45.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.296+0000 7f04abb77b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd7cd4f7a0 0x55fd7cd4fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:45.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.296+0000 7f04abb77b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fd7cc41f60 con 0x55fd7cd54f60 2024-06-06T03:27:45.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.296+0000 7f04abb77b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fd7cca0850 con 0x55fd7cd4f7a0 2024-06-06T03:27:45.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.296+0000 7f04abb77b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fd7cc08460 con 0x55fd7cd55880 2024-06-06T03:27:45.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.296+0000 7f049b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd7cd54f60 0x55fd7cd55340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:45.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.296+0000 7f049b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd7cd54f60 0x55fd7cd55340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39004/0 (socket says 172.21.15.50:39004) 2024-06-06T03:27:45.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.296+0000 7f049b7fe700 1 -- 172.21.15.50:0/2417356213 learned_addr learned my addr 172.21.15.50:0/2417356213 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:45.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.296+0000 7f049a7fc700 1 --2- 172.21.15.50:0/2417356213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd7cd4f7a0 0x55fd7cd4fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:45.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.296+0000 7f049affd700 1 --2- 172.21.15.50:0/2417356213 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd7cd55880 0x55fd7cd4f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:45.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.296+0000 7f049b7fe700 1 -- 172.21.15.50:0/2417356213 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd7cd55880 msgr2=0x55fd7cd4f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:45.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.296+0000 7f049b7fe700 1 --2- 172.21.15.50:0/2417356213 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd7cd55880 0x55fd7cd4f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.296+0000 7f049b7fe700 1 -- 172.21.15.50:0/2417356213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd7cd4f7a0 msgr2=0x55fd7cd4fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:45.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.296+0000 7f049b7fe700 1 --2- 172.21.15.50:0/2417356213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd7cd4f7a0 0x55fd7cd4fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.296+0000 7f049b7fe700 1 -- 172.21.15.50:0/2417356213 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd7cbef8d0 con 0x55fd7cd54f60 2024-06-06T03:27:45.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.296+0000 7f049a7fc700 1 --2- 172.21.15.50:0/2417356213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd7cd4f7a0 0x55fd7cd4fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:27:45.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.296+0000 7f049b7fe700 1 --2- 172.21.15.50:0/2417356213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd7cd54f60 0x55fd7cd55340 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0494009dc0 tx=0x7f0494009df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c285893a0fd5b0c9 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:45.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.297+0000 7f04817fa700 1 -- 172.21.15.50:0/2417356213 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0494028070 con 0x55fd7cd54f60 2024-06-06T03:27:45.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.297+0000 7f04817fa700 1 -- 172.21.15.50:0/2417356213 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0494022da0 con 0x55fd7cd54f60 2024-06-06T03:27:45.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.297+0000 7f04817fa700 1 -- 172.21.15.50:0/2417356213 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0494007860 con 0x55fd7cd54f60 2024-06-06T03:27:45.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.297+0000 7f0483fff700 1 --2- 172.21.15.50:0/79780771 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f04840a2dd0 0x7f04840a5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:45.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.298+0000 7f04abb77b80 1 -- 172.21.15.50:0/2417356213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd7cd54f60 msgr2=0x55fd7cd55340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:45.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.298+0000 7f04abb77b80 1 --2- 172.21.15.50:0/2417356213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd7cd54f60 0x55fd7cd55340 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0494009dc0 tx=0x7f0494009df0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.298+0000 7f04abb77b80 1 -- 172.21.15.50:0/2417356213 shutdown_connections 2024-06-06T03:27:45.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.298+0000 7f04abb77b80 1 --2- 172.21.15.50:0/2417356213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd7cd4f7a0 0x55fd7cd4fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.298+0000 7f04abb77b80 1 --2- 172.21.15.50:0/2417356213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd7cd54f60 0x55fd7cd55340 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.298+0000 7f049affd700 1 --2- 172.21.15.50:0/79780771 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f04840a2dd0 0x7f04840a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:45.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.298+0000 7f04abb77b80 1 --2- 172.21.15.50:0/2417356213 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd7cd55880 0x55fd7cd4f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.298+0000 7f04abb77b80 1 -- 172.21.15.50:0/2417356213 >> 172.21.15.50:0/2417356213 conn(0x55fd7cc7c080 msgr2=0x55fd7cd4a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:45.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.298+0000 7f0483fff700 1 -- 172.21.15.50:0/79780771 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f048c0cf220 con 0x7f049c101390 2024-06-06T03:27:45.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.298+0000 7f04abb77b80 1 -- 172.21.15.50:0/2417356213 shutdown_connections 2024-06-06T03:27:45.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.298+0000 7f04abb77b80 1 -- 172.21.15.50:0/2417356213 wait complete. 2024-06-06T03:27:45.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.298+0000 7f04abb77b80 1 -- start start 2024-06-06T03:27:45.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.299+0000 7f049affd700 1 --2- 172.21.15.50:0/79780771 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f04840a2dd0 0x7f04840a5290 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f048c097b00 tx=0x7f048c004f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:45.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.299+0000 7f04abb77b80 1 Processor -- start 2024-06-06T03:27:45.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.299+0000 7f04abb77b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd7cd4f7a0 0x55fd7cd5b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:45.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.299+0000 7f04abb77b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd7cd54f60 0x55fd7cd58910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:45.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.299+0000 7f04abb77b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd7cd55880 0x55fd7cd58e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:45.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.299+0000 7f049b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd7cd4f7a0 0x55fd7cd5b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:45.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.299+0000 7f049b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd7cd4f7a0 0x55fd7cd5b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39014/0 (socket says 172.21.15.50:39014) 2024-06-06T03:27:45.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.299+0000 7f049b7fe700 1 -- 172.21.15.50:0/3394556819 learned_addr learned my addr 172.21.15.50:0/3394556819 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:45.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.299+0000 7f04abb77b80 1 -- 172.21.15.50:0/3394556819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fd7cc40fc0 con 0x55fd7cd4f7a0 2024-06-06T03:27:45.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.299+0000 7f04abb77b80 1 -- 172.21.15.50:0/3394556819 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fd7cc9c810 con 0x55fd7cd54f60 2024-06-06T03:27:45.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.299+0000 7f04abb77b80 1 -- 172.21.15.50:0/3394556819 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fd7cd5c200 con 0x55fd7cd55880 2024-06-06T03:27:45.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.299+0000 7f04abb77b80 10 client.0 _ll_register_callbacks cb 0x55fd7cc365b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:45.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.299+0000 7f049a7fc700 1 --2- 172.21.15.50:0/3394556819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd7cd54f60 0x55fd7cd58910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:45.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.299+0000 7f049b7fe700 1 -- 172.21.15.50:0/3394556819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd7cd55880 msgr2=0x55fd7cd58e50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:27:45.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.299+0000 7f049b7fe700 1 --2- 172.21.15.50:0/3394556819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd7cd55880 0x55fd7cd58e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.299+0000 7f049b7fe700 1 -- 172.21.15.50:0/3394556819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd7cd54f60 msgr2=0x55fd7cd58910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:45.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.299+0000 7f049b7fe700 1 --2- 172.21.15.50:0/3394556819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd7cd54f60 0x55fd7cd58910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.300+0000 7f049b7fe700 1 -- 172.21.15.50:0/3394556819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd7cc66750 con 0x55fd7cd4f7a0 2024-06-06T03:27:45.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.300+0000 7f049b7fe700 1 --2- 172.21.15.50:0/3394556819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd7cd4f7a0 0x55fd7cd5b610 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f04940060c0 tx=0x7f0494004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5447ff6734ae7e1 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:45.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.300+0000 7f047eff5700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:27:45.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.300+0000 7f047eff5700 1 -- 172.21.15.50:0/3394556819 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0494032070 con 0x55fd7cd4f7a0 2024-06-06T03:27:45.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.300+0000 7f04abb77b80 1 -- 172.21.15.50:0/3394556819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0494022da0 con 0x55fd7cd4f7a0 2024-06-06T03:27:45.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.300+0000 7f047eff5700 1 -- 172.21.15.50:0/3394556819 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f04940078b0 con 0x55fd7cd4f7a0 2024-06-06T03:27:45.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.301+0000 7f047eff5700 1 -- 172.21.15.50:0/3394556819 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0494028040 con 0x55fd7cd4f7a0 2024-06-06T03:27:45.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.301+0000 7f04abb77b80 10 client.15555 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:45.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.301+0000 7f04abb77b80 1 -- 172.21.15.50:0/3394556819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fd7cd5d6b0 con 0x55fd7cd4f7a0 2024-06-06T03:27:45.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.301+0000 7f047eff5700 1 -- 172.21.15.50:0/3394556819 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0494022da0 con 0x55fd7cd4f7a0 2024-06-06T03:27:45.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.301+0000 7f047eff5700 1 -- 172.21.15.50:0/3394556819 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f0494011070 con 0x55fd7cd4f7a0 2024-06-06T03:27:45.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.302+0000 7f04abb77b80 10 client.15555 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:45.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.302+0000 7f04abb77b80 10 client.15555 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-06-06T03:27:45.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.302+0000 7f04abb77b80 20 client.15555 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:45.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.302+0000 7f04abb77b80 1 --2- 172.21.15.50:0/3394556819 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55fd7cd5fc40 0x55fd7cd62030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:45.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.302+0000 7f04abb77b80 4 client.15555 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:27:45.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.302+0000 7f04abb77b80 1 -- 172.21.15.50:0/3394556819 --> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd7ccadd50 con 0x55fd7cd5fc40 2024-06-06T03:27:45.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.302+0000 7f049a7fc700 1 --2- 172.21.15.50:0/3394556819 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55fd7cd5fc40 0x55fd7cd62030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:45.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.303+0000 7f047eff5700 10 client.15555 ms_handle_connect on v2:172.21.15.122:6834/2987597320 2024-06-06T03:27:45.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.303+0000 7f049a7fc700 1 --2- 172.21.15.50:0/3394556819 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55fd7cd5fc40 0x55fd7cd62030 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ea1d12030ca28025 server_cookie=24158959f3836a54 in_seq=0 out_seq=0 2024-06-06T03:27:45.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.303+0000 7f047eff5700 1 -- 172.21.15.50:0/3394556819 <== mds.2 v2:172.21.15.122:6834/2987597320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55fd7ccadd50 con 0x55fd7cd5fc40 2024-06-06T03:27:45.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.303+0000 7f047eff5700 10 client.15555 handle_command_reply: tid=0 2024-06-06T03:27:45.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.303+0000 7f04abb77b80 1 client.15555 shutdown 2024-06-06T03:27:45.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.304+0000 7f04abb77b80 1 -- 172.21.15.50:0/3394556819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd7cd4f7a0 msgr2=0x55fd7cd5b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:45.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.304+0000 7f04abb77b80 1 --2- 172.21.15.50:0/3394556819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd7cd4f7a0 0x55fd7cd5b610 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f04940060c0 tx=0x7f0494004c80 comp rx=0 tx=0).stop 2024-06-06T03:27:45.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.304+0000 7f04abb77b80 1 -- 172.21.15.50:0/3394556819 shutdown_connections 2024-06-06T03:27:45.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.304+0000 7f04abb77b80 1 --2- 172.21.15.50:0/3394556819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd7cd55880 0x55fd7cd58e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.304+0000 7f04abb77b80 1 --2- 172.21.15.50:0/3394556819 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55fd7cd5fc40 0x55fd7cd62030 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.304+0000 7f04abb77b80 1 --2- 172.21.15.50:0/3394556819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd7cd4f7a0 0x55fd7cd5b610 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.304+0000 7f04abb77b80 1 --2- 172.21.15.50:0/3394556819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd7cd54f60 0x55fd7cd58910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.304+0000 7f047eff5700 0 client.15555 ms_handle_reset on v2:172.21.15.122:6834/2987597320 2024-06-06T03:27:45.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.304+0000 7f04abb77b80 1 -- 172.21.15.50:0/3394556819 >> 172.21.15.50:0/3394556819 conn(0x55fd7cc7c080 msgr2=0x55fd7cd49700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:45.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.304+0000 7f04abb77b80 1 -- 172.21.15.50:0/3394556819 shutdown_connections 2024-06-06T03:27:45.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.304+0000 7f04abb77b80 1 -- 172.21.15.50:0/3394556819 wait complete. 2024-06-06T03:27:45.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.304+0000 7f04abb77b80 20 client.15555 trim_cache size 0 max 16384 2024-06-06T03:27:45.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.319+0000 7f04abb77b80 1 Processor -- start 2024-06-06T03:27:45.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.320+0000 7f04abb77b80 1 -- start start 2024-06-06T03:27:45.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.320+0000 7f04abb77b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd7cd4f7a0 0x55fd7cd564f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:45.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.320+0000 7f04abb77b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd7cd54f60 0x55fd7cd577e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:45.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.320+0000 7f04abb77b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd7cd55880 0x55fd7cd49e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:45.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.320+0000 7f04abb77b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f049c072c60 con 0x55fd7cd55880 2024-06-06T03:27:45.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.320+0000 7f04abb77b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f049c0704f0 con 0x55fd7cd54f60 2024-06-06T03:27:45.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.320+0000 7f04abb77b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f049c06e360 con 0x55fd7cd4f7a0 2024-06-06T03:27:45.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.320+0000 7f049b7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd7cd4f7a0 0x55fd7cd564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:45.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.320+0000 7f049b7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd7cd4f7a0 0x55fd7cd564f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:33538/0 (socket says 172.21.15.50:33538) 2024-06-06T03:27:45.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.320+0000 7f049b7fe700 1 -- 172.21.15.50:0/3523172056 learned_addr learned my addr 172.21.15.50:0/3523172056 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:45.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.320+0000 7f049b7fe700 1 --2- 172.21.15.50:0/3523172056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd7cd55880 0x55fd7cd49e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:45.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.320+0000 7f049a7fc700 1 --2- 172.21.15.50:0/3523172056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd7cd54f60 0x55fd7cd577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:45.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.321+0000 7f049b7fe700 1 -- 172.21.15.50:0/3523172056 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd7cd4f7a0 msgr2=0x55fd7cd564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:45.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.321+0000 7f049b7fe700 1 --2- 172.21.15.50:0/3523172056 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd7cd4f7a0 0x55fd7cd564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.321+0000 7f049b7fe700 1 -- 172.21.15.50:0/3523172056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd7cd54f60 msgr2=0x55fd7cd577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:45.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.321+0000 7f049b7fe700 1 --2- 172.21.15.50:0/3523172056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd7cd54f60 0x55fd7cd577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.321+0000 7f049b7fe700 1 -- 172.21.15.50:0/3523172056 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd7cd56e80 con 0x55fd7cd55880 2024-06-06T03:27:45.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.321+0000 7f049b7fe700 1 --2- 172.21.15.50:0/3523172056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd7cd55880 0x55fd7cd49e80 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f049402cc90 tx=0x7f049400b740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1566500d8ab2653 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:45.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.321+0000 7f0480ff9700 1 -- 172.21.15.50:0/3523172056 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04940093b0 con 0x55fd7cd55880 2024-06-06T03:27:45.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.322+0000 7f0480ff9700 1 -- 172.21.15.50:0/3523172056 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0494036400 con 0x55fd7cd55880 2024-06-06T03:27:45.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.322+0000 7f0480ff9700 1 -- 172.21.15.50:0/3523172056 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04940369e0 con 0x55fd7cd55880 2024-06-06T03:27:45.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.322+0000 7f04abb77b80 1 -- 172.21.15.50:0/3523172056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd7cd55880 msgr2=0x55fd7cd49e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:45.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.322+0000 7f04abb77b80 1 --2- 172.21.15.50:0/3523172056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd7cd55880 0x55fd7cd49e80 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f049402cc90 tx=0x7f049400b740 comp rx=0 tx=0).stop 2024-06-06T03:27:45.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.322+0000 7f04abb77b80 1 -- 172.21.15.50:0/3523172056 shutdown_connections 2024-06-06T03:27:45.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.322+0000 7f04abb77b80 1 --2- 172.21.15.50:0/3523172056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd7cd55880 0x55fd7cd49e80 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.322+0000 7f04abb77b80 1 --2- 172.21.15.50:0/3523172056 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd7cd4f7a0 0x55fd7cd564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.322+0000 7f04abb77b80 1 --2- 172.21.15.50:0/3523172056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd7cd54f60 0x55fd7cd577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.323+0000 7f04abb77b80 1 -- 172.21.15.50:0/3523172056 >> 172.21.15.50:0/3523172056 conn(0x55fd7cc7c080 msgr2=0x55fd7cd570d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:45.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.323+0000 7f04abb77b80 1 -- 172.21.15.50:0/3523172056 shutdown_connections 2024-06-06T03:27:45.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.323+0000 7f04abb77b80 1 -- 172.21.15.50:0/3523172056 wait complete. 2024-06-06T03:27:45.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.323+0000 7f04abb77b80 1 -- start start 2024-06-06T03:27:45.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.323+0000 7f04abb77b80 1 Processor -- start 2024-06-06T03:27:45.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.324+0000 7f04abb77b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd7cd4f7a0 0x55fd7cd63330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:45.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.324+0000 7f04abb77b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd7cd54f60 0x55fd7cd63870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:45.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.324+0000 7f04abb77b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd7cd55880 0x55fd7cded6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:45.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.324+0000 7f049a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd7cd54f60 0x55fd7cd63870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:45.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.324+0000 7f04abb77b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f049c06e9b0 con 0x55fd7cd54f60 2024-06-06T03:27:45.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.324+0000 7f04abb77b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f049c06fe20 con 0x55fd7cd4f7a0 2024-06-06T03:27:45.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.324+0000 7f04abb77b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f049c06f080 con 0x55fd7cd55880 2024-06-06T03:27:45.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.324+0000 7f049a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd7cd54f60 0x55fd7cd63870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39030/0 (socket says 172.21.15.50:39030) 2024-06-06T03:27:45.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.324+0000 7f049a7fc700 1 -- 172.21.15.50:0/1073734006 learned_addr learned my addr 172.21.15.50:0/1073734006 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:45.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.324+0000 7f049b7fe700 1 --2- 172.21.15.50:0/1073734006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd7cd4f7a0 0x55fd7cd63330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:45.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.324+0000 7f04abb77b80 10 client.0 _ll_register_callbacks cb 0x55fd7cc365b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:45.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.324+0000 7f049a7fc700 1 -- 172.21.15.50:0/1073734006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd7cd55880 msgr2=0x55fd7cded6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:45.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.324+0000 7f049a7fc700 1 --2- 172.21.15.50:0/1073734006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd7cd55880 0x55fd7cded6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.324+0000 7f049a7fc700 1 -- 172.21.15.50:0/1073734006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd7cd4f7a0 msgr2=0x55fd7cd63330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:45.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.324+0000 7f049a7fc700 1 --2- 172.21.15.50:0/1073734006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd7cd4f7a0 0x55fd7cd63330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.324+0000 7f049a7fc700 1 -- 172.21.15.50:0/1073734006 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd7cdedcf0 con 0x55fd7cd54f60 2024-06-06T03:27:45.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.325+0000 7f049a7fc700 1 --2- 172.21.15.50:0/1073734006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd7cd54f60 0x55fd7cd63870 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x55fd7cd59ee0 tx=0x7f0490011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7cb439a845d5a0f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:45.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.325+0000 7f047eff5700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:27:45.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.325+0000 7f047eff5700 1 -- 172.21.15.50:0/1073734006 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049002a060 con 0x55fd7cd54f60 2024-06-06T03:27:45.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.325+0000 7f047eff5700 1 -- 172.21.15.50:0/1073734006 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f0490011d90 con 0x55fd7cd54f60 2024-06-06T03:27:45.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.325+0000 7f04abb77b80 1 -- 172.21.15.50:0/1073734006 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0494036400 con 0x55fd7cd54f60 2024-06-06T03:27:45.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.325+0000 7f047eff5700 1 -- 172.21.15.50:0/1073734006 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f049001d3f0 con 0x55fd7cd54f60 2024-06-06T03:27:45.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.325+0000 7f04abb77b80 10 client.15561 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:45.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.325+0000 7f04abb77b80 1 -- 172.21.15.50:0/1073734006 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fd7cdf5020 con 0x55fd7cd54f60 2024-06-06T03:27:45.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.326+0000 7f047eff5700 1 -- 172.21.15.50:0/1073734006 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0494036400 con 0x55fd7cd54f60 2024-06-06T03:27:45.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.326+0000 7f047eff5700 1 -- 172.21.15.50:0/1073734006 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f0490010840 con 0x55fd7cd54f60 2024-06-06T03:27:45.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.326+0000 7f04abb77b80 10 client.15561 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:45.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.326+0000 7f04abb77b80 10 client.15561 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-06-06T03:27:45.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.326+0000 7f04abb77b80 20 client.15561 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:45.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.326+0000 7f04abb77b80 1 --2- 172.21.15.50:0/1073734006 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55fd7cdf5710 0x55fd7cdf7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:45.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.326+0000 7f04abb77b80 4 client.15561 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:27:45.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.326+0000 7f04abb77b80 1 -- 172.21.15.50:0/1073734006 --> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fd7cca82d0 con 0x55fd7cdf5710 2024-06-06T03:27:45.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.326+0000 7f049b7fe700 1 --2- 172.21.15.50:0/1073734006 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55fd7cdf5710 0x55fd7cdf7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:45.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.326+0000 7f049b7fe700 1 --2- 172.21.15.50:0/1073734006 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55fd7cdf5710 0x55fd7cdf7b30 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5cf34a6a5d69683a server_cookie=b9db80a68c4b2f76 in_seq=0 out_seq=0 2024-06-06T03:27:45.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.326+0000 7f047eff5700 10 client.15561 ms_handle_connect on v2:172.21.15.122:6834/2987597320 2024-06-06T03:27:45.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.327+0000 7f047eff5700 1 -- 172.21.15.50:0/1073734006 <== mds.2 v2:172.21.15.122:6834/2987597320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fd7cca82d0 con 0x55fd7cdf5710 2024-06-06T03:27:45.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.327+0000 7f047eff5700 10 client.15561 handle_command_reply: tid=0 2024-06-06T03:27:45.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.327+0000 7f04abb77b80 1 client.15561 shutdown 2024-06-06T03:27:45.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.327+0000 7f04abb77b80 1 -- 172.21.15.50:0/1073734006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd7cd54f60 msgr2=0x55fd7cd63870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:45.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.327+0000 7f04abb77b80 1 --2- 172.21.15.50:0/1073734006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd7cd54f60 0x55fd7cd63870 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x55fd7cd59ee0 tx=0x7f0490011440 comp rx=0 tx=0).stop 2024-06-06T03:27:45.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.327+0000 7f04abb77b80 1 -- 172.21.15.50:0/1073734006 shutdown_connections 2024-06-06T03:27:45.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.327+0000 7f04abb77b80 1 --2- 172.21.15.50:0/1073734006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd7cd55880 0x55fd7cded6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.327+0000 7f04abb77b80 1 --2- 172.21.15.50:0/1073734006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd7cd4f7a0 0x55fd7cd63330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.327+0000 7f04abb77b80 1 --2- 172.21.15.50:0/1073734006 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55fd7cdf5710 0x55fd7cdf7b30 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.327+0000 7f047eff5700 0 client.15561 ms_handle_reset on v2:172.21.15.122:6834/2987597320 2024-06-06T03:27:45.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.328+0000 7f04abb77b80 1 --2- 172.21.15.50:0/1073734006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd7cd54f60 0x55fd7cd63870 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.328+0000 7f04abb77b80 1 -- 172.21.15.50:0/1073734006 >> 172.21.15.50:0/1073734006 conn(0x55fd7cc7c080 msgr2=0x55fd7cd57960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:45.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.328+0000 7f04abb77b80 1 -- 172.21.15.50:0/1073734006 shutdown_connections 2024-06-06T03:27:45.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.328+0000 7f04abb77b80 1 -- 172.21.15.50:0/1073734006 wait complete. 2024-06-06T03:27:45.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.328+0000 7f04abb77b80 20 client.15561 trim_cache size 0 max 16384 2024-06-06T03:27:45.330 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:27:45.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.329+0000 7f04a12f4700 1 -- 172.21.15.50:0/79780771 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f04840a2dd0 msgr2=0x7f04840a5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:45.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.329+0000 7f04a12f4700 1 --2- 172.21.15.50:0/79780771 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f04840a2dd0 0x7f04840a5290 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f048c097b00 tx=0x7f048c004f60 comp rx=0 tx=0).stop 2024-06-06T03:27:45.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.329+0000 7f04a12f4700 1 -- 172.21.15.50:0/79780771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f049c101390 msgr2=0x7f049c1a0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:45.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.329+0000 7f04a12f4700 1 --2- 172.21.15.50:0/79780771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f049c101390 0x7f049c1a0940 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f048c00d980 tx=0x7f048c00dd40 comp rx=0 tx=0).stop 2024-06-06T03:27:45.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.329+0000 7f04a12f4700 1 -- 172.21.15.50:0/79780771 shutdown_connections 2024-06-06T03:27:45.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.329+0000 7f04a12f4700 1 --2- 172.21.15.50:0/79780771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f049c107400 0x7f049c19ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.329+0000 7f04a12f4700 1 --2- 172.21.15.50:0/79780771 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f04840a2dd0 0x7f04840a5290 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.329+0000 7f04a12f4700 1 --2- 172.21.15.50:0/79780771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f049c101390 0x7f049c1a0940 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.329+0000 7f04a12f4700 1 --2- 172.21.15.50:0/79780771 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f049c101d50 0x7f049c1a0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:45.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.329+0000 7f04a12f4700 1 -- 172.21.15.50:0/79780771 >> 172.21.15.50:0/79780771 conn(0x7f049c078340 msgr2=0x7f049c0ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:45.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.330+0000 7f04a12f4700 1 -- 172.21.15.50:0/79780771 shutdown_connections 2024-06-06T03:27:45.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:45.330+0000 7f04a12f4700 1 -- 172.21.15.50:0/79780771 wait complete. 2024-06-06T03:27:46.183 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-06-06T03:27:46.496 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:27:46.885 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:46 smithi050 ceph-mon[32421]: pgmap v465: 129 pgs: 129 active+clean; 670 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 8 op/s 2024-06-06T03:27:47.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:46 smithi079 ceph-mon[35478]: pgmap v465: 129 pgs: 129 active+clean; 670 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 8 op/s 2024-06-06T03:27:47.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:46 smithi122 ceph-mon[35759]: pgmap v465: 129 pgs: 129 active+clean; 670 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 8 op/s 2024-06-06T03:27:48.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.462+0000 7f97971e8700 1 -- 172.21.15.50:0/455829563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9790101df0 msgr2=0x7f97901021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:48.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.462+0000 7f97971e8700 1 --2- 172.21.15.50:0/455829563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9790101df0 0x7f97901021d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f97840099c0 tx=0x7f9784009cd0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.462+0000 7f97971e8700 1 -- 172.21.15.50:0/455829563 shutdown_connections 2024-06-06T03:27:48.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.462+0000 7f97971e8700 1 --2- 172.21.15.50:0/455829563 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9790106750 0x7f979010e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.462+0000 7f97971e8700 1 --2- 172.21.15.50:0/455829563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9790101df0 0x7f97901021d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.462+0000 7f97971e8700 1 --2- 172.21.15.50:0/455829563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97901027a0 0x7f9790106020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.462+0000 7f97971e8700 1 -- 172.21.15.50:0/455829563 >> 172.21.15.50:0/455829563 conn(0x7f9790077a00 msgr2=0x7f97900fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:48.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.462+0000 7f97971e8700 1 -- 172.21.15.50:0/455829563 shutdown_connections 2024-06-06T03:27:48.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.462+0000 7f97971e8700 1 -- 172.21.15.50:0/455829563 wait complete. 2024-06-06T03:27:48.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.463+0000 7f97971e8700 1 Processor -- start 2024-06-06T03:27:48.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.463+0000 7f97971e8700 1 -- start start 2024-06-06T03:27:48.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.463+0000 7f97971e8700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97901027a0 0x7f979019c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:48.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.463+0000 7f97971e8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9790106750 0x7f979019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:48.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.463+0000 7f97971e8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9790196970 0x7f9790196df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:48.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.463+0000 7f97971e8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9790110440 con 0x7f9790196970 2024-06-06T03:27:48.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.463+0000 7f97971e8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f97901102c0 con 0x7f9790106750 2024-06-06T03:27:48.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.464+0000 7f97971e8700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f97901105c0 con 0x7f97901027a0 2024-06-06T03:27:48.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.464+0000 7f9795785700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9790196970 0x7f9790196df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:48.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.464+0000 7f9795785700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9790196970 0x7f9790196df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52066/0 (socket says 172.21.15.50:52066) 2024-06-06T03:27:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.464+0000 7f9795785700 1 -- 172.21.15.50:0/2182247760 learned_addr learned my addr 172.21.15.50:0/2182247760 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.464+0000 7f978ffff700 1 --2- 172.21.15.50:0/2182247760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9790106750 0x7f979019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.464+0000 7f9795785700 1 -- 172.21.15.50:0/2182247760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97901027a0 msgr2=0x7f979019c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.464+0000 7f9794f84700 1 --2- 172.21.15.50:0/2182247760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97901027a0 0x7f979019c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.464+0000 7f9795785700 1 --2- 172.21.15.50:0/2182247760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97901027a0 0x7f979019c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.464+0000 7f9795785700 1 -- 172.21.15.50:0/2182247760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9790106750 msgr2=0x7f979019cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.464+0000 7f9795785700 1 --2- 172.21.15.50:0/2182247760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9790106750 0x7f979019cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.464+0000 7f9795785700 1 -- 172.21.15.50:0/2182247760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97901974f0 con 0x7f9790196970 2024-06-06T03:27:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.464+0000 7f9794f84700 1 --2- 172.21.15.50:0/2182247760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97901027a0 0x7f979019c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:27:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.465+0000 7f9795785700 1 --2- 172.21.15.50:0/2182247760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9790196970 0x7f9790196df0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9788007ee0 tx=0x7f978800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.465+0000 7f978dffb700 1 -- 172.21.15.50:0/2182247760 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978800dbd0 con 0x7f9790196970 2024-06-06T03:27:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.465+0000 7f978dffb700 1 -- 172.21.15.50:0/2182247760 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f978800dd70 con 0x7f9790196970 2024-06-06T03:27:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.465+0000 7f97971e8700 1 -- 172.21.15.50:0/2182247760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97901a7a40 con 0x7f9790196970 2024-06-06T03:27:48.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.465+0000 7f978dffb700 1 -- 172.21.15.50:0/2182247760 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9788005a20 con 0x7f9790196970 2024-06-06T03:27:48.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.465+0000 7f97971e8700 1 -- 172.21.15.50:0/2182247760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97901a7e30 con 0x7f9790196970 2024-06-06T03:27:48.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.469+0000 7f978dffb700 1 -- 172.21.15.50:0/2182247760 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f978801a020 con 0x7f9790196970 2024-06-06T03:27:48.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.470+0000 7f978dffb700 1 --2- 172.21.15.50:0/2182247760 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f97800a2d00 0x7f97800a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:48.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.470+0000 7f9794f84700 1 --2- 172.21.15.50:0/2182247760 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f97800a2d00 0x7f97800a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:48.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.470+0000 7f97a1a6bb80 1 Processor -- start 2024-06-06T03:27:48.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.470+0000 7f97a1a6bb80 1 -- start start 2024-06-06T03:27:48.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.471+0000 7f97a1a6bb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab59859770 0x55ab59859b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:48.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.471+0000 7f97a1a6bb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab5985a090 0x55ab59853a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:48.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.471+0000 7f97a1a6bb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab59853fb0 0x55ab598543d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:48.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.471+0000 7f97a1a6bb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ab5973df60 con 0x55ab5985a090 2024-06-06T03:27:48.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.471+0000 7f97a1a6bb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ab5979c850 con 0x55ab59859770 2024-06-06T03:27:48.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.471+0000 7f97a1a6bb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ab59704460 con 0x55ab59853fb0 2024-06-06T03:27:48.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.471+0000 7f9794f84700 1 --2- 172.21.15.50:0/2182247760 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f97800a2d00 0x7f97800a51c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9784009990 tx=0x7f9784005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:48.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.471+0000 7f978dffb700 1 -- 172.21.15.50:0/2182247760 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f97880ceb30 con 0x7f9790196970 2024-06-06T03:27:48.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.471+0000 7f978ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab5985a090 0x55ab59853a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:48.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.471+0000 7f978ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab5985a090 0x55ab59853a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52068/0 (socket says 172.21.15.50:52068) 2024-06-06T03:27:48.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.471+0000 7f978ffff700 1 -- 172.21.15.50:0/1209750093 learned_addr learned my addr 172.21.15.50:0/1209750093 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:48.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.471+0000 7f9794f84700 1 --2- 172.21.15.50:0/1209750093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab59859770 0x55ab59859b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:48.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.471+0000 7f9795785700 1 --2- 172.21.15.50:0/1209750093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab59853fb0 0x55ab598543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:48.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.471+0000 7f978ffff700 1 -- 172.21.15.50:0/1209750093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab59853fb0 msgr2=0x55ab598543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:48.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.471+0000 7f978ffff700 1 --2- 172.21.15.50:0/1209750093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab59853fb0 0x55ab598543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.471+0000 7f978ffff700 1 -- 172.21.15.50:0/1209750093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab59859770 msgr2=0x55ab59859b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:48.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.471+0000 7f978ffff700 1 --2- 172.21.15.50:0/1209750093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab59859770 0x55ab59859b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.471+0000 7f978ffff700 1 -- 172.21.15.50:0/1209750093 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab596eb8d0 con 0x55ab5985a090 2024-06-06T03:27:48.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.471+0000 7f9794f84700 1 --2- 172.21.15.50:0/1209750093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab59859770 0x55ab59859b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:27:48.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.472+0000 7f978ffff700 1 --2- 172.21.15.50:0/1209750093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab5985a090 0x55ab59853a70 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f977c00dca0 tx=0x7f977c00f360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb42ee714160831e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:48.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.472+0000 7f977affd700 1 -- 172.21.15.50:0/1209750093 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977c00fb20 con 0x55ab5985a090 2024-06-06T03:27:48.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.472+0000 7f977affd700 1 -- 172.21.15.50:0/1209750093 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f977c004ce0 con 0x55ab5985a090 2024-06-06T03:27:48.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.472+0000 7f977affd700 1 -- 172.21.15.50:0/1209750093 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977c0055f0 con 0x55ab5985a090 2024-06-06T03:27:48.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.473+0000 7f97a1a6bb80 1 -- 172.21.15.50:0/1209750093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab5985a090 msgr2=0x55ab59853a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:48.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.473+0000 7f97a1a6bb80 1 --2- 172.21.15.50:0/1209750093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab5985a090 0x55ab59853a70 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f977c00dca0 tx=0x7f977c00f360 comp rx=0 tx=0).stop 2024-06-06T03:27:48.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.473+0000 7f97a1a6bb80 1 -- 172.21.15.50:0/1209750093 shutdown_connections 2024-06-06T03:27:48.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.473+0000 7f97a1a6bb80 1 --2- 172.21.15.50:0/1209750093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab59853fb0 0x55ab598543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.473+0000 7f97a1a6bb80 1 --2- 172.21.15.50:0/1209750093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab59859770 0x55ab59859b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.473+0000 7f97a1a6bb80 1 --2- 172.21.15.50:0/1209750093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab5985a090 0x55ab59853a70 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.473+0000 7f97a1a6bb80 1 -- 172.21.15.50:0/1209750093 >> 172.21.15.50:0/1209750093 conn(0x55ab59778080 msgr2=0x55ab59846220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:48.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.473+0000 7f97a1a6bb80 1 -- 172.21.15.50:0/1209750093 shutdown_connections 2024-06-06T03:27:48.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.474+0000 7f97a1a6bb80 1 -- 172.21.15.50:0/1209750093 wait complete. 2024-06-06T03:27:48.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.474+0000 7f97a1a6bb80 1 -- start start 2024-06-06T03:27:48.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.474+0000 7f97a1a6bb80 1 Processor -- start 2024-06-06T03:27:48.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.475+0000 7f97a1a6bb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab59853fb0 0x55ab5984d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:48.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.475+0000 7f97a1a6bb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab59859770 0x55ab5984db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:48.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.475+0000 7f9794f84700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab59853fb0 0x55ab5984d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:48.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.475+0000 7f97a1a6bb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab598533b0 0x55ab59853830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:48.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.475+0000 7f97a1a6bb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ab5973cfc0 con 0x55ab59853fb0 2024-06-06T03:27:48.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.475+0000 7f9794f84700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab59853fb0 0x55ab5984d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52080/0 (socket says 172.21.15.50:52080) 2024-06-06T03:27:48.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.475+0000 7f9794f84700 1 -- 172.21.15.50:0/565012573 learned_addr learned my addr 172.21.15.50:0/565012573 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:48.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.475+0000 7f978ffff700 1 --2- 172.21.15.50:0/565012573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab59859770 0x55ab5984db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:48.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.476+0000 7f97a1a6bb80 1 -- 172.21.15.50:0/565012573 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ab59798810 con 0x55ab59859770 2024-06-06T03:27:48.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.476+0000 7f97a1a6bb80 1 -- 172.21.15.50:0/565012573 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ab59848490 con 0x55ab598533b0 2024-06-06T03:27:48.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.476+0000 7f9795785700 1 --2- 172.21.15.50:0/565012573 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab598533b0 0x55ab59853830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:48.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.476+0000 7f97a1a6bb80 10 client.0 _ll_register_callbacks cb 0x55ab597325b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:48.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.476+0000 7f978ffff700 1 -- 172.21.15.50:0/565012573 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab598533b0 msgr2=0x55ab59853830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:48.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.476+0000 7f978ffff700 1 --2- 172.21.15.50:0/565012573 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab598533b0 0x55ab59853830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.476+0000 7f978ffff700 1 -- 172.21.15.50:0/565012573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab59853fb0 msgr2=0x55ab5984d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:48.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.476+0000 7f978ffff700 1 --2- 172.21.15.50:0/565012573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab59853fb0 0x55ab5984d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.476+0000 7f978ffff700 1 -- 172.21.15.50:0/565012573 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab59762750 con 0x55ab59859770 2024-06-06T03:27:48.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.476+0000 7f9795785700 1 --2- 172.21.15.50:0/565012573 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab598533b0 0x55ab59853830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:27:48.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.476+0000 7f9794f84700 1 --2- 172.21.15.50:0/565012573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab59853fb0 0x55ab5984d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:27:48.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.476+0000 7f97a1a6bb80 1 -- 172.21.15.50:0/565012573 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f977c004ce0 con 0x55ab59859770 2024-06-06T03:27:48.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.476+0000 7f978ffff700 1 --2- 172.21.15.50:0/565012573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab59859770 0x55ab5984db70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f977c013000 tx=0x7f977c004980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cba572f887abc6b6 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:48.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.476+0000 7f976ffff700 10 client.25178 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:27:48.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.477+0000 7f976ffff700 1 -- 172.21.15.50:0/565012573 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977c00fb30 con 0x55ab59859770 2024-06-06T03:27:48.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.477+0000 7f976ffff700 1 -- 172.21.15.50:0/565012573 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f977c00fcd0 con 0x55ab59859770 2024-06-06T03:27:48.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.477+0000 7f976ffff700 1 -- 172.21.15.50:0/565012573 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f977c004040 con 0x55ab59859770 2024-06-06T03:27:48.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.477+0000 7f97a1a6bb80 10 client.25178 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:48.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.477+0000 7f97a1a6bb80 1 -- 172.21.15.50:0/565012573 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55ab59862f30 con 0x55ab59859770 2024-06-06T03:27:48.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.477+0000 7f976ffff700 1 -- 172.21.15.50:0/565012573 <== mon.2 v2:172.21.15.79:3300/0 4 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f977c0041e0 con 0x55ab59859770 2024-06-06T03:27:48.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.478+0000 7f97a1a6bb80 10 client.25178 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:48.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.478+0000 7f97a1a6bb80 10 client.25178 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-06-06T03:27:48.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.478+0000 7f97a1a6bb80 20 client.25178 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:48.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.478+0000 7f97a1a6bb80 1 --2- 172.21.15.50:0/565012573 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55ab59865400 0x55ab598677f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:48.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.478+0000 7f97a1a6bb80 4 client.25178 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:27:48.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.478+0000 7f97a1a6bb80 1 -- 172.21.15.50:0/565012573 --> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab597a9d50 con 0x55ab59865400 2024-06-06T03:27:48.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.478+0000 7f9794f84700 1 --2- 172.21.15.50:0/565012573 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55ab59865400 0x55ab598677f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:48.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.478+0000 7f9794f84700 1 --2- 172.21.15.50:0/565012573 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55ab59865400 0x55ab598677f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bb89f4d6ce2d98b5 server_cookie=f0fada3c8633d44f in_seq=0 out_seq=0 2024-06-06T03:27:48.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.479+0000 7f976ffff700 10 client.25178 ms_handle_connect on v2:172.21.15.122:6836/1604366318 2024-06-06T03:27:48.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.479+0000 7f976ffff700 1 -- 172.21.15.50:0/565012573 <== mds.1 v2:172.21.15.122:6836/1604366318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55ab597a9d50 con 0x55ab59865400 2024-06-06T03:27:48.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.479+0000 7f976ffff700 10 client.25178 handle_command_reply: tid=0 2024-06-06T03:27:48.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.479+0000 7f97a1a6bb80 1 client.25178 shutdown 2024-06-06T03:27:48.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.479+0000 7f97a1a6bb80 1 -- 172.21.15.50:0/565012573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab59859770 msgr2=0x55ab5984db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:48.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.479+0000 7f97a1a6bb80 1 --2- 172.21.15.50:0/565012573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab59859770 0x55ab5984db70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f977c013000 tx=0x7f977c004980 comp rx=0 tx=0).stop 2024-06-06T03:27:48.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.480+0000 7f97a1a6bb80 1 -- 172.21.15.50:0/565012573 shutdown_connections 2024-06-06T03:27:48.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.480+0000 7f97a1a6bb80 1 --2- 172.21.15.50:0/565012573 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55ab59865400 0x55ab598677f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.480+0000 7f97a1a6bb80 1 --2- 172.21.15.50:0/565012573 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab598533b0 0x55ab59853830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.480+0000 7f97a1a6bb80 1 --2- 172.21.15.50:0/565012573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab59853fb0 0x55ab5984d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.480+0000 7f97a1a6bb80 1 --2- 172.21.15.50:0/565012573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab59859770 0x55ab5984db70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.480+0000 7f97a1a6bb80 1 -- 172.21.15.50:0/565012573 >> 172.21.15.50:0/565012573 conn(0x55ab59778080 msgr2=0x55ab59845700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:48.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.480+0000 7f976ffff700 0 client.25178 ms_handle_reset on v2:172.21.15.122:6836/1604366318 2024-06-06T03:27:48.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.480+0000 7f97a1a6bb80 1 -- 172.21.15.50:0/565012573 shutdown_connections 2024-06-06T03:27:48.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.480+0000 7f97a1a6bb80 1 -- 172.21.15.50:0/565012573 wait complete. 2024-06-06T03:27:48.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.480+0000 7f97a1a6bb80 20 client.25178 trim_cache size 0 max 16384 2024-06-06T03:27:48.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.501+0000 7f97a1a6bb80 1 Processor -- start 2024-06-06T03:27:48.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.501+0000 7f97a1a6bb80 1 -- start start 2024-06-06T03:27:48.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.502+0000 7f97a1a6bb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab598533b0 0x55ab5985f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:48.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.502+0000 7f97a1a6bb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab59853fb0 0x55ab5986cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:48.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.502+0000 7f97a1a6bb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab59859770 0x55ab5986d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:48.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.502+0000 7f97a1a6bb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f97901aeef0 con 0x55ab598533b0 2024-06-06T03:27:48.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.502+0000 7f97a1a6bb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f97901ac780 con 0x55ab59859770 2024-06-06T03:27:48.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.502+0000 7f97a1a6bb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f97901aa5d0 con 0x55ab59853fb0 2024-06-06T03:27:48.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.502+0000 7f9794f84700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab598533b0 0x55ab5985f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:48.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.502+0000 7f9794f84700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab598533b0 0x55ab5985f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52090/0 (socket says 172.21.15.50:52090) 2024-06-06T03:27:48.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.502+0000 7f9794f84700 1 -- 172.21.15.50:0/1524405252 learned_addr learned my addr 172.21.15.50:0/1524405252 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:48.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.502+0000 7f9795785700 1 --2- 172.21.15.50:0/1524405252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab59859770 0x55ab5986d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:48.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.503+0000 7f978ffff700 1 --2- 172.21.15.50:0/1524405252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab59853fb0 0x55ab5986cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:48.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.503+0000 7f9795785700 1 -- 172.21.15.50:0/1524405252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab59853fb0 msgr2=0x55ab5986cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:48.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.503+0000 7f9795785700 1 --2- 172.21.15.50:0/1524405252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab59853fb0 0x55ab5986cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.503+0000 7f9795785700 1 -- 172.21.15.50:0/1524405252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab598533b0 msgr2=0x55ab5985f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:48.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.503+0000 7f9795785700 1 --2- 172.21.15.50:0/1524405252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab598533b0 0x55ab5985f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.503+0000 7f9795785700 1 -- 172.21.15.50:0/1524405252 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab59848990 con 0x55ab59859770 2024-06-06T03:27:48.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.503+0000 7f9795785700 1 --2- 172.21.15.50:0/1524405252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab59859770 0x55ab5986d3e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9788097980 tx=0x7f97880bb040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89817b8101a30ee1 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:48.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.503+0000 7f977a7fc700 1 -- 172.21.15.50:0/1524405252 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9788009390 con 0x55ab59859770 2024-06-06T03:27:48.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.503+0000 7f977a7fc700 1 -- 172.21.15.50:0/1524405252 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9788004c40 con 0x55ab59859770 2024-06-06T03:27:48.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.503+0000 7f977a7fc700 1 -- 172.21.15.50:0/1524405252 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97880a3c20 con 0x55ab59859770 2024-06-06T03:27:48.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.504+0000 7f97a1a6bb80 1 -- 172.21.15.50:0/1524405252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab59859770 msgr2=0x55ab5986d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:48.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.504+0000 7f97a1a6bb80 1 --2- 172.21.15.50:0/1524405252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab59859770 0x55ab5986d3e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9788097980 tx=0x7f97880bb040 comp rx=0 tx=0).stop 2024-06-06T03:27:48.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.504+0000 7f97a1a6bb80 1 -- 172.21.15.50:0/1524405252 shutdown_connections 2024-06-06T03:27:48.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.504+0000 7f97a1a6bb80 1 --2- 172.21.15.50:0/1524405252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab59859770 0x55ab5986d3e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.504+0000 7f97a1a6bb80 1 --2- 172.21.15.50:0/1524405252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab598533b0 0x55ab5985f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.504+0000 7f97a1a6bb80 1 --2- 172.21.15.50:0/1524405252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab59853fb0 0x55ab5986cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.504+0000 7f97a1a6bb80 1 -- 172.21.15.50:0/1524405252 >> 172.21.15.50:0/1524405252 conn(0x55ab59778080 msgr2=0x55ab5985f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:48.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.504+0000 7f97a1a6bb80 1 -- 172.21.15.50:0/1524405252 shutdown_connections 2024-06-06T03:27:48.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.504+0000 7f97a1a6bb80 1 -- 172.21.15.50:0/1524405252 wait complete. 2024-06-06T03:27:48.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.505+0000 7f97a1a6bb80 1 -- start start 2024-06-06T03:27:48.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.505+0000 7f97a1a6bb80 1 Processor -- start 2024-06-06T03:27:48.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.505+0000 7f97a1a6bb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab598533b0 0x55ab59875b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:48.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.505+0000 7f97a1a6bb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab59853fb0 0x55ab598760a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:48.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.505+0000 7f97a1a6bb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab59859770 0x55ab598765e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:48.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.505+0000 7f97a1a6bb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f97901aac40 con 0x55ab59853fb0 2024-06-06T03:27:48.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.505+0000 7f97a1a6bb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f97901ac0b0 con 0x55ab598533b0 2024-06-06T03:27:48.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.505+0000 7f97a1a6bb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f97901ab310 con 0x55ab59859770 2024-06-06T03:27:48.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.505+0000 7f97a1a6bb80 10 client.0 _ll_register_callbacks cb 0x55ab597325b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:48.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.505+0000 7f9794f84700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab598533b0 0x55ab59875b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:48.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.505+0000 7f9794f84700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab598533b0 0x55ab59875b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:33036/0 (socket says 172.21.15.50:33036) 2024-06-06T03:27:48.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.505+0000 7f978ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab59853fb0 0x55ab598760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:48.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.505+0000 7f9794f84700 1 -- 172.21.15.50:0/128052064 learned_addr learned my addr 172.21.15.50:0/128052064 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:48.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.506+0000 7f9795785700 1 --2- 172.21.15.50:0/128052064 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab59859770 0x55ab598765e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:48.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.506+0000 7f978ffff700 1 -- 172.21.15.50:0/128052064 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab59859770 msgr2=0x55ab598765e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:48.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.506+0000 7f978ffff700 1 --2- 172.21.15.50:0/128052064 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab59859770 0x55ab598765e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.506+0000 7f978ffff700 1 -- 172.21.15.50:0/128052064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab598533b0 msgr2=0x55ab59875b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:48.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.506+0000 7f978ffff700 1 --2- 172.21.15.50:0/128052064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab598533b0 0x55ab59875b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.506+0000 7f978ffff700 1 -- 172.21.15.50:0/128052064 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab598cdf00 con 0x55ab59853fb0 2024-06-06T03:27:48.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.506+0000 7f9794f84700 1 --2- 172.21.15.50:0/128052064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab598533b0 0x55ab59875b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:27:48.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.506+0000 7f978ffff700 1 --2- 172.21.15.50:0/128052064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab59853fb0 0x55ab598760a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f977c00dca0 tx=0x7f977c00d5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f36102a4fe8261b server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:48.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.506+0000 7f976ffff700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:27:48.509 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:27:48.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.506+0000 7f976ffff700 1 -- 172.21.15.50:0/128052064 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977c003880 con 0x55ab59853fb0 2024-06-06T03:27:48.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.506+0000 7f97a1a6bb80 1 -- 172.21.15.50:0/128052064 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ab597a42d0 con 0x55ab59853fb0 2024-06-06T03:27:48.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.506+0000 7f976ffff700 1 -- 172.21.15.50:0/128052064 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f977c003a20 con 0x55ab59853fb0 2024-06-06T03:27:48.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.506+0000 7f976ffff700 1 -- 172.21.15.50:0/128052064 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f977c00fdc0 con 0x55ab59853fb0 2024-06-06T03:27:48.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.506+0000 7f97a1a6bb80 10 client.15579 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:48.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.506+0000 7f97a1a6bb80 1 -- 172.21.15.50:0/128052064 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ab598cf1c0 con 0x55ab59853fb0 2024-06-06T03:27:48.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.507+0000 7f976ffff700 1 -- 172.21.15.50:0/128052064 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55ab597a42d0 con 0x55ab59853fb0 2024-06-06T03:27:48.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.507+0000 7f976ffff700 1 -- 172.21.15.50:0/128052064 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f977c030470 con 0x55ab59853fb0 2024-06-06T03:27:48.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.507+0000 7f97a1a6bb80 10 client.15579 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:48.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.507+0000 7f97a1a6bb80 10 client.15579 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-06-06T03:27:48.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.507+0000 7f97a1a6bb80 20 client.15579 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:48.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.507+0000 7f97a1a6bb80 1 --2- 172.21.15.50:0/128052064 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55ab598cf840 0x55ab598d1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:48.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.507+0000 7f97a1a6bb80 4 client.15579 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:27:48.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.507+0000 7f97a1a6bb80 1 -- 172.21.15.50:0/128052064 --> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ab59757f50 con 0x55ab598cf840 2024-06-06T03:27:48.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.507+0000 7f9794f84700 1 --2- 172.21.15.50:0/128052064 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55ab598cf840 0x55ab598d1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:48.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.508+0000 7f976ffff700 10 client.15579 ms_handle_connect on v2:172.21.15.122:6836/1604366318 2024-06-06T03:27:48.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.508+0000 7f9794f84700 1 --2- 172.21.15.50:0/128052064 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55ab598cf840 0x55ab598d1c60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=265547f9b87c253d server_cookie=8a8b49ae52f9aff3 in_seq=0 out_seq=0 2024-06-06T03:27:48.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.508+0000 7f976ffff700 1 -- 172.21.15.50:0/128052064 <== mds.1 v2:172.21.15.122:6836/1604366318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ab59757f50 con 0x55ab598cf840 2024-06-06T03:27:48.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.508+0000 7f976ffff700 10 client.15579 handle_command_reply: tid=0 2024-06-06T03:27:48.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.508+0000 7f97a1a6bb80 1 client.15579 shutdown 2024-06-06T03:27:48.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.508+0000 7f97a1a6bb80 1 -- 172.21.15.50:0/128052064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab59853fb0 msgr2=0x55ab598760a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:48.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.508+0000 7f97a1a6bb80 1 --2- 172.21.15.50:0/128052064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab59853fb0 0x55ab598760a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f977c00dca0 tx=0x7f977c00d5a0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.508+0000 7f97a1a6bb80 1 -- 172.21.15.50:0/128052064 shutdown_connections 2024-06-06T03:27:48.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.508+0000 7f97a1a6bb80 1 --2- 172.21.15.50:0/128052064 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55ab598cf840 0x55ab598d1c60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.508+0000 7f97a1a6bb80 1 --2- 172.21.15.50:0/128052064 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab59859770 0x55ab598765e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.508+0000 7f97a1a6bb80 1 --2- 172.21.15.50:0/128052064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab598533b0 0x55ab59875b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.508+0000 7f976ffff700 0 client.15579 ms_handle_reset on v2:172.21.15.122:6836/1604366318 2024-06-06T03:27:48.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.508+0000 7f97a1a6bb80 1 --2- 172.21.15.50:0/128052064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab59853fb0 0x55ab598760a0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.508+0000 7f97a1a6bb80 1 -- 172.21.15.50:0/128052064 >> 172.21.15.50:0/128052064 conn(0x55ab59778080 msgr2=0x55ab5985f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:48.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.509+0000 7f97a1a6bb80 1 -- 172.21.15.50:0/128052064 shutdown_connections 2024-06-06T03:27:48.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.509+0000 7f97a1a6bb80 1 -- 172.21.15.50:0/128052064 wait complete. 2024-06-06T03:27:48.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.509+0000 7f97a1a6bb80 20 client.15579 trim_cache size 0 max 16384 2024-06-06T03:27:48.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.509+0000 7f97971e8700 1 -- 172.21.15.50:0/2182247760 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f97800a2d00 msgr2=0x7f97800a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:48.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.509+0000 7f97971e8700 1 --2- 172.21.15.50:0/2182247760 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f97800a2d00 0x7f97800a51c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9784009990 tx=0x7f9784005f00 comp rx=0 tx=0).stop 2024-06-06T03:27:48.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.509+0000 7f97971e8700 1 -- 172.21.15.50:0/2182247760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9790196970 msgr2=0x7f9790196df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:48.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.509+0000 7f97971e8700 1 --2- 172.21.15.50:0/2182247760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9790196970 0x7f9790196df0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9788007ee0 tx=0x7f978800d3b0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.509+0000 7f97971e8700 1 -- 172.21.15.50:0/2182247760 shutdown_connections 2024-06-06T03:27:48.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.509+0000 7f97971e8700 1 --2- 172.21.15.50:0/2182247760 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f97800a2d00 0x7f97800a51c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.509+0000 7f97971e8700 1 --2- 172.21.15.50:0/2182247760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9790196970 0x7f9790196df0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.509+0000 7f97971e8700 1 --2- 172.21.15.50:0/2182247760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97901027a0 0x7f979019c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.509+0000 7f97971e8700 1 --2- 172.21.15.50:0/2182247760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9790106750 0x7f979019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:48.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.509+0000 7f97971e8700 1 -- 172.21.15.50:0/2182247760 >> 172.21.15.50:0/2182247760 conn(0x7f9790077a00 msgr2=0x7f97900fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:48.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.511+0000 7f97971e8700 1 -- 172.21.15.50:0/2182247760 shutdown_connections 2024-06-06T03:27:48.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:48.512+0000 7f97971e8700 1 -- 172.21.15.50:0/2182247760 wait complete. 2024-06-06T03:27:49.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:48 smithi079 ceph-mon[35478]: pgmap v466: 129 pgs: 129 active+clean; 670 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-06T03:27:49.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:48 smithi122 ceph-mon[35759]: pgmap v466: 129 pgs: 129 active+clean; 670 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-06T03:27:49.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:48 smithi050 ceph-mon[32421]: pgmap v466: 129 pgs: 129 active+clean; 670 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-06T03:27:49.367 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-06-06T03:27:49.751 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:27:51.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:50 smithi079 ceph-mon[35478]: pgmap v467: 129 pgs: 129 active+clean; 670 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-06T03:27:51.110 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:50 smithi050 ceph-mon[32421]: pgmap v467: 129 pgs: 129 active+clean; 670 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-06T03:27:51.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:50 smithi122 ceph-mon[35759]: pgmap v467: 129 pgs: 129 active+clean; 670 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-06T03:27:51.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.613+0000 7fca30fe7700 1 -- 172.21.15.50:0/1233622834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca2c101390 msgr2=0x7fca2c101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:51.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.613+0000 7fca30fe7700 1 --2- 172.21.15.50:0/1233622834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca2c101390 0x7fca2c101810 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fca20009990 tx=0x7fca20009ca0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.613+0000 7fca30fe7700 1 -- 172.21.15.50:0/1233622834 shutdown_connections 2024-06-06T03:27:51.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.614+0000 7fca30fe7700 1 --2- 172.21.15.50:0/1233622834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca2c101d50 0x7fca2c10e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.614+0000 7fca30fe7700 1 --2- 172.21.15.50:0/1233622834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca2c107400 0x7fca2c1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.614+0000 7fca30fe7700 1 --2- 172.21.15.50:0/1233622834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca2c101390 0x7fca2c101810 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.614+0000 7fca30fe7700 1 -- 172.21.15.50:0/1233622834 >> 172.21.15.50:0/1233622834 conn(0x7fca2c078340 msgr2=0x7fca2c078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:51.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.614+0000 7fca30fe7700 1 -- 172.21.15.50:0/1233622834 shutdown_connections 2024-06-06T03:27:51.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.614+0000 7fca30fe7700 1 -- 172.21.15.50:0/1233622834 wait complete. 2024-06-06T03:27:51.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.615+0000 7fca30fe7700 1 Processor -- start 2024-06-06T03:27:51.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.615+0000 7fca30fe7700 1 -- start start 2024-06-06T03:27:51.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.615+0000 7fca30fe7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca2c101390 0x7fca2c19ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:51.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.615+0000 7fca30fe7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca2c101d50 0x7fca2c19b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:51.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.615+0000 7fca30fe7700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca2c107400 0x7fca2c19f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:51.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.615+0000 7fca30fe7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c111550 con 0x7fca2c101390 2024-06-06T03:27:51.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.615+0000 7fca30fe7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c1113d0 con 0x7fca2c101d50 2024-06-06T03:27:51.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.615+0000 7fca30fe7700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c1116d0 con 0x7fca2c107400 2024-06-06T03:27:51.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.615+0000 7fca2a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca2c101390 0x7fca2c19ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:51.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.615+0000 7fca2a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca2c101390 0x7fca2c19ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52112/0 (socket says 172.21.15.50:52112) 2024-06-06T03:27:51.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.615+0000 7fca29d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca2c101d50 0x7fca2c19b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:51.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.615+0000 7fca29d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca2c101d50 0x7fca2c19b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:33044/0 (socket says 172.21.15.50:33044) 2024-06-06T03:27:51.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.615+0000 7fca29d9b700 1 -- 172.21.15.50:0/897837275 learned_addr learned my addr 172.21.15.50:0/897837275 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:51.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.616+0000 7fca2ad9d700 1 --2- 172.21.15.50:0/897837275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca2c107400 0x7fca2c19f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:51.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.616+0000 7fca29d9b700 1 -- 172.21.15.50:0/897837275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca2c107400 msgr2=0x7fca2c19f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:51.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.616+0000 7fca29d9b700 1 --2- 172.21.15.50:0/897837275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca2c107400 0x7fca2c19f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.616+0000 7fca29d9b700 1 -- 172.21.15.50:0/897837275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca2c101390 msgr2=0x7fca2c19ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:51.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.616+0000 7fca29d9b700 1 --2- 172.21.15.50:0/897837275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca2c101390 0x7fca2c19ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.616+0000 7fca29d9b700 1 -- 172.21.15.50:0/897837275 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca2c19fd40 con 0x7fca2c101d50 2024-06-06T03:27:51.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.616+0000 7fca29d9b700 1 --2- 172.21.15.50:0/897837275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca2c101d50 0x7fca2c19b270 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fca2000b5c0 tx=0x7fca200047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:51.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.616+0000 7fca1b7fe700 1 -- 172.21.15.50:0/897837275 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca20027070 con 0x7fca2c101d50 2024-06-06T03:27:51.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.617+0000 7fca1b7fe700 1 -- 172.21.15.50:0/897837275 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fca20003f80 con 0x7fca2c101d50 2024-06-06T03:27:51.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.617+0000 7fca30fe7700 1 -- 172.21.15.50:0/897837275 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca2c19ffd0 con 0x7fca2c101d50 2024-06-06T03:27:51.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.618+0000 7fca1b7fe700 1 -- 172.21.15.50:0/897837275 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca20022ca0 con 0x7fca2c101d50 2024-06-06T03:27:51.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.618+0000 7fca30fe7700 1 -- 172.21.15.50:0/897837275 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca2c1a03f0 con 0x7fca2c101d50 2024-06-06T03:27:51.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.619+0000 7fca1b7fe700 1 -- 172.21.15.50:0/897837275 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fca2002a070 con 0x7fca2c101d50 2024-06-06T03:27:51.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.620+0000 7fca1b7fe700 1 --2- 172.21.15.50:0/897837275 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fca140a2d70 0x7fca140a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:51.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.621+0000 7fca2a59c700 1 --2- 172.21.15.50:0/897837275 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fca140a2d70 0x7fca140a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:51.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.621+0000 7fca1b7fe700 1 -- 172.21.15.50:0/897837275 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fca200d0330 con 0x7fca2c101d50 2024-06-06T03:27:51.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.621+0000 7fca2a59c700 1 --2- 172.21.15.50:0/897837275 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fca140a2d70 0x7fca140a5230 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fca1c005950 tx=0x7fca1c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:51.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.623+0000 7fca3b86ab80 1 Processor -- start 2024-06-06T03:27:51.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.623+0000 7fca3b86ab80 1 -- start start 2024-06-06T03:27:51.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.624+0000 7fca3b86ab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff9d1a7640 0x55ff9d1a7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:51.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.624+0000 7fca3b86ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff9d1a7f60 0x55ff9d1a19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:51.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.624+0000 7fca3b86ab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff9d1a1f20 0x55ff9d1a2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:51.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.624+0000 7fca3b86ab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ff9d0f3810 con 0x55ff9d1a7640 2024-06-06T03:27:51.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.624+0000 7fca3b86ab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ff9d09b720 con 0x55ff9d1a7f60 2024-06-06T03:27:51.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.624+0000 7fca3b86ab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ff9d0ef7d0 con 0x55ff9d1a1f20 2024-06-06T03:27:51.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.624+0000 7fca2a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff9d1a7640 0x55ff9d1a7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:51.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.624+0000 7fca2a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff9d1a7640 0x55ff9d1a7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52118/0 (socket says 172.21.15.50:52118) 2024-06-06T03:27:51.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.624+0000 7fca2a59c700 1 -- 172.21.15.50:0/3068722188 learned_addr learned my addr 172.21.15.50:0/3068722188 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:51.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.624+0000 7fca29d9b700 1 --2- 172.21.15.50:0/3068722188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff9d1a7f60 0x55ff9d1a19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:51.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.624+0000 7fca2ad9d700 1 --2- 172.21.15.50:0/3068722188 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff9d1a1f20 0x55ff9d1a2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:51.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.624+0000 7fca2a59c700 1 -- 172.21.15.50:0/3068722188 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff9d1a1f20 msgr2=0x55ff9d1a2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:51.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.624+0000 7fca2a59c700 1 --2- 172.21.15.50:0/3068722188 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff9d1a1f20 0x55ff9d1a2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.624+0000 7fca2a59c700 1 -- 172.21.15.50:0/3068722188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff9d1a7f60 msgr2=0x55ff9d1a19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:51.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.624+0000 7fca2a59c700 1 --2- 172.21.15.50:0/3068722188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff9d1a7f60 0x55ff9d1a19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.624+0000 7fca2a59c700 1 -- 172.21.15.50:0/3068722188 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff9d091f50 con 0x55ff9d1a7640 2024-06-06T03:27:51.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.625+0000 7fca2a59c700 1 --2- 172.21.15.50:0/3068722188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff9d1a7640 0x55ff9d1a7a20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fca1c010e60 tx=0x7fca1c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=660df31e23725199 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:51.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.625+0000 7fca18ff9700 1 -- 172.21.15.50:0/3068722188 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c011db0 con 0x55ff9d1a7640 2024-06-06T03:27:51.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.625+0000 7fca18ff9700 1 -- 172.21.15.50:0/3068722188 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fca1c010e90 con 0x55ff9d1a7640 2024-06-06T03:27:51.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.625+0000 7fca18ff9700 1 -- 172.21.15.50:0/3068722188 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c01c730 con 0x55ff9d1a7640 2024-06-06T03:27:51.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.626+0000 7fca3b86ab80 1 -- 172.21.15.50:0/3068722188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff9d1a7640 msgr2=0x55ff9d1a7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:51.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.626+0000 7fca3b86ab80 1 --2- 172.21.15.50:0/3068722188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff9d1a7640 0x55ff9d1a7a20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fca1c010e60 tx=0x7fca1c013000 comp rx=0 tx=0).stop 2024-06-06T03:27:51.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.626+0000 7fca3b86ab80 1 -- 172.21.15.50:0/3068722188 shutdown_connections 2024-06-06T03:27:51.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.626+0000 7fca3b86ab80 1 --2- 172.21.15.50:0/3068722188 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff9d1a1f20 0x55ff9d1a2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.626+0000 7fca3b86ab80 1 --2- 172.21.15.50:0/3068722188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff9d1a7640 0x55ff9d1a7a20 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.626+0000 7fca3b86ab80 1 --2- 172.21.15.50:0/3068722188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff9d1a7f60 0x55ff9d1a19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.626+0000 7fca3b86ab80 1 -- 172.21.15.50:0/3068722188 >> 172.21.15.50:0/3068722188 conn(0x55ff9d0cccc0 msgr2=0x55ff9d19c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:51.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.626+0000 7fca3b86ab80 1 -- 172.21.15.50:0/3068722188 shutdown_connections 2024-06-06T03:27:51.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.626+0000 7fca3b86ab80 1 -- 172.21.15.50:0/3068722188 wait complete. 2024-06-06T03:27:51.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.627+0000 7fca3b86ab80 1 -- start start 2024-06-06T03:27:51.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.627+0000 7fca3b86ab80 1 Processor -- start 2024-06-06T03:27:51.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.628+0000 7fca3b86ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff9d1a1f20 0x55ff9d1add50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:51.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.628+0000 7fca3b86ab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff9d1a7640 0x55ff9d1ab050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:51.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.628+0000 7fca3b86ab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff9d1a7f60 0x55ff9d1ab590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:51.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.628+0000 7fca3b86ab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ff9d1ae9d0 con 0x55ff9d1a7640 2024-06-06T03:27:51.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.628+0000 7fca29d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff9d1a7640 0x55ff9d1ab050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:51.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.628+0000 7fca29d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff9d1a7640 0x55ff9d1ab050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52124/0 (socket says 172.21.15.50:52124) 2024-06-06T03:27:51.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.628+0000 7fca29d9b700 1 -- 172.21.15.50:0/3223592371 learned_addr learned my addr 172.21.15.50:0/3223592371 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:51.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.628+0000 7fca3b86ab80 1 -- 172.21.15.50:0/3223592371 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ff9d093bf0 con 0x55ff9d1a1f20 2024-06-06T03:27:51.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.628+0000 7fca3b86ab80 1 -- 172.21.15.50:0/3223592371 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ff9d1aeb50 con 0x55ff9d1a7f60 2024-06-06T03:27:51.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.628+0000 7fca2a59c700 1 --2- 172.21.15.50:0/3223592371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff9d1a1f20 0x55ff9d1add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:51.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.628+0000 7fca2ad9d700 1 --2- 172.21.15.50:0/3223592371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff9d1a7f60 0x55ff9d1ab590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:51.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.629+0000 7fca3b86ab80 10 client.0 _ll_register_callbacks cb 0x55ff9d08d920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:51.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.629+0000 7fca29d9b700 1 -- 172.21.15.50:0/3223592371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff9d1a7f60 msgr2=0x55ff9d1ab590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:51.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.629+0000 7fca29d9b700 1 --2- 172.21.15.50:0/3223592371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff9d1a7f60 0x55ff9d1ab590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.629+0000 7fca29d9b700 1 -- 172.21.15.50:0/3223592371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff9d1a1f20 msgr2=0x55ff9d1add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:51.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.629+0000 7fca29d9b700 1 --2- 172.21.15.50:0/3223592371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff9d1a1f20 0x55ff9d1add50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.629+0000 7fca29d9b700 1 -- 172.21.15.50:0/3223592371 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff9d0428d0 con 0x55ff9d1a7640 2024-06-06T03:27:51.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.629+0000 7fca2ad9d700 1 --2- 172.21.15.50:0/3223592371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff9d1a7f60 0x55ff9d1ab590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:27:51.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.629+0000 7fca29d9b700 1 --2- 172.21.15.50:0/3223592371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff9d1a7640 0x55ff9d1ab050 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fca20099210 tx=0x7fca20005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88c96b3e9c1f674 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:51.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.629+0000 7fca11ffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:27:51.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.629+0000 7fca11ffb700 1 -- 172.21.15.50:0/3223592371 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca200b4070 con 0x55ff9d1a7640 2024-06-06T03:27:51.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.629+0000 7fca11ffb700 1 -- 172.21.15.50:0/3223592371 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fca2009ab40 con 0x55ff9d1a7640 2024-06-06T03:27:51.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.630+0000 7fca3b86ab80 1 -- 172.21.15.50:0/3223592371 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca1c010e90 con 0x55ff9d1a7640 2024-06-06T03:27:51.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.630+0000 7fca11ffb700 1 -- 172.21.15.50:0/3223592371 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fca2009c840 con 0x55ff9d1a7640 2024-06-06T03:27:51.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.630+0000 7fca3b86ab80 10 client.15591 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:51.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.630+0000 7fca3b86ab80 1 -- 172.21.15.50:0/3223592371 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ff9d1b9390 con 0x55ff9d1a7640 2024-06-06T03:27:51.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.630+0000 7fca11ffb700 1 -- 172.21.15.50:0/3223592371 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fca200a0bf0 con 0x55ff9d1a7640 2024-06-06T03:27:51.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.630+0000 7fca11ffb700 1 -- 172.21.15.50:0/3223592371 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fca2009db70 con 0x55ff9d1a7640 2024-06-06T03:27:51.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.630+0000 7fca3b86ab80 10 client.15591 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:51.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.630+0000 7fca3b86ab80 10 client.15591 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:27:51.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.630+0000 7fca3b86ab80 20 client.15591 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:51.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.630+0000 7fca3b86ab80 1 --2- 172.21.15.50:0/3223592371 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ff9d1bb900 0x55ff9d1bdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:51.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.630+0000 7fca3b86ab80 4 client.15591 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:27:51.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.630+0000 7fca3b86ab80 1 -- 172.21.15.50:0/3223592371 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fca1c010e90 con 0x55ff9d1bb900 2024-06-06T03:27:51.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.631+0000 7fca2a59c700 1 --2- 172.21.15.50:0/3223592371 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ff9d1bb900 0x55ff9d1bdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:51.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.631+0000 7fca11ffb700 10 client.15591 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:51.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.631+0000 7fca2a59c700 1 --2- 172.21.15.50:0/3223592371 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ff9d1bb900 0x55ff9d1bdd80 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f30b22a273f4f5e9 server_cookie=57dd0b9f02d919af in_seq=0 out_seq=0 2024-06-06T03:27:51.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.632+0000 7fca11ffb700 1 -- 172.21.15.50:0/3223592371 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x7fca1c010e90 con 0x55ff9d1bb900 2024-06-06T03:27:51.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.632+0000 7fca11ffb700 10 client.15591 handle_command_reply: tid=0 2024-06-06T03:27:51.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.632+0000 7fca3b86ab80 1 client.15591 shutdown 2024-06-06T03:27:51.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.632+0000 7fca3b86ab80 1 -- 172.21.15.50:0/3223592371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff9d1a7640 msgr2=0x55ff9d1ab050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:51.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.632+0000 7fca3b86ab80 1 --2- 172.21.15.50:0/3223592371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff9d1a7640 0x55ff9d1ab050 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fca20099210 tx=0x7fca20005f10 comp rx=0 tx=0).stop 2024-06-06T03:27:51.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.632+0000 7fca3b86ab80 1 -- 172.21.15.50:0/3223592371 shutdown_connections 2024-06-06T03:27:51.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.632+0000 7fca3b86ab80 1 --2- 172.21.15.50:0/3223592371 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ff9d1bb900 0x55ff9d1bdd80 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.632+0000 7fca3b86ab80 1 --2- 172.21.15.50:0/3223592371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff9d1a7f60 0x55ff9d1ab590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.632+0000 7fca11ffb700 0 client.15591 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:51.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.632+0000 7fca3b86ab80 1 --2- 172.21.15.50:0/3223592371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff9d1a1f20 0x55ff9d1add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.632+0000 7fca3b86ab80 1 --2- 172.21.15.50:0/3223592371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff9d1a7640 0x55ff9d1ab050 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.632+0000 7fca3b86ab80 1 -- 172.21.15.50:0/3223592371 >> 172.21.15.50:0/3223592371 conn(0x55ff9d0cccc0 msgr2=0x55ff9d19c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:51.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.632+0000 7fca3b86ab80 1 -- 172.21.15.50:0/3223592371 shutdown_connections 2024-06-06T03:27:51.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.632+0000 7fca3b86ab80 1 -- 172.21.15.50:0/3223592371 wait complete. 2024-06-06T03:27:51.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.632+0000 7fca3b86ab80 20 client.15591 trim_cache size 0 max 16384 2024-06-06T03:27:51.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.663+0000 7fca3b86ab80 1 Processor -- start 2024-06-06T03:27:51.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.663+0000 7fca3b86ab80 1 -- start start 2024-06-06T03:27:51.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.663+0000 7fca3b86ab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff9d1a1f20 0x55ff9d1b7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:51.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.663+0000 7fca3b86ab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff9d1a7f60 0x55ff9d1a19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:51.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.663+0000 7fca3b86ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff9d1a8a50 0x55ff9d1c3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:51.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.663+0000 7fca3b86ab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c1b2ae0 con 0x55ff9d1a7f60 2024-06-06T03:27:51.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.663+0000 7fca3b86ab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c1b0370 con 0x55ff9d1a8a50 2024-06-06T03:27:51.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.663+0000 7fca3b86ab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c1ae1c0 con 0x55ff9d1a1f20 2024-06-06T03:27:51.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.663+0000 7fca2a59c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff9d1a1f20 0x55ff9d1b7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:51.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.663+0000 7fca2a59c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff9d1a1f20 0x55ff9d1b7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:43934/0 (socket says 172.21.15.50:43934) 2024-06-06T03:27:51.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.663+0000 7fca2a59c700 1 -- 172.21.15.50:0/1821259663 learned_addr learned my addr 172.21.15.50:0/1821259663 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:51.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.664+0000 7fca29d9b700 1 --2- 172.21.15.50:0/1821259663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff9d1a7f60 0x55ff9d1a19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:51.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.664+0000 7fca2ad9d700 1 --2- 172.21.15.50:0/1821259663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff9d1a8a50 0x55ff9d1c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:51.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.664+0000 7fca2a59c700 1 -- 172.21.15.50:0/1821259663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff9d1a8a50 msgr2=0x55ff9d1c3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:51.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.664+0000 7fca2a59c700 1 --2- 172.21.15.50:0/1821259663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff9d1a8a50 0x55ff9d1c3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.664+0000 7fca2a59c700 1 -- 172.21.15.50:0/1821259663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff9d1a7f60 msgr2=0x55ff9d1a19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:51.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.664+0000 7fca2a59c700 1 --2- 172.21.15.50:0/1821259663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff9d1a7f60 0x55ff9d1a19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.664+0000 7fca2a59c700 1 -- 172.21.15.50:0/1821259663 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff9d1a95c0 con 0x55ff9d1a1f20 2024-06-06T03:27:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.664+0000 7fca2ad9d700 1 --2- 172.21.15.50:0/1821259663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff9d1a8a50 0x55ff9d1c3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:27:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.664+0000 7fca2a59c700 1 --2- 172.21.15.50:0/1821259663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff9d1a1f20 0x55ff9d1b7ca0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fca1c010760 tx=0x7fca1c00b630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=815d96c14934a707 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.664+0000 7fca13fff700 1 -- 172.21.15.50:0/1821259663 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c005040 con 0x55ff9d1a1f20 2024-06-06T03:27:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.665+0000 7fca13fff700 1 -- 172.21.15.50:0/1821259663 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fca1c005690 con 0x55ff9d1a1f20 2024-06-06T03:27:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.665+0000 7fca13fff700 1 -- 172.21.15.50:0/1821259663 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c01e680 con 0x55ff9d1a1f20 2024-06-06T03:27:51.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.666+0000 7fca3b86ab80 1 -- 172.21.15.50:0/1821259663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff9d1a1f20 msgr2=0x55ff9d1b7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:51.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.666+0000 7fca3b86ab80 1 --2- 172.21.15.50:0/1821259663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff9d1a1f20 0x55ff9d1b7ca0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fca1c010760 tx=0x7fca1c00b630 comp rx=0 tx=0).stop 2024-06-06T03:27:51.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.666+0000 7fca3b86ab80 1 -- 172.21.15.50:0/1821259663 shutdown_connections 2024-06-06T03:27:51.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.666+0000 7fca3b86ab80 1 --2- 172.21.15.50:0/1821259663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff9d1a8a50 0x55ff9d1c3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.666+0000 7fca3b86ab80 1 --2- 172.21.15.50:0/1821259663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff9d1a1f20 0x55ff9d1b7ca0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.666+0000 7fca3b86ab80 1 --2- 172.21.15.50:0/1821259663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff9d1a7f60 0x55ff9d1a19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.666+0000 7fca3b86ab80 1 -- 172.21.15.50:0/1821259663 >> 172.21.15.50:0/1821259663 conn(0x55ff9d0cccc0 msgr2=0x55ff9d1a8340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:51.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.666+0000 7fca3b86ab80 1 -- 172.21.15.50:0/1821259663 shutdown_connections 2024-06-06T03:27:51.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.666+0000 7fca3b86ab80 1 -- 172.21.15.50:0/1821259663 wait complete. 2024-06-06T03:27:51.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.666+0000 7fca3b86ab80 1 -- start start 2024-06-06T03:27:51.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.667+0000 7fca3b86ab80 1 Processor -- start 2024-06-06T03:27:51.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.667+0000 7fca3b86ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff9d1a1f20 0x55ff9d1b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:51.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.667+0000 7fca3b86ab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff9d1a7f60 0x55ff9d1c3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:51.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.667+0000 7fca3b86ab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff9d1a8a50 0x55ff9d1c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:51.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.668+0000 7fca2a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff9d1a1f20 0x55ff9d1b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:51.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.668+0000 7fca2a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff9d1a1f20 0x55ff9d1b4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:33086/0 (socket says 172.21.15.50:33086) 2024-06-06T03:27:51.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.668+0000 7fca2ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff9d1a8a50 0x55ff9d1c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:51.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.668+0000 7fca2ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff9d1a8a50 0x55ff9d1c3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52134/0 (socket says 172.21.15.50:52134) 2024-06-06T03:27:51.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.668+0000 7fca2a59c700 1 -- 172.21.15.50:0/2041659944 learned_addr learned my addr 172.21.15.50:0/2041659944 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:51.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.668+0000 7fca3b86ab80 1 -- 172.21.15.50:0/2041659944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c1ae830 con 0x55ff9d1a8a50 2024-06-06T03:27:51.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.668+0000 7fca3b86ab80 1 -- 172.21.15.50:0/2041659944 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c1afca0 con 0x55ff9d1a1f20 2024-06-06T03:27:51.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.668+0000 7fca3b86ab80 1 -- 172.21.15.50:0/2041659944 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c1aef00 con 0x55ff9d1a7f60 2024-06-06T03:27:51.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.668+0000 7fca29d9b700 1 --2- 172.21.15.50:0/2041659944 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff9d1a7f60 0x55ff9d1c3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.668+0000 7fca3b86ab80 10 client.0 _ll_register_callbacks cb 0x55ff9d08d920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.668+0000 7fca2ad9d700 1 -- 172.21.15.50:0/2041659944 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff9d1a7f60 msgr2=0x55ff9d1c3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.668+0000 7fca2ad9d700 1 --2- 172.21.15.50:0/2041659944 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff9d1a7f60 0x55ff9d1c3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.668+0000 7fca2ad9d700 1 -- 172.21.15.50:0/2041659944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff9d1a1f20 msgr2=0x55ff9d1b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.668+0000 7fca2ad9d700 1 --2- 172.21.15.50:0/2041659944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff9d1a1f20 0x55ff9d1b4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.668+0000 7fca2ad9d700 1 -- 172.21.15.50:0/2041659944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff9d22de70 con 0x55ff9d1a8a50 2024-06-06T03:27:51.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.668+0000 7fca2a59c700 1 --2- 172.21.15.50:0/2041659944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff9d1a1f20 0x55ff9d1b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:27:51.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.669+0000 7fca2ad9d700 1 --2- 172.21.15.50:0/2041659944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff9d1a8a50 0x55ff9d1c3710 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fca24007660 tx=0x7fca24007970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8aac0fdc22194a1 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:51.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.669+0000 7fca11ffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:27:51.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.669+0000 7fca11ffb700 1 -- 172.21.15.50:0/2041659944 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca24003c00 con 0x55ff9d1a8a50 2024-06-06T03:27:51.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.669+0000 7fca11ffb700 1 -- 172.21.15.50:0/2041659944 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fca24003da0 con 0x55ff9d1a8a50 2024-06-06T03:27:51.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.669+0000 7fca3b86ab80 1 -- 172.21.15.50:0/2041659944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca1c005690 con 0x55ff9d1a8a50 2024-06-06T03:27:51.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.669+0000 7fca11ffb700 1 -- 172.21.15.50:0/2041659944 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fca24027050 con 0x55ff9d1a8a50 2024-06-06T03:27:51.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.669+0000 7fca3b86ab80 10 client.15597 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:51.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.669+0000 7fca3b86ab80 1 -- 172.21.15.50:0/2041659944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ff9d22efb0 con 0x55ff9d1a8a50 2024-06-06T03:27:51.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.670+0000 7fca11ffb700 1 -- 172.21.15.50:0/2041659944 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fca1c005690 con 0x55ff9d1a8a50 2024-06-06T03:27:51.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.670+0000 7fca11ffb700 1 -- 172.21.15.50:0/2041659944 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fca240043b0 con 0x55ff9d1a8a50 2024-06-06T03:27:51.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.670+0000 7fca3b86ab80 10 client.15597 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:51.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.670+0000 7fca3b86ab80 10 client.15597 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:27:51.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.670+0000 7fca3b86ab80 20 client.15597 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:51.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.670+0000 7fca3b86ab80 1 --2- 172.21.15.50:0/2041659944 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ff9d22f740 0x55ff9d231b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:51.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.670+0000 7fca3b86ab80 4 client.15597 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:27:51.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.670+0000 7fca3b86ab80 1 -- 172.21.15.50:0/2041659944 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ff9d100d10 con 0x55ff9d22f740 2024-06-06T03:27:51.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.671+0000 7fca2a59c700 1 --2- 172.21.15.50:0/2041659944 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ff9d22f740 0x55ff9d231b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:51.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.671+0000 7fca2a59c700 1 --2- 172.21.15.50:0/2041659944 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ff9d22f740 0x55ff9d231b60 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e66f84f8ad4b57d6 server_cookie=b0a9e4d9813a35c6 in_seq=0 out_seq=0 2024-06-06T03:27:51.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.671+0000 7fca11ffb700 10 client.15597 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:51.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.671+0000 7fca11ffb700 1 -- 172.21.15.50:0/2041659944 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ff9d100d10 con 0x55ff9d22f740 2024-06-06T03:27:51.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.671+0000 7fca11ffb700 10 client.15597 handle_command_reply: tid=0 2024-06-06T03:27:51.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.671+0000 7fca3b86ab80 1 client.15597 shutdown 2024-06-06T03:27:51.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.671+0000 7fca3b86ab80 1 -- 172.21.15.50:0/2041659944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff9d1a8a50 msgr2=0x55ff9d1c3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:51.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.671+0000 7fca3b86ab80 1 --2- 172.21.15.50:0/2041659944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff9d1a8a50 0x55ff9d1c3710 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fca24007660 tx=0x7fca24007970 comp rx=0 tx=0).stop 2024-06-06T03:27:51.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.672+0000 7fca3b86ab80 1 -- 172.21.15.50:0/2041659944 shutdown_connections 2024-06-06T03:27:51.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.672+0000 7fca3b86ab80 1 --2- 172.21.15.50:0/2041659944 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ff9d22f740 0x55ff9d231b60 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.672+0000 7fca3b86ab80 1 --2- 172.21.15.50:0/2041659944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff9d1a8a50 0x55ff9d1c3710 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.672+0000 7fca3b86ab80 1 --2- 172.21.15.50:0/2041659944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ff9d1a1f20 0x55ff9d1b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.672+0000 7fca3b86ab80 1 --2- 172.21.15.50:0/2041659944 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ff9d1a7f60 0x55ff9d1c3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.672+0000 7fca3b86ab80 1 -- 172.21.15.50:0/2041659944 >> 172.21.15.50:0/2041659944 conn(0x55ff9d0cccc0 msgr2=0x55ff9d195e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:51.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.672+0000 7fca11ffb700 0 client.15597 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:51.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.672+0000 7fca3b86ab80 1 -- 172.21.15.50:0/2041659944 shutdown_connections 2024-06-06T03:27:51.686 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:27:51.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.672+0000 7fca3b86ab80 1 -- 172.21.15.50:0/2041659944 wait complete. 2024-06-06T03:27:51.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.672+0000 7fca3b86ab80 20 client.15597 trim_cache size 0 max 16384 2024-06-06T03:27:51.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.672+0000 7fca30fe7700 1 -- 172.21.15.50:0/897837275 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fca140a2d70 msgr2=0x7fca140a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:51.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.672+0000 7fca30fe7700 1 --2- 172.21.15.50:0/897837275 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fca140a2d70 0x7fca140a5230 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fca1c005950 tx=0x7fca1c00b410 comp rx=0 tx=0).stop 2024-06-06T03:27:51.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.673+0000 7fca30fe7700 1 -- 172.21.15.50:0/897837275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca2c101d50 msgr2=0x7fca2c19b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:51.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.673+0000 7fca30fe7700 1 --2- 172.21.15.50:0/897837275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca2c101d50 0x7fca2c19b270 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fca2000b5c0 tx=0x7fca200047b0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.673+0000 7fca30fe7700 1 -- 172.21.15.50:0/897837275 shutdown_connections 2024-06-06T03:27:51.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.673+0000 7fca30fe7700 1 --2- 172.21.15.50:0/897837275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca2c107400 0x7fca2c19f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.673+0000 7fca30fe7700 1 --2- 172.21.15.50:0/897837275 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fca140a2d70 0x7fca140a5230 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.673+0000 7fca30fe7700 1 --2- 172.21.15.50:0/897837275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca2c101390 0x7fca2c19ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.673+0000 7fca30fe7700 1 --2- 172.21.15.50:0/897837275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca2c101d50 0x7fca2c19b270 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:51.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.673+0000 7fca30fe7700 1 -- 172.21.15.50:0/897837275 >> 172.21.15.50:0/897837275 conn(0x7fca2c078340 msgr2=0x7fca2c06a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:51.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.673+0000 7fca30fe7700 1 -- 172.21.15.50:0/897837275 shutdown_connections 2024-06-06T03:27:51.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:51.673+0000 7fca30fe7700 1 -- 172.21.15.50:0/897837275 wait complete. 2024-06-06T03:27:53.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:52 smithi079 ceph-mon[35478]: pgmap v468: 129 pgs: 129 active+clean; 670 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-06T03:27:53.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:52 smithi122 ceph-mon[35759]: pgmap v468: 129 pgs: 129 active+clean; 670 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-06T03:27:53.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:52 smithi050 ceph-mon[32421]: pgmap v468: 129 pgs: 129 active+clean; 670 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-06T03:27:53.458 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-06T03:27:53.459 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-06-06T03:27:53.709 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:27:55.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:54 smithi079 ceph-mon[35478]: pgmap v469: 129 pgs: 129 active+clean; 670 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-06T03:27:55.128 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:54 smithi050 ceph-mon[32421]: pgmap v469: 129 pgs: 129 active+clean; 670 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-06T03:27:55.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:54 smithi122 ceph-mon[35759]: pgmap v469: 129 pgs: 129 active+clean; 670 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-06T03:27:55.351 INFO:tasks.workunit.client.0.smithi050.stderr:Updating files: 93% (11730/12568) Updating files: 94% (11814/12568) Updating files: 95% (11940/12568) Updating files: 96% (12066/12568) Updating files: 97% (12191/12568) Updating files: 98% (12317/12568) Updating files: 99% (12443/12568) Updating files: 100% (12568/12568) Updating files: 100% (12568/12568), done. 2024-06-06T03:27:55.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.688+0000 7f929013c700 1 -- 172.21.15.50:0/196140385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92881084f0 msgr2=0x7f92881088d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:55.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.688+0000 7f929013c700 1 --2- 172.21.15.50:0/196140385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92881084f0 0x7f92881088d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9284009990 tx=0x7f9284009ca0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.688+0000 7f929013c700 1 -- 172.21.15.50:0/196140385 shutdown_connections 2024-06-06T03:27:55.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.688+0000 7f929013c700 1 --2- 172.21.15.50:0/196140385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f928806b3c0 0x7f928810f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.688+0000 7f929013c700 1 --2- 172.21.15.50:0/196140385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92881084f0 0x7f92881088d0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.688+0000 7f929013c700 1 --2- 172.21.15.50:0/196140385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f928806aa00 0x7f928806ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.688+0000 7f929013c700 1 -- 172.21.15.50:0/196140385 >> 172.21.15.50:0/196140385 conn(0x7f9288078300 msgr2=0x7f9288078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:55.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.688+0000 7f929013c700 1 -- 172.21.15.50:0/196140385 shutdown_connections 2024-06-06T03:27:55.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.688+0000 7f929013c700 1 -- 172.21.15.50:0/196140385 wait complete. 2024-06-06T03:27:55.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.689+0000 7f929013c700 1 Processor -- start 2024-06-06T03:27:55.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.689+0000 7f929013c700 1 -- start start 2024-06-06T03:27:55.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.689+0000 7f929013c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f928806aa00 0x7f9288101450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:55.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.689+0000 7f929013c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f928806b3c0 0x7f9288101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:55.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.689+0000 7f929013c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92881084f0 0x7f9288101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:55.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.689+0000 7f929013c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9288112620 con 0x7f92881084f0 2024-06-06T03:27:55.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.689+0000 7f929013c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f92881124a0 con 0x7f928806aa00 2024-06-06T03:27:55.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.689+0000 7f929013c700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f92881127a0 con 0x7f928806b3c0 2024-06-06T03:27:55.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.689+0000 7f928e6d9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92881084f0 0x7f9288101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:55.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.689+0000 7f928e6d9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92881084f0 0x7f9288101ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52142/0 (socket says 172.21.15.50:52142) 2024-06-06T03:27:55.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.689+0000 7f928e6d9700 1 -- 172.21.15.50:0/482987021 learned_addr learned my addr 172.21.15.50:0/482987021 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:55.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.690+0000 7f928d6d7700 1 --2- 172.21.15.50:0/482987021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f928806b3c0 0x7f9288101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:55.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.690+0000 7f928ded8700 1 --2- 172.21.15.50:0/482987021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f928806aa00 0x7f9288101450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:55.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.690+0000 7f928e6d9700 1 -- 172.21.15.50:0/482987021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f928806b3c0 msgr2=0x7f9288101990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:55.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.690+0000 7f928e6d9700 1 --2- 172.21.15.50:0/482987021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f928806b3c0 0x7f9288101990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.690+0000 7f928e6d9700 1 -- 172.21.15.50:0/482987021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f928806aa00 msgr2=0x7f9288101450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:55.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.690+0000 7f928e6d9700 1 --2- 172.21.15.50:0/482987021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f928806aa00 0x7f9288101450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.690+0000 7f928e6d9700 1 -- 172.21.15.50:0/482987021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92881a7170 con 0x7f92881084f0 2024-06-06T03:27:55.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.690+0000 7f928e6d9700 1 --2- 172.21.15.50:0/482987021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92881084f0 0x7f9288101ed0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f9280007ee0 tx=0x7f928000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:55.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.690+0000 7f927effd700 1 -- 172.21.15.50:0/482987021 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9280004bb0 con 0x7f92881084f0 2024-06-06T03:27:55.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.690+0000 7f927effd700 1 -- 172.21.15.50:0/482987021 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9280004d50 con 0x7f92881084f0 2024-06-06T03:27:55.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.690+0000 7f929013c700 1 -- 172.21.15.50:0/482987021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92881a7460 con 0x7f92881084f0 2024-06-06T03:27:55.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.690+0000 7f927effd700 1 -- 172.21.15.50:0/482987021 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92800058e0 con 0x7f92881084f0 2024-06-06T03:27:55.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.690+0000 7f929013c700 1 -- 172.21.15.50:0/482987021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92881a79a0 con 0x7f92881084f0 2024-06-06T03:27:55.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.692+0000 7f927effd700 1 -- 172.21.15.50:0/482987021 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f928001a020 con 0x7f92881084f0 2024-06-06T03:27:55.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.693+0000 7f927effd700 1 --2- 172.21.15.50:0/482987021 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f92740a2c20 0x7f92740a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:55.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.693+0000 7f927effd700 1 -- 172.21.15.50:0/482987021 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f92800cea10 con 0x7f92881084f0 2024-06-06T03:27:55.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.693+0000 7f928ded8700 1 --2- 172.21.15.50:0/482987021 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f92740a2c20 0x7f92740a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:55.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.694+0000 7f928ded8700 1 --2- 172.21.15.50:0/482987021 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f92740a2c20 0x7f92740a50e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f928400b2e0 tx=0x7f9284005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:55.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.694+0000 7f929a9bfb80 1 Processor -- start 2024-06-06T03:27:55.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.694+0000 7f929a9bfb80 1 -- start start 2024-06-06T03:27:55.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.695+0000 7f929a9bfb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559b78c70fe0 0x559b78c713c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:55.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.695+0000 7f929a9bfb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b78c71900 0x559b78c6b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:55.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.695+0000 7f929a9bfb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b78c6b820 0x559b78c6bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:55.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.695+0000 7f929a9bfb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559b78b5dfe0 con 0x559b78c71900 2024-06-06T03:27:55.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.695+0000 7f929a9bfb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559b78bbc8d0 con 0x559b78c6b820 2024-06-06T03:27:55.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.695+0000 7f929a9bfb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559b78b244e0 con 0x559b78c70fe0 2024-06-06T03:27:55.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.695+0000 7f928d6d7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b78c71900 0x559b78c6b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:55.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.695+0000 7f928d6d7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b78c71900 0x559b78c6b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52154/0 (socket says 172.21.15.50:52154) 2024-06-06T03:27:55.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.695+0000 7f928d6d7700 1 -- 172.21.15.50:0/60982929 learned_addr learned my addr 172.21.15.50:0/60982929 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:55.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.695+0000 7f928e6d9700 1 --2- 172.21.15.50:0/60982929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b78c6b820 0x559b78c6bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:55.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.695+0000 7f928ded8700 1 --2- 172.21.15.50:0/60982929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559b78c70fe0 0x559b78c713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:55.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.695+0000 7f928e6d9700 1 -- 172.21.15.50:0/60982929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559b78c70fe0 msgr2=0x559b78c713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:55.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.695+0000 7f928e6d9700 1 --2- 172.21.15.50:0/60982929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559b78c70fe0 0x559b78c713c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.695+0000 7f928e6d9700 1 -- 172.21.15.50:0/60982929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b78c71900 msgr2=0x559b78c6b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:55.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.695+0000 7f928e6d9700 1 --2- 172.21.15.50:0/60982929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b78c71900 0x559b78c6b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.695+0000 7f928e6d9700 1 -- 172.21.15.50:0/60982929 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b78b0b950 con 0x559b78c6b820 2024-06-06T03:27:55.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.695+0000 7f928d6d7700 1 --2- 172.21.15.50:0/60982929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b78c71900 0x559b78c6b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:27:55.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.695+0000 7f928e6d9700 1 --2- 172.21.15.50:0/60982929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b78c6b820 0x559b78c6bc40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f92800cc190 tx=0x7f928009aa30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cee55f07adf1b361 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:55.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.696+0000 7f9273fff700 1 -- 172.21.15.50:0/60982929 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928009b5f0 con 0x559b78c6b820 2024-06-06T03:27:55.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.696+0000 7f9273fff700 1 -- 172.21.15.50:0/60982929 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9280005a80 con 0x559b78c6b820 2024-06-06T03:27:55.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.696+0000 7f9273fff700 1 -- 172.21.15.50:0/60982929 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928009b3b0 con 0x559b78c6b820 2024-06-06T03:27:55.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.696+0000 7f929a9bfb80 1 -- 172.21.15.50:0/60982929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b78c6b820 msgr2=0x559b78c6bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:55.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.696+0000 7f929a9bfb80 1 --2- 172.21.15.50:0/60982929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b78c6b820 0x559b78c6bc40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f92800cc190 tx=0x7f928009aa30 comp rx=0 tx=0).stop 2024-06-06T03:27:55.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.697+0000 7f929a9bfb80 1 -- 172.21.15.50:0/60982929 shutdown_connections 2024-06-06T03:27:55.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.697+0000 7f929a9bfb80 1 --2- 172.21.15.50:0/60982929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b78c6b820 0x559b78c6bc40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.697+0000 7f929a9bfb80 1 --2- 172.21.15.50:0/60982929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559b78c70fe0 0x559b78c713c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.697+0000 7f929a9bfb80 1 --2- 172.21.15.50:0/60982929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b78c71900 0x559b78c6b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.697+0000 7f929a9bfb80 1 -- 172.21.15.50:0/60982929 >> 172.21.15.50:0/60982929 conn(0x559b78b98100 msgr2=0x559b78c662a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:55.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.697+0000 7f929a9bfb80 1 -- 172.21.15.50:0/60982929 shutdown_connections 2024-06-06T03:27:55.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.697+0000 7f929a9bfb80 1 -- 172.21.15.50:0/60982929 wait complete. 2024-06-06T03:27:55.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.697+0000 7f929a9bfb80 1 -- start start 2024-06-06T03:27:55.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.697+0000 7f929a9bfb80 1 Processor -- start 2024-06-06T03:27:55.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.698+0000 7f929a9bfb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b78c6b820 0x559b78c776f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:55.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.698+0000 7f929a9bfb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b78c70fe0 0x559b78c749f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:55.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.698+0000 7f929a9bfb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559b78c71900 0x559b78c74f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:55.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.698+0000 7f929a9bfb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559b78b5d040 con 0x559b78c70fe0 2024-06-06T03:27:55.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.698+0000 7f929a9bfb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559b78bb8890 con 0x559b78c6b820 2024-06-06T03:27:55.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.698+0000 7f929a9bfb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559b78c782e0 con 0x559b78c71900 2024-06-06T03:27:55.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.698+0000 7f929a9bfb80 10 client.0 _ll_register_callbacks cb 0x559b78b52630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:55.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.698+0000 7f928d6d7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b78c70fe0 0x559b78c749f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:55.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.698+0000 7f928d6d7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b78c70fe0 0x559b78c749f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52166/0 (socket says 172.21.15.50:52166) 2024-06-06T03:27:55.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.698+0000 7f928d6d7700 1 -- 172.21.15.50:0/171509271 learned_addr learned my addr 172.21.15.50:0/171509271 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:55.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.698+0000 7f928e6d9700 1 --2- 172.21.15.50:0/171509271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559b78c71900 0x559b78c74f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:55.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.698+0000 7f928ded8700 1 --2- 172.21.15.50:0/171509271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b78c6b820 0x559b78c776f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:55.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.699+0000 7f928d6d7700 1 -- 172.21.15.50:0/171509271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559b78c71900 msgr2=0x559b78c74f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:55.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.699+0000 7f928d6d7700 1 --2- 172.21.15.50:0/171509271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559b78c71900 0x559b78c74f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.699+0000 7f928d6d7700 1 -- 172.21.15.50:0/171509271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b78c6b820 msgr2=0x559b78c776f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:55.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.699+0000 7f928d6d7700 1 --2- 172.21.15.50:0/171509271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b78c6b820 0x559b78c776f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.699+0000 7f928d6d7700 1 -- 172.21.15.50:0/171509271 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b78b827d0 con 0x559b78c70fe0 2024-06-06T03:27:55.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.699+0000 7f928e6d9700 1 --2- 172.21.15.50:0/171509271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559b78c71900 0x559b78c74f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:27:55.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.699+0000 7f928ded8700 1 --2- 172.21.15.50:0/171509271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b78c6b820 0x559b78c776f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:27:55.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.699+0000 7f928d6d7700 1 --2- 172.21.15.50:0/171509271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b78c70fe0 0x559b78c749f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f92780128a0 tx=0x7f9278012c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b684b5492b23cc28 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:55.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.699+0000 7f92717fa700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:27:55.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.699+0000 7f92717fa700 1 -- 172.21.15.50:0/171509271 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9278004050 con 0x559b78c70fe0 2024-06-06T03:27:55.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.699+0000 7f92717fa700 1 -- 172.21.15.50:0/171509271 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f92780041f0 con 0x559b78c70fe0 2024-06-06T03:27:55.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.699+0000 7f929a9bfb80 1 -- 172.21.15.50:0/171509271 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9280005a80 con 0x559b78c70fe0 2024-06-06T03:27:55.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.699+0000 7f92717fa700 1 -- 172.21.15.50:0/171509271 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9278025050 con 0x559b78c70fe0 2024-06-06T03:27:55.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.699+0000 7f929a9bfb80 10 client.15609 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:55.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.699+0000 7f929a9bfb80 1 -- 172.21.15.50:0/171509271 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559b78c82b10 con 0x559b78c70fe0 2024-06-06T03:27:55.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.700+0000 7f92717fa700 1 -- 172.21.15.50:0/171509271 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9280005a80 con 0x559b78c70fe0 2024-06-06T03:27:55.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.700+0000 7f92717fa700 1 -- 172.21.15.50:0/171509271 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f92780038e0 con 0x559b78c70fe0 2024-06-06T03:27:55.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.700+0000 7f929a9bfb80 10 client.15609 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:55.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.700+0000 7f929a9bfb80 10 client.15609 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:27:55.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.700+0000 7f929a9bfb80 20 client.15609 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:55.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.700+0000 7f929a9bfb80 1 --2- 172.21.15.50:0/171509271 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x559b78c85150 0x559b78c87540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:55.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.700+0000 7f929a9bfb80 4 client.15609 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:27:55.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.700+0000 7f929a9bfb80 1 -- 172.21.15.50:0/171509271 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b78bc9dd0 con 0x559b78c85150 2024-06-06T03:27:55.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.700+0000 7f928ded8700 1 --2- 172.21.15.50:0/171509271 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x559b78c85150 0x559b78c87540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:55.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.701+0000 7f92717fa700 10 client.15609 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:55.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.701+0000 7f928ded8700 1 --2- 172.21.15.50:0/171509271 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x559b78c85150 0x559b78c87540 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=289b1dea1d261097 server_cookie=559b3edab00b9ab7 in_seq=0 out_seq=0 2024-06-06T03:27:55.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.702+0000 7f92717fa700 1 -- 172.21.15.50:0/171509271 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x559b78bc9dd0 con 0x559b78c85150 2024-06-06T03:27:55.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.702+0000 7f92717fa700 10 client.15609 handle_command_reply: tid=0 2024-06-06T03:27:55.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.702+0000 7f929a9bfb80 1 client.15609 shutdown 2024-06-06T03:27:55.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.702+0000 7f929a9bfb80 1 -- 172.21.15.50:0/171509271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b78c70fe0 msgr2=0x559b78c749f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:55.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.702+0000 7f929a9bfb80 1 --2- 172.21.15.50:0/171509271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b78c70fe0 0x559b78c749f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f92780128a0 tx=0x7f9278012c60 comp rx=0 tx=0).stop 2024-06-06T03:27:55.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.702+0000 7f929a9bfb80 1 -- 172.21.15.50:0/171509271 shutdown_connections 2024-06-06T03:27:55.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.702+0000 7f929a9bfb80 1 --2- 172.21.15.50:0/171509271 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x559b78c85150 0x559b78c87540 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.702+0000 7f929a9bfb80 1 --2- 172.21.15.50:0/171509271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559b78c71900 0x559b78c74f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.702+0000 7f929a9bfb80 1 --2- 172.21.15.50:0/171509271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b78c6b820 0x559b78c776f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.702+0000 7f92717fa700 0 client.15609 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:55.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.702+0000 7f929a9bfb80 1 --2- 172.21.15.50:0/171509271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b78c70fe0 0x559b78c749f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.702+0000 7f929a9bfb80 1 -- 172.21.15.50:0/171509271 >> 172.21.15.50:0/171509271 conn(0x559b78b98100 msgr2=0x559b78c65780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:55.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.702+0000 7f929a9bfb80 1 -- 172.21.15.50:0/171509271 shutdown_connections 2024-06-06T03:27:55.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.702+0000 7f929a9bfb80 1 -- 172.21.15.50:0/171509271 wait complete. 2024-06-06T03:27:55.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.702+0000 7f929a9bfb80 20 client.15609 trim_cache size 0 max 16384 2024-06-06T03:27:55.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.737+0000 7f929a9bfb80 1 Processor -- start 2024-06-06T03:27:55.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.737+0000 7f929a9bfb80 1 -- start start 2024-06-06T03:27:55.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.737+0000 7f929a9bfb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b78c6b820 0x559b78c81400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:55.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.737+0000 7f929a9bfb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559b78c70fe0 0x559b78c72570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:55.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.737+0000 7f929a9bfb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b78c71900 0x559b78c76930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:55.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.737+0000 7f929a9bfb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f92881b2d20 con 0x559b78c6b820 2024-06-06T03:27:55.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.737+0000 7f929a9bfb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f92881b05b0 con 0x559b78c71900 2024-06-06T03:27:55.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.737+0000 7f929a9bfb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f92881ae400 con 0x559b78c70fe0 2024-06-06T03:27:55.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.737+0000 7f928ded8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b78c6b820 0x559b78c81400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:55.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.737+0000 7f928ded8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b78c6b820 0x559b78c81400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52180/0 (socket says 172.21.15.50:52180) 2024-06-06T03:27:55.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.738+0000 7f928ded8700 1 -- 172.21.15.50:0/2470725213 learned_addr learned my addr 172.21.15.50:0/2470725213 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:55.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.738+0000 7f928d6d7700 1 --2- 172.21.15.50:0/2470725213 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559b78c70fe0 0x559b78c72570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:55.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.738+0000 7f928e6d9700 1 --2- 172.21.15.50:0/2470725213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b78c71900 0x559b78c76930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:55.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.738+0000 7f928ded8700 1 -- 172.21.15.50:0/2470725213 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559b78c70fe0 msgr2=0x559b78c72570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:55.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.738+0000 7f928ded8700 1 --2- 172.21.15.50:0/2470725213 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559b78c70fe0 0x559b78c72570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.738+0000 7f928ded8700 1 -- 172.21.15.50:0/2470725213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b78c71900 msgr2=0x559b78c76930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:55.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.738+0000 7f928ded8700 1 --2- 172.21.15.50:0/2470725213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b78c71900 0x559b78c76930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.738+0000 7f928ded8700 1 -- 172.21.15.50:0/2470725213 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b78c72f60 con 0x559b78c6b820 2024-06-06T03:27:55.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.738+0000 7f928e6d9700 1 --2- 172.21.15.50:0/2470725213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b78c71900 0x559b78c76930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:27:55.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.738+0000 7f928ded8700 1 --2- 172.21.15.50:0/2470725213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b78c6b820 0x559b78c81400 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9284009990 tx=0x7f9284022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cebcd2ec6287626a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:55.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.738+0000 7f92737fe700 1 -- 172.21.15.50:0/2470725213 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9284003680 con 0x559b78c6b820 2024-06-06T03:27:55.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.738+0000 7f92737fe700 1 -- 172.21.15.50:0/2470725213 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9284003cd0 con 0x559b78c6b820 2024-06-06T03:27:55.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.738+0000 7f92737fe700 1 -- 172.21.15.50:0/2470725213 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9284032bb0 con 0x559b78c6b820 2024-06-06T03:27:55.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.739+0000 7f929a9bfb80 1 -- 172.21.15.50:0/2470725213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b78c6b820 msgr2=0x559b78c81400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:55.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.739+0000 7f929a9bfb80 1 --2- 172.21.15.50:0/2470725213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b78c6b820 0x559b78c81400 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9284009990 tx=0x7f9284022000 comp rx=0 tx=0).stop 2024-06-06T03:27:55.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.739+0000 7f929a9bfb80 1 -- 172.21.15.50:0/2470725213 shutdown_connections 2024-06-06T03:27:55.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.739+0000 7f929a9bfb80 1 --2- 172.21.15.50:0/2470725213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b78c71900 0x559b78c76930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.739+0000 7f929a9bfb80 1 --2- 172.21.15.50:0/2470725213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b78c6b820 0x559b78c81400 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.739+0000 7f929a9bfb80 1 --2- 172.21.15.50:0/2470725213 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559b78c70fe0 0x559b78c72570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.739+0000 7f929a9bfb80 1 -- 172.21.15.50:0/2470725213 >> 172.21.15.50:0/2470725213 conn(0x559b78b98100 msgr2=0x559b78c76220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:55.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.739+0000 7f929a9bfb80 1 -- 172.21.15.50:0/2470725213 shutdown_connections 2024-06-06T03:27:55.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.739+0000 7f929a9bfb80 1 -- 172.21.15.50:0/2470725213 wait complete. 2024-06-06T03:27:55.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.740+0000 7f929a9bfb80 1 -- start start 2024-06-06T03:27:55.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.740+0000 7f929a9bfb80 1 Processor -- start 2024-06-06T03:27:55.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.740+0000 7f929a9bfb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b78c6b820 0x559b78c7dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:55.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.740+0000 7f929a9bfb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b78c70fe0 0x559b78c7a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:55.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.740+0000 7f929a9bfb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559b78c71900 0x559b78c7ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:55.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.740+0000 7f929a9bfb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f92881aea70 con 0x559b78c70fe0 2024-06-06T03:27:55.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.740+0000 7f929a9bfb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f92881afee0 con 0x559b78c6b820 2024-06-06T03:27:55.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.740+0000 7f929a9bfb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f92881af140 con 0x559b78c71900 2024-06-06T03:27:55.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.740+0000 7f929a9bfb80 10 client.0 _ll_register_callbacks cb 0x559b78c73e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:55.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.740+0000 7f928d6d7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b78c70fe0 0x559b78c7a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:55.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.740+0000 7f928d6d7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b78c70fe0 0x559b78c7a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52192/0 (socket says 172.21.15.50:52192) 2024-06-06T03:27:55.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.740+0000 7f928d6d7700 1 -- 172.21.15.50:0/1873605333 learned_addr learned my addr 172.21.15.50:0/1873605333 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:55.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.741+0000 7f928ded8700 1 --2- 172.21.15.50:0/1873605333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b78c6b820 0x559b78c7dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:55.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.741+0000 7f928e6d9700 1 --2- 172.21.15.50:0/1873605333 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559b78c71900 0x559b78c7ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:55.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.741+0000 7f928d6d7700 1 -- 172.21.15.50:0/1873605333 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559b78c71900 msgr2=0x559b78c7ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:55.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.741+0000 7f928d6d7700 1 --2- 172.21.15.50:0/1873605333 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559b78c71900 0x559b78c7ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.741+0000 7f928d6d7700 1 -- 172.21.15.50:0/1873605333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b78c6b820 msgr2=0x559b78c7dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:55.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.741+0000 7f928d6d7700 1 --2- 172.21.15.50:0/1873605333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b78c6b820 0x559b78c7dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.741+0000 7f928d6d7700 1 -- 172.21.15.50:0/1873605333 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b78cefdc0 con 0x559b78c70fe0 2024-06-06T03:27:55.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.741+0000 7f928e6d9700 1 --2- 172.21.15.50:0/1873605333 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559b78c71900 0x559b78c7ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:27:55.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.741+0000 7f928d6d7700 1 --2- 172.21.15.50:0/1873605333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b78c70fe0 0x559b78c7a540 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x559b78c75fc0 tx=0x7f9278003930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a99afced565225e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:55.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.741+0000 7f92717fa700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:27:55.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.741+0000 7f92717fa700 1 -- 172.21.15.50:0/1873605333 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9278012320 con 0x559b78c70fe0 2024-06-06T03:27:55.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.741+0000 7f929a9bfb80 1 -- 172.21.15.50:0/1873605333 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9284003cd0 con 0x559b78c70fe0 2024-06-06T03:27:55.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.741+0000 7f92717fa700 1 -- 172.21.15.50:0/1873605333 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f9278018040 con 0x559b78c70fe0 2024-06-06T03:27:55.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.741+0000 7f92717fa700 1 -- 172.21.15.50:0/1873605333 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f927803b050 con 0x559b78c70fe0 2024-06-06T03:27:55.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.742+0000 7f929a9bfb80 10 client.15615 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:55.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.742+0000 7f929a9bfb80 1 -- 172.21.15.50:0/1873605333 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559b78cf0f40 con 0x559b78c70fe0 2024-06-06T03:27:55.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.742+0000 7f92717fa700 1 -- 172.21.15.50:0/1873605333 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9284003cd0 con 0x559b78c70fe0 2024-06-06T03:27:55.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.742+0000 7f92717fa700 1 -- 172.21.15.50:0/1873605333 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f92780354d0 con 0x559b78c70fe0 2024-06-06T03:27:55.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.742+0000 7f929a9bfb80 10 client.15615 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:55.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.742+0000 7f929a9bfb80 10 client.15615 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:27:55.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.742+0000 7f929a9bfb80 20 client.15615 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:55.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.742+0000 7f929a9bfb80 1 --2- 172.21.15.50:0/1873605333 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x559b78cf1650 0x559b78cf3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:55.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.742+0000 7f929a9bfb80 4 client.15615 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-06T03:27:55.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.742+0000 7f929a9bfb80 1 -- 172.21.15.50:0/1873605333 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559b78c754d0 con 0x559b78cf1650 2024-06-06T03:27:55.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.742+0000 7f928ded8700 1 --2- 172.21.15.50:0/1873605333 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x559b78cf1650 0x559b78cf3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:55.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.743+0000 7f92717fa700 10 client.15615 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:55.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.743+0000 7f928ded8700 1 --2- 172.21.15.50:0/1873605333 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x559b78cf1650 0x559b78cf3a70 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d813d4011b3b396b server_cookie=ef7f0c01bde204bb in_seq=0 out_seq=0 2024-06-06T03:27:55.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.744+0000 7f92717fa700 1 -- 172.21.15.50:0/1873605333 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559b78c754d0 con 0x559b78cf1650 2024-06-06T03:27:55.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.744+0000 7f92717fa700 10 client.15615 handle_command_reply: tid=0 2024-06-06T03:27:55.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.744+0000 7f929a9bfb80 1 client.15615 shutdown 2024-06-06T03:27:55.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.744+0000 7f929a9bfb80 1 -- 172.21.15.50:0/1873605333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b78c70fe0 msgr2=0x559b78c7a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:55.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.744+0000 7f929a9bfb80 1 --2- 172.21.15.50:0/1873605333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b78c70fe0 0x559b78c7a540 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x559b78c75fc0 tx=0x7f9278003930 comp rx=0 tx=0).stop 2024-06-06T03:27:55.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.744+0000 7f929a9bfb80 1 -- 172.21.15.50:0/1873605333 shutdown_connections 2024-06-06T03:27:55.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.744+0000 7f929a9bfb80 1 --2- 172.21.15.50:0/1873605333 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x559b78cf1650 0x559b78cf3a70 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.744+0000 7f929a9bfb80 1 --2- 172.21.15.50:0/1873605333 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559b78c71900 0x559b78c7ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.744+0000 7f929a9bfb80 1 --2- 172.21.15.50:0/1873605333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b78c6b820 0x559b78c7dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.744+0000 7f92717fa700 0 client.15615 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:55.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.744+0000 7f929a9bfb80 1 --2- 172.21.15.50:0/1873605333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b78c70fe0 0x559b78c7a540 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.744+0000 7f929a9bfb80 1 -- 172.21.15.50:0/1873605333 >> 172.21.15.50:0/1873605333 conn(0x559b78b98100 msgr2=0x559b78c723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:55.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.745+0000 7f929a9bfb80 1 -- 172.21.15.50:0/1873605333 shutdown_connections 2024-06-06T03:27:55.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.745+0000 7f929a9bfb80 1 -- 172.21.15.50:0/1873605333 wait complete. 2024-06-06T03:27:55.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.745+0000 7f929a9bfb80 20 client.15615 trim_cache size 0 max 16384 2024-06-06T03:27:55.747 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:27:55.747 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-06-06T03:27:55.747 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "ffb2243a-d20e-43bf-8471-5ceafa52bd4e", 2024-06-06T03:27:55.747 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-06-06T03:27:55.747 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:27:55.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.745+0000 7f929013c700 1 -- 172.21.15.50:0/482987021 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f92740a2c20 msgr2=0x7f92740a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:55.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.745+0000 7f929013c700 1 --2- 172.21.15.50:0/482987021 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f92740a2c20 0x7f92740a50e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f928400b2e0 tx=0x7f9284005960 comp rx=0 tx=0).stop 2024-06-06T03:27:55.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.745+0000 7f929013c700 1 -- 172.21.15.50:0/482987021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92881084f0 msgr2=0x7f9288101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:55.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.745+0000 7f929013c700 1 --2- 172.21.15.50:0/482987021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92881084f0 0x7f9288101ed0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f9280007ee0 tx=0x7f928000d3b0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.746+0000 7f929013c700 1 -- 172.21.15.50:0/482987021 shutdown_connections 2024-06-06T03:27:55.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.746+0000 7f929013c700 1 --2- 172.21.15.50:0/482987021 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f92740a2c20 0x7f92740a50e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.746+0000 7f929013c700 1 --2- 172.21.15.50:0/482987021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92881084f0 0x7f9288101ed0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.746+0000 7f929013c700 1 --2- 172.21.15.50:0/482987021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f928806aa00 0x7f9288101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.746+0000 7f929013c700 1 --2- 172.21.15.50:0/482987021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f928806b3c0 0x7f9288101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:55.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.746+0000 7f929013c700 1 -- 172.21.15.50:0/482987021 >> 172.21.15.50:0/482987021 conn(0x7f9288078300 msgr2=0x7f92881001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:55.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.746+0000 7f929013c700 1 -- 172.21.15.50:0/482987021 shutdown_connections 2024-06-06T03:27:55.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:55.746+0000 7f929013c700 1 -- 172.21.15.50:0/482987021 wait complete. 2024-06-06T03:27:55.911 INFO:tasks.workunit.client.0.smithi050.stderr:Note: switching to '3d746ca5346f34eef7e826a1eb71e59e02b682ae'. 2024-06-06T03:27:55.911 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-06-06T03:27:55.911 INFO:tasks.workunit.client.0.smithi050.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-06-06T03:27:55.911 INFO:tasks.workunit.client.0.smithi050.stderr:changes and commit them, and you can discard any commits you make in this 2024-06-06T03:27:55.911 INFO:tasks.workunit.client.0.smithi050.stderr:state without impacting any branches by switching back to a branch. 2024-06-06T03:27:55.911 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-06-06T03:27:55.911 INFO:tasks.workunit.client.0.smithi050.stderr:If you want to create a new branch to retain commits you create, you may 2024-06-06T03:27:55.911 INFO:tasks.workunit.client.0.smithi050.stderr:do so (now or later) by using -c with the switch command. Example: 2024-06-06T03:27:55.911 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-06-06T03:27:55.911 INFO:tasks.workunit.client.0.smithi050.stderr: git switch -c 2024-06-06T03:27:55.911 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-06-06T03:27:55.911 INFO:tasks.workunit.client.0.smithi050.stderr:Or undo this operation with: 2024-06-06T03:27:55.912 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-06-06T03:27:55.912 INFO:tasks.workunit.client.0.smithi050.stderr: git switch - 2024-06-06T03:27:55.912 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-06-06T03:27:55.912 INFO:tasks.workunit.client.0.smithi050.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-06-06T03:27:55.912 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-06-06T03:27:55.912 INFO:tasks.workunit.client.0.smithi050.stderr:HEAD is now at 3d746ca5346 Merge pull request #57870 from zdover23/wip-doc-2024-06-05-backport-57867-to-squid 2024-06-06T03:27:55.916 DEBUG:teuthology.orchestra.run.smithi050:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-06-06T03:27:55.973 INFO:tasks.workunit.client.0.smithi050.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-06-06T03:27:55.975 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-06-06T03:27:55.975 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-06-06T03:27:56.388 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.387+0000 7fdfec729640 1 -- 172.21.15.50:0/2973139294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfe4103670 msgr2=0x7fdfe4109f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:56.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.387+0000 7fdfec729640 1 --2- 172.21.15.50:0/2973139294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfe4103670 0x7fdfe4109f00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc009cd0 tx=0x7fdfdc02a8e0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.387+0000 7fdfec729640 1 -- 172.21.15.50:0/2973139294 shutdown_connections 2024-06-06T03:27:56.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.387+0000 7fdfec729640 1 --2- 172.21.15.50:0/2973139294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfe4103670 0x7fdfe4109f00 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.387+0000 7fdfec729640 1 --2- 172.21.15.50:0/2973139294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdfe4102cb0 0x7fdfe4103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.387+0000 7fdfec729640 1 --2- 172.21.15.50:0/2973139294 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfe40ffce0 0x7fdfe4100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.387+0000 7fdfec729640 1 -- 172.21.15.50:0/2973139294 >> 172.21.15.50:0/2973139294 conn(0x7fdfe40fb610 msgr2=0x7fdfe40fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:56.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.387+0000 7fdfec729640 1 -- 172.21.15.50:0/2973139294 shutdown_connections 2024-06-06T03:27:56.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.387+0000 7fdfec729640 1 -- 172.21.15.50:0/2973139294 wait complete. 2024-06-06T03:27:56.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.388+0000 7fdfec729640 1 Processor -- start 2024-06-06T03:27:56.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.388+0000 7fdfec729640 1 -- start start 2024-06-06T03:27:56.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.388+0000 7fdfec729640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfe40ffce0 0x7fdfe4197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:56.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.388+0000 7fdfec729640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfe4102cb0 0x7fdfe4197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:56.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.388+0000 7fdfec729640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdfe4103670 0x7fdfe419f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.388+0000 7fdfec729640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe410d590 con 0x7fdfe4102cb0 2024-06-06T03:27:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.388+0000 7fdfec729640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe410d410 con 0x7fdfe4103670 2024-06-06T03:27:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.388+0000 7fdfec729640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe410d710 con 0x7fdfe40ffce0 2024-06-06T03:27:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.388+0000 7fdfe9cc4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfe4102cb0 0x7fdfe4197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.388+0000 7fdfe9cc4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfe4102cb0 0x7fdfe4197ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52208/0 (socket says 172.21.15.50:52208) 2024-06-06T03:27:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.388+0000 7fdfe9cc4640 1 -- 172.21.15.50:0/276469289 learned_addr learned my addr 172.21.15.50:0/276469289 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.388+0000 7fdfea4c5640 1 --2- 172.21.15.50:0/276469289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfe40ffce0 0x7fdfe4197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.388+0000 7fdfe9cc4640 1 -- 172.21.15.50:0/276469289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfe40ffce0 msgr2=0x7fdfe4197ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.388+0000 7fdfeacc6640 1 --2- 172.21.15.50:0/276469289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdfe4103670 0x7fdfe419f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.388+0000 7fdfe9cc4640 1 --2- 172.21.15.50:0/276469289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfe40ffce0 0x7fdfe4197ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.388+0000 7fdfe9cc4640 1 -- 172.21.15.50:0/276469289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdfe4103670 msgr2=0x7fdfe419f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.388+0000 7fdfe9cc4640 1 --2- 172.21.15.50:0/276469289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdfe4103670 0x7fdfe419f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.389+0000 7fdfe9cc4640 1 -- 172.21.15.50:0/276469289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe419f6d0 con 0x7fdfe4102cb0 2024-06-06T03:27:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.389+0000 7fdfea4c5640 1 --2- 172.21.15.50:0/276469289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfe40ffce0 0x7fdfe4197ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:27:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.389+0000 7fdfe9cc4640 1 --2- 172.21.15.50:0/276469289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfe4102cb0 0x7fdfe4197ff0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fdfd400c890 tx=0x7fdfd400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.389+0000 7fdfdb7fe640 1 -- 172.21.15.50:0/276469289 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4004220 con 0x7fdfe4102cb0 2024-06-06T03:27:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.389+0000 7fdfdb7fe640 1 -- 172.21.15.50:0/276469289 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdfd40043c0 con 0x7fdfe4102cb0 2024-06-06T03:27:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.389+0000 7fdfec729640 1 -- 172.21.15.50:0/276469289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfe419f9c0 con 0x7fdfe4102cb0 2024-06-06T03:27:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.389+0000 7fdfdb7fe640 1 -- 172.21.15.50:0/276469289 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4004a00 con 0x7fdfe4102cb0 2024-06-06T03:27:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.389+0000 7fdfec729640 1 -- 172.21.15.50:0/276469289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfe419ff60 con 0x7fdfe4102cb0 2024-06-06T03:27:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.391+0000 7fdfdb7fe640 1 -- 172.21.15.50:0/276469289 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fdfd4004ba0 con 0x7fdfe4102cb0 2024-06-06T03:27:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.391+0000 7fdfef43c740 1 Processor -- start 2024-06-06T03:27:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.392+0000 7fdfef43c740 1 -- start start 2024-06-06T03:27:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.392+0000 7fdfef43c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc84e92420 0x55bc84e92840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.392+0000 7fdfef43c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc84e92e10 0x55bc84e97910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.392+0000 7fdfef43c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bc84e97f80 0x55bc84e9a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.392+0000 7fdfef43c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55bc84df14f0 con 0x55bc84e92420 2024-06-06T03:27:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.392+0000 7fdfef43c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bc84d8f870 con 0x55bc84e97f80 2024-06-06T03:27:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.392+0000 7fdfef43c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bc84ded4b0 con 0x55bc84e92e10 2024-06-06T03:27:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.392+0000 7fdfeacc6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc84e92420 0x55bc84e92840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.392+0000 7fdfeacc6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc84e92420 0x55bc84e92840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52216/0 (socket says 172.21.15.50:52216) 2024-06-06T03:27:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.392+0000 7fdfeacc6640 1 -- 172.21.15.50:0/2377185903 learned_addr learned my addr 172.21.15.50:0/2377185903 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.392+0000 7fdfea4c5640 1 --2- 172.21.15.50:0/2377185903 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc84e92e10 0x55bc84e97910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.392+0000 7fdfe9cc4640 1 --2- 172.21.15.50:0/2377185903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bc84e97f80 0x55bc84e9a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.392+0000 7fdfdb7fe640 1 --2- 172.21.15.50:0/276469289 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fdfd00a2cb0 0x7fdfd00a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.392+0000 7fdfeacc6640 1 -- 172.21.15.50:0/2377185903 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc84e92e10 msgr2=0x55bc84e97910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.392+0000 7fdfeacc6640 1 --2- 172.21.15.50:0/2377185903 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc84e92e10 0x55bc84e97910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.393+0000 7fdfeacc6640 1 -- 172.21.15.50:0/2377185903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bc84e97f80 msgr2=0x55bc84e9a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:56.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.393+0000 7fdfeacc6640 1 --2- 172.21.15.50:0/2377185903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bc84e97f80 0x55bc84e9a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.393+0000 7fdfeacc6640 1 -- 172.21.15.50:0/2377185903 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc84dab9b0 con 0x55bc84e92420 2024-06-06T03:27:56.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.393+0000 7fdfdb7fe640 1 -- 172.21.15.50:0/276469289 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fdfd40cf0b0 con 0x7fdfe4102cb0 2024-06-06T03:27:56.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.393+0000 7fdfeacc6640 1 --2- 172.21.15.50:0/276469289 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fdfd00a2cb0 0x7fdfd00a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:56.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.393+0000 7fdfeacc6640 1 --2- 172.21.15.50:0/2377185903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc84e92420 0x55bc84e92840 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc009df0 tx=0x7fdfdc0315b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c1cd2c0802e1db1 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:56.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.393+0000 7fdfd8ff9640 1 -- 172.21.15.50:0/2377185903 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc04d070 con 0x55bc84e92420 2024-06-06T03:27:56.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.393+0000 7fdfd8ff9640 1 -- 172.21.15.50:0/2377185903 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdfdc043070 con 0x55bc84e92420 2024-06-06T03:27:56.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.393+0000 7fdfd8ff9640 1 -- 172.21.15.50:0/2377185903 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc030ea0 con 0x55bc84e92420 2024-06-06T03:27:56.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.393+0000 7fdfeacc6640 1 --2- 172.21.15.50:0/276469289 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fdfd00a2cb0 0x7fdfd00a5170 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc04a000 tx=0x7fdfdc04b000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:56.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.394+0000 7fdfef43c740 1 -- 172.21.15.50:0/2377185903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc84e92420 msgr2=0x55bc84e92840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:56.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.394+0000 7fdfef43c740 1 --2- 172.21.15.50:0/2377185903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc84e92420 0x55bc84e92840 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc009df0 tx=0x7fdfdc0315b0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.394+0000 7fdfef43c740 1 -- 172.21.15.50:0/2377185903 shutdown_connections 2024-06-06T03:27:56.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.394+0000 7fdfef43c740 1 --2- 172.21.15.50:0/2377185903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bc84e97f80 0x55bc84e9a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.394+0000 7fdfef43c740 1 --2- 172.21.15.50:0/2377185903 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc84e92e10 0x55bc84e97910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.394+0000 7fdfef43c740 1 --2- 172.21.15.50:0/2377185903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc84e92420 0x55bc84e92840 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.394+0000 7fdfef43c740 1 -- 172.21.15.50:0/2377185903 >> 172.21.15.50:0/2377185903 conn(0x55bc84e89680 msgr2=0x55bc84e89a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:56.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.394+0000 7fdfef43c740 1 -- 172.21.15.50:0/2377185903 shutdown_connections 2024-06-06T03:27:56.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.394+0000 7fdfef43c740 1 -- 172.21.15.50:0/2377185903 wait complete. 2024-06-06T03:27:56.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.394+0000 7fdfef43c740 1 -- start start 2024-06-06T03:27:56.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.394+0000 7fdfef43c740 1 Processor -- start 2024-06-06T03:27:56.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.394+0000 7fdfef43c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc84e92420 0x55bc84e9c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:56.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.394+0000 7fdfef43c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc84e92e10 0x55bc84e9cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:56.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.395+0000 7fdfef43c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bc84e97f80 0x55bc84ea3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:56.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.395+0000 7fdfef43c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55bc84e9af30 con 0x55bc84e92e10 2024-06-06T03:27:56.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.395+0000 7fdfef43c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bc84d7aae0 con 0x55bc84e97f80 2024-06-06T03:27:56.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.395+0000 7fdfef43c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bc84e9b0b0 con 0x55bc84e92420 2024-06-06T03:27:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.395+0000 7fdfef43c740 10 client.0 _ll_register_callbacks cb 0x55bc84db39b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.395+0000 7fdfe9cc4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc84e92e10 0x55bc84e9cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.395+0000 7fdfe9cc4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc84e92e10 0x55bc84e9cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52220/0 (socket says 172.21.15.50:52220) 2024-06-06T03:27:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.395+0000 7fdfe9cc4640 1 -- 172.21.15.50:0/1235514988 learned_addr learned my addr 172.21.15.50:0/1235514988 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.395+0000 7fdfeacc6640 1 --2- 172.21.15.50:0/1235514988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bc84e97f80 0x55bc84ea3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.395+0000 7fdfea4c5640 1 --2- 172.21.15.50:0/1235514988 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc84e92420 0x55bc84e9c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.395+0000 7fdfe9cc4640 1 -- 172.21.15.50:0/1235514988 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc84e92420 msgr2=0x55bc84e9c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.395+0000 7fdfe9cc4640 1 --2- 172.21.15.50:0/1235514988 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc84e92420 0x55bc84e9c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.395+0000 7fdfe9cc4640 1 -- 172.21.15.50:0/1235514988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bc84e97f80 msgr2=0x55bc84ea3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.395+0000 7fdfe9cc4640 1 --2- 172.21.15.50:0/1235514988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bc84e97f80 0x55bc84ea3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.395+0000 7fdfe9cc4640 1 -- 172.21.15.50:0/1235514988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc84b05210 con 0x55bc84e92e10 2024-06-06T03:27:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.395+0000 7fdfea4c5640 1 --2- 172.21.15.50:0/1235514988 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc84e92420 0x55bc84e9c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:27:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.395+0000 7fdfe9cc4640 1 --2- 172.21.15.50:0/1235514988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc84e92e10 0x55bc84e9cc10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fdfd40058c0 tx=0x7fdfd400a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd678135f731d95 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.395+0000 7fdfcdffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:27:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.395+0000 7fdfcdffb640 1 -- 172.21.15.50:0/1235514988 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd401d070 con 0x55bc84e92e10 2024-06-06T03:27:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.395+0000 7fdfcdffb640 1 -- 172.21.15.50:0/1235514988 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fdfd4004e90 con 0x55bc84e92e10 2024-06-06T03:27:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.395+0000 7fdfef43c740 1 -- 172.21.15.50:0/1235514988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfdc043070 con 0x55bc84e92e10 2024-06-06T03:27:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.395+0000 7fdfcdffb640 1 -- 172.21.15.50:0/1235514988 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdfd4093150 con 0x55bc84e92e10 2024-06-06T03:27:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.395+0000 7fdfef43c740 10 client.15627 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.395+0000 7fdfef43c740 1 -- 172.21.15.50:0/1235514988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bc84bd1620 con 0x55bc84e92e10 2024-06-06T03:27:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.396+0000 7fdfcdffb640 1 -- 172.21.15.50:0/1235514988 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdfdc043070 con 0x55bc84e92e10 2024-06-06T03:27:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.396+0000 7fdfcdffb640 1 -- 172.21.15.50:0/1235514988 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fdfd409a9e0 con 0x55bc84e92e10 2024-06-06T03:27:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.396+0000 7fdfef43c740 10 client.15627 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.396+0000 7fdfef43c740 10 client.15627 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:27:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.396+0000 7fdfef43c740 20 client.15627 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.396+0000 7fdfef43c740 1 --2- 172.21.15.50:0/1235514988 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bc84ea8540 0x55bc84eaa9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.396+0000 7fdfef43c740 4 client.15627 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:27:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.396+0000 7fdfef43c740 1 -- 172.21.15.50:0/1235514988 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc84e04f10 con 0x55bc84ea8540 2024-06-06T03:27:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.396+0000 7fdfea4c5640 1 --2- 172.21.15.50:0/1235514988 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bc84ea8540 0x55bc84eaa9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.397+0000 7fdfcdffb640 10 client.15627 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.397+0000 7fdfea4c5640 1 --2- 172.21.15.50:0/1235514988 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bc84ea8540 0x55bc84eaa9d0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25ee67b075f9f4ba server_cookie=8cbdd9fcd56fd60b in_seq=0 out_seq=0 2024-06-06T03:27:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.397+0000 7fdfcdffb640 1 -- 172.21.15.50:0/1235514988 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55bc84e04f10 con 0x55bc84ea8540 2024-06-06T03:27:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.397+0000 7fdfcdffb640 10 client.15627 handle_command_reply: tid=0 2024-06-06T03:27:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.397+0000 7fdfef43c740 1 client.15627 shutdown 2024-06-06T03:27:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.398+0000 7fdfef43c740 1 -- 172.21.15.50:0/1235514988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc84e92e10 msgr2=0x55bc84e9cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.398+0000 7fdfef43c740 1 --2- 172.21.15.50:0/1235514988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc84e92e10 0x55bc84e9cc10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fdfd40058c0 tx=0x7fdfd400a5f0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.398+0000 7fdfef43c740 1 -- 172.21.15.50:0/1235514988 shutdown_connections 2024-06-06T03:27:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.398+0000 7fdfef43c740 1 --2- 172.21.15.50:0/1235514988 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bc84ea8540 0x55bc84eaa9d0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.398+0000 7fdfef43c740 1 --2- 172.21.15.50:0/1235514988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc84e92e10 0x55bc84e9cc10 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.398+0000 7fdfef43c740 1 --2- 172.21.15.50:0/1235514988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bc84e97f80 0x55bc84ea3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.398+0000 7fdfef43c740 1 --2- 172.21.15.50:0/1235514988 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc84e92420 0x55bc84e9c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.398+0000 7fdfcdffb640 0 client.15627 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.398+0000 7fdfef43c740 1 -- 172.21.15.50:0/1235514988 >> 172.21.15.50:0/1235514988 conn(0x55bc84e89680 msgr2=0x55bc84e887e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.398+0000 7fdfef43c740 1 -- 172.21.15.50:0/1235514988 shutdown_connections 2024-06-06T03:27:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.398+0000 7fdfef43c740 1 -- 172.21.15.50:0/1235514988 wait complete. 2024-06-06T03:27:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.398+0000 7fdfef43c740 20 client.15627 trim_cache size 0 max 16384 2024-06-06T03:27:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.413+0000 7fdfef43c740 1 Processor -- start 2024-06-06T03:27:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.413+0000 7fdfef43c740 1 -- start start 2024-06-06T03:27:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.413+0000 7fdfef43c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc84e92420 0x55bc84e94090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.413+0000 7fdfef43c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc84e92e10 0x55bc84e945d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.413+0000 7fdfef43c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bc84e97f80 0x55bc84ea3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.413+0000 7fdfef43c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe41aaab0 con 0x55bc84e92420 2024-06-06T03:27:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.413+0000 7fdfef43c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe41a8380 con 0x55bc84e97f80 2024-06-06T03:27:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.413+0000 7fdfef43c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe41a61d0 con 0x55bc84e92e10 2024-06-06T03:27:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.413+0000 7fdfea4c5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc84e92420 0x55bc84e94090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.413+0000 7fdfea4c5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc84e92420 0x55bc84e94090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52230/0 (socket says 172.21.15.50:52230) 2024-06-06T03:27:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.413+0000 7fdfea4c5640 1 -- 172.21.15.50:0/2160493326 learned_addr learned my addr 172.21.15.50:0/2160493326 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.413+0000 7fdfea4c5640 1 -- 172.21.15.50:0/2160493326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc84e92e10 msgr2=0x55bc84e945d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.413+0000 7fdfea4c5640 1 --2- 172.21.15.50:0/2160493326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc84e92e10 0x55bc84e945d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.413+0000 7fdfea4c5640 1 -- 172.21.15.50:0/2160493326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bc84e97f80 msgr2=0x55bc84ea3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.413+0000 7fdfea4c5640 1 --2- 172.21.15.50:0/2160493326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bc84e97f80 0x55bc84ea3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.413+0000 7fdfea4c5640 1 -- 172.21.15.50:0/2160493326 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc84eab050 con 0x55bc84e92420 2024-06-06T03:27:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.414+0000 7fdfea4c5640 1 --2- 172.21.15.50:0/2160493326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc84e92420 0x55bc84e94090 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x55bc84e93210 tx=0x7fdfe000b470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=705585cc3c32917 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.414+0000 7fdfcffff640 1 -- 172.21.15.50:0/2160493326 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe001a330 con 0x55bc84e92420 2024-06-06T03:27:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.414+0000 7fdfcffff640 1 -- 172.21.15.50:0/2160493326 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdfe001a980 con 0x55bc84e92420 2024-06-06T03:27:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.414+0000 7fdfcffff640 1 -- 172.21.15.50:0/2160493326 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe0011ac0 con 0x55bc84e92420 2024-06-06T03:27:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.414+0000 7fdfef43c740 1 -- 172.21.15.50:0/2160493326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc84e92420 msgr2=0x55bc84e94090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.414+0000 7fdfef43c740 1 --2- 172.21.15.50:0/2160493326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc84e92420 0x55bc84e94090 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x55bc84e93210 tx=0x7fdfe000b470 comp rx=0 tx=0).stop 2024-06-06T03:27:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.414+0000 7fdfef43c740 1 -- 172.21.15.50:0/2160493326 shutdown_connections 2024-06-06T03:27:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.414+0000 7fdfef43c740 1 --2- 172.21.15.50:0/2160493326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bc84e97f80 0x55bc84ea3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.414+0000 7fdfef43c740 1 --2- 172.21.15.50:0/2160493326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc84e92e10 0x55bc84e945d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.414+0000 7fdfef43c740 1 --2- 172.21.15.50:0/2160493326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc84e92420 0x55bc84e94090 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.414+0000 7fdfef43c740 1 -- 172.21.15.50:0/2160493326 >> 172.21.15.50:0/2160493326 conn(0x55bc84e89680 msgr2=0x55bc84e976d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.414+0000 7fdfef43c740 1 -- 172.21.15.50:0/2160493326 shutdown_connections 2024-06-06T03:27:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.414+0000 7fdfef43c740 1 -- 172.21.15.50:0/2160493326 wait complete. 2024-06-06T03:27:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.415+0000 7fdfef43c740 1 -- start start 2024-06-06T03:27:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.415+0000 7fdfef43c740 1 Processor -- start 2024-06-06T03:27:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.415+0000 7fdfef43c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc84e92420 0x55bc84ea0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.415+0000 7fdfef43c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc84e92e10 0x55bc84ea1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.415+0000 7fdfef43c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bc84e97f80 0x55bc84f112f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.415+0000 7fdfef43c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe41a6840 con 0x55bc84e92e10 2024-06-06T03:27:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.415+0000 7fdfef43c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe41a7cb0 con 0x55bc84e97f80 2024-06-06T03:27:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.415+0000 7fdfef43c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe41a6f10 con 0x55bc84e92420 2024-06-06T03:27:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.415+0000 7fdfef43c740 10 client.0 _ll_register_callbacks cb 0x7fdfd4004570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.415+0000 7fdfe9cc4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc84e92e10 0x55bc84ea1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.415+0000 7fdfe9cc4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc84e92e10 0x55bc84ea1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52236/0 (socket says 172.21.15.50:52236) 2024-06-06T03:27:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.415+0000 7fdfe9cc4640 1 -- 172.21.15.50:0/3013374190 learned_addr learned my addr 172.21.15.50:0/3013374190 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.415+0000 7fdfea4c5640 1 --2- 172.21.15.50:0/3013374190 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc84e92420 0x55bc84ea0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.415+0000 7fdfe9cc4640 1 -- 172.21.15.50:0/3013374190 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc84e92420 msgr2=0x55bc84ea0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.415+0000 7fdfe9cc4640 1 --2- 172.21.15.50:0/3013374190 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc84e92420 0x55bc84ea0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.415+0000 7fdfeacc6640 1 --2- 172.21.15.50:0/3013374190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bc84e97f80 0x55bc84f112f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.415+0000 7fdfe9cc4640 1 -- 172.21.15.50:0/3013374190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bc84e97f80 msgr2=0x55bc84f112f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.415+0000 7fdfe9cc4640 1 --2- 172.21.15.50:0/3013374190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bc84e97f80 0x55bc84f112f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.415+0000 7fdfe9cc4640 1 -- 172.21.15.50:0/3013374190 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc84f118b0 con 0x55bc84e92e10 2024-06-06T03:27:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.415+0000 7fdfea4c5640 1 --2- 172.21.15.50:0/3013374190 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc84e92420 0x55bc84ea0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:27:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.416+0000 7fdfe9cc4640 1 --2- 172.21.15.50:0/3013374190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc84e92e10 0x55bc84ea1180 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fdfd409b520 tx=0x7fdfd40052e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8eac60d7738e2dc server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.416+0000 7fdfcdffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:27:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.416+0000 7fdfcdffb640 1 -- 172.21.15.50:0/3013374190 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd401d070 con 0x55bc84e92e10 2024-06-06T03:27:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.416+0000 7fdfcdffb640 1 -- 172.21.15.50:0/3013374190 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fdfd4004e90 con 0x55bc84e92e10 2024-06-06T03:27:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.416+0000 7fdfef43c740 1 -- 172.21.15.50:0/3013374190 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfe001a980 con 0x55bc84e92e10 2024-06-06T03:27:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.416+0000 7fdfcdffb640 1 -- 172.21.15.50:0/3013374190 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdfd409b0d0 con 0x55bc84e92e10 2024-06-06T03:27:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.416+0000 7fdfef43c740 10 client.15633 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.416+0000 7fdfef43c740 1 -- 172.21.15.50:0/3013374190 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bc84f12bc0 con 0x55bc84e92e10 2024-06-06T03:27:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.416+0000 7fdfcdffb640 1 -- 172.21.15.50:0/3013374190 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdfe001a980 con 0x55bc84e92e10 2024-06-06T03:27:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.416+0000 7fdfcdffb640 1 -- 172.21.15.50:0/3013374190 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fdfd4097470 con 0x55bc84e92e10 2024-06-06T03:27:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.416+0000 7fdfef43c740 10 client.15633 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.416+0000 7fdfef43c740 10 client.15633 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:27:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.416+0000 7fdfef43c740 20 client.15633 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.416+0000 7fdfef43c740 1 --2- 172.21.15.50:0/3013374190 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bc84f133e0 0x55bc84f15800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.416+0000 7fdfef43c740 4 client.15633 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:27:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.416+0000 7fdfef43c740 1 -- 172.21.15.50:0/3013374190 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bc84dfec20 con 0x55bc84f133e0 2024-06-06T03:27:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.417+0000 7fdfea4c5640 1 --2- 172.21.15.50:0/3013374190 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bc84f133e0 0x55bc84f15800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.417+0000 7fdfea4c5640 1 --2- 172.21.15.50:0/3013374190 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bc84f133e0 0x55bc84f15800 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1aaf7839813e8a25 server_cookie=4c19f966ca22dfc9 in_seq=0 out_seq=0 2024-06-06T03:27:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.417+0000 7fdfcdffb640 10 client.15633 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.420+0000 7fdfcdffb640 1 -- 172.21.15.50:0/3013374190 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55bc84dfec20 con 0x55bc84f133e0 2024-06-06T03:27:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.420+0000 7fdfcdffb640 10 client.15633 handle_command_reply: tid=0 2024-06-06T03:27:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.420+0000 7fdfef43c740 1 client.15633 shutdown 2024-06-06T03:27:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.421+0000 7fdfef43c740 1 -- 172.21.15.50:0/3013374190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc84e92e10 msgr2=0x55bc84ea1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.421+0000 7fdfef43c740 1 --2- 172.21.15.50:0/3013374190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc84e92e10 0x55bc84ea1180 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fdfd409b520 tx=0x7fdfd40052e0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.421+0000 7fdfef43c740 1 -- 172.21.15.50:0/3013374190 shutdown_connections 2024-06-06T03:27:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.421+0000 7fdfef43c740 1 --2- 172.21.15.50:0/3013374190 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bc84f133e0 0x55bc84f15800 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.421+0000 7fdfef43c740 1 --2- 172.21.15.50:0/3013374190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc84e92e10 0x55bc84ea1180 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.421+0000 7fdfef43c740 1 --2- 172.21.15.50:0/3013374190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bc84e97f80 0x55bc84f112f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.421+0000 7fdfef43c740 1 --2- 172.21.15.50:0/3013374190 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bc84e92420 0x55bc84ea0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.421+0000 7fdfef43c740 1 -- 172.21.15.50:0/3013374190 >> 172.21.15.50:0/3013374190 conn(0x55bc84e89680 msgr2=0x55bc84e972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.421+0000 7fdfcdffb640 0 client.15633 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.421+0000 7fdfef43c740 1 -- 172.21.15.50:0/3013374190 shutdown_connections 2024-06-06T03:27:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.421+0000 7fdfef43c740 1 -- 172.21.15.50:0/3013374190 wait complete. 2024-06-06T03:27:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.421+0000 7fdfef43c740 20 client.15633 trim_cache size 0 max 16384 2024-06-06T03:27:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:27:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:27:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:27:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.421+0000 7fdfec729640 1 -- 172.21.15.50:0/276469289 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fdfd00a2cb0 msgr2=0x7fdfd00a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.421+0000 7fdfec729640 1 --2- 172.21.15.50:0/276469289 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fdfd00a2cb0 0x7fdfd00a5170 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc04a000 tx=0x7fdfdc04b000 comp rx=0 tx=0).stop 2024-06-06T03:27:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.421+0000 7fdfec729640 1 -- 172.21.15.50:0/276469289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfe4102cb0 msgr2=0x7fdfe4197ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.421+0000 7fdfec729640 1 --2- 172.21.15.50:0/276469289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfe4102cb0 0x7fdfe4197ff0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fdfd400c890 tx=0x7fdfd400cd50 comp rx=0 tx=0).stop 2024-06-06T03:27:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.421+0000 7fdfec729640 1 -- 172.21.15.50:0/276469289 shutdown_connections 2024-06-06T03:27:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.421+0000 7fdfec729640 1 --2- 172.21.15.50:0/276469289 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fdfd00a2cb0 0x7fdfd00a5170 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.425 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.421+0000 7fdfec729640 1 --2- 172.21.15.50:0/276469289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfe4102cb0 0x7fdfe4197ff0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.425 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.421+0000 7fdfec729640 1 --2- 172.21.15.50:0/276469289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdfe4103670 0x7fdfe419f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.425 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.421+0000 7fdfec729640 1 --2- 172.21.15.50:0/276469289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfe40ffce0 0x7fdfe4197ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:56.425 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.421+0000 7fdfec729640 1 -- 172.21.15.50:0/276469289 >> 172.21.15.50:0/276469289 conn(0x7fdfe40fb610 msgr2=0x7fdfe4105ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:56.425 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.421+0000 7fdfec729640 1 -- 172.21.15.50:0/276469289 shutdown_connections 2024-06-06T03:27:56.425 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:27:56.421+0000 7fdfec729640 1 -- 172.21.15.50:0/276469289 wait complete. 2024-06-06T03:27:56.670 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-06T03:27:56.920 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:27:57.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:56 smithi050 ceph-mon[32421]: pgmap v470: 129 pgs: 129 active+clean; 670 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-06T03:27:57.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:56 smithi050 ceph-mon[32421]: scrub queued for path: / 2024-06-06T03:27:57.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:56 smithi050 ceph-mon[32421]: scrub summary: idle+waiting paths [/] 2024-06-06T03:27:57.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:56 smithi050 ceph-mon[32421]: scrub summary: active paths [/] 2024-06-06T03:27:57.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:56 smithi050 ceph-mon[32421]: scrub summary: idle+waiting paths [/] 2024-06-06T03:27:57.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:56 smithi079 ceph-mon[35478]: pgmap v470: 129 pgs: 129 active+clean; 670 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-06T03:27:57.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:56 smithi079 ceph-mon[35478]: scrub queued for path: / 2024-06-06T03:27:57.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:56 smithi079 ceph-mon[35478]: scrub summary: idle+waiting paths [/] 2024-06-06T03:27:57.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:56 smithi079 ceph-mon[35478]: scrub summary: active paths [/] 2024-06-06T03:27:57.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:56 smithi079 ceph-mon[35478]: scrub summary: idle+waiting paths [/] 2024-06-06T03:27:57.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:56 smithi122 ceph-mon[35759]: pgmap v470: 129 pgs: 129 active+clean; 670 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-06T03:27:57.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:56 smithi122 ceph-mon[35759]: scrub queued for path: / 2024-06-06T03:27:57.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:56 smithi122 ceph-mon[35759]: scrub summary: idle+waiting paths [/] 2024-06-06T03:27:57.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:56 smithi122 ceph-mon[35759]: scrub summary: active paths [/] 2024-06-06T03:27:57.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:56 smithi122 ceph-mon[35759]: scrub summary: idle+waiting paths [/] 2024-06-06T03:27:57.725 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-06-06T03:27:57.840 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-06-06T03:27:57.882 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-06-06T03:27:57.884 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-06-06T03:27:57.884 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-06-06T03:27:57.924 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-06-06T03:27:57.928 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-06-06T03:27:57.928 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-06-06T03:27:57.944 INFO:tasks.workunit:Running workunits matching suites/iogen.sh on client.0... 2024-06-06T03:27:57.946 INFO:tasks.workunit:Running workunit suites/iogen.sh... 2024-06-06T03:27:57.946 DEBUG:teuthology.orchestra.run.smithi050:workunit test suites/iogen.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3d746ca5346f34eef7e826a1eb71e59e02b682ae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iogen.sh 2024-06-06T03:27:58.012 INFO:tasks.workunit.client.0.smithi050.stdout:getting iogen 2024-06-06T03:27:58.012 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'getting iogen' 2024-06-06T03:27:58.012 INFO:tasks.workunit.client.0.smithi050.stderr:+ wget http://download.ceph.com/qa/iogen_3.1p0.tar 2024-06-06T03:27:58.082 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:57 smithi122 ceph-mon[35759]: scrub summary: idle 2024-06-06T03:27:58.091 INFO:tasks.workunit.client.0.smithi050.stderr:--2024-06-06 03:27:58-- http://download.ceph.com/qa/iogen_3.1p0.tar 2024-06-06T03:27:58.091 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:57 smithi050 ceph-mon[32421]: scrub summary: idle 2024-06-06T03:27:58.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:57 smithi079 ceph-mon[35478]: scrub summary: idle 2024-06-06T03:27:58.101 INFO:tasks.workunit.client.0.smithi050.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-06-06T03:27:58.137 INFO:tasks.workunit.client.0.smithi050.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-06-06T03:27:58.173 INFO:tasks.workunit.client.0.smithi050.stderr:HTTP request sent, awaiting response... 200 OK 2024-06-06T03:27:58.173 INFO:tasks.workunit.client.0.smithi050.stderr:Length: 8071 (7.9K) [application/octet-stream] 2024-06-06T03:27:58.175 INFO:tasks.workunit.client.0.smithi050.stderr:Saving to: ‘iogen_3.1p0.tar’ 2024-06-06T03:27:58.179 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-06-06T03:27:58.179 INFO:tasks.workunit.client.0.smithi050.stderr: 0K ....... 100% 1.16G=0s 2024-06-06T03:27:58.179 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-06-06T03:27:58.179 INFO:tasks.workunit.client.0.smithi050.stderr:2024-06-06 03:27:58 (1.16 GB/s) - ‘iogen_3.1p0.tar’ saved [8071/8071] 2024-06-06T03:27:58.179 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-06-06T03:27:58.179 INFO:tasks.workunit.client.0.smithi050.stderr:+ tar -xvzf iogen_3.1p0.tar 2024-06-06T03:27:58.247 INFO:tasks.workunit.client.0.smithi050.stdout:iogen_3.1p0 2024-06-06T03:27:58.249 INFO:tasks.workunit.client.0.smithi050.stdout:iogen_3.1p0/src 2024-06-06T03:27:58.251 INFO:tasks.workunit.client.0.smithi050.stdout:iogen_3.1p0/src/iogen.8 2024-06-06T03:27:58.253 INFO:tasks.workunit.client.0.smithi050.stdout:iogen_3.1p0/src/iogen.c 2024-06-06T03:27:58.256 INFO:tasks.workunit.client.0.smithi050.stdout:iogen_3.1p0/README 2024-06-06T03:27:58.258 INFO:tasks.workunit.client.0.smithi050.stdout:iogen_3.1p0/Makefile.bsd 2024-06-06T03:27:58.260 INFO:tasks.workunit.client.0.smithi050.stdout:iogen_3.1p0/Makefile 2024-06-06T03:27:58.263 INFO:tasks.workunit.client.0.smithi050.stderr:+ cd iogen_3.1p0 2024-06-06T03:27:58.265 INFO:tasks.workunit.client.0.smithi050.stdout:making iogen 2024-06-06T03:27:58.266 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'making iogen' 2024-06-06T03:27:58.266 INFO:tasks.workunit.client.0.smithi050.stderr:+ make 2024-06-06T03:27:58.277 INFO:tasks.workunit.client.0.smithi050.stdout:gcc -D_FILE_OFFSET_BITS=64 -DVERSION=\"3.1p0\" -Dstrlcpy=strncpy -Darc4random=rand -O2 src/iogen.c -o iogen 2024-06-06T03:27:58.626 INFO:tasks.workunit.client.0.smithi050.stdout:nroff -mandoc -Tascii src/iogen.8 > iogen.cat8 2024-06-06T03:27:58.870 INFO:tasks.workunit.client.0.smithi050.stdout:running iogen 2024-06-06T03:27:58.870 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'running iogen' 2024-06-06T03:27:58.871 INFO:tasks.workunit.client.0.smithi050.stderr:+ ./iogen -n 5 -s 2g 2024-06-06T03:27:58.871 INFO:tasks.workunit.client.0.smithi050.stderr:child spawned 95180 2024-06-06T03:27:58.872 INFO:tasks.workunit.client.0.smithi050.stderr:child spawned 95181 2024-06-06T03:27:58.872 INFO:tasks.workunit.client.0.smithi050.stderr:child spawned 95182 2024-06-06T03:27:58.872 INFO:tasks.workunit.client.0.smithi050.stderr:child spawned 95183 2024-06-06T03:27:58.872 INFO:tasks.workunit.client.0.smithi050.stderr:child spawned 95184 2024-06-06T03:27:58.872 INFO:tasks.workunit.client.0.smithi050.stdout:sleep for 10 min 2024-06-06T03:27:58.873 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'sleep for 10 min' 2024-06-06T03:27:58.873 INFO:tasks.workunit.client.0.smithi050.stderr:+ sleep 600 2024-06-06T03:27:58.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.983+0000 7f7c6dd63700 1 -- 172.21.15.50:0/3375488201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c68104ed0 msgr2=0x7f7c68105360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:58.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.983+0000 7f7c6dd63700 1 --2- 172.21.15.50:0/3375488201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c68104ed0 0x7f7c68105360 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7c6000b0a0 tx=0x7f7c6000b3b0 comp rx=0 tx=0).stop 2024-06-06T03:27:58.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.983+0000 7f7c6dd63700 1 -- 172.21.15.50:0/3375488201 shutdown_connections 2024-06-06T03:27:58.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.983+0000 7f7c6dd63700 1 --2- 172.21.15.50:0/3375488201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c68104ed0 0x7f7c68105360 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:58.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.983+0000 7f7c6dd63700 1 --2- 172.21.15.50:0/3375488201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c681073c0 0x7f7c6806a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:58.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.983+0000 7f7c6dd63700 1 --2- 172.21.15.50:0/3375488201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c6806a6e0 0x7f7c6806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:58.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.983+0000 7f7c6dd63700 1 -- 172.21.15.50:0/3375488201 >> 172.21.15.50:0/3375488201 conn(0x7f7c68078340 msgr2=0x7f7c68078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:58.984 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:27:58 smithi050 ceph-mon[32421]: pgmap v471: 129 pgs: 129 active+clean; 670 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 0 B/s wr, 5 op/s 2024-06-06T03:27:58.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.984+0000 7f7c6dd63700 1 -- 172.21.15.50:0/3375488201 shutdown_connections 2024-06-06T03:27:58.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.984+0000 7f7c6dd63700 1 -- 172.21.15.50:0/3375488201 wait complete. 2024-06-06T03:27:58.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.984+0000 7f7c6dd63700 1 Processor -- start 2024-06-06T03:27:58.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.985+0000 7f7c6dd63700 1 -- start start 2024-06-06T03:27:58.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.985+0000 7f7c6dd63700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c6806a6e0 0x7f7c6819f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:58.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.985+0000 7f7c6dd63700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c68104ed0 0x7f7c6819f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:58.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.985+0000 7f7c6dd63700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c681073c0 0x7f7c681a3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:58.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.985+0000 7f7c6dd63700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7c68118c50 con 0x7f7c681073c0 2024-06-06T03:27:58.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.985+0000 7f7c677fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c6806a6e0 0x7f7c6819f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:58.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.985+0000 7f7c677fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c6806a6e0 0x7f7c6819f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:41792/0 (socket says 172.21.15.50:41792) 2024-06-06T03:27:58.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.985+0000 7f7c677fe700 1 -- 172.21.15.50:0/3564214681 learned_addr learned my addr 172.21.15.50:0/3564214681 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:58.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.986+0000 7f7c67fff700 1 --2- 172.21.15.50:0/3564214681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c681073c0 0x7f7c681a3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:58.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.986+0000 7f7c6dd63700 1 -- 172.21.15.50:0/3564214681 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7c68118ad0 con 0x7f7c6806a6e0 2024-06-06T03:27:58.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.986+0000 7f7c6dd63700 1 -- 172.21.15.50:0/3564214681 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7c68118dd0 con 0x7f7c68104ed0 2024-06-06T03:27:58.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.986+0000 7f7c66ffd700 1 --2- 172.21.15.50:0/3564214681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c68104ed0 0x7f7c6819f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:58.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.986+0000 7f7c67fff700 1 -- 172.21.15.50:0/3564214681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c68104ed0 msgr2=0x7f7c6819f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:58.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.986+0000 7f7c67fff700 1 --2- 172.21.15.50:0/3564214681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c68104ed0 0x7f7c6819f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:58.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.986+0000 7f7c67fff700 1 -- 172.21.15.50:0/3564214681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c6806a6e0 msgr2=0x7f7c6819f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:58.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.986+0000 7f7c67fff700 1 --2- 172.21.15.50:0/3564214681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c6806a6e0 0x7f7c6819f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:58.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.986+0000 7f7c67fff700 1 -- 172.21.15.50:0/3564214681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c681a4170 con 0x7f7c681073c0 2024-06-06T03:27:58.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.986+0000 7f7c67fff700 1 --2- 172.21.15.50:0/3564214681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c681073c0 0x7f7c681a3a30 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f7c6000d010 tx=0x7f7c60004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:58.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.987+0000 7f7c64ff9700 1 -- 172.21.15.50:0/3564214681 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c60021070 con 0x7f7c681073c0 2024-06-06T03:27:58.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.987+0000 7f7c64ff9700 1 -- 172.21.15.50:0/3564214681 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c60007e30 con 0x7f7c681073c0 2024-06-06T03:27:58.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.987+0000 7f7c64ff9700 1 -- 172.21.15.50:0/3564214681 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c60004630 con 0x7f7c681073c0 2024-06-06T03:27:58.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.987+0000 7f7c6dd63700 1 -- 172.21.15.50:0/3564214681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c681a4400 con 0x7f7c681073c0 2024-06-06T03:27:58.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.988+0000 7f7c6dd63700 1 -- 172.21.15.50:0/3564214681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c681abce0 con 0x7f7c681073c0 2024-06-06T03:27:58.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.990+0000 7f7c64ff9700 1 -- 172.21.15.50:0/3564214681 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7c60007980 con 0x7f7c681073c0 2024-06-06T03:27:58.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.991+0000 7f7c64ff9700 1 --2- 172.21.15.50:0/3564214681 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7c500a2cf0 0x7f7c500a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:58.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.992+0000 7f7c677fe700 1 --2- 172.21.15.50:0/3564214681 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7c500a2cf0 0x7f7c500a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:58.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.992+0000 7f7c64ff9700 1 -- 172.21.15.50:0/3564214681 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f7c6000f020 con 0x7f7c681073c0 2024-06-06T03:27:58.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.993+0000 7f7c677fe700 1 --2- 172.21.15.50:0/3564214681 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7c500a2cf0 0x7f7c500a51b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7c58005950 tx=0x7f7c5800b500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:58.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.993+0000 7f7c785e6b80 1 Processor -- start 2024-06-06T03:27:58.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.993+0000 7f7c785e6b80 1 -- start start 2024-06-06T03:27:58.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.994+0000 7f7c785e6b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a40041640 0x564a40041a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:58.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.994+0000 7f7c785e6b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a40041f60 0x564a4003b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:58.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.994+0000 7f7c785e6b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a4003bf20 0x564a4003c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:58.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.994+0000 7f7c785e6b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564a3ff8d810 con 0x564a4003bf20 2024-06-06T03:27:58.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.994+0000 7f7c677fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a40041640 0x564a40041a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:58.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.994+0000 7f7c785e6b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564a3ff35720 con 0x564a40041f60 2024-06-06T03:27:58.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.994+0000 7f7c677fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a40041640 0x564a40041a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:38358/0 (socket says 172.21.15.50:38358) 2024-06-06T03:27:58.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.994+0000 7f7c67fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a4003bf20 0x564a4003c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:58.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.994+0000 7f7c677fe700 1 -- 172.21.15.50:0/2335361101 learned_addr learned my addr 172.21.15.50:0/2335361101 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:58.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.994+0000 7f7c785e6b80 1 -- 172.21.15.50:0/2335361101 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564a3ff897d0 con 0x564a40041640 2024-06-06T03:27:58.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.994+0000 7f7c66ffd700 1 --2- 172.21.15.50:0/2335361101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a40041f60 0x564a4003b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:58.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.994+0000 7f7c67fff700 1 -- 172.21.15.50:0/2335361101 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a40041640 msgr2=0x564a40041a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:58.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.994+0000 7f7c67fff700 1 --2- 172.21.15.50:0/2335361101 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a40041640 0x564a40041a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:58.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.994+0000 7f7c67fff700 1 -- 172.21.15.50:0/2335361101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a40041f60 msgr2=0x564a4003b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:58.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.994+0000 7f7c67fff700 1 --2- 172.21.15.50:0/2335361101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a40041f60 0x564a4003b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:58.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.994+0000 7f7c67fff700 1 -- 172.21.15.50:0/2335361101 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a3ff2bf50 con 0x564a4003bf20 2024-06-06T03:27:58.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.995+0000 7f7c67fff700 1 --2- 172.21.15.50:0/2335361101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a4003bf20 0x564a4003c340 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7c60009fd0 tx=0x7f7c60006020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff20629bd1d62ced server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:58.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.995+0000 7f7c4dffb700 1 -- 172.21.15.50:0/2335361101 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c60007c70 con 0x564a4003bf20 2024-06-06T03:27:58.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.995+0000 7f7c4dffb700 1 -- 172.21.15.50:0/2335361101 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c6009ca70 con 0x564a4003bf20 2024-06-06T03:27:58.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.995+0000 7f7c4dffb700 1 -- 172.21.15.50:0/2335361101 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c600047d0 con 0x564a4003bf20 2024-06-06T03:27:58.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.996+0000 7f7c785e6b80 1 -- 172.21.15.50:0/2335361101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a4003bf20 msgr2=0x564a4003c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:58.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.996+0000 7f7c785e6b80 1 --2- 172.21.15.50:0/2335361101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a4003bf20 0x564a4003c340 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7c60009fd0 tx=0x7f7c60006020 comp rx=0 tx=0).stop 2024-06-06T03:27:58.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.996+0000 7f7c785e6b80 1 -- 172.21.15.50:0/2335361101 shutdown_connections 2024-06-06T03:27:58.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.996+0000 7f7c785e6b80 1 --2- 172.21.15.50:0/2335361101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a4003bf20 0x564a4003c340 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:58.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.996+0000 7f7c785e6b80 1 --2- 172.21.15.50:0/2335361101 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a40041640 0x564a40041a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:58.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.996+0000 7f7c785e6b80 1 --2- 172.21.15.50:0/2335361101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a40041f60 0x564a4003b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:58.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.996+0000 7f7c785e6b80 1 -- 172.21.15.50:0/2335361101 >> 172.21.15.50:0/2335361101 conn(0x564a3ff66cc0 msgr2=0x564a40036850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:58.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.996+0000 7f7c785e6b80 1 -- 172.21.15.50:0/2335361101 shutdown_connections 2024-06-06T03:27:58.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.996+0000 7f7c785e6b80 1 -- 172.21.15.50:0/2335361101 wait complete. 2024-06-06T03:27:58.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.997+0000 7f7c785e6b80 1 -- start start 2024-06-06T03:27:58.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.997+0000 7f7c785e6b80 1 Processor -- start 2024-06-06T03:27:58.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.997+0000 7f7c785e6b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a4003bf20 0x564a40047d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:58.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.997+0000 7f7c785e6b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a40041640 0x564a40045040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:58.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.997+0000 7f7c785e6b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a40041f60 0x564a40045580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:58.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.998+0000 7f7c785e6b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564a400486f0 con 0x564a40041640 2024-06-06T03:27:58.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.998+0000 7f7c785e6b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564a3ff2dbf0 con 0x564a4003bf20 2024-06-06T03:27:58.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.998+0000 7f7c785e6b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564a40048870 con 0x564a40041f60 2024-06-06T03:27:58.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.998+0000 7f7c785e6b80 10 client.0 _ll_register_callbacks cb 0x564a3ff27920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:58.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.998+0000 7f7c66ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a40041640 0x564a40045040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:58.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.998+0000 7f7c66ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a40041640 0x564a40045040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48640/0 (socket says 172.21.15.50:48640) 2024-06-06T03:27:58.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.998+0000 7f7c66ffd700 1 -- 172.21.15.50:0/3450575263 learned_addr learned my addr 172.21.15.50:0/3450575263 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:58.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.998+0000 7f7c67fff700 1 --2- 172.21.15.50:0/3450575263 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a40041f60 0x564a40045580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:58.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.998+0000 7f7c677fe700 1 --2- 172.21.15.50:0/3450575263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a4003bf20 0x564a40047d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:59.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.998+0000 7f7c66ffd700 1 -- 172.21.15.50:0/3450575263 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a40041f60 msgr2=0x564a40045580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.998+0000 7f7c66ffd700 1 --2- 172.21.15.50:0/3450575263 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a40041f60 0x564a40045580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.998+0000 7f7c66ffd700 1 -- 172.21.15.50:0/3450575263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a4003bf20 msgr2=0x564a40047d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.998+0000 7f7c66ffd700 1 --2- 172.21.15.50:0/3450575263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a4003bf20 0x564a40047d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.998+0000 7f7c66ffd700 1 -- 172.21.15.50:0/3450575263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a3fedc8d0 con 0x564a40041640 2024-06-06T03:27:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.998+0000 7f7c66ffd700 1 --2- 172.21.15.50:0/3450575263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a40041640 0x564a40045040 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c012740 tx=0x7f7c5c012a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40393786d7f528da server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.998+0000 7f7c46ffd700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:27:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.999+0000 7f7c46ffd700 1 -- 172.21.15.50:0/3450575263 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c004260 con 0x564a40041640 2024-06-06T03:27:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.999+0000 7f7c46ffd700 1 -- 172.21.15.50:0/3450575263 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f7c5c004400 con 0x564a40041640 2024-06-06T03:27:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.999+0000 7f7c785e6b80 1 -- 172.21.15.50:0/3450575263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c6009ca70 con 0x564a40041640 2024-06-06T03:27:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.999+0000 7f7c46ffd700 1 -- 172.21.15.50:0/3450575263 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7c5c003680 con 0x564a40041640 2024-06-06T03:27:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.999+0000 7f7c785e6b80 10 client.15645 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:58.999+0000 7f7c785e6b80 1 -- 172.21.15.50:0/3450575263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564a400530e0 con 0x564a40041640 2024-06-06T03:27:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.000+0000 7f7c46ffd700 1 -- 172.21.15.50:0/3450575263 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c6009ca70 con 0x564a40041640 2024-06-06T03:27:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.000+0000 7f7c46ffd700 1 -- 172.21.15.50:0/3450575263 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f7c5c011a60 con 0x564a40041640 2024-06-06T03:27:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.000+0000 7f7c785e6b80 10 client.15645 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.000+0000 7f7c785e6b80 10 client.15645 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:27:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.000+0000 7f7c785e6b80 20 client.15645 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.000+0000 7f7c785e6b80 1 --2- 172.21.15.50:0/3450575263 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564a40055770 0x564a40057b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.000+0000 7f7c785e6b80 4 client.15645 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:27:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.000+0000 7f7c785e6b80 1 -- 172.21.15.50:0/3450575263 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a3ff9ad10 con 0x564a40055770 2024-06-06T03:27:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.000+0000 7f7c677fe700 1 --2- 172.21.15.50:0/3450575263 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564a40055770 0x564a40057b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.001+0000 7f7c677fe700 1 --2- 172.21.15.50:0/3450575263 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564a40055770 0x564a40057b60 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfb1630aaef81400 server_cookie=68cace8692503a1d in_seq=0 out_seq=0 2024-06-06T03:27:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.001+0000 7f7c46ffd700 10 client.15645 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:59.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.001+0000 7f7c46ffd700 1 -- 172.21.15.50:0/3450575263 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x564a3ff9ad10 con 0x564a40055770 2024-06-06T03:27:59.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.001+0000 7f7c46ffd700 10 client.15645 handle_command_reply: tid=0 2024-06-06T03:27:59.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.002+0000 7f7c785e6b80 1 client.15645 shutdown 2024-06-06T03:27:59.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.002+0000 7f7c785e6b80 1 -- 172.21.15.50:0/3450575263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a40041640 msgr2=0x564a40045040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:59.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.002+0000 7f7c785e6b80 1 --2- 172.21.15.50:0/3450575263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a40041640 0x564a40045040 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c012740 tx=0x7f7c5c012a50 comp rx=0 tx=0).stop 2024-06-06T03:27:59.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.002+0000 7f7c785e6b80 1 -- 172.21.15.50:0/3450575263 shutdown_connections 2024-06-06T03:27:59.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.002+0000 7f7c785e6b80 1 --2- 172.21.15.50:0/3450575263 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564a40055770 0x564a40057b60 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:59.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.002+0000 7f7c46ffd700 0 client.15645 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:59.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.002+0000 7f7c785e6b80 1 --2- 172.21.15.50:0/3450575263 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a40041f60 0x564a40045580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:59.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.002+0000 7f7c785e6b80 1 --2- 172.21.15.50:0/3450575263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a4003bf20 0x564a40047d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:59.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.002+0000 7f7c785e6b80 1 --2- 172.21.15.50:0/3450575263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a40041640 0x564a40045040 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:59.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.002+0000 7f7c785e6b80 1 -- 172.21.15.50:0/3450575263 >> 172.21.15.50:0/3450575263 conn(0x564a3ff66cc0 msgr2=0x564a4003a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:59.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.002+0000 7f7c785e6b80 1 -- 172.21.15.50:0/3450575263 shutdown_connections 2024-06-06T03:27:59.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.002+0000 7f7c785e6b80 1 -- 172.21.15.50:0/3450575263 wait complete. 2024-06-06T03:27:59.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.002+0000 7f7c785e6b80 20 client.15645 trim_cache size 0 max 16384 2024-06-06T03:27:59.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.037+0000 7f7c785e6b80 1 Processor -- start 2024-06-06T03:27:59.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.037+0000 7f7c785e6b80 1 -- start start 2024-06-06T03:27:59.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.038+0000 7f7c785e6b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a4003bf20 0x564a4003b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:59.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.038+0000 7f7c785e6b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a40041640 0x564a40051990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:59.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.038+0000 7f7c785e6b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a40041f60 0x564a40042a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:59.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.038+0000 7f7c785e6b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7c681b6f60 con 0x564a40041f60 2024-06-06T03:27:59.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.038+0000 7f7c785e6b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7c681b47f0 con 0x564a4003bf20 2024-06-06T03:27:59.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.038+0000 7f7c785e6b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7c681b2640 con 0x564a40041640 2024-06-06T03:27:59.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.038+0000 7f7c67fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a40041f60 0x564a40042a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:59.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.038+0000 7f7c66ffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a40041640 0x564a40051990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:59.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.038+0000 7f7c67fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a40041f60 0x564a40042a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48648/0 (socket says 172.21.15.50:48648) 2024-06-06T03:27:59.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.038+0000 7f7c67fff700 1 -- 172.21.15.50:0/2722239105 learned_addr learned my addr 172.21.15.50:0/2722239105 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:59.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.038+0000 7f7c677fe700 1 --2- 172.21.15.50:0/2722239105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a4003bf20 0x564a4003b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:59.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.038+0000 7f7c66ffd700 1 -- 172.21.15.50:0/2722239105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a4003bf20 msgr2=0x564a4003b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:59.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.038+0000 7f7c66ffd700 1 --2- 172.21.15.50:0/2722239105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a4003bf20 0x564a4003b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:59.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.038+0000 7f7c66ffd700 1 -- 172.21.15.50:0/2722239105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a40041f60 msgr2=0x564a40042a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:59.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.038+0000 7f7c66ffd700 1 --2- 172.21.15.50:0/2722239105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a40041f60 0x564a40042a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:59.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.038+0000 7f7c66ffd700 1 -- 172.21.15.50:0/2722239105 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a40037500 con 0x564a40041640 2024-06-06T03:27:59.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.039+0000 7f7c66ffd700 1 --2- 172.21.15.50:0/2722239105 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a40041640 0x564a40051990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c001eb0 tx=0x7f7c5c00f6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f40943d3486c466 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:59.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.039+0000 7f7c4d7fa700 1 -- 172.21.15.50:0/2722239105 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c02e020 con 0x564a40041640 2024-06-06T03:27:59.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.039+0000 7f7c4d7fa700 1 -- 172.21.15.50:0/2722239105 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c5c021040 con 0x564a40041640 2024-06-06T03:27:59.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.039+0000 7f7c4d7fa700 1 -- 172.21.15.50:0/2722239105 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c025030 con 0x564a40041640 2024-06-06T03:27:59.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.040+0000 7f7c785e6b80 1 -- 172.21.15.50:0/2722239105 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a40041640 msgr2=0x564a40051990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:59.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.040+0000 7f7c785e6b80 1 --2- 172.21.15.50:0/2722239105 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a40041640 0x564a40051990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c001eb0 tx=0x7f7c5c00f6a0 comp rx=0 tx=0).stop 2024-06-06T03:27:59.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.040+0000 7f7c785e6b80 1 -- 172.21.15.50:0/2722239105 shutdown_connections 2024-06-06T03:27:59.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.040+0000 7f7c785e6b80 1 --2- 172.21.15.50:0/2722239105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a40041f60 0x564a40042a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:59.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.040+0000 7f7c785e6b80 1 --2- 172.21.15.50:0/2722239105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a4003bf20 0x564a4003b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:59.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.040+0000 7f7c785e6b80 1 --2- 172.21.15.50:0/2722239105 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a40041640 0x564a40051990 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:59.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.040+0000 7f7c785e6b80 1 -- 172.21.15.50:0/2722239105 >> 172.21.15.50:0/2722239105 conn(0x564a3ff66cc0 msgr2=0x564a40042340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:59.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.040+0000 7f7c785e6b80 1 -- 172.21.15.50:0/2722239105 shutdown_connections 2024-06-06T03:27:59.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.041+0000 7f7c785e6b80 1 -- 172.21.15.50:0/2722239105 wait complete. 2024-06-06T03:27:59.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.041+0000 7f7c785e6b80 1 -- start start 2024-06-06T03:27:59.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.041+0000 7f7c785e6b80 1 Processor -- start 2024-06-06T03:27:59.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.042+0000 7f7c785e6b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a4003bf20 0x564a4005cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:59.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.042+0000 7f7c785e6b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a40041640 0x564a4005d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:59.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.042+0000 7f7c785e6b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a40041f60 0x564a4005d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:59.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.042+0000 7f7c785e6b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7c681b2cb0 con 0x564a4003bf20 2024-06-06T03:27:59.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.042+0000 7f7c785e6b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7c681b4120 con 0x564a40041640 2024-06-06T03:27:59.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.042+0000 7f7c785e6b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7c681b3380 con 0x564a40041f60 2024-06-06T03:27:59.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.042+0000 7f7c785e6b80 10 client.0 _ll_register_callbacks cb 0x564a3ff27920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:27:59.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.042+0000 7f7c677fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a4003bf20 0x564a4005cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:59.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.042+0000 7f7c66ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a40041640 0x564a4005d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:59.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.042+0000 7f7c66ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a40041640 0x564a4005d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:41834/0 (socket says 172.21.15.50:41834) 2024-06-06T03:27:59.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.042+0000 7f7c66ffd700 1 -- 172.21.15.50:0/959859437 learned_addr learned my addr 172.21.15.50:0/959859437 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:27:59.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.042+0000 7f7c67fff700 1 --2- 172.21.15.50:0/959859437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a40041f60 0x564a4005d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:59.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.042+0000 7f7c677fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a4003bf20 0x564a4005cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48654/0 (socket says 172.21.15.50:48654) 2024-06-06T03:27:59.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.042+0000 7f7c67fff700 1 -- 172.21.15.50:0/959859437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a40041640 msgr2=0x564a4005d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:59.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.042+0000 7f7c67fff700 1 --2- 172.21.15.50:0/959859437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a40041640 0x564a4005d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:59.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.042+0000 7f7c67fff700 1 -- 172.21.15.50:0/959859437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a4003bf20 msgr2=0x564a4005cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:27:59.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.042+0000 7f7c67fff700 1 --2- 172.21.15.50:0/959859437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a4003bf20 0x564a4005cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:59.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.042+0000 7f7c67fff700 1 -- 172.21.15.50:0/959859437 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a400bf400 con 0x564a40041f60 2024-06-06T03:27:59.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.042+0000 7f7c66ffd700 1 --2- 172.21.15.50:0/959859437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a40041640 0x564a4005d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:27:59.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.042+0000 7f7c67fff700 1 --2- 172.21.15.50:0/959859437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a40041f60 0x564a4005d9d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7c6000bfa0 tx=0x7f7c6009c250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59eb37bc5b84f4d2 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:27:59.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.042+0000 7f7c46ffd700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:27:59.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.043+0000 7f7c46ffd700 1 -- 172.21.15.50:0/959859437 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c600b4070 con 0x564a40041f60 2024-06-06T03:27:59.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.043+0000 7f7c785e6b80 1 -- 172.21.15.50:0/959859437 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c5c021040 con 0x564a40041f60 2024-06-06T03:27:59.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.043+0000 7f7c46ffd700 1 -- 172.21.15.50:0/959859437 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f7c600047d0 con 0x564a40041f60 2024-06-06T03:27:59.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.043+0000 7f7c46ffd700 1 -- 172.21.15.50:0/959859437 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7c6009ca70 con 0x564a40041f60 2024-06-06T03:27:59.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.043+0000 7f7c785e6b80 10 client.25243 fetch_fsmap learned FSMap version 27 2024-06-06T03:27:59.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.043+0000 7f7c785e6b80 1 -- 172.21.15.50:0/959859437 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564a400c0610 con 0x564a40041f60 2024-06-06T03:27:59.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.043+0000 7f7c46ffd700 1 -- 172.21.15.50:0/959859437 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c5c021040 con 0x564a40041f60 2024-06-06T03:27:59.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.044+0000 7f7c46ffd700 1 -- 172.21.15.50:0/959859437 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f7c60011070 con 0x564a40041f60 2024-06-06T03:27:59.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.044+0000 7f7c785e6b80 10 client.25243 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:27:59.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.044+0000 7f7c785e6b80 10 client.25243 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:27:59.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.044+0000 7f7c785e6b80 20 client.25243 populate_metadata read hostname 'smithi050' 2024-06-06T03:27:59.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.044+0000 7f7c785e6b80 1 --2- 172.21.15.50:0/959859437 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564a40055770 0x564a400c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:27:59.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.044+0000 7f7c785e6b80 4 client.25243 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-06T03:27:59.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.044+0000 7f7c785e6b80 1 -- 172.21.15.50:0/959859437 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564a3ff95290 con 0x564a40055770 2024-06-06T03:27:59.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.044+0000 7f7c677fe700 1 --2- 172.21.15.50:0/959859437 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564a40055770 0x564a400c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:27:59.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.044+0000 7f7c677fe700 1 --2- 172.21.15.50:0/959859437 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564a40055770 0x564a400c2b40 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e93a9fc46ad74b server_cookie=a9ca9878c09877af in_seq=0 out_seq=0 2024-06-06T03:27:59.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.044+0000 7f7c46ffd700 10 client.25243 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:59.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.045+0000 7f7c46ffd700 1 -- 172.21.15.50:0/959859437 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x564a3ff95290 con 0x564a40055770 2024-06-06T03:27:59.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.045+0000 7f7c46ffd700 10 client.25243 handle_command_reply: tid=0 2024-06-06T03:27:59.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.045+0000 7f7c785e6b80 1 client.25243 shutdown 2024-06-06T03:27:59.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.045+0000 7f7c785e6b80 1 -- 172.21.15.50:0/959859437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a40041f60 msgr2=0x564a4005d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:59.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.045+0000 7f7c785e6b80 1 --2- 172.21.15.50:0/959859437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a40041f60 0x564a4005d9d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7c6000bfa0 tx=0x7f7c6009c250 comp rx=0 tx=0).stop 2024-06-06T03:27:59.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.045+0000 7f7c785e6b80 1 -- 172.21.15.50:0/959859437 shutdown_connections 2024-06-06T03:27:59.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.045+0000 7f7c785e6b80 1 --2- 172.21.15.50:0/959859437 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564a40055770 0x564a400c2b40 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:59.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.045+0000 7f7c785e6b80 1 --2- 172.21.15.50:0/959859437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564a40041f60 0x564a4005d9d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:59.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.045+0000 7f7c785e6b80 1 --2- 172.21.15.50:0/959859437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a4003bf20 0x564a4005cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:59.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.045+0000 7f7c785e6b80 1 --2- 172.21.15.50:0/959859437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a40041640 0x564a4005d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:59.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.045+0000 7f7c785e6b80 1 -- 172.21.15.50:0/959859437 >> 172.21.15.50:0/959859437 conn(0x564a3ff66cc0 msgr2=0x564a40042340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:59.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.045+0000 7f7c46ffd700 0 client.25243 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:27:59.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.045+0000 7f7c785e6b80 1 -- 172.21.15.50:0/959859437 shutdown_connections 2024-06-06T03:27:59.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.045+0000 7f7c785e6b80 1 -- 172.21.15.50:0/959859437 wait complete. 2024-06-06T03:27:59.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.045+0000 7f7c785e6b80 20 client.25243 trim_cache size 0 max 16384 2024-06-06T03:27:59.049 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:27:59.049 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2024-06-06T03:27:59.049 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-06-06T03:27:59.049 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:27:59.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.046+0000 7f7c6dd63700 1 -- 172.21.15.50:0/3564214681 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7c500a2cf0 msgr2=0x7f7c500a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:59.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.046+0000 7f7c6dd63700 1 --2- 172.21.15.50:0/3564214681 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7c500a2cf0 0x7f7c500a51b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7c58005950 tx=0x7f7c5800b500 comp rx=0 tx=0).stop 2024-06-06T03:27:59.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.046+0000 7f7c6dd63700 1 -- 172.21.15.50:0/3564214681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c681073c0 msgr2=0x7f7c681a3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:27:59.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.046+0000 7f7c6dd63700 1 --2- 172.21.15.50:0/3564214681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c681073c0 0x7f7c681a3a30 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f7c6000d010 tx=0x7f7c60004c80 comp rx=0 tx=0).stop 2024-06-06T03:27:59.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.046+0000 7f7c6dd63700 1 -- 172.21.15.50:0/3564214681 shutdown_connections 2024-06-06T03:27:59.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.046+0000 7f7c6dd63700 1 --2- 172.21.15.50:0/3564214681 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7c500a2cf0 0x7f7c500a51b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:59.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.046+0000 7f7c6dd63700 1 --2- 172.21.15.50:0/3564214681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c681073c0 0x7f7c681a3a30 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:59.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.046+0000 7f7c6dd63700 1 --2- 172.21.15.50:0/3564214681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c6806a6e0 0x7f7c6819f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:59.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.046+0000 7f7c6dd63700 1 --2- 172.21.15.50:0/3564214681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c68104ed0 0x7f7c6819f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:27:59.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.046+0000 7f7c6dd63700 1 -- 172.21.15.50:0/3564214681 >> 172.21.15.50:0/3564214681 conn(0x7f7c68078340 msgr2=0x7f7c68103eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:27:59.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.046+0000 7f7c6dd63700 1 -- 172.21.15.50:0/3564214681 shutdown_connections 2024-06-06T03:27:59.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:27:59.046+0000 7f7c6dd63700 1 -- 172.21.15.50:0/3564214681 wait complete. 2024-06-06T03:27:59.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:27:58 smithi079 ceph-mon[35478]: pgmap v471: 129 pgs: 129 active+clean; 670 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 0 B/s wr, 5 op/s 2024-06-06T03:27:59.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:27:58 smithi122 ceph-mon[35759]: pgmap v471: 129 pgs: 129 active+clean; 670 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 0 B/s wr, 5 op/s 2024-06-06T03:27:59.906 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-06T03:27:59.907 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T03:28:00.306 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:28:01.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:00 smithi050 ceph-mon[32421]: pgmap v472: 129 pgs: 129 active+clean; 16 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-06-06T03:28:01.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:00 smithi079 ceph-mon[35478]: pgmap v472: 129 pgs: 129 active+clean; 16 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-06-06T03:28:01.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:00 smithi122 ceph-mon[35759]: pgmap v472: 129 pgs: 129 active+clean; 16 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-06-06T03:28:03.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:02 smithi079 ceph-mon[35478]: pgmap v473: 129 pgs: 129 active+clean; 66 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.5 MiB/s wr, 10 op/s 2024-06-06T03:28:03.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:02 smithi122 ceph-mon[35759]: pgmap v473: 129 pgs: 129 active+clean; 66 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.5 MiB/s wr, 10 op/s 2024-06-06T03:28:03.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:02 smithi050 ceph-mon[32421]: pgmap v473: 129 pgs: 129 active+clean; 66 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.5 MiB/s wr, 10 op/s 2024-06-06T03:28:03.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.692+0000 7f4919e2a700 1 -- 172.21.15.50:0/3412950267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4914105060 msgr2=0x7f4914111570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:03.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.692+0000 7f4919e2a700 1 --2- 172.21.15.50:0/3412950267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4914105060 0x7f4914111570 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f490c00b0a0 tx=0x7f490c00b3b0 comp rx=0 tx=0).stop 2024-06-06T03:28:03.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.692+0000 7f4919e2a700 1 -- 172.21.15.50:0/3412950267 shutdown_connections 2024-06-06T03:28:03.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.692+0000 7f4919e2a700 1 --2- 172.21.15.50:0/3412950267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4914105060 0x7f4914111570 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:03.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.692+0000 7f4919e2a700 1 --2- 172.21.15.50:0/3412950267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f491410a6a0 0x7f491410aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:03.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.692+0000 7f4919e2a700 1 --2- 172.21.15.50:0/3412950267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49141046a0 0x7f4914104b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:03.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.692+0000 7f4919e2a700 1 -- 172.21.15.50:0/3412950267 >> 172.21.15.50:0/3412950267 conn(0x7f4914100170 msgr2=0x7f4914102590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:03.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.692+0000 7f4919e2a700 1 -- 172.21.15.50:0/3412950267 shutdown_connections 2024-06-06T03:28:03.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.692+0000 7f4919e2a700 1 -- 172.21.15.50:0/3412950267 wait complete. 2024-06-06T03:28:03.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.694+0000 7f4919e2a700 1 Processor -- start 2024-06-06T03:28:03.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.694+0000 7f4919e2a700 1 -- start start 2024-06-06T03:28:03.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.694+0000 7f4919e2a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49141046a0 0x7f491419ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:03.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.694+0000 7f4919e2a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4914105060 0x7f491419b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:03.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.694+0000 7f4919e2a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f491410a6a0 0x7f491419f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:03.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.694+0000 7f4919e2a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f49141148e0 con 0x7f491410a6a0 2024-06-06T03:28:03.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.694+0000 7f4919e2a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4914114760 con 0x7f49141046a0 2024-06-06T03:28:03.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.694+0000 7f4919e2a700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4914114a60 con 0x7f4914105060 2024-06-06T03:28:03.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.695+0000 7f49137fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49141046a0 0x7f491419ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:03.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.695+0000 7f49137fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49141046a0 0x7f491419ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:41854/0 (socket says 172.21.15.50:41854) 2024-06-06T03:28:03.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.695+0000 7f49137fe700 1 -- 172.21.15.50:0/3432812209 learned_addr learned my addr 172.21.15.50:0/3432812209 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:03.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.695+0000 7f4913fff700 1 --2- 172.21.15.50:0/3432812209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f491410a6a0 0x7f491419f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:03.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.695+0000 7f49137fe700 1 -- 172.21.15.50:0/3432812209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4914105060 msgr2=0x7f491419b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:03.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.695+0000 7f49137fe700 1 --2- 172.21.15.50:0/3432812209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4914105060 0x7f491419b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:03.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.695+0000 7f49137fe700 1 -- 172.21.15.50:0/3432812209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f491410a6a0 msgr2=0x7f491419f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:03.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.695+0000 7f49137fe700 1 --2- 172.21.15.50:0/3432812209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f491410a6a0 0x7f491419f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:03.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.695+0000 7f49137fe700 1 -- 172.21.15.50:0/3432812209 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f491419fd30 con 0x7f49141046a0 2024-06-06T03:28:03.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.695+0000 7f49137fe700 1 --2- 172.21.15.50:0/3432812209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49141046a0 0x7f491419ad70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f490400e9c0 tx=0x7f490400ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:03.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.695+0000 7f4910ff9700 1 -- 172.21.15.50:0/3432812209 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490400cbd0 con 0x7f49141046a0 2024-06-06T03:28:03.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.696+0000 7f4910ff9700 1 -- 172.21.15.50:0/3432812209 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f490400cd70 con 0x7f49141046a0 2024-06-06T03:28:03.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.696+0000 7f4919e2a700 1 -- 172.21.15.50:0/3432812209 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49141a0020 con 0x7f49141046a0 2024-06-06T03:28:03.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.696+0000 7f4910ff9700 1 -- 172.21.15.50:0/3432812209 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4904010430 con 0x7f49141046a0 2024-06-06T03:28:03.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.696+0000 7f4919e2a700 1 -- 172.21.15.50:0/3432812209 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49141a78a0 con 0x7f49141046a0 2024-06-06T03:28:03.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.698+0000 7f4919e2a700 1 -- 172.21.15.50:0/3432812209 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4914069180 con 0x7f49141046a0 2024-06-06T03:28:03.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.699+0000 7f4910ff9700 1 -- 172.21.15.50:0/3432812209 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4904004750 con 0x7f49141046a0 2024-06-06T03:28:03.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.700+0000 7f4910ff9700 1 --2- 172.21.15.50:0/3432812209 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f48fc0a2ca0 0x7f48fc0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:03.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.700+0000 7f4910ff9700 1 -- 172.21.15.50:0/3432812209 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f49040cf6e0 con 0x7f49141046a0 2024-06-06T03:28:03.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.700+0000 7f4912ffd700 1 --2- 172.21.15.50:0/3432812209 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f48fc0a2ca0 0x7f48fc0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:03.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.701+0000 7f4912ffd700 1 --2- 172.21.15.50:0/3432812209 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f48fc0a2ca0 0x7f48fc0a5160 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4908005d30 tx=0x7f4908005c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:03.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:03.705+0000 7f4910ff9700 1 -- 172.21.15.50:0/3432812209 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f490409c260 con 0x7f49141046a0 2024-06-06T03:28:04.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:04.135+0000 7f4919e2a700 1 -- 172.21.15.50:0/3432812209 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f491402dca0 con 0x7f49141046a0 2024-06-06T03:28:04.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:04.136+0000 7f4910ff9700 1 -- 172.21.15.50:0/3432812209 <== mon.2 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11855 (secure 0 0 0) 0x7f490409bb60 con 0x7f49141046a0 2024-06-06T03:28:04.136 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:28:04.137 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1667847852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1667847852},{"type":"v1","addr":"172.21.15.50:6835","nonce":1667847852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/239971838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":239971838},{"type":"v1","addr":"172.21.15.50:6837","nonce":239971838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/2188134216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2188134216},{"type":"v1","addr":"172.21.15.50:6839","nonce":2188134216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/632572420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":632572420},{"type":"v1","addr":"172.21.15.50:6841","nonce":632572420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/864537078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":864537078},{"type":"v1","addr":"172.21.15.79:6833","nonce":864537078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/279268898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":279268898},{"type":"v1","addr":"172.21.15.79:6835","nonce":279268898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T03:22:36.202061+0000","modified":"2024-06-06T03:26:24.959500+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24490,"mds_1":24472,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/57533154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":57533154},{"type":"v1","addr":"172.21.15.122:6833","nonce":57533154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/3286722213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3286722213},{"type":"v1","addr":"172.21.15.79:6837","nonce":3286722213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/768067336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":768067336},{"type":"v1","addr":"172.21.15.79:6839","nonce":768067336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.122:6835/2987597320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2987597320},{"type":"v1","addr":"172.21.15.122:6835","nonce":2987597320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":23,"addr":"172.21.15.122:6837/1604366318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1604366318},{"type":"v1","addr":"172.21.15.122:6837","nonce":1604366318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6839/4129732900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":4129732900},{"type":"v1","addr":"172.21.15.122:6839","nonce":4129732900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24466,24472,24490]},"id":1}]} 2024-06-06T03:28:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:04.139+0000 7f4919e2a700 1 -- 172.21.15.50:0/3432812209 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f48fc0a2ca0 msgr2=0x7f48fc0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:04.139+0000 7f4919e2a700 1 --2- 172.21.15.50:0/3432812209 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f48fc0a2ca0 0x7f48fc0a5160 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4908005d30 tx=0x7f4908005c80 comp rx=0 tx=0).stop 2024-06-06T03:28:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:04.139+0000 7f4919e2a700 1 -- 172.21.15.50:0/3432812209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49141046a0 msgr2=0x7f491419ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:04.139+0000 7f4919e2a700 1 --2- 172.21.15.50:0/3432812209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49141046a0 0x7f491419ad70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f490400e9c0 tx=0x7f490400ed80 comp rx=0 tx=0).stop 2024-06-06T03:28:04.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:04.140+0000 7f4919e2a700 1 -- 172.21.15.50:0/3432812209 shutdown_connections 2024-06-06T03:28:04.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:04.140+0000 7f4919e2a700 1 --2- 172.21.15.50:0/3432812209 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f48fc0a2ca0 0x7f48fc0a5160 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:04.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:04.140+0000 7f4919e2a700 1 --2- 172.21.15.50:0/3432812209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f491410a6a0 0x7f491419f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:04.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:04.140+0000 7f4919e2a700 1 --2- 172.21.15.50:0/3432812209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49141046a0 0x7f491419ad70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:04.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:04.140+0000 7f4919e2a700 1 --2- 172.21.15.50:0/3432812209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4914105060 0x7f491419b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:04.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:04.140+0000 7f4919e2a700 1 -- 172.21.15.50:0/3432812209 >> 172.21.15.50:0/3432812209 conn(0x7f4914100170 msgr2=0x7f4914100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:04.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:04.140+0000 7f4919e2a700 1 -- 172.21.15.50:0/3432812209 shutdown_connections 2024-06-06T03:28:04.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:04.140+0000 7f4919e2a700 1 -- 172.21.15.50:0/3432812209 wait complete. 2024-06-06T03:28:04.141 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 27 2024-06-06T03:28:04.984 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-06-06T03:28:05.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:04 smithi079 ceph-mon[35478]: pgmap v474: 129 pgs: 129 active+clean; 233 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 19 MiB/s wr, 19 op/s 2024-06-06T03:28:05.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:04 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/3432812209' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:28:05.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:04 smithi122 ceph-mon[35759]: pgmap v474: 129 pgs: 129 active+clean; 233 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 19 MiB/s wr, 19 op/s 2024-06-06T03:28:05.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:04 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/3432812209' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:28:05.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:04 smithi050 ceph-mon[32421]: pgmap v474: 129 pgs: 129 active+clean; 233 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 19 MiB/s wr, 19 op/s 2024-06-06T03:28:05.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:04 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3432812209' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:28:05.358 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:28:07.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:06 smithi079 ceph-mon[35478]: pgmap v475: 129 pgs: 129 active+clean; 696 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 58 MiB/s wr, 44 op/s 2024-06-06T03:28:07.180 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:06 smithi050 ceph-mon[32421]: pgmap v475: 129 pgs: 129 active+clean; 696 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 58 MiB/s wr, 44 op/s 2024-06-06T03:28:07.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:06 smithi122 ceph-mon[35759]: pgmap v475: 129 pgs: 129 active+clean; 696 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 58 MiB/s wr, 44 op/s 2024-06-06T03:28:07.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.586+0000 7f25f332b700 1 -- 172.21.15.50:0/3132086499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25ec101d40 msgr2=0x7f25ec10e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:07.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.586+0000 7f25f332b700 1 --2- 172.21.15.50:0/3132086499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25ec101d40 0x7f25ec10e230 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f25e4009f90 tx=0x7f25e400b330 comp rx=0 tx=0).stop 2024-06-06T03:28:07.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.586+0000 7f25f332b700 1 -- 172.21.15.50:0/3132086499 shutdown_connections 2024-06-06T03:28:07.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.586+0000 7f25f332b700 1 --2- 172.21.15.50:0/3132086499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25ec101d40 0x7f25ec10e230 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:07.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.586+0000 7f25f332b700 1 --2- 172.21.15.50:0/3132086499 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25ec1073f0 0x7f25ec1077d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:07.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.586+0000 7f25f332b700 1 --2- 172.21.15.50:0/3132086499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25ec101380 0x7f25ec101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:07.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.586+0000 7f25f332b700 1 -- 172.21.15.50:0/3132086499 >> 172.21.15.50:0/3132086499 conn(0x7f25ec078300 msgr2=0x7f25ec078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:07.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.586+0000 7f25f332b700 1 -- 172.21.15.50:0/3132086499 shutdown_connections 2024-06-06T03:28:07.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.587+0000 7f25f332b700 1 -- 172.21.15.50:0/3132086499 wait complete. 2024-06-06T03:28:07.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.588+0000 7f25f332b700 1 Processor -- start 2024-06-06T03:28:07.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.588+0000 7f25f332b700 1 -- start start 2024-06-06T03:28:07.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.588+0000 7f25f332b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25ec101380 0x7f25ec197790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:07.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.588+0000 7f25f332b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25ec101d40 0x7f25ec197cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:07.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.588+0000 7f25f332b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25ec1073f0 0x7f25ec19c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:07.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.588+0000 7f25f332b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f25ec111580 con 0x7f25ec1073f0 2024-06-06T03:28:07.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.588+0000 7f25f332b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f25ec111400 con 0x7f25ec101d40 2024-06-06T03:28:07.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.588+0000 7f25f332b700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f25ec111700 con 0x7f25ec101380 2024-06-06T03:28:07.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.588+0000 7f25f18c8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25ec1073f0 0x7f25ec19c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:07.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.588+0000 7f25f08c6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25ec101d40 0x7f25ec197cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:07.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.588+0000 7f25f08c6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25ec101d40 0x7f25ec197cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:41878/0 (socket says 172.21.15.50:41878) 2024-06-06T03:28:07.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.588+0000 7f25f08c6700 1 -- 172.21.15.50:0/4193590292 learned_addr learned my addr 172.21.15.50:0/4193590292 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:07.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.588+0000 7f25f18c8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25ec1073f0 0x7f25ec19c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48686/0 (socket says 172.21.15.50:48686) 2024-06-06T03:28:07.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.588+0000 7f25f10c7700 1 --2- 172.21.15.50:0/4193590292 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25ec101380 0x7f25ec197790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:07.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.588+0000 7f25f18c8700 1 -- 172.21.15.50:0/4193590292 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25ec101380 msgr2=0x7f25ec197790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:07.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.589+0000 7f25f18c8700 1 --2- 172.21.15.50:0/4193590292 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25ec101380 0x7f25ec197790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:07.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.589+0000 7f25f18c8700 1 -- 172.21.15.50:0/4193590292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25ec101d40 msgr2=0x7f25ec197cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:07.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.589+0000 7f25f18c8700 1 --2- 172.21.15.50:0/4193590292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25ec101d40 0x7f25ec197cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:07.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.589+0000 7f25f18c8700 1 -- 172.21.15.50:0/4193590292 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25ec19cd20 con 0x7f25ec1073f0 2024-06-06T03:28:07.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.590+0000 7f25f18c8700 1 --2- 172.21.15.50:0/4193590292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25ec1073f0 0x7f25ec19c7e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f25e400b6c0 tx=0x7f25e400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:07.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.590+0000 7f25e27fc700 1 -- 172.21.15.50:0/4193590292 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e4021070 con 0x7f25ec1073f0 2024-06-06T03:28:07.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.590+0000 7f25e27fc700 1 -- 172.21.15.50:0/4193590292 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f25e4007ac0 con 0x7f25ec1073f0 2024-06-06T03:28:07.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.590+0000 7f25f332b700 1 -- 172.21.15.50:0/4193590292 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25ec19cfb0 con 0x7f25ec1073f0 2024-06-06T03:28:07.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.590+0000 7f25e27fc700 1 -- 172.21.15.50:0/4193590292 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e4005040 con 0x7f25ec1073f0 2024-06-06T03:28:07.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.590+0000 7f25f332b700 1 -- 172.21.15.50:0/4193590292 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25ec19d540 con 0x7f25ec1073f0 2024-06-06T03:28:07.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.594+0000 7f25e27fc700 1 -- 172.21.15.50:0/4193590292 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f25e4024070 con 0x7f25ec1073f0 2024-06-06T03:28:07.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.595+0000 7f25e27fc700 1 --2- 172.21.15.50:0/4193590292 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f25d80a2ca0 0x7f25d80a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.595+0000 7f25e27fc700 1 -- 172.21.15.50:0/4193590292 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f25e400f020 con 0x7f25ec1073f0 2024-06-06T03:28:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.595+0000 7f25f10c7700 1 --2- 172.21.15.50:0/4193590292 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f25d80a2ca0 0x7f25d80a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.596+0000 7f25f10c7700 1 --2- 172.21.15.50:0/4193590292 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f25d80a2ca0 0x7f25d80a5160 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f25e8009bd0 tx=0x7f25e8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.596+0000 7f25fdbaeb80 1 Processor -- start 2024-06-06T03:28:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.596+0000 7f25fdbaeb80 1 -- start start 2024-06-06T03:28:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.596+0000 7f25fdbaeb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e191bbf60 0x556e191bc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.596+0000 7f25fdbaeb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e191bc880 0x556e191b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.596+0000 7f25fdbaeb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e191b67a0 0x556e191b6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.596+0000 7f25fdbaeb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556e190a8f60 con 0x556e191b67a0 2024-06-06T03:28:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.596+0000 7f25fdbaeb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556e19107850 con 0x556e191bc880 2024-06-06T03:28:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.596+0000 7f25fdbaeb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556e1906f460 con 0x556e191bbf60 2024-06-06T03:28:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.597+0000 7f25f08c6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e191bc880 0x556e191b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.597+0000 7f25f18c8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e191b67a0 0x556e191b6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.597+0000 7f25f08c6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e191bc880 0x556e191b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:41884/0 (socket says 172.21.15.50:41884) 2024-06-06T03:28:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.597+0000 7f25f08c6700 1 -- 172.21.15.50:0/833179283 learned_addr learned my addr 172.21.15.50:0/833179283 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.597+0000 7f25f10c7700 1 --2- 172.21.15.50:0/833179283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e191bbf60 0x556e191bc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.597+0000 7f25f08c6700 1 -- 172.21.15.50:0/833179283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e191bbf60 msgr2=0x556e191bc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.597+0000 7f25f08c6700 1 --2- 172.21.15.50:0/833179283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e191bbf60 0x556e191bc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.597+0000 7f25f08c6700 1 -- 172.21.15.50:0/833179283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e191b67a0 msgr2=0x556e191b6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.597+0000 7f25f08c6700 1 --2- 172.21.15.50:0/833179283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e191b67a0 0x556e191b6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.597+0000 7f25f08c6700 1 -- 172.21.15.50:0/833179283 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e190568d0 con 0x556e191bc880 2024-06-06T03:28:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.597+0000 7f25f08c6700 1 --2- 172.21.15.50:0/833179283 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e191bc880 0x556e191b6260 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f25dc009e60 tx=0x7f25dc011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be5f31f6be18a6dd server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.597+0000 7f25d77fe700 1 -- 172.21.15.50:0/833179283 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25dc01e070 con 0x556e191bc880 2024-06-06T03:28:07.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.598+0000 7f25d77fe700 1 -- 172.21.15.50:0/833179283 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f25dc019ae0 con 0x556e191bc880 2024-06-06T03:28:07.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.598+0000 7f25d77fe700 1 -- 172.21.15.50:0/833179283 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25dc00ec40 con 0x556e191bc880 2024-06-06T03:28:07.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.598+0000 7f25fdbaeb80 1 -- 172.21.15.50:0/833179283 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e191bc880 msgr2=0x556e191b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:07.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.598+0000 7f25fdbaeb80 1 --2- 172.21.15.50:0/833179283 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e191bc880 0x556e191b6260 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f25dc009e60 tx=0x7f25dc011720 comp rx=0 tx=0).stop 2024-06-06T03:28:07.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.599+0000 7f25fdbaeb80 1 -- 172.21.15.50:0/833179283 shutdown_connections 2024-06-06T03:28:07.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.599+0000 7f25fdbaeb80 1 --2- 172.21.15.50:0/833179283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e191b67a0 0x556e191b6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:07.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.599+0000 7f25fdbaeb80 1 --2- 172.21.15.50:0/833179283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e191bbf60 0x556e191bc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:07.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.599+0000 7f25fdbaeb80 1 --2- 172.21.15.50:0/833179283 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e191bc880 0x556e191b6260 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:07.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.599+0000 7f25fdbaeb80 1 -- 172.21.15.50:0/833179283 >> 172.21.15.50:0/833179283 conn(0x556e190e3080 msgr2=0x556e191b1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:07.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.599+0000 7f25fdbaeb80 1 -- 172.21.15.50:0/833179283 shutdown_connections 2024-06-06T03:28:07.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.599+0000 7f25fdbaeb80 1 -- 172.21.15.50:0/833179283 wait complete. 2024-06-06T03:28:07.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.599+0000 7f25fdbaeb80 1 -- start start 2024-06-06T03:28:07.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.600+0000 7f25fdbaeb80 1 Processor -- start 2024-06-06T03:28:07.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.600+0000 7f25fdbaeb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e191b67a0 0x556e191c2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:07.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.600+0000 7f25fdbaeb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e191bbf60 0x556e191bf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:07.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.600+0000 7f25fdbaeb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e191bc880 0x556e191bfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:07.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.600+0000 7f25fdbaeb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556e190a7fc0 con 0x556e191bc880 2024-06-06T03:28:07.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.600+0000 7f25fdbaeb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556e19103810 con 0x556e191b67a0 2024-06-06T03:28:07.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.601+0000 7f25f08c6700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e191bbf60 0x556e191bf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:07.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.601+0000 7f25f10c7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e191b67a0 0x556e191c2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:07.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.601+0000 7f25fdbaeb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556e191c3260 con 0x556e191bbf60 2024-06-06T03:28:07.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.601+0000 7f25f08c6700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e191bbf60 0x556e191bf910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:38436/0 (socket says 172.21.15.50:38436) 2024-06-06T03:28:07.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.601+0000 7f25fdbaeb80 10 client.0 _ll_register_callbacks cb 0x556e1909d5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:28:07.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.601+0000 7f25f08c6700 1 -- 172.21.15.50:0/2193415211 learned_addr learned my addr 172.21.15.50:0/2193415211 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:07.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.601+0000 7f25f18c8700 1 --2- 172.21.15.50:0/2193415211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e191bc880 0x556e191bfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:07.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.601+0000 7f25f18c8700 1 -- 172.21.15.50:0/2193415211 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e191bbf60 msgr2=0x556e191bf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:07.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.601+0000 7f25f18c8700 1 --2- 172.21.15.50:0/2193415211 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e191bbf60 0x556e191bf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:07.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.601+0000 7f25f18c8700 1 -- 172.21.15.50:0/2193415211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e191b67a0 msgr2=0x556e191c2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:07.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.601+0000 7f25f18c8700 1 --2- 172.21.15.50:0/2193415211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e191b67a0 0x556e191c2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:07.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.601+0000 7f25f18c8700 1 -- 172.21.15.50:0/2193415211 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e190cd750 con 0x556e191bc880 2024-06-06T03:28:07.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.601+0000 7f25f08c6700 1 --2- 172.21.15.50:0/2193415211 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e191bbf60 0x556e191bf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:28:07.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.601+0000 7f25f18c8700 1 --2- 172.21.15.50:0/2193415211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e191bc880 0x556e191bfe50 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f25e40ce170 tx=0x7f25e409c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee88b25ce6f091e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:07.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.601+0000 7f25d4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:28:07.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.602+0000 7f25d4ff9700 1 -- 172.21.15.50:0/2193415211 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e409d2f0 con 0x556e191bc880 2024-06-06T03:28:07.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.602+0000 7f25d4ff9700 1 -- 172.21.15.50:0/2193415211 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f25e409aef0 con 0x556e191bc880 2024-06-06T03:28:07.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.602+0000 7f25fdbaeb80 1 -- 172.21.15.50:0/2193415211 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25dc019ae0 con 0x556e191bc880 2024-06-06T03:28:07.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.602+0000 7f25d4ff9700 1 -- 172.21.15.50:0/2193415211 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f25e40ba030 con 0x556e191bc880 2024-06-06T03:28:07.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.602+0000 7f25fdbaeb80 10 client.15669 fetch_fsmap learned FSMap version 27 2024-06-06T03:28:07.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.602+0000 7f25fdbaeb80 1 -- 172.21.15.50:0/2193415211 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556e191cda40 con 0x556e191bc880 2024-06-06T03:28:07.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.602+0000 7f25d4ff9700 1 -- 172.21.15.50:0/2193415211 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f25e40b4020 con 0x556e191bc880 2024-06-06T03:28:07.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.603+0000 7f25d4ff9700 1 -- 172.21.15.50:0/2193415211 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f25e4011070 con 0x556e191bc880 2024-06-06T03:28:07.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.603+0000 7f25fdbaeb80 10 client.15669 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:28:07.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.603+0000 7f25fdbaeb80 10 client.15669 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-06-06T03:28:07.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.603+0000 7f25fdbaeb80 20 client.15669 populate_metadata read hostname 'smithi050' 2024-06-06T03:28:07.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.603+0000 7f25fdbaeb80 1 --2- 172.21.15.50:0/2193415211 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x556e191d0050 0x556e191d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:07.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.603+0000 7f25fdbaeb80 4 client.15669 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:28:07.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.603+0000 7f25fdbaeb80 1 -- 172.21.15.50:0/2193415211 --> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f25dc019ae0 con 0x556e191d0050 2024-06-06T03:28:07.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.603+0000 7f25f10c7700 1 --2- 172.21.15.50:0/2193415211 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x556e191d0050 0x556e191d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:07.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.603+0000 7f25f10c7700 1 --2- 172.21.15.50:0/2193415211 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x556e191d0050 0x556e191d2470 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e81d46ab13a3aea8 server_cookie=3bd371d1fe5e1d5e in_seq=0 out_seq=0 2024-06-06T03:28:07.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.603+0000 7f25d4ff9700 10 client.15669 ms_handle_connect on v2:172.21.15.122:6834/2987597320 2024-06-06T03:28:07.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.604+0000 7f25d4ff9700 1 -- 172.21.15.50:0/2193415211 <== mds.2 v2:172.21.15.122:6834/2987597320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x7f25dc019ae0 con 0x556e191d0050 2024-06-06T03:28:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.604+0000 7f25d4ff9700 10 client.15669 handle_command_reply: tid=0 2024-06-06T03:28:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.604+0000 7f25fdbaeb80 1 client.15669 shutdown 2024-06-06T03:28:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.605+0000 7f25fdbaeb80 1 -- 172.21.15.50:0/2193415211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e191bc880 msgr2=0x556e191bfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.605+0000 7f25fdbaeb80 1 --2- 172.21.15.50:0/2193415211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e191bc880 0x556e191bfe50 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f25e40ce170 tx=0x7f25e409c730 comp rx=0 tx=0).stop 2024-06-06T03:28:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.605+0000 7f25fdbaeb80 1 -- 172.21.15.50:0/2193415211 shutdown_connections 2024-06-06T03:28:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.605+0000 7f25fdbaeb80 1 --2- 172.21.15.50:0/2193415211 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x556e191d0050 0x556e191d2470 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.605+0000 7f25fdbaeb80 1 --2- 172.21.15.50:0/2193415211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e191bc880 0x556e191bfe50 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.605+0000 7f25fdbaeb80 1 --2- 172.21.15.50:0/2193415211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e191b67a0 0x556e191c2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.605+0000 7f25fdbaeb80 1 --2- 172.21.15.50:0/2193415211 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e191bbf60 0x556e191bf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.605+0000 7f25fdbaeb80 1 -- 172.21.15.50:0/2193415211 >> 172.21.15.50:0/2193415211 conn(0x556e190e3080 msgr2=0x556e191b0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.605+0000 7f25d4ff9700 0 client.15669 ms_handle_reset on v2:172.21.15.122:6834/2987597320 2024-06-06T03:28:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.605+0000 7f25fdbaeb80 1 -- 172.21.15.50:0/2193415211 shutdown_connections 2024-06-06T03:28:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.605+0000 7f25fdbaeb80 1 -- 172.21.15.50:0/2193415211 wait complete. 2024-06-06T03:28:07.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.605+0000 7f25fdbaeb80 20 client.15669 trim_cache size 0 max 16384 2024-06-06T03:28:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.623+0000 7f25fdbaeb80 1 Processor -- start 2024-06-06T03:28:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.623+0000 7f25fdbaeb80 1 -- start start 2024-06-06T03:28:07.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.624+0000 7f25fdbaeb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e191b67a0 0x556e191b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:07.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.624+0000 7f25fdbaeb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e191bbf60 0x556e191b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:07.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.624+0000 7f25fdbaeb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e191bc880 0x556e191bcd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:07.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.624+0000 7f25fdbaeb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f25ec1b6f70 con 0x556e191bc880 2024-06-06T03:28:07.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.624+0000 7f25fdbaeb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f25ec1b4800 con 0x556e191b67a0 2024-06-06T03:28:07.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.624+0000 7f25fdbaeb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f25ec1b2650 con 0x556e191bbf60 2024-06-06T03:28:07.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.624+0000 7f25f10c7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e191b67a0 0x556e191b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:07.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.624+0000 7f25f10c7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e191b67a0 0x556e191b0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:41896/0 (socket says 172.21.15.50:41896) 2024-06-06T03:28:07.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.624+0000 7f25f10c7700 1 -- 172.21.15.50:0/1463531277 learned_addr learned my addr 172.21.15.50:0/1463531277 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:07.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.624+0000 7f25f08c6700 1 --2- 172.21.15.50:0/1463531277 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e191bbf60 0x556e191b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:07.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.624+0000 7f25f10c7700 1 -- 172.21.15.50:0/1463531277 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e191bbf60 msgr2=0x556e191b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:07.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.624+0000 7f25f10c7700 1 --2- 172.21.15.50:0/1463531277 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e191bbf60 0x556e191b13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:07.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.624+0000 7f25f10c7700 1 -- 172.21.15.50:0/1463531277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e191bc880 msgr2=0x556e191bcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:07.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.625+0000 7f25f18c8700 1 --2- 172.21.15.50:0/1463531277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e191bc880 0x556e191bcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:07.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.625+0000 7f25f10c7700 1 --2- 172.21.15.50:0/1463531277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e191bc880 0x556e191bcd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:07.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.625+0000 7f25f10c7700 1 -- 172.21.15.50:0/1463531277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e191bf6e0 con 0x556e191b67a0 2024-06-06T03:28:07.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.625+0000 7f25f18c8700 1 --2- 172.21.15.50:0/1463531277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e191bc880 0x556e191bcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:28:07.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.625+0000 7f25f10c7700 1 --2- 172.21.15.50:0/1463531277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e191b67a0 0x556e191b0e80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f25e8010760 tx=0x7f25e8013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee075c6f92718d06 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:07.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.625+0000 7f25d6ffd700 1 -- 172.21.15.50:0/1463531277 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e8011c70 con 0x556e191b67a0 2024-06-06T03:28:07.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.625+0000 7f25d6ffd700 1 -- 172.21.15.50:0/1463531277 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f25e8011e10 con 0x556e191b67a0 2024-06-06T03:28:07.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.625+0000 7f25d6ffd700 1 -- 172.21.15.50:0/1463531277 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e8005280 con 0x556e191b67a0 2024-06-06T03:28:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.626+0000 7f25fdbaeb80 1 -- 172.21.15.50:0/1463531277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e191b67a0 msgr2=0x556e191b0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.626+0000 7f25fdbaeb80 1 --2- 172.21.15.50:0/1463531277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e191b67a0 0x556e191b0e80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f25e8010760 tx=0x7f25e8013000 comp rx=0 tx=0).stop 2024-06-06T03:28:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.626+0000 7f25fdbaeb80 1 -- 172.21.15.50:0/1463531277 shutdown_connections 2024-06-06T03:28:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.626+0000 7f25fdbaeb80 1 --2- 172.21.15.50:0/1463531277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e191bc880 0x556e191bcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.626+0000 7f25fdbaeb80 1 --2- 172.21.15.50:0/1463531277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e191b67a0 0x556e191b0e80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.626+0000 7f25fdbaeb80 1 --2- 172.21.15.50:0/1463531277 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e191bbf60 0x556e191b13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.626+0000 7f25fdbaeb80 1 -- 172.21.15.50:0/1463531277 >> 172.21.15.50:0/1463531277 conn(0x556e190e3080 msgr2=0x556e191be200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.626+0000 7f25fdbaeb80 1 -- 172.21.15.50:0/1463531277 shutdown_connections 2024-06-06T03:28:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.626+0000 7f25fdbaeb80 1 -- 172.21.15.50:0/1463531277 wait complete. 2024-06-06T03:28:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.627+0000 7f25fdbaeb80 1 -- start start 2024-06-06T03:28:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.627+0000 7f25fdbaeb80 1 Processor -- start 2024-06-06T03:28:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.628+0000 7f25fdbaeb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e191b67a0 0x556e191c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.628+0000 7f25fdbaeb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e191bbf60 0x556e191d7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.628+0000 7f25fdbaeb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e191bc880 0x556e191d7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.628+0000 7f25f10c7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e191b67a0 0x556e191c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.628+0000 7f25f08c6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e191bbf60 0x556e191d7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.628+0000 7f25f10c7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e191b67a0 0x556e191c8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:41902/0 (socket says 172.21.15.50:41902) 2024-06-06T03:28:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.628+0000 7f25f08c6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e191bbf60 0x556e191d7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48740/0 (socket says 172.21.15.50:48740) 2024-06-06T03:28:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.628+0000 7f25f10c7700 1 -- 172.21.15.50:0/3363950434 learned_addr learned my addr 172.21.15.50:0/3363950434 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.628+0000 7f25fdbaeb80 1 -- 172.21.15.50:0/3363950434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f25ec1b2cc0 con 0x556e191bbf60 2024-06-06T03:28:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.628+0000 7f25fdbaeb80 1 -- 172.21.15.50:0/3363950434 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f25ec1b4130 con 0x556e191b67a0 2024-06-06T03:28:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.628+0000 7f25fdbaeb80 1 -- 172.21.15.50:0/3363950434 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f25ec1b3390 con 0x556e191bc880 2024-06-06T03:28:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.628+0000 7f25f10c7700 1 -- 172.21.15.50:0/3363950434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e191bc880 msgr2=0x556e191d7970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:28:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.629+0000 7f25fdbaeb80 10 client.0 _ll_register_callbacks cb 0x556e1909d5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:28:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.629+0000 7f25f10c7700 1 --2- 172.21.15.50:0/3363950434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e191bc880 0x556e191d7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:07.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.629+0000 7f25f10c7700 1 -- 172.21.15.50:0/3363950434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e191bbf60 msgr2=0x556e191d7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:07.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.629+0000 7f25f10c7700 1 --2- 172.21.15.50:0/3363950434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e191bbf60 0x556e191d7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:07.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.629+0000 7f25f10c7700 1 -- 172.21.15.50:0/3363950434 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e191d7f60 con 0x556e191b67a0 2024-06-06T03:28:07.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.629+0000 7f25f08c6700 1 --2- 172.21.15.50:0/3363950434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e191bbf60 0x556e191d7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:28:07.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.629+0000 7f25fdbaeb80 1 -- 172.21.15.50:0/3363950434 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25e8011e10 con 0x556e191b67a0 2024-06-06T03:28:07.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.629+0000 7f25f10c7700 1 --2- 172.21.15.50:0/3363950434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e191b67a0 0x556e191c8ad0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f25e8009a90 tx=0x7f25e8010e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72187c9202d4757b server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:07.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.629+0000 7f25d4ff9700 10 client.25268 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:28:07.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.629+0000 7f25d4ff9700 1 -- 172.21.15.50:0/3363950434 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e803a020 con 0x556e191b67a0 2024-06-06T03:28:07.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.629+0000 7f25d4ff9700 1 -- 172.21.15.50:0/3363950434 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f25e8004b60 con 0x556e191b67a0 2024-06-06T03:28:07.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.630+0000 7f25d4ff9700 1 -- 172.21.15.50:0/3363950434 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f25e8011c60 con 0x556e191b67a0 2024-06-06T03:28:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.630+0000 7f25fdbaeb80 10 client.25268 fetch_fsmap learned FSMap version 27 2024-06-06T03:28:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.630+0000 7f25fdbaeb80 1 -- 172.21.15.50:0/3363950434 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=27}) -- 0x556e1923a960 con 0x556e191b67a0 2024-06-06T03:28:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.630+0000 7f25d4ff9700 1 -- 172.21.15.50:0/3363950434 <== mon.2 v2:172.21.15.79:3300/0 4 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f25e8005020 con 0x556e191b67a0 2024-06-06T03:28:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.630+0000 7f25fdbaeb80 10 client.25268 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T03:28:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.630+0000 7f25fdbaeb80 10 client.25268 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-06-06T03:28:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.630+0000 7f25fdbaeb80 20 client.25268 populate_metadata read hostname 'smithi050' 2024-06-06T03:28:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.630+0000 7f25fdbaeb80 1 --2- 172.21.15.50:0/3363950434 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x556e1923af00 0x556e1923d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.630+0000 7f25fdbaeb80 4 client.25268 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:28:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.631+0000 7f25fdbaeb80 1 -- 172.21.15.50:0/3363950434 --> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556e19114d50 con 0x556e1923af00 2024-06-06T03:28:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.631+0000 7f25f08c6700 1 --2- 172.21.15.50:0/3363950434 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x556e1923af00 0x556e1923d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.632+0000 7f25d4ff9700 10 client.25268 ms_handle_connect on v2:172.21.15.122:6834/2987597320 2024-06-06T03:28:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.632+0000 7f25f08c6700 1 --2- 172.21.15.50:0/3363950434 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x556e1923af00 0x556e1923d2f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=11a9ce497fa59184 server_cookie=71beae4c74514488 in_seq=0 out_seq=0 2024-06-06T03:28:07.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.632+0000 7f25d4ff9700 1 -- 172.21.15.50:0/3363950434 <== mds.2 v2:172.21.15.122:6834/2987597320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556e19114d50 con 0x556e1923af00 2024-06-06T03:28:07.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.632+0000 7f25d4ff9700 10 client.25268 handle_command_reply: tid=0 2024-06-06T03:28:07.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.633+0000 7f25fdbaeb80 1 client.25268 shutdown 2024-06-06T03:28:07.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.633+0000 7f25fdbaeb80 1 -- 172.21.15.50:0/3363950434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e191b67a0 msgr2=0x556e191c8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:07.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.633+0000 7f25fdbaeb80 1 --2- 172.21.15.50:0/3363950434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e191b67a0 0x556e191c8ad0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f25e8009a90 tx=0x7f25e8010e80 comp rx=0 tx=0).stop 2024-06-06T03:28:07.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.633+0000 7f25fdbaeb80 1 -- 172.21.15.50:0/3363950434 shutdown_connections 2024-06-06T03:28:07.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.633+0000 7f25fdbaeb80 1 --2- 172.21.15.50:0/3363950434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e191bc880 0x556e191d7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:07.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.633+0000 7f25fdbaeb80 1 --2- 172.21.15.50:0/3363950434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e191b67a0 0x556e191c8ad0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:07.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.634+0000 7f25fdbaeb80 1 --2- 172.21.15.50:0/3363950434 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x556e1923af00 0x556e1923d2f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:07.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.634+0000 7f25fdbaeb80 1 --2- 172.21.15.50:0/3363950434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e191bbf60 0x556e191d7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:07.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.634+0000 7f25d4ff9700 0 client.25268 ms_handle_reset on v2:172.21.15.122:6834/2987597320 2024-06-06T03:28:07.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.634+0000 7f25fdbaeb80 1 -- 172.21.15.50:0/3363950434 >> 172.21.15.50:0/3363950434 conn(0x556e190e3080 msgr2=0x556e191bcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:07.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.634+0000 7f25fdbaeb80 1 -- 172.21.15.50:0/3363950434 shutdown_connections 2024-06-06T03:28:07.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.634+0000 7f25fdbaeb80 1 -- 172.21.15.50:0/3363950434 wait complete. 2024-06-06T03:28:07.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.634+0000 7f25fdbaeb80 20 client.25268 trim_cache size 0 max 16384 2024-06-06T03:28:07.636 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:28:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.635+0000 7f25f332b700 1 -- 172.21.15.50:0/4193590292 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f25d80a2ca0 msgr2=0x7f25d80a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.635+0000 7f25f332b700 1 --2- 172.21.15.50:0/4193590292 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f25d80a2ca0 0x7f25d80a5160 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f25e8009bd0 tx=0x7f25e8009260 comp rx=0 tx=0).stop 2024-06-06T03:28:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.635+0000 7f25f332b700 1 -- 172.21.15.50:0/4193590292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25ec1073f0 msgr2=0x7f25ec19c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.635+0000 7f25f332b700 1 --2- 172.21.15.50:0/4193590292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25ec1073f0 0x7f25ec19c7e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f25e400b6c0 tx=0x7f25e400cc30 comp rx=0 tx=0).stop 2024-06-06T03:28:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.635+0000 7f25f332b700 1 -- 172.21.15.50:0/4193590292 shutdown_connections 2024-06-06T03:28:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.635+0000 7f25f332b700 1 --2- 172.21.15.50:0/4193590292 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f25d80a2ca0 0x7f25d80a5160 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.636+0000 7f25f332b700 1 --2- 172.21.15.50:0/4193590292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25ec1073f0 0x7f25ec19c7e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.636+0000 7f25f332b700 1 --2- 172.21.15.50:0/4193590292 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25ec101380 0x7f25ec197790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.636+0000 7f25f332b700 1 --2- 172.21.15.50:0/4193590292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25ec101d40 0x7f25ec197cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.636+0000 7f25f332b700 1 -- 172.21.15.50:0/4193590292 >> 172.21.15.50:0/4193590292 conn(0x7f25ec078300 msgr2=0x7f25ec0fff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:07.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.636+0000 7f25f332b700 1 -- 172.21.15.50:0/4193590292 shutdown_connections 2024-06-06T03:28:07.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:07.636+0000 7f25f332b700 1 -- 172.21.15.50:0/4193590292 wait complete. 2024-06-06T03:28:08.487 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-06-06T03:28:08.872 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:28:09.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:08 smithi079 ceph-mon[35478]: pgmap v476: 129 pgs: 129 active+clean; 834 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 69 MiB/s wr, 47 op/s 2024-06-06T03:28:09.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:08 smithi079 ceph-mon[35478]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:28:09.155 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:08 smithi050 ceph-mon[32421]: pgmap v476: 129 pgs: 129 active+clean; 834 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 69 MiB/s wr, 47 op/s 2024-06-06T03:28:09.156 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:08 smithi050 ceph-mon[32421]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:28:09.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:08 smithi122 ceph-mon[35759]: pgmap v476: 129 pgs: 129 active+clean; 834 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 69 MiB/s wr, 47 op/s 2024-06-06T03:28:09.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:08 smithi122 ceph-mon[35759]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:28:09.560 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.558+0000 7fb89ed4f640 1 -- 172.21.15.50:0/2746479265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8981024e0 msgr2=0x7fb8981048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:09.560 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.558+0000 7fb89ed4f640 1 --2- 172.21.15.50:0/2746479265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8981024e0 0x7fb8981048d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb88c009900 tx=0x7fb88c02a3f0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.560 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.558+0000 7fb89ed4f640 1 -- 172.21.15.50:0/2746479265 shutdown_connections 2024-06-06T03:28:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.558+0000 7fb89ed4f640 1 --2- 172.21.15.50:0/2746479265 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb898107740 0x7fb898109b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.558+0000 7fb89ed4f640 1 --2- 172.21.15.50:0/2746479265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb898104e10 0x7fb898107200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.558+0000 7fb89ed4f640 1 --2- 172.21.15.50:0/2746479265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8981024e0 0x7fb8981048d0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.558+0000 7fb89ed4f640 1 -- 172.21.15.50:0/2746479265 >> 172.21.15.50:0/2746479265 conn(0x7fb8980fbe70 msgr2=0x7fb8980fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.558+0000 7fb89ed4f640 1 -- 172.21.15.50:0/2746479265 shutdown_connections 2024-06-06T03:28:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.558+0000 7fb89ed4f640 1 -- 172.21.15.50:0/2746479265 wait complete. 2024-06-06T03:28:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.559+0000 7fb89ed4f640 1 Processor -- start 2024-06-06T03:28:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.559+0000 7fb89ed4f640 1 -- start start 2024-06-06T03:28:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.559+0000 7fb89ed4f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8981024e0 0x7fb898197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.559+0000 7fb89ed4f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb898104e10 0x7fb898198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.559+0000 7fb89ed4f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb898107740 0x7fb89819f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.559+0000 7fb89ed4f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb89810d620 con 0x7fb898104e10 2024-06-06T03:28:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.559+0000 7fb89ed4f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb89810d4a0 con 0x7fb898107740 2024-06-06T03:28:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.559+0000 7fb89ed4f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb89810d7a0 con 0x7fb8981024e0 2024-06-06T03:28:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.559+0000 7fb897fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb898104e10 0x7fb898198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.559+0000 7fb897fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb898104e10 0x7fb898198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55854/0 (socket says 172.21.15.50:55854) 2024-06-06T03:28:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.559+0000 7fb897fff640 1 -- 172.21.15.50:0/1953956193 learned_addr learned my addr 172.21.15.50:0/1953956193 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.560+0000 7fb89d2ec640 1 --2- 172.21.15.50:0/1953956193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb898107740 0x7fb89819f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.560+0000 7fb89caeb640 1 --2- 172.21.15.50:0/1953956193 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8981024e0 0x7fb898197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.560+0000 7fb897fff640 1 -- 172.21.15.50:0/1953956193 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8981024e0 msgr2=0x7fb898197d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.560+0000 7fb897fff640 1 --2- 172.21.15.50:0/1953956193 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8981024e0 0x7fb898197d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.560+0000 7fb897fff640 1 -- 172.21.15.50:0/1953956193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb898107740 msgr2=0x7fb89819f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.560+0000 7fb897fff640 1 --2- 172.21.15.50:0/1953956193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb898107740 0x7fb89819f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.560+0000 7fb897fff640 1 -- 172.21.15.50:0/1953956193 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb89819f970 con 0x7fb898104e10 2024-06-06T03:28:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.560+0000 7fb897fff640 1 --2- 172.21.15.50:0/1953956193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb898104e10 0x7fb898198290 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb88400b450 tx=0x7fb88400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.560+0000 7fb895ffb640 1 -- 172.21.15.50:0/1953956193 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb884015020 con 0x7fb898104e10 2024-06-06T03:28:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.560+0000 7fb895ffb640 1 -- 172.21.15.50:0/1953956193 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb884011d40 con 0x7fb898104e10 2024-06-06T03:28:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.561+0000 7fb895ffb640 1 -- 172.21.15.50:0/1953956193 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb88400f340 con 0x7fb898104e10 2024-06-06T03:28:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.561+0000 7fb89ed4f640 1 -- 172.21.15.50:0/1953956193 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb89819fc60 con 0x7fb898104e10 2024-06-06T03:28:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.561+0000 7fb89ed4f640 1 -- 172.21.15.50:0/1953956193 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8981a0230 con 0x7fb898104e10 2024-06-06T03:28:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.564+0000 7fb895ffb640 1 -- 172.21.15.50:0/1953956193 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb884018020 con 0x7fb898104e10 2024-06-06T03:28:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.565+0000 7fb8a1a56740 1 Processor -- start 2024-06-06T03:28:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.565+0000 7fb8a1a56740 1 -- start start 2024-06-06T03:28:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.565+0000 7fb8a1a56740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56442a425010 0x56442a425430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.565+0000 7fb8a1a56740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56442a425a00 0x56442a42a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.565+0000 7fb8a1a56740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56442a42ab70 0x56442a42d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.565+0000 7fb8a1a56740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56442a3884f0 con 0x56442a425a00 2024-06-06T03:28:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.565+0000 7fb8a1a56740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56442a326870 con 0x56442a425010 2024-06-06T03:28:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.565+0000 7fb8a1a56740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56442a3844b0 con 0x56442a42ab70 2024-06-06T03:28:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.565+0000 7fb89caeb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56442a425a00 0x56442a42a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.565+0000 7fb89caeb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56442a425a00 0x56442a42a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55856/0 (socket says 172.21.15.50:55856) 2024-06-06T03:28:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.565+0000 7fb89caeb640 1 -- 172.21.15.50:0/1791984829 learned_addr learned my addr 172.21.15.50:0/1791984829 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.565+0000 7fb897fff640 1 --2- 172.21.15.50:0/1791984829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56442a42ab70 0x56442a42d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.565+0000 7fb89d2ec640 1 --2- 172.21.15.50:0/1791984829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56442a425010 0x56442a425430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.566+0000 7fb895ffb640 1 --2- 172.21.15.50:0/1953956193 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb8880a2cb0 0x7fb8880a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.566+0000 7fb89d2ec640 1 -- 172.21.15.50:0/1791984829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56442a42ab70 msgr2=0x56442a42d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.566+0000 7fb89d2ec640 1 --2- 172.21.15.50:0/1791984829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56442a42ab70 0x56442a42d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.566+0000 7fb89d2ec640 1 -- 172.21.15.50:0/1791984829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56442a425a00 msgr2=0x56442a42a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.566+0000 7fb89d2ec640 1 --2- 172.21.15.50:0/1791984829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56442a425a00 0x56442a42a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.566+0000 7fb89d2ec640 1 -- 172.21.15.50:0/1791984829 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56442a3429b0 con 0x56442a425010 2024-06-06T03:28:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.566+0000 7fb89caeb640 1 --2- 172.21.15.50:0/1791984829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56442a425a00 0x56442a42a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:28:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.566+0000 7fb897fff640 1 --2- 172.21.15.50:0/1791984829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56442a42ab70 0x56442a42d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:28:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.566+0000 7fb895ffb640 1 -- 172.21.15.50:0/1953956193 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fb8840ced30 con 0x7fb898104e10 2024-06-06T03:28:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.566+0000 7fb89d2ec640 1 --2- 172.21.15.50:0/1953956193 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb8880a2cb0 0x7fb8880a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.567+0000 7fb89d2ec640 1 --2- 172.21.15.50:0/1791984829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56442a425010 0x56442a425430 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb890009f70 tx=0x7fb890009650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c76cbfdecba1aedd server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.567+0000 7fb89d2ec640 1 --2- 172.21.15.50:0/1953956193 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb8880a2cb0 0x7fb8880a5170 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb890008000 tx=0x7fb890013000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.567+0000 7fb882ffd640 1 -- 172.21.15.50:0/1791984829 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb890026070 con 0x56442a425010 2024-06-06T03:28:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.567+0000 7fb882ffd640 1 -- 172.21.15.50:0/1791984829 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb890011450 con 0x56442a425010 2024-06-06T03:28:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.568+0000 7fb882ffd640 1 -- 172.21.15.50:0/1791984829 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb890021e10 con 0x56442a425010 2024-06-06T03:28:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.568+0000 7fb8a1a56740 1 -- 172.21.15.50:0/1791984829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56442a425010 msgr2=0x56442a425430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.568+0000 7fb8a1a56740 1 --2- 172.21.15.50:0/1791984829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56442a425010 0x56442a425430 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb890009f70 tx=0x7fb890009650 comp rx=0 tx=0).stop 2024-06-06T03:28:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.568+0000 7fb8a1a56740 1 -- 172.21.15.50:0/1791984829 shutdown_connections 2024-06-06T03:28:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.568+0000 7fb8a1a56740 1 --2- 172.21.15.50:0/1791984829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56442a425a00 0x56442a42a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.568+0000 7fb8a1a56740 1 --2- 172.21.15.50:0/1791984829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56442a42ab70 0x56442a42d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.568+0000 7fb8a1a56740 1 --2- 172.21.15.50:0/1791984829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56442a425010 0x56442a425430 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.568+0000 7fb8a1a56740 1 -- 172.21.15.50:0/1791984829 >> 172.21.15.50:0/1791984829 conn(0x56442a420680 msgr2=0x56442a420a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.568+0000 7fb8a1a56740 1 -- 172.21.15.50:0/1791984829 shutdown_connections 2024-06-06T03:28:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.568+0000 7fb8a1a56740 1 -- 172.21.15.50:0/1791984829 wait complete. 2024-06-06T03:28:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.569+0000 7fb8a1a56740 1 -- start start 2024-06-06T03:28:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.569+0000 7fb8a1a56740 1 Processor -- start 2024-06-06T03:28:09.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.570+0000 7fb8a1a56740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56442a425010 0x56442a42f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:09.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.570+0000 7fb8a1a56740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56442a425a00 0x56442a42f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:09.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.570+0000 7fb8a1a56740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56442a42ab70 0x56442a436890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:09.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.570+0000 7fb8a1a56740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56442a42dbc0 con 0x56442a425a00 2024-06-06T03:28:09.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.570+0000 7fb8a1a56740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56442a311ae0 con 0x56442a42ab70 2024-06-06T03:28:09.574 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.570+0000 7fb8a1a56740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56442a42dd40 con 0x56442a425010 2024-06-06T03:28:09.574 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.570+0000 7fb8a1a56740 10 client.0 _ll_register_callbacks cb 0x56442a34a9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:28:09.574 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.570+0000 7fb897fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56442a425a00 0x56442a42f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:09.574 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.570+0000 7fb897fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56442a425a00 0x56442a42f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55858/0 (socket says 172.21.15.50:55858) 2024-06-06T03:28:09.574 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.570+0000 7fb897fff640 1 -- 172.21.15.50:0/3509514499 learned_addr learned my addr 172.21.15.50:0/3509514499 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:09.574 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.570+0000 7fb89caeb640 1 --2- 172.21.15.50:0/3509514499 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56442a425010 0x56442a42f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:09.574 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.570+0000 7fb89d2ec640 1 --2- 172.21.15.50:0/3509514499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56442a42ab70 0x56442a436890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:09.574 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.571+0000 7fb897fff640 1 -- 172.21.15.50:0/3509514499 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56442a425010 msgr2=0x56442a42f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:09.574 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.571+0000 7fb897fff640 1 --2- 172.21.15.50:0/3509514499 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56442a425010 0x56442a42f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.574 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.571+0000 7fb897fff640 1 -- 172.21.15.50:0/3509514499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56442a42ab70 msgr2=0x56442a436890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:09.574 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.571+0000 7fb897fff640 1 --2- 172.21.15.50:0/3509514499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56442a42ab70 0x56442a436890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.574 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.571+0000 7fb897fff640 1 -- 172.21.15.50:0/3509514499 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56442a09c210 con 0x56442a425a00 2024-06-06T03:28:09.574 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.571+0000 7fb897fff640 1 --2- 172.21.15.50:0/3509514499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56442a425a00 0x56442a42f850 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb884097670 tx=0x7fb88409f8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e50929b1e73868 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:09.575 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.571+0000 7fb877fff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:28:09.575 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.571+0000 7fb877fff640 1 -- 172.21.15.50:0/3509514499 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb88409b210 con 0x56442a425a00 2024-06-06T03:28:09.575 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.571+0000 7fb877fff640 1 -- 172.21.15.50:0/3509514499 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fb884010570 con 0x56442a425a00 2024-06-06T03:28:09.575 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.571+0000 7fb8a1a56740 1 -- 172.21.15.50:0/3509514499 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56442a39bf10 con 0x56442a425a00 2024-06-06T03:28:09.575 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.571+0000 7fb877fff640 1 -- 172.21.15.50:0/3509514499 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb8840a3e80 con 0x56442a425a00 2024-06-06T03:28:09.575 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.571+0000 7fb8a1a56740 10 client.15684 fetch_fsmap learned FSMap version 28 2024-06-06T03:28:09.575 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.571+0000 7fb8a1a56740 1 -- 172.21.15.50:0/3509514499 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56442a168620 con 0x56442a425a00 2024-06-06T03:28:09.575 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.572+0000 7fb877fff640 1 -- 172.21.15.50:0/3509514499 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x56442a39bf10 con 0x56442a425a00 2024-06-06T03:28:09.575 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.572+0000 7fb877fff640 1 -- 172.21.15.50:0/3509514499 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7fb88409a660 con 0x56442a425a00 2024-06-06T03:28:09.575 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.572+0000 7fb8a1a56740 10 client.15684 fetch_fsmap finished waiting for FSMap version 28 2024-06-06T03:28:09.575 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.572+0000 7fb8a1a56740 10 client.15684 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:28:09.575 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.572+0000 7fb8a1a56740 20 client.15684 populate_metadata read hostname 'smithi050' 2024-06-06T03:28:09.576 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.572+0000 7fb8a1a56740 1 --2- 172.21.15.50:0/3509514499 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56442a43b150 0x56442a43d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:09.576 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.572+0000 7fb8a1a56740 4 client.15684 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:28:09.576 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.572+0000 7fb8a1a56740 1 -- 172.21.15.50:0/3509514499 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56442a395c20 con 0x56442a43b150 2024-06-06T03:28:09.576 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.572+0000 7fb89caeb640 1 --2- 172.21.15.50:0/3509514499 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56442a43b150 0x56442a43d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:09.576 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.573+0000 7fb877fff640 10 client.15684 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:09.576 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.573+0000 7fb89caeb640 1 --2- 172.21.15.50:0/3509514499 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56442a43b150 0x56442a43d540 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d770b63473d4f627 server_cookie=7c79fed168aaa4fc in_seq=0 out_seq=0 2024-06-06T03:28:09.576 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.573+0000 7fb877fff640 1 -- 172.21.15.50:0/3509514499 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x56442a395c20 con 0x56442a43b150 2024-06-06T03:28:09.576 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.573+0000 7fb877fff640 10 client.15684 handle_command_reply: tid=0 2024-06-06T03:28:09.576 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.574+0000 7fb8a1a56740 1 client.15684 shutdown 2024-06-06T03:28:09.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.574+0000 7fb8a1a56740 1 -- 172.21.15.50:0/3509514499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56442a425a00 msgr2=0x56442a42f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:09.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.574+0000 7fb8a1a56740 1 --2- 172.21.15.50:0/3509514499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56442a425a00 0x56442a42f850 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb884097670 tx=0x7fb88409f8e0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.574+0000 7fb8a1a56740 1 -- 172.21.15.50:0/3509514499 shutdown_connections 2024-06-06T03:28:09.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.574+0000 7fb8a1a56740 1 --2- 172.21.15.50:0/3509514499 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56442a43b150 0x56442a43d540 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.574+0000 7fb8a1a56740 1 --2- 172.21.15.50:0/3509514499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56442a425a00 0x56442a42f850 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.574+0000 7fb877fff640 0 client.15684 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:09.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.574+0000 7fb8a1a56740 1 --2- 172.21.15.50:0/3509514499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56442a42ab70 0x56442a436890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.574+0000 7fb8a1a56740 1 --2- 172.21.15.50:0/3509514499 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56442a425010 0x56442a42f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.574+0000 7fb8a1a56740 1 -- 172.21.15.50:0/3509514499 >> 172.21.15.50:0/3509514499 conn(0x56442a420680 msgr2=0x56442a41f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:09.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.574+0000 7fb8a1a56740 1 -- 172.21.15.50:0/3509514499 shutdown_connections 2024-06-06T03:28:09.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.574+0000 7fb8a1a56740 1 -- 172.21.15.50:0/3509514499 wait complete. 2024-06-06T03:28:09.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.574+0000 7fb8a1a56740 20 client.15684 trim_cache size 0 max 16384 2024-06-06T03:28:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.601+0000 7fb8a1a56740 1 Processor -- start 2024-06-06T03:28:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.601+0000 7fb8a1a56740 1 -- start start 2024-06-06T03:28:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.601+0000 7fb8a1a56740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56442a425010 0x56442a42f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.601+0000 7fb8a1a56740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56442a425a00 0x56442a42f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.601+0000 7fb8a1a56740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56442a42ab70 0x56442a436850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.601+0000 7fb8a1a56740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb8981acf20 con 0x56442a425010 2024-06-06T03:28:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.601+0000 7fb8a1a56740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb8981aa7f0 con 0x56442a42ab70 2024-06-06T03:28:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.601+0000 7fb8a1a56740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb8981a8640 con 0x56442a425a00 2024-06-06T03:28:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.601+0000 7fb89caeb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56442a425010 0x56442a42f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.601+0000 7fb89caeb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56442a425010 0x56442a42f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55868/0 (socket says 172.21.15.50:55868) 2024-06-06T03:28:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.601+0000 7fb89caeb640 1 -- 172.21.15.50:0/3217402206 learned_addr learned my addr 172.21.15.50:0/3217402206 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.601+0000 7fb897fff640 1 --2- 172.21.15.50:0/3217402206 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56442a425a00 0x56442a42f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:09.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.602+0000 7fb89caeb640 1 -- 172.21.15.50:0/3217402206 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56442a425a00 msgr2=0x56442a42f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:09.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.602+0000 7fb89caeb640 1 --2- 172.21.15.50:0/3217402206 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56442a425a00 0x56442a42f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.602+0000 7fb89caeb640 1 -- 172.21.15.50:0/3217402206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56442a42ab70 msgr2=0x56442a436850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:09.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.602+0000 7fb89caeb640 1 --2- 172.21.15.50:0/3217402206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56442a42ab70 0x56442a436850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.602+0000 7fb89caeb640 1 -- 172.21.15.50:0/3217402206 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56442a43d8b0 con 0x56442a425010 2024-06-06T03:28:09.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.602+0000 7fb89caeb640 1 --2- 172.21.15.50:0/3217402206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56442a425010 0x56442a42f310 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb88c009340 tx=0x7fb88c031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49c0854bd5dd7c92 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:09.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.603+0000 7fb8827fc640 1 -- 172.21.15.50:0/3217402206 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb88c035040 con 0x56442a425010 2024-06-06T03:28:09.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.603+0000 7fb8827fc640 1 -- 172.21.15.50:0/3217402206 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb88c048470 con 0x56442a425010 2024-06-06T03:28:09.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.603+0000 7fb8827fc640 1 -- 172.21.15.50:0/3217402206 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb88c032280 con 0x56442a425010 2024-06-06T03:28:09.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.605+0000 7fb8a1a56740 1 -- 172.21.15.50:0/3217402206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56442a425010 msgr2=0x56442a42f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:09.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.605+0000 7fb8a1a56740 1 --2- 172.21.15.50:0/3217402206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56442a425010 0x56442a42f310 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb88c009340 tx=0x7fb88c031630 comp rx=0 tx=0).stop 2024-06-06T03:28:09.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.605+0000 7fb8a1a56740 1 -- 172.21.15.50:0/3217402206 shutdown_connections 2024-06-06T03:28:09.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.605+0000 7fb8a1a56740 1 --2- 172.21.15.50:0/3217402206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56442a42ab70 0x56442a436850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.605+0000 7fb8a1a56740 1 --2- 172.21.15.50:0/3217402206 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56442a425a00 0x56442a42f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.605+0000 7fb8a1a56740 1 --2- 172.21.15.50:0/3217402206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56442a425010 0x56442a42f310 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.605+0000 7fb8a1a56740 1 -- 172.21.15.50:0/3217402206 >> 172.21.15.50:0/3217402206 conn(0x56442a420680 msgr2=0x56442a42a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:09.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.605+0000 7fb8a1a56740 1 -- 172.21.15.50:0/3217402206 shutdown_connections 2024-06-06T03:28:09.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.605+0000 7fb8a1a56740 1 -- 172.21.15.50:0/3217402206 wait complete. 2024-06-06T03:28:09.608 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.605+0000 7fb8a1a56740 1 -- start start 2024-06-06T03:28:09.608 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.606+0000 7fb8a1a56740 1 Processor -- start 2024-06-06T03:28:09.608 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.606+0000 7fb8a1a56740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56442a425010 0x56442a433480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:09.608 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.606+0000 7fb8a1a56740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56442a425a00 0x56442a4339c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:09.608 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.606+0000 7fb8a1a56740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56442a42ab70 0x56442a4ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:09.608 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.607+0000 7fb8a1a56740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb8981a8cb0 con 0x56442a42ab70 2024-06-06T03:28:09.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.607+0000 7fb89caeb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56442a425010 0x56442a433480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:09.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.607+0000 7fb8a1a56740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb8981aa120 con 0x56442a425010 2024-06-06T03:28:09.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.607+0000 7fb8a1a56740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb8981a9380 con 0x56442a425a00 2024-06-06T03:28:09.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.607+0000 7fb89caeb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56442a425010 0x56442a433480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:49254/0 (socket says 172.21.15.50:49254) 2024-06-06T03:28:09.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.607+0000 7fb89caeb640 1 -- 172.21.15.50:0/968081541 learned_addr learned my addr 172.21.15.50:0/968081541 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:09.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.607+0000 7fb89d2ec640 1 --2- 172.21.15.50:0/968081541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56442a42ab70 0x56442a4ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:09.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.607+0000 7fb8a1a56740 10 client.0 _ll_register_callbacks cb 0x7fb884010840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:28:09.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.607+0000 7fb897fff640 1 --2- 172.21.15.50:0/968081541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56442a425a00 0x56442a4339c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:09.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.607+0000 7fb89caeb640 1 -- 172.21.15.50:0/968081541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56442a425a00 msgr2=0x56442a4339c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:09.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.607+0000 7fb89caeb640 1 --2- 172.21.15.50:0/968081541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56442a425a00 0x56442a4339c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.607+0000 7fb89caeb640 1 -- 172.21.15.50:0/968081541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56442a42ab70 msgr2=0x56442a4ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:09.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.607+0000 7fb89caeb640 1 --2- 172.21.15.50:0/968081541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56442a42ab70 0x56442a4ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.607+0000 7fb89caeb640 1 -- 172.21.15.50:0/968081541 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56442a436a90 con 0x56442a425010 2024-06-06T03:28:09.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.607+0000 7fb89caeb640 1 --2- 172.21.15.50:0/968081541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56442a425010 0x56442a433480 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb88c006010 tx=0x7fb88c032e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79e333c6ff2d91cb server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:09.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.607+0000 7fb877fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:28:09.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.608+0000 7fb877fff640 1 -- 172.21.15.50:0/968081541 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb88c035070 con 0x56442a425010 2024-06-06T03:28:09.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.608+0000 7fb877fff640 1 -- 172.21.15.50:0/968081541 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fb88c0317e0 con 0x56442a425010 2024-06-06T03:28:09.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.608+0000 7fb8a1a56740 1 -- 172.21.15.50:0/968081541 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb88c048470 con 0x56442a425010 2024-06-06T03:28:09.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.608+0000 7fb877fff640 1 -- 172.21.15.50:0/968081541 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb88c062050 con 0x56442a425010 2024-06-06T03:28:09.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.608+0000 7fb8a1a56740 10 client.25280 fetch_fsmap learned FSMap version 28 2024-06-06T03:28:09.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.608+0000 7fb8a1a56740 1 -- 172.21.15.50:0/968081541 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56442a4adb30 con 0x56442a425010 2024-06-06T03:28:09.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.608+0000 7fb877fff640 1 -- 172.21.15.50:0/968081541 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb88c048470 con 0x56442a425010 2024-06-06T03:28:09.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.608+0000 7fb877fff640 1 -- 172.21.15.50:0/968081541 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7fb88c050070 con 0x56442a425010 2024-06-06T03:28:09.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.608+0000 7fb8a1a56740 10 client.25280 fetch_fsmap finished waiting for FSMap version 28 2024-06-06T03:28:09.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.608+0000 7fb8a1a56740 10 client.25280 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:28:09.611 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.608+0000 7fb8a1a56740 20 client.25280 populate_metadata read hostname 'smithi050' 2024-06-06T03:28:09.611 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.608+0000 7fb8a1a56740 1 --2- 172.21.15.50:0/968081541 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56442a4ae510 0x56442a4b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:09.611 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.608+0000 7fb8a1a56740 4 client.25280 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:28:09.611 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.608+0000 7fb8a1a56740 1 -- 172.21.15.50:0/968081541 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56442a38ff70 con 0x56442a4ae510 2024-06-06T03:28:09.611 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.609+0000 7fb897fff640 1 --2- 172.21.15.50:0/968081541 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56442a4ae510 0x56442a4b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:09.611 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.609+0000 7fb877fff640 10 client.25280 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:09.611 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.609+0000 7fb897fff640 1 --2- 172.21.15.50:0/968081541 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56442a4ae510 0x56442a4b0930 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f009a861d3f89aaf server_cookie=c2398f4e98fbefe8 in_seq=0 out_seq=0 2024-06-06T03:28:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.627+0000 7fb877fff640 1 -- 172.21.15.50:0/968081541 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x56442a38ff70 con 0x56442a4ae510 2024-06-06T03:28:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.627+0000 7fb877fff640 10 client.25280 handle_command_reply: tid=0 2024-06-06T03:28:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.628+0000 7fb8a1a56740 1 client.25280 shutdown 2024-06-06T03:28:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.628+0000 7fb8a1a56740 1 -- 172.21.15.50:0/968081541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56442a425010 msgr2=0x56442a433480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.628+0000 7fb8a1a56740 1 --2- 172.21.15.50:0/968081541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56442a425010 0x56442a433480 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb88c006010 tx=0x7fb88c032e80 comp rx=0 tx=0).stop 2024-06-06T03:28:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.628+0000 7fb8a1a56740 1 -- 172.21.15.50:0/968081541 shutdown_connections 2024-06-06T03:28:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.628+0000 7fb8a1a56740 1 --2- 172.21.15.50:0/968081541 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56442a4ae510 0x56442a4b0930 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.628+0000 7fb877fff640 0 client.25280 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.628+0000 7fb8a1a56740 1 --2- 172.21.15.50:0/968081541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56442a42ab70 0x56442a4ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.628+0000 7fb8a1a56740 1 --2- 172.21.15.50:0/968081541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56442a425a00 0x56442a4339c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.628+0000 7fb8a1a56740 1 --2- 172.21.15.50:0/968081541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56442a425010 0x56442a433480 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.628+0000 7fb8a1a56740 1 -- 172.21.15.50:0/968081541 >> 172.21.15.50:0/968081541 conn(0x56442a420680 msgr2=0x56442a426be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.628+0000 7fb8a1a56740 1 -- 172.21.15.50:0/968081541 shutdown_connections 2024-06-06T03:28:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.628+0000 7fb8a1a56740 1 -- 172.21.15.50:0/968081541 wait complete. 2024-06-06T03:28:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.628+0000 7fb8a1a56740 20 client.25280 trim_cache size 0 max 16384 2024-06-06T03:28:09.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:28:09.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:28:09.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:28:09.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.629+0000 7fb89ed4f640 1 -- 172.21.15.50:0/1953956193 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb8880a2cb0 msgr2=0x7fb8880a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.629+0000 7fb89ed4f640 1 --2- 172.21.15.50:0/1953956193 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb8880a2cb0 0x7fb8880a5170 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb890008000 tx=0x7fb890013000 comp rx=0 tx=0).stop 2024-06-06T03:28:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.629+0000 7fb89ed4f640 1 -- 172.21.15.50:0/1953956193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb898104e10 msgr2=0x7fb898198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.629+0000 7fb89ed4f640 1 --2- 172.21.15.50:0/1953956193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb898104e10 0x7fb898198290 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb88400b450 tx=0x7fb88400b910 comp rx=0 tx=0).stop 2024-06-06T03:28:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.629+0000 7fb89ed4f640 1 -- 172.21.15.50:0/1953956193 shutdown_connections 2024-06-06T03:28:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.629+0000 7fb89ed4f640 1 --2- 172.21.15.50:0/1953956193 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb8880a2cb0 0x7fb8880a5170 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.629+0000 7fb89ed4f640 1 --2- 172.21.15.50:0/1953956193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb898104e10 0x7fb898198290 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.629+0000 7fb89ed4f640 1 --2- 172.21.15.50:0/1953956193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb898107740 0x7fb89819f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.629+0000 7fb89ed4f640 1 --2- 172.21.15.50:0/1953956193 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8981024e0 0x7fb898197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.629+0000 7fb89ed4f640 1 -- 172.21.15.50:0/1953956193 >> 172.21.15.50:0/1953956193 conn(0x7fb8980fbe70 msgr2=0x7fb898102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.629+0000 7fb89ed4f640 1 -- 172.21.15.50:0/1953956193 shutdown_connections 2024-06-06T03:28:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:09.629+0000 7fb89ed4f640 1 -- 172.21.15.50:0/1953956193 wait complete. 2024-06-06T03:28:10.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.875+0000 7fbb5f573700 1 -- 172.21.15.50:0/370507955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb58106720 msgr2=0x7fbb5810e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:10.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.875+0000 7fbb5f573700 1 --2- 172.21.15.50:0/370507955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb58106720 0x7fbb5810e2c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fbb5000b0d0 tx=0x7fbb5000b3e0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.875+0000 7fbb5f573700 1 -- 172.21.15.50:0/370507955 shutdown_connections 2024-06-06T03:28:10.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.875+0000 7fbb5f573700 1 --2- 172.21.15.50:0/370507955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb58106720 0x7fbb5810e2c0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.875+0000 7fbb5f573700 1 --2- 172.21.15.50:0/370507955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb581019d0 0x7fbb58101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.875+0000 7fbb5f573700 1 --2- 172.21.15.50:0/370507955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbb58102380 0x7fbb58105ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.875+0000 7fbb5f573700 1 -- 172.21.15.50:0/370507955 >> 172.21.15.50:0/370507955 conn(0x7fbb58078340 msgr2=0x7fbb58078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:10.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.876+0000 7fbb5f573700 1 -- 172.21.15.50:0/370507955 shutdown_connections 2024-06-06T03:28:10.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.876+0000 7fbb5f573700 1 -- 172.21.15.50:0/370507955 wait complete. 2024-06-06T03:28:10.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.876+0000 7fbb5f573700 1 Processor -- start 2024-06-06T03:28:10.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.877+0000 7fbb5f573700 1 -- start start 2024-06-06T03:28:10.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.877+0000 7fbb5f573700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb581019d0 0x7fbb58196760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:10.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.877+0000 7fbb5f573700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbb58102380 0x7fbb58196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:10.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.877+0000 7fbb5f573700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb58106720 0x7fbb5819afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:10.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.877+0000 7fbb5f573700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbb581104b0 con 0x7fbb581019d0 2024-06-06T03:28:10.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.877+0000 7fbb5f573700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbb58110330 con 0x7fbb58106720 2024-06-06T03:28:10.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.877+0000 7fbb5f573700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbb58110630 con 0x7fbb58102380 2024-06-06T03:28:10.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.877+0000 7fbb5cb0e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbb58102380 0x7fbb58196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:10.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.877+0000 7fbb5cb0e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbb58102380 0x7fbb58196ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:56476/0 (socket says 172.21.15.50:56476) 2024-06-06T03:28:10.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.877+0000 7fbb5cb0e700 1 -- 172.21.15.50:0/386473925 learned_addr learned my addr 172.21.15.50:0/386473925 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:10.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.877+0000 7fbb5db10700 1 --2- 172.21.15.50:0/386473925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb58106720 0x7fbb5819afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:10.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.877+0000 7fbb5d30f700 1 --2- 172.21.15.50:0/386473925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb581019d0 0x7fbb58196760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:10.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.878+0000 7fbb5cb0e700 1 -- 172.21.15.50:0/386473925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb58106720 msgr2=0x7fbb5819afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:10.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.878+0000 7fbb5cb0e700 1 --2- 172.21.15.50:0/386473925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb58106720 0x7fbb5819afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.878+0000 7fbb5cb0e700 1 -- 172.21.15.50:0/386473925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb581019d0 msgr2=0x7fbb58196760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:10.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.878+0000 7fbb5cb0e700 1 --2- 172.21.15.50:0/386473925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb581019d0 0x7fbb58196760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.878+0000 7fbb5cb0e700 1 -- 172.21.15.50:0/386473925 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb5819b720 con 0x7fbb58102380 2024-06-06T03:28:10.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.878+0000 7fbb5d30f700 1 --2- 172.21.15.50:0/386473925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb581019d0 0x7fbb58196760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:28:10.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.878+0000 7fbb5cb0e700 1 --2- 172.21.15.50:0/386473925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbb58102380 0x7fbb58196ca0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbb48009fd0 tx=0x7fbb4800ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:10.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.878+0000 7fbb4e7fc700 1 -- 172.21.15.50:0/386473925 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4800cbd0 con 0x7fbb58102380 2024-06-06T03:28:10.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.878+0000 7fbb4e7fc700 1 -- 172.21.15.50:0/386473925 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb480044d0 con 0x7fbb58102380 2024-06-06T03:28:10.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.878+0000 7fbb4e7fc700 1 -- 172.21.15.50:0/386473925 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb48003e50 con 0x7fbb58102380 2024-06-06T03:28:10.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.878+0000 7fbb5f573700 1 -- 172.21.15.50:0/386473925 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb5819ba10 con 0x7fbb58102380 2024-06-06T03:28:10.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.878+0000 7fbb5f573700 1 -- 172.21.15.50:0/386473925 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb5819be10 con 0x7fbb58102380 2024-06-06T03:28:10.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.882+0000 7fbb4e7fc700 1 -- 172.21.15.50:0/386473925 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbb48004000 con 0x7fbb58102380 2024-06-06T03:28:10.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.882+0000 7fbb4e7fc700 1 --2- 172.21.15.50:0/386473925 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbb440a2e40 0x7fbb440a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:10.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.883+0000 7fbb4e7fc700 1 -- 172.21.15.50:0/386473925 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fbb480cf4d0 con 0x7fbb58102380 2024-06-06T03:28:10.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.883+0000 7fbb5d30f700 1 --2- 172.21.15.50:0/386473925 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbb440a2e40 0x7fbb440a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:10.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.883+0000 7fbb69df6b80 1 Processor -- start 2024-06-06T03:28:10.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.884+0000 7fbb5d30f700 1 --2- 172.21.15.50:0/386473925 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbb440a2e40 0x7fbb440a5300 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbb54009cb0 tx=0x7fbb54009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:10.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.884+0000 7fbb69df6b80 1 -- start start 2024-06-06T03:28:10.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.884+0000 7fbb69df6b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ba8abf9640 0x55ba8abf9a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:10.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.884+0000 7fbb69df6b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba8abf9f60 0x55ba8abf39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:10.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.884+0000 7fbb69df6b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ba8abf3f20 0x55ba8abf4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:10.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.884+0000 7fbb69df6b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ba8ab45810 con 0x55ba8abf9f60 2024-06-06T03:28:10.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.884+0000 7fbb69df6b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ba8aaed720 con 0x55ba8abf3f20 2024-06-06T03:28:10.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.884+0000 7fbb69df6b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ba8ab417d0 con 0x55ba8abf9640 2024-06-06T03:28:10.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.884+0000 7fbb5cb0e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba8abf9f60 0x55ba8abf39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:10.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.884+0000 7fbb5cb0e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba8abf9f60 0x55ba8abf39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55906/0 (socket says 172.21.15.50:55906) 2024-06-06T03:28:10.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.884+0000 7fbb5cb0e700 1 -- 172.21.15.50:0/1803416051 learned_addr learned my addr 172.21.15.50:0/1803416051 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:10.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.884+0000 7fbb5db10700 1 --2- 172.21.15.50:0/1803416051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ba8abf3f20 0x55ba8abf4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:10.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.885+0000 7fbb5d30f700 1 --2- 172.21.15.50:0/1803416051 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ba8abf9640 0x55ba8abf9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:10.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.885+0000 7fbb5db10700 1 -- 172.21.15.50:0/1803416051 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ba8abf9640 msgr2=0x55ba8abf9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:10.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.885+0000 7fbb5db10700 1 --2- 172.21.15.50:0/1803416051 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ba8abf9640 0x55ba8abf9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.885+0000 7fbb5db10700 1 -- 172.21.15.50:0/1803416051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba8abf9f60 msgr2=0x55ba8abf39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:10.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.885+0000 7fbb5db10700 1 --2- 172.21.15.50:0/1803416051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba8abf9f60 0x55ba8abf39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.885+0000 7fbb5db10700 1 -- 172.21.15.50:0/1803416051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba8aae3f50 con 0x55ba8abf3f20 2024-06-06T03:28:10.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.885+0000 7fbb5db10700 1 --2- 172.21.15.50:0/1803416051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ba8abf3f20 0x55ba8abf4340 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbb5000b0d0 tx=0x7fbb500099e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d152c043da51c6dc server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:10.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.885+0000 7fbb437fe700 1 -- 172.21.15.50:0/1803416051 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5000bca0 con 0x55ba8abf3f20 2024-06-06T03:28:10.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.885+0000 7fbb437fe700 1 -- 172.21.15.50:0/1803416051 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb50020070 con 0x55ba8abf3f20 2024-06-06T03:28:10.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.885+0000 7fbb437fe700 1 -- 172.21.15.50:0/1803416051 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb50005750 con 0x55ba8abf3f20 2024-06-06T03:28:10.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.886+0000 7fbb69df6b80 1 -- 172.21.15.50:0/1803416051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ba8abf3f20 msgr2=0x55ba8abf4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:10.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.886+0000 7fbb69df6b80 1 --2- 172.21.15.50:0/1803416051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ba8abf3f20 0x55ba8abf4340 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbb5000b0d0 tx=0x7fbb500099e0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.887+0000 7fbb69df6b80 1 -- 172.21.15.50:0/1803416051 shutdown_connections 2024-06-06T03:28:10.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.887+0000 7fbb69df6b80 1 --2- 172.21.15.50:0/1803416051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ba8abf3f20 0x55ba8abf4340 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.887+0000 7fbb69df6b80 1 --2- 172.21.15.50:0/1803416051 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ba8abf9640 0x55ba8abf9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.887+0000 7fbb69df6b80 1 --2- 172.21.15.50:0/1803416051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba8abf9f60 0x55ba8abf39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.887+0000 7fbb69df6b80 1 -- 172.21.15.50:0/1803416051 >> 172.21.15.50:0/1803416051 conn(0x55ba8ab1ecc0 msgr2=0x55ba8abee850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:10.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.887+0000 7fbb69df6b80 1 -- 172.21.15.50:0/1803416051 shutdown_connections 2024-06-06T03:28:10.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.888+0000 7fbb69df6b80 1 -- 172.21.15.50:0/1803416051 wait complete. 2024-06-06T03:28:10.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.888+0000 7fbb69df6b80 1 -- start start 2024-06-06T03:28:10.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.889+0000 7fbb69df6b80 1 Processor -- start 2024-06-06T03:28:10.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.889+0000 7fbb69df6b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba8abf3f20 0x55ba8abffd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:10.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.889+0000 7fbb69df6b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ba8abf9640 0x55ba8abfd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:10.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.889+0000 7fbb69df6b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ba8abf9f60 0x55ba8abfd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:10.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.890+0000 7fbb69df6b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ba8ac00970 con 0x55ba8abf3f20 2024-06-06T03:28:10.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.890+0000 7fbb69df6b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ba8aae5bf0 con 0x55ba8abf9f60 2024-06-06T03:28:10.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.890+0000 7fbb69df6b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ba8ac00af0 con 0x55ba8abf9640 2024-06-06T03:28:10.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.890+0000 7fbb69df6b80 10 client.0 _ll_register_callbacks cb 0x55ba8aadf920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:28:10.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.890+0000 7fbb5cb0e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ba8abf9640 0x55ba8abfd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:10.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.890+0000 7fbb5cb0e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ba8abf9640 0x55ba8abfd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:56490/0 (socket says 172.21.15.50:56490) 2024-06-06T03:28:10.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.890+0000 7fbb5cb0e700 1 -- 172.21.15.50:0/2149058845 learned_addr learned my addr 172.21.15.50:0/2149058845 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:10.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.890+0000 7fbb5d30f700 1 --2- 172.21.15.50:0/2149058845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba8abf3f20 0x55ba8abffd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:10.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.890+0000 7fbb5db10700 1 --2- 172.21.15.50:0/2149058845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ba8abf9f60 0x55ba8abfd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:10.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.890+0000 7fbb5cb0e700 1 -- 172.21.15.50:0/2149058845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ba8abf9f60 msgr2=0x55ba8abfd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:10.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.890+0000 7fbb5cb0e700 1 --2- 172.21.15.50:0/2149058845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ba8abf9f60 0x55ba8abfd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.890+0000 7fbb5cb0e700 1 -- 172.21.15.50:0/2149058845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba8abf3f20 msgr2=0x55ba8abffd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:10.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.890+0000 7fbb5cb0e700 1 --2- 172.21.15.50:0/2149058845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba8abf3f20 0x55ba8abffd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.890+0000 7fbb5cb0e700 1 -- 172.21.15.50:0/2149058845 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba8aa948d0 con 0x55ba8abf9640 2024-06-06T03:28:10.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.891+0000 7fbb5d30f700 1 --2- 172.21.15.50:0/2149058845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba8abf3f20 0x55ba8abffd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:28:10.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.891+0000 7fbb5cb0e700 1 --2- 172.21.15.50:0/2149058845 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ba8abf9640 0x55ba8abfd080 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbb48000c00 tx=0x7fbb4809b560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e21a4ae14fee8219 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:10.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.891+0000 7fbb40ff9700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:28:10.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.891+0000 7fbb40ff9700 1 -- 172.21.15.50:0/2149058845 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb480b3070 con 0x55ba8abf9640 2024-06-06T03:28:10.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.891+0000 7fbb40ff9700 1 -- 172.21.15.50:0/2149058845 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fbb48016df0 con 0x55ba8abf9640 2024-06-06T03:28:10.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.891+0000 7fbb69df6b80 1 -- 172.21.15.50:0/2149058845 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb50020070 con 0x55ba8abf9640 2024-06-06T03:28:10.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.892+0000 7fbb40ff9700 1 -- 172.21.15.50:0/2149058845 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbb480042f0 con 0x55ba8abf9640 2024-06-06T03:28:10.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.892+0000 7fbb69df6b80 10 client.25285 fetch_fsmap learned FSMap version 28 2024-06-06T03:28:10.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.892+0000 7fbb69df6b80 1 -- 172.21.15.50:0/2149058845 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ba8ac0b1a0 con 0x55ba8abf9640 2024-06-06T03:28:10.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.892+0000 7fbb40ff9700 1 -- 172.21.15.50:0/2149058845 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb50020070 con 0x55ba8abf9640 2024-06-06T03:28:10.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.892+0000 7fbb40ff9700 1 -- 172.21.15.50:0/2149058845 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7fbb480a4130 con 0x55ba8abf9640 2024-06-06T03:28:10.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.892+0000 7fbb69df6b80 10 client.25285 fetch_fsmap finished waiting for FSMap version 28 2024-06-06T03:28:10.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.892+0000 7fbb69df6b80 10 client.25285 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-06-06T03:28:10.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.892+0000 7fbb69df6b80 20 client.25285 populate_metadata read hostname 'smithi050' 2024-06-06T03:28:10.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.892+0000 7fbb69df6b80 1 --2- 172.21.15.50:0/2149058845 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55ba8ac0dbf0 0x55ba8ac10010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:10.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.892+0000 7fbb69df6b80 4 client.25285 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:28:10.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.892+0000 7fbb69df6b80 1 -- 172.21.15.50:0/2149058845 --> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba8ab52d10 con 0x55ba8ac0dbf0 2024-06-06T03:28:10.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.893+0000 7fbb5d30f700 1 --2- 172.21.15.50:0/2149058845 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55ba8ac0dbf0 0x55ba8ac10010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:10.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.893+0000 7fbb5d30f700 1 --2- 172.21.15.50:0/2149058845 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55ba8ac0dbf0 0x55ba8ac10010 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7a60e3e374a11009 server_cookie=2c267ef37617fd79 in_seq=0 out_seq=0 2024-06-06T03:28:10.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.893+0000 7fbb40ff9700 10 client.25285 ms_handle_connect on v2:172.21.15.122:6836/1604366318 2024-06-06T03:28:10.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.894+0000 7fbb40ff9700 1 -- 172.21.15.50:0/2149058845 <== mds.1 v2:172.21.15.122:6836/1604366318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55ba8ab52d10 con 0x55ba8ac0dbf0 2024-06-06T03:28:10.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.894+0000 7fbb40ff9700 10 client.25285 handle_command_reply: tid=0 2024-06-06T03:28:10.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.894+0000 7fbb69df6b80 1 client.25285 shutdown 2024-06-06T03:28:10.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.894+0000 7fbb69df6b80 1 -- 172.21.15.50:0/2149058845 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ba8abf9640 msgr2=0x55ba8abfd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:10.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.894+0000 7fbb69df6b80 1 --2- 172.21.15.50:0/2149058845 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ba8abf9640 0x55ba8abfd080 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbb48000c00 tx=0x7fbb4809b560 comp rx=0 tx=0).stop 2024-06-06T03:28:10.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.894+0000 7fbb69df6b80 1 -- 172.21.15.50:0/2149058845 shutdown_connections 2024-06-06T03:28:10.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.894+0000 7fbb69df6b80 1 --2- 172.21.15.50:0/2149058845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ba8abf9f60 0x55ba8abfd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.894+0000 7fbb69df6b80 1 --2- 172.21.15.50:0/2149058845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba8abf3f20 0x55ba8abffd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.894+0000 7fbb69df6b80 1 --2- 172.21.15.50:0/2149058845 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55ba8ac0dbf0 0x55ba8ac10010 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.894+0000 7fbb69df6b80 1 --2- 172.21.15.50:0/2149058845 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ba8abf9640 0x55ba8abfd080 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.894+0000 7fbb40ff9700 0 client.25285 ms_handle_reset on v2:172.21.15.122:6836/1604366318 2024-06-06T03:28:10.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.894+0000 7fbb69df6b80 1 -- 172.21.15.50:0/2149058845 >> 172.21.15.50:0/2149058845 conn(0x55ba8ab1ecc0 msgr2=0x55ba8abf29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:10.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.894+0000 7fbb69df6b80 1 -- 172.21.15.50:0/2149058845 shutdown_connections 2024-06-06T03:28:10.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.894+0000 7fbb69df6b80 1 -- 172.21.15.50:0/2149058845 wait complete. 2024-06-06T03:28:10.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.894+0000 7fbb69df6b80 20 client.25285 trim_cache size 0 max 16384 2024-06-06T03:28:10.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.921+0000 7fbb69df6b80 1 Processor -- start 2024-06-06T03:28:10.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.921+0000 7fbb69df6b80 1 -- start start 2024-06-06T03:28:10.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.921+0000 7fbb69df6b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ba8abf3f20 0x55ba8ac09c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:10.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.921+0000 7fbb69df6b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ba8abf9640 0x55ba8abf39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:10.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.921+0000 7fbb69df6b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba8abf9f60 0x55ba8abfc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:10.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.921+0000 7fbb69df6b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbb581b6f80 con 0x55ba8abf9f60 2024-06-06T03:28:10.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.921+0000 7fbb69df6b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbb581b4810 con 0x55ba8abf3f20 2024-06-06T03:28:10.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.921+0000 7fbb69df6b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbb581b2660 con 0x55ba8abf9640 2024-06-06T03:28:10.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.921+0000 7fbb5db10700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba8abf9f60 0x55ba8abfc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:10.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.921+0000 7fbb5cb0e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ba8abf9640 0x55ba8abf39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:10.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.921+0000 7fbb5db10700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba8abf9f60 0x55ba8abfc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55930/0 (socket says 172.21.15.50:55930) 2024-06-06T03:28:10.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.921+0000 7fbb5db10700 1 -- 172.21.15.50:0/1033155092 learned_addr learned my addr 172.21.15.50:0/1033155092 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:10.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.922+0000 7fbb5d30f700 1 --2- 172.21.15.50:0/1033155092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ba8abf3f20 0x55ba8ac09c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:10.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.922+0000 7fbb5cb0e700 1 -- 172.21.15.50:0/1033155092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ba8abf3f20 msgr2=0x55ba8ac09c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:10.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.922+0000 7fbb5cb0e700 1 --2- 172.21.15.50:0/1033155092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ba8abf3f20 0x55ba8ac09c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.922+0000 7fbb5cb0e700 1 -- 172.21.15.50:0/1033155092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba8abf9f60 msgr2=0x55ba8abfc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:10.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.922+0000 7fbb5cb0e700 1 --2- 172.21.15.50:0/1033155092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba8abf9f60 0x55ba8abfc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.922+0000 7fbb5cb0e700 1 -- 172.21.15.50:0/1033155092 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba8ac10690 con 0x55ba8abf9640 2024-06-06T03:28:10.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.922+0000 7fbb5db10700 1 --2- 172.21.15.50:0/1033155092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba8abf9f60 0x55ba8abfc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:28:10.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.922+0000 7fbb5cb0e700 1 --2- 172.21.15.50:0/1033155092 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ba8abf9640 0x55ba8abf39e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbb48098320 tx=0x7fbb480ccc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b13ba922c2ce901b server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:10.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.922+0000 7fbb42ffd700 1 -- 172.21.15.50:0/1033155092 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4807e020 con 0x55ba8abf9640 2024-06-06T03:28:10.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.922+0000 7fbb42ffd700 1 -- 172.21.15.50:0/1033155092 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb480cf2a0 con 0x55ba8abf9640 2024-06-06T03:28:10.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.922+0000 7fbb42ffd700 1 -- 172.21.15.50:0/1033155092 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb480b3070 con 0x55ba8abf9640 2024-06-06T03:28:10.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.923+0000 7fbb69df6b80 1 -- 172.21.15.50:0/1033155092 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ba8abf9640 msgr2=0x55ba8abf39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:10.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.923+0000 7fbb69df6b80 1 --2- 172.21.15.50:0/1033155092 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ba8abf9640 0x55ba8abf39e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbb48098320 tx=0x7fbb480ccc70 comp rx=0 tx=0).stop 2024-06-06T03:28:10.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.923+0000 7fbb69df6b80 1 -- 172.21.15.50:0/1033155092 shutdown_connections 2024-06-06T03:28:10.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.923+0000 7fbb69df6b80 1 --2- 172.21.15.50:0/1033155092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba8abf9f60 0x55ba8abfc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.923+0000 7fbb69df6b80 1 --2- 172.21.15.50:0/1033155092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ba8abf3f20 0x55ba8ac09c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.923+0000 7fbb69df6b80 1 --2- 172.21.15.50:0/1033155092 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ba8abf9640 0x55ba8abf39e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.923+0000 7fbb69df6b80 1 -- 172.21.15.50:0/1033155092 >> 172.21.15.50:0/1033155092 conn(0x55ba8ab1ecc0 msgr2=0x55ba8abe7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:10.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.923+0000 7fbb69df6b80 1 -- 172.21.15.50:0/1033155092 shutdown_connections 2024-06-06T03:28:10.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.923+0000 7fbb69df6b80 1 -- 172.21.15.50:0/1033155092 wait complete. 2024-06-06T03:28:10.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.924+0000 7fbb69df6b80 1 -- start start 2024-06-06T03:28:10.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.924+0000 7fbb69df6b80 1 Processor -- start 2024-06-06T03:28:10.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.924+0000 7fbb69df6b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ba8abf3f20 0x55ba8ac06400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:10.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.924+0000 7fbb69df6b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba8abf9640 0x55ba8ac151a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:10.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.924+0000 7fbb69df6b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ba8abf9f60 0x55ba8ac156e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:10.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.925+0000 7fbb69df6b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbb581b2cd0 con 0x55ba8abf9640 2024-06-06T03:28:10.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.925+0000 7fbb5d30f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ba8abf3f20 0x55ba8ac06400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:10.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.925+0000 7fbb5d30f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ba8abf3f20 0x55ba8ac06400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:56518/0 (socket says 172.21.15.50:56518) 2024-06-06T03:28:10.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.925+0000 7fbb5d30f700 1 -- 172.21.15.50:0/1362508082 learned_addr learned my addr 172.21.15.50:0/1362508082 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:10.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.925+0000 7fbb5cb0e700 1 --2- 172.21.15.50:0/1362508082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba8abf9640 0x55ba8ac151a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:10.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.925+0000 7fbb69df6b80 1 -- 172.21.15.50:0/1362508082 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbb581b4140 con 0x55ba8abf9f60 2024-06-06T03:28:10.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.925+0000 7fbb69df6b80 1 -- 172.21.15.50:0/1362508082 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbb581b33a0 con 0x55ba8abf3f20 2024-06-06T03:28:10.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.925+0000 7fbb5db10700 1 --2- 172.21.15.50:0/1362508082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ba8abf9f60 0x55ba8ac156e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:10.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.925+0000 7fbb69df6b80 10 client.0 _ll_register_callbacks cb 0x55ba8aadf920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:28:10.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.925+0000 7fbb5d30f700 1 -- 172.21.15.50:0/1362508082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ba8abf9f60 msgr2=0x55ba8ac156e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:10.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.925+0000 7fbb5d30f700 1 --2- 172.21.15.50:0/1362508082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ba8abf9f60 0x55ba8ac156e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.925+0000 7fbb5d30f700 1 -- 172.21.15.50:0/1362508082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba8abf9640 msgr2=0x55ba8ac151a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:10.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.925+0000 7fbb5d30f700 1 --2- 172.21.15.50:0/1362508082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba8abf9640 0x55ba8ac151a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.925+0000 7fbb5d30f700 1 -- 172.21.15.50:0/1362508082 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba8ac15e20 con 0x55ba8abf3f20 2024-06-06T03:28:10.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.925+0000 7fbb5d30f700 1 --2- 172.21.15.50:0/1362508082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ba8abf3f20 0x55ba8ac06400 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55ba8ac108c0 tx=0x7fbb54014070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ba6796fee442adc server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:10.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.925+0000 7fbb40ff9700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:28:10.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.926+0000 7fbb40ff9700 1 -- 172.21.15.50:0/1362508082 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb54012450 con 0x55ba8abf3f20 2024-06-06T03:28:10.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.926+0000 7fbb40ff9700 1 -- 172.21.15.50:0/1362508082 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fbb540125f0 con 0x55ba8abf3f20 2024-06-06T03:28:10.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.926+0000 7fbb69df6b80 1 -- 172.21.15.50:0/1362508082 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb480cf2a0 con 0x55ba8abf3f20 2024-06-06T03:28:10.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.926+0000 7fbb40ff9700 1 -- 172.21.15.50:0/1362508082 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbb54039050 con 0x55ba8abf3f20 2024-06-06T03:28:10.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.926+0000 7fbb69df6b80 10 client.25291 fetch_fsmap learned FSMap version 28 2024-06-06T03:28:10.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.926+0000 7fbb69df6b80 1 -- 172.21.15.50:0/1362508082 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ba8ac78880 con 0x55ba8abf3f20 2024-06-06T03:28:10.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.926+0000 7fbb40ff9700 1 -- 172.21.15.50:0/1362508082 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb5402c070 con 0x55ba8abf3f20 2024-06-06T03:28:10.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.926+0000 7fbb40ff9700 1 -- 172.21.15.50:0/1362508082 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7fbb54030840 con 0x55ba8abf3f20 2024-06-06T03:28:10.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.926+0000 7fbb69df6b80 10 client.25291 fetch_fsmap finished waiting for FSMap version 28 2024-06-06T03:28:10.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.927+0000 7fbb69df6b80 10 client.25291 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-06-06T03:28:10.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.927+0000 7fbb69df6b80 20 client.25291 populate_metadata read hostname 'smithi050' 2024-06-06T03:28:10.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.927+0000 7fbb69df6b80 1 --2- 172.21.15.50:0/1362508082 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55ba8ac78f40 0x55ba8ac7b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:10.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.927+0000 7fbb69df6b80 4 client.25291 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:28:10.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.927+0000 7fbb69df6b80 1 -- 172.21.15.50:0/1362508082 --> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fbb480cf2a0 con 0x55ba8ac78f40 2024-06-06T03:28:10.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.927+0000 7fbb5cb0e700 1 --2- 172.21.15.50:0/1362508082 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55ba8ac78f40 0x55ba8ac7b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:10.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.927+0000 7fbb5cb0e700 1 --2- 172.21.15.50:0/1362508082 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55ba8ac78f40 0x55ba8ac7b360 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=265fe7322b08151d server_cookie=69f5922f4acf590 in_seq=0 out_seq=0 2024-06-06T03:28:10.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.927+0000 7fbb40ff9700 10 client.25291 ms_handle_connect on v2:172.21.15.122:6836/1604366318 2024-06-06T03:28:10.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.927+0000 7fbb40ff9700 1 -- 172.21.15.50:0/1362508082 <== mds.1 v2:172.21.15.122:6836/1604366318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fbb480cf2a0 con 0x55ba8ac78f40 2024-06-06T03:28:10.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.927+0000 7fbb40ff9700 10 client.25291 handle_command_reply: tid=0 2024-06-06T03:28:10.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.927+0000 7fbb69df6b80 1 client.25291 shutdown 2024-06-06T03:28:10.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.928+0000 7fbb69df6b80 1 -- 172.21.15.50:0/1362508082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ba8abf3f20 msgr2=0x55ba8ac06400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:10.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.928+0000 7fbb69df6b80 1 --2- 172.21.15.50:0/1362508082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ba8abf3f20 0x55ba8ac06400 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55ba8ac108c0 tx=0x7fbb54014070 comp rx=0 tx=0).stop 2024-06-06T03:28:10.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.928+0000 7fbb69df6b80 1 -- 172.21.15.50:0/1362508082 shutdown_connections 2024-06-06T03:28:10.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.928+0000 7fbb69df6b80 1 --2- 172.21.15.50:0/1362508082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ba8abf9f60 0x55ba8ac156e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.928+0000 7fbb69df6b80 1 --2- 172.21.15.50:0/1362508082 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55ba8ac78f40 0x55ba8ac7b360 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.928+0000 7fbb69df6b80 1 --2- 172.21.15.50:0/1362508082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ba8abf3f20 0x55ba8ac06400 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.928+0000 7fbb69df6b80 1 --2- 172.21.15.50:0/1362508082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba8abf9640 0x55ba8ac151a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.928+0000 7fbb69df6b80 1 -- 172.21.15.50:0/1362508082 >> 172.21.15.50:0/1362508082 conn(0x55ba8ab1ecc0 msgr2=0x55ba8abfa340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:10.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.928+0000 7fbb40ff9700 0 client.25291 ms_handle_reset on v2:172.21.15.122:6836/1604366318 2024-06-06T03:28:10.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.928+0000 7fbb69df6b80 1 -- 172.21.15.50:0/1362508082 shutdown_connections 2024-06-06T03:28:10.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.928+0000 7fbb69df6b80 1 -- 172.21.15.50:0/1362508082 wait complete. 2024-06-06T03:28:10.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.928+0000 7fbb69df6b80 20 client.25291 trim_cache size 0 max 16384 2024-06-06T03:28:10.933 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:28:10.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.929+0000 7fbb5f573700 1 -- 172.21.15.50:0/386473925 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbb440a2e40 msgr2=0x7fbb440a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:10.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.929+0000 7fbb5f573700 1 --2- 172.21.15.50:0/386473925 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbb440a2e40 0x7fbb440a5300 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbb54009cb0 tx=0x7fbb54009260 comp rx=0 tx=0).stop 2024-06-06T03:28:10.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.929+0000 7fbb5f573700 1 -- 172.21.15.50:0/386473925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbb58102380 msgr2=0x7fbb58196ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:10.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.929+0000 7fbb5f573700 1 --2- 172.21.15.50:0/386473925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbb58102380 0x7fbb58196ca0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbb48009fd0 tx=0x7fbb4800ed10 comp rx=0 tx=0).stop 2024-06-06T03:28:10.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.929+0000 7fbb5f573700 1 -- 172.21.15.50:0/386473925 shutdown_connections 2024-06-06T03:28:10.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.929+0000 7fbb5f573700 1 --2- 172.21.15.50:0/386473925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb58106720 0x7fbb5819afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.929+0000 7fbb5f573700 1 --2- 172.21.15.50:0/386473925 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbb440a2e40 0x7fbb440a5300 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.929+0000 7fbb5f573700 1 --2- 172.21.15.50:0/386473925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb581019d0 0x7fbb58196760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.929+0000 7fbb5f573700 1 --2- 172.21.15.50:0/386473925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbb58102380 0x7fbb58196ca0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:10.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.929+0000 7fbb5f573700 1 -- 172.21.15.50:0/386473925 >> 172.21.15.50:0/386473925 conn(0x7fbb58078340 msgr2=0x7fbb580ff680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:10.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.929+0000 7fbb5f573700 1 -- 172.21.15.50:0/386473925 shutdown_connections 2024-06-06T03:28:10.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:10.929+0000 7fbb5f573700 1 -- 172.21.15.50:0/386473925 wait complete. 2024-06-06T03:28:11.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:10 smithi050 ceph-mon[32421]: pgmap v477: 129 pgs: 129 active+clean; 1.4 GiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 116 MiB/s wr, 75 op/s 2024-06-06T03:28:11.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:10 smithi079 ceph-mon[35478]: pgmap v477: 129 pgs: 129 active+clean; 1.4 GiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 116 MiB/s wr, 75 op/s 2024-06-06T03:28:11.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:10 smithi122 ceph-mon[35759]: pgmap v477: 129 pgs: 129 active+clean; 1.4 GiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 116 MiB/s wr, 75 op/s 2024-06-06T03:28:11.879 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-06-06T03:28:12.263 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:28:13.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:12 smithi050 ceph-mon[32421]: pgmap v478: 129 pgs: 129 active+clean; 1.5 GiB data, 574 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 126 MiB/s wr, 76 op/s 2024-06-06T03:28:13.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:12 smithi079 ceph-mon[35478]: pgmap v478: 129 pgs: 129 active+clean; 1.5 GiB data, 574 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 126 MiB/s wr, 76 op/s 2024-06-06T03:28:13.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:12 smithi122 ceph-mon[35759]: pgmap v478: 129 pgs: 129 active+clean; 1.5 GiB data, 574 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 126 MiB/s wr, 76 op/s 2024-06-06T03:28:14.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:13 smithi050 ceph-mon[32421]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:28:14.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:13 smithi079 ceph-mon[35478]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:28:14.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:13 smithi122 ceph-mon[35759]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:28:14.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.195+0000 7f56ed289700 1 -- 172.21.15.50:0/1614938745 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56e8102510 msgr2=0x7f56e8102990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:14.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.195+0000 7f56ed289700 1 --2- 172.21.15.50:0/1614938745 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56e8102510 0x7f56e8102990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f56dc009990 tx=0x7f56dc009ca0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.196+0000 7f56ed289700 1 -- 172.21.15.50:0/1614938745 shutdown_connections 2024-06-06T03:28:14.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.196+0000 7f56ed289700 1 --2- 172.21.15.50:0/1614938745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56e8102ed0 0x7f56e810f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.196+0000 7f56ed289700 1 --2- 172.21.15.50:0/1614938745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56e8108520 0x7f56e8108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.196+0000 7f56ed289700 1 --2- 172.21.15.50:0/1614938745 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56e8102510 0x7f56e8102990 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.196+0000 7f56ed289700 1 -- 172.21.15.50:0/1614938745 >> 172.21.15.50:0/1614938745 conn(0x7f56e8079560 msgr2=0x7f56e8079970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:14.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.196+0000 7f56ed289700 1 -- 172.21.15.50:0/1614938745 shutdown_connections 2024-06-06T03:28:14.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.196+0000 7f56ed289700 1 -- 172.21.15.50:0/1614938745 wait complete. 2024-06-06T03:28:14.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.196+0000 7f56ed289700 1 Processor -- start 2024-06-06T03:28:14.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.197+0000 7f56ed289700 1 -- start start 2024-06-06T03:28:14.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.197+0000 7f56ed289700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56e8102510 0x7f56e8074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:14.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.197+0000 7f56ed289700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56e8102ed0 0x7f56e8074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:14.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.197+0000 7f56ed289700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56e8108520 0x7f56e8075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:14.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.197+0000 7f56ed289700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f56e81126a0 con 0x7f56e8102510 2024-06-06T03:28:14.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.197+0000 7f56ed289700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f56e8112520 con 0x7f56e8102ed0 2024-06-06T03:28:14.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.197+0000 7f56ed289700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f56e8112820 con 0x7f56e8108520 2024-06-06T03:28:14.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.197+0000 7f56e77fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56e8108520 0x7f56e8075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:14.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.197+0000 7f56e77fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56e8108520 0x7f56e8075210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:56528/0 (socket says 172.21.15.50:56528) 2024-06-06T03:28:14.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.197+0000 7f56e77fe700 1 -- 172.21.15.50:0/2544584263 learned_addr learned my addr 172.21.15.50:0/2544584263 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:14.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.197+0000 7f56e67fc700 1 --2- 172.21.15.50:0/2544584263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56e8102ed0 0x7f56e8074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:14.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.198+0000 7f56e6ffd700 1 --2- 172.21.15.50:0/2544584263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56e8102510 0x7f56e8074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:14.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.198+0000 7f56e77fe700 1 -- 172.21.15.50:0/2544584263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56e8102ed0 msgr2=0x7f56e8074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:14.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.198+0000 7f56e77fe700 1 --2- 172.21.15.50:0/2544584263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56e8102ed0 0x7f56e8074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.198+0000 7f56e77fe700 1 -- 172.21.15.50:0/2544584263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56e8102510 msgr2=0x7f56e8074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:14.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.198+0000 7f56e77fe700 1 --2- 172.21.15.50:0/2544584263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56e8102510 0x7f56e8074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.198+0000 7f56e77fe700 1 -- 172.21.15.50:0/2544584263 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e81ab460 con 0x7f56e8108520 2024-06-06T03:28:14.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.198+0000 7f56e77fe700 1 --2- 172.21.15.50:0/2544584263 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56e8108520 0x7f56e8075210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f56e000ef30 tx=0x7f56e000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:14.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.198+0000 7f56cffff700 1 -- 172.21.15.50:0/2544584263 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e00092e0 con 0x7f56e8108520 2024-06-06T03:28:14.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.198+0000 7f56ed289700 1 -- 172.21.15.50:0/2544584263 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e81ab6f0 con 0x7f56e8108520 2024-06-06T03:28:14.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.198+0000 7f56cffff700 1 -- 172.21.15.50:0/2544584263 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f56e0004bb0 con 0x7f56e8108520 2024-06-06T03:28:14.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.198+0000 7f56cffff700 1 -- 172.21.15.50:0/2544584263 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e0004060 con 0x7f56e8108520 2024-06-06T03:28:14.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.198+0000 7f56ed289700 1 -- 172.21.15.50:0/2544584263 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e81abc00 con 0x7f56e8108520 2024-06-06T03:28:14.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.201+0000 7f56cffff700 1 -- 172.21.15.50:0/2544584263 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f56e001b030 con 0x7f56e8108520 2024-06-06T03:28:14.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.202+0000 7f56cffff700 1 --2- 172.21.15.50:0/2544584263 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f56d00a2ca0 0x7f56d00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:14.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.202+0000 7f56cffff700 1 -- 172.21.15.50:0/2544584263 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f56e00ceea0 con 0x7f56e8108520 2024-06-06T03:28:14.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.202+0000 7f56e6ffd700 1 --2- 172.21.15.50:0/2544584263 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f56d00a2ca0 0x7f56d00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:14.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.203+0000 7f56f7b0cb80 1 Processor -- start 2024-06-06T03:28:14.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.203+0000 7f56f7b0cb80 1 -- start start 2024-06-06T03:28:14.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.203+0000 7f56f7b0cb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557398aea640 0x557398aeaa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:14.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.203+0000 7f56f7b0cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557398aeaf60 0x557398ae49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:14.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.203+0000 7f56f7b0cb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557398ae4f20 0x557398ae5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:14.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.203+0000 7f56f7b0cb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557398a36810 con 0x557398ae4f20 2024-06-06T03:28:14.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.203+0000 7f56f7b0cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5573989de720 con 0x557398aeaf60 2024-06-06T03:28:14.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.203+0000 7f56f7b0cb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557398a327d0 con 0x557398aea640 2024-06-06T03:28:14.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.203+0000 7f56e6ffd700 1 --2- 172.21.15.50:0/2544584263 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f56d00a2ca0 0x7f56d00a5160 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f56d8005950 tx=0x7f56d80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:14.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.203+0000 7f56e77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557398ae4f20 0x557398ae5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:14.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.203+0000 7f56e67fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557398aeaf60 0x557398ae49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:14.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.203+0000 7f56e6ffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557398aea640 0x557398aeaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:14.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.203+0000 7f56e77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557398ae4f20 0x557398ae5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55960/0 (socket says 172.21.15.50:55960) 2024-06-06T03:28:14.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.203+0000 7f56e77fe700 1 -- 172.21.15.50:0/2521853194 learned_addr learned my addr 172.21.15.50:0/2521853194 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:14.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.203+0000 7f56e67fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557398aeaf60 0x557398ae49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:49358/0 (socket says 172.21.15.50:49358) 2024-06-06T03:28:14.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.203+0000 7f56e67fc700 1 -- 172.21.15.50:0/2521853194 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557398aea640 msgr2=0x557398aeaa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:14.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.203+0000 7f56e67fc700 1 --2- 172.21.15.50:0/2521853194 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557398aea640 0x557398aeaa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.204+0000 7f56e67fc700 1 -- 172.21.15.50:0/2521853194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557398ae4f20 msgr2=0x557398ae5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:14.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.204+0000 7f56e67fc700 1 --2- 172.21.15.50:0/2521853194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557398ae4f20 0x557398ae5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.204+0000 7f56e67fc700 1 -- 172.21.15.50:0/2521853194 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573989d4f50 con 0x557398aeaf60 2024-06-06T03:28:14.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.204+0000 7f56e67fc700 1 --2- 172.21.15.50:0/2521853194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557398aeaf60 0x557398ae49e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f56e819cbf0 tx=0x7f56dc00b6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe7470b22357c23e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:14.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.204+0000 7f56cd7fa700 1 -- 172.21.15.50:0/2521853194 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56dc004620 con 0x557398aeaf60 2024-06-06T03:28:14.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.204+0000 7f56cd7fa700 1 -- 172.21.15.50:0/2521853194 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f56dc027070 con 0x557398aeaf60 2024-06-06T03:28:14.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.204+0000 7f56cd7fa700 1 -- 172.21.15.50:0/2521853194 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56dc003b40 con 0x557398aeaf60 2024-06-06T03:28:14.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.205+0000 7f56f7b0cb80 1 -- 172.21.15.50:0/2521853194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557398aeaf60 msgr2=0x557398ae49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:14.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.205+0000 7f56f7b0cb80 1 --2- 172.21.15.50:0/2521853194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557398aeaf60 0x557398ae49e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f56e819cbf0 tx=0x7f56dc00b6e0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.205+0000 7f56f7b0cb80 1 -- 172.21.15.50:0/2521853194 shutdown_connections 2024-06-06T03:28:14.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.205+0000 7f56f7b0cb80 1 --2- 172.21.15.50:0/2521853194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557398ae4f20 0x557398ae5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.205+0000 7f56f7b0cb80 1 --2- 172.21.15.50:0/2521853194 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557398aea640 0x557398aeaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.205+0000 7f56f7b0cb80 1 --2- 172.21.15.50:0/2521853194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557398aeaf60 0x557398ae49e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.205+0000 7f56f7b0cb80 1 -- 172.21.15.50:0/2521853194 >> 172.21.15.50:0/2521853194 conn(0x557398a0fcc0 msgr2=0x557398adf850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:14.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.205+0000 7f56f7b0cb80 1 -- 172.21.15.50:0/2521853194 shutdown_connections 2024-06-06T03:28:14.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.205+0000 7f56f7b0cb80 1 -- 172.21.15.50:0/2521853194 wait complete. 2024-06-06T03:28:14.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.206+0000 7f56f7b0cb80 1 -- start start 2024-06-06T03:28:14.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.206+0000 7f56f7b0cb80 1 Processor -- start 2024-06-06T03:28:14.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.206+0000 7f56f7b0cb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557398ae4f20 0x557398af0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:14.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.206+0000 7f56f7b0cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557398aea640 0x557398aee010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:14.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.206+0000 7f56f7b0cb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557398aeaf60 0x557398aee550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:14.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.206+0000 7f56f7b0cb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557398af1970 con 0x557398aeaf60 2024-06-06T03:28:14.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.206+0000 7f56f7b0cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5573989d6bf0 con 0x557398aea640 2024-06-06T03:28:14.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.207+0000 7f56f7b0cb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557398af1af0 con 0x557398ae4f20 2024-06-06T03:28:14.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.207+0000 7f56f7b0cb80 10 client.0 _ll_register_callbacks cb 0x5573989d0920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:28:14.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.207+0000 7f56e67fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557398aea640 0x557398aee010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:14.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.207+0000 7f56e67fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557398aea640 0x557398aee010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:49366/0 (socket says 172.21.15.50:49366) 2024-06-06T03:28:14.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.207+0000 7f56e77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557398aeaf60 0x557398aee550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:14.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.207+0000 7f56e67fc700 1 -- 172.21.15.50:0/1818626168 learned_addr learned my addr 172.21.15.50:0/1818626168 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:14.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.207+0000 7f56e6ffd700 1 --2- 172.21.15.50:0/1818626168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557398ae4f20 0x557398af0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:14.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.207+0000 7f56e67fc700 1 -- 172.21.15.50:0/1818626168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557398ae4f20 msgr2=0x557398af0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:14.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.207+0000 7f56e67fc700 1 --2- 172.21.15.50:0/1818626168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557398ae4f20 0x557398af0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.207+0000 7f56e67fc700 1 -- 172.21.15.50:0/1818626168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557398aeaf60 msgr2=0x557398aee550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:14.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.207+0000 7f56e67fc700 1 --2- 172.21.15.50:0/1818626168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557398aeaf60 0x557398aee550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.207+0000 7f56e67fc700 1 -- 172.21.15.50:0/1818626168 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573989858d0 con 0x557398aea640 2024-06-06T03:28:14.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.207+0000 7f56e77fe700 1 --2- 172.21.15.50:0/1818626168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557398aeaf60 0x557398aee550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:28:14.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.207+0000 7f56e6ffd700 1 --2- 172.21.15.50:0/1818626168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557398ae4f20 0x557398af0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:28:14.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.208+0000 7f56e67fc700 1 --2- 172.21.15.50:0/1818626168 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557398aea640 0x557398aee010 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00b780 tx=0x7f56dc005ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eefbd8c274bbf6ff server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:14.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.208+0000 7f56caff5700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:28:14.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.208+0000 7f56caff5700 1 -- 172.21.15.50:0/1818626168 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56dc005da0 con 0x557398aea640 2024-06-06T03:28:14.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.208+0000 7f56f7b0cb80 1 -- 172.21.15.50:0/1818626168 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56dc027070 con 0x557398aea640 2024-06-06T03:28:14.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.208+0000 7f56caff5700 1 -- 172.21.15.50:0/1818626168 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f56dc0037c0 con 0x557398aea640 2024-06-06T03:28:14.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.208+0000 7f56caff5700 1 -- 172.21.15.50:0/1818626168 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f56dc0039c0 con 0x557398aea640 2024-06-06T03:28:14.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.208+0000 7f56f7b0cb80 10 client.25310 fetch_fsmap learned FSMap version 29 2024-06-06T03:28:14.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.208+0000 7f56f7b0cb80 1 -- 172.21.15.50:0/1818626168 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557398afc2b0 con 0x557398aea640 2024-06-06T03:28:14.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.209+0000 7f56caff5700 1 -- 172.21.15.50:0/1818626168 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f56dc027070 con 0x557398aea640 2024-06-06T03:28:14.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.209+0000 7f56caff5700 1 -- 172.21.15.50:0/1818626168 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f56dc00fad0 con 0x557398aea640 2024-06-06T03:28:14.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.209+0000 7f56f7b0cb80 10 client.25310 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:28:14.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.209+0000 7f56f7b0cb80 10 client.25310 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:28:14.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.209+0000 7f56f7b0cb80 20 client.25310 populate_metadata read hostname 'smithi050' 2024-06-06T03:28:14.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.209+0000 7f56f7b0cb80 1 --2- 172.21.15.50:0/1818626168 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x557398afe780 0x557398b00b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:14.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.209+0000 7f56f7b0cb80 4 client.25310 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:28:14.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.209+0000 7f56f7b0cb80 1 -- 172.21.15.50:0/1818626168 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557398a43d10 con 0x557398afe780 2024-06-06T03:28:14.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.210+0000 7f56e6ffd700 1 --2- 172.21.15.50:0/1818626168 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x557398afe780 0x557398b00b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:14.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.211+0000 7f56e6ffd700 1 --2- 172.21.15.50:0/1818626168 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x557398afe780 0x557398b00b70 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9c96b85a6422708 server_cookie=2688f7d7ba6b959e in_seq=0 out_seq=0 2024-06-06T03:28:14.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.211+0000 7f56caff5700 10 client.25310 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:14.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.211+0000 7f56caff5700 1 -- 172.21.15.50:0/1818626168 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x557398a43d10 con 0x557398afe780 2024-06-06T03:28:14.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.211+0000 7f56caff5700 10 client.25310 handle_command_reply: tid=0 2024-06-06T03:28:14.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.211+0000 7f56f7b0cb80 1 client.25310 shutdown 2024-06-06T03:28:14.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.212+0000 7f56f7b0cb80 1 -- 172.21.15.50:0/1818626168 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557398aea640 msgr2=0x557398aee010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:14.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.212+0000 7f56f7b0cb80 1 --2- 172.21.15.50:0/1818626168 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557398aea640 0x557398aee010 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00b780 tx=0x7f56dc005ac0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.212+0000 7f56f7b0cb80 1 -- 172.21.15.50:0/1818626168 shutdown_connections 2024-06-06T03:28:14.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.212+0000 7f56f7b0cb80 1 --2- 172.21.15.50:0/1818626168 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x557398afe780 0x557398b00b70 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.212+0000 7f56f7b0cb80 1 --2- 172.21.15.50:0/1818626168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557398aeaf60 0x557398aee550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.212+0000 7f56f7b0cb80 1 --2- 172.21.15.50:0/1818626168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557398ae4f20 0x557398af0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.212+0000 7f56caff5700 0 client.25310 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:14.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.212+0000 7f56f7b0cb80 1 --2- 172.21.15.50:0/1818626168 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557398aea640 0x557398aee010 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.212+0000 7f56f7b0cb80 1 -- 172.21.15.50:0/1818626168 >> 172.21.15.50:0/1818626168 conn(0x557398a0fcc0 msgr2=0x557398ae39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:14.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.212+0000 7f56f7b0cb80 1 -- 172.21.15.50:0/1818626168 shutdown_connections 2024-06-06T03:28:14.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.212+0000 7f56f7b0cb80 1 -- 172.21.15.50:0/1818626168 wait complete. 2024-06-06T03:28:14.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.212+0000 7f56f7b0cb80 20 client.25310 trim_cache size 0 max 16384 2024-06-06T03:28:14.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.241+0000 7f56f7b0cb80 1 Processor -- start 2024-06-06T03:28:14.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.241+0000 7f56f7b0cb80 1 -- start start 2024-06-06T03:28:14.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.241+0000 7f56f7b0cb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557398ae4f20 0x557398ae49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:14.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.241+0000 7f56f7b0cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557398aea640 0x557398adf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:14.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.241+0000 7f56f7b0cb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557398aeaf60 0x557398aee6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:14.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.242+0000 7f56f7b0cb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f56e81b6f70 con 0x557398ae4f20 2024-06-06T03:28:14.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.242+0000 7f56f7b0cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f56e81b4800 con 0x557398aea640 2024-06-06T03:28:14.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.242+0000 7f56f7b0cb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f56e81b2650 con 0x557398aeaf60 2024-06-06T03:28:14.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.242+0000 7f56e67fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557398aea640 0x557398adf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:14.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.242+0000 7f56e67fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557398aea640 0x557398adf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:49376/0 (socket says 172.21.15.50:49376) 2024-06-06T03:28:14.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.242+0000 7f56e67fc700 1 -- 172.21.15.50:0/242124462 learned_addr learned my addr 172.21.15.50:0/242124462 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:14.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.242+0000 7f56e6ffd700 1 --2- 172.21.15.50:0/242124462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557398ae4f20 0x557398ae49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:14.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.242+0000 7f56e77fe700 1 --2- 172.21.15.50:0/242124462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557398aeaf60 0x557398aee6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:14.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.242+0000 7f56e67fc700 1 -- 172.21.15.50:0/242124462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557398aeaf60 msgr2=0x557398aee6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:14.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.242+0000 7f56e67fc700 1 --2- 172.21.15.50:0/242124462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557398aeaf60 0x557398aee6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.242+0000 7f56e67fc700 1 -- 172.21.15.50:0/242124462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557398ae4f20 msgr2=0x557398ae49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:14.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.242+0000 7f56e67fc700 1 --2- 172.21.15.50:0/242124462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557398ae4f20 0x557398ae49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.242+0000 7f56e67fc700 1 -- 172.21.15.50:0/242124462 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557398aec580 con 0x557398aea640 2024-06-06T03:28:14.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.243+0000 7f56e67fc700 1 --2- 172.21.15.50:0/242124462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557398aea640 0x557398adf9f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f56dc009990 tx=0x7f56dc034f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=145f8ff3ca49cf15 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:14.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.243+0000 7f56ccff9700 1 -- 172.21.15.50:0/242124462 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56dc003790 con 0x557398aea640 2024-06-06T03:28:14.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.243+0000 7f56ccff9700 1 -- 172.21.15.50:0/242124462 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f56dc027070 con 0x557398aea640 2024-06-06T03:28:14.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.243+0000 7f56ccff9700 1 -- 172.21.15.50:0/242124462 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56dc003dc0 con 0x557398aea640 2024-06-06T03:28:14.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.245+0000 7f56f7b0cb80 1 -- 172.21.15.50:0/242124462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557398aea640 msgr2=0x557398adf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:14.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.245+0000 7f56f7b0cb80 1 --2- 172.21.15.50:0/242124462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557398aea640 0x557398adf9f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f56dc009990 tx=0x7f56dc034f20 comp rx=0 tx=0).stop 2024-06-06T03:28:14.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.245+0000 7f56f7b0cb80 1 -- 172.21.15.50:0/242124462 shutdown_connections 2024-06-06T03:28:14.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.245+0000 7f56f7b0cb80 1 --2- 172.21.15.50:0/242124462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557398aeaf60 0x557398aee6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.245+0000 7f56f7b0cb80 1 --2- 172.21.15.50:0/242124462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557398ae4f20 0x557398ae49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.245+0000 7f56f7b0cb80 1 --2- 172.21.15.50:0/242124462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557398aea640 0x557398adf9f0 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f56dc009990 tx=0x7f56dc034f20 comp rx=0 tx=0).stop 2024-06-06T03:28:14.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.245+0000 7f56f7b0cb80 1 -- 172.21.15.50:0/242124462 >> 172.21.15.50:0/242124462 conn(0x557398a0fcc0 msgr2=0x557398aedfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:14.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.245+0000 7f56f7b0cb80 1 -- 172.21.15.50:0/242124462 shutdown_connections 2024-06-06T03:28:14.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.246+0000 7f56f7b0cb80 1 -- 172.21.15.50:0/242124462 wait complete. 2024-06-06T03:28:14.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.246+0000 7f56f7b0cb80 1 -- start start 2024-06-06T03:28:14.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.246+0000 7f56f7b0cb80 1 Processor -- start 2024-06-06T03:28:14.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.247+0000 7f56f7b0cb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557398ae4f20 0x557398b01150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:14.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.247+0000 7f56f7b0cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557398aeaf60 0x557398b01690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:14.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.247+0000 7f56f7b0cb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557398b650a0 0x557398b67490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:14.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.247+0000 7f56f7b0cb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f56e81b2cc0 con 0x557398ae4f20 2024-06-06T03:28:14.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.247+0000 7f56f7b0cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f56e81b4130 con 0x557398aeaf60 2024-06-06T03:28:14.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.247+0000 7f56f7b0cb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f56e81b3390 con 0x557398b650a0 2024-06-06T03:28:14.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.247+0000 7f56f7b0cb80 10 client.0 _ll_register_callbacks cb 0x5573989d0920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:28:14.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.247+0000 7f56e67fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557398aeaf60 0x557398b01690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:14.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.247+0000 7f56e67fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557398aeaf60 0x557398b01690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:49380/0 (socket says 172.21.15.50:49380) 2024-06-06T03:28:14.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.247+0000 7f56e67fc700 1 -- 172.21.15.50:0/1164654626 learned_addr learned my addr 172.21.15.50:0/1164654626 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:14.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.247+0000 7f56e6ffd700 1 --2- 172.21.15.50:0/1164654626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557398ae4f20 0x557398b01150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:14.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.247+0000 7f56e77fe700 1 --2- 172.21.15.50:0/1164654626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557398b650a0 0x557398b67490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:14.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.247+0000 7f56e67fc700 1 -- 172.21.15.50:0/1164654626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557398b650a0 msgr2=0x557398b67490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:14.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.247+0000 7f56e67fc700 1 --2- 172.21.15.50:0/1164654626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557398b650a0 0x557398b67490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.247+0000 7f56e67fc700 1 -- 172.21.15.50:0/1164654626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557398ae4f20 msgr2=0x557398b01150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:14.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.247+0000 7f56e67fc700 1 --2- 172.21.15.50:0/1164654626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557398ae4f20 0x557398b01150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.247+0000 7f56e67fc700 1 -- 172.21.15.50:0/1164654626 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557398b679d0 con 0x557398aeaf60 2024-06-06T03:28:14.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.248+0000 7f56e67fc700 1 --2- 172.21.15.50:0/1164654626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557398aeaf60 0x557398b01690 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f56dc011040 tx=0x7f56dc005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=377b26950e582247 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:14.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.248+0000 7f56caff5700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:28:14.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.248+0000 7f56caff5700 1 -- 172.21.15.50:0/1164654626 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56dc048060 con 0x557398aeaf60 2024-06-06T03:28:14.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.248+0000 7f56caff5700 1 -- 172.21.15.50:0/1164654626 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f56dc016c30 con 0x557398aeaf60 2024-06-06T03:28:14.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.248+0000 7f56f7b0cb80 1 -- 172.21.15.50:0/1164654626 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56dc027070 con 0x557398aeaf60 2024-06-06T03:28:14.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.248+0000 7f56caff5700 1 -- 172.21.15.50:0/1164654626 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f56dc04f050 con 0x557398aeaf60 2024-06-06T03:28:14.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.248+0000 7f56f7b0cb80 10 client.25316 fetch_fsmap learned FSMap version 29 2024-06-06T03:28:14.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.248+0000 7f56f7b0cb80 1 -- 172.21.15.50:0/1164654626 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557398b68c90 con 0x557398aeaf60 2024-06-06T03:28:14.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.249+0000 7f56caff5700 1 -- 172.21.15.50:0/1164654626 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f56dc027070 con 0x557398aeaf60 2024-06-06T03:28:14.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.249+0000 7f56caff5700 1 -- 172.21.15.50:0/1164654626 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f56dc00fad0 con 0x557398aeaf60 2024-06-06T03:28:14.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.249+0000 7f56f7b0cb80 10 client.25316 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:28:14.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.249+0000 7f56f7b0cb80 10 client.25316 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:28:14.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.249+0000 7f56f7b0cb80 20 client.25316 populate_metadata read hostname 'smithi050' 2024-06-06T03:28:14.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.249+0000 7f56f7b0cb80 1 --2- 172.21.15.50:0/1164654626 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x557398b69110 0x557398b6b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:14.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.249+0000 7f56f7b0cb80 4 client.25316 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:28:14.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.249+0000 7f56f7b0cb80 1 -- 172.21.15.50:0/1164654626 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557398a3e290 con 0x557398b69110 2024-06-06T03:28:14.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.249+0000 7f56e6ffd700 1 --2- 172.21.15.50:0/1164654626 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x557398b69110 0x557398b6b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:14.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.250+0000 7f56e6ffd700 1 --2- 172.21.15.50:0/1164654626 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x557398b69110 0x557398b6b530 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d762f7216715019b server_cookie=298112418ba7794e in_seq=0 out_seq=0 2024-06-06T03:28:14.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.250+0000 7f56caff5700 10 client.25316 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:14.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.250+0000 7f56caff5700 1 -- 172.21.15.50:0/1164654626 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557398a3e290 con 0x557398b69110 2024-06-06T03:28:14.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.250+0000 7f56caff5700 10 client.25316 handle_command_reply: tid=0 2024-06-06T03:28:14.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.250+0000 7f56f7b0cb80 1 client.25316 shutdown 2024-06-06T03:28:14.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.250+0000 7f56f7b0cb80 1 -- 172.21.15.50:0/1164654626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557398aeaf60 msgr2=0x557398b01690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:14.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.250+0000 7f56f7b0cb80 1 --2- 172.21.15.50:0/1164654626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557398aeaf60 0x557398b01690 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f56dc011040 tx=0x7f56dc005fd0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.250+0000 7f56f7b0cb80 1 -- 172.21.15.50:0/1164654626 shutdown_connections 2024-06-06T03:28:14.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.250+0000 7f56f7b0cb80 1 --2- 172.21.15.50:0/1164654626 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x557398b69110 0x557398b6b530 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.250+0000 7f56f7b0cb80 1 --2- 172.21.15.50:0/1164654626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557398b650a0 0x557398b67490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.250+0000 7f56f7b0cb80 1 --2- 172.21.15.50:0/1164654626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557398ae4f20 0x557398b01150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.250+0000 7f56caff5700 0 client.25316 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:14.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.250+0000 7f56f7b0cb80 1 --2- 172.21.15.50:0/1164654626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557398aeaf60 0x557398b01690 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.250+0000 7f56f7b0cb80 1 -- 172.21.15.50:0/1164654626 >> 172.21.15.50:0/1164654626 conn(0x557398a0fcc0 msgr2=0x557398ad8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:14.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.251+0000 7f56f7b0cb80 1 -- 172.21.15.50:0/1164654626 shutdown_connections 2024-06-06T03:28:14.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.251+0000 7f56f7b0cb80 1 -- 172.21.15.50:0/1164654626 wait complete. 2024-06-06T03:28:14.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.251+0000 7f56f7b0cb80 20 client.25316 trim_cache size 0 max 16384 2024-06-06T03:28:14.254 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:28:14.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.251+0000 7f56ed289700 1 -- 172.21.15.50:0/2544584263 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f56d00a2ca0 msgr2=0x7f56d00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:14.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.252+0000 7f56ed289700 1 --2- 172.21.15.50:0/2544584263 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f56d00a2ca0 0x7f56d00a5160 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f56d8005950 tx=0x7f56d80058e0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.252+0000 7f56ed289700 1 -- 172.21.15.50:0/2544584263 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56e8108520 msgr2=0x7f56e8075210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:14.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.252+0000 7f56ed289700 1 --2- 172.21.15.50:0/2544584263 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56e8108520 0x7f56e8075210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f56e000ef30 tx=0x7f56e000c3a0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.252+0000 7f56ed289700 1 -- 172.21.15.50:0/2544584263 shutdown_connections 2024-06-06T03:28:14.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.252+0000 7f56ed289700 1 --2- 172.21.15.50:0/2544584263 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56e8108520 0x7f56e8075210 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.252+0000 7f56ed289700 1 --2- 172.21.15.50:0/2544584263 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f56d00a2ca0 0x7f56d00a5160 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.252+0000 7f56ed289700 1 --2- 172.21.15.50:0/2544584263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56e8102510 0x7f56e8074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.252+0000 7f56ed289700 1 --2- 172.21.15.50:0/2544584263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56e8102ed0 0x7f56e8074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:14.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.252+0000 7f56ed289700 1 -- 172.21.15.50:0/2544584263 >> 172.21.15.50:0/2544584263 conn(0x7f56e8079560 msgr2=0x7f56e81011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:14.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.252+0000 7f56ed289700 1 -- 172.21.15.50:0/2544584263 shutdown_connections 2024-06-06T03:28:14.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:14.252+0000 7f56ed289700 1 -- 172.21.15.50:0/2544584263 wait complete. 2024-06-06T03:28:14.942 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:14 smithi050 ceph-mon[32421]: pgmap v479: 129 pgs: 129 active+clean; 1.7 GiB data, 609 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 142 MiB/s wr, 86 op/s 2024-06-06T03:28:15.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:14 smithi079 ceph-mon[35478]: pgmap v479: 129 pgs: 129 active+clean; 1.7 GiB data, 609 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 142 MiB/s wr, 86 op/s 2024-06-06T03:28:15.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:14 smithi122 ceph-mon[35759]: pgmap v479: 129 pgs: 129 active+clean; 1.7 GiB data, 609 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 142 MiB/s wr, 86 op/s 2024-06-06T03:28:15.989 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-06T03:28:15.989 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-06-06T03:28:16.378 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:28:17.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:16 smithi079 ceph-mon[35478]: pgmap v480: 129 pgs: 129 active+clean; 2.1 GiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 163 MiB/s wr, 102 op/s 2024-06-06T03:28:17.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:16 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:28:17.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:16 smithi122 ceph-mon[35759]: pgmap v480: 129 pgs: 129 active+clean; 2.1 GiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 163 MiB/s wr, 102 op/s 2024-06-06T03:28:17.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:16 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:28:17.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:16 smithi050 ceph-mon[32421]: pgmap v480: 129 pgs: 129 active+clean; 2.1 GiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 163 MiB/s wr, 102 op/s 2024-06-06T03:28:17.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:16 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:28:18.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:17 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:28:18.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:17 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:28:18.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:17 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:28:18.167 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:17 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:28:18.167 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:17 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:28:18.167 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:17 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:28:18.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:17 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:28:18.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:17 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:28:18.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:17 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:28:18.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.498+0000 7f7d00c15700 1 -- 172.21.15.50:0/3453591955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cfc102510 msgr2=0x7f7cfc102990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:18.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.498+0000 7f7d00c15700 1 --2- 172.21.15.50:0/3453591955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cfc102510 0x7f7cfc102990 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0009990 tx=0x7f7cf0009ca0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.498+0000 7f7d00c15700 1 -- 172.21.15.50:0/3453591955 shutdown_connections 2024-06-06T03:28:18.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.498+0000 7f7d00c15700 1 --2- 172.21.15.50:0/3453591955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cfc102ed0 0x7f7cfc10f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.498+0000 7f7d00c15700 1 --2- 172.21.15.50:0/3453591955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cfc108520 0x7f7cfc108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.498+0000 7f7d00c15700 1 --2- 172.21.15.50:0/3453591955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cfc102510 0x7f7cfc102990 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.498+0000 7f7d00c15700 1 -- 172.21.15.50:0/3453591955 >> 172.21.15.50:0/3453591955 conn(0x7f7cfc079560 msgr2=0x7f7cfc079970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:18.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.498+0000 7f7d00c15700 1 -- 172.21.15.50:0/3453591955 shutdown_connections 2024-06-06T03:28:18.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.498+0000 7f7d00c15700 1 -- 172.21.15.50:0/3453591955 wait complete. 2024-06-06T03:28:18.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.499+0000 7f7d00c15700 1 Processor -- start 2024-06-06T03:28:18.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.499+0000 7f7d00c15700 1 -- start start 2024-06-06T03:28:18.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.500+0000 7f7d00c15700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cfc102510 0x7f7cfc19ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:18.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.500+0000 7f7d00c15700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cfc102ed0 0x7f7cfc19b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:18.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.500+0000 7f7d00c15700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cfc108520 0x7f7cfc19f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:18.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.500+0000 7f7d00c15700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7cfc075e70 con 0x7f7cfc108520 2024-06-06T03:28:18.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.500+0000 7f7d00c15700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7cfc075cf0 con 0x7f7cfc102510 2024-06-06T03:28:18.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.500+0000 7f7d00c15700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7cfc075ff0 con 0x7f7cfc102ed0 2024-06-06T03:28:18.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.500+0000 7f7cfad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cfc108520 0x7f7cfc19f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:18.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.500+0000 7f7cfad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cfc108520 0x7f7cfc19f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51642/0 (socket says 172.21.15.50:51642) 2024-06-06T03:28:18.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.500+0000 7f7cfad9d700 1 -- 172.21.15.50:0/611757918 learned_addr learned my addr 172.21.15.50:0/611757918 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:18.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.500+0000 7f7cfa59c700 1 --2- 172.21.15.50:0/611757918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cfc102510 0x7f7cfc19ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:18.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.500+0000 7f7cf9d9b700 1 --2- 172.21.15.50:0/611757918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cfc102ed0 0x7f7cfc19b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:18.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.500+0000 7f7cfa59c700 1 -- 172.21.15.50:0/611757918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cfc102ed0 msgr2=0x7f7cfc19b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:18.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.500+0000 7f7cfa59c700 1 --2- 172.21.15.50:0/611757918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cfc102ed0 0x7f7cfc19b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.501+0000 7f7cfa59c700 1 -- 172.21.15.50:0/611757918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cfc108520 msgr2=0x7f7cfc19f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:18.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.501+0000 7f7cfa59c700 1 --2- 172.21.15.50:0/611757918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cfc108520 0x7f7cfc19f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.501+0000 7f7cfa59c700 1 -- 172.21.15.50:0/611757918 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cfc19fd40 con 0x7f7cfc102510 2024-06-06T03:28:18.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.501+0000 7f7cfa59c700 1 --2- 172.21.15.50:0/611757918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cfc102510 0x7f7cfc19ad30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7cec00e9f0 tx=0x7f7cec00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:18.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.501+0000 7f7ceb7fe700 1 -- 172.21.15.50:0/611757918 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec00c9c0 con 0x7f7cfc102510 2024-06-06T03:28:18.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.502+0000 7f7ceb7fe700 1 -- 172.21.15.50:0/611757918 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7cec00cb60 con 0x7f7cfc102510 2024-06-06T03:28:18.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.502+0000 7f7ceb7fe700 1 -- 172.21.15.50:0/611757918 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec018680 con 0x7f7cfc102510 2024-06-06T03:28:18.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.502+0000 7f7d00c15700 1 -- 172.21.15.50:0/611757918 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cfc1a0030 con 0x7f7cfc102510 2024-06-06T03:28:18.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.502+0000 7f7d00c15700 1 -- 172.21.15.50:0/611757918 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cfc1a78b0 con 0x7f7cfc102510 2024-06-06T03:28:18.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.505+0000 7f7ceb7fe700 1 -- 172.21.15.50:0/611757918 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7cec010430 con 0x7f7cfc102510 2024-06-06T03:28:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.506+0000 7f7ceb7fe700 1 --2- 172.21.15.50:0/611757918 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7ce40a2ca0 0x7f7ce40a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.506+0000 7f7ceb7fe700 1 -- 172.21.15.50:0/611757918 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f7cec0cf380 con 0x7f7cfc102510 2024-06-06T03:28:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.506+0000 7f7cf9d9b700 1 --2- 172.21.15.50:0/611757918 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7ce40a2ca0 0x7f7ce40a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.507+0000 7f7d0b498b80 1 Processor -- start 2024-06-06T03:28:18.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.507+0000 7f7cf9d9b700 1 --2- 172.21.15.50:0/611757918 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7ce40a2ca0 0x7f7ce40a5160 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc079980 tx=0x7f7cf000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:18.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.507+0000 7f7d0b498b80 1 -- start start 2024-06-06T03:28:18.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.507+0000 7f7d0b498b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8aa29e7f0 0x55a8aa29ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:18.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.507+0000 7f7d0b498b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8aa29f110 0x55a8aa298af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:18.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.507+0000 7f7d0b498b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8aa299030 0x55a8aa299470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:18.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.507+0000 7f7d0b498b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a8aa182fe0 con 0x55a8aa299030 2024-06-06T03:28:18.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.507+0000 7f7d0b498b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a8aa1e18d0 con 0x55a8aa29e7f0 2024-06-06T03:28:18.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.507+0000 7f7d0b498b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a8aa1494e0 con 0x55a8aa29f110 2024-06-06T03:28:18.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.508+0000 7f7cfad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8aa299030 0x55a8aa299470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:18.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.508+0000 7f7cfad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8aa299030 0x55a8aa299470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51644/0 (socket says 172.21.15.50:51644) 2024-06-06T03:28:18.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.508+0000 7f7cfad9d700 1 -- 172.21.15.50:0/217988392 learned_addr learned my addr 172.21.15.50:0/217988392 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:18.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.508+0000 7f7cfa59c700 1 --2- 172.21.15.50:0/217988392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8aa29e7f0 0x55a8aa29ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:18.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.508+0000 7f7cf9d9b700 1 --2- 172.21.15.50:0/217988392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8aa29f110 0x55a8aa298af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:18.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.508+0000 7f7cfad9d700 1 -- 172.21.15.50:0/217988392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8aa29f110 msgr2=0x55a8aa298af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:18.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.508+0000 7f7cfad9d700 1 --2- 172.21.15.50:0/217988392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8aa29f110 0x55a8aa298af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.508+0000 7f7cfad9d700 1 -- 172.21.15.50:0/217988392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8aa29e7f0 msgr2=0x55a8aa29ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:18.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.508+0000 7f7cfad9d700 1 --2- 172.21.15.50:0/217988392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8aa29e7f0 0x55a8aa29ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.508+0000 7f7cfad9d700 1 -- 172.21.15.50:0/217988392 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8aa130950 con 0x55a8aa299030 2024-06-06T03:28:18.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.508+0000 7f7cfa59c700 1 --2- 172.21.15.50:0/217988392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8aa29e7f0 0x55a8aa29ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:28:18.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.508+0000 7f7cfad9d700 1 --2- 172.21.15.50:0/217988392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8aa299030 0x55a8aa299470 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4007500 tx=0x7f7cf4009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7a17c99378a6ed server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:18.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.508+0000 7f7ce8ff9700 1 -- 172.21.15.50:0/217988392 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf40147f0 con 0x55a8aa299030 2024-06-06T03:28:18.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.509+0000 7f7ce8ff9700 1 -- 172.21.15.50:0/217988392 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7cf401a070 con 0x55a8aa299030 2024-06-06T03:28:18.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.509+0000 7f7ce8ff9700 1 -- 172.21.15.50:0/217988392 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4015d80 con 0x55a8aa299030 2024-06-06T03:28:18.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.509+0000 7f7d0b498b80 1 -- 172.21.15.50:0/217988392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8aa299030 msgr2=0x55a8aa299470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:18.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.509+0000 7f7d0b498b80 1 --2- 172.21.15.50:0/217988392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8aa299030 0x55a8aa299470 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4007500 tx=0x7f7cf4009230 comp rx=0 tx=0).stop 2024-06-06T03:28:18.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.510+0000 7f7d0b498b80 1 -- 172.21.15.50:0/217988392 shutdown_connections 2024-06-06T03:28:18.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.510+0000 7f7d0b498b80 1 --2- 172.21.15.50:0/217988392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8aa299030 0x55a8aa299470 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.510+0000 7f7d0b498b80 1 --2- 172.21.15.50:0/217988392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8aa29e7f0 0x55a8aa29ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.510+0000 7f7d0b498b80 1 --2- 172.21.15.50:0/217988392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8aa29f110 0x55a8aa298af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.510+0000 7f7d0b498b80 1 -- 172.21.15.50:0/217988392 >> 172.21.15.50:0/217988392 conn(0x55a8aa1bd100 msgr2=0x55a8aa28b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:18.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.510+0000 7f7d0b498b80 1 -- 172.21.15.50:0/217988392 shutdown_connections 2024-06-06T03:28:18.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.510+0000 7f7d0b498b80 1 -- 172.21.15.50:0/217988392 wait complete. 2024-06-06T03:28:18.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.510+0000 7f7d0b498b80 1 -- start start 2024-06-06T03:28:18.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.510+0000 7f7d0b498b80 1 Processor -- start 2024-06-06T03:28:18.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.511+0000 7f7d0b498b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8aa299030 0x55a8aa2a4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:18.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.511+0000 7f7d0b498b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8aa29e7f0 0x55a8aa2a2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:18.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.511+0000 7f7d0b498b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8aa29f110 0x55a8aa2a2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:18.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.511+0000 7f7cfa59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8aa299030 0x55a8aa2a4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:18.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.511+0000 7f7d0b498b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a8aa182040 con 0x55a8aa29f110 2024-06-06T03:28:18.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.511+0000 7f7d0b498b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a8aa1dd890 con 0x55a8aa299030 2024-06-06T03:28:18.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.511+0000 7f7cfa59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8aa299030 0x55a8aa2a4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:57666/0 (socket says 172.21.15.50:57666) 2024-06-06T03:28:18.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.511+0000 7f7cfad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8aa29f110 0x55a8aa2a2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:18.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.511+0000 7f7cfa59c700 1 -- 172.21.15.50:0/1322600782 learned_addr learned my addr 172.21.15.50:0/1322600782 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:18.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.511+0000 7f7cf9d9b700 1 --2- 172.21.15.50:0/1322600782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8aa29e7f0 0x55a8aa2a2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:18.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.511+0000 7f7d0b498b80 1 -- 172.21.15.50:0/1322600782 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a8aa2a5ba0 con 0x55a8aa29e7f0 2024-06-06T03:28:18.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.511+0000 7f7d0b498b80 10 client.0 _ll_register_callbacks cb 0x55a8aa177630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:28:18.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.512+0000 7f7cfa59c700 1 -- 172.21.15.50:0/1322600782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8aa29e7f0 msgr2=0x55a8aa2a2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:18.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.512+0000 7f7cfa59c700 1 --2- 172.21.15.50:0/1322600782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8aa29e7f0 0x55a8aa2a2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.512+0000 7f7cfa59c700 1 -- 172.21.15.50:0/1322600782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8aa29f110 msgr2=0x55a8aa2a2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:18.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.512+0000 7f7cfa59c700 1 --2- 172.21.15.50:0/1322600782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8aa29f110 0x55a8aa2a2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.512+0000 7f7cfa59c700 1 -- 172.21.15.50:0/1322600782 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8aa1a77d0 con 0x55a8aa299030 2024-06-06T03:28:18.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.512+0000 7f7cfad9d700 1 --2- 172.21.15.50:0/1322600782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8aa29f110 0x55a8aa2a2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:28:18.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.512+0000 7f7cfa59c700 1 --2- 172.21.15.50:0/1322600782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8aa299030 0x55a8aa2a4e20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7cec009230 tx=0x7f7cec09b290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36faac4b2aa12c05 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:18.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.512+0000 7f7ce1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:28:18.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.512+0000 7f7ce1ffb700 1 -- 172.21.15.50:0/1322600782 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec09bf60 con 0x55a8aa299030 2024-06-06T03:28:18.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.512+0000 7f7ce1ffb700 1 -- 172.21.15.50:0/1322600782 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f7cec0860b0 con 0x55a8aa299030 2024-06-06T03:28:18.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.512+0000 7f7d0b498b80 1 -- 172.21.15.50:0/1322600782 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7cf401a070 con 0x55a8aa299030 2024-06-06T03:28:18.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.512+0000 7f7ce1ffb700 1 -- 172.21.15.50:0/1322600782 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7cec0862b0 con 0x55a8aa299030 2024-06-06T03:28:18.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.512+0000 7f7d0b498b80 10 client.25325 fetch_fsmap learned FSMap version 29 2024-06-06T03:28:18.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.512+0000 7f7d0b498b80 1 -- 172.21.15.50:0/1322600782 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a8aa2b0250 con 0x55a8aa299030 2024-06-06T03:28:18.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.512+0000 7f7ce1ffb700 1 -- 172.21.15.50:0/1322600782 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7cec09b860 con 0x55a8aa299030 2024-06-06T03:28:18.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.513+0000 7f7ce1ffb700 1 -- 172.21.15.50:0/1322600782 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f7cec09cb90 con 0x55a8aa299030 2024-06-06T03:28:18.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.513+0000 7f7d0b498b80 10 client.25325 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:28:18.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.513+0000 7f7d0b498b80 10 client.25325 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:28:18.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.513+0000 7f7d0b498b80 20 client.25325 populate_metadata read hostname 'smithi050' 2024-06-06T03:28:18.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.513+0000 7f7d0b498b80 1 --2- 172.21.15.50:0/1322600782 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55a8aa2b2890 0x55a8aa2b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:18.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.513+0000 7f7d0b498b80 4 client.25325 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:28:18.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.513+0000 7f7d0b498b80 1 -- 172.21.15.50:0/1322600782 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7cf401a070 con 0x55a8aa2b2890 2024-06-06T03:28:18.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.513+0000 7f7cf9d9b700 1 --2- 172.21.15.50:0/1322600782 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55a8aa2b2890 0x55a8aa2b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:18.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.514+0000 7f7ce1ffb700 10 client.25325 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:18.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.514+0000 7f7cf9d9b700 1 --2- 172.21.15.50:0/1322600782 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55a8aa2b2890 0x55a8aa2b4c80 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=354f8bb59d7cfcf2 server_cookie=39304a443df88b9 in_seq=0 out_seq=0 2024-06-06T03:28:18.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.514+0000 7f7ce1ffb700 1 -- 172.21.15.50:0/1322600782 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x7f7cf401a070 con 0x55a8aa2b2890 2024-06-06T03:28:18.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.514+0000 7f7ce1ffb700 10 client.25325 handle_command_reply: tid=0 2024-06-06T03:28:18.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.514+0000 7f7d0b498b80 1 client.25325 shutdown 2024-06-06T03:28:18.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.515+0000 7f7d0b498b80 1 -- 172.21.15.50:0/1322600782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8aa299030 msgr2=0x55a8aa2a4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:18.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.515+0000 7f7d0b498b80 1 --2- 172.21.15.50:0/1322600782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8aa299030 0x55a8aa2a4e20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7cec009230 tx=0x7f7cec09b290 comp rx=0 tx=0).stop 2024-06-06T03:28:18.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.515+0000 7f7d0b498b80 1 -- 172.21.15.50:0/1322600782 shutdown_connections 2024-06-06T03:28:18.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.515+0000 7f7d0b498b80 1 --2- 172.21.15.50:0/1322600782 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55a8aa2b2890 0x55a8aa2b4c80 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.515+0000 7f7ce1ffb700 0 client.25325 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:18.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.515+0000 7f7d0b498b80 1 --2- 172.21.15.50:0/1322600782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8aa29f110 0x55a8aa2a2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.515+0000 7f7d0b498b80 1 --2- 172.21.15.50:0/1322600782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8aa299030 0x55a8aa2a4e20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.515+0000 7f7d0b498b80 1 --2- 172.21.15.50:0/1322600782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8aa29e7f0 0x55a8aa2a2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.515+0000 7f7d0b498b80 1 -- 172.21.15.50:0/1322600782 >> 172.21.15.50:0/1322600782 conn(0x55a8aa1bd100 msgr2=0x55a8aa28a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:18.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.515+0000 7f7d0b498b80 1 -- 172.21.15.50:0/1322600782 shutdown_connections 2024-06-06T03:28:18.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.515+0000 7f7d0b498b80 1 -- 172.21.15.50:0/1322600782 wait complete. 2024-06-06T03:28:18.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.515+0000 7f7d0b498b80 20 client.25325 trim_cache size 0 max 16384 2024-06-06T03:28:18.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.549+0000 7f7d0b498b80 1 Processor -- start 2024-06-06T03:28:18.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.549+0000 7f7d0b498b80 1 -- start start 2024-06-06T03:28:18.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.550+0000 7f7d0b498b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8aa299030 0x55a8aa2a4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:18.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.550+0000 7f7d0b498b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8aa29e7f0 0x55a8aa28af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:18.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.550+0000 7f7d0b498b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8aa29f110 0x55a8aa28b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:18.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.550+0000 7f7d0b498b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7cfc1ae900 con 0x55a8aa299030 2024-06-06T03:28:18.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.550+0000 7f7d0b498b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7cfc1ac190 con 0x55a8aa29e7f0 2024-06-06T03:28:18.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.550+0000 7f7d0b498b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7cfc1aa000 con 0x55a8aa29f110 2024-06-06T03:28:18.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.550+0000 7f7cfa59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8aa299030 0x55a8aa2a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:18.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.550+0000 7f7cfa59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8aa299030 0x55a8aa2a4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51648/0 (socket says 172.21.15.50:51648) 2024-06-06T03:28:18.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.550+0000 7f7cfa59c700 1 -- 172.21.15.50:0/3761740540 learned_addr learned my addr 172.21.15.50:0/3761740540 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:18.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.550+0000 7f7cfad9d700 1 --2- 172.21.15.50:0/3761740540 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8aa29f110 0x55a8aa28b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:18.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.550+0000 7f7cf9d9b700 1 --2- 172.21.15.50:0/3761740540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8aa29e7f0 0x55a8aa28af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:18.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.550+0000 7f7cfa59c700 1 -- 172.21.15.50:0/3761740540 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8aa29f110 msgr2=0x55a8aa28b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:18.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.551+0000 7f7cfa59c700 1 --2- 172.21.15.50:0/3761740540 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8aa29f110 0x55a8aa28b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.551+0000 7f7cfa59c700 1 -- 172.21.15.50:0/3761740540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8aa29e7f0 msgr2=0x55a8aa28af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:18.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.551+0000 7f7cfa59c700 1 --2- 172.21.15.50:0/3761740540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8aa29e7f0 0x55a8aa28af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.551+0000 7f7cfa59c700 1 -- 172.21.15.50:0/3761740540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8aa2a29e0 con 0x55a8aa299030 2024-06-06T03:28:18.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.551+0000 7f7cfa59c700 1 --2- 172.21.15.50:0/3761740540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8aa299030 0x55a8aa2a4060 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7cec099b10 tx=0x7f7cec010a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e64882cbabec4d6 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:18.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.551+0000 7f7ce3fff700 1 -- 172.21.15.50:0/3761740540 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec09b860 con 0x55a8aa299030 2024-06-06T03:28:18.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.551+0000 7f7ce3fff700 1 -- 172.21.15.50:0/3761740540 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7cec0a44d0 con 0x55a8aa299030 2024-06-06T03:28:18.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.551+0000 7f7ce3fff700 1 -- 172.21.15.50:0/3761740540 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec09cb90 con 0x55a8aa299030 2024-06-06T03:28:18.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.552+0000 7f7d0b498b80 1 -- 172.21.15.50:0/3761740540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8aa299030 msgr2=0x55a8aa2a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:18.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.552+0000 7f7d0b498b80 1 --2- 172.21.15.50:0/3761740540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8aa299030 0x55a8aa2a4060 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7cec099b10 tx=0x7f7cec010a60 comp rx=0 tx=0).stop 2024-06-06T03:28:18.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.553+0000 7f7d0b498b80 1 -- 172.21.15.50:0/3761740540 shutdown_connections 2024-06-06T03:28:18.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.553+0000 7f7d0b498b80 1 --2- 172.21.15.50:0/3761740540 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8aa29f110 0x55a8aa28b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.553+0000 7f7d0b498b80 1 --2- 172.21.15.50:0/3761740540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8aa299030 0x55a8aa2a4060 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.553+0000 7f7d0b498b80 1 --2- 172.21.15.50:0/3761740540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8aa29e7f0 0x55a8aa28af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.553+0000 7f7d0b498b80 1 -- 172.21.15.50:0/3761740540 >> 172.21.15.50:0/3761740540 conn(0x55a8aa1bd100 msgr2=0x55a8aa2a3950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:18.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.553+0000 7f7d0b498b80 1 -- 172.21.15.50:0/3761740540 shutdown_connections 2024-06-06T03:28:18.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.553+0000 7f7d0b498b80 1 -- 172.21.15.50:0/3761740540 wait complete. 2024-06-06T03:28:18.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.554+0000 7f7d0b498b80 1 -- start start 2024-06-06T03:28:18.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.554+0000 7f7d0b498b80 1 Processor -- start 2024-06-06T03:28:18.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.554+0000 7f7d0b498b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8aa299030 0x55a8aa2ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:18.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.554+0000 7f7d0b498b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8aa29e7f0 0x55a8aa2a7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:18.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.554+0000 7f7d0b498b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8aa29f110 0x55a8aa2a8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:18.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.555+0000 7f7d0b498b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7cfc1aa650 con 0x55a8aa29e7f0 2024-06-06T03:28:18.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.555+0000 7f7d0b498b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7cfc1abac0 con 0x55a8aa299030 2024-06-06T03:28:18.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.555+0000 7f7d0b498b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7cfc1aad20 con 0x55a8aa29f110 2024-06-06T03:28:18.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.555+0000 7f7d0b498b80 10 client.0 _ll_register_callbacks cb 0x55a8aa29cd50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:28:18.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.555+0000 7f7cfa59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8aa299030 0x55a8aa2ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:18.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.555+0000 7f7cfa59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8aa299030 0x55a8aa2ab6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:57680/0 (socket says 172.21.15.50:57680) 2024-06-06T03:28:18.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.555+0000 7f7cfa59c700 1 -- 172.21.15.50:0/785234023 learned_addr learned my addr 172.21.15.50:0/785234023 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:18.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.555+0000 7f7cfad9d700 1 --2- 172.21.15.50:0/785234023 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8aa29f110 0x55a8aa2a8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:18.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.555+0000 7f7cf9d9b700 1 --2- 172.21.15.50:0/785234023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8aa29e7f0 0x55a8aa2a7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:18.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.555+0000 7f7cfa59c700 1 -- 172.21.15.50:0/785234023 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8aa29f110 msgr2=0x55a8aa2a8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:18.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.555+0000 7f7cfa59c700 1 --2- 172.21.15.50:0/785234023 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8aa29f110 0x55a8aa2a8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.555+0000 7f7cfa59c700 1 -- 172.21.15.50:0/785234023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8aa29e7f0 msgr2=0x55a8aa2a7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:18.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.555+0000 7f7cfa59c700 1 --2- 172.21.15.50:0/785234023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8aa29e7f0 0x55a8aa2a7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.555+0000 7f7cfa59c700 1 -- 172.21.15.50:0/785234023 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8aa31d510 con 0x55a8aa299030 2024-06-06T03:28:18.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.555+0000 7f7cf9d9b700 1 --2- 172.21.15.50:0/785234023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8aa29e7f0 0x55a8aa2a7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:28:18.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.555+0000 7f7cfa59c700 1 --2- 172.21.15.50:0/785234023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8aa299030 0x55a8aa2ab6e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7cec009230 tx=0x7f7cec00c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c39c0fe96745342 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:18.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.555+0000 7f7ce1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:28:18.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.556+0000 7f7ce1ffb700 1 -- 172.21.15.50:0/785234023 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec0860e0 con 0x55a8aa299030 2024-06-06T03:28:18.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.556+0000 7f7ce1ffb700 1 -- 172.21.15.50:0/785234023 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f7cec0a4250 con 0x55a8aa299030 2024-06-06T03:28:18.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.556+0000 7f7d0b498b80 1 -- 172.21.15.50:0/785234023 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7cec0a44d0 con 0x55a8aa299030 2024-06-06T03:28:18.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.556+0000 7f7ce1ffb700 1 -- 172.21.15.50:0/785234023 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7cec082050 con 0x55a8aa299030 2024-06-06T03:28:18.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.556+0000 7f7d0b498b80 10 client.25331 fetch_fsmap learned FSMap version 29 2024-06-06T03:28:18.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.556+0000 7f7d0b498b80 1 -- 172.21.15.50:0/785234023 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a8aa31e6e0 con 0x55a8aa299030 2024-06-06T03:28:18.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.556+0000 7f7ce1ffb700 1 -- 172.21.15.50:0/785234023 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7cec0a44d0 con 0x55a8aa299030 2024-06-06T03:28:18.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.556+0000 7f7ce1ffb700 1 -- 172.21.15.50:0/785234023 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f7cec09a720 con 0x55a8aa299030 2024-06-06T03:28:18.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.556+0000 7f7d0b498b80 10 client.25331 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:28:18.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.556+0000 7f7d0b498b80 10 client.25331 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:28:18.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.556+0000 7f7d0b498b80 20 client.25331 populate_metadata read hostname 'smithi050' 2024-06-06T03:28:18.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.556+0000 7f7d0b498b80 1 --2- 172.21.15.50:0/785234023 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55a8aa2b2890 0x55a8aa320ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:18.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.557+0000 7f7d0b498b80 4 client.25331 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-06T03:28:18.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.557+0000 7f7d0b498b80 1 -- 172.21.15.50:0/785234023 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a8aa1eedd0 con 0x55a8aa2b2890 2024-06-06T03:28:18.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.557+0000 7f7cf9d9b700 1 --2- 172.21.15.50:0/785234023 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55a8aa2b2890 0x55a8aa320ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:18.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.557+0000 7f7cf9d9b700 1 --2- 172.21.15.50:0/785234023 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55a8aa2b2890 0x55a8aa320ab0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da09b42bfe0408dc server_cookie=530859ed466fe2ec in_seq=0 out_seq=0 2024-06-06T03:28:18.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.557+0000 7f7ce1ffb700 10 client.25331 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:18.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.558+0000 7f7ce1ffb700 1 -- 172.21.15.50:0/785234023 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a8aa1eedd0 con 0x55a8aa2b2890 2024-06-06T03:28:18.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.558+0000 7f7ce1ffb700 10 client.25331 handle_command_reply: tid=0 2024-06-06T03:28:18.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.558+0000 7f7d0b498b80 1 client.25331 shutdown 2024-06-06T03:28:18.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.559+0000 7f7d0b498b80 1 -- 172.21.15.50:0/785234023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8aa299030 msgr2=0x55a8aa2ab6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:18.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.559+0000 7f7d0b498b80 1 --2- 172.21.15.50:0/785234023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8aa299030 0x55a8aa2ab6e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7cec009230 tx=0x7f7cec00c6e0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.559+0000 7f7d0b498b80 1 -- 172.21.15.50:0/785234023 shutdown_connections 2024-06-06T03:28:18.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.559+0000 7f7d0b498b80 1 --2- 172.21.15.50:0/785234023 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55a8aa2b2890 0x55a8aa320ab0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.559+0000 7f7d0b498b80 1 --2- 172.21.15.50:0/785234023 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8aa29f110 0x55a8aa2a8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.559+0000 7f7d0b498b80 1 --2- 172.21.15.50:0/785234023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8aa299030 0x55a8aa2ab6e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.559+0000 7f7d0b498b80 1 --2- 172.21.15.50:0/785234023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8aa29e7f0 0x55a8aa2a7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.559+0000 7f7ce1ffb700 0 client.25331 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:18.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.559+0000 7f7d0b498b80 1 -- 172.21.15.50:0/785234023 >> 172.21.15.50:0/785234023 conn(0x55a8aa1bd100 msgr2=0x55a8aa2a3950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:18.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.559+0000 7f7d0b498b80 1 -- 172.21.15.50:0/785234023 shutdown_connections 2024-06-06T03:28:18.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.559+0000 7f7d0b498b80 1 -- 172.21.15.50:0/785234023 wait complete. 2024-06-06T03:28:18.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.559+0000 7f7d0b498b80 20 client.25331 trim_cache size 0 max 16384 2024-06-06T03:28:18.564 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:28:18.564 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-06-06T03:28:18.564 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "f04c7097-5e56-4bce-b60f-712150f66d8d", 2024-06-06T03:28:18.564 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-06-06T03:28:18.564 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:28:18.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.560+0000 7f7d00c15700 1 -- 172.21.15.50:0/611757918 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7ce40a2ca0 msgr2=0x7f7ce40a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:18.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.560+0000 7f7d00c15700 1 --2- 172.21.15.50:0/611757918 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7ce40a2ca0 0x7f7ce40a5160 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc079980 tx=0x7f7cf000b260 comp rx=0 tx=0).stop 2024-06-06T03:28:18.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.560+0000 7f7d00c15700 1 -- 172.21.15.50:0/611757918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cfc102510 msgr2=0x7f7cfc19ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:18.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.560+0000 7f7d00c15700 1 --2- 172.21.15.50:0/611757918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cfc102510 0x7f7cfc19ad30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7cec00e9f0 tx=0x7f7cec00ed00 comp rx=0 tx=0).stop 2024-06-06T03:28:18.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.560+0000 7f7d00c15700 1 -- 172.21.15.50:0/611757918 shutdown_connections 2024-06-06T03:28:18.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.560+0000 7f7d00c15700 1 --2- 172.21.15.50:0/611757918 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7ce40a2ca0 0x7f7ce40a5160 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.560+0000 7f7d00c15700 1 --2- 172.21.15.50:0/611757918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cfc108520 0x7f7cfc19f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.560+0000 7f7d00c15700 1 --2- 172.21.15.50:0/611757918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cfc102510 0x7f7cfc19ad30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.560+0000 7f7d00c15700 1 --2- 172.21.15.50:0/611757918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cfc102ed0 0x7f7cfc19b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:18.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.560+0000 7f7d00c15700 1 -- 172.21.15.50:0/611757918 >> 172.21.15.50:0/611757918 conn(0x7f7cfc079560 msgr2=0x7f7cfc100c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:18.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.560+0000 7f7d00c15700 1 -- 172.21.15.50:0/611757918 shutdown_connections 2024-06-06T03:28:18.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:18.560+0000 7f7d00c15700 1 -- 172.21.15.50:0/611757918 wait complete. 2024-06-06T03:28:19.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:18 smithi050 ceph-mon[32421]: pgmap v481: 129 pgs: 129 active+clean; 2.3 GiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 142 MiB/s wr, 86 op/s 2024-06-06T03:28:19.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:18 smithi079 ceph-mon[35478]: pgmap v481: 129 pgs: 129 active+clean; 2.3 GiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 142 MiB/s wr, 86 op/s 2024-06-06T03:28:19.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:18 smithi122 ceph-mon[35759]: pgmap v481: 129 pgs: 129 active+clean; 2.3 GiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 142 MiB/s wr, 86 op/s 2024-06-06T03:28:19.655 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-06T03:28:20.042 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:28:20.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:19 smithi050 ceph-mon[32421]: scrub queued for path: / 2024-06-06T03:28:20.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:19 smithi050 ceph-mon[32421]: scrub summary: idle+waiting paths [/] 2024-06-06T03:28:20.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:19 smithi050 ceph-mon[32421]: scrub summary: active paths [/] 2024-06-06T03:28:20.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:19 smithi050 ceph-mon[32421]: scrub summary: active paths [/] 2024-06-06T03:28:20.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:19 smithi050 ceph-mon[32421]: scrub summary: idle+waiting paths [/] 2024-06-06T03:28:20.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:19 smithi050 ceph-mon[32421]: scrub summary: idle+waiting paths [/] 2024-06-06T03:28:20.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:19 smithi079 ceph-mon[35478]: scrub queued for path: / 2024-06-06T03:28:20.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:19 smithi079 ceph-mon[35478]: scrub summary: idle+waiting paths [/] 2024-06-06T03:28:20.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:19 smithi079 ceph-mon[35478]: scrub summary: active paths [/] 2024-06-06T03:28:20.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:19 smithi079 ceph-mon[35478]: scrub summary: active paths [/] 2024-06-06T03:28:20.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:19 smithi079 ceph-mon[35478]: scrub summary: idle+waiting paths [/] 2024-06-06T03:28:20.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:19 smithi079 ceph-mon[35478]: scrub summary: idle+waiting paths [/] 2024-06-06T03:28:20.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:19 smithi122 ceph-mon[35759]: scrub queued for path: / 2024-06-06T03:28:20.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:19 smithi122 ceph-mon[35759]: scrub summary: idle+waiting paths [/] 2024-06-06T03:28:20.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:19 smithi122 ceph-mon[35759]: scrub summary: active paths [/] 2024-06-06T03:28:20.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:19 smithi122 ceph-mon[35759]: scrub summary: active paths [/] 2024-06-06T03:28:20.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:19 smithi122 ceph-mon[35759]: scrub summary: idle+waiting paths [/] 2024-06-06T03:28:20.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:19 smithi122 ceph-mon[35759]: scrub summary: idle+waiting paths [/] 2024-06-06T03:28:21.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:20 smithi050 ceph-mon[32421]: pgmap v482: 129 pgs: 129 active+clean; 2.8 GiB data, 772 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 172 MiB/s wr, 105 op/s 2024-06-06T03:28:21.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:20 smithi079 ceph-mon[35478]: pgmap v482: 129 pgs: 129 active+clean; 2.8 GiB data, 772 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 172 MiB/s wr, 105 op/s 2024-06-06T03:28:21.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:20 smithi122 ceph-mon[35759]: pgmap v482: 129 pgs: 129 active+clean; 2.8 GiB data, 772 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 172 MiB/s wr, 105 op/s 2024-06-06T03:28:21.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.848+0000 7f391ca99700 1 -- 172.21.15.50:0/1382237440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3918107870 msgr2=0x7f391810f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:21.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.848+0000 7f391ca99700 1 --2- 172.21.15.50:0/1382237440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3918107870 0x7f391810f3f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f391000b0d0 tx=0x7f391000b3e0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.848+0000 7f391ca99700 1 -- 172.21.15.50:0/1382237440 shutdown_connections 2024-06-06T03:28:21.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.848+0000 7f391ca99700 1 --2- 172.21.15.50:0/1382237440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3918107870 0x7f391810f3f0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.848+0000 7f391ca99700 1 --2- 172.21.15.50:0/1382237440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39181027a0 0x7f3918102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.848+0000 7f391ca99700 1 --2- 172.21.15.50:0/1382237440 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3918103150 0x7f3918107140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.848+0000 7f391ca99700 1 -- 172.21.15.50:0/1382237440 >> 172.21.15.50:0/1382237440 conn(0x7f3918079520 msgr2=0x7f3918079930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:21.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.848+0000 7f391ca99700 1 -- 172.21.15.50:0/1382237440 shutdown_connections 2024-06-06T03:28:21.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.849+0000 7f391ca99700 1 -- 172.21.15.50:0/1382237440 wait complete. 2024-06-06T03:28:21.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.849+0000 7f391ca99700 1 Processor -- start 2024-06-06T03:28:21.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.850+0000 7f391ca99700 1 -- start start 2024-06-06T03:28:21.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.850+0000 7f391ca99700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39181027a0 0x7f391819e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:21.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.850+0000 7f391ca99700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3918103150 0x7f391819ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:21.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.850+0000 7f391ca99700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3918107870 0x7f3918198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:21.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.850+0000 7f391ca99700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3918112690 con 0x7f3918103150 2024-06-06T03:28:21.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.850+0000 7f391ca99700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3918112510 con 0x7f39181027a0 2024-06-06T03:28:21.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.850+0000 7f391ca99700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3918112810 con 0x7f3918107870 2024-06-06T03:28:21.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.850+0000 7f3915d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3918103150 0x7f391819ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:21.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.850+0000 7f3916d9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3918107870 0x7f3918198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:21.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.850+0000 7f3915d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3918103150 0x7f391819ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51666/0 (socket says 172.21.15.50:51666) 2024-06-06T03:28:21.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.850+0000 7f3915d9b700 1 -- 172.21.15.50:0/2006655842 learned_addr learned my addr 172.21.15.50:0/2006655842 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:21.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.850+0000 7f391659c700 1 --2- 172.21.15.50:0/2006655842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39181027a0 0x7f391819e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:21.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.850+0000 7f3916d9d700 1 -- 172.21.15.50:0/2006655842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39181027a0 msgr2=0x7f391819e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:21.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.850+0000 7f3916d9d700 1 --2- 172.21.15.50:0/2006655842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39181027a0 0x7f391819e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.850+0000 7f3916d9d700 1 -- 172.21.15.50:0/2006655842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3918103150 msgr2=0x7f391819ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:21.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.850+0000 7f3916d9d700 1 --2- 172.21.15.50:0/2006655842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3918103150 0x7f391819ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.850+0000 7f3916d9d700 1 -- 172.21.15.50:0/2006655842 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3918198ff0 con 0x7f3918107870 2024-06-06T03:28:21.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.851+0000 7f391659c700 1 --2- 172.21.15.50:0/2006655842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39181027a0 0x7f391819e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:28:21.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.851+0000 7f3916d9d700 1 --2- 172.21.15.50:0/2006655842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3918107870 0x7f3918198890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f391000b0d0 tx=0x7f3910007980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:21.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.851+0000 7f39077fe700 1 -- 172.21.15.50:0/2006655842 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391001f020 con 0x7f3918107870 2024-06-06T03:28:21.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.851+0000 7f39077fe700 1 -- 172.21.15.50:0/2006655842 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f39100096a0 con 0x7f3918107870 2024-06-06T03:28:21.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.851+0000 7f391ca99700 1 -- 172.21.15.50:0/2006655842 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3918199280 con 0x7f3918107870 2024-06-06T03:28:21.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.851+0000 7f39077fe700 1 -- 172.21.15.50:0/2006655842 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391001b430 con 0x7f3918107870 2024-06-06T03:28:21.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.851+0000 7f391ca99700 1 -- 172.21.15.50:0/2006655842 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39180746c0 con 0x7f3918107870 2024-06-06T03:28:21.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.854+0000 7f39077fe700 1 -- 172.21.15.50:0/2006655842 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3910022020 con 0x7f3918107870 2024-06-06T03:28:21.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.855+0000 7f39077fe700 1 --2- 172.21.15.50:0/2006655842 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f39000a2c20 0x7f39000a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:21.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.855+0000 7f391659c700 1 --2- 172.21.15.50:0/2006655842 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f39000a2c20 0x7f39000a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:21.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.855+0000 7f39077fe700 1 -- 172.21.15.50:0/2006655842 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f39100cffa0 con 0x7f3918107870 2024-06-06T03:28:21.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.856+0000 7f391659c700 1 --2- 172.21.15.50:0/2006655842 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f39000a2c20 0x7f39000a50e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f39181999d0 tx=0x7f3908009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:21.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.856+0000 7f392731cb80 1 Processor -- start 2024-06-06T03:28:21.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.857+0000 7f392731cb80 1 -- start start 2024-06-06T03:28:21.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.857+0000 7f392731cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bc7325640 0x562bc7325a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:21.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.857+0000 7f392731cb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bc7325f60 0x562bc731f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:21.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.857+0000 7f392731cb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bc731ff20 0x562bc7320340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:21.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.857+0000 7f392731cb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562bc7271810 con 0x562bc731ff20 2024-06-06T03:28:21.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.857+0000 7f392731cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562bc7219720 con 0x562bc7325640 2024-06-06T03:28:21.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.857+0000 7f392731cb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562bc726d7d0 con 0x562bc7325f60 2024-06-06T03:28:21.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.857+0000 7f3916d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bc731ff20 0x562bc7320340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:21.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.857+0000 7f3916d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bc731ff20 0x562bc7320340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51678/0 (socket says 172.21.15.50:51678) 2024-06-06T03:28:21.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.857+0000 7f3916d9d700 1 -- 172.21.15.50:0/3432983848 learned_addr learned my addr 172.21.15.50:0/3432983848 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:21.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.857+0000 7f391659c700 1 --2- 172.21.15.50:0/3432983848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bc7325640 0x562bc7325a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:21.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.857+0000 7f3915d9b700 1 --2- 172.21.15.50:0/3432983848 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bc7325f60 0x562bc731f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:21.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.858+0000 7f3916d9d700 1 -- 172.21.15.50:0/3432983848 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bc7325f60 msgr2=0x562bc731f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:21.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.858+0000 7f3916d9d700 1 --2- 172.21.15.50:0/3432983848 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bc7325f60 0x562bc731f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.858+0000 7f3916d9d700 1 -- 172.21.15.50:0/3432983848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bc7325640 msgr2=0x562bc7325a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:21.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.858+0000 7f3916d9d700 1 --2- 172.21.15.50:0/3432983848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bc7325640 0x562bc7325a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.858+0000 7f3915d9b700 1 --2- 172.21.15.50:0/3432983848 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bc7325f60 0x562bc731f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:28:21.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.858+0000 7f3916d9d700 1 -- 172.21.15.50:0/3432983848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bc720ff50 con 0x562bc731ff20 2024-06-06T03:28:21.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.858+0000 7f3916d9d700 1 --2- 172.21.15.50:0/3432983848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bc731ff20 0x562bc7320340 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3910098970 tx=0x7f39100099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94442c67be7071b1 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:21.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.858+0000 7f3904ff9700 1 -- 172.21.15.50:0/3432983848 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391009cc10 con 0x562bc731ff20 2024-06-06T03:28:21.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.858+0000 7f3904ff9700 1 -- 172.21.15.50:0/3432983848 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f391009c510 con 0x562bc731ff20 2024-06-06T03:28:21.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.858+0000 7f3904ff9700 1 -- 172.21.15.50:0/3432983848 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39100074e0 con 0x562bc731ff20 2024-06-06T03:28:21.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.859+0000 7f392731cb80 1 -- 172.21.15.50:0/3432983848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bc731ff20 msgr2=0x562bc7320340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:21.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.859+0000 7f392731cb80 1 --2- 172.21.15.50:0/3432983848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bc731ff20 0x562bc7320340 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3910098970 tx=0x7f39100099e0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.860+0000 7f392731cb80 1 -- 172.21.15.50:0/3432983848 shutdown_connections 2024-06-06T03:28:21.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.860+0000 7f392731cb80 1 --2- 172.21.15.50:0/3432983848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bc731ff20 0x562bc7320340 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.860+0000 7f392731cb80 1 --2- 172.21.15.50:0/3432983848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bc7325640 0x562bc7325a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.860+0000 7f392731cb80 1 --2- 172.21.15.50:0/3432983848 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bc7325f60 0x562bc731f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.860+0000 7f392731cb80 1 -- 172.21.15.50:0/3432983848 >> 172.21.15.50:0/3432983848 conn(0x562bc724acc0 msgr2=0x562bc731a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:21.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.860+0000 7f392731cb80 1 -- 172.21.15.50:0/3432983848 shutdown_connections 2024-06-06T03:28:21.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.860+0000 7f392731cb80 1 -- 172.21.15.50:0/3432983848 wait complete. 2024-06-06T03:28:21.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.860+0000 7f392731cb80 1 -- start start 2024-06-06T03:28:21.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.860+0000 7f392731cb80 1 Processor -- start 2024-06-06T03:28:21.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.861+0000 7f392731cb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bc731ff20 0x562bc732bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:21.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.861+0000 7f392731cb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bc7325640 0x562bc7329050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:21.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.861+0000 7f392731cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bc7325f60 0x562bc7329590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:21.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.861+0000 7f392731cb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562bc732c6f0 con 0x562bc731ff20 2024-06-06T03:28:21.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.861+0000 7f392731cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562bc7211bf0 con 0x562bc7325f60 2024-06-06T03:28:21.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.861+0000 7f392731cb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562bc732c870 con 0x562bc7325640 2024-06-06T03:28:21.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.861+0000 7f392731cb80 10 client.0 _ll_register_callbacks cb 0x562bc720b920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:28:21.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.861+0000 7f391659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bc731ff20 0x562bc732bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:21.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.861+0000 7f391659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bc731ff20 0x562bc732bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51690/0 (socket says 172.21.15.50:51690) 2024-06-06T03:28:21.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.861+0000 7f391659c700 1 -- 172.21.15.50:0/577990328 learned_addr learned my addr 172.21.15.50:0/577990328 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:21.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.861+0000 7f3915d9b700 1 --2- 172.21.15.50:0/577990328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bc7325640 0x562bc7329050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:21.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.862+0000 7f3916d9d700 1 --2- 172.21.15.50:0/577990328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bc7325f60 0x562bc7329590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:21.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.862+0000 7f391659c700 1 -- 172.21.15.50:0/577990328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bc7325640 msgr2=0x562bc7329050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:21.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.862+0000 7f391659c700 1 --2- 172.21.15.50:0/577990328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bc7325640 0x562bc7329050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.862+0000 7f391659c700 1 -- 172.21.15.50:0/577990328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bc7325f60 msgr2=0x562bc7329590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:21.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.862+0000 7f391659c700 1 --2- 172.21.15.50:0/577990328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bc7325f60 0x562bc7329590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.862+0000 7f391659c700 1 -- 172.21.15.50:0/577990328 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bc71c08d0 con 0x562bc731ff20 2024-06-06T03:28:21.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.862+0000 7f3916d9d700 1 --2- 172.21.15.50:0/577990328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bc7325f60 0x562bc7329590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:28:21.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.862+0000 7f391659c700 1 --2- 172.21.15.50:0/577990328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bc731ff20 0x562bc732bd50 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3908012c10 tx=0x7f39080047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c550c5f0dea6a3e7 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:21.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.862+0000 7f38fdffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:28:21.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.862+0000 7f38fdffb700 1 -- 172.21.15.50:0/577990328 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3908020840 con 0x562bc731ff20 2024-06-06T03:28:21.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.862+0000 7f38fdffb700 1 -- 172.21.15.50:0/577990328 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f39080209e0 con 0x562bc731ff20 2024-06-06T03:28:21.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.862+0000 7f392731cb80 1 -- 172.21.15.50:0/577990328 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f391009c510 con 0x562bc731ff20 2024-06-06T03:28:21.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.862+0000 7f38fdffb700 1 -- 172.21.15.50:0/577990328 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3908032050 con 0x562bc731ff20 2024-06-06T03:28:21.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.863+0000 7f392731cb80 10 client.15756 fetch_fsmap learned FSMap version 29 2024-06-06T03:28:21.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.863+0000 7f392731cb80 1 -- 172.21.15.50:0/577990328 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562bc7337060 con 0x562bc731ff20 2024-06-06T03:28:21.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.863+0000 7f38fdffb700 1 -- 172.21.15.50:0/577990328 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f391009c510 con 0x562bc731ff20 2024-06-06T03:28:21.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.863+0000 7f38fdffb700 1 -- 172.21.15.50:0/577990328 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f390801fcb0 con 0x562bc731ff20 2024-06-06T03:28:21.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.863+0000 7f392731cb80 10 client.15756 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:28:21.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.863+0000 7f392731cb80 10 client.15756 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:28:21.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.863+0000 7f392731cb80 20 client.15756 populate_metadata read hostname 'smithi050' 2024-06-06T03:28:21.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.863+0000 7f392731cb80 1 --2- 172.21.15.50:0/577990328 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562bc7339740 0x562bc733bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:21.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.863+0000 7f392731cb80 4 client.15756 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:28:21.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.863+0000 7f392731cb80 1 -- 172.21.15.50:0/577990328 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562bc727ed10 con 0x562bc7339740 2024-06-06T03:28:21.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.864+0000 7f3915d9b700 1 --2- 172.21.15.50:0/577990328 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562bc7339740 0x562bc733bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:21.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.865+0000 7f3915d9b700 1 --2- 172.21.15.50:0/577990328 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562bc7339740 0x562bc733bb90 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38a5a2a1221a6497 server_cookie=17730f8728352d60 in_seq=0 out_seq=0 2024-06-06T03:28:21.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.865+0000 7f38fdffb700 10 client.15756 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:21.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.866+0000 7f38fdffb700 1 -- 172.21.15.50:0/577990328 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x562bc727ed10 con 0x562bc7339740 2024-06-06T03:28:21.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.866+0000 7f38fdffb700 10 client.15756 handle_command_reply: tid=0 2024-06-06T03:28:21.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.866+0000 7f392731cb80 1 client.15756 shutdown 2024-06-06T03:28:21.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.866+0000 7f392731cb80 1 -- 172.21.15.50:0/577990328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bc731ff20 msgr2=0x562bc732bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:21.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.866+0000 7f392731cb80 1 --2- 172.21.15.50:0/577990328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bc731ff20 0x562bc732bd50 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3908012c10 tx=0x7f39080047c0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.866+0000 7f392731cb80 1 -- 172.21.15.50:0/577990328 shutdown_connections 2024-06-06T03:28:21.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.866+0000 7f392731cb80 1 --2- 172.21.15.50:0/577990328 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562bc7339740 0x562bc733bb90 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.867+0000 7f38fdffb700 0 client.15756 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:21.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.867+0000 7f392731cb80 1 --2- 172.21.15.50:0/577990328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bc7325f60 0x562bc7329590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.867+0000 7f392731cb80 1 --2- 172.21.15.50:0/577990328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bc731ff20 0x562bc732bd50 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.867+0000 7f392731cb80 1 --2- 172.21.15.50:0/577990328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bc7325640 0x562bc7329050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.867+0000 7f392731cb80 1 -- 172.21.15.50:0/577990328 >> 172.21.15.50:0/577990328 conn(0x562bc724acc0 msgr2=0x562bc731e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:21.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.867+0000 7f392731cb80 1 -- 172.21.15.50:0/577990328 shutdown_connections 2024-06-06T03:28:21.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.867+0000 7f392731cb80 1 -- 172.21.15.50:0/577990328 wait complete. 2024-06-06T03:28:21.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.867+0000 7f392731cb80 20 client.15756 trim_cache size 0 max 16384 2024-06-06T03:28:21.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.901+0000 7f392731cb80 1 Processor -- start 2024-06-06T03:28:21.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.902+0000 7f392731cb80 1 -- start start 2024-06-06T03:28:21.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.902+0000 7f392731cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bc731ff20 0x562bc731f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:21.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.902+0000 7f392731cb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bc7325640 0x562bc7335990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:21.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.902+0000 7f392731cb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bc7325f60 0x562bc7326bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:21.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.902+0000 7f392731cb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f39181b2af0 con 0x562bc7325f60 2024-06-06T03:28:21.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.902+0000 7f392731cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f39181b0380 con 0x562bc731ff20 2024-06-06T03:28:21.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.902+0000 7f392731cb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f39181ae1f0 con 0x562bc7325640 2024-06-06T03:28:21.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.902+0000 7f391659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bc731ff20 0x562bc731f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:21.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.902+0000 7f3916d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bc7325f60 0x562bc7326bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:21.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.902+0000 7f391659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bc731ff20 0x562bc731f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:57718/0 (socket says 172.21.15.50:57718) 2024-06-06T03:28:21.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.903+0000 7f391659c700 1 -- 172.21.15.50:0/3227329250 learned_addr learned my addr 172.21.15.50:0/3227329250 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:21.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.903+0000 7f3915d9b700 1 --2- 172.21.15.50:0/3227329250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bc7325640 0x562bc7335990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:21.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.903+0000 7f3915d9b700 1 -- 172.21.15.50:0/3227329250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bc731ff20 msgr2=0x562bc731f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:21.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.903+0000 7f3915d9b700 1 --2- 172.21.15.50:0/3227329250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bc731ff20 0x562bc731f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.903+0000 7f3915d9b700 1 -- 172.21.15.50:0/3227329250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bc7325f60 msgr2=0x562bc7326bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:21.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.903+0000 7f3915d9b700 1 --2- 172.21.15.50:0/3227329250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bc7325f60 0x562bc7326bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.903+0000 7f3915d9b700 1 -- 172.21.15.50:0/3227329250 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bc731b500 con 0x562bc7325640 2024-06-06T03:28:21.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.904+0000 7f3915d9b700 1 --2- 172.21.15.50:0/3227329250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bc7325640 0x562bc7335990 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x562bc733c3d0 tx=0x7f390c005e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ee9082f0e8ec8b8 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:21.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.904+0000 7f38fffff700 1 -- 172.21.15.50:0/3227329250 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c014110 con 0x562bc7325640 2024-06-06T03:28:21.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.904+0000 7f38fffff700 1 -- 172.21.15.50:0/3227329250 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f390c0142b0 con 0x562bc7325640 2024-06-06T03:28:21.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.904+0000 7f38fffff700 1 -- 172.21.15.50:0/3227329250 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c01e430 con 0x562bc7325640 2024-06-06T03:28:21.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.905+0000 7f392731cb80 1 -- 172.21.15.50:0/3227329250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bc7325640 msgr2=0x562bc7335990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:21.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.905+0000 7f392731cb80 1 --2- 172.21.15.50:0/3227329250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bc7325640 0x562bc7335990 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x562bc733c3d0 tx=0x7f390c005e50 comp rx=0 tx=0).stop 2024-06-06T03:28:21.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.905+0000 7f392731cb80 1 -- 172.21.15.50:0/3227329250 shutdown_connections 2024-06-06T03:28:21.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.905+0000 7f392731cb80 1 --2- 172.21.15.50:0/3227329250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bc7325f60 0x562bc7326bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.905+0000 7f392731cb80 1 --2- 172.21.15.50:0/3227329250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bc731ff20 0x562bc731f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.905+0000 7f392731cb80 1 --2- 172.21.15.50:0/3227329250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bc7325640 0x562bc7335990 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.905+0000 7f392731cb80 1 -- 172.21.15.50:0/3227329250 >> 172.21.15.50:0/3227329250 conn(0x562bc724acc0 msgr2=0x562bc7313e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:21.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.906+0000 7f392731cb80 1 -- 172.21.15.50:0/3227329250 shutdown_connections 2024-06-06T03:28:21.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.906+0000 7f392731cb80 1 -- 172.21.15.50:0/3227329250 wait complete. 2024-06-06T03:28:21.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.906+0000 7f392731cb80 1 -- start start 2024-06-06T03:28:21.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.906+0000 7f392731cb80 1 Processor -- start 2024-06-06T03:28:21.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.907+0000 7f392731cb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bc731ff20 0x562bc7331b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:21.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.907+0000 7f392731cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bc7325640 0x562bc7332040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:21.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.907+0000 7f392731cb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bc7325f60 0x562bc7341280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:21.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.907+0000 7f392731cb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f39181ae840 con 0x562bc731ff20 2024-06-06T03:28:21.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.907+0000 7f392731cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f39181afcb0 con 0x562bc7325640 2024-06-06T03:28:21.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.907+0000 7f392731cb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f39181aef10 con 0x562bc7325f60 2024-06-06T03:28:21.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.907+0000 7f392731cb80 10 client.0 _ll_register_callbacks cb 0x562bc720b920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:28:21.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.907+0000 7f3915d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bc7325640 0x562bc7332040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:21.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.907+0000 7f3915d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bc7325640 0x562bc7332040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:57728/0 (socket says 172.21.15.50:57728) 2024-06-06T03:28:21.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.907+0000 7f3915d9b700 1 -- 172.21.15.50:0/3192165058 learned_addr learned my addr 172.21.15.50:0/3192165058 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:21.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.907+0000 7f3916d9d700 1 --2- 172.21.15.50:0/3192165058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bc7325f60 0x562bc7341280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:21.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.907+0000 7f391659c700 1 --2- 172.21.15.50:0/3192165058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bc731ff20 0x562bc7331b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:21.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.907+0000 7f3915d9b700 1 -- 172.21.15.50:0/3192165058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bc7325f60 msgr2=0x562bc7341280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:21.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.907+0000 7f3915d9b700 1 --2- 172.21.15.50:0/3192165058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bc7325f60 0x562bc7341280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.907+0000 7f3915d9b700 1 -- 172.21.15.50:0/3192165058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bc731ff20 msgr2=0x562bc7331b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:21.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.907+0000 7f3915d9b700 1 --2- 172.21.15.50:0/3192165058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bc731ff20 0x562bc7331b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.907+0000 7f3915d9b700 1 -- 172.21.15.50:0/3192165058 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bc73a00a0 con 0x562bc7325640 2024-06-06T03:28:21.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.907+0000 7f391659c700 1 --2- 172.21.15.50:0/3192165058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bc731ff20 0x562bc7331b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:28:21.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.908+0000 7f3915d9b700 1 --2- 172.21.15.50:0/3192165058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bc7325640 0x562bc7332040 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f390c015f50 tx=0x7f390c015f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed830968b5b4f778 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:21.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.908+0000 7f38fdffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:28:21.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.908+0000 7f38fdffb700 1 -- 172.21.15.50:0/3192165058 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c005640 con 0x562bc7325640 2024-06-06T03:28:21.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.908+0000 7f392731cb80 1 -- 172.21.15.50:0/3192165058 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562bc7279290 con 0x562bc7325640 2024-06-06T03:28:21.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.908+0000 7f38fdffb700 1 -- 172.21.15.50:0/3192165058 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f390c004790 con 0x562bc7325640 2024-06-06T03:28:21.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.908+0000 7f38fdffb700 1 -- 172.21.15.50:0/3192165058 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f390c039050 con 0x562bc7325640 2024-06-06T03:28:21.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.908+0000 7f392731cb80 10 client.25349 fetch_fsmap learned FSMap version 29 2024-06-06T03:28:21.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.908+0000 7f392731cb80 1 -- 172.21.15.50:0/3192165058 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562bc73b58f0 con 0x562bc7325640 2024-06-06T03:28:21.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.908+0000 7f38fdffb700 1 -- 172.21.15.50:0/3192165058 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x562bc7279290 con 0x562bc7325640 2024-06-06T03:28:21.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.909+0000 7f38fdffb700 1 -- 172.21.15.50:0/3192165058 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f390c01eae0 con 0x562bc7325640 2024-06-06T03:28:21.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.909+0000 7f392731cb80 10 client.25349 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:28:21.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.909+0000 7f392731cb80 10 client.25349 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:28:21.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.909+0000 7f392731cb80 20 client.25349 populate_metadata read hostname 'smithi050' 2024-06-06T03:28:21.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.909+0000 7f392731cb80 1 --2- 172.21.15.50:0/3192165058 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562bc7339740 0x562bc73b7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:21.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.909+0000 7f392731cb80 4 client.25349 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-06T03:28:21.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.909+0000 7f392731cb80 1 -- 172.21.15.50:0/3192165058 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562bc70f3250 con 0x562bc7339740 2024-06-06T03:28:21.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.909+0000 7f391659c700 1 --2- 172.21.15.50:0/3192165058 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562bc7339740 0x562bc73b7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:21.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.909+0000 7f38fdffb700 10 client.25349 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:21.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.909+0000 7f391659c700 1 --2- 172.21.15.50:0/3192165058 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562bc7339740 0x562bc73b7fd0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0a8e1f8fc7785f8 server_cookie=9ae77c13bb6a8438 in_seq=0 out_seq=0 2024-06-06T03:28:21.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.910+0000 7f38fdffb700 1 -- 172.21.15.50:0/3192165058 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x562bc70f3250 con 0x562bc7339740 2024-06-06T03:28:21.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.910+0000 7f38fdffb700 10 client.25349 handle_command_reply: tid=0 2024-06-06T03:28:21.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.910+0000 7f392731cb80 1 client.25349 shutdown 2024-06-06T03:28:21.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.910+0000 7f392731cb80 1 -- 172.21.15.50:0/3192165058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bc7325640 msgr2=0x562bc7332040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:21.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.910+0000 7f392731cb80 1 --2- 172.21.15.50:0/3192165058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bc7325640 0x562bc7332040 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f390c015f50 tx=0x7f390c015f80 comp rx=0 tx=0).stop 2024-06-06T03:28:21.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.910+0000 7f392731cb80 1 -- 172.21.15.50:0/3192165058 shutdown_connections 2024-06-06T03:28:21.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.910+0000 7f392731cb80 1 --2- 172.21.15.50:0/3192165058 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562bc7339740 0x562bc73b7fd0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.910+0000 7f392731cb80 1 --2- 172.21.15.50:0/3192165058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bc7325f60 0x562bc7341280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.910+0000 7f392731cb80 1 --2- 172.21.15.50:0/3192165058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bc731ff20 0x562bc7331b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.910+0000 7f392731cb80 1 --2- 172.21.15.50:0/3192165058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bc7325640 0x562bc7332040 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.910+0000 7f38fdffb700 0 client.25349 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:21.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.910+0000 7f392731cb80 1 -- 172.21.15.50:0/3192165058 >> 172.21.15.50:0/3192165058 conn(0x562bc724acc0 msgr2=0x562bc7326bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:21.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.910+0000 7f392731cb80 1 -- 172.21.15.50:0/3192165058 shutdown_connections 2024-06-06T03:28:21.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.910+0000 7f392731cb80 1 -- 172.21.15.50:0/3192165058 wait complete. 2024-06-06T03:28:21.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.910+0000 7f392731cb80 20 client.25349 trim_cache size 0 max 16384 2024-06-06T03:28:21.927 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:28:21.927 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-06T03:28:21.927 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2024-06-06T03:28:21.927 INFO:teuthology.orchestra.run.smithi050.stdout: "f04c7097-5e56-4bce-b60f-712150f66d8d": { 2024-06-06T03:28:21.927 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2024-06-06T03:28:21.927 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "f04c7097-5e56-4bce-b60f-712150f66d8d", 2024-06-06T03:28:21.928 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "recursive,force" 2024-06-06T03:28:21.928 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:28:21.928 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:28:21.928 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:28:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.911+0000 7f391ca99700 1 -- 172.21.15.50:0/2006655842 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f39000a2c20 msgr2=0x7f39000a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.911+0000 7f391ca99700 1 --2- 172.21.15.50:0/2006655842 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f39000a2c20 0x7f39000a50e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f39181999d0 tx=0x7f3908009260 comp rx=0 tx=0).stop 2024-06-06T03:28:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.911+0000 7f391ca99700 1 -- 172.21.15.50:0/2006655842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3918107870 msgr2=0x7f3918198890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:21.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.911+0000 7f391ca99700 1 --2- 172.21.15.50:0/2006655842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3918107870 0x7f3918198890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f391000b0d0 tx=0x7f3910007980 comp rx=0 tx=0).stop 2024-06-06T03:28:21.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.911+0000 7f391ca99700 1 -- 172.21.15.50:0/2006655842 shutdown_connections 2024-06-06T03:28:21.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.911+0000 7f391ca99700 1 --2- 172.21.15.50:0/2006655842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3918107870 0x7f3918198890 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.911+0000 7f391ca99700 1 --2- 172.21.15.50:0/2006655842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39181027a0 0x7f391819e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.911+0000 7f391ca99700 1 --2- 172.21.15.50:0/2006655842 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f39000a2c20 0x7f39000a50e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.911+0000 7f391ca99700 1 --2- 172.21.15.50:0/2006655842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3918103150 0x7f391819ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:21.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.911+0000 7f391ca99700 1 -- 172.21.15.50:0/2006655842 >> 172.21.15.50:0/2006655842 conn(0x7f3918079520 msgr2=0x7f3918100590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:21.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.912+0000 7f391ca99700 1 -- 172.21.15.50:0/2006655842 shutdown_connections 2024-06-06T03:28:21.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:21.912+0000 7f391ca99700 1 -- 172.21.15.50:0/2006655842 wait complete. 2024-06-06T03:28:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.764+0000 7f260d831640 1 -- 172.21.15.50:0/3171387008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2608104e50 msgr2=0x7f2608107240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.764+0000 7f260d831640 1 --2- 172.21.15.50:0/3171387008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2608104e50 0x7f2608107240 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f25fc009900 tx=0x7f25fc02a410 comp rx=0 tx=0).stop 2024-06-06T03:28:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.764+0000 7f260d831640 1 -- 172.21.15.50:0/3171387008 shutdown_connections 2024-06-06T03:28:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.764+0000 7f260d831640 1 --2- 172.21.15.50:0/3171387008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2608104e50 0x7f2608107240 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.764+0000 7f260d831640 1 --2- 172.21.15.50:0/3171387008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2608107780 0x7f2608109b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.764+0000 7f260d831640 1 --2- 172.21.15.50:0/3171387008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2608102520 0x7f2608104910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.764+0000 7f260d831640 1 -- 172.21.15.50:0/3171387008 >> 172.21.15.50:0/3171387008 conn(0x7f26080fbe70 msgr2=0x7f26080fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.764+0000 7f260d831640 1 -- 172.21.15.50:0/3171387008 shutdown_connections 2024-06-06T03:28:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.764+0000 7f260d831640 1 -- 172.21.15.50:0/3171387008 wait complete. 2024-06-06T03:28:22.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.765+0000 7f260d831640 1 Processor -- start 2024-06-06T03:28:22.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.765+0000 7f260d831640 1 -- start start 2024-06-06T03:28:22.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.765+0000 7f260d831640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2608102520 0x7f2608101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:22.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.766+0000 7f260d831640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2608104e50 0x7f26081004d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:22.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.766+0000 7f260d831640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2608107780 0x7f2608100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.766+0000 7f260d831640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f260810d500 con 0x7f2608102520 2024-06-06T03:28:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.766+0000 7f260d831640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f260810d380 con 0x7f2608104e50 2024-06-06T03:28:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.766+0000 7f260d831640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f260810d680 con 0x7f2608107780 2024-06-06T03:28:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.766+0000 7f2606ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2608102520 0x7f2608101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.766+0000 7f2606ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2608102520 0x7f2608101e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51728/0 (socket says 172.21.15.50:51728) 2024-06-06T03:28:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.766+0000 7f2606ffd640 1 -- 172.21.15.50:0/2047192294 learned_addr learned my addr 172.21.15.50:0/2047192294 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.766+0000 7f26067fc640 1 --2- 172.21.15.50:0/2047192294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2608104e50 0x7f26081004d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.766+0000 7f26077fe640 1 --2- 172.21.15.50:0/2047192294 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2608107780 0x7f2608100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.766+0000 7f2606ffd640 1 -- 172.21.15.50:0/2047192294 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2608107780 msgr2=0x7f2608100a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.766+0000 7f2606ffd640 1 --2- 172.21.15.50:0/2047192294 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2608107780 0x7f2608100a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.766+0000 7f2606ffd640 1 -- 172.21.15.50:0/2047192294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2608104e50 msgr2=0x7f26081004d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.766+0000 7f2606ffd640 1 --2- 172.21.15.50:0/2047192294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2608104e50 0x7f26081004d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.766+0000 7f2606ffd640 1 -- 172.21.15.50:0/2047192294 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26081012a0 con 0x7f2608102520 2024-06-06T03:28:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.766+0000 7f26077fe640 1 --2- 172.21.15.50:0/2047192294 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2608107780 0x7f2608100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:28:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.767+0000 7f2606ffd640 1 --2- 172.21.15.50:0/2047192294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2608102520 0x7f2608101e90 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f25f800d950 tx=0x7f25f800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.767+0000 7f260c82f640 1 -- 172.21.15.50:0/2047192294 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f8017070 con 0x7f2608102520 2024-06-06T03:28:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.767+0000 7f260c82f640 1 -- 172.21.15.50:0/2047192294 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f25f8009c30 con 0x7f2608102520 2024-06-06T03:28:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.767+0000 7f260c82f640 1 -- 172.21.15.50:0/2047192294 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f800f620 con 0x7f2608102520 2024-06-06T03:28:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.767+0000 7f260d831640 1 -- 172.21.15.50:0/2047192294 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26081a1d20 con 0x7f2608102520 2024-06-06T03:28:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.767+0000 7f260d831640 1 -- 172.21.15.50:0/2047192294 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26081a2190 con 0x7f2608102520 2024-06-06T03:28:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.770+0000 7f260c82f640 1 -- 172.21.15.50:0/2047192294 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f25f80109a0 con 0x7f2608102520 2024-06-06T03:28:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.771+0000 7f261061a740 1 Processor -- start 2024-06-06T03:28:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.771+0000 7f261061a740 1 -- start start 2024-06-06T03:28:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.771+0000 7f261061a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb555b2010 0x55bb555b2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.771+0000 7f261061a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb555b2a00 0x55bb555b7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.771+0000 7f261061a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb555b7b70 0x55bb555ba000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.771+0000 7f261061a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55bb555154f0 con 0x55bb555b2010 2024-06-06T03:28:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.771+0000 7f261061a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bb554b3870 con 0x55bb555b2a00 2024-06-06T03:28:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.771+0000 7f261061a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bb555114b0 con 0x55bb555b7b70 2024-06-06T03:28:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.771+0000 7f26077fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb555b2010 0x55bb555b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.771+0000 7f26077fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb555b2010 0x55bb555b2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51734/0 (socket says 172.21.15.50:51734) 2024-06-06T03:28:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.771+0000 7f26077fe640 1 -- 172.21.15.50:0/2516897022 learned_addr learned my addr 172.21.15.50:0/2516897022 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.771+0000 7f2606ffd640 1 --2- 172.21.15.50:0/2516897022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb555b2a00 0x55bb555b7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.771+0000 7f26067fc640 1 --2- 172.21.15.50:0/2516897022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb555b7b70 0x55bb555ba000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.772+0000 7f260c82f640 1 --2- 172.21.15.50:0/2047192294 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f25f00a2cb0 0x7f25f00a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.772+0000 7f26077fe640 1 -- 172.21.15.50:0/2516897022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb555b7b70 msgr2=0x55bb555ba000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:22.773 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.772+0000 7f26077fe640 1 --2- 172.21.15.50:0/2516897022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb555b7b70 0x55bb555ba000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:22.773 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.772+0000 7f26077fe640 1 -- 172.21.15.50:0/2516897022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb555b2a00 msgr2=0x55bb555b7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:22.773 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.772+0000 7f26077fe640 1 --2- 172.21.15.50:0/2516897022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb555b2a00 0x55bb555b7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:22.773 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.772+0000 7f26077fe640 1 -- 172.21.15.50:0/2516897022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb554cf9b0 con 0x55bb555b2010 2024-06-06T03:28:22.773 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.772+0000 7f2606ffd640 1 --2- 172.21.15.50:0/2516897022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb555b2a00 0x55bb555b7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:28:22.773 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.772+0000 7f260c82f640 1 -- 172.21.15.50:0/2047192294 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f25f80cef60 con 0x7f2608102520 2024-06-06T03:28:22.773 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.773+0000 7f26077fe640 1 --2- 172.21.15.50:0/2516897022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb555b2010 0x55bb555b2430 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2600010450 tx=0x7f2600010910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce80cf459b6e64 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.773+0000 7f26077fe640 1 --2- 172.21.15.50:0/2047192294 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f25f00a2cb0 0x7f25f00a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.773+0000 7f25edffb640 1 -- 172.21.15.50:0/2516897022 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2600017070 con 0x55bb555b2010 2024-06-06T03:28:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.773+0000 7f25edffb640 1 -- 172.21.15.50:0/2516897022 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2600003d50 con 0x55bb555b2010 2024-06-06T03:28:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.773+0000 7f25edffb640 1 -- 172.21.15.50:0/2516897022 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2600011cf0 con 0x55bb555b2010 2024-06-06T03:28:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.774+0000 7f261061a740 1 -- 172.21.15.50:0/2516897022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb555b2010 msgr2=0x55bb555b2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.774+0000 7f261061a740 1 --2- 172.21.15.50:0/2516897022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb555b2010 0x55bb555b2430 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2600010450 tx=0x7f2600010910 comp rx=0 tx=0).stop 2024-06-06T03:28:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.774+0000 7f26077fe640 1 --2- 172.21.15.50:0/2047192294 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f25f00a2cb0 0x7f25f00a5170 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f26000049b0 tx=0x7f2600011f70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.774+0000 7f261061a740 1 -- 172.21.15.50:0/2516897022 shutdown_connections 2024-06-06T03:28:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.774+0000 7f261061a740 1 --2- 172.21.15.50:0/2516897022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb555b7b70 0x55bb555ba000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.774+0000 7f261061a740 1 --2- 172.21.15.50:0/2516897022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb555b2a00 0x55bb555b7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.774+0000 7f261061a740 1 --2- 172.21.15.50:0/2516897022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb555b2010 0x55bb555b2430 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.774+0000 7f261061a740 1 -- 172.21.15.50:0/2516897022 >> 172.21.15.50:0/2516897022 conn(0x55bb555ad680 msgr2=0x55bb555ada80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.774+0000 7f261061a740 1 -- 172.21.15.50:0/2516897022 shutdown_connections 2024-06-06T03:28:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.774+0000 7f261061a740 1 -- 172.21.15.50:0/2516897022 wait complete. 2024-06-06T03:28:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.775+0000 7f261061a740 1 -- start start 2024-06-06T03:28:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.775+0000 7f261061a740 1 Processor -- start 2024-06-06T03:28:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.775+0000 7f261061a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb555b2010 0x55bb555bc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.775+0000 7f261061a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb555b2a00 0x55bb555bc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.775+0000 7f261061a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb555b7b70 0x55bb555c3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.775+0000 7f261061a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55bb555bab20 con 0x55bb555b7b70 2024-06-06T03:28:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.775+0000 7f261061a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bb5549eae0 con 0x55bb555b2a00 2024-06-06T03:28:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.775+0000 7f261061a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bb555baca0 con 0x55bb555b2010 2024-06-06T03:28:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.775+0000 7f261061a740 10 client.0 _ll_register_callbacks cb 0x55bb554d79b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:28:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.775+0000 7f26077fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb555b7b70 0x55bb555c3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.775+0000 7f26067fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb555b2a00 0x55bb555bc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.775+0000 7f26077fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb555b7b70 0x55bb555c3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51748/0 (socket says 172.21.15.50:51748) 2024-06-06T03:28:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.775+0000 7f26077fe640 1 -- 172.21.15.50:0/4141145382 learned_addr learned my addr 172.21.15.50:0/4141145382 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.775+0000 7f2606ffd640 1 --2- 172.21.15.50:0/4141145382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb555b2010 0x55bb555bc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.776+0000 7f26077fe640 1 -- 172.21.15.50:0/4141145382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb555b2010 msgr2=0x55bb555bc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.776+0000 7f26077fe640 1 --2- 172.21.15.50:0/4141145382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb555b2010 0x55bb555bc2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.776+0000 7f26077fe640 1 -- 172.21.15.50:0/4141145382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb555b2a00 msgr2=0x55bb555bc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.776+0000 7f26077fe640 1 --2- 172.21.15.50:0/4141145382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb555b2a00 0x55bb555bc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.776+0000 7f26077fe640 1 -- 172.21.15.50:0/4141145382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb55229210 con 0x55bb555b7b70 2024-06-06T03:28:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.776+0000 7f26067fc640 1 --2- 172.21.15.50:0/4141145382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb555b2a00 0x55bb555bc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:28:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.776+0000 7f26077fe640 1 --2- 172.21.15.50:0/4141145382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb555b7b70 0x55bb555c3860 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2600011610 tx=0x7f260001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab7b5769af76afe server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.776+0000 7f25e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:28:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.776+0000 7f25e6ffd640 1 -- 172.21.15.50:0/4141145382 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2600017050 con 0x55bb555b7b70 2024-06-06T03:28:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.776+0000 7f261061a740 1 -- 172.21.15.50:0/4141145382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2600003d50 con 0x55bb555b7b70 2024-06-06T03:28:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.776+0000 7f25e6ffd640 1 -- 172.21.15.50:0/4141145382 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f2600003b10 con 0x55bb555b7b70 2024-06-06T03:28:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.777+0000 7f25e6ffd640 1 -- 172.21.15.50:0/4141145382 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f260003d050 con 0x55bb555b7b70 2024-06-06T03:28:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.777+0000 7f261061a740 10 client.15774 fetch_fsmap learned FSMap version 29 2024-06-06T03:28:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.777+0000 7f261061a740 1 -- 172.21.15.50:0/4141145382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bb552f5620 con 0x55bb555b7b70 2024-06-06T03:28:22.780 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.777+0000 7f25e6ffd640 1 -- 172.21.15.50:0/4141145382 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2600003d50 con 0x55bb555b7b70 2024-06-06T03:28:22.780 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.777+0000 7f25e6ffd640 1 -- 172.21.15.50:0/4141145382 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f260001aa30 con 0x55bb555b7b70 2024-06-06T03:28:22.780 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.777+0000 7f261061a740 10 client.15774 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:28:22.780 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.777+0000 7f261061a740 10 client.15774 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:28:22.780 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.777+0000 7f261061a740 20 client.15774 populate_metadata read hostname 'smithi050' 2024-06-06T03:28:22.780 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.777+0000 7f261061a740 1 --2- 172.21.15.50:0/4141145382 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bb555c7e50 0x55bb555ca240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:22.780 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.777+0000 7f261061a740 4 client.15774 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:28:22.780 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.777+0000 7f261061a740 1 -- 172.21.15.50:0/4141145382 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb55528f10 con 0x55bb555c7e50 2024-06-06T03:28:22.780 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.778+0000 7f2606ffd640 1 --2- 172.21.15.50:0/4141145382 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bb555c7e50 0x55bb555ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:22.780 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.778+0000 7f2606ffd640 1 --2- 172.21.15.50:0/4141145382 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bb555c7e50 0x55bb555ca240 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2dca0e35a1e550b server_cookie=4f705f1c77286bd2 in_seq=0 out_seq=0 2024-06-06T03:28:22.780 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.778+0000 7f25e6ffd640 10 client.15774 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:22.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.779+0000 7f25e6ffd640 1 -- 172.21.15.50:0/4141145382 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55bb55528f10 con 0x55bb555c7e50 2024-06-06T03:28:22.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.779+0000 7f25e6ffd640 10 client.15774 handle_command_reply: tid=0 2024-06-06T03:28:22.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.779+0000 7f261061a740 1 client.15774 shutdown 2024-06-06T03:28:22.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.779+0000 7f261061a740 1 -- 172.21.15.50:0/4141145382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb555b7b70 msgr2=0x55bb555c3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.779+0000 7f261061a740 1 --2- 172.21.15.50:0/4141145382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb555b7b70 0x55bb555c3860 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2600011610 tx=0x7f260001a000 comp rx=0 tx=0).stop 2024-06-06T03:28:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.779+0000 7f261061a740 1 -- 172.21.15.50:0/4141145382 shutdown_connections 2024-06-06T03:28:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.779+0000 7f261061a740 1 --2- 172.21.15.50:0/4141145382 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bb555c7e50 0x55bb555ca240 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.779+0000 7f261061a740 1 --2- 172.21.15.50:0/4141145382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb555b7b70 0x55bb555c3860 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.779+0000 7f261061a740 1 --2- 172.21.15.50:0/4141145382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb555b2a00 0x55bb555bc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.779+0000 7f261061a740 1 --2- 172.21.15.50:0/4141145382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb555b2010 0x55bb555bc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.779+0000 7f261061a740 1 -- 172.21.15.50:0/4141145382 >> 172.21.15.50:0/4141145382 conn(0x55bb555ad680 msgr2=0x55bb555ac7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.779+0000 7f25e6ffd640 0 client.15774 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.779+0000 7f261061a740 1 -- 172.21.15.50:0/4141145382 shutdown_connections 2024-06-06T03:28:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.779+0000 7f261061a740 1 -- 172.21.15.50:0/4141145382 wait complete. 2024-06-06T03:28:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.779+0000 7f261061a740 20 client.15774 trim_cache size 0 max 16384 2024-06-06T03:28:22.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.804+0000 7f261061a740 1 Processor -- start 2024-06-06T03:28:22.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.804+0000 7f261061a740 1 -- start start 2024-06-06T03:28:22.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.804+0000 7f261061a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb555b2010 0x55bb555bc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:22.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.804+0000 7f261061a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb555b2a00 0x55bb555bc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:22.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.804+0000 7f261061a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb555b7b70 0x55bb555c3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:22.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.804+0000 7f261061a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f26081af010 con 0x55bb555b2010 2024-06-06T03:28:22.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.804+0000 7f261061a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f26081ac8e0 con 0x55bb555b7b70 2024-06-06T03:28:22.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.804+0000 7f261061a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f26081aa730 con 0x55bb555b2a00 2024-06-06T03:28:22.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.804+0000 7f2606ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb555b2010 0x55bb555bc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:22.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.804+0000 7f2606ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb555b2010 0x55bb555bc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51752/0 (socket says 172.21.15.50:51752) 2024-06-06T03:28:22.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.804+0000 7f2606ffd640 1 -- 172.21.15.50:0/1288839515 learned_addr learned my addr 172.21.15.50:0/1288839515 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:22.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.804+0000 7f26067fc640 1 --2- 172.21.15.50:0/1288839515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb555b2a00 0x55bb555bc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:22.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.804+0000 7f26077fe640 1 --2- 172.21.15.50:0/1288839515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb555b7b70 0x55bb555c3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.805+0000 7f2606ffd640 1 -- 172.21.15.50:0/1288839515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb555b2a00 msgr2=0x55bb555bc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.805+0000 7f2606ffd640 1 --2- 172.21.15.50:0/1288839515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb555b2a00 0x55bb555bc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.805+0000 7f2606ffd640 1 -- 172.21.15.50:0/1288839515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb555b7b70 msgr2=0x55bb555c3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.805+0000 7f2606ffd640 1 --2- 172.21.15.50:0/1288839515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb555b7b70 0x55bb555c3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.805+0000 7f2606ffd640 1 -- 172.21.15.50:0/1288839515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb555ad4b0 con 0x55bb555b2010 2024-06-06T03:28:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.805+0000 7f2606ffd640 1 --2- 172.21.15.50:0/1288839515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb555b2010 0x55bb555bc2e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f25f809b140 tx=0x7f25f8097040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f0240965db472ef server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:22.809 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.805+0000 7f25ed7fa640 1 -- 172.21.15.50:0/1288839515 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f8020030 con 0x55bb555b2010 2024-06-06T03:28:22.809 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.805+0000 7f25ed7fa640 1 -- 172.21.15.50:0/1288839515 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f25f809b440 con 0x55bb555b2010 2024-06-06T03:28:22.809 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.805+0000 7f25ed7fa640 1 -- 172.21.15.50:0/1288839515 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f80997d0 con 0x55bb555b2010 2024-06-06T03:28:22.809 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.806+0000 7f261061a740 1 -- 172.21.15.50:0/1288839515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb555b2010 msgr2=0x55bb555bc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:22.809 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.806+0000 7f261061a740 1 --2- 172.21.15.50:0/1288839515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb555b2010 0x55bb555bc2e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f25f809b140 tx=0x7f25f8097040 comp rx=0 tx=0).stop 2024-06-06T03:28:22.809 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.806+0000 7f261061a740 1 -- 172.21.15.50:0/1288839515 shutdown_connections 2024-06-06T03:28:22.809 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.806+0000 7f261061a740 1 --2- 172.21.15.50:0/1288839515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb555b7b70 0x55bb555c3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:22.809 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.806+0000 7f261061a740 1 --2- 172.21.15.50:0/1288839515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb555b2a00 0x55bb555bc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:22.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.806+0000 7f261061a740 1 --2- 172.21.15.50:0/1288839515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb555b2010 0x55bb555bc2e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:22.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.806+0000 7f261061a740 1 -- 172.21.15.50:0/1288839515 >> 172.21.15.50:0/1288839515 conn(0x55bb555ad680 msgr2=0x55bb555ada60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:22.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.806+0000 7f261061a740 1 -- 172.21.15.50:0/1288839515 shutdown_connections 2024-06-06T03:28:22.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.806+0000 7f261061a740 1 -- 172.21.15.50:0/1288839515 wait complete. 2024-06-06T03:28:22.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.807+0000 7f261061a740 1 -- start start 2024-06-06T03:28:22.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.807+0000 7f261061a740 1 Processor -- start 2024-06-06T03:28:22.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.807+0000 7f261061a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb555b2a00 0x55bb555c3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:22.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.807+0000 7f261061a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb555b7b70 0x55bb555c0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:22.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.807+0000 7f261061a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb555c08d0 0x55bb556392e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:22.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.807+0000 7f261061a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f26081aada0 con 0x55bb555c08d0 2024-06-06T03:28:22.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.807+0000 7f261061a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f26081ac210 con 0x55bb555b2a00 2024-06-06T03:28:22.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.807+0000 7f261061a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f26081ab470 con 0x55bb555b7b70 2024-06-06T03:28:22.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.807+0000 7f261061a740 10 client.0 _ll_register_callbacks cb 0x7f25fc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:28:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.807+0000 7f2606ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb555b2a00 0x55bb555c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.808+0000 7f2606ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb555b2a00 0x55bb555c3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:57798/0 (socket says 172.21.15.50:57798) 2024-06-06T03:28:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.808+0000 7f2606ffd640 1 -- 172.21.15.50:0/3077799636 learned_addr learned my addr 172.21.15.50:0/3077799636 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.808+0000 7f26077fe640 1 --2- 172.21.15.50:0/3077799636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb555c08d0 0x55bb556392e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.808+0000 7f26067fc640 1 --2- 172.21.15.50:0/3077799636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb555b7b70 0x55bb555c0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.808+0000 7f2606ffd640 1 -- 172.21.15.50:0/3077799636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb555b7b70 msgr2=0x55bb555c0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.808+0000 7f2606ffd640 1 --2- 172.21.15.50:0/3077799636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb555b7b70 0x55bb555c0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.808+0000 7f2606ffd640 1 -- 172.21.15.50:0/3077799636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb555c08d0 msgr2=0x55bb556392e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.808+0000 7f2606ffd640 1 --2- 172.21.15.50:0/3077799636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb555c08d0 0x55bb556392e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.808+0000 7f2606ffd640 1 -- 172.21.15.50:0/3077799636 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb55639820 con 0x55bb555b2a00 2024-06-06T03:28:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.808+0000 7f26067fc640 1 --2- 172.21.15.50:0/3077799636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb555b7b70 0x55bb555c0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:28:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.808+0000 7f2606ffd640 1 --2- 172.21.15.50:0/3077799636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb555b2a00 0x55bb555c3830 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f25f80cc6b0 tx=0x7f25f800bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=481c574858dc6360 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.808+0000 7f25e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:28:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.808+0000 7f25e6ffd640 1 -- 172.21.15.50:0/3077799636 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f8020050 con 0x55bb555b2a00 2024-06-06T03:28:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.808+0000 7f25e6ffd640 1 -- 172.21.15.50:0/3077799636 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f25f80d1110 con 0x55bb555b2a00 2024-06-06T03:28:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.808+0000 7f261061a740 1 -- 172.21.15.50:0/3077799636 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25f809b440 con 0x55bb555b2a00 2024-06-06T03:28:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.809+0000 7f25e6ffd640 1 -- 172.21.15.50:0/3077799636 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f25f809ada0 con 0x55bb555b2a00 2024-06-06T03:28:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.809+0000 7f261061a740 10 client.25367 fetch_fsmap learned FSMap version 29 2024-06-06T03:28:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.809+0000 7f261061a740 1 -- 172.21.15.50:0/3077799636 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bb5563a990 con 0x55bb555b2a00 2024-06-06T03:28:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.809+0000 7f25e6ffd640 1 -- 172.21.15.50:0/3077799636 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f25f809b440 con 0x55bb555b2a00 2024-06-06T03:28:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.809+0000 7f25e6ffd640 1 -- 172.21.15.50:0/3077799636 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f25f80ccba0 con 0x55bb555b2a00 2024-06-06T03:28:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.809+0000 7f261061a740 10 client.25367 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:28:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.809+0000 7f261061a740 10 client.25367 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:28:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.809+0000 7f261061a740 20 client.25367 populate_metadata read hostname 'smithi050' 2024-06-06T03:28:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.809+0000 7f261061a740 1 --2- 172.21.15.50:0/3077799636 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bb5563b2c0 0x55bb5563d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.809+0000 7f261061a740 4 client.25367 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:28:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.809+0000 7f261061a740 1 -- 172.21.15.50:0/3077799636 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bb55522c20 con 0x55bb5563b2c0 2024-06-06T03:28:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.809+0000 7f26067fc640 1 --2- 172.21.15.50:0/3077799636 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bb5563b2c0 0x55bb5563d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:22.813 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.810+0000 7f26067fc640 1 --2- 172.21.15.50:0/3077799636 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bb5563b2c0 0x55bb5563d6e0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=814b85e4855af1b8 server_cookie=a438286834eb9bb3 in_seq=0 out_seq=0 2024-06-06T03:28:22.813 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.810+0000 7f25e6ffd640 10 client.25367 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.819+0000 7f25e6ffd640 1 -- 172.21.15.50:0/3077799636 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55bb55522c20 con 0x55bb5563b2c0 2024-06-06T03:28:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.819+0000 7f25e6ffd640 10 client.25367 handle_command_reply: tid=0 2024-06-06T03:28:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.819+0000 7f261061a740 1 client.25367 shutdown 2024-06-06T03:28:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.819+0000 7f261061a740 1 -- 172.21.15.50:0/3077799636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb555b2a00 msgr2=0x55bb555c3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.819+0000 7f261061a740 1 --2- 172.21.15.50:0/3077799636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb555b2a00 0x55bb555c3830 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f25f80cc6b0 tx=0x7f25f800bf60 comp rx=0 tx=0).stop 2024-06-06T03:28:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.819+0000 7f261061a740 1 -- 172.21.15.50:0/3077799636 shutdown_connections 2024-06-06T03:28:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.819+0000 7f261061a740 1 --2- 172.21.15.50:0/3077799636 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55bb5563b2c0 0x55bb5563d6e0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.819+0000 7f261061a740 1 --2- 172.21.15.50:0/3077799636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb555c08d0 0x55bb556392e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.819+0000 7f261061a740 1 --2- 172.21.15.50:0/3077799636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb555b7b70 0x55bb555c0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.819+0000 7f261061a740 1 --2- 172.21.15.50:0/3077799636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb555b2a00 0x55bb555c3830 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.819+0000 7f261061a740 1 -- 172.21.15.50:0/3077799636 >> 172.21.15.50:0/3077799636 conn(0x55bb555ad680 msgr2=0x55bb555bc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.819+0000 7f25e6ffd640 0 client.25367 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.819+0000 7f261061a740 1 -- 172.21.15.50:0/3077799636 shutdown_connections 2024-06-06T03:28:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.819+0000 7f261061a740 1 -- 172.21.15.50:0/3077799636 wait complete. 2024-06-06T03:28:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.819+0000 7f261061a740 20 client.25367 trim_cache size 0 max 16384 2024-06-06T03:28:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:28:22.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:28:22.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:28:22.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.820+0000 7f260d831640 1 -- 172.21.15.50:0/2047192294 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f25f00a2cb0 msgr2=0x7f25f00a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.820+0000 7f260d831640 1 --2- 172.21.15.50:0/2047192294 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f25f00a2cb0 0x7f25f00a5170 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f26000049b0 tx=0x7f2600011f70 comp rx=0 tx=0).stop 2024-06-06T03:28:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.820+0000 7f260d831640 1 -- 172.21.15.50:0/2047192294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2608102520 msgr2=0x7f2608101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.820+0000 7f260d831640 1 --2- 172.21.15.50:0/2047192294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2608102520 0x7f2608101e90 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f25f800d950 tx=0x7f25f800de10 comp rx=0 tx=0).stop 2024-06-06T03:28:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.821+0000 7f260d831640 1 -- 172.21.15.50:0/2047192294 shutdown_connections 2024-06-06T03:28:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.821+0000 7f260d831640 1 --2- 172.21.15.50:0/2047192294 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f25f00a2cb0 0x7f25f00a5170 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.821+0000 7f260d831640 1 --2- 172.21.15.50:0/2047192294 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2608107780 0x7f2608100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.821+0000 7f260d831640 1 --2- 172.21.15.50:0/2047192294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2608104e50 0x7f26081004d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.821+0000 7f260d831640 1 --2- 172.21.15.50:0/2047192294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2608102520 0x7f2608101e90 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.821+0000 7f260d831640 1 -- 172.21.15.50:0/2047192294 >> 172.21.15.50:0/2047192294 conn(0x7f26080fbe70 msgr2=0x7f2608104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.821+0000 7f260d831640 1 -- 172.21.15.50:0/2047192294 shutdown_connections 2024-06-06T03:28:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:22.821+0000 7f260d831640 1 -- 172.21.15.50:0/2047192294 wait complete. 2024-06-06T03:28:23.055 INFO:tasks.cephfs.filesystem:scrub status for tag:f04c7097-5e56-4bce-b60f-712150f66d8d - {'path': '/', 'tag': 'f04c7097-5e56-4bce-b60f-712150f66d8d', 'options': 'recursive,force'} 2024-06-06T03:28:23.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:22 smithi050 ceph-mon[32421]: pgmap v483: 129 pgs: 129 active+clean; 2.9 GiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 134 MiB/s wr, 82 op/s 2024-06-06T03:28:23.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:22 smithi079 ceph-mon[35478]: pgmap v483: 129 pgs: 129 active+clean; 2.9 GiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 134 MiB/s wr, 82 op/s 2024-06-06T03:28:23.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:22 smithi122 ceph-mon[35759]: pgmap v483: 129 pgs: 129 active+clean; 2.9 GiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 134 MiB/s wr, 82 op/s 2024-06-06T03:28:25.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:24 smithi050 ceph-mon[32421]: pgmap v484: 129 pgs: 129 active+clean; 3.2 GiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 148 MiB/s wr, 89 op/s 2024-06-06T03:28:25.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:24 smithi079 ceph-mon[35478]: pgmap v484: 129 pgs: 129 active+clean; 3.2 GiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 148 MiB/s wr, 89 op/s 2024-06-06T03:28:25.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:24 smithi122 ceph-mon[35759]: pgmap v484: 129 pgs: 129 active+clean; 3.2 GiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 148 MiB/s wr, 89 op/s 2024-06-06T03:28:27.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:26 smithi050 ceph-mon[32421]: pgmap v485: 129 pgs: 129 active+clean; 3.6 GiB data, 902 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 163 MiB/s wr, 99 op/s 2024-06-06T03:28:27.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:26 smithi079 ceph-mon[35478]: pgmap v485: 129 pgs: 129 active+clean; 3.6 GiB data, 902 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 163 MiB/s wr, 99 op/s 2024-06-06T03:28:27.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:26 smithi122 ceph-mon[35759]: pgmap v485: 129 pgs: 129 active+clean; 3.6 GiB data, 902 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 163 MiB/s wr, 99 op/s 2024-06-06T03:28:28.250 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:27 smithi079 ceph-mon[35478]: scrub summary: idle 2024-06-06T03:28:28.250 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:27 smithi079 ceph-mon[35478]: scrub summary: idle 2024-06-06T03:28:28.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:27 smithi050 ceph-mon[32421]: scrub summary: idle 2024-06-06T03:28:28.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:28 smithi050 ceph-mon[32421]: scrub summary: idle 2024-06-06T03:28:28.331 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:27 smithi122 ceph-mon[35759]: scrub summary: idle 2024-06-06T03:28:28.332 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:27 smithi122 ceph-mon[35759]: scrub summary: idle 2024-06-06T03:28:29.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:28 smithi050 ceph-mon[32421]: pgmap v486: 129 pgs: 129 active+clean; 3.8 GiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 142 MiB/s wr, 82 op/s 2024-06-06T03:28:29.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:28 smithi079 ceph-mon[35478]: pgmap v486: 129 pgs: 129 active+clean; 3.8 GiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 142 MiB/s wr, 82 op/s 2024-06-06T03:28:29.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:28 smithi122 ceph-mon[35759]: pgmap v486: 129 pgs: 129 active+clean; 3.8 GiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 142 MiB/s wr, 82 op/s 2024-06-06T03:28:31.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:30 smithi050 ceph-mon[32421]: pgmap v487: 129 pgs: 129 active+clean; 4.3 GiB data, 991 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 168 MiB/s wr, 97 op/s 2024-06-06T03:28:31.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:30 smithi079 ceph-mon[35478]: pgmap v487: 129 pgs: 129 active+clean; 4.3 GiB data, 991 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 168 MiB/s wr, 97 op/s 2024-06-06T03:28:31.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:30 smithi122 ceph-mon[35759]: pgmap v487: 129 pgs: 129 active+clean; 4.3 GiB data, 991 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 168 MiB/s wr, 97 op/s 2024-06-06T03:28:33.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:32 smithi050 ceph-mon[32421]: pgmap v488: 129 pgs: 129 active+clean; 4.5 GiB data, 1010 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 140 MiB/s wr, 79 op/s 2024-06-06T03:28:33.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:32 smithi079 ceph-mon[35478]: pgmap v488: 129 pgs: 129 active+clean; 4.5 GiB data, 1010 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 140 MiB/s wr, 79 op/s 2024-06-06T03:28:33.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:32 smithi122 ceph-mon[35759]: pgmap v488: 129 pgs: 129 active+clean; 4.5 GiB data, 1010 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 140 MiB/s wr, 79 op/s 2024-06-06T03:28:35.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:34 smithi050 ceph-mon[32421]: pgmap v489: 129 pgs: 129 active+clean; 4.8 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 155 MiB/s wr, 87 op/s 2024-06-06T03:28:35.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:34 smithi079 ceph-mon[35478]: pgmap v489: 129 pgs: 129 active+clean; 4.8 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 155 MiB/s wr, 87 op/s 2024-06-06T03:28:35.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:34 smithi122 ceph-mon[35759]: pgmap v489: 129 pgs: 129 active+clean; 4.8 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 155 MiB/s wr, 87 op/s 2024-06-06T03:28:35.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.959+0000 7f88d5a12640 1 -- 172.21.15.50:0/1318820768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d0101530 msgr2=0x7f88d0108dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:35.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.959+0000 7f88d5a12640 1 --2- 172.21.15.50:0/1318820768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d0101530 0x7f88d0108dd0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f88c8009cd0 tx=0x7f88c802a8f0 comp rx=0 tx=0).stop 2024-06-06T03:28:35.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.960+0000 7f88d5a12640 1 -- 172.21.15.50:0/1318820768 shutdown_connections 2024-06-06T03:28:35.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.960+0000 7f88d5a12640 1 --2- 172.21.15.50:0/1318820768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d0101530 0x7f88d0108dd0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:35.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.960+0000 7f88d5a12640 1 --2- 172.21.15.50:0/1318820768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88d0100b70 0x7f88d0100ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:35.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.960+0000 7f88d5a12640 1 --2- 172.21.15.50:0/1318820768 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88d0101ed0 0x7f88d01022f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:35.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.960+0000 7f88d5a12640 1 -- 172.21.15.50:0/1318820768 >> 172.21.15.50:0/1318820768 conn(0x7f88d00fb600 msgr2=0x7f88d00fda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:35.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.960+0000 7f88d5a12640 1 -- 172.21.15.50:0/1318820768 shutdown_connections 2024-06-06T03:28:35.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.960+0000 7f88d5a12640 1 -- 172.21.15.50:0/1318820768 wait complete. 2024-06-06T03:28:35.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.960+0000 7f88d5a12640 1 Processor -- start 2024-06-06T03:28:35.962 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.961+0000 7f88d5a12640 1 -- start start 2024-06-06T03:28:35.962 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.961+0000 7f88d5a12640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88d0100b70 0x7f88d0199d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:35.962 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.961+0000 7f88d5a12640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d0101530 0x7f88d019a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:35.962 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.961+0000 7f88d5a12640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88d0101ed0 0x7f88d01a1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:35.962 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.961+0000 7f88d5a12640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f88d010b310 con 0x7f88d0101530 2024-06-06T03:28:35.962 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.961+0000 7f88d5a12640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f88d010b190 con 0x7f88d0101ed0 2024-06-06T03:28:35.962 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.961+0000 7f88d5a12640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f88d010b490 con 0x7f88d0100b70 2024-06-06T03:28:35.962 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.961+0000 7f88ceffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88d0100b70 0x7f88d0199d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:35.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.961+0000 7f88ceffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88d0100b70 0x7f88d0199d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:34456/0 (socket says 172.21.15.50:34456) 2024-06-06T03:28:35.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.961+0000 7f88ceffd640 1 -- 172.21.15.50:0/70660613 learned_addr learned my addr 172.21.15.50:0/70660613 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:35.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.961+0000 7f88cf7fe640 1 --2- 172.21.15.50:0/70660613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88d0101ed0 0x7f88d01a1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:35.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.961+0000 7f88ce7fc640 1 --2- 172.21.15.50:0/70660613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d0101530 0x7f88d019a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:35.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.962+0000 7f88ceffd640 1 -- 172.21.15.50:0/70660613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88d0101ed0 msgr2=0x7f88d01a1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:35.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.962+0000 7f88ceffd640 1 --2- 172.21.15.50:0/70660613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88d0101ed0 0x7f88d01a1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:35.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.962+0000 7f88ceffd640 1 -- 172.21.15.50:0/70660613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d0101530 msgr2=0x7f88d019a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:35.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.962+0000 7f88ceffd640 1 --2- 172.21.15.50:0/70660613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d0101530 0x7f88d019a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:35.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.962+0000 7f88ceffd640 1 -- 172.21.15.50:0/70660613 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d01a1990 con 0x7f88d0100b70 2024-06-06T03:28:35.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.962+0000 7f88cf7fe640 1 --2- 172.21.15.50:0/70660613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88d0101ed0 0x7f88d01a1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:28:35.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.962+0000 7f88ceffd640 1 --2- 172.21.15.50:0/70660613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88d0100b70 0x7f88d0199d70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f88c000e9c0 tx=0x7f88c000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:35.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.962+0000 7f88d4a10640 1 -- 172.21.15.50:0/70660613 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c000cd80 con 0x7f88d0100b70 2024-06-06T03:28:35.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.962+0000 7f88d4a10640 1 -- 172.21.15.50:0/70660613 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f88c00035f0 con 0x7f88d0100b70 2024-06-06T03:28:35.964 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.962+0000 7f88d5a12640 1 -- 172.21.15.50:0/70660613 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88d01a1c80 con 0x7f88d0100b70 2024-06-06T03:28:35.964 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.962+0000 7f88d4a10640 1 -- 172.21.15.50:0/70660613 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c0010690 con 0x7f88d0100b70 2024-06-06T03:28:35.964 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.962+0000 7f88d5a12640 1 -- 172.21.15.50:0/70660613 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88d01a21d0 con 0x7f88d0100b70 2024-06-06T03:28:35.964 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.966+0000 7f88d87f9740 1 Processor -- start 2024-06-06T03:28:35.965 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.966+0000 7f88d87f9740 1 -- start start 2024-06-06T03:28:35.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.966+0000 7f88d87f9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cff6cee010 0x55cff6cee430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:35.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.966+0000 7f88d87f9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cff6ceea00 0x55cff6cf3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:35.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.966+0000 7f88d87f9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cff6cf3b70 0x55cff6cf6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:35.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.966+0000 7f88d87f9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cff6c514f0 con 0x55cff6ceea00 2024-06-06T03:28:35.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.966+0000 7f88d87f9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55cff6bef870 con 0x55cff6cf3b70 2024-06-06T03:28:35.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.966+0000 7f88d87f9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55cff6c4d4b0 con 0x55cff6cee010 2024-06-06T03:28:35.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.967+0000 7f88cf7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cff6cee010 0x55cff6cee430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:35.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.967+0000 7f88cf7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cff6cee010 0x55cff6cee430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:34462/0 (socket says 172.21.15.50:34462) 2024-06-06T03:28:35.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.967+0000 7f88cf7fe640 1 -- 172.21.15.50:0/1541589439 learned_addr learned my addr 172.21.15.50:0/1541589439 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:35.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.967+0000 7f88ce7fc640 1 --2- 172.21.15.50:0/1541589439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cff6cf3b70 0x55cff6cf6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:35.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.967+0000 7f88d4a10640 1 -- 172.21.15.50:0/70660613 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f88c00037a0 con 0x7f88d0100b70 2024-06-06T03:28:35.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.967+0000 7f88cf7fe640 1 -- 172.21.15.50:0/1541589439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cff6cf3b70 msgr2=0x55cff6cf6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:35.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.967+0000 7f88cf7fe640 1 --2- 172.21.15.50:0/1541589439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cff6cf3b70 0x55cff6cf6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:35.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.967+0000 7f88cf7fe640 1 -- 172.21.15.50:0/1541589439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cff6ceea00 msgr2=0x55cff6cf3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:35.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.967+0000 7f88cf7fe640 1 --2- 172.21.15.50:0/1541589439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cff6ceea00 0x55cff6cf3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:35.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.967+0000 7f88cf7fe640 1 -- 172.21.15.50:0/1541589439 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cff6c0b9b0 con 0x55cff6cee010 2024-06-06T03:28:35.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.967+0000 7f88cf7fe640 1 --2- 172.21.15.50:0/1541589439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cff6cee010 0x55cff6cee430 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f88c802ae10 tx=0x7f88c8009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a247fec2c02fdf5f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:35.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.968+0000 7f88b5ffb640 1 -- 172.21.15.50:0/1541589439 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c8030c20 con 0x55cff6cee010 2024-06-06T03:28:35.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.968+0000 7f88b5ffb640 1 -- 172.21.15.50:0/1541589439 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f88c8036030 con 0x55cff6cee010 2024-06-06T03:28:35.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.968+0000 7f88d4a10640 1 --2- 172.21.15.50:0/70660613 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f88b80a2cb0 0x7f88b80a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:35.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.968+0000 7f88ceffd640 1 --2- 172.21.15.50:0/70660613 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f88b80a2cb0 0x7f88b80a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:35.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.968+0000 7f88d4a10640 1 -- 172.21.15.50:0/70660613 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f88c00cf6f0 con 0x7f88d0100b70 2024-06-06T03:28:35.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.968+0000 7f88b5ffb640 1 -- 172.21.15.50:0/1541589439 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c8031440 con 0x55cff6cee010 2024-06-06T03:28:35.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.969+0000 7f88d87f9740 1 -- 172.21.15.50:0/1541589439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cff6cee010 msgr2=0x55cff6cee430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:35.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.969+0000 7f88d87f9740 1 --2- 172.21.15.50:0/1541589439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cff6cee010 0x55cff6cee430 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f88c802ae10 tx=0x7f88c8009a20 comp rx=0 tx=0).stop 2024-06-06T03:28:35.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.969+0000 7f88ceffd640 1 --2- 172.21.15.50:0/70660613 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f88b80a2cb0 0x7f88b80a5170 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f88c0098030 tx=0x7f88c0097f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:35.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.969+0000 7f88d87f9740 1 -- 172.21.15.50:0/1541589439 shutdown_connections 2024-06-06T03:28:35.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.969+0000 7f88d87f9740 1 --2- 172.21.15.50:0/1541589439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cff6ceea00 0x55cff6cf3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:35.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.969+0000 7f88d87f9740 1 --2- 172.21.15.50:0/1541589439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cff6cf3b70 0x55cff6cf6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:35.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.969+0000 7f88d87f9740 1 --2- 172.21.15.50:0/1541589439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cff6cee010 0x55cff6cee430 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:35.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.969+0000 7f88d87f9740 1 -- 172.21.15.50:0/1541589439 >> 172.21.15.50:0/1541589439 conn(0x55cff6ce9680 msgr2=0x55cff6ce9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:35.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.969+0000 7f88d87f9740 1 -- 172.21.15.50:0/1541589439 shutdown_connections 2024-06-06T03:28:35.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.969+0000 7f88d87f9740 1 -- 172.21.15.50:0/1541589439 wait complete. 2024-06-06T03:28:35.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.969+0000 7f88d87f9740 1 -- start start 2024-06-06T03:28:35.973 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.970+0000 7f88d87f9740 1 Processor -- start 2024-06-06T03:28:35.973 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.970+0000 7f88d87f9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cff6cee010 0x55cff6d00a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:35.973 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.970+0000 7f88d87f9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cff6ceea00 0x55cff6d00fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:35.973 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.970+0000 7f88d87f9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cff6cf3b70 0x55cff6d07ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:35.973 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.970+0000 7f88d87f9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cff6cf6b10 con 0x55cff6ceea00 2024-06-06T03:28:35.973 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.970+0000 7f88d87f9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55cff6bdaae0 con 0x55cff6cee010 2024-06-06T03:28:35.973 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.970+0000 7f88d87f9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55cff6cf6c90 con 0x55cff6cf3b70 2024-06-06T03:28:35.973 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.970+0000 7f88ce7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cff6ceea00 0x55cff6d00fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:35.973 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.970+0000 7f88d87f9740 10 client.0 _ll_register_callbacks cb 0x55cff6c139b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:28:35.973 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.970+0000 7f88ce7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cff6ceea00 0x55cff6d00fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49848/0 (socket says 172.21.15.50:49848) 2024-06-06T03:28:35.973 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.970+0000 7f88ce7fc640 1 -- 172.21.15.50:0/889006035 learned_addr learned my addr 172.21.15.50:0/889006035 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:35.973 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.970+0000 7f88cf7fe640 1 --2- 172.21.15.50:0/889006035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cff6cf3b70 0x55cff6d07ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:35.973 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.970+0000 7f88cf7fe640 1 --2- 172.21.15.50:0/889006035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cff6cee010 0x55cff6d00a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:35.973 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.971+0000 7f88cf7fe640 1 -- 172.21.15.50:0/889006035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cff6cee010 msgr2=0x55cff6d00a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:35.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.971+0000 7f88cf7fe640 1 --2- 172.21.15.50:0/889006035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cff6cee010 0x55cff6d00a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:35.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.971+0000 7f88cf7fe640 1 -- 172.21.15.50:0/889006035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cff6ceea00 msgr2=0x55cff6d00fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:35.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.971+0000 7f88cf7fe640 1 --2- 172.21.15.50:0/889006035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cff6ceea00 0x55cff6d00fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:35.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.971+0000 7f88cf7fe640 1 -- 172.21.15.50:0/889006035 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cff6965210 con 0x55cff6cf3b70 2024-06-06T03:28:35.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.971+0000 7f88ce7fc640 1 --2- 172.21.15.50:0/889006035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cff6ceea00 0x55cff6d00fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:28:35.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.971+0000 7f88cf7fe640 1 --2- 172.21.15.50:0/889006035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cff6cf3b70 0x55cff6d07ff0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f88c8009ca0 tx=0x7f88c8005f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bd05738e6dc2221 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:35.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.971+0000 7f88aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:28:35.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.971+0000 7f88aeffd640 1 -- 172.21.15.50:0/889006035 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c804a040 con 0x55cff6cf3b70 2024-06-06T03:28:35.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.971+0000 7f88aeffd640 1 -- 172.21.15.50:0/889006035 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f88c8004d40 con 0x55cff6cf3b70 2024-06-06T03:28:35.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.971+0000 7f88d87f9740 1 -- 172.21.15.50:0/889006035 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88c8036030 con 0x55cff6cf3b70 2024-06-06T03:28:35.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.971+0000 7f88aeffd640 1 -- 172.21.15.50:0/889006035 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f88c8003e20 con 0x55cff6cf3b70 2024-06-06T03:28:35.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.971+0000 7f88d87f9740 10 client.25372 fetch_fsmap learned FSMap version 29 2024-06-06T03:28:35.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.971+0000 7f88d87f9740 1 -- 172.21.15.50:0/889006035 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cff6a31620 con 0x55cff6cf3b70 2024-06-06T03:28:35.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.972+0000 7f88aeffd640 1 -- 172.21.15.50:0/889006035 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f88c8036030 con 0x55cff6cf3b70 2024-06-06T03:28:35.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.972+0000 7f88aeffd640 1 -- 172.21.15.50:0/889006035 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f88c8050070 con 0x55cff6cf3b70 2024-06-06T03:28:35.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.972+0000 7f88d87f9740 10 client.25372 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:28:35.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.972+0000 7f88d87f9740 10 client.25372 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:28:35.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.972+0000 7f88d87f9740 20 client.25372 populate_metadata read hostname 'smithi050' 2024-06-06T03:28:35.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.972+0000 7f88d87f9740 1 --2- 172.21.15.50:0/889006035 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55cff6d0c4e0 0x55cff6d0e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:35.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.972+0000 7f88d87f9740 4 client.25372 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:28:35.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.972+0000 7f88d87f9740 1 -- 172.21.15.50:0/889006035 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cff6c64f10 con 0x55cff6d0c4e0 2024-06-06T03:28:35.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.972+0000 7f88ce7fc640 1 --2- 172.21.15.50:0/889006035 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55cff6d0c4e0 0x55cff6d0e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:35.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.972+0000 7f88aeffd640 10 client.25372 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:35.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.972+0000 7f88ce7fc640 1 --2- 172.21.15.50:0/889006035 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55cff6d0c4e0 0x55cff6d0e8d0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3844f91f8f6bde9f server_cookie=d00c97e315607683 in_seq=0 out_seq=0 2024-06-06T03:28:35.976 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.973+0000 7f88aeffd640 1 -- 172.21.15.50:0/889006035 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55cff6c64f10 con 0x55cff6d0c4e0 2024-06-06T03:28:35.976 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.973+0000 7f88aeffd640 10 client.25372 handle_command_reply: tid=0 2024-06-06T03:28:35.976 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.973+0000 7f88d87f9740 1 client.25372 shutdown 2024-06-06T03:28:35.976 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.973+0000 7f88d87f9740 1 -- 172.21.15.50:0/889006035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cff6cf3b70 msgr2=0x55cff6d07ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:35.977 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.973+0000 7f88d87f9740 1 --2- 172.21.15.50:0/889006035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cff6cf3b70 0x55cff6d07ff0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f88c8009ca0 tx=0x7f88c8005f70 comp rx=0 tx=0).stop 2024-06-06T03:28:35.977 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.973+0000 7f88d87f9740 1 -- 172.21.15.50:0/889006035 shutdown_connections 2024-06-06T03:28:35.977 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.973+0000 7f88d87f9740 1 --2- 172.21.15.50:0/889006035 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55cff6d0c4e0 0x55cff6d0e8d0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:35.977 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.973+0000 7f88d87f9740 1 --2- 172.21.15.50:0/889006035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cff6ceea00 0x55cff6d00fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:35.977 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.973+0000 7f88d87f9740 1 --2- 172.21.15.50:0/889006035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cff6cf3b70 0x55cff6d07ff0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:35.977 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.973+0000 7f88aeffd640 0 client.25372 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:35.977 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.973+0000 7f88d87f9740 1 --2- 172.21.15.50:0/889006035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cff6cee010 0x55cff6d00a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:35.977 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.973+0000 7f88d87f9740 1 -- 172.21.15.50:0/889006035 >> 172.21.15.50:0/889006035 conn(0x55cff6ce9680 msgr2=0x55cff6ce87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:35.977 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.974+0000 7f88d87f9740 1 -- 172.21.15.50:0/889006035 shutdown_connections 2024-06-06T03:28:35.977 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.974+0000 7f88d87f9740 1 -- 172.21.15.50:0/889006035 wait complete. 2024-06-06T03:28:35.977 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.974+0000 7f88d87f9740 20 client.25372 trim_cache size 0 max 16384 2024-06-06T03:28:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.996+0000 7f88d87f9740 1 Processor -- start 2024-06-06T03:28:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.996+0000 7f88d87f9740 1 -- start start 2024-06-06T03:28:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.996+0000 7f88d87f9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cff6cee010 0x55cff6cefbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.996+0000 7f88d87f9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cff6ceea00 0x55cff6d07fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.997+0000 7f88d87f9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cff6cf3b70 0x55cff6cf0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.997+0000 7f88d87f9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f88d01aaaa0 con 0x55cff6cf3b70 2024-06-06T03:28:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.997+0000 7f88d87f9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f88d01a8370 con 0x55cff6cee010 2024-06-06T03:28:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.997+0000 7f88d87f9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f88d01a61c0 con 0x55cff6ceea00 2024-06-06T03:28:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.997+0000 7f88ce7fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cff6ceea00 0x55cff6d07fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.997+0000 7f88cf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cff6cee010 0x55cff6cefbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.997+0000 7f88ce7fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cff6ceea00 0x55cff6d07fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:34484/0 (socket says 172.21.15.50:34484) 2024-06-06T03:28:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.997+0000 7f88ce7fc640 1 -- 172.21.15.50:0/1999370584 learned_addr learned my addr 172.21.15.50:0/1999370584 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.997+0000 7f88cf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cff6cee010 0x55cff6cefbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:51456/0 (socket says 172.21.15.50:51456) 2024-06-06T03:28:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.997+0000 7f88cf7fe640 1 --2- 172.21.15.50:0/1999370584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cff6cf3b70 0x55cff6cf0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.997+0000 7f88cf7fe640 1 -- 172.21.15.50:0/1999370584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cff6ceea00 msgr2=0x55cff6d07fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.997+0000 7f88cf7fe640 1 --2- 172.21.15.50:0/1999370584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cff6ceea00 0x55cff6d07fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.997+0000 7f88cf7fe640 1 -- 172.21.15.50:0/1999370584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cff6cf3b70 msgr2=0x55cff6cf0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.997+0000 7f88cf7fe640 1 --2- 172.21.15.50:0/1999370584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cff6cf3b70 0x55cff6cf0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.997+0000 7f88cf7fe640 1 -- 172.21.15.50:0/1999370584 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cff6ce94b0 con 0x55cff6cee010 2024-06-06T03:28:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.997+0000 7f88cf7fe640 1 --2- 172.21.15.50:0/1999370584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cff6cee010 0x55cff6cefbe0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f88c80039f0 tx=0x7f88c8033040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=583a1861bb46936d server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.997+0000 7f88b57fa640 1 -- 172.21.15.50:0/1999370584 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c8004b40 con 0x55cff6cee010 2024-06-06T03:28:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.998+0000 7f88b57fa640 1 -- 172.21.15.50:0/1999370584 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f88c8036020 con 0x55cff6cee010 2024-06-06T03:28:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.998+0000 7f88b57fa640 1 -- 172.21.15.50:0/1999370584 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c80458c0 con 0x55cff6cee010 2024-06-06T03:28:36.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.998+0000 7f88d87f9740 1 -- 172.21.15.50:0/1999370584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cff6cee010 msgr2=0x55cff6cefbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:36.001 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.998+0000 7f88d87f9740 1 --2- 172.21.15.50:0/1999370584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cff6cee010 0x55cff6cefbe0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f88c80039f0 tx=0x7f88c8033040 comp rx=0 tx=0).stop 2024-06-06T03:28:36.001 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.999+0000 7f88d87f9740 1 -- 172.21.15.50:0/1999370584 shutdown_connections 2024-06-06T03:28:36.001 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.999+0000 7f88d87f9740 1 --2- 172.21.15.50:0/1999370584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cff6cf3b70 0x55cff6cf0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:36.001 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.999+0000 7f88d87f9740 1 --2- 172.21.15.50:0/1999370584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cff6ceea00 0x55cff6d07fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:36.001 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.999+0000 7f88d87f9740 1 --2- 172.21.15.50:0/1999370584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cff6cee010 0x55cff6cefbe0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:36.001 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.999+0000 7f88d87f9740 1 -- 172.21.15.50:0/1999370584 >> 172.21.15.50:0/1999370584 conn(0x55cff6ce9680 msgr2=0x55cff6cf3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:36.001 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.999+0000 7f88d87f9740 1 -- 172.21.15.50:0/1999370584 shutdown_connections 2024-06-06T03:28:36.001 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.999+0000 7f88d87f9740 1 -- 172.21.15.50:0/1999370584 wait complete. 2024-06-06T03:28:36.001 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:35.999+0000 7f88d87f9740 1 -- start start 2024-06-06T03:28:36.001 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.000+0000 7f88d87f9740 1 Processor -- start 2024-06-06T03:28:36.001 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.000+0000 7f88d87f9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cff6cee010 0x55cff6d04f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:36.001 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.000+0000 7f88d87f9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cff6ceea00 0x55cff6d05480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.000+0000 7f88d87f9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cff6cf3b70 0x55cff6d75000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.000+0000 7f88d87f9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f88d01a6830 con 0x55cff6ceea00 2024-06-06T03:28:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.000+0000 7f88ce7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cff6ceea00 0x55cff6d05480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.000+0000 7f88ce7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cff6ceea00 0x55cff6d05480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49870/0 (socket says 172.21.15.50:49870) 2024-06-06T03:28:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.000+0000 7f88ce7fc640 1 -- 172.21.15.50:0/4292676376 learned_addr learned my addr 172.21.15.50:0/4292676376 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.000+0000 7f88d87f9740 1 -- 172.21.15.50:0/4292676376 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f88d01a7ca0 con 0x55cff6cf3b70 2024-06-06T03:28:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.000+0000 7f88d87f9740 1 -- 172.21.15.50:0/4292676376 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f88d01a6f00 con 0x55cff6cee010 2024-06-06T03:28:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.000+0000 7f88d87f9740 10 client.0 _ll_register_callbacks cb 0x7f88c4009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:28:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.000+0000 7f88cf7fe640 1 --2- 172.21.15.50:0/4292676376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cff6cf3b70 0x55cff6d75000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.000+0000 7f88cf7fe640 1 --2- 172.21.15.50:0/4292676376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cff6cee010 0x55cff6d04f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.001+0000 7f88ce7fc640 1 -- 172.21.15.50:0/4292676376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cff6cee010 msgr2=0x55cff6d04f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.001+0000 7f88ce7fc640 1 --2- 172.21.15.50:0/4292676376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cff6cee010 0x55cff6d04f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.001+0000 7f88ce7fc640 1 -- 172.21.15.50:0/4292676376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cff6cf3b70 msgr2=0x55cff6d75000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:36.003 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.001+0000 7f88ce7fc640 1 --2- 172.21.15.50:0/4292676376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cff6cf3b70 0x55cff6d75000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:36.003 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.001+0000 7f88ce7fc640 1 -- 172.21.15.50:0/4292676376 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cff6cef6d0 con 0x55cff6ceea00 2024-06-06T03:28:36.003 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.001+0000 7f88cf7fe640 1 --2- 172.21.15.50:0/4292676376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cff6cf3b70 0x55cff6d75000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:28:36.003 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.001+0000 7f88ce7fc640 1 --2- 172.21.15.50:0/4292676376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cff6ceea00 0x55cff6d05480 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x55cff6d01f50 tx=0x7f88c4012f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eedcea1417a7acee server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:36.003 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.001+0000 7f88aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:28:36.003 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.001+0000 7f88aeffd640 1 -- 172.21.15.50:0/4292676376 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c401f980 con 0x55cff6ceea00 2024-06-06T03:28:36.003 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.001+0000 7f88aeffd640 1 -- 172.21.15.50:0/4292676376 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f88c401fb20 con 0x55cff6ceea00 2024-06-06T03:28:36.003 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.002+0000 7f88d87f9740 1 -- 172.21.15.50:0/4292676376 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88c8036020 con 0x55cff6ceea00 2024-06-06T03:28:36.003 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.002+0000 7f88aeffd640 1 -- 172.21.15.50:0/4292676376 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f88c4033050 con 0x55cff6ceea00 2024-06-06T03:28:36.003 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.002+0000 7f88d87f9740 10 client.15795 fetch_fsmap learned FSMap version 29 2024-06-06T03:28:36.003 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.002+0000 7f88d87f9740 1 -- 172.21.15.50:0/4292676376 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cff6d76780 con 0x55cff6ceea00 2024-06-06T03:28:36.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.002+0000 7f88aeffd640 1 -- 172.21.15.50:0/4292676376 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f88c8036020 con 0x55cff6ceea00 2024-06-06T03:28:36.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.002+0000 7f88aeffd640 1 -- 172.21.15.50:0/4292676376 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f88c4004900 con 0x55cff6ceea00 2024-06-06T03:28:36.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.002+0000 7f88d87f9740 10 client.15795 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:28:36.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.002+0000 7f88d87f9740 10 client.15795 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:28:36.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.002+0000 7f88d87f9740 20 client.15795 populate_metadata read hostname 'smithi050' 2024-06-06T03:28:36.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.002+0000 7f88d87f9740 1 --2- 172.21.15.50:0/4292676376 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55cff6d77200 0x55cff6d79620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:36.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.003+0000 7f88d87f9740 4 client.15795 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:28:36.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.003+0000 7f88d87f9740 1 -- 172.21.15.50:0/4292676376 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cff6c5ec20 con 0x55cff6d77200 2024-06-06T03:28:36.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.003+0000 7f88cf7fe640 1 --2- 172.21.15.50:0/4292676376 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55cff6d77200 0x55cff6d79620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:36.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.003+0000 7f88cf7fe640 1 --2- 172.21.15.50:0/4292676376 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55cff6d77200 0x55cff6d79620 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3c8093b748f7703 server_cookie=44c8a0878c250ad2 in_seq=0 out_seq=0 2024-06-06T03:28:36.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.003+0000 7f88aeffd640 10 client.15795 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:36.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.012+0000 7f88aeffd640 1 -- 172.21.15.50:0/4292676376 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55cff6c5ec20 con 0x55cff6d77200 2024-06-06T03:28:36.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.012+0000 7f88aeffd640 10 client.15795 handle_command_reply: tid=0 2024-06-06T03:28:36.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.012+0000 7f88d87f9740 1 client.15795 shutdown 2024-06-06T03:28:36.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.012+0000 7f88d87f9740 1 -- 172.21.15.50:0/4292676376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cff6ceea00 msgr2=0x55cff6d05480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:36.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.012+0000 7f88d87f9740 1 --2- 172.21.15.50:0/4292676376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cff6ceea00 0x55cff6d05480 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x55cff6d01f50 tx=0x7f88c4012f30 comp rx=0 tx=0).stop 2024-06-06T03:28:36.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.013+0000 7f88d87f9740 1 -- 172.21.15.50:0/4292676376 shutdown_connections 2024-06-06T03:28:36.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.013+0000 7f88d87f9740 1 --2- 172.21.15.50:0/4292676376 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55cff6d77200 0x55cff6d79620 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:36.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.013+0000 7f88d87f9740 1 --2- 172.21.15.50:0/4292676376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cff6ceea00 0x55cff6d05480 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:36.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.013+0000 7f88d87f9740 1 --2- 172.21.15.50:0/4292676376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cff6cf3b70 0x55cff6d75000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:36.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.013+0000 7f88d87f9740 1 --2- 172.21.15.50:0/4292676376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cff6cee010 0x55cff6d04f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:36.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.013+0000 7f88d87f9740 1 -- 172.21.15.50:0/4292676376 >> 172.21.15.50:0/4292676376 conn(0x55cff6ce9680 msgr2=0x55cff6d00a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:36.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.013+0000 7f88aeffd640 0 client.15795 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:36.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.013+0000 7f88d87f9740 1 -- 172.21.15.50:0/4292676376 shutdown_connections 2024-06-06T03:28:36.013 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.013+0000 7f88d87f9740 1 -- 172.21.15.50:0/4292676376 wait complete. 2024-06-06T03:28:36.013 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.013+0000 7f88d87f9740 20 client.15795 trim_cache size 0 max 16384 2024-06-06T03:28:36.013 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:28:36.013 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:28:36.013 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:28:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.014+0000 7f88d5a12640 1 -- 172.21.15.50:0/70660613 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f88b80a2cb0 msgr2=0x7f88b80a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.014+0000 7f88d5a12640 1 --2- 172.21.15.50:0/70660613 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f88b80a2cb0 0x7f88b80a5170 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f88c0098030 tx=0x7f88c0097f90 comp rx=0 tx=0).stop 2024-06-06T03:28:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.014+0000 7f88d5a12640 1 -- 172.21.15.50:0/70660613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88d0100b70 msgr2=0x7f88d0199d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.014+0000 7f88d5a12640 1 --2- 172.21.15.50:0/70660613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88d0100b70 0x7f88d0199d70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f88c000e9c0 tx=0x7f88c000ee80 comp rx=0 tx=0).stop 2024-06-06T03:28:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.014+0000 7f88d5a12640 1 -- 172.21.15.50:0/70660613 shutdown_connections 2024-06-06T03:28:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.014+0000 7f88d5a12640 1 --2- 172.21.15.50:0/70660613 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f88b80a2cb0 0x7f88b80a5170 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.014+0000 7f88d5a12640 1 --2- 172.21.15.50:0/70660613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d0101530 0x7f88d019a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.014+0000 7f88d5a12640 1 --2- 172.21.15.50:0/70660613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88d0101ed0 0x7f88d01a1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.014+0000 7f88d5a12640 1 --2- 172.21.15.50:0/70660613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88d0100b70 0x7f88d0199d70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.014+0000 7f88d5a12640 1 -- 172.21.15.50:0/70660613 >> 172.21.15.50:0/70660613 conn(0x7f88d00fb600 msgr2=0x7f88d0104e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.014+0000 7f88d5a12640 1 -- 172.21.15.50:0/70660613 shutdown_connections 2024-06-06T03:28:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:36.014+0000 7f88d5a12640 1 -- 172.21.15.50:0/70660613 wait complete. 2024-06-06T03:28:37.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:36 smithi050 ceph-mon[32421]: pgmap v490: 129 pgs: 129 active+clean; 5.2 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 166 MiB/s wr, 93 op/s 2024-06-06T03:28:37.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:36 smithi079 ceph-mon[35478]: pgmap v490: 129 pgs: 129 active+clean; 5.2 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 166 MiB/s wr, 93 op/s 2024-06-06T03:28:37.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:36 smithi122 ceph-mon[35759]: pgmap v490: 129 pgs: 129 active+clean; 5.2 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 166 MiB/s wr, 93 op/s 2024-06-06T03:28:39.253 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:38 smithi050 ceph-mon[32421]: pgmap v491: 129 pgs: 129 active+clean; 5.3 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 144 MiB/s wr, 78 op/s 2024-06-06T03:28:39.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:38 smithi079 ceph-mon[35478]: pgmap v491: 129 pgs: 129 active+clean; 5.3 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 144 MiB/s wr, 78 op/s 2024-06-06T03:28:39.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:38 smithi122 ceph-mon[35759]: pgmap v491: 129 pgs: 129 active+clean; 5.3 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 144 MiB/s wr, 78 op/s 2024-06-06T03:28:41.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:41 smithi050 ceph-mon[32421]: pgmap v492: 129 pgs: 129 active+clean; 5.9 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 176 MiB/s wr, 98 op/s 2024-06-06T03:28:41.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:41 smithi079 ceph-mon[35478]: pgmap v492: 129 pgs: 129 active+clean; 5.9 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 176 MiB/s wr, 98 op/s 2024-06-06T03:28:41.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:41 smithi122 ceph-mon[35759]: pgmap v492: 129 pgs: 129 active+clean; 5.9 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 176 MiB/s wr, 98 op/s 2024-06-06T03:28:43.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:43 smithi079 ceph-mon[35478]: pgmap v493: 129 pgs: 129 active+clean; 6.0 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 145 MiB/s wr, 80 op/s 2024-06-06T03:28:43.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:43 smithi122 ceph-mon[35759]: pgmap v493: 129 pgs: 129 active+clean; 6.0 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 145 MiB/s wr, 80 op/s 2024-06-06T03:28:43.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:43 smithi050 ceph-mon[32421]: pgmap v493: 129 pgs: 129 active+clean; 6.0 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 145 MiB/s wr, 80 op/s 2024-06-06T03:28:45.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:45 smithi079 ceph-mon[35478]: pgmap v494: 129 pgs: 129 active+clean; 6.3 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 155 MiB/s wr, 85 op/s 2024-06-06T03:28:45.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:45 smithi122 ceph-mon[35759]: pgmap v494: 129 pgs: 129 active+clean; 6.3 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 155 MiB/s wr, 85 op/s 2024-06-06T03:28:45.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:45 smithi050 ceph-mon[32421]: pgmap v494: 129 pgs: 129 active+clean; 6.3 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 155 MiB/s wr, 85 op/s 2024-06-06T03:28:47.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:47 smithi079 ceph-mon[35478]: pgmap v495: 129 pgs: 129 active+clean; 6.8 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 170 MiB/s wr, 95 op/s 2024-06-06T03:28:47.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:47 smithi122 ceph-mon[35759]: pgmap v495: 129 pgs: 129 active+clean; 6.8 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 170 MiB/s wr, 95 op/s 2024-06-06T03:28:47.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:47 smithi050 ceph-mon[32421]: pgmap v495: 129 pgs: 129 active+clean; 6.8 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 170 MiB/s wr, 95 op/s 2024-06-06T03:28:49.151 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.151+0000 7f267d322640 1 -- 172.21.15.50:0/2086853596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26780759e0 msgr2=0x7f2678073e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:49.151 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.151+0000 7f267d322640 1 --2- 172.21.15.50:0/2086853596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26780759e0 0x7f2678073e30 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f2668009890 tx=0x7f266802a360 comp rx=0 tx=0).stop 2024-06-06T03:28:49.152 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.151+0000 7f267d322640 1 -- 172.21.15.50:0/2086853596 shutdown_connections 2024-06-06T03:28:49.152 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.151+0000 7f267d322640 1 --2- 172.21.15.50:0/2086853596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f267810e000 0x7f26781103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.152 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.151+0000 7f267d322640 1 --2- 172.21.15.50:0/2086853596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2678074400 0x7f2678074880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.152 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.151+0000 7f267d322640 1 --2- 172.21.15.50:0/2086853596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26780759e0 0x7f2678073e30 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.152 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.151+0000 7f267d322640 1 -- 172.21.15.50:0/2086853596 >> 172.21.15.50:0/2086853596 conn(0x7f26780fcf80 msgr2=0x7f26780ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:49.152 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.151+0000 7f267d322640 1 -- 172.21.15.50:0/2086853596 shutdown_connections 2024-06-06T03:28:49.152 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.151+0000 7f267d322640 1 -- 172.21.15.50:0/2086853596 wait complete. 2024-06-06T03:28:49.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.152+0000 7f267d322640 1 Processor -- start 2024-06-06T03:28:49.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.152+0000 7f267d322640 1 -- start start 2024-06-06T03:28:49.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.152+0000 7f267d322640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2678074400 0x7f267819e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:49.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.152+0000 7f267d322640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f267810e000 0x7f267819e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:49.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.153+0000 7f267d322640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26781a3990 0x7f26781a5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:49.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.153+0000 7f267d322640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2678113b30 con 0x7f2678074400 2024-06-06T03:28:49.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.153+0000 7f267d322640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f26781139b0 con 0x7f26781a3990 2024-06-06T03:28:49.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.153+0000 7f267d322640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2678113cb0 con 0x7f267810e000 2024-06-06T03:28:49.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.153+0000 7f26767fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f267810e000 0x7f267819e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:49.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.153+0000 7f26777fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26781a3990 0x7f26781a5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:49.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.153+0000 7f26767fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f267810e000 0x7f267819e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:54880/0 (socket says 172.21.15.50:54880) 2024-06-06T03:28:49.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.153+0000 7f26777fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26781a3990 0x7f26781a5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:37394/0 (socket says 172.21.15.50:37394) 2024-06-06T03:28:49.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.153+0000 7f26767fc640 1 -- 172.21.15.50:0/2579061713 learned_addr learned my addr 172.21.15.50:0/2579061713 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:49.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.153+0000 7f2676ffd640 1 --2- 172.21.15.50:0/2579061713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2678074400 0x7f267819e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:49.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.153+0000 7f26767fc640 1 -- 172.21.15.50:0/2579061713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26781a3990 msgr2=0x7f26781a5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:49.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.153+0000 7f26767fc640 1 --2- 172.21.15.50:0/2579061713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26781a3990 0x7f26781a5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.153+0000 7f26767fc640 1 -- 172.21.15.50:0/2579061713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2678074400 msgr2=0x7f267819e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:49.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.153+0000 7f26767fc640 1 --2- 172.21.15.50:0/2579061713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2678074400 0x7f267819e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.154+0000 7f26767fc640 1 -- 172.21.15.50:0/2579061713 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26781a63f0 con 0x7f267810e000 2024-06-06T03:28:49.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.154+0000 7f2676ffd640 1 --2- 172.21.15.50:0/2579061713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2678074400 0x7f267819e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:28:49.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.154+0000 7f26767fc640 1 --2- 172.21.15.50:0/2579061713 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f267810e000 0x7f267819e930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f266c00e9c0 tx=0x7f266c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:49.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.154+0000 7f265ffff640 1 -- 172.21.15.50:0/2579061713 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266c00ccc0 con 0x7f267810e000 2024-06-06T03:28:49.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.154+0000 7f265ffff640 1 -- 172.21.15.50:0/2579061713 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f266c0054d0 con 0x7f267810e000 2024-06-06T03:28:49.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.154+0000 7f267d322640 1 -- 172.21.15.50:0/2579061713 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26781a66e0 con 0x7f267810e000 2024-06-06T03:28:49.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.154+0000 7f265ffff640 1 -- 172.21.15.50:0/2579061713 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266c010430 con 0x7f267810e000 2024-06-06T03:28:49.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.154+0000 7f267d322640 1 -- 172.21.15.50:0/2579061713 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26781a6c30 con 0x7f267810e000 2024-06-06T03:28:49.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.157+0000 7f265ffff640 1 -- 172.21.15.50:0/2579061713 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f266c005020 con 0x7f267810e000 2024-06-06T03:28:49.158 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.158+0000 7f2680035740 1 Processor -- start 2024-06-06T03:28:49.158 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.158+0000 7f265ffff640 1 --2- 172.21.15.50:0/2579061713 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f26600a2c30 0x7f26600a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:49.158 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.158+0000 7f2680035740 1 -- start start 2024-06-06T03:28:49.158 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.158+0000 7f265ffff640 1 -- 172.21.15.50:0/2579061713 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f266c0cf8b0 con 0x7f267810e000 2024-06-06T03:28:49.158 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.158+0000 7f26777fe640 1 --2- 172.21.15.50:0/2579061713 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f26600a2c30 0x7f26600a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:49.158 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.158+0000 7f2680035740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d30b8d0010 0x55d30b8d0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:49.158 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.158+0000 7f2680035740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d30b8d0a00 0x55d30b8d5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:49.158 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.158+0000 7f2680035740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d30b8d5b70 0x55d30b8d8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:49.158 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.158+0000 7f2680035740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d30b8334f0 con 0x55d30b8d0a00 2024-06-06T03:28:49.159 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.158+0000 7f2680035740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d30b7d1870 con 0x55d30b8d0010 2024-06-06T03:28:49.159 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.158+0000 7f2680035740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d30b82f4b0 con 0x55d30b8d5b70 2024-06-06T03:28:49.160 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.158+0000 7f26767fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d30b8d0a00 0x55d30b8d5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:49.160 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.158+0000 7f26767fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d30b8d0a00 0x55d30b8d5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41578/0 (socket says 172.21.15.50:41578) 2024-06-06T03:28:49.160 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.158+0000 7f26767fc640 1 -- 172.21.15.50:0/2009702045 learned_addr learned my addr 172.21.15.50:0/2009702045 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:49.160 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.158+0000 7f26777fe640 1 --2- 172.21.15.50:0/2009702045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d30b8d5b70 0x55d30b8d8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:49.160 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.158+0000 7f2676ffd640 1 --2- 172.21.15.50:0/2009702045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d30b8d0010 0x55d30b8d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:49.160 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.159+0000 7f26777fe640 1 --2- 172.21.15.50:0/2579061713 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f26600a2c30 0x7f26600a50f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2670005fd0 tx=0x7f2670009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:49.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.159+0000 7f26767fc640 1 -- 172.21.15.50:0/2009702045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d30b8d5b70 msgr2=0x55d30b8d8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:49.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.159+0000 7f26767fc640 1 --2- 172.21.15.50:0/2009702045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d30b8d5b70 0x55d30b8d8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.159+0000 7f26767fc640 1 -- 172.21.15.50:0/2009702045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d30b8d0010 msgr2=0x55d30b8d0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:49.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.159+0000 7f26767fc640 1 --2- 172.21.15.50:0/2009702045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d30b8d0010 0x55d30b8d0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.159+0000 7f26767fc640 1 -- 172.21.15.50:0/2009702045 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d30b7ed9b0 con 0x55d30b8d0a00 2024-06-06T03:28:49.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.159+0000 7f2676ffd640 1 --2- 172.21.15.50:0/2009702045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d30b8d0010 0x55d30b8d0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:28:49.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.159+0000 7f26767fc640 1 --2- 172.21.15.50:0/2009702045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d30b8d0a00 0x55d30b8d5500 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f266c09bd20 tx=0x7f266c00efb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2309761df82e25e9 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:49.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.159+0000 7f265d7fa640 1 -- 172.21.15.50:0/2009702045 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266c09c490 con 0x55d30b8d0a00 2024-06-06T03:28:49.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.159+0000 7f265d7fa640 1 -- 172.21.15.50:0/2009702045 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f266c09bd90 con 0x55d30b8d0a00 2024-06-06T03:28:49.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.160+0000 7f265d7fa640 1 -- 172.21.15.50:0/2009702045 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266c097ae0 con 0x55d30b8d0a00 2024-06-06T03:28:49.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.160+0000 7f2680035740 1 -- 172.21.15.50:0/2009702045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d30b8d0a00 msgr2=0x55d30b8d5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:49.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.160+0000 7f2680035740 1 --2- 172.21.15.50:0/2009702045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d30b8d0a00 0x55d30b8d5500 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f266c09bd20 tx=0x7f266c00efb0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.160+0000 7f2680035740 1 -- 172.21.15.50:0/2009702045 shutdown_connections 2024-06-06T03:28:49.162 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.160+0000 7f2680035740 1 --2- 172.21.15.50:0/2009702045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d30b8d0a00 0x55d30b8d5500 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.162 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.160+0000 7f2680035740 1 --2- 172.21.15.50:0/2009702045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d30b8d5b70 0x55d30b8d8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.162 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.160+0000 7f2680035740 1 --2- 172.21.15.50:0/2009702045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d30b8d0010 0x55d30b8d0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.162 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.160+0000 7f2680035740 1 -- 172.21.15.50:0/2009702045 >> 172.21.15.50:0/2009702045 conn(0x55d30b8cb680 msgr2=0x55d30b8cba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:49.162 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.160+0000 7f2680035740 1 -- 172.21.15.50:0/2009702045 shutdown_connections 2024-06-06T03:28:49.162 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.161+0000 7f2680035740 1 -- 172.21.15.50:0/2009702045 wait complete. 2024-06-06T03:28:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.161+0000 7f2680035740 1 -- start start 2024-06-06T03:28:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.161+0000 7f2680035740 1 Processor -- start 2024-06-06T03:28:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.162+0000 7f2680035740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d30b8d0010 0x55d30b8da520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.162+0000 7f2680035740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d30b8d0a00 0x55d30b8daa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.162+0000 7f2680035740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d30b8d5b70 0x55d30b8e1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.162+0000 7f2676ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d30b8d0010 0x55d30b8da520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.162+0000 7f2676ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d30b8d0010 0x55d30b8da520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:54902/0 (socket says 172.21.15.50:54902) 2024-06-06T03:28:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.162+0000 7f2676ffd640 1 -- 172.21.15.50:0/3162463555 learned_addr learned my addr 172.21.15.50:0/3162463555 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.162+0000 7f26777fe640 1 --2- 172.21.15.50:0/3162463555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d30b8d5b70 0x55d30b8e1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.162+0000 7f26767fc640 1 --2- 172.21.15.50:0/3162463555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d30b8d0a00 0x55d30b8daa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.162+0000 7f2680035740 1 -- 172.21.15.50:0/3162463555 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d30b8d8bc0 con 0x55d30b8d5b70 2024-06-06T03:28:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.162+0000 7f2680035740 1 -- 172.21.15.50:0/3162463555 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d30b7bcae0 con 0x55d30b8d0a00 2024-06-06T03:28:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.162+0000 7f2680035740 1 -- 172.21.15.50:0/3162463555 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d30b8d8d40 con 0x55d30b8d0010 2024-06-06T03:28:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.162+0000 7f2680035740 10 client.0 _ll_register_callbacks cb 0x55d30b7f59b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:28:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.162+0000 7f26777fe640 1 -- 172.21.15.50:0/3162463555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d30b8d0010 msgr2=0x55d30b8da520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.162+0000 7f26777fe640 1 --2- 172.21.15.50:0/3162463555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d30b8d0010 0x55d30b8da520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.162+0000 7f26777fe640 1 -- 172.21.15.50:0/3162463555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d30b8d0a00 msgr2=0x55d30b8daa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.162+0000 7f26777fe640 1 --2- 172.21.15.50:0/3162463555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d30b8d0a00 0x55d30b8daa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.162+0000 7f26777fe640 1 -- 172.21.15.50:0/3162463555 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d30b547210 con 0x55d30b8d5b70 2024-06-06T03:28:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.163+0000 7f26767fc640 1 --2- 172.21.15.50:0/3162463555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d30b8d0a00 0x55d30b8daa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:28:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.163+0000 7f2680035740 1 -- 172.21.15.50:0/3162463555 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f266c09bd90 con 0x55d30b8d5b70 2024-06-06T03:28:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.163+0000 7f26777fe640 1 --2- 172.21.15.50:0/3162463555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d30b8d5b70 0x55d30b8e1aa0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f2670012fd0 tx=0x7f2670004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ad7923112445e2 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.163+0000 7f265aff5640 10 client.15804 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:28:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.163+0000 7f265aff5640 1 -- 172.21.15.50:0/3162463555 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2670004b20 con 0x55d30b8d5b70 2024-06-06T03:28:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.163+0000 7f265aff5640 1 -- 172.21.15.50:0/3162463555 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f2670004cc0 con 0x55d30b8d5b70 2024-06-06T03:28:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.163+0000 7f265aff5640 1 -- 172.21.15.50:0/3162463555 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f267001c710 con 0x55d30b8d5b70 2024-06-06T03:28:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.163+0000 7f2680035740 10 client.15804 fetch_fsmap learned FSMap version 29 2024-06-06T03:28:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.163+0000 7f2680035740 1 -- 172.21.15.50:0/3162463555 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55d30b613620 con 0x55d30b8d5b70 2024-06-06T03:28:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.164+0000 7f265aff5640 1 -- 172.21.15.50:0/3162463555 <== mon.0 v2:172.21.15.50:3300/0 4 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f267001c8b0 con 0x55d30b8d5b70 2024-06-06T03:28:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.164+0000 7f2680035740 10 client.15804 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:28:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.164+0000 7f2680035740 10 client.15804 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:28:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.164+0000 7f2680035740 20 client.15804 populate_metadata read hostname 'smithi050' 2024-06-06T03:28:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.164+0000 7f2680035740 1 --2- 172.21.15.50:0/3162463555 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d30b8e6220 0x55d30b8e8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.164+0000 7f2680035740 4 client.15804 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:28:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.164+0000 7f2680035740 1 -- 172.21.15.50:0/3162463555 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d30b846f10 con 0x55d30b8e6220 2024-06-06T03:28:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.164+0000 7f2676ffd640 1 --2- 172.21.15.50:0/3162463555 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d30b8e6220 0x55d30b8e8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.164+0000 7f265aff5640 10 client.15804 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.164+0000 7f2676ffd640 1 --2- 172.21.15.50:0/3162463555 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d30b8e6220 0x55d30b8e8660 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef6449b484b8735e server_cookie=203022abefa86c63 in_seq=0 out_seq=0 2024-06-06T03:28:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.165+0000 7f265aff5640 1 -- 172.21.15.50:0/3162463555 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d30b846f10 con 0x55d30b8e6220 2024-06-06T03:28:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.165+0000 7f265aff5640 10 client.15804 handle_command_reply: tid=0 2024-06-06T03:28:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.165+0000 7f2680035740 1 client.15804 shutdown 2024-06-06T03:28:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.165+0000 7f2680035740 1 -- 172.21.15.50:0/3162463555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d30b8d5b70 msgr2=0x55d30b8e1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.165+0000 7f2680035740 1 --2- 172.21.15.50:0/3162463555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d30b8d5b70 0x55d30b8e1aa0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f2670012fd0 tx=0x7f2670004ab0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.165+0000 7f2680035740 1 -- 172.21.15.50:0/3162463555 shutdown_connections 2024-06-06T03:28:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.165+0000 7f2680035740 1 --2- 172.21.15.50:0/3162463555 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d30b8e6220 0x55d30b8e8660 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.165+0000 7f2680035740 1 --2- 172.21.15.50:0/3162463555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d30b8d5b70 0x55d30b8e1aa0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.165+0000 7f2680035740 1 --2- 172.21.15.50:0/3162463555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d30b8d0a00 0x55d30b8daa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.165+0000 7f2680035740 1 --2- 172.21.15.50:0/3162463555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d30b8d0010 0x55d30b8da520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.165+0000 7f2680035740 1 -- 172.21.15.50:0/3162463555 >> 172.21.15.50:0/3162463555 conn(0x55d30b8cb680 msgr2=0x55d30b8ca7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.165+0000 7f265aff5640 0 client.15804 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.166+0000 7f2680035740 1 -- 172.21.15.50:0/3162463555 shutdown_connections 2024-06-06T03:28:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.166+0000 7f2680035740 1 -- 172.21.15.50:0/3162463555 wait complete. 2024-06-06T03:28:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.166+0000 7f2680035740 20 client.15804 trim_cache size 0 max 16384 2024-06-06T03:28:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.189+0000 7f2680035740 1 Processor -- start 2024-06-06T03:28:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.189+0000 7f2680035740 1 -- start start 2024-06-06T03:28:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.189+0000 7f2680035740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d30b8d0010 0x55d30b8d9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.189+0000 7f2680035740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d30b8d0a00 0x55d30b8e1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.189+0000 7f2680035740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d30b8d5b70 0x55d30b8da520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.189+0000 7f2680035740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f26781b39e0 con 0x55d30b8d0010 2024-06-06T03:28:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.189+0000 7f2680035740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f26781b12b0 con 0x55d30b8d0a00 2024-06-06T03:28:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.189+0000 7f2680035740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f26781af100 con 0x55d30b8d5b70 2024-06-06T03:28:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.189+0000 7f2676ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d30b8d0010 0x55d30b8d9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.189+0000 7f2676ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d30b8d0010 0x55d30b8d9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41592/0 (socket says 172.21.15.50:41592) 2024-06-06T03:28:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.189+0000 7f2676ffd640 1 -- 172.21.15.50:0/678905546 learned_addr learned my addr 172.21.15.50:0/678905546 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.189+0000 7f26777fe640 1 --2- 172.21.15.50:0/678905546 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d30b8d5b70 0x55d30b8da520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.190+0000 7f26777fe640 1 -- 172.21.15.50:0/678905546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d30b8d0a00 msgr2=0x55d30b8e1a60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:28:49.191 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.190+0000 7f26777fe640 1 --2- 172.21.15.50:0/678905546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d30b8d0a00 0x55d30b8e1a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.191 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.190+0000 7f26777fe640 1 -- 172.21.15.50:0/678905546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d30b8d0010 msgr2=0x55d30b8d9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:49.191 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.190+0000 7f26777fe640 1 --2- 172.21.15.50:0/678905546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d30b8d0010 0x55d30b8d9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.191 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.190+0000 7f26777fe640 1 -- 172.21.15.50:0/678905546 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d30b8d50d0 con 0x55d30b8d5b70 2024-06-06T03:28:49.191 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.190+0000 7f2676ffd640 1 --2- 172.21.15.50:0/678905546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d30b8d0010 0x55d30b8d9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:28:49.191 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.190+0000 7f26777fe640 1 --2- 172.21.15.50:0/678905546 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d30b8d5b70 0x55d30b8da520 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2670003ef0 tx=0x7f2670021000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3bdc1038ea15b12 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.190+0000 7f265cff9640 1 -- 172.21.15.50:0/678905546 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2670004ab0 con 0x55d30b8d5b70 2024-06-06T03:28:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.190+0000 7f265cff9640 1 -- 172.21.15.50:0/678905546 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f267001ce50 con 0x55d30b8d5b70 2024-06-06T03:28:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.190+0000 7f265cff9640 1 -- 172.21.15.50:0/678905546 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267001b440 con 0x55d30b8d5b70 2024-06-06T03:28:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.191+0000 7f2680035740 1 -- 172.21.15.50:0/678905546 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d30b8d5b70 msgr2=0x55d30b8da520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.191+0000 7f2680035740 1 --2- 172.21.15.50:0/678905546 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d30b8d5b70 0x55d30b8da520 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2670003ef0 tx=0x7f2670021000 comp rx=0 tx=0).stop 2024-06-06T03:28:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.191+0000 7f2680035740 1 -- 172.21.15.50:0/678905546 shutdown_connections 2024-06-06T03:28:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.191+0000 7f2680035740 1 --2- 172.21.15.50:0/678905546 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d30b8d5b70 0x55d30b8da520 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.191+0000 7f2680035740 1 --2- 172.21.15.50:0/678905546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d30b8d0a00 0x55d30b8e1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.191+0000 7f2680035740 1 --2- 172.21.15.50:0/678905546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d30b8d0010 0x55d30b8d9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.191+0000 7f2680035740 1 -- 172.21.15.50:0/678905546 >> 172.21.15.50:0/678905546 conn(0x55d30b8cb680 msgr2=0x55d30b8cba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.191+0000 7f2680035740 1 -- 172.21.15.50:0/678905546 shutdown_connections 2024-06-06T03:28:49.194 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.192+0000 7f2680035740 1 -- 172.21.15.50:0/678905546 wait complete. 2024-06-06T03:28:49.194 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.192+0000 7f2680035740 1 -- start start 2024-06-06T03:28:49.194 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.192+0000 7f2680035740 1 Processor -- start 2024-06-06T03:28:49.194 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.192+0000 7f2680035740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d30b8d0010 0x55d30b8e1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:49.194 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.192+0000 7f2680035740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d30b8d0a00 0x55d30b8e1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:49.194 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.192+0000 7f2680035740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d30b8d5b70 0x55d30b8de0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:49.194 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.192+0000 7f2680035740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f26781af770 con 0x55d30b8d0a00 2024-06-06T03:28:49.194 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.192+0000 7f2680035740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f26781b0be0 con 0x55d30b8d0010 2024-06-06T03:28:49.194 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.193+0000 7f2680035740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f26781afe40 con 0x55d30b8d5b70 2024-06-06T03:28:49.194 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.193+0000 7f2680035740 10 client.0 _ll_register_callbacks cb 0x7f2670009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:28:49.194 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.193+0000 7f26767fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d30b8d0a00 0x55d30b8e1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:49.194 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.193+0000 7f26777fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d30b8d5b70 0x55d30b8de0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:49.194 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.193+0000 7f26777fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d30b8d5b70 0x55d30b8de0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:54920/0 (socket says 172.21.15.50:54920) 2024-06-06T03:28:49.195 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.193+0000 7f2676ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d30b8d0010 0x55d30b8e1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:49.195 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.193+0000 7f26777fe640 1 -- 172.21.15.50:0/626405988 learned_addr learned my addr 172.21.15.50:0/626405988 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:49.195 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.193+0000 7f26767fc640 1 --2- 172.21.15.50:0/626405988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d30b8d0a00 0x55d30b8e1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41608/0 (socket says 172.21.15.50:41608) 2024-06-06T03:28:49.195 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.193+0000 7f26777fe640 1 -- 172.21.15.50:0/626405988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d30b8d0010 msgr2=0x55d30b8e1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:49.195 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.193+0000 7f26777fe640 1 --2- 172.21.15.50:0/626405988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d30b8d0010 0x55d30b8e1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.195 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.193+0000 7f26777fe640 1 -- 172.21.15.50:0/626405988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d30b8d0a00 msgr2=0x55d30b8e1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:49.195 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.193+0000 7f26777fe640 1 --2- 172.21.15.50:0/626405988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d30b8d0a00 0x55d30b8e1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.195 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.193+0000 7f26777fe640 1 -- 172.21.15.50:0/626405988 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d30b8de8c0 con 0x55d30b8d5b70 2024-06-06T03:28:49.195 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.193+0000 7f26777fe640 1 --2- 172.21.15.50:0/626405988 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d30b8d5b70 0x55d30b8de0c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f26700048e0 tx=0x7f2670004cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acc96621017d26f7 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:49.195 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.193+0000 7f265aff5640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:28:49.196 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.193+0000 7f265aff5640 1 -- 172.21.15.50:0/626405988 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267001ca80 con 0x55d30b8d5b70 2024-06-06T03:28:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.194+0000 7f265aff5640 1 -- 172.21.15.50:0/626405988 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f267002f840 con 0x55d30b8d5b70 2024-06-06T03:28:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.194+0000 7f2680035740 1 -- 172.21.15.50:0/626405988 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f267001ce50 con 0x55d30b8d5b70 2024-06-06T03:28:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.194+0000 7f265aff5640 1 -- 172.21.15.50:0/626405988 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2670041430 con 0x55d30b8d5b70 2024-06-06T03:28:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.194+0000 7f2680035740 10 client.25396 fetch_fsmap learned FSMap version 29 2024-06-06T03:28:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.194+0000 7f2680035740 1 -- 172.21.15.50:0/626405988 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d30b94fd50 con 0x55d30b8d5b70 2024-06-06T03:28:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.194+0000 7f265aff5640 1 -- 172.21.15.50:0/626405988 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f267001ce50 con 0x55d30b8d5b70 2024-06-06T03:28:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.194+0000 7f265aff5640 1 -- 172.21.15.50:0/626405988 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f2670040070 con 0x55d30b8d5b70 2024-06-06T03:28:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.194+0000 7f2680035740 10 client.25396 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:28:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.194+0000 7f2680035740 10 client.25396 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:28:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.194+0000 7f2680035740 20 client.25396 populate_metadata read hostname 'smithi050' 2024-06-06T03:28:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.194+0000 7f2680035740 1 --2- 172.21.15.50:0/626405988 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d30b950670 0x55d30b952a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.194+0000 7f2680035740 4 client.25396 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:28:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.194+0000 7f2680035740 1 -- 172.21.15.50:0/626405988 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d30b840c20 con 0x55d30b950670 2024-06-06T03:28:49.198 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.194+0000 7f2676ffd640 1 --2- 172.21.15.50:0/626405988 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d30b950670 0x55d30b952a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:49.198 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.195+0000 7f265aff5640 10 client.25396 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:49.198 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.195+0000 7f2676ffd640 1 --2- 172.21.15.50:0/626405988 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d30b950670 0x55d30b952a90 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b868450aa99cb6e server_cookie=c7657e1112dc80ef in_seq=0 out_seq=0 2024-06-06T03:28:49.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.206+0000 7f265aff5640 1 -- 172.21.15.50:0/626405988 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55d30b840c20 con 0x55d30b950670 2024-06-06T03:28:49.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.206+0000 7f265aff5640 10 client.25396 handle_command_reply: tid=0 2024-06-06T03:28:49.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.206+0000 7f2680035740 1 client.25396 shutdown 2024-06-06T03:28:49.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.207+0000 7f2680035740 1 -- 172.21.15.50:0/626405988 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d30b8d5b70 msgr2=0x55d30b8de0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:49.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.207+0000 7f2680035740 1 --2- 172.21.15.50:0/626405988 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d30b8d5b70 0x55d30b8de0c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f26700048e0 tx=0x7f2670004cf0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.207+0000 7f2680035740 1 -- 172.21.15.50:0/626405988 shutdown_connections 2024-06-06T03:28:49.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.207+0000 7f2680035740 1 --2- 172.21.15.50:0/626405988 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d30b950670 0x55d30b952a90 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.207+0000 7f2680035740 1 --2- 172.21.15.50:0/626405988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d30b8d0a00 0x55d30b8e1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.207+0000 7f2680035740 1 --2- 172.21.15.50:0/626405988 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d30b8d5b70 0x55d30b8de0c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.207+0000 7f2680035740 1 --2- 172.21.15.50:0/626405988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d30b8d0010 0x55d30b8e1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.207+0000 7f2680035740 1 -- 172.21.15.50:0/626405988 >> 172.21.15.50:0/626405988 conn(0x55d30b8cb680 msgr2=0x55d30b8d1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.207+0000 7f265aff5640 0 client.25396 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.207+0000 7f2680035740 1 -- 172.21.15.50:0/626405988 shutdown_connections 2024-06-06T03:28:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.207+0000 7f2680035740 1 -- 172.21.15.50:0/626405988 wait complete. 2024-06-06T03:28:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.207+0000 7f2680035740 20 client.25396 trim_cache size 0 max 16384 2024-06-06T03:28:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:28:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:28:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:28:49.209 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.208+0000 7f267d322640 1 -- 172.21.15.50:0/2579061713 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f26600a2c30 msgr2=0x7f26600a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:49.209 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.208+0000 7f267d322640 1 --2- 172.21.15.50:0/2579061713 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f26600a2c30 0x7f26600a50f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2670005fd0 tx=0x7f2670009500 comp rx=0 tx=0).stop 2024-06-06T03:28:49.209 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.208+0000 7f267d322640 1 -- 172.21.15.50:0/2579061713 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f267810e000 msgr2=0x7f267819e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:49.209 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.208+0000 7f267d322640 1 --2- 172.21.15.50:0/2579061713 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f267810e000 0x7f267819e930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f266c00e9c0 tx=0x7f266c00ee80 comp rx=0 tx=0).stop 2024-06-06T03:28:49.209 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.208+0000 7f267d322640 1 -- 172.21.15.50:0/2579061713 shutdown_connections 2024-06-06T03:28:49.209 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.208+0000 7f267d322640 1 --2- 172.21.15.50:0/2579061713 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f26600a2c30 0x7f26600a50f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.209 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.208+0000 7f267d322640 1 --2- 172.21.15.50:0/2579061713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26781a3990 0x7f26781a5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.208+0000 7f267d322640 1 --2- 172.21.15.50:0/2579061713 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f267810e000 0x7f267819e930 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.208+0000 7f267d322640 1 --2- 172.21.15.50:0/2579061713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2678074400 0x7f267819e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.208+0000 7f267d322640 1 -- 172.21.15.50:0/2579061713 >> 172.21.15.50:0/2579061713 conn(0x7f26780fcf80 msgr2=0x7f26781013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.208+0000 7f267d322640 1 -- 172.21.15.50:0/2579061713 shutdown_connections 2024-06-06T03:28:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:28:49.208+0000 7f267d322640 1 -- 172.21.15.50:0/2579061713 wait complete. 2024-06-06T03:28:49.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:49 smithi079 ceph-mon[35478]: pgmap v496: 129 pgs: 129 active+clean; 6.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 148 MiB/s wr, 81 op/s 2024-06-06T03:28:49.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:49 smithi122 ceph-mon[35759]: pgmap v496: 129 pgs: 129 active+clean; 6.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 148 MiB/s wr, 81 op/s 2024-06-06T03:28:49.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:49 smithi050 ceph-mon[32421]: pgmap v496: 129 pgs: 129 active+clean; 6.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 148 MiB/s wr, 81 op/s 2024-06-06T03:28:51.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:51 smithi079 ceph-mon[35478]: pgmap v497: 129 pgs: 129 active+clean; 7.4 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 180 MiB/s wr, 100 op/s 2024-06-06T03:28:51.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:51 smithi122 ceph-mon[35759]: pgmap v497: 129 pgs: 129 active+clean; 7.4 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 180 MiB/s wr, 100 op/s 2024-06-06T03:28:51.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:51 smithi050 ceph-mon[32421]: pgmap v497: 129 pgs: 129 active+clean; 7.4 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 180 MiB/s wr, 100 op/s 2024-06-06T03:28:53.057 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-06T03:28:53.303 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:53 smithi050 ceph-mon[32421]: pgmap v498: 129 pgs: 129 active+clean; 7.6 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 145 MiB/s wr, 79 op/s 2024-06-06T03:28:53.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:53 smithi079 ceph-mon[35478]: pgmap v498: 129 pgs: 129 active+clean; 7.6 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 145 MiB/s wr, 79 op/s 2024-06-06T03:28:53.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:53 smithi122 ceph-mon[35759]: pgmap v498: 129 pgs: 129 active+clean; 7.6 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 145 MiB/s wr, 79 op/s 2024-06-06T03:28:53.435 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:28:55.131 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:55 smithi050 ceph-mon[32421]: pgmap v499: 129 pgs: 129 active+clean; 7.9 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 162 MiB/s wr, 88 op/s 2024-06-06T03:28:55.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:55 smithi079 ceph-mon[35478]: pgmap v499: 129 pgs: 129 active+clean; 7.9 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 162 MiB/s wr, 88 op/s 2024-06-06T03:28:55.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:55 smithi122 ceph-mon[35759]: pgmap v499: 129 pgs: 129 active+clean; 7.9 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 162 MiB/s wr, 88 op/s 2024-06-06T03:28:56.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.624+0000 7fa5f9ab2700 1 -- 172.21.15.50:0/2335926070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5f410ef40 msgr2=0x7fa5f4111330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:56.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.624+0000 7fa5f9ab2700 1 --2- 172.21.15.50:0/2335926070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5f410ef40 0x7fa5f4111330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec009f90 tx=0x7fa5ec00b330 comp rx=0 tx=0).stop 2024-06-06T03:28:56.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.624+0000 7fa5f9ab2700 1 -- 172.21.15.50:0/2335926070 shutdown_connections 2024-06-06T03:28:56.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.624+0000 7fa5f9ab2700 1 --2- 172.21.15.50:0/2335926070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5f410ef40 0x7fa5f4111330 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:56.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.624+0000 7fa5f9ab2700 1 --2- 172.21.15.50:0/2335926070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5f406a170 0x7fa5f406a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:56.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.624+0000 7fa5f9ab2700 1 --2- 172.21.15.50:0/2335926070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5f406aa90 0x7fa5f410ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:56.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.624+0000 7fa5f9ab2700 1 -- 172.21.15.50:0/2335926070 >> 172.21.15.50:0/2335926070 conn(0x7fa5f40782c0 msgr2=0x7fa5f40786d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:56.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.624+0000 7fa5f9ab2700 1 -- 172.21.15.50:0/2335926070 shutdown_connections 2024-06-06T03:28:56.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.624+0000 7fa5f9ab2700 1 -- 172.21.15.50:0/2335926070 wait complete. 2024-06-06T03:28:56.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.625+0000 7fa5f9ab2700 1 Processor -- start 2024-06-06T03:28:56.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.625+0000 7fa5f9ab2700 1 -- start start 2024-06-06T03:28:56.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.626+0000 7fa5f9ab2700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5f406a170 0x7fa5f419ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:56.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.626+0000 7fa5f9ab2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5f406aa90 0x7fa5f419b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:56.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.626+0000 7fa5f9ab2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5f410ef40 0x7fa5f419f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:56.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.626+0000 7fa5f9ab2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f41147f0 con 0x7fa5f410ef40 2024-06-06T03:28:56.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.626+0000 7fa5f9ab2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f4114670 con 0x7fa5f406aa90 2024-06-06T03:28:56.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.626+0000 7fa5f9ab2700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f4114970 con 0x7fa5f406a170 2024-06-06T03:28:56.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.626+0000 7fa5f37fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5f406a170 0x7fa5f419ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:56.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.626+0000 7fa5f37fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5f406a170 0x7fa5f419ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:54942/0 (socket says 172.21.15.50:54942) 2024-06-06T03:28:56.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.626+0000 7fa5f37fe700 1 -- 172.21.15.50:0/1105231892 learned_addr learned my addr 172.21.15.50:0/1105231892 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:56.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.626+0000 7fa5f2ffd700 1 --2- 172.21.15.50:0/1105231892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5f406aa90 0x7fa5f419b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:56.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.626+0000 7fa5f3fff700 1 --2- 172.21.15.50:0/1105231892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5f410ef40 0x7fa5f419f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:56.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.626+0000 7fa5f37fe700 1 -- 172.21.15.50:0/1105231892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5f406aa90 msgr2=0x7fa5f419b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:56.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.626+0000 7fa5f37fe700 1 --2- 172.21.15.50:0/1105231892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5f406aa90 0x7fa5f419b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:56.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.626+0000 7fa5f37fe700 1 -- 172.21.15.50:0/1105231892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5f410ef40 msgr2=0x7fa5f419f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:56.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.626+0000 7fa5f37fe700 1 --2- 172.21.15.50:0/1105231892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5f410ef40 0x7fa5f419f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:56.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.626+0000 7fa5f37fe700 1 -- 172.21.15.50:0/1105231892 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f419fd20 con 0x7fa5f406a170 2024-06-06T03:28:56.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.627+0000 7fa5f37fe700 1 --2- 172.21.15.50:0/1105231892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5f406a170 0x7fa5f419ad60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa5e400e9c0 tx=0x7fa5e400ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:56.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.627+0000 7fa5f0ff9700 1 -- 172.21.15.50:0/1105231892 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e400cbd0 con 0x7fa5f406a170 2024-06-06T03:28:56.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.627+0000 7fa5f0ff9700 1 -- 172.21.15.50:0/1105231892 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa5e400cd70 con 0x7fa5f406a170 2024-06-06T03:28:56.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.627+0000 7fa5f9ab2700 1 -- 172.21.15.50:0/1105231892 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5f41a0010 con 0x7fa5f406a170 2024-06-06T03:28:56.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.627+0000 7fa5f0ff9700 1 -- 172.21.15.50:0/1105231892 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4005650 con 0x7fa5f406a170 2024-06-06T03:28:56.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.627+0000 7fa5f9ab2700 1 -- 172.21.15.50:0/1105231892 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5f41a7890 con 0x7fa5f406a170 2024-06-06T03:28:56.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.630+0000 7fa5f0ff9700 1 -- 172.21.15.50:0/1105231892 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa5e4004750 con 0x7fa5f406a170 2024-06-06T03:28:56.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.631+0000 7fa5f0ff9700 1 --2- 172.21.15.50:0/1105231892 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa5dc0a2ca0 0x7fa5dc0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:56.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.632+0000 7fa5f0ff9700 1 -- 172.21.15.50:0/1105231892 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fa5e40cf650 con 0x7fa5f406a170 2024-06-06T03:28:56.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.632+0000 7fa5f2ffd700 1 --2- 172.21.15.50:0/1105231892 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa5dc0a2ca0 0x7fa5dc0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:56.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.633+0000 7fa5f2ffd700 1 --2- 172.21.15.50:0/1105231892 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa5dc0a2ca0 0x7fa5dc0a5160 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa5f41004b0 tx=0x7fa5e8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:56.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.633+0000 7fa604335b80 1 Processor -- start 2024-06-06T03:28:56.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.633+0000 7fa604335b80 1 -- start start 2024-06-06T03:28:56.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.633+0000 7fa604335b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597105d8da0 0x5597105d9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:56.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.633+0000 7fa604335b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5597105d96c0 0x5597105d41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:56.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.633+0000 7fa604335b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597105d4730 0x5597105d4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:56.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.634+0000 7fa5f37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597105d8da0 0x5597105d9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:56.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.634+0000 7fa5f37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597105d8da0 0x5597105d9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41626/0 (socket says 172.21.15.50:41626) 2024-06-06T03:28:56.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.634+0000 7fa5f37fe700 1 -- 172.21.15.50:0/501478381 learned_addr learned my addr 172.21.15.50:0/501478381 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:56.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.634+0000 7fa604335b80 1 -- 172.21.15.50:0/501478381 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55971051d810 con 0x5597105d8da0 2024-06-06T03:28:56.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.634+0000 7fa604335b80 1 -- 172.21.15.50:0/501478381 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5597104c5720 con 0x5597105d96c0 2024-06-06T03:28:56.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.634+0000 7fa604335b80 1 -- 172.21.15.50:0/501478381 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5597105197d0 con 0x5597105d4730 2024-06-06T03:28:56.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.634+0000 7fa5f2ffd700 1 --2- 172.21.15.50:0/501478381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5597105d96c0 0x5597105d41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:56.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.634+0000 7fa5f3fff700 1 --2- 172.21.15.50:0/501478381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597105d4730 0x5597105d4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:56.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.634+0000 7fa5f2ffd700 1 -- 172.21.15.50:0/501478381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597105d4730 msgr2=0x5597105d4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:56.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.634+0000 7fa5f2ffd700 1 --2- 172.21.15.50:0/501478381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597105d4730 0x5597105d4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:56.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.634+0000 7fa5f2ffd700 1 -- 172.21.15.50:0/501478381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597105d8da0 msgr2=0x5597105d9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:56.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.634+0000 7fa5f2ffd700 1 --2- 172.21.15.50:0/501478381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597105d8da0 0x5597105d9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:56.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.634+0000 7fa5f2ffd700 1 -- 172.21.15.50:0/501478381 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597104bbf50 con 0x5597105d96c0 2024-06-06T03:28:56.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.634+0000 7fa5f3fff700 1 --2- 172.21.15.50:0/501478381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597105d4730 0x5597105d4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:28:56.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.634+0000 7fa5f37fe700 1 --2- 172.21.15.50:0/501478381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597105d8da0 0x5597105d9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:28:56.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.635+0000 7fa5f2ffd700 1 --2- 172.21.15.50:0/501478381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5597105d96c0 0x5597105d41f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8010760 tx=0x7fa5e8013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d988f85ff8c64ed server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:56.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.635+0000 7fa5d9ffb700 1 -- 172.21.15.50:0/501478381 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8011ad0 con 0x5597105d96c0 2024-06-06T03:28:56.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.636+0000 7fa5d9ffb700 1 -- 172.21.15.50:0/501478381 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa5e8011c70 con 0x5597105d96c0 2024-06-06T03:28:56.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.636+0000 7fa5d9ffb700 1 -- 172.21.15.50:0/501478381 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e801c5f0 con 0x5597105d96c0 2024-06-06T03:28:56.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.637+0000 7fa604335b80 1 -- 172.21.15.50:0/501478381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5597105d96c0 msgr2=0x5597105d41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:56.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.637+0000 7fa604335b80 1 --2- 172.21.15.50:0/501478381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5597105d96c0 0x5597105d41f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8010760 tx=0x7fa5e8013000 comp rx=0 tx=0).stop 2024-06-06T03:28:56.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.637+0000 7fa604335b80 1 -- 172.21.15.50:0/501478381 shutdown_connections 2024-06-06T03:28:56.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.637+0000 7fa604335b80 1 --2- 172.21.15.50:0/501478381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597105d4730 0x5597105d4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:56.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.637+0000 7fa604335b80 1 --2- 172.21.15.50:0/501478381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597105d8da0 0x5597105d9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:56.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.637+0000 7fa604335b80 1 --2- 172.21.15.50:0/501478381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5597105d96c0 0x5597105d41f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:56.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.637+0000 7fa604335b80 1 -- 172.21.15.50:0/501478381 >> 172.21.15.50:0/501478381 conn(0x5597104f6cc0 msgr2=0x5597105c6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:56.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.638+0000 7fa604335b80 1 -- 172.21.15.50:0/501478381 shutdown_connections 2024-06-06T03:28:56.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.638+0000 7fa604335b80 1 -- 172.21.15.50:0/501478381 wait complete. 2024-06-06T03:28:56.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.638+0000 7fa604335b80 1 -- start start 2024-06-06T03:28:56.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.638+0000 7fa604335b80 1 Processor -- start 2024-06-06T03:28:56.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.639+0000 7fa604335b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597105d4730 0x5597105e0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:56.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.639+0000 7fa604335b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5597105d8da0 0x5597105dd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:56.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.639+0000 7fa5f2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5597105d8da0 0x5597105dd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:56.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.639+0000 7fa5f2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5597105d8da0 0x5597105dd820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:37454/0 (socket says 172.21.15.50:37454) 2024-06-06T03:28:56.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.639+0000 7fa5f2ffd700 1 -- 172.21.15.50:0/296649073 learned_addr learned my addr 172.21.15.50:0/296649073 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:56.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.639+0000 7fa604335b80 1 --2- 172.21.15.50:0/296649073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597105d96c0 0x5597105ddd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:56.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.639+0000 7fa5f37fe700 1 --2- 172.21.15.50:0/296649073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597105d4730 0x5597105e0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:56.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.639+0000 7fa604335b80 1 -- 172.21.15.50:0/296649073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5597105e1200 con 0x5597105d96c0 2024-06-06T03:28:56.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.639+0000 7fa604335b80 1 -- 172.21.15.50:0/296649073 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5597104bdbf0 con 0x5597105d8da0 2024-06-06T03:28:56.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.639+0000 7fa604335b80 1 -- 172.21.15.50:0/296649073 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5597105e1380 con 0x5597105d4730 2024-06-06T03:28:56.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.639+0000 7fa604335b80 10 client.0 _ll_register_callbacks cb 0x5597104b7920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:28:56.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.639+0000 7fa5f3fff700 1 --2- 172.21.15.50:0/296649073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597105d96c0 0x5597105ddd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:56.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.640+0000 7fa5f2ffd700 1 -- 172.21.15.50:0/296649073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597105d4730 msgr2=0x5597105e0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:56.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.640+0000 7fa5f2ffd700 1 --2- 172.21.15.50:0/296649073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597105d4730 0x5597105e0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:56.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.640+0000 7fa5f2ffd700 1 -- 172.21.15.50:0/296649073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597105d96c0 msgr2=0x5597105ddd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:56.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.640+0000 7fa5f2ffd700 1 --2- 172.21.15.50:0/296649073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597105d96c0 0x5597105ddd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:56.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.640+0000 7fa5f2ffd700 1 -- 172.21.15.50:0/296649073 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55971046c8d0 con 0x5597105d8da0 2024-06-06T03:28:56.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.640+0000 7fa5f2ffd700 1 --2- 172.21.15.50:0/296649073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5597105d8da0 0x5597105dd820 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa5e801e650 tx=0x7fa5e801e680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3bf8a5a592cc12b server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:56.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.640+0000 7fa5d2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:28:56.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.640+0000 7fa5d2ffd700 1 -- 172.21.15.50:0/296649073 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8035060 con 0x5597105d8da0 2024-06-06T03:28:56.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.640+0000 7fa5d2ffd700 1 -- 172.21.15.50:0/296649073 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fa5e8026600 con 0x5597105d8da0 2024-06-06T03:28:56.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.640+0000 7fa604335b80 1 -- 172.21.15.50:0/296649073 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5e8011c70 con 0x5597105d8da0 2024-06-06T03:28:56.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.640+0000 7fa5d2ffd700 1 -- 172.21.15.50:0/296649073 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa5e803c050 con 0x5597105d8da0 2024-06-06T03:28:56.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.641+0000 7fa604335b80 10 client.25409 fetch_fsmap learned FSMap version 29 2024-06-06T03:28:56.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.641+0000 7fa604335b80 1 -- 172.21.15.50:0/296649073 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5597105ebaf0 con 0x5597105d8da0 2024-06-06T03:28:56.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.641+0000 7fa5d2ffd700 1 -- 172.21.15.50:0/296649073 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa5e8026cb0 con 0x5597105d8da0 2024-06-06T03:28:56.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.641+0000 7fa5d2ffd700 1 -- 172.21.15.50:0/296649073 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fa5e8030b40 con 0x5597105d8da0 2024-06-06T03:28:56.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.641+0000 7fa604335b80 10 client.25409 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:28:56.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.641+0000 7fa604335b80 10 client.25409 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:28:56.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.641+0000 7fa604335b80 20 client.25409 populate_metadata read hostname 'smithi050' 2024-06-06T03:28:56.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.641+0000 7fa604335b80 1 --2- 172.21.15.50:0/296649073 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5597105ee0c0 0x5597105f04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:56.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.641+0000 7fa604335b80 4 client.25409 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:28:56.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.641+0000 7fa604335b80 1 -- 172.21.15.50:0/296649073 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa5e8011c70 con 0x5597105ee0c0 2024-06-06T03:28:56.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.641+0000 7fa5f37fe700 1 --2- 172.21.15.50:0/296649073 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5597105ee0c0 0x5597105f04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:56.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.642+0000 7fa5d2ffd700 10 client.25409 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:56.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.642+0000 7fa5f37fe700 1 --2- 172.21.15.50:0/296649073 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5597105ee0c0 0x5597105f04b0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adc1ba8bdc784fe4 server_cookie=6e22e7913297dc21 in_seq=0 out_seq=0 2024-06-06T03:28:56.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.643+0000 7fa5d2ffd700 1 -- 172.21.15.50:0/296649073 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x7fa5e8011c70 con 0x5597105ee0c0 2024-06-06T03:28:56.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.643+0000 7fa5d2ffd700 10 client.25409 handle_command_reply: tid=0 2024-06-06T03:28:56.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.643+0000 7fa604335b80 1 client.25409 shutdown 2024-06-06T03:28:56.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.643+0000 7fa604335b80 1 -- 172.21.15.50:0/296649073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5597105d8da0 msgr2=0x5597105dd820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:56.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.643+0000 7fa604335b80 1 --2- 172.21.15.50:0/296649073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5597105d8da0 0x5597105dd820 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa5e801e650 tx=0x7fa5e801e680 comp rx=0 tx=0).stop 2024-06-06T03:28:56.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.643+0000 7fa604335b80 1 -- 172.21.15.50:0/296649073 shutdown_connections 2024-06-06T03:28:56.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.643+0000 7fa604335b80 1 --2- 172.21.15.50:0/296649073 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5597105ee0c0 0x5597105f04b0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:56.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.643+0000 7fa604335b80 1 --2- 172.21.15.50:0/296649073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597105d96c0 0x5597105ddd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:56.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.643+0000 7fa604335b80 1 --2- 172.21.15.50:0/296649073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597105d4730 0x5597105e0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:56.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.643+0000 7fa604335b80 1 --2- 172.21.15.50:0/296649073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5597105d8da0 0x5597105dd820 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:56.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.643+0000 7fa604335b80 1 -- 172.21.15.50:0/296649073 >> 172.21.15.50:0/296649073 conn(0x5597104f6cc0 msgr2=0x5597105ca9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:56.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.643+0000 7fa5d2ffd700 0 client.25409 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:56.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.643+0000 7fa604335b80 1 -- 172.21.15.50:0/296649073 shutdown_connections 2024-06-06T03:28:56.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.643+0000 7fa604335b80 1 -- 172.21.15.50:0/296649073 wait complete. 2024-06-06T03:28:56.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.644+0000 7fa604335b80 20 client.25409 trim_cache size 0 max 16384 2024-06-06T03:28:56.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.684+0000 7fa604335b80 1 Processor -- start 2024-06-06T03:28:56.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.684+0000 7fa604335b80 1 -- start start 2024-06-06T03:28:56.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.684+0000 7fa604335b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597105d4730 0x5597105dc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:56.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.684+0000 7fa604335b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597105d8da0 0x5597105d4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:56.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.684+0000 7fa604335b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5597105d96c0 0x5597105c0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:56.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.684+0000 7fa604335b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f41ae9a0 con 0x5597105d8da0 2024-06-06T03:28:56.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.684+0000 7fa604335b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f41ac230 con 0x5597105d96c0 2024-06-06T03:28:56.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.684+0000 7fa604335b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f41aa080 con 0x5597105d4730 2024-06-06T03:28:56.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.684+0000 7fa5f2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597105d8da0 0x5597105d4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:56.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.684+0000 7fa5f2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597105d8da0 0x5597105d4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41646/0 (socket says 172.21.15.50:41646) 2024-06-06T03:28:56.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.684+0000 7fa5f2ffd700 1 -- 172.21.15.50:0/3923387587 learned_addr learned my addr 172.21.15.50:0/3923387587 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:56.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.684+0000 7fa5f37fe700 1 --2- 172.21.15.50:0/3923387587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597105d4730 0x5597105dc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:56.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.684+0000 7fa5f3fff700 1 --2- 172.21.15.50:0/3923387587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5597105d96c0 0x5597105c0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:56.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.685+0000 7fa5f2ffd700 1 -- 172.21.15.50:0/3923387587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597105d4730 msgr2=0x5597105dc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:56.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.685+0000 7fa5f2ffd700 1 --2- 172.21.15.50:0/3923387587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597105d4730 0x5597105dc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:56.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.685+0000 7fa5f2ffd700 1 -- 172.21.15.50:0/3923387587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5597105d96c0 msgr2=0x5597105c0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:56.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.685+0000 7fa5f2ffd700 1 --2- 172.21.15.50:0/3923387587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5597105d96c0 0x5597105c0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:56.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.685+0000 7fa5f2ffd700 1 -- 172.21.15.50:0/3923387587 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597105e1200 con 0x5597105d8da0 2024-06-06T03:28:56.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.685+0000 7fa5f2ffd700 1 --2- 172.21.15.50:0/3923387587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597105d8da0 0x5597105d4b10 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa5e801a490 tx=0x7fa5e8005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b386d08be1b2b1cf server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:56.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.685+0000 7fa5d97fa700 1 -- 172.21.15.50:0/3923387587 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8035070 con 0x5597105d8da0 2024-06-06T03:28:56.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.685+0000 7fa5d97fa700 1 -- 172.21.15.50:0/3923387587 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa5e801ae40 con 0x5597105d8da0 2024-06-06T03:28:56.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.685+0000 7fa5d97fa700 1 -- 172.21.15.50:0/3923387587 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8026c40 con 0x5597105d8da0 2024-06-06T03:28:56.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.686+0000 7fa604335b80 1 -- 172.21.15.50:0/3923387587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597105d8da0 msgr2=0x5597105d4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:56.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.686+0000 7fa604335b80 1 --2- 172.21.15.50:0/3923387587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597105d8da0 0x5597105d4b10 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa5e801a490 tx=0x7fa5e8005750 comp rx=0 tx=0).stop 2024-06-06T03:28:56.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.687+0000 7fa604335b80 1 -- 172.21.15.50:0/3923387587 shutdown_connections 2024-06-06T03:28:56.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.687+0000 7fa604335b80 1 --2- 172.21.15.50:0/3923387587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5597105d96c0 0x5597105c0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:56.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.687+0000 7fa604335b80 1 --2- 172.21.15.50:0/3923387587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597105d4730 0x5597105dc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:56.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.687+0000 7fa604335b80 1 --2- 172.21.15.50:0/3923387587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597105d8da0 0x5597105d4b10 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:56.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.687+0000 7fa604335b80 1 -- 172.21.15.50:0/3923387587 >> 172.21.15.50:0/3923387587 conn(0x5597104f6cc0 msgr2=0x5597105df050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:56.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.687+0000 7fa604335b80 1 -- 172.21.15.50:0/3923387587 shutdown_connections 2024-06-06T03:28:56.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.687+0000 7fa604335b80 1 -- 172.21.15.50:0/3923387587 wait complete. 2024-06-06T03:28:56.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.687+0000 7fa604335b80 1 -- start start 2024-06-06T03:28:56.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.688+0000 7fa604335b80 1 Processor -- start 2024-06-06T03:28:56.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.689+0000 7fa604335b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597105d4730 0x5597105e6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:56.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.689+0000 7fa604335b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597105d8da0 0x5597105e6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:56.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.689+0000 7fa604335b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5597105d96c0 0x5597105daaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:56.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.689+0000 7fa604335b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f41aa6f0 con 0x5597105d8da0 2024-06-06T03:28:56.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.689+0000 7fa604335b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f41abb60 con 0x5597105d96c0 2024-06-06T03:28:56.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.689+0000 7fa604335b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f41aadc0 con 0x5597105d4730 2024-06-06T03:28:56.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.689+0000 7fa604335b80 10 client.0 _ll_register_callbacks cb 0x5597104b7920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:28:56.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.689+0000 7fa5f2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597105d8da0 0x5597105e6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:56.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.689+0000 7fa5f2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597105d8da0 0x5597105e6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41650/0 (socket says 172.21.15.50:41650) 2024-06-06T03:28:56.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.689+0000 7fa5f2ffd700 1 -- 172.21.15.50:0/3134188856 learned_addr learned my addr 172.21.15.50:0/3134188856 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:56.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.689+0000 7fa5f3fff700 1 --2- 172.21.15.50:0/3134188856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5597105d96c0 0x5597105daaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:56.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.689+0000 7fa5f37fe700 1 --2- 172.21.15.50:0/3134188856 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597105d4730 0x5597105e6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:56.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.690+0000 7fa5f37fe700 1 -- 172.21.15.50:0/3134188856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5597105d96c0 msgr2=0x5597105daaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:56.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.690+0000 7fa5f37fe700 1 --2- 172.21.15.50:0/3134188856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5597105d96c0 0x5597105daaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:56.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.690+0000 7fa5f37fe700 1 -- 172.21.15.50:0/3134188856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597105d8da0 msgr2=0x5597105e6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:28:56.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.690+0000 7fa5f37fe700 1 --2- 172.21.15.50:0/3134188856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597105d8da0 0x5597105e6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:56.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.690+0000 7fa5f37fe700 1 -- 172.21.15.50:0/3134188856 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597105db190 con 0x5597105d4730 2024-06-06T03:28:56.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.691+0000 7fa5f37fe700 1 --2- 172.21.15.50:0/3134188856 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597105d4730 0x5597105e6820 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa5e40a4210 tx=0x7fa5e40ccd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7ac8af262fe11c9 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:56.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.691+0000 7fa5d2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:28:56.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.691+0000 7fa5d2ffd700 1 -- 172.21.15.50:0/3134188856 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e409c1d0 con 0x5597105d4730 2024-06-06T03:28:56.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.691+0000 7fa5d2ffd700 1 -- 172.21.15.50:0/3134188856 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fa5e409ce00 con 0x5597105d4730 2024-06-06T03:28:56.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.691+0000 7fa604335b80 1 -- 172.21.15.50:0/3134188856 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5e801ae40 con 0x5597105d4730 2024-06-06T03:28:56.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.691+0000 7fa5d2ffd700 1 -- 172.21.15.50:0/3134188856 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa5e409bad0 con 0x5597105d4730 2024-06-06T03:28:56.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.691+0000 7fa604335b80 10 client.25414 fetch_fsmap learned FSMap version 29 2024-06-06T03:28:56.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.691+0000 7fa604335b80 1 -- 172.21.15.50:0/3134188856 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5597105f5b00 con 0x5597105d4730 2024-06-06T03:28:56.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.692+0000 7fa5d2ffd700 1 -- 172.21.15.50:0/3134188856 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa5e409fe80 con 0x5597105d4730 2024-06-06T03:28:56.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.692+0000 7fa5d2ffd700 1 -- 172.21.15.50:0/3134188856 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fa5e4098140 con 0x5597105d4730 2024-06-06T03:28:56.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.692+0000 7fa604335b80 10 client.25414 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:28:56.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.692+0000 7fa604335b80 10 client.25414 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:28:56.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.692+0000 7fa604335b80 20 client.25414 populate_metadata read hostname 'smithi050' 2024-06-06T03:28:56.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.692+0000 7fa604335b80 1 --2- 172.21.15.50:0/3134188856 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x559710658db0 0x55971065b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:56.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.692+0000 7fa604335b80 4 client.25414 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-06T03:28:56.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.692+0000 7fa604335b80 1 -- 172.21.15.50:0/3134188856 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fa5e801ae40 con 0x559710658db0 2024-06-06T03:28:56.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.693+0000 7fa5f2ffd700 1 --2- 172.21.15.50:0/3134188856 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x559710658db0 0x55971065b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:56.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.693+0000 7fa5d2ffd700 10 client.25414 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:56.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.693+0000 7fa5f2ffd700 1 --2- 172.21.15.50:0/3134188856 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x559710658db0 0x55971065b1a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4edc5bf80ec3d52d server_cookie=fcd61e4fa76b889c in_seq=0 out_seq=0 2024-06-06T03:28:56.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.693+0000 7fa5d2ffd700 1 -- 172.21.15.50:0/3134188856 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7fa5e801ae40 con 0x559710658db0 2024-06-06T03:28:56.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.693+0000 7fa5d2ffd700 10 client.25414 handle_command_reply: tid=0 2024-06-06T03:28:56.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.693+0000 7fa604335b80 1 client.25414 shutdown 2024-06-06T03:28:56.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.694+0000 7fa604335b80 1 -- 172.21.15.50:0/3134188856 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597105d4730 msgr2=0x5597105e6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:56.227 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:28:56.227 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2024-06-06T03:28:56.228 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-06-06T03:28:56.228 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:28:56.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.694+0000 7fa604335b80 1 --2- 172.21.15.50:0/3134188856 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597105d4730 0x5597105e6820 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa5e40a4210 tx=0x7fa5e40ccd60 comp rx=0 tx=0).stop 2024-06-06T03:28:56.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.694+0000 7fa604335b80 1 -- 172.21.15.50:0/3134188856 shutdown_connections 2024-06-06T03:28:56.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.694+0000 7fa604335b80 1 --2- 172.21.15.50:0/3134188856 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x559710658db0 0x55971065b1a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:56.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.694+0000 7fa604335b80 1 --2- 172.21.15.50:0/3134188856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5597105d96c0 0x5597105daaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:56.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.694+0000 7fa604335b80 1 --2- 172.21.15.50:0/3134188856 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597105d4730 0x5597105e6820 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:56.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.694+0000 7fa604335b80 1 --2- 172.21.15.50:0/3134188856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597105d8da0 0x5597105e6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:56.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.694+0000 7fa604335b80 1 -- 172.21.15.50:0/3134188856 >> 172.21.15.50:0/3134188856 conn(0x5597104f6cc0 msgr2=0x5597105c0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:56.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.694+0000 7fa5d2ffd700 0 client.25414 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:28:56.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.694+0000 7fa604335b80 1 -- 172.21.15.50:0/3134188856 shutdown_connections 2024-06-06T03:28:56.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.694+0000 7fa604335b80 1 -- 172.21.15.50:0/3134188856 wait complete. 2024-06-06T03:28:56.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.694+0000 7fa604335b80 20 client.25414 trim_cache size 0 max 16384 2024-06-06T03:28:56.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.695+0000 7fa5f9ab2700 1 -- 172.21.15.50:0/1105231892 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa5dc0a2ca0 msgr2=0x7fa5dc0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:56.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.695+0000 7fa5f9ab2700 1 --2- 172.21.15.50:0/1105231892 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa5dc0a2ca0 0x7fa5dc0a5160 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa5f41004b0 tx=0x7fa5e8009260 comp rx=0 tx=0).stop 2024-06-06T03:28:56.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.695+0000 7fa5f9ab2700 1 -- 172.21.15.50:0/1105231892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5f406a170 msgr2=0x7fa5f419ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:56.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.695+0000 7fa5f9ab2700 1 --2- 172.21.15.50:0/1105231892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5f406a170 0x7fa5f419ad60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa5e400e9c0 tx=0x7fa5e400ed80 comp rx=0 tx=0).stop 2024-06-06T03:28:56.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.695+0000 7fa5f9ab2700 1 -- 172.21.15.50:0/1105231892 shutdown_connections 2024-06-06T03:28:56.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.695+0000 7fa5f9ab2700 1 --2- 172.21.15.50:0/1105231892 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa5dc0a2ca0 0x7fa5dc0a5160 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:56.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.695+0000 7fa5f9ab2700 1 --2- 172.21.15.50:0/1105231892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5f410ef40 0x7fa5f419f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:56.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.695+0000 7fa5f9ab2700 1 --2- 172.21.15.50:0/1105231892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5f406a170 0x7fa5f419ad60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:56.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.695+0000 7fa5f9ab2700 1 --2- 172.21.15.50:0/1105231892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5f406aa90 0x7fa5f419b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:56.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.695+0000 7fa5f9ab2700 1 -- 172.21.15.50:0/1105231892 >> 172.21.15.50:0/1105231892 conn(0x7fa5f40782c0 msgr2=0x7fa5f4110430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:56.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.695+0000 7fa5f9ab2700 1 -- 172.21.15.50:0/1105231892 shutdown_connections 2024-06-06T03:28:56.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:55.695+0000 7fa5f9ab2700 1 -- 172.21.15.50:0/1105231892 wait complete. 2024-06-06T03:28:57.153 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-06T03:28:57.154 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T03:28:57.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:57 smithi079 ceph-mon[35478]: pgmap v500: 129 pgs: 129 active+clean; 8.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 176 MiB/s wr, 98 op/s 2024-06-06T03:28:57.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:57 smithi122 ceph-mon[35759]: pgmap v500: 129 pgs: 129 active+clean; 8.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 176 MiB/s wr, 98 op/s 2024-06-06T03:28:57.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:57 smithi050 ceph-mon[32421]: pgmap v500: 129 pgs: 129 active+clean; 8.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 176 MiB/s wr, 98 op/s 2024-06-06T03:28:57.530 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:28:59.304 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:28:59 smithi050 ceph-mon[32421]: pgmap v501: 129 pgs: 129 active+clean; 8.5 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 148 MiB/s wr, 82 op/s 2024-06-06T03:28:59.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:28:59 smithi079 ceph-mon[35478]: pgmap v501: 129 pgs: 129 active+clean; 8.5 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 148 MiB/s wr, 82 op/s 2024-06-06T03:28:59.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:28:59 smithi122 ceph-mon[35759]: pgmap v501: 129 pgs: 129 active+clean; 8.5 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 148 MiB/s wr, 82 op/s 2024-06-06T03:28:59.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.471+0000 7f5442349700 1 -- 172.21.15.50:0/1404426455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f543c074c00 msgr2=0x7f543c075080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:59.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.471+0000 7f5442349700 1 --2- 172.21.15.50:0/1404426455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f543c074c00 0x7f543c075080 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5430009990 tx=0x7f5430009ca0 comp rx=0 tx=0).stop 2024-06-06T03:28:59.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.471+0000 7f5442349700 1 -- 172.21.15.50:0/1404426455 shutdown_connections 2024-06-06T03:28:59.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.471+0000 7f5442349700 1 --2- 172.21.15.50:0/1404426455 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f543c113180 0x7f543c115570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:59.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.471+0000 7f5442349700 1 --2- 172.21.15.50:0/1404426455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f543c0764b0 0x7f543c0746c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:59.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.471+0000 7f5442349700 1 --2- 172.21.15.50:0/1404426455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f543c074c00 0x7f543c075080 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:59.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.471+0000 7f5442349700 1 -- 172.21.15.50:0/1404426455 >> 172.21.15.50:0/1404426455 conn(0x7f543c079520 msgr2=0x7f543c079930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:59.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.471+0000 7f5442349700 1 -- 172.21.15.50:0/1404426455 shutdown_connections 2024-06-06T03:28:59.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.471+0000 7f5442349700 1 -- 172.21.15.50:0/1404426455 wait complete. 2024-06-06T03:28:59.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.471+0000 7f5442349700 1 Processor -- start 2024-06-06T03:28:59.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.472+0000 7f5442349700 1 -- start start 2024-06-06T03:28:59.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.472+0000 7f5442349700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f543c074c00 0x7f543c19f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:59.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.472+0000 7f5442349700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f543c0764b0 0x7f543c19f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:59.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.472+0000 7f5442349700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f543c113180 0x7f543c1a3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:59.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.472+0000 7f5442349700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f543c118cb0 con 0x7f543c0764b0 2024-06-06T03:28:59.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.472+0000 7f5442349700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f543c118b30 con 0x7f543c113180 2024-06-06T03:28:59.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.472+0000 7f5442349700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f543c118e30 con 0x7f543c074c00 2024-06-06T03:28:59.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.472+0000 7f543b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f543c0764b0 0x7f543c19f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:59.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.472+0000 7f543bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f543c074c00 0x7f543c19f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:59.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.472+0000 7f543b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f543c0764b0 0x7f543c19f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37674/0 (socket says 172.21.15.50:37674) 2024-06-06T03:28:59.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.472+0000 7f543b7fe700 1 -- 172.21.15.50:0/3116060676 learned_addr learned my addr 172.21.15.50:0/3116060676 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:28:59.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.472+0000 7f54408e6700 1 --2- 172.21.15.50:0/3116060676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f543c113180 0x7f543c1a3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:59.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.473+0000 7f543bfff700 1 -- 172.21.15.50:0/3116060676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f543c113180 msgr2=0x7f543c1a3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:59.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.473+0000 7f543bfff700 1 --2- 172.21.15.50:0/3116060676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f543c113180 0x7f543c1a3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:59.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.473+0000 7f543bfff700 1 -- 172.21.15.50:0/3116060676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f543c0764b0 msgr2=0x7f543c19f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:59.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.473+0000 7f543bfff700 1 --2- 172.21.15.50:0/3116060676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f543c0764b0 0x7f543c19f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:59.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.473+0000 7f543bfff700 1 -- 172.21.15.50:0/3116060676 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f543c1a41b0 con 0x7f543c074c00 2024-06-06T03:28:59.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.473+0000 7f54408e6700 1 --2- 172.21.15.50:0/3116060676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f543c113180 0x7f543c1a3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:28:59.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.473+0000 7f543bfff700 1 --2- 172.21.15.50:0/3116060676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f543c074c00 0x7f543c19f1a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f542c00e9f0 tx=0x7f542c00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:59.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.473+0000 7f54397fa700 1 -- 172.21.15.50:0/3116060676 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f542c00cbd0 con 0x7f543c074c00 2024-06-06T03:28:59.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.473+0000 7f5442349700 1 -- 172.21.15.50:0/3116060676 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f543c1a44a0 con 0x7f543c074c00 2024-06-06T03:28:59.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.473+0000 7f54397fa700 1 -- 172.21.15.50:0/3116060676 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f542c00cd70 con 0x7f543c074c00 2024-06-06T03:28:59.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.473+0000 7f54397fa700 1 -- 172.21.15.50:0/3116060676 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f542c018680 con 0x7f543c074c00 2024-06-06T03:28:59.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.473+0000 7f5442349700 1 -- 172.21.15.50:0/3116060676 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f543c1abd20 con 0x7f543c074c00 2024-06-06T03:28:59.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.474+0000 7f5442349700 1 -- 172.21.15.50:0/3116060676 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f543c069180 con 0x7f543c074c00 2024-06-06T03:28:59.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.475+0000 7f54397fa700 1 -- 172.21.15.50:0/3116060676 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f542c010430 con 0x7f543c074c00 2024-06-06T03:28:59.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.476+0000 7f54397fa700 1 --2- 172.21.15.50:0/3116060676 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f54240a2c20 0x7f54240a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:28:59.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.476+0000 7f54397fa700 1 -- 172.21.15.50:0/3116060676 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f542c0cf620 con 0x7f543c074c00 2024-06-06T03:28:59.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.476+0000 7f543b7fe700 1 --2- 172.21.15.50:0/3116060676 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f54240a2c20 0x7f54240a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:28:59.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.477+0000 7f543b7fe700 1 --2- 172.21.15.50:0/3116060676 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f54240a2c20 0x7f54240a50e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f543c079db0 tx=0x7f543000b2a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:28:59.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.481+0000 7f54397fa700 1 -- 172.21.15.50:0/3116060676 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f542c09c1a0 con 0x7f543c074c00 2024-06-06T03:28:59.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.917+0000 7f5442349700 1 -- 172.21.15.50:0/3116060676 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f543c1abf50 con 0x7f543c074c00 2024-06-06T03:28:59.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.918+0000 7f54397fa700 1 -- 172.21.15.50:0/3116060676 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11858 (secure 0 0 0) 0x7f542c09baa0 con 0x7f543c074c00 2024-06-06T03:28:59.918 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:28:59.918 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1667847852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1667847852},{"type":"v1","addr":"172.21.15.50:6835","nonce":1667847852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/239971838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":239971838},{"type":"v1","addr":"172.21.15.50:6837","nonce":239971838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/2188134216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2188134216},{"type":"v1","addr":"172.21.15.50:6839","nonce":2188134216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/632572420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":632572420},{"type":"v1","addr":"172.21.15.50:6841","nonce":632572420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/864537078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":864537078},{"type":"v1","addr":"172.21.15.79:6833","nonce":864537078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/279268898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":279268898},{"type":"v1","addr":"172.21.15.79:6835","nonce":279268898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T03:22:36.202061+0000","modified":"2024-06-06T03:28:11.975305+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24490,"mds_1":24472,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/57533154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":57533154},{"type":"v1","addr":"172.21.15.122:6833","nonce":57533154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/3286722213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3286722213},{"type":"v1","addr":"172.21.15.79:6837","nonce":3286722213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/768067336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":768067336},{"type":"v1","addr":"172.21.15.79:6839","nonce":768067336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.122:6835/2987597320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2987597320},{"type":"v1","addr":"172.21.15.122:6835","nonce":2987597320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":23,"addr":"172.21.15.122:6837/1604366318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1604366318},{"type":"v1","addr":"172.21.15.122:6837","nonce":1604366318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6839/4129732900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":4129732900},{"type":"v1","addr":"172.21.15.122:6839","nonce":4129732900}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24472,24490,24466]},"id":1}]} 2024-06-06T03:28:59.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.921+0000 7f5442349700 1 -- 172.21.15.50:0/3116060676 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f54240a2c20 msgr2=0x7f54240a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:59.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.921+0000 7f5442349700 1 --2- 172.21.15.50:0/3116060676 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f54240a2c20 0x7f54240a50e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f543c079db0 tx=0x7f543000b2a0 comp rx=0 tx=0).stop 2024-06-06T03:28:59.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.921+0000 7f5442349700 1 -- 172.21.15.50:0/3116060676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f543c074c00 msgr2=0x7f543c19f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:28:59.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.921+0000 7f5442349700 1 --2- 172.21.15.50:0/3116060676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f543c074c00 0x7f543c19f1a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f542c00e9f0 tx=0x7f542c00ed00 comp rx=0 tx=0).stop 2024-06-06T03:28:59.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.921+0000 7f5442349700 1 -- 172.21.15.50:0/3116060676 shutdown_connections 2024-06-06T03:28:59.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.921+0000 7f5442349700 1 --2- 172.21.15.50:0/3116060676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f543c113180 0x7f543c1a3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:59.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.921+0000 7f5442349700 1 --2- 172.21.15.50:0/3116060676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f543c074c00 0x7f543c19f1a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:59.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.921+0000 7f5442349700 1 --2- 172.21.15.50:0/3116060676 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f54240a2c20 0x7f54240a50e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:59.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.921+0000 7f5442349700 1 --2- 172.21.15.50:0/3116060676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f543c0764b0 0x7f543c19f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:28:59.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.921+0000 7f5442349700 1 -- 172.21.15.50:0/3116060676 >> 172.21.15.50:0/3116060676 conn(0x7f543c079520 msgr2=0x7f543c111ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:28:59.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.921+0000 7f5442349700 1 -- 172.21.15.50:0/3116060676 shutdown_connections 2024-06-06T03:28:59.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:28:59.921+0000 7f5442349700 1 -- 172.21.15.50:0/3116060676 wait complete. 2024-06-06T03:28:59.922 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 29 2024-06-06T03:29:00.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:00 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3116060676' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:29:00.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:00 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/3116060676' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:29:00.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:00 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/3116060676' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:29:00.854 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-06-06T03:29:01.235 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:29:01.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:01 smithi050 ceph-mon[32421]: pgmap v502: 129 pgs: 129 active+clean; 9.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 176 MiB/s wr, 99 op/s 2024-06-06T03:29:01.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:01 smithi079 ceph-mon[35478]: pgmap v502: 129 pgs: 129 active+clean; 9.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 176 MiB/s wr, 99 op/s 2024-06-06T03:29:01.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:01 smithi122 ceph-mon[35759]: pgmap v502: 129 pgs: 129 active+clean; 9.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 176 MiB/s wr, 99 op/s 2024-06-06T03:29:02.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.354+0000 7f1238893640 1 -- 172.21.15.50:0/3107703352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1234109220 msgr2=0x7f12341096a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:02.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.354+0000 7f1238893640 1 --2- 172.21.15.50:0/3107703352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1234109220 0x7f12341096a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1224009900 tx=0x7f122402a3f0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.354+0000 7f1238893640 1 -- 172.21.15.50:0/3107703352 shutdown_connections 2024-06-06T03:29:02.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.354+0000 7f1238893640 1 --2- 172.21.15.50:0/3107703352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1234109220 0x7f12341096a0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.354+0000 7f1238893640 1 --2- 172.21.15.50:0/3107703352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1234109be0 0x7f1234110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.354+0000 7f1238893640 1 --2- 172.21.15.50:0/3107703352 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1234108030 0x7f1234108450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.354+0000 7f1238893640 1 -- 172.21.15.50:0/3107703352 >> 172.21.15.50:0/3107703352 conn(0x7f1234076ff0 msgr2=0x7f1234079410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:02.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.354+0000 7f1238893640 1 -- 172.21.15.50:0/3107703352 shutdown_connections 2024-06-06T03:29:02.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.354+0000 7f1238893640 1 -- 172.21.15.50:0/3107703352 wait complete. 2024-06-06T03:29:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.355+0000 7f1238893640 1 Processor -- start 2024-06-06T03:29:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.355+0000 7f1238893640 1 -- start start 2024-06-06T03:29:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.355+0000 7f1238893640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1234108030 0x7f123419e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.355+0000 7f1238893640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1234109220 0x7f123419e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.355+0000 7f1238893640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1234109be0 0x7f12341a5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:02.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.355+0000 7f1238893640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1234113b70 con 0x7f1234109220 2024-06-06T03:29:02.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.355+0000 7f1238893640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f12341139f0 con 0x7f1234109be0 2024-06-06T03:29:02.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.355+0000 7f1238893640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1234113cf0 con 0x7f1234108030 2024-06-06T03:29:02.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.355+0000 7f1231d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1234109220 0x7f123419e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:02.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.355+0000 7f1232d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1234109be0 0x7f12341a5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:02.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.355+0000 7f1232d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1234109be0 0x7f12341a5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:55616/0 (socket says 172.21.15.50:55616) 2024-06-06T03:29:02.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.355+0000 7f1231d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1234109220 0x7f123419e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37700/0 (socket says 172.21.15.50:37700) 2024-06-06T03:29:02.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.355+0000 7f1232d9d640 1 -- 172.21.15.50:0/612693197 learned_addr learned my addr 172.21.15.50:0/612693197 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:02.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.355+0000 7f123259c640 1 --2- 172.21.15.50:0/612693197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1234108030 0x7f123419e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:02.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.356+0000 7f1232d9d640 1 -- 172.21.15.50:0/612693197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1234108030 msgr2=0x7f123419e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:02.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.356+0000 7f1232d9d640 1 --2- 172.21.15.50:0/612693197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1234108030 0x7f123419e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.356+0000 7f1232d9d640 1 -- 172.21.15.50:0/612693197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1234109220 msgr2=0x7f123419e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:02.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.356+0000 7f1232d9d640 1 --2- 172.21.15.50:0/612693197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1234109220 0x7f123419e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.356+0000 7f1232d9d640 1 -- 172.21.15.50:0/612693197 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12341a5db0 con 0x7f1234109be0 2024-06-06T03:29:02.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.356+0000 7f1232d9d640 1 --2- 172.21.15.50:0/612693197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1234109be0 0x7f12341a5740 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f122800e9b0 tx=0x7f122800ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:02.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.356+0000 7f12237fe640 1 -- 172.21.15.50:0/612693197 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122800cd80 con 0x7f1234109be0 2024-06-06T03:29:02.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.356+0000 7f1238893640 1 -- 172.21.15.50:0/612693197 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12341a60a0 con 0x7f1234109be0 2024-06-06T03:29:02.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.356+0000 7f12237fe640 1 -- 172.21.15.50:0/612693197 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f12280035f0 con 0x7f1234109be0 2024-06-06T03:29:02.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.357+0000 7f1238893640 1 -- 172.21.15.50:0/612693197 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12341a65c0 con 0x7f1234109be0 2024-06-06T03:29:02.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.357+0000 7f12237fe640 1 -- 172.21.15.50:0/612693197 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1228010690 con 0x7f1234109be0 2024-06-06T03:29:02.359 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.360+0000 7f12237fe640 1 -- 172.21.15.50:0/612693197 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f12280037a0 con 0x7f1234109be0 2024-06-06T03:29:02.359 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.360+0000 7f123b59f740 1 Processor -- start 2024-06-06T03:29:02.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.361+0000 7f123b59f740 1 -- start start 2024-06-06T03:29:02.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.361+0000 7f12237fe640 1 --2- 172.21.15.50:0/612693197 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f121c0a2c30 0x7f121c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:02.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.361+0000 7f123b59f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aafdcbc010 0x55aafdcbc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:02.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.361+0000 7f123b59f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aafdcbca00 0x55aafdcc1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:02.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.361+0000 7f123b59f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aafdcc1b70 0x55aafdcc4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:02.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.361+0000 7f123b59f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55aafdc1f4f0 con 0x55aafdcbca00 2024-06-06T03:29:02.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.361+0000 7f123b59f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55aafdbbd870 con 0x55aafdcc1b70 2024-06-06T03:29:02.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.361+0000 7f123b59f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55aafdc1b4b0 con 0x55aafdcbc010 2024-06-06T03:29:02.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.361+0000 7f12237fe640 1 -- 172.21.15.50:0/612693197 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f12280cf7b0 con 0x7f1234109be0 2024-06-06T03:29:02.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.361+0000 7f1232d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aafdcc1b70 0x55aafdcc4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:02.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.361+0000 7f1232d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aafdcc1b70 0x55aafdcc4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:55624/0 (socket says 172.21.15.50:55624) 2024-06-06T03:29:02.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.361+0000 7f1232d9d640 1 -- 172.21.15.50:0/673570768 learned_addr learned my addr 172.21.15.50:0/673570768 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:02.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.361+0000 7f1231d9b640 1 --2- 172.21.15.50:0/612693197 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f121c0a2c30 0x7f121c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:02.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.362+0000 7f1232d9d640 1 -- 172.21.15.50:0/673570768 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aafdcbc010 msgr2=0x55aafdcbc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:02.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.362+0000 7f123259c640 1 --2- 172.21.15.50:0/673570768 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aafdcbc010 0x55aafdcbc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:02.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.362+0000 7f1232d9d640 1 --2- 172.21.15.50:0/673570768 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aafdcbc010 0x55aafdcbc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.362+0000 7f1232d9d640 1 -- 172.21.15.50:0/673570768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aafdcbca00 msgr2=0x55aafdcc1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:02.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.362+0000 7f1232d9d640 1 --2- 172.21.15.50:0/673570768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aafdcbca00 0x55aafdcc1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.363 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.362+0000 7f1232d9d640 1 -- 172.21.15.50:0/673570768 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aafdbd99b0 con 0x55aafdcc1b70 2024-06-06T03:29:02.363 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.362+0000 7f1231d9b640 1 --2- 172.21.15.50:0/612693197 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f121c0a2c30 0x7f121c0a50f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1224006010 tx=0x7f1224005d70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:02.363 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.363+0000 7f1232d9d640 1 --2- 172.21.15.50:0/673570768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aafdcc1b70 0x55aafdcc4000 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f12280a43d0 tx=0x7f122809b5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1acc1ed632c90aa5 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:02.363 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.363+0000 7f1220ff9640 1 -- 172.21.15.50:0/673570768 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122809c390 con 0x55aafdcc1b70 2024-06-06T03:29:02.363 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.363+0000 7f1220ff9640 1 -- 172.21.15.50:0/673570768 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f122801fd70 con 0x55aafdcc1b70 2024-06-06T03:29:02.363 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.363+0000 7f1220ff9640 1 -- 172.21.15.50:0/673570768 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1228099f90 con 0x55aafdcc1b70 2024-06-06T03:29:02.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.364+0000 7f123b59f740 1 -- 172.21.15.50:0/673570768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aafdcc1b70 msgr2=0x55aafdcc4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:02.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.364+0000 7f123b59f740 1 --2- 172.21.15.50:0/673570768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aafdcc1b70 0x55aafdcc4000 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f12280a43d0 tx=0x7f122809b5f0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.364+0000 7f123b59f740 1 -- 172.21.15.50:0/673570768 shutdown_connections 2024-06-06T03:29:02.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.364+0000 7f123b59f740 1 --2- 172.21.15.50:0/673570768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aafdcbca00 0x55aafdcc1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.364+0000 7f123b59f740 1 --2- 172.21.15.50:0/673570768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aafdcc1b70 0x55aafdcc4000 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.364+0000 7f123b59f740 1 --2- 172.21.15.50:0/673570768 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aafdcbc010 0x55aafdcbc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.364+0000 7f123b59f740 1 -- 172.21.15.50:0/673570768 >> 172.21.15.50:0/673570768 conn(0x55aafdcb7680 msgr2=0x55aafdcb7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:02.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.365+0000 7f123b59f740 1 -- 172.21.15.50:0/673570768 shutdown_connections 2024-06-06T03:29:02.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.365+0000 7f123b59f740 1 -- 172.21.15.50:0/673570768 wait complete. 2024-06-06T03:29:02.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.365+0000 7f123b59f740 1 -- start start 2024-06-06T03:29:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.365+0000 7f123b59f740 1 Processor -- start 2024-06-06T03:29:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.365+0000 7f123b59f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aafdcbc010 0x55aafdcc6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.365+0000 7f123b59f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aafdcbca00 0x55aafdcc6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.365+0000 7f123b59f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aafdcc1b70 0x55aafdccd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.365+0000 7f123b59f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55aafdcc4b20 con 0x55aafdcc1b70 2024-06-06T03:29:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.365+0000 7f123b59f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55aafdba8ae0 con 0x55aafdcbc010 2024-06-06T03:29:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.366+0000 7f123b59f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55aafdcc4ca0 con 0x55aafdcbca00 2024-06-06T03:29:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.366+0000 7f123b59f740 10 client.0 _ll_register_callbacks cb 0x55aafdbe19b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:29:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.366+0000 7f1232d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aafdcc1b70 0x55aafdccd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.366+0000 7f123259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aafdcbc010 0x55aafdcc6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.366+0000 7f1232d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aafdcc1b70 0x55aafdccd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37730/0 (socket says 172.21.15.50:37730) 2024-06-06T03:29:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.366+0000 7f1232d9d640 1 -- 172.21.15.50:0/1427186147 learned_addr learned my addr 172.21.15.50:0/1427186147 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.366+0000 7f1231d9b640 1 --2- 172.21.15.50:0/1427186147 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aafdcbca00 0x55aafdcc6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.366+0000 7f1232d9d640 1 -- 172.21.15.50:0/1427186147 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aafdcbca00 msgr2=0x55aafdcc6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.366+0000 7f1232d9d640 1 --2- 172.21.15.50:0/1427186147 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aafdcbca00 0x55aafdcc6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.366+0000 7f1232d9d640 1 -- 172.21.15.50:0/1427186147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aafdcbc010 msgr2=0x55aafdcc6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.366+0000 7f1232d9d640 1 --2- 172.21.15.50:0/1427186147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aafdcbc010 0x55aafdcc6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.366+0000 7f1232d9d640 1 -- 172.21.15.50:0/1427186147 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aafd933210 con 0x55aafdcc1b70 2024-06-06T03:29:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.366+0000 7f1232d9d640 1 --2- 172.21.15.50:0/1427186147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aafdcc1b70 0x55aafdccd8c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f12280980f0 tx=0x7f122809bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba8bdc2b7e2b5ed server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.366+0000 7f1219ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:29:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.367+0000 7f1219ffb640 1 -- 172.21.15.50:0/1427186147 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12280b8020 con 0x55aafdcc1b70 2024-06-06T03:29:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.367+0000 7f1219ffb640 1 -- 172.21.15.50:0/1427186147 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f122809c0f0 con 0x55aafdcc1b70 2024-06-06T03:29:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.367+0000 7f123b59f740 1 -- 172.21.15.50:0/1427186147 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f122801fd70 con 0x55aafdcc1b70 2024-06-06T03:29:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.367+0000 7f1219ffb640 1 -- 172.21.15.50:0/1427186147 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f122809b0e0 con 0x55aafdcc1b70 2024-06-06T03:29:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.367+0000 7f123b59f740 10 client.15843 fetch_fsmap learned FSMap version 29 2024-06-06T03:29:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.367+0000 7f123b59f740 1 -- 172.21.15.50:0/1427186147 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55aafd9ff620 con 0x55aafdcc1b70 2024-06-06T03:29:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.367+0000 7f1219ffb640 1 -- 172.21.15.50:0/1427186147 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f122809b280 con 0x55aafdcc1b70 2024-06-06T03:29:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.367+0000 7f1219ffb640 1 -- 172.21.15.50:0/1427186147 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f122809ab50 con 0x55aafdcc1b70 2024-06-06T03:29:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.367+0000 7f123b59f740 10 client.15843 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:29:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.367+0000 7f123b59f740 10 client.15843 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:29:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.367+0000 7f123b59f740 20 client.15843 populate_metadata read hostname 'smithi050' 2024-06-06T03:29:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.367+0000 7f123b59f740 1 --2- 172.21.15.50:0/1427186147 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55aafdcd1db0 0x55aafdcd41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.367+0000 7f123b59f740 4 client.15843 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:29:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.367+0000 7f123b59f740 1 -- 172.21.15.50:0/1427186147 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f122801fd70 con 0x55aafdcd1db0 2024-06-06T03:29:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.368+0000 7f123259c640 1 --2- 172.21.15.50:0/1427186147 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55aafdcd1db0 0x55aafdcd41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.368+0000 7f1219ffb640 10 client.15843 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.368+0000 7f123259c640 1 --2- 172.21.15.50:0/1427186147 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55aafdcd1db0 0x55aafdcd41a0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=439635dfe6fe3d07 server_cookie=ac0b0ec163c20619 in_seq=0 out_seq=0 2024-06-06T03:29:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.369+0000 7f1219ffb640 1 -- 172.21.15.50:0/1427186147 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x7f122801fd70 con 0x55aafdcd1db0 2024-06-06T03:29:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.369+0000 7f1219ffb640 10 client.15843 handle_command_reply: tid=0 2024-06-06T03:29:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.369+0000 7f123b59f740 1 client.15843 shutdown 2024-06-06T03:29:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.369+0000 7f123b59f740 1 -- 172.21.15.50:0/1427186147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aafdcc1b70 msgr2=0x55aafdccd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.369+0000 7f123b59f740 1 --2- 172.21.15.50:0/1427186147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aafdcc1b70 0x55aafdccd8c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f12280980f0 tx=0x7f122809bd60 comp rx=0 tx=0).stop 2024-06-06T03:29:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.369+0000 7f123b59f740 1 -- 172.21.15.50:0/1427186147 shutdown_connections 2024-06-06T03:29:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.369+0000 7f123b59f740 1 --2- 172.21.15.50:0/1427186147 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55aafdcd1db0 0x55aafdcd41a0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.369+0000 7f123b59f740 1 --2- 172.21.15.50:0/1427186147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aafdcc1b70 0x55aafdccd8c0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.369+0000 7f123b59f740 1 --2- 172.21.15.50:0/1427186147 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aafdcbca00 0x55aafdcc6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.369+0000 7f1219ffb640 0 client.15843 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.369+0000 7f123b59f740 1 --2- 172.21.15.50:0/1427186147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aafdcbc010 0x55aafdcc6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.369+0000 7f123b59f740 1 -- 172.21.15.50:0/1427186147 >> 172.21.15.50:0/1427186147 conn(0x55aafdcb7680 msgr2=0x55aafdcb67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.369+0000 7f123b59f740 1 -- 172.21.15.50:0/1427186147 shutdown_connections 2024-06-06T03:29:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.369+0000 7f123b59f740 1 -- 172.21.15.50:0/1427186147 wait complete. 2024-06-06T03:29:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.369+0000 7f123b59f740 20 client.15843 trim_cache size 0 max 16384 2024-06-06T03:29:02.393 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.394+0000 7f123b59f740 1 Processor -- start 2024-06-06T03:29:02.393 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.394+0000 7f123b59f740 1 -- start start 2024-06-06T03:29:02.393 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.394+0000 7f123b59f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aafdcb7680 0x55aafdcbdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:02.393 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.394+0000 7f123b59f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aafdcbc010 0x55aafdcbe260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:02.393 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.394+0000 7f123b59f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aafdcbca00 0x55aafdccd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:02.394 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.394+0000 7f123b59f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f12341b3380 con 0x55aafdcbc010 2024-06-06T03:29:02.394 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.394+0000 7f123b59f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f12341b0c50 con 0x55aafdcbca00 2024-06-06T03:29:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.394+0000 7f123b59f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f12341aeaa0 con 0x55aafdcb7680 2024-06-06T03:29:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.394+0000 7f1232d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aafdcbca00 0x55aafdccd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.394+0000 7f1232d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aafdcbca00 0x55aafdccd880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:55648/0 (socket says 172.21.15.50:55648) 2024-06-06T03:29:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.394+0000 7f1232d9d640 1 -- 172.21.15.50:0/2902037941 learned_addr learned my addr 172.21.15.50:0/2902037941 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.394+0000 7f1231d9b640 1 --2- 172.21.15.50:0/2902037941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aafdcbc010 0x55aafdcbe260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.394+0000 7f123259c640 1 --2- 172.21.15.50:0/2902037941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aafdcb7680 0x55aafdcbdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.395+0000 7f1232d9d640 1 -- 172.21.15.50:0/2902037941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aafdcb7680 msgr2=0x55aafdcbdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.395+0000 7f1232d9d640 1 --2- 172.21.15.50:0/2902037941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aafdcb7680 0x55aafdcbdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.395+0000 7f1232d9d640 1 -- 172.21.15.50:0/2902037941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aafdcbc010 msgr2=0x55aafdcbe260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.395+0000 7f1232d9d640 1 --2- 172.21.15.50:0/2902037941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aafdcbc010 0x55aafdcbe260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.395+0000 7f1232d9d640 1 -- 172.21.15.50:0/2902037941 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aafdcb74b0 con 0x55aafdcbca00 2024-06-06T03:29:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.395+0000 7f123259c640 1 --2- 172.21.15.50:0/2902037941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aafdcb7680 0x55aafdcbdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:29:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.395+0000 7f1232d9d640 1 --2- 172.21.15.50:0/2902037941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aafdcbca00 0x55aafdccd880 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f12280cd2a0 tx=0x7f122809b5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=373b72c162e8ec63 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.395+0000 7f121bfff640 1 -- 172.21.15.50:0/2902037941 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12280b8040 con 0x55aafdcbca00 2024-06-06T03:29:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.395+0000 7f121bfff640 1 -- 172.21.15.50:0/2902037941 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f122809b280 con 0x55aafdcbca00 2024-06-06T03:29:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.395+0000 7f121bfff640 1 -- 172.21.15.50:0/2902037941 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122809bef0 con 0x55aafdcbca00 2024-06-06T03:29:02.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.396+0000 7f123b59f740 1 -- 172.21.15.50:0/2902037941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aafdcbca00 msgr2=0x55aafdccd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.396+0000 7f123b59f740 1 --2- 172.21.15.50:0/2902037941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aafdcbca00 0x55aafdccd880 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f12280cd2a0 tx=0x7f122809b5f0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.396+0000 7f123b59f740 1 -- 172.21.15.50:0/2902037941 shutdown_connections 2024-06-06T03:29:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.396+0000 7f123b59f740 1 --2- 172.21.15.50:0/2902037941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aafdcbc010 0x55aafdcbe260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.396+0000 7f123b59f740 1 --2- 172.21.15.50:0/2902037941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aafdcbca00 0x55aafdccd880 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.396+0000 7f123b59f740 1 --2- 172.21.15.50:0/2902037941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aafdcb7680 0x55aafdcbdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.396+0000 7f123b59f740 1 -- 172.21.15.50:0/2902037941 >> 172.21.15.50:0/2902037941 conn(0x55aafdcbd600 msgr2=0x55aafdcb7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.397+0000 7f123b59f740 1 -- 172.21.15.50:0/2902037941 shutdown_connections 2024-06-06T03:29:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.397+0000 7f123b59f740 1 -- 172.21.15.50:0/2902037941 wait complete. 2024-06-06T03:29:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.397+0000 7f123b59f740 1 -- start start 2024-06-06T03:29:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.397+0000 7f123b59f740 1 Processor -- start 2024-06-06T03:29:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.397+0000 7f123b59f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aafdcb7680 0x55aafdccabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.397+0000 7f123b59f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aafdcbc010 0x55aafdccb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.397+0000 7f123b59f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aafdcbca00 0x55aafdccc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.397+0000 7f123b59f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f12341af110 con 0x55aafdcbca00 2024-06-06T03:29:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.397+0000 7f123b59f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f12341b0580 con 0x55aafdcbc010 2024-06-06T03:29:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.397+0000 7f123b59f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f12341af7e0 con 0x55aafdcb7680 2024-06-06T03:29:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.397+0000 7f123b59f740 10 client.0 _ll_register_callbacks cb 0x7f122809baf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:29:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.398+0000 7f1231d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aafdcbc010 0x55aafdccb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.398+0000 7f1231d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aafdcbc010 0x55aafdccb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:55654/0 (socket says 172.21.15.50:55654) 2024-06-06T03:29:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.398+0000 7f1231d9b640 1 -- 172.21.15.50:0/2356725866 learned_addr learned my addr 172.21.15.50:0/2356725866 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.398+0000 7f1232d9d640 1 --2- 172.21.15.50:0/2356725866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aafdcbca00 0x55aafdccc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.398+0000 7f123259c640 1 --2- 172.21.15.50:0/2356725866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aafdcb7680 0x55aafdccabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.398+0000 7f1231d9b640 1 -- 172.21.15.50:0/2356725866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aafdcb7680 msgr2=0x55aafdccabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.398+0000 7f1231d9b640 1 --2- 172.21.15.50:0/2356725866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aafdcb7680 0x55aafdccabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.398+0000 7f1231d9b640 1 -- 172.21.15.50:0/2356725866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aafdcbca00 msgr2=0x55aafdccc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.398+0000 7f1231d9b640 1 --2- 172.21.15.50:0/2356725866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aafdcbca00 0x55aafdccc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.398+0000 7f1231d9b640 1 -- 172.21.15.50:0/2356725866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aafdccc710 con 0x55aafdcbc010 2024-06-06T03:29:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.398+0000 7f1232d9d640 1 --2- 172.21.15.50:0/2356725866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aafdcbca00 0x55aafdccc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:29:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.398+0000 7f1231d9b640 1 --2- 172.21.15.50:0/2356725866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aafdcbc010 0x55aafdccb110 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f122402a910 tx=0x7f1224009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc8aed5a97a0fbe5 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.398+0000 7f1219ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:29:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.398+0000 7f1219ffb640 1 -- 172.21.15.50:0/2356725866 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1224035040 con 0x55aafdcbc010 2024-06-06T03:29:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.398+0000 7f123b59f740 1 -- 172.21.15.50:0/2356725866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f122809b280 con 0x55aafdcbc010 2024-06-06T03:29:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.398+0000 7f1219ffb640 1 -- 172.21.15.50:0/2356725866 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f1224004440 con 0x55aafdcbc010 2024-06-06T03:29:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.399+0000 7f1219ffb640 1 -- 172.21.15.50:0/2356725866 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f122403d9a0 con 0x55aafdcbc010 2024-06-06T03:29:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.399+0000 7f123b59f740 10 client.25439 fetch_fsmap learned FSMap version 29 2024-06-06T03:29:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.399+0000 7f123b59f740 1 -- 172.21.15.50:0/2356725866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55aafdccdb10 con 0x55aafdcbc010 2024-06-06T03:29:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.399+0000 7f1219ffb640 1 -- 172.21.15.50:0/2356725866 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f122809b280 con 0x55aafdcbc010 2024-06-06T03:29:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.399+0000 7f1219ffb640 1 -- 172.21.15.50:0/2356725866 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f1224049420 con 0x55aafdcbc010 2024-06-06T03:29:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.399+0000 7f123b59f740 10 client.25439 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:29:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.399+0000 7f123b59f740 10 client.25439 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:29:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.399+0000 7f123b59f740 20 client.25439 populate_metadata read hostname 'smithi050' 2024-06-06T03:29:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.399+0000 7f123b59f740 1 --2- 172.21.15.50:0/2356725866 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55aafdcc1b70 0x55aafdd3f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.399+0000 7f123b59f740 4 client.25439 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:29:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.399+0000 7f123b59f740 1 -- 172.21.15.50:0/2356725866 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55aafdc32f10 con 0x55aafdcc1b70 2024-06-06T03:29:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.400+0000 7f123259c640 1 --2- 172.21.15.50:0/2356725866 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55aafdcc1b70 0x55aafdd3f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.400+0000 7f123259c640 1 --2- 172.21.15.50:0/2356725866 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55aafdcc1b70 0x55aafdd3f070 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=735199821725a41c server_cookie=fe7980babc02be38 in_seq=0 out_seq=0 2024-06-06T03:29:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.400+0000 7f1219ffb640 10 client.25439 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.407+0000 7f1219ffb640 1 -- 172.21.15.50:0/2356725866 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55aafdc32f10 con 0x55aafdcc1b70 2024-06-06T03:29:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.407+0000 7f1219ffb640 10 client.25439 handle_command_reply: tid=0 2024-06-06T03:29:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.407+0000 7f123b59f740 1 client.25439 shutdown 2024-06-06T03:29:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.407+0000 7f123b59f740 1 -- 172.21.15.50:0/2356725866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aafdcbc010 msgr2=0x55aafdccb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.407+0000 7f123b59f740 1 --2- 172.21.15.50:0/2356725866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aafdcbc010 0x55aafdccb110 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f122402a910 tx=0x7f1224009260 comp rx=0 tx=0).stop 2024-06-06T03:29:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.407+0000 7f123b59f740 1 -- 172.21.15.50:0/2356725866 shutdown_connections 2024-06-06T03:29:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.407+0000 7f123b59f740 1 --2- 172.21.15.50:0/2356725866 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55aafdcc1b70 0x55aafdd3f070 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.407+0000 7f123b59f740 1 --2- 172.21.15.50:0/2356725866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aafdcbca00 0x55aafdccc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.407+0000 7f1219ffb640 0 client.25439 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.407+0000 7f123b59f740 1 --2- 172.21.15.50:0/2356725866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aafdcbc010 0x55aafdccb110 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.407+0000 7f123b59f740 1 --2- 172.21.15.50:0/2356725866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aafdcb7680 0x55aafdccabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.407+0000 7f123b59f740 1 -- 172.21.15.50:0/2356725866 >> 172.21.15.50:0/2356725866 conn(0x55aafdcbd600 msgr2=0x55aafdcc6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.408+0000 7f123b59f740 1 -- 172.21.15.50:0/2356725866 shutdown_connections 2024-06-06T03:29:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.408+0000 7f123b59f740 1 -- 172.21.15.50:0/2356725866 wait complete. 2024-06-06T03:29:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.408+0000 7f123b59f740 20 client.25439 trim_cache size 0 max 16384 2024-06-06T03:29:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:29:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:29:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:29:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.408+0000 7f1238893640 1 -- 172.21.15.50:0/612693197 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f121c0a2c30 msgr2=0x7f121c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.408+0000 7f1238893640 1 --2- 172.21.15.50:0/612693197 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f121c0a2c30 0x7f121c0a50f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1224006010 tx=0x7f1224005d70 comp rx=0 tx=0).stop 2024-06-06T03:29:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.408+0000 7f1238893640 1 -- 172.21.15.50:0/612693197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1234109be0 msgr2=0x7f12341a5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.408+0000 7f1238893640 1 --2- 172.21.15.50:0/612693197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1234109be0 0x7f12341a5740 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f122800e9b0 tx=0x7f122800ee70 comp rx=0 tx=0).stop 2024-06-06T03:29:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.408+0000 7f1238893640 1 -- 172.21.15.50:0/612693197 shutdown_connections 2024-06-06T03:29:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.408+0000 7f1238893640 1 --2- 172.21.15.50:0/612693197 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f121c0a2c30 0x7f121c0a50f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.408+0000 7f1238893640 1 --2- 172.21.15.50:0/612693197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1234109220 0x7f123419e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.408+0000 7f1238893640 1 --2- 172.21.15.50:0/612693197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1234109be0 0x7f12341a5740 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.408+0000 7f1238893640 1 --2- 172.21.15.50:0/612693197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1234108030 0x7f123419e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.408+0000 7f1238893640 1 -- 172.21.15.50:0/612693197 >> 172.21.15.50:0/612693197 conn(0x7f1234076ff0 msgr2=0x7f123410c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.409+0000 7f1238893640 1 -- 172.21.15.50:0/612693197 shutdown_connections 2024-06-06T03:29:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:02.409+0000 7f1238893640 1 -- 172.21.15.50:0/612693197 wait complete. 2024-06-06T03:29:03.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:03 smithi050 ceph-mon[32421]: pgmap v503: 129 pgs: 129 active+clean; 9.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 145 MiB/s wr, 80 op/s 2024-06-06T03:29:03.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:03 smithi079 ceph-mon[35478]: pgmap v503: 129 pgs: 129 active+clean; 9.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 145 MiB/s wr, 80 op/s 2024-06-06T03:29:03.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:03 smithi122 ceph-mon[35759]: pgmap v503: 129 pgs: 129 active+clean; 9.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 145 MiB/s wr, 80 op/s 2024-06-06T03:29:05.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:05 smithi050 ceph-mon[32421]: pgmap v504: 129 pgs: 129 active+clean; 9.4 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 155 MiB/s wr, 85 op/s 2024-06-06T03:29:05.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:05 smithi079 ceph-mon[35478]: pgmap v504: 129 pgs: 129 active+clean; 9.4 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 155 MiB/s wr, 85 op/s 2024-06-06T03:29:05.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:05 smithi122 ceph-mon[35759]: pgmap v504: 129 pgs: 129 active+clean; 9.4 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 155 MiB/s wr, 85 op/s 2024-06-06T03:29:07.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:07 smithi079 ceph-mon[35478]: pgmap v505: 129 pgs: 129 active+clean; 9.8 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 158 MiB/s wr, 89 op/s 2024-06-06T03:29:07.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:07 smithi122 ceph-mon[35759]: pgmap v505: 129 pgs: 129 active+clean; 9.8 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 158 MiB/s wr, 89 op/s 2024-06-06T03:29:07.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:07 smithi050 ceph-mon[32421]: pgmap v505: 129 pgs: 129 active+clean; 9.8 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 158 MiB/s wr, 89 op/s 2024-06-06T03:29:09.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:09 smithi079 ceph-mon[35478]: pgmap v506: 129 pgs: 129 active+clean; 9.9 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 133 MiB/s wr, 94 op/s 2024-06-06T03:29:09.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:09 smithi122 ceph-mon[35759]: pgmap v506: 129 pgs: 129 active+clean; 9.9 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 133 MiB/s wr, 94 op/s 2024-06-06T03:29:09.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:09 smithi050 ceph-mon[32421]: pgmap v506: 129 pgs: 129 active+clean; 9.9 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 133 MiB/s wr, 94 op/s 2024-06-06T03:29:11.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:11 smithi079 ceph-mon[35478]: pgmap v507: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 139 MiB/s wr, 248 op/s 2024-06-06T03:29:11.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:11 smithi122 ceph-mon[35759]: pgmap v507: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 139 MiB/s wr, 248 op/s 2024-06-06T03:29:11.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:11 smithi050 ceph-mon[32421]: pgmap v507: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 139 MiB/s wr, 248 op/s 2024-06-06T03:29:13.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:13 smithi079 ceph-mon[35478]: pgmap v508: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 MiB/s wr, 283 op/s 2024-06-06T03:29:13.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:13 smithi122 ceph-mon[35759]: pgmap v508: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 MiB/s wr, 283 op/s 2024-06-06T03:29:13.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:13 smithi050 ceph-mon[32421]: pgmap v508: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 MiB/s wr, 283 op/s 2024-06-06T03:29:15.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:15 smithi079 ceph-mon[35478]: pgmap v509: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 95 MiB/s wr, 394 op/s 2024-06-06T03:29:15.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:15 smithi122 ceph-mon[35759]: pgmap v509: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 95 MiB/s wr, 394 op/s 2024-06-06T03:29:15.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:15 smithi050 ceph-mon[32421]: pgmap v509: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 95 MiB/s wr, 394 op/s 2024-06-06T03:29:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.570+0000 7f445f7fe640 1 -- 172.21.15.50:0/1130805990 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4450030d20 con 0x7f44601089a0 2024-06-06T03:29:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.571+0000 7f4466f9e640 1 -- 172.21.15.50:0/1130805990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44601089a0 msgr2=0x7f446010add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.571+0000 7f4466f9e640 1 --2- 172.21.15.50:0/1130805990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44601089a0 0x7f446010add0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4450009be0 tx=0x7f445002a6c0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.571+0000 7f4466f9e640 1 -- 172.21.15.50:0/1130805990 shutdown_connections 2024-06-06T03:29:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.571+0000 7f4466f9e640 1 --2- 172.21.15.50:0/1130805990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f446010b310 0x7f446010d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.571+0000 7f4466f9e640 1 --2- 172.21.15.50:0/1130805990 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f446010dcc0 0x7f446010e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.571+0000 7f4466f9e640 1 --2- 172.21.15.50:0/1130805990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44601089a0 0x7f446010add0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.571+0000 7f4466f9e640 1 -- 172.21.15.50:0/1130805990 >> 172.21.15.50:0/1130805990 conn(0x7f446006ea10 msgr2=0x7f4460070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.572+0000 7f4466f9e640 1 -- 172.21.15.50:0/1130805990 shutdown_connections 2024-06-06T03:29:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.572+0000 7f4466f9e640 1 -- 172.21.15.50:0/1130805990 wait complete. 2024-06-06T03:29:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.573+0000 7f4466f9e640 1 Processor -- start 2024-06-06T03:29:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.573+0000 7f4466f9e640 1 -- start start 2024-06-06T03:29:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.573+0000 7f4466f9e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44601089a0 0x7f4460117ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.573+0000 7f4466f9e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f446010b310 0x7f4460118420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.573+0000 7f4466f9e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f446010dcc0 0x7f4460119460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.573+0000 7f4466f9e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4460110560 con 0x7f44601089a0 2024-06-06T03:29:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.573+0000 7f4466f9e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f44601103e0 con 0x7f446010b310 2024-06-06T03:29:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.573+0000 7f4466f9e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f44601106e0 con 0x7f446010dcc0 2024-06-06T03:29:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.573+0000 7f446553b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f446010dcc0 0x7f4460119460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.573+0000 7f445ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f446010b310 0x7f4460118420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.574+0000 7f446553b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f446010dcc0 0x7f4460119460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:50892/0 (socket says 172.21.15.50:50892) 2024-06-06T03:29:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.574+0000 7f446553b640 1 -- 172.21.15.50:0/2367310773 learned_addr learned my addr 172.21.15.50:0/2367310773 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.574+0000 7f4464d3a640 1 --2- 172.21.15.50:0/2367310773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44601089a0 0x7f4460117ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.574+0000 7f446553b640 1 -- 172.21.15.50:0/2367310773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f446010b310 msgr2=0x7f4460118420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.574+0000 7f446553b640 1 --2- 172.21.15.50:0/2367310773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f446010b310 0x7f4460118420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.574+0000 7f446553b640 1 -- 172.21.15.50:0/2367310773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44601089a0 msgr2=0x7f4460117ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.574+0000 7f446553b640 1 --2- 172.21.15.50:0/2367310773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44601089a0 0x7f4460117ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.574+0000 7f446553b640 1 -- 172.21.15.50:0/2367310773 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4460119ad0 con 0x7f446010dcc0 2024-06-06T03:29:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.574+0000 7f4464d3a640 1 --2- 172.21.15.50:0/2367310773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44601089a0 0x7f4460117ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:29:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.574+0000 7f446553b640 1 --2- 172.21.15.50:0/2367310773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f446010dcc0 0x7f4460119460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f445800e970 tx=0x7f445800ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.574+0000 7f445dffb640 1 -- 172.21.15.50:0/2367310773 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445800ccc0 con 0x7f446010dcc0 2024-06-06T03:29:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.575+0000 7f4466f9e640 1 -- 172.21.15.50:0/2367310773 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4460119dc0 con 0x7f446010dcc0 2024-06-06T03:29:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.575+0000 7f445dffb640 1 -- 172.21.15.50:0/2367310773 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f445800ce60 con 0x7f446010dcc0 2024-06-06T03:29:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.575+0000 7f445dffb640 1 -- 172.21.15.50:0/2367310773 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4458010430 con 0x7f446010dcc0 2024-06-06T03:29:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.575+0000 7f4466f9e640 1 -- 172.21.15.50:0/2367310773 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f446011a310 con 0x7f446010dcc0 2024-06-06T03:29:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.578+0000 7f445dffb640 1 -- 172.21.15.50:0/2367310773 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4458004f20 con 0x7f446010dcc0 2024-06-06T03:29:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.579+0000 7f4469d86740 1 Processor -- start 2024-06-06T03:29:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.579+0000 7f4469d86740 1 -- start start 2024-06-06T03:29:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.579+0000 7f4469d86740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5586eff92010 0x5586eff92430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.579+0000 7f4469d86740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586eff92a00 0x5586eff97500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.579+0000 7f4469d86740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586eff97b70 0x5586eff9a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.579+0000 7f4469d86740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5586efef54f0 con 0x5586eff92010 2024-06-06T03:29:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.579+0000 7f4469d86740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5586efe93870 con 0x5586eff92a00 2024-06-06T03:29:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.579+0000 7f4469d86740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5586efef14b0 con 0x5586eff97b70 2024-06-06T03:29:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.580+0000 7f445dffb640 1 --2- 172.21.15.50:0/2367310773 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f444c0a2d00 0x7f444c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.580+0000 7f445ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586eff97b70 0x5586eff9a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.580+0000 7f446553b640 1 --2- 172.21.15.50:0/2367310773 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f444c0a2d00 0x7f444c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.580+0000 7f445ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586eff97b70 0x5586eff9a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:50896/0 (socket says 172.21.15.50:50896) 2024-06-06T03:29:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.580+0000 7f445ffff640 1 -- 172.21.15.50:0/3294492170 learned_addr learned my addr 172.21.15.50:0/3294492170 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.580+0000 7f445ffff640 1 --2- 172.21.15.50:0/3294492170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5586eff92010 0x5586eff92430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.581+0000 7f445ffff640 1 -- 172.21.15.50:0/3294492170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586eff92a00 msgr2=0x5586eff97500 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:29:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.581+0000 7f445ffff640 1 --2- 172.21.15.50:0/3294492170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586eff92a00 0x5586eff97500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.581+0000 7f445ffff640 1 -- 172.21.15.50:0/3294492170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5586eff92010 msgr2=0x5586eff92430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.581+0000 7f445ffff640 1 --2- 172.21.15.50:0/3294492170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5586eff92010 0x5586eff92430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.581+0000 7f445ffff640 1 -- 172.21.15.50:0/3294492170 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586efeaf9b0 con 0x5586eff97b70 2024-06-06T03:29:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.581+0000 7f445ffff640 1 --2- 172.21.15.50:0/3294492170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586eff97b70 0x5586eff9a000 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f44480117e0 tx=0x7f44480046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=933ed3e0369782fa server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.581+0000 7f445dffb640 1 -- 172.21.15.50:0/2367310773 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f44580cf760 con 0x7f446010dcc0 2024-06-06T03:29:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.581+0000 7f446553b640 1 --2- 172.21.15.50:0/2367310773 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f444c0a2d00 0x7f444c0a51c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f445809b8e0 tx=0x7f4458023000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.581+0000 7f4456ffd640 1 -- 172.21.15.50:0/3294492170 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4448004030 con 0x5586eff97b70 2024-06-06T03:29:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.581+0000 7f4456ffd640 1 -- 172.21.15.50:0/3294492170 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4448005020 con 0x5586eff97b70 2024-06-06T03:29:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.581+0000 7f4456ffd640 1 -- 172.21.15.50:0/3294492170 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4448004a00 con 0x5586eff97b70 2024-06-06T03:29:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.582+0000 7f4469d86740 1 -- 172.21.15.50:0/3294492170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586eff97b70 msgr2=0x5586eff9a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.582+0000 7f4469d86740 1 --2- 172.21.15.50:0/3294492170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586eff97b70 0x5586eff9a000 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f44480117e0 tx=0x7f44480046c0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.583+0000 7f4469d86740 1 -- 172.21.15.50:0/3294492170 shutdown_connections 2024-06-06T03:29:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.583+0000 7f4469d86740 1 --2- 172.21.15.50:0/3294492170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586eff97b70 0x5586eff9a000 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.584+0000 7f4469d86740 1 --2- 172.21.15.50:0/3294492170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586eff92a00 0x5586eff97500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.584+0000 7f4469d86740 1 --2- 172.21.15.50:0/3294492170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5586eff92010 0x5586eff92430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.584+0000 7f4469d86740 1 -- 172.21.15.50:0/3294492170 >> 172.21.15.50:0/3294492170 conn(0x5586eff8d680 msgr2=0x5586eff8da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.584+0000 7f4469d86740 1 -- 172.21.15.50:0/3294492170 shutdown_connections 2024-06-06T03:29:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.584+0000 7f4469d86740 1 -- 172.21.15.50:0/3294492170 wait complete. 2024-06-06T03:29:15.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.584+0000 7f4469d86740 1 -- start start 2024-06-06T03:29:15.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.585+0000 7f4469d86740 1 Processor -- start 2024-06-06T03:29:15.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.585+0000 7f4469d86740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586eff92010 0x5586eff9c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:15.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.585+0000 7f4469d86740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586eff92a00 0x5586eff9c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:15.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.585+0000 7f4469d86740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5586eff97b70 0x5586effa38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:15.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.585+0000 7f4469d86740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5586eff9ab20 con 0x5586eff97b70 2024-06-06T03:29:15.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.585+0000 7f4469d86740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5586efe7eae0 con 0x5586eff92a00 2024-06-06T03:29:15.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.585+0000 7f4469d86740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5586eff9aca0 con 0x5586eff92010 2024-06-06T03:29:15.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.585+0000 7f4469d86740 10 client.0 _ll_register_callbacks cb 0x5586efeb79b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:29:15.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.586+0000 7f445ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586eff92010 0x5586eff9c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:15.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.586+0000 7f445ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586eff92010 0x5586eff9c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:50900/0 (socket says 172.21.15.50:50900) 2024-06-06T03:29:15.586 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.586+0000 7f4464d3a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586eff92a00 0x5586eff9c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:15.586 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.586+0000 7f445ffff640 1 -- 172.21.15.50:0/3204430058 learned_addr learned my addr 172.21.15.50:0/3204430058 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:15.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.587+0000 7f445ffff640 1 --2- 172.21.15.50:0/3204430058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5586eff97b70 0x5586effa38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:15.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.587+0000 7f445ffff640 1 -- 172.21.15.50:0/3204430058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586eff92a00 msgr2=0x5586eff9c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:15.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.587+0000 7f445ffff640 1 --2- 172.21.15.50:0/3204430058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586eff92a00 0x5586eff9c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.587+0000 7f445ffff640 1 -- 172.21.15.50:0/3204430058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5586eff97b70 msgr2=0x5586effa38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:15.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.587+0000 7f445ffff640 1 --2- 172.21.15.50:0/3204430058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5586eff97b70 0x5586effa38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.587+0000 7f445ffff640 1 -- 172.21.15.50:0/3204430058 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586efc09210 con 0x5586eff92010 2024-06-06T03:29:15.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.588+0000 7f443ffff640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:29:15.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.588+0000 7f445ffff640 1 --2- 172.21.15.50:0/3204430058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586eff92010 0x5586eff9c320 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4448004a90 tx=0x7f4448005730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=911b53146d6be1d0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:15.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.588+0000 7f443ffff640 1 -- 172.21.15.50:0/3204430058 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4448024060 con 0x5586eff92010 2024-06-06T03:29:15.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.588+0000 7f4469d86740 1 -- 172.21.15.50:0/3204430058 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4448005020 con 0x5586eff92010 2024-06-06T03:29:15.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.588+0000 7f443ffff640 1 -- 172.21.15.50:0/3204430058 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f4448028070 con 0x5586eff92010 2024-06-06T03:29:15.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.589+0000 7f443ffff640 1 -- 172.21.15.50:0/3204430058 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4448024060 con 0x5586eff92010 2024-06-06T03:29:15.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.589+0000 7f4469d86740 10 client.25447 fetch_fsmap learned FSMap version 29 2024-06-06T03:29:15.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.589+0000 7f4469d86740 1 -- 172.21.15.50:0/3204430058 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5586efcd5620 con 0x5586eff92010 2024-06-06T03:29:15.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.589+0000 7f443ffff640 1 -- 172.21.15.50:0/3204430058 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4448005020 con 0x5586eff92010 2024-06-06T03:29:15.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.590+0000 7f443ffff640 1 -- 172.21.15.50:0/3204430058 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f444800fab0 con 0x5586eff92010 2024-06-06T03:29:15.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.590+0000 7f4469d86740 10 client.25447 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:29:15.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.590+0000 7f4469d86740 10 client.25447 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:29:15.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.590+0000 7f4469d86740 20 client.25447 populate_metadata read hostname 'smithi050' 2024-06-06T03:29:15.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.590+0000 7f4469d86740 1 --2- 172.21.15.50:0/3204430058 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5586effa7e50 0x5586effaa240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:15.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.590+0000 7f4469d86740 4 client.25447 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:29:15.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.590+0000 7f4469d86740 1 -- 172.21.15.50:0/3204430058 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586eff08f10 con 0x5586effa7e50 2024-06-06T03:29:15.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.590+0000 7f4464d3a640 1 --2- 172.21.15.50:0/3204430058 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5586effa7e50 0x5586effaa240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:15.590 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.591+0000 7f443ffff640 10 client.25447 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:15.590 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.591+0000 7f4464d3a640 1 --2- 172.21.15.50:0/3204430058 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5586effa7e50 0x5586effaa240 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91f318069592a6a1 server_cookie=9163431252063b86 in_seq=0 out_seq=0 2024-06-06T03:29:15.591 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.592+0000 7f443ffff640 1 -- 172.21.15.50:0/3204430058 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5586eff08f10 con 0x5586effa7e50 2024-06-06T03:29:15.591 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.592+0000 7f443ffff640 10 client.25447 handle_command_reply: tid=0 2024-06-06T03:29:15.591 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.592+0000 7f4469d86740 1 client.25447 shutdown 2024-06-06T03:29:15.592 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.593+0000 7f4469d86740 1 -- 172.21.15.50:0/3204430058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586eff92010 msgr2=0x5586eff9c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:15.592 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.593+0000 7f4469d86740 1 --2- 172.21.15.50:0/3204430058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586eff92010 0x5586eff9c320 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4448004a90 tx=0x7f4448005730 comp rx=0 tx=0).stop 2024-06-06T03:29:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.593+0000 7f4469d86740 1 -- 172.21.15.50:0/3204430058 shutdown_connections 2024-06-06T03:29:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.593+0000 7f4469d86740 1 --2- 172.21.15.50:0/3204430058 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5586effa7e50 0x5586effaa240 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.593+0000 7f443ffff640 0 client.25447 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.593+0000 7f4469d86740 1 --2- 172.21.15.50:0/3204430058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5586eff97b70 0x5586effa38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.593+0000 7f4469d86740 1 --2- 172.21.15.50:0/3204430058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586eff92a00 0x5586eff9c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.593+0000 7f4469d86740 1 --2- 172.21.15.50:0/3204430058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586eff92010 0x5586eff9c320 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.593+0000 7f4469d86740 1 -- 172.21.15.50:0/3204430058 >> 172.21.15.50:0/3204430058 conn(0x5586eff8d680 msgr2=0x5586eff8c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.593+0000 7f4469d86740 1 -- 172.21.15.50:0/3204430058 shutdown_connections 2024-06-06T03:29:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.593+0000 7f4469d86740 1 -- 172.21.15.50:0/3204430058 wait complete. 2024-06-06T03:29:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.594+0000 7f4469d86740 20 client.25447 trim_cache size 0 max 16384 2024-06-06T03:29:15.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.625+0000 7f4469d86740 1 Processor -- start 2024-06-06T03:29:15.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.625+0000 7f4469d86740 1 -- start start 2024-06-06T03:29:15.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.625+0000 7f4469d86740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5586eff92010 0x5586eff90670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:15.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.626+0000 7f4469d86740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586eff92a00 0x5586effa3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:15.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.626+0000 7f4469d86740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586eff97b70 0x5586eff90bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:15.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.626+0000 7f4469d86740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f44601c4620 con 0x5586eff92010 2024-06-06T03:29:15.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.626+0000 7f4464d3a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586eff92a00 0x5586effa3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:15.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.626+0000 7f4469d86740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f44601c1ef0 con 0x5586eff97b70 2024-06-06T03:29:15.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.626+0000 7f4469d86740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f44601bfce0 con 0x5586eff92a00 2024-06-06T03:29:15.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.626+0000 7f4464d3a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586eff92a00 0x5586effa3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:50904/0 (socket says 172.21.15.50:50904) 2024-06-06T03:29:15.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.626+0000 7f445ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586eff97b70 0x5586eff90bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:15.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.626+0000 7f445ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586eff97b70 0x5586eff90bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:52662/0 (socket says 172.21.15.50:52662) 2024-06-06T03:29:15.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.626+0000 7f445ffff640 1 -- 172.21.15.50:0/3015319851 learned_addr learned my addr 172.21.15.50:0/3015319851 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:15.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.626+0000 7f445ffff640 1 --2- 172.21.15.50:0/3015319851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5586eff92010 0x5586eff90670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:15.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.627+0000 7f445ffff640 1 -- 172.21.15.50:0/3015319851 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586eff92a00 msgr2=0x5586effa3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:15.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.627+0000 7f445ffff640 1 --2- 172.21.15.50:0/3015319851 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586eff92a00 0x5586effa3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.627+0000 7f445ffff640 1 -- 172.21.15.50:0/3015319851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5586eff92010 msgr2=0x5586eff90670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:15.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.627+0000 7f445ffff640 1 --2- 172.21.15.50:0/3015319851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5586eff92010 0x5586eff90670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.627+0000 7f445ffff640 1 -- 172.21.15.50:0/3015319851 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586eff8d4b0 con 0x5586eff97b70 2024-06-06T03:29:15.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.627+0000 7f445ffff640 1 --2- 172.21.15.50:0/3015319851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586eff97b70 0x5586eff90bb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4448004950 tx=0x7f4448001e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f1544cede5d38f7 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:15.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.627+0000 7f44567fc640 1 -- 172.21.15.50:0/3015319851 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4448032070 con 0x5586eff97b70 2024-06-06T03:29:15.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.628+0000 7f44567fc640 1 -- 172.21.15.50:0/3015319851 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f444800fc40 con 0x5586eff97b70 2024-06-06T03:29:15.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.628+0000 7f44567fc640 1 -- 172.21.15.50:0/3015319851 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4448024060 con 0x5586eff97b70 2024-06-06T03:29:15.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.629+0000 7f4469d86740 1 -- 172.21.15.50:0/3015319851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586eff97b70 msgr2=0x5586eff90bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:15.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.629+0000 7f4469d86740 1 --2- 172.21.15.50:0/3015319851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586eff97b70 0x5586eff90bb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4448004950 tx=0x7f4448001e50 comp rx=0 tx=0).stop 2024-06-06T03:29:15.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.629+0000 7f4469d86740 1 -- 172.21.15.50:0/3015319851 shutdown_connections 2024-06-06T03:29:15.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.629+0000 7f4469d86740 1 --2- 172.21.15.50:0/3015319851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586eff97b70 0x5586eff90bb0 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4448004950 tx=0x7f4448001e50 comp rx=0 tx=0).stop 2024-06-06T03:29:15.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.629+0000 7f4469d86740 1 --2- 172.21.15.50:0/3015319851 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586eff92a00 0x5586effa3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.629+0000 7f4469d86740 1 --2- 172.21.15.50:0/3015319851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5586eff92010 0x5586eff90670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.629+0000 7f4469d86740 1 -- 172.21.15.50:0/3015319851 >> 172.21.15.50:0/3015319851 conn(0x5586eff8d680 msgr2=0x5586eff8da60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:15.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.629+0000 7f4469d86740 1 -- 172.21.15.50:0/3015319851 shutdown_connections 2024-06-06T03:29:15.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.629+0000 7f4469d86740 1 -- 172.21.15.50:0/3015319851 wait complete. 2024-06-06T03:29:15.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.629+0000 7f4469d86740 1 -- start start 2024-06-06T03:29:15.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.630+0000 7f4469d86740 1 Processor -- start 2024-06-06T03:29:15.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.630+0000 7f4469d86740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5586eff92010 0x5586effa0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.630+0000 7f4469d86740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586eff92a00 0x5586effa13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.630+0000 7f4469d86740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586effa7e50 0x5586effa2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.630+0000 7f4469d86740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f44601c03b0 con 0x5586eff92010 2024-06-06T03:29:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.630+0000 7f4469d86740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f44601c1820 con 0x5586eff92a00 2024-06-06T03:29:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.630+0000 7f4469d86740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f44601c0a80 con 0x5586effa7e50 2024-06-06T03:29:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.631+0000 7f4469d86740 10 client.0 _ll_register_callbacks cb 0x7f4448009e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:29:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.631+0000 7f445ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586effa7e50 0x5586effa2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.631+0000 7f445ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586effa7e50 0x5586effa2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:50914/0 (socket says 172.21.15.50:50914) 2024-06-06T03:29:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.631+0000 7f445ffff640 1 -- 172.21.15.50:0/577927836 learned_addr learned my addr 172.21.15.50:0/577927836 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:15.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.631+0000 7f4464d3a640 1 --2- 172.21.15.50:0/577927836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586eff92a00 0x5586effa13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:15.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.631+0000 7f445ffff640 1 -- 172.21.15.50:0/577927836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586eff92a00 msgr2=0x5586effa13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:15.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.631+0000 7f445ffff640 1 --2- 172.21.15.50:0/577927836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586eff92a00 0x5586effa13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.631+0000 7f445ffff640 1 -- 172.21.15.50:0/577927836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5586eff92010 msgr2=0x5586effa0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:15.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.631+0000 7f445ffff640 1 --2- 172.21.15.50:0/577927836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5586eff92010 0x5586effa0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.631+0000 7f445ffff640 1 -- 172.21.15.50:0/577927836 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586effa2960 con 0x5586effa7e50 2024-06-06T03:29:15.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.631+0000 7f445ffff640 1 --2- 172.21.15.50:0/577927836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586effa7e50 0x5586effa2370 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4448039000 tx=0x7f4448005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c070e13363e6a8a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:15.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.631+0000 7f443ffff640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:29:15.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.632+0000 7f443ffff640 1 -- 172.21.15.50:0/577927836 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4448024030 con 0x5586effa7e50 2024-06-06T03:29:15.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.632+0000 7f443ffff640 1 -- 172.21.15.50:0/577927836 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f444801f640 con 0x5586effa7e50 2024-06-06T03:29:15.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.632+0000 7f4469d86740 1 -- 172.21.15.50:0/577927836 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f444800fc40 con 0x5586effa7e50 2024-06-06T03:29:15.634 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.633+0000 7f443ffff640 1 -- 172.21.15.50:0/577927836 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4448032070 con 0x5586effa7e50 2024-06-06T03:29:15.634 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.633+0000 7f4469d86740 10 client.25453 fetch_fsmap learned FSMap version 29 2024-06-06T03:29:15.634 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.633+0000 7f4469d86740 1 -- 172.21.15.50:0/577927836 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5586f0012ac0 con 0x5586effa7e50 2024-06-06T03:29:15.634 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.633+0000 7f443ffff640 1 -- 172.21.15.50:0/577927836 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4448042070 con 0x5586effa7e50 2024-06-06T03:29:15.634 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.633+0000 7f443ffff640 1 -- 172.21.15.50:0/577927836 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f4448047450 con 0x5586effa7e50 2024-06-06T03:29:15.634 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.633+0000 7f4469d86740 10 client.25453 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:29:15.634 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.633+0000 7f4469d86740 10 client.25453 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:29:15.634 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.633+0000 7f4469d86740 20 client.25453 populate_metadata read hostname 'smithi050' 2024-06-06T03:29:15.634 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.634+0000 7f4469d86740 1 --2- 172.21.15.50:0/577927836 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5586f0013400 0x5586f0015820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:15.635 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.634+0000 7f4469d86740 4 client.25453 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:29:15.635 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.634+0000 7f4469d86740 1 -- 172.21.15.50:0/577927836 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f444800fc40 con 0x5586f0013400 2024-06-06T03:29:15.635 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.634+0000 7f4464d3a640 1 --2- 172.21.15.50:0/577927836 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5586f0013400 0x5586f0015820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:15.635 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.634+0000 7f443ffff640 10 client.25453 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:15.635 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.634+0000 7f4464d3a640 1 --2- 172.21.15.50:0/577927836 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5586f0013400 0x5586f0015820 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=875167b6459c72f4 server_cookie=90cbb8309a266f96 in_seq=0 out_seq=0 2024-06-06T03:29:15.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.643+0000 7f443ffff640 1 -- 172.21.15.50:0/577927836 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x7f444800fc40 con 0x5586f0013400 2024-06-06T03:29:15.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.643+0000 7f443ffff640 10 client.25453 handle_command_reply: tid=0 2024-06-06T03:29:15.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.643+0000 7f4469d86740 1 client.25453 shutdown 2024-06-06T03:29:15.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.643+0000 7f4469d86740 1 -- 172.21.15.50:0/577927836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586effa7e50 msgr2=0x5586effa2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:15.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.643+0000 7f4469d86740 1 --2- 172.21.15.50:0/577927836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586effa7e50 0x5586effa2370 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4448039000 tx=0x7f4448005fd0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.643+0000 7f4469d86740 1 -- 172.21.15.50:0/577927836 shutdown_connections 2024-06-06T03:29:15.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.643+0000 7f4469d86740 1 --2- 172.21.15.50:0/577927836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586effa7e50 0x5586effa2370 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.643+0000 7f4469d86740 1 --2- 172.21.15.50:0/577927836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586eff92a00 0x5586effa13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.643+0000 7f4469d86740 1 --2- 172.21.15.50:0/577927836 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5586f0013400 0x5586f0015820 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.643+0000 7f4469d86740 1 --2- 172.21.15.50:0/577927836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5586eff92010 0x5586effa0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.643+0000 7f443ffff640 0 client.25453 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:15.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.643+0000 7f4469d86740 1 -- 172.21.15.50:0/577927836 >> 172.21.15.50:0/577927836 conn(0x5586eff8d680 msgr2=0x5586eff8da60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:15.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.643+0000 7f4469d86740 1 -- 172.21.15.50:0/577927836 shutdown_connections 2024-06-06T03:29:15.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.643+0000 7f4469d86740 1 -- 172.21.15.50:0/577927836 wait complete. 2024-06-06T03:29:15.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.643+0000 7f4469d86740 20 client.25453 trim_cache size 0 max 16384 2024-06-06T03:29:15.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:29:15.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:29:15.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:29:15.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.644+0000 7f4466f9e640 1 -- 172.21.15.50:0/2367310773 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f444c0a2d00 msgr2=0x7f444c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:15.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.644+0000 7f4466f9e640 1 --2- 172.21.15.50:0/2367310773 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f444c0a2d00 0x7f444c0a51c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f445809b8e0 tx=0x7f4458023000 comp rx=0 tx=0).stop 2024-06-06T03:29:15.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.644+0000 7f4466f9e640 1 -- 172.21.15.50:0/2367310773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f446010dcc0 msgr2=0x7f4460119460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:15.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.644+0000 7f4466f9e640 1 --2- 172.21.15.50:0/2367310773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f446010dcc0 0x7f4460119460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f445800e970 tx=0x7f445800ed70 comp rx=0 tx=0).stop 2024-06-06T03:29:15.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.644+0000 7f4466f9e640 1 -- 172.21.15.50:0/2367310773 shutdown_connections 2024-06-06T03:29:15.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.644+0000 7f4466f9e640 1 --2- 172.21.15.50:0/2367310773 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f444c0a2d00 0x7f444c0a51c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.644+0000 7f4466f9e640 1 --2- 172.21.15.50:0/2367310773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f446010dcc0 0x7f4460119460 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.644+0000 7f4466f9e640 1 --2- 172.21.15.50:0/2367310773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f446010b310 0x7f4460118420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.646 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.644+0000 7f4466f9e640 1 --2- 172.21.15.50:0/2367310773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44601089a0 0x7f4460117ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:15.646 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.644+0000 7f4466f9e640 1 -- 172.21.15.50:0/2367310773 >> 172.21.15.50:0/2367310773 conn(0x7f446006ea10 msgr2=0x7f4460109100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:15.646 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.645+0000 7f4466f9e640 1 -- 172.21.15.50:0/2367310773 shutdown_connections 2024-06-06T03:29:15.646 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:15.645+0000 7f4466f9e640 1 -- 172.21.15.50:0/2367310773 wait complete. 2024-06-06T03:29:17.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.035+0000 7fad6a613700 1 -- 172.21.15.50:0/2577329056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad641084f0 msgr2=0x7fad641088d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:17.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.035+0000 7fad6a613700 1 --2- 172.21.15.50:0/2577329056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad641084f0 0x7fad641088d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fad4c009990 tx=0x7fad4c009ca0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.036+0000 7fad6a613700 1 -- 172.21.15.50:0/2577329056 shutdown_connections 2024-06-06T03:29:17.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.036+0000 7fad6a613700 1 --2- 172.21.15.50:0/2577329056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad64102f10 0x7fad6410f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.036+0000 7fad6a613700 1 --2- 172.21.15.50:0/2577329056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad641084f0 0x7fad641088d0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.036+0000 7fad6a613700 1 --2- 172.21.15.50:0/2577329056 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad64102550 0x7fad641029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.036+0000 7fad6a613700 1 -- 172.21.15.50:0/2577329056 >> 172.21.15.50:0/2577329056 conn(0x7fad64079650 msgr2=0x7fad64079a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:17.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.037+0000 7fad6a613700 1 -- 172.21.15.50:0/2577329056 shutdown_connections 2024-06-06T03:29:17.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.037+0000 7fad6a613700 1 -- 172.21.15.50:0/2577329056 wait complete. 2024-06-06T03:29:17.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.038+0000 7fad6a613700 1 Processor -- start 2024-06-06T03:29:17.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.038+0000 7fad6a613700 1 -- start start 2024-06-06T03:29:17.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.038+0000 7fad6a613700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad64102550 0x7fad641ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:17.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.039+0000 7fad6a613700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad64102f10 0x7fad641ad920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:17.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.039+0000 7fad6a613700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad641084f0 0x7fad641a7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:17.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.039+0000 7fad5bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad64102f10 0x7fad641ad920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:17.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.039+0000 7fad5bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad64102f10 0x7fad641ad920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:50924/0 (socket says 172.21.15.50:50924) 2024-06-06T03:29:17.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.039+0000 7fad63fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad64102550 0x7fad641ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:17.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.039+0000 7fad63fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad64102550 0x7fad641ad3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:52684/0 (socket says 172.21.15.50:52684) 2024-06-06T03:29:17.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.039+0000 7fad63fff700 1 -- 172.21.15.50:0/2873039613 learned_addr learned my addr 172.21.15.50:0/2873039613 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:17.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.039+0000 7fad6a613700 1 -- 172.21.15.50:0/2873039613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fad6406c7b0 con 0x7fad641084f0 2024-06-06T03:29:17.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.039+0000 7fad6a613700 1 -- 172.21.15.50:0/2873039613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fad6406c630 con 0x7fad64102550 2024-06-06T03:29:17.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.039+0000 7fad6a613700 1 -- 172.21.15.50:0/2873039613 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fad6406c930 con 0x7fad64102f10 2024-06-06T03:29:17.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.039+0000 7fad68bb0700 1 --2- 172.21.15.50:0/2873039613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad641084f0 0x7fad641a7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:17.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.040+0000 7fad68bb0700 1 -- 172.21.15.50:0/2873039613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad64102f10 msgr2=0x7fad641ad920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:17.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.040+0000 7fad68bb0700 1 --2- 172.21.15.50:0/2873039613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad64102f10 0x7fad641ad920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.040+0000 7fad68bb0700 1 -- 172.21.15.50:0/2873039613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad64102550 msgr2=0x7fad641ad3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:17.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.040+0000 7fad68bb0700 1 --2- 172.21.15.50:0/2873039613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad64102550 0x7fad641ad3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.040+0000 7fad68bb0700 1 -- 172.21.15.50:0/2873039613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad641a8220 con 0x7fad641084f0 2024-06-06T03:29:17.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.041+0000 7fad68bb0700 1 --2- 172.21.15.50:0/2873039613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad641084f0 0x7fad641a7ac0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fad5c00efc0 tx=0x7fad5c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:17.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.041+0000 7fad5bfff700 1 --2- 172.21.15.50:0/2873039613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad64102f10 0x7fad641ad920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:29:17.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.041+0000 7fad63fff700 1 --2- 172.21.15.50:0/2873039613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad64102550 0x7fad641ad3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:29:17.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.042+0000 7fad61ffb700 1 -- 172.21.15.50:0/2873039613 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5c0092e0 con 0x7fad641084f0 2024-06-06T03:29:17.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.042+0000 7fad61ffb700 1 -- 172.21.15.50:0/2873039613 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fad5c004bb0 con 0x7fad641084f0 2024-06-06T03:29:17.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.042+0000 7fad61ffb700 1 -- 172.21.15.50:0/2873039613 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5c004280 con 0x7fad641084f0 2024-06-06T03:29:17.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.042+0000 7fad6a613700 1 -- 172.21.15.50:0/2873039613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad641a84b0 con 0x7fad641084f0 2024-06-06T03:29:17.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.042+0000 7fad6a613700 1 -- 172.21.15.50:0/2873039613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad641a88e0 con 0x7fad641084f0 2024-06-06T03:29:17.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.048+0000 7fad61ffb700 1 -- 172.21.15.50:0/2873039613 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fad5c01b030 con 0x7fad641084f0 2024-06-06T03:29:17.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.048+0000 7fad74e96b80 1 Processor -- start 2024-06-06T03:29:17.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.049+0000 7fad74e96b80 1 -- start start 2024-06-06T03:29:17.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.049+0000 7fad74e96b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559588568640 0x559588568a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:17.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.050+0000 7fad74e96b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559588568f60 0x5595885629e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:17.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.050+0000 7fad74e96b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559588562f20 0x559588563340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:17.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.050+0000 7fad74e96b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5595884b4810 con 0x559588568f60 2024-06-06T03:29:17.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.050+0000 7fad74e96b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55958845c720 con 0x559588568640 2024-06-06T03:29:17.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.050+0000 7fad74e96b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5595884b07d0 con 0x559588562f20 2024-06-06T03:29:17.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.051+0000 7fad61ffb700 1 --2- 172.21.15.50:0/2873039613 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fad500a2e20 0x7fad500a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:17.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.051+0000 7fad68bb0700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559588562f20 0x559588563340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:17.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.051+0000 7fad63fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559588568640 0x559588568a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:17.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.051+0000 7fad63fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559588568640 0x559588568a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:52696/0 (socket says 172.21.15.50:52696) 2024-06-06T03:29:17.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.051+0000 7fad63fff700 1 -- 172.21.15.50:0/636021429 learned_addr learned my addr 172.21.15.50:0/636021429 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:17.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.051+0000 7fad5bfff700 1 --2- 172.21.15.50:0/2873039613 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fad500a2e20 0x7fad500a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:17.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.051+0000 7fad61ffb700 1 -- 172.21.15.50:0/2873039613 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fad5c0cedc0 con 0x7fad641084f0 2024-06-06T03:29:17.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.051+0000 7fad5bfff700 1 --2- 172.21.15.50:0/636021429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559588568f60 0x5595885629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:17.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.052+0000 7fad63fff700 1 -- 172.21.15.50:0/636021429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559588562f20 msgr2=0x559588563340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:17.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.052+0000 7fad63fff700 1 --2- 172.21.15.50:0/636021429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559588562f20 0x559588563340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.052+0000 7fad63fff700 1 -- 172.21.15.50:0/636021429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559588568f60 msgr2=0x5595885629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:17.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.052+0000 7fad63fff700 1 --2- 172.21.15.50:0/636021429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559588568f60 0x5595885629e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.052+0000 7fad63fff700 1 -- 172.21.15.50:0/636021429 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559588452f50 con 0x559588568640 2024-06-06T03:29:17.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.052+0000 7fad63fff700 1 --2- 172.21.15.50:0/636021429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559588568640 0x559588568a20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fad4c0092e0 tx=0x7fad4c009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=256fa12971bd7c32 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:17.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.052+0000 7fad5bfff700 1 --2- 172.21.15.50:0/2873039613 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fad500a2e20 0x7fad500a52e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fad54005d90 tx=0x7fad54013900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:17.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.053+0000 7fad5a7fc700 1 -- 172.21.15.50:0/636021429 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4c026070 con 0x559588568640 2024-06-06T03:29:17.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.053+0000 7fad5a7fc700 1 -- 172.21.15.50:0/636021429 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fad4c005670 con 0x559588568640 2024-06-06T03:29:17.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.054+0000 7fad5a7fc700 1 -- 172.21.15.50:0/636021429 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4c003d30 con 0x559588568640 2024-06-06T03:29:17.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.055+0000 7fad74e96b80 1 -- 172.21.15.50:0/636021429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559588568640 msgr2=0x559588568a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:17.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.055+0000 7fad74e96b80 1 --2- 172.21.15.50:0/636021429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559588568640 0x559588568a20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fad4c0092e0 tx=0x7fad4c009310 comp rx=0 tx=0).stop 2024-06-06T03:29:17.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.055+0000 7fad74e96b80 1 -- 172.21.15.50:0/636021429 shutdown_connections 2024-06-06T03:29:17.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.055+0000 7fad74e96b80 1 --2- 172.21.15.50:0/636021429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559588562f20 0x559588563340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.055+0000 7fad74e96b80 1 --2- 172.21.15.50:0/636021429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559588568640 0x559588568a20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.055+0000 7fad74e96b80 1 --2- 172.21.15.50:0/636021429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559588568f60 0x5595885629e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.055+0000 7fad74e96b80 1 -- 172.21.15.50:0/636021429 >> 172.21.15.50:0/636021429 conn(0x55958848dcc0 msgr2=0x55958855d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:17.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.055+0000 7fad74e96b80 1 -- 172.21.15.50:0/636021429 shutdown_connections 2024-06-06T03:29:17.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.055+0000 7fad74e96b80 1 -- 172.21.15.50:0/636021429 wait complete. 2024-06-06T03:29:17.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.056+0000 7fad74e96b80 1 -- start start 2024-06-06T03:29:17.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.056+0000 7fad74e96b80 1 Processor -- start 2024-06-06T03:29:17.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.057+0000 7fad74e96b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559588562f20 0x55958856ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:17.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.057+0000 7fad74e96b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559588568640 0x55958856bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:17.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.057+0000 7fad74e96b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559588568f60 0x55958856c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:17.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.057+0000 7fad74e96b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55958856fa10 con 0x559588562f20 2024-06-06T03:29:17.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.057+0000 7fad74e96b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559588454bf0 con 0x559588568f60 2024-06-06T03:29:17.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.057+0000 7fad74e96b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55958856fb90 con 0x559588568640 2024-06-06T03:29:17.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.057+0000 7fad74e96b80 10 client.0 _ll_register_callbacks cb 0x55958844e920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:29:17.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.057+0000 7fad5bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559588568640 0x55958856bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:17.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.057+0000 7fad5bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559588568640 0x55958856bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:50942/0 (socket says 172.21.15.50:50942) 2024-06-06T03:29:17.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.057+0000 7fad5bfff700 1 -- 172.21.15.50:0/486270254 learned_addr learned my addr 172.21.15.50:0/486270254 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:17.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.057+0000 7fad63fff700 1 --2- 172.21.15.50:0/486270254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559588562f20 0x55958856ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:17.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.057+0000 7fad68bb0700 1 --2- 172.21.15.50:0/486270254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559588568f60 0x55958856c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:17.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.057+0000 7fad5bfff700 1 -- 172.21.15.50:0/486270254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559588568f60 msgr2=0x55958856c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:17.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.057+0000 7fad5bfff700 1 --2- 172.21.15.50:0/486270254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559588568f60 0x55958856c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.057+0000 7fad5bfff700 1 -- 172.21.15.50:0/486270254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559588562f20 msgr2=0x55958856ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:17.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.057+0000 7fad5bfff700 1 --2- 172.21.15.50:0/486270254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559588562f20 0x55958856ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.058+0000 7fad5bfff700 1 -- 172.21.15.50:0/486270254 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595884038d0 con 0x559588568640 2024-06-06T03:29:17.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.058+0000 7fad5bfff700 1 --2- 172.21.15.50:0/486270254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559588568640 0x55958856bf50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fad5400f920 tx=0x7fad54009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a0dae064802603a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:17.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.058+0000 7fad437fe700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:29:17.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.058+0000 7fad437fe700 1 -- 172.21.15.50:0/486270254 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad54004230 con 0x559588568640 2024-06-06T03:29:17.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.058+0000 7fad74e96b80 1 -- 172.21.15.50:0/486270254 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad4c005670 con 0x559588568640 2024-06-06T03:29:17.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.058+0000 7fad437fe700 1 -- 172.21.15.50:0/486270254 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fad540043d0 con 0x559588568640 2024-06-06T03:29:17.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.059+0000 7fad437fe700 1 -- 172.21.15.50:0/486270254 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fad54030050 con 0x559588568640 2024-06-06T03:29:17.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.059+0000 7fad74e96b80 10 client.25462 fetch_fsmap learned FSMap version 29 2024-06-06T03:29:17.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.059+0000 7fad74e96b80 1 -- 172.21.15.50:0/486270254 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55958858b2a0 con 0x559588568640 2024-06-06T03:29:17.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.059+0000 7fad437fe700 1 -- 172.21.15.50:0/486270254 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fad4c005670 con 0x559588568640 2024-06-06T03:29:17.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.059+0000 7fad437fe700 1 -- 172.21.15.50:0/486270254 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fad54003a40 con 0x559588568640 2024-06-06T03:29:17.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.059+0000 7fad74e96b80 10 client.25462 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:29:17.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.059+0000 7fad74e96b80 10 client.25462 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-06-06T03:29:17.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.059+0000 7fad74e96b80 20 client.25462 populate_metadata read hostname 'smithi050' 2024-06-06T03:29:17.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.060+0000 7fad74e96b80 1 --2- 172.21.15.50:0/486270254 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55958858dce0 0x559588590180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:17.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.060+0000 7fad74e96b80 4 client.25462 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:29:17.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.060+0000 7fad74e96b80 1 -- 172.21.15.50:0/486270254 --> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595884c1d10 con 0x55958858dce0 2024-06-06T03:29:17.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.060+0000 7fad63fff700 1 --2- 172.21.15.50:0/486270254 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55958858dce0 0x559588590180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:17.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.061+0000 7fad437fe700 10 client.25462 ms_handle_connect on v2:172.21.15.122:6834/2987597320 2024-06-06T03:29:17.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.061+0000 7fad63fff700 1 --2- 172.21.15.50:0/486270254 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55958858dce0 0x559588590180 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fd931c0493e07eb0 server_cookie=e72777c203b4a352 in_seq=0 out_seq=0 2024-06-06T03:29:17.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.062+0000 7fad437fe700 1 -- 172.21.15.50:0/486270254 <== mds.2 v2:172.21.15.122:6834/2987597320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5595884c1d10 con 0x55958858dce0 2024-06-06T03:29:17.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.062+0000 7fad437fe700 10 client.25462 handle_command_reply: tid=0 2024-06-06T03:29:17.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.062+0000 7fad74e96b80 1 client.25462 shutdown 2024-06-06T03:29:17.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.062+0000 7fad74e96b80 1 -- 172.21.15.50:0/486270254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559588568640 msgr2=0x55958856bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:17.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.062+0000 7fad74e96b80 1 --2- 172.21.15.50:0/486270254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559588568640 0x55958856bf50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fad5400f920 tx=0x7fad54009260 comp rx=0 tx=0).stop 2024-06-06T03:29:17.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.062+0000 7fad74e96b80 1 -- 172.21.15.50:0/486270254 shutdown_connections 2024-06-06T03:29:17.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.062+0000 7fad74e96b80 1 --2- 172.21.15.50:0/486270254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559588568f60 0x55958856c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.062+0000 7fad74e96b80 1 --2- 172.21.15.50:0/486270254 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55958858dce0 0x559588590180 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.062+0000 7fad74e96b80 1 --2- 172.21.15.50:0/486270254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559588562f20 0x55958856ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.062+0000 7fad74e96b80 1 --2- 172.21.15.50:0/486270254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559588568640 0x55958856bf50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.062+0000 7fad74e96b80 1 -- 172.21.15.50:0/486270254 >> 172.21.15.50:0/486270254 conn(0x55958848dcc0 msgr2=0x5595885619d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:17.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.062+0000 7fad437fe700 0 client.25462 ms_handle_reset on v2:172.21.15.122:6834/2987597320 2024-06-06T03:29:17.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.062+0000 7fad74e96b80 1 -- 172.21.15.50:0/486270254 shutdown_connections 2024-06-06T03:29:17.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.063+0000 7fad74e96b80 1 -- 172.21.15.50:0/486270254 wait complete. 2024-06-06T03:29:17.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.063+0000 7fad74e96b80 20 client.25462 trim_cache size 0 max 16384 2024-06-06T03:29:17.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.095+0000 7fad74e96b80 1 Processor -- start 2024-06-06T03:29:17.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.095+0000 7fad74e96b80 1 -- start start 2024-06-06T03:29:17.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.095+0000 7fad74e96b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559588562f20 0x5595885629e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:17.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.095+0000 7fad74e96b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559588568f60 0x55958856c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:17.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.095+0000 7fad74e96b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55958855da90 0x559588569340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:17.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.095+0000 7fad5bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559588568f60 0x55958856c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:17.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.095+0000 7fad63fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559588562f20 0x5595885629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:17.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.095+0000 7fad5bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559588568f60 0x55958856c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:50952/0 (socket says 172.21.15.50:50952) 2024-06-06T03:29:17.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.095+0000 7fad63fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559588562f20 0x5595885629e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:52712/0 (socket says 172.21.15.50:52712) 2024-06-06T03:29:17.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.095+0000 7fad5bfff700 1 -- 172.21.15.50:0/2988175022 learned_addr learned my addr 172.21.15.50:0/2988175022 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:17.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.095+0000 7fad74e96b80 1 -- 172.21.15.50:0/2988175022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fad641b6f90 con 0x55958855da90 2024-06-06T03:29:17.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.096+0000 7fad74e96b80 1 -- 172.21.15.50:0/2988175022 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fad641b4820 con 0x559588562f20 2024-06-06T03:29:17.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.096+0000 7fad74e96b80 1 -- 172.21.15.50:0/2988175022 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fad64073a40 con 0x559588568f60 2024-06-06T03:29:17.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.096+0000 7fad68bb0700 1 --2- 172.21.15.50:0/2988175022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55958855da90 0x559588569340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.096+0000 7fad5bfff700 1 -- 172.21.15.50:0/2988175022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559588562f20 msgr2=0x5595885629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.096+0000 7fad5bfff700 1 --2- 172.21.15.50:0/2988175022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559588562f20 0x5595885629e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.096+0000 7fad5bfff700 1 -- 172.21.15.50:0/2988175022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55958855da90 msgr2=0x559588569340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:17.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.096+0000 7fad5bfff700 1 --2- 172.21.15.50:0/2988175022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55958855da90 0x559588569340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.096+0000 7fad5bfff700 1 -- 172.21.15.50:0/2988175022 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55958856a4c0 con 0x559588568f60 2024-06-06T03:29:17.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.097+0000 7fad5bfff700 1 --2- 172.21.15.50:0/2988175022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559588568f60 0x55958856c4c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fad54003e40 tx=0x7fad54005ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edcf80d86cedce27 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:17.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.098+0000 7fad59ffb700 1 -- 172.21.15.50:0/2988175022 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad54009e50 con 0x559588568f60 2024-06-06T03:29:17.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.098+0000 7fad59ffb700 1 -- 172.21.15.50:0/2988175022 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fad540044e0 con 0x559588568f60 2024-06-06T03:29:17.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.098+0000 7fad59ffb700 1 -- 172.21.15.50:0/2988175022 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad540279c0 con 0x559588568f60 2024-06-06T03:29:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.099+0000 7fad74e96b80 1 -- 172.21.15.50:0/2988175022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559588568f60 msgr2=0x55958856c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.099+0000 7fad74e96b80 1 --2- 172.21.15.50:0/2988175022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559588568f60 0x55958856c4c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fad54003e40 tx=0x7fad54005ee0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.099+0000 7fad74e96b80 1 -- 172.21.15.50:0/2988175022 shutdown_connections 2024-06-06T03:29:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.099+0000 7fad74e96b80 1 --2- 172.21.15.50:0/2988175022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55958855da90 0x559588569340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.099+0000 7fad74e96b80 1 --2- 172.21.15.50:0/2988175022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559588562f20 0x5595885629e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.099+0000 7fad74e96b80 1 --2- 172.21.15.50:0/2988175022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559588568f60 0x55958856c4c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.099+0000 7fad74e96b80 1 -- 172.21.15.50:0/2988175022 >> 172.21.15.50:0/2988175022 conn(0x55958848dcc0 msgr2=0x55958855d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:17.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.099+0000 7fad74e96b80 1 -- 172.21.15.50:0/2988175022 shutdown_connections 2024-06-06T03:29:17.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.100+0000 7fad74e96b80 1 -- 172.21.15.50:0/2988175022 wait complete. 2024-06-06T03:29:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.100+0000 7fad74e96b80 1 -- start start 2024-06-06T03:29:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.100+0000 7fad74e96b80 1 Processor -- start 2024-06-06T03:29:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.101+0000 7fad74e96b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55958855da90 0x559588575400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.101+0000 7fad74e96b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559588562f20 0x5595885950c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.101+0000 7fad74e96b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559588595600 0x559588595a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.101+0000 7fad74e96b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fad640740b0 con 0x559588562f20 2024-06-06T03:29:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.101+0000 7fad74e96b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fad64075520 con 0x55958855da90 2024-06-06T03:29:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.101+0000 7fad74e96b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fad64074780 con 0x559588595600 2024-06-06T03:29:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.101+0000 7fad74e96b80 10 client.0 _ll_register_callbacks cb 0x55958844e920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:29:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.101+0000 7fad5bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559588562f20 0x5595885950c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.102+0000 7fad63fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55958855da90 0x559588575400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.102+0000 7fad63fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55958855da90 0x559588575400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:52726/0 (socket says 172.21.15.50:52726) 2024-06-06T03:29:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.102+0000 7fad5bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559588562f20 0x5595885950c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57326/0 (socket says 172.21.15.50:57326) 2024-06-06T03:29:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.102+0000 7fad63fff700 1 -- 172.21.15.50:0/2065453991 learned_addr learned my addr 172.21.15.50:0/2065453991 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:17.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.102+0000 7fad5bfff700 1 -- 172.21.15.50:0/2065453991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559588595600 msgr2=0x559588595a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:17.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.102+0000 7fad5bfff700 1 --2- 172.21.15.50:0/2065453991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559588595600 0x559588595a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.102+0000 7fad5bfff700 1 -- 172.21.15.50:0/2065453991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55958855da90 msgr2=0x559588575400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:17.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.102+0000 7fad5bfff700 1 --2- 172.21.15.50:0/2065453991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55958855da90 0x559588575400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.102+0000 7fad5bfff700 1 -- 172.21.15.50:0/2065453991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595885f7a60 con 0x559588562f20 2024-06-06T03:29:17.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.102+0000 7fad5bfff700 1 --2- 172.21.15.50:0/2065453991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559588562f20 0x5595885950c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x55958856f880 tx=0x7fad540092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b709ca5ceb6fa41 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:17.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.102+0000 7fad437fe700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:29:17.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.103+0000 7fad437fe700 1 -- 172.21.15.50:0/2065453991 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad54003fe0 con 0x559588562f20 2024-06-06T03:29:17.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.103+0000 7fad437fe700 1 -- 172.21.15.50:0/2065453991 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fad54004180 con 0x559588562f20 2024-06-06T03:29:17.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.103+0000 7fad74e96b80 1 -- 172.21.15.50:0/2065453991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad540044e0 con 0x559588562f20 2024-06-06T03:29:17.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.104+0000 7fad437fe700 1 -- 172.21.15.50:0/2065453991 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fad54005040 con 0x559588562f20 2024-06-06T03:29:17.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.104+0000 7fad74e96b80 10 client.15879 fetch_fsmap learned FSMap version 29 2024-06-06T03:29:17.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.104+0000 7fad74e96b80 1 -- 172.21.15.50:0/2065453991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5595885f8bc0 con 0x559588562f20 2024-06-06T03:29:17.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.105+0000 7fad437fe700 1 -- 172.21.15.50:0/2065453991 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fad540044e0 con 0x559588562f20 2024-06-06T03:29:17.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.105+0000 7fad437fe700 1 -- 172.21.15.50:0/2065453991 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fad54004c10 con 0x559588562f20 2024-06-06T03:29:17.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.105+0000 7fad74e96b80 10 client.15879 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:29:17.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.105+0000 7fad74e96b80 10 client.15879 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-06-06T03:29:17.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.105+0000 7fad74e96b80 20 client.15879 populate_metadata read hostname 'smithi050' 2024-06-06T03:29:17.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.105+0000 7fad74e96b80 1 --2- 172.21.15.50:0/2065453991 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x5595885f9100 0x5595885fb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:17.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.105+0000 7fad74e96b80 4 client.15879 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:29:17.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.105+0000 7fad74e96b80 1 -- 172.21.15.50:0/2065453991 --> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5595884bc290 con 0x5595885f9100 2024-06-06T03:29:17.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.108+0000 7fad63fff700 1 --2- 172.21.15.50:0/2065453991 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x5595885f9100 0x5595885fb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:17.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.110+0000 7fad63fff700 1 --2- 172.21.15.50:0/2065453991 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x5595885f9100 0x5595885fb520 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=30de5dfe6a611c7e server_cookie=13345e83d9813382 in_seq=0 out_seq=0 2024-06-06T03:29:17.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.110+0000 7fad437fe700 10 client.15879 ms_handle_connect on v2:172.21.15.122:6834/2987597320 2024-06-06T03:29:17.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.110+0000 7fad437fe700 1 -- 172.21.15.50:0/2065453991 <== mds.2 v2:172.21.15.122:6834/2987597320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5595884bc290 con 0x5595885f9100 2024-06-06T03:29:17.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.110+0000 7fad437fe700 10 client.15879 handle_command_reply: tid=0 2024-06-06T03:29:17.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.110+0000 7fad74e96b80 1 client.15879 shutdown 2024-06-06T03:29:17.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.111+0000 7fad74e96b80 1 -- 172.21.15.50:0/2065453991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559588562f20 msgr2=0x5595885950c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:17.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.111+0000 7fad74e96b80 1 --2- 172.21.15.50:0/2065453991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559588562f20 0x5595885950c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x55958856f880 tx=0x7fad540092d0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.111+0000 7fad74e96b80 1 -- 172.21.15.50:0/2065453991 shutdown_connections 2024-06-06T03:29:17.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.111+0000 7fad74e96b80 1 --2- 172.21.15.50:0/2065453991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559588595600 0x559588595a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.111+0000 7fad74e96b80 1 --2- 172.21.15.50:0/2065453991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55958855da90 0x559588575400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.111+0000 7fad74e96b80 1 --2- 172.21.15.50:0/2065453991 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x5595885f9100 0x5595885fb520 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.111+0000 7fad74e96b80 1 --2- 172.21.15.50:0/2065453991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559588562f20 0x5595885950c0 secure :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0x55958856f880 tx=0x7fad540092d0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.111+0000 7fad74e96b80 1 -- 172.21.15.50:0/2065453991 >> 172.21.15.50:0/2065453991 conn(0x55958848dcc0 msgr2=0x559588569340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:17.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.111+0000 7fad437fe700 0 client.15879 ms_handle_reset on v2:172.21.15.122:6834/2987597320 2024-06-06T03:29:17.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.112+0000 7fad74e96b80 1 -- 172.21.15.50:0/2065453991 shutdown_connections 2024-06-06T03:29:17.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.112+0000 7fad74e96b80 1 -- 172.21.15.50:0/2065453991 wait complete. 2024-06-06T03:29:17.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.112+0000 7fad74e96b80 20 client.15879 trim_cache size 0 max 16384 2024-06-06T03:29:17.113 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:29:17.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.113+0000 7fad6a613700 1 -- 172.21.15.50:0/2873039613 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fad500a2e20 msgr2=0x7fad500a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:17.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.113+0000 7fad6a613700 1 --2- 172.21.15.50:0/2873039613 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fad500a2e20 0x7fad500a52e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fad54005d90 tx=0x7fad54013900 comp rx=0 tx=0).stop 2024-06-06T03:29:17.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.113+0000 7fad6a613700 1 -- 172.21.15.50:0/2873039613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad641084f0 msgr2=0x7fad641a7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:17.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.113+0000 7fad6a613700 1 --2- 172.21.15.50:0/2873039613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad641084f0 0x7fad641a7ac0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fad5c00efc0 tx=0x7fad5c00c3a0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.113+0000 7fad6a613700 1 -- 172.21.15.50:0/2873039613 shutdown_connections 2024-06-06T03:29:17.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.113+0000 7fad6a613700 1 --2- 172.21.15.50:0/2873039613 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fad500a2e20 0x7fad500a52e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.113+0000 7fad6a613700 1 --2- 172.21.15.50:0/2873039613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad641084f0 0x7fad641a7ac0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.114+0000 7fad6a613700 1 --2- 172.21.15.50:0/2873039613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad64102550 0x7fad641ad3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.114+0000 7fad6a613700 1 --2- 172.21.15.50:0/2873039613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad64102f10 0x7fad641ad920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:17.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.114+0000 7fad6a613700 1 -- 172.21.15.50:0/2873039613 >> 172.21.15.50:0/2873039613 conn(0x7fad64079650 msgr2=0x7fad64075780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:17.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.114+0000 7fad6a613700 1 -- 172.21.15.50:0/2873039613 shutdown_connections 2024-06-06T03:29:17.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:17.114+0000 7fad6a613700 1 -- 172.21.15.50:0/2873039613 wait complete. 2024-06-06T03:29:17.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:17 smithi079 ceph-mon[35478]: pgmap v510: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 MiB/s wr, 566 op/s 2024-06-06T03:29:17.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:17 smithi122 ceph-mon[35759]: pgmap v510: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 MiB/s wr, 566 op/s 2024-06-06T03:29:17.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:17 smithi050 ceph-mon[32421]: pgmap v510: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 MiB/s wr, 566 op/s 2024-06-06T03:29:18.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:18 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:29:18.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:18 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:29:18.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:18 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:29:18.638 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-06-06T03:29:19.114 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:29:19.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:19 smithi079 ceph-mon[35478]: pgmap v511: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 58 MiB/s wr, 619 op/s 2024-06-06T03:29:19.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:19 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:29:19.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:19 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:29:19.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:19 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:29:19.399 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:19 smithi050 ceph-mon[32421]: pgmap v511: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 58 MiB/s wr, 619 op/s 2024-06-06T03:29:19.399 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:19 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:29:19.399 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:19 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:29:19.400 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:19 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:29:19.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:19 smithi122 ceph-mon[35759]: pgmap v511: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 58 MiB/s wr, 619 op/s 2024-06-06T03:29:19.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:19 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:29:19.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:19 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:29:19.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:19 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:29:21.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:21 smithi050 ceph-mon[32421]: pgmap v512: 129 pgs: 129 active+clean; 10 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 60 MiB/s wr, 817 op/s 2024-06-06T03:29:21.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:21 smithi079 ceph-mon[35478]: pgmap v512: 129 pgs: 129 active+clean; 10 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 60 MiB/s wr, 817 op/s 2024-06-06T03:29:21.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:21 smithi122 ceph-mon[35759]: pgmap v512: 129 pgs: 129 active+clean; 10 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 60 MiB/s wr, 817 op/s 2024-06-06T03:29:22.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.579+0000 7f7ac4831700 1 -- 172.21.15.50:0/3270984450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ac0108500 msgr2=0x7f7ac01088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:22.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.579+0000 7f7ac4831700 1 --2- 172.21.15.50:0/3270984450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ac0108500 0x7f7ac01088e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0009990 tx=0x7f7ab0009ca0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.579+0000 7f7ac4831700 1 -- 172.21.15.50:0/3270984450 shutdown_connections 2024-06-06T03:29:22.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.579+0000 7f7ac4831700 1 --2- 172.21.15.50:0/3270984450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ac006ab30 0x7f7ac010f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.579+0000 7f7ac4831700 1 --2- 172.21.15.50:0/3270984450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ac0108500 0x7f7ac01088e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.579+0000 7f7ac4831700 1 --2- 172.21.15.50:0/3270984450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ac006a170 0x7f7ac006a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.579+0000 7f7ac4831700 1 -- 172.21.15.50:0/3270984450 >> 172.21.15.50:0/3270984450 conn(0x7f7ac0078340 msgr2=0x7f7ac0078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:22.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.580+0000 7f7ac4831700 1 -- 172.21.15.50:0/3270984450 shutdown_connections 2024-06-06T03:29:22.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.580+0000 7f7ac4831700 1 -- 172.21.15.50:0/3270984450 wait complete. 2024-06-06T03:29:22.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.581+0000 7f7ac4831700 1 Processor -- start 2024-06-06T03:29:22.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.581+0000 7f7ac4831700 1 -- start start 2024-06-06T03:29:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.582+0000 7f7ac4831700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ac006a170 0x7f7ac019e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.582+0000 7f7ac4831700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ac006ab30 0x7f7ac019ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.582+0000 7f7ac4831700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ac0108500 0x7f7ac0198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.582+0000 7f7ac4831700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac0112630 con 0x7f7ac0108500 2024-06-06T03:29:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.582+0000 7f7ac4831700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac01124b0 con 0x7f7ac006ab30 2024-06-06T03:29:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.582+0000 7f7ac4831700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac01127b0 con 0x7f7ac006a170 2024-06-06T03:29:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.582+0000 7f7abe59c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ac006a170 0x7f7ac019e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:22.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.582+0000 7f7abe59c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ac006a170 0x7f7ac019e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:46188/0 (socket says 172.21.15.50:46188) 2024-06-06T03:29:22.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.582+0000 7f7abe59c700 1 -- 172.21.15.50:0/2608703583 learned_addr learned my addr 172.21.15.50:0/2608703583 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:22.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.582+0000 7f7abdd9b700 1 --2- 172.21.15.50:0/2608703583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ac006ab30 0x7f7ac019ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:22.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.583+0000 7f7abe59c700 1 -- 172.21.15.50:0/2608703583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ac006ab30 msgr2=0x7f7ac019ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:22.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.583+0000 7f7abe59c700 1 --2- 172.21.15.50:0/2608703583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ac006ab30 0x7f7ac019ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.583+0000 7f7abe59c700 1 -- 172.21.15.50:0/2608703583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ac0108500 msgr2=0x7f7ac0198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:22.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.583+0000 7f7abe59c700 1 --2- 172.21.15.50:0/2608703583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ac0108500 0x7f7ac0198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.583+0000 7f7abe59c700 1 -- 172.21.15.50:0/2608703583 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac0199170 con 0x7f7ac006a170 2024-06-06T03:29:22.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.583+0000 7f7abe59c700 1 --2- 172.21.15.50:0/2608703583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ac006a170 0x7f7ac019e850 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0000c00 tx=0x7f7ab0004790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:22.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.583+0000 7f7aaf7fe700 1 -- 172.21.15.50:0/2608703583 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0027070 con 0x7f7ac006a170 2024-06-06T03:29:22.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.583+0000 7f7aaf7fe700 1 -- 172.21.15.50:0/2608703583 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7ab0022470 con 0x7f7ac006a170 2024-06-06T03:29:22.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.583+0000 7f7aaf7fe700 1 -- 172.21.15.50:0/2608703583 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0017650 con 0x7f7ac006a170 2024-06-06T03:29:22.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.583+0000 7f7ac4831700 1 -- 172.21.15.50:0/2608703583 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ac0199400 con 0x7f7ac006a170 2024-06-06T03:29:22.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.584+0000 7f7ac4831700 1 -- 172.21.15.50:0/2608703583 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ac01997d0 con 0x7f7ac006a170 2024-06-06T03:29:22.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.587+0000 7f7aaf7fe700 1 -- 172.21.15.50:0/2608703583 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7ab002a070 con 0x7f7ac006a170 2024-06-06T03:29:22.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.589+0000 7f7aaf7fe700 1 --2- 172.21.15.50:0/2608703583 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7aa80a2ca0 0x7f7aa80a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:22.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.589+0000 7f7aaf7fe700 1 -- 172.21.15.50:0/2608703583 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f7ab00cffd0 con 0x7f7ac006a170 2024-06-06T03:29:22.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.589+0000 7f7abdd9b700 1 --2- 172.21.15.50:0/2608703583 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7aa80a2ca0 0x7f7aa80a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:22.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.590+0000 7f7abdd9b700 1 --2- 172.21.15.50:0/2608703583 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7aa80a2ca0 0x7f7aa80a5160 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0078a60 tx=0x7f7ab4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:22.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.596+0000 7f7acf0b4b80 1 Processor -- start 2024-06-06T03:29:22.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.597+0000 7f7acf0b4b80 1 -- start start 2024-06-06T03:29:22.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.597+0000 7f7acf0b4b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b116966760 0x55b1169629e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:22.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.597+0000 7f7acf0b4b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b116962f20 0x55b1169633a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:22.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.597+0000 7f7acf0b4b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b116975640 0x55b116977a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:22.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.597+0000 7f7acf0b4b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b1168b4810 con 0x55b116975640 2024-06-06T03:29:22.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.597+0000 7f7acf0b4b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b11685c720 con 0x55b116962f20 2024-06-06T03:29:22.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.597+0000 7f7acf0b4b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b1168b07d0 con 0x55b116966760 2024-06-06T03:29:22.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.597+0000 7f7abed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b116975640 0x55b116977a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:22.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.597+0000 7f7abed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b116975640 0x55b116977a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56538/0 (socket says 172.21.15.50:56538) 2024-06-06T03:29:22.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.597+0000 7f7abed9d700 1 -- 172.21.15.50:0/158614065 learned_addr learned my addr 172.21.15.50:0/158614065 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:22.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.598+0000 7f7abed9d700 1 -- 172.21.15.50:0/158614065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b116966760 msgr2=0x55b1169629e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:29:22.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.598+0000 7f7abed9d700 1 --2- 172.21.15.50:0/158614065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b116966760 0x55b1169629e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.598+0000 7f7abed9d700 1 -- 172.21.15.50:0/158614065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b116962f20 msgr2=0x55b1169633a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:29:22.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.598+0000 7f7abed9d700 1 --2- 172.21.15.50:0/158614065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b116962f20 0x55b1169633a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.598+0000 7f7abed9d700 1 -- 172.21.15.50:0/158614065 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b116852f50 con 0x55b116975640 2024-06-06T03:29:22.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.598+0000 7f7abed9d700 1 --2- 172.21.15.50:0/158614065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b116975640 0x55b116977a30 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800e380 tx=0x7f7ab800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e6d0a5af7d2e659 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:22.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.599+0000 7f7aacff9700 1 -- 172.21.15.50:0/158614065 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8004bb0 con 0x55b116975640 2024-06-06T03:29:22.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.599+0000 7f7aacff9700 1 -- 172.21.15.50:0/158614065 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7ab8004d50 con 0x55b116975640 2024-06-06T03:29:22.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.600+0000 7f7acf0b4b80 1 -- 172.21.15.50:0/158614065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b116975640 msgr2=0x55b116977a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:22.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.600+0000 7f7acf0b4b80 1 --2- 172.21.15.50:0/158614065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b116975640 0x55b116977a30 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800e380 tx=0x7f7ab800b040 comp rx=0 tx=0).stop 2024-06-06T03:29:22.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.600+0000 7f7acf0b4b80 1 -- 172.21.15.50:0/158614065 shutdown_connections 2024-06-06T03:29:22.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.600+0000 7f7acf0b4b80 1 --2- 172.21.15.50:0/158614065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b116975640 0x55b116977a30 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.600+0000 7f7acf0b4b80 1 --2- 172.21.15.50:0/158614065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b116966760 0x55b1169629e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.600+0000 7f7acf0b4b80 1 --2- 172.21.15.50:0/158614065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b116962f20 0x55b1169633a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.600+0000 7f7acf0b4b80 1 -- 172.21.15.50:0/158614065 >> 172.21.15.50:0/158614065 conn(0x55b11688dcc0 msgr2=0x55b11695d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:22.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.600+0000 7f7acf0b4b80 1 -- 172.21.15.50:0/158614065 shutdown_connections 2024-06-06T03:29:22.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.600+0000 7f7acf0b4b80 1 -- 172.21.15.50:0/158614065 wait complete. 2024-06-06T03:29:22.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.601+0000 7f7acf0b4b80 1 -- start start 2024-06-06T03:29:22.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.601+0000 7f7acf0b4b80 1 Processor -- start 2024-06-06T03:29:22.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.601+0000 7f7acf0b4b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b116962f20 0x55b116977600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.601+0000 7f7acf0b4b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b116966760 0x55b116974900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.602+0000 7f7abe59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b116962f20 0x55b116977600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.602+0000 7f7abe59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b116962f20 0x55b116977600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56546/0 (socket says 172.21.15.50:56546) 2024-06-06T03:29:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.602+0000 7f7acf0b4b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b116974e40 0x55b1169752c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.602+0000 7f7abe59c700 1 -- 172.21.15.50:0/1908127362 learned_addr learned my addr 172.21.15.50:0/1908127362 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.602+0000 7f7acf0b4b80 1 -- 172.21.15.50:0/1908127362 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b1169781f0 con 0x55b116962f20 2024-06-06T03:29:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.602+0000 7f7acf0b4b80 1 -- 172.21.15.50:0/1908127362 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b116854bf0 con 0x55b116974e40 2024-06-06T03:29:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.602+0000 7f7acf0b4b80 1 -- 172.21.15.50:0/1908127362 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b116978370 con 0x55b116966760 2024-06-06T03:29:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.602+0000 7f7acf0b4b80 10 client.0 _ll_register_callbacks cb 0x55b11684e920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:29:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.602+0000 7f7abdd9b700 1 --2- 172.21.15.50:0/1908127362 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b116966760 0x55b116974900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.602+0000 7f7abed9d700 1 --2- 172.21.15.50:0/1908127362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b116974e40 0x55b1169752c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.602+0000 7f7abdd9b700 1 -- 172.21.15.50:0/1908127362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b116974e40 msgr2=0x55b1169752c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.602+0000 7f7abdd9b700 1 --2- 172.21.15.50:0/1908127362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b116974e40 0x55b1169752c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.602+0000 7f7abdd9b700 1 -- 172.21.15.50:0/1908127362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b116962f20 msgr2=0x55b116977600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.602+0000 7f7abdd9b700 1 --2- 172.21.15.50:0/1908127362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b116962f20 0x55b116977600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.602+0000 7f7abdd9b700 1 -- 172.21.15.50:0/1908127362 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1168038d0 con 0x55b116966760 2024-06-06T03:29:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.603+0000 7f7abdd9b700 1 --2- 172.21.15.50:0/1908127362 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b116966760 0x55b116974900 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7ab40117d0 tx=0x7f7ab40047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f6f321e1cca8aa0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.603+0000 7f7aa5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:29:22.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.603+0000 7f7aa5ffb700 1 -- 172.21.15.50:0/1908127362 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab4004220 con 0x55b116966760 2024-06-06T03:29:22.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.603+0000 7f7aa5ffb700 1 -- 172.21.15.50:0/1908127362 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f7ab40043c0 con 0x55b116966760 2024-06-06T03:29:22.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.604+0000 7f7acf0b4b80 1 -- 172.21.15.50:0/1908127362 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b1168c1d10 con 0x55b116966760 2024-06-06T03:29:22.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.605+0000 7f7aa5ffb700 1 -- 172.21.15.50:0/1908127362 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7ab4003680 con 0x55b116966760 2024-06-06T03:29:22.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.605+0000 7f7acf0b4b80 10 client.25474 fetch_fsmap learned FSMap version 29 2024-06-06T03:29:22.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.605+0000 7f7acf0b4b80 1 -- 172.21.15.50:0/1908127362 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b116993f40 con 0x55b116966760 2024-06-06T03:29:22.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.606+0000 7f7aa5ffb700 1 -- 172.21.15.50:0/1908127362 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55b1168c1d10 con 0x55b116966760 2024-06-06T03:29:22.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.606+0000 7f7aa5ffb700 1 -- 172.21.15.50:0/1908127362 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f7ab401ca70 con 0x55b116966760 2024-06-06T03:29:22.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.606+0000 7f7acf0b4b80 10 client.25474 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:29:22.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.606+0000 7f7acf0b4b80 10 client.25474 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-06-06T03:29:22.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.606+0000 7f7acf0b4b80 20 client.25474 populate_metadata read hostname 'smithi050' 2024-06-06T03:29:22.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.606+0000 7f7acf0b4b80 1 --2- 172.21.15.50:0/1908127362 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55b116996580 0x55b116998970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:22.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.607+0000 7f7acf0b4b80 4 client.25474 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:29:22.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.607+0000 7f7acf0b4b80 1 -- 172.21.15.50:0/1908127362 --> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1168bc290 con 0x55b116996580 2024-06-06T03:29:22.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.607+0000 7f7abe59c700 1 --2- 172.21.15.50:0/1908127362 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55b116996580 0x55b116998970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:22.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.608+0000 7f7abe59c700 1 --2- 172.21.15.50:0/1908127362 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55b116996580 0x55b116998970 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7c731ed8e211bda0 server_cookie=2faea50c26f317a in_seq=0 out_seq=0 2024-06-06T03:29:22.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.608+0000 7f7aa5ffb700 10 client.25474 ms_handle_connect on v2:172.21.15.122:6836/1604366318 2024-06-06T03:29:22.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.609+0000 7f7aa5ffb700 1 -- 172.21.15.50:0/1908127362 <== mds.1 v2:172.21.15.122:6836/1604366318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55b1168bc290 con 0x55b116996580 2024-06-06T03:29:22.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.609+0000 7f7aa5ffb700 10 client.25474 handle_command_reply: tid=0 2024-06-06T03:29:22.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.609+0000 7f7acf0b4b80 1 client.25474 shutdown 2024-06-06T03:29:22.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.610+0000 7f7acf0b4b80 1 -- 172.21.15.50:0/1908127362 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b116966760 msgr2=0x55b116974900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:22.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.610+0000 7f7acf0b4b80 1 --2- 172.21.15.50:0/1908127362 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b116966760 0x55b116974900 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7ab40117d0 tx=0x7f7ab40047c0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.610+0000 7f7acf0b4b80 1 -- 172.21.15.50:0/1908127362 shutdown_connections 2024-06-06T03:29:22.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.610+0000 7f7acf0b4b80 1 --2- 172.21.15.50:0/1908127362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b116974e40 0x55b1169752c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.610+0000 7f7acf0b4b80 1 --2- 172.21.15.50:0/1908127362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b116962f20 0x55b116977600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.610+0000 7f7acf0b4b80 1 --2- 172.21.15.50:0/1908127362 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55b116996580 0x55b116998970 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.610+0000 7f7acf0b4b80 1 --2- 172.21.15.50:0/1908127362 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b116966760 0x55b116974900 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.610+0000 7f7acf0b4b80 1 -- 172.21.15.50:0/1908127362 >> 172.21.15.50:0/1908127362 conn(0x55b11688dcc0 msgr2=0x55b11695f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.610+0000 7f7aa5ffb700 0 client.25474 ms_handle_reset on v2:172.21.15.122:6836/1604366318 2024-06-06T03:29:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.611+0000 7f7acf0b4b80 1 -- 172.21.15.50:0/1908127362 shutdown_connections 2024-06-06T03:29:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.611+0000 7f7acf0b4b80 1 -- 172.21.15.50:0/1908127362 wait complete. 2024-06-06T03:29:22.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.612+0000 7f7acf0b4b80 20 client.25474 trim_cache size 0 max 16384 2024-06-06T03:29:22.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.647+0000 7f7acf0b4b80 1 Processor -- start 2024-06-06T03:29:22.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.647+0000 7f7acf0b4b80 1 -- start start 2024-06-06T03:29:22.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.648+0000 7f7acf0b4b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b116962f20 0x55b116973a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:22.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.648+0000 7f7acf0b4b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b116966760 0x55b116992570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:22.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.648+0000 7f7acf0b4b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b116974e40 0x55b11699e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:22.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.648+0000 7f7acf0b4b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac01a5fc0 con 0x55b116966760 2024-06-06T03:29:22.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.648+0000 7f7acf0b4b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac0072790 con 0x55b116974e40 2024-06-06T03:29:22.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.648+0000 7f7acf0b4b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac00705e0 con 0x55b116962f20 2024-06-06T03:29:22.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.649+0000 7f7abe59c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b116962f20 0x55b116973a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:22.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.650+0000 7f7abe59c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b116962f20 0x55b116973a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:46202/0 (socket says 172.21.15.50:46202) 2024-06-06T03:29:22.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.650+0000 7f7abe59c700 1 -- 172.21.15.50:0/2615153376 learned_addr learned my addr 172.21.15.50:0/2615153376 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:22.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.650+0000 7f7abe59c700 1 -- 172.21.15.50:0/2615153376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b116974e40 msgr2=0x55b11699e1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:29:22.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.651+0000 7f7abe59c700 1 --2- 172.21.15.50:0/2615153376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b116974e40 0x55b11699e1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.651+0000 7f7abe59c700 1 -- 172.21.15.50:0/2615153376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b116966760 msgr2=0x55b116992570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:22.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.651+0000 7f7abe59c700 1 --2- 172.21.15.50:0/2615153376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b116966760 0x55b116992570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.651+0000 7f7abe59c700 1 -- 172.21.15.50:0/2615153376 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1169639b0 con 0x55b116962f20 2024-06-06T03:29:22.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.651+0000 7f7abe59c700 1 --2- 172.21.15.50:0/2615153376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b116962f20 0x55b116973a80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7ab009c4d0 tx=0x7f7ab0009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b223ddabd8cfdba3 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:22.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.651+0000 7f7aa7fff700 1 -- 172.21.15.50:0/2615153376 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab00b5070 con 0x55b116962f20 2024-06-06T03:29:22.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.651+0000 7f7aa7fff700 1 -- 172.21.15.50:0/2615153376 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7ab009c540 con 0x55b116962f20 2024-06-06T03:29:22.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.651+0000 7f7aa7fff700 1 -- 172.21.15.50:0/2615153376 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab009c7a0 con 0x55b116962f20 2024-06-06T03:29:22.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.652+0000 7f7acf0b4b80 1 -- 172.21.15.50:0/2615153376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b116962f20 msgr2=0x55b116973a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:22.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.652+0000 7f7acf0b4b80 1 --2- 172.21.15.50:0/2615153376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b116962f20 0x55b116973a80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7ab009c4d0 tx=0x7f7ab0009310 comp rx=0 tx=0).stop 2024-06-06T03:29:22.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.653+0000 7f7acf0b4b80 1 -- 172.21.15.50:0/2615153376 shutdown_connections 2024-06-06T03:29:22.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.653+0000 7f7acf0b4b80 1 --2- 172.21.15.50:0/2615153376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b116974e40 0x55b11699e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.653+0000 7f7acf0b4b80 1 --2- 172.21.15.50:0/2615153376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b116962f20 0x55b116973a80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.653+0000 7f7acf0b4b80 1 --2- 172.21.15.50:0/2615153376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b116966760 0x55b116992570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.653+0000 7f7acf0b4b80 1 -- 172.21.15.50:0/2615153376 >> 172.21.15.50:0/2615153376 conn(0x55b11688dcc0 msgr2=0x55b116957470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:22.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.656+0000 7f7acf0b4b80 1 -- 172.21.15.50:0/2615153376 shutdown_connections 2024-06-06T03:29:22.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.657+0000 7f7acf0b4b80 1 -- 172.21.15.50:0/2615153376 wait complete. 2024-06-06T03:29:22.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.658+0000 7f7acf0b4b80 1 -- start start 2024-06-06T03:29:22.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.658+0000 7f7acf0b4b80 1 Processor -- start 2024-06-06T03:29:22.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.659+0000 7f7acf0b4b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b116962f20 0x55b11698b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:22.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.659+0000 7f7acf0b4b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b116974e40 0x55b11698b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:22.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.659+0000 7f7acf0b4b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b11698be70 0x55b11696edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:22.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.659+0000 7f7acf0b4b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac0070c50 con 0x55b116974e40 2024-06-06T03:29:22.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.659+0000 7f7acf0b4b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac00720c0 con 0x55b116962f20 2024-06-06T03:29:22.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.659+0000 7f7acf0b4b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac0071320 con 0x55b11698be70 2024-06-06T03:29:22.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.659+0000 7f7acf0b4b80 10 client.0 _ll_register_callbacks cb 0x55b11684e920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:29:22.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.659+0000 7f7abed9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b11698be70 0x55b11696edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:22.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.659+0000 7f7abed9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b11698be70 0x55b11696edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:46216/0 (socket says 172.21.15.50:46216) 2024-06-06T03:29:22.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.659+0000 7f7abed9d700 1 -- 172.21.15.50:0/4284429397 learned_addr learned my addr 172.21.15.50:0/4284429397 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:22.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.659+0000 7f7abdd9b700 1 --2- 172.21.15.50:0/4284429397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b116974e40 0x55b11698b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:22.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.659+0000 7f7abe59c700 1 --2- 172.21.15.50:0/4284429397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b116962f20 0x55b11698b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:22.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.660+0000 7f7abed9d700 1 -- 172.21.15.50:0/4284429397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b116962f20 msgr2=0x55b11698b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:22.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.660+0000 7f7abed9d700 1 --2- 172.21.15.50:0/4284429397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b116962f20 0x55b11698b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.660+0000 7f7abed9d700 1 -- 172.21.15.50:0/4284429397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b116974e40 msgr2=0x55b11698b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:22.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.660+0000 7f7abed9d700 1 --2- 172.21.15.50:0/4284429397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b116974e40 0x55b11698b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.660+0000 7f7abed9d700 1 -- 172.21.15.50:0/4284429397 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b11696f2f0 con 0x55b11698be70 2024-06-06T03:29:22.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.660+0000 7f7abed9d700 1 --2- 172.21.15.50:0/4284429397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b11698be70 0x55b11696edb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800e320 tx=0x7f7ab800efd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b5d58102d0e512e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:22.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.661+0000 7f7aa5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:29:22.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.661+0000 7f7aa5ffb700 1 -- 172.21.15.50:0/4284429397 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8022070 con 0x55b11698be70 2024-06-06T03:29:22.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.661+0000 7f7aa5ffb700 1 -- 172.21.15.50:0/4284429397 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f7ab80045a0 con 0x55b11698be70 2024-06-06T03:29:22.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.662+0000 7f7acf0b4b80 1 -- 172.21.15.50:0/4284429397 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ab009c540 con 0x55b11698be70 2024-06-06T03:29:22.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.665+0000 7f7aa5ffb700 1 -- 172.21.15.50:0/4284429397 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7ab80047c0 con 0x55b11698be70 2024-06-06T03:29:22.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.666+0000 7f7acf0b4b80 10 client.25480 fetch_fsmap learned FSMap version 29 2024-06-06T03:29:22.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.666+0000 7f7acf0b4b80 1 -- 172.21.15.50:0/4284429397 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b1169f9180 con 0x55b11698be70 2024-06-06T03:29:22.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.666+0000 7f7aa5ffb700 1 -- 172.21.15.50:0/4284429397 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7ab009c540 con 0x55b11698be70 2024-06-06T03:29:22.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.666+0000 7f7aa5ffb700 1 -- 172.21.15.50:0/4284429397 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f7ab8007810 con 0x55b11698be70 2024-06-06T03:29:22.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.666+0000 7f7acf0b4b80 10 client.25480 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:29:22.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.666+0000 7f7acf0b4b80 10 client.25480 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-06-06T03:29:22.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.666+0000 7f7acf0b4b80 20 client.25480 populate_metadata read hostname 'smithi050' 2024-06-06T03:29:22.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.666+0000 7f7acf0b4b80 1 --2- 172.21.15.50:0/4284429397 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55b1169f95d0 0x55b1169fb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:22.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.666+0000 7f7acf0b4b80 4 client.25480 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:29:22.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.666+0000 7f7acf0b4b80 1 -- 172.21.15.50:0/4284429397 --> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b116736250 con 0x55b1169f95d0 2024-06-06T03:29:22.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.668+0000 7f7abe59c700 1 --2- 172.21.15.50:0/4284429397 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55b1169f95d0 0x55b1169fb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:22.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.669+0000 7f7abe59c700 1 --2- 172.21.15.50:0/4284429397 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55b1169f95d0 0x55b1169fb9c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e9bfff9ed151c138 server_cookie=7e46812314784889 in_seq=0 out_seq=0 2024-06-06T03:29:22.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.669+0000 7f7aa5ffb700 10 client.25480 ms_handle_connect on v2:172.21.15.122:6836/1604366318 2024-06-06T03:29:22.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.670+0000 7f7aa5ffb700 1 -- 172.21.15.50:0/4284429397 <== mds.1 v2:172.21.15.122:6836/1604366318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b116736250 con 0x55b1169f95d0 2024-06-06T03:29:22.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.670+0000 7f7aa5ffb700 10 client.25480 handle_command_reply: tid=0 2024-06-06T03:29:22.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.670+0000 7f7acf0b4b80 1 client.25480 shutdown 2024-06-06T03:29:22.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.671+0000 7f7acf0b4b80 1 -- 172.21.15.50:0/4284429397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b11698be70 msgr2=0x55b11696edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:22.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.671+0000 7f7acf0b4b80 1 --2- 172.21.15.50:0/4284429397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b11698be70 0x55b11696edb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800e320 tx=0x7f7ab800efd0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.671+0000 7f7acf0b4b80 1 -- 172.21.15.50:0/4284429397 shutdown_connections 2024-06-06T03:29:22.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.671+0000 7f7acf0b4b80 1 --2- 172.21.15.50:0/4284429397 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55b1169f95d0 0x55b1169fb9c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.671+0000 7f7acf0b4b80 1 --2- 172.21.15.50:0/4284429397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b11698be70 0x55b11696edb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.671+0000 7f7acf0b4b80 1 --2- 172.21.15.50:0/4284429397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b116962f20 0x55b11698b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.671+0000 7f7acf0b4b80 1 --2- 172.21.15.50:0/4284429397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b116974e40 0x55b11698b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.671+0000 7f7acf0b4b80 1 -- 172.21.15.50:0/4284429397 >> 172.21.15.50:0/4284429397 conn(0x55b11688dcc0 msgr2=0x55b1169619d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:22.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.671+0000 7f7aa5ffb700 0 client.25480 ms_handle_reset on v2:172.21.15.122:6836/1604366318 2024-06-06T03:29:22.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.671+0000 7f7acf0b4b80 1 -- 172.21.15.50:0/4284429397 shutdown_connections 2024-06-06T03:29:22.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.671+0000 7f7acf0b4b80 1 -- 172.21.15.50:0/4284429397 wait complete. 2024-06-06T03:29:22.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.672+0000 7f7acf0b4b80 20 client.25480 trim_cache size 0 max 16384 2024-06-06T03:29:22.673 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:29:22.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.674+0000 7f7ac4831700 1 -- 172.21.15.50:0/2608703583 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7aa80a2ca0 msgr2=0x7f7aa80a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:22.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.674+0000 7f7ac4831700 1 --2- 172.21.15.50:0/2608703583 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7aa80a2ca0 0x7f7aa80a5160 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0078a60 tx=0x7f7ab4009260 comp rx=0 tx=0).stop 2024-06-06T03:29:22.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.674+0000 7f7ac4831700 1 -- 172.21.15.50:0/2608703583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ac006a170 msgr2=0x7f7ac019e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:22.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.674+0000 7f7ac4831700 1 --2- 172.21.15.50:0/2608703583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ac006a170 0x7f7ac019e850 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0000c00 tx=0x7f7ab0004790 comp rx=0 tx=0).stop 2024-06-06T03:29:22.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.674+0000 7f7ac4831700 1 -- 172.21.15.50:0/2608703583 shutdown_connections 2024-06-06T03:29:22.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.674+0000 7f7ac4831700 1 --2- 172.21.15.50:0/2608703583 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7aa80a2ca0 0x7f7aa80a5160 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.674+0000 7f7ac4831700 1 --2- 172.21.15.50:0/2608703583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ac0108500 0x7f7ac0198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.674+0000 7f7ac4831700 1 --2- 172.21.15.50:0/2608703583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ac006a170 0x7f7ac019e850 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.674+0000 7f7ac4831700 1 --2- 172.21.15.50:0/2608703583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ac006ab30 0x7f7ac019ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:22.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.674+0000 7f7ac4831700 1 -- 172.21.15.50:0/2608703583 >> 172.21.15.50:0/2608703583 conn(0x7f7ac0078340 msgr2=0x7f7ac0100260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:22.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.674+0000 7f7ac4831700 1 -- 172.21.15.50:0/2608703583 shutdown_connections 2024-06-06T03:29:22.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:22.674+0000 7f7ac4831700 1 -- 172.21.15.50:0/2608703583 wait complete. 2024-06-06T03:29:23.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:23 smithi079 ceph-mon[35478]: pgmap v513: 129 pgs: 129 active+clean; 10 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 44 MiB/s wr, 716 op/s 2024-06-06T03:29:23.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:23 smithi122 ceph-mon[35759]: pgmap v513: 129 pgs: 129 active+clean; 10 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 44 MiB/s wr, 716 op/s 2024-06-06T03:29:23.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:23 smithi050 ceph-mon[32421]: pgmap v513: 129 pgs: 129 active+clean; 10 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 44 MiB/s wr, 716 op/s 2024-06-06T03:29:23.555 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-06-06T03:29:24.017 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:29:25.113 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:25 smithi050 ceph-mon[32421]: pgmap v514: 129 pgs: 129 active+clean; 10 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 48 MiB/s wr, 778 op/s 2024-06-06T03:29:25.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:25 smithi079 ceph-mon[35478]: pgmap v514: 129 pgs: 129 active+clean; 10 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 48 MiB/s wr, 778 op/s 2024-06-06T03:29:25.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:25 smithi122 ceph-mon[35759]: pgmap v514: 129 pgs: 129 active+clean; 10 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 48 MiB/s wr, 778 op/s 2024-06-06T03:29:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.123+0000 7f27c159a700 1 -- 172.21.15.50:0/1274188189 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b400b760 con 0x7f27c4102740 2024-06-06T03:29:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.124+0000 7f27c8983700 1 -- 172.21.15.50:0/1274188189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27c4102740 msgr2=0x7f27c4102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.124+0000 7f27c8983700 1 --2- 172.21.15.50:0/1274188189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27c4102740 0x7f27c4102b20 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f27b4009920 tx=0x7f27b4009c30 comp rx=0 tx=0).stop 2024-06-06T03:29:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.124+0000 7f27c8983700 1 -- 172.21.15.50:0/1274188189 shutdown_connections 2024-06-06T03:29:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.124+0000 7f27c8983700 1 --2- 172.21.15.50:0/1274188189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27c4107840 0x7f27c410f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.124+0000 7f27c8983700 1 --2- 172.21.15.50:0/1274188189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27c4102740 0x7f27c4102b20 secure :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f27b4009920 tx=0x7f27b4009c30 comp rx=0 tx=0).stop 2024-06-06T03:29:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.124+0000 7f27c8983700 1 --2- 172.21.15.50:0/1274188189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27c41030f0 0x7f27c4107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.124+0000 7f27c8983700 1 -- 172.21.15.50:0/1274188189 >> 172.21.15.50:0/1274188189 conn(0x7f27c40795f0 msgr2=0x7f27c4079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.124+0000 7f27c8983700 1 -- 172.21.15.50:0/1274188189 shutdown_connections 2024-06-06T03:29:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.124+0000 7f27c8983700 1 -- 172.21.15.50:0/1274188189 wait complete. 2024-06-06T03:29:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.125+0000 7f27c8983700 1 Processor -- start 2024-06-06T03:29:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.125+0000 7f27c8983700 1 -- start start 2024-06-06T03:29:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.126+0000 7f27c8983700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27c41030f0 0x7f27c4073e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.126+0000 7f27c8983700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27c4107840 0x7f27c406cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.126+0000 7f27c8983700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27c406d440 0x7f27c406d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.126+0000 7f27c8983700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f27c4112740 con 0x7f27c41030f0 2024-06-06T03:29:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.126+0000 7f27c8983700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f27c41125c0 con 0x7f27c406d440 2024-06-06T03:29:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.126+0000 7f27c8983700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f27c41128c0 con 0x7f27c4107840 2024-06-06T03:29:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.126+0000 7f27c259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27c41030f0 0x7f27c4073e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.126+0000 7f27c259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27c41030f0 0x7f27c4073e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56588/0 (socket says 172.21.15.50:56588) 2024-06-06T03:29:26.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.126+0000 7f27c259c700 1 -- 172.21.15.50:0/2857969101 learned_addr learned my addr 172.21.15.50:0/2857969101 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:26.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.126+0000 7f27c2d9d700 1 --2- 172.21.15.50:0/2857969101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27c406d440 0x7f27c406d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:26.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.126+0000 7f27c1d9b700 1 --2- 172.21.15.50:0/2857969101 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27c4107840 0x7f27c406cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:26.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.127+0000 7f27c259c700 1 -- 172.21.15.50:0/2857969101 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27c4107840 msgr2=0x7f27c406cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:26.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.127+0000 7f27c259c700 1 --2- 172.21.15.50:0/2857969101 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27c4107840 0x7f27c406cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:26.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.127+0000 7f27c259c700 1 -- 172.21.15.50:0/2857969101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27c406d440 msgr2=0x7f27c406d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:26.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.127+0000 7f27c259c700 1 --2- 172.21.15.50:0/2857969101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27c406d440 0x7f27c406d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:26.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.127+0000 7f27c259c700 1 -- 172.21.15.50:0/2857969101 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c4071ad0 con 0x7f27c41030f0 2024-06-06T03:29:26.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.127+0000 7f27c259c700 1 --2- 172.21.15.50:0/2857969101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27c41030f0 0x7f27c4073e70 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f27b4000c00 tx=0x7f27b4005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:26.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.127+0000 7f27bb7fe700 1 -- 172.21.15.50:0/2857969101 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b4005680 con 0x7f27c41030f0 2024-06-06T03:29:26.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.128+0000 7f27bb7fe700 1 -- 172.21.15.50:0/2857969101 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f27b400ba10 con 0x7f27c41030f0 2024-06-06T03:29:26.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.128+0000 7f27bb7fe700 1 -- 172.21.15.50:0/2857969101 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b4005680 con 0x7f27c41030f0 2024-06-06T03:29:26.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.128+0000 7f27c8983700 1 -- 172.21.15.50:0/2857969101 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27c4071d60 con 0x7f27c41030f0 2024-06-06T03:29:26.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.128+0000 7f27c8983700 1 -- 172.21.15.50:0/2857969101 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27c40721f0 con 0x7f27c41030f0 2024-06-06T03:29:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.132+0000 7f27bb7fe700 1 -- 172.21.15.50:0/2857969101 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f27b4003710 con 0x7f27c41030f0 2024-06-06T03:29:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.134+0000 7f27bb7fe700 1 --2- 172.21.15.50:0/2857969101 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f27b00a3050 0x7f27b00a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.134+0000 7f27bb7fe700 1 -- 172.21.15.50:0/2857969101 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f27b4005480 con 0x7f27c41030f0 2024-06-06T03:29:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.134+0000 7f27c1d9b700 1 --2- 172.21.15.50:0/2857969101 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f27b00a3050 0x7f27b00a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.135+0000 7f27c1d9b700 1 --2- 172.21.15.50:0/2857969101 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f27b00a3050 0x7f27b00a5510 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f27c406e6c0 tx=0x7f27ac009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:26.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.137+0000 7f27d3206b80 1 Processor -- start 2024-06-06T03:29:26.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.138+0000 7f27d3206b80 1 -- start start 2024-06-06T03:29:26.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.138+0000 7f27d3206b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558020f93f60 0x558020f94340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:26.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.138+0000 7f27d3206b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558020f94880 0x558020f8e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:26.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.138+0000 7f27d3206b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558020f8e7a0 0x558020f8ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.139+0000 7f27d3206b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558020e80f60 con 0x558020f8e7a0 2024-06-06T03:29:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.139+0000 7f27d3206b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558020edf850 con 0x558020f94880 2024-06-06T03:29:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.139+0000 7f27d3206b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558020e47460 con 0x558020f93f60 2024-06-06T03:29:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.139+0000 7f27c1d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558020f94880 0x558020f8e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.139+0000 7f27c1d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558020f94880 0x558020f8e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:48950/0 (socket says 172.21.15.50:48950) 2024-06-06T03:29:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.139+0000 7f27c1d9b700 1 -- 172.21.15.50:0/2901039116 learned_addr learned my addr 172.21.15.50:0/2901039116 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.139+0000 7f27c259c700 1 --2- 172.21.15.50:0/2901039116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558020f93f60 0x558020f94340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.139+0000 7f27c2d9d700 1 --2- 172.21.15.50:0/2901039116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558020f8e7a0 0x558020f8ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.139+0000 7f27c1d9b700 1 -- 172.21.15.50:0/2901039116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558020f93f60 msgr2=0x558020f94340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.139+0000 7f27c1d9b700 1 --2- 172.21.15.50:0/2901039116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558020f93f60 0x558020f94340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.139+0000 7f27c1d9b700 1 -- 172.21.15.50:0/2901039116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558020f8e7a0 msgr2=0x558020f8ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.139+0000 7f27c1d9b700 1 --2- 172.21.15.50:0/2901039116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558020f8e7a0 0x558020f8ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.139+0000 7f27c1d9b700 1 -- 172.21.15.50:0/2901039116 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558020e2e8d0 con 0x558020f94880 2024-06-06T03:29:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.139+0000 7f27c259c700 1 --2- 172.21.15.50:0/2901039116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558020f93f60 0x558020f94340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:29:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.140+0000 7f27c1d9b700 1 --2- 172.21.15.50:0/2901039116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558020f94880 0x558020f8e260 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00e9b0 tx=0x7f27ac011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b575c3643709afe0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:26.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.141+0000 7f27b8ff9700 1 -- 172.21.15.50:0/2901039116 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ac01b040 con 0x558020f94880 2024-06-06T03:29:26.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.141+0000 7f27b8ff9700 1 -- 172.21.15.50:0/2901039116 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f27ac024070 con 0x558020f94880 2024-06-06T03:29:26.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.141+0000 7f27b8ff9700 1 -- 172.21.15.50:0/2901039116 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ac0136b0 con 0x558020f94880 2024-06-06T03:29:26.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.142+0000 7f27d3206b80 1 -- 172.21.15.50:0/2901039116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558020f94880 msgr2=0x558020f8e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:26.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.142+0000 7f27d3206b80 1 --2- 172.21.15.50:0/2901039116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558020f94880 0x558020f8e260 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00e9b0 tx=0x7f27ac011000 comp rx=0 tx=0).stop 2024-06-06T03:29:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.144+0000 7f27d3206b80 1 -- 172.21.15.50:0/2901039116 shutdown_connections 2024-06-06T03:29:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.144+0000 7f27d3206b80 1 --2- 172.21.15.50:0/2901039116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558020f8e7a0 0x558020f8ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.144+0000 7f27d3206b80 1 --2- 172.21.15.50:0/2901039116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558020f93f60 0x558020f94340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.144+0000 7f27d3206b80 1 --2- 172.21.15.50:0/2901039116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558020f94880 0x558020f8e260 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.144+0000 7f27d3206b80 1 -- 172.21.15.50:0/2901039116 >> 172.21.15.50:0/2901039116 conn(0x558020ebb080 msgr2=0x558020f89220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:26.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.146+0000 7f27d3206b80 1 -- 172.21.15.50:0/2901039116 shutdown_connections 2024-06-06T03:29:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.147+0000 7f27d3206b80 1 -- 172.21.15.50:0/2901039116 wait complete. 2024-06-06T03:29:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.147+0000 7f27d3206b80 1 -- start start 2024-06-06T03:29:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.147+0000 7f27d3206b80 1 Processor -- start 2024-06-06T03:29:26.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.149+0000 7f27d3206b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558020f8e7a0 0x558020f9a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:26.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.149+0000 7f27d3206b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558020f93f60 0x558020f97990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:26.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.149+0000 7f27d3206b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558020f94880 0x558020f97ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:26.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.149+0000 7f27d3206b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558020e7ffc0 con 0x558020f93f60 2024-06-06T03:29:26.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.149+0000 7f27d3206b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558020edb810 con 0x558020f94880 2024-06-06T03:29:26.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.149+0000 7f27d3206b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558020f9b260 con 0x558020f8e7a0 2024-06-06T03:29:26.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.149+0000 7f27c259c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558020f8e7a0 0x558020f9a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:26.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.149+0000 7f27c259c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558020f8e7a0 0x558020f9a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:46242/0 (socket says 172.21.15.50:46242) 2024-06-06T03:29:26.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.149+0000 7f27c259c700 1 -- 172.21.15.50:0/1982456154 learned_addr learned my addr 172.21.15.50:0/1982456154 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:26.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.149+0000 7f27d3206b80 10 client.0 _ll_register_callbacks cb 0x558020e755b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:29:26.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.150+0000 7f27c1d9b700 1 --2- 172.21.15.50:0/1982456154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558020f93f60 0x558020f97990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:26.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.151+0000 7f27c2d9d700 1 --2- 172.21.15.50:0/1982456154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558020f94880 0x558020f97ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:26.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.151+0000 7f27c2d9d700 1 -- 172.21.15.50:0/1982456154 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558020f8e7a0 msgr2=0x558020f9a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:26.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.151+0000 7f27c2d9d700 1 --2- 172.21.15.50:0/1982456154 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558020f8e7a0 0x558020f9a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:26.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.151+0000 7f27c2d9d700 1 -- 172.21.15.50:0/1982456154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558020f93f60 msgr2=0x558020f97990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:26.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.151+0000 7f27c2d9d700 1 --2- 172.21.15.50:0/1982456154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558020f93f60 0x558020f97990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:26.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.152+0000 7f27c2d9d700 1 -- 172.21.15.50:0/1982456154 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558020ea5750 con 0x558020f94880 2024-06-06T03:29:26.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.152+0000 7f27c1d9b700 1 --2- 172.21.15.50:0/1982456154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558020f93f60 0x558020f97990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:29:26.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.154+0000 7f27c2d9d700 1 --2- 172.21.15.50:0/1982456154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558020f94880 0x558020f97ed0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f27bc012e40 tx=0x7f27bc014600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4780471dcf79f6f7 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:26.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.154+0000 7f27a9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:29:26.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.154+0000 7f27a9ffb700 1 -- 172.21.15.50:0/1982456154 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27bc0090d0 con 0x558020f94880 2024-06-06T03:29:26.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.154+0000 7f27a9ffb700 1 -- 172.21.15.50:0/1982456154 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f27bc009270 con 0x558020f94880 2024-06-06T03:29:26.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.155+0000 7f27d3206b80 1 -- 172.21.15.50:0/1982456154 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27ac024070 con 0x558020f94880 2024-06-06T03:29:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.157+0000 7f27a9ffb700 1 -- 172.21.15.50:0/1982456154 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f27bc003a00 con 0x558020f94880 2024-06-06T03:29:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.157+0000 7f27d3206b80 10 client.25493 fetch_fsmap learned FSMap version 29 2024-06-06T03:29:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.157+0000 7f27d3206b80 1 -- 172.21.15.50:0/1982456154 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558020fae2b0 con 0x558020f94880 2024-06-06T03:29:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.157+0000 7f27a9ffb700 1 -- 172.21.15.50:0/1982456154 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f27bc009470 con 0x558020f94880 2024-06-06T03:29:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.157+0000 7f27a9ffb700 1 -- 172.21.15.50:0/1982456154 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f27bc004050 con 0x558020f94880 2024-06-06T03:29:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.159+0000 7f27d3206b80 10 client.25493 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:29:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.159+0000 7f27d3206b80 10 client.25493 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:29:26.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.159+0000 7f27d3206b80 20 client.25493 populate_metadata read hostname 'smithi050' 2024-06-06T03:29:26.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.159+0000 7f27d3206b80 1 --2- 172.21.15.50:0/1982456154 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x558020fb08f0 0x558020fb2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:26.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.159+0000 7f27d3206b80 4 client.25493 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:29:26.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.159+0000 7f27d3206b80 1 -- 172.21.15.50:0/1982456154 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f27ac024070 con 0x558020fb08f0 2024-06-06T03:29:26.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.159+0000 7f27c259c700 1 --2- 172.21.15.50:0/1982456154 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x558020fb08f0 0x558020fb2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:26.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.160+0000 7f27c259c700 1 --2- 172.21.15.50:0/1982456154 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x558020fb08f0 0x558020fb2ce0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=177e1a30d1dafeea server_cookie=3706a502ce5cf79c in_seq=0 out_seq=0 2024-06-06T03:29:26.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.160+0000 7f27a9ffb700 10 client.25493 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:26.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.161+0000 7f27a9ffb700 1 -- 172.21.15.50:0/1982456154 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x7f27ac024070 con 0x558020fb08f0 2024-06-06T03:29:26.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.161+0000 7f27a9ffb700 10 client.25493 handle_command_reply: tid=0 2024-06-06T03:29:26.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.161+0000 7f27d3206b80 1 client.25493 shutdown 2024-06-06T03:29:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.162+0000 7f27d3206b80 1 -- 172.21.15.50:0/1982456154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558020f94880 msgr2=0x558020f97ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.162+0000 7f27d3206b80 1 --2- 172.21.15.50:0/1982456154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558020f94880 0x558020f97ed0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f27bc012e40 tx=0x7f27bc014600 comp rx=0 tx=0).stop 2024-06-06T03:29:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.162+0000 7f27d3206b80 1 -- 172.21.15.50:0/1982456154 shutdown_connections 2024-06-06T03:29:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.162+0000 7f27d3206b80 1 --2- 172.21.15.50:0/1982456154 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x558020fb08f0 0x558020fb2ce0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.162+0000 7f27d3206b80 1 --2- 172.21.15.50:0/1982456154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558020f94880 0x558020f97ed0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.162+0000 7f27d3206b80 1 --2- 172.21.15.50:0/1982456154 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558020f8e7a0 0x558020f9a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.162+0000 7f27d3206b80 1 --2- 172.21.15.50:0/1982456154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558020f93f60 0x558020f97990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:26.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.162+0000 7f27d3206b80 1 -- 172.21.15.50:0/1982456154 >> 172.21.15.50:0/1982456154 conn(0x558020ebb080 msgr2=0x558020f88700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:26.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.162+0000 7f27a9ffb700 0 client.25493 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:26.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.162+0000 7f27d3206b80 1 -- 172.21.15.50:0/1982456154 shutdown_connections 2024-06-06T03:29:26.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.162+0000 7f27d3206b80 1 -- 172.21.15.50:0/1982456154 wait complete. 2024-06-06T03:29:26.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.163+0000 7f27d3206b80 20 client.25493 trim_cache size 0 max 16384 2024-06-06T03:29:26.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.194+0000 7f27d3206b80 1 Processor -- start 2024-06-06T03:29:26.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.194+0000 7f27d3206b80 1 -- start start 2024-06-06T03:29:26.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.195+0000 7f27d3206b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558020f8e7a0 0x558020f8e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:26.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.195+0000 7f27d3206b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558020f93f60 0x558020f88e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:26.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.195+0000 7f27d3206b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558020f94880 0x558020f893c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:26.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.195+0000 7f27d3206b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f27c41b77c0 con 0x558020f8e7a0 2024-06-06T03:29:26.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.195+0000 7f27d3206b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f27c41b5050 con 0x558020f94880 2024-06-06T03:29:26.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.195+0000 7f27d3206b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f27c41b2ec0 con 0x558020f93f60 2024-06-06T03:29:26.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.196+0000 7f27c259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558020f8e7a0 0x558020f8e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:26.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.196+0000 7f27c259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558020f8e7a0 0x558020f8e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56606/0 (socket says 172.21.15.50:56606) 2024-06-06T03:29:26.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.196+0000 7f27c259c700 1 -- 172.21.15.50:0/1008213010 learned_addr learned my addr 172.21.15.50:0/1008213010 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:26.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.197+0000 7f27c1d9b700 1 --2- 172.21.15.50:0/1008213010 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558020f93f60 0x558020f88e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:26.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.197+0000 7f27c259c700 1 -- 172.21.15.50:0/1008213010 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558020f93f60 msgr2=0x558020f88e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:26.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.197+0000 7f27c259c700 1 --2- 172.21.15.50:0/1008213010 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558020f93f60 0x558020f88e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:26.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.197+0000 7f27c259c700 1 -- 172.21.15.50:0/1008213010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558020f94880 msgr2=0x558020f893c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:26.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.197+0000 7f27c259c700 1 --2- 172.21.15.50:0/1008213010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558020f94880 0x558020f893c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:26.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.197+0000 7f27c259c700 1 -- 172.21.15.50:0/1008213010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558020f85810 con 0x558020f8e7a0 2024-06-06T03:29:26.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.198+0000 7f27c259c700 1 --2- 172.21.15.50:0/1008213010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558020f8e7a0 0x558020f8e260 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f27b409c3c0 tx=0x7f27b40bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92075773f7e2469 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:26.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.199+0000 7f27abfff700 1 -- 172.21.15.50:0/1008213010 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b409c430 con 0x558020f8e7a0 2024-06-06T03:29:26.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.199+0000 7f27abfff700 1 -- 172.21.15.50:0/1008213010 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f27b40b5070 con 0x558020f8e7a0 2024-06-06T03:29:26.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.199+0000 7f27abfff700 1 -- 172.21.15.50:0/1008213010 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b409a540 con 0x558020f8e7a0 2024-06-06T03:29:26.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.200+0000 7f27d3206b80 1 -- 172.21.15.50:0/1008213010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558020f8e7a0 msgr2=0x558020f8e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:26.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.200+0000 7f27d3206b80 1 --2- 172.21.15.50:0/1008213010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558020f8e7a0 0x558020f8e260 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f27b409c3c0 tx=0x7f27b40bc040 comp rx=0 tx=0).stop 2024-06-06T03:29:26.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.200+0000 7f27d3206b80 1 -- 172.21.15.50:0/1008213010 shutdown_connections 2024-06-06T03:29:26.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.200+0000 7f27d3206b80 1 --2- 172.21.15.50:0/1008213010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558020f94880 0x558020f893c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:26.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.200+0000 7f27d3206b80 1 --2- 172.21.15.50:0/1008213010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558020f8e7a0 0x558020f8e260 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:26.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.200+0000 7f27d3206b80 1 --2- 172.21.15.50:0/1008213010 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558020f93f60 0x558020f88e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:26.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.200+0000 7f27d3206b80 1 -- 172.21.15.50:0/1008213010 >> 172.21.15.50:0/1008213010 conn(0x558020ebb080 msgr2=0x558020f96280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:26.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.201+0000 7f27d3206b80 1 -- 172.21.15.50:0/1008213010 shutdown_connections 2024-06-06T03:29:26.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.201+0000 7f27d3206b80 1 -- 172.21.15.50:0/1008213010 wait complete. 2024-06-06T03:29:26.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.202+0000 7f27d3206b80 1 -- start start 2024-06-06T03:29:26.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.202+0000 7f27d3206b80 1 Processor -- start 2024-06-06T03:29:26.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.202+0000 7f27d3206b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558020f8e7a0 0x558020fa8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:26.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.203+0000 7f27d3206b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558020f93f60 0x558020fa94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:26.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.203+0000 7f27d3206b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558020f94880 0x558020fb7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:26.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.203+0000 7f27d3206b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f27c41b3510 con 0x558020f8e7a0 2024-06-06T03:29:26.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.203+0000 7f27d3206b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f27c41b4980 con 0x558020f94880 2024-06-06T03:29:26.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.203+0000 7f27d3206b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f27c41b3be0 con 0x558020f93f60 2024-06-06T03:29:26.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.203+0000 7f27d3206b80 10 client.0 _ll_register_callbacks cb 0x558020e755b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:29:26.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.203+0000 7f27c259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558020f8e7a0 0x558020fa8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:26.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.203+0000 7f27c259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558020f8e7a0 0x558020fa8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56618/0 (socket says 172.21.15.50:56618) 2024-06-06T03:29:26.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.203+0000 7f27c259c700 1 -- 172.21.15.50:0/711540959 learned_addr learned my addr 172.21.15.50:0/711540959 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:26.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.204+0000 7f27c1d9b700 1 --2- 172.21.15.50:0/711540959 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558020f93f60 0x558020fa94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:26.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.204+0000 7f27c2d9d700 1 --2- 172.21.15.50:0/711540959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558020f94880 0x558020fb7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:26.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.205+0000 7f27c1d9b700 1 -- 172.21.15.50:0/711540959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558020f94880 msgr2=0x558020fb7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:26.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.205+0000 7f27c1d9b700 1 --2- 172.21.15.50:0/711540959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558020f94880 0x558020fb7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:26.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.205+0000 7f27c1d9b700 1 -- 172.21.15.50:0/711540959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558020f8e7a0 msgr2=0x558020fa8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:26.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.205+0000 7f27c1d9b700 1 --2- 172.21.15.50:0/711540959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558020f8e7a0 0x558020fa8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:26.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.205+0000 7f27c1d9b700 1 -- 172.21.15.50:0/711540959 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558020fb7f80 con 0x558020f93f60 2024-06-06T03:29:26.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.206+0000 7f27c1d9b700 1 --2- 172.21.15.50:0/711540959 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558020f93f60 0x558020fa94d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f27ac015c60 tx=0x7f27ac009490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49143d067b1548f0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:26.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.206+0000 7f27a9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:29:26.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.206+0000 7f27a9ffb700 1 -- 172.21.15.50:0/711540959 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ac004590 con 0x558020f93f60 2024-06-06T03:29:26.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.206+0000 7f27a9ffb700 1 -- 172.21.15.50:0/711540959 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f27ac003740 con 0x558020f93f60 2024-06-06T03:29:26.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.206+0000 7f27d3206b80 1 -- 172.21.15.50:0/711540959 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27b40b5070 con 0x558020f93f60 2024-06-06T03:29:26.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.207+0000 7f27a9ffb700 1 -- 172.21.15.50:0/711540959 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f27ac03a050 con 0x558020f93f60 2024-06-06T03:29:26.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.207+0000 7f27d3206b80 10 client.25492 fetch_fsmap learned FSMap version 29 2024-06-06T03:29:26.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.207+0000 7f27d3206b80 1 -- 172.21.15.50:0/711540959 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55802101ae80 con 0x558020f93f60 2024-06-06T03:29:26.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.207+0000 7f27a9ffb700 1 -- 172.21.15.50:0/711540959 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f27b40b5070 con 0x558020f93f60 2024-06-06T03:29:26.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.209+0000 7f27a9ffb700 1 -- 172.21.15.50:0/711540959 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f27ac01e030 con 0x558020f93f60 2024-06-06T03:29:26.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.209+0000 7f27d3206b80 10 client.25492 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:29:26.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.209+0000 7f27d3206b80 10 client.25492 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:29:26.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.209+0000 7f27d3206b80 20 client.25492 populate_metadata read hostname 'smithi050' 2024-06-06T03:29:26.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.209+0000 7f27d3206b80 1 --2- 172.21.15.50:0/711540959 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55802101b530 0x55802101d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:26.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.209+0000 7f27d3206b80 4 client.25492 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:29:26.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.209+0000 7f27d3206b80 1 -- 172.21.15.50:0/711540959 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558020eecd50 con 0x55802101b530 2024-06-06T03:29:26.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.209+0000 7f27c259c700 1 --2- 172.21.15.50:0/711540959 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55802101b530 0x55802101d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:26.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.211+0000 7f27c259c700 1 --2- 172.21.15.50:0/711540959 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55802101b530 0x55802101d950 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ac1cd1b67fcc6bc server_cookie=3af081f39c062c4a in_seq=0 out_seq=0 2024-06-06T03:29:26.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.211+0000 7f27a9ffb700 10 client.25492 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:26.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.214+0000 7f27a9ffb700 1 -- 172.21.15.50:0/711540959 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558020eecd50 con 0x55802101b530 2024-06-06T03:29:26.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.214+0000 7f27a9ffb700 10 client.25492 handle_command_reply: tid=0 2024-06-06T03:29:26.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.215+0000 7f27d3206b80 1 client.25492 shutdown 2024-06-06T03:29:26.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.215+0000 7f27d3206b80 1 -- 172.21.15.50:0/711540959 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558020f93f60 msgr2=0x558020fa94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:26.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.215+0000 7f27d3206b80 1 --2- 172.21.15.50:0/711540959 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558020f93f60 0x558020fa94d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f27ac015c60 tx=0x7f27ac009490 comp rx=0 tx=0).stop 2024-06-06T03:29:26.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.217+0000 7f27d3206b80 1 -- 172.21.15.50:0/711540959 shutdown_connections 2024-06-06T03:29:26.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.217+0000 7f27d3206b80 1 --2- 172.21.15.50:0/711540959 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55802101b530 0x55802101d950 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:26.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.217+0000 7f27d3206b80 1 --2- 172.21.15.50:0/711540959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558020f94880 0x558020fb7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:26.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.217+0000 7f27d3206b80 1 --2- 172.21.15.50:0/711540959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558020f8e7a0 0x558020fa8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:26.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.217+0000 7f27d3206b80 1 --2- 172.21.15.50:0/711540959 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558020f93f60 0x558020fa94d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:26.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.217+0000 7f27d3206b80 1 -- 172.21.15.50:0/711540959 >> 172.21.15.50:0/711540959 conn(0x558020ebb080 msgr2=0x558020f94d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:26.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.217+0000 7f27a9ffb700 0 client.25492 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:26.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.219+0000 7f27d3206b80 1 -- 172.21.15.50:0/711540959 shutdown_connections 2024-06-06T03:29:26.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.219+0000 7f27d3206b80 1 -- 172.21.15.50:0/711540959 wait complete. 2024-06-06T03:29:26.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.219+0000 7f27d3206b80 20 client.25492 trim_cache size 0 max 16384 2024-06-06T03:29:26.220 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:29:26.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.220+0000 7f27c8983700 1 -- 172.21.15.50:0/2857969101 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f27b00a3050 msgr2=0x7f27b00a5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:26.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.220+0000 7f27c8983700 1 --2- 172.21.15.50:0/2857969101 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f27b00a3050 0x7f27b00a5510 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f27c406e6c0 tx=0x7f27ac009190 comp rx=0 tx=0).stop 2024-06-06T03:29:26.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.220+0000 7f27c8983700 1 -- 172.21.15.50:0/2857969101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27c41030f0 msgr2=0x7f27c4073e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:26.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.220+0000 7f27c8983700 1 --2- 172.21.15.50:0/2857969101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27c41030f0 0x7f27c4073e70 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f27b4000c00 tx=0x7f27b4005040 comp rx=0 tx=0).stop 2024-06-06T03:29:26.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.221+0000 7f27c8983700 1 -- 172.21.15.50:0/2857969101 shutdown_connections 2024-06-06T03:29:26.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.221+0000 7f27c8983700 1 --2- 172.21.15.50:0/2857969101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27c406d440 0x7f27c406d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:26.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.221+0000 7f27c8983700 1 --2- 172.21.15.50:0/2857969101 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f27b00a3050 0x7f27b00a5510 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:26.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.221+0000 7f27c8983700 1 --2- 172.21.15.50:0/2857969101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27c41030f0 0x7f27c4073e70 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:26.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.221+0000 7f27c8983700 1 --2- 172.21.15.50:0/2857969101 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27c4107840 0x7f27c406cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:26.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.221+0000 7f27c8983700 1 -- 172.21.15.50:0/2857969101 >> 172.21.15.50:0/2857969101 conn(0x7f27c40795f0 msgr2=0x7f27c41008c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:26.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.222+0000 7f27c8983700 1 -- 172.21.15.50:0/2857969101 shutdown_connections 2024-06-06T03:29:26.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:26.223+0000 7f27c8983700 1 -- 172.21.15.50:0/2857969101 wait complete. 2024-06-06T03:29:27.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:27 smithi050 ceph-mon[32421]: pgmap v515: 129 pgs: 129 active+clean; 10 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 54 MiB/s wr, 870 op/s 2024-06-06T03:29:27.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:27 smithi079 ceph-mon[35478]: pgmap v515: 129 pgs: 129 active+clean; 10 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 54 MiB/s wr, 870 op/s 2024-06-06T03:29:27.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:27 smithi122 ceph-mon[35759]: pgmap v515: 129 pgs: 129 active+clean; 10 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 54 MiB/s wr, 870 op/s 2024-06-06T03:29:28.054 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-06T03:29:28.055 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-06-06T03:29:28.507 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:29:28.806 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.806+0000 7f4fa24bc640 1 -- 172.21.15.50:0/1689723066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f9c108c10 msgr2=0x7f4f9c10b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:28.807 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.806+0000 7f4fa24bc640 1 --2- 172.21.15.50:0/1689723066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f9c108c10 0x7f4f9c10b000 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4f94009900 tx=0x7f4f9402a580 comp rx=0 tx=0).stop 2024-06-06T03:29:28.807 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.807+0000 7f4fa24bc640 1 -- 172.21.15.50:0/1689723066 shutdown_connections 2024-06-06T03:29:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.807+0000 7f4fa24bc640 1 --2- 172.21.15.50:0/1689723066 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f9c10e0b0 0x7f4f9c110570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.807+0000 7f4fa24bc640 1 --2- 172.21.15.50:0/1689723066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f9c10b5d0 0x7f4f9c10da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.807+0000 7f4fa24bc640 1 --2- 172.21.15.50:0/1689723066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f9c108c10 0x7f4f9c10b000 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.807+0000 7f4fa24bc640 1 -- 172.21.15.50:0/1689723066 >> 172.21.15.50:0/1689723066 conn(0x7f4f9c06ebd0 msgr2=0x7f4f9c071010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.808+0000 7f4fa24bc640 1 -- 172.21.15.50:0/1689723066 shutdown_connections 2024-06-06T03:29:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.808+0000 7f4fa24bc640 1 -- 172.21.15.50:0/1689723066 wait complete. 2024-06-06T03:29:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.809+0000 7f4fa24bc640 1 Processor -- start 2024-06-06T03:29:28.809 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.809+0000 7f4fa24bc640 1 -- start start 2024-06-06T03:29:28.809 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.809+0000 7f4fa24bc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f9c108c10 0x7f4f9c1a6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:28.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.809+0000 7f4fa24bc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f9c10b5d0 0x7f4f9c1a6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:28.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.809+0000 7f4fa24bc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f9c10e0b0 0x7f4f9c1add70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:28.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.809+0000 7f4fa24bc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c113b90 con 0x7f4f9c108c10 2024-06-06T03:29:28.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.809+0000 7f4fa24bc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c113a10 con 0x7f4f9c10e0b0 2024-06-06T03:29:28.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.809+0000 7f4fa24bc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c113d10 con 0x7f4f9c10b5d0 2024-06-06T03:29:28.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.810+0000 7f4f9bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f9c108c10 0x7f4f9c1a6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:28.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.810+0000 7f4fa0a59640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f9c10e0b0 0x7f4f9c1add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:28.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.810+0000 7f4f9bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f9c108c10 0x7f4f9c1a6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33706/0 (socket says 172.21.15.50:33706) 2024-06-06T03:29:28.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.810+0000 7f4f9bfff640 1 -- 172.21.15.50:0/2468008847 learned_addr learned my addr 172.21.15.50:0/2468008847 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:28.811 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.811+0000 7f4f9bfff640 1 -- 172.21.15.50:0/2468008847 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f9c10b5d0 msgr2=0x7f4f9c1a6d50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-06T03:29:28.811 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.811+0000 7f4f9bfff640 1 --2- 172.21.15.50:0/2468008847 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f9c10b5d0 0x7f4f9c1a6d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:28.811 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.811+0000 7f4f9bfff640 1 -- 172.21.15.50:0/2468008847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f9c10e0b0 msgr2=0x7f4f9c1add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:28.811 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.811+0000 7f4f9bfff640 1 --2- 172.21.15.50:0/2468008847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f9c10e0b0 0x7f4f9c1add70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:28.811 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.811+0000 7f4f9bfff640 1 -- 172.21.15.50:0/2468008847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9c19dd50 con 0x7f4f9c108c10 2024-06-06T03:29:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.811+0000 7f4fa0a59640 1 --2- 172.21.15.50:0/2468008847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f9c10e0b0 0x7f4f9c1add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:29:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.811+0000 7f4f9bfff640 1 --2- 172.21.15.50:0/2468008847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f9c108c10 0x7f4f9c1a6810 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4f94009850 tx=0x7f4f94031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.812+0000 7f4f997fa640 1 -- 172.21.15.50:0/2468008847 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f94040070 con 0x7f4f9c108c10 2024-06-06T03:29:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.812+0000 7f4f997fa640 1 -- 172.21.15.50:0/2468008847 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4f94004040 con 0x7f4f9c108c10 2024-06-06T03:29:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.812+0000 7f4f997fa640 1 -- 172.21.15.50:0/2468008847 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f940456c0 con 0x7f4f9c108c10 2024-06-06T03:29:28.813 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.812+0000 7f4fa24bc640 1 -- 172.21.15.50:0/2468008847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f9c19dfe0 con 0x7f4f9c108c10 2024-06-06T03:29:28.813 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.812+0000 7f4fa24bc640 1 -- 172.21.15.50:0/2468008847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f9c19e480 con 0x7f4f9c108c10 2024-06-06T03:29:28.816 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.817+0000 7f4fa51c5740 1 Processor -- start 2024-06-06T03:29:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.817+0000 7f4fa51c5740 1 -- start start 2024-06-06T03:29:28.818 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.818+0000 7f4fa51c5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55addb59b000 0x55addb59b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:28.818 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.818+0000 7f4fa51c5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55addb59b9f0 0x55addb5a04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:28.818 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.818+0000 7f4fa51c5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55addb5a0b60 0x55addb5a2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:28.818 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.818+0000 7f4fa51c5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55addb4fe4f0 con 0x55addb5a0b60 2024-06-06T03:29:28.818 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.818+0000 7f4fa51c5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55addb49c870 con 0x55addb59b000 2024-06-06T03:29:28.818 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.818+0000 7f4fa51c5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55addb4fa4b0 con 0x55addb59b9f0 2024-06-06T03:29:28.818 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.818+0000 7f4fa0a59640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55addb59b000 0x55addb59b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:28.819 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.818+0000 7f4fa0a59640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55addb59b000 0x55addb59b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:44742/0 (socket says 172.21.15.50:44742) 2024-06-06T03:29:28.819 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.818+0000 7f4fa0a59640 1 -- 172.21.15.50:0/1703791744 learned_addr learned my addr 172.21.15.50:0/1703791744 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:28.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.818+0000 7f4f9b7fe640 1 --2- 172.21.15.50:0/1703791744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55addb5a0b60 0x55addb5a2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:28.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.819+0000 7f4f997fa640 1 -- 172.21.15.50:0/2468008847 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4f94039040 con 0x7f4f9c108c10 2024-06-06T03:29:28.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.819+0000 7f4f9bfff640 1 --2- 172.21.15.50:0/1703791744 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55addb59b9f0 0x55addb5a04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:28.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.819+0000 7f4fa0a59640 1 -- 172.21.15.50:0/1703791744 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55addb59b9f0 msgr2=0x55addb5a04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:28.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.819+0000 7f4fa0a59640 1 --2- 172.21.15.50:0/1703791744 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55addb59b9f0 0x55addb5a04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:28.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.819+0000 7f4fa0a59640 1 -- 172.21.15.50:0/1703791744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55addb5a0b60 msgr2=0x55addb5a2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:28.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.819+0000 7f4fa0a59640 1 --2- 172.21.15.50:0/1703791744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55addb5a0b60 0x55addb5a2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:28.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.819+0000 7f4fa0a59640 1 -- 172.21.15.50:0/1703791744 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55addb4b89b0 con 0x55addb59b000 2024-06-06T03:29:28.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.820+0000 7f4f997fa640 1 --2- 172.21.15.50:0/2468008847 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4f840a2e60 0x7f4f840a5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:28.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.820+0000 7f4fa0a59640 1 --2- 172.21.15.50:0/1703791744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55addb59b000 0x55addb59b420 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c011540 tx=0x7f4f8c011a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8132b2824a026fa5 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:28.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.820+0000 7f4f997fa640 1 -- 172.21.15.50:0/2468008847 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f4f940f0880 con 0x7f4f9c108c10 2024-06-06T03:29:28.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.821+0000 7f4f9bfff640 1 --2- 172.21.15.50:0/2468008847 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4f840a2e60 0x7f4f840a5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:28.822 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.821+0000 7f4f9bfff640 1 --2- 172.21.15.50:0/2468008847 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4f840a2e60 0x7f4f840a5320 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4f940b9ad0 tx=0x7f4f94009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:28.822 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.821+0000 7f4f81ffb640 1 -- 172.21.15.50:0/1703791744 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c00f5c0 con 0x55addb59b000 2024-06-06T03:29:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.821+0000 7f4f81ffb640 1 -- 172.21.15.50:0/1703791744 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4f8c00fc10 con 0x55addb59b000 2024-06-06T03:29:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.821+0000 7f4f81ffb640 1 -- 172.21.15.50:0/1703791744 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c019cb0 con 0x55addb59b000 2024-06-06T03:29:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.823+0000 7f4fa51c5740 1 -- 172.21.15.50:0/1703791744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55addb59b000 msgr2=0x55addb59b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.823+0000 7f4fa51c5740 1 --2- 172.21.15.50:0/1703791744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55addb59b000 0x55addb59b420 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c011540 tx=0x7f4f8c011a00 comp rx=0 tx=0).stop 2024-06-06T03:29:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.823+0000 7f4fa51c5740 1 -- 172.21.15.50:0/1703791744 shutdown_connections 2024-06-06T03:29:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.823+0000 7f4fa51c5740 1 --2- 172.21.15.50:0/1703791744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55addb5a0b60 0x55addb5a2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.823+0000 7f4fa51c5740 1 --2- 172.21.15.50:0/1703791744 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55addb59b9f0 0x55addb5a04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.823+0000 7f4fa51c5740 1 --2- 172.21.15.50:0/1703791744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55addb59b000 0x55addb59b420 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.823+0000 7f4fa51c5740 1 -- 172.21.15.50:0/1703791744 >> 172.21.15.50:0/1703791744 conn(0x55addb596960 msgr2=0x55addb596d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:28.824 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.823+0000 7f4fa51c5740 1 -- 172.21.15.50:0/1703791744 shutdown_connections 2024-06-06T03:29:28.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.823+0000 7f4fa51c5740 1 -- 172.21.15.50:0/1703791744 wait complete. 2024-06-06T03:29:28.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.824+0000 7f4fa51c5740 1 -- start start 2024-06-06T03:29:28.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.824+0000 7f4fa51c5740 1 Processor -- start 2024-06-06T03:29:28.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.825+0000 7f4fa51c5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55addb59b000 0x55addb5a5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:28.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.825+0000 7f4fa51c5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55addb59b9f0 0x55addb5a5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:28.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.825+0000 7f4fa51c5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55addb5a0b60 0x55addb5ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:28.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.825+0000 7f4fa51c5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55addb5a3b10 con 0x55addb5a0b60 2024-06-06T03:29:28.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.825+0000 7f4fa51c5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55addb487ae0 con 0x55addb59b9f0 2024-06-06T03:29:28.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.825+0000 7f4fa51c5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55addb5a3c90 con 0x55addb59b000 2024-06-06T03:29:28.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.825+0000 7f4fa51c5740 10 client.0 _ll_register_callbacks cb 0x55addb4c09b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:29:28.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.826+0000 7f4f9b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55addb59b9f0 0x55addb5a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:28.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.826+0000 7f4f9b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55addb59b9f0 0x55addb5a5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:44748/0 (socket says 172.21.15.50:44748) 2024-06-06T03:29:28.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.826+0000 7f4f9b7fe640 1 -- 172.21.15.50:0/1537817846 learned_addr learned my addr 172.21.15.50:0/1537817846 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:28.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.826+0000 7f4fa0a59640 1 --2- 172.21.15.50:0/1537817846 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55addb59b000 0x55addb5a5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:28.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.826+0000 7f4fa0a59640 1 --2- 172.21.15.50:0/1537817846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55addb5a0b60 0x55addb5ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:28.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.826+0000 7f4f9b7fe640 1 -- 172.21.15.50:0/1537817846 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55addb59b000 msgr2=0x55addb5a5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:28.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.826+0000 7f4f9b7fe640 1 --2- 172.21.15.50:0/1537817846 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55addb59b000 0x55addb5a5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:28.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.826+0000 7f4f9b7fe640 1 -- 172.21.15.50:0/1537817846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55addb5a0b60 msgr2=0x55addb5ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:28.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.826+0000 7f4f9b7fe640 1 --2- 172.21.15.50:0/1537817846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55addb5a0b60 0x55addb5ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:28.828 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.826+0000 7f4f9b7fe640 1 -- 172.21.15.50:0/1537817846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55addb212210 con 0x55addb59b9f0 2024-06-06T03:29:28.828 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.826+0000 7f4fa0a59640 1 --2- 172.21.15.50:0/1537817846 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55addb59b000 0x55addb5a5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:29:28.828 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.828+0000 7f4f9b7fe640 1 --2- 172.21.15.50:0/1537817846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55addb59b9f0 0x55addb5a5850 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000a5b0 tx=0x7f4f9000aa70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efb212a4e9079ab3 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:28.828 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.828+0000 7f4f7b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:29:28.828 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.829+0000 7f4f7b7fe640 1 -- 172.21.15.50:0/1537817846 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9001a060 con 0x55addb59b9f0 2024-06-06T03:29:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.829+0000 7f4fa51c5740 1 -- 172.21.15.50:0/1537817846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f8c00fc10 con 0x55addb59b9f0 2024-06-06T03:29:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.829+0000 7f4f7b7fe640 1 -- 172.21.15.50:0/1537817846 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f4f90004230 con 0x55addb59b9f0 2024-06-06T03:29:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.829+0000 7f4f7b7fe640 1 -- 172.21.15.50:0/1537817846 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4f90021050 con 0x55addb59b9f0 2024-06-06T03:29:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.829+0000 7f4fa51c5740 10 client.25508 fetch_fsmap learned FSMap version 29 2024-06-06T03:29:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.829+0000 7f4fa51c5740 1 -- 172.21.15.50:0/1537817846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55addb2de620 con 0x55addb59b9f0 2024-06-06T03:29:28.830 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.830+0000 7f4f7b7fe640 1 -- 172.21.15.50:0/1537817846 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4f8c00fc10 con 0x55addb59b9f0 2024-06-06T03:29:28.830 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.830+0000 7f4f7b7fe640 1 -- 172.21.15.50:0/1537817846 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f4f90014660 con 0x55addb59b9f0 2024-06-06T03:29:28.830 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.830+0000 7f4fa51c5740 10 client.25508 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:29:28.830 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.830+0000 7f4fa51c5740 10 client.25508 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:29:28.830 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.830+0000 7f4fa51c5740 20 client.25508 populate_metadata read hostname 'smithi050' 2024-06-06T03:29:28.830 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.830+0000 7f4fa51c5740 1 --2- 172.21.15.50:0/1537817846 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55addb5d36c0 0x55addb5d5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:28.830 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.830+0000 7f4fa51c5740 4 client.25508 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:29:28.830 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.830+0000 7f4fa51c5740 1 -- 172.21.15.50:0/1537817846 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55addb511f10 con 0x55addb5d36c0 2024-06-06T03:29:28.830 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.830+0000 7f4fa0a59640 1 --2- 172.21.15.50:0/1537817846 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55addb5d36c0 0x55addb5d5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:28.831 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.831+0000 7f4fa0a59640 1 --2- 172.21.15.50:0/1537817846 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55addb5d36c0 0x55addb5d5ae0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22f8efff7ec5c587 server_cookie=ee53cafec51cafaa in_seq=0 out_seq=0 2024-06-06T03:29:28.831 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.831+0000 7f4f7b7fe640 10 client.25508 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:28.832 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.832+0000 7f4f7b7fe640 1 -- 172.21.15.50:0/1537817846 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55addb511f10 con 0x55addb5d36c0 2024-06-06T03:29:28.832 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.832+0000 7f4f7b7fe640 10 client.25508 handle_command_reply: tid=0 2024-06-06T03:29:28.832 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.832+0000 7f4fa51c5740 1 client.25508 shutdown 2024-06-06T03:29:28.833 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.833+0000 7f4fa51c5740 1 -- 172.21.15.50:0/1537817846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55addb59b9f0 msgr2=0x55addb5a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:28.833 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.833+0000 7f4fa51c5740 1 --2- 172.21.15.50:0/1537817846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55addb59b9f0 0x55addb5a5850 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000a5b0 tx=0x7f4f9000aa70 comp rx=0 tx=0).stop 2024-06-06T03:29:28.833 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.833+0000 7f4fa51c5740 1 -- 172.21.15.50:0/1537817846 shutdown_connections 2024-06-06T03:29:28.833 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.833+0000 7f4fa51c5740 1 --2- 172.21.15.50:0/1537817846 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55addb5d36c0 0x55addb5d5ae0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:28.833 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.833+0000 7f4fa51c5740 1 --2- 172.21.15.50:0/1537817846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55addb5a0b60 0x55addb5ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:28.833 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.833+0000 7f4fa51c5740 1 --2- 172.21.15.50:0/1537817846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55addb59b9f0 0x55addb5a5850 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:28.833 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.833+0000 7f4fa51c5740 1 --2- 172.21.15.50:0/1537817846 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55addb59b000 0x55addb5a5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:28.833 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.833+0000 7f4fa51c5740 1 -- 172.21.15.50:0/1537817846 >> 172.21.15.50:0/1537817846 conn(0x55addb596960 msgr2=0x55addb595ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:28.833 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.833+0000 7f4f7b7fe640 0 client.25508 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:28.834 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.833+0000 7f4fa51c5740 1 -- 172.21.15.50:0/1537817846 shutdown_connections 2024-06-06T03:29:28.835 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.835+0000 7f4fa51c5740 1 -- 172.21.15.50:0/1537817846 wait complete. 2024-06-06T03:29:28.835 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.836+0000 7f4fa51c5740 20 client.25508 trim_cache size 0 max 16384 2024-06-06T03:29:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.871+0000 7f4fa51c5740 1 Processor -- start 2024-06-06T03:29:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.872+0000 7f4fa51c5740 1 -- start start 2024-06-06T03:29:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.872+0000 7f4fa51c5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55addb59b000 0x55addb5919a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.872+0000 7f4fa51c5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55addb59b9f0 0x55addb5ac850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.872+0000 7f4fa51c5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55addb5a0b60 0x55addb5a5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:28.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.872+0000 7f4fa0a59640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55addb59b000 0x55addb5919a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:28.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.872+0000 7f4fa0a59640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55addb59b000 0x55addb5919a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:57036/0 (socket says 172.21.15.50:57036) 2024-06-06T03:29:28.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.873+0000 7f4f9b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55addb59b9f0 0x55addb5ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:28.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.873+0000 7f4fa51c5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c1b3180 con 0x55addb59b9f0 2024-06-06T03:29:28.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.873+0000 7f4fa51c5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c1b0a50 con 0x55addb5a0b60 2024-06-06T03:29:28.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.873+0000 7f4fa51c5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c1a6110 con 0x55addb59b000 2024-06-06T03:29:28.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.873+0000 7f4fa0a59640 1 -- 172.21.15.50:0/2142783587 learned_addr learned my addr 172.21.15.50:0/2142783587 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:28.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.873+0000 7f4fa0a59640 1 --2- 172.21.15.50:0/2142783587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55addb5a0b60 0x55addb5a5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:28.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.873+0000 7f4fa0a59640 1 -- 172.21.15.50:0/2142783587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55addb5a0b60 msgr2=0x55addb5a5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:28.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.873+0000 7f4fa0a59640 1 --2- 172.21.15.50:0/2142783587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55addb5a0b60 0x55addb5a5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:28.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.873+0000 7f4fa0a59640 1 -- 172.21.15.50:0/2142783587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55addb59b9f0 msgr2=0x55addb5ac850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:28.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.873+0000 7f4fa0a59640 1 --2- 172.21.15.50:0/2142783587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55addb59b9f0 0x55addb5ac850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:28.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.873+0000 7f4fa0a59640 1 -- 172.21.15.50:0/2142783587 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55addb597630 con 0x55addb59b000 2024-06-06T03:29:28.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.873+0000 7f4f9b7fe640 1 --2- 172.21.15.50:0/2142783587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55addb59b9f0 0x55addb5ac850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:29:28.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.874+0000 7f4fa0a59640 1 --2- 172.21.15.50:0/2142783587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55addb59b000 0x55addb5919a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c011510 tx=0x7f4f8c005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=269e7a56c26a4b6a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:28.875 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.874+0000 7f4fa24bc640 1 -- 172.21.15.50:0/2142783587 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c005180 con 0x55addb59b000 2024-06-06T03:29:28.875 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.874+0000 7f4fa24bc640 1 -- 172.21.15.50:0/2142783587 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4f8c019d30 con 0x55addb59b000 2024-06-06T03:29:28.875 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.874+0000 7f4fa24bc640 1 -- 172.21.15.50:0/2142783587 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c005180 con 0x55addb59b000 2024-06-06T03:29:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.875+0000 7f4fa51c5740 1 -- 172.21.15.50:0/2142783587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55addb59b000 msgr2=0x55addb5919a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.875+0000 7f4fa51c5740 1 --2- 172.21.15.50:0/2142783587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55addb59b000 0x55addb5919a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c011510 tx=0x7f4f8c005f90 comp rx=0 tx=0).stop 2024-06-06T03:29:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.875+0000 7f4fa51c5740 1 -- 172.21.15.50:0/2142783587 shutdown_connections 2024-06-06T03:29:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.875+0000 7f4fa51c5740 1 --2- 172.21.15.50:0/2142783587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55addb59b9f0 0x55addb5ac850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.876+0000 7f4fa51c5740 1 --2- 172.21.15.50:0/2142783587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55addb5a0b60 0x55addb5a5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.876+0000 7f4fa51c5740 1 --2- 172.21.15.50:0/2142783587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55addb59b000 0x55addb5919a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.876+0000 7f4fa51c5740 1 -- 172.21.15.50:0/2142783587 >> 172.21.15.50:0/2142783587 conn(0x55addb596960 msgr2=0x55addb596d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:28.877 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.877+0000 7f4fa51c5740 1 -- 172.21.15.50:0/2142783587 shutdown_connections 2024-06-06T03:29:28.877 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.877+0000 7f4fa51c5740 1 -- 172.21.15.50:0/2142783587 wait complete. 2024-06-06T03:29:28.877 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.878+0000 7f4fa51c5740 1 -- start start 2024-06-06T03:29:28.877 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.878+0000 7f4fa51c5740 1 Processor -- start 2024-06-06T03:29:28.878 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.879+0000 7f4fa51c5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55addb59b000 0x55addb5ac530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:28.879 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.879+0000 7f4fa51c5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55addb59b9f0 0x55addb5a9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:28.879 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.879+0000 7f4fa51c5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55addb5a0b60 0x55addb5a9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:28.879 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.879+0000 7f4fa51c5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c1aef10 con 0x55addb5a0b60 2024-06-06T03:29:28.879 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.879+0000 7f4fa51c5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c1b0380 con 0x55addb59b9f0 2024-06-06T03:29:28.879 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.879+0000 7f4fa51c5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c1af5e0 con 0x55addb59b000 2024-06-06T03:29:28.879 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.879+0000 7f4fa51c5740 10 client.0 _ll_register_callbacks cb 0x7f4f90005f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:29:28.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.879+0000 7f4f9b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55addb59b9f0 0x55addb5a9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:28.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.879+0000 7f4f9b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55addb59b9f0 0x55addb5a9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:44776/0 (socket says 172.21.15.50:44776) 2024-06-06T03:29:28.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.879+0000 7f4f9b7fe640 1 -- 172.21.15.50:0/3911695449 learned_addr learned my addr 172.21.15.50:0/3911695449 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:28.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.880+0000 7f4f9b7fe640 1 -- 172.21.15.50:0/3911695449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55addb59b000 msgr2=0x55addb5ac530 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:29:28.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.880+0000 7f4f9b7fe640 1 --2- 172.21.15.50:0/3911695449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55addb59b000 0x55addb5ac530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:28.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.880+0000 7f4f9b7fe640 1 -- 172.21.15.50:0/3911695449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55addb5a0b60 msgr2=0x55addb5a9560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:29:28.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.880+0000 7f4f9b7fe640 1 --2- 172.21.15.50:0/3911695449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55addb5a0b60 0x55addb5a9560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:28.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.880+0000 7f4f9b7fe640 1 -- 172.21.15.50:0/3911695449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55addb5a9b50 con 0x55addb59b9f0 2024-06-06T03:29:28.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.880+0000 7f4f9b7fe640 1 --2- 172.21.15.50:0/3911695449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55addb59b9f0 0x55addb5a9020 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4f90001eb0 tx=0x7f4f90014f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b17e904f1270e717 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:28.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.880+0000 7f4f7b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:29:28.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.881+0000 7f4f7b7fe640 1 -- 172.21.15.50:0/3911695449 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f90014770 con 0x55addb59b9f0 2024-06-06T03:29:28.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.881+0000 7f4f7b7fe640 1 -- 172.21.15.50:0/3911695449 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f4f90005040 con 0x55addb59b9f0 2024-06-06T03:29:28.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.881+0000 7f4fa51c5740 1 -- 172.21.15.50:0/3911695449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f8c019d30 con 0x55addb59b9f0 2024-06-06T03:29:28.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.881+0000 7f4f7b7fe640 1 -- 172.21.15.50:0/3911695449 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4f90031050 con 0x55addb59b9f0 2024-06-06T03:29:28.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.881+0000 7f4fa51c5740 10 client.25514 fetch_fsmap learned FSMap version 29 2024-06-06T03:29:28.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.881+0000 7f4fa51c5740 1 -- 172.21.15.50:0/3911695449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55addb63d400 con 0x55addb59b9f0 2024-06-06T03:29:28.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.882+0000 7f4f7b7fe640 1 -- 172.21.15.50:0/3911695449 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4f8c019d30 con 0x55addb59b9f0 2024-06-06T03:29:28.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.882+0000 7f4f7b7fe640 1 -- 172.21.15.50:0/3911695449 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f4f90003ca0 con 0x55addb59b9f0 2024-06-06T03:29:28.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.882+0000 7f4fa51c5740 10 client.25514 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:29:28.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.882+0000 7f4fa51c5740 10 client.25514 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:29:28.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.883+0000 7f4fa51c5740 20 client.25514 populate_metadata read hostname 'smithi050' 2024-06-06T03:29:28.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.883+0000 7f4fa51c5740 1 --2- 172.21.15.50:0/3911695449 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55addb63de00 0x55addb640220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:28.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.883+0000 7f4fa51c5740 4 client.25514 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:29:28.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.883+0000 7f4fa51c5740 1 -- 172.21.15.50:0/3911695449 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55addb50bc20 con 0x55addb63de00 2024-06-06T03:29:28.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.883+0000 7f4fa0a59640 1 --2- 172.21.15.50:0/3911695449 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55addb63de00 0x55addb640220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:28.884 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.884+0000 7f4fa0a59640 1 --2- 172.21.15.50:0/3911695449 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55addb63de00 0x55addb640220 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=184344a5ef932486 server_cookie=e55e9c423752ae7d in_seq=0 out_seq=0 2024-06-06T03:29:28.884 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.884+0000 7f4f7b7fe640 10 client.25514 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.888+0000 7f4f7b7fe640 1 -- 172.21.15.50:0/3911695449 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55addb50bc20 con 0x55addb63de00 2024-06-06T03:29:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.888+0000 7f4f7b7fe640 10 client.25514 handle_command_reply: tid=0 2024-06-06T03:29:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.888+0000 7f4fa51c5740 1 client.25514 shutdown 2024-06-06T03:29:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.888+0000 7f4fa51c5740 1 -- 172.21.15.50:0/3911695449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55addb59b9f0 msgr2=0x55addb5a9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.888+0000 7f4fa51c5740 1 --2- 172.21.15.50:0/3911695449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55addb59b9f0 0x55addb5a9020 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4f90001eb0 tx=0x7f4f90014f50 comp rx=0 tx=0).stop 2024-06-06T03:29:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.888+0000 7f4fa51c5740 1 -- 172.21.15.50:0/3911695449 shutdown_connections 2024-06-06T03:29:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.888+0000 7f4fa51c5740 1 --2- 172.21.15.50:0/3911695449 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55addb63de00 0x55addb640220 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.888+0000 7f4fa51c5740 1 --2- 172.21.15.50:0/3911695449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55addb5a0b60 0x55addb5a9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.888+0000 7f4fa51c5740 1 --2- 172.21.15.50:0/3911695449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55addb59b9f0 0x55addb5a9020 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.888+0000 7f4fa51c5740 1 --2- 172.21.15.50:0/3911695449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55addb59b000 0x55addb5ac530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.888+0000 7f4f7b7fe640 0 client.25514 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.888+0000 7f4fa51c5740 1 -- 172.21.15.50:0/3911695449 >> 172.21.15.50:0/3911695449 conn(0x55addb596960 msgr2=0x55addb5919a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.889+0000 7f4fa51c5740 1 -- 172.21.15.50:0/3911695449 shutdown_connections 2024-06-06T03:29:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.889+0000 7f4fa51c5740 1 -- 172.21.15.50:0/3911695449 wait complete. 2024-06-06T03:29:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.889+0000 7f4fa51c5740 20 client.25514 trim_cache size 0 max 16384 2024-06-06T03:29:28.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:29:28.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:29:28.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:29:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.889+0000 7f4f82ffd640 1 -- 172.21.15.50:0/2468008847 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4f840a2e60 msgr2=0x7f4f840a5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.889+0000 7f4f82ffd640 1 --2- 172.21.15.50:0/2468008847 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4f840a2e60 0x7f4f840a5320 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4f940b9ad0 tx=0x7f4f94009560 comp rx=0 tx=0).stop 2024-06-06T03:29:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.889+0000 7f4f82ffd640 1 -- 172.21.15.50:0/2468008847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f9c108c10 msgr2=0x7f4f9c1a6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.890+0000 7f4f82ffd640 1 --2- 172.21.15.50:0/2468008847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f9c108c10 0x7f4f9c1a6810 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4f94009850 tx=0x7f4f94031630 comp rx=0 tx=0).stop 2024-06-06T03:29:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.890+0000 7f4f82ffd640 1 -- 172.21.15.50:0/2468008847 shutdown_connections 2024-06-06T03:29:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.890+0000 7f4f82ffd640 1 --2- 172.21.15.50:0/2468008847 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4f840a2e60 0x7f4f840a5320 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:28.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.890+0000 7f4f82ffd640 1 --2- 172.21.15.50:0/2468008847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f9c10e0b0 0x7f4f9c1add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:28.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.890+0000 7f4f82ffd640 1 --2- 172.21.15.50:0/2468008847 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f9c10b5d0 0x7f4f9c1a6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:28.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.890+0000 7f4f82ffd640 1 --2- 172.21.15.50:0/2468008847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f9c108c10 0x7f4f9c1a6810 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:28.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.890+0000 7f4f82ffd640 1 -- 172.21.15.50:0/2468008847 >> 172.21.15.50:0/2468008847 conn(0x7f4f9c06ebd0 msgr2=0x7f4f9c10bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:28.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.890+0000 7f4f82ffd640 1 -- 172.21.15.50:0/2468008847 shutdown_connections 2024-06-06T03:29:28.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:28.890+0000 7f4f82ffd640 1 -- 172.21.15.50:0/2468008847 wait complete. 2024-06-06T03:29:29.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:29 smithi050 ceph-mon[32421]: pgmap v516: 129 pgs: 129 active+clean; 10 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 48 MiB/s wr, 766 op/s 2024-06-06T03:29:29.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:29 smithi079 ceph-mon[35478]: pgmap v516: 129 pgs: 129 active+clean; 10 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 48 MiB/s wr, 766 op/s 2024-06-06T03:29:29.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:29 smithi122 ceph-mon[35759]: pgmap v516: 129 pgs: 129 active+clean; 10 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 48 MiB/s wr, 766 op/s 2024-06-06T03:29:30.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.572+0000 7ffb75305700 1 -- 172.21.15.50:0/1669226581 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c003e30 con 0x7ffb70109e50 2024-06-06T03:29:30.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.573+0000 7ffb7856b700 1 -- 172.21.15.50:0/1669226581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb70109e50 msgr2=0x7ffb70115d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:30.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.573+0000 7ffb7856b700 1 --2- 172.21.15.50:0/1669226581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb70109e50 0x7ffb70115d80 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009580 tx=0x7ffb6c009890 comp rx=0 tx=0).stop 2024-06-06T03:29:30.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.573+0000 7ffb7856b700 1 -- 172.21.15.50:0/1669226581 shutdown_connections 2024-06-06T03:29:30.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.573+0000 7ffb7856b700 1 --2- 172.21.15.50:0/1669226581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb70109e50 0x7ffb70115d80 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.573+0000 7ffb7856b700 1 --2- 172.21.15.50:0/1669226581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb7010dee0 0x7ffb7010e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.573+0000 7ffb7856b700 1 --2- 172.21.15.50:0/1669226581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb70109490 0x7ffb70109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.573+0000 7ffb7856b700 1 -- 172.21.15.50:0/1669226581 >> 172.21.15.50:0/1669226581 conn(0x7ffb7006d9e0 msgr2=0x7ffb7006ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:30.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.573+0000 7ffb7856b700 1 -- 172.21.15.50:0/1669226581 shutdown_connections 2024-06-06T03:29:30.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.573+0000 7ffb7856b700 1 -- 172.21.15.50:0/1669226581 wait complete. 2024-06-06T03:29:30.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.574+0000 7ffb7856b700 1 Processor -- start 2024-06-06T03:29:30.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.574+0000 7ffb7856b700 1 -- start start 2024-06-06T03:29:30.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.575+0000 7ffb7856b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb70109490 0x7ffb70115bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:30.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.575+0000 7ffb7856b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb70109e50 0x7ffb70112cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:30.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.575+0000 7ffb7856b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb7010dee0 0x7ffb70113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:30.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.575+0000 7ffb7856b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffb70118af0 con 0x7ffb70109490 2024-06-06T03:29:30.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.575+0000 7ffb7856b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffb70118970 con 0x7ffb7010dee0 2024-06-06T03:29:30.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.575+0000 7ffb7856b700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ffb70118c70 con 0x7ffb70109e50 2024-06-06T03:29:30.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.575+0000 7ffb76b08700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb7010dee0 0x7ffb70113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:30.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.575+0000 7ffb76b08700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb7010dee0 0x7ffb70113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:44800/0 (socket says 172.21.15.50:44800) 2024-06-06T03:29:30.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.575+0000 7ffb76b08700 1 -- 172.21.15.50:0/518317051 learned_addr learned my addr 172.21.15.50:0/518317051 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:30.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.576+0000 7ffb76b08700 1 -- 172.21.15.50:0/518317051 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb70109e50 msgr2=0x7ffb70112cd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T03:29:30.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.576+0000 7ffb76b08700 1 --2- 172.21.15.50:0/518317051 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb70109e50 0x7ffb70112cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.576+0000 7ffb76b08700 1 -- 172.21.15.50:0/518317051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb70109490 msgr2=0x7ffb70115bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T03:29:30.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.576+0000 7ffb76b08700 1 --2- 172.21.15.50:0/518317051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb70109490 0x7ffb70115bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.576+0000 7ffb76b08700 1 -- 172.21.15.50:0/518317051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb70113ae0 con 0x7ffb7010dee0 2024-06-06T03:29:30.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.576+0000 7ffb76b08700 1 --2- 172.21.15.50:0/518317051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb7010dee0 0x7ffb70113210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009e50 tx=0x7ffb6c00cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:30.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.577+0000 7ffb677fe700 1 -- 172.21.15.50:0/518317051 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c025070 con 0x7ffb7010dee0 2024-06-06T03:29:30.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.578+0000 7ffb677fe700 1 -- 172.21.15.50:0/518317051 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb6c0050d0 con 0x7ffb7010dee0 2024-06-06T03:29:30.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.578+0000 7ffb7856b700 1 -- 172.21.15.50:0/518317051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb701b3f50 con 0x7ffb7010dee0 2024-06-06T03:29:30.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.579+0000 7ffb677fe700 1 -- 172.21.15.50:0/518317051 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c00eb60 con 0x7ffb7010dee0 2024-06-06T03:29:30.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.579+0000 7ffb7856b700 1 -- 172.21.15.50:0/518317051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb701b43a0 con 0x7ffb7010dee0 2024-06-06T03:29:30.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.581+0000 7ffb677fe700 1 -- 172.21.15.50:0/518317051 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ffb6c028070 con 0x7ffb7010dee0 2024-06-06T03:29:30.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.582+0000 7ffb677fe700 1 --2- 172.21.15.50:0/518317051 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ffb5c0a2c10 0x7ffb5c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:30.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.583+0000 7ffb677fe700 1 -- 172.21.15.50:0/518317051 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7ffb6c0cf4d0 con 0x7ffb7010dee0 2024-06-06T03:29:30.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.583+0000 7ffb76307700 1 --2- 172.21.15.50:0/518317051 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ffb5c0a2c10 0x7ffb5c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:30.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.584+0000 7ffb76307700 1 --2- 172.21.15.50:0/518317051 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ffb5c0a2c10 0x7ffb5c0a50d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009af0 tx=0x7ffb68009280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:30.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.585+0000 7ffb82deeb80 1 Processor -- start 2024-06-06T03:29:30.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.586+0000 7ffb82deeb80 1 -- start start 2024-06-06T03:29:30.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.586+0000 7ffb82deeb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56079b608fe0 0x56079b6093c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:30.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.586+0000 7ffb82deeb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56079b609900 0x56079b6032e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:30.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.586+0000 7ffb82deeb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56079b603820 0x56079b603c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:30.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.586+0000 7ffb82deeb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56079b4f5fe0 con 0x56079b608fe0 2024-06-06T03:29:30.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.586+0000 7ffb76b08700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56079b603820 0x56079b603c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:30.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.586+0000 7ffb76b08700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56079b603820 0x56079b603c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:44810/0 (socket says 172.21.15.50:44810) 2024-06-06T03:29:30.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.586+0000 7ffb76b08700 1 -- 172.21.15.50:0/1884513926 learned_addr learned my addr 172.21.15.50:0/1884513926 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:30.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.586+0000 7ffb75b06700 1 --2- 172.21.15.50:0/1884513926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56079b609900 0x56079b6032e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:30.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.587+0000 7ffb76307700 1 --2- 172.21.15.50:0/1884513926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56079b608fe0 0x56079b6093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:30.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.587+0000 7ffb82deeb80 1 -- 172.21.15.50:0/1884513926 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56079b5548d0 con 0x56079b603820 2024-06-06T03:29:30.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.587+0000 7ffb82deeb80 1 -- 172.21.15.50:0/1884513926 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56079b4bc4e0 con 0x56079b609900 2024-06-06T03:29:30.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.587+0000 7ffb76b08700 1 -- 172.21.15.50:0/1884513926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56079b609900 msgr2=0x56079b6032e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:30.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.587+0000 7ffb76b08700 1 --2- 172.21.15.50:0/1884513926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56079b609900 0x56079b6032e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.587+0000 7ffb76b08700 1 -- 172.21.15.50:0/1884513926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56079b608fe0 msgr2=0x56079b6093c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:30.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.587+0000 7ffb76b08700 1 --2- 172.21.15.50:0/1884513926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56079b608fe0 0x56079b6093c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.587+0000 7ffb76b08700 1 -- 172.21.15.50:0/1884513926 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56079b4a3950 con 0x56079b603820 2024-06-06T03:29:30.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.588+0000 7ffb76b08700 1 --2- 172.21.15.50:0/1884513926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56079b603820 0x56079b603c40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c0a4240 tx=0x7ffb6c009890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=390374083f60a1bd server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:30.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.588+0000 7ffb64ff9700 1 -- 172.21.15.50:0/1884513926 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c0b4020 con 0x56079b603820 2024-06-06T03:29:30.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.588+0000 7ffb64ff9700 1 -- 172.21.15.50:0/1884513926 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb6c09c290 con 0x56079b603820 2024-06-06T03:29:30.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.588+0000 7ffb64ff9700 1 -- 172.21.15.50:0/1884513926 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c09c050 con 0x56079b603820 2024-06-06T03:29:30.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.589+0000 7ffb82deeb80 1 -- 172.21.15.50:0/1884513926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56079b603820 msgr2=0x56079b603c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:30.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.589+0000 7ffb82deeb80 1 --2- 172.21.15.50:0/1884513926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56079b603820 0x56079b603c40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c0a4240 tx=0x7ffb6c009890 comp rx=0 tx=0).stop 2024-06-06T03:29:30.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.589+0000 7ffb82deeb80 1 -- 172.21.15.50:0/1884513926 shutdown_connections 2024-06-06T03:29:30.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.589+0000 7ffb82deeb80 1 --2- 172.21.15.50:0/1884513926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56079b603820 0x56079b603c40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.589+0000 7ffb82deeb80 1 --2- 172.21.15.50:0/1884513926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56079b608fe0 0x56079b6093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.589+0000 7ffb82deeb80 1 --2- 172.21.15.50:0/1884513926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56079b609900 0x56079b6032e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.589+0000 7ffb82deeb80 1 -- 172.21.15.50:0/1884513926 >> 172.21.15.50:0/1884513926 conn(0x56079b530100 msgr2=0x56079b5fe2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:30.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.589+0000 7ffb82deeb80 1 -- 172.21.15.50:0/1884513926 shutdown_connections 2024-06-06T03:29:30.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.590+0000 7ffb82deeb80 1 -- 172.21.15.50:0/1884513926 wait complete. 2024-06-06T03:29:30.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.590+0000 7ffb82deeb80 1 -- start start 2024-06-06T03:29:30.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.590+0000 7ffb82deeb80 1 Processor -- start 2024-06-06T03:29:30.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.591+0000 7ffb82deeb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56079b603820 0x56079b60f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:30.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.591+0000 7ffb82deeb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56079b608fe0 0x56079b60c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:30.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.591+0000 7ffb82deeb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56079b609900 0x56079b60cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:30.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.591+0000 7ffb82deeb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56079b4f5040 con 0x56079b603820 2024-06-06T03:29:30.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.591+0000 7ffb82deeb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56079b550890 con 0x56079b609900 2024-06-06T03:29:30.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.591+0000 7ffb76b08700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56079b609900 0x56079b60cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:30.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.591+0000 7ffb76b08700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56079b609900 0x56079b60cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:44818/0 (socket says 172.21.15.50:44818) 2024-06-06T03:29:30.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.591+0000 7ffb76b08700 1 -- 172.21.15.50:0/150779540 learned_addr learned my addr 172.21.15.50:0/150779540 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:30.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.591+0000 7ffb82deeb80 1 -- 172.21.15.50:0/150779540 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56079b610090 con 0x56079b608fe0 2024-06-06T03:29:30.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.592+0000 7ffb82deeb80 10 client.0 _ll_register_callbacks cb 0x56079b4ea630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:29:30.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.592+0000 7ffb75b06700 1 --2- 172.21.15.50:0/150779540 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56079b608fe0 0x56079b60c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:30.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.592+0000 7ffb76307700 1 --2- 172.21.15.50:0/150779540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56079b603820 0x56079b60f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:30.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.592+0000 7ffb76b08700 1 -- 172.21.15.50:0/150779540 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56079b608fe0 msgr2=0x56079b60c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:30.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.592+0000 7ffb76b08700 1 --2- 172.21.15.50:0/150779540 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56079b608fe0 0x56079b60c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.592+0000 7ffb76b08700 1 -- 172.21.15.50:0/150779540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56079b603820 msgr2=0x56079b60f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:30.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.592+0000 7ffb76b08700 1 --2- 172.21.15.50:0/150779540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56079b603820 0x56079b60f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.592+0000 7ffb76b08700 1 -- 172.21.15.50:0/150779540 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56079b51a7d0 con 0x56079b609900 2024-06-06T03:29:30.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.592+0000 7ffb76307700 1 --2- 172.21.15.50:0/150779540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56079b603820 0x56079b60f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:29:30.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.592+0000 7ffb76b08700 1 --2- 172.21.15.50:0/150779540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56079b609900 0x56079b60cf30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c0094d0 tx=0x7ffb6c0a4640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a378d69e16c6ac6 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:30.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.592+0000 7ffb59ffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:29:30.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.593+0000 7ffb59ffb700 1 -- 172.21.15.50:0/150779540 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c0b4050 con 0x56079b609900 2024-06-06T03:29:30.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.593+0000 7ffb59ffb700 1 -- 172.21.15.50:0/150779540 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7ffb6c0ba430 con 0x56079b609900 2024-06-06T03:29:30.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.593+0000 7ffb82deeb80 1 -- 172.21.15.50:0/150779540 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb6c09c290 con 0x56079b609900 2024-06-06T03:29:30.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.593+0000 7ffb59ffb700 1 -- 172.21.15.50:0/150779540 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffb6c09bb90 con 0x56079b609900 2024-06-06T03:29:30.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.593+0000 7ffb82deeb80 10 client.25526 fetch_fsmap learned FSMap version 29 2024-06-06T03:29:30.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.593+0000 7ffb82deeb80 1 -- 172.21.15.50:0/150779540 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56079b61a5d0 con 0x56079b609900 2024-06-06T03:29:30.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.594+0000 7ffb59ffb700 1 -- 172.21.15.50:0/150779540 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb6c09c290 con 0x56079b609900 2024-06-06T03:29:30.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.594+0000 7ffb59ffb700 1 -- 172.21.15.50:0/150779540 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7ffb6c0ac030 con 0x56079b609900 2024-06-06T03:29:30.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.594+0000 7ffb82deeb80 10 client.25526 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:29:30.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.594+0000 7ffb82deeb80 10 client.25526 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:29:30.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.594+0000 7ffb82deeb80 20 client.25526 populate_metadata read hostname 'smithi050' 2024-06-06T03:29:30.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.594+0000 7ffb82deeb80 1 --2- 172.21.15.50:0/150779540 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56079b61caa0 0x56079b61ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:30.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.594+0000 7ffb82deeb80 4 client.25526 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:29:30.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.594+0000 7ffb82deeb80 1 -- 172.21.15.50:0/150779540 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56079b561dd0 con 0x56079b61caa0 2024-06-06T03:29:30.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.594+0000 7ffb76307700 1 --2- 172.21.15.50:0/150779540 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56079b61caa0 0x56079b61ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:30.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.595+0000 7ffb59ffb700 10 client.25526 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:30.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.595+0000 7ffb76307700 1 --2- 172.21.15.50:0/150779540 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56079b61caa0 0x56079b61ee90 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1912e057e86d102 server_cookie=729f1ace8cb72902 in_seq=0 out_seq=0 2024-06-06T03:29:30.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.596+0000 7ffb59ffb700 1 -- 172.21.15.50:0/150779540 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x56079b561dd0 con 0x56079b61caa0 2024-06-06T03:29:30.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.596+0000 7ffb59ffb700 10 client.25526 handle_command_reply: tid=0 2024-06-06T03:29:30.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.596+0000 7ffb82deeb80 1 client.25526 shutdown 2024-06-06T03:29:30.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.597+0000 7ffb82deeb80 1 -- 172.21.15.50:0/150779540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56079b609900 msgr2=0x56079b60cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:30.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.597+0000 7ffb82deeb80 1 --2- 172.21.15.50:0/150779540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56079b609900 0x56079b60cf30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c0094d0 tx=0x7ffb6c0a4640 comp rx=0 tx=0).stop 2024-06-06T03:29:30.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.597+0000 7ffb82deeb80 1 -- 172.21.15.50:0/150779540 shutdown_connections 2024-06-06T03:29:30.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.597+0000 7ffb82deeb80 1 --2- 172.21.15.50:0/150779540 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56079b61caa0 0x56079b61ee90 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.597+0000 7ffb82deeb80 1 --2- 172.21.15.50:0/150779540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56079b609900 0x56079b60cf30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.597+0000 7ffb82deeb80 1 --2- 172.21.15.50:0/150779540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56079b603820 0x56079b60f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.597+0000 7ffb82deeb80 1 --2- 172.21.15.50:0/150779540 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56079b608fe0 0x56079b60c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.597+0000 7ffb82deeb80 1 -- 172.21.15.50:0/150779540 >> 172.21.15.50:0/150779540 conn(0x56079b530100 msgr2=0x56079b5fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:30.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.597+0000 7ffb59ffb700 0 client.25526 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:30.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.597+0000 7ffb82deeb80 1 -- 172.21.15.50:0/150779540 shutdown_connections 2024-06-06T03:29:30.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.598+0000 7ffb82deeb80 1 -- 172.21.15.50:0/150779540 wait complete. 2024-06-06T03:29:30.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.598+0000 7ffb82deeb80 20 client.25526 trim_cache size 0 max 16384 2024-06-06T03:29:30.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.641+0000 7ffb82deeb80 1 Processor -- start 2024-06-06T03:29:30.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.641+0000 7ffb82deeb80 1 -- start start 2024-06-06T03:29:30.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.641+0000 7ffb82deeb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56079b603820 0x56079b6032e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:30.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.641+0000 7ffb82deeb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56079b608fe0 0x56079b60bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:30.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.642+0000 7ffb82deeb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56079b609900 0x56079b5fdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:30.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.642+0000 7ffb82deeb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffb701bf5b0 con 0x56079b608fe0 2024-06-06T03:29:30.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.642+0000 7ffb82deeb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffb701bce40 con 0x56079b609900 2024-06-06T03:29:30.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.642+0000 7ffb82deeb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ffb701bac90 con 0x56079b603820 2024-06-06T03:29:30.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.642+0000 7ffb76b08700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56079b609900 0x56079b5fdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:30.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.642+0000 7ffb76b08700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56079b609900 0x56079b5fdf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:44830/0 (socket says 172.21.15.50:44830) 2024-06-06T03:29:30.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.642+0000 7ffb76b08700 1 -- 172.21.15.50:0/839469098 learned_addr learned my addr 172.21.15.50:0/839469098 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:30.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.643+0000 7ffb76307700 1 --2- 172.21.15.50:0/839469098 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56079b603820 0x56079b6032e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:30.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.643+0000 7ffb76b08700 1 -- 172.21.15.50:0/839469098 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56079b603820 msgr2=0x56079b6032e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:30.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.643+0000 7ffb76b08700 1 --2- 172.21.15.50:0/839469098 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56079b603820 0x56079b6032e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.643+0000 7ffb76b08700 1 -- 172.21.15.50:0/839469098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56079b608fe0 msgr2=0x56079b60bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:30.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.643+0000 7ffb76b08700 1 --2- 172.21.15.50:0/839469098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56079b608fe0 0x56079b60bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.643+0000 7ffb76b08700 1 -- 172.21.15.50:0/839469098 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56079b5fa890 con 0x56079b609900 2024-06-06T03:29:30.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.643+0000 7ffb76307700 1 --2- 172.21.15.50:0/839469098 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56079b603820 0x56079b6032e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:29:30.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.644+0000 7ffb76b08700 1 --2- 172.21.15.50:0/839469098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56079b609900 0x56079b5fdf00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c0a4240 tx=0x7ffb6c009890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28edf345984654e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:30.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.644+0000 7ffb5bfff700 1 -- 172.21.15.50:0/839469098 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c0b4070 con 0x56079b609900 2024-06-06T03:29:30.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.644+0000 7ffb5bfff700 1 -- 172.21.15.50:0/839469098 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb6c0ba070 con 0x56079b609900 2024-06-06T03:29:30.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.644+0000 7ffb5bfff700 1 -- 172.21.15.50:0/839469098 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c097b60 con 0x56079b609900 2024-06-06T03:29:30.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.645+0000 7ffb82deeb80 1 -- 172.21.15.50:0/839469098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56079b609900 msgr2=0x56079b5fdf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:30.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.645+0000 7ffb82deeb80 1 --2- 172.21.15.50:0/839469098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56079b609900 0x56079b5fdf00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c0a4240 tx=0x7ffb6c009890 comp rx=0 tx=0).stop 2024-06-06T03:29:30.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.645+0000 7ffb82deeb80 1 -- 172.21.15.50:0/839469098 shutdown_connections 2024-06-06T03:29:30.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.645+0000 7ffb82deeb80 1 --2- 172.21.15.50:0/839469098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56079b609900 0x56079b5fdf00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.645+0000 7ffb82deeb80 1 --2- 172.21.15.50:0/839469098 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56079b603820 0x56079b6032e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.645+0000 7ffb82deeb80 1 --2- 172.21.15.50:0/839469098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56079b608fe0 0x56079b60bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.645+0000 7ffb82deeb80 1 -- 172.21.15.50:0/839469098 >> 172.21.15.50:0/839469098 conn(0x56079b530100 msgr2=0x56079b60a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:30.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.645+0000 7ffb82deeb80 1 -- 172.21.15.50:0/839469098 shutdown_connections 2024-06-06T03:29:30.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.646+0000 7ffb82deeb80 1 -- 172.21.15.50:0/839469098 wait complete. 2024-06-06T03:29:30.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.646+0000 7ffb82deeb80 1 -- start start 2024-06-06T03:29:30.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.646+0000 7ffb82deeb80 1 Processor -- start 2024-06-06T03:29:30.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.647+0000 7ffb82deeb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56079b603820 0x56079b6152e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:30.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.647+0000 7ffb82deeb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56079b608fe0 0x56079b615820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:30.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.647+0000 7ffb82deeb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56079b609900 0x56079b6122b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:30.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.647+0000 7ffb75b06700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56079b608fe0 0x56079b615820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:30.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.647+0000 7ffb75b06700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56079b608fe0 0x56079b615820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:57090/0 (socket says 172.21.15.50:57090) 2024-06-06T03:29:30.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.647+0000 7ffb75b06700 1 -- 172.21.15.50:0/4199201087 learned_addr learned my addr 172.21.15.50:0/4199201087 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:30.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.647+0000 7ffb82deeb80 1 -- 172.21.15.50:0/4199201087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffb701bb300 con 0x56079b609900 2024-06-06T03:29:30.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.647+0000 7ffb82deeb80 1 -- 172.21.15.50:0/4199201087 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffb701bc770 con 0x56079b603820 2024-06-06T03:29:30.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.647+0000 7ffb82deeb80 1 -- 172.21.15.50:0/4199201087 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ffb701bb9d0 con 0x56079b608fe0 2024-06-06T03:29:30.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.647+0000 7ffb82deeb80 10 client.0 _ll_register_callbacks cb 0x56079b60d5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:29:30.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.647+0000 7ffb76b08700 1 --2- 172.21.15.50:0/4199201087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56079b609900 0x56079b6122b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:30.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.647+0000 7ffb76307700 1 --2- 172.21.15.50:0/4199201087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56079b603820 0x56079b6152e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:30.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.648+0000 7ffb76b08700 1 -- 172.21.15.50:0/4199201087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56079b608fe0 msgr2=0x56079b615820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:30.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.648+0000 7ffb76b08700 1 --2- 172.21.15.50:0/4199201087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56079b608fe0 0x56079b615820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.648+0000 7ffb76b08700 1 -- 172.21.15.50:0/4199201087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56079b603820 msgr2=0x56079b6152e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:30.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.648+0000 7ffb76b08700 1 --2- 172.21.15.50:0/4199201087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56079b603820 0x56079b6152e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.648+0000 7ffb76b08700 1 -- 172.21.15.50:0/4199201087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56079b615ef0 con 0x56079b609900 2024-06-06T03:29:30.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.648+0000 7ffb76b08700 1 --2- 172.21.15.50:0/4199201087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56079b609900 0x56079b6122b0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c097ff0 tx=0x7ffb6c097ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a37b79e471139cc9 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:30.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.649+0000 7ffb59ffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:29:30.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.649+0000 7ffb59ffb700 1 -- 172.21.15.50:0/4199201087 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c0b4040 con 0x56079b609900 2024-06-06T03:29:30.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.649+0000 7ffb82deeb80 1 -- 172.21.15.50:0/4199201087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb6c0ba070 con 0x56079b609900 2024-06-06T03:29:30.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.649+0000 7ffb59ffb700 1 -- 172.21.15.50:0/4199201087 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7ffb6c086470 con 0x56079b609900 2024-06-06T03:29:30.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.650+0000 7ffb59ffb700 1 -- 172.21.15.50:0/4199201087 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffb6c09b6d0 con 0x56079b609900 2024-06-06T03:29:30.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.650+0000 7ffb82deeb80 10 client.15930 fetch_fsmap learned FSMap version 29 2024-06-06T03:29:30.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.650+0000 7ffb82deeb80 1 -- 172.21.15.50:0/4199201087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56079b615ef0 con 0x56079b609900 2024-06-06T03:29:30.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.651+0000 7ffb59ffb700 1 -- 172.21.15.50:0/4199201087 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb6c0a2150 con 0x56079b609900 2024-06-06T03:29:30.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.651+0000 7ffb59ffb700 1 -- 172.21.15.50:0/4199201087 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7ffb6c0ac070 con 0x56079b609900 2024-06-06T03:29:30.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.651+0000 7ffb82deeb80 10 client.15930 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:29:30.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.651+0000 7ffb82deeb80 10 client.15930 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:29:30.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.651+0000 7ffb82deeb80 20 client.15930 populate_metadata read hostname 'smithi050' 2024-06-06T03:29:30.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.651+0000 7ffb82deeb80 1 --2- 172.21.15.50:0/4199201087 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56079b687ee0 0x56079b68a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:30.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.651+0000 7ffb82deeb80 4 client.15930 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-06T03:29:30.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.651+0000 7ffb82deeb80 1 -- 172.21.15.50:0/4199201087 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7ffb6c0ba070 con 0x56079b687ee0 2024-06-06T03:29:30.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.652+0000 7ffb76307700 1 --2- 172.21.15.50:0/4199201087 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56079b687ee0 0x56079b68a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:30.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.653+0000 7ffb76307700 1 --2- 172.21.15.50:0/4199201087 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56079b687ee0 0x56079b68a300 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1dda24ad42114e9 server_cookie=1409109cee1f7a96 in_seq=0 out_seq=0 2024-06-06T03:29:30.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.653+0000 7ffb59ffb700 10 client.15930 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:30.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.655+0000 7ffb59ffb700 1 -- 172.21.15.50:0/4199201087 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7ffb6c0ba070 con 0x56079b687ee0 2024-06-06T03:29:30.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.655+0000 7ffb59ffb700 10 client.15930 handle_command_reply: tid=0 2024-06-06T03:29:30.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.656+0000 7ffb82deeb80 1 client.15930 shutdown 2024-06-06T03:29:30.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.656+0000 7ffb82deeb80 1 -- 172.21.15.50:0/4199201087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56079b609900 msgr2=0x56079b6122b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:30.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.656+0000 7ffb82deeb80 1 --2- 172.21.15.50:0/4199201087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56079b609900 0x56079b6122b0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c097ff0 tx=0x7ffb6c097ee0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.656+0000 7ffb82deeb80 1 -- 172.21.15.50:0/4199201087 shutdown_connections 2024-06-06T03:29:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.656+0000 7ffb82deeb80 1 --2- 172.21.15.50:0/4199201087 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56079b687ee0 0x56079b68a300 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.656+0000 7ffb82deeb80 1 --2- 172.21.15.50:0/4199201087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56079b609900 0x56079b6122b0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.656+0000 7ffb82deeb80 1 --2- 172.21.15.50:0/4199201087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56079b603820 0x56079b6152e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.657+0000 7ffb82deeb80 1 --2- 172.21.15.50:0/4199201087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56079b608fe0 0x56079b615820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.657+0000 7ffb82deeb80 1 -- 172.21.15.50:0/4199201087 >> 172.21.15.50:0/4199201087 conn(0x56079b530100 msgr2=0x56079b60e220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.657+0000 7ffb59ffb700 0 client.15930 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.657+0000 7ffb82deeb80 1 -- 172.21.15.50:0/4199201087 shutdown_connections 2024-06-06T03:29:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.657+0000 7ffb82deeb80 1 -- 172.21.15.50:0/4199201087 wait complete. 2024-06-06T03:29:30.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.657+0000 7ffb82deeb80 20 client.15930 trim_cache size 0 max 16384 2024-06-06T03:29:30.658 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:29:30.658 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-06-06T03:29:30.658 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "0985a202-0fd2-4e6e-9b8b-771abc1c8402", 2024-06-06T03:29:30.658 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-06-06T03:29:30.658 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:29:30.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.658+0000 7ffb7856b700 1 -- 172.21.15.50:0/518317051 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ffb5c0a2c10 msgr2=0x7ffb5c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:30.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.658+0000 7ffb7856b700 1 --2- 172.21.15.50:0/518317051 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ffb5c0a2c10 0x7ffb5c0a50d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009af0 tx=0x7ffb68009280 comp rx=0 tx=0).stop 2024-06-06T03:29:30.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.659+0000 7ffb7856b700 1 -- 172.21.15.50:0/518317051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb7010dee0 msgr2=0x7ffb70113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:30.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.659+0000 7ffb7856b700 1 --2- 172.21.15.50:0/518317051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb7010dee0 0x7ffb70113210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009e50 tx=0x7ffb6c00cbc0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.660+0000 7ffb7856b700 1 -- 172.21.15.50:0/518317051 shutdown_connections 2024-06-06T03:29:30.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.660+0000 7ffb7856b700 1 --2- 172.21.15.50:0/518317051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb7010dee0 0x7ffb70113210 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.660+0000 7ffb7856b700 1 --2- 172.21.15.50:0/518317051 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ffb5c0a2c10 0x7ffb5c0a50d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.660+0000 7ffb7856b700 1 --2- 172.21.15.50:0/518317051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb70109490 0x7ffb70115bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.660+0000 7ffb7856b700 1 --2- 172.21.15.50:0/518317051 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb70109e50 0x7ffb70112cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:30.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.660+0000 7ffb7856b700 1 -- 172.21.15.50:0/518317051 >> 172.21.15.50:0/518317051 conn(0x7ffb7006d9e0 msgr2=0x7ffb70072e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:30.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.661+0000 7ffb7856b700 1 -- 172.21.15.50:0/518317051 shutdown_connections 2024-06-06T03:29:30.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:30.661+0000 7ffb7856b700 1 -- 172.21.15.50:0/518317051 wait complete. 2024-06-06T03:29:31.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:31 smithi079 ceph-mon[35478]: pgmap v517: 129 pgs: 129 active+clean; 10 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 58 MiB/s wr, 942 op/s 2024-06-06T03:29:31.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:31 smithi079 ceph-mon[35478]: scrub queued for path: / 2024-06-06T03:29:31.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:31 smithi079 ceph-mon[35478]: scrub summary: idle+waiting paths [/] 2024-06-06T03:29:31.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:31 smithi079 ceph-mon[35478]: scrub summary: active paths [/] 2024-06-06T03:29:31.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:31 smithi079 ceph-mon[35478]: scrub summary: idle+waiting paths [/] 2024-06-06T03:29:31.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:31 smithi122 ceph-mon[35759]: pgmap v517: 129 pgs: 129 active+clean; 10 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 58 MiB/s wr, 942 op/s 2024-06-06T03:29:31.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:31 smithi122 ceph-mon[35759]: scrub queued for path: / 2024-06-06T03:29:31.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:31 smithi122 ceph-mon[35759]: scrub summary: idle+waiting paths [/] 2024-06-06T03:29:31.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:31 smithi122 ceph-mon[35759]: scrub summary: active paths [/] 2024-06-06T03:29:31.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:31 smithi122 ceph-mon[35759]: scrub summary: idle+waiting paths [/] 2024-06-06T03:29:31.432 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:31 smithi050 ceph-mon[32421]: pgmap v517: 129 pgs: 129 active+clean; 10 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 58 MiB/s wr, 942 op/s 2024-06-06T03:29:31.432 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:31 smithi050 ceph-mon[32421]: scrub queued for path: / 2024-06-06T03:29:31.432 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:31 smithi050 ceph-mon[32421]: scrub summary: idle+waiting paths [/] 2024-06-06T03:29:31.433 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:31 smithi050 ceph-mon[32421]: scrub summary: active paths [/] 2024-06-06T03:29:31.433 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:31 smithi050 ceph-mon[32421]: scrub summary: idle+waiting paths [/] 2024-06-06T03:29:31.483 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-06T03:29:31.944 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:29:32.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:32 smithi079 ceph-mon[35478]: scrub summary: active paths [/] 2024-06-06T03:29:32.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:32 smithi079 ceph-mon[35478]: scrub summary: idle+waiting paths [/] 2024-06-06T03:29:32.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:32 smithi122 ceph-mon[35759]: scrub summary: active paths [/] 2024-06-06T03:29:32.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:32 smithi122 ceph-mon[35759]: scrub summary: idle+waiting paths [/] 2024-06-06T03:29:32.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:32 smithi050 ceph-mon[32421]: scrub summary: active paths [/] 2024-06-06T03:29:32.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:32 smithi050 ceph-mon[32421]: scrub summary: idle+waiting paths [/] 2024-06-06T03:29:33.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:33 smithi079 ceph-mon[35478]: pgmap v518: 129 pgs: 129 active+clean; 10 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 49 MiB/s wr, 787 op/s 2024-06-06T03:29:33.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:33 smithi122 ceph-mon[35759]: pgmap v518: 129 pgs: 129 active+clean; 10 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 49 MiB/s wr, 787 op/s 2024-06-06T03:29:33.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:33 smithi050 ceph-mon[32421]: pgmap v518: 129 pgs: 129 active+clean; 10 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 49 MiB/s wr, 787 op/s 2024-06-06T03:29:35.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:35 smithi079 ceph-mon[35478]: pgmap v519: 129 pgs: 129 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 53 MiB/s wr, 852 op/s 2024-06-06T03:29:35.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:35 smithi122 ceph-mon[35759]: pgmap v519: 129 pgs: 129 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 53 MiB/s wr, 852 op/s 2024-06-06T03:29:35.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:35 smithi050 ceph-mon[32421]: pgmap v519: 129 pgs: 129 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 53 MiB/s wr, 852 op/s 2024-06-06T03:29:37.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.025+0000 7f72706f0700 1 -- 172.21.15.50:0/3906171434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7268106620 msgr2=0x7f726810e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:37.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.025+0000 7f72706f0700 1 --2- 172.21.15.50:0/3906171434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7268106620 0x7f726810e1f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f726000b0d0 tx=0x7f726000b3e0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.025+0000 7f72706f0700 1 -- 172.21.15.50:0/3906171434 shutdown_connections 2024-06-06T03:29:37.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.025+0000 7f72706f0700 1 --2- 172.21.15.50:0/3906171434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7268106620 0x7f726810e1f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.025+0000 7f72706f0700 1 --2- 172.21.15.50:0/3906171434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7268101540 0x7f7268101920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.025+0000 7f72706f0700 1 --2- 172.21.15.50:0/3906171434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7268101ef0 0x7f7268105f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.025+0000 7f72706f0700 1 -- 172.21.15.50:0/3906171434 >> 172.21.15.50:0/3906171434 conn(0x7f72680fce10 msgr2=0x7f72680ff230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:37.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.025+0000 7f72706f0700 1 -- 172.21.15.50:0/3906171434 shutdown_connections 2024-06-06T03:29:37.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.025+0000 7f72706f0700 1 -- 172.21.15.50:0/3906171434 wait complete. 2024-06-06T03:29:37.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.026+0000 7f72706f0700 1 Processor -- start 2024-06-06T03:29:37.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.026+0000 7f72706f0700 1 -- start start 2024-06-06T03:29:37.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.027+0000 7f72706f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7268101540 0x7f72681158d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:37.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.027+0000 7f72706f0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7268101ef0 0x7f7268111b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:37.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.027+0000 7f72706f0700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7268106620 0x7f72681120b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:37.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.027+0000 7f72706f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f726810f620 con 0x7f7268101540 2024-06-06T03:29:37.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.027+0000 7f72706f0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f726810f4a0 con 0x7f7268101ef0 2024-06-06T03:29:37.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.027+0000 7f72706f0700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f726810f7a0 con 0x7f7268106620 2024-06-06T03:29:37.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.027+0000 7f726e48c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7268101540 0x7f72681158d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:37.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.027+0000 7f726e48c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7268101540 0x7f72681158d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33792/0 (socket says 172.21.15.50:33792) 2024-06-06T03:29:37.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.027+0000 7f726e48c700 1 -- 172.21.15.50:0/1293912889 learned_addr learned my addr 172.21.15.50:0/1293912889 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:37.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.027+0000 7f726dc8b700 1 --2- 172.21.15.50:0/1293912889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7268101ef0 0x7f7268111b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:37.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.027+0000 7f726ec8d700 1 --2- 172.21.15.50:0/1293912889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7268106620 0x7f72681120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:37.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.028+0000 7f726ec8d700 1 -- 172.21.15.50:0/1293912889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7268101ef0 msgr2=0x7f7268111b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:37.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.028+0000 7f726ec8d700 1 --2- 172.21.15.50:0/1293912889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7268101ef0 0x7f7268111b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.028+0000 7f726ec8d700 1 -- 172.21.15.50:0/1293912889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7268101540 msgr2=0x7f72681158d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:37.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.028+0000 7f726ec8d700 1 --2- 172.21.15.50:0/1293912889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7268101540 0x7f72681158d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.028+0000 7f726ec8d700 1 -- 172.21.15.50:0/1293912889 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72681b3c90 con 0x7f7268106620 2024-06-06T03:29:37.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.028+0000 7f726ec8d700 1 --2- 172.21.15.50:0/1293912889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7268106620 0x7f72681120b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f726000b0d0 tx=0x7f7260007a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:37.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.029+0000 7f725f7fe700 1 -- 172.21.15.50:0/1293912889 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726001f070 con 0x7f7268106620 2024-06-06T03:29:37.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.029+0000 7f725f7fe700 1 -- 172.21.15.50:0/1293912889 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7260004c50 con 0x7f7268106620 2024-06-06T03:29:37.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.029+0000 7f72706f0700 1 -- 172.21.15.50:0/1293912889 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72681b3e60 con 0x7f7268106620 2024-06-06T03:29:37.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.029+0000 7f72706f0700 1 -- 172.21.15.50:0/1293912889 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72681b4200 con 0x7f7268106620 2024-06-06T03:29:37.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.029+0000 7f725f7fe700 1 -- 172.21.15.50:0/1293912889 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726001b690 con 0x7f7268106620 2024-06-06T03:29:37.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.035+0000 7f727af73b80 1 Processor -- start 2024-06-06T03:29:37.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.035+0000 7f725f7fe700 1 -- 172.21.15.50:0/1293912889 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7260022070 con 0x7f7268106620 2024-06-06T03:29:37.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.036+0000 7f727af73b80 1 -- start start 2024-06-06T03:29:37.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.037+0000 7f727af73b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c3e1ac0a0 0x558c3e1ac480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:37.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.037+0000 7f727af73b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c3e1ac9c0 0x558c3e1a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:37.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.037+0000 7f726dc8b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c3e1ac0a0 0x558c3e1ac480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:37.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.037+0000 7f726dc8b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c3e1ac0a0 0x558c3e1ac480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:57128/0 (socket says 172.21.15.50:57128) 2024-06-06T03:29:37.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.037+0000 7f726dc8b700 1 -- 172.21.15.50:0/3256461982 learned_addr learned my addr 172.21.15.50:0/3256461982 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:37.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.037+0000 7f727af73b80 1 --2- 172.21.15.50:0/3256461982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3e1a79f0 0x558c3e1a7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:37.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.037+0000 7f726e48c700 1 --2- 172.21.15.50:0/3256461982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c3e1ac9c0 0x558c3e1a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:37.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.037+0000 7f727af73b80 1 -- 172.21.15.50:0/3256461982 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558c3e099f60 con 0x558c3e1a79f0 2024-06-06T03:29:37.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.037+0000 7f727af73b80 1 -- 172.21.15.50:0/3256461982 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558c3e0f8850 con 0x558c3e1ac9c0 2024-06-06T03:29:37.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.037+0000 7f727af73b80 1 -- 172.21.15.50:0/3256461982 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558c3e060460 con 0x558c3e1ac0a0 2024-06-06T03:29:37.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.038+0000 7f726dc8b700 1 --2- 172.21.15.50:0/3256461982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3e1a79f0 0x558c3e1a7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:37.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.038+0000 7f726dc8b700 1 -- 172.21.15.50:0/3256461982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c3e1ac9c0 msgr2=0x558c3e1a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:37.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.038+0000 7f726dc8b700 1 --2- 172.21.15.50:0/3256461982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c3e1ac9c0 0x558c3e1a74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.038+0000 7f726dc8b700 1 -- 172.21.15.50:0/3256461982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3e1a79f0 msgr2=0x558c3e1a7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:37.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.038+0000 7f726dc8b700 1 --2- 172.21.15.50:0/3256461982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3e1a79f0 0x558c3e1a7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.038+0000 7f726dc8b700 1 -- 172.21.15.50:0/3256461982 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c3e0478d0 con 0x558c3e1ac0a0 2024-06-06T03:29:37.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.038+0000 7f725f7fe700 1 --2- 172.21.15.50:0/1293912889 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f72540a2d70 0x7f72540a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:37.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.038+0000 7f726dc8b700 1 --2- 172.21.15.50:0/3256461982 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c3e1ac0a0 0x558c3e1ac480 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f72580097c0 tx=0x7f72580058e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfba1640e53127c4 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:37.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.038+0000 7f725f7fe700 1 -- 172.21.15.50:0/1293912889 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f72600cff80 con 0x7f7268106620 2024-06-06T03:29:37.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.038+0000 7f725cff9700 1 -- 172.21.15.50:0/3256461982 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7258004030 con 0x558c3e1ac0a0 2024-06-06T03:29:37.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.038+0000 7f725cff9700 1 -- 172.21.15.50:0/3256461982 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7258003680 con 0x558c3e1ac0a0 2024-06-06T03:29:37.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.039+0000 7f726e48c700 1 --2- 172.21.15.50:0/1293912889 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f72540a2d70 0x7f72540a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:37.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.039+0000 7f725cff9700 1 -- 172.21.15.50:0/3256461982 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7258010650 con 0x558c3e1ac0a0 2024-06-06T03:29:37.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.040+0000 7f726e48c700 1 --2- 172.21.15.50:0/1293912889 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f72540a2d70 0x7f72540a5230 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7264009bd0 tx=0x7f7264008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:37.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.040+0000 7f727af73b80 1 -- 172.21.15.50:0/3256461982 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c3e1ac0a0 msgr2=0x558c3e1ac480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:37.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.040+0000 7f727af73b80 1 --2- 172.21.15.50:0/3256461982 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c3e1ac0a0 0x558c3e1ac480 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f72580097c0 tx=0x7f72580058e0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.040+0000 7f727af73b80 1 -- 172.21.15.50:0/3256461982 shutdown_connections 2024-06-06T03:29:37.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.040+0000 7f727af73b80 1 --2- 172.21.15.50:0/3256461982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3e1a79f0 0x558c3e1a7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.040+0000 7f727af73b80 1 --2- 172.21.15.50:0/3256461982 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c3e1ac0a0 0x558c3e1ac480 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.040+0000 7f727af73b80 1 --2- 172.21.15.50:0/3256461982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c3e1ac9c0 0x558c3e1a74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.040+0000 7f727af73b80 1 -- 172.21.15.50:0/3256461982 >> 172.21.15.50:0/3256461982 conn(0x558c3e0d4080 msgr2=0x558c3e1a2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:37.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.041+0000 7f727af73b80 1 -- 172.21.15.50:0/3256461982 shutdown_connections 2024-06-06T03:29:37.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.041+0000 7f727af73b80 1 -- 172.21.15.50:0/3256461982 wait complete. 2024-06-06T03:29:37.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.041+0000 7f727af73b80 1 -- start start 2024-06-06T03:29:37.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.041+0000 7f727af73b80 1 Processor -- start 2024-06-06T03:29:37.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.042+0000 7f727af73b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c3e1a79f0 0x558c3e1b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:37.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.042+0000 7f727af73b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c3e1ac0a0 0x558c3e1b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:37.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.042+0000 7f727af73b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3e1ac9c0 0x558c3e1b1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:37.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.042+0000 7f726e48c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c3e1a79f0 0x558c3e1b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:37.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.043+0000 7f726e48c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c3e1a79f0 0x558c3e1b37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:57142/0 (socket says 172.21.15.50:57142) 2024-06-06T03:29:37.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.043+0000 7f727af73b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558c3e098fc0 con 0x558c3e1ac9c0 2024-06-06T03:29:37.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.043+0000 7f727af73b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558c3e0f4810 con 0x558c3e1ac0a0 2024-06-06T03:29:37.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.043+0000 7f727af73b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558c3e1b44a0 con 0x558c3e1a79f0 2024-06-06T03:29:37.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.043+0000 7f726ec8d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3e1ac9c0 0x558c3e1b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:37.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.043+0000 7f726ec8d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3e1ac9c0 0x558c3e1b1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33814/0 (socket says 172.21.15.50:33814) 2024-06-06T03:29:37.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.043+0000 7f726ec8d700 1 -- 172.21.15.50:0/1269924258 learned_addr learned my addr 172.21.15.50:0/1269924258 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:37.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.043+0000 7f727af73b80 10 client.0 _ll_register_callbacks cb 0x558c3e08e5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:29:37.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.043+0000 7f726dc8b700 1 --2- 172.21.15.50:0/1269924258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c3e1ac0a0 0x558c3e1b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:37.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.043+0000 7f726ec8d700 1 -- 172.21.15.50:0/1269924258 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c3e1a79f0 msgr2=0x558c3e1b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:37.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.043+0000 7f726ec8d700 1 --2- 172.21.15.50:0/1269924258 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c3e1a79f0 0x558c3e1b37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.043+0000 7f726ec8d700 1 -- 172.21.15.50:0/1269924258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c3e1ac0a0 msgr2=0x558c3e1b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:37.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.043+0000 7f726ec8d700 1 --2- 172.21.15.50:0/1269924258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c3e1ac0a0 0x558c3e1b0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.043+0000 7f726ec8d700 1 -- 172.21.15.50:0/1269924258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c3e0be750 con 0x558c3e1ac9c0 2024-06-06T03:29:37.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.044+0000 7f726ec8d700 1 --2- 172.21.15.50:0/1269924258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3e1ac9c0 0x558c3e1b1020 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f726009c420 tx=0x7f726009bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c73160b9db4e38 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:37.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.044+0000 7f726e48c700 1 --2- 172.21.15.50:0/1269924258 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c3e1a79f0 0x558c3e1b37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:29:37.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.044+0000 7f7251ffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:29:37.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.044+0000 7f7251ffb700 1 -- 172.21.15.50:0/1269924258 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72600b5060 con 0x558c3e1ac9c0 2024-06-06T03:29:37.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.044+0000 7f727af73b80 1 -- 172.21.15.50:0/1269924258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7258003680 con 0x558c3e1ac9c0 2024-06-06T03:29:37.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.044+0000 7f7251ffb700 1 -- 172.21.15.50:0/1269924258 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f726009a790 con 0x558c3e1ac9c0 2024-06-06T03:29:37.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.045+0000 7f7251ffb700 1 -- 172.21.15.50:0/1269924258 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7260029070 con 0x558c3e1ac9c0 2024-06-06T03:29:37.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.045+0000 7f727af73b80 10 client.15939 fetch_fsmap learned FSMap version 29 2024-06-06T03:29:37.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.045+0000 7f727af73b80 1 -- 172.21.15.50:0/1269924258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558c3e1bea70 con 0x558c3e1ac9c0 2024-06-06T03:29:37.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.047+0000 7f7251ffb700 1 -- 172.21.15.50:0/1269924258 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7258003680 con 0x558c3e1ac9c0 2024-06-06T03:29:37.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.047+0000 7f7251ffb700 1 -- 172.21.15.50:0/1269924258 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f7260011070 con 0x558c3e1ac9c0 2024-06-06T03:29:37.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.047+0000 7f727af73b80 10 client.15939 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:29:37.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.047+0000 7f727af73b80 10 client.15939 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:29:37.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.047+0000 7f727af73b80 20 client.15939 populate_metadata read hostname 'smithi050' 2024-06-06T03:29:37.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.047+0000 7f727af73b80 1 --2- 172.21.15.50:0/1269924258 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x558c3e1c1010 0x558c3e1c3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:37.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.047+0000 7f727af73b80 4 client.15939 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:29:37.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.047+0000 7f727af73b80 1 -- 172.21.15.50:0/1269924258 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c3e105d50 con 0x558c3e1c1010 2024-06-06T03:29:37.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.047+0000 7f726e48c700 1 --2- 172.21.15.50:0/1269924258 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x558c3e1c1010 0x558c3e1c3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:37.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.048+0000 7f726e48c700 1 --2- 172.21.15.50:0/1269924258 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x558c3e1c1010 0x558c3e1c3430 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92fc26190464308a server_cookie=d292f3f511544c4e in_seq=0 out_seq=0 2024-06-06T03:29:37.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.048+0000 7f7251ffb700 10 client.15939 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:37.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.049+0000 7f7251ffb700 1 -- 172.21.15.50:0/1269924258 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x558c3e105d50 con 0x558c3e1c1010 2024-06-06T03:29:37.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.049+0000 7f7251ffb700 10 client.15939 handle_command_reply: tid=0 2024-06-06T03:29:37.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.049+0000 7f727af73b80 1 client.15939 shutdown 2024-06-06T03:29:37.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.050+0000 7f727af73b80 1 -- 172.21.15.50:0/1269924258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3e1ac9c0 msgr2=0x558c3e1b1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:37.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.050+0000 7f727af73b80 1 --2- 172.21.15.50:0/1269924258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3e1ac9c0 0x558c3e1b1020 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f726009c420 tx=0x7f726009bdf0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.052+0000 7f727af73b80 1 -- 172.21.15.50:0/1269924258 shutdown_connections 2024-06-06T03:29:37.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.052+0000 7f727af73b80 1 --2- 172.21.15.50:0/1269924258 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x558c3e1c1010 0x558c3e1c3430 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.052+0000 7f727af73b80 1 --2- 172.21.15.50:0/1269924258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3e1ac9c0 0x558c3e1b1020 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.052+0000 7f727af73b80 1 --2- 172.21.15.50:0/1269924258 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c3e1a79f0 0x558c3e1b37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.052+0000 7f727af73b80 1 --2- 172.21.15.50:0/1269924258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c3e1ac0a0 0x558c3e1b0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.052+0000 7f727af73b80 1 -- 172.21.15.50:0/1269924258 >> 172.21.15.50:0/1269924258 conn(0x558c3e0d4080 msgr2=0x558c3e1a1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:37.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.052+0000 7f7251ffb700 0 client.15939 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:37.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.052+0000 7f727af73b80 1 -- 172.21.15.50:0/1269924258 shutdown_connections 2024-06-06T03:29:37.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.052+0000 7f727af73b80 1 -- 172.21.15.50:0/1269924258 wait complete. 2024-06-06T03:29:37.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.053+0000 7f727af73b80 20 client.15939 trim_cache size 0 max 16384 2024-06-06T03:29:37.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.096+0000 7f727af73b80 1 Processor -- start 2024-06-06T03:29:37.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.096+0000 7f727af73b80 1 -- start start 2024-06-06T03:29:37.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.097+0000 7f727af73b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3e1a79f0 0x558c3e1a20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:37.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.097+0000 7f727af73b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c3e1ac0a0 0x558c3e1c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:37.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.097+0000 7f727af73b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c3e1ac9c0 0x558c3e1c9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.097+0000 7f727af73b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f724c011300 con 0x558c3e1a79f0 2024-06-06T03:29:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.097+0000 7f727af73b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f724c00eb90 con 0x558c3e1ac9c0 2024-06-06T03:29:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.097+0000 7f727af73b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f724c00c9e0 con 0x558c3e1ac0a0 2024-06-06T03:29:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.097+0000 7f726dc8b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c3e1ac0a0 0x558c3e1c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.097+0000 7f726dc8b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c3e1ac0a0 0x558c3e1c8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:57146/0 (socket says 172.21.15.50:57146) 2024-06-06T03:29:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.097+0000 7f726dc8b700 1 -- 172.21.15.50:0/3378690322 learned_addr learned my addr 172.21.15.50:0/3378690322 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.097+0000 7f726e48c700 1 --2- 172.21.15.50:0/3378690322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3e1a79f0 0x558c3e1a20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.097+0000 7f726ec8d700 1 --2- 172.21.15.50:0/3378690322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c3e1ac9c0 0x558c3e1c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.098+0000 7f726e48c700 1 -- 172.21.15.50:0/3378690322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c3e1ac0a0 msgr2=0x558c3e1c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:37.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.098+0000 7f726e48c700 1 --2- 172.21.15.50:0/3378690322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c3e1ac0a0 0x558c3e1c8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.098+0000 7f726e48c700 1 -- 172.21.15.50:0/3378690322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c3e1ac9c0 msgr2=0x558c3e1c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:37.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.098+0000 7f726e48c700 1 --2- 172.21.15.50:0/3378690322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c3e1ac9c0 0x558c3e1c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.098+0000 7f726e48c700 1 -- 172.21.15.50:0/3378690322 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c3e1b1330 con 0x558c3e1a79f0 2024-06-06T03:29:37.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.098+0000 7f726dc8b700 1 --2- 172.21.15.50:0/3378690322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c3e1ac0a0 0x558c3e1c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:29:37.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.098+0000 7f726ec8d700 1 --2- 172.21.15.50:0/3378690322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c3e1ac9c0 0x558c3e1c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:29:37.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.098+0000 7f726e48c700 1 --2- 172.21.15.50:0/3378690322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3e1a79f0 0x558c3e1a20d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x558c3e1c3c60 tx=0x7f7264014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41cbbcf64697cb32 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:37.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.099+0000 7f7253fff700 1 -- 172.21.15.50:0/3378690322 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72640158c0 con 0x558c3e1a79f0 2024-06-06T03:29:37.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.099+0000 7f7253fff700 1 -- 172.21.15.50:0/3378690322 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f726402f070 con 0x558c3e1a79f0 2024-06-06T03:29:37.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.099+0000 7f7253fff700 1 -- 172.21.15.50:0/3378690322 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7264029aa0 con 0x558c3e1a79f0 2024-06-06T03:29:37.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.101+0000 7f727af73b80 1 -- 172.21.15.50:0/3378690322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3e1a79f0 msgr2=0x558c3e1a20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:37.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.101+0000 7f727af73b80 1 --2- 172.21.15.50:0/3378690322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3e1a79f0 0x558c3e1a20d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x558c3e1c3c60 tx=0x7f7264014000 comp rx=0 tx=0).stop 2024-06-06T03:29:37.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.105+0000 7f727af73b80 1 -- 172.21.15.50:0/3378690322 shutdown_connections 2024-06-06T03:29:37.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.105+0000 7f727af73b80 1 --2- 172.21.15.50:0/3378690322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c3e1ac9c0 0x558c3e1c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.105+0000 7f727af73b80 1 --2- 172.21.15.50:0/3378690322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3e1a79f0 0x558c3e1a20d0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.105+0000 7f727af73b80 1 --2- 172.21.15.50:0/3378690322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c3e1ac0a0 0x558c3e1c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.105+0000 7f727af73b80 1 -- 172.21.15.50:0/3378690322 >> 172.21.15.50:0/3378690322 conn(0x558c3e0d4080 msgr2=0x558c3e1af3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:37.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.108+0000 7f727af73b80 1 -- 172.21.15.50:0/3378690322 shutdown_connections 2024-06-06T03:29:37.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.109+0000 7f727af73b80 1 -- 172.21.15.50:0/3378690322 wait complete. 2024-06-06T03:29:37.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.109+0000 7f727af73b80 1 -- start start 2024-06-06T03:29:37.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.110+0000 7f727af73b80 1 Processor -- start 2024-06-06T03:29:37.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.110+0000 7f727af73b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3e1a79f0 0x558c3e1b9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:37.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.110+0000 7f727af73b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c3e1ac0a0 0x558c3e1adf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:37.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.111+0000 7f727af73b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c3e1ac9c0 0x558c3e1ae440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:37.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.111+0000 7f727af73b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f724c00d050 con 0x558c3e1a79f0 2024-06-06T03:29:37.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.111+0000 7f727af73b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f724c00e4c0 con 0x558c3e1ac9c0 2024-06-06T03:29:37.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.111+0000 7f727af73b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f724c00d720 con 0x558c3e1ac0a0 2024-06-06T03:29:37.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.111+0000 7f727af73b80 10 client.0 _ll_register_callbacks cb 0x558c3e08e5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:29:37.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.111+0000 7f726e48c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3e1a79f0 0x558c3e1b9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:37.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.111+0000 7f726e48c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3e1a79f0 0x558c3e1b9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33836/0 (socket says 172.21.15.50:33836) 2024-06-06T03:29:37.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.111+0000 7f726e48c700 1 -- 172.21.15.50:0/2234224853 learned_addr learned my addr 172.21.15.50:0/2234224853 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:37.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.112+0000 7f726e48c700 1 -- 172.21.15.50:0/2234224853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c3e1ac0a0 msgr2=0x558c3e1adf00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:29:37.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.112+0000 7f726e48c700 1 --2- 172.21.15.50:0/2234224853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c3e1ac0a0 0x558c3e1adf00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.112+0000 7f726e48c700 1 -- 172.21.15.50:0/2234224853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c3e1ac9c0 msgr2=0x558c3e1ae440 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:29:37.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.112+0000 7f726e48c700 1 --2- 172.21.15.50:0/2234224853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c3e1ac9c0 0x558c3e1ae440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.112+0000 7f726e48c700 1 -- 172.21.15.50:0/2234224853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c3e1ae980 con 0x558c3e1a79f0 2024-06-06T03:29:37.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.114+0000 7f726e48c700 1 --2- 172.21.15.50:0/2234224853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3e1a79f0 0x558c3e1b9c90 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7264008010 tx=0x7f7264015970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=384cd4a897086f41 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:37.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.115+0000 7f7251ffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:29:37.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.115+0000 7f7251ffb700 1 -- 172.21.15.50:0/2234224853 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7264038060 con 0x558c3e1a79f0 2024-06-06T03:29:37.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.116+0000 7f727af73b80 1 -- 172.21.15.50:0/2234224853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f726402f070 con 0x558c3e1a79f0 2024-06-06T03:29:37.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.116+0000 7f7251ffb700 1 -- 172.21.15.50:0/2234224853 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f7264028040 con 0x558c3e1a79f0 2024-06-06T03:29:37.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.116+0000 7f7251ffb700 1 -- 172.21.15.50:0/2234224853 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7264015e50 con 0x558c3e1a79f0 2024-06-06T03:29:37.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.117+0000 7f727af73b80 10 client.15945 fetch_fsmap learned FSMap version 29 2024-06-06T03:29:37.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.117+0000 7f727af73b80 1 -- 172.21.15.50:0/2234224853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558c3e22bcf0 con 0x558c3e1a79f0 2024-06-06T03:29:37.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.118+0000 7f7251ffb700 1 -- 172.21.15.50:0/2234224853 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f726402f070 con 0x558c3e1a79f0 2024-06-06T03:29:37.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.118+0000 7f7251ffb700 1 -- 172.21.15.50:0/2234224853 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f72640225f0 con 0x558c3e1a79f0 2024-06-06T03:29:37.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.118+0000 7f727af73b80 10 client.15945 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:29:37.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.118+0000 7f727af73b80 10 client.15945 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:29:37.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.118+0000 7f727af73b80 20 client.15945 populate_metadata read hostname 'smithi050' 2024-06-06T03:29:37.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.118+0000 7f727af73b80 1 --2- 172.21.15.50:0/2234224853 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x558c3e22c240 0x558c3e22e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:37.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.119+0000 7f727af73b80 4 client.15945 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-06T03:29:37.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.119+0000 7f727af73b80 1 -- 172.21.15.50:0/2234224853 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558c3e1002d0 con 0x558c3e22c240 2024-06-06T03:29:37.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.120+0000 7f726dc8b700 1 --2- 172.21.15.50:0/2234224853 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x558c3e22c240 0x558c3e22e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:37.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.121+0000 7f726dc8b700 1 --2- 172.21.15.50:0/2234224853 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x558c3e22c240 0x558c3e22e660 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8de9eacab8c5db25 server_cookie=991c8f16df7c8a3f in_seq=0 out_seq=0 2024-06-06T03:29:37.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.121+0000 7f7251ffb700 10 client.15945 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:37.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.121+0000 7f7251ffb700 1 -- 172.21.15.50:0/2234224853 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558c3e1002d0 con 0x558c3e22c240 2024-06-06T03:29:37.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.121+0000 7f7251ffb700 10 client.15945 handle_command_reply: tid=0 2024-06-06T03:29:37.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.121+0000 7f727af73b80 1 client.15945 shutdown 2024-06-06T03:29:37.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.122+0000 7f727af73b80 1 -- 172.21.15.50:0/2234224853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3e1a79f0 msgr2=0x558c3e1b9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:37.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.122+0000 7f727af73b80 1 --2- 172.21.15.50:0/2234224853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3e1a79f0 0x558c3e1b9c90 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7264008010 tx=0x7f7264015970 comp rx=0 tx=0).stop 2024-06-06T03:29:37.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.122+0000 7f727af73b80 1 -- 172.21.15.50:0/2234224853 shutdown_connections 2024-06-06T03:29:37.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.122+0000 7f727af73b80 1 --2- 172.21.15.50:0/2234224853 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x558c3e22c240 0x558c3e22e660 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.122+0000 7f727af73b80 1 --2- 172.21.15.50:0/2234224853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c3e1ac9c0 0x558c3e1ae440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.122+0000 7f7251ffb700 0 client.15945 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:37.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.122+0000 7f727af73b80 1 --2- 172.21.15.50:0/2234224853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3e1a79f0 0x558c3e1b9c90 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.122+0000 7f727af73b80 1 --2- 172.21.15.50:0/2234224853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c3e1ac0a0 0x558c3e1adf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.122+0000 7f727af73b80 1 -- 172.21.15.50:0/2234224853 >> 172.21.15.50:0/2234224853 conn(0x558c3e0d4080 msgr2=0x558c3e1b2310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:37.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.123+0000 7f727af73b80 1 -- 172.21.15.50:0/2234224853 shutdown_connections 2024-06-06T03:29:37.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.123+0000 7f727af73b80 1 -- 172.21.15.50:0/2234224853 wait complete. 2024-06-06T03:29:37.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.124+0000 7f727af73b80 20 client.15945 trim_cache size 0 max 16384 2024-06-06T03:29:37.124 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:29:37.124 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2024-06-06T03:29:37.124 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-06-06T03:29:37.124 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:29:37.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.125+0000 7f72706f0700 1 -- 172.21.15.50:0/1293912889 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f72540a2d70 msgr2=0x7f72540a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:37.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.125+0000 7f72706f0700 1 --2- 172.21.15.50:0/1293912889 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f72540a2d70 0x7f72540a5230 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7264009bd0 tx=0x7f7264008040 comp rx=0 tx=0).stop 2024-06-06T03:29:37.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.125+0000 7f72706f0700 1 -- 172.21.15.50:0/1293912889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7268106620 msgr2=0x7f72681120b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:37.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.125+0000 7f72706f0700 1 --2- 172.21.15.50:0/1293912889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7268106620 0x7f72681120b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f726000b0d0 tx=0x7f7260007a00 comp rx=0 tx=0).stop 2024-06-06T03:29:37.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.125+0000 7f72706f0700 1 -- 172.21.15.50:0/1293912889 shutdown_connections 2024-06-06T03:29:37.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.125+0000 7f72706f0700 1 --2- 172.21.15.50:0/1293912889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7268106620 0x7f72681120b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.125+0000 7f72706f0700 1 --2- 172.21.15.50:0/1293912889 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f72540a2d70 0x7f72540a5230 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.125+0000 7f72706f0700 1 --2- 172.21.15.50:0/1293912889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7268101540 0x7f72681158d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.125+0000 7f72706f0700 1 --2- 172.21.15.50:0/1293912889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7268101ef0 0x7f7268111b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:37.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.125+0000 7f72706f0700 1 -- 172.21.15.50:0/1293912889 >> 172.21.15.50:0/1293912889 conn(0x7f72680fce10 msgr2=0x7f72680fda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:37.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.126+0000 7f72706f0700 1 -- 172.21.15.50:0/1293912889 shutdown_connections 2024-06-06T03:29:37.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:37.126+0000 7f72706f0700 1 -- 172.21.15.50:0/1293912889 wait complete. 2024-06-06T03:29:37.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:37 smithi122 ceph-mon[35759]: pgmap v520: 129 pgs: 129 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 58 MiB/s wr, 934 op/s 2024-06-06T03:29:37.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:37 smithi122 ceph-mon[35759]: scrub summary: idle 2024-06-06T03:29:37.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:37 smithi050 ceph-mon[32421]: pgmap v520: 129 pgs: 129 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 58 MiB/s wr, 934 op/s 2024-06-06T03:29:37.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:37 smithi050 ceph-mon[32421]: scrub summary: idle 2024-06-06T03:29:37.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:37 smithi079 ceph-mon[35478]: pgmap v520: 129 pgs: 129 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 58 MiB/s wr, 934 op/s 2024-06-06T03:29:37.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:37 smithi079 ceph-mon[35478]: scrub summary: idle 2024-06-06T03:29:38.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:38 smithi050 ceph-mon[32421]: scrub summary: idle 2024-06-06T03:29:38.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:38 smithi122 ceph-mon[35759]: scrub summary: idle 2024-06-06T03:29:38.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:38 smithi079 ceph-mon[35478]: scrub summary: idle 2024-06-06T03:29:39.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:39 smithi122 ceph-mon[35759]: pgmap v521: 129 pgs: 129 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 49 MiB/s wr, 797 op/s 2024-06-06T03:29:39.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:39 smithi050 ceph-mon[32421]: pgmap v521: 129 pgs: 129 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 49 MiB/s wr, 797 op/s 2024-06-06T03:29:39.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:39 smithi079 ceph-mon[35478]: pgmap v521: 129 pgs: 129 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 49 MiB/s wr, 797 op/s 2024-06-06T03:29:41.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:41 smithi122 ceph-mon[35759]: pgmap v522: 129 pgs: 129 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 59 MiB/s wr, 957 op/s 2024-06-06T03:29:41.486 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:41 smithi050 ceph-mon[32421]: pgmap v522: 129 pgs: 129 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 59 MiB/s wr, 957 op/s 2024-06-06T03:29:41.542 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-06T03:29:41.543 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T03:29:41.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:41 smithi079 ceph-mon[35478]: pgmap v522: 129 pgs: 129 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 59 MiB/s wr, 957 op/s 2024-06-06T03:29:42.019 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:29:42.069 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.069+0000 7f7da62ee640 1 -- 172.21.15.50:0/2165335572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7da01053e0 msgr2=0x7f7da0105860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:42.069 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.070+0000 7f7da62ee640 1 --2- 172.21.15.50:0/2165335572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7da01053e0 0x7f7da0105860 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7d98009ca0 tx=0x7f7d9802a8e0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.069 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.070+0000 7f7da62ee640 1 -- 172.21.15.50:0/2165335572 shutdown_connections 2024-06-06T03:29:42.069 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.070+0000 7f7da62ee640 1 --2- 172.21.15.50:0/2165335572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7da0102a30 0x7f7da0104ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.069 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.070+0000 7f7da62ee640 1 --2- 172.21.15.50:0/2165335572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7da01053e0 0x7f7da0105860 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.070 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.070+0000 7f7da62ee640 1 --2- 172.21.15.50:0/2165335572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7da01000c0 0x7f7da01024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.070 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.070+0000 7f7da62ee640 1 -- 172.21.15.50:0/2165335572 >> 172.21.15.50:0/2165335572 conn(0x7f7da00fbcc0 msgr2=0x7f7da00fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:42.070 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.070+0000 7f7da62ee640 1 -- 172.21.15.50:0/2165335572 shutdown_connections 2024-06-06T03:29:42.071 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.070+0000 7f7da62ee640 1 -- 172.21.15.50:0/2165335572 wait complete. 2024-06-06T03:29:42.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.071+0000 7f7da62ee640 1 Processor -- start 2024-06-06T03:29:42.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.071+0000 7f7da62ee640 1 -- start start 2024-06-06T03:29:42.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.072+0000 7f7da62ee640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7da01000c0 0x7f7da0070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:42.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.072+0000 7f7da62ee640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7da0102a30 0x7f7da0070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:42.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.072+0000 7f7da62ee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7da01053e0 0x7f7da01ae060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:42.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.072+0000 7f7da62ee640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7da0113950 con 0x7f7da0102a30 2024-06-06T03:29:42.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.072+0000 7f7da62ee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7da01137d0 con 0x7f7da01053e0 2024-06-06T03:29:42.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.072+0000 7f7da62ee640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7da0113ad0 con 0x7f7da01000c0 2024-06-06T03:29:42.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.072+0000 7f7d9ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7da01000c0 0x7f7da0070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:42.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.072+0000 7f7d9ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7da01000c0 0x7f7da0070330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:48026/0 (socket says 172.21.15.50:48026) 2024-06-06T03:29:42.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.072+0000 7f7d9ffff640 1 -- 172.21.15.50:0/2212371853 learned_addr learned my addr 172.21.15.50:0/2212371853 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:42.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.072+0000 7f7da488b640 1 --2- 172.21.15.50:0/2212371853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7da01053e0 0x7f7da01ae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:42.073 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.072+0000 7f7d9ffff640 1 -- 172.21.15.50:0/2212371853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7da01053e0 msgr2=0x7f7da01ae060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:42.073 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.072+0000 7f7d9ffff640 1 --2- 172.21.15.50:0/2212371853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7da01053e0 0x7f7da01ae060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.073 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.072+0000 7f7d9ffff640 1 -- 172.21.15.50:0/2212371853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7da0102a30 msgr2=0x7f7da0070870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:42.073 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.072+0000 7f7d9ffff640 1 --2- 172.21.15.50:0/2212371853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7da0102a30 0x7f7da0070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.073 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.072+0000 7f7d9ffff640 1 -- 172.21.15.50:0/2212371853 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7da01ae5a0 con 0x7f7da01000c0 2024-06-06T03:29:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.073+0000 7f7d9ffff640 1 --2- 172.21.15.50:0/2212371853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7da01000c0 0x7f7da0070330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7d9000c920 tx=0x7f7d9000cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.073+0000 7f7d9d7fa640 1 -- 172.21.15.50:0/2212371853 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d90007c70 con 0x7f7da01000c0 2024-06-06T03:29:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.073+0000 7f7d9d7fa640 1 -- 172.21.15.50:0/2212371853 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7d90007e10 con 0x7f7da01000c0 2024-06-06T03:29:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.073+0000 7f7d9d7fa640 1 -- 172.21.15.50:0/2212371853 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d90018840 con 0x7f7da01000c0 2024-06-06T03:29:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.074+0000 7f7da62ee640 1 -- 172.21.15.50:0/2212371853 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7da01ae770 con 0x7f7da01000c0 2024-06-06T03:29:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.074+0000 7f7da62ee640 1 -- 172.21.15.50:0/2212371853 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7da01aeb80 con 0x7f7da01000c0 2024-06-06T03:29:42.078 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.079+0000 7f7d9d7fa640 1 -- 172.21.15.50:0/2212371853 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7d900189e0 con 0x7f7da01000c0 2024-06-06T03:29:42.079 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.080+0000 7f7da8ffc740 1 Processor -- start 2024-06-06T03:29:42.079 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.080+0000 7f7da8ffc740 1 -- start start 2024-06-06T03:29:42.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.081+0000 7f7da8ffc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c926de1e0 0x563c926de600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:42.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.081+0000 7f7da8ffc740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c926debd0 0x563c926e36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:42.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.081+0000 7f7da8ffc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c926e3d40 0x563c926e61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:42.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.081+0000 7f7da8ffc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563c926414f0 con 0x563c926e3d40 2024-06-06T03:29:42.081 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.081+0000 7f7da8ffc740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563c925df870 con 0x563c926debd0 2024-06-06T03:29:42.081 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.081+0000 7f7da8ffc740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563c9263d4b0 con 0x563c926de1e0 2024-06-06T03:29:42.081 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.081+0000 7f7d9ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c926debd0 0x563c926e36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:42.081 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.081+0000 7f7da488b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c926de1e0 0x563c926de600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:42.081 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.081+0000 7f7da488b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c926de1e0 0x563c926de600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:48042/0 (socket says 172.21.15.50:48042) 2024-06-06T03:29:42.081 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.081+0000 7f7da488b640 1 -- 172.21.15.50:0/1389452795 learned_addr learned my addr 172.21.15.50:0/1389452795 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:42.081 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.081+0000 7f7d9ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c926debd0 0x563c926e36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:35944/0 (socket says 172.21.15.50:35944) 2024-06-06T03:29:42.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.081+0000 7f7d9d7fa640 1 --2- 172.21.15.50:0/2212371853 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7d8c0a2c00 0x7f7d8c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:42.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.082+0000 7f7d9d7fa640 1 -- 172.21.15.50:0/2212371853 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f7d900cf370 con 0x7f7da01000c0 2024-06-06T03:29:42.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.082+0000 7f7da488b640 1 -- 172.21.15.50:0/1389452795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c926debd0 msgr2=0x563c926e36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:42.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.082+0000 7f7da488b640 1 --2- 172.21.15.50:0/1389452795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c926debd0 0x563c926e36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.082+0000 7f7da488b640 1 -- 172.21.15.50:0/1389452795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c926e3d40 msgr2=0x563c926e61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:42.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.082+0000 7f7da488b640 1 --2- 172.21.15.50:0/1389452795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c926e3d40 0x563c926e61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.082+0000 7f7da488b640 1 -- 172.21.15.50:0/1389452795 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c925fb9b0 con 0x563c926de1e0 2024-06-06T03:29:42.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.082+0000 7f7da488b640 1 --2- 172.21.15.50:0/2212371853 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7d8c0a2c00 0x7f7d8c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:42.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.082+0000 7f7da488b640 1 --2- 172.21.15.50:0/1389452795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c926de1e0 0x563c926de600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7d98033040 tx=0x7f7d980315e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e13d4736f72b326d server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:42.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.083+0000 7f7d967fc640 1 -- 172.21.15.50:0/1389452795 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d98042040 con 0x563c926de1e0 2024-06-06T03:29:42.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.083+0000 7f7d967fc640 1 -- 172.21.15.50:0/1389452795 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7d98036040 con 0x563c926de1e0 2024-06-06T03:29:42.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.083+0000 7f7d967fc640 1 -- 172.21.15.50:0/1389452795 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d98047400 con 0x563c926de1e0 2024-06-06T03:29:42.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.084+0000 7f7da8ffc740 1 -- 172.21.15.50:0/1389452795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c926de1e0 msgr2=0x563c926de600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:42.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.084+0000 7f7da8ffc740 1 --2- 172.21.15.50:0/1389452795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c926de1e0 0x563c926de600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7d98033040 tx=0x7f7d980315e0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.084+0000 7f7da488b640 1 --2- 172.21.15.50:0/2212371853 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7d8c0a2c00 0x7f7d8c0a50c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7d9804d000 tx=0x7f7d9804e000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:42.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.085+0000 7f7da8ffc740 1 -- 172.21.15.50:0/1389452795 shutdown_connections 2024-06-06T03:29:42.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.085+0000 7f7da8ffc740 1 --2- 172.21.15.50:0/1389452795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c926e3d40 0x563c926e61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.085+0000 7f7da8ffc740 1 --2- 172.21.15.50:0/1389452795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c926debd0 0x563c926e36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.085+0000 7f7da8ffc740 1 --2- 172.21.15.50:0/1389452795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c926de1e0 0x563c926de600 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.085+0000 7f7da8ffc740 1 -- 172.21.15.50:0/1389452795 >> 172.21.15.50:0/1389452795 conn(0x563c926d9850 msgr2=0x563c926d9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:42.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.085+0000 7f7da8ffc740 1 -- 172.21.15.50:0/1389452795 shutdown_connections 2024-06-06T03:29:42.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.085+0000 7f7da8ffc740 1 -- 172.21.15.50:0/1389452795 wait complete. 2024-06-06T03:29:42.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.086+0000 7f7da8ffc740 1 -- start start 2024-06-06T03:29:42.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.086+0000 7f7da8ffc740 1 Processor -- start 2024-06-06T03:29:42.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.087+0000 7f7da8ffc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c926de1e0 0x563c926e84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:42.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.087+0000 7f7da8ffc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c926debd0 0x563c926e89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:42.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.087+0000 7f7da8ffc740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c926e3d40 0x563c926efa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:42.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.087+0000 7f7da8ffc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563c926e6cf0 con 0x563c926debd0 2024-06-06T03:29:42.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.087+0000 7f7da8ffc740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563c925caae0 con 0x563c926e3d40 2024-06-06T03:29:42.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.087+0000 7f7da8ffc740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563c926e6e70 con 0x563c926de1e0 2024-06-06T03:29:42.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.087+0000 7f7da8ffc740 10 client.0 _ll_register_callbacks cb 0x563c926039b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:29:42.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.087+0000 7f7da488b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c926e3d40 0x563c926efa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:42.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.087+0000 7f7d9ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c926de1e0 0x563c926e84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:42.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.087+0000 7f7d9ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c926de1e0 0x563c926e84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:48056/0 (socket says 172.21.15.50:48056) 2024-06-06T03:29:42.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.087+0000 7f7d9ffff640 1 -- 172.21.15.50:0/2807045716 learned_addr learned my addr 172.21.15.50:0/2807045716 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:42.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.087+0000 7f7d9f7fe640 1 --2- 172.21.15.50:0/2807045716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c926debd0 0x563c926e89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:42.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.087+0000 7f7d9ffff640 1 -- 172.21.15.50:0/2807045716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c926e3d40 msgr2=0x563c926efa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:42.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.087+0000 7f7d9ffff640 1 --2- 172.21.15.50:0/2807045716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c926e3d40 0x563c926efa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.087+0000 7f7d9ffff640 1 -- 172.21.15.50:0/2807045716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c926debd0 msgr2=0x563c926e89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:42.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.087+0000 7f7d9ffff640 1 --2- 172.21.15.50:0/2807045716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c926debd0 0x563c926e89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.088+0000 7f7d9ffff640 1 -- 172.21.15.50:0/2807045716 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c92355210 con 0x563c926de1e0 2024-06-06T03:29:42.089 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.090+0000 7f7d9ffff640 1 --2- 172.21.15.50:0/2807045716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c926de1e0 0x563c926e84b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7d9009b550 tx=0x7f7d9009b390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99473d2142e238f4 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:42.089 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.090+0000 7f7d7f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:29:42.089 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.090+0000 7f7d7f7fe640 1 -- 172.21.15.50:0/2807045716 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d9009b850 con 0x563c926de1e0 2024-06-06T03:29:42.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.090+0000 7f7d7f7fe640 1 -- 172.21.15.50:0/2807045716 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f7d9000fb70 con 0x563c926de1e0 2024-06-06T03:29:42.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.090+0000 7f7da8ffc740 1 -- 172.21.15.50:0/2807045716 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d98036040 con 0x563c926de1e0 2024-06-06T03:29:42.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.090+0000 7f7d7f7fe640 1 -- 172.21.15.50:0/2807045716 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7d9009fc00 con 0x563c926de1e0 2024-06-06T03:29:42.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.090+0000 7f7da8ffc740 10 client.25540 fetch_fsmap learned FSMap version 29 2024-06-06T03:29:42.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.090+0000 7f7da8ffc740 1 -- 172.21.15.50:0/2807045716 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563c92421620 con 0x563c926de1e0 2024-06-06T03:29:42.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.091+0000 7f7d7f7fe640 1 -- 172.21.15.50:0/2807045716 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7d98036040 con 0x563c926de1e0 2024-06-06T03:29:42.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.091+0000 7f7d7f7fe640 1 -- 172.21.15.50:0/2807045716 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f7d90020020 con 0x563c926de1e0 2024-06-06T03:29:42.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.091+0000 7f7da8ffc740 10 client.25540 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:29:42.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.091+0000 7f7da8ffc740 10 client.25540 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:29:42.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.091+0000 7f7da8ffc740 20 client.25540 populate_metadata read hostname 'smithi050' 2024-06-06T03:29:42.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.091+0000 7f7da8ffc740 1 --2- 172.21.15.50:0/2807045716 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x563c92705300 0x563c92707770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:42.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.091+0000 7f7da8ffc740 4 client.25540 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:29:42.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.091+0000 7f7da8ffc740 1 -- 172.21.15.50:0/2807045716 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c92654f10 con 0x563c92705300 2024-06-06T03:29:42.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.093+0000 7f7d9f7fe640 1 --2- 172.21.15.50:0/2807045716 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x563c92705300 0x563c92707770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:42.093 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.094+0000 7f7d9f7fe640 1 --2- 172.21.15.50:0/2807045716 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x563c92705300 0x563c92707770 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=816540b7b764ebd0 server_cookie=ea71c1657adc9a75 in_seq=0 out_seq=0 2024-06-06T03:29:42.093 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.094+0000 7f7d7f7fe640 10 client.25540 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:42.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.095+0000 7f7d7f7fe640 1 -- 172.21.15.50:0/2807045716 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x563c92654f10 con 0x563c92705300 2024-06-06T03:29:42.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.095+0000 7f7d7f7fe640 10 client.25540 handle_command_reply: tid=0 2024-06-06T03:29:42.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.095+0000 7f7da8ffc740 1 client.25540 shutdown 2024-06-06T03:29:42.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.097+0000 7f7da8ffc740 1 -- 172.21.15.50:0/2807045716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c926de1e0 msgr2=0x563c926e84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:42.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.097+0000 7f7da8ffc740 1 --2- 172.21.15.50:0/2807045716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c926de1e0 0x563c926e84b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7d9009b550 tx=0x7f7d9009b390 comp rx=0 tx=0).stop 2024-06-06T03:29:42.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.097+0000 7f7da8ffc740 1 -- 172.21.15.50:0/2807045716 shutdown_connections 2024-06-06T03:29:42.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.097+0000 7f7da8ffc740 1 --2- 172.21.15.50:0/2807045716 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x563c92705300 0x563c92707770 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.097+0000 7f7da8ffc740 1 --2- 172.21.15.50:0/2807045716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c926debd0 0x563c926e89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.097+0000 7f7da8ffc740 1 --2- 172.21.15.50:0/2807045716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c926e3d40 0x563c926efa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.097+0000 7f7da8ffc740 1 --2- 172.21.15.50:0/2807045716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c926de1e0 0x563c926e84b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.097+0000 7f7da8ffc740 1 -- 172.21.15.50:0/2807045716 >> 172.21.15.50:0/2807045716 conn(0x563c926d9850 msgr2=0x563c926d89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:42.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.097+0000 7f7d7f7fe640 0 client.25540 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:42.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.098+0000 7f7da8ffc740 1 -- 172.21.15.50:0/2807045716 shutdown_connections 2024-06-06T03:29:42.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.098+0000 7f7da8ffc740 1 -- 172.21.15.50:0/2807045716 wait complete. 2024-06-06T03:29:42.098 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.099+0000 7f7da8ffc740 20 client.25540 trim_cache size 0 max 16384 2024-06-06T03:29:42.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.132+0000 7f7da8ffc740 1 Processor -- start 2024-06-06T03:29:42.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.132+0000 7f7da8ffc740 1 -- start start 2024-06-06T03:29:42.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.133+0000 7f7da8ffc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c926de1e0 0x563c926e8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:42.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.133+0000 7f7da8ffc740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c926debd0 0x563c926ef9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:42.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.133+0000 7f7da8ffc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c926e3d40 0x563c926dce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:42.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.133+0000 7f7d9ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c926de1e0 0x563c926e8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:42.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.133+0000 7f7d9ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c926de1e0 0x563c926e8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:48062/0 (socket says 172.21.15.50:48062) 2024-06-06T03:29:42.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.133+0000 7f7d9ffff640 1 -- 172.21.15.50:0/2590683721 learned_addr learned my addr 172.21.15.50:0/2590683721 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:42.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.133+0000 7f7da8ffc740 1 -- 172.21.15.50:0/2590683721 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7da01b30f0 con 0x563c926e3d40 2024-06-06T03:29:42.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.133+0000 7f7da8ffc740 1 -- 172.21.15.50:0/2590683721 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7da01b09c0 con 0x563c926debd0 2024-06-06T03:29:42.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.133+0000 7f7da8ffc740 1 -- 172.21.15.50:0/2590683721 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7da010e920 con 0x563c926de1e0 2024-06-06T03:29:42.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.133+0000 7f7d9f7fe640 1 --2- 172.21.15.50:0/2590683721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c926debd0 0x563c926ef9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:42.134 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.133+0000 7f7da488b640 1 --2- 172.21.15.50:0/2590683721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c926e3d40 0x563c926dce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:42.134 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.134+0000 7f7d9f7fe640 1 -- 172.21.15.50:0/2590683721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c926de1e0 msgr2=0x563c926e8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:42.134 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.134+0000 7f7d9f7fe640 1 --2- 172.21.15.50:0/2590683721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c926de1e0 0x563c926e8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.134 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.134+0000 7f7d9f7fe640 1 -- 172.21.15.50:0/2590683721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c926e3d40 msgr2=0x563c926dce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:42.134 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.134+0000 7f7d9f7fe640 1 --2- 172.21.15.50:0/2590683721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c926e3d40 0x563c926dce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.134 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.134+0000 7f7d9f7fe640 1 -- 172.21.15.50:0/2590683721 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c926defb0 con 0x563c926debd0 2024-06-06T03:29:42.134 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.134+0000 7f7d9f7fe640 1 --2- 172.21.15.50:0/2590683721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c926debd0 0x563c926ef9f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x563c92707ff0 tx=0x7f7d8800a380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4f0e4237263d9bc server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:42.134 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.134+0000 7f7d95ffb640 1 -- 172.21.15.50:0/2590683721 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d88010c20 con 0x563c926debd0 2024-06-06T03:29:42.134 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.134+0000 7f7d95ffb640 1 -- 172.21.15.50:0/2590683721 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7d88010dc0 con 0x563c926debd0 2024-06-06T03:29:42.134 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.134+0000 7f7d95ffb640 1 -- 172.21.15.50:0/2590683721 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d88019480 con 0x563c926debd0 2024-06-06T03:29:42.135 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.136+0000 7f7da8ffc740 1 -- 172.21.15.50:0/2590683721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c926debd0 msgr2=0x563c926ef9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:42.135 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.136+0000 7f7da8ffc740 1 --2- 172.21.15.50:0/2590683721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c926debd0 0x563c926ef9f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x563c92707ff0 tx=0x7f7d8800a380 comp rx=0 tx=0).stop 2024-06-06T03:29:42.137 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.138+0000 7f7da8ffc740 1 -- 172.21.15.50:0/2590683721 shutdown_connections 2024-06-06T03:29:42.137 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.138+0000 7f7da8ffc740 1 --2- 172.21.15.50:0/2590683721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c926e3d40 0x563c926dce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.137 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.138+0000 7f7da8ffc740 1 --2- 172.21.15.50:0/2590683721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c926debd0 0x563c926ef9f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.137 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.138+0000 7f7da8ffc740 1 --2- 172.21.15.50:0/2590683721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c926de1e0 0x563c926e8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.137 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.138+0000 7f7da8ffc740 1 -- 172.21.15.50:0/2590683721 >> 172.21.15.50:0/2590683721 conn(0x563c926d9850 msgr2=0x563c926dc760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:42.137 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.138+0000 7f7da8ffc740 1 -- 172.21.15.50:0/2590683721 shutdown_connections 2024-06-06T03:29:42.137 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.138+0000 7f7da8ffc740 1 -- 172.21.15.50:0/2590683721 wait complete. 2024-06-06T03:29:42.138 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.138+0000 7f7da8ffc740 1 -- start start 2024-06-06T03:29:42.138 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.139+0000 7f7da8ffc740 1 Processor -- start 2024-06-06T03:29:42.139 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.139+0000 7f7da8ffc740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c926de1e0 0x563c926ecda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:42.139 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.139+0000 7f7da8ffc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c926debd0 0x563c926ed2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:42.139 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.139+0000 7f7da8ffc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c926e3d40 0x563c926ee2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:42.139 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.139+0000 7f7da8ffc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7da01aee80 con 0x563c926e3d40 2024-06-06T03:29:42.139 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.139+0000 7f7da8ffc740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7da01b02f0 con 0x563c926de1e0 2024-06-06T03:29:42.139 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.139+0000 7f7da8ffc740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7da01af550 con 0x563c926debd0 2024-06-06T03:29:42.139 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.139+0000 7f7da8ffc740 10 client.0 _ll_register_callbacks cb 0x7f7d9000cf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:29:42.139 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.140+0000 7f7d9ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c926de1e0 0x563c926ecda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:42.140 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.140+0000 7f7da488b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c926e3d40 0x563c926ee2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:42.140 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.140+0000 7f7da488b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c926e3d40 0x563c926ee2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43436/0 (socket says 172.21.15.50:43436) 2024-06-06T03:29:42.140 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.140+0000 7f7da488b640 1 -- 172.21.15.50:0/2481587765 learned_addr learned my addr 172.21.15.50:0/2481587765 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:42.140 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.141+0000 7f7da488b640 1 -- 172.21.15.50:0/2481587765 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c926debd0 msgr2=0x563c926ed2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:29:42.140 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.141+0000 7f7da488b640 1 --2- 172.21.15.50:0/2481587765 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c926debd0 0x563c926ed2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.140 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.141+0000 7f7da488b640 1 -- 172.21.15.50:0/2481587765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c926de1e0 msgr2=0x563c926ecda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:42.140 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.141+0000 7f7da488b640 1 --2- 172.21.15.50:0/2481587765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c926de1e0 0x563c926ecda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.140 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.141+0000 7f7da488b640 1 -- 172.21.15.50:0/2481587765 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c926ee8e0 con 0x563c926e3d40 2024-06-06T03:29:42.141 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.141+0000 7f7da488b640 1 --2- 172.21.15.50:0/2481587765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c926e3d40 0x563c926ee2f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x563c926df430 tx=0x7f7d980318c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503723ef67554a9c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:42.141 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.141+0000 7f7d7f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:29:42.141 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.142+0000 7f7d7f7fe640 1 -- 172.21.15.50:0/2481587765 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d98042020 con 0x563c926e3d40 2024-06-06T03:29:42.141 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.142+0000 7f7d7f7fe640 1 -- 172.21.15.50:0/2481587765 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f7d98003e00 con 0x563c926e3d40 2024-06-06T03:29:42.141 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.142+0000 7f7da8ffc740 1 -- 172.21.15.50:0/2481587765 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d88010dc0 con 0x563c926e3d40 2024-06-06T03:29:42.142 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.143+0000 7f7d7f7fe640 1 -- 172.21.15.50:0/2481587765 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7d98060070 con 0x563c926e3d40 2024-06-06T03:29:42.142 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.143+0000 7f7da8ffc740 10 client.15954 fetch_fsmap learned FSMap version 29 2024-06-06T03:29:42.142 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.143+0000 7f7da8ffc740 1 -- 172.21.15.50:0/2481587765 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563c926efc90 con 0x563c926e3d40 2024-06-06T03:29:42.143 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.144+0000 7f7d7f7fe640 1 -- 172.21.15.50:0/2481587765 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7d98036040 con 0x563c926e3d40 2024-06-06T03:29:42.143 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.144+0000 7f7d7f7fe640 1 -- 172.21.15.50:0/2481587765 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f7d98046070 con 0x563c926e3d40 2024-06-06T03:29:42.143 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.144+0000 7f7da8ffc740 10 client.15954 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:29:42.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.144+0000 7f7da8ffc740 10 client.15954 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:29:42.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.145+0000 7f7da8ffc740 20 client.15954 populate_metadata read hostname 'smithi050' 2024-06-06T03:29:42.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.145+0000 7f7da8ffc740 1 --2- 172.21.15.50:0/2481587765 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x563c92770350 0x563c92772770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:42.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.145+0000 7f7d9ffff640 1 --2- 172.21.15.50:0/2481587765 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x563c92770350 0x563c92772770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.146+0000 7f7da8ffc740 4 client.15954 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:29:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.146+0000 7f7d9ffff640 1 --2- 172.21.15.50:0/2481587765 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x563c92770350 0x563c92772770 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86271197c54df171 server_cookie=e81b1c7477699765 in_seq=0 out_seq=0 2024-06-06T03:29:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.146+0000 7f7d7f7fe640 10 client.15954 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.146+0000 7f7da8ffc740 1 -- 172.21.15.50:0/2481587765 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f7d88010dc0 con 0x563c92770350 2024-06-06T03:29:42.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.150+0000 7f7d7f7fe640 1 -- 172.21.15.50:0/2481587765 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x7f7d88010dc0 con 0x563c92770350 2024-06-06T03:29:42.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.150+0000 7f7d7f7fe640 10 client.15954 handle_command_reply: tid=0 2024-06-06T03:29:42.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.151+0000 7f7da8ffc740 1 client.15954 shutdown 2024-06-06T03:29:42.151 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.151+0000 7f7da8ffc740 1 -- 172.21.15.50:0/2481587765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c926e3d40 msgr2=0x563c926ee2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:42.151 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.151+0000 7f7da8ffc740 1 --2- 172.21.15.50:0/2481587765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c926e3d40 0x563c926ee2f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x563c926df430 tx=0x7f7d980318c0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.151 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.152+0000 7f7da8ffc740 1 -- 172.21.15.50:0/2481587765 shutdown_connections 2024-06-06T03:29:42.151 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.152+0000 7f7da8ffc740 1 --2- 172.21.15.50:0/2481587765 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x563c92770350 0x563c92772770 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.151 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.152+0000 7f7da8ffc740 1 --2- 172.21.15.50:0/2481587765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c926e3d40 0x563c926ee2f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.151 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.152+0000 7f7da8ffc740 1 --2- 172.21.15.50:0/2481587765 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c926debd0 0x563c926ed2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.151 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.152+0000 7f7da8ffc740 1 --2- 172.21.15.50:0/2481587765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c926de1e0 0x563c926ecda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.151 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.152+0000 7f7da8ffc740 1 -- 172.21.15.50:0/2481587765 >> 172.21.15.50:0/2481587765 conn(0x563c926d9850 msgr2=0x563c926e87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:42.151 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.152+0000 7f7d7f7fe640 0 client.15954 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:42.152 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.153+0000 7f7da8ffc740 1 -- 172.21.15.50:0/2481587765 shutdown_connections 2024-06-06T03:29:42.152 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.153+0000 7f7da8ffc740 1 -- 172.21.15.50:0/2481587765 wait complete. 2024-06-06T03:29:42.152 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.154+0000 7f7da8ffc740 20 client.15954 trim_cache size 0 max 16384 2024-06-06T03:29:42.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:29:42.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:29:42.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:29:42.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.157+0000 7f7da62ee640 1 -- 172.21.15.50:0/2212371853 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7d8c0a2c00 msgr2=0x7f7d8c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:42.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.157+0000 7f7da62ee640 1 --2- 172.21.15.50:0/2212371853 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7d8c0a2c00 0x7f7d8c0a50c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7d9804d000 tx=0x7f7d9804e000 comp rx=0 tx=0).stop 2024-06-06T03:29:42.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.157+0000 7f7da62ee640 1 -- 172.21.15.50:0/2212371853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7da01000c0 msgr2=0x7f7da0070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:42.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.157+0000 7f7da62ee640 1 --2- 172.21.15.50:0/2212371853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7da01000c0 0x7f7da0070330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7d9000c920 tx=0x7f7d9000cde0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.157+0000 7f7da62ee640 1 -- 172.21.15.50:0/2212371853 shutdown_connections 2024-06-06T03:29:42.157 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.157+0000 7f7da62ee640 1 --2- 172.21.15.50:0/2212371853 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7d8c0a2c00 0x7f7d8c0a50c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.157 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.157+0000 7f7da62ee640 1 --2- 172.21.15.50:0/2212371853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7da0102a30 0x7f7da0070870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.157 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.157+0000 7f7da62ee640 1 --2- 172.21.15.50:0/2212371853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7da01053e0 0x7f7da01ae060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.157 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.157+0000 7f7da62ee640 1 --2- 172.21.15.50:0/2212371853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7da01000c0 0x7f7da0070330 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:42.157 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.157+0000 7f7da62ee640 1 -- 172.21.15.50:0/2212371853 >> 172.21.15.50:0/2212371853 conn(0x7f7da00fbcc0 msgr2=0x7f7da01009a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:42.157 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.158+0000 7f7da62ee640 1 -- 172.21.15.50:0/2212371853 shutdown_connections 2024-06-06T03:29:42.157 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:42.158+0000 7f7da62ee640 1 -- 172.21.15.50:0/2212371853 wait complete. 2024-06-06T03:29:43.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:43 smithi122 ceph-mon[35759]: pgmap v523: 129 pgs: 129 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 48 MiB/s wr, 770 op/s 2024-06-06T03:29:43.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:43 smithi050 ceph-mon[32421]: pgmap v523: 129 pgs: 129 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 48 MiB/s wr, 770 op/s 2024-06-06T03:29:43.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:43 smithi079 ceph-mon[35478]: pgmap v523: 129 pgs: 129 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 48 MiB/s wr, 770 op/s 2024-06-06T03:29:45.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:45 smithi122 ceph-mon[35759]: pgmap v524: 129 pgs: 129 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 50 MiB/s wr, 809 op/s 2024-06-06T03:29:45.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:45 smithi050 ceph-mon[32421]: pgmap v524: 129 pgs: 129 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 50 MiB/s wr, 809 op/s 2024-06-06T03:29:45.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:45 smithi079 ceph-mon[35478]: pgmap v524: 129 pgs: 129 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 50 MiB/s wr, 809 op/s 2024-06-06T03:29:47.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:47 smithi122 ceph-mon[35759]: pgmap v525: 129 pgs: 129 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 53 MiB/s wr, 856 op/s 2024-06-06T03:29:47.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:47 smithi050 ceph-mon[32421]: pgmap v525: 129 pgs: 129 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 53 MiB/s wr, 856 op/s 2024-06-06T03:29:47.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:47 smithi079 ceph-mon[35478]: pgmap v525: 129 pgs: 129 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 53 MiB/s wr, 856 op/s 2024-06-06T03:29:49.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:49 smithi122 ceph-mon[35759]: pgmap v526: 129 pgs: 129 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 44 MiB/s wr, 715 op/s 2024-06-06T03:29:49.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:49 smithi050 ceph-mon[32421]: pgmap v526: 129 pgs: 129 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 44 MiB/s wr, 715 op/s 2024-06-06T03:29:49.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:49 smithi079 ceph-mon[35478]: pgmap v526: 129 pgs: 129 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 44 MiB/s wr, 715 op/s 2024-06-06T03:29:51.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:51 smithi122 ceph-mon[35759]: pgmap v527: 129 pgs: 129 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 51 MiB/s wr, 819 op/s 2024-06-06T03:29:51.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:51 smithi050 ceph-mon[32421]: pgmap v527: 129 pgs: 129 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 51 MiB/s wr, 819 op/s 2024-06-06T03:29:51.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:51 smithi079 ceph-mon[35478]: pgmap v527: 129 pgs: 129 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 51 MiB/s wr, 819 op/s 2024-06-06T03:29:53.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:53 smithi122 ceph-mon[35759]: pgmap v528: 129 pgs: 129 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 39 MiB/s wr, 624 op/s 2024-06-06T03:29:53.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:53 smithi050 ceph-mon[32421]: pgmap v528: 129 pgs: 129 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 39 MiB/s wr, 624 op/s 2024-06-06T03:29:53.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:53 smithi079 ceph-mon[35478]: pgmap v528: 129 pgs: 129 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 39 MiB/s wr, 624 op/s 2024-06-06T03:29:55.237 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:55 smithi050 ceph-mon[32421]: pgmap v529: 129 pgs: 129 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 39 MiB/s wr, 632 op/s 2024-06-06T03:29:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.330+0000 7f7e7292e640 1 -- 172.21.15.50:0/210976317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e6c1053d0 msgr2=0x7f7e6c105850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.330+0000 7f7e7292e640 1 --2- 172.21.15.50:0/210976317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e6c1053d0 0x7f7e6c105850 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7e64009ca0 tx=0x7f7e6402a8e0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.331+0000 7f7e7292e640 1 -- 172.21.15.50:0/210976317 shutdown_connections 2024-06-06T03:29:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.331+0000 7f7e7292e640 1 --2- 172.21.15.50:0/210976317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e6c1053d0 0x7f7e6c105850 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.331+0000 7f7e7292e640 1 --2- 172.21.15.50:0/210976317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e6c102a20 0x7f7e6c104e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.331+0000 7f7e7292e640 1 --2- 172.21.15.50:0/210976317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e6c1000b0 0x7f7e6c1024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.331+0000 7f7e7292e640 1 -- 172.21.15.50:0/210976317 >> 172.21.15.50:0/210976317 conn(0x7f7e6c0fbc90 msgr2=0x7f7e6c0fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.333+0000 7f7e7292e640 1 -- 172.21.15.50:0/210976317 shutdown_connections 2024-06-06T03:29:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.334+0000 7f7e7292e640 1 -- 172.21.15.50:0/210976317 wait complete. 2024-06-06T03:29:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.335+0000 7f7e7292e640 1 Processor -- start 2024-06-06T03:29:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.336+0000 7f7e7292e640 1 -- start start 2024-06-06T03:29:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.336+0000 7f7e7292e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e6c1000b0 0x7f7e6c19e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:55.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.336+0000 7f7e7292e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e6c102a20 0x7f7e6c19e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:55.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.336+0000 7f7e7292e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e6c1053d0 0x7f7e6c1a5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:55.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.336+0000 7f7e7292e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6c113a40 con 0x7f7e6c1053d0 2024-06-06T03:29:55.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.336+0000 7f7e7292e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6c1138c0 con 0x7f7e6c102a20 2024-06-06T03:29:55.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.336+0000 7f7e7292e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6c113bc0 con 0x7f7e6c1000b0 2024-06-06T03:29:55.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.336+0000 7f7e7212d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e6c1053d0 0x7f7e6c1a5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:55.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.336+0000 7f7e7212d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e6c1053d0 0x7f7e6c1a5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42756/0 (socket says 172.21.15.50:42756) 2024-06-06T03:29:55.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.336+0000 7f7e7212d640 1 -- 172.21.15.50:0/1377632219 learned_addr learned my addr 172.21.15.50:0/1377632219 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:55.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.337+0000 7f7e7192c640 1 --2- 172.21.15.50:0/1377632219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e6c1000b0 0x7f7e6c19e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:55.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.337+0000 7f7e7212d640 1 -- 172.21.15.50:0/1377632219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e6c1000b0 msgr2=0x7f7e6c19e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:55.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.337+0000 7f7e7212d640 1 --2- 172.21.15.50:0/1377632219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e6c1000b0 0x7f7e6c19e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.337+0000 7f7e7212d640 1 -- 172.21.15.50:0/1377632219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e6c102a20 msgr2=0x7f7e6c19e720 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-06T03:29:55.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.337+0000 7f7e7212d640 1 --2- 172.21.15.50:0/1377632219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e6c102a20 0x7f7e6c19e720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.337+0000 7f7e7212d640 1 -- 172.21.15.50:0/1377632219 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e6c1a5db0 con 0x7f7e6c1053d0 2024-06-06T03:29:55.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.338+0000 7f7e7212d640 1 --2- 172.21.15.50:0/1377632219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e6c1053d0 0x7f7e6c1a5740 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7e64003d10 tx=0x7f7e64003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:55.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.339+0000 7f7e62ffd640 1 -- 172.21.15.50:0/1377632219 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e64004040 con 0x7f7e6c1053d0 2024-06-06T03:29:55.339 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.339+0000 7f7e62ffd640 1 -- 172.21.15.50:0/1377632219 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7e64004690 con 0x7f7e6c1053d0 2024-06-06T03:29:55.339 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.339+0000 7f7e62ffd640 1 -- 172.21.15.50:0/1377632219 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e64030ed0 con 0x7f7e6c1053d0 2024-06-06T03:29:55.339 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.339+0000 7f7e7292e640 1 -- 172.21.15.50:0/1377632219 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e6c1a6040 con 0x7f7e6c1053d0 2024-06-06T03:29:55.339 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.339+0000 7f7e7292e640 1 -- 172.21.15.50:0/1377632219 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e6c1a65c0 con 0x7f7e6c1053d0 2024-06-06T03:29:55.342 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.343+0000 7f7e7697b740 1 Processor -- start 2024-06-06T03:29:55.345 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.345+0000 7f7e62ffd640 1 -- 172.21.15.50:0/1377632219 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7e64030670 con 0x7f7e6c1053d0 2024-06-06T03:29:55.345 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.345+0000 7f7e7697b740 1 -- start start 2024-06-06T03:29:55.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.348+0000 7f7e7697b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55baeb0fc200 0x55baeb0fc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:55.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.348+0000 7f7e7697b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55baeb0fcbf0 0x55baeb1016f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:55.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.348+0000 7f7e7697b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55baeb101d60 0x55baeb1041f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:55.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.348+0000 7f7e7697b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55baeb05f4f0 con 0x55baeb0fc200 2024-06-06T03:29:55.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.348+0000 7f7e7697b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55baeaffd870 con 0x55baeb101d60 2024-06-06T03:29:55.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.348+0000 7f7e7697b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55baeb05b4b0 con 0x55baeb0fcbf0 2024-06-06T03:29:55.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.348+0000 7f7e62ffd640 1 --2- 172.21.15.50:0/1377632219 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7e580a2d90 0x7f7e580a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:55.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.348+0000 7f7e7212d640 1 --2- 172.21.15.50:0/1377632219 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7e580a2d90 0x7f7e580a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:55.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.349+0000 7f7e7112b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55baeb0fc200 0x55baeb0fc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:55.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.349+0000 7f7e7112b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55baeb0fc200 0x55baeb0fc620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42772/0 (socket says 172.21.15.50:42772) 2024-06-06T03:29:55.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.349+0000 7f7e7112b640 1 -- 172.21.15.50:0/1112853145 learned_addr learned my addr 172.21.15.50:0/1112853145 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:55.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.349+0000 7f7e7112b640 1 --2- 172.21.15.50:0/1112853145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55baeb101d60 0x55baeb1041f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:55.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.349+0000 7f7e62ffd640 1 -- 172.21.15.50:0/1377632219 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f7e640f0a40 con 0x7f7e6c1053d0 2024-06-06T03:29:55.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.350+0000 7f7e7112b640 1 -- 172.21.15.50:0/1112853145 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55baeb0fcbf0 msgr2=0x55baeb1016f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:29:55.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.350+0000 7f7e7112b640 1 --2- 172.21.15.50:0/1112853145 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55baeb0fcbf0 0x55baeb1016f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.350+0000 7f7e7112b640 1 -- 172.21.15.50:0/1112853145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55baeb0fc200 msgr2=0x55baeb0fc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:55.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.350+0000 7f7e7112b640 1 --2- 172.21.15.50:0/1112853145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55baeb0fc200 0x55baeb0fc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.350+0000 7f7e7112b640 1 -- 172.21.15.50:0/1112853145 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baeb0199b0 con 0x55baeb101d60 2024-06-06T03:29:55.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.351+0000 7f7e7112b640 1 --2- 172.21.15.50:0/1112853145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55baeb101d60 0x55baeb1041f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c009fd0 tx=0x7f7e5c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79277cb8ba3e7cff server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:55.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.351+0000 7f7e7212d640 1 --2- 172.21.15.50:0/1377632219 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7e580a2d90 0x7f7e580a5250 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7e640bcbc0 tx=0x7f7e640b8ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:55.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.351+0000 7f7e57fff640 1 -- 172.21.15.50:0/1112853145 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c01c070 con 0x55baeb101d60 2024-06-06T03:29:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.351+0000 7f7e57fff640 1 -- 172.21.15.50:0/1112853145 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7e5c0178f0 con 0x55baeb101d60 2024-06-06T03:29:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.351+0000 7f7e57fff640 1 -- 172.21.15.50:0/1112853145 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c00c070 con 0x55baeb101d60 2024-06-06T03:29:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.352+0000 7f7e7697b740 1 -- 172.21.15.50:0/1112853145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55baeb101d60 msgr2=0x55baeb1041f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.352+0000 7f7e7697b740 1 --2- 172.21.15.50:0/1112853145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55baeb101d60 0x55baeb1041f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c009fd0 tx=0x7f7e5c004750 comp rx=0 tx=0).stop 2024-06-06T03:29:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.353+0000 7f7e7697b740 1 -- 172.21.15.50:0/1112853145 shutdown_connections 2024-06-06T03:29:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.353+0000 7f7e7697b740 1 --2- 172.21.15.50:0/1112853145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55baeb101d60 0x55baeb1041f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.353+0000 7f7e7697b740 1 --2- 172.21.15.50:0/1112853145 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55baeb0fcbf0 0x55baeb1016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.353+0000 7f7e7697b740 1 --2- 172.21.15.50:0/1112853145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55baeb0fc200 0x55baeb0fc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.353+0000 7f7e7697b740 1 -- 172.21.15.50:0/1112853145 >> 172.21.15.50:0/1112853145 conn(0x55baeb0f7870 msgr2=0x55baeb0f7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.353+0000 7f7e7697b740 1 -- 172.21.15.50:0/1112853145 shutdown_connections 2024-06-06T03:29:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.354+0000 7f7e7697b740 1 -- 172.21.15.50:0/1112853145 wait complete. 2024-06-06T03:29:55.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.354+0000 7f7e7697b740 1 -- start start 2024-06-06T03:29:55.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.354+0000 7f7e7697b740 1 Processor -- start 2024-06-06T03:29:55.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.355+0000 7f7e7697b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55baeb0fc200 0x55baeb106500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:55.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.355+0000 7f7e7697b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55baeb0fcbf0 0x55baeb106a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:55.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.355+0000 7f7e7697b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55baeb101d60 0x55baeb10da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:55.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.355+0000 7f7e7697b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55baeb104d10 con 0x55baeb0fcbf0 2024-06-06T03:29:55.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.355+0000 7f7e7697b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55baeafe8ae0 con 0x55baeb0fc200 2024-06-06T03:29:55.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.355+0000 7f7e7697b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55baeb104e90 con 0x55baeb101d60 2024-06-06T03:29:55.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.355+0000 7f7e7697b740 10 client.0 _ll_register_callbacks cb 0x55baeb0219b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:29:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.356+0000 7f7e7192c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55baeb0fcbf0 0x55baeb106a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.356+0000 7f7e7192c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55baeb0fcbf0 0x55baeb106a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42782/0 (socket says 172.21.15.50:42782) 2024-06-06T03:29:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.356+0000 7f7e7192c640 1 -- 172.21.15.50:0/2921891696 learned_addr learned my addr 172.21.15.50:0/2921891696 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.356+0000 7f7e7192c640 1 -- 172.21.15.50:0/2921891696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55baeb101d60 msgr2=0x55baeb10da80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:29:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.356+0000 7f7e7192c640 1 --2- 172.21.15.50:0/2921891696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55baeb101d60 0x55baeb10da80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.356+0000 7f7e7192c640 1 -- 172.21.15.50:0/2921891696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55baeb0fc200 msgr2=0x55baeb106500 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:29:55.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.356+0000 7f7e7192c640 1 --2- 172.21.15.50:0/2921891696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55baeb0fc200 0x55baeb106500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.357+0000 7f7e7192c640 1 -- 172.21.15.50:0/2921891696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55baead73210 con 0x55baeb0fcbf0 2024-06-06T03:29:55.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.358+0000 7f7e7192c640 1 --2- 172.21.15.50:0/2921891696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55baeb0fcbf0 0x55baeb106a40 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800bfb0 tx=0x7f7e6800d5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d51690ee26199b server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:55.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.358+0000 7f7e557fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:29:55.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.359+0000 7f7e557fa640 1 -- 172.21.15.50:0/2921891696 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68013480 con 0x55baeb0fcbf0 2024-06-06T03:29:55.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.359+0000 7f7e7697b740 1 -- 172.21.15.50:0/2921891696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e5c0178f0 con 0x55baeb0fcbf0 2024-06-06T03:29:55.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.359+0000 7f7e557fa640 1 -- 172.21.15.50:0/2921891696 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f7e68013620 con 0x55baeb0fcbf0 2024-06-06T03:29:55.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.359+0000 7f7e557fa640 1 -- 172.21.15.50:0/2921891696 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7e68021050 con 0x55baeb0fcbf0 2024-06-06T03:29:55.359 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.360+0000 7f7e7697b740 10 client.15966 fetch_fsmap learned FSMap version 29 2024-06-06T03:29:55.359 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.360+0000 7f7e7697b740 1 -- 172.21.15.50:0/2921891696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55baeae3f620 con 0x55baeb0fcbf0 2024-06-06T03:29:55.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.361+0000 7f7e557fa640 1 -- 172.21.15.50:0/2921891696 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7e5c0178f0 con 0x55baeb0fcbf0 2024-06-06T03:29:55.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.361+0000 7f7e557fa640 1 -- 172.21.15.50:0/2921891696 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f7e68012aa0 con 0x55baeb0fcbf0 2024-06-06T03:29:55.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.361+0000 7f7e7697b740 10 client.15966 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:29:55.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.361+0000 7f7e7697b740 10 client.15966 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:29:55.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.361+0000 7f7e7697b740 20 client.15966 populate_metadata read hostname 'smithi050' 2024-06-06T03:29:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.361+0000 7f7e7697b740 1 --2- 172.21.15.50:0/2921891696 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55baeb112920 0x55baeb114de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.361+0000 7f7e7697b740 4 client.15966 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:29:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.361+0000 7f7e7697b740 1 -- 172.21.15.50:0/2921891696 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55baeb072f10 con 0x55baeb112920 2024-06-06T03:29:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.363+0000 7f7e7112b640 1 --2- 172.21.15.50:0/2921891696 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55baeb112920 0x55baeb114de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.367+0000 7f7e7112b640 1 --2- 172.21.15.50:0/2921891696 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55baeb112920 0x55baeb114de0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fdaac88fb81531c server_cookie=c0b480f1122beed2 in_seq=0 out_seq=0 2024-06-06T03:29:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.367+0000 7f7e557fa640 10 client.15966 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:55.370 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.371+0000 7f7e557fa640 1 -- 172.21.15.50:0/2921891696 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55baeb072f10 con 0x55baeb112920 2024-06-06T03:29:55.371 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.371+0000 7f7e557fa640 10 client.15966 handle_command_reply: tid=0 2024-06-06T03:29:55.371 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.371+0000 7f7e7697b740 1 client.15966 shutdown 2024-06-06T03:29:55.375 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.372+0000 7f7e7697b740 1 -- 172.21.15.50:0/2921891696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55baeb0fcbf0 msgr2=0x55baeb106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:55.375 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.372+0000 7f7e7697b740 1 --2- 172.21.15.50:0/2921891696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55baeb0fcbf0 0x55baeb106a40 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800bfb0 tx=0x7f7e6800d5f0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.375 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.372+0000 7f7e7697b740 1 -- 172.21.15.50:0/2921891696 shutdown_connections 2024-06-06T03:29:55.375 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.372+0000 7f7e7697b740 1 --2- 172.21.15.50:0/2921891696 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55baeb112920 0x55baeb114de0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.375 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.372+0000 7f7e7697b740 1 --2- 172.21.15.50:0/2921891696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55baeb0fcbf0 0x55baeb106a40 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.375 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.372+0000 7f7e7697b740 1 --2- 172.21.15.50:0/2921891696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55baeb101d60 0x55baeb10da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.375 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.372+0000 7f7e7697b740 1 --2- 172.21.15.50:0/2921891696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55baeb0fc200 0x55baeb106500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.376 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.372+0000 7f7e7697b740 1 -- 172.21.15.50:0/2921891696 >> 172.21.15.50:0/2921891696 conn(0x55baeb0f7870 msgr2=0x55baeb0f69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:55.376 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.374+0000 7f7e557fa640 0 client.15966 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:55.376 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.375+0000 7f7e7697b740 1 -- 172.21.15.50:0/2921891696 shutdown_connections 2024-06-06T03:29:55.376 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.376+0000 7f7e7697b740 1 -- 172.21.15.50:0/2921891696 wait complete. 2024-06-06T03:29:55.377 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.376+0000 7f7e7697b740 20 client.15966 trim_cache size 0 max 16384 2024-06-06T03:29:55.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.418+0000 7f7e7697b740 1 Processor -- start 2024-06-06T03:29:55.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.418+0000 7f7e7697b740 1 -- start start 2024-06-06T03:29:55.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.418+0000 7f7e7697b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55baeb0fc200 0x55baeb106500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:55.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.418+0000 7f7e7697b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55baeb0fcbf0 0x55baeb106a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:55.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.419+0000 7f7e7697b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55baeb101d60 0x55baeb10da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:55.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.419+0000 7f7e7697b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6c1b33f0 con 0x55baeb0fcbf0 2024-06-06T03:29:55.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.419+0000 7f7e7697b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6c1b0cc0 con 0x55baeb0fc200 2024-06-06T03:29:55.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.419+0000 7f7e7697b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6c1aeb10 con 0x55baeb101d60 2024-06-06T03:29:55.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.425+0000 7f7e7192c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55baeb0fcbf0 0x55baeb106a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:55.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.425+0000 7f7e7192c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55baeb0fcbf0 0x55baeb106a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42788/0 (socket says 172.21.15.50:42788) 2024-06-06T03:29:55.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.425+0000 7f7e7192c640 1 -- 172.21.15.50:0/612863753 learned_addr learned my addr 172.21.15.50:0/612863753 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:55.426 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.426+0000 7f7e7192c640 1 -- 172.21.15.50:0/612863753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55baeb101d60 msgr2=0x55baeb10da40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:29:55.426 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.426+0000 7f7e7192c640 1 --2- 172.21.15.50:0/612863753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55baeb101d60 0x55baeb10da40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.426 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.426+0000 7f7e7192c640 1 -- 172.21.15.50:0/612863753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55baeb0fc200 msgr2=0x55baeb106500 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:29:55.426 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.426+0000 7f7e7192c640 1 --2- 172.21.15.50:0/612863753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55baeb0fc200 0x55baeb106500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.427 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.426+0000 7f7e7192c640 1 -- 172.21.15.50:0/612863753 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baeb0f76a0 con 0x55baeb0fcbf0 2024-06-06T03:29:55.427 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.427+0000 7f7e7192c640 1 --2- 172.21.15.50:0/612863753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55baeb0fcbf0 0x55baeb106a40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7e68004810 tx=0x7f7e68006d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb6bd25cfa091df server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:55.428 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.427+0000 7f7e577fe640 1 -- 172.21.15.50:0/612863753 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6801c580 con 0x55baeb0fcbf0 2024-06-06T03:29:55.428 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.427+0000 7f7e577fe640 1 -- 172.21.15.50:0/612863753 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7e68018070 con 0x55baeb0fcbf0 2024-06-06T03:29:55.428 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.427+0000 7f7e577fe640 1 -- 172.21.15.50:0/612863753 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68012820 con 0x55baeb0fcbf0 2024-06-06T03:29:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.428+0000 7f7e7697b740 1 -- 172.21.15.50:0/612863753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55baeb0fcbf0 msgr2=0x55baeb106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.428+0000 7f7e7697b740 1 --2- 172.21.15.50:0/612863753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55baeb0fcbf0 0x55baeb106a40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7e68004810 tx=0x7f7e68006d60 comp rx=0 tx=0).stop 2024-06-06T03:29:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.430+0000 7f7e7697b740 1 -- 172.21.15.50:0/612863753 shutdown_connections 2024-06-06T03:29:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.430+0000 7f7e7697b740 1 --2- 172.21.15.50:0/612863753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55baeb0fcbf0 0x55baeb106a40 secure :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7e68004810 tx=0x7f7e68006d60 comp rx=0 tx=0).stop 2024-06-06T03:29:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.430+0000 7f7e7697b740 1 --2- 172.21.15.50:0/612863753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55baeb101d60 0x55baeb10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.430+0000 7f7e7697b740 1 --2- 172.21.15.50:0/612863753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55baeb0fc200 0x55baeb106500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.430+0000 7f7e7697b740 1 -- 172.21.15.50:0/612863753 >> 172.21.15.50:0/612863753 conn(0x55baeb0f7870 msgr2=0x55baeb0f2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:55.432 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.432+0000 7f7e7697b740 1 -- 172.21.15.50:0/612863753 shutdown_connections 2024-06-06T03:29:55.433 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:55 smithi122 ceph-mon[35759]: pgmap v529: 129 pgs: 129 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 39 MiB/s wr, 632 op/s 2024-06-06T03:29:55.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.432+0000 7f7e7697b740 1 -- 172.21.15.50:0/612863753 wait complete. 2024-06-06T03:29:55.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.432+0000 7f7e7697b740 1 -- start start 2024-06-06T03:29:55.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.432+0000 7f7e7697b740 1 Processor -- start 2024-06-06T03:29:55.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.433+0000 7f7e7697b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55baeb0fc200 0x55baeb10a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:55.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.433+0000 7f7e7697b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55baeb101d60 0x55baeb10adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:55.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.433+0000 7f7e7697b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55baeb1796a0 0x55baeb17ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:55.435 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.433+0000 7f7e7697b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6c1af180 con 0x55baeb1796a0 2024-06-06T03:29:55.435 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.433+0000 7f7e7697b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6c1b05f0 con 0x55baeb101d60 2024-06-06T03:29:55.435 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.433+0000 7f7e7697b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6c1af850 con 0x55baeb0fc200 2024-06-06T03:29:55.435 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.433+0000 7f7e7697b740 10 client.0 _ll_register_callbacks cb 0x7f7e6800b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:29:55.435 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.433+0000 7f7e7112b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55baeb0fc200 0x55baeb10a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:55.435 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.433+0000 7f7e7112b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55baeb0fc200 0x55baeb10a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:46522/0 (socket says 172.21.15.50:46522) 2024-06-06T03:29:55.435 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.433+0000 7f7e7112b640 1 -- 172.21.15.50:0/3847468087 learned_addr learned my addr 172.21.15.50:0/3847468087 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:55.436 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.434+0000 7f7e7192c640 1 --2- 172.21.15.50:0/3847468087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55baeb101d60 0x55baeb10adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:55.436 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.434+0000 7f7e7112b640 1 -- 172.21.15.50:0/3847468087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55baeb101d60 msgr2=0x55baeb10adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:55.436 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.434+0000 7f7e7112b640 1 --2- 172.21.15.50:0/3847468087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55baeb101d60 0x55baeb10adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.436 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.434+0000 7f7e7112b640 1 -- 172.21.15.50:0/3847468087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55baeb1796a0 msgr2=0x55baeb17ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:29:55.436 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.434+0000 7f7e7112b640 1 --2- 172.21.15.50:0/3847468087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55baeb1796a0 0x55baeb17ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.436 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.434+0000 7f7e7112b640 1 -- 172.21.15.50:0/3847468087 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55baeb0f1ce0 con 0x55baeb0fc200 2024-06-06T03:29:55.436 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.434+0000 7f7e7112b640 1 --2- 172.21.15.50:0/3847468087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55baeb0fc200 0x55baeb10a8b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c01a040 tx=0x7f7e5c0091c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b94e44949dd0eb2 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:55.436 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.434+0000 7f7e557fa640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:29:55.436 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.434+0000 7f7e557fa640 1 -- 172.21.15.50:0/3847468087 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c00c030 con 0x55baeb0fc200 2024-06-06T03:29:55.437 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.435+0000 7f7e557fa640 1 -- 172.21.15.50:0/3847468087 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f7e5c009800 con 0x55baeb0fc200 2024-06-06T03:29:55.438 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.435+0000 7f7e7697b740 1 -- 172.21.15.50:0/3847468087 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e68018070 con 0x55baeb0fc200 2024-06-06T03:29:55.438 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.439+0000 7f7e557fa640 1 -- 172.21.15.50:0/3847468087 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7e5c026040 con 0x55baeb0fc200 2024-06-06T03:29:55.440 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.440+0000 7f7e7697b740 10 client.25549 fetch_fsmap learned FSMap version 29 2024-06-06T03:29:55.440 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.440+0000 7f7e7697b740 1 -- 172.21.15.50:0/3847468087 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55baeb18df50 con 0x55baeb0fc200 2024-06-06T03:29:55.440 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.441+0000 7f7e557fa640 1 -- 172.21.15.50:0/3847468087 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7e68018070 con 0x55baeb0fc200 2024-06-06T03:29:55.442 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.443+0000 7f7e557fa640 1 -- 172.21.15.50:0/3847468087 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f7e5c003930 con 0x55baeb0fc200 2024-06-06T03:29:55.443 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.444+0000 7f7e7697b740 10 client.25549 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:29:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.444+0000 7f7e7697b740 10 client.25549 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:29:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.444+0000 7f7e7697b740 20 client.25549 populate_metadata read hostname 'smithi050' 2024-06-06T03:29:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.444+0000 7f7e7697b740 1 --2- 172.21.15.50:0/3847468087 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55baeb18e6e0 0x55baeb190ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.444+0000 7f7e7697b740 4 client.25549 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:29:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.444+0000 7f7e7697b740 1 -- 172.21.15.50:0/3847468087 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55baeb06cc20 con 0x55baeb18e6e0 2024-06-06T03:29:55.445 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.445+0000 7f7e7192c640 1 --2- 172.21.15.50:0/3847468087 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55baeb18e6e0 0x55baeb190ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:55.445 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.446+0000 7f7e7192c640 1 --2- 172.21.15.50:0/3847468087 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55baeb18e6e0 0x55baeb190ba0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e82029dd8ee09ce server_cookie=611c7f8627801a97 in_seq=0 out_seq=0 2024-06-06T03:29:55.445 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.446+0000 7f7e557fa640 10 client.25549 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:55.448 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.449+0000 7f7e557fa640 1 -- 172.21.15.50:0/3847468087 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55baeb06cc20 con 0x55baeb18e6e0 2024-06-06T03:29:55.449 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.449+0000 7f7e557fa640 10 client.25549 handle_command_reply: tid=0 2024-06-06T03:29:55.449 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.449+0000 7f7e7697b740 1 client.25549 shutdown 2024-06-06T03:29:55.450 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.451+0000 7f7e7697b740 1 -- 172.21.15.50:0/3847468087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55baeb0fc200 msgr2=0x55baeb10a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:55.450 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.451+0000 7f7e7697b740 1 --2- 172.21.15.50:0/3847468087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55baeb0fc200 0x55baeb10a8b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c01a040 tx=0x7f7e5c0091c0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.452+0000 7f7e7697b740 1 -- 172.21.15.50:0/3847468087 shutdown_connections 2024-06-06T03:29:55.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.452+0000 7f7e7697b740 1 --2- 172.21.15.50:0/3847468087 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55baeb18e6e0 0x55baeb190ba0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.452+0000 7f7e7697b740 1 --2- 172.21.15.50:0/3847468087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55baeb1796a0 0x55baeb17ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.452+0000 7f7e7697b740 1 --2- 172.21.15.50:0/3847468087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55baeb101d60 0x55baeb10adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.452+0000 7f7e7697b740 1 --2- 172.21.15.50:0/3847468087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55baeb0fc200 0x55baeb10a8b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.452+0000 7f7e7697b740 1 -- 172.21.15.50:0/3847468087 >> 172.21.15.50:0/3847468087 conn(0x55baeb0f7870 msgr2=0x55baeb0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:55.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.453+0000 7f7e557fa640 0 client.25549 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:29:55.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.454+0000 7f7e7697b740 1 -- 172.21.15.50:0/3847468087 shutdown_connections 2024-06-06T03:29:55.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.454+0000 7f7e7697b740 1 -- 172.21.15.50:0/3847468087 wait complete. 2024-06-06T03:29:55.455 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.456+0000 7f7e7697b740 20 client.25549 trim_cache size 0 max 16384 2024-06-06T03:29:55.455 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:29:55.455 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:29:55.455 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:29:55.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.458+0000 7f7e7292e640 1 -- 172.21.15.50:0/1377632219 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7e580a2d90 msgr2=0x7f7e580a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:55.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.458+0000 7f7e7292e640 1 --2- 172.21.15.50:0/1377632219 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7e580a2d90 0x7f7e580a5250 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7e640bcbc0 tx=0x7f7e640b8ab0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.460 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.459+0000 7f7e7292e640 1 -- 172.21.15.50:0/1377632219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e6c1053d0 msgr2=0x7f7e6c1a5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:55.460 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.459+0000 7f7e7292e640 1 --2- 172.21.15.50:0/1377632219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e6c1053d0 0x7f7e6c1a5740 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7e64003d10 tx=0x7f7e64003d40 comp rx=0 tx=0).stop 2024-06-06T03:29:55.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.460+0000 7f7e7292e640 1 -- 172.21.15.50:0/1377632219 shutdown_connections 2024-06-06T03:29:55.462 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.460+0000 7f7e7292e640 1 --2- 172.21.15.50:0/1377632219 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7e580a2d90 0x7f7e580a5250 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.462 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.461+0000 7f7e7292e640 1 --2- 172.21.15.50:0/1377632219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e6c1053d0 0x7f7e6c1a5740 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.462 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.461+0000 7f7e7292e640 1 --2- 172.21.15.50:0/1377632219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e6c102a20 0x7f7e6c19e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.462 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.461+0000 7f7e7292e640 1 --2- 172.21.15.50:0/1377632219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e6c1000b0 0x7f7e6c19e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.462 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.461+0000 7f7e7292e640 1 -- 172.21.15.50:0/1377632219 >> 172.21.15.50:0/1377632219 conn(0x7f7e6c0fbc90 msgr2=0x7f7e6c103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:55.462 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.461+0000 7f7e7292e640 1 -- 172.21.15.50:0/1377632219 shutdown_connections 2024-06-06T03:29:55.462 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:29:55.461+0000 7f7e7292e640 1 -- 172.21.15.50:0/1377632219 wait complete. 2024-06-06T03:29:55.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:55 smithi079 ceph-mon[35478]: pgmap v529: 129 pgs: 129 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 39 MiB/s wr, 632 op/s 2024-06-06T03:29:55.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.760+0000 7f6749a5d700 1 -- 172.21.15.50:0/113168087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6744109480 msgr2=0x7f6744115990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:55.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.760+0000 7f6749a5d700 1 --2- 172.21.15.50:0/113168087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6744109480 0x7f6744115990 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f673c009f90 tx=0x7f673c00b330 comp rx=0 tx=0).stop 2024-06-06T03:29:55.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.760+0000 7f6749a5d700 1 -- 172.21.15.50:0/113168087 shutdown_connections 2024-06-06T03:29:55.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.760+0000 7f6749a5d700 1 --2- 172.21.15.50:0/113168087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6744109480 0x7f6744115990 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.760+0000 7f6749a5d700 1 --2- 172.21.15.50:0/113168087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f674410eac0 0x7f674410eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.760+0000 7f6749a5d700 1 --2- 172.21.15.50:0/113168087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6744108ac0 0x7f6744108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.760+0000 7f6749a5d700 1 -- 172.21.15.50:0/113168087 >> 172.21.15.50:0/113168087 conn(0x7f6744075c60 msgr2=0x7f6744078080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:55.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.762+0000 7f6749a5d700 1 -- 172.21.15.50:0/113168087 shutdown_connections 2024-06-06T03:29:55.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.762+0000 7f6749a5d700 1 -- 172.21.15.50:0/113168087 wait complete. 2024-06-06T03:29:55.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.763+0000 7f6749a5d700 1 Processor -- start 2024-06-06T03:29:55.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.763+0000 7f6749a5d700 1 -- start start 2024-06-06T03:29:55.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.764+0000 7f6749a5d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6744108ac0 0x7f674419f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:55.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.764+0000 7f6749a5d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6744109480 0x7f674419f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:55.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.764+0000 7f6749a5d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f674410eac0 0x7f67441a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:55.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.764+0000 7f6749a5d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6744118da0 con 0x7f6744109480 2024-06-06T03:29:55.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.764+0000 7f6749a5d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6744118c20 con 0x7f674410eac0 2024-06-06T03:29:55.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.764+0000 7f6749a5d700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6744118f20 con 0x7f6744108ac0 2024-06-06T03:29:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.764+0000 7f67427fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6744109480 0x7f674419f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.764+0000 7f6742ffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6744108ac0 0x7f674419f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.764+0000 7f6742ffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6744108ac0 0x7f674419f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:46548/0 (socket says 172.21.15.50:46548) 2024-06-06T03:29:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.764+0000 7f6742ffd700 1 -- 172.21.15.50:0/2183907898 learned_addr learned my addr 172.21.15.50:0/2183907898 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:29:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.764+0000 7f67437fe700 1 --2- 172.21.15.50:0/2183907898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f674410eac0 0x7f67441a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.765+0000 7f6742ffd700 1 -- 172.21.15.50:0/2183907898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f674410eac0 msgr2=0x7f67441a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.765+0000 7f6742ffd700 1 --2- 172.21.15.50:0/2183907898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f674410eac0 0x7f67441a39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.765+0000 7f6742ffd700 1 -- 172.21.15.50:0/2183907898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6744109480 msgr2=0x7f674419f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.765+0000 7f6742ffd700 1 --2- 172.21.15.50:0/2183907898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6744109480 0x7f674419f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.765+0000 7f6742ffd700 1 -- 172.21.15.50:0/2183907898 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67441a4100 con 0x7f6744108ac0 2024-06-06T03:29:55.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.765+0000 7f67437fe700 1 --2- 172.21.15.50:0/2183907898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f674410eac0 0x7f67441a39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:29:55.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.765+0000 7f6742ffd700 1 --2- 172.21.15.50:0/2183907898 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6744108ac0 0x7f674419f0f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f673800d950 tx=0x7f673800dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:55.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.765+0000 7f6748a5b700 1 -- 172.21.15.50:0/2183907898 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6738016070 con 0x7f6744108ac0 2024-06-06T03:29:55.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.765+0000 7f6749a5d700 1 -- 172.21.15.50:0/2183907898 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67441a43f0 con 0x7f6744108ac0 2024-06-06T03:29:55.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.765+0000 7f6749a5d700 1 -- 172.21.15.50:0/2183907898 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f674406beb0 con 0x7f6744108ac0 2024-06-06T03:29:55.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.766+0000 7f6748a5b700 1 -- 172.21.15.50:0/2183907898 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f673800fd40 con 0x7f6744108ac0 2024-06-06T03:29:55.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.766+0000 7f6748a5b700 1 -- 172.21.15.50:0/2183907898 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673800e3b0 con 0x7f6744108ac0 2024-06-06T03:29:55.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.770+0000 7f6748a5b700 1 -- 172.21.15.50:0/2183907898 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6738019070 con 0x7f6744108ac0 2024-06-06T03:29:55.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.771+0000 7f6749a5d700 1 -- 172.21.15.50:0/2183907898 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6730005330 con 0x7f6744108ac0 2024-06-06T03:29:55.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.771+0000 7f6748a5b700 1 --2- 172.21.15.50:0/2183907898 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f672c0a2d60 0x7f672c0a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:29:55.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.772+0000 7f6748a5b700 1 -- 172.21.15.50:0/2183907898 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f67380cedb0 con 0x7f6744108ac0 2024-06-06T03:29:55.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.772+0000 7f67427fc700 1 --2- 172.21.15.50:0/2183907898 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f672c0a2d60 0x7f672c0a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:29:55.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.773+0000 7f67427fc700 1 --2- 172.21.15.50:0/2183907898 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f672c0a2d60 0x7f672c0a5220 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f674410e080 tx=0x7f673400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:29:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:55.778+0000 7f6748a5b700 1 -- 172.21.15.50:0/2183907898 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f673809b930 con 0x7f6744108ac0 2024-06-06T03:29:56.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:56.291+0000 7f6749a5d700 1 -- 172.21.15.50:0/2183907898 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6730005620 con 0x7f6744108ac0 2024-06-06T03:29:56.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:56.293+0000 7f6748a5b700 1 -- 172.21.15.50:0/2183907898 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11858 (secure 0 0 0) 0x7f673809b230 con 0x7f6744108ac0 2024-06-06T03:29:56.293 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:29:56.293 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1667847852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1667847852},{"type":"v1","addr":"172.21.15.50:6835","nonce":1667847852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/239971838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":239971838},{"type":"v1","addr":"172.21.15.50:6837","nonce":239971838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/2188134216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2188134216},{"type":"v1","addr":"172.21.15.50:6839","nonce":2188134216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/632572420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":632572420},{"type":"v1","addr":"172.21.15.50:6841","nonce":632572420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/864537078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":864537078},{"type":"v1","addr":"172.21.15.79:6833","nonce":864537078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/279268898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":279268898},{"type":"v1","addr":"172.21.15.79:6835","nonce":279268898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T03:22:36.202061+0000","modified":"2024-06-06T03:28:11.975305+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24490,"mds_1":24472,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/57533154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":57533154},{"type":"v1","addr":"172.21.15.122:6833","nonce":57533154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/3286722213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3286722213},{"type":"v1","addr":"172.21.15.79:6837","nonce":3286722213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/768067336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":768067336},{"type":"v1","addr":"172.21.15.79:6839","nonce":768067336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.122:6835/2987597320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2987597320},{"type":"v1","addr":"172.21.15.122:6835","nonce":2987597320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":23,"addr":"172.21.15.122:6837/1604366318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1604366318},{"type":"v1","addr":"172.21.15.122:6837","nonce":1604366318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6839/4129732900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":4129732900},{"type":"v1","addr":"172.21.15.122:6839","nonce":4129732900}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24472,24490,24466]},"id":1}]} 2024-06-06T03:29:56.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:56.298+0000 7f6749a5d700 1 -- 172.21.15.50:0/2183907898 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f672c0a2d60 msgr2=0x7f672c0a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:56.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:56.298+0000 7f6749a5d700 1 --2- 172.21.15.50:0/2183907898 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f672c0a2d60 0x7f672c0a5220 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f674410e080 tx=0x7f673400b410 comp rx=0 tx=0).stop 2024-06-06T03:29:56.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:56.298+0000 7f6749a5d700 1 -- 172.21.15.50:0/2183907898 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6744108ac0 msgr2=0x7f674419f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:29:56.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:56.298+0000 7f6749a5d700 1 --2- 172.21.15.50:0/2183907898 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6744108ac0 0x7f674419f0f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f673800d950 tx=0x7f673800dc60 comp rx=0 tx=0).stop 2024-06-06T03:29:56.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:56.298+0000 7f6749a5d700 1 -- 172.21.15.50:0/2183907898 shutdown_connections 2024-06-06T03:29:56.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:56.298+0000 7f6749a5d700 1 --2- 172.21.15.50:0/2183907898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f674410eac0 0x7f67441a39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:56.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:56.298+0000 7f6749a5d700 1 --2- 172.21.15.50:0/2183907898 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6744108ac0 0x7f674419f0f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:56.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:56.298+0000 7f6749a5d700 1 --2- 172.21.15.50:0/2183907898 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f672c0a2d60 0x7f672c0a5220 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:56.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:56.298+0000 7f6749a5d700 1 --2- 172.21.15.50:0/2183907898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6744109480 0x7f674419f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:29:56.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:56.298+0000 7f6749a5d700 1 -- 172.21.15.50:0/2183907898 >> 172.21.15.50:0/2183907898 conn(0x7f6744075c60 msgr2=0x7f6744076180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:29:56.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:56.300+0000 7f6749a5d700 1 -- 172.21.15.50:0/2183907898 shutdown_connections 2024-06-06T03:29:56.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:29:56.300+0000 7f6749a5d700 1 -- 172.21.15.50:0/2183907898 wait complete. 2024-06-06T03:29:56.306 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 29 2024-06-06T03:29:57.050 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-06-06T03:29:57.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:57 smithi050 ceph-mon[32421]: pgmap v530: 129 pgs: 129 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 45 MiB/s wr, 729 op/s 2024-06-06T03:29:57.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:57 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/2183907898' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:29:57.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:57 smithi122 ceph-mon[35759]: pgmap v530: 129 pgs: 129 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 45 MiB/s wr, 729 op/s 2024-06-06T03:29:57.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:57 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/2183907898' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:29:57.568 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:29:57.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:57 smithi079 ceph-mon[35478]: pgmap v530: 129 pgs: 129 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 45 MiB/s wr, 729 op/s 2024-06-06T03:29:57.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:57 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/2183907898' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:29:59.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:29:59 smithi122 ceph-mon[35759]: pgmap v531: 129 pgs: 129 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 39 MiB/s wr, 630 op/s 2024-06-06T03:29:59.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:29:59 smithi050 ceph-mon[32421]: pgmap v531: 129 pgs: 129 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 39 MiB/s wr, 630 op/s 2024-06-06T03:29:59.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:29:59 smithi079 ceph-mon[35478]: pgmap v531: 129 pgs: 129 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 39 MiB/s wr, 630 op/s 2024-06-06T03:30:00.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.288+0000 7fa2ecd67700 1 -- 172.21.15.50:0/3565221992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2e81073b0 msgr2=0x7fa2e806aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:00.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.288+0000 7fa2ecd67700 1 --2- 172.21.15.50:0/3565221992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2e81073b0 0x7fa2e806aa30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0009f90 tx=0x7fa2e000b330 comp rx=0 tx=0).stop 2024-06-06T03:30:00.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.288+0000 7fa2ecd67700 1 -- 172.21.15.50:0/3565221992 shutdown_connections 2024-06-06T03:30:00.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.288+0000 7fa2ecd67700 1 --2- 172.21.15.50:0/3565221992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2e8104ec0 0x7fa2e8105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.288+0000 7fa2ecd67700 1 --2- 172.21.15.50:0/3565221992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2e81073b0 0x7fa2e806aa30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.288+0000 7fa2ecd67700 1 --2- 172.21.15.50:0/3565221992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2e806af70 0x7fa2e806b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.288+0000 7fa2ecd67700 1 -- 172.21.15.50:0/3565221992 >> 172.21.15.50:0/3565221992 conn(0x7fa2e8078300 msgr2=0x7fa2e8078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:00.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.289+0000 7fa2ecd67700 1 -- 172.21.15.50:0/3565221992 shutdown_connections 2024-06-06T03:30:00.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.289+0000 7fa2ecd67700 1 -- 172.21.15.50:0/3565221992 wait complete. 2024-06-06T03:30:00.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.290+0000 7fa2ecd67700 1 Processor -- start 2024-06-06T03:30:00.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.290+0000 7fa2ecd67700 1 -- start start 2024-06-06T03:30:00.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.290+0000 7fa2ecd67700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2e8104ec0 0x7fa2e8115980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:00.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.290+0000 7fa2ecd67700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2e81073b0 0x7fa2e810faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:00.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.290+0000 7fa2ecd67700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2e810ffe0 0x7fa2e8110490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:00.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.290+0000 7fa2ecd67700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e81082a0 con 0x7fa2e81073b0 2024-06-06T03:30:00.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.290+0000 7fa2ecd67700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e8108120 con 0x7fa2e810ffe0 2024-06-06T03:30:00.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.290+0000 7fa2ecd67700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e8108420 con 0x7fa2e8104ec0 2024-06-06T03:30:00.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.290+0000 7fa2e5d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2e81073b0 0x7fa2e810faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:00.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.290+0000 7fa2e5d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2e81073b0 0x7fa2e810faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42078/0 (socket says 172.21.15.50:42078) 2024-06-06T03:30:00.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.290+0000 7fa2e5d9b700 1 -- 172.21.15.50:0/1492849484 learned_addr learned my addr 172.21.15.50:0/1492849484 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:00.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.290+0000 7fa2e6d9d700 1 --2- 172.21.15.50:0/1492849484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2e810ffe0 0x7fa2e8110490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:00.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.291+0000 7fa2e659c700 1 --2- 172.21.15.50:0/1492849484 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2e8104ec0 0x7fa2e8115980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:00.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.291+0000 7fa2e5d9b700 1 -- 172.21.15.50:0/1492849484 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2e8104ec0 msgr2=0x7fa2e8115980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:00.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.291+0000 7fa2e5d9b700 1 --2- 172.21.15.50:0/1492849484 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2e8104ec0 0x7fa2e8115980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.291+0000 7fa2e5d9b700 1 -- 172.21.15.50:0/1492849484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2e810ffe0 msgr2=0x7fa2e8110490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:00.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.291+0000 7fa2e5d9b700 1 --2- 172.21.15.50:0/1492849484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2e810ffe0 0x7fa2e8110490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.291+0000 7fa2e5d9b700 1 -- 172.21.15.50:0/1492849484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2e81b4280 con 0x7fa2e81073b0 2024-06-06T03:30:00.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.291+0000 7fa2e659c700 1 --2- 172.21.15.50:0/1492849484 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2e8104ec0 0x7fa2e8115980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:30:00.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.291+0000 7fa2e5d9b700 1 --2- 172.21.15.50:0/1492849484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2e81073b0 0x7fa2e810faa0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc00b450 tx=0x7fa2dc00b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:00.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.292+0000 7fa2d77fe700 1 -- 172.21.15.50:0/1492849484 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc015030 con 0x7fa2e81073b0 2024-06-06T03:30:00.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.292+0000 7fa2ecd67700 1 -- 172.21.15.50:0/1492849484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2e81b4570 con 0x7fa2e81073b0 2024-06-06T03:30:00.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.292+0000 7fa2ecd67700 1 -- 172.21.15.50:0/1492849484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2e81b4b00 con 0x7fa2e81073b0 2024-06-06T03:30:00.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.292+0000 7fa2d77fe700 1 -- 172.21.15.50:0/1492849484 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa2dc011ae0 con 0x7fa2e81073b0 2024-06-06T03:30:00.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.292+0000 7fa2d77fe700 1 -- 172.21.15.50:0/1492849484 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc010bd0 con 0x7fa2e81073b0 2024-06-06T03:30:00.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.295+0000 7fa2d77fe700 1 -- 172.21.15.50:0/1492849484 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa2dc018070 con 0x7fa2e81073b0 2024-06-06T03:30:00.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.297+0000 7fa2d77fe700 1 --2- 172.21.15.50:0/1492849484 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa2d00a2cf0 0x7fa2d00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:00.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.297+0000 7fa2e659c700 1 --2- 172.21.15.50:0/1492849484 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa2d00a2cf0 0x7fa2d00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:00.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.298+0000 7fa2e659c700 1 --2- 172.21.15.50:0/1492849484 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa2d00a2cf0 0x7fa2d00a51b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa2e000b770 tx=0x7fa2e0009ce0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:00.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.298+0000 7fa2d77fe700 1 -- 172.21.15.50:0/1492849484 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fa2dc0ce760 con 0x7fa2e81073b0 2024-06-06T03:30:00.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.298+0000 7fa2f75eab80 1 Processor -- start 2024-06-06T03:30:00.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.299+0000 7fa2f75eab80 1 -- start start 2024-06-06T03:30:00.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.299+0000 7fa2f75eab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a04fcc5640 0x55a04fcc5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:00.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.299+0000 7fa2f75eab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a04fcc5f60 0x55a04fcbf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:00.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.299+0000 7fa2f75eab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a04fcbff20 0x55a04fcc0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:00.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.300+0000 7fa2f75eab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a04fc11810 con 0x55a04fcbff20 2024-06-06T03:30:00.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.300+0000 7fa2e5d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a04fcc5f60 0x55a04fcbf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:00.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.300+0000 7fa2e659c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a04fcc5640 0x55a04fcc5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:00.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.300+0000 7fa2e5d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a04fcc5f60 0x55a04fcbf9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:52784/0 (socket says 172.21.15.50:52784) 2024-06-06T03:30:00.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.300+0000 7fa2e5d9b700 1 -- 172.21.15.50:0/2094815308 learned_addr learned my addr 172.21.15.50:0/2094815308 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:00.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.300+0000 7fa2f75eab80 1 -- 172.21.15.50:0/2094815308 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a04fbb9720 con 0x55a04fcc5f60 2024-06-06T03:30:00.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.300+0000 7fa2e6d9d700 1 --2- 172.21.15.50:0/2094815308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a04fcbff20 0x55a04fcc0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:00.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.300+0000 7fa2f75eab80 1 -- 172.21.15.50:0/2094815308 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a04fc0d7d0 con 0x55a04fcc5640 2024-06-06T03:30:00.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.301+0000 7fa2e659c700 1 -- 172.21.15.50:0/2094815308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a04fcc5f60 msgr2=0x55a04fcbf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:00.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.301+0000 7fa2e659c700 1 --2- 172.21.15.50:0/2094815308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a04fcc5f60 0x55a04fcbf9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.301+0000 7fa2e659c700 1 -- 172.21.15.50:0/2094815308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a04fcbff20 msgr2=0x55a04fcc0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:00.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.301+0000 7fa2e659c700 1 --2- 172.21.15.50:0/2094815308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a04fcbff20 0x55a04fcc0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.301+0000 7fa2e659c700 1 -- 172.21.15.50:0/2094815308 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a04fbaff50 con 0x55a04fcc5640 2024-06-06T03:30:00.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.301+0000 7fa2e659c700 1 --2- 172.21.15.50:0/2094815308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a04fcc5640 0x55a04fcc5a20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0000f80 tx=0x7fa2e001c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52eb39ce5694bcd8 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:00.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.301+0000 7fa2d4ff9700 1 -- 172.21.15.50:0/2094815308 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0007880 con 0x55a04fcc5640 2024-06-06T03:30:00.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.301+0000 7fa2d4ff9700 1 -- 172.21.15.50:0/2094815308 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa2e002e070 con 0x55a04fcc5640 2024-06-06T03:30:00.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.301+0000 7fa2d4ff9700 1 -- 172.21.15.50:0/2094815308 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0029d60 con 0x55a04fcc5640 2024-06-06T03:30:00.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.302+0000 7fa2f75eab80 1 -- 172.21.15.50:0/2094815308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a04fcc5640 msgr2=0x55a04fcc5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:00.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.302+0000 7fa2f75eab80 1 --2- 172.21.15.50:0/2094815308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a04fcc5640 0x55a04fcc5a20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0000f80 tx=0x7fa2e001c000 comp rx=0 tx=0).stop 2024-06-06T03:30:00.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.303+0000 7fa2f75eab80 1 -- 172.21.15.50:0/2094815308 shutdown_connections 2024-06-06T03:30:00.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.303+0000 7fa2f75eab80 1 --2- 172.21.15.50:0/2094815308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a04fcbff20 0x55a04fcc0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.303+0000 7fa2f75eab80 1 --2- 172.21.15.50:0/2094815308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a04fcc5640 0x55a04fcc5a20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.303+0000 7fa2f75eab80 1 --2- 172.21.15.50:0/2094815308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a04fcc5f60 0x55a04fcbf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.303+0000 7fa2f75eab80 1 -- 172.21.15.50:0/2094815308 >> 172.21.15.50:0/2094815308 conn(0x55a04fbeacc0 msgr2=0x55a04fcba850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:00.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.303+0000 7fa2f75eab80 1 -- 172.21.15.50:0/2094815308 shutdown_connections 2024-06-06T03:30:00.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.303+0000 7fa2f75eab80 1 -- 172.21.15.50:0/2094815308 wait complete. 2024-06-06T03:30:00.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.304+0000 7fa2f75eab80 1 -- start start 2024-06-06T03:30:00.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.304+0000 7fa2f75eab80 1 Processor -- start 2024-06-06T03:30:00.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.305+0000 7fa2f75eab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a04fcbff20 0x55a04fccbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:00.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.305+0000 7fa2f75eab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a04fcc5640 0x55a04fcc8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:00.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.305+0000 7fa2f75eab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a04fcc5f60 0x55a04fcc9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:00.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.305+0000 7fa2e5d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a04fcc5640 0x55a04fcc8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:00.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.305+0000 7fa2e5d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a04fcc5640 0x55a04fcc8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42082/0 (socket says 172.21.15.50:42082) 2024-06-06T03:30:00.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.306+0000 7fa2e5d9b700 1 -- 172.21.15.50:0/347791969 learned_addr learned my addr 172.21.15.50:0/347791969 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:00.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.306+0000 7fa2f75eab80 1 -- 172.21.15.50:0/347791969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a04fccc970 con 0x55a04fcc5640 2024-06-06T03:30:00.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.306+0000 7fa2e659c700 1 --2- 172.21.15.50:0/347791969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a04fcbff20 0x55a04fccbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:00.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.306+0000 7fa2e6d9d700 1 --2- 172.21.15.50:0/347791969 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a04fcc5f60 0x55a04fcc9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:00.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.306+0000 7fa2f75eab80 1 -- 172.21.15.50:0/347791969 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a04fbb1bf0 con 0x55a04fcbff20 2024-06-06T03:30:00.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.306+0000 7fa2f75eab80 1 -- 172.21.15.50:0/347791969 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a04fcccaf0 con 0x55a04fcc5f60 2024-06-06T03:30:00.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.306+0000 7fa2f75eab80 10 client.0 _ll_register_callbacks cb 0x55a04fbab920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:30:00.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.307+0000 7fa2e6d9d700 1 -- 172.21.15.50:0/347791969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a04fcbff20 msgr2=0x55a04fccbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:00.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.307+0000 7fa2e6d9d700 1 --2- 172.21.15.50:0/347791969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a04fcbff20 0x55a04fccbce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.307+0000 7fa2e6d9d700 1 -- 172.21.15.50:0/347791969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a04fcc5640 msgr2=0x55a04fcc8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:00.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.307+0000 7fa2e6d9d700 1 --2- 172.21.15.50:0/347791969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a04fcc5640 0x55a04fcc8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.307+0000 7fa2e6d9d700 1 -- 172.21.15.50:0/347791969 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a04fb608d0 con 0x55a04fcc5f60 2024-06-06T03:30:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.307+0000 7fa2f75eab80 1 -- 172.21.15.50:0/347791969 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2e002e070 con 0x55a04fcc5f60 2024-06-06T03:30:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.307+0000 7fa2e6d9d700 1 --2- 172.21.15.50:0/347791969 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a04fcc5f60 0x55a04fcc9520 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa2d800bda0 tx=0x7fa2d80116c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71f4f5384a4c88f8 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.307+0000 7fa2cdffb700 10 client.25564 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:30:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.308+0000 7fa2cdffb700 1 -- 172.21.15.50:0/347791969 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8004250 con 0x55a04fcc5f60 2024-06-06T03:30:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.308+0000 7fa2cdffb700 1 -- 172.21.15.50:0/347791969 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fa2d8004050 con 0x55a04fcc5f60 2024-06-06T03:30:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.308+0000 7fa2cdffb700 1 -- 172.21.15.50:0/347791969 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa2d8004250 con 0x55a04fcc5f60 2024-06-06T03:30:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.308+0000 7fa2f75eab80 10 client.25564 fetch_fsmap learned FSMap version 29 2024-06-06T03:30:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.308+0000 7fa2f75eab80 1 -- 172.21.15.50:0/347791969 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55a04fcd7020 con 0x55a04fcc5f60 2024-06-06T03:30:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.309+0000 7fa2cdffb700 1 -- 172.21.15.50:0/347791969 <== mon.1 v2:172.21.15.122:3300/0 4 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fa2d80043f0 con 0x55a04fcc5f60 2024-06-06T03:30:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.309+0000 7fa2f75eab80 10 client.25564 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:30:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.309+0000 7fa2f75eab80 10 client.25564 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-06-06T03:30:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.309+0000 7fa2f75eab80 20 client.25564 populate_metadata read hostname 'smithi050' 2024-06-06T03:30:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.309+0000 7fa2f75eab80 1 --2- 172.21.15.50:0/347791969 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55a04fcd94f0 0x55a04fcdb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:00.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.309+0000 7fa2f75eab80 4 client.25564 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:30:00.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.309+0000 7fa2f75eab80 1 -- 172.21.15.50:0/347791969 --> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a04fc1ed10 con 0x55a04fcd94f0 2024-06-06T03:30:00.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.309+0000 7fa2e659c700 1 --2- 172.21.15.50:0/347791969 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55a04fcd94f0 0x55a04fcdb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:00.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.310+0000 7fa2cdffb700 10 client.25564 ms_handle_connect on v2:172.21.15.122:6834/2987597320 2024-06-06T03:30:00.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.310+0000 7fa2e659c700 1 --2- 172.21.15.50:0/347791969 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55a04fcd94f0 0x55a04fcdb8e0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=16eeff5dedc34459 server_cookie=751b08b0af44d688 in_seq=0 out_seq=0 2024-06-06T03:30:00.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.311+0000 7fa2cdffb700 1 -- 172.21.15.50:0/347791969 <== mds.2 v2:172.21.15.122:6834/2987597320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55a04fc1ed10 con 0x55a04fcd94f0 2024-06-06T03:30:00.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.311+0000 7fa2cdffb700 10 client.25564 handle_command_reply: tid=0 2024-06-06T03:30:00.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.312+0000 7fa2f75eab80 1 client.25564 shutdown 2024-06-06T03:30:00.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.312+0000 7fa2f75eab80 1 -- 172.21.15.50:0/347791969 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a04fcc5f60 msgr2=0x55a04fcc9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:00.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.312+0000 7fa2f75eab80 1 --2- 172.21.15.50:0/347791969 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a04fcc5f60 0x55a04fcc9520 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa2d800bda0 tx=0x7fa2d80116c0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.312+0000 7fa2f75eab80 1 -- 172.21.15.50:0/347791969 shutdown_connections 2024-06-06T03:30:00.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.312+0000 7fa2f75eab80 1 --2- 172.21.15.50:0/347791969 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a04fcc5f60 0x55a04fcc9520 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.312+0000 7fa2f75eab80 1 --2- 172.21.15.50:0/347791969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a04fcbff20 0x55a04fccbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.312+0000 7fa2f75eab80 1 --2- 172.21.15.50:0/347791969 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55a04fcd94f0 0x55a04fcdb8e0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.312+0000 7fa2f75eab80 1 --2- 172.21.15.50:0/347791969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a04fcc5640 0x55a04fcc8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.312+0000 7fa2f75eab80 1 -- 172.21.15.50:0/347791969 >> 172.21.15.50:0/347791969 conn(0x55a04fbeacc0 msgr2=0x55a04fcba5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:00.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.313+0000 7fa2cdffb700 0 client.25564 ms_handle_reset on v2:172.21.15.122:6834/2987597320 2024-06-06T03:30:00.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.313+0000 7fa2f75eab80 1 -- 172.21.15.50:0/347791969 shutdown_connections 2024-06-06T03:30:00.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.314+0000 7fa2f75eab80 1 -- 172.21.15.50:0/347791969 wait complete. 2024-06-06T03:30:00.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.314+0000 7fa2f75eab80 20 client.25564 trim_cache size 0 max 16384 2024-06-06T03:30:00.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.344+0000 7fa2f75eab80 1 Processor -- start 2024-06-06T03:30:00.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.344+0000 7fa2f75eab80 1 -- start start 2024-06-06T03:30:00.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.345+0000 7fa2f75eab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a04fcbff20 0x55a04fcbf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:00.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.345+0000 7fa2f75eab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a04fcc5640 0x55a04fcb4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:00.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.345+0000 7fa2f75eab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a04fcc5f60 0x55a04fce1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:00.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.345+0000 7fa2f75eab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e81c0050 con 0x55a04fcc5f60 2024-06-06T03:30:00.346 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:00 smithi050 ceph-mon[32421]: overall HEALTH_OK 2024-06-06T03:30:00.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.345+0000 7fa2f75eab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e81bd8e0 con 0x55a04fcbff20 2024-06-06T03:30:00.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.345+0000 7fa2f75eab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e81bb6d0 con 0x55a04fcc5640 2024-06-06T03:30:00.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.345+0000 7fa2e5d9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a04fcc5640 0x55a04fcb4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:00.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.345+0000 7fa2e5d9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a04fcc5640 0x55a04fcb4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:53570/0 (socket says 172.21.15.50:53570) 2024-06-06T03:30:00.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.345+0000 7fa2e5d9b700 1 -- 172.21.15.50:0/2752814981 learned_addr learned my addr 172.21.15.50:0/2752814981 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:00.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.345+0000 7fa2e659c700 1 --2- 172.21.15.50:0/2752814981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a04fcbff20 0x55a04fcbf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:00.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.345+0000 7fa2e6d9d700 1 --2- 172.21.15.50:0/2752814981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a04fcc5f60 0x55a04fce1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:00.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.346+0000 7fa2e5d9b700 1 -- 172.21.15.50:0/2752814981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a04fcbff20 msgr2=0x55a04fcbf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:00.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.346+0000 7fa2e5d9b700 1 --2- 172.21.15.50:0/2752814981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a04fcbff20 0x55a04fcbf9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.346+0000 7fa2e5d9b700 1 -- 172.21.15.50:0/2752814981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a04fcc5f60 msgr2=0x55a04fce1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:00.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.346+0000 7fa2e5d9b700 1 --2- 172.21.15.50:0/2752814981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a04fcc5f60 0x55a04fce1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.346+0000 7fa2e5d9b700 1 -- 172.21.15.50:0/2752814981 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a04fcb53b0 con 0x55a04fcc5640 2024-06-06T03:30:00.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.346+0000 7fa2e5d9b700 1 --2- 172.21.15.50:0/2752814981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a04fcc5640 0x55a04fcb4510 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc097610 tx=0x7fa2dc09b340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c88a42d5b82df068 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:00.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.346+0000 7fa2cffff700 1 -- 172.21.15.50:0/2752814981 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc09eff0 con 0x55a04fcc5640 2024-06-06T03:30:00.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.346+0000 7fa2cffff700 1 -- 172.21.15.50:0/2752814981 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa2dc0a38b0 con 0x55a04fcc5640 2024-06-06T03:30:00.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.346+0000 7fa2cffff700 1 -- 172.21.15.50:0/2752814981 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc00f2e0 con 0x55a04fcc5640 2024-06-06T03:30:00.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.347+0000 7fa2f75eab80 1 -- 172.21.15.50:0/2752814981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a04fcc5640 msgr2=0x55a04fcb4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:00.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.347+0000 7fa2f75eab80 1 --2- 172.21.15.50:0/2752814981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a04fcc5640 0x55a04fcb4510 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc097610 tx=0x7fa2dc09b340 comp rx=0 tx=0).stop 2024-06-06T03:30:00.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.348+0000 7fa2f75eab80 1 -- 172.21.15.50:0/2752814981 shutdown_connections 2024-06-06T03:30:00.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.348+0000 7fa2f75eab80 1 --2- 172.21.15.50:0/2752814981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a04fcc5f60 0x55a04fce1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.348+0000 7fa2f75eab80 1 --2- 172.21.15.50:0/2752814981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a04fcbff20 0x55a04fcbf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.348+0000 7fa2f75eab80 1 --2- 172.21.15.50:0/2752814981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a04fcc5640 0x55a04fcb4510 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.348+0000 7fa2f75eab80 1 -- 172.21.15.50:0/2752814981 >> 172.21.15.50:0/2752814981 conn(0x55a04fbeacc0 msgr2=0x55a04fcb3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:00.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.348+0000 7fa2f75eab80 1 -- 172.21.15.50:0/2752814981 shutdown_connections 2024-06-06T03:30:00.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.348+0000 7fa2f75eab80 1 -- 172.21.15.50:0/2752814981 wait complete. 2024-06-06T03:30:00.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.349+0000 7fa2f75eab80 1 -- start start 2024-06-06T03:30:00.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.349+0000 7fa2f75eab80 1 Processor -- start 2024-06-06T03:30:00.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.350+0000 7fa2f75eab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a04fcc5640 0x55a04fce0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:00.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.350+0000 7fa2f75eab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a04fcc5f60 0x55a04fce1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:00.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.350+0000 7fa2f75eab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a04fce16c0 0x55a04fd54170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:00.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.350+0000 7fa2f75eab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e81bbda0 con 0x55a04fce16c0 2024-06-06T03:30:00.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.350+0000 7fa2f75eab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e81bd210 con 0x55a04fcc5f60 2024-06-06T03:30:00.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.350+0000 7fa2f75eab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e81bc470 con 0x55a04fcc5640 2024-06-06T03:30:00.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.350+0000 7fa2f75eab80 10 client.0 _ll_register_callbacks cb 0x55a04fbab920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:30:00.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.350+0000 7fa2e659c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a04fcc5640 0x55a04fce0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:00.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.350+0000 7fa2e659c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a04fcc5640 0x55a04fce0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:53580/0 (socket says 172.21.15.50:53580) 2024-06-06T03:30:00.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.350+0000 7fa2e659c700 1 -- 172.21.15.50:0/227130872 learned_addr learned my addr 172.21.15.50:0/227130872 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:00.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.350+0000 7fa2e5d9b700 1 --2- 172.21.15.50:0/227130872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a04fcc5f60 0x55a04fce1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:00.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.350+0000 7fa2e659c700 1 -- 172.21.15.50:0/227130872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a04fcc5f60 msgr2=0x55a04fce1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:00.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.350+0000 7fa2e659c700 1 --2- 172.21.15.50:0/227130872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a04fcc5f60 0x55a04fce1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.350+0000 7fa2e659c700 1 -- 172.21.15.50:0/227130872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a04fce16c0 msgr2=0x55a04fd54170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:00.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.350+0000 7fa2e659c700 1 --2- 172.21.15.50:0/227130872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a04fce16c0 0x55a04fd54170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.350+0000 7fa2e659c700 1 -- 172.21.15.50:0/227130872 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a04fcd2a50 con 0x55a04fcc5640 2024-06-06T03:30:00.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.351+0000 7fa2e659c700 1 --2- 172.21.15.50:0/227130872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a04fcc5640 0x55a04fce0c40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0009f90 tx=0x7fa2e00298b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76a7d1722cb36e8 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:00.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.351+0000 7fa2cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:30:00.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.352+0000 7fa2cdffb700 1 -- 172.21.15.50:0/227130872 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0029bc0 con 0x55a04fcc5640 2024-06-06T03:30:00.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.352+0000 7fa2cdffb700 1 -- 172.21.15.50:0/227130872 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fa2e0029d60 con 0x55a04fcc5640 2024-06-06T03:30:00.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.353+0000 7fa2f75eab80 1 -- 172.21.15.50:0/227130872 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2dc0a38b0 con 0x55a04fcc5640 2024-06-06T03:30:00.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.353+0000 7fa2cdffb700 1 -- 172.21.15.50:0/227130872 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa2e0007800 con 0x55a04fcc5640 2024-06-06T03:30:00.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.353+0000 7fa2f75eab80 10 client.25570 fetch_fsmap learned FSMap version 29 2024-06-06T03:30:00.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.353+0000 7fa2f75eab80 1 -- 172.21.15.50:0/227130872 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a04fd55770 con 0x55a04fcc5640 2024-06-06T03:30:00.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.354+0000 7fa2cdffb700 1 -- 172.21.15.50:0/227130872 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa2e0036070 con 0x55a04fcc5640 2024-06-06T03:30:00.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.354+0000 7fa2cdffb700 1 -- 172.21.15.50:0/227130872 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fa2e0011070 con 0x55a04fcc5640 2024-06-06T03:30:00.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.354+0000 7fa2f75eab80 10 client.25570 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T03:30:00.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.354+0000 7fa2f75eab80 10 client.25570 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-06-06T03:30:00.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.354+0000 7fa2f75eab80 20 client.25570 populate_metadata read hostname 'smithi050' 2024-06-06T03:30:00.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.354+0000 7fa2f75eab80 1 --2- 172.21.15.50:0/227130872 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55a04fd55940 0x55a04fd57d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:00.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.354+0000 7fa2f75eab80 4 client.25570 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:30:00.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.354+0000 7fa2f75eab80 1 -- 172.21.15.50:0/227130872 --> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fa2dc0a38b0 con 0x55a04fd55940 2024-06-06T03:30:00.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.355+0000 7fa2e5d9b700 1 --2- 172.21.15.50:0/227130872 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55a04fd55940 0x55a04fd57d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:00.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.356+0000 7fa2cdffb700 10 client.25570 ms_handle_connect on v2:172.21.15.122:6834/2987597320 2024-06-06T03:30:00.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.356+0000 7fa2e5d9b700 1 --2- 172.21.15.50:0/227130872 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55a04fd55940 0x55a04fd57d30 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cbfa478d88f9791f server_cookie=ce8fcb714aaf47ae in_seq=0 out_seq=0 2024-06-06T03:30:00.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.356+0000 7fa2cdffb700 1 -- 172.21.15.50:0/227130872 <== mds.2 v2:172.21.15.122:6834/2987597320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fa2dc0a38b0 con 0x55a04fd55940 2024-06-06T03:30:00.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.356+0000 7fa2cdffb700 10 client.25570 handle_command_reply: tid=0 2024-06-06T03:30:00.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.356+0000 7fa2f75eab80 1 client.25570 shutdown 2024-06-06T03:30:00.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.357+0000 7fa2f75eab80 1 -- 172.21.15.50:0/227130872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a04fcc5640 msgr2=0x55a04fce0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:00.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.357+0000 7fa2f75eab80 1 --2- 172.21.15.50:0/227130872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a04fcc5640 0x55a04fce0c40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0009f90 tx=0x7fa2e00298b0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.358+0000 7fa2f75eab80 1 -- 172.21.15.50:0/227130872 shutdown_connections 2024-06-06T03:30:00.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.358+0000 7fa2f75eab80 1 --2- 172.21.15.50:0/227130872 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55a04fd55940 0x55a04fd57d30 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.358+0000 7fa2f75eab80 1 --2- 172.21.15.50:0/227130872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a04fce16c0 0x55a04fd54170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.358+0000 7fa2f75eab80 1 --2- 172.21.15.50:0/227130872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a04fcc5640 0x55a04fce0c40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.358+0000 7fa2f75eab80 1 --2- 172.21.15.50:0/227130872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a04fcc5f60 0x55a04fce1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.358+0000 7fa2f75eab80 1 -- 172.21.15.50:0/227130872 >> 172.21.15.50:0/227130872 conn(0x55a04fbeacc0 msgr2=0x55a04fcc78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:00.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.358+0000 7fa2cdffb700 0 client.25570 ms_handle_reset on v2:172.21.15.122:6834/2987597320 2024-06-06T03:30:00.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.358+0000 7fa2f75eab80 1 -- 172.21.15.50:0/227130872 shutdown_connections 2024-06-06T03:30:00.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.359+0000 7fa2f75eab80 1 -- 172.21.15.50:0/227130872 wait complete. 2024-06-06T03:30:00.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.359+0000 7fa2f75eab80 20 client.25570 trim_cache size 0 max 16384 2024-06-06T03:30:00.367 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:30:00.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.360+0000 7fa2ecd67700 1 -- 172.21.15.50:0/1492849484 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa2d00a2cf0 msgr2=0x7fa2d00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:00.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.360+0000 7fa2ecd67700 1 --2- 172.21.15.50:0/1492849484 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa2d00a2cf0 0x7fa2d00a51b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa2e000b770 tx=0x7fa2e0009ce0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.360+0000 7fa2ecd67700 1 -- 172.21.15.50:0/1492849484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2e81073b0 msgr2=0x7fa2e810faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:00.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.360+0000 7fa2ecd67700 1 --2- 172.21.15.50:0/1492849484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2e81073b0 0x7fa2e810faa0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc00b450 tx=0x7fa2dc00b810 comp rx=0 tx=0).stop 2024-06-06T03:30:00.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.360+0000 7fa2ecd67700 1 -- 172.21.15.50:0/1492849484 shutdown_connections 2024-06-06T03:30:00.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.360+0000 7fa2ecd67700 1 --2- 172.21.15.50:0/1492849484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2e810ffe0 0x7fa2e8110490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.360+0000 7fa2ecd67700 1 --2- 172.21.15.50:0/1492849484 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2e8104ec0 0x7fa2e8115980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.360+0000 7fa2ecd67700 1 --2- 172.21.15.50:0/1492849484 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fa2d00a2cf0 0x7fa2d00a51b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.360+0000 7fa2ecd67700 1 --2- 172.21.15.50:0/1492849484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2e81073b0 0x7fa2e810faa0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:00.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.360+0000 7fa2ecd67700 1 -- 172.21.15.50:0/1492849484 >> 172.21.15.50:0/1492849484 conn(0x7fa2e8078300 msgr2=0x7fa2e8100370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:00.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.360+0000 7fa2ecd67700 1 -- 172.21.15.50:0/1492849484 shutdown_connections 2024-06-06T03:30:00.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:00.360+0000 7fa2ecd67700 1 -- 172.21.15.50:0/1492849484 wait complete. 2024-06-06T03:30:00.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:00 smithi122 ceph-mon[35759]: overall HEALTH_OK 2024-06-06T03:30:00.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:00 smithi079 ceph-mon[35478]: overall HEALTH_OK 2024-06-06T03:30:01.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:01 smithi122 ceph-mon[35759]: pgmap v532: 129 pgs: 129 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 50 MiB/s wr, 799 op/s 2024-06-06T03:30:01.476 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:01 smithi050 ceph-mon[32421]: pgmap v532: 129 pgs: 129 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 50 MiB/s wr, 799 op/s 2024-06-06T03:30:01.526 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-06-06T03:30:01.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:01 smithi079 ceph-mon[35478]: pgmap v532: 129 pgs: 129 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 50 MiB/s wr, 799 op/s 2024-06-06T03:30:02.003 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:30:03.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:03 smithi050 ceph-mon[32421]: pgmap v533: 129 pgs: 129 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 42 MiB/s wr, 683 op/s 2024-06-06T03:30:03.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:03 smithi050 ceph-mon[32421]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:30:03.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:03 smithi079 ceph-mon[35478]: pgmap v533: 129 pgs: 129 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 42 MiB/s wr, 683 op/s 2024-06-06T03:30:03.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:03 smithi079 ceph-mon[35478]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:30:03.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:03 smithi122 ceph-mon[35759]: pgmap v533: 129 pgs: 129 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 42 MiB/s wr, 683 op/s 2024-06-06T03:30:03.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:03 smithi122 ceph-mon[35759]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:30:04.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.671+0000 7f6888322700 1 -- 172.21.15.50:0/371121409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68801085d0 msgr2=0x7f68801089b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:04.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.671+0000 7f6888322700 1 --2- 172.21.15.50:0/371121409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68801085d0 0x7f68801089b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f687c0099c0 tx=0x7f687c009cd0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.671+0000 7f6888322700 1 -- 172.21.15.50:0/371121409 shutdown_connections 2024-06-06T03:30:04.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.672+0000 7f6888322700 1 --2- 172.21.15.50:0/371121409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6880102ef0 0x7f688010f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.672+0000 7f6888322700 1 --2- 172.21.15.50:0/371121409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68801085d0 0x7f68801089b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.672+0000 7f6888322700 1 --2- 172.21.15.50:0/371121409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6880102530 0x7f68801029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.672+0000 7f6888322700 1 -- 172.21.15.50:0/371121409 >> 172.21.15.50:0/371121409 conn(0x7f6880079640 msgr2=0x7f6880079a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:04.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.672+0000 7f6888322700 1 -- 172.21.15.50:0/371121409 shutdown_connections 2024-06-06T03:30:04.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.672+0000 7f6888322700 1 -- 172.21.15.50:0/371121409 wait complete. 2024-06-06T03:30:04.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.674+0000 7f6888322700 1 Processor -- start 2024-06-06T03:30:04.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.674+0000 7f6888322700 1 -- start start 2024-06-06T03:30:04.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.674+0000 7f6888322700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6880102530 0x7f688019e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:04.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.674+0000 7f6888322700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6880102ef0 0x7f688019eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:04.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.675+0000 7f6888322700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68801085d0 0x7f68801987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:04.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.675+0000 7f6888322700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6880112710 con 0x7f68801085d0 2024-06-06T03:30:04.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.675+0000 7f6888322700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6880112590 con 0x7f6880102ef0 2024-06-06T03:30:04.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.675+0000 7f6888322700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6880112890 con 0x7f6880102530 2024-06-06T03:30:04.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.675+0000 7f68860be700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6880102530 0x7f688019e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:04.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.675+0000 7f68860be700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6880102530 0x7f688019e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:53598/0 (socket says 172.21.15.50:53598) 2024-06-06T03:30:04.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.675+0000 7f68860be700 1 -- 172.21.15.50:0/1614708590 learned_addr learned my addr 172.21.15.50:0/1614708590 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:04.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.675+0000 7f68858bd700 1 --2- 172.21.15.50:0/1614708590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6880102ef0 0x7f688019eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:04.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.675+0000 7f68860be700 1 -- 172.21.15.50:0/1614708590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6880102ef0 msgr2=0x7f688019eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:04.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.675+0000 7f68860be700 1 --2- 172.21.15.50:0/1614708590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6880102ef0 0x7f688019eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.675+0000 7f68860be700 1 -- 172.21.15.50:0/1614708590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68801085d0 msgr2=0x7f68801987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:04.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.675+0000 7f68860be700 1 --2- 172.21.15.50:0/1614708590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68801085d0 0x7f68801987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.675+0000 7f68860be700 1 -- 172.21.15.50:0/1614708590 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6880198fb0 con 0x7f6880102530 2024-06-06T03:30:04.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.676+0000 7f68858bd700 1 --2- 172.21.15.50:0/1614708590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6880102ef0 0x7f688019eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:30:04.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.676+0000 7f68860be700 1 --2- 172.21.15.50:0/1614708590 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6880102530 0x7f688019e650 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f687c009320 tx=0x7f687c003680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:04.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.677+0000 7f68777fe700 1 -- 172.21.15.50:0/1614708590 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687c00fe10 con 0x7f6880102530 2024-06-06T03:30:04.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.677+0000 7f68777fe700 1 -- 172.21.15.50:0/1614708590 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f687c023070 con 0x7f6880102530 2024-06-06T03:30:04.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.677+0000 7f68777fe700 1 -- 172.21.15.50:0/1614708590 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687c01f4d0 con 0x7f6880102530 2024-06-06T03:30:04.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.678+0000 7f6888322700 1 -- 172.21.15.50:0/1614708590 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6880199240 con 0x7f6880102530 2024-06-06T03:30:04.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.678+0000 7f6888322700 1 -- 172.21.15.50:0/1614708590 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68800746c0 con 0x7f6880102530 2024-06-06T03:30:04.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.682+0000 7f68777fe700 1 -- 172.21.15.50:0/1614708590 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f687c025020 con 0x7f6880102530 2024-06-06T03:30:04.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.683+0000 7f6892ba5b80 1 Processor -- start 2024-06-06T03:30:04.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.684+0000 7f68777fe700 1 --2- 172.21.15.50:0/1614708590 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f686c0a2df0 0x7f686c0a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:04.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.684+0000 7f6892ba5b80 1 -- start start 2024-06-06T03:30:04.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.684+0000 7f6892ba5b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620c5cd1770 0x5620c5cd1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:04.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.684+0000 7f6892ba5b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620c5cd2090 0x5620c5ccba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:04.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.685+0000 7f68860be700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620c5cd1770 0x5620c5cd1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:04.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.685+0000 7f68868bf700 1 --2- 172.21.15.50:0/1614708590 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f686c0a2df0 0x7f686c0a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:04.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.685+0000 7f68860be700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620c5cd1770 0x5620c5cd1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:53604/0 (socket says 172.21.15.50:53604) 2024-06-06T03:30:04.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.685+0000 7f6892ba5b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620c5ccbfb0 0x5620c5ccc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:04.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.685+0000 7f6892ba5b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5620c5bb5f60 con 0x5620c5ccbfb0 2024-06-06T03:30:04.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.685+0000 7f68858bd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620c5cd2090 0x5620c5ccba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:04.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.685+0000 7f68858bd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620c5cd2090 0x5620c5ccba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:52842/0 (socket says 172.21.15.50:52842) 2024-06-06T03:30:04.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.685+0000 7f68858bd700 1 -- 172.21.15.50:0/1005765113 learned_addr learned my addr 172.21.15.50:0/1005765113 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:04.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.685+0000 7f6892ba5b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5620c5c14850 con 0x5620c5cd2090 2024-06-06T03:30:04.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.685+0000 7f6892ba5b80 1 -- 172.21.15.50:0/1005765113 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5620c5b7c460 con 0x5620c5cd1770 2024-06-06T03:30:04.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.685+0000 7f68868bf700 1 --2- 172.21.15.50:0/1005765113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620c5ccbfb0 0x5620c5ccc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:04.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.685+0000 7f68858bd700 1 -- 172.21.15.50:0/1005765113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620c5cd1770 msgr2=0x5620c5cd1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:04.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.685+0000 7f68858bd700 1 --2- 172.21.15.50:0/1005765113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620c5cd1770 0x5620c5cd1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.685+0000 7f68858bd700 1 -- 172.21.15.50:0/1005765113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620c5ccbfb0 msgr2=0x5620c5ccc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:04.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.685+0000 7f68858bd700 1 --2- 172.21.15.50:0/1005765113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620c5ccbfb0 0x5620c5ccc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.685+0000 7f68858bd700 1 -- 172.21.15.50:0/1005765113 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620c5b638d0 con 0x5620c5cd2090 2024-06-06T03:30:04.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.686+0000 7f68858bd700 1 --2- 172.21.15.50:0/1005765113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620c5cd2090 0x5620c5ccba70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f687000bcf0 tx=0x7f687000d340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc795e7796708bcd server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:04.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.686+0000 7f68777fe700 1 -- 172.21.15.50:0/1614708590 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f687c0d41e0 con 0x7f6880102530 2024-06-06T03:30:04.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.687+0000 7f6874d70700 1 -- 172.21.15.50:0/1005765113 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687000dd50 con 0x5620c5cd2090 2024-06-06T03:30:04.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.687+0000 7f6874d70700 1 -- 172.21.15.50:0/1005765113 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f687000f8d0 con 0x5620c5cd2090 2024-06-06T03:30:04.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.688+0000 7f6874d70700 1 -- 172.21.15.50:0/1005765113 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6870016980 con 0x5620c5cd2090 2024-06-06T03:30:04.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.690+0000 7f68868bf700 1 --2- 172.21.15.50:0/1614708590 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f686c0a2df0 0x7f686c0a52b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6878010720 tx=0x7f6878010ae0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:04.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.690+0000 7f6892ba5b80 1 -- 172.21.15.50:0/1005765113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620c5cd2090 msgr2=0x5620c5ccba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:04.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.690+0000 7f6892ba5b80 1 --2- 172.21.15.50:0/1005765113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620c5cd2090 0x5620c5ccba70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f687000bcf0 tx=0x7f687000d340 comp rx=0 tx=0).stop 2024-06-06T03:30:04.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.690+0000 7f6892ba5b80 1 -- 172.21.15.50:0/1005765113 shutdown_connections 2024-06-06T03:30:04.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.690+0000 7f6892ba5b80 1 --2- 172.21.15.50:0/1005765113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620c5ccbfb0 0x5620c5ccc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.690+0000 7f6892ba5b80 1 --2- 172.21.15.50:0/1005765113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620c5cd1770 0x5620c5cd1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.690+0000 7f6892ba5b80 1 --2- 172.21.15.50:0/1005765113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620c5cd2090 0x5620c5ccba70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.690+0000 7f6892ba5b80 1 -- 172.21.15.50:0/1005765113 >> 172.21.15.50:0/1005765113 conn(0x5620c5bf0080 msgr2=0x5620c5cbe220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:04.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.690+0000 7f6892ba5b80 1 -- 172.21.15.50:0/1005765113 shutdown_connections 2024-06-06T03:30:04.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.690+0000 7f6892ba5b80 1 -- 172.21.15.50:0/1005765113 wait complete. 2024-06-06T03:30:04.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.691+0000 7f6892ba5b80 1 -- start start 2024-06-06T03:30:04.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.691+0000 7f6892ba5b80 1 Processor -- start 2024-06-06T03:30:04.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.692+0000 7f6892ba5b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620c5ccbfb0 0x5620c5cd56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:04.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.692+0000 7f6892ba5b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620c5cd1770 0x5620c5cd5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:04.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.692+0000 7f6892ba5b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620c5cd2090 0x5620c5cd6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:04.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.692+0000 7f68860be700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620c5ccbfb0 0x5620c5cd56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:04.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.692+0000 7f68860be700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620c5ccbfb0 0x5620c5cd56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:53612/0 (socket says 172.21.15.50:53612) 2024-06-06T03:30:04.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.692+0000 7f68858bd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620c5cd1770 0x5620c5cd5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:04.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.692+0000 7f68858bd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620c5cd1770 0x5620c5cd5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:52854/0 (socket says 172.21.15.50:52854) 2024-06-06T03:30:04.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.693+0000 7f68860be700 1 -- 172.21.15.50:0/1609922023 learned_addr learned my addr 172.21.15.50:0/1609922023 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:04.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.693+0000 7f6892ba5b80 1 -- 172.21.15.50:0/1609922023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5620c5bb4fc0 con 0x5620c5cd2090 2024-06-06T03:30:04.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.693+0000 7f6892ba5b80 1 -- 172.21.15.50:0/1609922023 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5620c5c10810 con 0x5620c5cd1770 2024-06-06T03:30:04.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.693+0000 7f6892ba5b80 1 -- 172.21.15.50:0/1609922023 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5620c5cc34b0 con 0x5620c5ccbfb0 2024-06-06T03:30:04.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.693+0000 7f68868bf700 1 --2- 172.21.15.50:0/1609922023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620c5cd2090 0x5620c5cd6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:04.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.693+0000 7f68860be700 1 -- 172.21.15.50:0/1609922023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620c5cd1770 msgr2=0x5620c5cd5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:04.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.693+0000 7f68860be700 1 --2- 172.21.15.50:0/1609922023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620c5cd1770 0x5620c5cd5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.693+0000 7f68860be700 1 -- 172.21.15.50:0/1609922023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620c5cd2090 msgr2=0x5620c5cd6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:04.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.693+0000 7f68860be700 1 --2- 172.21.15.50:0/1609922023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620c5cd2090 0x5620c5cd6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.693+0000 7f68860be700 1 -- 172.21.15.50:0/1609922023 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620c5bda750 con 0x5620c5ccbfb0 2024-06-06T03:30:04.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.694+0000 7f68860be700 1 --2- 172.21.15.50:0/1609922023 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620c5ccbfb0 0x5620c5cd56f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f687c006010 tx=0x7f687c0a0230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65c8add49cf7ad93 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:04.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.694+0000 7f6892ba5b80 10 client.0 _ll_register_callbacks cb 0x5620c5baa5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:30:04.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.694+0000 7f6869ffb700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:30:04.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.694+0000 7f6869ffb700 1 -- 172.21.15.50:0/1609922023 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687c0a0df0 con 0x5620c5ccbfb0 2024-06-06T03:30:04.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.694+0000 7f6869ffb700 1 -- 172.21.15.50:0/1609922023 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f687c02ec00 con 0x5620c5ccbfb0 2024-06-06T03:30:04.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.694+0000 7f6892ba5b80 1 -- 172.21.15.50:0/1609922023 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f687000f8d0 con 0x5620c5ccbfb0 2024-06-06T03:30:04.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.695+0000 7f6869ffb700 1 -- 172.21.15.50:0/1609922023 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f687c0a9520 con 0x5620c5ccbfb0 2024-06-06T03:30:04.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.695+0000 7f6892ba5b80 10 client.25579 fetch_fsmap learned FSMap version 30 2024-06-06T03:30:04.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.695+0000 7f6892ba5b80 1 -- 172.21.15.50:0/1609922023 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5620c5ccbc00 con 0x5620c5ccbfb0 2024-06-06T03:30:04.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.695+0000 7f6869ffb700 1 -- 172.21.15.50:0/1609922023 <== mon.1 v2:172.21.15.122:3300/0 4 ==== fsmap(e 30) ==== 8350+0+0 (secure 0 0 0) 0x7f687c0a0950 con 0x5620c5ccbfb0 2024-06-06T03:30:04.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.695+0000 7f6892ba5b80 10 client.25579 fetch_fsmap finished waiting for FSMap version 30 2024-06-06T03:30:04.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.695+0000 7f6892ba5b80 10 client.25579 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-06-06T03:30:04.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.695+0000 7f6892ba5b80 20 client.25579 populate_metadata read hostname 'smithi050' 2024-06-06T03:30:04.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.695+0000 7f6892ba5b80 1 --2- 172.21.15.50:0/1609922023 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x5620c5cdcb40 0x5620c5cdf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:04.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.695+0000 7f6892ba5b80 4 client.25579 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:30:04.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.695+0000 7f6892ba5b80 1 -- 172.21.15.50:0/1609922023 --> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620c5c21d50 con 0x5620c5cdcb40 2024-06-06T03:30:04.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.695+0000 7f68858bd700 1 --2- 172.21.15.50:0/1609922023 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x5620c5cdcb40 0x5620c5cdf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:04.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.696+0000 7f68858bd700 1 --2- 172.21.15.50:0/1609922023 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x5620c5cdcb40 0x5620c5cdf000 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c181c2eb5643efe8 server_cookie=1a1d1563ee5ab758 in_seq=0 out_seq=0 2024-06-06T03:30:04.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.696+0000 7f6869ffb700 10 client.25579 ms_handle_connect on v2:172.21.15.122:6836/1604366318 2024-06-06T03:30:04.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.697+0000 7f6869ffb700 1 -- 172.21.15.50:0/1609922023 <== mds.1 v2:172.21.15.122:6836/1604366318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5620c5c21d50 con 0x5620c5cdcb40 2024-06-06T03:30:04.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.697+0000 7f6869ffb700 10 client.25579 handle_command_reply: tid=0 2024-06-06T03:30:04.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.697+0000 7f6892ba5b80 1 client.25579 shutdown 2024-06-06T03:30:04.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.697+0000 7f6892ba5b80 1 -- 172.21.15.50:0/1609922023 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620c5ccbfb0 msgr2=0x5620c5cd56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:04.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.697+0000 7f6892ba5b80 1 --2- 172.21.15.50:0/1609922023 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620c5ccbfb0 0x5620c5cd56f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f687c006010 tx=0x7f687c0a0230 comp rx=0 tx=0).stop 2024-06-06T03:30:04.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.697+0000 7f6892ba5b80 1 -- 172.21.15.50:0/1609922023 shutdown_connections 2024-06-06T03:30:04.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.697+0000 7f6892ba5b80 1 --2- 172.21.15.50:0/1609922023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620c5cd2090 0x5620c5cd6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.697+0000 7f6892ba5b80 1 --2- 172.21.15.50:0/1609922023 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x5620c5cdcb40 0x5620c5cdf000 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.697+0000 7f6892ba5b80 1 --2- 172.21.15.50:0/1609922023 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620c5ccbfb0 0x5620c5cd56f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.697+0000 7f6892ba5b80 1 --2- 172.21.15.50:0/1609922023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620c5cd1770 0x5620c5cd5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.697+0000 7f6869ffb700 0 client.25579 ms_handle_reset on v2:172.21.15.122:6836/1604366318 2024-06-06T03:30:04.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.698+0000 7f6892ba5b80 1 -- 172.21.15.50:0/1609922023 >> 172.21.15.50:0/1609922023 conn(0x5620c5bf0080 msgr2=0x5620c5cbd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:04.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.698+0000 7f6892ba5b80 1 -- 172.21.15.50:0/1609922023 shutdown_connections 2024-06-06T03:30:04.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.698+0000 7f6892ba5b80 1 -- 172.21.15.50:0/1609922023 wait complete. 2024-06-06T03:30:04.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.698+0000 7f6892ba5b80 20 client.25579 trim_cache size 0 max 16384 2024-06-06T03:30:04.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.732+0000 7f6892ba5b80 1 Processor -- start 2024-06-06T03:30:04.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.732+0000 7f6892ba5b80 1 -- start start 2024-06-06T03:30:04.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.733+0000 7f6892ba5b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620c5ccbfb0 0x5620c5cd5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:04.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.733+0000 7f6892ba5b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620c5cd1770 0x5620c5cc2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:04.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.733+0000 7f6892ba5b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620c5cd2090 0x5620c5cbde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:04.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.733+0000 7f6892ba5b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f68801ae510 con 0x5620c5ccbfb0 2024-06-06T03:30:04.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.733+0000 7f6892ba5b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f68801abda0 con 0x5620c5cd2090 2024-06-06T03:30:04.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.733+0000 7f68860be700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620c5ccbfb0 0x5620c5cd5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:04.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.733+0000 7f68868bf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620c5cd2090 0x5620c5cbde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:04.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.733+0000 7f68860be700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620c5ccbfb0 0x5620c5cd5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42156/0 (socket says 172.21.15.50:42156) 2024-06-06T03:30:04.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.733+0000 7f68860be700 1 -- 172.21.15.50:0/733884225 learned_addr learned my addr 172.21.15.50:0/733884225 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:04.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.733+0000 7f68868bf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620c5cd2090 0x5620c5cbde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:52858/0 (socket says 172.21.15.50:52858) 2024-06-06T03:30:04.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.733+0000 7f6892ba5b80 1 -- 172.21.15.50:0/733884225 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f68801a9c10 con 0x5620c5cd1770 2024-06-06T03:30:04.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.734+0000 7f68868bf700 1 -- 172.21.15.50:0/733884225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620c5cd1770 msgr2=0x5620c5cc2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:04.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.734+0000 7f68868bf700 1 --2- 172.21.15.50:0/733884225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620c5cd1770 0x5620c5cc2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.734+0000 7f68868bf700 1 -- 172.21.15.50:0/733884225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620c5ccbfb0 msgr2=0x5620c5cd5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:04.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.734+0000 7f68868bf700 1 --2- 172.21.15.50:0/733884225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620c5ccbfb0 0x5620c5cd5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.734+0000 7f68868bf700 1 -- 172.21.15.50:0/733884225 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620c5cd1da0 con 0x5620c5cd2090 2024-06-06T03:30:04.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.735+0000 7f68868bf700 1 --2- 172.21.15.50:0/733884225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620c5cd2090 0x5620c5cbde80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6878009dd0 tx=0x7f687801c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbd23b239f0bf661 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:04.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.736+0000 7f686bfff700 1 -- 172.21.15.50:0/733884225 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878018cf0 con 0x5620c5cd2090 2024-06-06T03:30:04.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.736+0000 7f686bfff700 1 -- 172.21.15.50:0/733884225 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6878004bb0 con 0x5620c5cd2090 2024-06-06T03:30:04.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.736+0000 7f686bfff700 1 -- 172.21.15.50:0/733884225 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68780042a0 con 0x5620c5cd2090 2024-06-06T03:30:04.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.737+0000 7f6892ba5b80 1 -- 172.21.15.50:0/733884225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620c5cd2090 msgr2=0x5620c5cbde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:04.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.737+0000 7f6892ba5b80 1 --2- 172.21.15.50:0/733884225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620c5cd2090 0x5620c5cbde80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6878009dd0 tx=0x7f687801c000 comp rx=0 tx=0).stop 2024-06-06T03:30:04.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.737+0000 7f6892ba5b80 1 -- 172.21.15.50:0/733884225 shutdown_connections 2024-06-06T03:30:04.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.737+0000 7f6892ba5b80 1 --2- 172.21.15.50:0/733884225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620c5cd2090 0x5620c5cbde80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.737+0000 7f6892ba5b80 1 --2- 172.21.15.50:0/733884225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620c5ccbfb0 0x5620c5cd5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.737+0000 7f6892ba5b80 1 --2- 172.21.15.50:0/733884225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620c5cd1770 0x5620c5cc2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.737+0000 7f6892ba5b80 1 -- 172.21.15.50:0/733884225 >> 172.21.15.50:0/733884225 conn(0x5620c5bf0080 msgr2=0x5620c5cc2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:04.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.737+0000 7f6892ba5b80 1 -- 172.21.15.50:0/733884225 shutdown_connections 2024-06-06T03:30:04.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.738+0000 7f6892ba5b80 1 -- 172.21.15.50:0/733884225 wait complete. 2024-06-06T03:30:04.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.738+0000 7f6892ba5b80 1 -- start start 2024-06-06T03:30:04.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.738+0000 7f6892ba5b80 1 Processor -- start 2024-06-06T03:30:04.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.739+0000 7f6892ba5b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620c5ccbfb0 0x5620c5cc5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:04.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.739+0000 7f6892ba5b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620c5cd1770 0x5620c5cc5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:04.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.739+0000 7f6892ba5b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620c5cd2090 0x5620c5d45890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:04.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.739+0000 7f6892ba5b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f68801aa260 con 0x5620c5cd2090 2024-06-06T03:30:04.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.739+0000 7f68868bf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620c5cd2090 0x5620c5d45890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:04.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.740+0000 7f6892ba5b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f68801ab6d0 con 0x5620c5cd1770 2024-06-06T03:30:04.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.740+0000 7f6892ba5b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f68801aa930 con 0x5620c5ccbfb0 2024-06-06T03:30:04.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.740+0000 7f68868bf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620c5cd2090 0x5620c5d45890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42170/0 (socket says 172.21.15.50:42170) 2024-06-06T03:30:04.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.740+0000 7f68868bf700 1 -- 172.21.15.50:0/39001092 learned_addr learned my addr 172.21.15.50:0/39001092 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:04.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.740+0000 7f6892ba5b80 10 client.0 _ll_register_callbacks cb 0x5620c5baa5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:30:04.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.740+0000 7f68868bf700 1 -- 172.21.15.50:0/39001092 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620c5ccbfb0 msgr2=0x5620c5cc5710 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:30:04.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.740+0000 7f68868bf700 1 --2- 172.21.15.50:0/39001092 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620c5ccbfb0 0x5620c5cc5710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.740+0000 7f68868bf700 1 -- 172.21.15.50:0/39001092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620c5cd1770 msgr2=0x5620c5cc5c50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:30:04.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.740+0000 7f68868bf700 1 --2- 172.21.15.50:0/39001092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620c5cd1770 0x5620c5cc5c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.740+0000 7f68868bf700 1 -- 172.21.15.50:0/39001092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620c5d45dd0 con 0x5620c5cd2090 2024-06-06T03:30:04.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.741+0000 7f68868bf700 1 --2- 172.21.15.50:0/39001092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620c5cd2090 0x5620c5d45890 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f6878011010 tx=0x7f6878003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e38f100dff4614 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:04.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.741+0000 7f6869ffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:30:04.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.741+0000 7f6869ffb700 1 -- 172.21.15.50:0/39001092 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878032020 con 0x5620c5cd2090 2024-06-06T03:30:04.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.741+0000 7f6869ffb700 1 -- 172.21.15.50:0/39001092 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f6878020040 con 0x5620c5cd2090 2024-06-06T03:30:04.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.742+0000 7f6892ba5b80 1 -- 172.21.15.50:0/39001092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6878004bb0 con 0x5620c5cd2090 2024-06-06T03:30:04.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.742+0000 7f6869ffb700 1 -- 172.21.15.50:0/39001092 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f687803d050 con 0x5620c5cd2090 2024-06-06T03:30:04.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.742+0000 7f6892ba5b80 10 client.16005 fetch_fsmap learned FSMap version 30 2024-06-06T03:30:04.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.742+0000 7f6892ba5b80 1 -- 172.21.15.50:0/39001092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5620c5d46ef0 con 0x5620c5cd2090 2024-06-06T03:30:04.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.743+0000 7f6869ffb700 1 -- 172.21.15.50:0/39001092 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6878004bb0 con 0x5620c5cd2090 2024-06-06T03:30:04.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.743+0000 7f6869ffb700 1 -- 172.21.15.50:0/39001092 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 30) ==== 8350+0+0 (secure 0 0 0) 0x7f6878025070 con 0x5620c5cd2090 2024-06-06T03:30:04.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.743+0000 7f6892ba5b80 10 client.16005 fetch_fsmap finished waiting for FSMap version 30 2024-06-06T03:30:04.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.743+0000 7f6892ba5b80 10 client.16005 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-06-06T03:30:04.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.743+0000 7f6892ba5b80 20 client.16005 populate_metadata read hostname 'smithi050' 2024-06-06T03:30:04.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.743+0000 7f6892ba5b80 1 --2- 172.21.15.50:0/39001092 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x5620c5cdcb40 0x5620c5d49500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:04.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.743+0000 7f6892ba5b80 4 client.16005 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:30:04.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.743+0000 7f6892ba5b80 1 -- 172.21.15.50:0/39001092 --> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5620c5c1c2d0 con 0x5620c5cdcb40 2024-06-06T03:30:04.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.746+0000 7f68860be700 1 --2- 172.21.15.50:0/39001092 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x5620c5cdcb40 0x5620c5d49500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:04.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.747+0000 7f68860be700 1 --2- 172.21.15.50:0/39001092 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x5620c5cdcb40 0x5620c5d49500 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8ba50013ccbe5aeb server_cookie=bb99710e3f37e750 in_seq=0 out_seq=0 2024-06-06T03:30:04.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.747+0000 7f6869ffb700 10 client.16005 ms_handle_connect on v2:172.21.15.122:6836/1604366318 2024-06-06T03:30:04.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.747+0000 7f6869ffb700 1 -- 172.21.15.50:0/39001092 <== mds.1 v2:172.21.15.122:6836/1604366318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5620c5c1c2d0 con 0x5620c5cdcb40 2024-06-06T03:30:04.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.747+0000 7f6869ffb700 10 client.16005 handle_command_reply: tid=0 2024-06-06T03:30:04.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.747+0000 7f6892ba5b80 1 client.16005 shutdown 2024-06-06T03:30:04.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.748+0000 7f6892ba5b80 1 -- 172.21.15.50:0/39001092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620c5cd2090 msgr2=0x5620c5d45890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:04.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.748+0000 7f6892ba5b80 1 --2- 172.21.15.50:0/39001092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620c5cd2090 0x5620c5d45890 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f6878011010 tx=0x7f6878003d60 comp rx=0 tx=0).stop 2024-06-06T03:30:04.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.748+0000 7f6892ba5b80 1 -- 172.21.15.50:0/39001092 shutdown_connections 2024-06-06T03:30:04.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.748+0000 7f6892ba5b80 1 --2- 172.21.15.50:0/39001092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620c5cd2090 0x5620c5d45890 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.748+0000 7f6892ba5b80 1 --2- 172.21.15.50:0/39001092 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x5620c5cdcb40 0x5620c5d49500 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.748+0000 7f6892ba5b80 1 --2- 172.21.15.50:0/39001092 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620c5ccbfb0 0x5620c5cc5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.748+0000 7f6892ba5b80 1 --2- 172.21.15.50:0/39001092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620c5cd1770 0x5620c5cc5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.748+0000 7f6892ba5b80 1 -- 172.21.15.50:0/39001092 >> 172.21.15.50:0/39001092 conn(0x5620c5bf0080 msgr2=0x5620c5cc2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:04.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.749+0000 7f6869ffb700 0 client.16005 ms_handle_reset on v2:172.21.15.122:6836/1604366318 2024-06-06T03:30:04.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.753+0000 7f6892ba5b80 1 -- 172.21.15.50:0/39001092 shutdown_connections 2024-06-06T03:30:04.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.753+0000 7f6892ba5b80 1 -- 172.21.15.50:0/39001092 wait complete. 2024-06-06T03:30:04.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.753+0000 7f6892ba5b80 20 client.16005 trim_cache size 0 max 16384 2024-06-06T03:30:04.757 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:30:04.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.755+0000 7f6888322700 1 -- 172.21.15.50:0/1614708590 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f686c0a2df0 msgr2=0x7f686c0a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:04.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.755+0000 7f6888322700 1 --2- 172.21.15.50:0/1614708590 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f686c0a2df0 0x7f686c0a52b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6878010720 tx=0x7f6878010ae0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.755+0000 7f6888322700 1 -- 172.21.15.50:0/1614708590 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6880102530 msgr2=0x7f688019e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:04.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.755+0000 7f6888322700 1 --2- 172.21.15.50:0/1614708590 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6880102530 0x7f688019e650 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f687c009320 tx=0x7f687c003680 comp rx=0 tx=0).stop 2024-06-06T03:30:04.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.755+0000 7f6888322700 1 -- 172.21.15.50:0/1614708590 shutdown_connections 2024-06-06T03:30:04.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.755+0000 7f6888322700 1 --2- 172.21.15.50:0/1614708590 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f686c0a2df0 0x7f686c0a52b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.755+0000 7f6888322700 1 --2- 172.21.15.50:0/1614708590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68801085d0 0x7f68801987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.755+0000 7f6888322700 1 --2- 172.21.15.50:0/1614708590 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6880102530 0x7f688019e650 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.755+0000 7f6888322700 1 --2- 172.21.15.50:0/1614708590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6880102ef0 0x7f688019eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:04.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.755+0000 7f6888322700 1 -- 172.21.15.50:0/1614708590 >> 172.21.15.50:0/1614708590 conn(0x7f6880079640 msgr2=0x7f6880100d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:04.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.755+0000 7f6888322700 1 -- 172.21.15.50:0/1614708590 shutdown_connections 2024-06-06T03:30:04.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:04.756+0000 7f6888322700 1 -- 172.21.15.50:0/1614708590 wait complete. 2024-06-06T03:30:05.503 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:05 smithi050 ceph-mon[32421]: pgmap v534: 129 pgs: 129 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 47 MiB/s wr, 755 op/s 2024-06-06T03:30:05.563 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-06-06T03:30:05.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:05 smithi079 ceph-mon[35478]: pgmap v534: 129 pgs: 129 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 47 MiB/s wr, 755 op/s 2024-06-06T03:30:05.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:05 smithi122 ceph-mon[35759]: pgmap v534: 129 pgs: 129 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 47 MiB/s wr, 755 op/s 2024-06-06T03:30:06.068 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:30:07.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:07 smithi050 ceph-mon[32421]: pgmap v535: 129 pgs: 129 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 55 MiB/s wr, 887 op/s 2024-06-06T03:30:07.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:07 smithi079 ceph-mon[35478]: pgmap v535: 129 pgs: 129 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 55 MiB/s wr, 887 op/s 2024-06-06T03:30:07.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:07 smithi122 ceph-mon[35759]: pgmap v535: 129 pgs: 129 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 55 MiB/s wr, 887 op/s 2024-06-06T03:30:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.627+0000 7f278c838640 1 -- 172.21.15.50:0/334912377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2788100270 msgr2=0x7f27881026a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.627+0000 7f278c838640 1 --2- 172.21.15.50:0/334912377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2788100270 0x7f27881026a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2778009900 tx=0x7f277802a3f0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.627+0000 7f278c838640 1 -- 172.21.15.50:0/334912377 shutdown_connections 2024-06-06T03:30:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.627+0000 7f278c838640 1 --2- 172.21.15.50:0/334912377 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2788105590 0x7f2788105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.627+0000 7f278c838640 1 --2- 172.21.15.50:0/334912377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2788102be0 0x7f2788105050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.627+0000 7f278c838640 1 --2- 172.21.15.50:0/334912377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2788100270 0x7f27881026a0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.627+0000 7f278c838640 1 -- 172.21.15.50:0/334912377 >> 172.21.15.50:0/334912377 conn(0x7f27880fbe70 msgr2=0x7f27880fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.627+0000 7f278c838640 1 -- 172.21.15.50:0/334912377 shutdown_connections 2024-06-06T03:30:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.627+0000 7f278c838640 1 -- 172.21.15.50:0/334912377 wait complete. 2024-06-06T03:30:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.628+0000 7f278c838640 1 Processor -- start 2024-06-06T03:30:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.628+0000 7f278c838640 1 -- start start 2024-06-06T03:30:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.628+0000 7f278c838640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2788100270 0x7f278819e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.628+0000 7f278c838640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2788102be0 0x7f278819e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.628+0000 7f278c838640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2788105590 0x7f27881a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.628+0000 7f278c838640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2788113b50 con 0x7f2788102be0 2024-06-06T03:30:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.628+0000 7f278c838640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f27881139d0 con 0x7f2788105590 2024-06-06T03:30:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.628+0000 7f278c838640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2788113cd0 con 0x7f2788100270 2024-06-06T03:30:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.628+0000 7f2785d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2788102be0 0x7f278819e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.628+0000 7f2785d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2788102be0 0x7f278819e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48580/0 (socket says 172.21.15.50:48580) 2024-06-06T03:30:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.628+0000 7f2785d9b640 1 -- 172.21.15.50:0/3714591670 learned_addr learned my addr 172.21.15.50:0/3714591670 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.628+0000 7f2786d9d640 1 --2- 172.21.15.50:0/3714591670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2788105590 0x7f27881a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.628+0000 7f278659c640 1 --2- 172.21.15.50:0/3714591670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2788100270 0x7f278819e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.629+0000 7f2785d9b640 1 -- 172.21.15.50:0/3714591670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2788100270 msgr2=0x7f278819e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.629+0000 7f2785d9b640 1 --2- 172.21.15.50:0/3714591670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2788100270 0x7f278819e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.629+0000 7f2785d9b640 1 -- 172.21.15.50:0/3714591670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2788105590 msgr2=0x7f27881a5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.629+0000 7f2785d9b640 1 --2- 172.21.15.50:0/3714591670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2788105590 0x7f27881a5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.629+0000 7f2785d9b640 1 -- 172.21.15.50:0/3714591670 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27881a5d80 con 0x7f2788102be0 2024-06-06T03:30:08.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.629+0000 7f2785d9b640 1 --2- 172.21.15.50:0/3714591670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2788102be0 0x7f278819e6a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f277c00e9f0 tx=0x7f277c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:08.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.629+0000 7f27777fe640 1 -- 172.21.15.50:0/3714591670 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c00cd80 con 0x7f2788102be0 2024-06-06T03:30:08.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.629+0000 7f27777fe640 1 -- 172.21.15.50:0/3714591670 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f277c0108e0 con 0x7f2788102be0 2024-06-06T03:30:08.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.629+0000 7f27777fe640 1 -- 172.21.15.50:0/3714591670 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c018920 con 0x7f2788102be0 2024-06-06T03:30:08.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.629+0000 7f278c838640 1 -- 172.21.15.50:0/3714591670 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27881a6070 con 0x7f2788102be0 2024-06-06T03:30:08.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.629+0000 7f278c838640 1 -- 172.21.15.50:0/3714591670 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27881a6610 con 0x7f2788102be0 2024-06-06T03:30:08.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.631+0000 7f278f629740 1 Processor -- start 2024-06-06T03:30:08.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.632+0000 7f278f629740 1 -- start start 2024-06-06T03:30:08.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.632+0000 7f278f629740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e737829010 0x55e737829430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:08.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.632+0000 7f27777fe640 1 -- 172.21.15.50:0/3714591670 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f277c010a90 con 0x7f2788102be0 2024-06-06T03:30:08.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.632+0000 7f278f629740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e737829a00 0x55e73782e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:08.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.632+0000 7f278f629740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e73782eb70 0x55e737831000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:08.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.632+0000 7f278f629740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e73778c4f0 con 0x55e73782eb70 2024-06-06T03:30:08.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.632+0000 7f278f629740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e73772a870 con 0x55e737829a00 2024-06-06T03:30:08.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.632+0000 7f278f629740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e7377884b0 con 0x55e737829010 2024-06-06T03:30:08.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.632+0000 7f2786d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e737829010 0x55e737829430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:08.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.632+0000 7f2786d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e737829010 0x55e737829430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:47128/0 (socket says 172.21.15.50:47128) 2024-06-06T03:30:08.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.632+0000 7f2786d9d640 1 -- 172.21.15.50:0/2849461339 learned_addr learned my addr 172.21.15.50:0/2849461339 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:08.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.632+0000 7f2785d9b640 1 --2- 172.21.15.50:0/2849461339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e73782eb70 0x55e737831000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:08.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.632+0000 7f278659c640 1 --2- 172.21.15.50:0/2849461339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e737829a00 0x55e73782e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:08.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.632+0000 7f2786d9d640 1 -- 172.21.15.50:0/2849461339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e737829a00 msgr2=0x55e73782e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:08.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.632+0000 7f2786d9d640 1 --2- 172.21.15.50:0/2849461339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e737829a00 0x55e73782e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.632+0000 7f2786d9d640 1 -- 172.21.15.50:0/2849461339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e73782eb70 msgr2=0x55e737831000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:08.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.632+0000 7f2786d9d640 1 --2- 172.21.15.50:0/2849461339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e73782eb70 0x55e737831000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.632+0000 7f2786d9d640 1 -- 172.21.15.50:0/2849461339 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7377469b0 con 0x55e737829010 2024-06-06T03:30:08.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.632+0000 7f2785d9b640 1 --2- 172.21.15.50:0/2849461339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e73782eb70 0x55e737831000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:30:08.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.633+0000 7f2786d9d640 1 --2- 172.21.15.50:0/2849461339 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e737829010 0x55e737829430 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2780009fd0 tx=0x7f27800118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd184e1d19027c2f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:08.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.633+0000 7f2774ff9640 1 -- 172.21.15.50:0/2849461339 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2780004d20 con 0x55e737829010 2024-06-06T03:30:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.633+0000 7f2774ff9640 1 -- 172.21.15.50:0/2849461339 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2780004050 con 0x55e737829010 2024-06-06T03:30:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.633+0000 7f2774ff9640 1 -- 172.21.15.50:0/2849461339 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2780005280 con 0x55e737829010 2024-06-06T03:30:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.633+0000 7f27777fe640 1 --2- 172.21.15.50:0/3714591670 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f27700a2cb0 0x7f27700a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.633+0000 7f27777fe640 1 -- 172.21.15.50:0/3714591670 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f277c0cf690 con 0x7f2788102be0 2024-06-06T03:30:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.633+0000 7f278659c640 1 --2- 172.21.15.50:0/3714591670 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f27700a2cb0 0x7f27700a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.634+0000 7f278f629740 1 -- 172.21.15.50:0/2849461339 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e737829010 msgr2=0x55e737829430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.634+0000 7f278659c640 1 --2- 172.21.15.50:0/3714591670 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f27700a2cb0 0x7f27700a5170 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2778006010 tx=0x7f2778000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.634+0000 7f278f629740 1 --2- 172.21.15.50:0/2849461339 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e737829010 0x55e737829430 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2780009fd0 tx=0x7f27800118d0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.634+0000 7f278f629740 1 -- 172.21.15.50:0/2849461339 shutdown_connections 2024-06-06T03:30:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.634+0000 7f278f629740 1 --2- 172.21.15.50:0/2849461339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e73782eb70 0x55e737831000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.634+0000 7f278f629740 1 --2- 172.21.15.50:0/2849461339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e737829a00 0x55e73782e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.634+0000 7f278f629740 1 --2- 172.21.15.50:0/2849461339 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e737829010 0x55e737829430 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.634+0000 7f278f629740 1 -- 172.21.15.50:0/2849461339 >> 172.21.15.50:0/2849461339 conn(0x55e737824680 msgr2=0x55e737824a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.634+0000 7f278f629740 1 -- 172.21.15.50:0/2849461339 shutdown_connections 2024-06-06T03:30:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.634+0000 7f278f629740 1 -- 172.21.15.50:0/2849461339 wait complete. 2024-06-06T03:30:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.634+0000 7f278f629740 1 -- start start 2024-06-06T03:30:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.634+0000 7f278f629740 1 Processor -- start 2024-06-06T03:30:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.634+0000 7f278f629740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e737829010 0x55e7378332f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.635+0000 7f278f629740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e737829a00 0x55e737833830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.635+0000 7f278f629740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e73782eb70 0x55e73783a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.635+0000 7f278f629740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e737831b20 con 0x55e73782eb70 2024-06-06T03:30:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.635+0000 7f278f629740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e737715ae0 con 0x55e737829a00 2024-06-06T03:30:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.635+0000 7f278f629740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e737831ca0 con 0x55e737829010 2024-06-06T03:30:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.635+0000 7f278f629740 10 client.0 _ll_register_callbacks cb 0x55e73774e9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:30:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.635+0000 7f278659c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e737829010 0x55e7378332f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.635+0000 7f278659c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e737829010 0x55e7378332f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:47140/0 (socket says 172.21.15.50:47140) 2024-06-06T03:30:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.635+0000 7f278659c640 1 -- 172.21.15.50:0/246884410 learned_addr learned my addr 172.21.15.50:0/246884410 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.635+0000 7f2786d9d640 1 --2- 172.21.15.50:0/246884410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e73782eb70 0x55e73783a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.635+0000 7f2785d9b640 1 --2- 172.21.15.50:0/246884410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e737829a00 0x55e737833830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.635+0000 7f278659c640 1 -- 172.21.15.50:0/246884410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e737829a00 msgr2=0x55e737833830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.635+0000 7f278659c640 1 --2- 172.21.15.50:0/246884410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e737829a00 0x55e737833830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.635+0000 7f278659c640 1 -- 172.21.15.50:0/246884410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e73782eb70 msgr2=0x55e73783a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.635+0000 7f278659c640 1 --2- 172.21.15.50:0/246884410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e73782eb70 0x55e73783a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.635+0000 7f278659c640 1 -- 172.21.15.50:0/246884410 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7374a0210 con 0x55e737829010 2024-06-06T03:30:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.635+0000 7f278659c640 1 --2- 172.21.15.50:0/246884410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e737829010 0x55e7378332f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2778009900 tx=0x7f2778009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9216a24dcfd0ce8 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.635+0000 7f276dffb640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:30:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.635+0000 7f276dffb640 1 -- 172.21.15.50:0/246884410 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2778035070 con 0x55e737829010 2024-06-06T03:30:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.635+0000 7f278f629740 1 -- 172.21.15.50:0/246884410 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2780004050 con 0x55e737829010 2024-06-06T03:30:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.635+0000 7f276dffb640 1 -- 172.21.15.50:0/246884410 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f27780035f0 con 0x55e737829010 2024-06-06T03:30:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.636+0000 7f276dffb640 1 -- 172.21.15.50:0/246884410 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f27780037f0 con 0x55e737829010 2024-06-06T03:30:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.636+0000 7f278f629740 10 client.25591 fetch_fsmap learned FSMap version 30 2024-06-06T03:30:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.636+0000 7f278f629740 1 -- 172.21.15.50:0/246884410 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e73756c620 con 0x55e737829010 2024-06-06T03:30:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.636+0000 7f276dffb640 1 -- 172.21.15.50:0/246884410 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2780004050 con 0x55e737829010 2024-06-06T03:30:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.636+0000 7f276dffb640 1 -- 172.21.15.50:0/246884410 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 30) ==== 8350+0+0 (secure 0 0 0) 0x7f2778043070 con 0x55e737829010 2024-06-06T03:30:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.636+0000 7f278f629740 10 client.25591 fetch_fsmap finished waiting for FSMap version 30 2024-06-06T03:30:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.636+0000 7f278f629740 10 client.25591 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:30:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.636+0000 7f278f629740 20 client.25591 populate_metadata read hostname 'smithi050' 2024-06-06T03:30:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.636+0000 7f278f629740 1 --2- 172.21.15.50:0/246884410 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55e73783f150 0x55e737841560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.636+0000 7f278f629740 4 client.25591 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:30:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.636+0000 7f278f629740 1 -- 172.21.15.50:0/246884410 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e73779ff10 con 0x55e73783f150 2024-06-06T03:30:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.636+0000 7f2785d9b640 1 --2- 172.21.15.50:0/246884410 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55e73783f150 0x55e737841560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:08.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.636+0000 7f276dffb640 10 client.25591 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:30:08.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.636+0000 7f2785d9b640 1 --2- 172.21.15.50:0/246884410 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55e73783f150 0x55e737841560 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f19f0109b581f339 server_cookie=5acc0a39a8380680 in_seq=0 out_seq=0 2024-06-06T03:30:08.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.637+0000 7f276dffb640 1 -- 172.21.15.50:0/246884410 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55e73779ff10 con 0x55e73783f150 2024-06-06T03:30:08.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.637+0000 7f276dffb640 10 client.25591 handle_command_reply: tid=0 2024-06-06T03:30:08.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.637+0000 7f278f629740 1 client.25591 shutdown 2024-06-06T03:30:08.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.637+0000 7f278f629740 1 -- 172.21.15.50:0/246884410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e737829010 msgr2=0x55e7378332f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:08.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.637+0000 7f278f629740 1 --2- 172.21.15.50:0/246884410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e737829010 0x55e7378332f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2778009900 tx=0x7f2778009260 comp rx=0 tx=0).stop 2024-06-06T03:30:08.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.637+0000 7f278f629740 1 -- 172.21.15.50:0/246884410 shutdown_connections 2024-06-06T03:30:08.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.637+0000 7f278f629740 1 --2- 172.21.15.50:0/246884410 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55e73783f150 0x55e737841560 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.637+0000 7f278f629740 1 --2- 172.21.15.50:0/246884410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e73782eb70 0x55e73783a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.637+0000 7f276dffb640 0 client.25591 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:30:08.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.637+0000 7f278f629740 1 --2- 172.21.15.50:0/246884410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e737829a00 0x55e737833830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.637+0000 7f278f629740 1 --2- 172.21.15.50:0/246884410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e737829010 0x55e7378332f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.646 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.637+0000 7f278f629740 1 -- 172.21.15.50:0/246884410 >> 172.21.15.50:0/246884410 conn(0x55e737824680 msgr2=0x55e7378237e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:08.646 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.638+0000 7f278f629740 1 -- 172.21.15.50:0/246884410 shutdown_connections 2024-06-06T03:30:08.646 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.638+0000 7f278f629740 1 -- 172.21.15.50:0/246884410 wait complete. 2024-06-06T03:30:08.646 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.638+0000 7f278f629740 20 client.25591 trim_cache size 0 max 16384 2024-06-06T03:30:08.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.653+0000 7f278f629740 1 Processor -- start 2024-06-06T03:30:08.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.653+0000 7f278f629740 1 -- start start 2024-06-06T03:30:08.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.653+0000 7f278f629740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e737829010 0x55e737832040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:08.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.653+0000 7f278f629740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e737829a00 0x55e73783a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:08.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.653+0000 7f278f629740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e73782eb70 0x55e737833790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:08.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.653+0000 7f278f629740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f27881b3370 con 0x55e73782eb70 2024-06-06T03:30:08.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.653+0000 7f278f629740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f27881b0c40 con 0x55e737829010 2024-06-06T03:30:08.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.653+0000 7f278f629740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f27881aea90 con 0x55e737829a00 2024-06-06T03:30:08.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.653+0000 7f2786d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e73782eb70 0x55e737833790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:08.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.653+0000 7f2786d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e73782eb70 0x55e737833790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48600/0 (socket says 172.21.15.50:48600) 2024-06-06T03:30:08.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.653+0000 7f2786d9d640 1 -- 172.21.15.50:0/826682588 learned_addr learned my addr 172.21.15.50:0/826682588 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:08.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.653+0000 7f278659c640 1 --2- 172.21.15.50:0/826682588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e737829010 0x55e737832040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:08.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.653+0000 7f2785d9b640 1 --2- 172.21.15.50:0/826682588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e737829a00 0x55e73783a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:08.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.653+0000 7f2786d9d640 1 -- 172.21.15.50:0/826682588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e737829a00 msgr2=0x55e73783a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:08.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.653+0000 7f2786d9d640 1 --2- 172.21.15.50:0/826682588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e737829a00 0x55e73783a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.653+0000 7f2786d9d640 1 -- 172.21.15.50:0/826682588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e737829010 msgr2=0x55e737832040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:08.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.653+0000 7f2786d9d640 1 --2- 172.21.15.50:0/826682588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e737829010 0x55e737832040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.653+0000 7f2786d9d640 1 -- 172.21.15.50:0/826682588 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e73782a290 con 0x55e73782eb70 2024-06-06T03:30:08.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.653+0000 7f278659c640 1 --2- 172.21.15.50:0/826682588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e737829010 0x55e737832040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:30:08.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.654+0000 7f2786d9d640 1 --2- 172.21.15.50:0/826682588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e73782eb70 0x55e737833790 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x55e73782a260 tx=0x7f2780005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef4afb528a7198f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:08.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.654+0000 7f276ffff640 1 -- 172.21.15.50:0/826682588 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2780003ab0 con 0x55e73782eb70 2024-06-06T03:30:08.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.654+0000 7f276ffff640 1 -- 172.21.15.50:0/826682588 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2780003c50 con 0x55e73782eb70 2024-06-06T03:30:08.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.654+0000 7f276ffff640 1 -- 172.21.15.50:0/826682588 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2780005030 con 0x55e73782eb70 2024-06-06T03:30:08.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.654+0000 7f278f629740 1 -- 172.21.15.50:0/826682588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e73782eb70 msgr2=0x55e737833790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:08.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.654+0000 7f278f629740 1 --2- 172.21.15.50:0/826682588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e73782eb70 0x55e737833790 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x55e73782a260 tx=0x7f2780005bf0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.654+0000 7f278f629740 1 -- 172.21.15.50:0/826682588 shutdown_connections 2024-06-06T03:30:08.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.654+0000 7f278f629740 1 --2- 172.21.15.50:0/826682588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e73782eb70 0x55e737833790 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.654+0000 7f278f629740 1 --2- 172.21.15.50:0/826682588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e737829a00 0x55e73783a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.654+0000 7f278f629740 1 --2- 172.21.15.50:0/826682588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e737829010 0x55e737832040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.654+0000 7f278f629740 1 -- 172.21.15.50:0/826682588 >> 172.21.15.50:0/826682588 conn(0x55e737824680 msgr2=0x55e73782e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:08.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.654+0000 7f278f629740 1 -- 172.21.15.50:0/826682588 shutdown_connections 2024-06-06T03:30:08.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.655+0000 7f278f629740 1 -- 172.21.15.50:0/826682588 wait complete. 2024-06-06T03:30:08.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.655+0000 7f278f629740 1 -- start start 2024-06-06T03:30:08.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.655+0000 7f278f629740 1 Processor -- start 2024-06-06T03:30:08.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.655+0000 7f278f629740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e737829010 0x55e737837840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:08.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.655+0000 7f278f629740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e737829a00 0x55e737837d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:08.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.655+0000 7f278f629740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e73782eb70 0x55e737838d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:08.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.655+0000 7f278f629740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f27881af100 con 0x55e73782eb70 2024-06-06T03:30:08.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.655+0000 7f278f629740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f27881b0570 con 0x55e737829010 2024-06-06T03:30:08.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.655+0000 7f278f629740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f27881af7d0 con 0x55e737829a00 2024-06-06T03:30:08.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.655+0000 7f278f629740 10 client.0 _ll_register_callbacks cb 0x7f27800093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:30:08.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.655+0000 7f2786d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e73782eb70 0x55e737838d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:08.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.655+0000 7f2785d9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e737829a00 0x55e737837d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:08.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.655+0000 7f2785d9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e737829a00 0x55e737837d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:47166/0 (socket says 172.21.15.50:47166) 2024-06-06T03:30:08.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.655+0000 7f2786d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e73782eb70 0x55e737838d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48606/0 (socket says 172.21.15.50:48606) 2024-06-06T03:30:08.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.655+0000 7f2785d9b640 1 -- 172.21.15.50:0/936076799 learned_addr learned my addr 172.21.15.50:0/936076799 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:08.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.655+0000 7f278659c640 1 --2- 172.21.15.50:0/936076799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e737829010 0x55e737837840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.655+0000 7f2785d9b640 1 -- 172.21.15.50:0/936076799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e737829010 msgr2=0x55e737837840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.655+0000 7f2785d9b640 1 --2- 172.21.15.50:0/936076799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e737829010 0x55e737837840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.655+0000 7f2785d9b640 1 -- 172.21.15.50:0/936076799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e73782eb70 msgr2=0x55e737838d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.655+0000 7f2785d9b640 1 --2- 172.21.15.50:0/936076799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e73782eb70 0x55e737838d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.655+0000 7f2785d9b640 1 -- 172.21.15.50:0/936076799 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e737839330 con 0x55e737829a00 2024-06-06T03:30:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.655+0000 7f2786d9d640 1 --2- 172.21.15.50:0/936076799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e73782eb70 0x55e737838d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:30:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.656+0000 7f2785d9b640 1 --2- 172.21.15.50:0/936076799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e737829a00 0x55e737837d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f277c098590 tx=0x7f277c005f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1fd0ea8f1aa8235 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.656+0000 7f276dffb640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:30:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.656+0000 7f276dffb640 1 -- 172.21.15.50:0/936076799 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c0a4780 con 0x55e737829a00 2024-06-06T03:30:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.656+0000 7f276dffb640 1 -- 172.21.15.50:0/936076799 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f277c0cf350 con 0x55e737829a00 2024-06-06T03:30:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.656+0000 7f278f629740 1 -- 172.21.15.50:0/936076799 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2780003c50 con 0x55e737829a00 2024-06-06T03:30:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.656+0000 7f276dffb640 1 -- 172.21.15.50:0/936076799 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f277c098230 con 0x55e737829a00 2024-06-06T03:30:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.656+0000 7f278f629740 10 client.25597 fetch_fsmap learned FSMap version 30 2024-06-06T03:30:08.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.656+0000 7f278f629740 1 -- 172.21.15.50:0/936076799 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e73783a6b0 con 0x55e737829a00 2024-06-06T03:30:08.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.656+0000 7f276dffb640 1 -- 172.21.15.50:0/936076799 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2780003c50 con 0x55e737829a00 2024-06-06T03:30:08.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.656+0000 7f276dffb640 1 -- 172.21.15.50:0/936076799 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 30) ==== 8350+0+0 (secure 0 0 0) 0x7f277c0ba2a0 con 0x55e737829a00 2024-06-06T03:30:08.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.656+0000 7f278f629740 10 client.25597 fetch_fsmap finished waiting for FSMap version 30 2024-06-06T03:30:08.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.656+0000 7f278f629740 10 client.25597 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:30:08.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.656+0000 7f278f629740 20 client.25597 populate_metadata read hostname 'smithi050' 2024-06-06T03:30:08.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.656+0000 7f278f629740 1 --2- 172.21.15.50:0/936076799 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55e7378aa220 0x55e7378ac640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:08.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.656+0000 7f278f629740 4 client.25597 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:30:08.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.656+0000 7f278f629740 1 -- 172.21.15.50:0/936076799 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e737799c20 con 0x55e7378aa220 2024-06-06T03:30:08.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.656+0000 7f278659c640 1 --2- 172.21.15.50:0/936076799 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55e7378aa220 0x55e7378ac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:08.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.657+0000 7f278659c640 1 --2- 172.21.15.50:0/936076799 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55e7378aa220 0x55e7378ac640 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffc11824bd2fc22c server_cookie=63544ed95ab983db in_seq=0 out_seq=0 2024-06-06T03:30:08.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.657+0000 7f276dffb640 10 client.25597 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:30:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.669+0000 7f276dffb640 1 -- 172.21.15.50:0/936076799 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55e737799c20 con 0x55e7378aa220 2024-06-06T03:30:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.669+0000 7f276dffb640 10 client.25597 handle_command_reply: tid=0 2024-06-06T03:30:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.669+0000 7f278f629740 1 client.25597 shutdown 2024-06-06T03:30:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.670+0000 7f278f629740 1 -- 172.21.15.50:0/936076799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e737829a00 msgr2=0x55e737837d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.670+0000 7f278f629740 1 --2- 172.21.15.50:0/936076799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e737829a00 0x55e737837d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f277c098590 tx=0x7f277c005f10 comp rx=0 tx=0).stop 2024-06-06T03:30:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.671+0000 7f278f629740 1 -- 172.21.15.50:0/936076799 shutdown_connections 2024-06-06T03:30:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.671+0000 7f278f629740 1 --2- 172.21.15.50:0/936076799 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55e7378aa220 0x55e7378ac640 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.671+0000 7f278f629740 1 --2- 172.21.15.50:0/936076799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e73782eb70 0x55e737838d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.671+0000 7f278f629740 1 --2- 172.21.15.50:0/936076799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e737829a00 0x55e737837d80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.671+0000 7f278f629740 1 --2- 172.21.15.50:0/936076799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e737829010 0x55e737837840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.671+0000 7f278f629740 1 -- 172.21.15.50:0/936076799 >> 172.21.15.50:0/936076799 conn(0x55e737824680 msgr2=0x55e737832f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.671+0000 7f276dffb640 0 client.25597 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:30:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.671+0000 7f278f629740 1 -- 172.21.15.50:0/936076799 shutdown_connections 2024-06-06T03:30:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.671+0000 7f278f629740 1 -- 172.21.15.50:0/936076799 wait complete. 2024-06-06T03:30:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.672+0000 7f278f629740 20 client.25597 trim_cache size 0 max 16384 2024-06-06T03:30:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:30:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:30:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:30:08.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.673+0000 7f278c838640 1 -- 172.21.15.50:0/3714591670 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f27700a2cb0 msgr2=0x7f27700a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.673+0000 7f278c838640 1 --2- 172.21.15.50:0/3714591670 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f27700a2cb0 0x7f27700a5170 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2778006010 tx=0x7f2778000bc0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.673+0000 7f278c838640 1 -- 172.21.15.50:0/3714591670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2788102be0 msgr2=0x7f278819e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.673+0000 7f278c838640 1 --2- 172.21.15.50:0/3714591670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2788102be0 0x7f278819e6a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f277c00e9f0 tx=0x7f277c00eeb0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.673+0000 7f278c838640 1 -- 172.21.15.50:0/3714591670 shutdown_connections 2024-06-06T03:30:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.673+0000 7f278c838640 1 --2- 172.21.15.50:0/3714591670 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f27700a2cb0 0x7f27700a5170 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.673+0000 7f278c838640 1 --2- 172.21.15.50:0/3714591670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2788102be0 0x7f278819e6a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.674+0000 7f278c838640 1 --2- 172.21.15.50:0/3714591670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2788105590 0x7f27881a5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.674+0000 7f278c838640 1 --2- 172.21.15.50:0/3714591670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2788100270 0x7f278819e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.674+0000 7f278c838640 1 -- 172.21.15.50:0/3714591670 >> 172.21.15.50:0/3714591670 conn(0x7f27880fbe70 msgr2=0x7f2788103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.674+0000 7f278c838640 1 -- 172.21.15.50:0/3714591670 shutdown_connections 2024-06-06T03:30:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:08.674+0000 7f278c838640 1 -- 172.21.15.50:0/3714591670 wait complete. 2024-06-06T03:30:09.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:09 smithi050 ceph-mon[32421]: pgmap v536: 129 pgs: 129 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 47 MiB/s wr, 757 op/s 2024-06-06T03:30:09.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:09 smithi079 ceph-mon[35478]: pgmap v536: 129 pgs: 129 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 47 MiB/s wr, 757 op/s 2024-06-06T03:30:09.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:09 smithi122 ceph-mon[35759]: pgmap v536: 129 pgs: 129 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 47 MiB/s wr, 757 op/s 2024-06-06T03:30:11.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:11 smithi050 ceph-mon[32421]: pgmap v537: 129 pgs: 129 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 55 MiB/s wr, 893 op/s 2024-06-06T03:30:11.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:11 smithi079 ceph-mon[35478]: pgmap v537: 129 pgs: 129 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 55 MiB/s wr, 893 op/s 2024-06-06T03:30:11.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:11 smithi122 ceph-mon[35759]: pgmap v537: 129 pgs: 129 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 55 MiB/s wr, 893 op/s 2024-06-06T03:30:13.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:13 smithi050 ceph-mon[32421]: pgmap v538: 129 pgs: 129 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 44 MiB/s wr, 717 op/s 2024-06-06T03:30:13.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:13 smithi050 ceph-mon[32421]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:30:13.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:13 smithi079 ceph-mon[35478]: pgmap v538: 129 pgs: 129 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 44 MiB/s wr, 717 op/s 2024-06-06T03:30:13.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:13 smithi079 ceph-mon[35478]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:30:13.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:13 smithi122 ceph-mon[35759]: pgmap v538: 129 pgs: 129 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 44 MiB/s wr, 717 op/s 2024-06-06T03:30:13.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:13 smithi122 ceph-mon[35759]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:30:15.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:15 smithi050 ceph-mon[32421]: pgmap v539: 129 pgs: 129 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 47 MiB/s wr, 757 op/s 2024-06-06T03:30:15.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:15 smithi079 ceph-mon[35478]: pgmap v539: 129 pgs: 129 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 47 MiB/s wr, 757 op/s 2024-06-06T03:30:15.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:15 smithi122 ceph-mon[35759]: pgmap v539: 129 pgs: 129 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 47 MiB/s wr, 757 op/s 2024-06-06T03:30:17.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:17 smithi050 ceph-mon[32421]: pgmap v540: 129 pgs: 129 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 49 MiB/s wr, 800 op/s 2024-06-06T03:30:17.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:17 smithi079 ceph-mon[35478]: pgmap v540: 129 pgs: 129 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 49 MiB/s wr, 800 op/s 2024-06-06T03:30:17.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:17 smithi122 ceph-mon[35759]: pgmap v540: 129 pgs: 129 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 49 MiB/s wr, 800 op/s 2024-06-06T03:30:18.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.622+0000 7feca5c0c700 1 -- 172.21.15.50:0/2303248619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca010cfb0 msgr2=0x7feca01099d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:18.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.622+0000 7feca5c0c700 1 --2- 172.21.15.50:0/2303248619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca010cfb0 0x7feca01099d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fec98009990 tx=0x7fec98009ca0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.623+0000 7feca5c0c700 1 -- 172.21.15.50:0/2303248619 shutdown_connections 2024-06-06T03:30:18.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.623+0000 7feca5c0c700 1 --2- 172.21.15.50:0/2303248619 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feca010f440 0x7feca010f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.623+0000 7feca5c0c700 1 --2- 172.21.15.50:0/2303248619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feca010cb40 0x7feca0109490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.623+0000 7feca5c0c700 1 --2- 172.21.15.50:0/2303248619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca010cfb0 0x7feca01099d0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.623+0000 7feca5c0c700 1 -- 172.21.15.50:0/2303248619 >> 172.21.15.50:0/2303248619 conn(0x7feca006d470 msgr2=0x7feca006d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:18.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.624+0000 7feca5c0c700 1 -- 172.21.15.50:0/2303248619 shutdown_connections 2024-06-06T03:30:18.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.624+0000 7feca5c0c700 1 -- 172.21.15.50:0/2303248619 wait complete. 2024-06-06T03:30:18.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.625+0000 7feca5c0c700 1 Processor -- start 2024-06-06T03:30:18.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.625+0000 7feca5c0c700 1 -- start start 2024-06-06T03:30:18.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.625+0000 7feca5c0c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feca010cb40 0x7feca019f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:18.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.626+0000 7feca5c0c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feca010cfb0 0x7feca019f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:18.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.626+0000 7feca5c0c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca010f440 0x7feca01a3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:18.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.626+0000 7feca5c0c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7feca0116c80 con 0x7feca010f440 2024-06-06T03:30:18.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.626+0000 7feca5c0c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7feca0116b00 con 0x7feca010cfb0 2024-06-06T03:30:18.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.626+0000 7feca5c0c700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7feca0116e00 con 0x7feca010cb40 2024-06-06T03:30:18.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.626+0000 7feca4c0a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feca010cb40 0x7feca019f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:18.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.626+0000 7fec9ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feca010cfb0 0x7feca019f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:18.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.626+0000 7fec9ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feca010cfb0 0x7feca019f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:49282/0 (socket says 172.21.15.50:49282) 2024-06-06T03:30:18.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.626+0000 7fec9ffff700 1 -- 172.21.15.50:0/3410084565 learned_addr learned my addr 172.21.15.50:0/3410084565 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:18.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.627+0000 7feca4c0a700 1 -- 172.21.15.50:0/3410084565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feca010cfb0 msgr2=0x7feca019f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:18.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.627+0000 7feca4c0a700 1 --2- 172.21.15.50:0/3410084565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feca010cfb0 0x7feca019f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.627+0000 7feca4c0a700 1 -- 172.21.15.50:0/3410084565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca010f440 msgr2=0x7feca01a3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:18.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.627+0000 7feca4c0a700 1 --2- 172.21.15.50:0/3410084565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca010f440 0x7feca01a3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.627+0000 7feca4c0a700 1 -- 172.21.15.50:0/3410084565 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feca01a40a0 con 0x7feca010cb40 2024-06-06T03:30:18.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.627+0000 7feca4c0a700 1 --2- 172.21.15.50:0/3410084565 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feca010cb40 0x7feca019f090 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fec90018f20 tx=0x7fec9001e3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:18.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.628+0000 7fec9dffb700 1 -- 172.21.15.50:0/3410084565 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec90004db0 con 0x7feca010cb40 2024-06-06T03:30:18.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.629+0000 7feca5c0c700 1 -- 172.21.15.50:0/3410084565 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feca01a4390 con 0x7feca010cb40 2024-06-06T03:30:18.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.629+0000 7feca5c0c700 1 -- 172.21.15.50:0/3410084565 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feca01abc10 con 0x7feca010cb40 2024-06-06T03:30:18.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.629+0000 7fec9dffb700 1 -- 172.21.15.50:0/3410084565 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fec90005020 con 0x7feca010cb40 2024-06-06T03:30:18.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.629+0000 7fec9dffb700 1 -- 172.21.15.50:0/3410084565 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec90026660 con 0x7feca010cb40 2024-06-06T03:30:18.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.634+0000 7fec9dffb700 1 -- 172.21.15.50:0/3410084565 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fec9001eac0 con 0x7feca010cb40 2024-06-06T03:30:18.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.635+0000 7fec9dffb700 1 --2- 172.21.15.50:0/3410084565 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fec8c0a2e20 0x7fec8c0a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:18.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.635+0000 7fec9dffb700 1 -- 172.21.15.50:0/3410084565 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fec900dfce0 con 0x7feca010cb40 2024-06-06T03:30:18.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.636+0000 7fec9ffff700 1 --2- 172.21.15.50:0/3410084565 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fec8c0a2e20 0x7fec8c0a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:18.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.638+0000 7fec9ffff700 1 --2- 172.21.15.50:0/3410084565 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fec8c0a2e20 0x7fec8c0a52e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7feca006ddb0 tx=0x7fec9800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:18.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.646+0000 7fecb16f1b80 1 Processor -- start 2024-06-06T03:30:18.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.647+0000 7fecb16f1b80 1 -- start start 2024-06-06T03:30:18.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.647+0000 7fecb16f1b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bdd2568f0 0x562bdd256cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:18.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.647+0000 7fecb16f1b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bdd257210 0x562bdd250b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:18.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.647+0000 7fecb16f1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bdd251080 0x562bdd2514c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:18.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.647+0000 7fecb16f1b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562bdd1a2810 con 0x562bdd2568f0 2024-06-06T03:30:18.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.647+0000 7fecb16f1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562bdd14a720 con 0x562bdd251080 2024-06-06T03:30:18.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.647+0000 7fecb16f1b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562bdd19e7d0 con 0x562bdd257210 2024-06-06T03:30:18.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.648+0000 7fec9ffff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bdd257210 0x562bdd250b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:18.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.648+0000 7fec9ffff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bdd257210 0x562bdd250b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:58240/0 (socket says 172.21.15.50:58240) 2024-06-06T03:30:18.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.648+0000 7fec9ffff700 1 -- 172.21.15.50:0/2919029484 learned_addr learned my addr 172.21.15.50:0/2919029484 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:18.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.648+0000 7fec9ffff700 1 -- 172.21.15.50:0/2919029484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bdd251080 msgr2=0x562bdd2514c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:30:18.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.648+0000 7fec9ffff700 1 --2- 172.21.15.50:0/2919029484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bdd251080 0x562bdd2514c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.648+0000 7fec9ffff700 1 -- 172.21.15.50:0/2919029484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bdd2568f0 msgr2=0x562bdd256cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:30:18.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.648+0000 7fec9ffff700 1 --2- 172.21.15.50:0/2919029484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bdd2568f0 0x562bdd256cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.648+0000 7fec9ffff700 1 -- 172.21.15.50:0/2919029484 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bdd140f50 con 0x562bdd257210 2024-06-06T03:30:18.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.650+0000 7fec9ffff700 1 --2- 172.21.15.50:0/2919029484 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bdd257210 0x562bdd250b40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fec9800ba90 tx=0x7fec98020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a617a6cd9d341776 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:18.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.652+0000 7fec96ffd700 1 -- 172.21.15.50:0/2919029484 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec98033070 con 0x562bdd257210 2024-06-06T03:30:18.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.652+0000 7fec96ffd700 1 -- 172.21.15.50:0/2919029484 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fec980095d0 con 0x562bdd257210 2024-06-06T03:30:18.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.652+0000 7fec96ffd700 1 -- 172.21.15.50:0/2919029484 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9802eba0 con 0x562bdd257210 2024-06-06T03:30:18.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.653+0000 7fecb16f1b80 1 -- 172.21.15.50:0/2919029484 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bdd257210 msgr2=0x562bdd250b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:18.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.653+0000 7fecb16f1b80 1 --2- 172.21.15.50:0/2919029484 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bdd257210 0x562bdd250b40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fec9800ba90 tx=0x7fec98020000 comp rx=0 tx=0).stop 2024-06-06T03:30:18.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.655+0000 7fecb16f1b80 1 -- 172.21.15.50:0/2919029484 shutdown_connections 2024-06-06T03:30:18.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.655+0000 7fecb16f1b80 1 --2- 172.21.15.50:0/2919029484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bdd251080 0x562bdd2514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.655+0000 7fecb16f1b80 1 --2- 172.21.15.50:0/2919029484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bdd2568f0 0x562bdd256cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.655+0000 7fecb16f1b80 1 --2- 172.21.15.50:0/2919029484 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bdd257210 0x562bdd250b40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.655+0000 7fecb16f1b80 1 -- 172.21.15.50:0/2919029484 >> 172.21.15.50:0/2919029484 conn(0x562bdd17bcc0 msgr2=0x562bdd24baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:18.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.656+0000 7fecb16f1b80 1 -- 172.21.15.50:0/2919029484 shutdown_connections 2024-06-06T03:30:18.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.656+0000 7fecb16f1b80 1 -- 172.21.15.50:0/2919029484 wait complete. 2024-06-06T03:30:18.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.656+0000 7fecb16f1b80 1 -- start start 2024-06-06T03:30:18.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.656+0000 7fecb16f1b80 1 Processor -- start 2024-06-06T03:30:18.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.657+0000 7fecb16f1b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bdd251080 0x562bdd25cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:18.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.657+0000 7fecb16f1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bdd2568f0 0x562bdd25a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:18.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.657+0000 7fecb16f1b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bdd257210 0x562bdd25a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:18.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.657+0000 7fecb16f1b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562bdd25db70 con 0x562bdd251080 2024-06-06T03:30:18.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.657+0000 7fecb16f1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562bdd142bf0 con 0x562bdd2568f0 2024-06-06T03:30:18.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.657+0000 7fecb16f1b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562bdd25dcf0 con 0x562bdd257210 2024-06-06T03:30:18.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.657+0000 7fecb16f1b80 10 client.0 _ll_register_callbacks cb 0x562bdd13c920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:30:18.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.657+0000 7feca540b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bdd257210 0x562bdd25a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:18.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.657+0000 7feca540b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bdd257210 0x562bdd25a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:58244/0 (socket says 172.21.15.50:58244) 2024-06-06T03:30:18.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.657+0000 7feca540b700 1 -- 172.21.15.50:0/3050590201 learned_addr learned my addr 172.21.15.50:0/3050590201 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:18.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.658+0000 7feca4c0a700 1 --2- 172.21.15.50:0/3050590201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bdd251080 0x562bdd25cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:18.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.658+0000 7feca540b700 1 -- 172.21.15.50:0/3050590201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bdd2568f0 msgr2=0x562bdd25a280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:30:18.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.658+0000 7feca540b700 1 --2- 172.21.15.50:0/3050590201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bdd2568f0 0x562bdd25a280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.658+0000 7feca540b700 1 -- 172.21.15.50:0/3050590201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bdd251080 msgr2=0x562bdd25cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:18.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.658+0000 7feca540b700 1 --2- 172.21.15.50:0/3050590201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bdd251080 0x562bdd25cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.658+0000 7feca540b700 1 -- 172.21.15.50:0/3050590201 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bdd0f18d0 con 0x562bdd257210 2024-06-06T03:30:18.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.659+0000 7feca540b700 1 --2- 172.21.15.50:0/3050590201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bdd257210 0x562bdd25a7c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fec8800bb20 tx=0x7fec8800bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b5bdeb84b8b329 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:18.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.659+0000 7fec7ffff700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:30:18.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.659+0000 7fec7ffff700 1 -- 172.21.15.50:0/3050590201 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec88016070 con 0x562bdd257210 2024-06-06T03:30:18.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.659+0000 7fec7ffff700 1 -- 172.21.15.50:0/3050590201 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fec8800dd00 con 0x562bdd257210 2024-06-06T03:30:18.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.659+0000 7fecb16f1b80 1 -- 172.21.15.50:0/3050590201 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec980095d0 con 0x562bdd257210 2024-06-06T03:30:18.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.660+0000 7fec7ffff700 1 -- 172.21.15.50:0/3050590201 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fec88022050 con 0x562bdd257210 2024-06-06T03:30:18.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.660+0000 7fecb16f1b80 10 client.25609 fetch_fsmap learned FSMap version 31 2024-06-06T03:30:18.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.660+0000 7fecb16f1b80 1 -- 172.21.15.50:0/3050590201 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562bdd268640 con 0x562bdd257210 2024-06-06T03:30:18.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.660+0000 7fec7ffff700 1 -- 172.21.15.50:0/3050590201 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fec980095d0 con 0x562bdd257210 2024-06-06T03:30:18.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.660+0000 7fec7ffff700 1 -- 172.21.15.50:0/3050590201 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7fec8800f580 con 0x562bdd257210 2024-06-06T03:30:18.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.660+0000 7fecb16f1b80 10 client.25609 fetch_fsmap finished waiting for FSMap version 31 2024-06-06T03:30:18.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.660+0000 7fecb16f1b80 10 client.25609 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:30:18.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.660+0000 7fecb16f1b80 20 client.25609 populate_metadata read hostname 'smithi050' 2024-06-06T03:30:18.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.660+0000 7fecb16f1b80 1 --2- 172.21.15.50:0/3050590201 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562bdd26ac20 0x562bdd26d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:18.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.660+0000 7fecb16f1b80 4 client.25609 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:30:18.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.660+0000 7fecb16f1b80 1 -- 172.21.15.50:0/3050590201 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562bdd1afd10 con 0x562bdd26ac20 2024-06-06T03:30:18.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.661+0000 7feca4c0a700 1 --2- 172.21.15.50:0/3050590201 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562bdd26ac20 0x562bdd26d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:18.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.662+0000 7feca4c0a700 1 --2- 172.21.15.50:0/3050590201 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562bdd26ac20 0x562bdd26d010 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8346807306504df server_cookie=116895de8cec8153 in_seq=0 out_seq=0 2024-06-06T03:30:18.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.662+0000 7fec7ffff700 10 client.25609 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:30:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.662+0000 7fec7ffff700 1 -- 172.21.15.50:0/3050590201 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x562bdd1afd10 con 0x562bdd26ac20 2024-06-06T03:30:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.662+0000 7fec7ffff700 10 client.25609 handle_command_reply: tid=0 2024-06-06T03:30:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.662+0000 7fecb16f1b80 1 client.25609 shutdown 2024-06-06T03:30:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.663+0000 7fecb16f1b80 1 -- 172.21.15.50:0/3050590201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bdd257210 msgr2=0x562bdd25a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.663+0000 7fecb16f1b80 1 --2- 172.21.15.50:0/3050590201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bdd257210 0x562bdd25a7c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fec8800bb20 tx=0x7fec8800bee0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.663+0000 7fecb16f1b80 1 -- 172.21.15.50:0/3050590201 shutdown_connections 2024-06-06T03:30:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.663+0000 7fecb16f1b80 1 --2- 172.21.15.50:0/3050590201 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562bdd26ac20 0x562bdd26d010 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.663+0000 7fecb16f1b80 1 --2- 172.21.15.50:0/3050590201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bdd257210 0x562bdd25a7c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.663+0000 7fecb16f1b80 1 --2- 172.21.15.50:0/3050590201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bdd251080 0x562bdd25cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.663+0000 7fecb16f1b80 1 --2- 172.21.15.50:0/3050590201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bdd2568f0 0x562bdd25a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.663+0000 7fecb16f1b80 1 -- 172.21.15.50:0/3050590201 >> 172.21.15.50:0/3050590201 conn(0x562bdd17bcc0 msgr2=0x562bdd24fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:18.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.663+0000 7fec7ffff700 0 client.25609 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:30:18.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.663+0000 7fecb16f1b80 1 -- 172.21.15.50:0/3050590201 shutdown_connections 2024-06-06T03:30:18.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.663+0000 7fecb16f1b80 1 -- 172.21.15.50:0/3050590201 wait complete. 2024-06-06T03:30:18.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.665+0000 7fecb16f1b80 20 client.25609 trim_cache size 0 max 16384 2024-06-06T03:30:18.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.696+0000 7fecb16f1b80 1 Processor -- start 2024-06-06T03:30:18.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.696+0000 7fecb16f1b80 1 -- start start 2024-06-06T03:30:18.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.696+0000 7fecb16f1b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bdd17bcc0 0x562bdd266ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:18.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.696+0000 7fecb16f1b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bdd251080 0x562bdd259c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:18.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.696+0000 7fecb16f1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bdd2568f0 0x562bdd258b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:18.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.696+0000 7fecb16f1b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fec800113e0 con 0x562bdd17bcc0 2024-06-06T03:30:18.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.696+0000 7fecb16f1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fec8000ec70 con 0x562bdd2568f0 2024-06-06T03:30:18.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.696+0000 7fecb16f1b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fec8000cac0 con 0x562bdd251080 2024-06-06T03:30:18.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.696+0000 7feca540b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bdd2568f0 0x562bdd258b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:18.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.697+0000 7feca540b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bdd2568f0 0x562bdd258b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:49304/0 (socket says 172.21.15.50:49304) 2024-06-06T03:30:18.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.697+0000 7feca540b700 1 -- 172.21.15.50:0/3006386131 learned_addr learned my addr 172.21.15.50:0/3006386131 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:18.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.699+0000 7fec9ffff700 1 --2- 172.21.15.50:0/3006386131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bdd251080 0x562bdd259c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:18.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.699+0000 7feca4c0a700 1 --2- 172.21.15.50:0/3006386131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bdd17bcc0 0x562bdd266ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:18.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.700+0000 7fec9ffff700 1 -- 172.21.15.50:0/3006386131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bdd2568f0 msgr2=0x562bdd258b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:18.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.700+0000 7fec9ffff700 1 --2- 172.21.15.50:0/3006386131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bdd2568f0 0x562bdd258b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.700+0000 7fec9ffff700 1 -- 172.21.15.50:0/3006386131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bdd17bcc0 msgr2=0x562bdd266ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:18.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.700+0000 7fec9ffff700 1 --2- 172.21.15.50:0/3006386131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bdd17bcc0 0x562bdd266ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.700+0000 7fec9ffff700 1 -- 172.21.15.50:0/3006386131 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bdd2564d0 con 0x562bdd251080 2024-06-06T03:30:18.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.700+0000 7fec9ffff700 1 --2- 172.21.15.50:0/3006386131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bdd251080 0x562bdd259c40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x562bdd2575f0 tx=0x7fec98005bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddcfcc22f38a5f21 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:18.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.702+0000 7fec967fc700 1 -- 172.21.15.50:0/3006386131 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec98033030 con 0x562bdd251080 2024-06-06T03:30:18.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.702+0000 7fec967fc700 1 -- 172.21.15.50:0/3006386131 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fec9800fd20 con 0x562bdd251080 2024-06-06T03:30:18.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.703+0000 7fecb16f1b80 1 -- 172.21.15.50:0/3006386131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bdd251080 msgr2=0x562bdd259c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:18.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.703+0000 7fecb16f1b80 1 --2- 172.21.15.50:0/3006386131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bdd251080 0x562bdd259c40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x562bdd2575f0 tx=0x7fec98005bc0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.706+0000 7fecb16f1b80 1 -- 172.21.15.50:0/3006386131 shutdown_connections 2024-06-06T03:30:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.706+0000 7fecb16f1b80 1 --2- 172.21.15.50:0/3006386131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bdd2568f0 0x562bdd258b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.706+0000 7fecb16f1b80 1 --2- 172.21.15.50:0/3006386131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bdd17bcc0 0x562bdd266ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.706+0000 7fecb16f1b80 1 --2- 172.21.15.50:0/3006386131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bdd251080 0x562bdd259c40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.706+0000 7fecb16f1b80 1 -- 172.21.15.50:0/3006386131 >> 172.21.15.50:0/3006386131 conn(0x562bdd2517c0 msgr2=0x562bdd2542c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:18.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.707+0000 7fecb16f1b80 1 -- 172.21.15.50:0/3006386131 shutdown_connections 2024-06-06T03:30:18.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.707+0000 7fecb16f1b80 1 -- 172.21.15.50:0/3006386131 wait complete. 2024-06-06T03:30:18.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.707+0000 7fecb16f1b80 1 -- start start 2024-06-06T03:30:18.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.707+0000 7fecb16f1b80 1 Processor -- start 2024-06-06T03:30:18.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.708+0000 7fecb16f1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bdd17bcc0 0x562bdd263430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:18.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.708+0000 7fecb16f1b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bdd251080 0x562bdd271e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:18.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.708+0000 7fecb16f1b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bdd2568f0 0x562bdd272390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:18.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.708+0000 7fecb16f1b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fec8000d130 con 0x562bdd2568f0 2024-06-06T03:30:18.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.708+0000 7fecb16f1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fec8000e5a0 con 0x562bdd17bcc0 2024-06-06T03:30:18.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.708+0000 7fecb16f1b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fec8000d800 con 0x562bdd251080 2024-06-06T03:30:18.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.708+0000 7fecb16f1b80 10 client.0 _ll_register_callbacks cb 0x562bdd13c920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:30:18.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.709+0000 7feca4c0a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bdd17bcc0 0x562bdd263430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:18.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.709+0000 7fec9ffff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bdd251080 0x562bdd271e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:18.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.709+0000 7feca4c0a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bdd17bcc0 0x562bdd263430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:49310/0 (socket says 172.21.15.50:49310) 2024-06-06T03:30:18.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.709+0000 7fec9ffff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bdd251080 0x562bdd271e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:58248/0 (socket says 172.21.15.50:58248) 2024-06-06T03:30:18.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.709+0000 7feca4c0a700 1 -- 172.21.15.50:0/1767066671 learned_addr learned my addr 172.21.15.50:0/1767066671 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:18.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.709+0000 7feca4c0a700 1 -- 172.21.15.50:0/1767066671 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bdd251080 msgr2=0x562bdd271e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:18.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.709+0000 7feca4c0a700 1 --2- 172.21.15.50:0/1767066671 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bdd251080 0x562bdd271e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.709+0000 7feca4c0a700 1 -- 172.21.15.50:0/1767066671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bdd2568f0 msgr2=0x562bdd272390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:18.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.709+0000 7feca4c0a700 1 --2- 172.21.15.50:0/1767066671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bdd2568f0 0x562bdd272390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.709+0000 7feca4c0a700 1 -- 172.21.15.50:0/1767066671 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bdd2728d0 con 0x562bdd17bcc0 2024-06-06T03:30:18.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.710+0000 7feca4c0a700 1 --2- 172.21.15.50:0/1767066671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bdd17bcc0 0x562bdd263430 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fec900abe60 tx=0x7fec90006040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5a9b0c458846dd5 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:18.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.710+0000 7fec7ffff700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:30:18.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.710+0000 7fec7ffff700 1 -- 172.21.15.50:0/1767066671 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec900dd510 con 0x562bdd17bcc0 2024-06-06T03:30:18.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.710+0000 7fecb16f1b80 1 -- 172.21.15.50:0/1767066671 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec9800fd20 con 0x562bdd17bcc0 2024-06-06T03:30:18.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.710+0000 7fec7ffff700 1 -- 172.21.15.50:0/1767066671 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fec900cc0b0 con 0x562bdd17bcc0 2024-06-06T03:30:18.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.710+0000 7fec7ffff700 1 -- 172.21.15.50:0/1767066671 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fec900b00b0 con 0x562bdd17bcc0 2024-06-06T03:30:18.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.710+0000 7fecb16f1b80 10 client.25625 fetch_fsmap learned FSMap version 31 2024-06-06T03:30:18.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.710+0000 7fecb16f1b80 1 -- 172.21.15.50:0/1767066671 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562bdd2d55c0 con 0x562bdd17bcc0 2024-06-06T03:30:18.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.711+0000 7fec7ffff700 1 -- 172.21.15.50:0/1767066671 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fec9800fd20 con 0x562bdd17bcc0 2024-06-06T03:30:18.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.711+0000 7fec7ffff700 1 -- 172.21.15.50:0/1767066671 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7fec900ac4c0 con 0x562bdd17bcc0 2024-06-06T03:30:18.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.711+0000 7fecb16f1b80 10 client.25625 fetch_fsmap finished waiting for FSMap version 31 2024-06-06T03:30:18.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.711+0000 7fecb16f1b80 10 client.25625 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:30:18.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.711+0000 7fecb16f1b80 20 client.25625 populate_metadata read hostname 'smithi050' 2024-06-06T03:30:18.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.711+0000 7fecb16f1b80 1 --2- 172.21.15.50:0/1767066671 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562bdd257210 0x562bdd2d7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:18.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.711+0000 7fecb16f1b80 4 client.25625 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:30:18.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.711+0000 7fecb16f1b80 1 -- 172.21.15.50:0/1767066671 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562bdd1aa290 con 0x562bdd257210 2024-06-06T03:30:18.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.711+0000 7fec9ffff700 1 --2- 172.21.15.50:0/1767066671 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562bdd257210 0x562bdd2d7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:18.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.712+0000 7fec7ffff700 10 client.25625 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:30:18.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.712+0000 7fec9ffff700 1 --2- 172.21.15.50:0/1767066671 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562bdd257210 0x562bdd2d7cf0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa81119cf5564179 server_cookie=55e94973b606f641 in_seq=0 out_seq=0 2024-06-06T03:30:18.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.712+0000 7fec7ffff700 1 -- 172.21.15.50:0/1767066671 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562bdd1aa290 con 0x562bdd257210 2024-06-06T03:30:18.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.712+0000 7fec7ffff700 10 client.25625 handle_command_reply: tid=0 2024-06-06T03:30:18.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.712+0000 7fecb16f1b80 1 client.25625 shutdown 2024-06-06T03:30:18.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.712+0000 7fecb16f1b80 1 -- 172.21.15.50:0/1767066671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bdd17bcc0 msgr2=0x562bdd263430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:18.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.712+0000 7fecb16f1b80 1 --2- 172.21.15.50:0/1767066671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bdd17bcc0 0x562bdd263430 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fec900abe60 tx=0x7fec90006040 comp rx=0 tx=0).stop 2024-06-06T03:30:18.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.712+0000 7fecb16f1b80 1 -- 172.21.15.50:0/1767066671 shutdown_connections 2024-06-06T03:30:18.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.712+0000 7fecb16f1b80 1 --2- 172.21.15.50:0/1767066671 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562bdd257210 0x562bdd2d7cf0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.712+0000 7fecb16f1b80 1 --2- 172.21.15.50:0/1767066671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562bdd2568f0 0x562bdd272390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.712+0000 7fecb16f1b80 1 --2- 172.21.15.50:0/1767066671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562bdd17bcc0 0x562bdd263430 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fec900abe60 tx=0x7fec90006040 comp rx=0 tx=0).stop 2024-06-06T03:30:18.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.712+0000 7fec7ffff700 0 client.25625 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:30:18.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.712+0000 7fecb16f1b80 1 --2- 172.21.15.50:0/1767066671 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562bdd251080 0x562bdd271e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.712+0000 7fecb16f1b80 1 -- 172.21.15.50:0/1767066671 >> 172.21.15.50:0/1767066671 conn(0x562bdd2517c0 msgr2=0x562bdd258b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:18.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.713+0000 7fecb16f1b80 1 -- 172.21.15.50:0/1767066671 shutdown_connections 2024-06-06T03:30:18.715 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:30:18.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.713+0000 7fecb16f1b80 1 -- 172.21.15.50:0/1767066671 wait complete. 2024-06-06T03:30:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.713+0000 7fecb16f1b80 20 client.25625 trim_cache size 0 max 16384 2024-06-06T03:30:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.714+0000 7feca5c0c700 1 -- 172.21.15.50:0/3410084565 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fec8c0a2e20 msgr2=0x7fec8c0a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.714+0000 7feca5c0c700 1 --2- 172.21.15.50:0/3410084565 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fec8c0a2e20 0x7fec8c0a52e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7feca006ddb0 tx=0x7fec9800b540 comp rx=0 tx=0).stop 2024-06-06T03:30:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.714+0000 7feca5c0c700 1 -- 172.21.15.50:0/3410084565 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feca010cb40 msgr2=0x7feca019f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.714+0000 7feca5c0c700 1 --2- 172.21.15.50:0/3410084565 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feca010cb40 0x7feca019f090 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fec90018f20 tx=0x7fec9001e3b0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.715+0000 7feca5c0c700 1 -- 172.21.15.50:0/3410084565 shutdown_connections 2024-06-06T03:30:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.715+0000 7feca5c0c700 1 --2- 172.21.15.50:0/3410084565 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fec8c0a2e20 0x7fec8c0a52e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.715+0000 7feca5c0c700 1 --2- 172.21.15.50:0/3410084565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca010f440 0x7feca01a3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.715+0000 7feca5c0c700 1 --2- 172.21.15.50:0/3410084565 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feca010cb40 0x7feca019f090 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.715+0000 7feca5c0c700 1 --2- 172.21.15.50:0/3410084565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feca010cfb0 0x7feca019f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.715+0000 7feca5c0c700 1 -- 172.21.15.50:0/3410084565 >> 172.21.15.50:0/3410084565 conn(0x7feca006d470 msgr2=0x7feca0072e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.715+0000 7feca5c0c700 1 -- 172.21.15.50:0/3410084565 shutdown_connections 2024-06-06T03:30:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:18.715+0000 7feca5c0c700 1 -- 172.21.15.50:0/3410084565 wait complete. 2024-06-06T03:30:19.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:19 smithi050 ceph-mon[32421]: pgmap v541: 129 pgs: 129 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 41 MiB/s wr, 655 op/s 2024-06-06T03:30:19.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:19 smithi079 ceph-mon[35478]: pgmap v541: 129 pgs: 129 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 41 MiB/s wr, 655 op/s 2024-06-06T03:30:19.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:19 smithi122 ceph-mon[35759]: pgmap v541: 129 pgs: 129 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 41 MiB/s wr, 655 op/s 2024-06-06T03:30:20.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:20 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:30:20.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:20 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:30:20.606 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-06T03:30:20.607 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-06-06T03:30:20.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:20 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:30:21.103 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:30:21.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:21 smithi050 ceph-mon[32421]: pgmap v542: 129 pgs: 129 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 48 MiB/s wr, 774 op/s 2024-06-06T03:30:21.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:21 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:30:21.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:21 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:30:21.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:21 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:30:21.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:21 smithi079 ceph-mon[35478]: pgmap v542: 129 pgs: 129 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 48 MiB/s wr, 774 op/s 2024-06-06T03:30:21.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:21 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:30:21.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:21 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:30:21.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:21 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:30:21.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:21 smithi122 ceph-mon[35759]: pgmap v542: 129 pgs: 129 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 48 MiB/s wr, 774 op/s 2024-06-06T03:30:21.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:21 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:30:21.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:21 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:30:21.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:21 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:30:21.836 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.837+0000 7f0823f90640 1 -- 172.21.15.50:0/2834302356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f081c10b310 msgr2=0x7f081c1120e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:21.836 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.837+0000 7f0823f90640 1 --2- 172.21.15.50:0/2834302356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f081c10b310 0x7f081c1120e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f080c009860 tx=0x7f080c02a340 comp rx=0 tx=0).stop 2024-06-06T03:30:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.837+0000 7f0823f90640 1 -- 172.21.15.50:0/2834302356 shutdown_connections 2024-06-06T03:30:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.837+0000 7f0823f90640 1 --2- 172.21.15.50:0/2834302356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f081c10b310 0x7f081c1120e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.837+0000 7f0823f90640 1 --2- 172.21.15.50:0/2834302356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f081c10b790 0x7f081c114630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.837+0000 7f0823f90640 1 --2- 172.21.15.50:0/2834302356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f081c1089a0 0x7f081c10add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.838+0000 7f0823f90640 1 -- 172.21.15.50:0/2834302356 >> 172.21.15.50:0/2834302356 conn(0x7f081c06ebd0 msgr2=0x7f081c071010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.838+0000 7f0823f90640 1 -- 172.21.15.50:0/2834302356 shutdown_connections 2024-06-06T03:30:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.838+0000 7f0823f90640 1 -- 172.21.15.50:0/2834302356 wait complete. 2024-06-06T03:30:21.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.838+0000 7f0823f90640 1 Processor -- start 2024-06-06T03:30:21.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.839+0000 7f0823f90640 1 -- start start 2024-06-06T03:30:21.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.839+0000 7f0823f90640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f081c1089a0 0x7f081c1a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.839+0000 7f0823f90640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f081c10b310 0x7f081c1a2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.839+0000 7f0821d2c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f081c1089a0 0x7f081c1a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.839+0000 7f0821d2c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f081c1089a0 0x7f081c1a2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:58262/0 (socket says 172.21.15.50:58262) 2024-06-06T03:30:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.840+0000 7f0821d2c640 1 -- 172.21.15.50:0/1319165945 learned_addr learned my addr 172.21.15.50:0/1319165945 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.840+0000 7f082152b640 1 --2- 172.21.15.50:0/1319165945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f081c10b310 0x7f081c1a2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.840+0000 7f0823f90640 1 --2- 172.21.15.50:0/1319165945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f081c10b790 0x7f081c1a9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.840+0000 7f0823f90640 1 -- 172.21.15.50:0/1319165945 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f081c117f00 con 0x7f081c10b310 2024-06-06T03:30:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.840+0000 7f0823f90640 1 -- 172.21.15.50:0/1319165945 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f081c117d80 con 0x7f081c10b790 2024-06-06T03:30:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.840+0000 7f082252d640 1 --2- 172.21.15.50:0/1319165945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f081c10b790 0x7f081c1a9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.840+0000 7f0823f90640 1 -- 172.21.15.50:0/1319165945 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f081c118080 con 0x7f081c1089a0 2024-06-06T03:30:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.842+0000 7f0821d2c640 1 -- 172.21.15.50:0/1319165945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f081c10b790 msgr2=0x7f081c1a9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.842+0000 7f0821d2c640 1 --2- 172.21.15.50:0/1319165945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f081c10b790 0x7f081c1a9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.842+0000 7f0821d2c640 1 -- 172.21.15.50:0/1319165945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f081c10b310 msgr2=0x7f081c1a2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.842+0000 7f0821d2c640 1 --2- 172.21.15.50:0/1319165945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f081c10b310 0x7f081c1a2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.842+0000 7f0821d2c640 1 -- 172.21.15.50:0/1319165945 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f081c1aa1a0 con 0x7f081c1089a0 2024-06-06T03:30:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.842+0000 7f0821d2c640 1 --2- 172.21.15.50:0/1319165945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f081c1089a0 0x7f081c1a2580 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0818009e70 tx=0x7f081800ed90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.843+0000 7f0812ffd640 1 -- 172.21.15.50:0/1319165945 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f081800c8b0 con 0x7f081c1089a0 2024-06-06T03:30:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.843+0000 7f0812ffd640 1 -- 172.21.15.50:0/1319165945 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0818005020 con 0x7f081c1089a0 2024-06-06T03:30:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.843+0000 7f0812ffd640 1 -- 172.21.15.50:0/1319165945 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0818004a90 con 0x7f081c1089a0 2024-06-06T03:30:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.843+0000 7f0823f90640 1 -- 172.21.15.50:0/1319165945 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f081c10bd20 con 0x7f081c1089a0 2024-06-06T03:30:21.843 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.844+0000 7f0823f90640 1 -- 172.21.15.50:0/1319165945 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f081c10c130 con 0x7f081c1089a0 2024-06-06T03:30:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.848+0000 7f0826d7d740 1 Processor -- start 2024-06-06T03:30:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.848+0000 7f0826d7d740 1 -- start start 2024-06-06T03:30:21.849 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.849+0000 7f0826d7d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d4347010 0x5638d4347430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:21.849 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.849+0000 7f0826d7d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638d4347a00 0x5638d434c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:21.849 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.849+0000 7f0826d7d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d434cb70 0x5638d434f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:21.849 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.849+0000 7f0826d7d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5638d42aa4f0 con 0x5638d434cb70 2024-06-06T03:30:21.849 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.849+0000 7f0826d7d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5638d4248870 con 0x5638d4347010 2024-06-06T03:30:21.849 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.849+0000 7f0826d7d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5638d42a64b0 con 0x5638d4347a00 2024-06-06T03:30:21.849 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.849+0000 7f082252d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d4347010 0x5638d4347430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:21.849 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.849+0000 7f082252d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d4347010 0x5638d4347430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:49332/0 (socket says 172.21.15.50:49332) 2024-06-06T03:30:21.850 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.849+0000 7f082252d640 1 -- 172.21.15.50:0/644307843 learned_addr learned my addr 172.21.15.50:0/644307843 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:21.850 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.849+0000 7f0812ffd640 1 -- 172.21.15.50:0/1319165945 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f08180051d0 con 0x7f081c1089a0 2024-06-06T03:30:21.850 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.850+0000 7f082252d640 1 -- 172.21.15.50:0/644307843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638d4347a00 msgr2=0x5638d434c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.851+0000 7f0812ffd640 1 --2- 172.21.15.50:0/1319165945 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f08080a2e20 0x7f08080a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.851+0000 7f0821d2c640 1 --2- 172.21.15.50:0/644307843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638d4347a00 0x5638d434c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.851+0000 7f0812ffd640 1 -- 172.21.15.50:0/1319165945 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f08180d7930 con 0x7f081c1089a0 2024-06-06T03:30:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.851+0000 7f082152b640 1 --2- 172.21.15.50:0/644307843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d434cb70 0x5638d434f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.851+0000 7f082252d640 1 --2- 172.21.15.50:0/644307843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638d4347a00 0x5638d434c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.851+0000 7f082252d640 1 -- 172.21.15.50:0/644307843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d434cb70 msgr2=0x5638d434f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.851+0000 7f082252d640 1 --2- 172.21.15.50:0/644307843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d434cb70 0x5638d434f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.851+0000 7f082252d640 1 -- 172.21.15.50:0/644307843 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638d42649b0 con 0x5638d4347010 2024-06-06T03:30:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.851+0000 7f082152b640 1 --2- 172.21.15.50:0/644307843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d434cb70 0x5638d434f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:30:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.852+0000 7f0821d2c640 1 --2- 172.21.15.50:0/644307843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638d4347a00 0x5638d434c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:30:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.852+0000 7f082252d640 1 --2- 172.21.15.50:0/644307843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d4347010 0x5638d4347430 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0814009fd0 tx=0x7f08140118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=789216f79bfd0df6 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.852+0000 7f082252d640 1 --2- 172.21.15.50:0/1319165945 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f08080a2e20 0x7f08080a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.853+0000 7f0807fff640 1 -- 172.21.15.50:0/644307843 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0814004250 con 0x5638d4347010 2024-06-06T03:30:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.853+0000 7f0807fff640 1 -- 172.21.15.50:0/644307843 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f081400f4e0 con 0x5638d4347010 2024-06-06T03:30:21.853 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.854+0000 7f0826d7d740 1 -- 172.21.15.50:0/644307843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d4347010 msgr2=0x5638d4347430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:21.853 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.854+0000 7f0826d7d740 1 --2- 172.21.15.50:0/644307843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d4347010 0x5638d4347430 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0814009fd0 tx=0x7f08140118d0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.856+0000 7f082252d640 1 --2- 172.21.15.50:0/1319165945 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f08080a2e20 0x7f08080a52e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0814020000 tx=0x7f081401bd70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.857+0000 7f0826d7d740 1 -- 172.21.15.50:0/644307843 shutdown_connections 2024-06-06T03:30:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.857+0000 7f0826d7d740 1 --2- 172.21.15.50:0/644307843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d434cb70 0x5638d434f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.857+0000 7f0826d7d740 1 --2- 172.21.15.50:0/644307843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638d4347a00 0x5638d434c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.857+0000 7f0826d7d740 1 --2- 172.21.15.50:0/644307843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d4347010 0x5638d4347430 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.857+0000 7f0826d7d740 1 -- 172.21.15.50:0/644307843 >> 172.21.15.50:0/644307843 conn(0x5638d4342680 msgr2=0x5638d4342a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.857+0000 7f0826d7d740 1 -- 172.21.15.50:0/644307843 shutdown_connections 2024-06-06T03:30:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.857+0000 7f0826d7d740 1 -- 172.21.15.50:0/644307843 wait complete. 2024-06-06T03:30:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.858+0000 7f0826d7d740 1 -- start start 2024-06-06T03:30:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.858+0000 7f0826d7d740 1 Processor -- start 2024-06-06T03:30:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.858+0000 7f0826d7d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d4347010 0x5638d4351170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.858+0000 7f0826d7d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638d4347a00 0x5638d43516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.858+0000 7f0826d7d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d434cb70 0x5638d43586f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.859+0000 7f0826d7d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5638d434fbc0 con 0x5638d4347010 2024-06-06T03:30:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.859+0000 7f0826d7d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5638d4233ae0 con 0x5638d434cb70 2024-06-06T03:30:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.859+0000 7f0826d7d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5638d434fd40 con 0x5638d4347a00 2024-06-06T03:30:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.859+0000 7f0826d7d740 10 client.0 _ll_register_callbacks cb 0x5638d426c9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:30:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.859+0000 7f0821d2c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d4347010 0x5638d4351170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.859+0000 7f0821d2c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d4347010 0x5638d4351170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47522/0 (socket says 172.21.15.50:47522) 2024-06-06T03:30:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.859+0000 7f0821d2c640 1 -- 172.21.15.50:0/3799263542 learned_addr learned my addr 172.21.15.50:0/3799263542 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.859+0000 7f082252d640 1 --2- 172.21.15.50:0/3799263542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d434cb70 0x5638d43586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.859+0000 7f082152b640 1 --2- 172.21.15.50:0/3799263542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638d4347a00 0x5638d43516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.859+0000 7f0821d2c640 1 -- 172.21.15.50:0/3799263542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638d4347a00 msgr2=0x5638d43516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.859+0000 7f0821d2c640 1 --2- 172.21.15.50:0/3799263542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638d4347a00 0x5638d43516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.859+0000 7f0821d2c640 1 -- 172.21.15.50:0/3799263542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d434cb70 msgr2=0x5638d43586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.859+0000 7f0821d2c640 1 --2- 172.21.15.50:0/3799263542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d434cb70 0x5638d43586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.859+0000 7f0821d2c640 1 -- 172.21.15.50:0/3799263542 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638d3fbe210 con 0x5638d4347010 2024-06-06T03:30:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.860+0000 7f082152b640 1 --2- 172.21.15.50:0/3799263542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638d4347a00 0x5638d43516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:30:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.860+0000 7f082252d640 1 --2- 172.21.15.50:0/3799263542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d434cb70 0x5638d43586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:30:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.860+0000 7f0821d2c640 1 --2- 172.21.15.50:0/3799263542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d4347010 0x5638d4351170 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0818000c00 tx=0x7f08180a3880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c672696bec7ce server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.861+0000 7f08057fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:30:21.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.862+0000 7f08057fa640 1 -- 172.21.15.50:0/3799263542 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08180a42c0 con 0x5638d4347010 2024-06-06T03:30:21.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.862+0000 7f08057fa640 1 -- 172.21.15.50:0/3799263542 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f08180ac590 con 0x5638d4347010 2024-06-06T03:30:21.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.864+0000 7f0826d7d740 1 -- 172.21.15.50:0/3799263542 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f081400f4e0 con 0x5638d4347010 2024-06-06T03:30:21.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.865+0000 7f08057fa640 1 -- 172.21.15.50:0/3799263542 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f08180aca20 con 0x5638d4347010 2024-06-06T03:30:21.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.865+0000 7f0826d7d740 10 client.16041 fetch_fsmap learned FSMap version 31 2024-06-06T03:30:21.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.865+0000 7f0826d7d740 1 -- 172.21.15.50:0/3799263542 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5638d408a620 con 0x5638d4347010 2024-06-06T03:30:21.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.867+0000 7f08057fa640 1 -- 172.21.15.50:0/3799263542 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f081400f4e0 con 0x5638d4347010 2024-06-06T03:30:21.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.868+0000 7f08057fa640 1 -- 172.21.15.50:0/3799263542 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f081809fbb0 con 0x5638d4347010 2024-06-06T03:30:21.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.869+0000 7f0826d7d740 10 client.16041 fetch_fsmap finished waiting for FSMap version 31 2024-06-06T03:30:21.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.869+0000 7f0826d7d740 10 client.16041 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:30:21.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.869+0000 7f0826d7d740 20 client.16041 populate_metadata read hostname 'smithi050' 2024-06-06T03:30:21.868 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.869+0000 7f0826d7d740 1 --2- 172.21.15.50:0/3799263542 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5638d435d010 0x5638d435f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:21.868 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.869+0000 7f0826d7d740 4 client.16041 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:30:21.868 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.869+0000 7f0826d7d740 1 -- 172.21.15.50:0/3799263542 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638d42bdf10 con 0x5638d435d010 2024-06-06T03:30:21.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.873+0000 7f082152b640 1 --2- 172.21.15.50:0/3799263542 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5638d435d010 0x5638d435f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:21.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.875+0000 7f082152b640 1 --2- 172.21.15.50:0/3799263542 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5638d435d010 0x5638d435f460 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfdc3edea9d91b74 server_cookie=545ecba6659e6ec5 in_seq=0 out_seq=0 2024-06-06T03:30:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.876+0000 7f08057fa640 10 client.16041 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:30:21.877 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.878+0000 7f08057fa640 1 -- 172.21.15.50:0/3799263542 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5638d42bdf10 con 0x5638d435d010 2024-06-06T03:30:21.877 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.878+0000 7f08057fa640 10 client.16041 handle_command_reply: tid=0 2024-06-06T03:30:21.878 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.879+0000 7f0826d7d740 1 client.16041 shutdown 2024-06-06T03:30:21.879 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.880+0000 7f0826d7d740 1 -- 172.21.15.50:0/3799263542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d4347010 msgr2=0x5638d4351170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:21.879 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.880+0000 7f0826d7d740 1 --2- 172.21.15.50:0/3799263542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d4347010 0x5638d4351170 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0818000c00 tx=0x7f08180a3880 comp rx=0 tx=0).stop 2024-06-06T03:30:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.881+0000 7f0826d7d740 1 -- 172.21.15.50:0/3799263542 shutdown_connections 2024-06-06T03:30:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.881+0000 7f0826d7d740 1 --2- 172.21.15.50:0/3799263542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d434cb70 0x5638d43586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.881+0000 7f0826d7d740 1 --2- 172.21.15.50:0/3799263542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638d4347a00 0x5638d43516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.881+0000 7f0826d7d740 1 --2- 172.21.15.50:0/3799263542 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5638d435d010 0x5638d435f460 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.881+0000 7f0826d7d740 1 --2- 172.21.15.50:0/3799263542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d4347010 0x5638d4351170 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.881+0000 7f08057fa640 0 client.16041 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:30:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.881+0000 7f0826d7d740 1 -- 172.21.15.50:0/3799263542 >> 172.21.15.50:0/3799263542 conn(0x5638d4342680 msgr2=0x5638d43417e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:21.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.884+0000 7f0826d7d740 1 -- 172.21.15.50:0/3799263542 shutdown_connections 2024-06-06T03:30:21.885 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.885+0000 7f0826d7d740 1 -- 172.21.15.50:0/3799263542 wait complete. 2024-06-06T03:30:21.885 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.885+0000 7f0826d7d740 20 client.16041 trim_cache size 0 max 16384 2024-06-06T03:30:21.920 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.920+0000 7f0826d7d740 1 Processor -- start 2024-06-06T03:30:21.922 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.923+0000 7f0826d7d740 1 -- start start 2024-06-06T03:30:21.922 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.923+0000 7f0826d7d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638d4347010 0x5638d434ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:21.922 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.923+0000 7f0826d7d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d4347a00 0x5638d43586b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:21.922 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.923+0000 7f0826d7d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d434cb70 0x5638d4348a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:21.923 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.923+0000 7f0826d7d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f081c1b3400 con 0x5638d434cb70 2024-06-06T03:30:21.923 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.923+0000 7f0826d7d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f081c1b0cd0 con 0x5638d4347a00 2024-06-06T03:30:21.923 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.923+0000 7f0826d7d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f081c1aeb40 con 0x5638d4347010 2024-06-06T03:30:21.923 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.924+0000 7f082152b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d4347a00 0x5638d43586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:21.923 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.924+0000 7f082152b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d4347a00 0x5638d43586b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:49344/0 (socket says 172.21.15.50:49344) 2024-06-06T03:30:21.923 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.924+0000 7f082152b640 1 -- 172.21.15.50:0/3724449326 learned_addr learned my addr 172.21.15.50:0/3724449326 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:21.924 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.925+0000 7f0821d2c640 1 --2- 172.21.15.50:0/3724449326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638d4347010 0x5638d434ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:21.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.926+0000 7f082152b640 1 -- 172.21.15.50:0/3724449326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638d4347010 msgr2=0x5638d434ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:21.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.926+0000 7f082152b640 1 --2- 172.21.15.50:0/3724449326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638d4347010 0x5638d434ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.926+0000 7f082152b640 1 -- 172.21.15.50:0/3724449326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d434cb70 msgr2=0x5638d4348a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:21.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.926+0000 7f082152b640 1 --2- 172.21.15.50:0/3724449326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d434cb70 0x5638d4348a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.926+0000 7f082152b640 1 -- 172.21.15.50:0/3724449326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638d4348060 con 0x5638d4347a00 2024-06-06T03:30:21.926 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.927+0000 7f082152b640 1 --2- 172.21.15.50:0/3724449326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d4347a00 0x5638d43586b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f080c005e00 tx=0x7f080c0097b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8f2e356a08db4fe server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:21.926 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.927+0000 7f08077fe640 1 -- 172.21.15.50:0/3724449326 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c037040 con 0x5638d4347a00 2024-06-06T03:30:21.926 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.927+0000 7f08077fe640 1 -- 172.21.15.50:0/3724449326 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f080c038040 con 0x5638d4347a00 2024-06-06T03:30:21.926 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.927+0000 7f08077fe640 1 -- 172.21.15.50:0/3724449326 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c032440 con 0x5638d4347a00 2024-06-06T03:30:21.929 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.929+0000 7f0826d7d740 1 -- 172.21.15.50:0/3724449326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d4347a00 msgr2=0x5638d43586b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:21.929 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.929+0000 7f0826d7d740 1 --2- 172.21.15.50:0/3724449326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d4347a00 0x5638d43586b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f080c005e00 tx=0x7f080c0097b0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.931+0000 7f0826d7d740 1 -- 172.21.15.50:0/3724449326 shutdown_connections 2024-06-06T03:30:21.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.931+0000 7f0826d7d740 1 --2- 172.21.15.50:0/3724449326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d434cb70 0x5638d4348a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.931+0000 7f0826d7d740 1 --2- 172.21.15.50:0/3724449326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d4347a00 0x5638d43586b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.931+0000 7f0826d7d740 1 --2- 172.21.15.50:0/3724449326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638d4347010 0x5638d434ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.931+0000 7f0826d7d740 1 -- 172.21.15.50:0/3724449326 >> 172.21.15.50:0/3724449326 conn(0x5638d4342680 msgr2=0x5638d4342a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:21.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.932+0000 7f0826d7d740 1 -- 172.21.15.50:0/3724449326 shutdown_connections 2024-06-06T03:30:21.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.932+0000 7f0826d7d740 1 -- 172.21.15.50:0/3724449326 wait complete. 2024-06-06T03:30:21.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.932+0000 7f0826d7d740 1 -- start start 2024-06-06T03:30:21.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.932+0000 7f0826d7d740 1 Processor -- start 2024-06-06T03:30:21.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.933+0000 7f0826d7d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d4347010 0x5638d4358570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:21.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.933+0000 7f0826d7d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638d4347a00 0x5638d43550b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:21.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.933+0000 7f0826d7d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d434cb70 0x5638d43555f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:21.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.933+0000 7f0826d7d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f081c1af190 con 0x5638d434cb70 2024-06-06T03:30:21.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.933+0000 7f0826d7d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f081c1b0600 con 0x5638d4347010 2024-06-06T03:30:21.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.933+0000 7f0826d7d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f081c1af860 con 0x5638d4347a00 2024-06-06T03:30:21.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.933+0000 7f0826d7d740 10 client.0 _ll_register_callbacks cb 0x7f0818005710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:30:21.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.934+0000 7f082152b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638d4347a00 0x5638d43550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:21.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.934+0000 7f0821d2c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d4347010 0x5638d4358570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:21.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.934+0000 7f082152b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638d4347a00 0x5638d43550b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:58314/0 (socket says 172.21.15.50:58314) 2024-06-06T03:30:21.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.934+0000 7f082152b640 1 -- 172.21.15.50:0/1989561502 learned_addr learned my addr 172.21.15.50:0/1989561502 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:21.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.934+0000 7f082252d640 1 --2- 172.21.15.50:0/1989561502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d434cb70 0x5638d43555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:21.936 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.935+0000 7f082252d640 1 -- 172.21.15.50:0/1989561502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638d4347a00 msgr2=0x5638d43550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:21.936 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.935+0000 7f082252d640 1 --2- 172.21.15.50:0/1989561502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638d4347a00 0x5638d43550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.936 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.935+0000 7f082252d640 1 -- 172.21.15.50:0/1989561502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d4347010 msgr2=0x5638d4358570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:21.936 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.935+0000 7f082252d640 1 --2- 172.21.15.50:0/1989561502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d4347010 0x5638d4358570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.936 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.935+0000 7f082252d640 1 -- 172.21.15.50:0/1989561502 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638d43c5d20 con 0x5638d434cb70 2024-06-06T03:30:21.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.937+0000 7f082252d640 1 --2- 172.21.15.50:0/1989561502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d434cb70 0x5638d43555f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f081401d040 tx=0x7f0814015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599c9333869749e7 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:21.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.937+0000 7f08057fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:30:21.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.938+0000 7f08057fa640 1 -- 172.21.15.50:0/1989561502 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0814037020 con 0x5638d434cb70 2024-06-06T03:30:21.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.938+0000 7f08057fa640 1 -- 172.21.15.50:0/1989561502 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f081400f8f0 con 0x5638d434cb70 2024-06-06T03:30:21.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.938+0000 7f0826d7d740 1 -- 172.21.15.50:0/1989561502 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f080c038040 con 0x5638d434cb70 2024-06-06T03:30:21.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.938+0000 7f08057fa640 1 -- 172.21.15.50:0/1989561502 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0814019e20 con 0x5638d434cb70 2024-06-06T03:30:21.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.938+0000 7f0826d7d740 10 client.16044 fetch_fsmap learned FSMap version 31 2024-06-06T03:30:21.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.938+0000 7f0826d7d740 1 -- 172.21.15.50:0/1989561502 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5638d43c7030 con 0x5638d434cb70 2024-06-06T03:30:21.939 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.940+0000 7f08057fa640 1 -- 172.21.15.50:0/1989561502 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f080c038040 con 0x5638d434cb70 2024-06-06T03:30:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.940+0000 7f08057fa640 1 -- 172.21.15.50:0/1989561502 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f0814033840 con 0x5638d434cb70 2024-06-06T03:30:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.940+0000 7f0826d7d740 10 client.16044 fetch_fsmap finished waiting for FSMap version 31 2024-06-06T03:30:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.940+0000 7f0826d7d740 10 client.16044 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:30:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.940+0000 7f0826d7d740 20 client.16044 populate_metadata read hostname 'smithi050' 2024-06-06T03:30:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.941+0000 7f0826d7d740 1 --2- 172.21.15.50:0/1989561502 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5638d43c7870 0x5638d43c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.941+0000 7f0826d7d740 4 client.16044 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:30:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.941+0000 7f0826d7d740 1 -- 172.21.15.50:0/1989561502 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5638d42b7c20 con 0x5638d43c7870 2024-06-06T03:30:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.941+0000 7f0821d2c640 1 --2- 172.21.15.50:0/1989561502 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5638d43c7870 0x5638d43c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:21.941 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.942+0000 7f0821d2c640 1 --2- 172.21.15.50:0/1989561502 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5638d43c7870 0x5638d43c9c90 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=940849c78828cd8e server_cookie=85ec807dbc1fb1b1 in_seq=0 out_seq=0 2024-06-06T03:30:21.941 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.942+0000 7f08057fa640 10 client.16044 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:30:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.953+0000 7f08057fa640 1 -- 172.21.15.50:0/1989561502 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5638d42b7c20 con 0x5638d43c7870 2024-06-06T03:30:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.953+0000 7f08057fa640 10 client.16044 handle_command_reply: tid=0 2024-06-06T03:30:21.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.954+0000 7f0826d7d740 1 client.16044 shutdown 2024-06-06T03:30:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.954+0000 7f0826d7d740 1 -- 172.21.15.50:0/1989561502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d434cb70 msgr2=0x5638d43555f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.954+0000 7f0826d7d740 1 --2- 172.21.15.50:0/1989561502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d434cb70 0x5638d43555f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f081401d040 tx=0x7f0814015000 comp rx=0 tx=0).stop 2024-06-06T03:30:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.955+0000 7f0826d7d740 1 -- 172.21.15.50:0/1989561502 shutdown_connections 2024-06-06T03:30:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.955+0000 7f0826d7d740 1 --2- 172.21.15.50:0/1989561502 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5638d43c7870 0x5638d43c9c90 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.955+0000 7f0826d7d740 1 --2- 172.21.15.50:0/1989561502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d434cb70 0x5638d43555f0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.955+0000 7f0826d7d740 1 --2- 172.21.15.50:0/1989561502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638d4347a00 0x5638d43550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.955+0000 7f0826d7d740 1 --2- 172.21.15.50:0/1989561502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d4347010 0x5638d4358570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.955+0000 7f08057fa640 0 client.16044 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:30:21.955 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.955+0000 7f0826d7d740 1 -- 172.21.15.50:0/1989561502 >> 172.21.15.50:0/1989561502 conn(0x5638d4342680 msgr2=0x5638d434bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:21.955 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.956+0000 7f0826d7d740 1 -- 172.21.15.50:0/1989561502 shutdown_connections 2024-06-06T03:30:21.955 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.956+0000 7f0826d7d740 1 -- 172.21.15.50:0/1989561502 wait complete. 2024-06-06T03:30:21.955 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.956+0000 7f0826d7d740 20 client.16044 trim_cache size 0 max 16384 2024-06-06T03:30:21.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:30:21.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:30:21.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:30:21.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.958+0000 7f0823f90640 1 -- 172.21.15.50:0/1319165945 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f08080a2e20 msgr2=0x7f08080a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:21.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.958+0000 7f0823f90640 1 --2- 172.21.15.50:0/1319165945 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f08080a2e20 0x7f08080a52e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0814020000 tx=0x7f081401bd70 comp rx=0 tx=0).stop 2024-06-06T03:30:21.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.958+0000 7f0823f90640 1 -- 172.21.15.50:0/1319165945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f081c1089a0 msgr2=0x7f081c1a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:21.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.958+0000 7f0823f90640 1 --2- 172.21.15.50:0/1319165945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f081c1089a0 0x7f081c1a2580 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0818009e70 tx=0x7f081800ed90 comp rx=0 tx=0).stop 2024-06-06T03:30:21.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.959+0000 7f0823f90640 1 -- 172.21.15.50:0/1319165945 shutdown_connections 2024-06-06T03:30:21.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.959+0000 7f0823f90640 1 --2- 172.21.15.50:0/1319165945 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f08080a2e20 0x7f08080a52e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.959+0000 7f0823f90640 1 --2- 172.21.15.50:0/1319165945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f081c10b310 0x7f081c1a2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.959+0000 7f0823f90640 1 --2- 172.21.15.50:0/1319165945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f081c10b790 0x7f081c1a9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.959+0000 7f0823f90640 1 --2- 172.21.15.50:0/1319165945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f081c1089a0 0x7f081c1a2580 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:21.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.959+0000 7f0823f90640 1 -- 172.21.15.50:0/1319165945 >> 172.21.15.50:0/1319165945 conn(0x7f081c06ebd0 msgr2=0x7f081c06f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:21.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.959+0000 7f0823f90640 1 -- 172.21.15.50:0/1319165945 shutdown_connections 2024-06-06T03:30:21.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:21.959+0000 7f0823f90640 1 -- 172.21.15.50:0/1319165945 wait complete. 2024-06-06T03:30:23.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:23 smithi050 ceph-mon[32421]: pgmap v543: 129 pgs: 129 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 39 MiB/s wr, 621 op/s 2024-06-06T03:30:23.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:23 smithi079 ceph-mon[35478]: pgmap v543: 129 pgs: 129 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 39 MiB/s wr, 621 op/s 2024-06-06T03:30:23.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:23 smithi122 ceph-mon[35759]: pgmap v543: 129 pgs: 129 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 39 MiB/s wr, 621 op/s 2024-06-06T03:30:25.532 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:25 smithi050 ceph-mon[32421]: pgmap v544: 129 pgs: 129 active+clean; 10 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 42 MiB/s wr, 681 op/s 2024-06-06T03:30:25.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:25 smithi079 ceph-mon[35478]: pgmap v544: 129 pgs: 129 active+clean; 10 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 42 MiB/s wr, 681 op/s 2024-06-06T03:30:25.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:25 smithi122 ceph-mon[35759]: pgmap v544: 129 pgs: 129 active+clean; 10 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 42 MiB/s wr, 681 op/s 2024-06-06T03:30:25.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.877+0000 7facd5e7b700 1 -- 172.21.15.50:0/1519273678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facd0102620 msgr2=0x7facd0102a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:25.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.878+0000 7facd5e7b700 1 --2- 172.21.15.50:0/1519273678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facd0102620 0x7facd0102a00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7facc800b0d0 tx=0x7facc800b3e0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.878+0000 7facd5e7b700 1 -- 172.21.15.50:0/1519273678 shutdown_connections 2024-06-06T03:30:25.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.878+0000 7facd5e7b700 1 --2- 172.21.15.50:0/1519273678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facd0107700 0x7facd010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.878+0000 7facd5e7b700 1 --2- 172.21.15.50:0/1519273678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facd0102620 0x7facd0102a00 secure :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7facc800b0d0 tx=0x7facc800b3e0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.878+0000 7facd5e7b700 1 --2- 172.21.15.50:0/1519273678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facd0102fd0 0x7facd0107020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.878+0000 7facd5e7b700 1 -- 172.21.15.50:0/1519273678 >> 172.21.15.50:0/1519273678 conn(0x7facd00fdf10 msgr2=0x7facd0100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:25.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.878+0000 7facd5e7b700 1 -- 172.21.15.50:0/1519273678 shutdown_connections 2024-06-06T03:30:25.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.879+0000 7facd5e7b700 1 -- 172.21.15.50:0/1519273678 wait complete. 2024-06-06T03:30:25.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.880+0000 7facd5e7b700 1 Processor -- start 2024-06-06T03:30:25.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.881+0000 7facd5e7b700 1 -- start start 2024-06-06T03:30:25.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.881+0000 7facd5e7b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facd0102fd0 0x7facd0198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:25.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.881+0000 7facd5e7b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facd0107700 0x7facd01992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:25.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.881+0000 7facd5e7b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facd019d600 0x7facd019da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:25.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.882+0000 7facd5e7b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7facd0112610 con 0x7facd0107700 2024-06-06T03:30:25.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.882+0000 7faccffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facd0107700 0x7facd01992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:25.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.882+0000 7faccffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facd0107700 0x7facd01992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47546/0 (socket says 172.21.15.50:47546) 2024-06-06T03:30:25.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.882+0000 7faccffff700 1 -- 172.21.15.50:0/931989074 learned_addr learned my addr 172.21.15.50:0/931989074 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:25.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.882+0000 7facd4e79700 1 --2- 172.21.15.50:0/931989074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facd0102fd0 0x7facd0198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:25.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.882+0000 7facd567a700 1 --2- 172.21.15.50:0/931989074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facd019d600 0x7facd019da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:25.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.882+0000 7facd5e7b700 1 -- 172.21.15.50:0/931989074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7facd0112490 con 0x7facd019d600 2024-06-06T03:30:25.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.882+0000 7facd5e7b700 1 -- 172.21.15.50:0/931989074 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7facd0112790 con 0x7facd0102fd0 2024-06-06T03:30:25.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.883+0000 7faccffff700 1 -- 172.21.15.50:0/931989074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facd0102fd0 msgr2=0x7facd0198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:25.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.883+0000 7faccffff700 1 --2- 172.21.15.50:0/931989074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facd0102fd0 0x7facd0198d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.883+0000 7faccffff700 1 -- 172.21.15.50:0/931989074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facd019d600 msgr2=0x7facd019da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:25.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.883+0000 7faccffff700 1 --2- 172.21.15.50:0/931989074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facd019d600 0x7facd019da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.883+0000 7faccffff700 1 -- 172.21.15.50:0/931989074 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd019e120 con 0x7facd0107700 2024-06-06T03:30:25.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.884+0000 7faccffff700 1 --2- 172.21.15.50:0/931989074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facd0107700 0x7facd01992c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7facc000b500 tx=0x7facc000b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:25.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.886+0000 7faccdffb700 1 -- 172.21.15.50:0/931989074 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc001d070 con 0x7facd0107700 2024-06-06T03:30:25.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.887+0000 7faccdffb700 1 -- 172.21.15.50:0/931989074 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7facc0010e20 con 0x7facd0107700 2024-06-06T03:30:25.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.887+0000 7faccdffb700 1 -- 172.21.15.50:0/931989074 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc0016340 con 0x7facd0107700 2024-06-06T03:30:25.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.887+0000 7facd5e7b700 1 -- 172.21.15.50:0/931989074 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facd019e410 con 0x7facd0107700 2024-06-06T03:30:25.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.887+0000 7facd5e7b700 1 -- 172.21.15.50:0/931989074 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facd00749b0 con 0x7facd0107700 2024-06-06T03:30:25.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.893+0000 7face1960b80 1 Processor -- start 2024-06-06T03:30:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.893+0000 7face1960b80 1 -- start start 2024-06-06T03:30:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.893+0000 7face1960b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf03d79db0 0x55cf03d7a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.893+0000 7face1960b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf03d7a6d0 0x55cf03d7e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.894+0000 7facd567a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf03d79db0 0x55cf03d7a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.894+0000 7facd567a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf03d79db0 0x55cf03d7a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:49388/0 (socket says 172.21.15.50:49388) 2024-06-06T03:30:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.894+0000 7facd567a700 1 -- 172.21.15.50:0/839057617 learned_addr learned my addr 172.21.15.50:0/839057617 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.894+0000 7face1960b80 1 --2- 172.21.15.50:0/839057617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cf03d7ea80 0x55cf03d7eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.894+0000 7face1960b80 1 -- 172.21.15.50:0/839057617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cf03cba890 con 0x55cf03d7a6d0 2024-06-06T03:30:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.894+0000 7face1960b80 1 -- 172.21.15.50:0/839057617 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55cf03c627a0 con 0x55cf03d79db0 2024-06-06T03:30:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.894+0000 7face1960b80 1 -- 172.21.15.50:0/839057617 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55cf03cb6850 con 0x55cf03d7ea80 2024-06-06T03:30:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.894+0000 7facd4e79700 1 --2- 172.21.15.50:0/839057617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf03d7a6d0 0x55cf03d7e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:25.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.895+0000 7facd4e79700 1 -- 172.21.15.50:0/839057617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cf03d7ea80 msgr2=0x55cf03d7eee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:30:25.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.895+0000 7facd4e79700 1 --2- 172.21.15.50:0/839057617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cf03d7ea80 0x55cf03d7eee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.895+0000 7facd4e79700 1 -- 172.21.15.50:0/839057617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf03d79db0 msgr2=0x55cf03d7a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:25.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.895+0000 7facd4e79700 1 --2- 172.21.15.50:0/839057617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf03d79db0 0x55cf03d7a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.895+0000 7facd4e79700 1 -- 172.21.15.50:0/839057617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf03c58fd0 con 0x55cf03d7a6d0 2024-06-06T03:30:25.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.895+0000 7facd567a700 1 --2- 172.21.15.50:0/839057617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf03d79db0 0x55cf03d7a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:30:25.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.895+0000 7facd4e79700 1 --2- 172.21.15.50:0/839057617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf03d7a6d0 0x55cf03d7e540 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7facc8008000 tx=0x7facc80090d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8724dcb2edd1e3f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:25.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.897+0000 7facb6ffd700 1 -- 172.21.15.50:0/839057617 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc8020070 con 0x55cf03d7a6d0 2024-06-06T03:30:25.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.897+0000 7facb6ffd700 1 -- 172.21.15.50:0/839057617 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7facc80074e0 con 0x55cf03d7a6d0 2024-06-06T03:30:25.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.897+0000 7facb6ffd700 1 -- 172.21.15.50:0/839057617 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc80052a0 con 0x55cf03d7a6d0 2024-06-06T03:30:25.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.898+0000 7face1960b80 1 -- 172.21.15.50:0/839057617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf03d7a6d0 msgr2=0x55cf03d7e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:25.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.898+0000 7faccdffb700 1 -- 172.21.15.50:0/931989074 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7facc0020070 con 0x7facd0107700 2024-06-06T03:30:25.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.898+0000 7face1960b80 1 --2- 172.21.15.50:0/839057617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf03d7a6d0 0x55cf03d7e540 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7facc8008000 tx=0x7facc80090d0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.899+0000 7faccdffb700 1 --2- 172.21.15.50:0/931989074 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7facb80a2d70 0x7facb80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:25.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.899+0000 7faccdffb700 1 -- 172.21.15.50:0/931989074 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7facc000c150 con 0x7facd0107700 2024-06-06T03:30:25.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.900+0000 7facd567a700 1 --2- 172.21.15.50:0/931989074 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7facb80a2d70 0x7facb80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:25.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.900+0000 7face1960b80 1 -- 172.21.15.50:0/839057617 shutdown_connections 2024-06-06T03:30:25.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.900+0000 7face1960b80 1 --2- 172.21.15.50:0/839057617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cf03d7ea80 0x55cf03d7eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.900+0000 7face1960b80 1 --2- 172.21.15.50:0/839057617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf03d79db0 0x55cf03d7a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.900+0000 7face1960b80 1 --2- 172.21.15.50:0/839057617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf03d7a6d0 0x55cf03d7e540 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.900+0000 7face1960b80 1 -- 172.21.15.50:0/839057617 >> 172.21.15.50:0/839057617 conn(0x55cf03c93d40 msgr2=0x55cf03d63b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:25.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.900+0000 7face1960b80 1 -- 172.21.15.50:0/839057617 shutdown_connections 2024-06-06T03:30:25.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.900+0000 7face1960b80 1 -- 172.21.15.50:0/839057617 wait complete. 2024-06-06T03:30:25.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.901+0000 7face1960b80 1 -- start start 2024-06-06T03:30:25.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.901+0000 7face1960b80 1 Processor -- start 2024-06-06T03:30:25.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.902+0000 7face1960b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf03d79db0 0x55cf03d86010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:25.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.902+0000 7face1960b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cf03d7a6d0 0x55cf03d83360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:25.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.902+0000 7face1960b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf03d7ea80 0x55cf03d838a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:25.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.902+0000 7face1960b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cf03d86be0 con 0x55cf03d79db0 2024-06-06T03:30:25.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.902+0000 7face1960b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55cf03c5ac70 con 0x55cf03d7ea80 2024-06-06T03:30:25.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.902+0000 7face1960b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55cf03d86d60 con 0x55cf03d7a6d0 2024-06-06T03:30:25.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.902+0000 7face1960b80 10 client.0 _ll_register_callbacks cb 0x55cf03c549a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:30:25.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.903+0000 7facd567a700 1 --2- 172.21.15.50:0/931989074 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7facb80a2d70 0x7facb80a5230 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7facc4005950 tx=0x7facc400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:25.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.903+0000 7facd567a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf03d7ea80 0x55cf03d838a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:25.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.903+0000 7facd567a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf03d7ea80 0x55cf03d838a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:49394/0 (socket says 172.21.15.50:49394) 2024-06-06T03:30:25.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.903+0000 7facd567a700 1 -- 172.21.15.50:0/500436479 learned_addr learned my addr 172.21.15.50:0/500436479 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:25.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.903+0000 7facd4e79700 1 --2- 172.21.15.50:0/500436479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf03d79db0 0x55cf03d86010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:25.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.903+0000 7facd567a700 1 -- 172.21.15.50:0/500436479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cf03d7a6d0 msgr2=0x55cf03d83360 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:30:25.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.903+0000 7facd567a700 1 --2- 172.21.15.50:0/500436479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cf03d7a6d0 0x55cf03d83360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.903+0000 7facd567a700 1 -- 172.21.15.50:0/500436479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf03d79db0 msgr2=0x55cf03d86010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:25.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.903+0000 7facd567a700 1 --2- 172.21.15.50:0/500436479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf03d79db0 0x55cf03d86010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.903+0000 7facd567a700 1 -- 172.21.15.50:0/500436479 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf03c09950 con 0x55cf03d7ea80 2024-06-06T03:30:25.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.905+0000 7facd567a700 1 --2- 172.21.15.50:0/500436479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf03d7ea80 0x55cf03d838a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7facc4003df0 tx=0x7facc4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb88e9fa45519f77 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:25.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.905+0000 7facaffff700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:30:25.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.905+0000 7facaffff700 1 -- 172.21.15.50:0/500436479 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc4004a30 con 0x55cf03d7ea80 2024-06-06T03:30:25.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.905+0000 7face1960b80 1 -- 172.21.15.50:0/500436479 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facc80074e0 con 0x55cf03d7ea80 2024-06-06T03:30:25.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.905+0000 7facaffff700 1 -- 172.21.15.50:0/500436479 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7facc4004bd0 con 0x55cf03d7ea80 2024-06-06T03:30:25.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.905+0000 7facaffff700 1 -- 172.21.15.50:0/500436479 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7facc4003e20 con 0x55cf03d7ea80 2024-06-06T03:30:25.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.906+0000 7face1960b80 10 client.25652 fetch_fsmap learned FSMap version 31 2024-06-06T03:30:25.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.906+0000 7face1960b80 1 -- 172.21.15.50:0/500436479 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55cf03d99dd0 con 0x55cf03d7ea80 2024-06-06T03:30:25.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.907+0000 7facaffff700 1 -- 172.21.15.50:0/500436479 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7facc80074e0 con 0x55cf03d7ea80 2024-06-06T03:30:25.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.907+0000 7facaffff700 1 -- 172.21.15.50:0/500436479 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7facc4024030 con 0x55cf03d7ea80 2024-06-06T03:30:25.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.908+0000 7face1960b80 10 client.25652 fetch_fsmap finished waiting for FSMap version 31 2024-06-06T03:30:25.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.908+0000 7face1960b80 10 client.25652 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:30:25.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.908+0000 7face1960b80 20 client.25652 populate_metadata read hostname 'smithi050' 2024-06-06T03:30:25.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.908+0000 7face1960b80 1 --2- 172.21.15.50:0/500436479 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55cf03d9c410 0x55cf03d9e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:25.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.908+0000 7face1960b80 4 client.25652 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:30:25.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.908+0000 7face1960b80 1 -- 172.21.15.50:0/500436479 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf03cc7d90 con 0x55cf03d9c410 2024-06-06T03:30:25.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.911+0000 7facd4e79700 1 --2- 172.21.15.50:0/500436479 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55cf03d9c410 0x55cf03d9e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:25.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.913+0000 7facaffff700 10 client.25652 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:30:25.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.913+0000 7facd4e79700 1 --2- 172.21.15.50:0/500436479 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55cf03d9c410 0x55cf03d9e800 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=358cb9367d75693 server_cookie=b600214aad15c88f in_seq=0 out_seq=0 2024-06-06T03:30:25.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.915+0000 7facaffff700 1 -- 172.21.15.50:0/500436479 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55cf03cc7d90 con 0x55cf03d9c410 2024-06-06T03:30:25.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.915+0000 7facaffff700 10 client.25652 handle_command_reply: tid=0 2024-06-06T03:30:25.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.916+0000 7face1960b80 1 client.25652 shutdown 2024-06-06T03:30:25.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.916+0000 7face1960b80 1 -- 172.21.15.50:0/500436479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf03d7ea80 msgr2=0x55cf03d838a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:25.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.916+0000 7face1960b80 1 --2- 172.21.15.50:0/500436479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf03d7ea80 0x55cf03d838a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7facc4003df0 tx=0x7facc4004750 comp rx=0 tx=0).stop 2024-06-06T03:30:25.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.917+0000 7face1960b80 1 -- 172.21.15.50:0/500436479 shutdown_connections 2024-06-06T03:30:25.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.917+0000 7face1960b80 1 --2- 172.21.15.50:0/500436479 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55cf03d9c410 0x55cf03d9e800 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.917+0000 7face1960b80 1 --2- 172.21.15.50:0/500436479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf03d7ea80 0x55cf03d838a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.917+0000 7face1960b80 1 --2- 172.21.15.50:0/500436479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf03d79db0 0x55cf03d86010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.917+0000 7face1960b80 1 --2- 172.21.15.50:0/500436479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cf03d7a6d0 0x55cf03d83360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.917+0000 7face1960b80 1 -- 172.21.15.50:0/500436479 >> 172.21.15.50:0/500436479 conn(0x55cf03c93d40 msgr2=0x55cf03d67bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:25.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.917+0000 7facaffff700 0 client.25652 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:30:25.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.918+0000 7face1960b80 1 -- 172.21.15.50:0/500436479 shutdown_connections 2024-06-06T03:30:25.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.918+0000 7face1960b80 1 -- 172.21.15.50:0/500436479 wait complete. 2024-06-06T03:30:25.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.919+0000 7face1960b80 20 client.25652 trim_cache size 0 max 16384 2024-06-06T03:30:25.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.966+0000 7face1960b80 1 Processor -- start 2024-06-06T03:30:25.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.966+0000 7face1960b80 1 -- start start 2024-06-06T03:30:25.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.966+0000 7face1960b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cf03d79db0 0x55cf03d63bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:25.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.966+0000 7face1960b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf03d7a6d0 0x55cf03d5d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:25.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.966+0000 7face1960b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf03d7ea80 0x55cf03d85250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:25.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.967+0000 7face1960b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7facd01a6480 con 0x55cf03d7ea80 2024-06-06T03:30:25.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.967+0000 7face1960b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7facd0072b10 con 0x55cf03d7a6d0 2024-06-06T03:30:25.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.967+0000 7face1960b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7facd0070960 con 0x55cf03d79db0 2024-06-06T03:30:25.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.967+0000 7facd4e79700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cf03d79db0 0x55cf03d63bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:25.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.968+0000 7facd4e79700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cf03d79db0 0x55cf03d63bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:58354/0 (socket says 172.21.15.50:58354) 2024-06-06T03:30:25.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.968+0000 7facd4e79700 1 -- 172.21.15.50:0/279331349 learned_addr learned my addr 172.21.15.50:0/279331349 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:25.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.968+0000 7facd567a700 1 --2- 172.21.15.50:0/279331349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf03d7ea80 0x55cf03d85250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:25.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.968+0000 7faccffff700 1 --2- 172.21.15.50:0/279331349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf03d7a6d0 0x55cf03d5d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:25.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.968+0000 7facd567a700 1 -- 172.21.15.50:0/279331349 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cf03d79db0 msgr2=0x55cf03d63bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:25.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.968+0000 7facd567a700 1 --2- 172.21.15.50:0/279331349 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cf03d79db0 0x55cf03d63bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.968+0000 7facd567a700 1 -- 172.21.15.50:0/279331349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf03d7a6d0 msgr2=0x55cf03d5d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:25.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.968+0000 7facd567a700 1 --2- 172.21.15.50:0/279331349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf03d7a6d0 0x55cf03d5d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.968+0000 7facd567a700 1 -- 172.21.15.50:0/279331349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf03d7ab70 con 0x55cf03d7ea80 2024-06-06T03:30:25.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.969+0000 7facd567a700 1 --2- 172.21.15.50:0/279331349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf03d7ea80 0x55cf03d85250 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7facc4012ac0 tx=0x7facc40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=954085f4a9353ad0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:25.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.970+0000 7facb67fc700 1 -- 172.21.15.50:0/279331349 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc401bcd0 con 0x55cf03d7ea80 2024-06-06T03:30:25.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.971+0000 7facb67fc700 1 -- 172.21.15.50:0/279331349 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7facc40054e0 con 0x55cf03d7ea80 2024-06-06T03:30:25.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.971+0000 7facb67fc700 1 -- 172.21.15.50:0/279331349 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc4004b60 con 0x55cf03d7ea80 2024-06-06T03:30:25.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.972+0000 7face1960b80 1 -- 172.21.15.50:0/279331349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf03d7ea80 msgr2=0x55cf03d85250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:25.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.972+0000 7face1960b80 1 --2- 172.21.15.50:0/279331349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf03d7ea80 0x55cf03d85250 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7facc4012ac0 tx=0x7facc40045e0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.972+0000 7face1960b80 1 -- 172.21.15.50:0/279331349 shutdown_connections 2024-06-06T03:30:25.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.972+0000 7face1960b80 1 --2- 172.21.15.50:0/279331349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf03d7ea80 0x55cf03d85250 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.972+0000 7face1960b80 1 --2- 172.21.15.50:0/279331349 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cf03d79db0 0x55cf03d63bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.972+0000 7face1960b80 1 --2- 172.21.15.50:0/279331349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf03d7a6d0 0x55cf03d5d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.972+0000 7face1960b80 1 -- 172.21.15.50:0/279331349 >> 172.21.15.50:0/279331349 conn(0x55cf03c93d40 msgr2=0x55cf03d84b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:25.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.974+0000 7face1960b80 1 -- 172.21.15.50:0/279331349 shutdown_connections 2024-06-06T03:30:25.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.974+0000 7face1960b80 1 -- 172.21.15.50:0/279331349 wait complete. 2024-06-06T03:30:25.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.975+0000 7face1960b80 1 -- start start 2024-06-06T03:30:25.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.975+0000 7face1960b80 1 Processor -- start 2024-06-06T03:30:25.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.976+0000 7face1960b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf03d79db0 0x55cf03d94bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:25.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.976+0000 7face1960b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cf03d7a6d0 0x55cf03d95130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:25.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.976+0000 7face1960b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf03d7ea80 0x55cf03d911d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:25.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.976+0000 7face1960b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7facd0070fd0 con 0x55cf03d79db0 2024-06-06T03:30:25.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.976+0000 7face1960b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7facd0072440 con 0x55cf03d7ea80 2024-06-06T03:30:25.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.976+0000 7face1960b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7facd00716a0 con 0x55cf03d7a6d0 2024-06-06T03:30:25.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.976+0000 7face1960b80 10 client.0 _ll_register_callbacks cb 0x55cf03c549a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:30:25.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.977+0000 7faccffff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cf03d7a6d0 0x55cf03d95130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:25.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.977+0000 7faccffff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cf03d7a6d0 0x55cf03d95130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:58366/0 (socket says 172.21.15.50:58366) 2024-06-06T03:30:25.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.977+0000 7faccffff700 1 -- 172.21.15.50:0/3015636235 learned_addr learned my addr 172.21.15.50:0/3015636235 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:25.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.977+0000 7facd567a700 1 --2- 172.21.15.50:0/3015636235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf03d7ea80 0x55cf03d911d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:25.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.977+0000 7facd4e79700 1 --2- 172.21.15.50:0/3015636235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf03d79db0 0x55cf03d94bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:25.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.978+0000 7faccffff700 1 -- 172.21.15.50:0/3015636235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf03d7ea80 msgr2=0x55cf03d911d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:25.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.978+0000 7faccffff700 1 --2- 172.21.15.50:0/3015636235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf03d7ea80 0x55cf03d911d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.978+0000 7faccffff700 1 -- 172.21.15.50:0/3015636235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf03d79db0 msgr2=0x55cf03d94bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.978+0000 7faccffff700 1 --2- 172.21.15.50:0/3015636235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf03d79db0 0x55cf03d94bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.978+0000 7faccffff700 1 -- 172.21.15.50:0/3015636235 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf03d91940 con 0x55cf03d7a6d0 2024-06-06T03:30:25.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.980+0000 7faccffff700 1 --2- 172.21.15.50:0/3015636235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cf03d7a6d0 0x55cf03d95130 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7facc000b4d0 tx=0x7facc0004860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb8fc689aa2b8402 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:25.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.980+0000 7facaffff700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:30:25.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.981+0000 7facaffff700 1 -- 172.21.15.50:0/3015636235 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc009e7b0 con 0x55cf03d7a6d0 2024-06-06T03:30:25.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.981+0000 7facaffff700 1 -- 172.21.15.50:0/3015636235 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7facc0018760 con 0x55cf03d7a6d0 2024-06-06T03:30:25.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.982+0000 7face1960b80 1 -- 172.21.15.50:0/3015636235 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facc40054e0 con 0x55cf03d7a6d0 2024-06-06T03:30:25.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.984+0000 7facaffff700 1 -- 172.21.15.50:0/3015636235 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7facc00bc050 con 0x55cf03d7a6d0 2024-06-06T03:30:25.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.984+0000 7face1960b80 10 client.25639 fetch_fsmap learned FSMap version 31 2024-06-06T03:30:25.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.984+0000 7face1960b80 1 -- 172.21.15.50:0/3015636235 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55cf03d87d10 con 0x55cf03d7a6d0 2024-06-06T03:30:25.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.985+0000 7facaffff700 1 -- 172.21.15.50:0/3015636235 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7facc40054e0 con 0x55cf03d7a6d0 2024-06-06T03:30:25.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.985+0000 7facaffff700 1 -- 172.21.15.50:0/3015636235 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7facc00100d0 con 0x55cf03d7a6d0 2024-06-06T03:30:25.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.985+0000 7face1960b80 10 client.25639 fetch_fsmap finished waiting for FSMap version 31 2024-06-06T03:30:25.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.985+0000 7face1960b80 10 client.25639 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:30:25.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.985+0000 7face1960b80 20 client.25639 populate_metadata read hostname 'smithi050' 2024-06-06T03:30:25.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.985+0000 7face1960b80 1 --2- 172.21.15.50:0/3015636235 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55cf03d883d0 0x55cf03d8a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:25.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.985+0000 7face1960b80 4 client.25639 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-06T03:30:25.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.985+0000 7face1960b80 1 -- 172.21.15.50:0/3015636235 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55cf03cc2310 con 0x55cf03d883d0 2024-06-06T03:30:25.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.986+0000 7facd4e79700 1 --2- 172.21.15.50:0/3015636235 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55cf03d883d0 0x55cf03d8a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:25.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.988+0000 7facd4e79700 1 --2- 172.21.15.50:0/3015636235 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55cf03d883d0 0x55cf03d8a7f0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d803902743cf4ffc server_cookie=80f625c63c7d8d0f in_seq=0 out_seq=0 2024-06-06T03:30:25.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.989+0000 7facaffff700 10 client.25639 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:30:25.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.989+0000 7facaffff700 1 -- 172.21.15.50:0/3015636235 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55cf03cc2310 con 0x55cf03d883d0 2024-06-06T03:30:25.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.989+0000 7facaffff700 10 client.25639 handle_command_reply: tid=0 2024-06-06T03:30:25.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.990+0000 7face1960b80 1 client.25639 shutdown 2024-06-06T03:30:25.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.990+0000 7face1960b80 1 -- 172.21.15.50:0/3015636235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cf03d7a6d0 msgr2=0x55cf03d95130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:25.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.990+0000 7face1960b80 1 --2- 172.21.15.50:0/3015636235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cf03d7a6d0 0x55cf03d95130 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7facc000b4d0 tx=0x7facc0004860 comp rx=0 tx=0).stop 2024-06-06T03:30:25.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.990+0000 7face1960b80 1 -- 172.21.15.50:0/3015636235 shutdown_connections 2024-06-06T03:30:25.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.990+0000 7face1960b80 1 --2- 172.21.15.50:0/3015636235 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55cf03d883d0 0x55cf03d8a7f0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.990+0000 7face1960b80 1 --2- 172.21.15.50:0/3015636235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf03d7ea80 0x55cf03d911d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.990+0000 7face1960b80 1 --2- 172.21.15.50:0/3015636235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf03d79db0 0x55cf03d94bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.990+0000 7face1960b80 1 --2- 172.21.15.50:0/3015636235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cf03d7a6d0 0x55cf03d95130 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.990+0000 7facaffff700 0 client.25639 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:30:25.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.990+0000 7face1960b80 1 -- 172.21.15.50:0/3015636235 >> 172.21.15.50:0/3015636235 conn(0x55cf03c93d40 msgr2=0x55cf03d7e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:25.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.990+0000 7face1960b80 1 -- 172.21.15.50:0/3015636235 shutdown_connections 2024-06-06T03:30:25.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.990+0000 7face1960b80 1 -- 172.21.15.50:0/3015636235 wait complete. 2024-06-06T03:30:25.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.991+0000 7face1960b80 20 client.25639 trim_cache size 0 max 16384 2024-06-06T03:30:25.991 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:30:25.991 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-06-06T03:30:25.991 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "19bbdcc6-af05-4447-8ad0-7fa6229f2b45", 2024-06-06T03:30:25.991 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-06-06T03:30:25.991 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:30:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.994+0000 7facd5e7b700 1 -- 172.21.15.50:0/931989074 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7facb80a2d70 msgr2=0x7facb80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.994+0000 7facd5e7b700 1 --2- 172.21.15.50:0/931989074 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7facb80a2d70 0x7facb80a5230 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7facc4005950 tx=0x7facc400b390 comp rx=0 tx=0).stop 2024-06-06T03:30:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.994+0000 7facd5e7b700 1 -- 172.21.15.50:0/931989074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facd0107700 msgr2=0x7facd01992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.994+0000 7facd5e7b700 1 --2- 172.21.15.50:0/931989074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facd0107700 0x7facd01992c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7facc000b500 tx=0x7facc000b810 comp rx=0 tx=0).stop 2024-06-06T03:30:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.995+0000 7facd5e7b700 1 -- 172.21.15.50:0/931989074 shutdown_connections 2024-06-06T03:30:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.995+0000 7facd5e7b700 1 --2- 172.21.15.50:0/931989074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facd019d600 0x7facd019da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.995+0000 7facd5e7b700 1 --2- 172.21.15.50:0/931989074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facd0102fd0 0x7facd0198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.995+0000 7facd5e7b700 1 --2- 172.21.15.50:0/931989074 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7facb80a2d70 0x7facb80a5230 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.995+0000 7facd5e7b700 1 --2- 172.21.15.50:0/931989074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facd0107700 0x7facd01992c0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.995+0000 7facd5e7b700 1 -- 172.21.15.50:0/931989074 >> 172.21.15.50:0/931989074 conn(0x7facd00fdf10 msgr2=0x7facd00ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.995+0000 7facd5e7b700 1 -- 172.21.15.50:0/931989074 shutdown_connections 2024-06-06T03:30:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:25.995+0000 7facd5e7b700 1 -- 172.21.15.50:0/931989074 wait complete. 2024-06-06T03:30:26.541 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:26 smithi050 ceph-mon[32421]: scrub queued for path: / 2024-06-06T03:30:26.541 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:26 smithi050 ceph-mon[32421]: scrub summary: idle+waiting paths [/] 2024-06-06T03:30:26.541 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:26 smithi050 ceph-mon[32421]: scrub summary: active paths [/] 2024-06-06T03:30:26.541 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:26 smithi050 ceph-mon[32421]: scrub summary: idle+waiting paths [/] 2024-06-06T03:30:26.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:26 smithi079 ceph-mon[35478]: scrub queued for path: / 2024-06-06T03:30:26.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:26 smithi079 ceph-mon[35478]: scrub summary: idle+waiting paths [/] 2024-06-06T03:30:26.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:26 smithi079 ceph-mon[35478]: scrub summary: active paths [/] 2024-06-06T03:30:26.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:26 smithi079 ceph-mon[35478]: scrub summary: idle+waiting paths [/] 2024-06-06T03:30:26.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:26 smithi122 ceph-mon[35759]: scrub queued for path: / 2024-06-06T03:30:26.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:26 smithi122 ceph-mon[35759]: scrub summary: idle+waiting paths [/] 2024-06-06T03:30:26.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:26 smithi122 ceph-mon[35759]: scrub summary: active paths [/] 2024-06-06T03:30:26.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:26 smithi122 ceph-mon[35759]: scrub summary: idle+waiting paths [/] 2024-06-06T03:30:27.163 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-06T03:30:27.504 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:27 smithi050 ceph-mon[32421]: pgmap v545: 129 pgs: 129 active+clean; 10 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 46 MiB/s wr, 747 op/s 2024-06-06T03:30:27.504 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:27 smithi050 ceph-mon[32421]: scrub summary: active paths [/] 2024-06-06T03:30:27.504 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:27 smithi050 ceph-mon[32421]: scrub summary: idle+waiting paths [/] 2024-06-06T03:30:27.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:27 smithi079 ceph-mon[35478]: pgmap v545: 129 pgs: 129 active+clean; 10 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 46 MiB/s wr, 747 op/s 2024-06-06T03:30:27.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:27 smithi079 ceph-mon[35478]: scrub summary: active paths [/] 2024-06-06T03:30:27.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:27 smithi079 ceph-mon[35478]: scrub summary: idle+waiting paths [/] 2024-06-06T03:30:27.647 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:30:27.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:27 smithi122 ceph-mon[35759]: pgmap v545: 129 pgs: 129 active+clean; 10 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 46 MiB/s wr, 747 op/s 2024-06-06T03:30:27.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:27 smithi122 ceph-mon[35759]: scrub summary: active paths [/] 2024-06-06T03:30:27.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:27 smithi122 ceph-mon[35759]: scrub summary: idle+waiting paths [/] 2024-06-06T03:30:28.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:28 smithi050 ceph-mon[32421]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:30:28.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:28 smithi050 ceph-mon[32421]: pgmap v546: 129 pgs: 129 active+clean; 10 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 41 MiB/s wr, 656 op/s 2024-06-06T03:30:28.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:28 smithi079 ceph-mon[35478]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:30:28.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:28 smithi079 ceph-mon[35478]: pgmap v546: 129 pgs: 129 active+clean; 10 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 41 MiB/s wr, 656 op/s 2024-06-06T03:30:28.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:28 smithi122 ceph-mon[35759]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:30:28.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:28 smithi122 ceph-mon[35759]: pgmap v546: 129 pgs: 129 active+clean; 10 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 41 MiB/s wr, 656 op/s 2024-06-06T03:30:30.817 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:30 smithi050 ceph-mon[32421]: pgmap v547: 129 pgs: 129 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 51 MiB/s wr, 827 op/s 2024-06-06T03:30:30.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:30 smithi079 ceph-mon[35478]: pgmap v547: 129 pgs: 129 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 51 MiB/s wr, 827 op/s 2024-06-06T03:30:30.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:30 smithi122 ceph-mon[35759]: pgmap v547: 129 pgs: 129 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 51 MiB/s wr, 827 op/s 2024-06-06T03:30:31.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.313+0000 7f312236c700 1 -- 172.21.15.50:0/4105090234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f311c109db0 msgr2=0x7f311c1150a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:31.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.313+0000 7f312236c700 1 --2- 172.21.15.50:0/4105090234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f311c109db0 0x7f311c1150a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f310c00b0a0 tx=0x7f310c00b3b0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.314+0000 7f312236c700 1 -- 172.21.15.50:0/4105090234 shutdown_connections 2024-06-06T03:30:31.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.314+0000 7f312236c700 1 --2- 172.21.15.50:0/4105090234 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f311c1155e0 0x7f311c1179d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.314+0000 7f312236c700 1 --2- 172.21.15.50:0/4105090234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f311c109490 0x7f311c109870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.314+0000 7f312236c700 1 --2- 172.21.15.50:0/4105090234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f311c109db0 0x7f311c1150a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.314+0000 7f312236c700 1 -- 172.21.15.50:0/4105090234 >> 172.21.15.50:0/4105090234 conn(0x7f311c06d600 msgr2=0x7f311c06da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:31.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.314+0000 7f312236c700 1 -- 172.21.15.50:0/4105090234 shutdown_connections 2024-06-06T03:30:31.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.314+0000 7f312236c700 1 -- 172.21.15.50:0/4105090234 wait complete. 2024-06-06T03:30:31.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.315+0000 7f312236c700 1 Processor -- start 2024-06-06T03:30:31.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.315+0000 7f312236c700 1 -- start start 2024-06-06T03:30:31.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.316+0000 7f312236c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f311c109490 0x7f311c114230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:31.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.316+0000 7f312236c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f311c109db0 0x7f311c114770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:31.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.316+0000 7f312236c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f311c1155e0 0x7f311c1a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:31.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.316+0000 7f311bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f311c109490 0x7f311c114230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:31.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.316+0000 7f311bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f311c109490 0x7f311c114230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36834/0 (socket says 172.21.15.50:36834) 2024-06-06T03:30:31.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.316+0000 7f311bfff700 1 -- 172.21.15.50:0/3986613918 learned_addr learned my addr 172.21.15.50:0/3986613918 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:31.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.316+0000 7f312236c700 1 -- 172.21.15.50:0/3986613918 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f311c11af30 con 0x7f311c109490 2024-06-06T03:30:31.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.316+0000 7f312236c700 1 -- 172.21.15.50:0/3986613918 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f311c11adb0 con 0x7f311c1155e0 2024-06-06T03:30:31.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.316+0000 7f312236c700 1 -- 172.21.15.50:0/3986613918 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f311c11b0b0 con 0x7f311c109db0 2024-06-06T03:30:31.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.317+0000 7f311bfff700 1 -- 172.21.15.50:0/3986613918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f311c109db0 msgr2=0x7f311c114770 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-06T03:30:31.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.317+0000 7f311bfff700 1 --2- 172.21.15.50:0/3986613918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f311c109db0 0x7f311c114770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.317+0000 7f311bfff700 1 -- 172.21.15.50:0/3986613918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f311c1155e0 msgr2=0x7f311c1a3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:31.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.317+0000 7f3120909700 1 --2- 172.21.15.50:0/3986613918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f311c1155e0 0x7f311c1a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:31.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.317+0000 7f311bfff700 1 --2- 172.21.15.50:0/3986613918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f311c1155e0 0x7f311c1a3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.317+0000 7f311bfff700 1 -- 172.21.15.50:0/3986613918 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f311c1a4110 con 0x7f311c109490 2024-06-06T03:30:31.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.317+0000 7f311bfff700 1 --2- 172.21.15.50:0/3986613918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f311c109490 0x7f311c114230 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f311400b530 tx=0x7f311400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:31.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.318+0000 7f31197fa700 1 -- 172.21.15.50:0/3986613918 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3114015020 con 0x7f311c109490 2024-06-06T03:30:31.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.318+0000 7f31197fa700 1 -- 172.21.15.50:0/3986613918 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3114011ce0 con 0x7f311c109490 2024-06-06T03:30:31.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.318+0000 7f31197fa700 1 -- 172.21.15.50:0/3986613918 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3114010d60 con 0x7f311c109490 2024-06-06T03:30:31.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.319+0000 7f312236c700 1 -- 172.21.15.50:0/3986613918 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f311c1a4400 con 0x7f311c109490 2024-06-06T03:30:31.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.319+0000 7f312236c700 1 -- 172.21.15.50:0/3986613918 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f311c1a0940 con 0x7f311c109490 2024-06-06T03:30:31.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.325+0000 7f312cbefb80 1 Processor -- start 2024-06-06T03:30:31.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.325+0000 7f312cbefb80 1 -- start start 2024-06-06T03:30:31.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.325+0000 7f31197fa700 1 -- 172.21.15.50:0/3986613918 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3114018020 con 0x7f311c109490 2024-06-06T03:30:31.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.325+0000 7f312cbefb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558ee0ef9f60 0x558ee0efa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:31.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.326+0000 7f312cbefb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ee0efa880 0x558ee0ef4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:31.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.326+0000 7f312cbefb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ee0ef47a0 0x558ee0ef4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:31.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.326+0000 7f312cbefb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558ee0de6f60 con 0x558ee0efa880 2024-06-06T03:30:31.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.326+0000 7f312cbefb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558ee0e45850 con 0x558ee0ef47a0 2024-06-06T03:30:31.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.326+0000 7f312cbefb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558ee0dad460 con 0x558ee0ef9f60 2024-06-06T03:30:31.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.326+0000 7f3120909700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558ee0ef9f60 0x558ee0efa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:31.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.326+0000 7f3120909700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558ee0ef9f60 0x558ee0efa340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:44282/0 (socket says 172.21.15.50:44282) 2024-06-06T03:30:31.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.326+0000 7f3120909700 1 -- 172.21.15.50:0/1014870358 learned_addr learned my addr 172.21.15.50:0/1014870358 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:31.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.326+0000 7f311b7fe700 1 --2- 172.21.15.50:0/1014870358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ee0ef47a0 0x558ee0ef4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:31.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.326+0000 7f311bfff700 1 --2- 172.21.15.50:0/1014870358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ee0efa880 0x558ee0ef4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:31.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.327+0000 7f3120909700 1 -- 172.21.15.50:0/1014870358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ee0ef47a0 msgr2=0x558ee0ef4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:31.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.327+0000 7f3120909700 1 --2- 172.21.15.50:0/1014870358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ee0ef47a0 0x558ee0ef4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.327+0000 7f3120909700 1 -- 172.21.15.50:0/1014870358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ee0efa880 msgr2=0x558ee0ef4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:31.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.327+0000 7f3120909700 1 --2- 172.21.15.50:0/1014870358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ee0efa880 0x558ee0ef4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.327+0000 7f3120909700 1 -- 172.21.15.50:0/1014870358 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ee0d948d0 con 0x558ee0ef9f60 2024-06-06T03:30:31.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.327+0000 7f3120909700 1 --2- 172.21.15.50:0/1014870358 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558ee0ef9f60 0x558ee0efa340 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3110009c60 tx=0x7f3110009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=127397d5fc1cba70 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:31.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.329+0000 7f31197fa700 1 --2- 172.21.15.50:0/3986613918 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f31040a2df0 0x7f31040a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:31.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.329+0000 7f31197fa700 1 -- 172.21.15.50:0/3986613918 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f31140ceba0 con 0x7f311c109490 2024-06-06T03:30:31.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.329+0000 7f31027fc700 1 -- 172.21.15.50:0/1014870358 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3110010b80 con 0x558ee0ef9f60 2024-06-06T03:30:31.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.329+0000 7f31027fc700 1 -- 172.21.15.50:0/1014870358 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3110010d20 con 0x558ee0ef9f60 2024-06-06T03:30:31.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.330+0000 7f31027fc700 1 -- 172.21.15.50:0/1014870358 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3110012730 con 0x558ee0ef9f60 2024-06-06T03:30:31.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.330+0000 7f311bfff700 1 --2- 172.21.15.50:0/3986613918 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f31040a2df0 0x7f31040a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:31.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.330+0000 7f312cbefb80 1 -- 172.21.15.50:0/1014870358 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558ee0ef9f60 msgr2=0x558ee0efa340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:31.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.331+0000 7f312cbefb80 1 --2- 172.21.15.50:0/1014870358 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558ee0ef9f60 0x558ee0efa340 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3110009c60 tx=0x7f3110009f70 comp rx=0 tx=0).stop 2024-06-06T03:30:31.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.331+0000 7f312cbefb80 1 -- 172.21.15.50:0/1014870358 shutdown_connections 2024-06-06T03:30:31.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.331+0000 7f312cbefb80 1 --2- 172.21.15.50:0/1014870358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ee0ef47a0 0x558ee0ef4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.331+0000 7f312cbefb80 1 --2- 172.21.15.50:0/1014870358 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558ee0ef9f60 0x558ee0efa340 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.331+0000 7f312cbefb80 1 --2- 172.21.15.50:0/1014870358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ee0efa880 0x558ee0ef4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.331+0000 7f312cbefb80 1 -- 172.21.15.50:0/1014870358 >> 172.21.15.50:0/1014870358 conn(0x558ee0e21080 msgr2=0x558ee0eef220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:31.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.331+0000 7f311bfff700 1 --2- 172.21.15.50:0/3986613918 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f31040a2df0 0x7f31040a52b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f31140a3760 tx=0x7f3114004860 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:31.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.331+0000 7f312cbefb80 1 -- 172.21.15.50:0/1014870358 shutdown_connections 2024-06-06T03:30:31.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.331+0000 7f312cbefb80 1 -- 172.21.15.50:0/1014870358 wait complete. 2024-06-06T03:30:31.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.332+0000 7f312cbefb80 1 -- start start 2024-06-06T03:30:31.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.332+0000 7f312cbefb80 1 Processor -- start 2024-06-06T03:30:31.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.333+0000 7f312cbefb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ee0ef47a0 0x558ee0f005d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:31.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.333+0000 7f312cbefb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558ee0ef9f60 0x558ee0efd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:31.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.333+0000 7f312cbefb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ee0efa880 0x558ee0efde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:31.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.333+0000 7f312cbefb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558ee0de5fc0 con 0x558ee0efa880 2024-06-06T03:30:31.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.333+0000 7f312cbefb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558ee0e41810 con 0x558ee0ef47a0 2024-06-06T03:30:31.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.333+0000 7f312cbefb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558ee0f01300 con 0x558ee0ef9f60 2024-06-06T03:30:31.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.333+0000 7f312cbefb80 10 client.0 _ll_register_callbacks cb 0x558ee0ddb5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:30:31.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.334+0000 7f3120909700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ee0ef47a0 0x558ee0f005d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:31.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.334+0000 7f3120909700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ee0ef47a0 0x558ee0f005d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:56162/0 (socket says 172.21.15.50:56162) 2024-06-06T03:30:31.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.334+0000 7f3120909700 1 -- 172.21.15.50:0/567588970 learned_addr learned my addr 172.21.15.50:0/567588970 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:31.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.334+0000 7f311b7fe700 1 --2- 172.21.15.50:0/567588970 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558ee0ef9f60 0x558ee0efd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:31.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.334+0000 7f3120909700 1 -- 172.21.15.50:0/567588970 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558ee0ef9f60 msgr2=0x558ee0efd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:31.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.334+0000 7f3120909700 1 --2- 172.21.15.50:0/567588970 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558ee0ef9f60 0x558ee0efd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.334+0000 7f3120909700 1 -- 172.21.15.50:0/567588970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ee0efa880 msgr2=0x558ee0efde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:31.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.334+0000 7f3120909700 1 --2- 172.21.15.50:0/567588970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ee0efa880 0x558ee0efde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.334+0000 7f3120909700 1 -- 172.21.15.50:0/567588970 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ee0e0b750 con 0x558ee0ef47a0 2024-06-06T03:30:31.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.334+0000 7f3120909700 1 --2- 172.21.15.50:0/567588970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ee0ef47a0 0x558ee0f005d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3110012840 tx=0x7f3110009420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62ac8ebcd2ed6572 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:31.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.334+0000 7f30fb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:30:31.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.335+0000 7f30fb7fe700 1 -- 172.21.15.50:0/567588970 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311001b480 con 0x558ee0ef47a0 2024-06-06T03:30:31.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.335+0000 7f30fb7fe700 1 -- 172.21.15.50:0/567588970 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f311001b620 con 0x558ee0ef47a0 2024-06-06T03:30:31.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.335+0000 7f312cbefb80 1 -- 172.21.15.50:0/567588970 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3110010d20 con 0x558ee0ef47a0 2024-06-06T03:30:31.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.336+0000 7f30fb7fe700 1 -- 172.21.15.50:0/567588970 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f311001f030 con 0x558ee0ef47a0 2024-06-06T03:30:31.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.336+0000 7f312cbefb80 10 client.25667 fetch_fsmap learned FSMap version 32 2024-06-06T03:30:31.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.336+0000 7f312cbefb80 1 -- 172.21.15.50:0/567588970 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558ee0f0b850 con 0x558ee0ef47a0 2024-06-06T03:30:31.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.336+0000 7f30fb7fe700 1 -- 172.21.15.50:0/567588970 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3110010d20 con 0x558ee0ef47a0 2024-06-06T03:30:31.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.336+0000 7f30fb7fe700 1 -- 172.21.15.50:0/567588970 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f311000f040 con 0x558ee0ef47a0 2024-06-06T03:30:31.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.336+0000 7f312cbefb80 10 client.25667 fetch_fsmap finished waiting for FSMap version 32 2024-06-06T03:30:31.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.336+0000 7f312cbefb80 10 client.25667 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:30:31.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.336+0000 7f312cbefb80 20 client.25667 populate_metadata read hostname 'smithi050' 2024-06-06T03:30:31.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.336+0000 7f312cbefb80 1 --2- 172.21.15.50:0/567588970 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x558ee0f0e0b0 0x558ee0f10510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:31.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.336+0000 7f312cbefb80 4 client.25667 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:30:31.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.336+0000 7f312cbefb80 1 -- 172.21.15.50:0/567588970 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ee0e52d50 con 0x558ee0f0e0b0 2024-06-06T03:30:31.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.337+0000 7f311b7fe700 1 --2- 172.21.15.50:0/567588970 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x558ee0f0e0b0 0x558ee0f10510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:31.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.339+0000 7f30fb7fe700 10 client.25667 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:30:31.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.339+0000 7f311b7fe700 1 --2- 172.21.15.50:0/567588970 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x558ee0f0e0b0 0x558ee0f10510 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8017b658292c0c5f server_cookie=e685942d7d73dc3f in_seq=0 out_seq=0 2024-06-06T03:30:31.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.340+0000 7f30fb7fe700 1 -- 172.21.15.50:0/567588970 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x558ee0e52d50 con 0x558ee0f0e0b0 2024-06-06T03:30:31.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.340+0000 7f30fb7fe700 10 client.25667 handle_command_reply: tid=0 2024-06-06T03:30:31.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.340+0000 7f312cbefb80 1 client.25667 shutdown 2024-06-06T03:30:31.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.341+0000 7f312cbefb80 1 -- 172.21.15.50:0/567588970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ee0ef47a0 msgr2=0x558ee0f005d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:31.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.341+0000 7f312cbefb80 1 --2- 172.21.15.50:0/567588970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ee0ef47a0 0x558ee0f005d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3110012840 tx=0x7f3110009420 comp rx=0 tx=0).stop 2024-06-06T03:30:31.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.343+0000 7f312cbefb80 1 -- 172.21.15.50:0/567588970 shutdown_connections 2024-06-06T03:30:31.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.343+0000 7f312cbefb80 1 --2- 172.21.15.50:0/567588970 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x558ee0f0e0b0 0x558ee0f10510 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.343+0000 7f312cbefb80 1 --2- 172.21.15.50:0/567588970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ee0efa880 0x558ee0efde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.343+0000 7f312cbefb80 1 --2- 172.21.15.50:0/567588970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ee0ef47a0 0x558ee0f005d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.343+0000 7f312cbefb80 1 --2- 172.21.15.50:0/567588970 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558ee0ef9f60 0x558ee0efd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.343+0000 7f312cbefb80 1 -- 172.21.15.50:0/567588970 >> 172.21.15.50:0/567588970 conn(0x558ee0e21080 msgr2=0x558ee0eee700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:31.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.343+0000 7f30fb7fe700 0 client.25667 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:30:31.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.345+0000 7f312cbefb80 1 -- 172.21.15.50:0/567588970 shutdown_connections 2024-06-06T03:30:31.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.347+0000 7f312cbefb80 1 -- 172.21.15.50:0/567588970 wait complete. 2024-06-06T03:30:31.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.347+0000 7f312cbefb80 20 client.25667 trim_cache size 0 max 16384 2024-06-06T03:30:31.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.387+0000 7f312cbefb80 1 Processor -- start 2024-06-06T03:30:31.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.389+0000 7f312cbefb80 1 -- start start 2024-06-06T03:30:31.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.389+0000 7f312cbefb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558ee0ef47a0 0x558ee0efde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:31.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.389+0000 7f312cbefb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ee0ef9f60 0x558ee0f00110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:31.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.389+0000 7f312cbefb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ee0efa880 0x558ee0eeee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:31.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.389+0000 7f312cbefb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f311c1c8050 con 0x558ee0ef9f60 2024-06-06T03:30:31.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.389+0000 7f312cbefb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f311c1c58e0 con 0x558ee0efa880 2024-06-06T03:30:31.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.389+0000 7f312cbefb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f311c1c3730 con 0x558ee0ef47a0 2024-06-06T03:30:31.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.389+0000 7f311b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ee0ef9f60 0x558ee0f00110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:31.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.389+0000 7f311b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ee0ef9f60 0x558ee0f00110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36856/0 (socket says 172.21.15.50:36856) 2024-06-06T03:30:31.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.389+0000 7f311b7fe700 1 -- 172.21.15.50:0/3759705183 learned_addr learned my addr 172.21.15.50:0/3759705183 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:31.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.390+0000 7f311b7fe700 1 -- 172.21.15.50:0/3759705183 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558ee0ef47a0 msgr2=0x558ee0efde80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:30:31.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.390+0000 7f311b7fe700 1 --2- 172.21.15.50:0/3759705183 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558ee0ef47a0 0x558ee0efde80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.390+0000 7f311b7fe700 1 -- 172.21.15.50:0/3759705183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ee0efa880 msgr2=0x558ee0eeee80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:30:31.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.390+0000 7f311b7fe700 1 --2- 172.21.15.50:0/3759705183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ee0efa880 0x558ee0eeee80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.390+0000 7f311b7fe700 1 -- 172.21.15.50:0/3759705183 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ee0ef83d0 con 0x558ee0ef9f60 2024-06-06T03:30:31.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.390+0000 7f311b7fe700 1 --2- 172.21.15.50:0/3759705183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ee0ef9f60 0x558ee0f00110 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f310c00d010 tx=0x7f310c005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78d375bb2260bee2 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:31.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.391+0000 7f3101ffb700 1 -- 172.21.15.50:0/3759705183 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c0092e0 con 0x558ee0ef9f60 2024-06-06T03:30:31.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.391+0000 7f3101ffb700 1 -- 172.21.15.50:0/3759705183 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f310c02a070 con 0x558ee0ef9f60 2024-06-06T03:30:31.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.391+0000 7f3101ffb700 1 -- 172.21.15.50:0/3759705183 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c005960 con 0x558ee0ef9f60 2024-06-06T03:30:31.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.392+0000 7f312cbefb80 1 -- 172.21.15.50:0/3759705183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ee0ef9f60 msgr2=0x558ee0f00110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:31.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.392+0000 7f312cbefb80 1 --2- 172.21.15.50:0/3759705183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ee0ef9f60 0x558ee0f00110 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f310c00d010 tx=0x7f310c005040 comp rx=0 tx=0).stop 2024-06-06T03:30:31.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.392+0000 7f312cbefb80 1 -- 172.21.15.50:0/3759705183 shutdown_connections 2024-06-06T03:30:31.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.392+0000 7f312cbefb80 1 --2- 172.21.15.50:0/3759705183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ee0efa880 0x558ee0eeee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.392+0000 7f312cbefb80 1 --2- 172.21.15.50:0/3759705183 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558ee0ef47a0 0x558ee0efde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.392+0000 7f312cbefb80 1 --2- 172.21.15.50:0/3759705183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ee0ef9f60 0x558ee0f00110 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.392+0000 7f312cbefb80 1 -- 172.21.15.50:0/3759705183 >> 172.21.15.50:0/3759705183 conn(0x558ee0e21080 msgr2=0x558ee0ef8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:31.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.393+0000 7f312cbefb80 1 -- 172.21.15.50:0/3759705183 shutdown_connections 2024-06-06T03:30:31.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.393+0000 7f312cbefb80 1 -- 172.21.15.50:0/3759705183 wait complete. 2024-06-06T03:30:31.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.394+0000 7f312cbefb80 1 -- start start 2024-06-06T03:30:31.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.394+0000 7f312cbefb80 1 Processor -- start 2024-06-06T03:30:31.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.395+0000 7f312cbefb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ee0ef47a0 0x558ee0f16530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:31.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.395+0000 7f312cbefb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ee0ef9f60 0x558ee0f065c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:31.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.395+0000 7f312cbefb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558ee0efa880 0x558ee0f06b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:31.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.395+0000 7f312cbefb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f311c1c3da0 con 0x558ee0ef9f60 2024-06-06T03:30:31.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.395+0000 7f312cbefb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f311c1c5210 con 0x558ee0ef47a0 2024-06-06T03:30:31.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.395+0000 7f312cbefb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f311c1c4470 con 0x558ee0efa880 2024-06-06T03:30:31.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.395+0000 7f312cbefb80 10 client.0 _ll_register_callbacks cb 0x558ee0ddb5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:30:31.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.395+0000 7f3120909700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ee0ef47a0 0x558ee0f16530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:31.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.395+0000 7f3120909700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558ee0efa880 0x558ee0f06b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:31.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.395+0000 7f311b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ee0ef9f60 0x558ee0f065c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:31.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.395+0000 7f311b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ee0ef9f60 0x558ee0f065c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36870/0 (socket says 172.21.15.50:36870) 2024-06-06T03:30:31.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.395+0000 7f311b7fe700 1 -- 172.21.15.50:0/2296446454 learned_addr learned my addr 172.21.15.50:0/2296446454 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:31.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.396+0000 7f3120909700 1 -- 172.21.15.50:0/2296446454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558ee0efa880 msgr2=0x558ee0f06b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:31.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.396+0000 7f3120909700 1 --2- 172.21.15.50:0/2296446454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558ee0efa880 0x558ee0f06b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.396+0000 7f3120909700 1 -- 172.21.15.50:0/2296446454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ee0ef9f60 msgr2=0x558ee0f065c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:31.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.396+0000 7f3120909700 1 --2- 172.21.15.50:0/2296446454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ee0ef9f60 0x558ee0f065c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.396+0000 7f3120909700 1 -- 172.21.15.50:0/2296446454 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ee0f14e10 con 0x558ee0ef47a0 2024-06-06T03:30:31.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.396+0000 7f3120909700 1 --2- 172.21.15.50:0/2296446454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ee0ef47a0 0x558ee0f16530 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f311001e040 tx=0x7f3110009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1611d8d5831e4681 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:31.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.397+0000 7f30fb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:30:31.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.397+0000 7f30fb7fe700 1 -- 172.21.15.50:0/2296446454 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31100050e0 con 0x558ee0ef47a0 2024-06-06T03:30:31.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.397+0000 7f30fb7fe700 1 -- 172.21.15.50:0/2296446454 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f3110005280 con 0x558ee0ef47a0 2024-06-06T03:30:31.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.398+0000 7f312cbefb80 1 -- 172.21.15.50:0/2296446454 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f310c02a070 con 0x558ee0ef47a0 2024-06-06T03:30:31.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.400+0000 7f30fb7fe700 1 -- 172.21.15.50:0/2296446454 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f311003b050 con 0x558ee0ef47a0 2024-06-06T03:30:31.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.400+0000 7f312cbefb80 10 client.25670 fetch_fsmap learned FSMap version 32 2024-06-06T03:30:31.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.400+0000 7f312cbefb80 1 -- 172.21.15.50:0/2296446454 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558ee0f77fa0 con 0x558ee0ef47a0 2024-06-06T03:30:31.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.401+0000 7f30fb7fe700 1 -- 172.21.15.50:0/2296446454 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f310c02a070 con 0x558ee0ef47a0 2024-06-06T03:30:31.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.401+0000 7f30fb7fe700 1 -- 172.21.15.50:0/2296446454 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f311003e080 con 0x558ee0ef47a0 2024-06-06T03:30:31.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.401+0000 7f312cbefb80 10 client.25670 fetch_fsmap finished waiting for FSMap version 32 2024-06-06T03:30:31.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.401+0000 7f312cbefb80 10 client.25670 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:30:31.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.401+0000 7f312cbefb80 20 client.25670 populate_metadata read hostname 'smithi050' 2024-06-06T03:30:31.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.401+0000 7f312cbefb80 1 --2- 172.21.15.50:0/2296446454 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x558ee0f78600 0x558ee0f7aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:31.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.401+0000 7f312cbefb80 4 client.25670 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-06T03:30:31.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.401+0000 7f312cbefb80 1 -- 172.21.15.50:0/2296446454 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558ee0e4d2d0 con 0x558ee0f78600 2024-06-06T03:30:31.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.401+0000 7f311b7fe700 1 --2- 172.21.15.50:0/2296446454 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x558ee0f78600 0x558ee0f7aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:31.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.403+0000 7f311b7fe700 1 --2- 172.21.15.50:0/2296446454 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x558ee0f78600 0x558ee0f7aa20 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c60829f16bdbf5e server_cookie=7159373e6b10b014 in_seq=0 out_seq=0 2024-06-06T03:30:31.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.404+0000 7f30fb7fe700 10 client.25670 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:30:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.404+0000 7f30fb7fe700 1 -- 172.21.15.50:0/2296446454 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x558ee0e4d2d0 con 0x558ee0f78600 2024-06-06T03:30:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.404+0000 7f30fb7fe700 10 client.25670 handle_command_reply: tid=0 2024-06-06T03:30:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.404+0000 7f312cbefb80 1 client.25670 shutdown 2024-06-06T03:30:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.405+0000 7f312cbefb80 1 -- 172.21.15.50:0/2296446454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ee0ef47a0 msgr2=0x558ee0f16530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.405+0000 7f312cbefb80 1 --2- 172.21.15.50:0/2296446454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ee0ef47a0 0x558ee0f16530 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f311001e040 tx=0x7f3110009260 comp rx=0 tx=0).stop 2024-06-06T03:30:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.405+0000 7f312cbefb80 1 -- 172.21.15.50:0/2296446454 shutdown_connections 2024-06-06T03:30:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.405+0000 7f312cbefb80 1 --2- 172.21.15.50:0/2296446454 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x558ee0f78600 0x558ee0f7aa20 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.405+0000 7f312cbefb80 1 --2- 172.21.15.50:0/2296446454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558ee0efa880 0x558ee0f06b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.405+0000 7f312cbefb80 1 --2- 172.21.15.50:0/2296446454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ee0ef47a0 0x558ee0f16530 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.405+0000 7f312cbefb80 1 --2- 172.21.15.50:0/2296446454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ee0ef9f60 0x558ee0f065c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.405+0000 7f312cbefb80 1 -- 172.21.15.50:0/2296446454 >> 172.21.15.50:0/2296446454 conn(0x558ee0e21080 msgr2=0x558ee0ef92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:31.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.405+0000 7f30fb7fe700 0 client.25670 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:30:31.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.405+0000 7f312cbefb80 1 -- 172.21.15.50:0/2296446454 shutdown_connections 2024-06-06T03:30:31.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.405+0000 7f312cbefb80 1 -- 172.21.15.50:0/2296446454 wait complete. 2024-06-06T03:30:31.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.406+0000 7f312cbefb80 20 client.25670 trim_cache size 0 max 16384 2024-06-06T03:30:31.409 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:30:31.410 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-06T03:30:31.410 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2024-06-06T03:30:31.410 INFO:teuthology.orchestra.run.smithi050.stdout: "19bbdcc6-af05-4447-8ad0-7fa6229f2b45": { 2024-06-06T03:30:31.410 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2024-06-06T03:30:31.410 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "19bbdcc6-af05-4447-8ad0-7fa6229f2b45", 2024-06-06T03:30:31.410 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "recursive,force" 2024-06-06T03:30:31.410 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:30:31.410 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:30:31.410 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:30:31.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.410+0000 7f312236c700 1 -- 172.21.15.50:0/3986613918 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f31040a2df0 msgr2=0x7f31040a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:31.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.410+0000 7f312236c700 1 --2- 172.21.15.50:0/3986613918 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f31040a2df0 0x7f31040a52b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f31140a3760 tx=0x7f3114004860 comp rx=0 tx=0).stop 2024-06-06T03:30:31.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.410+0000 7f312236c700 1 -- 172.21.15.50:0/3986613918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f311c109490 msgr2=0x7f311c114230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:31.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.410+0000 7f312236c700 1 --2- 172.21.15.50:0/3986613918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f311c109490 0x7f311c114230 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f311400b530 tx=0x7f311400b8f0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.411+0000 7f312236c700 1 -- 172.21.15.50:0/3986613918 shutdown_connections 2024-06-06T03:30:31.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.411+0000 7f312236c700 1 --2- 172.21.15.50:0/3986613918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f311c1155e0 0x7f311c1a3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.411+0000 7f312236c700 1 --2- 172.21.15.50:0/3986613918 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f31040a2df0 0x7f31040a52b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.411+0000 7f312236c700 1 --2- 172.21.15.50:0/3986613918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f311c109490 0x7f311c114230 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.411+0000 7f312236c700 1 --2- 172.21.15.50:0/3986613918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f311c109db0 0x7f311c114770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:31.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.411+0000 7f312236c700 1 -- 172.21.15.50:0/3986613918 >> 172.21.15.50:0/3986613918 conn(0x7f311c06d600 msgr2=0x7f311c071030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:31.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.411+0000 7f312236c700 1 -- 172.21.15.50:0/3986613918 shutdown_connections 2024-06-06T03:30:31.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:30:31.411+0000 7f312236c700 1 -- 172.21.15.50:0/3986613918 wait complete. 2024-06-06T03:30:32.240 INFO:tasks.cephfs.filesystem:scrub status for tag:19bbdcc6-af05-4447-8ad0-7fa6229f2b45 - {'path': '/', 'tag': '19bbdcc6-af05-4447-8ad0-7fa6229f2b45', 'options': 'recursive,force'} 2024-06-06T03:30:32.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:32 smithi122 ceph-mon[35759]: pgmap v548: 129 pgs: 129 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 43 MiB/s wr, 694 op/s 2024-06-06T03:30:32.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:32 smithi122 ceph-mon[35759]: scrub summary: idle 2024-06-06T03:30:32.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:32 smithi122 ceph-mon[35759]: scrub summary: idle 2024-06-06T03:30:32.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:32 smithi079 ceph-mon[35478]: pgmap v548: 129 pgs: 129 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 43 MiB/s wr, 694 op/s 2024-06-06T03:30:32.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:32 smithi079 ceph-mon[35478]: scrub summary: idle 2024-06-06T03:30:32.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:32 smithi079 ceph-mon[35478]: scrub summary: idle 2024-06-06T03:30:33.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:32 smithi050 ceph-mon[32421]: pgmap v548: 129 pgs: 129 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 43 MiB/s wr, 694 op/s 2024-06-06T03:30:33.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:32 smithi050 ceph-mon[32421]: scrub summary: idle 2024-06-06T03:30:33.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:32 smithi050 ceph-mon[32421]: scrub summary: idle 2024-06-06T03:30:34.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:34 smithi079 ceph-mon[35478]: pgmap v549: 129 pgs: 129 active+clean; 10 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 44 MiB/s wr, 716 op/s 2024-06-06T03:30:34.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:34 smithi122 ceph-mon[35759]: pgmap v549: 129 pgs: 129 active+clean; 10 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 44 MiB/s wr, 716 op/s 2024-06-06T03:30:35.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:34 smithi050 ceph-mon[32421]: pgmap v549: 129 pgs: 129 active+clean; 10 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 44 MiB/s wr, 716 op/s 2024-06-06T03:30:35.124 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.124+0000 7f392bfff640 1 -- 172.21.15.50:0/91645799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f392c104c00 msgr2=0x7f392c106ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.124+0000 7f392bfff640 1 --2- 172.21.15.50:0/91645799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f392c104c00 0x7f392c106ff0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f3920009900 tx=0x7f392002a410 comp rx=0 tx=0).stop 2024-06-06T03:30:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.124+0000 7f392bfff640 1 -- 172.21.15.50:0/91645799 shutdown_connections 2024-06-06T03:30:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.124+0000 7f392bfff640 1 --2- 172.21.15.50:0/91645799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f392c104c00 0x7f392c106ff0 secure :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f3920009900 tx=0x7f392002a410 comp rx=0 tx=0).stop 2024-06-06T03:30:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.124+0000 7f392bfff640 1 --2- 172.21.15.50:0/91645799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f392c107530 0x7f392c109980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.124+0000 7f392bfff640 1 --2- 172.21.15.50:0/91645799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f392c1022d0 0x7f392c1046c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.124+0000 7f392bfff640 1 -- 172.21.15.50:0/91645799 >> 172.21.15.50:0/91645799 conn(0x7f392c0fbcc0 msgr2=0x7f392c0fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.125+0000 7f392bfff640 1 -- 172.21.15.50:0/91645799 shutdown_connections 2024-06-06T03:30:35.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.125+0000 7f392bfff640 1 -- 172.21.15.50:0/91645799 wait complete. 2024-06-06T03:30:35.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.126+0000 7f392bfff640 1 Processor -- start 2024-06-06T03:30:35.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.128+0000 7f392bfff640 1 -- start start 2024-06-06T03:30:35.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.128+0000 7f392bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f392c1022d0 0x7f392c0705a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:35.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.128+0000 7f392bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f392c107530 0x7f392c070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:35.129 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.128+0000 7f392bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f392c1a5ac0 0x7f392c1a7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:35.129 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.128+0000 7f392bfff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f392c10d3c0 con 0x7f392c107530 2024-06-06T03:30:35.129 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.128+0000 7f392bfff640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f392c10d240 con 0x7f392c1a5ac0 2024-06-06T03:30:35.129 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.128+0000 7f392bfff640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f392c10d540 con 0x7f392c1022d0 2024-06-06T03:30:35.129 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.128+0000 7f392affd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f392c1022d0 0x7f392c0705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:35.129 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.128+0000 7f392affd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f392c1022d0 0x7f392c0705a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:44338/0 (socket says 172.21.15.50:44338) 2024-06-06T03:30:35.129 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.128+0000 7f392affd640 1 -- 172.21.15.50:0/4182405492 learned_addr learned my addr 172.21.15.50:0/4182405492 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:35.129 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.128+0000 7f392b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f392c1a5ac0 0x7f392c1a7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:35.129 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.128+0000 7f392a7fc640 1 --2- 172.21.15.50:0/4182405492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f392c107530 0x7f392c070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:35.131 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.129+0000 7f392affd640 1 -- 172.21.15.50:0/4182405492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f392c1a5ac0 msgr2=0x7f392c1a7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:35.131 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.129+0000 7f392affd640 1 --2- 172.21.15.50:0/4182405492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f392c1a5ac0 0x7f392c1a7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.131 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.129+0000 7f392affd640 1 -- 172.21.15.50:0/4182405492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f392c107530 msgr2=0x7f392c070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:35.131 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.129+0000 7f392affd640 1 --2- 172.21.15.50:0/4182405492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f392c107530 0x7f392c070ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.129+0000 7f392affd640 1 -- 172.21.15.50:0/4182405492 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392c1a84a0 con 0x7f392c1022d0 2024-06-06T03:30:35.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.129+0000 7f392affd640 1 --2- 172.21.15.50:0/4182405492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f392c1022d0 0x7f392c0705a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f391c00d950 tx=0x7f391c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:35.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.132+0000 7f3913fff640 1 -- 172.21.15.50:0/4182405492 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c017030 con 0x7f392c1022d0 2024-06-06T03:30:35.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.132+0000 7f3913fff640 1 -- 172.21.15.50:0/4182405492 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f391c004020 con 0x7f392c1022d0 2024-06-06T03:30:35.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.132+0000 7f392bfff640 1 -- 172.21.15.50:0/4182405492 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f392c1000c0 con 0x7f392c1022d0 2024-06-06T03:30:35.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.132+0000 7f392bfff640 1 -- 172.21.15.50:0/4182405492 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f392c1005e0 con 0x7f392c1022d0 2024-06-06T03:30:35.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.132+0000 7f3913fff640 1 -- 172.21.15.50:0/4182405492 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c003c30 con 0x7f392c1022d0 2024-06-06T03:30:35.136 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.137+0000 7f393406d740 1 Processor -- start 2024-06-06T03:30:35.139 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.139+0000 7f3913fff640 1 -- 172.21.15.50:0/4182405492 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f391c01a070 con 0x7f392c1022d0 2024-06-06T03:30:35.140 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.140+0000 7f3913fff640 1 --2- 172.21.15.50:0/4182405492 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f39140ab520 0x7f39140ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:35.140 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.141+0000 7f3913fff640 1 -- 172.21.15.50:0/4182405492 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f391c0cee40 con 0x7f392c1022d0 2024-06-06T03:30:35.141 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.141+0000 7f393406d740 1 -- start start 2024-06-06T03:30:35.141 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.141+0000 7f393406d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56193b85a200 0x56193b85a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:35.141 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.141+0000 7f393406d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56193b85abf0 0x56193b85f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:35.141 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.141+0000 7f393406d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56193b85fd60 0x56193b8621f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:35.141 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.141+0000 7f393406d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56193b7bd4f0 con 0x56193b85fd60 2024-06-06T03:30:35.142 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.141+0000 7f393406d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56193b75b870 con 0x56193b85abf0 2024-06-06T03:30:35.142 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.141+0000 7f393406d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56193b7b94b0 con 0x56193b85a200 2024-06-06T03:30:35.142 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.141+0000 7f392affd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56193b85a200 0x56193b85a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:35.142 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.141+0000 7f392a7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56193b85abf0 0x56193b85f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:35.142 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.141+0000 7f392affd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56193b85a200 0x56193b85a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:44340/0 (socket says 172.21.15.50:44340) 2024-06-06T03:30:35.142 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.142+0000 7f392affd640 1 -- 172.21.15.50:0/2093354629 learned_addr learned my addr 172.21.15.50:0/2093354629 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:35.142 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.141+0000 7f392a7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56193b85abf0 0x56193b85f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:56206/0 (socket says 172.21.15.50:56206) 2024-06-06T03:30:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.142+0000 7f392affd640 1 -- 172.21.15.50:0/2093354629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56193b85abf0 msgr2=0x56193b85f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.142+0000 7f392affd640 1 --2- 172.21.15.50:0/2093354629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56193b85abf0 0x56193b85f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.142+0000 7f392affd640 1 -- 172.21.15.50:0/2093354629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56193b85fd60 msgr2=0x56193b8621f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:30:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.142+0000 7f392affd640 1 --2- 172.21.15.50:0/2093354629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56193b85fd60 0x56193b8621f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.142+0000 7f392affd640 1 -- 172.21.15.50:0/2093354629 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56193b7779b0 con 0x56193b85a200 2024-06-06T03:30:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.142+0000 7f392affd640 1 --2- 172.21.15.50:0/2093354629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56193b85a200 0x56193b85a620 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f391c097780 tx=0x7f391c09bae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97bac90af0e1255c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.143+0000 7f39117fa640 1 -- 172.21.15.50:0/2093354629 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c014070 con 0x56193b85a200 2024-06-06T03:30:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.143+0000 7f39117fa640 1 -- 172.21.15.50:0/2093354629 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f391c0a3f90 con 0x56193b85a200 2024-06-06T03:30:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.143+0000 7f39117fa640 1 -- 172.21.15.50:0/2093354629 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c004430 con 0x56193b85a200 2024-06-06T03:30:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.144+0000 7f393406d740 1 -- 172.21.15.50:0/2093354629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56193b85a200 msgr2=0x56193b85a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.144+0000 7f393406d740 1 --2- 172.21.15.50:0/2093354629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56193b85a200 0x56193b85a620 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f391c097780 tx=0x7f391c09bae0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.144+0000 7f392b7fe640 1 --2- 172.21.15.50:0/4182405492 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f39140ab520 0x7f39140ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.144+0000 7f393406d740 1 -- 172.21.15.50:0/2093354629 shutdown_connections 2024-06-06T03:30:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.144+0000 7f393406d740 1 --2- 172.21.15.50:0/2093354629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56193b85fd60 0x56193b8621f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.144+0000 7f393406d740 1 --2- 172.21.15.50:0/2093354629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56193b85abf0 0x56193b85f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.145 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.144+0000 7f393406d740 1 --2- 172.21.15.50:0/2093354629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56193b85a200 0x56193b85a620 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.145 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.144+0000 7f393406d740 1 -- 172.21.15.50:0/2093354629 >> 172.21.15.50:0/2093354629 conn(0x56193b855870 msgr2=0x56193b855c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:35.145 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.145+0000 7f393406d740 1 -- 172.21.15.50:0/2093354629 shutdown_connections 2024-06-06T03:30:35.148 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.147+0000 7f393406d740 1 -- 172.21.15.50:0/2093354629 wait complete. 2024-06-06T03:30:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.147+0000 7f393406d740 1 -- start start 2024-06-06T03:30:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.147+0000 7f393406d740 1 Processor -- start 2024-06-06T03:30:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.148+0000 7f393406d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56193b85a200 0x56193b864470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.148+0000 7f393406d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56193b85abf0 0x56193b8649b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.148+0000 7f393406d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56193b85fd60 0x56193b86b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.148+0000 7f393406d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56193b862d10 con 0x56193b85a200 2024-06-06T03:30:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.148+0000 7f393406d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56193b746ae0 con 0x56193b85fd60 2024-06-06T03:30:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.148+0000 7f393406d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56193b862e90 con 0x56193b85abf0 2024-06-06T03:30:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.148+0000 7f393406d740 10 client.0 _ll_register_callbacks cb 0x56193b77f9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:30:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.148+0000 7f392b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56193b85fd60 0x56193b86b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.148+0000 7f392b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56193b85fd60 0x56193b86b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:56222/0 (socket says 172.21.15.50:56222) 2024-06-06T03:30:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.148+0000 7f392b7fe640 1 -- 172.21.15.50:0/3537320636 learned_addr learned my addr 172.21.15.50:0/3537320636 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.149+0000 7f392a7fc640 1 --2- 172.21.15.50:0/3537320636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56193b85abf0 0x56193b8649b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.149+0000 7f392affd640 1 --2- 172.21.15.50:0/3537320636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56193b85a200 0x56193b864470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:35.152 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.149+0000 7f392b7fe640 1 --2- 172.21.15.50:0/4182405492 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f39140ab520 0x7f39140ad9e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3924005fd0 tx=0x7f3924009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:35.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.149+0000 7f392b7fe640 1 -- 172.21.15.50:0/3537320636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56193b85abf0 msgr2=0x56193b8649b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:35.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.149+0000 7f392b7fe640 1 --2- 172.21.15.50:0/3537320636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56193b85abf0 0x56193b8649b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.149+0000 7f392b7fe640 1 -- 172.21.15.50:0/3537320636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56193b85a200 msgr2=0x56193b864470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:35.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.149+0000 7f392b7fe640 1 --2- 172.21.15.50:0/3537320636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56193b85a200 0x56193b864470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.150+0000 7f392b7fe640 1 -- 172.21.15.50:0/3537320636 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56193b4d1210 con 0x56193b85fd60 2024-06-06T03:30:35.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.151+0000 7f392b7fe640 1 --2- 172.21.15.50:0/3537320636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56193b85fd60 0x56193b86b9f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f39240040c0 tx=0x7f3924004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54e010ca315dd7b2 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:35.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.151+0000 7f390eff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:30:35.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.151+0000 7f390eff5640 1 -- 172.21.15.50:0/3537320636 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392401c890 con 0x56193b85fd60 2024-06-06T03:30:35.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.151+0000 7f393406d740 1 -- 172.21.15.50:0/3537320636 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f391c0a3f90 con 0x56193b85fd60 2024-06-06T03:30:35.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.151+0000 7f390eff5640 1 -- 172.21.15.50:0/3537320636 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f392401ca30 con 0x56193b85fd60 2024-06-06T03:30:35.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.152+0000 7f390eff5640 1 -- 172.21.15.50:0/3537320636 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f392401cc30 con 0x56193b85fd60 2024-06-06T03:30:35.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.152+0000 7f393406d740 10 client.25682 fetch_fsmap learned FSMap version 32 2024-06-06T03:30:35.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.152+0000 7f393406d740 1 -- 172.21.15.50:0/3537320636 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56193b59d620 con 0x56193b85fd60 2024-06-06T03:30:35.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.155+0000 7f390eff5640 1 -- 172.21.15.50:0/3537320636 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f391c0a3f90 con 0x56193b85fd60 2024-06-06T03:30:35.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.156+0000 7f390eff5640 1 -- 172.21.15.50:0/3537320636 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f392402f420 con 0x56193b85fd60 2024-06-06T03:30:35.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.156+0000 7f393406d740 10 client.25682 fetch_fsmap finished waiting for FSMap version 32 2024-06-06T03:30:35.157 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.156+0000 7f393406d740 10 client.25682 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:30:35.157 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.156+0000 7f393406d740 20 client.25682 populate_metadata read hostname 'smithi050' 2024-06-06T03:30:35.157 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.156+0000 7f393406d740 1 --2- 172.21.15.50:0/3537320636 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56193b8817f0 0x56193b883c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:35.157 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.157+0000 7f393406d740 4 client.25682 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:30:35.157 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.157+0000 7f393406d740 1 -- 172.21.15.50:0/3537320636 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56193b7d0f10 con 0x56193b8817f0 2024-06-06T03:30:35.157 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.157+0000 7f392affd640 1 --2- 172.21.15.50:0/3537320636 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56193b8817f0 0x56193b883c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:35.159 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.157+0000 7f392affd640 1 --2- 172.21.15.50:0/3537320636 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56193b8817f0 0x56193b883c70 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc5e7df5cdc9201d server_cookie=29a1f20367a86d84 in_seq=0 out_seq=0 2024-06-06T03:30:35.159 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.159+0000 7f390eff5640 10 client.25682 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:30:35.159 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.159+0000 7f390eff5640 1 -- 172.21.15.50:0/3537320636 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x56193b7d0f10 con 0x56193b8817f0 2024-06-06T03:30:35.159 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.159+0000 7f390eff5640 10 client.25682 handle_command_reply: tid=0 2024-06-06T03:30:35.159 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.159+0000 7f393406d740 1 client.25682 shutdown 2024-06-06T03:30:35.160 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.160+0000 7f393406d740 1 -- 172.21.15.50:0/3537320636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56193b85fd60 msgr2=0x56193b86b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:35.160 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.160+0000 7f393406d740 1 --2- 172.21.15.50:0/3537320636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56193b85fd60 0x56193b86b9f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f39240040c0 tx=0x7f3924004ab0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.160 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.160+0000 7f393406d740 1 -- 172.21.15.50:0/3537320636 shutdown_connections 2024-06-06T03:30:35.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.160+0000 7f393406d740 1 --2- 172.21.15.50:0/3537320636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56193b85fd60 0x56193b86b9f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.160+0000 7f393406d740 1 --2- 172.21.15.50:0/3537320636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56193b85abf0 0x56193b8649b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.160+0000 7f393406d740 1 --2- 172.21.15.50:0/3537320636 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56193b8817f0 0x56193b883c70 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.160+0000 7f393406d740 1 --2- 172.21.15.50:0/3537320636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56193b85a200 0x56193b864470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.160+0000 7f393406d740 1 -- 172.21.15.50:0/3537320636 >> 172.21.15.50:0/3537320636 conn(0x56193b855870 msgr2=0x56193b8549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:35.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.160+0000 7f390eff5640 0 client.25682 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:30:35.162 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.162+0000 7f393406d740 1 -- 172.21.15.50:0/3537320636 shutdown_connections 2024-06-06T03:30:35.162 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.163+0000 7f393406d740 1 -- 172.21.15.50:0/3537320636 wait complete. 2024-06-06T03:30:35.162 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.163+0000 7f393406d740 20 client.25682 trim_cache size 0 max 16384 2024-06-06T03:30:35.206 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.204+0000 7f393406d740 1 Processor -- start 2024-06-06T03:30:35.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.205+0000 7f393406d740 1 -- start start 2024-06-06T03:30:35.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.205+0000 7f393406d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56193b85a200 0x56193b85be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:35.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.205+0000 7f393406d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56193b85abf0 0x56193b86b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:35.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.205+0000 7f393406d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56193b85fd60 0x56193b85c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:35.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.205+0000 7f393406d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3918012390 con 0x56193b85fd60 2024-06-06T03:30:35.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.205+0000 7f393406d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f391800fc60 con 0x56193b85a200 2024-06-06T03:30:35.208 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.205+0000 7f393406d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f391800db60 con 0x56193b85abf0 2024-06-06T03:30:35.208 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.205+0000 7f392a7fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56193b85abf0 0x56193b86b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:35.208 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.206+0000 7f392b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56193b85fd60 0x56193b85c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:35.208 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.206+0000 7f392a7fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56193b85abf0 0x56193b86b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:44348/0 (socket says 172.21.15.50:44348) 2024-06-06T03:30:35.208 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.206+0000 7f392a7fc640 1 -- 172.21.15.50:0/3446934347 learned_addr learned my addr 172.21.15.50:0/3446934347 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:35.209 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.206+0000 7f392affd640 1 --2- 172.21.15.50:0/3446934347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56193b85a200 0x56193b85be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:35.209 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.206+0000 7f392a7fc640 1 -- 172.21.15.50:0/3446934347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56193b85a200 msgr2=0x56193b85be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:35.209 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.206+0000 7f392a7fc640 1 --2- 172.21.15.50:0/3446934347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56193b85a200 0x56193b85be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.209 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.206+0000 7f392a7fc640 1 -- 172.21.15.50:0/3446934347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56193b85fd60 msgr2=0x56193b85c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:35.209 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.206+0000 7f392a7fc640 1 --2- 172.21.15.50:0/3446934347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56193b85fd60 0x56193b85c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.209 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.206+0000 7f392a7fc640 1 -- 172.21.15.50:0/3446934347 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56193b8556a0 con 0x56193b85abf0 2024-06-06T03:30:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.209+0000 7f392a7fc640 1 --2- 172.21.15.50:0/3446934347 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56193b85abf0 0x56193b86b910 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f392002a980 tx=0x7f3920005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b36960d6c91fe9f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.209+0000 7f3910ff9640 1 -- 172.21.15.50:0/3446934347 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3920035040 con 0x56193b85abf0 2024-06-06T03:30:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.209+0000 7f3910ff9640 1 -- 172.21.15.50:0/3446934347 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f39200054f0 con 0x56193b85abf0 2024-06-06T03:30:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.209+0000 7f3910ff9640 1 -- 172.21.15.50:0/3446934347 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39200035f0 con 0x56193b85abf0 2024-06-06T03:30:35.213 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.210+0000 7f393406d740 1 -- 172.21.15.50:0/3446934347 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56193b85abf0 msgr2=0x56193b86b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:35.213 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.210+0000 7f393406d740 1 --2- 172.21.15.50:0/3446934347 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56193b85abf0 0x56193b86b910 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f392002a980 tx=0x7f3920005fd0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.213 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.211+0000 7f393406d740 1 -- 172.21.15.50:0/3446934347 shutdown_connections 2024-06-06T03:30:35.213 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.211+0000 7f393406d740 1 --2- 172.21.15.50:0/3446934347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56193b85fd60 0x56193b85c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.213 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.212+0000 7f393406d740 1 --2- 172.21.15.50:0/3446934347 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56193b85abf0 0x56193b86b910 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.213 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.212+0000 7f393406d740 1 --2- 172.21.15.50:0/3446934347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56193b85a200 0x56193b85be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.212+0000 7f393406d740 1 -- 172.21.15.50:0/3446934347 >> 172.21.15.50:0/3446934347 conn(0x56193b855870 msgr2=0x56193b855c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:35.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.216+0000 7f393406d740 1 -- 172.21.15.50:0/3446934347 shutdown_connections 2024-06-06T03:30:35.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.216+0000 7f393406d740 1 -- 172.21.15.50:0/3446934347 wait complete. 2024-06-06T03:30:35.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.217+0000 7f393406d740 1 -- start start 2024-06-06T03:30:35.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.217+0000 7f393406d740 1 Processor -- start 2024-06-06T03:30:35.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.219+0000 7f393406d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56193b85a200 0x56193b86b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:35.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.219+0000 7f393406d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56193b85abf0 0x56193b868190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:35.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.219+0000 7f393406d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56193b85fd60 0x56193b8686d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:35.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.219+0000 7f393406d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f391800e120 con 0x56193b85abf0 2024-06-06T03:30:35.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.219+0000 7f393406d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f391800f590 con 0x56193b85fd60 2024-06-06T03:30:35.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.219+0000 7f393406d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f391800e7f0 con 0x56193b85a200 2024-06-06T03:30:35.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.219+0000 7f393406d740 10 client.0 _ll_register_callbacks cb 0x7f3924009c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:30:35.222 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.219+0000 7f392b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56193b85fd60 0x56193b8686d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.219+0000 7f392b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56193b85fd60 0x56193b8686d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:56248/0 (socket says 172.21.15.50:56248) 2024-06-06T03:30:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.219+0000 7f392b7fe640 1 -- 172.21.15.50:0/1252510170 learned_addr learned my addr 172.21.15.50:0/1252510170 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.219+0000 7f392a7fc640 1 --2- 172.21.15.50:0/1252510170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56193b85abf0 0x56193b868190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.220+0000 7f392a7fc640 1 -- 172.21.15.50:0/1252510170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56193b85a200 msgr2=0x56193b86b6f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:30:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.220+0000 7f392a7fc640 1 --2- 172.21.15.50:0/1252510170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56193b85a200 0x56193b86b6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.220+0000 7f392a7fc640 1 -- 172.21.15.50:0/1252510170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56193b85fd60 msgr2=0x56193b8686d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:35.224 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.220+0000 7f392a7fc640 1 --2- 172.21.15.50:0/1252510170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56193b85fd60 0x56193b8686d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.224 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.220+0000 7f392a7fc640 1 -- 172.21.15.50:0/1252510170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56193b8ea540 con 0x56193b85abf0 2024-06-06T03:30:35.224 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.222+0000 7f392a7fc640 1 --2- 172.21.15.50:0/1252510170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56193b85abf0 0x56193b868190 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x56193b85f430 tx=0x7f3920005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da488b1c382b3c22 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:35.224 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.222+0000 7f390eff5640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:30:35.225 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.226+0000 7f390eff5640 1 -- 172.21.15.50:0/1252510170 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3920035030 con 0x56193b85abf0 2024-06-06T03:30:35.226 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.226+0000 7f393406d740 1 -- 172.21.15.50:0/1252510170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39200054f0 con 0x56193b85abf0 2024-06-06T03:30:35.226 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.226+0000 7f390eff5640 1 -- 172.21.15.50:0/1252510170 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f3920005080 con 0x56193b85abf0 2024-06-06T03:30:35.226 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.226+0000 7f390eff5640 1 -- 172.21.15.50:0/1252510170 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3920057050 con 0x56193b85abf0 2024-06-06T03:30:35.231 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.231+0000 7f393406d740 10 client.16086 fetch_fsmap learned FSMap version 32 2024-06-06T03:30:35.231 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.231+0000 7f393406d740 1 -- 172.21.15.50:0/1252510170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56193b8eb6b0 con 0x56193b85abf0 2024-06-06T03:30:35.232 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.232+0000 7f390eff5640 1 -- 172.21.15.50:0/1252510170 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f39200054f0 con 0x56193b85abf0 2024-06-06T03:30:35.233 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.232+0000 7f390eff5640 1 -- 172.21.15.50:0/1252510170 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f392003b430 con 0x56193b85abf0 2024-06-06T03:30:35.233 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.233+0000 7f393406d740 10 client.16086 fetch_fsmap finished waiting for FSMap version 32 2024-06-06T03:30:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.233+0000 7f393406d740 10 client.16086 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:30:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.233+0000 7f393406d740 20 client.16086 populate_metadata read hostname 'smithi050' 2024-06-06T03:30:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.233+0000 7f393406d740 1 --2- 172.21.15.50:0/1252510170 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56193b8ec070 0x56193b8ee490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.233+0000 7f393406d740 4 client.16086 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:30:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.233+0000 7f393406d740 1 -- 172.21.15.50:0/1252510170 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56193b7cac20 con 0x56193b8ec070 2024-06-06T03:30:35.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.235+0000 7f392affd640 1 --2- 172.21.15.50:0/1252510170 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56193b8ec070 0x56193b8ee490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:35.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.239+0000 7f392affd640 1 --2- 172.21.15.50:0/1252510170 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56193b8ec070 0x56193b8ee490 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c637468a15165db3 server_cookie=8348d205b687d84c in_seq=0 out_seq=0 2024-06-06T03:30:35.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.239+0000 7f390eff5640 10 client.16086 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:30:35.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.244+0000 7f390eff5640 1 -- 172.21.15.50:0/1252510170 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x56193b7cac20 con 0x56193b8ec070 2024-06-06T03:30:35.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.244+0000 7f390eff5640 10 client.16086 handle_command_reply: tid=0 2024-06-06T03:30:35.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.244+0000 7f393406d740 1 client.16086 shutdown 2024-06-06T03:30:35.246 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.246+0000 7f393406d740 1 -- 172.21.15.50:0/1252510170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56193b85abf0 msgr2=0x56193b868190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:35.246 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.246+0000 7f393406d740 1 --2- 172.21.15.50:0/1252510170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56193b85abf0 0x56193b868190 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x56193b85f430 tx=0x7f3920005be0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.249 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.249+0000 7f393406d740 1 -- 172.21.15.50:0/1252510170 shutdown_connections 2024-06-06T03:30:35.249 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.249+0000 7f393406d740 1 --2- 172.21.15.50:0/1252510170 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56193b8ec070 0x56193b8ee490 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.249 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.249+0000 7f393406d740 1 --2- 172.21.15.50:0/1252510170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56193b85abf0 0x56193b868190 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.249 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.249+0000 7f393406d740 1 --2- 172.21.15.50:0/1252510170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56193b85fd60 0x56193b8686d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.249 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.249+0000 7f393406d740 1 --2- 172.21.15.50:0/1252510170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56193b85a200 0x56193b86b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.249 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.249+0000 7f393406d740 1 -- 172.21.15.50:0/1252510170 >> 172.21.15.50:0/1252510170 conn(0x56193b855870 msgr2=0x56193b85be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:35.249 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.249+0000 7f390eff5640 0 client.16086 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:30:35.249 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.249+0000 7f393406d740 1 -- 172.21.15.50:0/1252510170 shutdown_connections 2024-06-06T03:30:35.249 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.249+0000 7f393406d740 1 -- 172.21.15.50:0/1252510170 wait complete. 2024-06-06T03:30:35.250 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:30:35.250 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:30:35.250 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:30:35.251 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.249+0000 7f393406d740 20 client.16086 trim_cache size 0 max 16384 2024-06-06T03:30:35.251 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.251+0000 7f392bfff640 1 -- 172.21.15.50:0/4182405492 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f39140ab520 msgr2=0x7f39140ad9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:35.251 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.251+0000 7f392bfff640 1 --2- 172.21.15.50:0/4182405492 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f39140ab520 0x7f39140ad9e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3924005fd0 tx=0x7f3924009500 comp rx=0 tx=0).stop 2024-06-06T03:30:35.251 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.251+0000 7f392bfff640 1 -- 172.21.15.50:0/4182405492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f392c1022d0 msgr2=0x7f392c0705a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:35.251 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.251+0000 7f392bfff640 1 --2- 172.21.15.50:0/4182405492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f392c1022d0 0x7f392c0705a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f391c00d950 tx=0x7f391c00de10 comp rx=0 tx=0).stop 2024-06-06T03:30:35.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.252+0000 7f392bfff640 1 -- 172.21.15.50:0/4182405492 shutdown_connections 2024-06-06T03:30:35.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.252+0000 7f392bfff640 1 --2- 172.21.15.50:0/4182405492 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f39140ab520 0x7f39140ad9e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.252+0000 7f392bfff640 1 --2- 172.21.15.50:0/4182405492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f392c107530 0x7f392c070ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.252+0000 7f392bfff640 1 --2- 172.21.15.50:0/4182405492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f392c1a5ac0 0x7f392c1a7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.252+0000 7f392bfff640 1 --2- 172.21.15.50:0/4182405492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f392c1022d0 0x7f392c0705a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:35.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.252+0000 7f392bfff640 1 -- 172.21.15.50:0/4182405492 >> 172.21.15.50:0/4182405492 conn(0x7f392c0fbcc0 msgr2=0x7f392c106a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:35.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.252+0000 7f392bfff640 1 -- 172.21.15.50:0/4182405492 shutdown_connections 2024-06-06T03:30:35.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:35.252+0000 7f392bfff640 1 -- 172.21.15.50:0/4182405492 wait complete. 2024-06-06T03:30:36.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:36 smithi050 ceph-mon[32421]: pgmap v550: 129 pgs: 129 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 51 MiB/s wr, 826 op/s 2024-06-06T03:30:36.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:36 smithi079 ceph-mon[35478]: pgmap v550: 129 pgs: 129 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 51 MiB/s wr, 826 op/s 2024-06-06T03:30:36.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:36 smithi122 ceph-mon[35759]: pgmap v550: 129 pgs: 129 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 51 MiB/s wr, 826 op/s 2024-06-06T03:30:38.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:38 smithi079 ceph-mon[35478]: pgmap v551: 129 pgs: 129 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 45 MiB/s wr, 730 op/s 2024-06-06T03:30:38.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:38 smithi122 ceph-mon[35759]: pgmap v551: 129 pgs: 129 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 45 MiB/s wr, 730 op/s 2024-06-06T03:30:39.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:38 smithi050 ceph-mon[32421]: pgmap v551: 129 pgs: 129 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 45 MiB/s wr, 730 op/s 2024-06-06T03:30:40.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:40 smithi079 ceph-mon[35478]: pgmap v552: 129 pgs: 129 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 56 MiB/s wr, 900 op/s 2024-06-06T03:30:40.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:40 smithi122 ceph-mon[35759]: pgmap v552: 129 pgs: 129 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 56 MiB/s wr, 900 op/s 2024-06-06T03:30:41.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:40 smithi050 ceph-mon[32421]: pgmap v552: 129 pgs: 129 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 56 MiB/s wr, 900 op/s 2024-06-06T03:30:42.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:42 smithi079 ceph-mon[35478]: pgmap v553: 129 pgs: 129 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 46 MiB/s wr, 735 op/s 2024-06-06T03:30:42.917 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:42 smithi122 ceph-mon[35759]: pgmap v553: 129 pgs: 129 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 46 MiB/s wr, 735 op/s 2024-06-06T03:30:43.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:42 smithi050 ceph-mon[32421]: pgmap v553: 129 pgs: 129 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 46 MiB/s wr, 735 op/s 2024-06-06T03:30:44.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:44 smithi079 ceph-mon[35478]: pgmap v554: 129 pgs: 129 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 47 MiB/s wr, 752 op/s 2024-06-06T03:30:44.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:44 smithi122 ceph-mon[35759]: pgmap v554: 129 pgs: 129 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 47 MiB/s wr, 752 op/s 2024-06-06T03:30:45.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:44 smithi050 ceph-mon[32421]: pgmap v554: 129 pgs: 129 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 47 MiB/s wr, 752 op/s 2024-06-06T03:30:46.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:46 smithi079 ceph-mon[35478]: pgmap v555: 129 pgs: 129 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 56 MiB/s wr, 897 op/s 2024-06-06T03:30:46.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:46 smithi122 ceph-mon[35759]: pgmap v555: 129 pgs: 129 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 56 MiB/s wr, 897 op/s 2024-06-06T03:30:47.003 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:46 smithi050 ceph-mon[32421]: pgmap v555: 129 pgs: 129 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 56 MiB/s wr, 897 op/s 2024-06-06T03:30:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.429+0000 7fbaeec72640 1 -- 172.21.15.50:0/4068811810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbae81053f0 msgr2=0x7fbae8105870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.429+0000 7fbaeec72640 1 --2- 172.21.15.50:0/4068811810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbae81053f0 0x7fbae8105870 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fbad8009900 tx=0x7fbad802a440 comp rx=0 tx=0).stop 2024-06-06T03:30:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.429+0000 7fbaeec72640 1 -- 172.21.15.50:0/4068811810 shutdown_connections 2024-06-06T03:30:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.429+0000 7fbaeec72640 1 --2- 172.21.15.50:0/4068811810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbae81053f0 0x7fbae8105870 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.429+0000 7fbaeec72640 1 --2- 172.21.15.50:0/4068811810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbae8102a40 0x7fbae8104eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.429+0000 7fbaeec72640 1 --2- 172.21.15.50:0/4068811810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbae81000d0 0x7fbae8102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.429+0000 7fbaeec72640 1 -- 172.21.15.50:0/4068811810 >> 172.21.15.50:0/4068811810 conn(0x7fbae80fbcf0 msgr2=0x7fbae80fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.431+0000 7fbaeec72640 1 -- 172.21.15.50:0/4068811810 shutdown_connections 2024-06-06T03:30:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.431+0000 7fbaeec72640 1 -- 172.21.15.50:0/4068811810 wait complete. 2024-06-06T03:30:48.432 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.432+0000 7fbaeec72640 1 Processor -- start 2024-06-06T03:30:48.432 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.432+0000 7fbaeec72640 1 -- start start 2024-06-06T03:30:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.433+0000 7fbaeec72640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbae81000d0 0x7fbae819e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.433+0000 7fbaeec72640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbae8102a40 0x7fbae819e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.433+0000 7fbaeec72640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbae81053f0 0x7fbae81a5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.433+0000 7fbaeec72640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbae8113a90 con 0x7fbae81053f0 2024-06-06T03:30:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.433+0000 7fbaeca0e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbae81000d0 0x7fbae819e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.433+0000 7fbae7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbae8102a40 0x7fbae819e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.433+0000 7fbaeec72640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbae8113910 con 0x7fbae8102a40 2024-06-06T03:30:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.433+0000 7fbaeca0e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbae81000d0 0x7fbae819e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:54052/0 (socket says 172.21.15.50:54052) 2024-06-06T03:30:48.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.433+0000 7fbaeca0e640 1 -- 172.21.15.50:0/3438472956 learned_addr learned my addr 172.21.15.50:0/3438472956 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:48.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.433+0000 7fbaeec72640 1 -- 172.21.15.50:0/3438472956 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbae8113c10 con 0x7fbae81000d0 2024-06-06T03:30:48.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.434+0000 7fbaeca0e640 1 -- 172.21.15.50:0/3438472956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbae8102a40 msgr2=0x7fbae819e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:48.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.434+0000 7fbaeca0e640 1 --2- 172.21.15.50:0/3438472956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbae8102a40 0x7fbae819e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.434+0000 7fbaeca0e640 1 -- 172.21.15.50:0/3438472956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbae81053f0 msgr2=0x7fbae81a5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:48.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.434+0000 7fbaeca0e640 1 --2- 172.21.15.50:0/3438472956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbae81053f0 0x7fbae81a5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.434+0000 7fbaeca0e640 1 -- 172.21.15.50:0/3438472956 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbae81a5dd0 con 0x7fbae81000d0 2024-06-06T03:30:48.435 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.434+0000 7fbaeca0e640 1 --2- 172.21.15.50:0/3438472956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbae81000d0 0x7fbae819e200 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbae000ba50 tx=0x7fbae000bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.436+0000 7fbae5ffb640 1 -- 172.21.15.50:0/3438472956 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae0019070 con 0x7fbae81000d0 2024-06-06T03:30:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.437+0000 7fbae5ffb640 1 -- 172.21.15.50:0/3438472956 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbae000cc10 con 0x7fbae81000d0 2024-06-06T03:30:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.437+0000 7fbae5ffb640 1 -- 172.21.15.50:0/3438472956 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae00075d0 con 0x7fbae81000d0 2024-06-06T03:30:48.437 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.437+0000 7fbaeec72640 1 -- 172.21.15.50:0/3438472956 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbae81a60c0 con 0x7fbae81000d0 2024-06-06T03:30:48.437 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.437+0000 7fbaeec72640 1 -- 172.21.15.50:0/3438472956 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbae81a6640 con 0x7fbae81000d0 2024-06-06T03:30:48.441 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.441+0000 7fbaf197c740 1 Processor -- start 2024-06-06T03:30:48.441 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.441+0000 7fbaf197c740 1 -- start start 2024-06-06T03:30:48.441 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.441+0000 7fbaf197c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637d8c4f1e0 0x5637d8c4f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:48.441 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.441+0000 7fbaf197c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637d8c4fbd0 0x5637d8c546d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:48.441 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.441+0000 7fbaf197c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637d8c54d40 0x5637d8c571d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:48.441 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.441+0000 7fbaf197c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5637d8bb24f0 con 0x5637d8c54d40 2024-06-06T03:30:48.442 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.441+0000 7fbaf197c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5637d8b50870 con 0x5637d8c4f1e0 2024-06-06T03:30:48.442 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.441+0000 7fbaf197c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5637d8bae4b0 con 0x5637d8c4fbd0 2024-06-06T03:30:48.442 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.442+0000 7fbaed20f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637d8c4f1e0 0x5637d8c4f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:48.442 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.442+0000 7fbae5ffb640 1 -- 172.21.15.50:0/3438472956 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbae0014440 con 0x7fbae81000d0 2024-06-06T03:30:48.442 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.443+0000 7fbaeca0e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637d8c4fbd0 0x5637d8c546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:48.443 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.443+0000 7fbaed20f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637d8c4f1e0 0x5637d8c4f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:53808/0 (socket says 172.21.15.50:53808) 2024-06-06T03:30:48.443 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.443+0000 7fbaed20f640 1 -- 172.21.15.50:0/583495135 learned_addr learned my addr 172.21.15.50:0/583495135 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:48.444 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.443+0000 7fbaed20f640 1 -- 172.21.15.50:0/583495135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637d8c4fbd0 msgr2=0x5637d8c546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:48.444 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.444+0000 7fbae5ffb640 1 --2- 172.21.15.50:0/3438472956 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbad00a2d50 0x7fbad00a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:48.444 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.444+0000 7fbae5ffb640 1 -- 172.21.15.50:0/3438472956 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fbae00ce970 con 0x7fbae81000d0 2024-06-06T03:30:48.444 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.444+0000 7fbae7fff640 1 --2- 172.21.15.50:0/583495135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637d8c54d40 0x5637d8c571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:48.445 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.445+0000 7fbaed20f640 1 --2- 172.21.15.50:0/583495135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637d8c4fbd0 0x5637d8c546d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.445 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.445+0000 7fbaed20f640 1 -- 172.21.15.50:0/583495135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637d8c54d40 msgr2=0x5637d8c571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:48.445 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.445+0000 7fbaed20f640 1 --2- 172.21.15.50:0/583495135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637d8c54d40 0x5637d8c571d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.445 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.445+0000 7fbaed20f640 1 -- 172.21.15.50:0/583495135 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637d8b6c9b0 con 0x5637d8c4f1e0 2024-06-06T03:30:48.445 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.445+0000 7fbaeca0e640 1 --2- 172.21.15.50:0/583495135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637d8c4fbd0 0x5637d8c546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:30:48.446 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.446+0000 7fbae7fff640 1 --2- 172.21.15.50:0/583495135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637d8c54d40 0x5637d8c571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:30:48.446 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.446+0000 7fbaed20f640 1 --2- 172.21.15.50:0/583495135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637d8c4f1e0 0x5637d8c4f600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbad8005ec0 tx=0x7fbad8004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=769496394fd49b00 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:48.446 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.446+0000 7fbaceffd640 1 -- 172.21.15.50:0/583495135 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad803e030 con 0x5637d8c4f1e0 2024-06-06T03:30:48.447 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.446+0000 7fbaceffd640 1 -- 172.21.15.50:0/583495135 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbad8004230 con 0x5637d8c4f1e0 2024-06-06T03:30:48.447 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.446+0000 7fbaed20f640 1 --2- 172.21.15.50:0/3438472956 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbad00a2d50 0x7fbad00a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:48.447 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.446+0000 7fbaceffd640 1 -- 172.21.15.50:0/583495135 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad8035040 con 0x5637d8c4f1e0 2024-06-06T03:30:48.447 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.447+0000 7fbaed20f640 1 --2- 172.21.15.50:0/3438472956 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbad00a2d50 0x7fbad00a5210 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbad8005c20 tx=0x7fbad803a920 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:48.448 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.448+0000 7fbaf197c740 1 -- 172.21.15.50:0/583495135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637d8c4f1e0 msgr2=0x5637d8c4f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:48.448 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.448+0000 7fbaf197c740 1 --2- 172.21.15.50:0/583495135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637d8c4f1e0 0x5637d8c4f600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbad8005ec0 tx=0x7fbad8004040 comp rx=0 tx=0).stop 2024-06-06T03:30:48.449 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.449+0000 7fbaf197c740 1 -- 172.21.15.50:0/583495135 shutdown_connections 2024-06-06T03:30:48.449 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.449+0000 7fbaf197c740 1 --2- 172.21.15.50:0/583495135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637d8c54d40 0x5637d8c571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.449 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.449+0000 7fbaf197c740 1 --2- 172.21.15.50:0/583495135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637d8c4fbd0 0x5637d8c546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.449 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.449+0000 7fbaf197c740 1 --2- 172.21.15.50:0/583495135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637d8c4f1e0 0x5637d8c4f600 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.449 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.449+0000 7fbaf197c740 1 -- 172.21.15.50:0/583495135 >> 172.21.15.50:0/583495135 conn(0x5637d8c4a850 msgr2=0x5637d8c4ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:48.450 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.449+0000 7fbaf197c740 1 -- 172.21.15.50:0/583495135 shutdown_connections 2024-06-06T03:30:48.450 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.450+0000 7fbaf197c740 1 -- 172.21.15.50:0/583495135 wait complete. 2024-06-06T03:30:48.450 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.450+0000 7fbaf197c740 1 -- start start 2024-06-06T03:30:48.450 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.450+0000 7fbaf197c740 1 Processor -- start 2024-06-06T03:30:48.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.451+0000 7fbaf197c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637d8c4f1e0 0x5637d8c59360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:48.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.451+0000 7fbaf197c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637d8c4fbd0 0x5637d8c598a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:48.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.451+0000 7fbaf197c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637d8c54d40 0x5637d8c608e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:48.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.451+0000 7fbaf197c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5637d8c57c90 con 0x5637d8c4fbd0 2024-06-06T03:30:48.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.451+0000 7fbaf197c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5637d8b3bae0 con 0x5637d8c4f1e0 2024-06-06T03:30:48.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.451+0000 7fbaf197c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5637d8c57e10 con 0x5637d8c54d40 2024-06-06T03:30:48.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.451+0000 7fbaf197c740 10 client.0 _ll_register_callbacks cb 0x5637d8b749b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:30:48.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.451+0000 7fbaeca0e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637d8c4f1e0 0x5637d8c59360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:48.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.451+0000 7fbaeca0e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637d8c4f1e0 0x5637d8c59360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:53822/0 (socket says 172.21.15.50:53822) 2024-06-06T03:30:48.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.451+0000 7fbaeca0e640 1 -- 172.21.15.50:0/4181746548 learned_addr learned my addr 172.21.15.50:0/4181746548 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:48.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.452+0000 7fbaed20f640 1 --2- 172.21.15.50:0/4181746548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637d8c54d40 0x5637d8c608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:48.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.452+0000 7fbae7fff640 1 --2- 172.21.15.50:0/4181746548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637d8c4fbd0 0x5637d8c598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:48.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.452+0000 7fbaeca0e640 1 -- 172.21.15.50:0/4181746548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637d8c54d40 msgr2=0x5637d8c608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:48.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.452+0000 7fbaeca0e640 1 --2- 172.21.15.50:0/4181746548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637d8c54d40 0x5637d8c608e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.452+0000 7fbaeca0e640 1 -- 172.21.15.50:0/4181746548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637d8c4fbd0 msgr2=0x5637d8c598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:48.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.452+0000 7fbaeca0e640 1 --2- 172.21.15.50:0/4181746548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637d8c4fbd0 0x5637d8c598a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.452+0000 7fbaeca0e640 1 -- 172.21.15.50:0/4181746548 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637d88c6210 con 0x5637d8c4f1e0 2024-06-06T03:30:48.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.452+0000 7fbae7fff640 1 --2- 172.21.15.50:0/4181746548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637d8c4fbd0 0x5637d8c598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:30:48.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.452+0000 7fbaeca0e640 1 --2- 172.21.15.50:0/4181746548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637d8c4f1e0 0x5637d8c59360 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbae00cec50 tx=0x7fbae009b5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4d661ed1a17efe7 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:48.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.452+0000 7fbac7fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:30:48.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.453+0000 7fbac7fff640 1 -- 172.21.15.50:0/4181746548 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae00a3a60 con 0x5637d8c4f1e0 2024-06-06T03:30:48.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.453+0000 7fbac7fff640 1 -- 172.21.15.50:0/4181746548 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fbae0097460 con 0x5637d8c4f1e0 2024-06-06T03:30:48.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.453+0000 7fbaf197c740 1 -- 172.21.15.50:0/4181746548 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbad8004230 con 0x5637d8c4f1e0 2024-06-06T03:30:48.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.453+0000 7fbac7fff640 1 -- 172.21.15.50:0/4181746548 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbae009b050 con 0x5637d8c4f1e0 2024-06-06T03:30:48.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.454+0000 7fbaf197c740 10 client.25697 fetch_fsmap learned FSMap version 32 2024-06-06T03:30:48.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.454+0000 7fbaf197c740 1 -- 172.21.15.50:0/4181746548 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5637d8992620 con 0x5637d8c4f1e0 2024-06-06T03:30:48.455 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.455+0000 7fbac7fff640 1 -- 172.21.15.50:0/4181746548 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbad8004230 con 0x5637d8c4f1e0 2024-06-06T03:30:48.455 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.455+0000 7fbac7fff640 1 -- 172.21.15.50:0/4181746548 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7fbae0096b40 con 0x5637d8c4f1e0 2024-06-06T03:30:48.455 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.455+0000 7fbaf197c740 10 client.25697 fetch_fsmap finished waiting for FSMap version 32 2024-06-06T03:30:48.455 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.455+0000 7fbaf197c740 10 client.25697 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:30:48.455 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.455+0000 7fbaf197c740 20 client.25697 populate_metadata read hostname 'smithi050' 2024-06-06T03:30:48.456 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.455+0000 7fbaf197c740 1 --2- 172.21.15.50:0/4181746548 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5637d8c65120 0x5637d8c67530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:48.456 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.455+0000 7fbaf197c740 4 client.25697 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:30:48.456 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.455+0000 7fbaf197c740 1 -- 172.21.15.50:0/4181746548 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637d8bc5f10 con 0x5637d8c65120 2024-06-06T03:30:48.456 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.456+0000 7fbae7fff640 1 --2- 172.21.15.50:0/4181746548 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5637d8c65120 0x5637d8c67530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:48.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.456+0000 7fbae7fff640 1 --2- 172.21.15.50:0/4181746548 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5637d8c65120 0x5637d8c67530 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6872f1da02fe2a66 server_cookie=1d7a168c7ed4ca00 in_seq=0 out_seq=0 2024-06-06T03:30:48.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.456+0000 7fbac7fff640 10 client.25697 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:30:48.458 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.458+0000 7fbac7fff640 1 -- 172.21.15.50:0/4181746548 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5637d8bc5f10 con 0x5637d8c65120 2024-06-06T03:30:48.458 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.458+0000 7fbac7fff640 10 client.25697 handle_command_reply: tid=0 2024-06-06T03:30:48.458 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.458+0000 7fbaf197c740 1 client.25697 shutdown 2024-06-06T03:30:48.459 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.458+0000 7fbaf197c740 1 -- 172.21.15.50:0/4181746548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637d8c4f1e0 msgr2=0x5637d8c59360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:48.459 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.458+0000 7fbaf197c740 1 --2- 172.21.15.50:0/4181746548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637d8c4f1e0 0x5637d8c59360 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbae00cec50 tx=0x7fbae009b5b0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.459 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.458+0000 7fbaf197c740 1 -- 172.21.15.50:0/4181746548 shutdown_connections 2024-06-06T03:30:48.459 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.458+0000 7fbaf197c740 1 --2- 172.21.15.50:0/4181746548 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5637d8c65120 0x5637d8c67530 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.459 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.458+0000 7fbaf197c740 1 --2- 172.21.15.50:0/4181746548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637d8c4fbd0 0x5637d8c598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.459 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.458+0000 7fbaf197c740 1 --2- 172.21.15.50:0/4181746548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637d8c54d40 0x5637d8c608e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.459 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.458+0000 7fbaf197c740 1 --2- 172.21.15.50:0/4181746548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637d8c4f1e0 0x5637d8c59360 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.459 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.458+0000 7fbaf197c740 1 -- 172.21.15.50:0/4181746548 >> 172.21.15.50:0/4181746548 conn(0x5637d8c4a850 msgr2=0x5637d8c499d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:48.459 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.458+0000 7fbac7fff640 0 client.25697 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:30:48.459 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.459+0000 7fbaf197c740 1 -- 172.21.15.50:0/4181746548 shutdown_connections 2024-06-06T03:30:48.459 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.459+0000 7fbaf197c740 1 -- 172.21.15.50:0/4181746548 wait complete. 2024-06-06T03:30:48.459 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.459+0000 7fbaf197c740 20 client.25697 trim_cache size 0 max 16384 2024-06-06T03:30:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.489+0000 7fbaf197c740 1 Processor -- start 2024-06-06T03:30:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.489+0000 7fbaf197c740 1 -- start start 2024-06-06T03:30:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.489+0000 7fbaf197c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637d8c4f1e0 0x5637d8c50db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.489+0000 7fbaf197c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637d8c4fbd0 0x5637d8c608a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.490+0000 7fbaeca0e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637d8c4f1e0 0x5637d8c50db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.490+0000 7fbaeca0e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637d8c4f1e0 0x5637d8c50db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:54082/0 (socket says 172.21.15.50:54082) 2024-06-06T03:30:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.490+0000 7fbaeca0e640 1 -- 172.21.15.50:0/1443633244 learned_addr learned my addr 172.21.15.50:0/1443633244 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.490+0000 7fbaf197c740 1 --2- 172.21.15.50:0/1443633244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637d8c54d40 0x5637d8c512f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.490+0000 7fbaf197c740 1 -- 172.21.15.50:0/1443633244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbae81b32b0 con 0x5637d8c4fbd0 2024-06-06T03:30:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.490+0000 7fbaf197c740 1 -- 172.21.15.50:0/1443633244 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbae81b0b80 con 0x5637d8c54d40 2024-06-06T03:30:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.490+0000 7fbaf197c740 1 -- 172.21.15.50:0/1443633244 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbae81ae9d0 con 0x5637d8c4f1e0 2024-06-06T03:30:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.490+0000 7fbae7fff640 1 --2- 172.21.15.50:0/1443633244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637d8c4fbd0 0x5637d8c608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:48.491 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.490+0000 7fbaed20f640 1 --2- 172.21.15.50:0/1443633244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637d8c54d40 0x5637d8c512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:48.491 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.490+0000 7fbaeca0e640 1 -- 172.21.15.50:0/1443633244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637d8c54d40 msgr2=0x5637d8c512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:48.491 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.490+0000 7fbaeca0e640 1 --2- 172.21.15.50:0/1443633244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637d8c54d40 0x5637d8c512f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.491 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.490+0000 7fbaeca0e640 1 -- 172.21.15.50:0/1443633244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637d8c4fbd0 msgr2=0x5637d8c608a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:48.491 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.490+0000 7fbaeca0e640 1 --2- 172.21.15.50:0/1443633244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637d8c4fbd0 0x5637d8c608a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.490+0000 7fbaeca0e640 1 -- 172.21.15.50:0/1443633244 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637d8c45f50 con 0x5637d8c4f1e0 2024-06-06T03:30:48.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.490+0000 7fbaeca0e640 1 --2- 172.21.15.50:0/1443633244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637d8c4f1e0 0x5637d8c50db0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbae000ba20 tx=0x7fbae009f320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8540f0d04002605a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:48.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.491+0000 7fbace7fc640 1 -- 172.21.15.50:0/1443633244 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae00a3a60 con 0x5637d8c4f1e0 2024-06-06T03:30:48.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.491+0000 7fbace7fc640 1 -- 172.21.15.50:0/1443633244 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbae0096b40 con 0x5637d8c4f1e0 2024-06-06T03:30:48.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.491+0000 7fbace7fc640 1 -- 172.21.15.50:0/1443633244 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae0099cb0 con 0x5637d8c4f1e0 2024-06-06T03:30:48.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.492+0000 7fbaf197c740 1 -- 172.21.15.50:0/1443633244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637d8c4f1e0 msgr2=0x5637d8c50db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.492+0000 7fbaf197c740 1 --2- 172.21.15.50:0/1443633244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637d8c4f1e0 0x5637d8c50db0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbae000ba20 tx=0x7fbae009f320 comp rx=0 tx=0).stop 2024-06-06T03:30:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.493+0000 7fbaf197c740 1 -- 172.21.15.50:0/1443633244 shutdown_connections 2024-06-06T03:30:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.493+0000 7fbaf197c740 1 --2- 172.21.15.50:0/1443633244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637d8c4fbd0 0x5637d8c608a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.493+0000 7fbaf197c740 1 --2- 172.21.15.50:0/1443633244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637d8c54d40 0x5637d8c512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.493+0000 7fbaf197c740 1 --2- 172.21.15.50:0/1443633244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637d8c4f1e0 0x5637d8c50db0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.493+0000 7fbaf197c740 1 -- 172.21.15.50:0/1443633244 >> 172.21.15.50:0/1443633244 conn(0x5637d8c4a850 msgr2=0x5637d8c543f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.493+0000 7fbaf197c740 1 -- 172.21.15.50:0/1443633244 shutdown_connections 2024-06-06T03:30:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.493+0000 7fbaf197c740 1 -- 172.21.15.50:0/1443633244 wait complete. 2024-06-06T03:30:48.494 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.493+0000 7fbaf197c740 1 -- start start 2024-06-06T03:30:48.494 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.493+0000 7fbaf197c740 1 Processor -- start 2024-06-06T03:30:48.494 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.494+0000 7fbaf197c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637d8c4f1e0 0x5637d8c601f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:48.494 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.494+0000 7fbaf197c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637d8c4fbd0 0x5637d8c60730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:48.494 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.494+0000 7fbaf197c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637d8c54d40 0x5637d8c5cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:48.494 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.494+0000 7fbaf197c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbae81af040 con 0x5637d8c54d40 2024-06-06T03:30:48.494 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.494+0000 7fbaf197c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbae81b04b0 con 0x5637d8c4fbd0 2024-06-06T03:30:48.495 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.494+0000 7fbaf197c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbae81af710 con 0x5637d8c4f1e0 2024-06-06T03:30:48.495 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.494+0000 7fbaf197c740 10 client.0 _ll_register_callbacks cb 0x7fbae0014b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:30:48.495 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.494+0000 7fbaeca0e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637d8c4f1e0 0x5637d8c601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:48.495 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.494+0000 7fbae7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637d8c4fbd0 0x5637d8c60730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:48.495 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.494+0000 7fbae7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637d8c4fbd0 0x5637d8c60730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:53848/0 (socket says 172.21.15.50:53848) 2024-06-06T03:30:48.495 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.494+0000 7fbae7fff640 1 -- 172.21.15.50:0/2046273559 learned_addr learned my addr 172.21.15.50:0/2046273559 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:30:48.495 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.494+0000 7fbaeca0e640 1 --2- 172.21.15.50:0/2046273559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637d8c4f1e0 0x5637d8c601f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:54084/0 (socket says 172.21.15.50:54084) 2024-06-06T03:30:48.496 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.495+0000 7fbae7fff640 1 -- 172.21.15.50:0/2046273559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637d8c4f1e0 msgr2=0x5637d8c601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:48.497 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.495+0000 7fbae7fff640 1 --2- 172.21.15.50:0/2046273559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637d8c4f1e0 0x5637d8c601f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.497 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.495+0000 7fbae7fff640 1 -- 172.21.15.50:0/2046273559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637d8c54d40 msgr2=0x5637d8c5cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:30:48.497 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.495+0000 7fbae7fff640 1 --2- 172.21.15.50:0/2046273559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637d8c54d40 0x5637d8c5cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.497 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.495+0000 7fbae7fff640 1 -- 172.21.15.50:0/2046273559 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637d8c5d4e0 con 0x5637d8c4fbd0 2024-06-06T03:30:48.497 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.495+0000 7fbae7fff640 1 --2- 172.21.15.50:0/2046273559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637d8c4fbd0 0x5637d8c60730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x5637d8c4b720 tx=0x7fbadc017810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bcc7615a987c287 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:30:48.497 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.495+0000 7fbac7fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:30:48.497 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.495+0000 7fbac7fff640 1 -- 172.21.15.50:0/2046273559 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbadc023020 con 0x5637d8c4fbd0 2024-06-06T03:30:48.497 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.495+0000 7fbac7fff640 1 -- 172.21.15.50:0/2046273559 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fbadc01f480 con 0x5637d8c4fbd0 2024-06-06T03:30:48.497 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.495+0000 7fbaf197c740 1 -- 172.21.15.50:0/2046273559 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbae0096b40 con 0x5637d8c4fbd0 2024-06-06T03:30:48.497 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.496+0000 7fbac7fff640 1 -- 172.21.15.50:0/2046273559 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbadc02e050 con 0x5637d8c4fbd0 2024-06-06T03:30:48.497 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.496+0000 7fbaf197c740 10 client.25703 fetch_fsmap learned FSMap version 32 2024-06-06T03:30:48.497 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.496+0000 7fbaf197c740 1 -- 172.21.15.50:0/2046273559 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5637d8cf0c20 con 0x5637d8c4fbd0 2024-06-06T03:30:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.496+0000 7fbac7fff640 1 -- 172.21.15.50:0/2046273559 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbae0096b40 con 0x5637d8c4fbd0 2024-06-06T03:30:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.496+0000 7fbac7fff640 1 -- 172.21.15.50:0/2046273559 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7fbadc0156b0 con 0x5637d8c4fbd0 2024-06-06T03:30:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.496+0000 7fbaf197c740 10 client.25703 fetch_fsmap finished waiting for FSMap version 32 2024-06-06T03:30:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.496+0000 7fbaf197c740 10 client.25703 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:30:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.496+0000 7fbaf197c740 20 client.25703 populate_metadata read hostname 'smithi050' 2024-06-06T03:30:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.496+0000 7fbaf197c740 1 --2- 172.21.15.50:0/2046273559 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5637d8cf16b0 0x5637d8cf3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:30:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.496+0000 7fbaf197c740 4 client.25703 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:30:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.496+0000 7fbaf197c740 1 -- 172.21.15.50:0/2046273559 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5637d8bbfc20 con 0x5637d8cf16b0 2024-06-06T03:30:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.497+0000 7fbaeca0e640 1 --2- 172.21.15.50:0/2046273559 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5637d8cf16b0 0x5637d8cf3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:30:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.498+0000 7fbaeca0e640 1 --2- 172.21.15.50:0/2046273559 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5637d8cf16b0 0x5637d8cf3ad0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bf297b417c35120 server_cookie=58b4b6c61dc5ca78 in_seq=0 out_seq=0 2024-06-06T03:30:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.498+0000 7fbac7fff640 10 client.25703 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:30:48.507 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.507+0000 7fbac7fff640 1 -- 172.21.15.50:0/2046273559 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5637d8bbfc20 con 0x5637d8cf16b0 2024-06-06T03:30:48.507 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.507+0000 7fbac7fff640 10 client.25703 handle_command_reply: tid=0 2024-06-06T03:30:48.507 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.507+0000 7fbaf197c740 1 client.25703 shutdown 2024-06-06T03:30:48.507 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.507+0000 7fbaf197c740 1 -- 172.21.15.50:0/2046273559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637d8c4fbd0 msgr2=0x5637d8c60730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:48.508 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.507+0000 7fbaf197c740 1 --2- 172.21.15.50:0/2046273559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637d8c4fbd0 0x5637d8c60730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x5637d8c4b720 tx=0x7fbadc017810 comp rx=0 tx=0).stop 2024-06-06T03:30:48.508 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.508+0000 7fbaf197c740 1 -- 172.21.15.50:0/2046273559 shutdown_connections 2024-06-06T03:30:48.508 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.508+0000 7fbaf197c740 1 --2- 172.21.15.50:0/2046273559 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5637d8cf16b0 0x5637d8cf3ad0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.508 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.508+0000 7fbaf197c740 1 --2- 172.21.15.50:0/2046273559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637d8c54d40 0x5637d8c5cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.508 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.508+0000 7fbaf197c740 1 --2- 172.21.15.50:0/2046273559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637d8c4fbd0 0x5637d8c60730 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.508 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.508+0000 7fbaf197c740 1 --2- 172.21.15.50:0/2046273559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637d8c4f1e0 0x5637d8c601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.508 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.508+0000 7fbaf197c740 1 -- 172.21.15.50:0/2046273559 >> 172.21.15.50:0/2046273559 conn(0x5637d8c4a850 msgr2=0x5637d8c53fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:48.508 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.508+0000 7fbac7fff640 0 client.25703 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:30:48.509 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.508+0000 7fbaf197c740 1 -- 172.21.15.50:0/2046273559 shutdown_connections 2024-06-06T03:30:48.509 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.508+0000 7fbaf197c740 1 -- 172.21.15.50:0/2046273559 wait complete. 2024-06-06T03:30:48.509 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.508+0000 7fbaf197c740 20 client.25703 trim_cache size 0 max 16384 2024-06-06T03:30:48.509 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:30:48.509 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:30:48.509 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:30:48.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.515+0000 7fbaeec72640 1 -- 172.21.15.50:0/3438472956 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbad00a2d50 msgr2=0x7fbad00a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:48.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.515+0000 7fbaeec72640 1 --2- 172.21.15.50:0/3438472956 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbad00a2d50 0x7fbad00a5210 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbad8005c20 tx=0x7fbad803a920 comp rx=0 tx=0).stop 2024-06-06T03:30:48.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.515+0000 7fbaeec72640 1 -- 172.21.15.50:0/3438472956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbae81000d0 msgr2=0x7fbae819e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:30:48.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.515+0000 7fbaeec72640 1 --2- 172.21.15.50:0/3438472956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbae81000d0 0x7fbae819e200 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbae000ba50 tx=0x7fbae000bf10 comp rx=0 tx=0).stop 2024-06-06T03:30:48.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.516+0000 7fbaeec72640 1 -- 172.21.15.50:0/3438472956 shutdown_connections 2024-06-06T03:30:48.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.516+0000 7fbaeec72640 1 --2- 172.21.15.50:0/3438472956 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbad00a2d50 0x7fbad00a5210 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.516+0000 7fbaeec72640 1 --2- 172.21.15.50:0/3438472956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbae81053f0 0x7fbae81a5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.516+0000 7fbaeec72640 1 --2- 172.21.15.50:0/3438472956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbae8102a40 0x7fbae819e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.516+0000 7fbaeec72640 1 --2- 172.21.15.50:0/3438472956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbae81000d0 0x7fbae819e200 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:30:48.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.516+0000 7fbaeec72640 1 -- 172.21.15.50:0/3438472956 >> 172.21.15.50:0/3438472956 conn(0x7fbae80fbcf0 msgr2=0x7fbae8100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:30:48.517 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.516+0000 7fbaeec72640 1 -- 172.21.15.50:0/3438472956 shutdown_connections 2024-06-06T03:30:48.517 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:30:48.516+0000 7fbaeec72640 1 -- 172.21.15.50:0/3438472956 wait complete. 2024-06-06T03:30:48.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:48 smithi079 ceph-mon[35478]: pgmap v556: 129 pgs: 129 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 47 MiB/s wr, 748 op/s 2024-06-06T03:30:48.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:48 smithi122 ceph-mon[35759]: pgmap v556: 129 pgs: 129 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 47 MiB/s wr, 748 op/s 2024-06-06T03:30:49.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:48 smithi050 ceph-mon[32421]: pgmap v556: 129 pgs: 129 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 47 MiB/s wr, 748 op/s 2024-06-06T03:30:50.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:50 smithi079 ceph-mon[35478]: pgmap v557: 129 pgs: 129 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 56 MiB/s wr, 909 op/s 2024-06-06T03:30:50.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:50 smithi122 ceph-mon[35759]: pgmap v557: 129 pgs: 129 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 56 MiB/s wr, 909 op/s 2024-06-06T03:30:51.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:50 smithi050 ceph-mon[32421]: pgmap v557: 129 pgs: 129 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 56 MiB/s wr, 909 op/s 2024-06-06T03:30:52.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:52 smithi079 ceph-mon[35478]: pgmap v558: 129 pgs: 129 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 45 MiB/s wr, 728 op/s 2024-06-06T03:30:52.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:52 smithi122 ceph-mon[35759]: pgmap v558: 129 pgs: 129 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 45 MiB/s wr, 728 op/s 2024-06-06T03:30:53.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:52 smithi050 ceph-mon[32421]: pgmap v558: 129 pgs: 129 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 45 MiB/s wr, 728 op/s 2024-06-06T03:30:54.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:54 smithi079 ceph-mon[35478]: pgmap v559: 129 pgs: 129 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 46 MiB/s wr, 742 op/s 2024-06-06T03:30:54.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:54 smithi122 ceph-mon[35759]: pgmap v559: 129 pgs: 129 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 46 MiB/s wr, 742 op/s 2024-06-06T03:30:55.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:54 smithi050 ceph-mon[32421]: pgmap v559: 129 pgs: 129 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 46 MiB/s wr, 742 op/s 2024-06-06T03:30:56.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:56 smithi079 ceph-mon[35478]: pgmap v560: 129 pgs: 129 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 55 MiB/s wr, 884 op/s 2024-06-06T03:30:56.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:56 smithi122 ceph-mon[35759]: pgmap v560: 129 pgs: 129 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 55 MiB/s wr, 884 op/s 2024-06-06T03:30:57.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:56 smithi050 ceph-mon[32421]: pgmap v560: 129 pgs: 129 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 55 MiB/s wr, 884 op/s 2024-06-06T03:30:58.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:30:58 smithi122 ceph-mon[35759]: pgmap v561: 129 pgs: 129 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 46 MiB/s wr, 732 op/s 2024-06-06T03:30:59.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:30:58 smithi050 ceph-mon[32421]: pgmap v561: 129 pgs: 129 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 46 MiB/s wr, 732 op/s 2024-06-06T03:30:59.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:30:58 smithi079 ceph-mon[35478]: pgmap v561: 129 pgs: 129 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 46 MiB/s wr, 732 op/s 2024-06-06T03:31:00.900 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:00 smithi079 ceph-mon[35478]: pgmap v562: 129 pgs: 129 active+clean; 10 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 54 MiB/s wr, 872 op/s 2024-06-06T03:31:00.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:00 smithi122 ceph-mon[35759]: pgmap v562: 129 pgs: 129 active+clean; 10 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 54 MiB/s wr, 872 op/s 2024-06-06T03:31:01.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:00 smithi050 ceph-mon[32421]: pgmap v562: 129 pgs: 129 active+clean; 10 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 54 MiB/s wr, 872 op/s 2024-06-06T03:31:01.701 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.702+0000 7f680de31640 1 -- 172.21.15.50:0/1162264675 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6808100920 msgr2=0x7f6808100d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:01.701 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.702+0000 7f680de31640 1 --2- 172.21.15.50:0/1162264675 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6808100920 0x7f6808100d40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6800009900 tx=0x7f680002a3f0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.701 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.702+0000 7f680de31640 1 -- 172.21.15.50:0/1162264675 shutdown_connections 2024-06-06T03:31:01.701 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.702+0000 7f680de31640 1 --2- 172.21.15.50:0/1162264675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6808101b10 0x7f6808101f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.702+0000 7f680de31640 1 --2- 172.21.15.50:0/1162264675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68081024d0 0x7f6808108d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.702+0000 7f680de31640 1 --2- 172.21.15.50:0/1162264675 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6808100920 0x7f6808100d40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.702+0000 7f680de31640 1 -- 172.21.15.50:0/1162264675 >> 172.21.15.50:0/1162264675 conn(0x7f68080fbe90 msgr2=0x7f68080fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:01.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.702+0000 7f680de31640 1 -- 172.21.15.50:0/1162264675 shutdown_connections 2024-06-06T03:31:01.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.702+0000 7f680de31640 1 -- 172.21.15.50:0/1162264675 wait complete. 2024-06-06T03:31:01.704 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.703+0000 7f680de31640 1 Processor -- start 2024-06-06T03:31:01.704 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.703+0000 7f680de31640 1 -- start start 2024-06-06T03:31:01.704 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.703+0000 7f680de31640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6808100920 0x7f6808197bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:01.704 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.704+0000 7f680de31640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6808101b10 0x7f6808198110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:01.704 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.704+0000 7f68077fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6808100920 0x7f6808197bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:01.704 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.704+0000 7f68077fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6808100920 0x7f6808197bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36254/0 (socket says 172.21.15.50:36254) 2024-06-06T03:31:01.704 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.704+0000 7f68077fe640 1 -- 172.21.15.50:0/2095875810 learned_addr learned my addr 172.21.15.50:0/2095875810 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:01.704 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.704+0000 7f680de31640 1 --2- 172.21.15.50:0/2095875810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68081024d0 0x7f680819f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:01.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.704+0000 7f6806ffd640 1 --2- 172.21.15.50:0/2095875810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6808101b10 0x7f6808198110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:01.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.704+0000 7f6807fff640 1 --2- 172.21.15.50:0/2095875810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68081024d0 0x7f680819f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:01.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.704+0000 7f680de31640 1 -- 172.21.15.50:0/2095875810 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f680810c470 con 0x7f6808100920 2024-06-06T03:31:01.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.704+0000 7f680de31640 1 -- 172.21.15.50:0/2095875810 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f680810c2f0 con 0x7f6808101b10 2024-06-06T03:31:01.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.704+0000 7f680de31640 1 -- 172.21.15.50:0/2095875810 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f680810c5f0 con 0x7f68081024d0 2024-06-06T03:31:01.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.705+0000 7f6806ffd640 1 -- 172.21.15.50:0/2095875810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68081024d0 msgr2=0x7f680819f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:01.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.705+0000 7f6806ffd640 1 --2- 172.21.15.50:0/2095875810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68081024d0 0x7f680819f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.705+0000 7f6806ffd640 1 -- 172.21.15.50:0/2095875810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6808100920 msgr2=0x7f6808197bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:01.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.705+0000 7f6806ffd640 1 --2- 172.21.15.50:0/2095875810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6808100920 0x7f6808197bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.705+0000 7f6806ffd640 1 -- 172.21.15.50:0/2095875810 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f680819f7f0 con 0x7f6808101b10 2024-06-06T03:31:01.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.705+0000 7f6807fff640 1 --2- 172.21.15.50:0/2095875810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68081024d0 0x7f680819f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:31:01.706 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.705+0000 7f6806ffd640 1 --2- 172.21.15.50:0/2095875810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6808101b10 0x7f6808198110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f67fc00e9f0 tx=0x7f67fc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:01.706 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.705+0000 7f6804ff9640 1 -- 172.21.15.50:0/2095875810 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67fc00ccc0 con 0x7f6808101b10 2024-06-06T03:31:01.706 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.706+0000 7f6804ff9640 1 -- 172.21.15.50:0/2095875810 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f67fc0108e0 con 0x7f6808101b10 2024-06-06T03:31:01.706 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.706+0000 7f6804ff9640 1 -- 172.21.15.50:0/2095875810 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67fc018880 con 0x7f6808101b10 2024-06-06T03:31:01.706 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.706+0000 7f680de31640 1 -- 172.21.15.50:0/2095875810 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f680819fae0 con 0x7f6808101b10 2024-06-06T03:31:01.707 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.706+0000 7f680de31640 1 -- 172.21.15.50:0/2095875810 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f680819ffe0 con 0x7f6808101b10 2024-06-06T03:31:01.709 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.710+0000 7f6810c1b740 1 Processor -- start 2024-06-06T03:31:01.709 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.710+0000 7f6810c1b740 1 -- start start 2024-06-06T03:31:01.710 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.711+0000 7f6810c1b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560041026e70 0x560041027290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:01.710 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.711+0000 7f6810c1b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560041027860 0x56004102bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:01.710 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.711+0000 7f6810c1b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56004102c3b0 0x56004102e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:01.710 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.711+0000 7f6810c1b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560040f814f0 con 0x56004102c3b0 2024-06-06T03:31:01.710 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.711+0000 7f6810c1b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560040f1f870 con 0x560041027860 2024-06-06T03:31:01.710 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.711+0000 7f6810c1b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560040f7d4b0 con 0x560041026e70 2024-06-06T03:31:01.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.711+0000 7f6807fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560041026e70 0x560041027290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:01.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.711+0000 7f6807fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560041026e70 0x560041027290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:44450/0 (socket says 172.21.15.50:44450) 2024-06-06T03:31:01.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.711+0000 7f6807fff640 1 -- 172.21.15.50:0/387032606 learned_addr learned my addr 172.21.15.50:0/387032606 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:01.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.712+0000 7f6807fff640 1 -- 172.21.15.50:0/387032606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560041027860 msgr2=0x56004102bd40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:31:01.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.712+0000 7f6807fff640 1 --2- 172.21.15.50:0/387032606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560041027860 0x56004102bd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.712+0000 7f6807fff640 1 -- 172.21.15.50:0/387032606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56004102c3b0 msgr2=0x56004102e800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:31:01.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.712+0000 7f6807fff640 1 --2- 172.21.15.50:0/387032606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56004102c3b0 0x56004102e800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.712+0000 7f6807fff640 1 -- 172.21.15.50:0/387032606 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560040f3b9b0 con 0x560041026e70 2024-06-06T03:31:01.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.712+0000 7f6804ff9640 1 -- 172.21.15.50:0/2095875810 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f67fc010430 con 0x7f6808101b10 2024-06-06T03:31:01.712 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.712+0000 7f6807fff640 1 --2- 172.21.15.50:0/387032606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560041026e70 0x560041027290 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f67f80117e0 tx=0x7f67f8011ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f814e1a0658e79a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:01.712 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.713+0000 7f67edffb640 1 -- 172.21.15.50:0/387032606 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f8011310 con 0x560041026e70 2024-06-06T03:31:01.712 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.713+0000 7f67edffb640 1 -- 172.21.15.50:0/387032606 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f67f8003e20 con 0x560041026e70 2024-06-06T03:31:01.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.714+0000 7f6804ff9640 1 --2- 172.21.15.50:0/2095875810 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f67f00a2cb0 0x7f67f00a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:01.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.714+0000 7f6804ff9640 1 -- 172.21.15.50:0/2095875810 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f67fc0cf650 con 0x7f6808101b10 2024-06-06T03:31:01.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.714+0000 7f68077fe640 1 --2- 172.21.15.50:0/2095875810 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f67f00a2cb0 0x7f67f00a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:01.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.714+0000 7f6810c1b740 1 -- 172.21.15.50:0/387032606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560041026e70 msgr2=0x560041027290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:01.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.714+0000 7f6810c1b740 1 --2- 172.21.15.50:0/387032606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560041026e70 0x560041027290 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f67f80117e0 tx=0x7f67f8011ca0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.715+0000 7f6810c1b740 1 -- 172.21.15.50:0/387032606 shutdown_connections 2024-06-06T03:31:01.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.715+0000 7f6810c1b740 1 --2- 172.21.15.50:0/387032606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56004102c3b0 0x56004102e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.715+0000 7f6810c1b740 1 --2- 172.21.15.50:0/387032606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560041027860 0x56004102bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.715+0000 7f6810c1b740 1 --2- 172.21.15.50:0/387032606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560041026e70 0x560041027290 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.715+0000 7f6810c1b740 1 -- 172.21.15.50:0/387032606 >> 172.21.15.50:0/387032606 conn(0x560041019600 msgr2=0x560041019a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:01.720 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.722+0000 7f6810c1b740 1 -- 172.21.15.50:0/387032606 shutdown_connections 2024-06-06T03:31:01.721 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.722+0000 7f6810c1b740 1 -- 172.21.15.50:0/387032606 wait complete. 2024-06-06T03:31:01.721 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.722+0000 7f6810c1b740 1 -- start start 2024-06-06T03:31:01.722 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.723+0000 7f6810c1b740 1 Processor -- start 2024-06-06T03:31:01.722 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.723+0000 7f6810c1b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560041026e70 0x560041030b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:01.722 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.723+0000 7f6810c1b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560041027860 0x560041031060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:01.722 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.723+0000 7f6810c1b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56004102c3b0 0x560041038030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:01.723 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.723+0000 7f6810c1b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56004102f3c0 con 0x560041027860 2024-06-06T03:31:01.723 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.723+0000 7f6810c1b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560040f0aae0 con 0x56004102c3b0 2024-06-06T03:31:01.723 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.723+0000 7f6810c1b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56004102f540 con 0x560041026e70 2024-06-06T03:31:01.723 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.723+0000 7f6810c1b740 10 client.0 _ll_register_callbacks cb 0x560040f439b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:31:01.723 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.723+0000 7f68077fe640 1 --2- 172.21.15.50:0/2095875810 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f67f00a2cb0 0x7f67f00a5170 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6800000c00 tx=0x7f6800005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:01.724 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.724+0000 7f68077fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560041026e70 0x560041030b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:01.724 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.724+0000 7f68077fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560041026e70 0x560041030b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:44460/0 (socket says 172.21.15.50:44460) 2024-06-06T03:31:01.724 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.724+0000 7f68077fe640 1 -- 172.21.15.50:0/2959530628 learned_addr learned my addr 172.21.15.50:0/2959530628 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:01.724 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.724+0000 7f6807fff640 1 --2- 172.21.15.50:0/2959530628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56004102c3b0 0x560041038030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:01.724 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.724+0000 7f6806ffd640 1 --2- 172.21.15.50:0/2959530628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560041027860 0x560041031060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:01.724 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.724+0000 7f68077fe640 1 -- 172.21.15.50:0/2959530628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56004102c3b0 msgr2=0x560041038030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:01.724 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.724+0000 7f68077fe640 1 --2- 172.21.15.50:0/2959530628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56004102c3b0 0x560041038030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.724 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.724+0000 7f68077fe640 1 -- 172.21.15.50:0/2959530628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560041027860 msgr2=0x560041031060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:01.724 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.724+0000 7f68077fe640 1 --2- 172.21.15.50:0/2959530628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560041027860 0x560041031060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.724 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.724+0000 7f68077fe640 1 -- 172.21.15.50:0/2959530628 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560040c95210 con 0x560041026e70 2024-06-06T03:31:01.724 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.725+0000 7f68077fe640 1 --2- 172.21.15.50:0/2959530628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560041026e70 0x560041030b20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f680002a910 tx=0x7f680002a3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fb5c515ae67a9ba server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:01.725 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.726+0000 7f67e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:31:01.725 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.726+0000 7f67e6ffd640 1 -- 172.21.15.50:0/2959530628 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6800035050 con 0x560041026e70 2024-06-06T03:31:01.725 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.726+0000 7f6810c1b740 1 -- 172.21.15.50:0/2959530628 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67f8003e20 con 0x560041026e70 2024-06-06T03:31:01.725 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.727+0000 7f67e6ffd640 1 -- 172.21.15.50:0/2959530628 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f6800031780 con 0x560041026e70 2024-06-06T03:31:01.726 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.728+0000 7f67e6ffd640 1 -- 172.21.15.50:0/2959530628 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f680005a050 con 0x560041026e70 2024-06-06T03:31:01.727 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.728+0000 7f6810c1b740 10 client.25687 fetch_fsmap learned FSMap version 32 2024-06-06T03:31:01.727 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.728+0000 7f6810c1b740 1 -- 172.21.15.50:0/2959530628 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x560040d61620 con 0x560041026e70 2024-06-06T03:31:01.727 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.728+0000 7f67e6ffd640 1 -- 172.21.15.50:0/2959530628 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f67f8003e20 con 0x560041026e70 2024-06-06T03:31:01.728 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.729+0000 7f67e6ffd640 1 -- 172.21.15.50:0/2959530628 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f6800049530 con 0x560041026e70 2024-06-06T03:31:01.728 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.729+0000 7f6810c1b740 10 client.25687 fetch_fsmap finished waiting for FSMap version 32 2024-06-06T03:31:01.728 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.729+0000 7f6810c1b740 10 client.25687 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:31:01.728 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.729+0000 7f6810c1b740 20 client.25687 populate_metadata read hostname 'smithi050' 2024-06-06T03:31:01.728 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.729+0000 7f6810c1b740 1 --2- 172.21.15.50:0/2959530628 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56004104dd80 0x560041050220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:01.728 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.729+0000 7f6810c1b740 4 client.25687 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:31:01.728 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.729+0000 7f6810c1b740 1 -- 172.21.15.50:0/2959530628 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560040f94f10 con 0x56004104dd80 2024-06-06T03:31:01.728 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.729+0000 7f6806ffd640 1 --2- 172.21.15.50:0/2959530628 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56004104dd80 0x560041050220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:01.729 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.730+0000 7f6806ffd640 1 --2- 172.21.15.50:0/2959530628 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56004104dd80 0x560041050220 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81948e4ef9c5e04c server_cookie=7857f92e4df296a1 in_seq=0 out_seq=0 2024-06-06T03:31:01.729 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.730+0000 7f67e6ffd640 10 client.25687 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:01.730 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.732+0000 7f67e6ffd640 1 -- 172.21.15.50:0/2959530628 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x560040f94f10 con 0x56004104dd80 2024-06-06T03:31:01.731 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.732+0000 7f67e6ffd640 10 client.25687 handle_command_reply: tid=0 2024-06-06T03:31:01.731 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.732+0000 7f6810c1b740 1 client.25687 shutdown 2024-06-06T03:31:01.735 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.736+0000 7f6810c1b740 1 -- 172.21.15.50:0/2959530628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560041026e70 msgr2=0x560041030b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:01.735 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.736+0000 7f6810c1b740 1 --2- 172.21.15.50:0/2959530628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560041026e70 0x560041030b20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f680002a910 tx=0x7f680002a3f0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.736 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.736+0000 7f6810c1b740 1 -- 172.21.15.50:0/2959530628 shutdown_connections 2024-06-06T03:31:01.736 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.736+0000 7f6810c1b740 1 --2- 172.21.15.50:0/2959530628 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56004104dd80 0x560041050220 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.736 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.736+0000 7f6810c1b740 1 --2- 172.21.15.50:0/2959530628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560041027860 0x560041031060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.736 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.736+0000 7f6810c1b740 1 --2- 172.21.15.50:0/2959530628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56004102c3b0 0x560041038030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.736 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.736+0000 7f6810c1b740 1 --2- 172.21.15.50:0/2959530628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560041026e70 0x560041030b20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.736 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.737+0000 7f6810c1b740 1 -- 172.21.15.50:0/2959530628 >> 172.21.15.50:0/2959530628 conn(0x560041019600 msgr2=0x560041026500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:01.736 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.737+0000 7f67e6ffd640 0 client.25687 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:01.743 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.737+0000 7f6810c1b740 1 -- 172.21.15.50:0/2959530628 shutdown_connections 2024-06-06T03:31:01.743 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.737+0000 7f6810c1b740 1 -- 172.21.15.50:0/2959530628 wait complete. 2024-06-06T03:31:01.743 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.737+0000 7f6810c1b740 20 client.25687 trim_cache size 0 max 16384 2024-06-06T03:31:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.787+0000 7f6810c1b740 1 Processor -- start 2024-06-06T03:31:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.789+0000 7f6810c1b740 1 -- start start 2024-06-06T03:31:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.789+0000 7f6810c1b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560041026e70 0x5600410190a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.789+0000 7f6810c1b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560041027860 0x560041037ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:01.790 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.789+0000 7f6810c1b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56004102c3b0 0x560041030730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:01.790 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.790+0000 7f68077fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560041026e70 0x5600410190a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:01.790 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.790+0000 7f68077fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560041026e70 0x5600410190a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:43174/0 (socket says 172.21.15.50:43174) 2024-06-06T03:31:01.790 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.790+0000 7f6806ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560041027860 0x560041037ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:01.790 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.790+0000 7f6806ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560041027860 0x560041037ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:44474/0 (socket says 172.21.15.50:44474) 2024-06-06T03:31:01.790 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.790+0000 7f68077fe640 1 -- 172.21.15.50:0/916485398 learned_addr learned my addr 172.21.15.50:0/916485398 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:01.790 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.790+0000 7f6810c1b740 1 -- 172.21.15.50:0/916485398 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f68081a2450 con 0x56004102c3b0 2024-06-06T03:31:01.790 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.790+0000 7f6810c1b740 1 -- 172.21.15.50:0/916485398 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6808073740 con 0x560041026e70 2024-06-06T03:31:01.790 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.790+0000 7f6810c1b740 1 -- 172.21.15.50:0/916485398 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6808071590 con 0x560041027860 2024-06-06T03:31:01.790 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.790+0000 7f68077fe640 1 -- 172.21.15.50:0/916485398 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560041027860 msgr2=0x560041037ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:01.790 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.790+0000 7f68077fe640 1 --2- 172.21.15.50:0/916485398 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560041027860 0x560041037ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.790 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.790+0000 7f68077fe640 1 -- 172.21.15.50:0/916485398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56004102c3b0 msgr2=0x560041030730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:01.791 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.790+0000 7f68077fe640 1 --2- 172.21.15.50:0/916485398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56004102c3b0 0x560041030730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.791 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.790+0000 7f68077fe640 1 -- 172.21.15.50:0/916485398 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56004101a2d0 con 0x560041026e70 2024-06-06T03:31:01.791 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.791+0000 7f68077fe640 1 --2- 172.21.15.50:0/916485398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560041026e70 0x5600410190a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6800006010 tx=0x7f68000058b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6782dce1e2dd31c0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.792+0000 7f67ed7fa640 1 -- 172.21.15.50:0/916485398 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6800035040 con 0x560041026e70 2024-06-06T03:31:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.792+0000 7f67ed7fa640 1 -- 172.21.15.50:0/916485398 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6800049620 con 0x560041026e70 2024-06-06T03:31:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.792+0000 7f67ed7fa640 1 -- 172.21.15.50:0/916485398 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680003c6a0 con 0x560041026e70 2024-06-06T03:31:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.794+0000 7f6810c1b740 1 -- 172.21.15.50:0/916485398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560041026e70 msgr2=0x5600410190a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.794+0000 7f6810c1b740 1 --2- 172.21.15.50:0/916485398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560041026e70 0x5600410190a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6800006010 tx=0x7f68000058b0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.798 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.800+0000 7f6810c1b740 1 -- 172.21.15.50:0/916485398 shutdown_connections 2024-06-06T03:31:01.799 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.800+0000 7f6810c1b740 1 --2- 172.21.15.50:0/916485398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56004102c3b0 0x560041030730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.799 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.800+0000 7f6810c1b740 1 --2- 172.21.15.50:0/916485398 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560041027860 0x560041037ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.799 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.800+0000 7f6810c1b740 1 --2- 172.21.15.50:0/916485398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560041026e70 0x5600410190a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.799 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.800+0000 7f6810c1b740 1 -- 172.21.15.50:0/916485398 >> 172.21.15.50:0/916485398 conn(0x560041019600 msgr2=0x56004102bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:01.799 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.800+0000 7f6810c1b740 1 -- 172.21.15.50:0/916485398 shutdown_connections 2024-06-06T03:31:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.801+0000 7f6810c1b740 1 -- 172.21.15.50:0/916485398 wait complete. 2024-06-06T03:31:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.802+0000 7f6810c1b740 1 -- start start 2024-06-06T03:31:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.802+0000 7f6810c1b740 1 Processor -- start 2024-06-06T03:31:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.803+0000 7f6810c1b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560041026e70 0x560041034710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.803+0000 7f6810c1b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560041027860 0x560041034c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.803+0000 7f6810c1b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56004102c3b0 0x56004103bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.803+0000 7f6810c1b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6808071c00 con 0x560041026e70 2024-06-06T03:31:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.803+0000 7f6810c1b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6808073070 con 0x56004102c3b0 2024-06-06T03:31:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.803+0000 7f6810c1b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f68080722d0 con 0x560041027860 2024-06-06T03:31:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.803+0000 7f6810c1b740 10 client.0 _ll_register_callbacks cb 0x7f67f80093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:31:01.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.806+0000 7f6806ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560041027860 0x560041034c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:01.806 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.806+0000 7f6806ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560041027860 0x560041034c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:44488/0 (socket says 172.21.15.50:44488) 2024-06-06T03:31:01.806 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.806+0000 7f6806ffd640 1 -- 172.21.15.50:0/3623294414 learned_addr learned my addr 172.21.15.50:0/3623294414 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:01.806 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.806+0000 7f6807fff640 1 --2- 172.21.15.50:0/3623294414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56004102c3b0 0x56004103bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:01.806 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.806+0000 7f6806ffd640 1 -- 172.21.15.50:0/3623294414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56004102c3b0 msgr2=0x56004103bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:01.806 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.806+0000 7f6806ffd640 1 --2- 172.21.15.50:0/3623294414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56004102c3b0 0x56004103bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.806 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.806+0000 7f6806ffd640 1 -- 172.21.15.50:0/3623294414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560041026e70 msgr2=0x560041034710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.806+0000 7f6806ffd640 1 --2- 172.21.15.50:0/3623294414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560041026e70 0x560041034710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.806+0000 7f6806ffd640 1 -- 172.21.15.50:0/3623294414 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56004103c280 con 0x560041027860 2024-06-06T03:31:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.808+0000 7f6806ffd640 1 --2- 172.21.15.50:0/3623294414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560041027860 0x560041034c50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f67fc0ccdd0 tx=0x7f67fc09b660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d757e48f3960ed5c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.808+0000 7f67e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:31:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.808+0000 7f67e6ffd640 1 -- 172.21.15.50:0/3623294414 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67fc0b9060 con 0x560041027860 2024-06-06T03:31:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.808+0000 7f67e6ffd640 1 -- 172.21.15.50:0/3623294414 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f67fc0cf370 con 0x560041027860 2024-06-06T03:31:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.809+0000 7f6810c1b740 1 -- 172.21.15.50:0/3623294414 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6800049620 con 0x560041027860 2024-06-06T03:31:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.810+0000 7f67e6ffd640 1 -- 172.21.15.50:0/3623294414 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f67fc086040 con 0x560041027860 2024-06-06T03:31:01.811 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.813+0000 7f6810c1b740 10 client.25693 fetch_fsmap learned FSMap version 32 2024-06-06T03:31:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.813+0000 7f6810c1b740 1 -- 172.21.15.50:0/3623294414 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56004103d660 con 0x560041027860 2024-06-06T03:31:01.813 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.814+0000 7f67e6ffd640 1 -- 172.21.15.50:0/3623294414 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6800049620 con 0x560041027860 2024-06-06T03:31:01.813 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.814+0000 7f67e6ffd640 1 -- 172.21.15.50:0/3623294414 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f67fc0ba320 con 0x560041027860 2024-06-06T03:31:01.814 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.815+0000 7f6810c1b740 10 client.25693 fetch_fsmap finished waiting for FSMap version 32 2024-06-06T03:31:01.814 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.815+0000 7f6810c1b740 10 client.25693 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:31:01.814 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.815+0000 7f6810c1b740 20 client.25693 populate_metadata read hostname 'smithi050' 2024-06-06T03:31:01.814 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.815+0000 7f6810c1b740 1 --2- 172.21.15.50:0/3623294414 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56004103e070 0x560041040490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:01.814 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.815+0000 7f6810c1b740 4 client.25693 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:31:01.814 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.815+0000 7f6810c1b740 1 -- 172.21.15.50:0/3623294414 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560040f8ec20 con 0x56004103e070 2024-06-06T03:31:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.819+0000 7f68077fe640 1 --2- 172.21.15.50:0/3623294414 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56004103e070 0x560041040490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.821+0000 7f68077fe640 1 --2- 172.21.15.50:0/3623294414 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56004103e070 0x560041040490 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fe4f23940228806 server_cookie=faf4d1af52153ec9 in_seq=0 out_seq=0 2024-06-06T03:31:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.821+0000 7f67e6ffd640 10 client.25693 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.827+0000 7f67e6ffd640 1 -- 172.21.15.50:0/3623294414 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x560040f8ec20 con 0x56004103e070 2024-06-06T03:31:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.827+0000 7f67e6ffd640 10 client.25693 handle_command_reply: tid=0 2024-06-06T03:31:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.827+0000 7f6810c1b740 1 client.25693 shutdown 2024-06-06T03:31:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.829+0000 7f6810c1b740 1 -- 172.21.15.50:0/3623294414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560041027860 msgr2=0x560041034c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.829+0000 7f6810c1b740 1 --2- 172.21.15.50:0/3623294414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560041027860 0x560041034c50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f67fc0ccdd0 tx=0x7f67fc09b660 comp rx=0 tx=0).stop 2024-06-06T03:31:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.831+0000 7f6810c1b740 1 -- 172.21.15.50:0/3623294414 shutdown_connections 2024-06-06T03:31:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.831+0000 7f6810c1b740 1 --2- 172.21.15.50:0/3623294414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56004102c3b0 0x56004103bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.831+0000 7f6810c1b740 1 --2- 172.21.15.50:0/3623294414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560041027860 0x560041034c50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.831+0000 7f6810c1b740 1 --2- 172.21.15.50:0/3623294414 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56004103e070 0x560041040490 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.831+0000 7f6810c1b740 1 --2- 172.21.15.50:0/3623294414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560041026e70 0x560041034710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.831+0000 7f6810c1b740 1 -- 172.21.15.50:0/3623294414 >> 172.21.15.50:0/3623294414 conn(0x560041019600 msgr2=0x560041030710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.832+0000 7f67e6ffd640 0 client.25693 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.832+0000 7f6810c1b740 1 -- 172.21.15.50:0/3623294414 shutdown_connections 2024-06-06T03:31:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.832+0000 7f6810c1b740 1 -- 172.21.15.50:0/3623294414 wait complete. 2024-06-06T03:31:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.833+0000 7f6810c1b740 20 client.25693 trim_cache size 0 max 16384 2024-06-06T03:31:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:31:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:31:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:31:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.833+0000 7f680de31640 1 -- 172.21.15.50:0/2095875810 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f67f00a2cb0 msgr2=0x7f67f00a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.833+0000 7f680de31640 1 --2- 172.21.15.50:0/2095875810 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f67f00a2cb0 0x7f67f00a5170 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6800000c00 tx=0x7f6800005a20 comp rx=0 tx=0).stop 2024-06-06T03:31:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.833+0000 7f680de31640 1 -- 172.21.15.50:0/2095875810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6808101b10 msgr2=0x7f6808198110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.833+0000 7f680de31640 1 --2- 172.21.15.50:0/2095875810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6808101b10 0x7f6808198110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f67fc00e9f0 tx=0x7f67fc00eeb0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.833+0000 7f680de31640 1 -- 172.21.15.50:0/2095875810 shutdown_connections 2024-06-06T03:31:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.833+0000 7f680de31640 1 --2- 172.21.15.50:0/2095875810 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f67f00a2cb0 0x7f67f00a5170 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.833+0000 7f680de31640 1 --2- 172.21.15.50:0/2095875810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68081024d0 0x7f680819f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.833+0000 7f680de31640 1 --2- 172.21.15.50:0/2095875810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6808101b10 0x7f6808198110 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.833+0000 7f680de31640 1 --2- 172.21.15.50:0/2095875810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6808100920 0x7f6808197bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.833+0000 7f680de31640 1 -- 172.21.15.50:0/2095875810 >> 172.21.15.50:0/2095875810 conn(0x7f68080fbe90 msgr2=0x7f68080fd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:01.834 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.835+0000 7f680de31640 1 -- 172.21.15.50:0/2095875810 shutdown_connections 2024-06-06T03:31:01.834 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:01.835+0000 7f680de31640 1 -- 172.21.15.50:0/2095875810 wait complete. 2024-06-06T03:31:02.241 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-06T03:31:02.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:02 smithi122 ceph-mon[35759]: pgmap v563: 129 pgs: 129 active+clean; 10 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 43 MiB/s wr, 698 op/s 2024-06-06T03:31:03.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:02 smithi050 ceph-mon[32421]: pgmap v563: 129 pgs: 129 active+clean; 10 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 43 MiB/s wr, 698 op/s 2024-06-06T03:31:03.039 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:31:03.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:02 smithi079 ceph-mon[35478]: pgmap v563: 129 pgs: 129 active+clean; 10 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 43 MiB/s wr, 698 op/s 2024-06-06T03:31:04.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:04 smithi122 ceph-mon[35759]: pgmap v564: 129 pgs: 129 active+clean; 10 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 45 MiB/s wr, 718 op/s 2024-06-06T03:31:05.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:04 smithi050 ceph-mon[32421]: pgmap v564: 129 pgs: 129 active+clean; 10 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 45 MiB/s wr, 718 op/s 2024-06-06T03:31:05.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:04 smithi079 ceph-mon[35478]: pgmap v564: 129 pgs: 129 active+clean; 10 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 45 MiB/s wr, 718 op/s 2024-06-06T03:31:06.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.484+0000 7f22f170f700 1 -- 172.21.15.50:0/2270872171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22ec104ed0 msgr2=0x7f22ec105360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:06.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.484+0000 7f22f170f700 1 --2- 172.21.15.50:0/2270872171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22ec104ed0 0x7f22ec105360 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f22dc009990 tx=0x7f22dc009ca0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.486+0000 7f22f170f700 1 -- 172.21.15.50:0/2270872171 shutdown_connections 2024-06-06T03:31:06.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.486+0000 7f22f170f700 1 --2- 172.21.15.50:0/2270872171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22ec104ed0 0x7f22ec105360 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.486+0000 7f22f170f700 1 --2- 172.21.15.50:0/2270872171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22ec1073c0 0x7f22ec06a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.486+0000 7f22f170f700 1 --2- 172.21.15.50:0/2270872171 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22ec06a6e0 0x7f22ec06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.486+0000 7f22f170f700 1 -- 172.21.15.50:0/2270872171 >> 172.21.15.50:0/2270872171 conn(0x7f22ec078340 msgr2=0x7f22ec078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:06.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.486+0000 7f22f170f700 1 -- 172.21.15.50:0/2270872171 shutdown_connections 2024-06-06T03:31:06.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.486+0000 7f22f170f700 1 -- 172.21.15.50:0/2270872171 wait complete. 2024-06-06T03:31:06.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.487+0000 7f22f170f700 1 Processor -- start 2024-06-06T03:31:06.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.488+0000 7f22f170f700 1 -- start start 2024-06-06T03:31:06.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.488+0000 7f22f170f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22ec06a6e0 0x7f22ec073cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:06.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.488+0000 7f22f170f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22ec104ed0 0x7f22ec06cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:06.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.488+0000 7f22f170f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22ec1073c0 0x7f22ec06d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:06.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.488+0000 7f22f170f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f22ec118c50 con 0x7f22ec06a6e0 2024-06-06T03:31:06.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.488+0000 7f22f170f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f22ec118ad0 con 0x7f22ec1073c0 2024-06-06T03:31:06.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.488+0000 7f22f170f700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f22ec118dd0 con 0x7f22ec104ed0 2024-06-06T03:31:06.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.488+0000 7f22eaffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22ec06a6e0 0x7f22ec073cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:06.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.488+0000 7f22eaffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22ec06a6e0 0x7f22ec073cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36296/0 (socket says 172.21.15.50:36296) 2024-06-06T03:31:06.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.488+0000 7f22eaffd700 1 -- 172.21.15.50:0/1929637888 learned_addr learned my addr 172.21.15.50:0/1929637888 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:06.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.488+0000 7f22eb7fe700 1 --2- 172.21.15.50:0/1929637888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22ec1073c0 0x7f22ec06d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:06.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.488+0000 7f22ea7fc700 1 --2- 172.21.15.50:0/1929637888 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22ec104ed0 0x7f22ec06cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:06.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.489+0000 7f22ea7fc700 1 -- 172.21.15.50:0/1929637888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22ec1073c0 msgr2=0x7f22ec06d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:06.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.489+0000 7f22ea7fc700 1 --2- 172.21.15.50:0/1929637888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22ec1073c0 0x7f22ec06d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.489+0000 7f22ea7fc700 1 -- 172.21.15.50:0/1929637888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22ec06a6e0 msgr2=0x7f22ec073cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:06.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.489+0000 7f22ea7fc700 1 --2- 172.21.15.50:0/1929637888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22ec06a6e0 0x7f22ec073cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.489+0000 7f22ea7fc700 1 -- 172.21.15.50:0/1929637888 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22ec06d910 con 0x7f22ec104ed0 2024-06-06T03:31:06.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.490+0000 7f22ea7fc700 1 --2- 172.21.15.50:0/1929637888 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22ec104ed0 0x7f22ec06cd60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f22d400ef10 tx=0x7f22d400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:06.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.491+0000 7f22e3fff700 1 -- 172.21.15.50:0/1929637888 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d400c9c0 con 0x7f22ec104ed0 2024-06-06T03:31:06.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.491+0000 7f22e3fff700 1 -- 172.21.15.50:0/1929637888 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f22d4019070 con 0x7f22ec104ed0 2024-06-06T03:31:06.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.491+0000 7f22e3fff700 1 -- 172.21.15.50:0/1929637888 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d4014480 con 0x7f22ec104ed0 2024-06-06T03:31:06.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.492+0000 7f22f170f700 1 -- 172.21.15.50:0/1929637888 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22ec06dba0 con 0x7f22ec104ed0 2024-06-06T03:31:06.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.492+0000 7f22f170f700 1 -- 172.21.15.50:0/1929637888 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22ec071b20 con 0x7f22ec104ed0 2024-06-06T03:31:06.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.498+0000 7f22fbf92b80 1 Processor -- start 2024-06-06T03:31:06.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.499+0000 7f22fbf92b80 1 -- start start 2024-06-06T03:31:06.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.499+0000 7f22e3fff700 1 -- 172.21.15.50:0/1929637888 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f22d4012050 con 0x7f22ec104ed0 2024-06-06T03:31:06.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.500+0000 7f22fbf92b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626705ccf60 0x5626705cd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:06.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.500+0000 7f22fbf92b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626705cd880 0x5626705c7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:06.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.500+0000 7f22fbf92b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626705c77a0 0x5626705c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:06.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.500+0000 7f22fbf92b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5626704b9f60 con 0x5626705ccf60 2024-06-06T03:31:06.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.500+0000 7f22fbf92b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562670518850 con 0x5626705cd880 2024-06-06T03:31:06.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.500+0000 7f22fbf92b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562670480460 con 0x5626705c77a0 2024-06-06T03:31:06.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.501+0000 7f22ea7fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626705c77a0 0x5626705c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:06.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.501+0000 7f22ea7fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626705c77a0 0x5626705c7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:44526/0 (socket says 172.21.15.50:44526) 2024-06-06T03:31:06.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.501+0000 7f22ea7fc700 1 -- 172.21.15.50:0/3386804656 learned_addr learned my addr 172.21.15.50:0/3386804656 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:06.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.501+0000 7f22eaffd700 1 --2- 172.21.15.50:0/3386804656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626705cd880 0x5626705c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:06.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.501+0000 7f22eb7fe700 1 --2- 172.21.15.50:0/3386804656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626705ccf60 0x5626705cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:06.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.502+0000 7f22eaffd700 1 -- 172.21.15.50:0/3386804656 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626705c77a0 msgr2=0x5626705c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:06.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.502+0000 7f22eaffd700 1 --2- 172.21.15.50:0/3386804656 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626705c77a0 0x5626705c7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.502+0000 7f22eaffd700 1 -- 172.21.15.50:0/3386804656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626705ccf60 msgr2=0x5626705cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:06.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.502+0000 7f22eaffd700 1 --2- 172.21.15.50:0/3386804656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626705ccf60 0x5626705cd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.502+0000 7f22eaffd700 1 -- 172.21.15.50:0/3386804656 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626704678d0 con 0x5626705cd880 2024-06-06T03:31:06.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.502+0000 7f22eb7fe700 1 --2- 172.21.15.50:0/3386804656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626705ccf60 0x5626705cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:31:06.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.502+0000 7f22eaffd700 1 --2- 172.21.15.50:0/3386804656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626705cd880 0x5626705c7260 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f22e400bd90 tx=0x7f22e40106b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad55e5970f5361a3 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:06.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.502+0000 7f22e3fff700 1 --2- 172.21.15.50:0/1929637888 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f22d80a2e20 0x7f22d80a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:06.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.503+0000 7f22e17fa700 1 -- 172.21.15.50:0/3386804656 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e4010db0 con 0x5626705cd880 2024-06-06T03:31:06.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.503+0000 7f22e17fa700 1 -- 172.21.15.50:0/3386804656 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f22e40044e0 con 0x5626705cd880 2024-06-06T03:31:06.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.503+0000 7f22e17fa700 1 -- 172.21.15.50:0/3386804656 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e4011680 con 0x5626705cd880 2024-06-06T03:31:06.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.503+0000 7f22e3fff700 1 -- 172.21.15.50:0/1929637888 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f22d40d0160 con 0x7f22ec104ed0 2024-06-06T03:31:06.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.504+0000 7f22fbf92b80 1 -- 172.21.15.50:0/3386804656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626705cd880 msgr2=0x5626705c7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:06.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.504+0000 7f22fbf92b80 1 --2- 172.21.15.50:0/3386804656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626705cd880 0x5626705c7260 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f22e400bd90 tx=0x7f22e40106b0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.505+0000 7f22eb7fe700 1 --2- 172.21.15.50:0/1929637888 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f22d80a2e20 0x7f22d80a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:06.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.505+0000 7f22fbf92b80 1 -- 172.21.15.50:0/3386804656 shutdown_connections 2024-06-06T03:31:06.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.505+0000 7f22fbf92b80 1 --2- 172.21.15.50:0/3386804656 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626705c77a0 0x5626705c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.505+0000 7f22fbf92b80 1 --2- 172.21.15.50:0/3386804656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626705ccf60 0x5626705cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.505+0000 7f22fbf92b80 1 --2- 172.21.15.50:0/3386804656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626705cd880 0x5626705c7260 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.505+0000 7f22fbf92b80 1 -- 172.21.15.50:0/3386804656 >> 172.21.15.50:0/3386804656 conn(0x5626704f4080 msgr2=0x5626705c2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:06.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.506+0000 7f22eb7fe700 1 --2- 172.21.15.50:0/1929637888 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f22d80a2e20 0x7f22d80a52e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f22dc009750 tx=0x7f22dc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:06.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.507+0000 7f22fbf92b80 1 -- 172.21.15.50:0/3386804656 shutdown_connections 2024-06-06T03:31:06.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.510+0000 7f22fbf92b80 1 -- 172.21.15.50:0/3386804656 wait complete. 2024-06-06T03:31:06.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.510+0000 7f22fbf92b80 1 -- start start 2024-06-06T03:31:06.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.511+0000 7f22fbf92b80 1 Processor -- start 2024-06-06T03:31:06.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.512+0000 7f22fbf92b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626705c77a0 0x5626705d3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:06.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.512+0000 7f22fbf92b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626705ccf60 0x5626705d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:06.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.512+0000 7f22fbf92b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626705cd880 0x5626705d0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:06.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.512+0000 7f22fbf92b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5626704b8fc0 con 0x5626705ccf60 2024-06-06T03:31:06.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.512+0000 7f22fbf92b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562670514810 con 0x5626705c77a0 2024-06-06T03:31:06.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.512+0000 7f22fbf92b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5626705d4260 con 0x5626705cd880 2024-06-06T03:31:06.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.512+0000 7f22fbf92b80 10 client.0 _ll_register_callbacks cb 0x5626704ae5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:31:06.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.513+0000 7f22ea7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626705ccf60 0x5626705d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:06.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.513+0000 7f22ea7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626705ccf60 0x5626705d08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36302/0 (socket says 172.21.15.50:36302) 2024-06-06T03:31:06.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.513+0000 7f22ea7fc700 1 -- 172.21.15.50:0/2761873117 learned_addr learned my addr 172.21.15.50:0/2761873117 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:06.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.513+0000 7f22eaffd700 1 --2- 172.21.15.50:0/2761873117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626705c77a0 0x5626705d3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:06.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.514+0000 7f22eaffd700 1 -- 172.21.15.50:0/2761873117 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626705cd880 msgr2=0x5626705d0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:06.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.514+0000 7f22eaffd700 1 --2- 172.21.15.50:0/2761873117 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626705cd880 0x5626705d0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.514+0000 7f22eaffd700 1 -- 172.21.15.50:0/2761873117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626705ccf60 msgr2=0x5626705d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:06.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.514+0000 7f22eaffd700 1 --2- 172.21.15.50:0/2761873117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626705ccf60 0x5626705d08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.514+0000 7f22eaffd700 1 -- 172.21.15.50:0/2761873117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626704de750 con 0x5626705c77a0 2024-06-06T03:31:06.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.516+0000 7f22eaffd700 1 --2- 172.21.15.50:0/2761873117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626705c77a0 0x5626705d3590 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f22e400bd90 tx=0x7f22e4003680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc377197672abe42 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:06.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.517+0000 7f22d27fc700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:31:06.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.518+0000 7f22d27fc700 1 -- 172.21.15.50:0/2761873117 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e4028060 con 0x5626705c77a0 2024-06-06T03:31:06.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.518+0000 7f22d27fc700 1 -- 172.21.15.50:0/2761873117 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f22e4003d20 con 0x5626705c77a0 2024-06-06T03:31:06.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.519+0000 7f22fbf92b80 1 -- 172.21.15.50:0/2761873117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22e40044e0 con 0x5626705c77a0 2024-06-06T03:31:06.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.519+0000 7f22d27fc700 1 -- 172.21.15.50:0/2761873117 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f22e402f050 con 0x5626705c77a0 2024-06-06T03:31:06.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.519+0000 7f22fbf92b80 10 client.25730 fetch_fsmap learned FSMap version 32 2024-06-06T03:31:06.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.519+0000 7f22fbf92b80 1 -- 172.21.15.50:0/2761873117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5626705ef9f0 con 0x5626705c77a0 2024-06-06T03:31:06.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.519+0000 7f22d27fc700 1 -- 172.21.15.50:0/2761873117 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f22e40044e0 con 0x5626705c77a0 2024-06-06T03:31:06.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.519+0000 7f22d27fc700 1 -- 172.21.15.50:0/2761873117 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f22e4022030 con 0x5626705c77a0 2024-06-06T03:31:06.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.519+0000 7f22fbf92b80 10 client.25730 fetch_fsmap finished waiting for FSMap version 32 2024-06-06T03:31:06.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.519+0000 7f22fbf92b80 10 client.25730 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:31:06.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.520+0000 7f22fbf92b80 20 client.25730 populate_metadata read hostname 'smithi050' 2024-06-06T03:31:06.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.520+0000 7f22fbf92b80 1 --2- 172.21.15.50:0/2761873117 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5626705f2280 0x5626705f4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:06.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.520+0000 7f22fbf92b80 4 client.25730 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:31:06.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.520+0000 7f22fbf92b80 1 -- 172.21.15.50:0/2761873117 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562670525d50 con 0x5626705f2280 2024-06-06T03:31:06.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.520+0000 7f22ea7fc700 1 --2- 172.21.15.50:0/2761873117 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5626705f2280 0x5626705f4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:06.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.521+0000 7f22d27fc700 10 client.25730 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:06.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.521+0000 7f22ea7fc700 1 --2- 172.21.15.50:0/2761873117 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5626705f2280 0x5626705f4700 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ba198306d978ffc server_cookie=af9369cf2fc4441f in_seq=0 out_seq=0 2024-06-06T03:31:06.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.522+0000 7f22d27fc700 1 -- 172.21.15.50:0/2761873117 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x562670525d50 con 0x5626705f2280 2024-06-06T03:31:06.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.522+0000 7f22d27fc700 10 client.25730 handle_command_reply: tid=0 2024-06-06T03:31:06.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.522+0000 7f22fbf92b80 1 client.25730 shutdown 2024-06-06T03:31:06.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.524+0000 7f22fbf92b80 1 -- 172.21.15.50:0/2761873117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626705c77a0 msgr2=0x5626705d3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:06.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.524+0000 7f22fbf92b80 1 --2- 172.21.15.50:0/2761873117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626705c77a0 0x5626705d3590 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f22e400bd90 tx=0x7f22e4003680 comp rx=0 tx=0).stop 2024-06-06T03:31:06.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.524+0000 7f22fbf92b80 1 -- 172.21.15.50:0/2761873117 shutdown_connections 2024-06-06T03:31:06.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.524+0000 7f22fbf92b80 1 --2- 172.21.15.50:0/2761873117 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5626705f2280 0x5626705f4700 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.524+0000 7f22fbf92b80 1 --2- 172.21.15.50:0/2761873117 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626705cd880 0x5626705d0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.524+0000 7f22fbf92b80 1 --2- 172.21.15.50:0/2761873117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626705c77a0 0x5626705d3590 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.524+0000 7f22fbf92b80 1 --2- 172.21.15.50:0/2761873117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626705ccf60 0x5626705d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.524+0000 7f22fbf92b80 1 -- 172.21.15.50:0/2761873117 >> 172.21.15.50:0/2761873117 conn(0x5626704f4080 msgr2=0x5626705c1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:06.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.524+0000 7f22d27fc700 0 client.25730 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:06.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.524+0000 7f22fbf92b80 1 -- 172.21.15.50:0/2761873117 shutdown_connections 2024-06-06T03:31:06.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.524+0000 7f22fbf92b80 1 -- 172.21.15.50:0/2761873117 wait complete. 2024-06-06T03:31:06.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.525+0000 7f22fbf92b80 20 client.25730 trim_cache size 0 max 16384 2024-06-06T03:31:06.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.575+0000 7f22fbf92b80 1 Processor -- start 2024-06-06T03:31:06.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.576+0000 7f22fbf92b80 1 -- start start 2024-06-06T03:31:06.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.576+0000 7f22fbf92b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626705c77a0 0x5626705c7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:06.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.576+0000 7f22fbf92b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626705ccf60 0x5626705d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:06.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.576+0000 7f22fbf92b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626705cd880 0x5626705ce430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:06.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.576+0000 7f22fbf92b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc0113e0 con 0x5626705c77a0 2024-06-06T03:31:06.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.576+0000 7f22fbf92b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc00ec70 con 0x5626705cd880 2024-06-06T03:31:06.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.576+0000 7f22fbf92b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc00cac0 con 0x5626705ccf60 2024-06-06T03:31:06.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.576+0000 7f22eaffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626705c77a0 0x5626705c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:06.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.576+0000 7f22eaffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626705c77a0 0x5626705c7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36304/0 (socket says 172.21.15.50:36304) 2024-06-06T03:31:06.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.576+0000 7f22eaffd700 1 -- 172.21.15.50:0/3981673469 learned_addr learned my addr 172.21.15.50:0/3981673469 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:06.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.576+0000 7f22eb7fe700 1 --2- 172.21.15.50:0/3981673469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626705cd880 0x5626705ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:06.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.577+0000 7f22ea7fc700 1 --2- 172.21.15.50:0/3981673469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626705ccf60 0x5626705d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:06.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.577+0000 7f22ea7fc700 1 -- 172.21.15.50:0/3981673469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626705cd880 msgr2=0x5626705ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:06.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.577+0000 7f22ea7fc700 1 --2- 172.21.15.50:0/3981673469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626705cd880 0x5626705ce430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.578+0000 7f22ea7fc700 1 -- 172.21.15.50:0/3981673469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626705c77a0 msgr2=0x5626705c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:06.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.578+0000 7f22ea7fc700 1 --2- 172.21.15.50:0/3981673469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626705c77a0 0x5626705c7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.578+0000 7f22ea7fc700 1 -- 172.21.15.50:0/3981673469 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626705c39a0 con 0x5626705ccf60 2024-06-06T03:31:06.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.578+0000 7f22ea7fc700 1 --2- 172.21.15.50:0/3981673469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626705ccf60 0x5626705d0e50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f22d409c570 tx=0x7f22d4011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa10986ec6d0afba server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:06.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.578+0000 7f22e0ff9700 1 -- 172.21.15.50:0/3981673469 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d409c3b0 con 0x5626705ccf60 2024-06-06T03:31:06.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.579+0000 7f22e0ff9700 1 -- 172.21.15.50:0/3981673469 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f22d409cce0 con 0x5626705ccf60 2024-06-06T03:31:06.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.579+0000 7f22e0ff9700 1 -- 172.21.15.50:0/3981673469 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d409bf40 con 0x5626705ccf60 2024-06-06T03:31:06.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.580+0000 7f22fbf92b80 1 -- 172.21.15.50:0/3981673469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626705ccf60 msgr2=0x5626705d0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:06.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.580+0000 7f22fbf92b80 1 --2- 172.21.15.50:0/3981673469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626705ccf60 0x5626705d0e50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f22d409c570 tx=0x7f22d4011000 comp rx=0 tx=0).stop 2024-06-06T03:31:06.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.583+0000 7f22fbf92b80 1 -- 172.21.15.50:0/3981673469 shutdown_connections 2024-06-06T03:31:06.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.584+0000 7f22fbf92b80 1 --2- 172.21.15.50:0/3981673469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626705cd880 0x5626705ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.584+0000 7f22fbf92b80 1 --2- 172.21.15.50:0/3981673469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626705c77a0 0x5626705c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.584+0000 7f22fbf92b80 1 --2- 172.21.15.50:0/3981673469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626705ccf60 0x5626705d0e50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.584+0000 7f22fbf92b80 1 -- 172.21.15.50:0/3981673469 >> 172.21.15.50:0/3981673469 conn(0x5626704f4080 msgr2=0x5626705cdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:06.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.584+0000 7f22fbf92b80 1 -- 172.21.15.50:0/3981673469 shutdown_connections 2024-06-06T03:31:06.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.584+0000 7f22fbf92b80 1 -- 172.21.15.50:0/3981673469 wait complete. 2024-06-06T03:31:06.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.584+0000 7f22fbf92b80 1 -- start start 2024-06-06T03:31:06.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.585+0000 7f22fbf92b80 1 Processor -- start 2024-06-06T03:31:06.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.585+0000 7f22fbf92b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626705c77a0 0x5626705d9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:06.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.585+0000 7f22fbf92b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626705ccf60 0x5626705d9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:06.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.585+0000 7f22fbf92b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626705cd880 0x5626705f9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:06.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.585+0000 7f22fbf92b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc00d130 con 0x5626705ccf60 2024-06-06T03:31:06.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.585+0000 7f22fbf92b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc00e5a0 con 0x5626705c77a0 2024-06-06T03:31:06.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.585+0000 7f22fbf92b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc00d800 con 0x5626705cd880 2024-06-06T03:31:06.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.585+0000 7f22fbf92b80 10 client.0 _ll_register_callbacks cb 0x5626704ae5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:31:06.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.586+0000 7f22eaffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626705c77a0 0x5626705d9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:06.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.586+0000 7f22eb7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626705cd880 0x5626705f9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:06.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.586+0000 7f22eb7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626705cd880 0x5626705f9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:44564/0 (socket says 172.21.15.50:44564) 2024-06-06T03:31:06.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.586+0000 7f22eb7fe700 1 -- 172.21.15.50:0/2951325581 learned_addr learned my addr 172.21.15.50:0/2951325581 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:06.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.586+0000 7f22eb7fe700 1 -- 172.21.15.50:0/2951325581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626705c77a0 msgr2=0x5626705d9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:06.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.586+0000 7f22eb7fe700 1 --2- 172.21.15.50:0/2951325581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626705c77a0 0x5626705d9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.586+0000 7f22eb7fe700 1 -- 172.21.15.50:0/2951325581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626705ccf60 msgr2=0x5626705d9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:06.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.586+0000 7f22eb7fe700 1 --2- 172.21.15.50:0/2951325581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626705ccf60 0x5626705d9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.586+0000 7f22eb7fe700 1 -- 172.21.15.50:0/2951325581 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626705fab10 con 0x5626705cd880 2024-06-06T03:31:06.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.587+0000 7f22eb7fe700 1 --2- 172.21.15.50:0/2951325581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626705cd880 0x5626705f9000 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f22dc009990 tx=0x7f22dc009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6953423c0cf852a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:06.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.587+0000 7f22d27fc700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:31:06.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.587+0000 7f22d27fc700 1 -- 172.21.15.50:0/2951325581 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22dc035060 con 0x5626705cd880 2024-06-06T03:31:06.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.587+0000 7f22d27fc700 1 -- 172.21.15.50:0/2951325581 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f22dc00f660 con 0x5626705cd880 2024-06-06T03:31:06.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.587+0000 7f22fbf92b80 1 -- 172.21.15.50:0/2951325581 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22d409cce0 con 0x5626705cd880 2024-06-06T03:31:06.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.588+0000 7f22d27fc700 1 -- 172.21.15.50:0/2951325581 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f22dc02b070 con 0x5626705cd880 2024-06-06T03:31:06.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.588+0000 7f22fbf92b80 10 client.25708 fetch_fsmap learned FSMap version 32 2024-06-06T03:31:06.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.588+0000 7f22fbf92b80 1 -- 172.21.15.50:0/2951325581 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56267065c4c0 con 0x5626705cd880 2024-06-06T03:31:06.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.589+0000 7f22d27fc700 1 -- 172.21.15.50:0/2951325581 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f22d409cce0 con 0x5626705cd880 2024-06-06T03:31:06.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.589+0000 7f22d27fc700 1 -- 172.21.15.50:0/2951325581 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f22dc024890 con 0x5626705cd880 2024-06-06T03:31:06.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.590+0000 7f22fbf92b80 10 client.25708 fetch_fsmap finished waiting for FSMap version 32 2024-06-06T03:31:06.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.590+0000 7f22fbf92b80 10 client.25708 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:31:06.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.590+0000 7f22fbf92b80 20 client.25708 populate_metadata read hostname 'smithi050' 2024-06-06T03:31:06.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.590+0000 7f22fbf92b80 1 --2- 172.21.15.50:0/2951325581 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56267065cb60 0x56267065efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:06.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.590+0000 7f22fbf92b80 4 client.25708 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-06T03:31:06.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.590+0000 7f22fbf92b80 1 -- 172.21.15.50:0/2951325581 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5626705202d0 con 0x56267065cb60 2024-06-06T03:31:06.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.592+0000 7f22eaffd700 1 --2- 172.21.15.50:0/2951325581 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56267065cb60 0x56267065efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:06.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.595+0000 7f22d27fc700 10 client.25708 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:06.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.595+0000 7f22eaffd700 1 --2- 172.21.15.50:0/2951325581 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56267065cb60 0x56267065efa0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=767217c21f24e5d1 server_cookie=e98df90c297ee32c in_seq=0 out_seq=0 2024-06-06T03:31:06.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.596+0000 7f22d27fc700 1 -- 172.21.15.50:0/2951325581 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5626705202d0 con 0x56267065cb60 2024-06-06T03:31:06.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.596+0000 7f22d27fc700 10 client.25708 handle_command_reply: tid=0 2024-06-06T03:31:06.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.596+0000 7f22fbf92b80 1 client.25708 shutdown 2024-06-06T03:31:06.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.598+0000 7f22fbf92b80 1 -- 172.21.15.50:0/2951325581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626705cd880 msgr2=0x5626705f9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:06.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.598+0000 7f22fbf92b80 1 --2- 172.21.15.50:0/2951325581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626705cd880 0x5626705f9000 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f22dc009990 tx=0x7f22dc009ca0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.598+0000 7f22fbf92b80 1 -- 172.21.15.50:0/2951325581 shutdown_connections 2024-06-06T03:31:06.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.598+0000 7f22fbf92b80 1 --2- 172.21.15.50:0/2951325581 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56267065cb60 0x56267065efa0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.598+0000 7f22fbf92b80 1 --2- 172.21.15.50:0/2951325581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626705cd880 0x5626705f9000 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.598+0000 7f22fbf92b80 1 --2- 172.21.15.50:0/2951325581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626705c77a0 0x5626705d9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.598+0000 7f22fbf92b80 1 --2- 172.21.15.50:0/2951325581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626705ccf60 0x5626705d9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.598+0000 7f22d27fc700 0 client.25708 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:06.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.598+0000 7f22fbf92b80 1 -- 172.21.15.50:0/2951325581 >> 172.21.15.50:0/2951325581 conn(0x5626704f4080 msgr2=0x5626705d20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:06.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.598+0000 7f22fbf92b80 1 -- 172.21.15.50:0/2951325581 shutdown_connections 2024-06-06T03:31:06.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.599+0000 7f22fbf92b80 1 -- 172.21.15.50:0/2951325581 wait complete. 2024-06-06T03:31:06.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.599+0000 7f22fbf92b80 20 client.25708 trim_cache size 0 max 16384 2024-06-06T03:31:06.598 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:31:06.599 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2024-06-06T03:31:06.599 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-06-06T03:31:06.599 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:31:06.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.600+0000 7f22f170f700 1 -- 172.21.15.50:0/1929637888 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f22d80a2e20 msgr2=0x7f22d80a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:06.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.600+0000 7f22f170f700 1 --2- 172.21.15.50:0/1929637888 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f22d80a2e20 0x7f22d80a52e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f22dc009750 tx=0x7f22dc0058e0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.600+0000 7f22f170f700 1 -- 172.21.15.50:0/1929637888 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22ec104ed0 msgr2=0x7f22ec06cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:06.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.600+0000 7f22f170f700 1 --2- 172.21.15.50:0/1929637888 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22ec104ed0 0x7f22ec06cd60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f22d400ef10 tx=0x7f22d400c3a0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.600+0000 7f22f170f700 1 -- 172.21.15.50:0/1929637888 shutdown_connections 2024-06-06T03:31:06.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.600+0000 7f22f170f700 1 --2- 172.21.15.50:0/1929637888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22ec1073c0 0x7f22ec06d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.600+0000 7f22f170f700 1 --2- 172.21.15.50:0/1929637888 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f22d80a2e20 0x7f22d80a52e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.600+0000 7f22f170f700 1 --2- 172.21.15.50:0/1929637888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22ec06a6e0 0x7f22ec073cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.600+0000 7f22f170f700 1 --2- 172.21.15.50:0/1929637888 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22ec104ed0 0x7f22ec06cd60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:06.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.600+0000 7f22f170f700 1 -- 172.21.15.50:0/1929637888 >> 172.21.15.50:0/1929637888 conn(0x7f22ec078340 msgr2=0x7f22ec103eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:06.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.601+0000 7f22f170f700 1 -- 172.21.15.50:0/1929637888 shutdown_connections 2024-06-06T03:31:06.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:06.601+0000 7f22f170f700 1 -- 172.21.15.50:0/1929637888 wait complete. 2024-06-06T03:31:06.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:06 smithi122 ceph-mon[35759]: pgmap v565: 129 pgs: 129 active+clean; 10 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 53 MiB/s wr, 849 op/s 2024-06-06T03:31:07.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:06 smithi050 ceph-mon[32421]: pgmap v565: 129 pgs: 129 active+clean; 10 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 53 MiB/s wr, 849 op/s 2024-06-06T03:31:07.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:06 smithi079 ceph-mon[35478]: pgmap v565: 129 pgs: 129 active+clean; 10 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 53 MiB/s wr, 849 op/s 2024-06-06T03:31:08.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:08 smithi122 ceph-mon[35759]: pgmap v566: 129 pgs: 129 active+clean; 10 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 43 MiB/s wr, 698 op/s 2024-06-06T03:31:09.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:08 smithi050 ceph-mon[32421]: pgmap v566: 129 pgs: 129 active+clean; 10 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 43 MiB/s wr, 698 op/s 2024-06-06T03:31:09.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:08 smithi079 ceph-mon[35478]: pgmap v566: 129 pgs: 129 active+clean; 10 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 43 MiB/s wr, 698 op/s 2024-06-06T03:31:09.723 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-06T03:31:09.723 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T03:31:10.894 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:31:10.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:10 smithi122 ceph-mon[35759]: pgmap v567: 129 pgs: 129 active+clean; 10 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 51 MiB/s wr, 818 op/s 2024-06-06T03:31:11.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:10 smithi050 ceph-mon[32421]: pgmap v567: 129 pgs: 129 active+clean; 10 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 51 MiB/s wr, 818 op/s 2024-06-06T03:31:11.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:10 smithi079 ceph-mon[35478]: pgmap v567: 129 pgs: 129 active+clean; 10 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 51 MiB/s wr, 818 op/s 2024-06-06T03:31:12.922 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:12 smithi050 ceph-mon[32421]: pgmap v568: 129 pgs: 129 active+clean; 10 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 41 MiB/s wr, 660 op/s 2024-06-06T03:31:12.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:12 smithi122 ceph-mon[35759]: pgmap v568: 129 pgs: 129 active+clean; 10 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 41 MiB/s wr, 660 op/s 2024-06-06T03:31:13.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:12 smithi079 ceph-mon[35478]: pgmap v568: 129 pgs: 129 active+clean; 10 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 41 MiB/s wr, 660 op/s 2024-06-06T03:31:13.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.121+0000 7f9cc8e89700 1 -- 172.21.15.50:0/3560066514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cc4109db0 msgr2=0x7f9cc41150a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:13.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.121+0000 7f9cc8e89700 1 --2- 172.21.15.50:0/3560066514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cc4109db0 0x7f9cc41150a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8009990 tx=0x7f9cb8009ca0 comp rx=0 tx=0).stop 2024-06-06T03:31:13.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.121+0000 7f9cc8e89700 1 -- 172.21.15.50:0/3560066514 shutdown_connections 2024-06-06T03:31:13.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.121+0000 7f9cc8e89700 1 --2- 172.21.15.50:0/3560066514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cc41155e0 0x7f9cc41179d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:13.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.121+0000 7f9cc8e89700 1 --2- 172.21.15.50:0/3560066514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cc4109490 0x7f9cc4109870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:13.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.121+0000 7f9cc8e89700 1 --2- 172.21.15.50:0/3560066514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cc4109db0 0x7f9cc41150a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:13.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.121+0000 7f9cc8e89700 1 -- 172.21.15.50:0/3560066514 >> 172.21.15.50:0/3560066514 conn(0x7f9cc406d600 msgr2=0x7f9cc406da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:13.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.121+0000 7f9cc8e89700 1 -- 172.21.15.50:0/3560066514 shutdown_connections 2024-06-06T03:31:13.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.121+0000 7f9cc8e89700 1 -- 172.21.15.50:0/3560066514 wait complete. 2024-06-06T03:31:13.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.122+0000 7f9cc8e89700 1 Processor -- start 2024-06-06T03:31:13.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.123+0000 7f9cc8e89700 1 -- start start 2024-06-06T03:31:13.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.123+0000 7f9cc8e89700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cc4109490 0x7f9cc41a1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:13.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.123+0000 7f9cc8e89700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cc4109db0 0x7f9cc41a1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:13.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.123+0000 7f9cc8e89700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cc41155e0 0x7f9cc41a5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:13.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.123+0000 7f9cc8e89700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc411af50 con 0x7f9cc4109490 2024-06-06T03:31:13.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.123+0000 7f9cc8e89700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc411add0 con 0x7f9cc4109db0 2024-06-06T03:31:13.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.123+0000 7f9cc8e89700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc411b0d0 con 0x7f9cc41155e0 2024-06-06T03:31:13.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.123+0000 7f9cc2d9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cc41155e0 0x7f9cc41a5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:13.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.123+0000 7f9cc2d9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cc41155e0 0x7f9cc41a5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:60352/0 (socket says 172.21.15.50:60352) 2024-06-06T03:31:13.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.124+0000 7f9cc2d9d700 1 -- 172.21.15.50:0/1732830439 learned_addr learned my addr 172.21.15.50:0/1732830439 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:13.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.124+0000 7f9cc259c700 1 --2- 172.21.15.50:0/1732830439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cc4109490 0x7f9cc41a1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:13.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.126+0000 7f9cc259c700 1 -- 172.21.15.50:0/1732830439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cc41155e0 msgr2=0x7f9cc41a5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:13.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.126+0000 7f9cc259c700 1 --2- 172.21.15.50:0/1732830439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cc41155e0 0x7f9cc41a5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:13.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.126+0000 7f9cc259c700 1 -- 172.21.15.50:0/1732830439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cc4109db0 msgr2=0x7f9cc41a1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:13.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.126+0000 7f9cc259c700 1 --2- 172.21.15.50:0/1732830439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cc4109db0 0x7f9cc41a1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:13.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.126+0000 7f9cc259c700 1 -- 172.21.15.50:0/1732830439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc41a63e0 con 0x7f9cc4109490 2024-06-06T03:31:13.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.127+0000 7f9cc259c700 1 --2- 172.21.15.50:0/1732830439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cc4109490 0x7f9cc41a1420 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4009ad0 tx=0x7f9cb4009de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:13.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.127+0000 7f9cb37fe700 1 -- 172.21.15.50:0/1732830439 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb401f070 con 0x7f9cc4109490 2024-06-06T03:31:13.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.127+0000 7f9cc8e89700 1 -- 172.21.15.50:0/1732830439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cc41a6670 con 0x7f9cc4109490 2024-06-06T03:31:13.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.127+0000 7f9cc8e89700 1 -- 172.21.15.50:0/1732830439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cc410ae30 con 0x7f9cc4109490 2024-06-06T03:31:13.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.129+0000 7f9cb37fe700 1 -- 172.21.15.50:0/1732830439 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9cb4007ba0 con 0x7f9cc4109490 2024-06-06T03:31:13.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.129+0000 7f9cb37fe700 1 -- 172.21.15.50:0/1732830439 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb401ac40 con 0x7f9cc4109490 2024-06-06T03:31:13.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.133+0000 7f9cb37fe700 1 -- 172.21.15.50:0/1732830439 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9cb4022070 con 0x7f9cc4109490 2024-06-06T03:31:13.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.134+0000 7f9cb37fe700 1 --2- 172.21.15.50:0/1732830439 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9cac0a2e20 0x7f9cac0a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:13.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.134+0000 7f9cc8e89700 1 -- 172.21.15.50:0/1732830439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ca4005330 con 0x7f9cc4109490 2024-06-06T03:31:13.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.134+0000 7f9cb37fe700 1 -- 172.21.15.50:0/1732830439 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f9cb40cebc0 con 0x7f9cc4109490 2024-06-06T03:31:13.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.135+0000 7f9cc1d9b700 1 --2- 172.21.15.50:0/1732830439 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9cac0a2e20 0x7f9cac0a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:13.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.141+0000 7f9cc1d9b700 1 --2- 172.21.15.50:0/1732830439 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9cac0a2e20 0x7f9cac0a52e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9cb80098e0 tx=0x7f9cb800b610 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:13.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.150+0000 7f9cb37fe700 1 -- 172.21.15.50:0/1732830439 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9cb409b740 con 0x7f9cc4109490 2024-06-06T03:31:13.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.668+0000 7f9cc8e89700 1 -- 172.21.15.50:0/1732830439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ca4005620 con 0x7f9cc4109490 2024-06-06T03:31:13.673 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:31:13.673 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1667847852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1667847852},{"type":"v1","addr":"172.21.15.50:6835","nonce":1667847852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/239971838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":239971838},{"type":"v1","addr":"172.21.15.50:6837","nonce":239971838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/2188134216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2188134216},{"type":"v1","addr":"172.21.15.50:6839","nonce":2188134216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/632572420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":632572420},{"type":"v1","addr":"172.21.15.50:6841","nonce":632572420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/864537078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":864537078},{"type":"v1","addr":"172.21.15.79:6833","nonce":864537078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/279268898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":279268898},{"type":"v1","addr":"172.21.15.79:6835","nonce":279268898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T03:22:36.202061+0000","modified":"2024-06-06T03:30:26.979252+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24490,"mds_1":24472,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/57533154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":57533154},{"type":"v1","addr":"172.21.15.122:6833","nonce":57533154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/3286722213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3286722213},{"type":"v1","addr":"172.21.15.79:6837","nonce":3286722213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/768067336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":768067336},{"type":"v1","addr":"172.21.15.79:6839","nonce":768067336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.122:6835/2987597320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2987597320},{"type":"v1","addr":"172.21.15.122:6835","nonce":2987597320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":23,"addr":"172.21.15.122:6837/1604366318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1604366318},{"type":"v1","addr":"172.21.15.122:6837","nonce":1604366318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6839/4129732900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":4129732900},{"type":"v1","addr":"172.21.15.122:6839","nonce":4129732900}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24472,24490,24466]},"id":1}]} 2024-06-06T03:31:13.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.671+0000 7f9cb37fe700 1 -- 172.21.15.50:0/1732830439 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11856 (secure 0 0 0) 0x7f9cb409b040 con 0x7f9cc4109490 2024-06-06T03:31:13.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.677+0000 7f9cc8e89700 1 -- 172.21.15.50:0/1732830439 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9cac0a2e20 msgr2=0x7f9cac0a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:13.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.677+0000 7f9cc8e89700 1 --2- 172.21.15.50:0/1732830439 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9cac0a2e20 0x7f9cac0a52e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9cb80098e0 tx=0x7f9cb800b610 comp rx=0 tx=0).stop 2024-06-06T03:31:13.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.677+0000 7f9cc8e89700 1 -- 172.21.15.50:0/1732830439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cc4109490 msgr2=0x7f9cc41a1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:13.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.677+0000 7f9cc8e89700 1 --2- 172.21.15.50:0/1732830439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cc4109490 0x7f9cc41a1420 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4009ad0 tx=0x7f9cb4009de0 comp rx=0 tx=0).stop 2024-06-06T03:31:13.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.678+0000 7f9cc8e89700 1 -- 172.21.15.50:0/1732830439 shutdown_connections 2024-06-06T03:31:13.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.678+0000 7f9cc8e89700 1 --2- 172.21.15.50:0/1732830439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cc41155e0 0x7f9cc41a5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:13.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.678+0000 7f9cc8e89700 1 --2- 172.21.15.50:0/1732830439 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9cac0a2e20 0x7f9cac0a52e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:13.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.678+0000 7f9cc8e89700 1 --2- 172.21.15.50:0/1732830439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cc4109490 0x7f9cc41a1420 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:13.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.678+0000 7f9cc8e89700 1 --2- 172.21.15.50:0/1732830439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cc4109db0 0x7f9cc41a1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:13.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.679+0000 7f9cc8e89700 1 -- 172.21.15.50:0/1732830439 >> 172.21.15.50:0/1732830439 conn(0x7f9cc406d600 msgr2=0x7f9cc4071210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:13.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.682+0000 7f9cc8e89700 1 -- 172.21.15.50:0/1732830439 shutdown_connections 2024-06-06T03:31:13.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:13.682+0000 7f9cc8e89700 1 -- 172.21.15.50:0/1732830439 wait complete. 2024-06-06T03:31:13.686 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 32 2024-06-06T03:31:14.483 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-06-06T03:31:14.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:14 smithi050 ceph-mon[32421]: pgmap v569: 129 pgs: 129 active+clean; 10 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 42 MiB/s wr, 678 op/s 2024-06-06T03:31:14.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:14 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/1732830439' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:31:14.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:14 smithi122 ceph-mon[35759]: pgmap v569: 129 pgs: 129 active+clean; 10 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 42 MiB/s wr, 678 op/s 2024-06-06T03:31:14.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:14 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/1732830439' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:31:15.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:14 smithi079 ceph-mon[35478]: pgmap v569: 129 pgs: 129 active+clean; 10 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 42 MiB/s wr, 678 op/s 2024-06-06T03:31:15.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:14 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/1732830439' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:31:15.169 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.168+0000 7f7f170b4640 1 -- 172.21.15.50:0/1735342076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f10076360 msgr2=0x7f7f10076780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:15.169 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.168+0000 7f7f170b4640 1 --2- 172.21.15.50:0/1735342076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f10076360 0x7f7f10076780 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7f00009900 tx=0x7f7f0002a3f0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.169 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.169+0000 7f7f170b4640 1 -- 172.21.15.50:0/1735342076 shutdown_connections 2024-06-06T03:31:15.169 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.169+0000 7f7f170b4640 1 --2- 172.21.15.50:0/1735342076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f10077f40 0x7f7f100787e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.169 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.169+0000 7f7f170b4640 1 --2- 172.21.15.50:0/1735342076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f100775a0 0x7f7f10077a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.170 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.169+0000 7f7f170b4640 1 --2- 172.21.15.50:0/1735342076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f10076360 0x7f7f10076780 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.170 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.169+0000 7f7f170b4640 1 -- 172.21.15.50:0/1735342076 >> 172.21.15.50:0/1735342076 conn(0x7f7f100fefd0 msgr2=0x7f7f10101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:15.170 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.169+0000 7f7f170b4640 1 -- 172.21.15.50:0/1735342076 shutdown_connections 2024-06-06T03:31:15.170 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.169+0000 7f7f170b4640 1 -- 172.21.15.50:0/1735342076 wait complete. 2024-06-06T03:31:15.172 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.170+0000 7f7f170b4640 1 Processor -- start 2024-06-06T03:31:15.172 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.170+0000 7f7f170b4640 1 -- start start 2024-06-06T03:31:15.172 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.171+0000 7f7f170b4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f100775a0 0x7f7f1019e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:15.172 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.171+0000 7f7f170b4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f10077f40 0x7f7f1019e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:15.172 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.171+0000 7f7f170b4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f101a3770 0x7f7f101a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.171+0000 7f7f170b4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7f101139e0 con 0x7f7f100775a0 2024-06-06T03:31:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.171+0000 7f7f170b4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7f10113860 con 0x7f7f10077f40 2024-06-06T03:31:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.171+0000 7f7f170b4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7f10113b60 con 0x7f7f101a3770 2024-06-06T03:31:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.171+0000 7f7f168b3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f101a3770 0x7f7f101a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.172+0000 7f7f168b3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f101a3770 0x7f7f101a5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:60366/0 (socket says 172.21.15.50:60366) 2024-06-06T03:31:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.172+0000 7f7f168b3640 1 -- 172.21.15.50:0/2406251151 learned_addr learned my addr 172.21.15.50:0/2406251151 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.172+0000 7f7f168b3640 1 -- 172.21.15.50:0/2406251151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f10077f40 msgr2=0x7f7f1019e710 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-06T03:31:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.172+0000 7f7f168b3640 1 --2- 172.21.15.50:0/2406251151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f10077f40 0x7f7f1019e710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.172+0000 7f7f168b3640 1 -- 172.21.15.50:0/2406251151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f100775a0 msgr2=0x7f7f1019e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.172+0000 7f7f168b3640 1 --2- 172.21.15.50:0/2406251151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f100775a0 0x7f7f1019e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.172+0000 7f7f168b3640 1 -- 172.21.15.50:0/2406251151 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f101a61d0 con 0x7f7f101a3770 2024-06-06T03:31:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.173+0000 7f7f168b3640 1 --2- 172.21.15.50:0/2406251151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f101a3770 0x7f7f101a5b60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7f0800cce0 tx=0x7f7f0800a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.173+0000 7f7f077fe640 1 -- 172.21.15.50:0/2406251151 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0800f450 con 0x7f7f101a3770 2024-06-06T03:31:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.173+0000 7f7f077fe640 1 -- 172.21.15.50:0/2406251151 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7f0800faa0 con 0x7f7f101a3770 2024-06-06T03:31:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.173+0000 7f7f077fe640 1 -- 172.21.15.50:0/2406251151 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f08018bb0 con 0x7f7f101a3770 2024-06-06T03:31:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.175+0000 7f7f170b4640 1 -- 172.21.15.50:0/2406251151 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f101a64c0 con 0x7f7f101a3770 2024-06-06T03:31:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.176+0000 7f7f170b4640 1 -- 172.21.15.50:0/2406251151 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f101a6990 con 0x7f7f101a3770 2024-06-06T03:31:15.183 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.181+0000 7f7f077fe640 1 -- 172.21.15.50:0/2406251151 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7f0800fc50 con 0x7f7f101a3770 2024-06-06T03:31:15.183 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.182+0000 7f7f077fe640 1 --2- 172.21.15.50:0/2406251151 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7efc0a2d90 0x7f7efc0a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:15.183 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.182+0000 7f7f077fe640 1 -- 172.21.15.50:0/2406251151 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f7f080cfca0 con 0x7f7f101a3770 2024-06-06T03:31:15.186 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.184+0000 7f7f160b2640 1 --2- 172.21.15.50:0/2406251151 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7efc0a2d90 0x7f7efc0a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:15.186 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.186+0000 7f7f160b2640 1 --2- 172.21.15.50:0/2406251151 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7efc0a2d90 0x7f7efc0a5250 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7f00005730 tx=0x7f7f000314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:15.198 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.198+0000 7f7f1b01b740 1 Processor -- start 2024-06-06T03:31:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.199+0000 7f7f1b01b740 1 -- start start 2024-06-06T03:31:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.199+0000 7f7f1b01b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ded5c0200 0x557ded5c0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.199+0000 7f7f1b01b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ded5c0bf0 0x557ded5c56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.199+0000 7f7f1b01b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ded5c5d60 0x557ded5c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.199+0000 7f7f1b01b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557ded5234f0 con 0x557ded5c0200 2024-06-06T03:31:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.199+0000 7f7f1b01b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557ded4c1870 con 0x557ded5c5d60 2024-06-06T03:31:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.199+0000 7f7f1b01b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557ded51f4b0 con 0x557ded5c0bf0 2024-06-06T03:31:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.200+0000 7f7f168b3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ded5c5d60 0x557ded5c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.200+0000 7f7f168b3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ded5c5d60 0x557ded5c81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:60044/0 (socket says 172.21.15.50:60044) 2024-06-06T03:31:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.200+0000 7f7f168b3640 1 -- 172.21.15.50:0/2222454268 learned_addr learned my addr 172.21.15.50:0/2222454268 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.200+0000 7f7f160b2640 1 --2- 172.21.15.50:0/2222454268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ded5c0200 0x557ded5c0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.200+0000 7f7f168b3640 1 -- 172.21.15.50:0/2222454268 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ded5c0bf0 msgr2=0x557ded5c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.200+0000 7f7f168b3640 1 --2- 172.21.15.50:0/2222454268 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ded5c0bf0 0x557ded5c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.200+0000 7f7f168b3640 1 -- 172.21.15.50:0/2222454268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ded5c0200 msgr2=0x557ded5c0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.200+0000 7f7f168b3640 1 --2- 172.21.15.50:0/2222454268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ded5c0200 0x557ded5c0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.200+0000 7f7f168b3640 1 -- 172.21.15.50:0/2222454268 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ded4dd9b0 con 0x557ded5c5d60 2024-06-06T03:31:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.201+0000 7f7f168b3640 1 --2- 172.21.15.50:0/2222454268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ded5c5d60 0x557ded5c81f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7f0809c130 tx=0x7f7f0809bc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9df0d441e43d8ea1 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.201+0000 7f7f04bfe640 1 -- 172.21.15.50:0/2222454268 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f080b4070 con 0x557ded5c5d60 2024-06-06T03:31:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.202+0000 7f7f04bfe640 1 -- 172.21.15.50:0/2222454268 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7f080a4e10 con 0x557ded5c5d60 2024-06-06T03:31:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.203+0000 7f7f1b01b740 1 -- 172.21.15.50:0/2222454268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ded5c5d60 msgr2=0x557ded5c81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.203+0000 7f7f1b01b740 1 --2- 172.21.15.50:0/2222454268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ded5c5d60 0x557ded5c81f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7f0809c130 tx=0x7f7f0809bc10 comp rx=0 tx=0).stop 2024-06-06T03:31:15.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.207+0000 7f7f1b01b740 1 -- 172.21.15.50:0/2222454268 shutdown_connections 2024-06-06T03:31:15.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.207+0000 7f7f1b01b740 1 --2- 172.21.15.50:0/2222454268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ded5c5d60 0x557ded5c81f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.207+0000 7f7f1b01b740 1 --2- 172.21.15.50:0/2222454268 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ded5c0bf0 0x557ded5c56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.207+0000 7f7f1b01b740 1 --2- 172.21.15.50:0/2222454268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ded5c0200 0x557ded5c0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.207+0000 7f7f1b01b740 1 -- 172.21.15.50:0/2222454268 >> 172.21.15.50:0/2222454268 conn(0x557ded5bb870 msgr2=0x557ded5bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.211+0000 7f7f1b01b740 1 -- 172.21.15.50:0/2222454268 shutdown_connections 2024-06-06T03:31:15.211 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.211+0000 7f7f1b01b740 1 -- 172.21.15.50:0/2222454268 wait complete. 2024-06-06T03:31:15.211 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.211+0000 7f7f1b01b740 1 -- start start 2024-06-06T03:31:15.211 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.212+0000 7f7f1b01b740 1 Processor -- start 2024-06-06T03:31:15.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.212+0000 7f7f1b01b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ded5c0200 0x557ded5db4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:15.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.212+0000 7f7f1b01b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ded5c0bf0 0x557ded5db9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:15.213 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.213+0000 7f7f160b2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ded5c0200 0x557ded5db4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:15.213 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.213+0000 7f7f160b2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ded5c0200 0x557ded5db4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:60386/0 (socket says 172.21.15.50:60386) 2024-06-06T03:31:15.213 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.213+0000 7f7f160b2640 1 -- 172.21.15.50:0/1556187096 learned_addr learned my addr 172.21.15.50:0/1556187096 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:15.213 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.213+0000 7f7f1b01b740 1 --2- 172.21.15.50:0/1556187096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ded5c5d60 0x557ded5e2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:15.213 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.213+0000 7f7f1b01b740 1 -- 172.21.15.50:0/1556187096 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557ded5d9d60 con 0x557ded5c0bf0 2024-06-06T03:31:15.213 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.213+0000 7f7f1b01b740 1 -- 172.21.15.50:0/1556187096 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557ded4acae0 con 0x557ded5c5d60 2024-06-06T03:31:15.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.213+0000 7f7f168b3640 1 --2- 172.21.15.50:0/1556187096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ded5c5d60 0x557ded5e2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:15.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.213+0000 7f7f1b01b740 1 -- 172.21.15.50:0/1556187096 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557ded5d9ee0 con 0x557ded5c0200 2024-06-06T03:31:15.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.214+0000 7f7f1b01b740 10 client.0 _ll_register_callbacks cb 0x557ded4e59b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:31:15.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.214+0000 7f7f160b2640 1 -- 172.21.15.50:0/1556187096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ded5c5d60 msgr2=0x557ded5e2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:15.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.214+0000 7f7f160b2640 1 --2- 172.21.15.50:0/1556187096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ded5c5d60 0x557ded5e2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.214+0000 7f7f160b2640 1 -- 172.21.15.50:0/1556187096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ded5c0bf0 msgr2=0x557ded5db9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:15.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.214+0000 7f7f160b2640 1 --2- 172.21.15.50:0/1556187096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ded5c0bf0 0x557ded5db9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.214+0000 7f7f160b2640 1 -- 172.21.15.50:0/1556187096 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ded237210 con 0x557ded5c0200 2024-06-06T03:31:15.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.214+0000 7f7f160b2640 1 --2- 172.21.15.50:0/1556187096 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ded5c0200 0x557ded5db4b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7f0002a9e0 tx=0x7f7f00009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4d91ee4819535f5 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:15.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.214+0000 7f7ef9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:31:15.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.215+0000 7f7f1b01b740 1 -- 172.21.15.50:0/1556187096 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f080a4e10 con 0x557ded5c0200 2024-06-06T03:31:15.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.218+0000 7f7ef9ffb640 1 -- 172.21.15.50:0/1556187096 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0004c070 con 0x557ded5c0200 2024-06-06T03:31:15.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.218+0000 7f7ef9ffb640 1 -- 172.21.15.50:0/1556187096 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f7f00003a00 con 0x557ded5c0200 2024-06-06T03:31:15.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.218+0000 7f7ef9ffb640 1 -- 172.21.15.50:0/1556187096 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7f00056050 con 0x557ded5c0200 2024-06-06T03:31:15.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.218+0000 7f7f1b01b740 10 client.25720 fetch_fsmap learned FSMap version 32 2024-06-06T03:31:15.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.218+0000 7f7f1b01b740 1 -- 172.21.15.50:0/1556187096 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({fsmap=32}) -- 0x557ded303620 con 0x557ded5c0200 2024-06-06T03:31:15.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.221+0000 7f7ef9ffb640 1 -- 172.21.15.50:0/1556187096 <== mon.1 v2:172.21.15.122:3300/0 4 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f7f00059020 con 0x557ded5c0200 2024-06-06T03:31:15.222 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.221+0000 7f7f1b01b740 10 client.25720 fetch_fsmap finished waiting for FSMap version 32 2024-06-06T03:31:15.222 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.221+0000 7f7f1b01b740 10 client.25720 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:31:15.222 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.221+0000 7f7f1b01b740 20 client.25720 populate_metadata read hostname 'smithi050' 2024-06-06T03:31:15.222 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.222+0000 7f7f1b01b740 1 --2- 172.21.15.50:0/1556187096 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x557ded5e7110 0x557ded5e95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:15.222 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.222+0000 7f7f1b01b740 4 client.25720 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:31:15.222 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.222+0000 7f7f1b01b740 1 -- 172.21.15.50:0/1556187096 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7f080a4e10 con 0x557ded5e7110 2024-06-06T03:31:15.222 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.222+0000 7f7f158b1640 1 --2- 172.21.15.50:0/1556187096 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x557ded5e7110 0x557ded5e95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:15.223 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.223+0000 7f7f158b1640 1 --2- 172.21.15.50:0/1556187096 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x557ded5e7110 0x557ded5e95a0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6de02196f3fbb399 server_cookie=6146279d048e7668 in_seq=0 out_seq=0 2024-06-06T03:31:15.223 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.223+0000 7f7ef9ffb640 10 client.25720 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:15.224 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.224+0000 7f7ef9ffb640 1 -- 172.21.15.50:0/1556187096 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x7f7f080a4e10 con 0x557ded5e7110 2024-06-06T03:31:15.224 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.224+0000 7f7ef9ffb640 10 client.25720 handle_command_reply: tid=0 2024-06-06T03:31:15.224 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.224+0000 7f7f1b01b740 1 client.25720 shutdown 2024-06-06T03:31:15.228 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.228+0000 7f7f1b01b740 1 -- 172.21.15.50:0/1556187096 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ded5c0200 msgr2=0x557ded5db4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:15.228 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.228+0000 7f7f1b01b740 1 --2- 172.21.15.50:0/1556187096 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ded5c0200 0x557ded5db4b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7f0002a9e0 tx=0x7f7f00009260 comp rx=0 tx=0).stop 2024-06-06T03:31:15.229 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.229+0000 7f7f1b01b740 1 -- 172.21.15.50:0/1556187096 shutdown_connections 2024-06-06T03:31:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.229+0000 7f7f1b01b740 1 --2- 172.21.15.50:0/1556187096 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x557ded5e7110 0x557ded5e95a0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.229+0000 7f7f1b01b740 1 --2- 172.21.15.50:0/1556187096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ded5c0bf0 0x557ded5db9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.229+0000 7f7f1b01b740 1 --2- 172.21.15.50:0/1556187096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ded5c5d60 0x557ded5e2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.229+0000 7f7f1b01b740 1 --2- 172.21.15.50:0/1556187096 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ded5c0200 0x557ded5db4b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.229+0000 7f7f1b01b740 1 -- 172.21.15.50:0/1556187096 >> 172.21.15.50:0/1556187096 conn(0x557ded5bb870 msgr2=0x557ded5ba9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.229+0000 7f7ef9ffb640 0 client.25720 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.229+0000 7f7f1b01b740 1 -- 172.21.15.50:0/1556187096 shutdown_connections 2024-06-06T03:31:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.230+0000 7f7f1b01b740 1 -- 172.21.15.50:0/1556187096 wait complete. 2024-06-06T03:31:15.231 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.230+0000 7f7f1b01b740 20 client.25720 trim_cache size 0 max 16384 2024-06-06T03:31:15.253 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:31:15.273 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.274+0000 7f7f1b01b740 1 Processor -- start 2024-06-06T03:31:15.274 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.274+0000 7f7f1b01b740 1 -- start start 2024-06-06T03:31:15.275 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.274+0000 7f7f1b01b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ded5c0200 0x557ded5be780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:15.275 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.274+0000 7f7f1b01b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ded5c0bf0 0x557ded5e29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:15.275 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.274+0000 7f7f1b01b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ded5c5d60 0x557ded5becc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:15.275 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.274+0000 7f7f160b2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ded5c0200 0x557ded5be780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:15.275 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.274+0000 7f7f160b2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ded5c0200 0x557ded5be780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:60392/0 (socket says 172.21.15.50:60392) 2024-06-06T03:31:15.276 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.275+0000 7f7f158b1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ded5c0bf0 0x557ded5e29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:15.276 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.275+0000 7f7f158b1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ded5c0bf0 0x557ded5e29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:60064/0 (socket says 172.21.15.50:60064) 2024-06-06T03:31:15.276 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.275+0000 7f7f160b2640 1 -- 172.21.15.50:0/1577870636 learned_addr learned my addr 172.21.15.50:0/1577870636 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:15.276 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.275+0000 7f7f1b01b740 1 -- 172.21.15.50:0/1577870636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7f101aaf60 con 0x557ded5c5d60 2024-06-06T03:31:15.276 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.275+0000 7f7f1b01b740 1 -- 172.21.15.50:0/1577870636 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7f101a8830 con 0x557ded5c0bf0 2024-06-06T03:31:15.276 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.275+0000 7f7f1b01b740 1 -- 172.21.15.50:0/1577870636 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7f1010b6c0 con 0x557ded5c0200 2024-06-06T03:31:15.276 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.275+0000 7f7f168b3640 1 --2- 172.21.15.50:0/1577870636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ded5c5d60 0x557ded5becc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:15.278 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.278+0000 7f7f158b1640 1 -- 172.21.15.50:0/1577870636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ded5c0200 msgr2=0x557ded5be780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:15.278 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.278+0000 7f7f158b1640 1 --2- 172.21.15.50:0/1577870636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ded5c0200 0x557ded5be780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.278 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.278+0000 7f7f158b1640 1 -- 172.21.15.50:0/1577870636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ded5c5d60 msgr2=0x557ded5becc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:15.278 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.278+0000 7f7f158b1640 1 --2- 172.21.15.50:0/1577870636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ded5c5d60 0x557ded5becc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.278 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.278+0000 7f7f158b1640 1 -- 172.21.15.50:0/1577870636 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ded5bb6a0 con 0x557ded5c0bf0 2024-06-06T03:31:15.280 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.279+0000 7f7f158b1640 1 --2- 172.21.15.50:0/1577870636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ded5c0bf0 0x557ded5e29f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x557ded5dc990 tx=0x7f7f0c005bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f766dee127de8e7 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.281+0000 7f7efbfff640 1 -- 172.21.15.50:0/1577870636 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c011ba0 con 0x557ded5c0bf0 2024-06-06T03:31:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.282+0000 7f7efbfff640 1 -- 172.21.15.50:0/1577870636 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7f0c01b030 con 0x557ded5c0bf0 2024-06-06T03:31:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.282+0000 7f7efbfff640 1 -- 172.21.15.50:0/1577870636 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c004d00 con 0x557ded5c0bf0 2024-06-06T03:31:15.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.284+0000 7f7f1b01b740 1 -- 172.21.15.50:0/1577870636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ded5c0bf0 msgr2=0x557ded5e29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:15.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.284+0000 7f7f1b01b740 1 --2- 172.21.15.50:0/1577870636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ded5c0bf0 0x557ded5e29f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x557ded5dc990 tx=0x7f7f0c005bc0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.290+0000 7f7f1b01b740 1 -- 172.21.15.50:0/1577870636 shutdown_connections 2024-06-06T03:31:15.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.290+0000 7f7f1b01b740 1 --2- 172.21.15.50:0/1577870636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ded5c5d60 0x557ded5becc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.290+0000 7f7f1b01b740 1 --2- 172.21.15.50:0/1577870636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ded5c0bf0 0x557ded5e29f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.290+0000 7f7f1b01b740 1 --2- 172.21.15.50:0/1577870636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ded5c0200 0x557ded5be780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.290+0000 7f7f1b01b740 1 -- 172.21.15.50:0/1577870636 >> 172.21.15.50:0/1577870636 conn(0x557ded5bb870 msgr2=0x557ded5e8f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.297+0000 7f7f1b01b740 1 -- 172.21.15.50:0/1577870636 shutdown_connections 2024-06-06T03:31:15.300 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.301+0000 7f7f1b01b740 1 -- 172.21.15.50:0/1577870636 wait complete. 2024-06-06T03:31:15.302 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.303+0000 7f7f1b01b740 1 -- start start 2024-06-06T03:31:15.303 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.303+0000 7f7f1b01b740 1 Processor -- start 2024-06-06T03:31:15.307 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.305+0000 7f7f1b01b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ded5c0200 0x557ded5dfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:15.307 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.306+0000 7f7f1b01b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ded5c0bf0 0x557ded5e0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:15.307 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.306+0000 7f7f1b01b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ded5c5d60 0x557ded5e1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:15.307 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.307+0000 7f7f1b01b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7f101a6cf0 con 0x557ded5c0200 2024-06-06T03:31:15.307 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.307+0000 7f7f1b01b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7f101a8160 con 0x557ded5c5d60 2024-06-06T03:31:15.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.307+0000 7f7f1b01b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7f101a73c0 con 0x557ded5c0bf0 2024-06-06T03:31:15.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.307+0000 7f7f168b3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ded5c5d60 0x557ded5e1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:15.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.308+0000 7f7f168b3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ded5c5d60 0x557ded5e1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:60076/0 (socket says 172.21.15.50:60076) 2024-06-06T03:31:15.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.308+0000 7f7f168b3640 1 -- 172.21.15.50:0/2212007002 learned_addr learned my addr 172.21.15.50:0/2212007002 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:15.312 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.310+0000 7f7f1b01b740 10 client.0 _ll_register_callbacks cb 0x7f7f00009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:31:15.312 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.311+0000 7f7f160b2640 1 --2- 172.21.15.50:0/2212007002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ded5c0200 0x557ded5dfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.312+0000 7f7f168b3640 1 -- 172.21.15.50:0/2212007002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ded5c0bf0 msgr2=0x557ded5e0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.307+0000 7f7f158b1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ded5c0bf0 0x557ded5e0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.312+0000 7f7f168b3640 1 --2- 172.21.15.50:0/2212007002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ded5c0bf0 0x557ded5e0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.312+0000 7f7f168b3640 1 -- 172.21.15.50:0/2212007002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ded5c0200 msgr2=0x557ded5dfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.312+0000 7f7f168b3640 1 --2- 172.21.15.50:0/2212007002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ded5c0200 0x557ded5dfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.313+0000 7f7f168b3640 1 -- 172.21.15.50:0/2212007002 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ded5c18c0 con 0x557ded5c5d60 2024-06-06T03:31:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.313+0000 7f7f1b01b740 1 -- 172.21.15.50:0/2212007002 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f0c01b030 con 0x557ded5c5d60 2024-06-06T03:31:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.315+0000 7f7f168b3640 1 --2- 172.21.15.50:0/2212007002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ded5c5d60 0x557ded5e1030 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7f0809bea0 tx=0x7f7f0809c320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f42b0d189c3a8f5 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.315+0000 7f7ef9ffb640 10 client.25754 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:31:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.315+0000 7f7f160b2640 1 --2- 172.21.15.50:0/2212007002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ded5c0200 0x557ded5dfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:31:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.315+0000 7f7f158b1640 1 --2- 172.21.15.50:0/2212007002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ded5c0bf0 0x557ded5e0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:31:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.316+0000 7f7ef9ffb640 1 -- 172.21.15.50:0/2212007002 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f080ab050 con 0x557ded5c5d60 2024-06-06T03:31:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.316+0000 7f7ef9ffb640 1 -- 172.21.15.50:0/2212007002 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f7f0800f5f0 con 0x557ded5c5d60 2024-06-06T03:31:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.316+0000 7f7ef9ffb640 1 -- 172.21.15.50:0/2212007002 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7f080b4040 con 0x557ded5c5d60 2024-06-06T03:31:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.316+0000 7f7f1b01b740 10 client.25754 fetch_fsmap learned FSMap version 32 2024-06-06T03:31:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.316+0000 7f7f1b01b740 1 -- 172.21.15.50:0/2212007002 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=32}) -- 0x557ded5e2720 con 0x557ded5c5d60 2024-06-06T03:31:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.317+0000 7f7ef9ffb640 1 -- 172.21.15.50:0/2212007002 <== mon.2 v2:172.21.15.79:3300/0 4 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f7f08020070 con 0x557ded5c5d60 2024-06-06T03:31:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.317+0000 7f7f1b01b740 10 client.25754 fetch_fsmap finished waiting for FSMap version 32 2024-06-06T03:31:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.317+0000 7f7f1b01b740 10 client.25754 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:31:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.317+0000 7f7f1b01b740 20 client.25754 populate_metadata read hostname 'smithi050' 2024-06-06T03:31:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.317+0000 7f7f1b01b740 1 --2- 172.21.15.50:0/2212007002 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x557ded5e2b00 0x557ded653ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.317+0000 7f7f1b01b740 4 client.25754 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:31:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.317+0000 7f7f1b01b740 1 -- 172.21.15.50:0/2212007002 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557ded536f10 con 0x557ded5e2b00 2024-06-06T03:31:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.318+0000 7f7f160b2640 1 --2- 172.21.15.50:0/2212007002 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x557ded5e2b00 0x557ded653ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.318+0000 7f7f160b2640 1 --2- 172.21.15.50:0/2212007002 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x557ded5e2b00 0x557ded653ee0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c8606d1543b8bf8 server_cookie=839b738f1713e6e0 in_seq=0 out_seq=0 2024-06-06T03:31:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.320+0000 7f7ef9ffb640 10 client.25754 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:15.328 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.328+0000 7f7ef9ffb640 1 -- 172.21.15.50:0/2212007002 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x557ded536f10 con 0x557ded5e2b00 2024-06-06T03:31:15.328 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.328+0000 7f7ef9ffb640 10 client.25754 handle_command_reply: tid=0 2024-06-06T03:31:15.328 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.329+0000 7f7f1b01b740 1 client.25754 shutdown 2024-06-06T03:31:15.329 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.329+0000 7f7f1b01b740 1 -- 172.21.15.50:0/2212007002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ded5c5d60 msgr2=0x557ded5e1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:15.329 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.330+0000 7f7f1b01b740 1 --2- 172.21.15.50:0/2212007002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ded5c5d60 0x557ded5e1030 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7f0809bea0 tx=0x7f7f0809c320 comp rx=0 tx=0).stop 2024-06-06T03:31:15.330 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.330+0000 7f7f1b01b740 1 -- 172.21.15.50:0/2212007002 shutdown_connections 2024-06-06T03:31:15.331 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.330+0000 7f7f1b01b740 1 --2- 172.21.15.50:0/2212007002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ded5c5d60 0x557ded5e1030 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.331 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.330+0000 7f7f1b01b740 1 --2- 172.21.15.50:0/2212007002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ded5c0bf0 0x557ded5e0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.331 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.330+0000 7f7f1b01b740 1 --2- 172.21.15.50:0/2212007002 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x557ded5e2b00 0x557ded653ee0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.331 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.330+0000 7f7ef9ffb640 0 client.25754 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:15.331 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.330+0000 7f7f1b01b740 1 --2- 172.21.15.50:0/2212007002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ded5c0200 0x557ded5dfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.331 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.331+0000 7f7f1b01b740 1 -- 172.21.15.50:0/2212007002 >> 172.21.15.50:0/2212007002 conn(0x557ded5bb870 msgr2=0x557ded5be780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:15.332 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.331+0000 7f7f1b01b740 1 -- 172.21.15.50:0/2212007002 shutdown_connections 2024-06-06T03:31:15.332 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.331+0000 7f7f1b01b740 1 -- 172.21.15.50:0/2212007002 wait complete. 2024-06-06T03:31:15.332 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.332+0000 7f7f1b01b740 20 client.25754 trim_cache size 0 max 16384 2024-06-06T03:31:15.332 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:31:15.332 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:31:15.332 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:31:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.333+0000 7f7f170b4640 1 -- 172.21.15.50:0/2406251151 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7efc0a2d90 msgr2=0x7f7efc0a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.333+0000 7f7f170b4640 1 --2- 172.21.15.50:0/2406251151 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7efc0a2d90 0x7f7efc0a5250 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7f00005730 tx=0x7f7f000314a0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.333+0000 7f7f170b4640 1 -- 172.21.15.50:0/2406251151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f101a3770 msgr2=0x7f7f101a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.333+0000 7f7f170b4640 1 --2- 172.21.15.50:0/2406251151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f101a3770 0x7f7f101a5b60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7f0800cce0 tx=0x7f7f0800a620 comp rx=0 tx=0).stop 2024-06-06T03:31:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.333+0000 7f7f170b4640 1 -- 172.21.15.50:0/2406251151 shutdown_connections 2024-06-06T03:31:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.333+0000 7f7f170b4640 1 --2- 172.21.15.50:0/2406251151 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7efc0a2d90 0x7f7efc0a5250 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.333+0000 7f7f170b4640 1 --2- 172.21.15.50:0/2406251151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f101a3770 0x7f7f101a5b60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.334+0000 7f7f170b4640 1 --2- 172.21.15.50:0/2406251151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f10077f40 0x7f7f1019e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.334+0000 7f7f170b4640 1 --2- 172.21.15.50:0/2406251151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f100775a0 0x7f7f1019e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.334+0000 7f7f170b4640 1 -- 172.21.15.50:0/2406251151 >> 172.21.15.50:0/2406251151 conn(0x7f7f100fefd0 msgr2=0x7f7f10100760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:15.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.334+0000 7f7f170b4640 1 -- 172.21.15.50:0/2406251151 shutdown_connections 2024-06-06T03:31:15.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:15.334+0000 7f7f170b4640 1 -- 172.21.15.50:0/2406251151 wait complete. 2024-06-06T03:31:16.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:16 smithi122 ceph-mon[35759]: pgmap v570: 129 pgs: 129 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 50 MiB/s wr, 806 op/s 2024-06-06T03:31:16.975 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:16 smithi050 ceph-mon[32421]: pgmap v570: 129 pgs: 129 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 50 MiB/s wr, 806 op/s 2024-06-06T03:31:17.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:16 smithi079 ceph-mon[35478]: pgmap v570: 129 pgs: 129 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 50 MiB/s wr, 806 op/s 2024-06-06T03:31:18.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:18 smithi122 ceph-mon[35759]: pgmap v571: 129 pgs: 129 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 41 MiB/s wr, 665 op/s 2024-06-06T03:31:19.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:18 smithi050 ceph-mon[32421]: pgmap v571: 129 pgs: 129 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 41 MiB/s wr, 665 op/s 2024-06-06T03:31:19.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:18 smithi079 ceph-mon[35478]: pgmap v571: 129 pgs: 129 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 41 MiB/s wr, 665 op/s 2024-06-06T03:31:20.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:20 smithi122 ceph-mon[35759]: pgmap v572: 129 pgs: 129 active+clean; 10 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 50 MiB/s wr, 807 op/s 2024-06-06T03:31:21.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:20 smithi050 ceph-mon[32421]: pgmap v572: 129 pgs: 129 active+clean; 10 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 50 MiB/s wr, 807 op/s 2024-06-06T03:31:21.065 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:31:21.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.121+0000 7fa006ffd700 1 -- 172.21.15.50:0/1476849854 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc00bb30 con 0x7fa00806bc60 2024-06-06T03:31:21.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.122+0000 7fa00d73c700 1 -- 172.21.15.50:0/1476849854 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa00806bc60 msgr2=0x7fa00806c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:21.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.122+0000 7fa00d73c700 1 --2- 172.21.15.50:0/1476849854 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa00806bc60 0x7fa00806c040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc009990 tx=0x7f9ffc009ca0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.122+0000 7fa00d73c700 1 -- 172.21.15.50:0/1476849854 shutdown_connections 2024-06-06T03:31:21.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.122+0000 7fa00d73c700 1 --2- 172.21.15.50:0/1476849854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa00811bbd0 0x7fa00811dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.122+0000 7fa00d73c700 1 --2- 172.21.15.50:0/1476849854 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa00806bc60 0x7fa00806c040 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.122+0000 7fa00d73c700 1 --2- 172.21.15.50:0/1476849854 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa00806c580 0x7fa00811b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.122+0000 7fa00d73c700 1 -- 172.21.15.50:0/1476849854 >> 172.21.15.50:0/1476849854 conn(0x7fa00806f230 msgr2=0x7fa008071650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:21.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.122+0000 7fa00d73c700 1 -- 172.21.15.50:0/1476849854 shutdown_connections 2024-06-06T03:31:21.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.122+0000 7fa00d73c700 1 -- 172.21.15.50:0/1476849854 wait complete. 2024-06-06T03:31:21.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.123+0000 7fa00d73c700 1 Processor -- start 2024-06-06T03:31:21.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.123+0000 7fa00d73c700 1 -- start start 2024-06-06T03:31:21.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.123+0000 7fa00d73c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa00806bc60 0x7fa00811b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:21.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.123+0000 7fa00d73c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa00806c580 0x7fa00811b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:21.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.123+0000 7fa00d73c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa00811bbd0 0x7fa0081143d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:21.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.123+0000 7fa00d73c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa008121420 con 0x7fa00806c580 2024-06-06T03:31:21.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.123+0000 7fa00d73c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa0081212a0 con 0x7fa00806bc60 2024-06-06T03:31:21.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.123+0000 7fa00d73c700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa0081215a0 con 0x7fa00811bbd0 2024-06-06T03:31:21.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.124+0000 7fa00cf3b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa00811bbd0 0x7fa0081143d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:21.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.124+0000 7fa00cf3b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa00811bbd0 0x7fa0081143d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:60204/0 (socket says 172.21.15.50:60204) 2024-06-06T03:31:21.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.124+0000 7fa00cf3b700 1 -- 172.21.15.50:0/2693260474 learned_addr learned my addr 172.21.15.50:0/2693260474 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:21.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.124+0000 7fa00cf3b700 1 -- 172.21.15.50:0/2693260474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa00806bc60 msgr2=0x7fa00811b0f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-06T03:31:21.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.124+0000 7fa00cf3b700 1 --2- 172.21.15.50:0/2693260474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa00806bc60 0x7fa00811b0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.124+0000 7fa00cf3b700 1 -- 172.21.15.50:0/2693260474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa00806c580 msgr2=0x7fa00811b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:21.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.124+0000 7fa00cf3b700 1 --2- 172.21.15.50:0/2693260474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa00806c580 0x7fa00811b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.124+0000 7fa00cf3b700 1 -- 172.21.15.50:0/2693260474 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa008114cd0 con 0x7fa00811bbd0 2024-06-06T03:31:21.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.124+0000 7fa00cf3b700 1 --2- 172.21.15.50:0/2693260474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa00811bbd0 0x7fa0081143d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa000007d40 tx=0x7fa00000a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:21.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.125+0000 7fa0057fa700 1 -- 172.21.15.50:0/2693260474 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa000016020 con 0x7fa00811bbd0 2024-06-06T03:31:21.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.125+0000 7fa0057fa700 1 -- 172.21.15.50:0/2693260474 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa00000ad40 con 0x7fa00811bbd0 2024-06-06T03:31:21.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.125+0000 7fa0057fa700 1 -- 172.21.15.50:0/2693260474 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa000011620 con 0x7fa00811bbd0 2024-06-06T03:31:21.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.125+0000 7fa00d73c700 1 -- 172.21.15.50:0/2693260474 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa008114f60 con 0x7fa00811bbd0 2024-06-06T03:31:21.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.125+0000 7fa00d73c700 1 -- 172.21.15.50:0/2693260474 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa008118eb0 con 0x7fa00811bbd0 2024-06-06T03:31:21.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.130+0000 7fa019221b80 1 Processor -- start 2024-06-06T03:31:21.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.132+0000 7fa0057fa700 1 -- 172.21.15.50:0/2693260474 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa000019020 con 0x7fa00811bbd0 2024-06-06T03:31:21.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.133+0000 7fa019221b80 1 -- start start 2024-06-06T03:31:21.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.133+0000 7fa019221b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c1ca948f0 0x555c1ca94cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:21.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.133+0000 7fa019221b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c1ca95210 0x555c1ca8eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:21.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.133+0000 7fa019221b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555c1ca8f080 0x555c1ca8f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:21.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.134+0000 7fa019221b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555c1c9e0810 con 0x555c1ca8f080 2024-06-06T03:31:21.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.134+0000 7fa019221b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555c1c988720 con 0x555c1ca948f0 2024-06-06T03:31:21.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.134+0000 7fa019221b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555c1c9dc7d0 con 0x555c1ca95210 2024-06-06T03:31:21.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.134+0000 7fa0077fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c1ca948f0 0x555c1ca94cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:21.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.134+0000 7fa0077fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c1ca948f0 0x555c1ca94cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:37422/0 (socket says 172.21.15.50:37422) 2024-06-06T03:31:21.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.134+0000 7fa0077fe700 1 -- 172.21.15.50:0/1406985820 learned_addr learned my addr 172.21.15.50:0/1406985820 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:21.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.134+0000 7fa007fff700 1 --2- 172.21.15.50:0/1406985820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c1ca95210 0x555c1ca8eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:21.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.135+0000 7fa0077fe700 1 -- 172.21.15.50:0/1406985820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c1ca95210 msgr2=0x555c1ca8eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:21.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.135+0000 7fa0077fe700 1 --2- 172.21.15.50:0/1406985820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c1ca95210 0x555c1ca8eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.135+0000 7fa0077fe700 1 -- 172.21.15.50:0/1406985820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555c1ca8f080 msgr2=0x555c1ca8f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:21.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.135+0000 7fa0077fe700 1 --2- 172.21.15.50:0/1406985820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555c1ca8f080 0x555c1ca8f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.135+0000 7fa0077fe700 1 -- 172.21.15.50:0/1406985820 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c1c97ef50 con 0x555c1ca948f0 2024-06-06T03:31:21.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.135+0000 7fa0057fa700 1 --2- 172.21.15.50:0/2693260474 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9ff00a2cf0 0x7f9ff00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:21.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.135+0000 7fa0077fe700 1 --2- 172.21.15.50:0/1406985820 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c1ca948f0 0x555c1ca94cd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8009c60 tx=0x7f9ff8009f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c156a48b39482f9 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:21.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.135+0000 7fa007fff700 1 --2- 172.21.15.50:0/2693260474 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9ff00a2cf0 0x7f9ff00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:21.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.135+0000 7f9fee7fc700 1 -- 172.21.15.50:0/1406985820 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8010c50 con 0x555c1ca948f0 2024-06-06T03:31:21.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.136+0000 7f9fee7fc700 1 -- 172.21.15.50:0/1406985820 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9ff8015030 con 0x555c1ca948f0 2024-06-06T03:31:21.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.136+0000 7f9fee7fc700 1 -- 172.21.15.50:0/1406985820 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8003dd0 con 0x555c1ca948f0 2024-06-06T03:31:21.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.136+0000 7fa0057fa700 1 -- 172.21.15.50:0/2693260474 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fa0000cf200 con 0x7fa00811bbd0 2024-06-06T03:31:21.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.137+0000 7fa007fff700 1 --2- 172.21.15.50:0/2693260474 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9ff00a2cf0 0x7f9ff00a51b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x555c1ca8b730 tx=0x7f9ffc00b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:21.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.137+0000 7fa019221b80 1 -- 172.21.15.50:0/1406985820 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c1ca948f0 msgr2=0x555c1ca94cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:21.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.138+0000 7fa019221b80 1 --2- 172.21.15.50:0/1406985820 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c1ca948f0 0x555c1ca94cd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8009c60 tx=0x7f9ff8009f70 comp rx=0 tx=0).stop 2024-06-06T03:31:21.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.141+0000 7fa019221b80 1 -- 172.21.15.50:0/1406985820 shutdown_connections 2024-06-06T03:31:21.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.141+0000 7fa019221b80 1 --2- 172.21.15.50:0/1406985820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555c1ca8f080 0x555c1ca8f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.141+0000 7fa019221b80 1 --2- 172.21.15.50:0/1406985820 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c1ca948f0 0x555c1ca94cd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.141+0000 7fa019221b80 1 --2- 172.21.15.50:0/1406985820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c1ca95210 0x555c1ca8eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.141+0000 7fa019221b80 1 -- 172.21.15.50:0/1406985820 >> 172.21.15.50:0/1406985820 conn(0x555c1c9b9cc0 msgr2=0x555c1ca89af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:21.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.142+0000 7fa019221b80 1 -- 172.21.15.50:0/1406985820 shutdown_connections 2024-06-06T03:31:21.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.142+0000 7fa019221b80 1 -- 172.21.15.50:0/1406985820 wait complete. 2024-06-06T03:31:21.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.143+0000 7fa019221b80 1 -- start start 2024-06-06T03:31:21.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.143+0000 7fa019221b80 1 Processor -- start 2024-06-06T03:31:21.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.143+0000 7fa019221b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c1ca8f080 0x555c1ca9aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:21.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.143+0000 7fa019221b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c1ca948f0 0x555c1ca981a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:21.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.143+0000 7fa019221b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555c1ca95210 0x555c1ca986e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:21.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.144+0000 7fa019221b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555c1ca9bbd0 con 0x555c1ca95210 2024-06-06T03:31:21.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.144+0000 7fa019221b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555c1c980bf0 con 0x555c1ca8f080 2024-06-06T03:31:21.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.144+0000 7fa019221b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555c1ca9bd50 con 0x555c1ca948f0 2024-06-06T03:31:21.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.144+0000 7fa019221b80 10 client.0 _ll_register_callbacks cb 0x555c1c97a920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:31:21.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.144+0000 7fa007fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c1ca8f080 0x555c1ca9aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:21.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.144+0000 7fa00cf3b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555c1ca95210 0x555c1ca986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:21.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.144+0000 7fa00cf3b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555c1ca95210 0x555c1ca986e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40004/0 (socket says 172.21.15.50:40004) 2024-06-06T03:31:21.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.144+0000 7fa00cf3b700 1 -- 172.21.15.50:0/3340852714 learned_addr learned my addr 172.21.15.50:0/3340852714 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:21.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.144+0000 7fa0077fe700 1 --2- 172.21.15.50:0/3340852714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c1ca948f0 0x555c1ca981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:21.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.145+0000 7fa00cf3b700 1 -- 172.21.15.50:0/3340852714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c1ca948f0 msgr2=0x555c1ca981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:21.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.145+0000 7fa00cf3b700 1 --2- 172.21.15.50:0/3340852714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c1ca948f0 0x555c1ca981a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.145+0000 7fa00cf3b700 1 -- 172.21.15.50:0/3340852714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c1ca8f080 msgr2=0x555c1ca9aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:21.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.145+0000 7fa00cf3b700 1 --2- 172.21.15.50:0/3340852714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c1ca8f080 0x555c1ca9aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.145+0000 7fa00cf3b700 1 -- 172.21.15.50:0/3340852714 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c1c92f8d0 con 0x555c1ca95210 2024-06-06T03:31:21.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.145+0000 7fa00cf3b700 1 --2- 172.21.15.50:0/3340852714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555c1ca95210 0x555c1ca986e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa000097b40 tx=0x7fa00009be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3fa27d988b79dc4 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:21.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.145+0000 7f9fe77fe700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:31:21.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.146+0000 7f9fe77fe700 1 -- 172.21.15.50:0/3340852714 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00009fa90 con 0x555c1ca95210 2024-06-06T03:31:21.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.147+0000 7fa019221b80 1 -- 172.21.15.50:0/3340852714 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ff8015030 con 0x555c1ca95210 2024-06-06T03:31:21.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.147+0000 7f9fe77fe700 1 -- 172.21.15.50:0/3340852714 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fa0000a3ec0 con 0x555c1ca95210 2024-06-06T03:31:21.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.147+0000 7f9fe77fe700 1 -- 172.21.15.50:0/3340852714 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa0000a4100 con 0x555c1ca95210 2024-06-06T03:31:21.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.147+0000 7fa019221b80 10 client.16134 fetch_fsmap learned FSMap version 32 2024-06-06T03:31:21.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.147+0000 7fa019221b80 1 -- 172.21.15.50:0/3340852714 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x555c1caa6530 con 0x555c1ca95210 2024-06-06T03:31:21.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.148+0000 7f9fe77fe700 1 -- 172.21.15.50:0/3340852714 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9ff8015030 con 0x555c1ca95210 2024-06-06T03:31:21.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.148+0000 7f9fe77fe700 1 -- 172.21.15.50:0/3340852714 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7fa000004ad0 con 0x555c1ca95210 2024-06-06T03:31:21.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.148+0000 7fa019221b80 10 client.16134 fetch_fsmap finished waiting for FSMap version 32 2024-06-06T03:31:21.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.148+0000 7fa019221b80 10 client.16134 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-06-06T03:31:21.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.148+0000 7fa019221b80 20 client.16134 populate_metadata read hostname 'smithi050' 2024-06-06T03:31:21.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.148+0000 7fa019221b80 1 --2- 172.21.15.50:0/3340852714 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x555c1caa8f40 0x555c1caab360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:21.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.148+0000 7fa019221b80 4 client.16134 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:31:21.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.148+0000 7fa019221b80 1 -- 172.21.15.50:0/3340852714 --> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c1c9edd10 con 0x555c1caa8f40 2024-06-06T03:31:21.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.149+0000 7fa007fff700 1 --2- 172.21.15.50:0/3340852714 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x555c1caa8f40 0x555c1caab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:21.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.150+0000 7fa007fff700 1 --2- 172.21.15.50:0/3340852714 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x555c1caa8f40 0x555c1caab360 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c58e2f14dd34748e server_cookie=b260d68b9dca2afc in_seq=0 out_seq=0 2024-06-06T03:31:21.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.150+0000 7f9fe77fe700 10 client.16134 ms_handle_connect on v2:172.21.15.122:6834/2987597320 2024-06-06T03:31:21.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.151+0000 7f9fe77fe700 1 -- 172.21.15.50:0/3340852714 <== mds.2 v2:172.21.15.122:6834/2987597320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x555c1c9edd10 con 0x555c1caa8f40 2024-06-06T03:31:21.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.151+0000 7f9fe77fe700 10 client.16134 handle_command_reply: tid=0 2024-06-06T03:31:21.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.151+0000 7fa019221b80 1 client.16134 shutdown 2024-06-06T03:31:21.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.151+0000 7fa019221b80 1 -- 172.21.15.50:0/3340852714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555c1ca95210 msgr2=0x555c1ca986e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:21.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.151+0000 7fa019221b80 1 --2- 172.21.15.50:0/3340852714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555c1ca95210 0x555c1ca986e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa000097b40 tx=0x7fa00009be60 comp rx=0 tx=0).stop 2024-06-06T03:31:21.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.151+0000 7fa019221b80 1 -- 172.21.15.50:0/3340852714 shutdown_connections 2024-06-06T03:31:21.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.151+0000 7fa019221b80 1 --2- 172.21.15.50:0/3340852714 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x555c1caa8f40 0x555c1caab360 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.151+0000 7fa019221b80 1 --2- 172.21.15.50:0/3340852714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555c1ca95210 0x555c1ca986e0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.151+0000 7fa019221b80 1 --2- 172.21.15.50:0/3340852714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c1ca8f080 0x555c1ca9aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.151+0000 7f9fe77fe700 0 client.16134 ms_handle_reset on v2:172.21.15.122:6834/2987597320 2024-06-06T03:31:21.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.151+0000 7fa019221b80 1 --2- 172.21.15.50:0/3340852714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c1ca948f0 0x555c1ca981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.151+0000 7fa019221b80 1 -- 172.21.15.50:0/3340852714 >> 172.21.15.50:0/3340852714 conn(0x555c1c9b9cc0 msgr2=0x555c1ca8db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:21.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.151+0000 7fa019221b80 1 -- 172.21.15.50:0/3340852714 shutdown_connections 2024-06-06T03:31:21.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.151+0000 7fa019221b80 1 -- 172.21.15.50:0/3340852714 wait complete. 2024-06-06T03:31:21.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.152+0000 7fa019221b80 20 client.16134 trim_cache size 0 max 16384 2024-06-06T03:31:21.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.184+0000 7fa019221b80 1 Processor -- start 2024-06-06T03:31:21.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.185+0000 7fa019221b80 1 -- start start 2024-06-06T03:31:21.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.185+0000 7fa019221b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c1ca8f080 0x555c1ca8eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:21.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.185+0000 7fa019221b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c1ca948f0 0x555c1ca987d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:21.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.185+0000 7fa019221b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555c1ca95210 0x555c1ca95da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:21.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.186+0000 7fa0077fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c1ca948f0 0x555c1ca987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:21.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.186+0000 7fa019221b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff40112a0 con 0x555c1ca95210 2024-06-06T03:31:21.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.186+0000 7fa0077fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c1ca948f0 0x555c1ca987d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:60236/0 (socket says 172.21.15.50:60236) 2024-06-06T03:31:21.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.186+0000 7fa0077fe700 1 -- 172.21.15.50:0/2363584410 learned_addr learned my addr 172.21.15.50:0/2363584410 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:21.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.186+0000 7fa019221b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff400eb30 con 0x555c1ca8f080 2024-06-06T03:31:21.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.186+0000 7fa019221b80 1 -- 172.21.15.50:0/2363584410 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff400c980 con 0x555c1ca948f0 2024-06-06T03:31:21.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.186+0000 7fa007fff700 1 --2- 172.21.15.50:0/2363584410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c1ca8f080 0x555c1ca8eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:21.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.186+0000 7fa007fff700 1 -- 172.21.15.50:0/2363584410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c1ca948f0 msgr2=0x555c1ca987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:21.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.186+0000 7fa007fff700 1 --2- 172.21.15.50:0/2363584410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c1ca948f0 0x555c1ca987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.186+0000 7fa007fff700 1 -- 172.21.15.50:0/2363584410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555c1ca95210 msgr2=0x555c1ca95da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:21.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.186+0000 7fa007fff700 1 --2- 172.21.15.50:0/2363584410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555c1ca95210 0x555c1ca95da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.186+0000 7fa007fff700 1 -- 172.21.15.50:0/2363584410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c1ca95020 con 0x555c1ca8f080 2024-06-06T03:31:21.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.187+0000 7fa007fff700 1 --2- 172.21.15.50:0/2363584410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c1ca8f080 0x555c1ca8eb40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc000c00 tx=0x7f9ffc01f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb0b31874b987b50 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:21.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.188+0000 7f9fedffb700 1 -- 172.21.15.50:0/2363584410 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc00be00 con 0x555c1ca8f080 2024-06-06T03:31:21.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.188+0000 7fa0077fe700 1 --2- 172.21.15.50:0/2363584410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c1ca948f0 0x555c1ca987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:31:21.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.188+0000 7f9fedffb700 1 -- 172.21.15.50:0/2363584410 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9ffc003b30 con 0x555c1ca8f080 2024-06-06T03:31:21.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.189+0000 7f9fedffb700 1 -- 172.21.15.50:0/2363584410 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc031b90 con 0x555c1ca8f080 2024-06-06T03:31:21.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.189+0000 7fa019221b80 1 -- 172.21.15.50:0/2363584410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c1ca8f080 msgr2=0x555c1ca8eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:21.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.189+0000 7fa019221b80 1 --2- 172.21.15.50:0/2363584410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c1ca8f080 0x555c1ca8eb40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc000c00 tx=0x7f9ffc01f000 comp rx=0 tx=0).stop 2024-06-06T03:31:21.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.189+0000 7fa019221b80 1 -- 172.21.15.50:0/2363584410 shutdown_connections 2024-06-06T03:31:21.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.189+0000 7fa019221b80 1 --2- 172.21.15.50:0/2363584410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555c1ca95210 0x555c1ca95da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.189+0000 7fa019221b80 1 --2- 172.21.15.50:0/2363584410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c1ca8f080 0x555c1ca8eb40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.189+0000 7fa019221b80 1 --2- 172.21.15.50:0/2363584410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c1ca948f0 0x555c1ca987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.189+0000 7fa019221b80 1 -- 172.21.15.50:0/2363584410 >> 172.21.15.50:0/2363584410 conn(0x555c1c9b9cc0 msgr2=0x555c1ca95690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:21.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.189+0000 7fa019221b80 1 -- 172.21.15.50:0/2363584410 shutdown_connections 2024-06-06T03:31:21.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.189+0000 7fa019221b80 1 -- 172.21.15.50:0/2363584410 wait complete. 2024-06-06T03:31:21.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.189+0000 7fa019221b80 1 -- start start 2024-06-06T03:31:21.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.190+0000 7fa019221b80 1 Processor -- start 2024-06-06T03:31:21.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.190+0000 7fa019221b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c1ca8f080 0x555c1caa15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:21.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.190+0000 7fa019221b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555c1ca948f0 0x555c1cab03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:21.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.190+0000 7fa019221b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c1ca95210 0x555c1cab0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:21.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.190+0000 7fa019221b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff400cff0 con 0x555c1ca948f0 2024-06-06T03:31:21.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.190+0000 7fa019221b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff400e460 con 0x555c1ca8f080 2024-06-06T03:31:21.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.190+0000 7fa0077fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555c1ca948f0 0x555c1cab03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:21.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.190+0000 7fa0077fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555c1ca948f0 0x555c1cab03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40024/0 (socket says 172.21.15.50:40024) 2024-06-06T03:31:21.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.190+0000 7fa0077fe700 1 -- 172.21.15.50:0/160487919 learned_addr learned my addr 172.21.15.50:0/160487919 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:21.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.190+0000 7fa019221b80 1 -- 172.21.15.50:0/160487919 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff400d6c0 con 0x555c1ca95210 2024-06-06T03:31:21.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.190+0000 7fa007fff700 1 --2- 172.21.15.50:0/160487919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c1ca8f080 0x555c1caa15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:21.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.190+0000 7fa019221b80 10 client.0 _ll_register_callbacks cb 0x555c1c97a920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:31:21.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.190+0000 7fa00cf3b700 1 --2- 172.21.15.50:0/160487919 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c1ca95210 0x555c1cab0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:21.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.191+0000 7fa0077fe700 1 -- 172.21.15.50:0/160487919 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c1ca95210 msgr2=0x555c1cab0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:21.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.191+0000 7fa0077fe700 1 --2- 172.21.15.50:0/160487919 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c1ca95210 0x555c1cab0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.191+0000 7fa0077fe700 1 -- 172.21.15.50:0/160487919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c1ca8f080 msgr2=0x555c1caa15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:21.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.191+0000 7fa0077fe700 1 --2- 172.21.15.50:0/160487919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c1ca8f080 0x555c1caa15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.191+0000 7fa0077fe700 1 -- 172.21.15.50:0/160487919 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c1cab0f70 con 0x555c1ca948f0 2024-06-06T03:31:21.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.191+0000 7fa0077fe700 1 --2- 172.21.15.50:0/160487919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555c1ca948f0 0x555c1cab03f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8009c60 tx=0x7f9ff8005d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad4f40f5a753767 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:21.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.191+0000 7f9fe77fe700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:31:21.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.191+0000 7f9fe77fe700 1 -- 172.21.15.50:0/160487919 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8004830 con 0x555c1ca948f0 2024-06-06T03:31:21.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.191+0000 7f9fe77fe700 1 -- 172.21.15.50:0/160487919 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f9ff80049d0 con 0x555c1ca948f0 2024-06-06T03:31:21.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.191+0000 7fa019221b80 1 -- 172.21.15.50:0/160487919 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ffc003b30 con 0x555c1ca948f0 2024-06-06T03:31:21.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.191+0000 7f9fe77fe700 1 -- 172.21.15.50:0/160487919 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9ff8031050 con 0x555c1ca948f0 2024-06-06T03:31:21.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.191+0000 7fa019221b80 10 client.16137 fetch_fsmap learned FSMap version 32 2024-06-06T03:31:21.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.191+0000 7fa019221b80 1 -- 172.21.15.50:0/160487919 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x555c1cb13990 con 0x555c1ca948f0 2024-06-06T03:31:21.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.191+0000 7f9fe77fe700 1 -- 172.21.15.50:0/160487919 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9ff8015040 con 0x555c1ca948f0 2024-06-06T03:31:21.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.191+0000 7f9fe77fe700 1 -- 172.21.15.50:0/160487919 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f9ff80114f0 con 0x555c1ca948f0 2024-06-06T03:31:21.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.192+0000 7fa019221b80 10 client.16137 fetch_fsmap finished waiting for FSMap version 32 2024-06-06T03:31:21.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.192+0000 7fa019221b80 10 client.16137 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-06-06T03:31:21.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.192+0000 7fa019221b80 20 client.16137 populate_metadata read hostname 'smithi050' 2024-06-06T03:31:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.192+0000 7fa019221b80 1 --2- 172.21.15.50:0/160487919 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x555c1cb13d50 0x555c1cb16140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.192+0000 7fa019221b80 4 client.16137 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:31:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.192+0000 7fa019221b80 1 -- 172.21.15.50:0/160487919 --> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f9ffc003b30 con 0x555c1cb13d50 2024-06-06T03:31:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.192+0000 7fa007fff700 1 --2- 172.21.15.50:0/160487919 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x555c1cb13d50 0x555c1cb16140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.192+0000 7f9fe77fe700 10 client.16137 ms_handle_connect on v2:172.21.15.122:6834/2987597320 2024-06-06T03:31:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.192+0000 7fa007fff700 1 --2- 172.21.15.50:0/160487919 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x555c1cb13d50 0x555c1cb16140 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5566d9ced1314109 server_cookie=3b9b61e1be01b1c5 in_seq=0 out_seq=0 2024-06-06T03:31:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.192+0000 7f9fe77fe700 1 -- 172.21.15.50:0/160487919 <== mds.2 v2:172.21.15.122:6834/2987597320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f9ffc003b30 con 0x555c1cb13d50 2024-06-06T03:31:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.192+0000 7f9fe77fe700 10 client.16137 handle_command_reply: tid=0 2024-06-06T03:31:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.192+0000 7fa019221b80 1 client.16137 shutdown 2024-06-06T03:31:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.193+0000 7fa019221b80 1 -- 172.21.15.50:0/160487919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555c1ca948f0 msgr2=0x555c1cab03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.193+0000 7fa019221b80 1 --2- 172.21.15.50:0/160487919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555c1ca948f0 0x555c1cab03f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8009c60 tx=0x7f9ff8005d00 comp rx=0 tx=0).stop 2024-06-06T03:31:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.193+0000 7fa019221b80 1 -- 172.21.15.50:0/160487919 shutdown_connections 2024-06-06T03:31:21.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.193+0000 7fa019221b80 1 --2- 172.21.15.50:0/160487919 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c1ca95210 0x555c1cab0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.193+0000 7fa019221b80 1 --2- 172.21.15.50:0/160487919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c1ca8f080 0x555c1caa15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.193+0000 7fa019221b80 1 --2- 172.21.15.50:0/160487919 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x555c1cb13d50 0x555c1cb16140 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.193+0000 7fa019221b80 1 --2- 172.21.15.50:0/160487919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555c1ca948f0 0x555c1cab03f0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.193+0000 7fa019221b80 1 -- 172.21.15.50:0/160487919 >> 172.21.15.50:0/160487919 conn(0x555c1c9b9cc0 msgr2=0x555c1ca894e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:21.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.193+0000 7f9fe77fe700 0 client.16137 ms_handle_reset on v2:172.21.15.122:6834/2987597320 2024-06-06T03:31:21.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.193+0000 7fa019221b80 1 -- 172.21.15.50:0/160487919 shutdown_connections 2024-06-06T03:31:21.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.193+0000 7fa019221b80 1 -- 172.21.15.50:0/160487919 wait complete. 2024-06-06T03:31:21.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.193+0000 7fa019221b80 20 client.16137 trim_cache size 0 max 16384 2024-06-06T03:31:21.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.193+0000 7fa00d73c700 1 -- 172.21.15.50:0/2693260474 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9ff00a2cf0 msgr2=0x7f9ff00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:21.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.193+0000 7fa00d73c700 1 --2- 172.21.15.50:0/2693260474 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9ff00a2cf0 0x7f9ff00a51b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x555c1ca8b730 tx=0x7f9ffc00b260 comp rx=0 tx=0).stop 2024-06-06T03:31:21.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.193+0000 7fa00d73c700 1 -- 172.21.15.50:0/2693260474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa00811bbd0 msgr2=0x7fa0081143d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:21.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.193+0000 7fa00d73c700 1 --2- 172.21.15.50:0/2693260474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa00811bbd0 0x7fa0081143d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa000007d40 tx=0x7fa00000a340 comp rx=0 tx=0).stop 2024-06-06T03:31:21.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.193+0000 7fa00d73c700 1 -- 172.21.15.50:0/2693260474 shutdown_connections 2024-06-06T03:31:21.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.193+0000 7fa00d73c700 1 --2- 172.21.15.50:0/2693260474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa00811bbd0 0x7fa0081143d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.193+0000 7fa00d73c700 1 --2- 172.21.15.50:0/2693260474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa00806bc60 0x7fa00811b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.193+0000 7fa00d73c700 1 --2- 172.21.15.50:0/2693260474 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9ff00a2cf0 0x7f9ff00a51b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.193+0000 7fa00d73c700 1 --2- 172.21.15.50:0/2693260474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa00806c580 0x7fa00811b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:21.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.193+0000 7fa00d73c700 1 -- 172.21.15.50:0/2693260474 >> 172.21.15.50:0/2693260474 conn(0x7fa00806f230 msgr2=0x7fa00806fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:21.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.194+0000 7fa00d73c700 1 -- 172.21.15.50:0/2693260474 shutdown_connections 2024-06-06T03:31:21.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:20.194+0000 7fa00d73c700 1 -- 172.21.15.50:0/2693260474 wait complete. 2024-06-06T03:31:21.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:20 smithi079 ceph-mon[35478]: pgmap v572: 129 pgs: 129 active+clean; 10 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 50 MiB/s wr, 807 op/s 2024-06-06T03:31:21.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:21 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:31:22.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:21 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:31:22.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:21 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:31:22.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:22 smithi122 ceph-mon[35759]: pgmap v573: 129 pgs: 129 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 41 MiB/s wr, 666 op/s 2024-06-06T03:31:22.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:22 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:31:22.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:22 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:31:22.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:22 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:31:22.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:22 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:31:22.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:22 smithi122 ceph-mon[35759]: Adjusting osd_memory_target on smithi079 to 176.1M 2024-06-06T03:31:22.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:22 smithi122 ceph-mon[35759]: Unable to set osd_memory_target on smithi079 to 184732262: error parsing value: Value '184732262' is below minimum 939524096 2024-06-06T03:31:22.980 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:22 smithi050 ceph-mon[32421]: pgmap v573: 129 pgs: 129 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 41 MiB/s wr, 666 op/s 2024-06-06T03:31:22.980 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:22 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:31:22.980 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:22 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:31:22.981 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:22 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:31:22.981 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:22 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:31:22.981 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:22 smithi050 ceph-mon[32421]: Adjusting osd_memory_target on smithi079 to 176.1M 2024-06-06T03:31:22.981 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:22 smithi050 ceph-mon[32421]: Unable to set osd_memory_target on smithi079 to 184732262: error parsing value: Value '184732262' is below minimum 939524096 2024-06-06T03:31:23.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:22 smithi079 ceph-mon[35478]: pgmap v573: 129 pgs: 129 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 41 MiB/s wr, 666 op/s 2024-06-06T03:31:23.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:22 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:31:23.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:22 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:31:23.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:22 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:31:23.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:22 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:31:23.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:22 smithi079 ceph-mon[35478]: Adjusting osd_memory_target on smithi079 to 176.1M 2024-06-06T03:31:23.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:22 smithi079 ceph-mon[35478]: Unable to set osd_memory_target on smithi079 to 184732262: error parsing value: Value '184732262' is below minimum 939524096 2024-06-06T03:31:23.436 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-06-06T03:31:23.664 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:23 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:31:23.664 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:23 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:31:23.664 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:23 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:31:23.664 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:23 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:31:23.664 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:23 smithi050 ceph-mon[32421]: Adjusting osd_memory_target on smithi050 to 177.2M 2024-06-06T03:31:23.664 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:23 smithi050 ceph-mon[32421]: Unable to set osd_memory_target on smithi050 to 185844736: error parsing value: Value '185844736' is below minimum 939524096 2024-06-06T03:31:23.664 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:23 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:31:23.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:23 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:31:23.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:23 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:31:23.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:23 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:31:23.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:23 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:31:23.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:23 smithi122 ceph-mon[35759]: Adjusting osd_memory_target on smithi050 to 177.2M 2024-06-06T03:31:23.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:23 smithi122 ceph-mon[35759]: Unable to set osd_memory_target on smithi050 to 185844736: error parsing value: Value '185844736' is below minimum 939524096 2024-06-06T03:31:23.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:23 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:31:23.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:23 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:31:23.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:23 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:31:24.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:23 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:31:24.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:23 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:31:24.076 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:31:24.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:23 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:31:24.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:23 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:31:24.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:23 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:31:24.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:23 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:31:24.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:23 smithi079 ceph-mon[35478]: Adjusting osd_memory_target on smithi050 to 177.2M 2024-06-06T03:31:24.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:23 smithi079 ceph-mon[35478]: Unable to set osd_memory_target on smithi050 to 185844736: error parsing value: Value '185844736' is below minimum 939524096 2024-06-06T03:31:24.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:23 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:31:24.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:23 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:31:24.101 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:23 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:31:25.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:25 smithi050 ceph-mon[32421]: pgmap v574: 129 pgs: 129 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 42 MiB/s wr, 677 op/s 2024-06-06T03:31:25.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:25 smithi079 ceph-mon[35478]: pgmap v574: 129 pgs: 129 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 42 MiB/s wr, 677 op/s 2024-06-06T03:31:25.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:25 smithi122 ceph-mon[35759]: pgmap v574: 129 pgs: 129 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 42 MiB/s wr, 677 op/s 2024-06-06T03:31:27.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:27 smithi050 ceph-mon[32421]: pgmap v575: 129 pgs: 129 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 48 MiB/s wr, 771 op/s 2024-06-06T03:31:27.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:27 smithi079 ceph-mon[35478]: pgmap v575: 129 pgs: 129 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 48 MiB/s wr, 771 op/s 2024-06-06T03:31:27.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:27 smithi122 ceph-mon[35759]: pgmap v575: 129 pgs: 129 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 48 MiB/s wr, 771 op/s 2024-06-06T03:31:28.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.538+0000 7f69f85f9640 1 -- 172.21.15.50:0/3240485199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f0101af0 msgr2=0x7f69f0101f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:28.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.538+0000 7f69f85f9640 1 --2- 172.21.15.50:0/3240485199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f0101af0 0x7f69f0101f70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f69e0009900 tx=0x7f69e002a410 comp rx=0 tx=0).stop 2024-06-06T03:31:28.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.539+0000 7f69f85f9640 1 -- 172.21.15.50:0/3240485199 shutdown_connections 2024-06-06T03:31:28.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.539+0000 7f69f85f9640 1 --2- 172.21.15.50:0/3240485199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f0101af0 0x7f69f0101f70 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.539+0000 7f69f85f9640 1 --2- 172.21.15.50:0/3240485199 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69f01024b0 0x7f69f0108d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.539+0000 7f69f85f9640 1 --2- 172.21.15.50:0/3240485199 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69f0100900 0x7f69f0100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.542 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.539+0000 7f69f85f9640 1 -- 172.21.15.50:0/3240485199 >> 172.21.15.50:0/3240485199 conn(0x7f69f00fbe70 msgr2=0x7f69f00fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:28.542 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.539+0000 7f69f85f9640 1 -- 172.21.15.50:0/3240485199 shutdown_connections 2024-06-06T03:31:28.542 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.539+0000 7f69f85f9640 1 -- 172.21.15.50:0/3240485199 wait complete. 2024-06-06T03:31:28.542 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.539+0000 7f69f85f9640 1 Processor -- start 2024-06-06T03:31:28.542 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.539+0000 7f69f85f9640 1 -- start start 2024-06-06T03:31:28.542 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.539+0000 7f69f85f9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69f0100900 0x7f69f006ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:28.542 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.539+0000 7f69f85f9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f0101af0 0x7f69f019c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:28.542 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.539+0000 7f69f85f9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69f01024b0 0x7f69f019eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:28.542 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.540+0000 7f69f85f9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f69f010c460 con 0x7f69f0101af0 2024-06-06T03:31:28.542 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.540+0000 7f69f85f9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f69f010c2e0 con 0x7f69f0100900 2024-06-06T03:31:28.542 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.540+0000 7f69f85f9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f69f010c5e0 con 0x7f69f01024b0 2024-06-06T03:31:28.543 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.540+0000 7f69f6395640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69f0100900 0x7f69f006ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:28.543 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.540+0000 7f69f6395640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69f0100900 0x7f69f006ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:33764/0 (socket says 172.21.15.50:33764) 2024-06-06T03:31:28.543 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.540+0000 7f69f6395640 1 -- 172.21.15.50:0/746080316 learned_addr learned my addr 172.21.15.50:0/746080316 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:28.543 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.540+0000 7f69f5b94640 1 --2- 172.21.15.50:0/746080316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f0101af0 0x7f69f019c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:28.543 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.540+0000 7f69f6b96640 1 --2- 172.21.15.50:0/746080316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69f01024b0 0x7f69f019eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:28.543 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.540+0000 7f69f6395640 1 -- 172.21.15.50:0/746080316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69f01024b0 msgr2=0x7f69f019eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:28.543 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.540+0000 7f69f6395640 1 --2- 172.21.15.50:0/746080316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69f01024b0 0x7f69f019eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.543 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.540+0000 7f69f6395640 1 -- 172.21.15.50:0/746080316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f0101af0 msgr2=0x7f69f019c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:28.543 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.540+0000 7f69f6395640 1 --2- 172.21.15.50:0/746080316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f0101af0 0x7f69f019c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.543 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.540+0000 7f69f6395640 1 -- 172.21.15.50:0/746080316 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f019f7c0 con 0x7f69f0100900 2024-06-06T03:31:28.543 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.540+0000 7f69f6b96640 1 --2- 172.21.15.50:0/746080316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69f01024b0 0x7f69f019eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:31:28.543 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.540+0000 7f69f5b94640 1 --2- 172.21.15.50:0/746080316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f0101af0 0x7f69f019c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:31:28.543 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.540+0000 7f69f6395640 1 --2- 172.21.15.50:0/746080316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69f0100900 0x7f69f006ad80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00e9c0 tx=0x7f69ec00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:28.544 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.540+0000 7f69e77fe640 1 -- 172.21.15.50:0/746080316 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec00cd80 con 0x7f69f0100900 2024-06-06T03:31:28.544 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.540+0000 7f69e77fe640 1 -- 172.21.15.50:0/746080316 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f69ec0035f0 con 0x7f69f0100900 2024-06-06T03:31:28.544 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.540+0000 7f69f85f9640 1 -- 172.21.15.50:0/746080316 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f019fa50 con 0x7f69f0100900 2024-06-06T03:31:28.544 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.540+0000 7f69e77fe640 1 -- 172.21.15.50:0/746080316 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec010690 con 0x7f69f0100900 2024-06-06T03:31:28.544 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.541+0000 7f69f85f9640 1 -- 172.21.15.50:0/746080316 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f019ff20 con 0x7f69f0100900 2024-06-06T03:31:28.544 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.544+0000 7f69e77fe640 1 -- 172.21.15.50:0/746080316 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f69ec0108f0 con 0x7f69f0100900 2024-06-06T03:31:28.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.545+0000 7f69fb3e9740 1 Processor -- start 2024-06-06T03:31:28.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.545+0000 7f69e77fe640 1 --2- 172.21.15.50:0/746080316 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f69dc0a2c30 0x7f69dc0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:28.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.545+0000 7f69fb3e9740 1 -- start start 2024-06-06T03:31:28.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.545+0000 7f69e77fe640 1 -- 172.21.15.50:0/746080316 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f69ec0cf830 con 0x7f69f0100900 2024-06-06T03:31:28.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.545+0000 7f69f6b96640 1 --2- 172.21.15.50:0/746080316 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f69dc0a2c30 0x7f69dc0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:28.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.545+0000 7f69fb3e9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc1681010 0x55ebc1681430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:28.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.545+0000 7f69fb3e9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ebc1681a00 0x55ebc1686500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:28.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.545+0000 7f69fb3e9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ebc1686b70 0x55ebc1689000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:28.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.545+0000 7f69fb3e9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ebc15e44f0 con 0x55ebc1686b70 2024-06-06T03:31:28.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.546+0000 7f69fb3e9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ebc1582870 con 0x55ebc1681a00 2024-06-06T03:31:28.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.546+0000 7f69fb3e9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ebc15e04b0 con 0x55ebc1681010 2024-06-06T03:31:28.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.546+0000 7f69f6395640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc1681010 0x55ebc1681430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:28.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.546+0000 7f69f6395640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc1681010 0x55ebc1681430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:35886/0 (socket says 172.21.15.50:35886) 2024-06-06T03:31:28.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.546+0000 7f69f6395640 1 -- 172.21.15.50:0/248955609 learned_addr learned my addr 172.21.15.50:0/248955609 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.546+0000 7f69f5b94640 1 --2- 172.21.15.50:0/248955609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ebc1681a00 0x55ebc1686500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.546+0000 7f69f6b96640 1 --2- 172.21.15.50:0/248955609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ebc1686b70 0x55ebc1689000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.546+0000 7f69f6395640 1 -- 172.21.15.50:0/248955609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ebc1681a00 msgr2=0x55ebc1686500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.546+0000 7f69f6395640 1 --2- 172.21.15.50:0/248955609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ebc1681a00 0x55ebc1686500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.546+0000 7f69f6395640 1 -- 172.21.15.50:0/248955609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ebc1686b70 msgr2=0x55ebc1689000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.546+0000 7f69f6395640 1 --2- 172.21.15.50:0/248955609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ebc1686b70 0x55ebc1689000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.546+0000 7f69f6395640 1 -- 172.21.15.50:0/248955609 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebc159e9b0 con 0x55ebc1681010 2024-06-06T03:31:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.546+0000 7f69f6b96640 1 --2- 172.21.15.50:0/746080316 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f69dc0a2c30 0x7f69dc0a50f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f69e8005fd0 tx=0x7f69e80107a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.547+0000 7f69f6395640 1 --2- 172.21.15.50:0/248955609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc1681010 0x55ebc1681430 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f69ec098170 tx=0x7f69ec09b670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d79309770e5c0f03 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.547+0000 7f69e4bfe640 1 -- 172.21.15.50:0/248955609 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec0b9070 con 0x55ebc1681010 2024-06-06T03:31:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.547+0000 7f69e4bfe640 1 -- 172.21.15.50:0/248955609 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f69ec09bd10 con 0x55ebc1681010 2024-06-06T03:31:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.547+0000 7f69e4bfe640 1 -- 172.21.15.50:0/248955609 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec098510 con 0x55ebc1681010 2024-06-06T03:31:28.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.548+0000 7f69fb3e9740 1 -- 172.21.15.50:0/248955609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc1681010 msgr2=0x55ebc1681430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:28.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.548+0000 7f69fb3e9740 1 --2- 172.21.15.50:0/248955609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc1681010 0x55ebc1681430 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f69ec098170 tx=0x7f69ec09b670 comp rx=0 tx=0).stop 2024-06-06T03:31:28.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.548+0000 7f69fb3e9740 1 -- 172.21.15.50:0/248955609 shutdown_connections 2024-06-06T03:31:28.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.548+0000 7f69fb3e9740 1 --2- 172.21.15.50:0/248955609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ebc1686b70 0x55ebc1689000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.548+0000 7f69fb3e9740 1 --2- 172.21.15.50:0/248955609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ebc1681a00 0x55ebc1686500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.548+0000 7f69fb3e9740 1 --2- 172.21.15.50:0/248955609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc1681010 0x55ebc1681430 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.548+0000 7f69fb3e9740 1 -- 172.21.15.50:0/248955609 >> 172.21.15.50:0/248955609 conn(0x55ebc167c680 msgr2=0x55ebc167ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:28.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.548+0000 7f69fb3e9740 1 -- 172.21.15.50:0/248955609 shutdown_connections 2024-06-06T03:31:28.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.548+0000 7f69fb3e9740 1 -- 172.21.15.50:0/248955609 wait complete. 2024-06-06T03:31:28.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.549+0000 7f69fb3e9740 1 -- start start 2024-06-06T03:31:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.549+0000 7f69fb3e9740 1 Processor -- start 2024-06-06T03:31:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.549+0000 7f69fb3e9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ebc1681010 0x55ebc168cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.549+0000 7f69fb3e9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ebc1681a00 0x55ebc168d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.549+0000 7f69fb3e9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc1686b70 0x55ebc1689a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.549+0000 7f69f6395640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ebc1681010 0x55ebc168cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.549+0000 7f69f6395640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ebc1681010 0x55ebc168cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:33774/0 (socket says 172.21.15.50:33774) 2024-06-06T03:31:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.550+0000 7f69f6395640 1 -- 172.21.15.50:0/4251286835 learned_addr learned my addr 172.21.15.50:0/4251286835 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.550+0000 7f69f5b94640 1 --2- 172.21.15.50:0/4251286835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ebc1681a00 0x55ebc168d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.550+0000 7f69fb3e9740 1 -- 172.21.15.50:0/4251286835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ebc168df30 con 0x55ebc1681a00 2024-06-06T03:31:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.550+0000 7f69fb3e9740 1 -- 172.21.15.50:0/4251286835 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ebc156dae0 con 0x55ebc1681010 2024-06-06T03:31:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.550+0000 7f69fb3e9740 1 -- 172.21.15.50:0/4251286835 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ebc168e0b0 con 0x55ebc1686b70 2024-06-06T03:31:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.550+0000 7f69fb3e9740 10 client.0 _ll_register_callbacks cb 0x55ebc15a69b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:31:28.553 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.550+0000 7f69f6b96640 1 --2- 172.21.15.50:0/4251286835 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc1686b70 0x55ebc1689a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:28.553 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.550+0000 7f69f6395640 1 -- 172.21.15.50:0/4251286835 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc1686b70 msgr2=0x55ebc1689a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:28.553 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.550+0000 7f69f6395640 1 --2- 172.21.15.50:0/4251286835 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc1686b70 0x55ebc1689a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.553 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.550+0000 7f69f6395640 1 -- 172.21.15.50:0/4251286835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ebc1681a00 msgr2=0x55ebc168d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:28.553 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.550+0000 7f69f6395640 1 --2- 172.21.15.50:0/4251286835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ebc1681a00 0x55ebc168d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.553 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.550+0000 7f69f6395640 1 -- 172.21.15.50:0/4251286835 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebc12f8210 con 0x55ebc1681010 2024-06-06T03:31:28.553 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.551+0000 7f69f6395640 1 --2- 172.21.15.50:0/4251286835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ebc1681010 0x55ebc168cfb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0cd320 tx=0x7f69ec09c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=190eb64e458b398c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:28.553 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.551+0000 7f69d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:31:28.553 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.551+0000 7f69d9ffb640 1 -- 172.21.15.50:0/4251286835 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec0b9070 con 0x55ebc1681010 2024-06-06T03:31:28.553 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.551+0000 7f69d9ffb640 1 -- 172.21.15.50:0/4251286835 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f69ec0a44f0 con 0x55ebc1681010 2024-06-06T03:31:28.553 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.551+0000 7f69fb3e9740 1 -- 172.21.15.50:0/4251286835 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69ec09bd10 con 0x55ebc1681010 2024-06-06T03:31:28.554 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.551+0000 7f69d9ffb640 1 -- 172.21.15.50:0/4251286835 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f69ec0984f0 con 0x55ebc1681010 2024-06-06T03:31:28.554 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.551+0000 7f69fb3e9740 10 client.25781 fetch_fsmap learned FSMap version 32 2024-06-06T03:31:28.554 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.551+0000 7f69fb3e9740 1 -- 172.21.15.50:0/4251286835 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ebc13c4620 con 0x55ebc1681010 2024-06-06T03:31:28.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.551+0000 7f69d9ffb640 1 -- 172.21.15.50:0/4251286835 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f69ec09a010 con 0x55ebc1681010 2024-06-06T03:31:28.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.552+0000 7f69d9ffb640 1 -- 172.21.15.50:0/4251286835 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f69ec09ac60 con 0x55ebc1681010 2024-06-06T03:31:28.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.552+0000 7f69fb3e9740 10 client.25781 fetch_fsmap finished waiting for FSMap version 32 2024-06-06T03:31:28.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.552+0000 7f69fb3e9740 10 client.25781 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:31:28.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.552+0000 7f69fb3e9740 20 client.25781 populate_metadata read hostname 'smithi050' 2024-06-06T03:31:28.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.552+0000 7f69fb3e9740 1 --2- 172.21.15.50:0/4251286835 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ebc169f540 0x55ebc16a1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:28.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.552+0000 7f69fb3e9740 4 client.25781 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:31:28.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.552+0000 7f69fb3e9740 1 -- 172.21.15.50:0/4251286835 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f69ec09bd10 con 0x55ebc169f540 2024-06-06T03:31:28.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.552+0000 7f69f5b94640 1 --2- 172.21.15.50:0/4251286835 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ebc169f540 0x55ebc16a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:28.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.553+0000 7f69d9ffb640 10 client.25781 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:28.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.553+0000 7f69f5b94640 1 --2- 172.21.15.50:0/4251286835 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ebc169f540 0x55ebc16a1930 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=182d8fafcdb2f354 server_cookie=3b69d7b055fbc04 in_seq=0 out_seq=0 2024-06-06T03:31:28.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.555+0000 7f69d9ffb640 1 -- 172.21.15.50:0/4251286835 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x7f69ec09bd10 con 0x55ebc169f540 2024-06-06T03:31:28.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.555+0000 7f69d9ffb640 10 client.25781 handle_command_reply: tid=0 2024-06-06T03:31:28.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.555+0000 7f69fb3e9740 1 client.25781 shutdown 2024-06-06T03:31:28.557 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.555+0000 7f69fb3e9740 1 -- 172.21.15.50:0/4251286835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ebc1681010 msgr2=0x55ebc168cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:28.557 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.555+0000 7f69fb3e9740 1 --2- 172.21.15.50:0/4251286835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ebc1681010 0x55ebc168cfb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0cd320 tx=0x7f69ec09c4d0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.557 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.555+0000 7f69fb3e9740 1 -- 172.21.15.50:0/4251286835 shutdown_connections 2024-06-06T03:31:28.557 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.555+0000 7f69fb3e9740 1 --2- 172.21.15.50:0/4251286835 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ebc169f540 0x55ebc16a1930 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.557 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.555+0000 7f69fb3e9740 1 --2- 172.21.15.50:0/4251286835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ebc1681a00 0x55ebc168d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.557 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.555+0000 7f69fb3e9740 1 --2- 172.21.15.50:0/4251286835 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc1686b70 0x55ebc1689a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.557 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.555+0000 7f69d9ffb640 0 client.25781 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:28.557 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.555+0000 7f69fb3e9740 1 --2- 172.21.15.50:0/4251286835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ebc1681010 0x55ebc168cfb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.557 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.555+0000 7f69fb3e9740 1 -- 172.21.15.50:0/4251286835 >> 172.21.15.50:0/4251286835 conn(0x55ebc167c680 msgr2=0x55ebc167b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:28.558 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.555+0000 7f69fb3e9740 1 -- 172.21.15.50:0/4251286835 shutdown_connections 2024-06-06T03:31:28.558 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.556+0000 7f69fb3e9740 1 -- 172.21.15.50:0/4251286835 wait complete. 2024-06-06T03:31:28.558 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.556+0000 7f69fb3e9740 20 client.25781 trim_cache size 0 max 16384 2024-06-06T03:31:28.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.587+0000 7f69fb3e9740 1 Processor -- start 2024-06-06T03:31:28.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.587+0000 7f69fb3e9740 1 -- start start 2024-06-06T03:31:28.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.588+0000 7f69fb3e9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc1681010 0x55ebc167f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:28.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.588+0000 7f69fb3e9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ebc1681a00 0x55ebc167f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:28.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.588+0000 7f69fb3e9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ebc1686b70 0x55ebc167fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:28.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.588+0000 7f69f5b94640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ebc1681a00 0x55ebc167f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:28.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.588+0000 7f69f5b94640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ebc1681a00 0x55ebc167f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:33778/0 (socket says 172.21.15.50:33778) 2024-06-06T03:31:28.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.588+0000 7f69f5b94640 1 -- 172.21.15.50:0/1414838434 learned_addr learned my addr 172.21.15.50:0/1414838434 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:28.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.589+0000 7f69f6b96640 1 --2- 172.21.15.50:0/1414838434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ebc1686b70 0x55ebc167fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:28.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.589+0000 7f69fb3e9740 1 -- 172.21.15.50:0/1414838434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f69f01aabb0 con 0x55ebc1686b70 2024-06-06T03:31:28.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.589+0000 7f69fb3e9740 1 -- 172.21.15.50:0/1414838434 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f69f01a8480 con 0x55ebc1681a00 2024-06-06T03:31:28.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.589+0000 7f69fb3e9740 1 -- 172.21.15.50:0/1414838434 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f69f01a62d0 con 0x55ebc1681010 2024-06-06T03:31:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.589+0000 7f69f6395640 1 --2- 172.21.15.50:0/1414838434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc1681010 0x55ebc167f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.589+0000 7f69f5b94640 1 -- 172.21.15.50:0/1414838434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc1681010 msgr2=0x55ebc167f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.589+0000 7f69f5b94640 1 --2- 172.21.15.50:0/1414838434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc1681010 0x55ebc167f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.589+0000 7f69f5b94640 1 -- 172.21.15.50:0/1414838434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ebc1686b70 msgr2=0x55ebc167fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.589+0000 7f69f5b94640 1 --2- 172.21.15.50:0/1414838434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ebc1686b70 0x55ebc167fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.589+0000 7f69f5b94640 1 -- 172.21.15.50:0/1414838434 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebc1680320 con 0x55ebc1681a00 2024-06-06T03:31:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.589+0000 7f69f6395640 1 --2- 172.21.15.50:0/1414838434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc1681010 0x55ebc167f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:31:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.590+0000 7f69f5b94640 1 --2- 172.21.15.50:0/1414838434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ebc1681a00 0x55ebc167f8a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f69e00314e0 tx=0x7f69e0003710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb1e50d57a246186 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.590+0000 7f69dbfff640 1 -- 172.21.15.50:0/1414838434 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e004a070 con 0x55ebc1681a00 2024-06-06T03:31:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.590+0000 7f69dbfff640 1 -- 172.21.15.50:0/1414838434 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f69e0031580 con 0x55ebc1681a00 2024-06-06T03:31:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.590+0000 7f69dbfff640 1 -- 172.21.15.50:0/1414838434 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e0035040 con 0x55ebc1681a00 2024-06-06T03:31:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.592+0000 7f69fb3e9740 1 -- 172.21.15.50:0/1414838434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ebc1681a00 msgr2=0x55ebc167f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.592+0000 7f69fb3e9740 1 --2- 172.21.15.50:0/1414838434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ebc1681a00 0x55ebc167f8a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f69e00314e0 tx=0x7f69e0003710 comp rx=0 tx=0).stop 2024-06-06T03:31:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.592+0000 7f69fb3e9740 1 -- 172.21.15.50:0/1414838434 shutdown_connections 2024-06-06T03:31:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.592+0000 7f69fb3e9740 1 --2- 172.21.15.50:0/1414838434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ebc1686b70 0x55ebc167fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.592+0000 7f69fb3e9740 1 --2- 172.21.15.50:0/1414838434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ebc1681a00 0x55ebc167f8a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.592+0000 7f69fb3e9740 1 --2- 172.21.15.50:0/1414838434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc1681010 0x55ebc167f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.592+0000 7f69fb3e9740 1 -- 172.21.15.50:0/1414838434 >> 172.21.15.50:0/1414838434 conn(0x55ebc167c680 msgr2=0x55ebc1682c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.592+0000 7f69fb3e9740 1 -- 172.21.15.50:0/1414838434 shutdown_connections 2024-06-06T03:31:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.592+0000 7f69fb3e9740 1 -- 172.21.15.50:0/1414838434 wait complete. 2024-06-06T03:31:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.593+0000 7f69fb3e9740 1 -- start start 2024-06-06T03:31:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.593+0000 7f69fb3e9740 1 Processor -- start 2024-06-06T03:31:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.593+0000 7f69fb3e9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ebc1681010 0x55ebc16b0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.594+0000 7f69fb3e9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ebc1681a00 0x55ebc16b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:28.595 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.594+0000 7f69fb3e9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc1686b70 0x55ebc16b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:28.595 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.594+0000 7f69f6395640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ebc1681010 0x55ebc16b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:28.595 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.594+0000 7f69f5b94640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ebc1681a00 0x55ebc16b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:28.595 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.594+0000 7f69f5b94640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ebc1681a00 0x55ebc16b0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44132/0 (socket says 172.21.15.50:44132) 2024-06-06T03:31:28.595 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.594+0000 7f69f6395640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ebc1681010 0x55ebc16b0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:33784/0 (socket says 172.21.15.50:33784) 2024-06-06T03:31:28.595 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.594+0000 7f69f6b96640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc1686b70 0x55ebc16b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:28.595 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.594+0000 7f69f6b96640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc1686b70 0x55ebc16b1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:35918/0 (socket says 172.21.15.50:35918) 2024-06-06T03:31:28.595 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.594+0000 7f69f5b94640 1 -- 172.21.15.50:0/1046359258 learned_addr learned my addr 172.21.15.50:0/1046359258 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:28.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.594+0000 7f69fb3e9740 1 -- 172.21.15.50:0/1046359258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f69f01a6940 con 0x55ebc1681a00 2024-06-06T03:31:28.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.594+0000 7f69fb3e9740 1 -- 172.21.15.50:0/1046359258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f69f01a7db0 con 0x55ebc1681010 2024-06-06T03:31:28.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.594+0000 7f69fb3e9740 1 -- 172.21.15.50:0/1046359258 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f69f01a7010 con 0x55ebc1686b70 2024-06-06T03:31:28.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.594+0000 7f69fb3e9740 10 client.0 _ll_register_callbacks cb 0x7f69ec0b7070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:31:28.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.595+0000 7f69f6395640 1 -- 172.21.15.50:0/1046359258 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc1686b70 msgr2=0x55ebc16b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:28.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.595+0000 7f69f6395640 1 --2- 172.21.15.50:0/1046359258 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc1686b70 0x55ebc16b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.595+0000 7f69f6395640 1 -- 172.21.15.50:0/1046359258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ebc1681a00 msgr2=0x55ebc16b0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:28.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.595+0000 7f69f6395640 1 --2- 172.21.15.50:0/1046359258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ebc1681a00 0x55ebc16b0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.595+0000 7f69f6395640 1 -- 172.21.15.50:0/1046359258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebc16b23b0 con 0x55ebc1681010 2024-06-06T03:31:28.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.595+0000 7f69f6395640 1 --2- 172.21.15.50:0/1046359258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ebc1681010 0x55ebc16b0870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0986e0 tx=0x7f69ec0a4a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca144317c833cb10 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:28.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.595+0000 7f69d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:31:28.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.595+0000 7f69d9ffb640 1 -- 172.21.15.50:0/1046359258 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec0b9040 con 0x55ebc1681010 2024-06-06T03:31:28.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.595+0000 7f69d9ffb640 1 -- 172.21.15.50:0/1046359258 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f69ec09abd0 con 0x55ebc1681010 2024-06-06T03:31:28.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.595+0000 7f69fb3e9740 1 -- 172.21.15.50:0/1046359258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69e0031580 con 0x55ebc1681010 2024-06-06T03:31:28.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.595+0000 7f69d9ffb640 1 -- 172.21.15.50:0/1046359258 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f69ec003b30 con 0x55ebc1681010 2024-06-06T03:31:28.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.596+0000 7f69fb3e9740 10 client.25787 fetch_fsmap learned FSMap version 32 2024-06-06T03:31:28.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.596+0000 7f69fb3e9740 1 -- 172.21.15.50:0/1046359258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ebc16b36a0 con 0x55ebc1681010 2024-06-06T03:31:28.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.596+0000 7f69d9ffb640 1 -- 172.21.15.50:0/1046359258 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f69e0031580 con 0x55ebc1681010 2024-06-06T03:31:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.596+0000 7f69d9ffb640 1 -- 172.21.15.50:0/1046359258 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f69ec097bf0 con 0x55ebc1681010 2024-06-06T03:31:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.596+0000 7f69fb3e9740 10 client.25787 fetch_fsmap finished waiting for FSMap version 32 2024-06-06T03:31:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.596+0000 7f69fb3e9740 10 client.25787 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:31:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.596+0000 7f69fb3e9740 20 client.25787 populate_metadata read hostname 'smithi050' 2024-06-06T03:31:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.596+0000 7f69fb3e9740 1 --2- 172.21.15.50:0/1046359258 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ebc170a190 0x55ebc170c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.596+0000 7f69fb3e9740 4 client.25787 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:31:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.596+0000 7f69fb3e9740 1 -- 172.21.15.50:0/1046359258 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ebc15f7f10 con 0x55ebc170a190 2024-06-06T03:31:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.596+0000 7f69f5b94640 1 --2- 172.21.15.50:0/1046359258 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ebc170a190 0x55ebc170c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.597+0000 7f69f5b94640 1 --2- 172.21.15.50:0/1046359258 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ebc170a190 0x55ebc170c580 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=267133c90a397dd5 server_cookie=21ed361ab141d942 in_seq=0 out_seq=0 2024-06-06T03:31:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.597+0000 7f69d9ffb640 10 client.25787 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:28.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.601+0000 7f69d9ffb640 1 -- 172.21.15.50:0/1046359258 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55ebc15f7f10 con 0x55ebc170a190 2024-06-06T03:31:28.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.601+0000 7f69d9ffb640 10 client.25787 handle_command_reply: tid=0 2024-06-06T03:31:28.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.601+0000 7f69fb3e9740 1 client.25787 shutdown 2024-06-06T03:31:28.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.601+0000 7f69fb3e9740 1 -- 172.21.15.50:0/1046359258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ebc1681010 msgr2=0x55ebc16b0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:28.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.601+0000 7f69fb3e9740 1 --2- 172.21.15.50:0/1046359258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ebc1681010 0x55ebc16b0870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0986e0 tx=0x7f69ec0a4a00 comp rx=0 tx=0).stop 2024-06-06T03:31:28.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.601+0000 7f69fb3e9740 1 -- 172.21.15.50:0/1046359258 shutdown_connections 2024-06-06T03:31:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.601+0000 7f69fb3e9740 1 --2- 172.21.15.50:0/1046359258 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ebc170a190 0x55ebc170c580 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.601+0000 7f69fb3e9740 1 --2- 172.21.15.50:0/1046359258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ebc1681a00 0x55ebc16b0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.601+0000 7f69fb3e9740 1 --2- 172.21.15.50:0/1046359258 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc1686b70 0x55ebc16b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.601+0000 7f69d9ffb640 0 client.25787 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.601+0000 7f69fb3e9740 1 --2- 172.21.15.50:0/1046359258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ebc1681010 0x55ebc16b0870 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.601+0000 7f69fb3e9740 1 -- 172.21.15.50:0/1046359258 >> 172.21.15.50:0/1046359258 conn(0x55ebc167c680 msgr2=0x55ebc167f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.602+0000 7f69fb3e9740 1 -- 172.21.15.50:0/1046359258 shutdown_connections 2024-06-06T03:31:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.602+0000 7f69fb3e9740 1 -- 172.21.15.50:0/1046359258 wait complete. 2024-06-06T03:31:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.603+0000 7f69fb3e9740 20 client.25787 trim_cache size 0 max 16384 2024-06-06T03:31:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:31:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:31:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:31:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.603+0000 7f69f85f9640 1 -- 172.21.15.50:0/746080316 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f69dc0a2c30 msgr2=0x7f69dc0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.604+0000 7f69f85f9640 1 --2- 172.21.15.50:0/746080316 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f69dc0a2c30 0x7f69dc0a50f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f69e8005fd0 tx=0x7f69e80107a0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.604+0000 7f69f85f9640 1 -- 172.21.15.50:0/746080316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69f0100900 msgr2=0x7f69f006ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.604+0000 7f69f85f9640 1 --2- 172.21.15.50:0/746080316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69f0100900 0x7f69f006ad80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00e9c0 tx=0x7f69ec00ee80 comp rx=0 tx=0).stop 2024-06-06T03:31:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.604+0000 7f69f85f9640 1 -- 172.21.15.50:0/746080316 shutdown_connections 2024-06-06T03:31:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.604+0000 7f69f85f9640 1 --2- 172.21.15.50:0/746080316 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f69dc0a2c30 0x7f69dc0a50f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.604+0000 7f69f85f9640 1 --2- 172.21.15.50:0/746080316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f0101af0 0x7f69f019c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.604+0000 7f69f85f9640 1 --2- 172.21.15.50:0/746080316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69f01024b0 0x7f69f019eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.604+0000 7f69f85f9640 1 --2- 172.21.15.50:0/746080316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69f0100900 0x7f69f006ad80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.604+0000 7f69f85f9640 1 -- 172.21.15.50:0/746080316 >> 172.21.15.50:0/746080316 conn(0x7f69f00fbe70 msgr2=0x7f69f0104d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.604+0000 7f69f85f9640 1 -- 172.21.15.50:0/746080316 shutdown_connections 2024-06-06T03:31:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:28.605+0000 7f69f85f9640 1 -- 172.21.15.50:0/746080316 wait complete. 2024-06-06T03:31:29.243 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:29 smithi050 ceph-mon[32421]: pgmap v576: 129 pgs: 129 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 39 MiB/s wr, 630 op/s 2024-06-06T03:31:29.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:29 smithi079 ceph-mon[35478]: pgmap v576: 129 pgs: 129 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 39 MiB/s wr, 630 op/s 2024-06-06T03:31:29.651 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:31:29.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.180+0000 7fb946181700 1 -- 172.21.15.50:0/1401166830 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb940102900 msgr2=0x7fb940100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:29.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.180+0000 7fb946181700 1 --2- 172.21.15.50:0/1401166830 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb940102900 0x7fb940100e30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb930009990 tx=0x7fb930009ca0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.182+0000 7fb946181700 1 -- 172.21.15.50:0/1401166830 shutdown_connections 2024-06-06T03:31:29.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.182+0000 7fb946181700 1 --2- 172.21.15.50:0/1401166830 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb940102900 0x7fb940100e30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.182+0000 7fb946181700 1 --2- 172.21.15.50:0/1401166830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9401063c0 0x7fb9401067a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.182+0000 7fb946181700 1 --2- 172.21.15.50:0/1401166830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb940101f40 0x7fb9401023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.182+0000 7fb946181700 1 -- 172.21.15.50:0/1401166830 >> 172.21.15.50:0/1401166830 conn(0x7fb940076730 msgr2=0x7fb940076b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:29.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.191+0000 7fb946181700 1 -- 172.21.15.50:0/1401166830 shutdown_connections 2024-06-06T03:31:29.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.192+0000 7fb946181700 1 -- 172.21.15.50:0/1401166830 wait complete. 2024-06-06T03:31:29.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.193+0000 7fb946181700 1 Processor -- start 2024-06-06T03:31:29.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.193+0000 7fb946181700 1 -- start start 2024-06-06T03:31:29.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.193+0000 7fb946181700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb940101f40 0x7fb940114240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:29.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.193+0000 7fb946181700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb940102900 0x7fb9401112f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:29.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.193+0000 7fb946181700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb940111830 0x7fb940111cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:29.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.193+0000 7fb946181700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb940114a00 con 0x7fb940102900 2024-06-06T03:31:29.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.193+0000 7fb946181700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb940114880 con 0x7fb940101f40 2024-06-06T03:31:29.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.193+0000 7fb946181700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb940114b80 con 0x7fb940111830 2024-06-06T03:31:29.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.194+0000 7fb93ffff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb940111830 0x7fb940111cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:29.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.194+0000 7fb93ffff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb940111830 0x7fb940111cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:35944/0 (socket says 172.21.15.50:35944) 2024-06-06T03:31:29.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.194+0000 7fb93ffff700 1 -- 172.21.15.50:0/3240188534 learned_addr learned my addr 172.21.15.50:0/3240188534 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:29.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.195+0000 7fb93effd700 1 --2- 172.21.15.50:0/3240188534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb940102900 0x7fb9401112f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:29.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.197+0000 7fb93effd700 1 -- 172.21.15.50:0/3240188534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb940111830 msgr2=0x7fb940111cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:29.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.197+0000 7fb93effd700 1 --2- 172.21.15.50:0/3240188534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb940111830 0x7fb940111cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.197+0000 7fb93effd700 1 -- 172.21.15.50:0/3240188534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb940101f40 msgr2=0x7fb940114240 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-06T03:31:29.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.197+0000 7fb93effd700 1 --2- 172.21.15.50:0/3240188534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb940101f40 0x7fb940114240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.197+0000 7fb93effd700 1 -- 172.21.15.50:0/3240188534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9401a11b0 con 0x7fb940102900 2024-06-06T03:31:29.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.201+0000 7fb93effd700 1 --2- 172.21.15.50:0/3240188534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb940102900 0x7fb9401112f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb93801cb90 tx=0x7fb93801cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:29.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.214+0000 7fb93cff9700 1 -- 172.21.15.50:0/3240188534 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93802a070 con 0x7fb940102900 2024-06-06T03:31:29.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.214+0000 7fb946181700 1 -- 172.21.15.50:0/3240188534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9401a14a0 con 0x7fb940102900 2024-06-06T03:31:29.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.214+0000 7fb946181700 1 -- 172.21.15.50:0/3240188534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9401a19e0 con 0x7fb940102900 2024-06-06T03:31:29.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.214+0000 7fb93cff9700 1 -- 172.21.15.50:0/3240188534 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb93801db90 con 0x7fb940102900 2024-06-06T03:31:29.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.214+0000 7fb93cff9700 1 -- 172.21.15.50:0/3240188534 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9380235a0 con 0x7fb940102900 2024-06-06T03:31:29.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.220+0000 7fb93cff9700 1 -- 172.21.15.50:0/3240188534 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb93802d070 con 0x7fb940102900 2024-06-06T03:31:29.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.222+0000 7fb93cff9700 1 --2- 172.21.15.50:0/3240188534 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb9280a2e30 0x7fb9280a52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:29.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.222+0000 7fb93cff9700 1 -- 172.21.15.50:0/3240188534 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fb9380e0910 con 0x7fb940102900 2024-06-06T03:31:29.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.224+0000 7fb93f7fe700 1 --2- 172.21.15.50:0/3240188534 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb9280a2e30 0x7fb9280a52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:29.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.224+0000 7fb950a04b80 1 Processor -- start 2024-06-06T03:31:29.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.225+0000 7fb950a04b80 1 -- start start 2024-06-06T03:31:29.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.225+0000 7fb950a04b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8eefd9f60 0x55a8eefda340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:29.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.225+0000 7fb950a04b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8eefda880 0x55a8eefd4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:29.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.226+0000 7fb950a04b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8eefd47a0 0x55a8eefd4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:29.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.226+0000 7fb93effd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8eefda880 0x55a8eefd4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:29.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.226+0000 7fb93effd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8eefda880 0x55a8eefd4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:35952/0 (socket says 172.21.15.50:35952) 2024-06-06T03:31:29.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.226+0000 7fb93ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8eefd47a0 0x55a8eefd4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:29.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.226+0000 7fb93effd700 1 -- 172.21.15.50:0/3327393115 learned_addr learned my addr 172.21.15.50:0/3327393115 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:29.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.226+0000 7fb950a04b80 1 -- 172.21.15.50:0/3327393115 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a8eeec6f60 con 0x55a8eefd47a0 2024-06-06T03:31:29.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.226+0000 7fb950a04b80 1 -- 172.21.15.50:0/3327393115 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a8eef25850 con 0x55a8eefd9f60 2024-06-06T03:31:29.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.226+0000 7fb950a04b80 1 -- 172.21.15.50:0/3327393115 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a8eee8d460 con 0x55a8eefda880 2024-06-06T03:31:29.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.227+0000 7fb93effd700 1 -- 172.21.15.50:0/3327393115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8eefd9f60 msgr2=0x55a8eefda340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:31:29.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.227+0000 7fb93effd700 1 --2- 172.21.15.50:0/3327393115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8eefd9f60 0x55a8eefda340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.227+0000 7fb93effd700 1 -- 172.21.15.50:0/3327393115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8eefd47a0 msgr2=0x55a8eefd4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:29.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.227+0000 7fb93effd700 1 --2- 172.21.15.50:0/3327393115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8eefd47a0 0x55a8eefd4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.227+0000 7fb93effd700 1 -- 172.21.15.50:0/3327393115 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8eee748d0 con 0x55a8eefda880 2024-06-06T03:31:29.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.227+0000 7fb93effd700 1 --2- 172.21.15.50:0/3327393115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8eefda880 0x55a8eefd4260 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb938025d60 tx=0x7fb9380a9030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41bc11e1bd84d9b5 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:29.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.228+0000 7fb925ffb700 1 -- 172.21.15.50:0/3327393115 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9380b1140 con 0x55a8eefda880 2024-06-06T03:31:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.228+0000 7fb925ffb700 1 -- 172.21.15.50:0/3327393115 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb9380b5a00 con 0x55a8eefda880 2024-06-06T03:31:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.229+0000 7fb925ffb700 1 -- 172.21.15.50:0/3327393115 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9380b5570 con 0x55a8eefda880 2024-06-06T03:31:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.229+0000 7fb950a04b80 1 -- 172.21.15.50:0/3327393115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8eefda880 msgr2=0x55a8eefd4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.229+0000 7fb950a04b80 1 --2- 172.21.15.50:0/3327393115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8eefda880 0x55a8eefd4260 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb938025d60 tx=0x7fb9380a9030 comp rx=0 tx=0).stop 2024-06-06T03:31:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.229+0000 7fb93f7fe700 1 --2- 172.21.15.50:0/3240188534 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb9280a2e30 0x7fb9280a52f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb94006a480 tx=0x7fb934006c10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.230+0000 7fb950a04b80 1 -- 172.21.15.50:0/3327393115 shutdown_connections 2024-06-06T03:31:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.230+0000 7fb950a04b80 1 --2- 172.21.15.50:0/3327393115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8eefd47a0 0x55a8eefd4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.230+0000 7fb950a04b80 1 --2- 172.21.15.50:0/3327393115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8eefd9f60 0x55a8eefda340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.230+0000 7fb950a04b80 1 --2- 172.21.15.50:0/3327393115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8eefda880 0x55a8eefd4260 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.230+0000 7fb950a04b80 1 -- 172.21.15.50:0/3327393115 >> 172.21.15.50:0/3327393115 conn(0x55a8eef01080 msgr2=0x55a8eefcf220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.233+0000 7fb950a04b80 1 -- 172.21.15.50:0/3327393115 shutdown_connections 2024-06-06T03:31:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.233+0000 7fb950a04b80 1 -- 172.21.15.50:0/3327393115 wait complete. 2024-06-06T03:31:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.233+0000 7fb950a04b80 1 -- start start 2024-06-06T03:31:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.234+0000 7fb950a04b80 1 Processor -- start 2024-06-06T03:31:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.234+0000 7fb950a04b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8eefd47a0 0x55a8eefe05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:29.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.234+0000 7fb950a04b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8eefd9f60 0x55a8eefdd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:29.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.234+0000 7fb950a04b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8eefda880 0x55a8eefdde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:29.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.234+0000 7fb950a04b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a8eeec5fc0 con 0x55a8eefda880 2024-06-06T03:31:29.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.234+0000 7fb950a04b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a8eef21810 con 0x55a8eefd47a0 2024-06-06T03:31:29.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.234+0000 7fb950a04b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a8eefe12b0 con 0x55a8eefd9f60 2024-06-06T03:31:29.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.234+0000 7fb950a04b80 10 client.0 _ll_register_callbacks cb 0x55a8eeebb5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:31:29.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.236+0000 7fb93effd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8eefd9f60 0x55a8eefdd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:29.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.236+0000 7fb93effd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8eefd9f60 0x55a8eefdd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:35960/0 (socket says 172.21.15.50:35960) 2024-06-06T03:31:29.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.236+0000 7fb93effd700 1 -- 172.21.15.50:0/944620067 learned_addr learned my addr 172.21.15.50:0/944620067 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:29.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.236+0000 7fb93ffff700 1 --2- 172.21.15.50:0/944620067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8eefda880 0x55a8eefdde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:29.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.236+0000 7fb93f7fe700 1 --2- 172.21.15.50:0/944620067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8eefd47a0 0x55a8eefe05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:29.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.238+0000 7fb93effd700 1 -- 172.21.15.50:0/944620067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8eefd47a0 msgr2=0x55a8eefe05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:29.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.238+0000 7fb93effd700 1 --2- 172.21.15.50:0/944620067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8eefd47a0 0x55a8eefe05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.238+0000 7fb93effd700 1 -- 172.21.15.50:0/944620067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8eefda880 msgr2=0x55a8eefdde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:29.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.238+0000 7fb93effd700 1 --2- 172.21.15.50:0/944620067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8eefda880 0x55a8eefdde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.238+0000 7fb93effd700 1 -- 172.21.15.50:0/944620067 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8eeeeb750 con 0x55a8eefd9f60 2024-06-06T03:31:29.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.240+0000 7fb93effd700 1 --2- 172.21.15.50:0/944620067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8eefd9f60 0x55a8eefdd8d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb93801d750 tx=0x7fb9380a90a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5de35dcefcbb71bd server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:29.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.240+0000 7fb91effd700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:31:29.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.243+0000 7fb91effd700 1 -- 172.21.15.50:0/944620067 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9380cb020 con 0x55a8eefd9f60 2024-06-06T03:31:29.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.243+0000 7fb950a04b80 1 -- 172.21.15.50:0/944620067 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9380b5a00 con 0x55a8eefd9f60 2024-06-06T03:31:29.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.243+0000 7fb91effd700 1 -- 172.21.15.50:0/944620067 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fb9380b5570 con 0x55a8eefd9f60 2024-06-06T03:31:29.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.243+0000 7fb91effd700 1 -- 172.21.15.50:0/944620067 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb9380b5770 con 0x55a8eefd9f60 2024-06-06T03:31:29.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.243+0000 7fb950a04b80 10 client.25768 fetch_fsmap learned FSMap version 32 2024-06-06T03:31:29.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.243+0000 7fb950a04b80 1 -- 172.21.15.50:0/944620067 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a8eefeba40 con 0x55a8eefd9f60 2024-06-06T03:31:29.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.244+0000 7fb91effd700 1 -- 172.21.15.50:0/944620067 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb9380b5a00 con 0x55a8eefd9f60 2024-06-06T03:31:29.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.244+0000 7fb91effd700 1 -- 172.21.15.50:0/944620067 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7fb9380b22d0 con 0x55a8eefd9f60 2024-06-06T03:31:29.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.244+0000 7fb950a04b80 10 client.25768 fetch_fsmap finished waiting for FSMap version 32 2024-06-06T03:31:29.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.244+0000 7fb950a04b80 10 client.25768 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-06-06T03:31:29.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.244+0000 7fb950a04b80 20 client.25768 populate_metadata read hostname 'smithi050' 2024-06-06T03:31:29.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.244+0000 7fb950a04b80 1 --2- 172.21.15.50:0/944620067 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55a8eefee1a0 0x55a8eeff05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:29.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.244+0000 7fb950a04b80 4 client.25768 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:31:29.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.244+0000 7fb950a04b80 1 -- 172.21.15.50:0/944620067 --> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8eef32d50 con 0x55a8eefee1a0 2024-06-06T03:31:29.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.244+0000 7fb93f7fe700 1 --2- 172.21.15.50:0/944620067 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55a8eefee1a0 0x55a8eeff05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:29.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.245+0000 7fb91effd700 10 client.25768 ms_handle_connect on v2:172.21.15.122:6836/1604366318 2024-06-06T03:31:29.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.245+0000 7fb93f7fe700 1 --2- 172.21.15.50:0/944620067 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55a8eefee1a0 0x55a8eeff05c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1ee6cdc48a03ab4c server_cookie=af030e2c27255d6d in_seq=0 out_seq=0 2024-06-06T03:31:29.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.247+0000 7fb91effd700 1 -- 172.21.15.50:0/944620067 <== mds.1 v2:172.21.15.122:6836/1604366318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55a8eef32d50 con 0x55a8eefee1a0 2024-06-06T03:31:29.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.248+0000 7fb91effd700 10 client.25768 handle_command_reply: tid=0 2024-06-06T03:31:29.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.248+0000 7fb950a04b80 1 client.25768 shutdown 2024-06-06T03:31:29.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.248+0000 7fb950a04b80 1 -- 172.21.15.50:0/944620067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8eefd9f60 msgr2=0x55a8eefdd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:29.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.248+0000 7fb950a04b80 1 --2- 172.21.15.50:0/944620067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8eefd9f60 0x55a8eefdd8d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb93801d750 tx=0x7fb9380a90a0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.248+0000 7fb950a04b80 1 -- 172.21.15.50:0/944620067 shutdown_connections 2024-06-06T03:31:29.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.248+0000 7fb950a04b80 1 --2- 172.21.15.50:0/944620067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8eefda880 0x55a8eefdde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.248+0000 7fb950a04b80 1 --2- 172.21.15.50:0/944620067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8eefd47a0 0x55a8eefe05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.248+0000 7fb950a04b80 1 --2- 172.21.15.50:0/944620067 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55a8eefee1a0 0x55a8eeff05c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.248+0000 7fb950a04b80 1 --2- 172.21.15.50:0/944620067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8eefd9f60 0x55a8eefdd8d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.248+0000 7fb950a04b80 1 -- 172.21.15.50:0/944620067 >> 172.21.15.50:0/944620067 conn(0x55a8eef01080 msgr2=0x55a8eefce700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:29.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.248+0000 7fb91effd700 0 client.25768 ms_handle_reset on v2:172.21.15.122:6836/1604366318 2024-06-06T03:31:29.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.249+0000 7fb950a04b80 1 -- 172.21.15.50:0/944620067 shutdown_connections 2024-06-06T03:31:29.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.249+0000 7fb950a04b80 1 -- 172.21.15.50:0/944620067 wait complete. 2024-06-06T03:31:29.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.249+0000 7fb950a04b80 20 client.25768 trim_cache size 0 max 16384 2024-06-06T03:31:29.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.267+0000 7fb950a04b80 1 Processor -- start 2024-06-06T03:31:29.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.267+0000 7fb950a04b80 1 -- start start 2024-06-06T03:31:29.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.268+0000 7fb950a04b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8eefd47a0 0x55a8eefd4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:29.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.268+0000 7fb950a04b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8eefd9f60 0x55a8eefe0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:29.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.268+0000 7fb950a04b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8eefda880 0x55a8eefd9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:29.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.268+0000 7fb950a04b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb92c011390 con 0x55a8eefd47a0 2024-06-06T03:31:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.268+0000 7fb950a04b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb92c00ec20 con 0x55a8eefda880 2024-06-06T03:31:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.268+0000 7fb950a04b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb92c00ca70 con 0x55a8eefd9f60 2024-06-06T03:31:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.268+0000 7fb93f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8eefd47a0 0x55a8eefd4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.268+0000 7fb93f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8eefd47a0 0x55a8eefd4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44154/0 (socket says 172.21.15.50:44154) 2024-06-06T03:31:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.268+0000 7fb93f7fe700 1 -- 172.21.15.50:0/2516884813 learned_addr learned my addr 172.21.15.50:0/2516884813 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.268+0000 7fb93effd700 1 --2- 172.21.15.50:0/2516884813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8eefd9f60 0x55a8eefe0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.268+0000 7fb93ffff700 1 --2- 172.21.15.50:0/2516884813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8eefda880 0x55a8eefd9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.268+0000 7fb93f7fe700 1 -- 172.21.15.50:0/2516884813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8eefd9f60 msgr2=0x55a8eefe0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.268+0000 7fb93f7fe700 1 --2- 172.21.15.50:0/2516884813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8eefd9f60 0x55a8eefe0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.268+0000 7fb93f7fe700 1 -- 172.21.15.50:0/2516884813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8eefda880 msgr2=0x55a8eefd9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.268+0000 7fb93f7fe700 1 --2- 172.21.15.50:0/2516884813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8eefda880 0x55a8eefd9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.268+0000 7fb93f7fe700 1 -- 172.21.15.50:0/2516884813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8eeff0c20 con 0x55a8eefd47a0 2024-06-06T03:31:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.269+0000 7fb93f7fe700 1 --2- 172.21.15.50:0/2516884813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8eefd47a0 0x55a8eefd4260 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x55a8eeff0e50 tx=0x7fb934012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f015eef4a151d1 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.269+0000 7fb9257fa700 1 -- 172.21.15.50:0/2516884813 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93402e070 con 0x55a8eefd47a0 2024-06-06T03:31:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.269+0000 7fb9257fa700 1 -- 172.21.15.50:0/2516884813 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb934020d90 con 0x55a8eefd47a0 2024-06-06T03:31:29.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.269+0000 7fb9257fa700 1 -- 172.21.15.50:0/2516884813 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb934029cb0 con 0x55a8eefd47a0 2024-06-06T03:31:29.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.270+0000 7fb950a04b80 1 -- 172.21.15.50:0/2516884813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8eefd47a0 msgr2=0x55a8eefd4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:29.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.270+0000 7fb950a04b80 1 --2- 172.21.15.50:0/2516884813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8eefd47a0 0x55a8eefd4260 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x55a8eeff0e50 tx=0x7fb934012000 comp rx=0 tx=0).stop 2024-06-06T03:31:29.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.270+0000 7fb950a04b80 1 -- 172.21.15.50:0/2516884813 shutdown_connections 2024-06-06T03:31:29.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.270+0000 7fb950a04b80 1 --2- 172.21.15.50:0/2516884813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8eefda880 0x55a8eefd9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.270+0000 7fb950a04b80 1 --2- 172.21.15.50:0/2516884813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8eefd47a0 0x55a8eefd4260 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.270+0000 7fb950a04b80 1 --2- 172.21.15.50:0/2516884813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8eefd9f60 0x55a8eefe0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.270+0000 7fb950a04b80 1 -- 172.21.15.50:0/2516884813 >> 172.21.15.50:0/2516884813 conn(0x55a8eef01080 msgr2=0x55a8eefd8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:29.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.270+0000 7fb950a04b80 1 -- 172.21.15.50:0/2516884813 shutdown_connections 2024-06-06T03:31:29.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.270+0000 7fb950a04b80 1 -- 172.21.15.50:0/2516884813 wait complete. 2024-06-06T03:31:29.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.270+0000 7fb950a04b80 1 -- start start 2024-06-06T03:31:29.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.270+0000 7fb950a04b80 1 Processor -- start 2024-06-06T03:31:29.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.271+0000 7fb950a04b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8eefd47a0 0x55a8eefe67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:29.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.271+0000 7fb93f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8eefd47a0 0x55a8eefe67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:29.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.271+0000 7fb93f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8eefd47a0 0x55a8eefe67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44156/0 (socket says 172.21.15.50:44156) 2024-06-06T03:31:29.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.271+0000 7fb950a04b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8eefd9f60 0x55a8eefe6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:29.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.271+0000 7fb93f7fe700 1 -- 172.21.15.50:0/1376793986 learned_addr learned my addr 172.21.15.50:0/1376793986 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:29.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.271+0000 7fb950a04b80 1 --2- 172.21.15.50:0/1376793986 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8eefda880 0x55a8eeff52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:29.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.271+0000 7fb950a04b80 1 -- 172.21.15.50:0/1376793986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb92c00d0e0 con 0x55a8eefd47a0 2024-06-06T03:31:29.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.271+0000 7fb950a04b80 1 -- 172.21.15.50:0/1376793986 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb92c00e550 con 0x55a8eefd9f60 2024-06-06T03:31:29.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.271+0000 7fb950a04b80 1 -- 172.21.15.50:0/1376793986 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb92c00d7b0 con 0x55a8eefda880 2024-06-06T03:31:29.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.271+0000 7fb93effd700 1 --2- 172.21.15.50:0/1376793986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8eefd9f60 0x55a8eefe6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:29.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.271+0000 7fb93ffff700 1 --2- 172.21.15.50:0/1376793986 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8eefda880 0x55a8eeff52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:29.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.271+0000 7fb93f7fe700 1 -- 172.21.15.50:0/1376793986 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8eefda880 msgr2=0x55a8eeff52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:29.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.271+0000 7fb93f7fe700 1 --2- 172.21.15.50:0/1376793986 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8eefda880 0x55a8eeff52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.271+0000 7fb93f7fe700 1 -- 172.21.15.50:0/1376793986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8eefd9f60 msgr2=0x55a8eefe6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:29.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.271+0000 7fb93f7fe700 1 --2- 172.21.15.50:0/1376793986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8eefd9f60 0x55a8eefe6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.271+0000 7fb93f7fe700 1 -- 172.21.15.50:0/1376793986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8eeff5ae0 con 0x55a8eefd47a0 2024-06-06T03:31:29.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.271+0000 7fb950a04b80 10 client.0 _ll_register_callbacks cb 0x55a8eeebb5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:31:29.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.271+0000 7fb93f7fe700 1 --2- 172.21.15.50:0/1376793986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8eefd47a0 0x55a8eefe67f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fb934009fd0 tx=0x7fb934029670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1939ccefdec97e3 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:29.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.271+0000 7fb950a04b80 1 -- 172.21.15.50:0/1376793986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb934020d90 con 0x55a8eefd47a0 2024-06-06T03:31:29.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.271+0000 7fb91effd700 10 client.16170 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:31:29.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.272+0000 7fb91effd700 1 -- 172.21.15.50:0/1376793986 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb934039060 con 0x55a8eefd47a0 2024-06-06T03:31:29.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.272+0000 7fb91effd700 1 -- 172.21.15.50:0/1376793986 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fb934020af0 con 0x55a8eefd47a0 2024-06-06T03:31:29.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.272+0000 7fb91effd700 1 -- 172.21.15.50:0/1376793986 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb93402e070 con 0x55a8eefd47a0 2024-06-06T03:31:29.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.272+0000 7fb950a04b80 10 client.16170 fetch_fsmap learned FSMap version 32 2024-06-06T03:31:29.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.272+0000 7fb950a04b80 1 -- 172.21.15.50:0/1376793986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({fsmap=32}) -- 0x55a8ef0587f0 con 0x55a8eefd47a0 2024-06-06T03:31:29.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.272+0000 7fb91effd700 1 -- 172.21.15.50:0/1376793986 <== mon.0 v2:172.21.15.50:3300/0 4 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7fb934012070 con 0x55a8eefd47a0 2024-06-06T03:31:29.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.272+0000 7fb950a04b80 10 client.16170 fetch_fsmap finished waiting for FSMap version 32 2024-06-06T03:31:29.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.272+0000 7fb950a04b80 10 client.16170 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-06-06T03:31:29.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.272+0000 7fb950a04b80 20 client.16170 populate_metadata read hostname 'smithi050' 2024-06-06T03:31:29.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.272+0000 7fb950a04b80 1 --2- 172.21.15.50:0/1376793986 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55a8ef058df0 0x55a8ef05b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:29.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.272+0000 7fb950a04b80 4 client.16170 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:31:29.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.272+0000 7fb950a04b80 1 -- 172.21.15.50:0/1376793986 --> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a8eef2d2d0 con 0x55a8ef058df0 2024-06-06T03:31:29.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.272+0000 7fb93effd700 1 --2- 172.21.15.50:0/1376793986 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55a8ef058df0 0x55a8ef05b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:29.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.273+0000 7fb93effd700 1 --2- 172.21.15.50:0/1376793986 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55a8ef058df0 0x55a8ef05b230 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=13e51009f76c16f3 server_cookie=8facb403680c326e in_seq=0 out_seq=0 2024-06-06T03:31:29.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.273+0000 7fb91effd700 10 client.16170 ms_handle_connect on v2:172.21.15.122:6836/1604366318 2024-06-06T03:31:29.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.273+0000 7fb91effd700 1 -- 172.21.15.50:0/1376793986 <== mds.1 v2:172.21.15.122:6836/1604366318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a8eef2d2d0 con 0x55a8ef058df0 2024-06-06T03:31:29.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.273+0000 7fb91effd700 10 client.16170 handle_command_reply: tid=0 2024-06-06T03:31:29.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.273+0000 7fb950a04b80 1 client.16170 shutdown 2024-06-06T03:31:29.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.273+0000 7fb950a04b80 1 -- 172.21.15.50:0/1376793986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8eefd47a0 msgr2=0x55a8eefe67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:29.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.273+0000 7fb950a04b80 1 --2- 172.21.15.50:0/1376793986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8eefd47a0 0x55a8eefe67f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fb934009fd0 tx=0x7fb934029670 comp rx=0 tx=0).stop 2024-06-06T03:31:29.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.273+0000 7fb950a04b80 1 -- 172.21.15.50:0/1376793986 shutdown_connections 2024-06-06T03:31:29.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.273+0000 7fb950a04b80 1 --2- 172.21.15.50:0/1376793986 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55a8ef058df0 0x55a8ef05b230 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.273+0000 7fb950a04b80 1 --2- 172.21.15.50:0/1376793986 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a8eefda880 0x55a8eeff52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.273+0000 7fb91effd700 0 client.16170 ms_handle_reset on v2:172.21.15.122:6836/1604366318 2024-06-06T03:31:29.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.273+0000 7fb950a04b80 1 --2- 172.21.15.50:0/1376793986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8eefd47a0 0x55a8eefe67f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.273+0000 7fb950a04b80 1 --2- 172.21.15.50:0/1376793986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8eefd9f60 0x55a8eefe6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.273+0000 7fb950a04b80 1 -- 172.21.15.50:0/1376793986 >> 172.21.15.50:0/1376793986 conn(0x55a8eef01080 msgr2=0x55a8eefd9310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:29.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.274+0000 7fb950a04b80 1 -- 172.21.15.50:0/1376793986 shutdown_connections 2024-06-06T03:31:29.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.274+0000 7fb950a04b80 1 -- 172.21.15.50:0/1376793986 wait complete. 2024-06-06T03:31:29.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.274+0000 7fb950a04b80 20 client.16170 trim_cache size 0 max 16384 2024-06-06T03:31:29.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.274+0000 7fb946181700 1 -- 172.21.15.50:0/3240188534 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb9280a2e30 msgr2=0x7fb9280a52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:29.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.274+0000 7fb946181700 1 --2- 172.21.15.50:0/3240188534 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb9280a2e30 0x7fb9280a52f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb94006a480 tx=0x7fb934006c10 comp rx=0 tx=0).stop 2024-06-06T03:31:29.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.274+0000 7fb946181700 1 -- 172.21.15.50:0/3240188534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb940102900 msgr2=0x7fb9401112f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:29.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.274+0000 7fb946181700 1 --2- 172.21.15.50:0/3240188534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb940102900 0x7fb9401112f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb93801cb90 tx=0x7fb93801cf50 comp rx=0 tx=0).stop 2024-06-06T03:31:29.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.274+0000 7fb946181700 1 -- 172.21.15.50:0/3240188534 shutdown_connections 2024-06-06T03:31:29.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.274+0000 7fb946181700 1 --2- 172.21.15.50:0/3240188534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb940111830 0x7fb940111cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.274+0000 7fb946181700 1 --2- 172.21.15.50:0/3240188534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb940101f40 0x7fb940114240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.274+0000 7fb946181700 1 --2- 172.21.15.50:0/3240188534 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb9280a2e30 0x7fb9280a52f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.274+0000 7fb946181700 1 --2- 172.21.15.50:0/3240188534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb940102900 0x7fb9401112f0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:29.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.274+0000 7fb946181700 1 -- 172.21.15.50:0/3240188534 >> 172.21.15.50:0/3240188534 conn(0x7fb940076730 msgr2=0x7fb9400ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:29.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.275+0000 7fb946181700 1 -- 172.21.15.50:0/3240188534 shutdown_connections 2024-06-06T03:31:29.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:29.275+0000 7fb946181700 1 -- 172.21.15.50:0/3240188534 wait complete. 2024-06-06T03:31:29.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:29 smithi122 ceph-mon[35759]: pgmap v576: 129 pgs: 129 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 39 MiB/s wr, 630 op/s 2024-06-06T03:31:31.482 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:31 smithi122 ceph-mon[35759]: pgmap v577: 129 pgs: 129 active+clean; 10 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 46 MiB/s wr, 752 op/s 2024-06-06T03:31:31.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:31 smithi050 ceph-mon[32421]: pgmap v577: 129 pgs: 129 active+clean; 10 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 46 MiB/s wr, 752 op/s 2024-06-06T03:31:31.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:31 smithi079 ceph-mon[35478]: pgmap v577: 129 pgs: 129 active+clean; 10 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 46 MiB/s wr, 752 op/s 2024-06-06T03:31:32.119 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-06-06T03:31:32.728 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:31:33.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:33 smithi050 ceph-mon[32421]: pgmap v578: 129 pgs: 129 active+clean; 10 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 37 MiB/s wr, 590 op/s 2024-06-06T03:31:33.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:33 smithi079 ceph-mon[35478]: pgmap v578: 129 pgs: 129 active+clean; 10 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 37 MiB/s wr, 590 op/s 2024-06-06T03:31:33.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:33 smithi122 ceph-mon[35759]: pgmap v578: 129 pgs: 129 active+clean; 10 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 37 MiB/s wr, 590 op/s 2024-06-06T03:31:35.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:35 smithi050 ceph-mon[32421]: pgmap v579: 129 pgs: 129 active+clean; 10 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 38 MiB/s wr, 608 op/s 2024-06-06T03:31:35.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:35 smithi079 ceph-mon[35478]: pgmap v579: 129 pgs: 129 active+clean; 10 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 38 MiB/s wr, 608 op/s 2024-06-06T03:31:35.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:35 smithi122 ceph-mon[35759]: pgmap v579: 129 pgs: 129 active+clean; 10 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 38 MiB/s wr, 608 op/s 2024-06-06T03:31:36.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.531+0000 7fd26affd700 1 -- 172.21.15.50:0/2011323614 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25c003c10 con 0x7fd26c1019d0 2024-06-06T03:31:36.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.531+0000 7fd2729e7700 1 -- 172.21.15.50:0/2011323614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd26c1019d0 msgr2=0x7fd26c101db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:36.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.531+0000 7fd2729e7700 1 --2- 172.21.15.50:0/2011323614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd26c1019d0 0x7fd26c101db0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fd25c0099c0 tx=0x7fd25c009cd0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.531+0000 7fd2729e7700 1 -- 172.21.15.50:0/2011323614 shutdown_connections 2024-06-06T03:31:36.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.531+0000 7fd2729e7700 1 --2- 172.21.15.50:0/2011323614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd26c106720 0x7fd26c10e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.531+0000 7fd2729e7700 1 --2- 172.21.15.50:0/2011323614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd26c1019d0 0x7fd26c101db0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.531+0000 7fd2729e7700 1 --2- 172.21.15.50:0/2011323614 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd26c102380 0x7fd26c105ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.531+0000 7fd2729e7700 1 -- 172.21.15.50:0/2011323614 >> 172.21.15.50:0/2011323614 conn(0x7fd26c078340 msgr2=0x7fd26c078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:36.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.540+0000 7fd2729e7700 1 -- 172.21.15.50:0/2011323614 shutdown_connections 2024-06-06T03:31:36.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.540+0000 7fd2729e7700 1 -- 172.21.15.50:0/2011323614 wait complete. 2024-06-06T03:31:36.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.541+0000 7fd2729e7700 1 Processor -- start 2024-06-06T03:31:36.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.542+0000 7fd2729e7700 1 -- start start 2024-06-06T03:31:36.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.542+0000 7fd2729e7700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd26c1019d0 0x7fd26c10a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:36.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.542+0000 7fd2729e7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd26c102380 0x7fd26c10a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:36.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.542+0000 7fd2729e7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd26c106720 0x7fd26c10aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:36.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.542+0000 7fd2729e7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd26c110610 con 0x7fd26c102380 2024-06-06T03:31:36.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.542+0000 7fd2729e7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd26c110490 con 0x7fd26c106720 2024-06-06T03:31:36.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.542+0000 7fd2729e7700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd26c110790 con 0x7fd26c1019d0 2024-06-06T03:31:36.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.543+0000 7fd270f84700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd26c106720 0x7fd26c10aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:36.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.543+0000 7fd270f84700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd26c106720 0x7fd26c10aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:33854/0 (socket says 172.21.15.50:33854) 2024-06-06T03:31:36.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.543+0000 7fd270f84700 1 -- 172.21.15.50:0/1897812908 learned_addr learned my addr 172.21.15.50:0/1897812908 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:36.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.543+0000 7fd270f84700 1 -- 172.21.15.50:0/1897812908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd26c1019d0 msgr2=0x7fd26c10a430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T03:31:36.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.543+0000 7fd270f84700 1 --2- 172.21.15.50:0/1897812908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd26c1019d0 0x7fd26c10a430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.543+0000 7fd270f84700 1 -- 172.21.15.50:0/1897812908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd26c102380 msgr2=0x7fd26c10a970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T03:31:36.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.543+0000 7fd270f84700 1 --2- 172.21.15.50:0/1897812908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd26c102380 0x7fd26c10a970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.544+0000 7fd270f84700 1 -- 172.21.15.50:0/1897812908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd26c06bf60 con 0x7fd26c106720 2024-06-06T03:31:36.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.544+0000 7fd270f84700 1 --2- 172.21.15.50:0/1897812908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd26c106720 0x7fd26c10aeb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd26400b780 tx=0x7fd26400bb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:36.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.544+0000 7fd2697fa700 1 -- 172.21.15.50:0/1897812908 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26400f840 con 0x7fd26c106720 2024-06-06T03:31:36.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.544+0000 7fd2729e7700 1 -- 172.21.15.50:0/1897812908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd26c06c250 con 0x7fd26c106720 2024-06-06T03:31:36.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.544+0000 7fd2729e7700 1 -- 172.21.15.50:0/1897812908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd26c06c790 con 0x7fd26c106720 2024-06-06T03:31:36.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.545+0000 7fd2697fa700 1 -- 172.21.15.50:0/1897812908 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd264017400 con 0x7fd26c106720 2024-06-06T03:31:36.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.545+0000 7fd2697fa700 1 -- 172.21.15.50:0/1897812908 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26400d610 con 0x7fd26c106720 2024-06-06T03:31:36.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.550+0000 7fd2697fa700 1 -- 172.21.15.50:0/1897812908 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd26400d7b0 con 0x7fd26c106720 2024-06-06T03:31:36.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.551+0000 7fd27d26ab80 1 Processor -- start 2024-06-06T03:31:36.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.551+0000 7fd2697fa700 1 --2- 172.21.15.50:0/1897812908 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd2540a2d70 0x7fd2540a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:36.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.551+0000 7fd27d26ab80 1 -- start start 2024-06-06T03:31:36.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.552+0000 7fd2697fa700 1 -- 172.21.15.50:0/1897812908 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fd2640d01e0 con 0x7fd26c106720 2024-06-06T03:31:36.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.552+0000 7fd27d26ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611117ff640 0x5611117ffa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:36.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.552+0000 7fd27d26ab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611117fff60 0x5611117f99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:36.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.552+0000 7fd27d26ab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611117f9f20 0x5611117fa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:36.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.552+0000 7fd27d26ab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56111174b810 con 0x5611117fff60 2024-06-06T03:31:36.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.552+0000 7fd27d26ab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5611116f3720 con 0x5611117ff640 2024-06-06T03:31:36.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.552+0000 7fd27d26ab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5611117477d0 con 0x5611117f9f20 2024-06-06T03:31:36.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.552+0000 7fd270f84700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611117f9f20 0x5611117fa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:36.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.552+0000 7fd270f84700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611117f9f20 0x5611117fa340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:35982/0 (socket says 172.21.15.50:35982) 2024-06-06T03:31:36.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.552+0000 7fd270f84700 1 -- 172.21.15.50:0/2138512336 learned_addr learned my addr 172.21.15.50:0/2138512336 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:36.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.553+0000 7fd26bfff700 1 --2- 172.21.15.50:0/2138512336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611117ff640 0x5611117ffa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:36.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.553+0000 7fd26b7fe700 1 --2- 172.21.15.50:0/1897812908 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd2540a2d70 0x7fd2540a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:36.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.553+0000 7fd26b7fe700 1 --2- 172.21.15.50:0/2138512336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611117fff60 0x5611117f99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:36.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.554+0000 7fd26b7fe700 1 -- 172.21.15.50:0/2138512336 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611117f9f20 msgr2=0x5611117fa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:36.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.554+0000 7fd26b7fe700 1 --2- 172.21.15.50:0/2138512336 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611117f9f20 0x5611117fa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.554+0000 7fd26b7fe700 1 -- 172.21.15.50:0/2138512336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611117ff640 msgr2=0x5611117ffa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:36.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.554+0000 7fd26b7fe700 1 --2- 172.21.15.50:0/2138512336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611117ff640 0x5611117ffa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.554+0000 7fd26b7fe700 1 -- 172.21.15.50:0/2138512336 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611116e9f50 con 0x5611117fff60 2024-06-06T03:31:36.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.554+0000 7fd270f84700 1 --2- 172.21.15.50:0/2138512336 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611117f9f20 0x5611117fa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:31:36.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.554+0000 7fd26bfff700 1 --2- 172.21.15.50:0/2138512336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611117ff640 0x5611117ffa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:31:36.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.554+0000 7fd26b7fe700 1 --2- 172.21.15.50:0/1897812908 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd2540a2d70 0x7fd2540a5230 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd26c10bbf0 tx=0x7fd26000c960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:36.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.554+0000 7fd26b7fe700 1 --2- 172.21.15.50:0/2138512336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611117fff60 0x5611117f99e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fd26c06a9d0 tx=0x7fd26000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce69b3384146da67 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:36.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.555+0000 7fd2527fc700 1 -- 172.21.15.50:0/2138512336 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26001bb40 con 0x5611117fff60 2024-06-06T03:31:36.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.555+0000 7fd2527fc700 1 -- 172.21.15.50:0/2138512336 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd260032070 con 0x5611117fff60 2024-06-06T03:31:36.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.556+0000 7fd27d26ab80 1 -- 172.21.15.50:0/2138512336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611117fff60 msgr2=0x5611117f99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:36.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.556+0000 7fd27d26ab80 1 --2- 172.21.15.50:0/2138512336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611117fff60 0x5611117f99e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fd26c06a9d0 tx=0x7fd26000ef90 comp rx=0 tx=0).stop 2024-06-06T03:31:36.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.558+0000 7fd27d26ab80 1 -- 172.21.15.50:0/2138512336 shutdown_connections 2024-06-06T03:31:36.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.558+0000 7fd27d26ab80 1 --2- 172.21.15.50:0/2138512336 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611117f9f20 0x5611117fa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.558+0000 7fd27d26ab80 1 --2- 172.21.15.50:0/2138512336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611117ff640 0x5611117ffa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.558+0000 7fd27d26ab80 1 --2- 172.21.15.50:0/2138512336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611117fff60 0x5611117f99e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.558+0000 7fd27d26ab80 1 -- 172.21.15.50:0/2138512336 >> 172.21.15.50:0/2138512336 conn(0x561111724cc0 msgr2=0x5611117f4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:36.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.559+0000 7fd27d26ab80 1 -- 172.21.15.50:0/2138512336 shutdown_connections 2024-06-06T03:31:36.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.559+0000 7fd27d26ab80 1 -- 172.21.15.50:0/2138512336 wait complete. 2024-06-06T03:31:36.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.560+0000 7fd27d26ab80 1 -- start start 2024-06-06T03:31:36.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.560+0000 7fd27d26ab80 1 Processor -- start 2024-06-06T03:31:36.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.560+0000 7fd27d26ab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611117f9f20 0x561111805c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:36.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.561+0000 7fd27d26ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611117ff640 0x561111802f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:36.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.561+0000 7fd27d26ab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611117fff60 0x5611118034b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:36.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.561+0000 7fd26bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611117f9f20 0x561111805c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:36.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.561+0000 7fd26bfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611117f9f20 0x561111805c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:35996/0 (socket says 172.21.15.50:35996) 2024-06-06T03:31:36.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.561+0000 7fd270f84700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611117fff60 0x5611118034b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:36.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.561+0000 7fd26bfff700 1 -- 172.21.15.50:0/2994702859 learned_addr learned my addr 172.21.15.50:0/2994702859 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:36.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.561+0000 7fd27d26ab80 1 -- 172.21.15.50:0/2994702859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5611118069c0 con 0x5611117fff60 2024-06-06T03:31:36.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.561+0000 7fd27d26ab80 1 -- 172.21.15.50:0/2994702859 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5611116ebbf0 con 0x5611117ff640 2024-06-06T03:31:36.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.561+0000 7fd27d26ab80 1 -- 172.21.15.50:0/2994702859 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561111806b40 con 0x5611117f9f20 2024-06-06T03:31:36.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.561+0000 7fd26b7fe700 1 --2- 172.21.15.50:0/2994702859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611117ff640 0x561111802f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:36.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.561+0000 7fd27d26ab80 10 client.0 _ll_register_callbacks cb 0x5611116e5920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:31:36.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.562+0000 7fd26bfff700 1 -- 172.21.15.50:0/2994702859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611117ff640 msgr2=0x561111802f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:36.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.562+0000 7fd26bfff700 1 --2- 172.21.15.50:0/2994702859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611117ff640 0x561111802f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.562+0000 7fd26bfff700 1 -- 172.21.15.50:0/2994702859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611117fff60 msgr2=0x5611118034b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:36.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.562+0000 7fd26bfff700 1 --2- 172.21.15.50:0/2994702859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611117fff60 0x5611118034b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.562+0000 7fd26bfff700 1 -- 172.21.15.50:0/2994702859 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56111169a8d0 con 0x5611117f9f20 2024-06-06T03:31:36.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.566+0000 7fd26bfff700 1 --2- 172.21.15.50:0/2994702859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611117f9f20 0x561111805c70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd25c006010 tx=0x7fd25c005330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89a4515d5f24b642 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:36.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.566+0000 7fd24b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:31:36.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.566+0000 7fd24b7fe700 1 -- 172.21.15.50:0/2994702859 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25c00b790 con 0x5611117f9f20 2024-06-06T03:31:36.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.566+0000 7fd27d26ab80 1 -- 172.21.15.50:0/2994702859 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd260032070 con 0x5611117f9f20 2024-06-06T03:31:36.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.566+0000 7fd24b7fe700 1 -- 172.21.15.50:0/2994702859 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fd25c00b930 con 0x5611117f9f20 2024-06-06T03:31:36.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.566+0000 7fd24b7fe700 1 -- 172.21.15.50:0/2994702859 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd25c00bb30 con 0x5611117f9f20 2024-06-06T03:31:36.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.567+0000 7fd27d26ab80 10 client.25780 fetch_fsmap learned FSMap version 32 2024-06-06T03:31:36.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.567+0000 7fd27d26ab80 1 -- 172.21.15.50:0/2994702859 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561111811270 con 0x5611117f9f20 2024-06-06T03:31:36.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.569+0000 7fd24b7fe700 1 -- 172.21.15.50:0/2994702859 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd260032070 con 0x5611117f9f20 2024-06-06T03:31:36.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.570+0000 7fd24b7fe700 1 -- 172.21.15.50:0/2994702859 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7fd25c00fc60 con 0x5611117f9f20 2024-06-06T03:31:36.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.572+0000 7fd27d26ab80 10 client.25780 fetch_fsmap finished waiting for FSMap version 32 2024-06-06T03:31:36.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.572+0000 7fd27d26ab80 10 client.25780 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:31:36.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.572+0000 7fd27d26ab80 20 client.25780 populate_metadata read hostname 'smithi050' 2024-06-06T03:31:36.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.572+0000 7fd27d26ab80 1 --2- 172.21.15.50:0/2994702859 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561111813900 0x561111815d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:36.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.572+0000 7fd27d26ab80 4 client.25780 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:31:36.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.572+0000 7fd27d26ab80 1 -- 172.21.15.50:0/2994702859 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561111758d10 con 0x561111813900 2024-06-06T03:31:36.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.576+0000 7fd26b7fe700 1 --2- 172.21.15.50:0/2994702859 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561111813900 0x561111815d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:36.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.580+0000 7fd26b7fe700 1 --2- 172.21.15.50:0/2994702859 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561111813900 0x561111815d90 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=189862fd96b4b0a8 server_cookie=b9b86ed290088c0a in_seq=0 out_seq=0 2024-06-06T03:31:36.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.580+0000 7fd24b7fe700 10 client.25780 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:36.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.581+0000 7fd24b7fe700 1 -- 172.21.15.50:0/2994702859 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x561111758d10 con 0x561111813900 2024-06-06T03:31:36.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.581+0000 7fd24b7fe700 10 client.25780 handle_command_reply: tid=0 2024-06-06T03:31:36.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.583+0000 7fd27d26ab80 1 client.25780 shutdown 2024-06-06T03:31:36.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.584+0000 7fd27d26ab80 1 -- 172.21.15.50:0/2994702859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611117f9f20 msgr2=0x561111805c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:36.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.584+0000 7fd27d26ab80 1 --2- 172.21.15.50:0/2994702859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611117f9f20 0x561111805c70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd25c006010 tx=0x7fd25c005330 comp rx=0 tx=0).stop 2024-06-06T03:31:36.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.585+0000 7fd27d26ab80 1 -- 172.21.15.50:0/2994702859 shutdown_connections 2024-06-06T03:31:36.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.585+0000 7fd27d26ab80 1 --2- 172.21.15.50:0/2994702859 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561111813900 0x561111815d90 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.585+0000 7fd27d26ab80 1 --2- 172.21.15.50:0/2994702859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611117fff60 0x5611118034b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.585+0000 7fd27d26ab80 1 --2- 172.21.15.50:0/2994702859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611117f9f20 0x561111805c70 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.585+0000 7fd27d26ab80 1 --2- 172.21.15.50:0/2994702859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611117ff640 0x561111802f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.585+0000 7fd27d26ab80 1 -- 172.21.15.50:0/2994702859 >> 172.21.15.50:0/2994702859 conn(0x561111724cc0 msgr2=0x5611117f89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:36.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.585+0000 7fd24b7fe700 0 client.25780 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:36.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.585+0000 7fd27d26ab80 1 -- 172.21.15.50:0/2994702859 shutdown_connections 2024-06-06T03:31:36.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.585+0000 7fd27d26ab80 1 -- 172.21.15.50:0/2994702859 wait complete. 2024-06-06T03:31:36.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.585+0000 7fd27d26ab80 20 client.25780 trim_cache size 0 max 16384 2024-06-06T03:31:36.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.619+0000 7fd27d26ab80 1 Processor -- start 2024-06-06T03:31:36.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.619+0000 7fd27d26ab80 1 -- start start 2024-06-06T03:31:36.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.620+0000 7fd27d26ab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611117f9f20 0x5611117f99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:36.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.620+0000 7fd27d26ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611117ff640 0x561111800380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:36.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.620+0000 7fd27d26ab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611117fff60 0x5611118008c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:36.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.620+0000 7fd27d26ab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd2580112f0 con 0x5611117f9f20 2024-06-06T03:31:36.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.620+0000 7fd27d26ab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd25800eb80 con 0x5611117ff640 2024-06-06T03:31:36.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.620+0000 7fd27d26ab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd25800ca80 con 0x5611117fff60 2024-06-06T03:31:36.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.620+0000 7fd26bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611117f9f20 0x5611117f99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:36.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.620+0000 7fd26b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611117ff640 0x561111800380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:36.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.620+0000 7fd26b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611117ff640 0x561111800380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:33882/0 (socket says 172.21.15.50:33882) 2024-06-06T03:31:36.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.620+0000 7fd26bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611117f9f20 0x5611117f99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44186/0 (socket says 172.21.15.50:44186) 2024-06-06T03:31:36.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.620+0000 7fd26b7fe700 1 -- 172.21.15.50:0/990963237 learned_addr learned my addr 172.21.15.50:0/990963237 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:36.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.620+0000 7fd270f84700 1 --2- 172.21.15.50:0/990963237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611117fff60 0x5611118008c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:36.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.620+0000 7fd26b7fe700 1 -- 172.21.15.50:0/990963237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611117fff60 msgr2=0x5611118008c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:36.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.620+0000 7fd26b7fe700 1 --2- 172.21.15.50:0/990963237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611117fff60 0x5611118008c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.620+0000 7fd26b7fe700 1 -- 172.21.15.50:0/990963237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611117f9f20 msgr2=0x5611117f99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:36.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.620+0000 7fd26b7fe700 1 --2- 172.21.15.50:0/990963237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611117f9f20 0x5611117f99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.621+0000 7fd26b7fe700 1 -- 172.21.15.50:0/990963237 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611118014e0 con 0x5611117ff640 2024-06-06T03:31:36.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.621+0000 7fd26b7fe700 1 --2- 172.21.15.50:0/990963237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611117ff640 0x561111800380 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd26000b290 tx=0x7fd26000a280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ab049416c741ba6 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:36.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.623+0000 7fd251ffb700 1 -- 172.21.15.50:0/990963237 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26001bc40 con 0x5611117ff640 2024-06-06T03:31:36.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.623+0000 7fd251ffb700 1 -- 172.21.15.50:0/990963237 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd260032040 con 0x5611117ff640 2024-06-06T03:31:36.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.623+0000 7fd251ffb700 1 -- 172.21.15.50:0/990963237 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2600043a0 con 0x5611117ff640 2024-06-06T03:31:36.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.624+0000 7fd27d26ab80 1 -- 172.21.15.50:0/990963237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611117ff640 msgr2=0x561111800380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:36.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.624+0000 7fd27d26ab80 1 --2- 172.21.15.50:0/990963237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611117ff640 0x561111800380 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd26000b290 tx=0x7fd26000a280 comp rx=0 tx=0).stop 2024-06-06T03:31:36.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.624+0000 7fd27d26ab80 1 -- 172.21.15.50:0/990963237 shutdown_connections 2024-06-06T03:31:36.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.624+0000 7fd27d26ab80 1 --2- 172.21.15.50:0/990963237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611117fff60 0x5611118008c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.624+0000 7fd27d26ab80 1 --2- 172.21.15.50:0/990963237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611117f9f20 0x5611117f99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.624+0000 7fd27d26ab80 1 --2- 172.21.15.50:0/990963237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611117ff640 0x561111800380 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.624+0000 7fd27d26ab80 1 -- 172.21.15.50:0/990963237 >> 172.21.15.50:0/990963237 conn(0x561111724cc0 msgr2=0x561111801860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:36.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.624+0000 7fd27d26ab80 1 -- 172.21.15.50:0/990963237 shutdown_connections 2024-06-06T03:31:36.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.625+0000 7fd27d26ab80 1 -- 172.21.15.50:0/990963237 wait complete. 2024-06-06T03:31:36.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.625+0000 7fd27d26ab80 1 -- start start 2024-06-06T03:31:36.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.625+0000 7fd27d26ab80 1 Processor -- start 2024-06-06T03:31:36.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.626+0000 7fd27d26ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611117f9f20 0x56111180c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:36.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.626+0000 7fd27d26ab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611117ff640 0x56111180c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:36.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.627+0000 7fd26bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611117f9f20 0x56111180c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:36.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.627+0000 7fd26bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611117f9f20 0x56111180c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:33894/0 (socket says 172.21.15.50:33894) 2024-06-06T03:31:36.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.627+0000 7fd26bfff700 1 -- 172.21.15.50:0/3099218644 learned_addr learned my addr 172.21.15.50:0/3099218644 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:36.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.627+0000 7fd27d26ab80 1 --2- 172.21.15.50:0/3099218644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611117fff60 0x56111181ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:36.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.627+0000 7fd27d26ab80 1 -- 172.21.15.50:0/3099218644 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd25800d040 con 0x5611117ff640 2024-06-06T03:31:36.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.627+0000 7fd27d26ab80 1 -- 172.21.15.50:0/3099218644 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd25800e4b0 con 0x5611117f9f20 2024-06-06T03:31:36.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.627+0000 7fd27d26ab80 1 -- 172.21.15.50:0/3099218644 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd25800d710 con 0x5611117fff60 2024-06-06T03:31:36.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.627+0000 7fd270f84700 1 --2- 172.21.15.50:0/3099218644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611117fff60 0x56111181ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:36.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.627+0000 7fd27d26ab80 10 client.0 _ll_register_callbacks cb 0x5611116e5920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:31:36.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.627+0000 7fd26bfff700 1 -- 172.21.15.50:0/3099218644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611117fff60 msgr2=0x56111181ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:36.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.627+0000 7fd26bfff700 1 --2- 172.21.15.50:0/3099218644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611117fff60 0x56111181ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.627+0000 7fd26bfff700 1 -- 172.21.15.50:0/3099218644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611117ff640 msgr2=0x56111180c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:36.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.627+0000 7fd26bfff700 1 --2- 172.21.15.50:0/3099218644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611117ff640 0x56111180c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.627+0000 7fd26bfff700 1 -- 172.21.15.50:0/3099218644 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56111181b4f0 con 0x5611117f9f20 2024-06-06T03:31:36.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.628+0000 7fd26bfff700 1 --2- 172.21.15.50:0/3099218644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611117f9f20 0x56111180c170 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd25c024620 tx=0x7fd25c024750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce011d0d9e33b233 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:36.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.628+0000 7fd24b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:31:36.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.628+0000 7fd24b7fe700 1 -- 172.21.15.50:0/3099218644 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25c0248a0 con 0x5611117f9f20 2024-06-06T03:31:36.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.628+0000 7fd24b7fe700 1 -- 172.21.15.50:0/3099218644 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fd25c00bcd0 con 0x5611117f9f20 2024-06-06T03:31:36.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.628+0000 7fd27d26ab80 1 -- 172.21.15.50:0/3099218644 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd260032040 con 0x5611117f9f20 2024-06-06T03:31:36.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.629+0000 7fd24b7fe700 1 -- 172.21.15.50:0/3099218644 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd25c00b6b0 con 0x5611117f9f20 2024-06-06T03:31:36.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.629+0000 7fd27d26ab80 10 client.25811 fetch_fsmap learned FSMap version 32 2024-06-06T03:31:36.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.629+0000 7fd27d26ab80 1 -- 172.21.15.50:0/3099218644 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56111187e210 con 0x5611117f9f20 2024-06-06T03:31:36.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.630+0000 7fd24b7fe700 1 -- 172.21.15.50:0/3099218644 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd25c00b850 con 0x5611117f9f20 2024-06-06T03:31:36.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.630+0000 7fd24b7fe700 1 -- 172.21.15.50:0/3099218644 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7fd25c00fac0 con 0x5611117f9f20 2024-06-06T03:31:36.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.631+0000 7fd27d26ab80 10 client.25811 fetch_fsmap finished waiting for FSMap version 32 2024-06-06T03:31:36.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.631+0000 7fd27d26ab80 10 client.25811 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:31:36.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.631+0000 7fd27d26ab80 20 client.25811 populate_metadata read hostname 'smithi050' 2024-06-06T03:31:36.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.631+0000 7fd27d26ab80 1 --2- 172.21.15.50:0/3099218644 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56111187e700 0x561111880b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:36.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.631+0000 7fd27d26ab80 4 client.25811 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:31:36.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.631+0000 7fd27d26ab80 1 -- 172.21.15.50:0/3099218644 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fd260032040 con 0x56111187e700 2024-06-06T03:31:36.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.632+0000 7fd26b7fe700 1 --2- 172.21.15.50:0/3099218644 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56111187e700 0x561111880b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:36.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.636+0000 7fd26b7fe700 1 --2- 172.21.15.50:0/3099218644 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56111187e700 0x561111880b80 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be844432c124a05b server_cookie=f78656d14b46a07 in_seq=0 out_seq=0 2024-06-06T03:31:36.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.636+0000 7fd24b7fe700 10 client.25811 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:36.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.636+0000 7fd24b7fe700 1 -- 172.21.15.50:0/3099218644 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fd260032040 con 0x56111187e700 2024-06-06T03:31:36.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.637+0000 7fd24b7fe700 10 client.25811 handle_command_reply: tid=0 2024-06-06T03:31:36.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.637+0000 7fd27d26ab80 1 client.25811 shutdown 2024-06-06T03:31:36.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.639+0000 7fd27d26ab80 1 -- 172.21.15.50:0/3099218644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611117f9f20 msgr2=0x56111180c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:36.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.639+0000 7fd27d26ab80 1 --2- 172.21.15.50:0/3099218644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611117f9f20 0x56111180c170 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd25c024620 tx=0x7fd25c024750 comp rx=0 tx=0).stop 2024-06-06T03:31:36.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.642+0000 7fd27d26ab80 1 -- 172.21.15.50:0/3099218644 shutdown_connections 2024-06-06T03:31:36.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.642+0000 7fd27d26ab80 1 --2- 172.21.15.50:0/3099218644 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56111187e700 0x561111880b80 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.642+0000 7fd27d26ab80 1 --2- 172.21.15.50:0/3099218644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5611117fff60 0x56111181ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.642+0000 7fd27d26ab80 1 --2- 172.21.15.50:0/3099218644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611117f9f20 0x56111180c170 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.642+0000 7fd27d26ab80 1 --2- 172.21.15.50:0/3099218644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611117ff640 0x56111180c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.642+0000 7fd24b7fe700 0 client.25811 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:36.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.642+0000 7fd27d26ab80 1 -- 172.21.15.50:0/3099218644 >> 172.21.15.50:0/3099218644 conn(0x561111724cc0 msgr2=0x561111800340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:36.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.643+0000 7fd27d26ab80 1 -- 172.21.15.50:0/3099218644 shutdown_connections 2024-06-06T03:31:36.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.643+0000 7fd27d26ab80 1 -- 172.21.15.50:0/3099218644 wait complete. 2024-06-06T03:31:36.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.643+0000 7fd27d26ab80 20 client.25811 trim_cache size 0 max 16384 2024-06-06T03:31:36.645 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:31:36.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.644+0000 7fd2729e7700 1 -- 172.21.15.50:0/1897812908 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd2540a2d70 msgr2=0x7fd2540a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:36.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.644+0000 7fd2729e7700 1 --2- 172.21.15.50:0/1897812908 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd2540a2d70 0x7fd2540a5230 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd26c10bbf0 tx=0x7fd26000c960 comp rx=0 tx=0).stop 2024-06-06T03:31:36.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.644+0000 7fd2729e7700 1 -- 172.21.15.50:0/1897812908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd26c106720 msgr2=0x7fd26c10aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:36.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.644+0000 7fd2729e7700 1 --2- 172.21.15.50:0/1897812908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd26c106720 0x7fd26c10aeb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd26400b780 tx=0x7fd26400bb40 comp rx=0 tx=0).stop 2024-06-06T03:31:36.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.645+0000 7fd2729e7700 1 -- 172.21.15.50:0/1897812908 shutdown_connections 2024-06-06T03:31:36.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.645+0000 7fd2729e7700 1 --2- 172.21.15.50:0/1897812908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd26c106720 0x7fd26c10aeb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.645+0000 7fd2729e7700 1 --2- 172.21.15.50:0/1897812908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd26c1019d0 0x7fd26c10a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.645+0000 7fd2729e7700 1 --2- 172.21.15.50:0/1897812908 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd2540a2d70 0x7fd2540a5230 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.645+0000 7fd2729e7700 1 --2- 172.21.15.50:0/1897812908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd26c102380 0x7fd26c10a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:36.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.645+0000 7fd2729e7700 1 -- 172.21.15.50:0/1897812908 >> 172.21.15.50:0/1897812908 conn(0x7fd26c078340 msgr2=0x7fd26c107870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:36.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.645+0000 7fd2729e7700 1 -- 172.21.15.50:0/1897812908 shutdown_connections 2024-06-06T03:31:36.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:36.645+0000 7fd2729e7700 1 -- 172.21.15.50:0/1897812908 wait complete. 2024-06-06T03:31:37.484 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:37 smithi050 ceph-mon[32421]: pgmap v580: 129 pgs: 129 active+clean; 10 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 46 MiB/s wr, 738 op/s 2024-06-06T03:31:37.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:37 smithi079 ceph-mon[35478]: pgmap v580: 129 pgs: 129 active+clean; 10 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 46 MiB/s wr, 738 op/s 2024-06-06T03:31:37.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:37 smithi122 ceph-mon[35759]: pgmap v580: 129 pgs: 129 active+clean; 10 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 46 MiB/s wr, 738 op/s 2024-06-06T03:31:38.549 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-06T03:31:38.549 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-06-06T03:31:39.209 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:31:39.512 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:39 smithi050 ceph-mon[32421]: pgmap v581: 129 pgs: 129 active+clean; 10 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 39 MiB/s wr, 633 op/s 2024-06-06T03:31:39.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:39 smithi079 ceph-mon[35478]: pgmap v581: 129 pgs: 129 active+clean; 10 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 39 MiB/s wr, 633 op/s 2024-06-06T03:31:39.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:39 smithi122 ceph-mon[35759]: pgmap v581: 129 pgs: 129 active+clean; 10 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 39 MiB/s wr, 633 op/s 2024-06-06T03:31:41.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:41 smithi079 ceph-mon[35478]: pgmap v582: 129 pgs: 129 active+clean; 10 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 48 MiB/s wr, 774 op/s 2024-06-06T03:31:41.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:41 smithi122 ceph-mon[35759]: pgmap v582: 129 pgs: 129 active+clean; 10 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 48 MiB/s wr, 774 op/s 2024-06-06T03:31:41.688 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:41 smithi050 ceph-mon[32421]: pgmap v582: 129 pgs: 129 active+clean; 10 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 48 MiB/s wr, 774 op/s 2024-06-06T03:31:41.816 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.817+0000 7f1b2a04d640 1 -- 172.21.15.50:0/57520844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b24074400 msgr2=0x7f1b24074880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:41.816 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.817+0000 7f1b2a04d640 1 --2- 172.21.15.50:0/57520844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b24074400 0x7f1b24074880 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1b14009930 tx=0x7f1b1402a440 comp rx=0 tx=0).stop 2024-06-06T03:31:41.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.819+0000 7f1b2a04d640 1 -- 172.21.15.50:0/57520844 shutdown_connections 2024-06-06T03:31:41.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.819+0000 7f1b2a04d640 1 --2- 172.21.15.50:0/57520844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b2410de40 0x7f1b24110230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:41.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.819+0000 7f1b2a04d640 1 --2- 172.21.15.50:0/57520844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b24074400 0x7f1b24074880 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:41.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.819+0000 7f1b2a04d640 1 --2- 172.21.15.50:0/57520844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b240759e0 0x7f1b24073e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:41.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.819+0000 7f1b2a04d640 1 -- 172.21.15.50:0/57520844 >> 172.21.15.50:0/57520844 conn(0x7f1b240fce00 msgr2=0x7f1b240ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:41.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.821+0000 7f1b2a04d640 1 -- 172.21.15.50:0/57520844 shutdown_connections 2024-06-06T03:31:41.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.823+0000 7f1b2a04d640 1 -- 172.21.15.50:0/57520844 wait complete. 2024-06-06T03:31:41.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.824+0000 7f1b2a04d640 1 Processor -- start 2024-06-06T03:31:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.825+0000 7f1b2a04d640 1 -- start start 2024-06-06T03:31:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.825+0000 7f1b2a04d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b24074400 0x7f1b24071260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.825+0000 7f1b2a04d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b240759e0 0x7f1b240717a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.825+0000 7f1b2a04d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b2410de40 0x7f1b240727e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.825+0000 7f1b2a04d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2406b750 con 0x7f1b24074400 2024-06-06T03:31:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.825+0000 7f1b2a04d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2406b5d0 con 0x7f1b2410de40 2024-06-06T03:31:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.825+0000 7f1b2a04d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2406b8d0 con 0x7f1b240759e0 2024-06-06T03:31:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.826+0000 7f1b23fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b2410de40 0x7f1b240727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.826+0000 7f1b23fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b2410de40 0x7f1b240727e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:59090/0 (socket says 172.21.15.50:59090) 2024-06-06T03:31:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.826+0000 7f1b23fff640 1 -- 172.21.15.50:0/87361914 learned_addr learned my addr 172.21.15.50:0/87361914 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.826+0000 7f1b237fe640 1 --2- 172.21.15.50:0/87361914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b24074400 0x7f1b24071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:41.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.826+0000 7f1b23fff640 1 -- 172.21.15.50:0/87361914 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b240759e0 msgr2=0x7f1b240717a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T03:31:41.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.826+0000 7f1b23fff640 1 --2- 172.21.15.50:0/87361914 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b240759e0 0x7f1b240717a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:41.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.826+0000 7f1b23fff640 1 -- 172.21.15.50:0/87361914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b24074400 msgr2=0x7f1b24071260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:41.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.826+0000 7f1b23fff640 1 --2- 172.21.15.50:0/87361914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b24074400 0x7f1b24071260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:41.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.826+0000 7f1b23fff640 1 -- 172.21.15.50:0/87361914 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b24072e50 con 0x7f1b2410de40 2024-06-06T03:31:41.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.827+0000 7f1b23fff640 1 --2- 172.21.15.50:0/87361914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b2410de40 0x7f1b240727e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1b1800c970 tx=0x7f1b1800ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:41.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.828+0000 7f1b20ff9640 1 -- 172.21.15.50:0/87361914 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b18007bb0 con 0x7f1b2410de40 2024-06-06T03:31:41.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.828+0000 7f1b2a04d640 1 -- 172.21.15.50:0/87361914 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b24073140 con 0x7f1b2410de40 2024-06-06T03:31:41.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.828+0000 7f1b20ff9640 1 -- 172.21.15.50:0/87361914 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1b18007d50 con 0x7f1b2410de40 2024-06-06T03:31:41.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.828+0000 7f1b2a04d640 1 -- 172.21.15.50:0/87361914 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b24073690 con 0x7f1b2410de40 2024-06-06T03:31:41.828 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.828+0000 7f1b20ff9640 1 -- 172.21.15.50:0/87361914 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b18004e10 con 0x7f1b2410de40 2024-06-06T03:31:41.830 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.832+0000 7f1b2c9fd740 1 Processor -- start 2024-06-06T03:31:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.833+0000 7f1b20ff9640 1 -- 172.21.15.50:0/87361914 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1b18005020 con 0x7f1b2410de40 2024-06-06T03:31:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.834+0000 7f1b20ff9640 1 --2- 172.21.15.50:0/87361914 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f1b0c0a2cc0 0x7f1b0c0a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.834+0000 7f1b20ff9640 1 -- 172.21.15.50:0/87361914 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f1b180cefe0 con 0x7f1b2410de40 2024-06-06T03:31:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.835+0000 7f1b2c9fd740 1 -- start start 2024-06-06T03:31:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.835+0000 7f1b2c9fd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe480a91e0 0x55fe480a9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.835+0000 7f1b2c9fd740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe480a9bd0 0x55fe480ae6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.835+0000 7f1b2c9fd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe480aed40 0x55fe480b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.835+0000 7f1b2c9fd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fe4800c4f0 con 0x55fe480a91e0 2024-06-06T03:31:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.835+0000 7f1b2c9fd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fe47faa870 con 0x55fe480aed40 2024-06-06T03:31:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.835+0000 7f1b2c9fd740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fe480084b0 con 0x55fe480a9bd0 2024-06-06T03:31:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.836+0000 7f1b23fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe480aed40 0x55fe480b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.836+0000 7f1b23fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe480aed40 0x55fe480b11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:59104/0 (socket says 172.21.15.50:59104) 2024-06-06T03:31:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.836+0000 7f1b23fff640 1 -- 172.21.15.50:0/3445700140 learned_addr learned my addr 172.21.15.50:0/3445700140 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.836+0000 7f1b237fe640 1 --2- 172.21.15.50:0/3445700140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe480a91e0 0x55fe480a9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.836+0000 7f1b23fff640 1 -- 172.21.15.50:0/3445700140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe480a9bd0 msgr2=0x55fe480ae6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:31:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.836+0000 7f1b23fff640 1 --2- 172.21.15.50:0/3445700140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe480a9bd0 0x55fe480ae6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.836+0000 7f1b23fff640 1 -- 172.21.15.50:0/3445700140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe480a91e0 msgr2=0x55fe480a9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.836+0000 7f1b23fff640 1 --2- 172.21.15.50:0/3445700140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe480a91e0 0x55fe480a9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.836+0000 7f1b23fff640 1 -- 172.21.15.50:0/3445700140 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe47fc69b0 con 0x55fe480aed40 2024-06-06T03:31:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.837+0000 7f1b23fff640 1 --2- 172.21.15.50:0/3445700140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe480aed40 0x55fe480b11d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1b18097e30 tx=0x7f1b1809bb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69589a8d4ab4880f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.837+0000 7f1b09ffb640 1 -- 172.21.15.50:0/3445700140 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1801d040 con 0x55fe480aed40 2024-06-06T03:31:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.838+0000 7f1b09ffb640 1 -- 172.21.15.50:0/3445700140 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1b180a40d0 con 0x55fe480aed40 2024-06-06T03:31:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.838+0000 7f1b09ffb640 1 -- 172.21.15.50:0/3445700140 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b180cce20 con 0x55fe480aed40 2024-06-06T03:31:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.839+0000 7f1b2c9fd740 1 -- 172.21.15.50:0/3445700140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe480aed40 msgr2=0x55fe480b11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.839+0000 7f1b2c9fd740 1 --2- 172.21.15.50:0/3445700140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe480aed40 0x55fe480b11d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1b18097e30 tx=0x7f1b1809bb60 comp rx=0 tx=0).stop 2024-06-06T03:31:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.839+0000 7f1b2c9fd740 1 -- 172.21.15.50:0/3445700140 shutdown_connections 2024-06-06T03:31:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.839+0000 7f1b2c9fd740 1 --2- 172.21.15.50:0/3445700140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe480aed40 0x55fe480b11d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.839+0000 7f1b2c9fd740 1 --2- 172.21.15.50:0/3445700140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe480a9bd0 0x55fe480ae6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.839+0000 7f1b2c9fd740 1 --2- 172.21.15.50:0/3445700140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe480a91e0 0x55fe480a9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.839+0000 7f1b2c9fd740 1 -- 172.21.15.50:0/3445700140 >> 172.21.15.50:0/3445700140 conn(0x55fe480a4850 msgr2=0x55fe480a4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:41.840 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.842+0000 7f1b22ffd640 1 --2- 172.21.15.50:0/87361914 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f1b0c0a2cc0 0x7f1b0c0a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:41.841 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.842+0000 7f1b2c9fd740 1 -- 172.21.15.50:0/3445700140 shutdown_connections 2024-06-06T03:31:41.843 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.843+0000 7f1b2c9fd740 1 -- 172.21.15.50:0/3445700140 wait complete. 2024-06-06T03:31:41.843 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.844+0000 7f1b2c9fd740 1 -- start start 2024-06-06T03:31:41.843 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.844+0000 7f1b2c9fd740 1 Processor -- start 2024-06-06T03:31:41.844 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.845+0000 7f1b2c9fd740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe480a91e0 0x55fe480b3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:41.844 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.845+0000 7f1b2c9fd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe480aed40 0x55fe480b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:41.844 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.845+0000 7f1b2c9fd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe480b8a80 0x55fe480bae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:41.844 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.845+0000 7f1b2c9fd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fe480b1c30 con 0x55fe480b8a80 2024-06-06T03:31:41.844 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.845+0000 7f1b2c9fd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fe47f95ae0 con 0x55fe480aed40 2024-06-06T03:31:41.844 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.845+0000 7f1b2c9fd740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fe480b1db0 con 0x55fe480a91e0 2024-06-06T03:31:41.844 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.845+0000 7f1b2c9fd740 10 client.0 _ll_register_callbacks cb 0x55fe47fce9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:31:41.844 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.845+0000 7f1b237fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe480a91e0 0x55fe480b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:41.844 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.845+0000 7f1b237fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe480a91e0 0x55fe480b3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:59108/0 (socket says 172.21.15.50:59108) 2024-06-06T03:31:41.844 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.845+0000 7f1b237fe640 1 -- 172.21.15.50:0/3113314019 learned_addr learned my addr 172.21.15.50:0/3113314019 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:41.846 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.845+0000 7f1b237fe640 1 -- 172.21.15.50:0/3113314019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe480aed40 msgr2=0x55fe480b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:41.846 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.845+0000 7f1b237fe640 1 --2- 172.21.15.50:0/3113314019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe480aed40 0x55fe480b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:41.846 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.845+0000 7f1b237fe640 1 -- 172.21.15.50:0/3113314019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe480b8a80 msgr2=0x55fe480bae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:41.846 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.845+0000 7f1b237fe640 1 --2- 172.21.15.50:0/3113314019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe480b8a80 0x55fe480bae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:41.846 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.845+0000 7f1b237fe640 1 -- 172.21.15.50:0/3113314019 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe47d20210 con 0x55fe480a91e0 2024-06-06T03:31:41.846 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.846+0000 7f1b22ffd640 1 --2- 172.21.15.50:0/87361914 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f1b0c0a2cc0 0x7f1b0c0a5180 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55fe480aa090 tx=0x7f1b14005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:41.846 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.846+0000 7f1b237fe640 1 --2- 172.21.15.50:0/3113314019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe480a91e0 0x55fe480b3510 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c00be80 tx=0x7f1b1c007680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d265c5e2e5b7ec8 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:41.846 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.846+0000 7f1b02ffd640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:31:41.846 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.846+0000 7f1b02ffd640 1 -- 172.21.15.50:0/3113314019 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c009e20 con 0x55fe480a91e0 2024-06-06T03:31:41.847 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.847+0000 7f1b2c9fd740 1 -- 172.21.15.50:0/3113314019 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b180a40d0 con 0x55fe480a91e0 2024-06-06T03:31:41.847 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.847+0000 7f1b02ffd640 1 -- 172.21.15.50:0/3113314019 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f1b1c007c30 con 0x55fe480a91e0 2024-06-06T03:31:41.847 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.847+0000 7f1b02ffd640 1 -- 172.21.15.50:0/3113314019 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f1b1c007e30 con 0x55fe480a91e0 2024-06-06T03:31:41.847 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.847+0000 7f1b2c9fd740 10 client.25789 fetch_fsmap learned FSMap version 32 2024-06-06T03:31:41.847 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.847+0000 7f1b2c9fd740 1 -- 172.21.15.50:0/3113314019 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55fe47dec620 con 0x55fe480a91e0 2024-06-06T03:31:41.847 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.848+0000 7f1b02ffd640 1 -- 172.21.15.50:0/3113314019 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1b180a40d0 con 0x55fe480a91e0 2024-06-06T03:31:41.848 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.849+0000 7f1b02ffd640 1 -- 172.21.15.50:0/3113314019 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f1b1c018640 con 0x55fe480a91e0 2024-06-06T03:31:41.848 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.850+0000 7f1b2c9fd740 10 client.25789 fetch_fsmap finished waiting for FSMap version 32 2024-06-06T03:31:41.849 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.850+0000 7f1b2c9fd740 10 client.25789 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:31:41.849 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.850+0000 7f1b2c9fd740 20 client.25789 populate_metadata read hostname 'smithi050' 2024-06-06T03:31:41.849 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.850+0000 7f1b2c9fd740 1 --2- 172.21.15.50:0/3113314019 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fe480bfc90 0x55fe480c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:41.849 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.850+0000 7f1b2c9fd740 4 client.25789 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:31:41.849 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.850+0000 7f1b2c9fd740 1 -- 172.21.15.50:0/3113314019 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe4801ff10 con 0x55fe480bfc90 2024-06-06T03:31:41.849 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.850+0000 7f1b22ffd640 1 --2- 172.21.15.50:0/3113314019 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fe480bfc90 0x55fe480c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:41.850 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.851+0000 7f1b22ffd640 1 --2- 172.21.15.50:0/3113314019 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fe480bfc90 0x55fe480c2130 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c3626c83d81e92d server_cookie=81946e90e97e37ba in_seq=0 out_seq=0 2024-06-06T03:31:41.850 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.851+0000 7f1b02ffd640 10 client.25789 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:41.850 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.851+0000 7f1b02ffd640 1 -- 172.21.15.50:0/3113314019 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55fe4801ff10 con 0x55fe480bfc90 2024-06-06T03:31:41.850 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.851+0000 7f1b02ffd640 10 client.25789 handle_command_reply: tid=0 2024-06-06T03:31:41.850 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.852+0000 7f1b2c9fd740 1 client.25789 shutdown 2024-06-06T03:31:41.852 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.852+0000 7f1b2c9fd740 1 -- 172.21.15.50:0/3113314019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe480a91e0 msgr2=0x55fe480b3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:41.852 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.852+0000 7f1b2c9fd740 1 --2- 172.21.15.50:0/3113314019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe480a91e0 0x55fe480b3510 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c00be80 tx=0x7f1b1c007680 comp rx=0 tx=0).stop 2024-06-06T03:31:41.852 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.853+0000 7f1b2c9fd740 1 -- 172.21.15.50:0/3113314019 shutdown_connections 2024-06-06T03:31:41.852 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.853+0000 7f1b2c9fd740 1 --2- 172.21.15.50:0/3113314019 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fe480bfc90 0x55fe480c2130 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:41.852 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.853+0000 7f1b2c9fd740 1 --2- 172.21.15.50:0/3113314019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe480b8a80 0x55fe480bae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:41.852 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.853+0000 7f1b2c9fd740 1 --2- 172.21.15.50:0/3113314019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe480aed40 0x55fe480b3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:41.852 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.853+0000 7f1b2c9fd740 1 --2- 172.21.15.50:0/3113314019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe480a91e0 0x55fe480b3510 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:41.852 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.853+0000 7f1b2c9fd740 1 -- 172.21.15.50:0/3113314019 >> 172.21.15.50:0/3113314019 conn(0x55fe480a4850 msgr2=0x55fe480a39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.855+0000 7f1b02ffd640 0 client.25789 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.855+0000 7f1b2c9fd740 1 -- 172.21.15.50:0/3113314019 shutdown_connections 2024-06-06T03:31:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.855+0000 7f1b2c9fd740 1 -- 172.21.15.50:0/3113314019 wait complete. 2024-06-06T03:31:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.856+0000 7f1b2c9fd740 20 client.25789 trim_cache size 0 max 16384 2024-06-06T03:31:41.933 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.930+0000 7f1b2c9fd740 1 Processor -- start 2024-06-06T03:31:41.933 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.930+0000 7f1b2c9fd740 1 -- start start 2024-06-06T03:31:41.933 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.930+0000 7f1b2c9fd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe480a91e0 0x55fe480a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:41.933 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.931+0000 7f1b2c9fd740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe480aed40 0x55fe480b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:41.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.931+0000 7f1b2c9fd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe480b8a80 0x55fe480c1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:41.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.931+0000 7f1b2c9fd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1b10012390 con 0x55fe480a91e0 2024-06-06T03:31:41.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.931+0000 7f1b2c9fd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1000fc60 con 0x55fe480b8a80 2024-06-06T03:31:41.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.931+0000 7f1b2c9fd740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1000db60 con 0x55fe480aed40 2024-06-06T03:31:41.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.934+0000 7f1b23fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe480b8a80 0x55fe480c1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:41.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.934+0000 7f1b23fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe480b8a80 0x55fe480c1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:59124/0 (socket says 172.21.15.50:59124) 2024-06-06T03:31:41.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.934+0000 7f1b23fff640 1 -- 172.21.15.50:0/2381882048 learned_addr learned my addr 172.21.15.50:0/2381882048 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:41.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.934+0000 7f1b237fe640 1 --2- 172.21.15.50:0/2381882048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe480a91e0 0x55fe480a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:41.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.934+0000 7f1b22ffd640 1 --2- 172.21.15.50:0/2381882048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe480aed40 0x55fe480b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.935+0000 7f1b237fe640 1 -- 172.21.15.50:0/2381882048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe480aed40 msgr2=0x55fe480b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.935+0000 7f1b237fe640 1 --2- 172.21.15.50:0/2381882048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe480aed40 0x55fe480b37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.935+0000 7f1b237fe640 1 -- 172.21.15.50:0/2381882048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe480b8a80 msgr2=0x55fe480c1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.935+0000 7f1b237fe640 1 --2- 172.21.15.50:0/2381882048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe480b8a80 0x55fe480c1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.935+0000 7f1b237fe640 1 -- 172.21.15.50:0/2381882048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe480a5520 con 0x55fe480a91e0 2024-06-06T03:31:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.936+0000 7f1b237fe640 1 --2- 172.21.15.50:0/2381882048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe480a91e0 0x55fe480a4c30 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c018ca0 tx=0x7f1b1c009b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88bddf60b0334b33 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.936+0000 7f1b097fa640 1 -- 172.21.15.50:0/2381882048 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c007b80 con 0x55fe480a91e0 2024-06-06T03:31:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.936+0000 7f1b097fa640 1 -- 172.21.15.50:0/2381882048 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1b1c011040 con 0x55fe480a91e0 2024-06-06T03:31:41.939 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.939+0000 7f1b097fa640 1 -- 172.21.15.50:0/2381882048 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c0287a0 con 0x55fe480a91e0 2024-06-06T03:31:41.939 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.939+0000 7f1b2c9fd740 1 -- 172.21.15.50:0/2381882048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe480a91e0 msgr2=0x55fe480a4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:41.939 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.939+0000 7f1b2c9fd740 1 --2- 172.21.15.50:0/2381882048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe480a91e0 0x55fe480a4c30 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c018ca0 tx=0x7f1b1c009b10 comp rx=0 tx=0).stop 2024-06-06T03:31:41.939 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.939+0000 7f1b2c9fd740 1 -- 172.21.15.50:0/2381882048 shutdown_connections 2024-06-06T03:31:41.939 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.939+0000 7f1b2c9fd740 1 --2- 172.21.15.50:0/2381882048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe480b8a80 0x55fe480c1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:41.939 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.939+0000 7f1b2c9fd740 1 --2- 172.21.15.50:0/2381882048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe480aed40 0x55fe480b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:41.939 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.939+0000 7f1b2c9fd740 1 --2- 172.21.15.50:0/2381882048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe480a91e0 0x55fe480a4c30 secure :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c018ca0 tx=0x7f1b1c009b10 comp rx=0 tx=0).stop 2024-06-06T03:31:41.939 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.939+0000 7f1b2c9fd740 1 -- 172.21.15.50:0/2381882048 >> 172.21.15.50:0/2381882048 conn(0x55fe480a4850 msgr2=0x55fe4809f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:41.940 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.940+0000 7f1b2c9fd740 1 -- 172.21.15.50:0/2381882048 shutdown_connections 2024-06-06T03:31:41.940 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.940+0000 7f1b2c9fd740 1 -- 172.21.15.50:0/2381882048 wait complete. 2024-06-06T03:31:41.940 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.941+0000 7f1b2c9fd740 1 -- start start 2024-06-06T03:31:41.940 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.941+0000 7f1b2c9fd740 1 Processor -- start 2024-06-06T03:31:41.941 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.942+0000 7f1b2c9fd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe480aed40 0x55fe480d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:41.941 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.942+0000 7f1b2c9fd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe480b8a80 0x55fe480d1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:41.941 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.942+0000 7f1b2c9fd740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe480d40b0 0x55fe48128880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:41.941 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.942+0000 7f1b2c9fd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1000e120 con 0x55fe480b8a80 2024-06-06T03:31:41.941 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.942+0000 7f1b2c9fd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1000f590 con 0x55fe480aed40 2024-06-06T03:31:41.941 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.942+0000 7f1b2c9fd740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1000e7f0 con 0x55fe480d40b0 2024-06-06T03:31:41.941 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.942+0000 7f1b2c9fd740 10 client.0 _ll_register_callbacks cb 0x7f1b1c009b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:31:41.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.942+0000 7f1b237fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe480aed40 0x55fe480d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:41.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.942+0000 7f1b22ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe480b8a80 0x55fe480d1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:41.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.942+0000 7f1b22ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe480b8a80 0x55fe480d1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40428/0 (socket says 172.21.15.50:40428) 2024-06-06T03:31:41.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.942+0000 7f1b22ffd640 1 -- 172.21.15.50:0/2094925639 learned_addr learned my addr 172.21.15.50:0/2094925639 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:41.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.942+0000 7f1b23fff640 1 --2- 172.21.15.50:0/2094925639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe480d40b0 0x55fe48128880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:41.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.943+0000 7f1b23fff640 1 -- 172.21.15.50:0/2094925639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe480aed40 msgr2=0x55fe480d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:41.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.943+0000 7f1b23fff640 1 --2- 172.21.15.50:0/2094925639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe480aed40 0x55fe480d0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:41.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.943+0000 7f1b23fff640 1 -- 172.21.15.50:0/2094925639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe480b8a80 msgr2=0x55fe480d1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:41.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.943+0000 7f1b23fff640 1 --2- 172.21.15.50:0/2094925639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe480b8a80 0x55fe480d1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:41.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.943+0000 7f1b23fff640 1 -- 172.21.15.50:0/2094925639 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe480a4680 con 0x55fe480d40b0 2024-06-06T03:31:41.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.943+0000 7f1b23fff640 1 --2- 172.21.15.50:0/2094925639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe480d40b0 0x55fe48128880 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1b18007590 tx=0x7f1b180a40d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d09c7d29614bd0f8 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:41.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.943+0000 7f1b02ffd640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:31:41.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.943+0000 7f1b02ffd640 1 -- 172.21.15.50:0/2094925639 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1801d040 con 0x55fe480d40b0 2024-06-06T03:31:41.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.944+0000 7f1b02ffd640 1 -- 172.21.15.50:0/2094925639 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f1b180ccbc0 con 0x55fe480d40b0 2024-06-06T03:31:41.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.944+0000 7f1b2c9fd740 1 -- 172.21.15.50:0/2094925639 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b1c011040 con 0x55fe480d40b0 2024-06-06T03:31:41.944 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.944+0000 7f1b02ffd640 1 -- 172.21.15.50:0/2094925639 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f1b180ccdc0 con 0x55fe480d40b0 2024-06-06T03:31:41.944 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.944+0000 7f1b2c9fd740 10 client.25795 fetch_fsmap learned FSMap version 32 2024-06-06T03:31:41.944 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.945+0000 7f1b2c9fd740 1 -- 172.21.15.50:0/2094925639 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55fe48129ed0 con 0x55fe480d40b0 2024-06-06T03:31:41.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.945+0000 7f1b02ffd640 1 -- 172.21.15.50:0/2094925639 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1b180b4170 con 0x55fe480d40b0 2024-06-06T03:31:41.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.946+0000 7f1b02ffd640 1 -- 172.21.15.50:0/2094925639 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f1b1809a8b0 con 0x55fe480d40b0 2024-06-06T03:31:41.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.946+0000 7f1b2c9fd740 10 client.25795 fetch_fsmap finished waiting for FSMap version 32 2024-06-06T03:31:41.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.946+0000 7f1b2c9fd740 10 client.25795 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:31:41.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.946+0000 7f1b2c9fd740 20 client.25795 populate_metadata read hostname 'smithi050' 2024-06-06T03:31:41.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.946+0000 7f1b2c9fd740 1 --2- 172.21.15.50:0/2094925639 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fe4812a420 0x55fe4812c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:41.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.947+0000 7f1b2c9fd740 4 client.25795 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:31:41.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.947+0000 7f1b2c9fd740 1 -- 172.21.15.50:0/2094925639 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f1b1c011040 con 0x55fe4812a420 2024-06-06T03:31:41.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.959+0000 7f1b237fe640 1 --2- 172.21.15.50:0/2094925639 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fe4812a420 0x55fe4812c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:41.973 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.974+0000 7f1b237fe640 1 --2- 172.21.15.50:0/2094925639 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fe4812a420 0x55fe4812c870 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eda899d1f976f45 server_cookie=bed26f8f57ed7ee8 in_seq=0 out_seq=0 2024-06-06T03:31:41.973 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.974+0000 7f1b02ffd640 10 client.25795 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:41.982 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.983+0000 7f1b02ffd640 1 -- 172.21.15.50:0/2094925639 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x7f1b1c011040 con 0x55fe4812a420 2024-06-06T03:31:41.982 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.983+0000 7f1b02ffd640 10 client.25795 handle_command_reply: tid=0 2024-06-06T03:31:41.982 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.983+0000 7f1b2c9fd740 1 client.25795 shutdown 2024-06-06T03:31:41.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.989+0000 7f1b2c9fd740 1 -- 172.21.15.50:0/2094925639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe480d40b0 msgr2=0x55fe48128880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:41.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.989+0000 7f1b2c9fd740 1 --2- 172.21.15.50:0/2094925639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe480d40b0 0x55fe48128880 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1b18007590 tx=0x7f1b180a40d0 comp rx=0 tx=0).stop 2024-06-06T03:31:41.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.993+0000 7f1b2c9fd740 1 -- 172.21.15.50:0/2094925639 shutdown_connections 2024-06-06T03:31:41.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.993+0000 7f1b2c9fd740 1 --2- 172.21.15.50:0/2094925639 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fe4812a420 0x55fe4812c870 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:41.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.993+0000 7f1b02ffd640 0 client.25795 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:41.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.993+0000 7f1b2c9fd740 1 --2- 172.21.15.50:0/2094925639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe480b8a80 0x55fe480d1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:41.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.993+0000 7f1b2c9fd740 1 --2- 172.21.15.50:0/2094925639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe480d40b0 0x55fe48128880 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:41.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.993+0000 7f1b2c9fd740 1 --2- 172.21.15.50:0/2094925639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe480aed40 0x55fe480d0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:41.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.993+0000 7f1b2c9fd740 1 -- 172.21.15.50:0/2094925639 >> 172.21.15.50:0/2094925639 conn(0x55fe480a4850 msgr2=0x55fe4809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:41.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.997+0000 7f1b2c9fd740 1 -- 172.21.15.50:0/2094925639 shutdown_connections 2024-06-06T03:31:41.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.997+0000 7f1b2c9fd740 1 -- 172.21.15.50:0/2094925639 wait complete. 2024-06-06T03:31:41.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:41.997+0000 7f1b2c9fd740 20 client.25795 trim_cache size 0 max 16384 2024-06-06T03:31:41.998 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:31:41.998 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:31:41.998 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:31:42.003 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:42.005+0000 7f1b2a04d640 1 -- 172.21.15.50:0/87361914 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f1b0c0a2cc0 msgr2=0x7f1b0c0a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:42.003 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:42.005+0000 7f1b2a04d640 1 --2- 172.21.15.50:0/87361914 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f1b0c0a2cc0 0x7f1b0c0a5180 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55fe480aa090 tx=0x7f1b14005fd0 comp rx=0 tx=0).stop 2024-06-06T03:31:42.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:42.005+0000 7f1b2a04d640 1 -- 172.21.15.50:0/87361914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b2410de40 msgr2=0x7f1b240727e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:42.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:42.005+0000 7f1b2a04d640 1 --2- 172.21.15.50:0/87361914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b2410de40 0x7f1b240727e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1b1800c970 tx=0x7f1b1800ce30 comp rx=0 tx=0).stop 2024-06-06T03:31:42.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:42.006+0000 7f1b2a04d640 1 -- 172.21.15.50:0/87361914 shutdown_connections 2024-06-06T03:31:42.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:42.006+0000 7f1b2a04d640 1 --2- 172.21.15.50:0/87361914 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f1b0c0a2cc0 0x7f1b0c0a5180 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:42.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:42.006+0000 7f1b2a04d640 1 --2- 172.21.15.50:0/87361914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b2410de40 0x7f1b240727e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:42.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:42.006+0000 7f1b2a04d640 1 --2- 172.21.15.50:0/87361914 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b240759e0 0x7f1b240717a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:42.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:42.006+0000 7f1b2a04d640 1 --2- 172.21.15.50:0/87361914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b24074400 0x7f1b24071260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:42.006+0000 7f1b2a04d640 1 -- 172.21.15.50:0/87361914 >> 172.21.15.50:0/87361914 conn(0x7f1b240fce00 msgr2=0x7f1b241011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:42.006+0000 7f1b2a04d640 1 -- 172.21.15.50:0/87361914 shutdown_connections 2024-06-06T03:31:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:42.006+0000 7f1b2a04d640 1 -- 172.21.15.50:0/87361914 wait complete. 2024-06-06T03:31:43.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.135+0000 7f3c8e534700 1 -- 172.21.15.50:0/14813785 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c881073c0 msgr2=0x7f3c8806a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:43.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.135+0000 7f3c8e534700 1 --2- 172.21.15.50:0/14813785 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c881073c0 0x7f3c8806a1a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3c8000b0a0 tx=0x7f3c8000b3b0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.135+0000 7f3c8e534700 1 -- 172.21.15.50:0/14813785 shutdown_connections 2024-06-06T03:31:43.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.135+0000 7f3c8e534700 1 --2- 172.21.15.50:0/14813785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c88104ed0 0x7f3c88105360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.135+0000 7f3c8e534700 1 --2- 172.21.15.50:0/14813785 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c881073c0 0x7f3c8806a1a0 secure :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3c8000b0a0 tx=0x7f3c8000b3b0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.135+0000 7f3c8e534700 1 --2- 172.21.15.50:0/14813785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c8806a6e0 0x7f3c8806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.135+0000 7f3c8e534700 1 -- 172.21.15.50:0/14813785 >> 172.21.15.50:0/14813785 conn(0x7f3c88078340 msgr2=0x7f3c88078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:43.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.135+0000 7f3c8e534700 1 -- 172.21.15.50:0/14813785 shutdown_connections 2024-06-06T03:31:43.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.135+0000 7f3c8e534700 1 -- 172.21.15.50:0/14813785 wait complete. 2024-06-06T03:31:43.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.136+0000 7f3c8e534700 1 Processor -- start 2024-06-06T03:31:43.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.137+0000 7f3c8e534700 1 -- start start 2024-06-06T03:31:43.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.137+0000 7f3c8e534700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c8806a6e0 0x7f3c88115910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:43.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.137+0000 7f3c8e534700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c88104ed0 0x7f3c8810e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:43.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.137+0000 7f3c8e534700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c8810eee0 0x7f3c8810f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:43.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.137+0000 7f3c8e534700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3c88118da0 con 0x7f3c88104ed0 2024-06-06T03:31:43.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.137+0000 7f3c8e534700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3c88118c20 con 0x7f3c8810eee0 2024-06-06T03:31:43.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.137+0000 7f3c8e534700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3c88118f20 con 0x7f3c8806a6e0 2024-06-06T03:31:43.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.138+0000 7f3c87fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c8806a6e0 0x7f3c88115910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:43.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.138+0000 7f3c877fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c88104ed0 0x7f3c8810e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:43.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.138+0000 7f3c87fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c8806a6e0 0x7f3c88115910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:59140/0 (socket says 172.21.15.50:59140) 2024-06-06T03:31:43.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.138+0000 7f3c87fff700 1 -- 172.21.15.50:0/594084842 learned_addr learned my addr 172.21.15.50:0/594084842 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:43.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.138+0000 7f3c8cad1700 1 --2- 172.21.15.50:0/594084842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c8810eee0 0x7f3c8810f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:43.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.138+0000 7f3c87fff700 1 -- 172.21.15.50:0/594084842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c8810eee0 msgr2=0x7f3c8810f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:43.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.138+0000 7f3c87fff700 1 --2- 172.21.15.50:0/594084842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c8810eee0 0x7f3c8810f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.138+0000 7f3c87fff700 1 -- 172.21.15.50:0/594084842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c88104ed0 msgr2=0x7f3c8810e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:43.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.138+0000 7f3c87fff700 1 --2- 172.21.15.50:0/594084842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c88104ed0 0x7f3c8810e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.138+0000 7f3c87fff700 1 -- 172.21.15.50:0/594084842 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c881134f0 con 0x7f3c8806a6e0 2024-06-06T03:31:43.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.139+0000 7f3c87fff700 1 --2- 172.21.15.50:0/594084842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c8806a6e0 0x7f3c88115910 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3c8000b070 tx=0x7f3c80013be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:43.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.140+0000 7f3c857fa700 1 -- 172.21.15.50:0/594084842 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c80021070 con 0x7f3c8806a6e0 2024-06-06T03:31:43.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.140+0000 7f3c857fa700 1 -- 172.21.15.50:0/594084842 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3c80007e30 con 0x7f3c8806a6e0 2024-06-06T03:31:43.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.140+0000 7f3c857fa700 1 -- 172.21.15.50:0/594084842 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c800059a0 con 0x7f3c8806a6e0 2024-06-06T03:31:43.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.140+0000 7f3c8e534700 1 -- 172.21.15.50:0/594084842 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c88113780 con 0x7f3c8806a6e0 2024-06-06T03:31:43.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.140+0000 7f3c8e534700 1 -- 172.21.15.50:0/594084842 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c88113c10 con 0x7f3c8806a6e0 2024-06-06T03:31:43.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.147+0000 7f3c98db7b80 1 Processor -- start 2024-06-06T03:31:43.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.147+0000 7f3c98db7b80 1 -- start start 2024-06-06T03:31:43.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.147+0000 7f3c98db7b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5604db8810f0 0x5604db8814d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:43.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.147+0000 7f3c98db7b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604db87b2f0 0x5604db87b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:43.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.147+0000 7f3c98db7b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604db87bcb0 0x5604db887e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:43.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.147+0000 7f3c98db7b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5604db75cfe0 con 0x5604db8810f0 2024-06-06T03:31:43.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.147+0000 7f3c98db7b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5604db7bb8d0 con 0x5604db87bcb0 2024-06-06T03:31:43.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.147+0000 7f3c98db7b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5604db7234e0 con 0x5604db87b2f0 2024-06-06T03:31:43.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.148+0000 7f3c877fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604db87bcb0 0x5604db887e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:43.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.148+0000 7f3c877fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604db87bcb0 0x5604db887e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:59164/0 (socket says 172.21.15.50:59164) 2024-06-06T03:31:43.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.148+0000 7f3c877fe700 1 -- 172.21.15.50:0/4098494382 learned_addr learned my addr 172.21.15.50:0/4098494382 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:43.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.148+0000 7f3c8cad1700 1 --2- 172.21.15.50:0/4098494382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5604db8810f0 0x5604db8814d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:43.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.148+0000 7f3c857fa700 1 -- 172.21.15.50:0/594084842 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3c80024070 con 0x7f3c8806a6e0 2024-06-06T03:31:43.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.148+0000 7f3c877fe700 1 -- 172.21.15.50:0/4098494382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604db87b2f0 msgr2=0x5604db87b770 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:31:43.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.148+0000 7f3c877fe700 1 --2- 172.21.15.50:0/4098494382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604db87b2f0 0x5604db87b770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.148+0000 7f3c877fe700 1 -- 172.21.15.50:0/4098494382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5604db8810f0 msgr2=0x5604db8814d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:43.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.148+0000 7f3c877fe700 1 --2- 172.21.15.50:0/4098494382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5604db8810f0 0x5604db8814d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.148+0000 7f3c877fe700 1 -- 172.21.15.50:0/4098494382 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604db70a950 con 0x5604db87bcb0 2024-06-06T03:31:43.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.150+0000 7f3c857fa700 1 --2- 172.21.15.50:0/594084842 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f3c700a2d60 0x7f3c700a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:43.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.150+0000 7f3c857fa700 1 -- 172.21.15.50:0/594084842 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f3c800d00f0 con 0x7f3c8806a6e0 2024-06-06T03:31:43.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.150+0000 7f3c877fe700 1 --2- 172.21.15.50:0/4098494382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604db87bcb0 0x5604db887e90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c0077c0 tx=0x7f3c7c007ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6330e98cb3e51e7 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:43.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.151+0000 7f3c8cad1700 1 --2- 172.21.15.50:0/594084842 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f3c700a2d60 0x7f3c700a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:43.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.151+0000 7f3c6e7fc700 1 -- 172.21.15.50:0/4098494382 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c0125f0 con 0x5604db87bcb0 2024-06-06T03:31:43.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.151+0000 7f3c6e7fc700 1 -- 172.21.15.50:0/4098494382 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3c7c018070 con 0x5604db87bcb0 2024-06-06T03:31:43.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.151+0000 7f3c6e7fc700 1 -- 172.21.15.50:0/4098494382 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c013d50 con 0x5604db87bcb0 2024-06-06T03:31:43.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.152+0000 7f3c8cad1700 1 --2- 172.21.15.50:0/594084842 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f3c700a2d60 0x7f3c700a5220 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3c78006fd0 tx=0x7f3c78008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:43.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.155+0000 7f3c98db7b80 1 -- 172.21.15.50:0/4098494382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604db87bcb0 msgr2=0x5604db887e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:43.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.156+0000 7f3c98db7b80 1 --2- 172.21.15.50:0/4098494382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604db87bcb0 0x5604db887e90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c0077c0 tx=0x7f3c7c007ad0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.157+0000 7f3c98db7b80 1 -- 172.21.15.50:0/4098494382 shutdown_connections 2024-06-06T03:31:43.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.157+0000 7f3c98db7b80 1 --2- 172.21.15.50:0/4098494382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604db87bcb0 0x5604db887e90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.157+0000 7f3c98db7b80 1 --2- 172.21.15.50:0/4098494382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5604db8810f0 0x5604db8814d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.157+0000 7f3c98db7b80 1 --2- 172.21.15.50:0/4098494382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604db87b2f0 0x5604db87b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.157+0000 7f3c98db7b80 1 -- 172.21.15.50:0/4098494382 >> 172.21.15.50:0/4098494382 conn(0x5604db797100 msgr2=0x5604db8652a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:43.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.160+0000 7f3c98db7b80 1 -- 172.21.15.50:0/4098494382 shutdown_connections 2024-06-06T03:31:43.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.160+0000 7f3c98db7b80 1 -- 172.21.15.50:0/4098494382 wait complete. 2024-06-06T03:31:43.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.160+0000 7f3c98db7b80 1 -- start start 2024-06-06T03:31:43.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.161+0000 7f3c98db7b80 1 Processor -- start 2024-06-06T03:31:43.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.161+0000 7f3c98db7b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5604db87b2f0 0x5604db887c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:43.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.161+0000 7f3c98db7b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604db87bcb0 0x5604db884f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:43.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.161+0000 7f3c98db7b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604db8810f0 0x5604db8854a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:43.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.161+0000 7f3c98db7b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5604db75c040 con 0x5604db87b2f0 2024-06-06T03:31:43.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.161+0000 7f3c98db7b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5604db7b7890 con 0x5604db8810f0 2024-06-06T03:31:43.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.161+0000 7f3c98db7b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5604db8883d0 con 0x5604db87bcb0 2024-06-06T03:31:43.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.161+0000 7f3c98db7b80 10 client.0 _ll_register_callbacks cb 0x5604db751630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:31:43.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.162+0000 7f3c87fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5604db87b2f0 0x5604db887c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:43.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.162+0000 7f3c87fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5604db87b2f0 0x5604db887c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40468/0 (socket says 172.21.15.50:40468) 2024-06-06T03:31:43.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.162+0000 7f3c87fff700 1 -- 172.21.15.50:0/3155921291 learned_addr learned my addr 172.21.15.50:0/3155921291 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:43.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.163+0000 7f3c877fe700 1 --2- 172.21.15.50:0/3155921291 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604db87bcb0 0x5604db884f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:43.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.165+0000 7f3c8cad1700 1 --2- 172.21.15.50:0/3155921291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604db8810f0 0x5604db8854a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:43.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.167+0000 7f3c877fe700 1 -- 172.21.15.50:0/3155921291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604db8810f0 msgr2=0x5604db8854a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:43.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.167+0000 7f3c877fe700 1 --2- 172.21.15.50:0/3155921291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604db8810f0 0x5604db8854a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.167+0000 7f3c877fe700 1 -- 172.21.15.50:0/3155921291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5604db87b2f0 msgr2=0x5604db887c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:43.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.167+0000 7f3c877fe700 1 --2- 172.21.15.50:0/3155921291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5604db87b2f0 0x5604db887c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.167+0000 7f3c877fe700 1 -- 172.21.15.50:0/3155921291 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604db7817d0 con 0x5604db87bcb0 2024-06-06T03:31:43.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.168+0000 7f3c877fe700 1 --2- 172.21.15.50:0/3155921291 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604db87bcb0 0x5604db884f60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c0077c0 tx=0x7f3c7c0136b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5f5bf33d9e4af76 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:43.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.168+0000 7f3c677fe700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:31:43.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.168+0000 7f3c677fe700 1 -- 172.21.15.50:0/3155921291 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c013b80 con 0x5604db87bcb0 2024-06-06T03:31:43.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.168+0000 7f3c98db7b80 1 -- 172.21.15.50:0/3155921291 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c7c018070 con 0x5604db87bcb0 2024-06-06T03:31:43.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.169+0000 7f3c677fe700 1 -- 172.21.15.50:0/3155921291 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f3c7c013d20 con 0x5604db87bcb0 2024-06-06T03:31:43.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.169+0000 7f3c677fe700 1 -- 172.21.15.50:0/3155921291 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3c7c030050 con 0x5604db87bcb0 2024-06-06T03:31:43.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.169+0000 7f3c98db7b80 10 client.25804 fetch_fsmap learned FSMap version 32 2024-06-06T03:31:43.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.169+0000 7f3c98db7b80 1 -- 172.21.15.50:0/3155921291 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5604db892b90 con 0x5604db87bcb0 2024-06-06T03:31:43.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.169+0000 7f3c677fe700 1 -- 172.21.15.50:0/3155921291 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3c7c018070 con 0x5604db87bcb0 2024-06-06T03:31:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.169+0000 7f3c677fe700 1 -- 172.21.15.50:0/3155921291 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f3c7c01d630 con 0x5604db87bcb0 2024-06-06T03:31:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.170+0000 7f3c98db7b80 10 client.25804 fetch_fsmap finished waiting for FSMap version 32 2024-06-06T03:31:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.170+0000 7f3c98db7b80 10 client.25804 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:31:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.170+0000 7f3c98db7b80 20 client.25804 populate_metadata read hostname 'smithi050' 2024-06-06T03:31:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.170+0000 7f3c98db7b80 1 --2- 172.21.15.50:0/3155921291 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5604db8953d0 0x5604db897810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.170+0000 7f3c98db7b80 4 client.25804 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:31:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.170+0000 7f3c98db7b80 1 -- 172.21.15.50:0/3155921291 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604db7c8dd0 con 0x5604db8953d0 2024-06-06T03:31:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.170+0000 7f3c87fff700 1 --2- 172.21.15.50:0/3155921291 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5604db8953d0 0x5604db897810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:43.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.173+0000 7f3c87fff700 1 --2- 172.21.15.50:0/3155921291 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5604db8953d0 0x5604db897810 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f59776e3ffa2d7f5 server_cookie=c5f7d43a8b40a3f7 in_seq=0 out_seq=0 2024-06-06T03:31:43.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.173+0000 7f3c677fe700 10 client.25804 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:43.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.174+0000 7f3c677fe700 1 -- 172.21.15.50:0/3155921291 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5604db7c8dd0 con 0x5604db8953d0 2024-06-06T03:31:43.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.174+0000 7f3c677fe700 10 client.25804 handle_command_reply: tid=0 2024-06-06T03:31:43.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.175+0000 7f3c98db7b80 1 client.25804 shutdown 2024-06-06T03:31:43.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.176+0000 7f3c98db7b80 1 -- 172.21.15.50:0/3155921291 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604db87bcb0 msgr2=0x5604db884f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:43.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.176+0000 7f3c98db7b80 1 --2- 172.21.15.50:0/3155921291 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604db87bcb0 0x5604db884f60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c0077c0 tx=0x7f3c7c0136b0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.177+0000 7f3c98db7b80 1 -- 172.21.15.50:0/3155921291 shutdown_connections 2024-06-06T03:31:43.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.177+0000 7f3c98db7b80 1 --2- 172.21.15.50:0/3155921291 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5604db8953d0 0x5604db897810 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.177+0000 7f3c98db7b80 1 --2- 172.21.15.50:0/3155921291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604db8810f0 0x5604db8854a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.177+0000 7f3c98db7b80 1 --2- 172.21.15.50:0/3155921291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5604db87b2f0 0x5604db887c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.177+0000 7f3c98db7b80 1 --2- 172.21.15.50:0/3155921291 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604db87bcb0 0x5604db884f60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.177+0000 7f3c98db7b80 1 -- 172.21.15.50:0/3155921291 >> 172.21.15.50:0/3155921291 conn(0x5604db797100 msgr2=0x5604db864780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:43.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.177+0000 7f3c677fe700 0 client.25804 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:43.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.178+0000 7f3c98db7b80 1 -- 172.21.15.50:0/3155921291 shutdown_connections 2024-06-06T03:31:43.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.178+0000 7f3c98db7b80 1 -- 172.21.15.50:0/3155921291 wait complete. 2024-06-06T03:31:43.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.178+0000 7f3c98db7b80 20 client.25804 trim_cache size 0 max 16384 2024-06-06T03:31:43.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.226+0000 7f3c98db7b80 1 Processor -- start 2024-06-06T03:31:43.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.226+0000 7f3c98db7b80 1 -- start start 2024-06-06T03:31:43.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.227+0000 7f3c98db7b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5604db87b2f0 0x5604db891270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:43.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.227+0000 7f3c98db7b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604db87bcb0 0x5604db87f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:43.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.227+0000 7f3c98db7b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604db8810f0 0x5604db864f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:43.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.227+0000 7f3c98db7b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3c881b7620 con 0x5604db87b2f0 2024-06-06T03:31:43.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.227+0000 7f3c98db7b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3c880742b0 con 0x5604db87bcb0 2024-06-06T03:31:43.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.227+0000 7f3c98db7b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3c88072100 con 0x5604db8810f0 2024-06-06T03:31:43.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.229+0000 7f3c8cad1700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604db8810f0 0x5604db864f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:43.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.229+0000 7f3c8cad1700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604db8810f0 0x5604db864f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:59170/0 (socket says 172.21.15.50:59170) 2024-06-06T03:31:43.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.229+0000 7f3c8cad1700 1 -- 172.21.15.50:0/4001573022 learned_addr learned my addr 172.21.15.50:0/4001573022 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:43.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.230+0000 7f3c877fe700 1 --2- 172.21.15.50:0/4001573022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604db87bcb0 0x5604db87f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:43.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.230+0000 7f3c87fff700 1 --2- 172.21.15.50:0/4001573022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5604db87b2f0 0x5604db891270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:43.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.230+0000 7f3c877fe700 1 -- 172.21.15.50:0/4001573022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604db8810f0 msgr2=0x5604db864f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:43.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.230+0000 7f3c877fe700 1 --2- 172.21.15.50:0/4001573022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604db8810f0 0x5604db864f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.230+0000 7f3c877fe700 1 -- 172.21.15.50:0/4001573022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5604db87b2f0 msgr2=0x5604db891270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:43.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.230+0000 7f3c877fe700 1 --2- 172.21.15.50:0/4001573022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5604db87b2f0 0x5604db891270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.230+0000 7f3c877fe700 1 -- 172.21.15.50:0/4001573022 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604db884290 con 0x5604db87bcb0 2024-06-06T03:31:43.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.232+0000 7f3c877fe700 1 --2- 172.21.15.50:0/4001573022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604db87bcb0 0x5604db87f1f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c01db70 tx=0x7f3c7c007ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=360568b062234f3b server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:43.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.233+0000 7f3c6dffb700 1 -- 172.21.15.50:0/4001573022 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c013d80 con 0x5604db87bcb0 2024-06-06T03:31:43.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.233+0000 7f3c6dffb700 1 -- 172.21.15.50:0/4001573022 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3c7c018040 con 0x5604db87bcb0 2024-06-06T03:31:43.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.233+0000 7f3c6dffb700 1 -- 172.21.15.50:0/4001573022 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c012ce0 con 0x5604db87bcb0 2024-06-06T03:31:43.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.235+0000 7f3c98db7b80 1 -- 172.21.15.50:0/4001573022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604db87bcb0 msgr2=0x5604db87f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:43.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.236+0000 7f3c98db7b80 1 --2- 172.21.15.50:0/4001573022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604db87bcb0 0x5604db87f1f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c01db70 tx=0x7f3c7c007ed0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.236+0000 7f3c98db7b80 1 -- 172.21.15.50:0/4001573022 shutdown_connections 2024-06-06T03:31:43.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.236+0000 7f3c98db7b80 1 --2- 172.21.15.50:0/4001573022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604db8810f0 0x5604db864f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.236+0000 7f3c98db7b80 1 --2- 172.21.15.50:0/4001573022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5604db87b2f0 0x5604db891270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.236+0000 7f3c98db7b80 1 --2- 172.21.15.50:0/4001573022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604db87bcb0 0x5604db87f1f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.236+0000 7f3c98db7b80 1 -- 172.21.15.50:0/4001573022 >> 172.21.15.50:0/4001573022 conn(0x5604db797100 msgr2=0x5604db87eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:43.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.237+0000 7f3c98db7b80 1 -- 172.21.15.50:0/4001573022 shutdown_connections 2024-06-06T03:31:43.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.240+0000 7f3c98db7b80 1 -- 172.21.15.50:0/4001573022 wait complete. 2024-06-06T03:31:43.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.240+0000 7f3c98db7b80 1 -- start start 2024-06-06T03:31:43.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.241+0000 7f3c98db7b80 1 Processor -- start 2024-06-06T03:31:43.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.241+0000 7f3c98db7b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604db87b2f0 0x5604db88d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:43.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.242+0000 7f3c98db7b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604db87bcb0 0x5604db88dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:43.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.242+0000 7f3c98db7b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5604db8810f0 0x5604db89c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:43.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.242+0000 7f3c98db7b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3c88072770 con 0x5604db8810f0 2024-06-06T03:31:43.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.242+0000 7f3c98db7b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3c88073be0 con 0x5604db87bcb0 2024-06-06T03:31:43.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.242+0000 7f3c98db7b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3c88072e40 con 0x5604db87b2f0 2024-06-06T03:31:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.242+0000 7f3c98db7b80 10 client.0 _ll_register_callbacks cb 0x5604db751630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:31:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.242+0000 7f3c877fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604db87bcb0 0x5604db88dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.242+0000 7f3c87fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604db87b2f0 0x5604db88d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.242+0000 7f3c877fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604db87bcb0 0x5604db88dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:59188/0 (socket says 172.21.15.50:59188) 2024-06-06T03:31:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.242+0000 7f3c877fe700 1 -- 172.21.15.50:0/517936458 learned_addr learned my addr 172.21.15.50:0/517936458 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.242+0000 7f3c8cad1700 1 --2- 172.21.15.50:0/517936458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5604db8810f0 0x5604db89c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.243+0000 7f3c8cad1700 1 -- 172.21.15.50:0/517936458 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604db87b2f0 msgr2=0x5604db88d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.243+0000 7f3c8cad1700 1 --2- 172.21.15.50:0/517936458 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604db87b2f0 0x5604db88d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.243+0000 7f3c8cad1700 1 -- 172.21.15.50:0/517936458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604db87bcb0 msgr2=0x5604db88dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.243+0000 7f3c8cad1700 1 --2- 172.21.15.50:0/517936458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604db87bcb0 0x5604db88dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.243+0000 7f3c8cad1700 1 -- 172.21.15.50:0/517936458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604db89d100 con 0x5604db8810f0 2024-06-06T03:31:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.244+0000 7f3c8cad1700 1 --2- 172.21.15.50:0/517936458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5604db8810f0 0x5604db89c8c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x5604db892020 tx=0x7f3c78004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e24e9439a0aa0d3 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.244+0000 7f3c677fe700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:31:43.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.245+0000 7f3c677fe700 1 -- 172.21.15.50:0/517936458 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c78026070 con 0x5604db8810f0 2024-06-06T03:31:43.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.245+0000 7f3c677fe700 1 -- 172.21.15.50:0/517936458 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f3c78014cd0 con 0x5604db8810f0 2024-06-06T03:31:43.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.245+0000 7f3c98db7b80 1 -- 172.21.15.50:0/517936458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c7c018040 con 0x5604db8810f0 2024-06-06T03:31:43.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.246+0000 7f3c677fe700 1 -- 172.21.15.50:0/517936458 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3c78030050 con 0x5604db8810f0 2024-06-06T03:31:43.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.247+0000 7f3c98db7b80 10 client.16206 fetch_fsmap learned FSMap version 32 2024-06-06T03:31:43.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.247+0000 7f3c98db7b80 1 -- 172.21.15.50:0/517936458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5604db8ffe20 con 0x5604db8810f0 2024-06-06T03:31:43.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.249+0000 7f3c677fe700 1 -- 172.21.15.50:0/517936458 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3c78022910 con 0x5604db8810f0 2024-06-06T03:31:43.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.249+0000 7f3c677fe700 1 -- 172.21.15.50:0/517936458 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f3c7802b680 con 0x5604db8810f0 2024-06-06T03:31:43.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.249+0000 7f3c98db7b80 10 client.16206 fetch_fsmap finished waiting for FSMap version 32 2024-06-06T03:31:43.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.249+0000 7f3c98db7b80 10 client.16206 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:31:43.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.249+0000 7f3c98db7b80 20 client.16206 populate_metadata read hostname 'smithi050' 2024-06-06T03:31:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.249+0000 7f3c98db7b80 1 --2- 172.21.15.50:0/517936458 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5604db900590 0x5604db9029b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.249+0000 7f3c98db7b80 4 client.16206 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-06T03:31:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.249+0000 7f3c98db7b80 1 -- 172.21.15.50:0/517936458 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f3c7c018040 con 0x5604db900590 2024-06-06T03:31:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.250+0000 7f3c87fff700 1 --2- 172.21.15.50:0/517936458 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5604db900590 0x5604db9029b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:43.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.251+0000 7f3c87fff700 1 --2- 172.21.15.50:0/517936458 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5604db900590 0x5604db9029b0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbc531482f3b2641 server_cookie=30a806a90bfb1d0f in_seq=0 out_seq=0 2024-06-06T03:31:43.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.251+0000 7f3c677fe700 10 client.16206 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:43.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.252+0000 7f3c677fe700 1 -- 172.21.15.50:0/517936458 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f3c7c018040 con 0x5604db900590 2024-06-06T03:31:43.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.252+0000 7f3c677fe700 10 client.16206 handle_command_reply: tid=0 2024-06-06T03:31:43.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.253+0000 7f3c98db7b80 1 client.16206 shutdown 2024-06-06T03:31:43.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.254+0000 7f3c98db7b80 1 -- 172.21.15.50:0/517936458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5604db8810f0 msgr2=0x5604db89c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:43.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.254+0000 7f3c98db7b80 1 --2- 172.21.15.50:0/517936458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5604db8810f0 0x5604db89c8c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x5604db892020 tx=0x7f3c78004750 comp rx=0 tx=0).stop 2024-06-06T03:31:43.260 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:31:43.260 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-06-06T03:31:43.260 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "9c45df6a-0054-4df4-a7ea-751fb6428e01", 2024-06-06T03:31:43.261 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-06-06T03:31:43.261 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:31:43.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.256+0000 7f3c98db7b80 1 -- 172.21.15.50:0/517936458 shutdown_connections 2024-06-06T03:31:43.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.256+0000 7f3c98db7b80 1 --2- 172.21.15.50:0/517936458 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5604db900590 0x5604db9029b0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.256+0000 7f3c98db7b80 1 --2- 172.21.15.50:0/517936458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5604db8810f0 0x5604db89c8c0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.256+0000 7f3c677fe700 0 client.16206 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:43.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.256+0000 7f3c98db7b80 1 --2- 172.21.15.50:0/517936458 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604db87b2f0 0x5604db88d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.256+0000 7f3c98db7b80 1 --2- 172.21.15.50:0/517936458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604db87bcb0 0x5604db88dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.256+0000 7f3c98db7b80 1 -- 172.21.15.50:0/517936458 >> 172.21.15.50:0/517936458 conn(0x5604db797100 msgr2=0x5604db87f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:43.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.257+0000 7f3c98db7b80 1 -- 172.21.15.50:0/517936458 shutdown_connections 2024-06-06T03:31:43.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.257+0000 7f3c98db7b80 1 -- 172.21.15.50:0/517936458 wait complete. 2024-06-06T03:31:43.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.257+0000 7f3c98db7b80 20 client.16206 trim_cache size 0 max 16384 2024-06-06T03:31:43.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.259+0000 7f3c8e534700 1 -- 172.21.15.50:0/594084842 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f3c700a2d60 msgr2=0x7f3c700a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:43.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.259+0000 7f3c8e534700 1 --2- 172.21.15.50:0/594084842 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f3c700a2d60 0x7f3c700a5220 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3c78006fd0 tx=0x7f3c78008040 comp rx=0 tx=0).stop 2024-06-06T03:31:43.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.259+0000 7f3c8e534700 1 -- 172.21.15.50:0/594084842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c8806a6e0 msgr2=0x7f3c88115910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:43.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.259+0000 7f3c8e534700 1 --2- 172.21.15.50:0/594084842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c8806a6e0 0x7f3c88115910 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3c8000b070 tx=0x7f3c80013be0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.261+0000 7f3c8e534700 1 -- 172.21.15.50:0/594084842 shutdown_connections 2024-06-06T03:31:43.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.261+0000 7f3c8e534700 1 --2- 172.21.15.50:0/594084842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c8810eee0 0x7f3c8810f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.261+0000 7f3c8e534700 1 --2- 172.21.15.50:0/594084842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c8806a6e0 0x7f3c88115910 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.261+0000 7f3c8e534700 1 --2- 172.21.15.50:0/594084842 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f3c700a2d60 0x7f3c700a5220 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.261+0000 7f3c8e534700 1 --2- 172.21.15.50:0/594084842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c88104ed0 0x7f3c8810e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:43.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.261+0000 7f3c8e534700 1 -- 172.21.15.50:0/594084842 >> 172.21.15.50:0/594084842 conn(0x7f3c88078340 msgr2=0x7f3c88100380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:43.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.264+0000 7f3c8e534700 1 -- 172.21.15.50:0/594084842 shutdown_connections 2024-06-06T03:31:43.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:43.268+0000 7f3c8e534700 1 -- 172.21.15.50:0/594084842 wait complete. 2024-06-06T03:31:43.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:43 smithi050 ceph-mon[32421]: pgmap v583: 129 pgs: 129 active+clean; 10 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 40 MiB/s wr, 639 op/s 2024-06-06T03:31:43.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:43 smithi079 ceph-mon[35478]: pgmap v583: 129 pgs: 129 active+clean; 10 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 40 MiB/s wr, 639 op/s 2024-06-06T03:31:43.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:43 smithi122 ceph-mon[35759]: pgmap v583: 129 pgs: 129 active+clean; 10 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 40 MiB/s wr, 639 op/s 2024-06-06T03:31:44.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:44 smithi079 ceph-mon[35478]: scrub queued for path: / 2024-06-06T03:31:44.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:44 smithi079 ceph-mon[35478]: scrub summary: idle+waiting paths [/] 2024-06-06T03:31:44.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:44 smithi079 ceph-mon[35478]: scrub summary: active paths [/] 2024-06-06T03:31:44.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:44 smithi079 ceph-mon[35478]: scrub summary: active paths [/] 2024-06-06T03:31:44.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:44 smithi079 ceph-mon[35478]: scrub summary: idle+waiting paths [/] 2024-06-06T03:31:44.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:44 smithi079 ceph-mon[35478]: scrub summary: idle+waiting paths [/] 2024-06-06T03:31:44.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:44 smithi122 ceph-mon[35759]: scrub queued for path: / 2024-06-06T03:31:44.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:44 smithi122 ceph-mon[35759]: scrub summary: idle+waiting paths [/] 2024-06-06T03:31:44.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:44 smithi122 ceph-mon[35759]: scrub summary: active paths [/] 2024-06-06T03:31:44.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:44 smithi122 ceph-mon[35759]: scrub summary: active paths [/] 2024-06-06T03:31:44.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:44 smithi122 ceph-mon[35759]: scrub summary: idle+waiting paths [/] 2024-06-06T03:31:44.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:44 smithi122 ceph-mon[35759]: scrub summary: idle+waiting paths [/] 2024-06-06T03:31:44.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:44 smithi050 ceph-mon[32421]: scrub queued for path: / 2024-06-06T03:31:44.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:44 smithi050 ceph-mon[32421]: scrub summary: idle+waiting paths [/] 2024-06-06T03:31:44.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:44 smithi050 ceph-mon[32421]: scrub summary: active paths [/] 2024-06-06T03:31:44.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:44 smithi050 ceph-mon[32421]: scrub summary: active paths [/] 2024-06-06T03:31:44.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:44 smithi050 ceph-mon[32421]: scrub summary: idle+waiting paths [/] 2024-06-06T03:31:44.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:44 smithi050 ceph-mon[32421]: scrub summary: idle+waiting paths [/] 2024-06-06T03:31:45.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:45 smithi079 ceph-mon[35478]: pgmap v584: 129 pgs: 129 active+clean; 10 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 41 MiB/s wr, 660 op/s 2024-06-06T03:31:45.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:45 smithi122 ceph-mon[35759]: pgmap v584: 129 pgs: 129 active+clean; 10 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 41 MiB/s wr, 660 op/s 2024-06-06T03:31:45.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:45 smithi050 ceph-mon[32421]: pgmap v584: 129 pgs: 129 active+clean; 10 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 41 MiB/s wr, 660 op/s 2024-06-06T03:31:45.804 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-06T03:31:46.468 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:31:47.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:47 smithi079 ceph-mon[35478]: pgmap v585: 129 pgs: 129 active+clean; 10 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 48 MiB/s wr, 781 op/s 2024-06-06T03:31:47.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:47 smithi122 ceph-mon[35759]: pgmap v585: 129 pgs: 129 active+clean; 10 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 48 MiB/s wr, 781 op/s 2024-06-06T03:31:47.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:47 smithi050 ceph-mon[32421]: pgmap v585: 129 pgs: 129 active+clean; 10 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 48 MiB/s wr, 781 op/s 2024-06-06T03:31:49.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:49 smithi079 ceph-mon[35478]: pgmap v586: 129 pgs: 129 active+clean; 10 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 38 MiB/s wr, 610 op/s 2024-06-06T03:31:49.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:49 smithi122 ceph-mon[35759]: pgmap v586: 129 pgs: 129 active+clean; 10 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 38 MiB/s wr, 610 op/s 2024-06-06T03:31:49.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:49 smithi050 ceph-mon[32421]: pgmap v586: 129 pgs: 129 active+clean; 10 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 38 MiB/s wr, 610 op/s 2024-06-06T03:31:51.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.022+0000 7ff0c4d24700 1 -- 172.21.15.50:0/1970950104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0c0108ac0 msgr2=0x7ff0c0108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:51.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.022+0000 7ff0c4d24700 1 --2- 172.21.15.50:0/1970950104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0c0108ac0 0x7ff0c0108f40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8009990 tx=0x7ff0a8009ca0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.023+0000 7ff0c4d24700 1 -- 172.21.15.50:0/1970950104 shutdown_connections 2024-06-06T03:31:51.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.023+0000 7ff0c4d24700 1 --2- 172.21.15.50:0/1970950104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0c0109480 0x7ff0c0115990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.023+0000 7ff0c4d24700 1 --2- 172.21.15.50:0/1970950104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0c010eac0 0x7ff0c010eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.023+0000 7ff0c4d24700 1 --2- 172.21.15.50:0/1970950104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0c0108ac0 0x7ff0c0108f40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.023+0000 7ff0c4d24700 1 -- 172.21.15.50:0/1970950104 >> 172.21.15.50:0/1970950104 conn(0x7ff0c0075c60 msgr2=0x7ff0c01072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:51.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.023+0000 7ff0c4d24700 1 -- 172.21.15.50:0/1970950104 shutdown_connections 2024-06-06T03:31:51.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.023+0000 7ff0c4d24700 1 -- 172.21.15.50:0/1970950104 wait complete. 2024-06-06T03:31:51.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.024+0000 7ff0c4d24700 1 Processor -- start 2024-06-06T03:31:51.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.024+0000 7ff0c4d24700 1 -- start start 2024-06-06T03:31:51.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.024+0000 7ff0c4d24700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0c0108ac0 0x7ff0c0073c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:51.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.024+0000 7ff0c4d24700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0c0109480 0x7ff0c0074170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:51.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.024+0000 7ff0c4d24700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0c010eac0 0x7ff0c006cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:51.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.024+0000 7ff0bdd9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0c0109480 0x7ff0c0074170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:51.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.024+0000 7ff0c4d24700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c0118d60 con 0x7ff0c010eac0 2024-06-06T03:31:51.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.024+0000 7ff0c4d24700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c0118be0 con 0x7ff0c0108ac0 2024-06-06T03:31:51.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.024+0000 7ff0c4d24700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c0118ee0 con 0x7ff0c0109480 2024-06-06T03:31:51.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.025+0000 7ff0bdd9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0c0109480 0x7ff0c0074170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:59070/0 (socket says 172.21.15.50:59070) 2024-06-06T03:31:51.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.025+0000 7ff0bdd9b700 1 -- 172.21.15.50:0/2258284590 learned_addr learned my addr 172.21.15.50:0/2258284590 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:51.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.025+0000 7ff0be59c700 1 --2- 172.21.15.50:0/2258284590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0c0108ac0 0x7ff0c0073c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:51.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.026+0000 7ff0bdd9b700 1 -- 172.21.15.50:0/2258284590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0c0108ac0 msgr2=0x7ff0c0073c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:51.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.026+0000 7ff0bdd9b700 1 --2- 172.21.15.50:0/2258284590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0c0108ac0 0x7ff0c0073c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.026+0000 7ff0bdd9b700 1 -- 172.21.15.50:0/2258284590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0c010eac0 msgr2=0x7ff0c006cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:51.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.026+0000 7ff0bdd9b700 1 --2- 172.21.15.50:0/2258284590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0c010eac0 0x7ff0c006cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.026+0000 7ff0bdd9b700 1 -- 172.21.15.50:0/2258284590 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c006d860 con 0x7ff0c0109480 2024-06-06T03:31:51.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.026+0000 7ff0be59c700 1 --2- 172.21.15.50:0/2258284590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0c0108ac0 0x7ff0c0073c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:31:51.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.026+0000 7ff0bdd9b700 1 --2- 172.21.15.50:0/2258284590 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0c0109480 0x7ff0c0074170 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8005f50 tx=0x7ff0a800b680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:51.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.027+0000 7ff0b77fe700 1 -- 172.21.15.50:0/2258284590 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a800fa40 con 0x7ff0c0109480 2024-06-06T03:31:51.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.027+0000 7ff0b77fe700 1 -- 172.21.15.50:0/2258284590 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff0a800fbe0 con 0x7ff0c0109480 2024-06-06T03:31:51.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.027+0000 7ff0b77fe700 1 -- 172.21.15.50:0/2258284590 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a800e640 con 0x7ff0c0109480 2024-06-06T03:31:51.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.028+0000 7ff0c4d24700 1 -- 172.21.15.50:0/2258284590 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0c006daf0 con 0x7ff0c0109480 2024-06-06T03:31:51.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.028+0000 7ff0c4d24700 1 -- 172.21.15.50:0/2258284590 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0c0071930 con 0x7ff0c0109480 2024-06-06T03:31:51.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.033+0000 7ff0b77fe700 1 -- 172.21.15.50:0/2258284590 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff0a8009d10 con 0x7ff0c0109480 2024-06-06T03:31:51.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.034+0000 7ff0b77fe700 1 --2- 172.21.15.50:0/2258284590 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff0ac0a2e20 0x7ff0ac0a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:51.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.034+0000 7ff0b77fe700 1 -- 172.21.15.50:0/2258284590 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7ff0a80d0390 con 0x7ff0c0109480 2024-06-06T03:31:51.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.037+0000 7ff0be59c700 1 --2- 172.21.15.50:0/2258284590 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff0ac0a2e20 0x7ff0ac0a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:51.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.038+0000 7ff0be59c700 1 --2- 172.21.15.50:0/2258284590 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff0ac0a2e20 0x7ff0ac0a52e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0009c50 tx=0x7ff0b0009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:51.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.244+0000 7ff0cf5a7b80 1 Processor -- start 2024-06-06T03:31:51.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.244+0000 7ff0cf5a7b80 1 -- start start 2024-06-06T03:31:51.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.244+0000 7ff0cf5a7b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637fa79d640 0x5637fa79da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:51.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.244+0000 7ff0cf5a7b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637fa79df60 0x5637fa7979e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:51.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.244+0000 7ff0cf5a7b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637fa797f20 0x5637fa798340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:51.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.244+0000 7ff0cf5a7b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5637fa6e9810 con 0x5637fa79df60 2024-06-06T03:31:51.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.244+0000 7ff0cf5a7b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5637fa691720 con 0x5637fa797f20 2024-06-06T03:31:51.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.245+0000 7ff0cf5a7b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5637fa6e57d0 con 0x5637fa79d640 2024-06-06T03:31:51.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.245+0000 7ff0bdd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637fa79df60 0x5637fa7979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:51.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.245+0000 7ff0bdd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637fa79df60 0x5637fa7979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34142/0 (socket says 172.21.15.50:34142) 2024-06-06T03:31:51.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.245+0000 7ff0bdd9b700 1 -- 172.21.15.50:0/451040862 learned_addr learned my addr 172.21.15.50:0/451040862 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:51.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.245+0000 7ff0bed9d700 1 --2- 172.21.15.50:0/451040862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637fa797f20 0x5637fa798340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:51.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.246+0000 7ff0bed9d700 1 -- 172.21.15.50:0/451040862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637fa79d640 msgr2=0x5637fa79da20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:31:51.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.246+0000 7ff0bed9d700 1 --2- 172.21.15.50:0/451040862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637fa79d640 0x5637fa79da20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.246+0000 7ff0bed9d700 1 -- 172.21.15.50:0/451040862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637fa79df60 msgr2=0x5637fa7979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:51.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.246+0000 7ff0bed9d700 1 --2- 172.21.15.50:0/451040862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637fa79df60 0x5637fa7979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.246+0000 7ff0bed9d700 1 -- 172.21.15.50:0/451040862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637fa687f50 con 0x5637fa797f20 2024-06-06T03:31:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.247+0000 7ff0bed9d700 1 --2- 172.21.15.50:0/451040862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637fa797f20 0x5637fa798340 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8009bd0 tx=0x7ff0b8009ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15e805610fd28929 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.247+0000 7ff0b4ff9700 1 -- 172.21.15.50:0/451040862 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8004230 con 0x5637fa797f20 2024-06-06T03:31:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.248+0000 7ff0b4ff9700 1 -- 172.21.15.50:0/451040862 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff0b800ed30 con 0x5637fa797f20 2024-06-06T03:31:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.248+0000 7ff0cf5a7b80 1 -- 172.21.15.50:0/451040862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637fa797f20 msgr2=0x5637fa798340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.249+0000 7ff0cf5a7b80 1 --2- 172.21.15.50:0/451040862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637fa797f20 0x5637fa798340 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8009bd0 tx=0x7ff0b8009ee0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.249+0000 7ff0cf5a7b80 1 -- 172.21.15.50:0/451040862 shutdown_connections 2024-06-06T03:31:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.249+0000 7ff0cf5a7b80 1 --2- 172.21.15.50:0/451040862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637fa797f20 0x5637fa798340 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.249+0000 7ff0cf5a7b80 1 --2- 172.21.15.50:0/451040862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637fa79d640 0x5637fa79da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.249+0000 7ff0cf5a7b80 1 --2- 172.21.15.50:0/451040862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637fa79df60 0x5637fa7979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.249+0000 7ff0cf5a7b80 1 -- 172.21.15.50:0/451040862 >> 172.21.15.50:0/451040862 conn(0x5637fa6c2cc0 msgr2=0x5637fa792850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:51.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.250+0000 7ff0cf5a7b80 1 -- 172.21.15.50:0/451040862 shutdown_connections 2024-06-06T03:31:51.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.251+0000 7ff0cf5a7b80 1 -- 172.21.15.50:0/451040862 wait complete. 2024-06-06T03:31:51.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.251+0000 7ff0cf5a7b80 1 -- start start 2024-06-06T03:31:51.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.251+0000 7ff0cf5a7b80 1 Processor -- start 2024-06-06T03:31:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.252+0000 7ff0cf5a7b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637fa797f20 0x5637fa7a3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.252+0000 7ff0cf5a7b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637fa79d640 0x5637fa7a0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.252+0000 7ff0cf5a7b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637fa79df60 0x5637fa7a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.252+0000 7ff0cf5a7b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5637fa7a4a20 con 0x5637fa79d640 2024-06-06T03:31:51.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.252+0000 7ff0cf5a7b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5637fa689bf0 con 0x5637fa797f20 2024-06-06T03:31:51.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.252+0000 7ff0cf5a7b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5637fa7a4ba0 con 0x5637fa79df60 2024-06-06T03:31:51.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.252+0000 7ff0cf5a7b80 10 client.0 _ll_register_callbacks cb 0x5637fa683920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:31:51.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.253+0000 7ff0bed9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637fa79df60 0x5637fa7a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:51.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.253+0000 7ff0bed9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637fa79df60 0x5637fa7a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:59086/0 (socket says 172.21.15.50:59086) 2024-06-06T03:31:51.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.253+0000 7ff0bed9d700 1 -- 172.21.15.50:0/2884982956 learned_addr learned my addr 172.21.15.50:0/2884982956 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:51.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.253+0000 7ff0be59c700 1 --2- 172.21.15.50:0/2884982956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637fa797f20 0x5637fa7a3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:51.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.254+0000 7ff0bdd9b700 1 --2- 172.21.15.50:0/2884982956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637fa79d640 0x5637fa7a0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:51.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.254+0000 7ff0bed9d700 1 -- 172.21.15.50:0/2884982956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637fa797f20 msgr2=0x5637fa7a3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:51.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.254+0000 7ff0bed9d700 1 --2- 172.21.15.50:0/2884982956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637fa797f20 0x5637fa7a3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.254+0000 7ff0bed9d700 1 -- 172.21.15.50:0/2884982956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637fa79d640 msgr2=0x5637fa7a0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:51.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.254+0000 7ff0bed9d700 1 --2- 172.21.15.50:0/2884982956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637fa79d640 0x5637fa7a0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.254+0000 7ff0bed9d700 1 -- 172.21.15.50:0/2884982956 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637fa6388d0 con 0x5637fa79df60 2024-06-06T03:31:51.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.254+0000 7ff0bed9d700 1 --2- 172.21.15.50:0/2884982956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637fa79df60 0x5637fa7a1520 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8009ba0 tx=0x7ff0b8005520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=447c5aa76e5737c4 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:51.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.254+0000 7ff0a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:31:51.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.255+0000 7ff0a5ffb700 1 -- 172.21.15.50:0/2884982956 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8004bc0 con 0x5637fa79df60 2024-06-06T03:31:51.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.255+0000 7ff0cf5a7b80 1 -- 172.21.15.50:0/2884982956 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0b800ed30 con 0x5637fa79df60 2024-06-06T03:31:51.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.255+0000 7ff0a5ffb700 1 -- 172.21.15.50:0/2884982956 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7ff0b8004440 con 0x5637fa79df60 2024-06-06T03:31:51.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.255+0000 7ff0a5ffb700 1 -- 172.21.15.50:0/2884982956 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff0b8003680 con 0x5637fa79df60 2024-06-06T03:31:51.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.255+0000 7ff0cf5a7b80 10 client.25819 fetch_fsmap learned FSMap version 32 2024-06-06T03:31:51.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.255+0000 7ff0cf5a7b80 1 -- 172.21.15.50:0/2884982956 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5637fa7af340 con 0x5637fa79df60 2024-06-06T03:31:51.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.256+0000 7ff0a5ffb700 1 -- 172.21.15.50:0/2884982956 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff0b800ed30 con 0x5637fa79df60 2024-06-06T03:31:51.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.256+0000 7ff0a5ffb700 1 -- 172.21.15.50:0/2884982956 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7ff0b8018610 con 0x5637fa79df60 2024-06-06T03:31:51.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.257+0000 7ff0cf5a7b80 10 client.25819 fetch_fsmap finished waiting for FSMap version 32 2024-06-06T03:31:51.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.257+0000 7ff0cf5a7b80 10 client.25819 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:31:51.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.257+0000 7ff0cf5a7b80 20 client.25819 populate_metadata read hostname 'smithi050' 2024-06-06T03:31:51.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.257+0000 7ff0cf5a7b80 1 --2- 172.21.15.50:0/2884982956 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5637fa7b1be0 0x5637fa7b4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:51.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.257+0000 7ff0cf5a7b80 4 client.25819 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:31:51.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.257+0000 7ff0cf5a7b80 1 -- 172.21.15.50:0/2884982956 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637fa6f6d10 con 0x5637fa7b1be0 2024-06-06T03:31:51.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.258+0000 7ff0be59c700 1 --2- 172.21.15.50:0/2884982956 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5637fa7b1be0 0x5637fa7b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:51.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.258+0000 7ff0be59c700 1 --2- 172.21.15.50:0/2884982956 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5637fa7b1be0 0x5637fa7b4020 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77bc304be91e9d08 server_cookie=4b31b5052c01362c in_seq=0 out_seq=0 2024-06-06T03:31:51.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.259+0000 7ff0a5ffb700 10 client.25819 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:51.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.259+0000 7ff0a5ffb700 1 -- 172.21.15.50:0/2884982956 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5637fa6f6d10 con 0x5637fa7b1be0 2024-06-06T03:31:51.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.259+0000 7ff0a5ffb700 10 client.25819 handle_command_reply: tid=0 2024-06-06T03:31:51.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.259+0000 7ff0cf5a7b80 1 client.25819 shutdown 2024-06-06T03:31:51.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.260+0000 7ff0cf5a7b80 1 -- 172.21.15.50:0/2884982956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637fa79df60 msgr2=0x5637fa7a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:51.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.260+0000 7ff0cf5a7b80 1 --2- 172.21.15.50:0/2884982956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637fa79df60 0x5637fa7a1520 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8009ba0 tx=0x7ff0b8005520 comp rx=0 tx=0).stop 2024-06-06T03:31:51.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.261+0000 7ff0cf5a7b80 1 -- 172.21.15.50:0/2884982956 shutdown_connections 2024-06-06T03:31:51.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.261+0000 7ff0cf5a7b80 1 --2- 172.21.15.50:0/2884982956 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5637fa7b1be0 0x5637fa7b4020 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.261+0000 7ff0cf5a7b80 1 --2- 172.21.15.50:0/2884982956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637fa79df60 0x5637fa7a1520 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.261+0000 7ff0cf5a7b80 1 --2- 172.21.15.50:0/2884982956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637fa797f20 0x5637fa7a3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.261+0000 7ff0cf5a7b80 1 --2- 172.21.15.50:0/2884982956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637fa79d640 0x5637fa7a0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.261+0000 7ff0cf5a7b80 1 -- 172.21.15.50:0/2884982956 >> 172.21.15.50:0/2884982956 conn(0x5637fa6c2cc0 msgr2=0x5637fa7969d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:51.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.261+0000 7ff0a5ffb700 0 client.25819 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:51.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.262+0000 7ff0cf5a7b80 1 -- 172.21.15.50:0/2884982956 shutdown_connections 2024-06-06T03:31:51.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.262+0000 7ff0cf5a7b80 1 -- 172.21.15.50:0/2884982956 wait complete. 2024-06-06T03:31:51.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.262+0000 7ff0cf5a7b80 20 client.25819 trim_cache size 0 max 16384 2024-06-06T03:31:51.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.304+0000 7ff0cf5a7b80 1 Processor -- start 2024-06-06T03:31:51.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.304+0000 7ff0cf5a7b80 1 -- start start 2024-06-06T03:31:51.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.304+0000 7ff0cf5a7b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637fa797f20 0x5637fa7979e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:51.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.305+0000 7ff0be59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637fa797f20 0x5637fa7979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:51.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.305+0000 7ff0be59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637fa797f20 0x5637fa7979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34148/0 (socket says 172.21.15.50:34148) 2024-06-06T03:31:51.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.305+0000 7ff0be59c700 1 -- 172.21.15.50:0/1546066011 learned_addr learned my addr 172.21.15.50:0/1546066011 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:51.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.305+0000 7ff0cf5a7b80 1 --2- 172.21.15.50:0/1546066011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637fa79d640 0x5637fa79ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:51.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.305+0000 7ff0cf5a7b80 1 --2- 172.21.15.50:0/1546066011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637fa79df60 0x5637fa79ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:51.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.305+0000 7ff0cf5a7b80 1 -- 172.21.15.50:0/1546066011 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c01ae820 con 0x5637fa797f20 2024-06-06T03:31:51.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.305+0000 7ff0cf5a7b80 1 -- 172.21.15.50:0/1546066011 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c01ac0b0 con 0x5637fa79df60 2024-06-06T03:31:51.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.305+0000 7ff0bed9d700 1 --2- 172.21.15.50:0/1546066011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637fa79df60 0x5637fa79ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:51.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.305+0000 7ff0cf5a7b80 1 -- 172.21.15.50:0/1546066011 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c01a9f00 con 0x5637fa79d640 2024-06-06T03:31:51.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.306+0000 7ff0bdd9b700 1 --2- 172.21.15.50:0/1546066011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637fa79d640 0x5637fa79ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:51.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.306+0000 7ff0be59c700 1 -- 172.21.15.50:0/1546066011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637fa79d640 msgr2=0x5637fa79ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:51.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.306+0000 7ff0be59c700 1 --2- 172.21.15.50:0/1546066011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637fa79d640 0x5637fa79ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.306+0000 7ff0be59c700 1 -- 172.21.15.50:0/1546066011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637fa79df60 msgr2=0x5637fa79ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:51.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.306+0000 7ff0be59c700 1 --2- 172.21.15.50:0/1546066011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637fa79df60 0x5637fa79ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.306+0000 7ff0be59c700 1 -- 172.21.15.50:0/1546066011 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637fa7a1eb0 con 0x5637fa797f20 2024-06-06T03:31:51.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.307+0000 7ff0be59c700 1 --2- 172.21.15.50:0/1546066011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637fa797f20 0x5637fa7979e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff0b00094c0 tx=0x7ff0b0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41023a38eea61c6 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:51.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.308+0000 7ff0a7fff700 1 -- 172.21.15.50:0/1546066011 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b0003a00 con 0x5637fa797f20 2024-06-06T03:31:51.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.308+0000 7ff0a7fff700 1 -- 172.21.15.50:0/1546066011 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff0b0003ba0 con 0x5637fa797f20 2024-06-06T03:31:51.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.309+0000 7ff0cf5a7b80 1 -- 172.21.15.50:0/1546066011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637fa797f20 msgr2=0x5637fa7979e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:51.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.309+0000 7ff0cf5a7b80 1 --2- 172.21.15.50:0/1546066011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637fa797f20 0x5637fa7979e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff0b00094c0 tx=0x7ff0b0014000 comp rx=0 tx=0).stop 2024-06-06T03:31:51.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.311+0000 7ff0cf5a7b80 1 -- 172.21.15.50:0/1546066011 shutdown_connections 2024-06-06T03:31:51.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.311+0000 7ff0cf5a7b80 1 --2- 172.21.15.50:0/1546066011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637fa79df60 0x5637fa79ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.311+0000 7ff0cf5a7b80 1 --2- 172.21.15.50:0/1546066011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637fa797f20 0x5637fa7979e0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.311+0000 7ff0cf5a7b80 1 --2- 172.21.15.50:0/1546066011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637fa79d640 0x5637fa79ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.311+0000 7ff0cf5a7b80 1 -- 172.21.15.50:0/1546066011 >> 172.21.15.50:0/1546066011 conn(0x5637fa6c2cc0 msgr2=0x5637fa78be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:51.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.312+0000 7ff0cf5a7b80 1 -- 172.21.15.50:0/1546066011 shutdown_connections 2024-06-06T03:31:51.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.312+0000 7ff0cf5a7b80 1 -- 172.21.15.50:0/1546066011 wait complete. 2024-06-06T03:31:51.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.312+0000 7ff0cf5a7b80 1 -- start start 2024-06-06T03:31:51.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.312+0000 7ff0cf5a7b80 1 Processor -- start 2024-06-06T03:31:51.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.313+0000 7ff0cf5a7b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637fa797f20 0x5637fa7aa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:51.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.313+0000 7ff0cf5a7b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637fa79d640 0x5637fa7aa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:51.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.313+0000 7ff0cf5a7b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637fa79df60 0x5637fa7b8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:51.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.313+0000 7ff0cf5a7b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c01aa570 con 0x5637fa797f20 2024-06-06T03:31:51.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.313+0000 7ff0cf5a7b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c01ab9e0 con 0x5637fa79df60 2024-06-06T03:31:51.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.313+0000 7ff0cf5a7b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c01aac40 con 0x5637fa79d640 2024-06-06T03:31:51.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.313+0000 7ff0bdd9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637fa79d640 0x5637fa7aa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:51.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.313+0000 7ff0bdd9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637fa79d640 0x5637fa7aa5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:59094/0 (socket says 172.21.15.50:59094) 2024-06-06T03:31:51.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.313+0000 7ff0bdd9b700 1 -- 172.21.15.50:0/731688502 learned_addr learned my addr 172.21.15.50:0/731688502 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:51.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.313+0000 7ff0bed9d700 1 --2- 172.21.15.50:0/731688502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637fa79df60 0x5637fa7b8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:51.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.314+0000 7ff0cf5a7b80 10 client.0 _ll_register_callbacks cb 0x5637fa683920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:31:51.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.314+0000 7ff0bed9d700 1 -- 172.21.15.50:0/731688502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637fa79d640 msgr2=0x5637fa7aa5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:51.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.314+0000 7ff0bed9d700 1 --2- 172.21.15.50:0/731688502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637fa79d640 0x5637fa7aa5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.314+0000 7ff0bed9d700 1 -- 172.21.15.50:0/731688502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637fa797f20 msgr2=0x5637fa7aa090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:51.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.314+0000 7ff0bed9d700 1 --2- 172.21.15.50:0/731688502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637fa797f20 0x5637fa7aa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.314+0000 7ff0bed9d700 1 -- 172.21.15.50:0/731688502 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637fa7b95b0 con 0x5637fa79df60 2024-06-06T03:31:51.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.314+0000 7ff0bdd9b700 1 --2- 172.21.15.50:0/731688502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637fa79d640 0x5637fa7aa5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:31:51.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.318+0000 7ff0bed9d700 1 --2- 172.21.15.50:0/731688502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637fa79df60 0x5637fa7b8d40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8009b70 tx=0x7ff0b80058e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f9b0323156a853f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:51.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.318+0000 7ff0a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:31:51.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.320+0000 7ff0a5ffb700 1 -- 172.21.15.50:0/731688502 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8036070 con 0x5637fa79df60 2024-06-06T03:31:51.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.320+0000 7ff0a5ffb700 1 -- 172.21.15.50:0/731688502 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7ff0b8005640 con 0x5637fa79df60 2024-06-06T03:31:51.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.323+0000 7ff0cf5a7b80 1 -- 172.21.15.50:0/731688502 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5637fa6f1290 con 0x5637fa79df60 2024-06-06T03:31:51.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.329+0000 7ff0a5ffb700 1 -- 172.21.15.50:0/731688502 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff0b8040050 con 0x5637fa79df60 2024-06-06T03:31:51.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.330+0000 7ff0cf5a7b80 10 client.25853 fetch_fsmap learned FSMap version 32 2024-06-06T03:31:51.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.330+0000 7ff0cf5a7b80 1 -- 172.21.15.50:0/731688502 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5637fa81c3c0 con 0x5637fa79df60 2024-06-06T03:31:51.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.334+0000 7ff0a5ffb700 1 -- 172.21.15.50:0/731688502 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x5637fa6f1290 con 0x5637fa79df60 2024-06-06T03:31:51.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.335+0000 7ff0a5ffb700 1 -- 172.21.15.50:0/731688502 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7ff0b8003c00 con 0x5637fa79df60 2024-06-06T03:31:51.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.336+0000 7ff0cf5a7b80 10 client.25853 fetch_fsmap finished waiting for FSMap version 32 2024-06-06T03:31:51.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.336+0000 7ff0cf5a7b80 10 client.25853 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:31:51.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.336+0000 7ff0cf5a7b80 20 client.25853 populate_metadata read hostname 'smithi050' 2024-06-06T03:31:51.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.336+0000 7ff0cf5a7b80 1 --2- 172.21.15.50:0/731688502 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5637fa81c8e0 0x5637fa81ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:51.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.336+0000 7ff0cf5a7b80 4 client.25853 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-06T03:31:51.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.336+0000 7ff0cf5a7b80 1 -- 172.21.15.50:0/731688502 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5637fa56b250 con 0x5637fa81c8e0 2024-06-06T03:31:51.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.337+0000 7ff0be59c700 1 --2- 172.21.15.50:0/731688502 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5637fa81c8e0 0x5637fa81ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:51.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.339+0000 7ff0be59c700 1 --2- 172.21.15.50:0/731688502 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5637fa81c8e0 0x5637fa81ed40 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7feb0033bb0a767d server_cookie=a395554ab3d27c05 in_seq=0 out_seq=0 2024-06-06T03:31:51.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.340+0000 7ff0a5ffb700 10 client.25853 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:51.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.340+0000 7ff0a5ffb700 1 -- 172.21.15.50:0/731688502 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5637fa56b250 con 0x5637fa81c8e0 2024-06-06T03:31:51.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.340+0000 7ff0a5ffb700 10 client.25853 handle_command_reply: tid=0 2024-06-06T03:31:51.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.340+0000 7ff0cf5a7b80 1 client.25853 shutdown 2024-06-06T03:31:51.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.340+0000 7ff0cf5a7b80 1 -- 172.21.15.50:0/731688502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637fa79df60 msgr2=0x5637fa7b8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:51.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.340+0000 7ff0cf5a7b80 1 --2- 172.21.15.50:0/731688502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637fa79df60 0x5637fa7b8d40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8009b70 tx=0x7ff0b80058e0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.341+0000 7ff0cf5a7b80 1 -- 172.21.15.50:0/731688502 shutdown_connections 2024-06-06T03:31:51.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.341+0000 7ff0cf5a7b80 1 --2- 172.21.15.50:0/731688502 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5637fa81c8e0 0x5637fa81ed40 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.341+0000 7ff0cf5a7b80 1 --2- 172.21.15.50:0/731688502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637fa79df60 0x5637fa7b8d40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.341+0000 7ff0cf5a7b80 1 --2- 172.21.15.50:0/731688502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637fa797f20 0x5637fa7aa090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.341+0000 7ff0cf5a7b80 1 --2- 172.21.15.50:0/731688502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5637fa79d640 0x5637fa7aa5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.341+0000 7ff0cf5a7b80 1 -- 172.21.15.50:0/731688502 >> 172.21.15.50:0/731688502 conn(0x5637fa6c2cc0 msgr2=0x5637fa7a27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:51.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.341+0000 7ff0a5ffb700 0 client.25853 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:51.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.341+0000 7ff0cf5a7b80 1 -- 172.21.15.50:0/731688502 shutdown_connections 2024-06-06T03:31:51.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.341+0000 7ff0cf5a7b80 1 -- 172.21.15.50:0/731688502 wait complete. 2024-06-06T03:31:51.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.342+0000 7ff0cf5a7b80 20 client.25853 trim_cache size 0 max 16384 2024-06-06T03:31:51.342 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:31:51.342 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-06T03:31:51.342 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2024-06-06T03:31:51.342 INFO:teuthology.orchestra.run.smithi050.stdout: "9c45df6a-0054-4df4-a7ea-751fb6428e01": { 2024-06-06T03:31:51.343 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2024-06-06T03:31:51.343 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "9c45df6a-0054-4df4-a7ea-751fb6428e01", 2024-06-06T03:31:51.343 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "recursive,force" 2024-06-06T03:31:51.343 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:31:51.343 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:31:51.343 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:31:51.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.344+0000 7ff0c4d24700 1 -- 172.21.15.50:0/2258284590 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff0ac0a2e20 msgr2=0x7ff0ac0a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:51.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.344+0000 7ff0c4d24700 1 --2- 172.21.15.50:0/2258284590 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff0ac0a2e20 0x7ff0ac0a52e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0009c50 tx=0x7ff0b0009040 comp rx=0 tx=0).stop 2024-06-06T03:31:51.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.344+0000 7ff0c4d24700 1 -- 172.21.15.50:0/2258284590 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0c0109480 msgr2=0x7ff0c0074170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:51.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.344+0000 7ff0c4d24700 1 --2- 172.21.15.50:0/2258284590 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0c0109480 0x7ff0c0074170 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8005f50 tx=0x7ff0a800b680 comp rx=0 tx=0).stop 2024-06-06T03:31:51.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.344+0000 7ff0c4d24700 1 -- 172.21.15.50:0/2258284590 shutdown_connections 2024-06-06T03:31:51.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.344+0000 7ff0c4d24700 1 --2- 172.21.15.50:0/2258284590 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff0ac0a2e20 0x7ff0ac0a52e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.344+0000 7ff0c4d24700 1 --2- 172.21.15.50:0/2258284590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0c010eac0 0x7ff0c006cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.344+0000 7ff0c4d24700 1 --2- 172.21.15.50:0/2258284590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0c0108ac0 0x7ff0c0073c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.344+0000 7ff0c4d24700 1 --2- 172.21.15.50:0/2258284590 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0c0109480 0x7ff0c0074170 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:51.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.344+0000 7ff0c4d24700 1 -- 172.21.15.50:0/2258284590 >> 172.21.15.50:0/2258284590 conn(0x7ff0c0075c60 msgr2=0x7ff0c0076260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:51.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.346+0000 7ff0c4d24700 1 -- 172.21.15.50:0/2258284590 shutdown_connections 2024-06-06T03:31:51.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:31:51.346+0000 7ff0c4d24700 1 -- 172.21.15.50:0/2258284590 wait complete. 2024-06-06T03:31:51.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:51 smithi079 ceph-mon[35478]: pgmap v587: 129 pgs: 129 active+clean; 10 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 47 MiB/s wr, 753 op/s 2024-06-06T03:31:51.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:51 smithi122 ceph-mon[35759]: pgmap v587: 129 pgs: 129 active+clean; 10 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 47 MiB/s wr, 753 op/s 2024-06-06T03:31:51.708 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:51 smithi050 ceph-mon[32421]: pgmap v587: 129 pgs: 129 active+clean; 10 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 47 MiB/s wr, 753 op/s 2024-06-06T03:31:52.097 INFO:tasks.cephfs.filesystem:scrub status for tag:9c45df6a-0054-4df4-a7ea-751fb6428e01 - {'path': '/', 'tag': '9c45df6a-0054-4df4-a7ea-751fb6428e01', 'options': 'recursive,force'} 2024-06-06T03:31:52.303 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:52 smithi050 ceph-mon[32421]: scrub summary: idle 2024-06-06T03:31:52.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:52 smithi079 ceph-mon[35478]: scrub summary: idle 2024-06-06T03:31:52.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:52 smithi122 ceph-mon[35759]: scrub summary: idle 2024-06-06T03:31:53.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:53 smithi079 ceph-mon[35478]: pgmap v588: 129 pgs: 129 active+clean; 10 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 37 MiB/s wr, 595 op/s 2024-06-06T03:31:53.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:53 smithi079 ceph-mon[35478]: scrub summary: idle 2024-06-06T03:31:53.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:53 smithi122 ceph-mon[35759]: pgmap v588: 129 pgs: 129 active+clean; 10 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 37 MiB/s wr, 595 op/s 2024-06-06T03:31:53.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:53 smithi122 ceph-mon[35759]: scrub summary: idle 2024-06-06T03:31:53.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:53 smithi050 ceph-mon[32421]: pgmap v588: 129 pgs: 129 active+clean; 10 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 37 MiB/s wr, 595 op/s 2024-06-06T03:31:53.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:53 smithi050 ceph-mon[32421]: scrub summary: idle 2024-06-06T03:31:54.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:54 smithi079 ceph-mon[35478]: pgmap v589: 129 pgs: 129 active+clean; 10 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 37 MiB/s wr, 606 op/s 2024-06-06T03:31:54.652 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:54 smithi050 ceph-mon[32421]: pgmap v589: 129 pgs: 129 active+clean; 10 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 37 MiB/s wr, 606 op/s 2024-06-06T03:31:54.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:54 smithi122 ceph-mon[35759]: pgmap v589: 129 pgs: 129 active+clean; 10 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 37 MiB/s wr, 606 op/s 2024-06-06T03:31:55.205 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.205+0000 7f33c7210640 1 -- 172.21.15.50:0/540765858 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33c0109970 msgr2=0x7f33c010e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:55.205 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.205+0000 7f33c7210640 1 --2- 172.21.15.50:0/540765858 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33c0109970 0x7f33c010e2e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f33b8009ca0 tx=0x7f33b802a8f0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.209 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.207+0000 7f33c7210640 1 -- 172.21.15.50:0/540765858 shutdown_connections 2024-06-06T03:31:55.209 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.207+0000 7f33c7210640 1 --2- 172.21.15.50:0/540765858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33c0108fb0 0x7f33c0109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.209 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.207+0000 7f33c7210640 1 --2- 172.21.15.50:0/540765858 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33c0109970 0x7f33c010e2e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.209 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.207+0000 7f33c7210640 1 --2- 172.21.15.50:0/540765858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33c0072cd0 0x7f33c00730f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.209 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.207+0000 7f33c7210640 1 -- 172.21.15.50:0/540765858 >> 172.21.15.50:0/540765858 conn(0x7f33c006e840 msgr2=0x7f33c0070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:55.209 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.210+0000 7f33c7210640 1 -- 172.21.15.50:0/540765858 shutdown_connections 2024-06-06T03:31:55.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.211+0000 7f33c7210640 1 -- 172.21.15.50:0/540765858 wait complete. 2024-06-06T03:31:55.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.212+0000 7f33c7210640 1 Processor -- start 2024-06-06T03:31:55.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.212+0000 7f33c7210640 1 -- start start 2024-06-06T03:31:55.213 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.213+0000 7f33c7210640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33c0072cd0 0x7f33c0115160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:55.213 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.213+0000 7f33c7210640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33c0108fb0 0x7f33c01156a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:55.213 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.213+0000 7f33c7210640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33c0109970 0x7f33c01b6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:55.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.213+0000 7f33c7210640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f33c011c280 con 0x7f33c0109970 2024-06-06T03:31:55.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.213+0000 7f33c7210640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f33c011c100 con 0x7f33c0108fb0 2024-06-06T03:31:55.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.213+0000 7f33c7210640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f33c011c400 con 0x7f33c0072cd0 2024-06-06T03:31:55.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.213+0000 7f33c5a0d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33c0108fb0 0x7f33c01156a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:55.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.213+0000 7f33c5a0d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33c0108fb0 0x7f33c01156a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:56000/0 (socket says 172.21.15.50:56000) 2024-06-06T03:31:55.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.213+0000 7f33c5a0d640 1 -- 172.21.15.50:0/3887182422 learned_addr learned my addr 172.21.15.50:0/3887182422 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:55.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.214+0000 7f33c6a0f640 1 --2- 172.21.15.50:0/3887182422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33c0109970 0x7f33c01b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:55.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.215+0000 7f33c620e640 1 --2- 172.21.15.50:0/3887182422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33c0072cd0 0x7f33c0115160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:55.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.215+0000 7f33c6a0f640 1 -- 172.21.15.50:0/3887182422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33c0072cd0 msgr2=0x7f33c0115160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:55.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.215+0000 7f33c6a0f640 1 --2- 172.21.15.50:0/3887182422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33c0072cd0 0x7f33c0115160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.215+0000 7f33c6a0f640 1 -- 172.21.15.50:0/3887182422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33c0108fb0 msgr2=0x7f33c01156a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:55.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.215+0000 7f33c6a0f640 1 --2- 172.21.15.50:0/3887182422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33c0108fb0 0x7f33c01156a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.216 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.215+0000 7f33c6a0f640 1 -- 172.21.15.50:0/3887182422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c01b6ed0 con 0x7f33c0109970 2024-06-06T03:31:55.216 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.216+0000 7f33c6a0f640 1 --2- 172.21.15.50:0/3887182422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33c0109970 0x7f33c01b6990 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f33b8009bf0 tx=0x7f33b8003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:55.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.219+0000 7f33b77fe640 1 -- 172.21.15.50:0/3887182422 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b8004040 con 0x7f33c0109970 2024-06-06T03:31:55.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.219+0000 7f33b77fe640 1 -- 172.21.15.50:0/3887182422 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f33b802d070 con 0x7f33c0109970 2024-06-06T03:31:55.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.219+0000 7f33b77fe640 1 -- 172.21.15.50:0/3887182422 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b802fc90 con 0x7f33c0109970 2024-06-06T03:31:55.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.220+0000 7f33c7210640 1 -- 172.21.15.50:0/3887182422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33c01b7100 con 0x7f33c0109970 2024-06-06T03:31:55.223 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.221+0000 7f33c7210640 1 -- 172.21.15.50:0/3887182422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33c01b7650 con 0x7f33c0109970 2024-06-06T03:31:55.228 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.227+0000 7f33cb17c740 1 Processor -- start 2024-06-06T03:31:55.228 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.228+0000 7f33cb17c740 1 -- start start 2024-06-06T03:31:55.228 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.228+0000 7f33cb17c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55967143f1f0 0x55967143f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:55.228 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.228+0000 7f33cb17c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55967143fbe0 0x5596714446e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:55.228 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.228+0000 7f33cb17c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559671444d50 0x5596714471e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:55.228 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.228+0000 7f33cb17c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5596713a24f0 con 0x55967143f1f0 2024-06-06T03:31:55.228 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.228+0000 7f33cb17c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559671340870 con 0x559671444d50 2024-06-06T03:31:55.228 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.228+0000 7f33cb17c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55967139e4b0 con 0x55967143fbe0 2024-06-06T03:31:55.232 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.232+0000 7f33c620e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55967143fbe0 0x5596714446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:55.233 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.232+0000 7f33c620e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55967143fbe0 0x5596714446e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:59120/0 (socket says 172.21.15.50:59120) 2024-06-06T03:31:55.233 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.232+0000 7f33c620e640 1 -- 172.21.15.50:0/2965210095 learned_addr learned my addr 172.21.15.50:0/2965210095 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:55.233 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.233+0000 7f33b77fe640 1 -- 172.21.15.50:0/3887182422 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f33b80041e0 con 0x7f33c0109970 2024-06-06T03:31:55.233 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.233+0000 7f33c5a0d640 1 --2- 172.21.15.50:0/2965210095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559671444d50 0x5596714471e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:55.233 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.234+0000 7f33c5a0d640 1 --2- 172.21.15.50:0/2965210095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55967143f1f0 0x55967143f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:55.234 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.234+0000 7f33b77fe640 1 --2- 172.21.15.50:0/3887182422 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f33ac0a2d90 0x7f33ac0a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:55.234 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.235+0000 7f33b77fe640 1 -- 172.21.15.50:0/3887182422 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f33b80f0a50 con 0x7f33c0109970 2024-06-06T03:31:55.235 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.236+0000 7f33c6a0f640 1 --2- 172.21.15.50:0/3887182422 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f33ac0a2d90 0x7f33ac0a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:55.237 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.236+0000 7f33c6a0f640 1 --2- 172.21.15.50:0/3887182422 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f33ac0a2d90 0x7f33ac0a5250 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f33b80bcbd0 tx=0x7f33b8031b40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:55.237 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.237+0000 7f33c5a0d640 1 -- 172.21.15.50:0/2965210095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55967143fbe0 msgr2=0x5596714446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:55.237 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.237+0000 7f33c5a0d640 1 --2- 172.21.15.50:0/2965210095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55967143fbe0 0x5596714446e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.237 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.237+0000 7f33c5a0d640 1 -- 172.21.15.50:0/2965210095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55967143f1f0 msgr2=0x55967143f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:55.237 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.237+0000 7f33c5a0d640 1 --2- 172.21.15.50:0/2965210095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55967143f1f0 0x55967143f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.237 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.237+0000 7f33c5a0d640 1 -- 172.21.15.50:0/2965210095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55967135c9b0 con 0x559671444d50 2024-06-06T03:31:55.238 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.238+0000 7f33c5a0d640 1 --2- 172.21.15.50:0/2965210095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559671444d50 0x5596714471e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x559671440440 tx=0x7f33b0006a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6438c3e384a7b94f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:55.238 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.238+0000 7f33b4bfe640 1 -- 172.21.15.50:0/2965210095 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b0015930 con 0x559671444d50 2024-06-06T03:31:55.238 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.239+0000 7f33b4bfe640 1 -- 172.21.15.50:0/2965210095 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f33b001d070 con 0x559671444d50 2024-06-06T03:31:55.240 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.240+0000 7f33cb17c740 1 -- 172.21.15.50:0/2965210095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559671444d50 msgr2=0x5596714471e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:55.240 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.240+0000 7f33cb17c740 1 --2- 172.21.15.50:0/2965210095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559671444d50 0x5596714471e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x559671440440 tx=0x7f33b0006a30 comp rx=0 tx=0).stop 2024-06-06T03:31:55.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.244+0000 7f33cb17c740 1 -- 172.21.15.50:0/2965210095 shutdown_connections 2024-06-06T03:31:55.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.244+0000 7f33cb17c740 1 --2- 172.21.15.50:0/2965210095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559671444d50 0x5596714471e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.244+0000 7f33cb17c740 1 --2- 172.21.15.50:0/2965210095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55967143fbe0 0x5596714446e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.244+0000 7f33cb17c740 1 --2- 172.21.15.50:0/2965210095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55967143f1f0 0x55967143f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.244+0000 7f33cb17c740 1 -- 172.21.15.50:0/2965210095 >> 172.21.15.50:0/2965210095 conn(0x55967143a860 msgr2=0x55967143ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:55.250 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.250+0000 7f33cb17c740 1 -- 172.21.15.50:0/2965210095 shutdown_connections 2024-06-06T03:31:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.255+0000 7f33cb17c740 1 -- 172.21.15.50:0/2965210095 wait complete. 2024-06-06T03:31:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.256+0000 7f33cb17c740 1 -- start start 2024-06-06T03:31:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.256+0000 7f33cb17c740 1 Processor -- start 2024-06-06T03:31:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.259+0000 7f33cb17c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55967143f1f0 0x559671449700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.259+0000 7f33cb17c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55967143fbe0 0x559671449c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.259+0000 7f33cb17c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559671444d50 0x559671450c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.259+0000 7f33cb17c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559671447d40 con 0x55967143fbe0 2024-06-06T03:31:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.259+0000 7f33cb17c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55967132bae0 con 0x55967143f1f0 2024-06-06T03:31:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.259+0000 7f33cb17c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559671447ec0 con 0x559671444d50 2024-06-06T03:31:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.259+0000 7f33cb17c740 10 client.0 _ll_register_callbacks cb 0x5596713649b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:31:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.259+0000 7f33c5a0d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55967143f1f0 0x559671449700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.259+0000 7f33c5a0d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559671444d50 0x559671450c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.259+0000 7f33c5a0d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55967143f1f0 0x559671449700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:56028/0 (socket says 172.21.15.50:56028) 2024-06-06T03:31:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.259+0000 7f33c5a0d640 1 -- 172.21.15.50:0/4025158004 learned_addr learned my addr 172.21.15.50:0/4025158004 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:55.263 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.260+0000 7f33c620e640 1 --2- 172.21.15.50:0/4025158004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55967143fbe0 0x559671449c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:55.266 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.266+0000 7f33c5a0d640 1 -- 172.21.15.50:0/4025158004 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559671444d50 msgr2=0x559671450c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:55.267 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.266+0000 7f33c5a0d640 1 --2- 172.21.15.50:0/4025158004 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559671444d50 0x559671450c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.267 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.266+0000 7f33c5a0d640 1 -- 172.21.15.50:0/4025158004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55967143fbe0 msgr2=0x559671449c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:55.267 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.266+0000 7f33c5a0d640 1 --2- 172.21.15.50:0/4025158004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55967143fbe0 0x559671449c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.267 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.266+0000 7f33c5a0d640 1 -- 172.21.15.50:0/4025158004 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596710b6210 con 0x55967143f1f0 2024-06-06T03:31:55.267 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.266+0000 7f33c5a0d640 1 --2- 172.21.15.50:0/4025158004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55967143f1f0 0x559671449700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f33b0009b60 tx=0x7f33b00047d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78384cc70f91ca15 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:55.267 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.267+0000 7f33a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:31:55.267 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.267+0000 7f33a9ffb640 1 -- 172.21.15.50:0/4025158004 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b0015930 con 0x55967143f1f0 2024-06-06T03:31:55.268 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.267+0000 7f33cb17c740 1 -- 172.21.15.50:0/4025158004 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5596713b5f10 con 0x55967143f1f0 2024-06-06T03:31:55.268 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.267+0000 7f33a9ffb640 1 -- 172.21.15.50:0/4025158004 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f33b0015ad0 con 0x55967143f1f0 2024-06-06T03:31:55.268 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.268+0000 7f33a9ffb640 1 -- 172.21.15.50:0/4025158004 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f33b0034050 con 0x55967143f1f0 2024-06-06T03:31:55.268 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.268+0000 7f33cb17c740 10 client.25862 fetch_fsmap learned FSMap version 32 2024-06-06T03:31:55.268 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.268+0000 7f33cb17c740 1 -- 172.21.15.50:0/4025158004 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x559671182620 con 0x55967143f1f0 2024-06-06T03:31:55.269 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.268+0000 7f33a9ffb640 1 -- 172.21.15.50:0/4025158004 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x5596713b5f10 con 0x55967143f1f0 2024-06-06T03:31:55.269 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.268+0000 7f33a9ffb640 1 -- 172.21.15.50:0/4025158004 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f33b0021c40 con 0x55967143f1f0 2024-06-06T03:31:55.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.271+0000 7f33cb17c740 10 client.25862 fetch_fsmap finished waiting for FSMap version 32 2024-06-06T03:31:55.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.271+0000 7f33cb17c740 10 client.25862 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:31:55.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.271+0000 7f33cb17c740 20 client.25862 populate_metadata read hostname 'smithi050' 2024-06-06T03:31:55.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.271+0000 7f33cb17c740 1 --2- 172.21.15.50:0/4025158004 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5596714552a0 0x559671457690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:55.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.271+0000 7f33cb17c740 4 client.25862 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:31:55.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.271+0000 7f33cb17c740 1 -- 172.21.15.50:0/4025158004 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596713afc20 con 0x5596714552a0 2024-06-06T03:31:55.272 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.272+0000 7f33c620e640 1 --2- 172.21.15.50:0/4025158004 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5596714552a0 0x559671457690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:55.274 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.275+0000 7f33c620e640 1 --2- 172.21.15.50:0/4025158004 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5596714552a0 0x559671457690 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=affac61731ddc959 server_cookie=a59e49e75f9548d8 in_seq=0 out_seq=0 2024-06-06T03:31:55.274 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.275+0000 7f33a9ffb640 10 client.25862 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:55.280 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.279+0000 7f33a9ffb640 1 -- 172.21.15.50:0/4025158004 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5596713afc20 con 0x5596714552a0 2024-06-06T03:31:55.280 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.279+0000 7f33a9ffb640 10 client.25862 handle_command_reply: tid=0 2024-06-06T03:31:55.280 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.279+0000 7f33cb17c740 1 client.25862 shutdown 2024-06-06T03:31:55.281 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.281+0000 7f33cb17c740 1 -- 172.21.15.50:0/4025158004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55967143f1f0 msgr2=0x559671449700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:55.281 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.281+0000 7f33cb17c740 1 --2- 172.21.15.50:0/4025158004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55967143f1f0 0x559671449700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f33b0009b60 tx=0x7f33b00047d0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.283+0000 7f33cb17c740 1 -- 172.21.15.50:0/4025158004 shutdown_connections 2024-06-06T03:31:55.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.283+0000 7f33cb17c740 1 --2- 172.21.15.50:0/4025158004 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5596714552a0 0x559671457690 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.283+0000 7f33cb17c740 1 --2- 172.21.15.50:0/4025158004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55967143fbe0 0x559671449c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.283+0000 7f33cb17c740 1 --2- 172.21.15.50:0/4025158004 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559671444d50 0x559671450c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.283+0000 7f33cb17c740 1 --2- 172.21.15.50:0/4025158004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55967143f1f0 0x559671449700 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.283+0000 7f33cb17c740 1 -- 172.21.15.50:0/4025158004 >> 172.21.15.50:0/4025158004 conn(0x55967143a860 msgr2=0x559671439a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.283+0000 7f33a9ffb640 0 client.25862 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.283+0000 7f33cb17c740 1 -- 172.21.15.50:0/4025158004 shutdown_connections 2024-06-06T03:31:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.283+0000 7f33cb17c740 1 -- 172.21.15.50:0/4025158004 wait complete. 2024-06-06T03:31:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.283+0000 7f33cb17c740 20 client.25862 trim_cache size 0 max 16384 2024-06-06T03:31:55.314 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.314+0000 7f33cb17c740 1 Processor -- start 2024-06-06T03:31:55.315 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.315+0000 7f33cb17c740 1 -- start start 2024-06-06T03:31:55.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.316+0000 7f33cb17c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55967143f1f0 0x559671435a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:55.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.316+0000 7f33cb17c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55967143fbe0 0x559671450ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:55.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.316+0000 7f33cb17c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559671444d50 0x5596714482b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:55.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.316+0000 7f33cb17c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f33c01c43d0 con 0x55967143fbe0 2024-06-06T03:31:55.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.316+0000 7f33cb17c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f33c01c1ca0 con 0x55967143f1f0 2024-06-06T03:31:55.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.316+0000 7f33cb17c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f33c01bfaf0 con 0x559671444d50 2024-06-06T03:31:55.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.316+0000 7f33c5a0d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55967143f1f0 0x559671435a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:55.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.316+0000 7f33c5a0d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55967143f1f0 0x559671435a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:56038/0 (socket says 172.21.15.50:56038) 2024-06-06T03:31:55.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.316+0000 7f33c5a0d640 1 -- 172.21.15.50:0/877572823 learned_addr learned my addr 172.21.15.50:0/877572823 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:55.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.316+0000 7f33c5a0d640 1 --2- 172.21.15.50:0/877572823 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559671444d50 0x5596714482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.317+0000 7f33c5a0d640 1 -- 172.21.15.50:0/877572823 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559671444d50 msgr2=0x5596714482b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.317+0000 7f33c5a0d640 1 --2- 172.21.15.50:0/877572823 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559671444d50 0x5596714482b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.317+0000 7f33c5a0d640 1 -- 172.21.15.50:0/877572823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55967143fbe0 msgr2=0x559671450ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.317+0000 7f33c5a0d640 1 --2- 172.21.15.50:0/877572823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55967143fbe0 0x559671450ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.317+0000 7f33c5a0d640 1 -- 172.21.15.50:0/877572823 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55967143a690 con 0x55967143f1f0 2024-06-06T03:31:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.317+0000 7f33c5a0d640 1 --2- 172.21.15.50:0/877572823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55967143f1f0 0x559671435a70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f33b0015fd0 tx=0x7f33b0000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67f102055fb4d74e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:55.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.319+0000 7f33abfff640 1 -- 172.21.15.50:0/877572823 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b00300b0 con 0x55967143f1f0 2024-06-06T03:31:55.319 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.319+0000 7f33abfff640 1 -- 172.21.15.50:0/877572823 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f33b001d040 con 0x55967143f1f0 2024-06-06T03:31:55.319 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.319+0000 7f33abfff640 1 -- 172.21.15.50:0/877572823 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b00309c0 con 0x55967143f1f0 2024-06-06T03:31:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.320+0000 7f33cb17c740 1 -- 172.21.15.50:0/877572823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55967143f1f0 msgr2=0x559671435a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.320+0000 7f33cb17c740 1 --2- 172.21.15.50:0/877572823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55967143f1f0 0x559671435a70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f33b0015fd0 tx=0x7f33b0000bc0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.321+0000 7f33cb17c740 1 -- 172.21.15.50:0/877572823 shutdown_connections 2024-06-06T03:31:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.321+0000 7f33cb17c740 1 --2- 172.21.15.50:0/877572823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55967143fbe0 0x559671450ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.321+0000 7f33cb17c740 1 --2- 172.21.15.50:0/877572823 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559671444d50 0x5596714482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.321+0000 7f33cb17c740 1 --2- 172.21.15.50:0/877572823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55967143f1f0 0x559671435a70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.321+0000 7f33cb17c740 1 -- 172.21.15.50:0/877572823 >> 172.21.15.50:0/877572823 conn(0x55967143a860 msgr2=0x55967143ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.321+0000 7f33cb17c740 1 -- 172.21.15.50:0/877572823 shutdown_connections 2024-06-06T03:31:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.321+0000 7f33cb17c740 1 -- 172.21.15.50:0/877572823 wait complete. 2024-06-06T03:31:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.322+0000 7f33cb17c740 1 -- start start 2024-06-06T03:31:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.322+0000 7f33cb17c740 1 Processor -- start 2024-06-06T03:31:55.323 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.323+0000 7f33cb17c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55967143f1f0 0x5596714504b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:55.323 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.323+0000 7f33cb17c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55967143fbe0 0x5596714509f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:55.324 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.323+0000 7f33cb17c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559671444d50 0x55967144cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:55.324 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.324+0000 7f33cb17c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f33c01c0160 con 0x55967143f1f0 2024-06-06T03:31:55.324 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.324+0000 7f33cb17c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f33c01c15d0 con 0x559671444d50 2024-06-06T03:31:55.324 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.324+0000 7f33cb17c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f33c01c0830 con 0x55967143fbe0 2024-06-06T03:31:55.324 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.324+0000 7f33cb17c740 10 client.0 _ll_register_callbacks cb 0x7f33b0009cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:31:55.326 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.326+0000 7f33c620e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55967143fbe0 0x5596714509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:55.326 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.326+0000 7f33c620e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55967143fbe0 0x5596714509f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:59154/0 (socket says 172.21.15.50:59154) 2024-06-06T03:31:55.326 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.326+0000 7f33c620e640 1 -- 172.21.15.50:0/1876626636 learned_addr learned my addr 172.21.15.50:0/1876626636 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:31:55.326 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.326+0000 7f33c5a0d640 1 --2- 172.21.15.50:0/1876626636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559671444d50 0x55967144cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:55.326 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.326+0000 7f33c5a0d640 1 --2- 172.21.15.50:0/1876626636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55967143f1f0 0x5596714504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.330+0000 7f33c620e640 1 -- 172.21.15.50:0/1876626636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559671444d50 msgr2=0x55967144cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.330+0000 7f33c620e640 1 --2- 172.21.15.50:0/1876626636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559671444d50 0x55967144cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.330+0000 7f33c620e640 1 -- 172.21.15.50:0/1876626636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55967143f1f0 msgr2=0x5596714504b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:31:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.330+0000 7f33c620e640 1 --2- 172.21.15.50:0/1876626636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55967143f1f0 0x5596714504b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.330+0000 7f33c620e640 1 -- 172.21.15.50:0/1876626636 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559671447d80 con 0x55967143fbe0 2024-06-06T03:31:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.330+0000 7f33c620e640 1 --2- 172.21.15.50:0/1876626636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55967143fbe0 0x5596714509f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x55967143ffe0 tx=0x7f33bc0157f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47c80af71d70e0a0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:31:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.332+0000 7f33a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:31:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.332+0000 7f33a9ffb640 1 -- 172.21.15.50:0/1876626636 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33bc021020 con 0x55967143fbe0 2024-06-06T03:31:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.332+0000 7f33a9ffb640 1 -- 172.21.15.50:0/1876626636 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f33bc01d4e0 con 0x55967143fbe0 2024-06-06T03:31:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.333+0000 7f33cb17c740 1 -- 172.21.15.50:0/1876626636 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33b001d040 con 0x55967143fbe0 2024-06-06T03:31:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.335+0000 7f33a9ffb640 1 -- 172.21.15.50:0/1876626636 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f33bc015e10 con 0x55967143fbe0 2024-06-06T03:31:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.335+0000 7f33cb17c740 10 client.25843 fetch_fsmap learned FSMap version 32 2024-06-06T03:31:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.335+0000 7f33cb17c740 1 -- 172.21.15.50:0/1876626636 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5596714be9b0 con 0x55967143fbe0 2024-06-06T03:31:55.340 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.339+0000 7f33a9ffb640 1 -- 172.21.15.50:0/1876626636 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f33bc01db90 con 0x55967143fbe0 2024-06-06T03:31:55.340 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.340+0000 7f33a9ffb640 1 -- 172.21.15.50:0/1876626636 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f33bc025b20 con 0x55967143fbe0 2024-06-06T03:31:55.340 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.340+0000 7f33cb17c740 10 client.25843 fetch_fsmap finished waiting for FSMap version 32 2024-06-06T03:31:55.340 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.340+0000 7f33cb17c740 10 client.25843 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:31:55.340 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.340+0000 7f33cb17c740 20 client.25843 populate_metadata read hostname 'smithi050' 2024-06-06T03:31:55.340 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.340+0000 7f33cb17c740 1 --2- 172.21.15.50:0/1876626636 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5596714bf370 0x5596714c1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:31:55.341 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.340+0000 7f33cb17c740 4 client.25843 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:31:55.341 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.341+0000 7f33cb17c740 1 -- 172.21.15.50:0/1876626636 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f33b001d040 con 0x5596714bf370 2024-06-06T03:31:55.343 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.343+0000 7f33c5a0d640 1 --2- 172.21.15.50:0/1876626636 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5596714bf370 0x5596714c1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:31:55.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.344+0000 7f33c5a0d640 1 --2- 172.21.15.50:0/1876626636 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5596714bf370 0x5596714c1790 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d44f448a6f0019cd server_cookie=70f7eb94053890e7 in_seq=0 out_seq=0 2024-06-06T03:31:55.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.344+0000 7f33a9ffb640 10 client.25843 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:55.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.348+0000 7f33a9ffb640 1 -- 172.21.15.50:0/1876626636 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x7f33b001d040 con 0x5596714bf370 2024-06-06T03:31:55.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.348+0000 7f33a9ffb640 10 client.25843 handle_command_reply: tid=0 2024-06-06T03:31:55.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.349+0000 7f33cb17c740 1 client.25843 shutdown 2024-06-06T03:31:55.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.351+0000 7f33cb17c740 1 -- 172.21.15.50:0/1876626636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55967143fbe0 msgr2=0x5596714509f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:55.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.351+0000 7f33cb17c740 1 --2- 172.21.15.50:0/1876626636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55967143fbe0 0x5596714509f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x55967143ffe0 tx=0x7f33bc0157f0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.351+0000 7f33cb17c740 1 -- 172.21.15.50:0/1876626636 shutdown_connections 2024-06-06T03:31:55.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.351+0000 7f33cb17c740 1 --2- 172.21.15.50:0/1876626636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559671444d50 0x55967144cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.351+0000 7f33cb17c740 1 --2- 172.21.15.50:0/1876626636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55967143fbe0 0x5596714509f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.351+0000 7f33cb17c740 1 --2- 172.21.15.50:0/1876626636 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5596714bf370 0x5596714c1790 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.351+0000 7f33cb17c740 1 --2- 172.21.15.50:0/1876626636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55967143f1f0 0x5596714504b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.351+0000 7f33cb17c740 1 -- 172.21.15.50:0/1876626636 >> 172.21.15.50:0/1876626636 conn(0x55967143a860 msgr2=0x55967143ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:55.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.351+0000 7f33a9ffb640 0 client.25843 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:31:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.353+0000 7f33cb17c740 1 -- 172.21.15.50:0/1876626636 shutdown_connections 2024-06-06T03:31:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.353+0000 7f33cb17c740 1 -- 172.21.15.50:0/1876626636 wait complete. 2024-06-06T03:31:55.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.354+0000 7f33cb17c740 20 client.25843 trim_cache size 0 max 16384 2024-06-06T03:31:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:31:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:31:55.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:31:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.362+0000 7f33c7210640 1 -- 172.21.15.50:0/3887182422 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f33ac0a2d90 msgr2=0x7f33ac0a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.362+0000 7f33c7210640 1 --2- 172.21.15.50:0/3887182422 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f33ac0a2d90 0x7f33ac0a5250 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f33b80bcbd0 tx=0x7f33b8031b40 comp rx=0 tx=0).stop 2024-06-06T03:31:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.362+0000 7f33c7210640 1 -- 172.21.15.50:0/3887182422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33c0109970 msgr2=0x7f33c01b6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:31:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.362+0000 7f33c7210640 1 --2- 172.21.15.50:0/3887182422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33c0109970 0x7f33c01b6990 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f33b8009bf0 tx=0x7f33b8003ba0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.363+0000 7f33c7210640 1 -- 172.21.15.50:0/3887182422 shutdown_connections 2024-06-06T03:31:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.363+0000 7f33c7210640 1 --2- 172.21.15.50:0/3887182422 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f33ac0a2d90 0x7f33ac0a5250 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.363+0000 7f33c7210640 1 --2- 172.21.15.50:0/3887182422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33c0109970 0x7f33c01b6990 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.363+0000 7f33c7210640 1 --2- 172.21.15.50:0/3887182422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33c0108fb0 0x7f33c01156a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.363+0000 7f33c7210640 1 --2- 172.21.15.50:0/3887182422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33c0072cd0 0x7f33c0115160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:31:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.363+0000 7f33c7210640 1 -- 172.21.15.50:0/3887182422 >> 172.21.15.50:0/3887182422 conn(0x7f33c006e840 msgr2=0x7f33c0070600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:31:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.363+0000 7f33c7210640 1 -- 172.21.15.50:0/3887182422 shutdown_connections 2024-06-06T03:31:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:31:55.364+0000 7f33c7210640 1 -- 172.21.15.50:0/3887182422 wait complete. 2024-06-06T03:31:56.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:56 smithi079 ceph-mon[35478]: pgmap v590: 129 pgs: 129 active+clean; 10 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 45 MiB/s wr, 734 op/s 2024-06-06T03:31:56.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:56 smithi122 ceph-mon[35759]: pgmap v590: 129 pgs: 129 active+clean; 10 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 45 MiB/s wr, 734 op/s 2024-06-06T03:31:57.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:56 smithi050 ceph-mon[32421]: pgmap v590: 129 pgs: 129 active+clean; 10 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 45 MiB/s wr, 734 op/s 2024-06-06T03:31:58.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:31:58 smithi079 ceph-mon[35478]: pgmap v591: 129 pgs: 129 active+clean; 10 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 35 MiB/s wr, 570 op/s 2024-06-06T03:31:58.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:31:58 smithi122 ceph-mon[35759]: pgmap v591: 129 pgs: 129 active+clean; 10 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 35 MiB/s wr, 570 op/s 2024-06-06T03:31:59.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:31:58 smithi050 ceph-mon[32421]: pgmap v591: 129 pgs: 129 active+clean; 10 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 35 MiB/s wr, 570 op/s 2024-06-06T03:32:00.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:00 smithi079 ceph-mon[35478]: pgmap v592: 129 pgs: 129 active+clean; 10 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 48 MiB/s wr, 777 op/s 2024-06-06T03:32:00.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:00 smithi122 ceph-mon[35759]: pgmap v592: 129 pgs: 129 active+clean; 10 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 48 MiB/s wr, 777 op/s 2024-06-06T03:32:01.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:00 smithi050 ceph-mon[32421]: pgmap v592: 129 pgs: 129 active+clean; 10 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 48 MiB/s wr, 777 op/s 2024-06-06T03:32:02.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:02 smithi079 ceph-mon[35478]: pgmap v593: 129 pgs: 129 active+clean; 10 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 39 MiB/s wr, 622 op/s 2024-06-06T03:32:02.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:02 smithi122 ceph-mon[35759]: pgmap v593: 129 pgs: 129 active+clean; 10 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 39 MiB/s wr, 622 op/s 2024-06-06T03:32:03.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:02 smithi050 ceph-mon[32421]: pgmap v593: 129 pgs: 129 active+clean; 10 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 39 MiB/s wr, 622 op/s 2024-06-06T03:32:04.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:04 smithi122 ceph-mon[35759]: pgmap v594: 129 pgs: 129 active+clean; 10 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 40 MiB/s wr, 645 op/s 2024-06-06T03:32:05.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:04 smithi050 ceph-mon[32421]: pgmap v594: 129 pgs: 129 active+clean; 10 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 40 MiB/s wr, 645 op/s 2024-06-06T03:32:05.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:04 smithi079 ceph-mon[35478]: pgmap v594: 129 pgs: 129 active+clean; 10 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 40 MiB/s wr, 645 op/s 2024-06-06T03:32:06.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:06 smithi122 ceph-mon[35759]: pgmap v595: 129 pgs: 129 active+clean; 10 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 48 MiB/s wr, 782 op/s 2024-06-06T03:32:07.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:06 smithi050 ceph-mon[32421]: pgmap v595: 129 pgs: 129 active+clean; 10 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 48 MiB/s wr, 782 op/s 2024-06-06T03:32:07.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:06 smithi079 ceph-mon[35478]: pgmap v595: 129 pgs: 129 active+clean; 10 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 48 MiB/s wr, 782 op/s 2024-06-06T03:32:08.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.661+0000 7f6dcd6f5640 1 -- 172.21.15.50:0/2790780541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6dc8072d90 msgr2=0x7f6dc80731b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:08.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.661+0000 7f6dcd6f5640 1 --2- 172.21.15.50:0/2790780541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6dc8072d90 0x7f6dc80731b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6db8009860 tx=0x7f6db802a360 comp rx=0 tx=0).stop 2024-06-06T03:32:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.663+0000 7f6dcd6f5640 1 -- 172.21.15.50:0/2790780541 shutdown_connections 2024-06-06T03:32:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.663+0000 7f6dcd6f5640 1 --2- 172.21.15.50:0/2790780541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dc81099e0 0x7f6dc810e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.663+0000 7f6dcd6f5640 1 --2- 172.21.15.50:0/2790780541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dc8109040 0x7f6dc81094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.663+0000 7f6dcd6f5640 1 --2- 172.21.15.50:0/2790780541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6dc8072d90 0x7f6dc80731b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.663+0000 7f6dcd6f5640 1 -- 172.21.15.50:0/2790780541 >> 172.21.15.50:0/2790780541 conn(0x7f6dc806e840 msgr2=0x7f6dc8070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.664+0000 7f6dcd6f5640 1 -- 172.21.15.50:0/2790780541 shutdown_connections 2024-06-06T03:32:08.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.665+0000 7f6dcd6f5640 1 -- 172.21.15.50:0/2790780541 wait complete. 2024-06-06T03:32:08.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.666+0000 7f6dcd6f5640 1 Processor -- start 2024-06-06T03:32:08.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.666+0000 7f6dcd6f5640 1 -- start start 2024-06-06T03:32:08.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.666+0000 7f6dcd6f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dc8072d90 0x7f6dc8114ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:08.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.666+0000 7f6dcd6f5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dc8109040 0x7f6dc8115530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:08.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.666+0000 7f6dcd6f5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6dc81099e0 0x7f6dc81b6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:08.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.666+0000 7f6dcd6f5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc811c250 con 0x7f6dc8109040 2024-06-06T03:32:08.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.666+0000 7f6dcd6f5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc811c0d0 con 0x7f6dc8072d90 2024-06-06T03:32:08.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.666+0000 7f6dcd6f5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc811c3d0 con 0x7f6dc81099e0 2024-06-06T03:32:08.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.667+0000 7f6dc77fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6dc81099e0 0x7f6dc81b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:08.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.667+0000 7f6dc77fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6dc81099e0 0x7f6dc81b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:40406/0 (socket says 172.21.15.50:40406) 2024-06-06T03:32:08.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.667+0000 7f6dc67fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dc8109040 0x7f6dc8115530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:08.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.667+0000 7f6dc77fe640 1 -- 172.21.15.50:0/600134979 learned_addr learned my addr 172.21.15.50:0/600134979 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:08.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.667+0000 7f6dc77fe640 1 -- 172.21.15.50:0/600134979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dc8072d90 msgr2=0x7f6dc8114ff0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-06T03:32:08.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.667+0000 7f6dc77fe640 1 --2- 172.21.15.50:0/600134979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dc8072d90 0x7f6dc8114ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.667+0000 7f6dc77fe640 1 -- 172.21.15.50:0/600134979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dc8109040 msgr2=0x7f6dc8115530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:08.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.667+0000 7f6dc77fe640 1 --2- 172.21.15.50:0/600134979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dc8109040 0x7f6dc8115530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.667+0000 7f6dc77fe640 1 -- 172.21.15.50:0/600134979 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc8115bd0 con 0x7f6dc81099e0 2024-06-06T03:32:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.668+0000 7f6dc77fe640 1 --2- 172.21.15.50:0/600134979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6dc81099e0 0x7f6dc81b6960 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0009fd0 tx=0x7f6dc000c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.668+0000 7f6daffff640 1 -- 172.21.15.50:0/600134979 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0004b20 con 0x7f6dc81099e0 2024-06-06T03:32:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.669+0000 7f6dcd6f5640 1 -- 172.21.15.50:0/600134979 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc81b6fc0 con 0x7f6dc81099e0 2024-06-06T03:32:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.669+0000 7f6dcd6f5640 1 -- 172.21.15.50:0/600134979 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc81b7480 con 0x7f6dc81099e0 2024-06-06T03:32:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.669+0000 7f6daffff640 1 -- 172.21.15.50:0/600134979 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6dc0003e20 con 0x7f6dc81099e0 2024-06-06T03:32:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.669+0000 7f6daffff640 1 -- 172.21.15.50:0/600134979 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0004820 con 0x7f6dc81099e0 2024-06-06T03:32:08.675 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.675+0000 7f6dd0402740 1 Processor -- start 2024-06-06T03:32:08.680 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.680+0000 7f6dd0402740 1 -- start start 2024-06-06T03:32:08.680 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.680+0000 7f6daffff640 1 -- 172.21.15.50:0/600134979 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6dc001d020 con 0x7f6dc81099e0 2024-06-06T03:32:08.681 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.680+0000 7f6dd0402740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a16a24d1e0 0x55a16a24d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:08.681 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.680+0000 7f6dd0402740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a16a24dbd0 0x55a16a2526d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:08.681 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.680+0000 7f6dd0402740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a16a252d40 0x55a16a2551d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:08.681 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.680+0000 7f6dd0402740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a16a1b04f0 con 0x55a16a252d40 2024-06-06T03:32:08.681 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.680+0000 7f6dd0402740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a16a14e870 con 0x55a16a24d1e0 2024-06-06T03:32:08.681 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.680+0000 7f6dd0402740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a16a1ac4b0 con 0x55a16a24dbd0 2024-06-06T03:32:08.681 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.681+0000 7f6dc67fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a16a24d1e0 0x55a16a24d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:08.682 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.681+0000 7f6dc67fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a16a24d1e0 0x55a16a24d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:42744/0 (socket says 172.21.15.50:42744) 2024-06-06T03:32:08.682 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.681+0000 7f6dc67fc640 1 -- 172.21.15.50:0/77287834 learned_addr learned my addr 172.21.15.50:0/77287834 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:08.682 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.681+0000 7f6dc67fc640 1 -- 172.21.15.50:0/77287834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a16a24dbd0 msgr2=0x55a16a2526d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:32:08.682 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.681+0000 7f6dc67fc640 1 --2- 172.21.15.50:0/77287834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a16a24dbd0 0x55a16a2526d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.682 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.681+0000 7f6dc67fc640 1 -- 172.21.15.50:0/77287834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a16a252d40 msgr2=0x55a16a2551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:08.682 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.681+0000 7f6dc67fc640 1 --2- 172.21.15.50:0/77287834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a16a252d40 0x55a16a2551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.682 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.681+0000 7f6dc67fc640 1 -- 172.21.15.50:0/77287834 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a16a16a9b0 con 0x55a16a24d1e0 2024-06-06T03:32:08.683 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.682+0000 7f6daffff640 1 --2- 172.21.15.50:0/600134979 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6db00a2d90 0x7f6db00a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:08.683 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.682+0000 7f6daffff640 1 -- 172.21.15.50:0/600134979 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f6dc00cf240 con 0x7f6dc81099e0 2024-06-06T03:32:08.683 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.682+0000 7f6dc67fc640 1 --2- 172.21.15.50:0/77287834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a16a24d1e0 0x55a16a24d600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009d00 tx=0x7f6dbc011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b59562fbeed8584b server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.683+0000 7f6dc6ffd640 1 --2- 172.21.15.50:0/600134979 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6db00a2d90 0x7f6db00a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.683+0000 7f6dc6ffd640 1 --2- 172.21.15.50:0/600134979 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6db00a2d90 0x7f6db00a5250 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6db8009230 tx=0x7f6db8000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.695+0000 7f6dad7fa640 1 -- 172.21.15.50:0/77287834 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc009df0 con 0x55a16a24d1e0 2024-06-06T03:32:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.695+0000 7f6dad7fa640 1 -- 172.21.15.50:0/77287834 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6dbc0054d0 con 0x55a16a24d1e0 2024-06-06T03:32:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.695+0000 7f6dad7fa640 1 -- 172.21.15.50:0/77287834 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc01a670 con 0x55a16a24d1e0 2024-06-06T03:32:08.696 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.696+0000 7f6dd0402740 1 -- 172.21.15.50:0/77287834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a16a24d1e0 msgr2=0x55a16a24d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:08.696 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.696+0000 7f6dd0402740 1 --2- 172.21.15.50:0/77287834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a16a24d1e0 0x55a16a24d600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009d00 tx=0x7f6dbc011810 comp rx=0 tx=0).stop 2024-06-06T03:32:08.696 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.696+0000 7f6dd0402740 1 -- 172.21.15.50:0/77287834 shutdown_connections 2024-06-06T03:32:08.696 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.696+0000 7f6dd0402740 1 --2- 172.21.15.50:0/77287834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a16a252d40 0x55a16a2551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.696 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.696+0000 7f6dd0402740 1 --2- 172.21.15.50:0/77287834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a16a24dbd0 0x55a16a2526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.696 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.696+0000 7f6dd0402740 1 --2- 172.21.15.50:0/77287834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a16a24d1e0 0x55a16a24d600 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.696 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.696+0000 7f6dd0402740 1 -- 172.21.15.50:0/77287834 >> 172.21.15.50:0/77287834 conn(0x55a16a248850 msgr2=0x55a16a248c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:08.697 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.697+0000 7f6dd0402740 1 -- 172.21.15.50:0/77287834 shutdown_connections 2024-06-06T03:32:08.697 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.697+0000 7f6dd0402740 1 -- 172.21.15.50:0/77287834 wait complete. 2024-06-06T03:32:08.697 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.697+0000 7f6dd0402740 1 -- start start 2024-06-06T03:32:08.697 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.697+0000 7f6dd0402740 1 Processor -- start 2024-06-06T03:32:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.698+0000 7f6dd0402740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a16a24d1e0 0x55a16a257510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.698+0000 7f6dd0402740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a16a24dbd0 0x55a16a257a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.698+0000 7f6dd0402740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a16a252d40 0x55a16a25ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.698+0000 7f6dd0402740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a16a255cf0 con 0x55a16a252d40 2024-06-06T03:32:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.698+0000 7f6dd0402740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a16a139ae0 con 0x55a16a24d1e0 2024-06-06T03:32:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.698+0000 7f6dd0402740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a16a255e70 con 0x55a16a24dbd0 2024-06-06T03:32:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.698+0000 7f6dd0402740 10 client.0 _ll_register_callbacks cb 0x55a16a1729b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:32:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.698+0000 7f6dc77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a16a252d40 0x55a16a25ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.698+0000 7f6dc77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a16a252d40 0x55a16a25ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40400/0 (socket says 172.21.15.50:40400) 2024-06-06T03:32:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.698+0000 7f6dc77fe640 1 -- 172.21.15.50:0/4055430656 learned_addr learned my addr 172.21.15.50:0/4055430656 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.698+0000 7f6dc6ffd640 1 --2- 172.21.15.50:0/4055430656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a16a24d1e0 0x55a16a257510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.699+0000 7f6dc67fc640 1 --2- 172.21.15.50:0/4055430656 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a16a24dbd0 0x55a16a257a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.699+0000 7f6dc77fe640 1 -- 172.21.15.50:0/4055430656 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a16a24dbd0 msgr2=0x55a16a257a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.699+0000 7f6dc77fe640 1 --2- 172.21.15.50:0/4055430656 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a16a24dbd0 0x55a16a257a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.699+0000 7f6dc77fe640 1 -- 172.21.15.50:0/4055430656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a16a24d1e0 msgr2=0x55a16a257510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.699+0000 7f6dc77fe640 1 --2- 172.21.15.50:0/4055430656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a16a24d1e0 0x55a16a257510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.699+0000 7f6dc77fe640 1 -- 172.21.15.50:0/4055430656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a169ec4210 con 0x55a16a252d40 2024-06-06T03:32:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.700+0000 7f6dc77fe640 1 --2- 172.21.15.50:0/4055430656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a16a252d40 0x55a16a25ea90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0097b20 tx=0x7f6dc0004140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a057af83384ccce server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.700+0000 7f6daaff5640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:32:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.704+0000 7f6daaff5640 1 -- 172.21.15.50:0/4055430656 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc001a050 con 0x55a16a252d40 2024-06-06T03:32:08.709 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.705+0000 7f6daaff5640 1 -- 172.21.15.50:0/4055430656 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f6dc00b4510 con 0x55a16a252d40 2024-06-06T03:32:08.709 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.706+0000 7f6dd0402740 1 -- 172.21.15.50:0/4055430656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6dbc0054d0 con 0x55a16a252d40 2024-06-06T03:32:08.709 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.707+0000 7f6daaff5640 1 -- 172.21.15.50:0/4055430656 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6dc009fa70 con 0x55a16a252d40 2024-06-06T03:32:08.709 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.707+0000 7f6dd0402740 10 client.16239 fetch_fsmap learned FSMap version 32 2024-06-06T03:32:08.709 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.707+0000 7f6dd0402740 1 -- 172.21.15.50:0/4055430656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a169f90620 con 0x55a16a252d40 2024-06-06T03:32:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.709+0000 7f6daaff5640 1 -- 172.21.15.50:0/4055430656 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6dbc0054d0 con 0x55a16a252d40 2024-06-06T03:32:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.709+0000 7f6daaff5640 1 -- 172.21.15.50:0/4055430656 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f6dc000b040 con 0x55a16a252d40 2024-06-06T03:32:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.709+0000 7f6dd0402740 10 client.16239 fetch_fsmap finished waiting for FSMap version 32 2024-06-06T03:32:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.709+0000 7f6dd0402740 10 client.16239 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:32:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.709+0000 7f6dd0402740 20 client.16239 populate_metadata read hostname 'smithi050' 2024-06-06T03:32:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.709+0000 7f6dd0402740 1 --2- 172.21.15.50:0/4055430656 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55a16a263930 0x55a16a265d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.709+0000 7f6dd0402740 4 client.16239 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:32:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.709+0000 7f6dd0402740 1 -- 172.21.15.50:0/4055430656 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a16a1c3f10 con 0x55a16a263930 2024-06-06T03:32:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.711+0000 7f6dc6ffd640 1 --2- 172.21.15.50:0/4055430656 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55a16a263930 0x55a16a265d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.712+0000 7f6dc6ffd640 1 --2- 172.21.15.50:0/4055430656 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55a16a263930 0x55a16a265d50 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2feb486b4045ae2 server_cookie=c2615c3d025b3882 in_seq=0 out_seq=0 2024-06-06T03:32:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.712+0000 7f6daaff5640 10 client.16239 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:32:08.712 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.713+0000 7f6daaff5640 1 -- 172.21.15.50:0/4055430656 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55a16a1c3f10 con 0x55a16a263930 2024-06-06T03:32:08.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.713+0000 7f6daaff5640 10 client.16239 handle_command_reply: tid=0 2024-06-06T03:32:08.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.713+0000 7f6dd0402740 1 client.16239 shutdown 2024-06-06T03:32:08.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.713+0000 7f6dd0402740 1 -- 172.21.15.50:0/4055430656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a16a252d40 msgr2=0x55a16a25ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.713+0000 7f6dd0402740 1 --2- 172.21.15.50:0/4055430656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a16a252d40 0x55a16a25ea90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0097b20 tx=0x7f6dc0004140 comp rx=0 tx=0).stop 2024-06-06T03:32:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.713+0000 7f6dd0402740 1 -- 172.21.15.50:0/4055430656 shutdown_connections 2024-06-06T03:32:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.713+0000 7f6dd0402740 1 --2- 172.21.15.50:0/4055430656 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55a16a263930 0x55a16a265d50 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.713+0000 7f6dd0402740 1 --2- 172.21.15.50:0/4055430656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a16a252d40 0x55a16a25ea90 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.713+0000 7f6dd0402740 1 --2- 172.21.15.50:0/4055430656 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a16a24dbd0 0x55a16a257a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.713+0000 7f6dd0402740 1 --2- 172.21.15.50:0/4055430656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a16a24d1e0 0x55a16a257510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.713+0000 7f6dd0402740 1 -- 172.21.15.50:0/4055430656 >> 172.21.15.50:0/4055430656 conn(0x55a16a248850 msgr2=0x55a16a2479d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.713+0000 7f6daaff5640 0 client.16239 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:32:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.714+0000 7f6dd0402740 1 -- 172.21.15.50:0/4055430656 shutdown_connections 2024-06-06T03:32:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.714+0000 7f6dd0402740 1 -- 172.21.15.50:0/4055430656 wait complete. 2024-06-06T03:32:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.715+0000 7f6dd0402740 20 client.16239 trim_cache size 0 max 16384 2024-06-06T03:32:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.741+0000 7f6dd0402740 1 Processor -- start 2024-06-06T03:32:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.741+0000 7f6dd0402740 1 -- start start 2024-06-06T03:32:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.741+0000 7f6dd0402740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a16a248850 0x55a16a24ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.741+0000 7f6dd0402740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a16a24d1e0 0x55a16a25ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.741+0000 7f6dd0402740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a16a24dbd0 0x55a16a24f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.741+0000 7f6dd0402740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6db4012490 con 0x55a16a248850 2024-06-06T03:32:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.741+0000 7f6dd0402740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6db400fd60 con 0x55a16a24dbd0 2024-06-06T03:32:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.741+0000 7f6dd0402740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6db400dbb0 con 0x55a16a24d1e0 2024-06-06T03:32:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.741+0000 7f6dc6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a16a248850 0x55a16a24ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.742+0000 7f6dc6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a16a248850 0x55a16a24ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40412/0 (socket says 172.21.15.50:40412) 2024-06-06T03:32:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.742+0000 7f6dc6ffd640 1 -- 172.21.15.50:0/3694819322 learned_addr learned my addr 172.21.15.50:0/3694819322 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.742+0000 7f6dc77fe640 1 --2- 172.21.15.50:0/3694819322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a16a24dbd0 0x55a16a24f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.742+0000 7f6dc67fc640 1 --2- 172.21.15.50:0/3694819322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a16a24d1e0 0x55a16a25ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.742+0000 7f6dc6ffd640 1 -- 172.21.15.50:0/3694819322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a16a24d1e0 msgr2=0x55a16a25ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.742+0000 7f6dc6ffd640 1 --2- 172.21.15.50:0/3694819322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a16a24d1e0 0x55a16a25ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.742+0000 7f6dc6ffd640 1 -- 172.21.15.50:0/3694819322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a16a24dbd0 msgr2=0x55a16a24f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.742+0000 7f6dc6ffd640 1 --2- 172.21.15.50:0/3694819322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a16a24dbd0 0x55a16a24f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.742+0000 7f6dc6ffd640 1 -- 172.21.15.50:0/3694819322 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a16a248680 con 0x55a16a248850 2024-06-06T03:32:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.742+0000 7f6dc6ffd640 1 --2- 172.21.15.50:0/3694819322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a16a248850 0x55a16a24ee10 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f6db802a950 tx=0x7f6db8033000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4b300b0b51b3aa6 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:08.744 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.743+0000 7f6dacff9640 1 -- 172.21.15.50:0/3694819322 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db8037040 con 0x55a16a248850 2024-06-06T03:32:08.744 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.743+0000 7f6dacff9640 1 -- 172.21.15.50:0/3694819322 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6db804b070 con 0x55a16a248850 2024-06-06T03:32:08.744 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.743+0000 7f6dacff9640 1 -- 172.21.15.50:0/3694819322 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db80326a0 con 0x55a16a248850 2024-06-06T03:32:08.745 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.744+0000 7f6dd0402740 1 -- 172.21.15.50:0/3694819322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a16a248850 msgr2=0x55a16a24ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:08.745 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.744+0000 7f6dd0402740 1 --2- 172.21.15.50:0/3694819322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a16a248850 0x55a16a24ee10 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f6db802a950 tx=0x7f6db8033000 comp rx=0 tx=0).stop 2024-06-06T03:32:08.745 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.744+0000 7f6dd0402740 1 -- 172.21.15.50:0/3694819322 shutdown_connections 2024-06-06T03:32:08.745 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.744+0000 7f6dd0402740 1 --2- 172.21.15.50:0/3694819322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a16a24dbd0 0x55a16a24f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.745 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.744+0000 7f6dd0402740 1 --2- 172.21.15.50:0/3694819322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a16a24d1e0 0x55a16a25ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.745 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.744+0000 7f6dd0402740 1 --2- 172.21.15.50:0/3694819322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a16a248850 0x55a16a24ee10 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.745 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.744+0000 7f6dd0402740 1 -- 172.21.15.50:0/3694819322 >> 172.21.15.50:0/3694819322 conn(0x55a16a252810 msgr2=0x55a16a243900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:08.745 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.744+0000 7f6dd0402740 1 -- 172.21.15.50:0/3694819322 shutdown_connections 2024-06-06T03:32:08.745 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.744+0000 7f6dd0402740 1 -- 172.21.15.50:0/3694819322 wait complete. 2024-06-06T03:32:08.745 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.745+0000 7f6dd0402740 1 -- start start 2024-06-06T03:32:08.745 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.745+0000 7f6dd0402740 1 Processor -- start 2024-06-06T03:32:08.745 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.745+0000 7f6dd0402740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a16a248850 0x55a16a25e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:08.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.745+0000 7f6dc6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a16a248850 0x55a16a25e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:08.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.745+0000 7f6dc6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a16a248850 0x55a16a25e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40426/0 (socket says 172.21.15.50:40426) 2024-06-06T03:32:08.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.745+0000 7f6dc6ffd640 1 -- 172.21.15.50:0/1991867443 learned_addr learned my addr 172.21.15.50:0/1991867443 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:08.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.745+0000 7f6dd0402740 1 --2- 172.21.15.50:0/1991867443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a16a24d1e0 0x55a16a25b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:08.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.745+0000 7f6dd0402740 1 --2- 172.21.15.50:0/1991867443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a16a24dbd0 0x55a16a25b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.745+0000 7f6dd0402740 1 -- 172.21.15.50:0/1991867443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6db400e220 con 0x55a16a248850 2024-06-06T03:32:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.745+0000 7f6dd0402740 1 -- 172.21.15.50:0/1991867443 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6db400f690 con 0x55a16a24dbd0 2024-06-06T03:32:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.745+0000 7f6dd0402740 1 -- 172.21.15.50:0/1991867443 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6db400e8f0 con 0x55a16a24d1e0 2024-06-06T03:32:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.746+0000 7f6dd0402740 10 client.0 _ll_register_callbacks cb 0x7f6dc0004a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:32:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.746+0000 7f6dc77fe640 1 --2- 172.21.15.50:0/1991867443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a16a24dbd0 0x55a16a25b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.746+0000 7f6dc6ffd640 1 -- 172.21.15.50:0/1991867443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a16a24d1e0 msgr2=0x55a16a25b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.746+0000 7f6dc6ffd640 1 --2- 172.21.15.50:0/1991867443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a16a24d1e0 0x55a16a25b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.746+0000 7f6dc6ffd640 1 -- 172.21.15.50:0/1991867443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a16a24dbd0 msgr2=0x55a16a25b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.746+0000 7f6dc6ffd640 1 --2- 172.21.15.50:0/1991867443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a16a24dbd0 0x55a16a25b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.746+0000 7f6dc6ffd640 1 -- 172.21.15.50:0/1991867443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a16a2cc620 con 0x55a16a248850 2024-06-06T03:32:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.746+0000 7f6dc77fe640 1 --2- 172.21.15.50:0/1991867443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a16a24dbd0 0x55a16a25b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:32:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.746+0000 7f6dd0402740 1 -- 172.21.15.50:0/1991867443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6db804b070 con 0x55a16a248850 2024-06-06T03:32:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.746+0000 7f6dc6ffd640 1 --2- 172.21.15.50:0/1991867443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a16a248850 0x55a16a25e950 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f6db8006010 tx=0x7f6db8030990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd3c118c7093f8 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.746+0000 7f6daaff5640 10 client.16245 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:32:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.747+0000 7f6daaff5640 1 -- 172.21.15.50:0/1991867443 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db8037040 con 0x55a16a248850 2024-06-06T03:32:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.747+0000 7f6daaff5640 1 -- 172.21.15.50:0/1991867443 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f6db8004450 con 0x55a16a248850 2024-06-06T03:32:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.747+0000 7f6daaff5640 1 -- 172.21.15.50:0/1991867443 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6db80035f0 con 0x55a16a248850 2024-06-06T03:32:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.747+0000 7f6dd0402740 10 client.16245 fetch_fsmap learned FSMap version 32 2024-06-06T03:32:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.747+0000 7f6dd0402740 1 -- 172.21.15.50:0/1991867443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({fsmap=32}) -- 0x55a16a2cd700 con 0x55a16a248850 2024-06-06T03:32:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.747+0000 7f6daaff5640 1 -- 172.21.15.50:0/1991867443 <== mon.0 v2:172.21.15.50:3300/0 4 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f6dc0004cc0 con 0x55a16a248850 2024-06-06T03:32:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.748+0000 7f6dd0402740 10 client.16245 fetch_fsmap finished waiting for FSMap version 32 2024-06-06T03:32:08.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.748+0000 7f6dd0402740 10 client.16245 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:32:08.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.748+0000 7f6dd0402740 20 client.16245 populate_metadata read hostname 'smithi050' 2024-06-06T03:32:08.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.748+0000 7f6dd0402740 1 --2- 172.21.15.50:0/1991867443 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55a16a252d40 0x55a16a2d0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:08.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.748+0000 7f6dd0402740 4 client.16245 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:32:08.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.748+0000 7f6dd0402740 1 -- 172.21.15.50:0/1991867443 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a16a1bdc20 con 0x55a16a252d40 2024-06-06T03:32:08.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.748+0000 7f6dc67fc640 1 --2- 172.21.15.50:0/1991867443 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55a16a252d40 0x55a16a2d0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:08.751 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.751+0000 7f6dc67fc640 1 --2- 172.21.15.50:0/1991867443 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55a16a252d40 0x55a16a2d0040 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1e060c13c63086 server_cookie=b4917ecda5f4964f in_seq=0 out_seq=0 2024-06-06T03:32:08.751 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.751+0000 7f6daaff5640 10 client.16245 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:32:08.814 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.814+0000 7f6daaff5640 1 -- 172.21.15.50:0/1991867443 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55a16a1bdc20 con 0x55a16a252d40 2024-06-06T03:32:08.814 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.814+0000 7f6daaff5640 10 client.16245 handle_command_reply: tid=0 2024-06-06T03:32:08.819 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.820+0000 7f6dd0402740 1 client.16245 shutdown 2024-06-06T03:32:08.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.826+0000 7f6dd0402740 1 -- 172.21.15.50:0/1991867443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a16a248850 msgr2=0x55a16a25e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.826+0000 7f6dd0402740 1 --2- 172.21.15.50:0/1991867443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a16a248850 0x55a16a25e950 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f6db8006010 tx=0x7f6db8030990 comp rx=0 tx=0).stop 2024-06-06T03:32:08.830 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.826+0000 7f6dd0402740 1 -- 172.21.15.50:0/1991867443 shutdown_connections 2024-06-06T03:32:08.830 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.826+0000 7f6dd0402740 1 --2- 172.21.15.50:0/1991867443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a16a24dbd0 0x55a16a25b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.830 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.827+0000 7f6dd0402740 1 --2- 172.21.15.50:0/1991867443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a16a24d1e0 0x55a16a25b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.830 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.827+0000 7f6dd0402740 1 --2- 172.21.15.50:0/1991867443 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55a16a252d40 0x55a16a2d0040 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.830 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.827+0000 7f6daaff5640 0 client.16245 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:32:08.831 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.827+0000 7f6dd0402740 1 --2- 172.21.15.50:0/1991867443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a16a248850 0x55a16a25e950 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.831 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.827+0000 7f6dd0402740 1 -- 172.21.15.50:0/1991867443 >> 172.21.15.50:0/1991867443 conn(0x55a16a252810 msgr2=0x55a16a24ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:08.832 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.832+0000 7f6dd0402740 1 -- 172.21.15.50:0/1991867443 shutdown_connections 2024-06-06T03:32:08.832 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.833+0000 7f6dd0402740 1 -- 172.21.15.50:0/1991867443 wait complete. 2024-06-06T03:32:08.834 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.834+0000 7f6dd0402740 20 client.16245 trim_cache size 0 max 16384 2024-06-06T03:32:08.835 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:32:08.835 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:32:08.835 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:32:08.836 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.837+0000 7f6dcd6f5640 1 -- 172.21.15.50:0/600134979 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6db00a2d90 msgr2=0x7f6db00a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.837+0000 7f6dcd6f5640 1 --2- 172.21.15.50:0/600134979 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6db00a2d90 0x7f6db00a5250 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6db8009230 tx=0x7f6db8000bc0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.837+0000 7f6dcd6f5640 1 -- 172.21.15.50:0/600134979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6dc81099e0 msgr2=0x7f6dc81b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.837+0000 7f6dcd6f5640 1 --2- 172.21.15.50:0/600134979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6dc81099e0 0x7f6dc81b6960 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0009fd0 tx=0x7f6dc000c800 comp rx=0 tx=0).stop 2024-06-06T03:32:08.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.839+0000 7f6dcd6f5640 1 -- 172.21.15.50:0/600134979 shutdown_connections 2024-06-06T03:32:08.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.839+0000 7f6dcd6f5640 1 --2- 172.21.15.50:0/600134979 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6db00a2d90 0x7f6db00a5250 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.839+0000 7f6dcd6f5640 1 --2- 172.21.15.50:0/600134979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dc8109040 0x7f6dc8115530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.839+0000 7f6dcd6f5640 1 --2- 172.21.15.50:0/600134979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6dc81099e0 0x7f6dc81b6960 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.839+0000 7f6dcd6f5640 1 --2- 172.21.15.50:0/600134979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dc8072d90 0x7f6dc8114ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:08.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.839+0000 7f6dcd6f5640 1 -- 172.21.15.50:0/600134979 >> 172.21.15.50:0/600134979 conn(0x7f6dc806e840 msgr2=0x7f6dc8070450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:08.842 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.841+0000 7f6dcd6f5640 1 -- 172.21.15.50:0/600134979 shutdown_connections 2024-06-06T03:32:08.842 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:08.842+0000 7f6dcd6f5640 1 -- 172.21.15.50:0/600134979 wait complete. 2024-06-06T03:32:08.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:08 smithi122 ceph-mon[35759]: pgmap v596: 129 pgs: 129 active+clean; 10 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 38 MiB/s wr, 610 op/s 2024-06-06T03:32:09.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:08 smithi050 ceph-mon[32421]: pgmap v596: 129 pgs: 129 active+clean; 10 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 38 MiB/s wr, 610 op/s 2024-06-06T03:32:09.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:08 smithi079 ceph-mon[35478]: pgmap v596: 129 pgs: 129 active+clean; 10 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 38 MiB/s wr, 610 op/s 2024-06-06T03:32:10.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:10 smithi122 ceph-mon[35759]: pgmap v597: 129 pgs: 129 active+clean; 10 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 51 MiB/s wr, 824 op/s 2024-06-06T03:32:11.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:10 smithi050 ceph-mon[32421]: pgmap v597: 129 pgs: 129 active+clean; 10 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 51 MiB/s wr, 824 op/s 2024-06-06T03:32:11.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:10 smithi079 ceph-mon[35478]: pgmap v597: 129 pgs: 129 active+clean; 10 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 51 MiB/s wr, 824 op/s 2024-06-06T03:32:12.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:12 smithi122 ceph-mon[35759]: pgmap v598: 129 pgs: 129 active+clean; 10 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 40 MiB/s wr, 644 op/s 2024-06-06T03:32:13.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:12 smithi050 ceph-mon[32421]: pgmap v598: 129 pgs: 129 active+clean; 10 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 40 MiB/s wr, 644 op/s 2024-06-06T03:32:13.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:12 smithi079 ceph-mon[35478]: pgmap v598: 129 pgs: 129 active+clean; 10 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 40 MiB/s wr, 644 op/s 2024-06-06T03:32:14.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:14 smithi122 ceph-mon[35759]: pgmap v599: 129 pgs: 129 active+clean; 10 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 41 MiB/s wr, 661 op/s 2024-06-06T03:32:15.004 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:14 smithi050 ceph-mon[32421]: pgmap v599: 129 pgs: 129 active+clean; 10 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 41 MiB/s wr, 661 op/s 2024-06-06T03:32:15.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:14 smithi079 ceph-mon[35478]: pgmap v599: 129 pgs: 129 active+clean; 10 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 41 MiB/s wr, 661 op/s 2024-06-06T03:32:16.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:16 smithi122 ceph-mon[35759]: pgmap v600: 129 pgs: 129 active+clean; 10 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 48 MiB/s wr, 782 op/s 2024-06-06T03:32:17.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:16 smithi050 ceph-mon[32421]: pgmap v600: 129 pgs: 129 active+clean; 10 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 48 MiB/s wr, 782 op/s 2024-06-06T03:32:17.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:16 smithi079 ceph-mon[35478]: pgmap v600: 129 pgs: 129 active+clean; 10 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 48 MiB/s wr, 782 op/s 2024-06-06T03:32:18.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:18 smithi122 ceph-mon[35759]: pgmap v601: 129 pgs: 129 active+clean; 10 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 37 MiB/s wr, 605 op/s 2024-06-06T03:32:18.932 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:18 smithi122 ceph-mon[35759]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:32:19.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:18 smithi050 ceph-mon[32421]: pgmap v601: 129 pgs: 129 active+clean; 10 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 37 MiB/s wr, 605 op/s 2024-06-06T03:32:19.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:18 smithi050 ceph-mon[32421]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:32:19.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:18 smithi079 ceph-mon[35478]: pgmap v601: 129 pgs: 129 active+clean; 10 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 37 MiB/s wr, 605 op/s 2024-06-06T03:32:19.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:18 smithi079 ceph-mon[35478]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:32:20.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:20 smithi122 ceph-mon[35759]: pgmap v602: 129 pgs: 129 active+clean; 10 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 51 MiB/s wr, 827 op/s 2024-06-06T03:32:21.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:20 smithi050 ceph-mon[32421]: pgmap v602: 129 pgs: 129 active+clean; 10 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 51 MiB/s wr, 827 op/s 2024-06-06T03:32:21.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:20 smithi079 ceph-mon[35478]: pgmap v602: 129 pgs: 129 active+clean; 10 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 51 MiB/s wr, 827 op/s 2024-06-06T03:32:22.069 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.070+0000 7f447dce7640 1 -- 172.21.15.50:0/582845439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4478109040 msgr2=0x7f44781094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:22.069 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.070+0000 7f447dce7640 1 --2- 172.21.15.50:0/582845439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4478109040 0x7f44781094a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4468009860 tx=0x7f446802a360 comp rx=0 tx=0).stop 2024-06-06T03:32:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.070+0000 7f447dce7640 1 -- 172.21.15.50:0/582845439 shutdown_connections 2024-06-06T03:32:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.070+0000 7f447dce7640 1 --2- 172.21.15.50:0/582845439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44781099e0 0x7f447810e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.070+0000 7f447dce7640 1 --2- 172.21.15.50:0/582845439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4478109040 0x7f44781094a0 secure :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4468009860 tx=0x7f446802a360 comp rx=0 tx=0).stop 2024-06-06T03:32:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.070+0000 7f447dce7640 1 --2- 172.21.15.50:0/582845439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4478072d90 0x7f44780731b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.070+0000 7f447dce7640 1 -- 172.21.15.50:0/582845439 >> 172.21.15.50:0/582845439 conn(0x7f447806e840 msgr2=0x7f4478070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:22.079 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.080+0000 7f447dce7640 1 -- 172.21.15.50:0/582845439 shutdown_connections 2024-06-06T03:32:22.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.083+0000 7f447dce7640 1 -- 172.21.15.50:0/582845439 wait complete. 2024-06-06T03:32:22.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.083+0000 7f447dce7640 1 Processor -- start 2024-06-06T03:32:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.084+0000 7f447dce7640 1 -- start start 2024-06-06T03:32:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.084+0000 7f447dce7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4478072d90 0x7f4478119d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.084+0000 7f447dce7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44781099e0 0x7f447811a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.084+0000 7f447dce7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f44781183a0 0x7f4478118850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.084+0000 7f447dce7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f44781109d0 con 0x7f4478072d90 2024-06-06T03:32:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.084+0000 7f447dce7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4478110850 con 0x7f44781099e0 2024-06-06T03:32:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.084+0000 7f447dce7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4478110b50 con 0x7f44781183a0 2024-06-06T03:32:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.085+0000 7f4477fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f44781183a0 0x7f4478118850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.085+0000 7f4477fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f44781183a0 0x7f4478118850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:50244/0 (socket says 172.21.15.50:50244) 2024-06-06T03:32:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.085+0000 7f4477fff640 1 -- 172.21.15.50:0/412034798 learned_addr learned my addr 172.21.15.50:0/412034798 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.086+0000 7f44777fe640 1 --2- 172.21.15.50:0/412034798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4478072d90 0x7f4478119d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.086+0000 7f4477fff640 1 -- 172.21.15.50:0/412034798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44781099e0 msgr2=0x7f447811a2a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-06T03:32:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.086+0000 7f4477fff640 1 --2- 172.21.15.50:0/412034798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44781099e0 0x7f447811a2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.086+0000 7f4477fff640 1 -- 172.21.15.50:0/412034798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4478072d90 msgr2=0x7f4478119d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.086+0000 7f4477fff640 1 --2- 172.21.15.50:0/412034798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4478072d90 0x7f4478119d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.086+0000 7f4477fff640 1 -- 172.21.15.50:0/412034798 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4478119050 con 0x7f44781183a0 2024-06-06T03:32:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.086+0000 7f44777fe640 1 --2- 172.21.15.50:0/412034798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4478072d90 0x7f4478119d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:32:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.086+0000 7f4477fff640 1 --2- 172.21.15.50:0/412034798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f44781183a0 0x7f4478118850 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f447000eda0 tx=0x7f447000c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.091+0000 7f4474ff9640 1 -- 172.21.15.50:0/412034798 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4470003b70 con 0x7f44781183a0 2024-06-06T03:32:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.092+0000 7f4474ff9640 1 -- 172.21.15.50:0/412034798 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4470003d10 con 0x7f44781183a0 2024-06-06T03:32:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.092+0000 7f4474ff9640 1 -- 172.21.15.50:0/412034798 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44700178a0 con 0x7f44781183a0 2024-06-06T03:32:22.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.093+0000 7f447dce7640 1 -- 172.21.15.50:0/412034798 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44781b76a0 con 0x7f44781183a0 2024-06-06T03:32:22.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.093+0000 7f447dce7640 1 -- 172.21.15.50:0/412034798 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44781b7b40 con 0x7f44781183a0 2024-06-06T03:32:22.099 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-06T03:32:22.100 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.100+0000 7f4474ff9640 1 -- 172.21.15.50:0/412034798 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4470017a40 con 0x7f44781183a0 2024-06-06T03:32:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.106+0000 7f4474ff9640 1 --2- 172.21.15.50:0/412034798 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f44600a2d90 0x7f44600a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.107+0000 7f4474ff9640 1 -- 172.21.15.50:0/412034798 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f44700cf520 con 0x7f44781183a0 2024-06-06T03:32:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.111+0000 7f44777fe640 1 --2- 172.21.15.50:0/412034798 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f44600a2d90 0x7f44600a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.116+0000 7f44809f0740 1 Processor -- start 2024-06-06T03:32:22.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.121+0000 7f44809f0740 1 -- start start 2024-06-06T03:32:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.121+0000 7f44809f0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588a1cdc1e0 0x5588a1cdc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.121+0000 7f44809f0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588a1cdcbd0 0x5588a1ce16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.121+0000 7f44809f0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588a1ce1d40 0x5588a1ce41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.121+0000 7f44809f0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5588a1c3f4f0 con 0x5588a1cdc1e0 2024-06-06T03:32:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.121+0000 7f44809f0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5588a1bdd870 con 0x5588a1cdcbd0 2024-06-06T03:32:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.121+0000 7f44809f0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5588a1c3b4b0 con 0x5588a1ce1d40 2024-06-06T03:32:22.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.122+0000 7f44777fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588a1cdc1e0 0x5588a1cdc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:22.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.122+0000 7f44777fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588a1cdc1e0 0x5588a1cdc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44650/0 (socket says 172.21.15.50:44650) 2024-06-06T03:32:22.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.122+0000 7f44777fe640 1 -- 172.21.15.50:0/2485024232 learned_addr learned my addr 172.21.15.50:0/2485024232 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:22.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.123+0000 7f44777fe640 1 --2- 172.21.15.50:0/412034798 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f44600a2d90 0x7f44600a5250 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f446c00aa10 tx=0x7f446c00a330 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:22.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.123+0000 7f4476ffd640 1 --2- 172.21.15.50:0/2485024232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588a1cdcbd0 0x5588a1ce16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.123+0000 7f44777fe640 1 -- 172.21.15.50:0/2485024232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588a1ce1d40 msgr2=0x5588a1ce41d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:32:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.123+0000 7f44777fe640 1 --2- 172.21.15.50:0/2485024232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588a1ce1d40 0x5588a1ce41d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.123+0000 7f44777fe640 1 -- 172.21.15.50:0/2485024232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588a1cdcbd0 msgr2=0x5588a1ce16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.123+0000 7f44777fe640 1 --2- 172.21.15.50:0/2485024232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588a1cdcbd0 0x5588a1ce16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.123+0000 7f44777fe640 1 -- 172.21.15.50:0/2485024232 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588a1bf99b0 con 0x5588a1cdc1e0 2024-06-06T03:32:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.123+0000 7f44777fe640 1 --2- 172.21.15.50:0/2485024232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588a1cdc1e0 0x5588a1cdc600 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f446c00ed10 tx=0x7f446c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=978dc1dcd93087e2 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.124+0000 7f445dffb640 1 -- 172.21.15.50:0/2485024232 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446c00f040 con 0x5588a1cdc1e0 2024-06-06T03:32:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.124+0000 7f445dffb640 1 -- 172.21.15.50:0/2485024232 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f446c01a040 con 0x5588a1cdc1e0 2024-06-06T03:32:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.124+0000 7f445dffb640 1 -- 172.21.15.50:0/2485024232 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446c003cf0 con 0x5588a1cdc1e0 2024-06-06T03:32:22.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.125+0000 7f44809f0740 1 -- 172.21.15.50:0/2485024232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588a1cdc1e0 msgr2=0x5588a1cdc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:22.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.125+0000 7f44809f0740 1 --2- 172.21.15.50:0/2485024232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588a1cdc1e0 0x5588a1cdc600 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f446c00ed10 tx=0x7f446c017000 comp rx=0 tx=0).stop 2024-06-06T03:32:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.133+0000 7f44809f0740 1 -- 172.21.15.50:0/2485024232 shutdown_connections 2024-06-06T03:32:22.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.133+0000 7f44809f0740 1 --2- 172.21.15.50:0/2485024232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588a1ce1d40 0x5588a1ce41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.133+0000 7f44809f0740 1 --2- 172.21.15.50:0/2485024232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588a1cdcbd0 0x5588a1ce16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.133+0000 7f44809f0740 1 --2- 172.21.15.50:0/2485024232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588a1cdc1e0 0x5588a1cdc600 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.133+0000 7f44809f0740 1 -- 172.21.15.50:0/2485024232 >> 172.21.15.50:0/2485024232 conn(0x5588a1cd7850 msgr2=0x5588a1cd7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:22.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.133+0000 7f44809f0740 1 -- 172.21.15.50:0/2485024232 shutdown_connections 2024-06-06T03:32:22.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.133+0000 7f44809f0740 1 -- 172.21.15.50:0/2485024232 wait complete. 2024-06-06T03:32:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.133+0000 7f44809f0740 1 -- start start 2024-06-06T03:32:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.134+0000 7f44809f0740 1 Processor -- start 2024-06-06T03:32:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.134+0000 7f44809f0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588a1cdc1e0 0x5588a1ce6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.134+0000 7f44809f0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588a1cdcbd0 0x5588a1ce6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.134+0000 7f44809f0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588a1ce1d40 0x5588a1ced950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.134+0000 7f44809f0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5588a1ce4d40 con 0x5588a1ce1d40 2024-06-06T03:32:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.134+0000 7f44809f0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5588a1bc8ae0 con 0x5588a1cdc1e0 2024-06-06T03:32:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.134+0000 7f44809f0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5588a1ce4ec0 con 0x5588a1cdcbd0 2024-06-06T03:32:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.134+0000 7f44809f0740 10 client.0 _ll_register_callbacks cb 0x5588a1c019b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:32:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.137+0000 7f4476ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588a1cdcbd0 0x5588a1ce6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.137+0000 7f4476ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588a1cdcbd0 0x5588a1ce6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:50260/0 (socket says 172.21.15.50:50260) 2024-06-06T03:32:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.137+0000 7f4476ffd640 1 -- 172.21.15.50:0/319427826 learned_addr learned my addr 172.21.15.50:0/319427826 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.138+0000 7f4477fff640 1 --2- 172.21.15.50:0/319427826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588a1ce1d40 0x5588a1ced950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.139+0000 7f4476ffd640 1 -- 172.21.15.50:0/319427826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588a1cdc1e0 msgr2=0x5588a1ce6440 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:32:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.139+0000 7f4476ffd640 1 --2- 172.21.15.50:0/319427826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588a1cdc1e0 0x5588a1ce6440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.139+0000 7f4476ffd640 1 -- 172.21.15.50:0/319427826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588a1ce1d40 msgr2=0x5588a1ced950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.139+0000 7f4476ffd640 1 --2- 172.21.15.50:0/319427826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588a1ce1d40 0x5588a1ced950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.139+0000 7f4476ffd640 1 -- 172.21.15.50:0/319427826 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588a1953210 con 0x5588a1cdcbd0 2024-06-06T03:32:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.141+0000 7f4476ffd640 1 --2- 172.21.15.50:0/319427826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588a1cdcbd0 0x5588a1ce6980 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4468035040 tx=0x7f44680043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56f435ee9a32023b server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:22.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.145+0000 7f4456ffd640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:32:22.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.145+0000 7f4456ffd640 1 -- 172.21.15.50:0/319427826 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4468040020 con 0x5588a1cdcbd0 2024-06-06T03:32:22.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.145+0000 7f4456ffd640 1 -- 172.21.15.50:0/319427826 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f4468005240 con 0x5588a1cdcbd0 2024-06-06T03:32:22.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.145+0000 7f44809f0740 1 -- 172.21.15.50:0/319427826 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f446c01a040 con 0x5588a1cdcbd0 2024-06-06T03:32:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.149+0000 7f4456ffd640 1 -- 172.21.15.50:0/319427826 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f4468037040 con 0x5588a1cdcbd0 2024-06-06T03:32:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.149+0000 7f44809f0740 10 client.25864 fetch_fsmap learned FSMap version 33 2024-06-06T03:32:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.149+0000 7f44809f0740 1 -- 172.21.15.50:0/319427826 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5588a1a1f620 con 0x5588a1cdcbd0 2024-06-06T03:32:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.154+0000 7f4456ffd640 1 -- 172.21.15.50:0/319427826 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f446c01a040 con 0x5588a1cdcbd0 2024-06-06T03:32:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.154+0000 7f4456ffd640 1 -- 172.21.15.50:0/319427826 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f44680035f0 con 0x5588a1cdcbd0 2024-06-06T03:32:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.154+0000 7f44809f0740 10 client.25864 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:32:22.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.154+0000 7f44809f0740 10 client.25864 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:32:22.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.154+0000 7f44809f0740 20 client.25864 populate_metadata read hostname 'smithi050' 2024-06-06T03:32:22.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.154+0000 7f44809f0740 1 --2- 172.21.15.50:0/319427826 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5588a1d146d0 0x5588a1d16b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:22.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.154+0000 7f44809f0740 4 client.25864 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:32:22.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.154+0000 7f44809f0740 1 -- 172.21.15.50:0/319427826 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588a1c52f10 con 0x5588a1d146d0 2024-06-06T03:32:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.164+0000 7f44777fe640 1 --2- 172.21.15.50:0/319427826 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5588a1d146d0 0x5588a1d16b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:22.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.168+0000 7f44777fe640 1 --2- 172.21.15.50:0/319427826 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5588a1d146d0 0x5588a1d16b70 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54a9d62a61b1053a server_cookie=d0bbfc860892f755 in_seq=0 out_seq=0 2024-06-06T03:32:22.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.168+0000 7f4456ffd640 10 client.25864 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:32:22.171 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.170+0000 7f4456ffd640 1 -- 172.21.15.50:0/319427826 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5588a1c52f10 con 0x5588a1d146d0 2024-06-06T03:32:22.173 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.170+0000 7f4456ffd640 10 client.25864 handle_command_reply: tid=0 2024-06-06T03:32:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.170+0000 7f44809f0740 1 client.25864 shutdown 2024-06-06T03:32:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.171+0000 7f44809f0740 1 -- 172.21.15.50:0/319427826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588a1cdcbd0 msgr2=0x5588a1ce6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.171+0000 7f44809f0740 1 --2- 172.21.15.50:0/319427826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588a1cdcbd0 0x5588a1ce6980 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4468035040 tx=0x7f44680043b0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.173+0000 7f44809f0740 1 -- 172.21.15.50:0/319427826 shutdown_connections 2024-06-06T03:32:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.173+0000 7f44809f0740 1 --2- 172.21.15.50:0/319427826 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5588a1d146d0 0x5588a1d16b70 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.173+0000 7f44809f0740 1 --2- 172.21.15.50:0/319427826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588a1ce1d40 0x5588a1ced950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.173+0000 7f44809f0740 1 --2- 172.21.15.50:0/319427826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588a1cdcbd0 0x5588a1ce6980 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.175 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.173+0000 7f44809f0740 1 --2- 172.21.15.50:0/319427826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588a1cdc1e0 0x5588a1ce6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.175 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.173+0000 7f44809f0740 1 -- 172.21.15.50:0/319427826 >> 172.21.15.50:0/319427826 conn(0x5588a1cd7850 msgr2=0x5588a1cd69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:22.175 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.173+0000 7f4456ffd640 0 client.25864 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:32:22.184 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.185+0000 7f44809f0740 1 -- 172.21.15.50:0/319427826 shutdown_connections 2024-06-06T03:32:22.186 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.186+0000 7f44809f0740 1 -- 172.21.15.50:0/319427826 wait complete. 2024-06-06T03:32:22.186 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.186+0000 7f44809f0740 20 client.25864 trim_cache size 0 max 16384 2024-06-06T03:32:22.247 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.248+0000 7f44809f0740 1 Processor -- start 2024-06-06T03:32:22.247 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.248+0000 7f44809f0740 1 -- start start 2024-06-06T03:32:22.249 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.249+0000 7f44809f0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588a1cdc1e0 0x5588a1d166e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:22.249 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.249+0000 7f44809f0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588a1cdcbd0 0x5588a1ced910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:22.249 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.249+0000 7f44809f0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588a1ce1d40 0x5588a1ce5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:22.249 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.249+0000 7f44777fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588a1cdc1e0 0x5588a1d166e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:22.249 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.249+0000 7f44777fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588a1cdc1e0 0x5588a1d166e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:50264/0 (socket says 172.21.15.50:50264) 2024-06-06T03:32:22.249 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.249+0000 7f4476ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588a1cdcbd0 0x5588a1ced910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:22.249 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.249+0000 7f4476ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588a1cdcbd0 0x5588a1ced910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:54868/0 (socket says 172.21.15.50:54868) 2024-06-06T03:32:22.249 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.249+0000 7f44777fe640 1 -- 172.21.15.50:0/3349902321 learned_addr learned my addr 172.21.15.50:0/3349902321 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:22.249 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.249+0000 7f44809f0740 1 -- 172.21.15.50:0/3349902321 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4464012530 con 0x5588a1ce1d40 2024-06-06T03:32:22.249 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.249+0000 7f44809f0740 1 -- 172.21.15.50:0/3349902321 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f446400fe00 con 0x5588a1cdcbd0 2024-06-06T03:32:22.249 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.249+0000 7f44809f0740 1 -- 172.21.15.50:0/3349902321 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f446400dc50 con 0x5588a1cdc1e0 2024-06-06T03:32:22.249 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.250+0000 7f44777fe640 1 -- 172.21.15.50:0/3349902321 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588a1cdcbd0 msgr2=0x5588a1ced910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:22.249 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.250+0000 7f44777fe640 1 --2- 172.21.15.50:0/3349902321 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588a1cdcbd0 0x5588a1ced910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.250 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.250+0000 7f44777fe640 1 -- 172.21.15.50:0/3349902321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588a1ce1d40 msgr2=0x5588a1ce5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:22.250 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.250+0000 7f44777fe640 1 --2- 172.21.15.50:0/3349902321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588a1ce1d40 0x5588a1ce5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.250 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.250+0000 7f44777fe640 1 -- 172.21.15.50:0/3349902321 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588a1ce72e0 con 0x5588a1cdc1e0 2024-06-06T03:32:22.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.254+0000 7f44777fe640 1 --2- 172.21.15.50:0/3349902321 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588a1cdc1e0 0x5588a1d166e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f446c00ee20 tx=0x7f446c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=baa5e743d94f724d server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:22.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.259+0000 7f445d7fa640 1 -- 172.21.15.50:0/3349902321 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446c004050 con 0x5588a1cdc1e0 2024-06-06T03:32:22.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.259+0000 7f445d7fa640 1 -- 172.21.15.50:0/3349902321 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f446c01a030 con 0x5588a1cdc1e0 2024-06-06T03:32:22.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.260+0000 7f44809f0740 1 -- 172.21.15.50:0/3349902321 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588a1cdc1e0 msgr2=0x5588a1d166e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:22.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.260+0000 7f44809f0740 1 --2- 172.21.15.50:0/3349902321 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588a1cdc1e0 0x5588a1d166e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f446c00ee20 tx=0x7f446c017000 comp rx=0 tx=0).stop 2024-06-06T03:32:22.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.260+0000 7f44809f0740 1 -- 172.21.15.50:0/3349902321 shutdown_connections 2024-06-06T03:32:22.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.260+0000 7f44809f0740 1 --2- 172.21.15.50:0/3349902321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588a1ce1d40 0x5588a1ce5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.260+0000 7f44809f0740 1 --2- 172.21.15.50:0/3349902321 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588a1cdcbd0 0x5588a1ced910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.260+0000 7f44809f0740 1 --2- 172.21.15.50:0/3349902321 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588a1cdc1e0 0x5588a1d166e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.260+0000 7f44809f0740 1 -- 172.21.15.50:0/3349902321 >> 172.21.15.50:0/3349902321 conn(0x5588a1cd7850 msgr2=0x5588a1ce6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:22.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.260+0000 7f44809f0740 1 -- 172.21.15.50:0/3349902321 shutdown_connections 2024-06-06T03:32:22.260 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.260+0000 7f44809f0740 1 -- 172.21.15.50:0/3349902321 wait complete. 2024-06-06T03:32:22.260 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.261+0000 7f44809f0740 1 -- start start 2024-06-06T03:32:22.260 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.261+0000 7f44809f0740 1 Processor -- start 2024-06-06T03:32:22.260 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.261+0000 7f44809f0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588a1cdcbd0 0x5588a1ced560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:22.260 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.262+0000 7f44809f0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588a1ce1d40 0x5588a1cea000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:22.261 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.262+0000 7f44809f0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588a1cea540 0x5588a1d7d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:22.261 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.262+0000 7f44809f0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f446400e2c0 con 0x5588a1ce1d40 2024-06-06T03:32:22.262 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.262+0000 7f44809f0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f446400f730 con 0x5588a1cea540 2024-06-06T03:32:22.262 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.262+0000 7f44809f0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f446400e990 con 0x5588a1cdcbd0 2024-06-06T03:32:22.262 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.262+0000 7f4477fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588a1cea540 0x5588a1d7d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:22.262 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.262+0000 7f4477fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588a1cea540 0x5588a1d7d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:54882/0 (socket says 172.21.15.50:54882) 2024-06-06T03:32:22.262 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.262+0000 7f4477fff640 1 -- 172.21.15.50:0/53776012 learned_addr learned my addr 172.21.15.50:0/53776012 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:22.262 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.262+0000 7f44809f0740 10 client.0 _ll_register_callbacks cb 0x7f4468004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:32:22.262 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.263+0000 7f4477fff640 1 -- 172.21.15.50:0/53776012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588a1cdcbd0 msgr2=0x5588a1ced560 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:32:22.262 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.263+0000 7f4477fff640 1 --2- 172.21.15.50:0/53776012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588a1cdcbd0 0x5588a1ced560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.262 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.263+0000 7f4477fff640 1 -- 172.21.15.50:0/53776012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588a1ce1d40 msgr2=0x5588a1cea000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:22.262 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.263+0000 7f4477fff640 1 --2- 172.21.15.50:0/53776012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588a1ce1d40 0x5588a1cea000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.262 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.263+0000 7f4477fff640 1 -- 172.21.15.50:0/53776012 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588a1cea9c0 con 0x5588a1cea540 2024-06-06T03:32:22.263 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.263+0000 7f4477fff640 1 --2- 172.21.15.50:0/53776012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588a1cea540 0x5588a1d7d410 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f44700ccc40 tx=0x7f447009c0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f5457765724a632 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:22.269 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.270+0000 7f4456ffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:32:22.269 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.270+0000 7f4456ffd640 1 -- 172.21.15.50:0/53776012 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44700cf040 con 0x5588a1cea540 2024-06-06T03:32:22.269 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.270+0000 7f44809f0740 1 -- 172.21.15.50:0/53776012 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5588a1c4cc20 con 0x5588a1cea540 2024-06-06T03:32:22.269 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.270+0000 7f4456ffd640 1 -- 172.21.15.50:0/53776012 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f447009bc00 con 0x5588a1cea540 2024-06-06T03:32:22.270 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.270+0000 7f4456ffd640 1 -- 172.21.15.50:0/53776012 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f44700a4610 con 0x5588a1cea540 2024-06-06T03:32:22.270 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.271+0000 7f44809f0740 10 client.25886 fetch_fsmap learned FSMap version 33 2024-06-06T03:32:22.270 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.271+0000 7f44809f0740 1 -- 172.21.15.50:0/53776012 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5588a1d7e920 con 0x5588a1cea540 2024-06-06T03:32:22.270 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.271+0000 7f4456ffd640 1 -- 172.21.15.50:0/53776012 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x5588a1c4cc20 con 0x5588a1cea540 2024-06-06T03:32:22.270 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.271+0000 7f4456ffd640 1 -- 172.21.15.50:0/53776012 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f447000b030 con 0x5588a1cea540 2024-06-06T03:32:22.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.272+0000 7f44809f0740 10 client.25886 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:32:22.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.272+0000 7f44809f0740 10 client.25886 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:32:22.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.272+0000 7f44809f0740 20 client.25886 populate_metadata read hostname 'smithi050' 2024-06-06T03:32:22.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.272+0000 7f44809f0740 1 --2- 172.21.15.50:0/53776012 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5588a1d7f3c0 0x5588a1d817e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:22.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.272+0000 7f44809f0740 4 client.25886 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:32:22.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.272+0000 7f44809f0740 1 -- 172.21.15.50:0/53776012 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5588a1c46f70 con 0x5588a1d7f3c0 2024-06-06T03:32:22.280 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.282+0000 7f44777fe640 1 --2- 172.21.15.50:0/53776012 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5588a1d7f3c0 0x5588a1d817e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:22.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.294+0000 7f4456ffd640 10 client.25886 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:32:22.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.294+0000 7f44777fe640 1 --2- 172.21.15.50:0/53776012 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5588a1d7f3c0 0x5588a1d817e0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68cc8c84f70a6130 server_cookie=9c4c7cfe5214c8ef in_seq=0 out_seq=0 2024-06-06T03:32:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.357+0000 7f4456ffd640 1 -- 172.21.15.50:0/53776012 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5588a1c46f70 con 0x5588a1d7f3c0 2024-06-06T03:32:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.357+0000 7f4456ffd640 10 client.25886 handle_command_reply: tid=0 2024-06-06T03:32:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.357+0000 7f44809f0740 1 client.25886 shutdown 2024-06-06T03:32:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.368+0000 7f44809f0740 1 -- 172.21.15.50:0/53776012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588a1cea540 msgr2=0x5588a1d7d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.368+0000 7f44809f0740 1 --2- 172.21.15.50:0/53776012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588a1cea540 0x5588a1d7d410 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f44700ccc40 tx=0x7f447009c0a0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.369+0000 7f44809f0740 1 -- 172.21.15.50:0/53776012 shutdown_connections 2024-06-06T03:32:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.369+0000 7f44809f0740 1 --2- 172.21.15.50:0/53776012 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5588a1d7f3c0 0x5588a1d817e0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.369+0000 7f44809f0740 1 --2- 172.21.15.50:0/53776012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588a1ce1d40 0x5588a1cea000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.369+0000 7f44809f0740 1 --2- 172.21.15.50:0/53776012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588a1cea540 0x5588a1d7d410 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.369+0000 7f44809f0740 1 --2- 172.21.15.50:0/53776012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588a1cdcbd0 0x5588a1ced560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.369+0000 7f44809f0740 1 -- 172.21.15.50:0/53776012 >> 172.21.15.50:0/53776012 conn(0x5588a1cd7850 msgr2=0x5588a1ce5710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.369+0000 7f4456ffd640 0 client.25886 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:32:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.369+0000 7f44809f0740 1 -- 172.21.15.50:0/53776012 shutdown_connections 2024-06-06T03:32:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.369+0000 7f44809f0740 1 -- 172.21.15.50:0/53776012 wait complete. 2024-06-06T03:32:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.369+0000 7f44809f0740 20 client.25886 trim_cache size 0 max 16384 2024-06-06T03:32:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:32:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:32:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:32:22.385 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.386+0000 7f447dce7640 1 -- 172.21.15.50:0/412034798 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f44600a2d90 msgr2=0x7f44600a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:22.385 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.386+0000 7f447dce7640 1 --2- 172.21.15.50:0/412034798 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f44600a2d90 0x7f44600a5250 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f446c00aa10 tx=0x7f446c00a330 comp rx=0 tx=0).stop 2024-06-06T03:32:22.385 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.386+0000 7f447dce7640 1 -- 172.21.15.50:0/412034798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f44781183a0 msgr2=0x7f4478118850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:22.385 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.386+0000 7f447dce7640 1 --2- 172.21.15.50:0/412034798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f44781183a0 0x7f4478118850 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f447000eda0 tx=0x7f447000c6e0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.386 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.387+0000 7f447dce7640 1 -- 172.21.15.50:0/412034798 shutdown_connections 2024-06-06T03:32:22.386 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.387+0000 7f447dce7640 1 --2- 172.21.15.50:0/412034798 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f44600a2d90 0x7f44600a5250 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.386 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.387+0000 7f447dce7640 1 --2- 172.21.15.50:0/412034798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f44781183a0 0x7f4478118850 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.386 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.387+0000 7f447dce7640 1 --2- 172.21.15.50:0/412034798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44781099e0 0x7f447811a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.386 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.387+0000 7f447dce7640 1 --2- 172.21.15.50:0/412034798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4478072d90 0x7f4478119d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:22.386 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.387+0000 7f447dce7640 1 -- 172.21.15.50:0/412034798 >> 172.21.15.50:0/412034798 conn(0x7f447806e840 msgr2=0x7f447810c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:22.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.391+0000 7f447dce7640 1 -- 172.21.15.50:0/412034798 shutdown_connections 2024-06-06T03:32:22.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:22.391+0000 7f447dce7640 1 -- 172.21.15.50:0/412034798 wait complete. 2024-06-06T03:32:22.854 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:32:22.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:22 smithi122 ceph-mon[35759]: pgmap v603: 129 pgs: 129 active+clean; 10 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 39 MiB/s wr, 638 op/s 2024-06-06T03:32:23.003 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:22 smithi050 ceph-mon[32421]: pgmap v603: 129 pgs: 129 active+clean; 10 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 39 MiB/s wr, 638 op/s 2024-06-06T03:32:23.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:22 smithi079 ceph-mon[35478]: pgmap v603: 129 pgs: 129 active+clean; 10 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 39 MiB/s wr, 638 op/s 2024-06-06T03:32:23.674 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:23 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:32:23.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:23 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:32:24.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:23 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:32:24.816 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:24 smithi050 ceph-mon[32421]: pgmap v604: 129 pgs: 129 active+clean; 10 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 40 MiB/s wr, 655 op/s 2024-06-06T03:32:24.816 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:24 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:32:24.816 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:24 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:32:24.817 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:24 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:32:24.817 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:24 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:32:24.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:24 smithi122 ceph-mon[35759]: pgmap v604: 129 pgs: 129 active+clean; 10 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 40 MiB/s wr, 655 op/s 2024-06-06T03:32:24.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:24 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:32:24.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:24 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:32:24.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:24 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:32:24.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:24 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:32:25.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:24 smithi079 ceph-mon[35478]: pgmap v604: 129 pgs: 129 active+clean; 10 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 40 MiB/s wr, 655 op/s 2024-06-06T03:32:25.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:24 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:32:25.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:24 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:32:25.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:24 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:32:25.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:24 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-06T03:32:25.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:25 smithi122 ceph-mon[35759]: Adjusting osd_memory_target on smithi122 to 176.1M 2024-06-06T03:32:25.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:25 smithi122 ceph-mon[35759]: Unable to set osd_memory_target on smithi122 to 184675635: error parsing value: Value '184675635' is below minimum 939524096 2024-06-06T03:32:25.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:25 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:32:25.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:25 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:32:25.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:25 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:32:26.008 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:25 smithi050 ceph-mon[32421]: Adjusting osd_memory_target on smithi122 to 176.1M 2024-06-06T03:32:26.009 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:25 smithi050 ceph-mon[32421]: Unable to set osd_memory_target on smithi122 to 184675635: error parsing value: Value '184675635' is below minimum 939524096 2024-06-06T03:32:26.009 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:25 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:32:26.009 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:25 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:32:26.009 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:25 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:32:26.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:25 smithi079 ceph-mon[35478]: Adjusting osd_memory_target on smithi122 to 176.1M 2024-06-06T03:32:26.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:25 smithi079 ceph-mon[35478]: Unable to set osd_memory_target on smithi122 to 184675635: error parsing value: Value '184675635' is below minimum 939524096 2024-06-06T03:32:26.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:25 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:32:26.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:25 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:32:26.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:25 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:32:27.028 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:32:27.028 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2024-06-06T03:32:27.028 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-06-06T03:32:27.028 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:32:27.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.052+0000 7f84d116b700 1 -- 172.21.15.50:0/298082569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84cc1073f0 msgr2=0x7f84cc06ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:27.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.052+0000 7f84d116b700 1 --2- 172.21.15.50:0/298082569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84cc1073f0 0x7f84cc06ab90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f84bc009990 tx=0x7f84bc009ca0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.052+0000 7f84d116b700 1 -- 172.21.15.50:0/298082569 shutdown_connections 2024-06-06T03:32:27.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.052+0000 7f84d116b700 1 --2- 172.21.15.50:0/298082569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84cc104f00 0x7f84cc105390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.052+0000 7f84d116b700 1 --2- 172.21.15.50:0/298082569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84cc1073f0 0x7f84cc06ab90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.052+0000 7f84d116b700 1 --2- 172.21.15.50:0/298082569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84cc06b0d0 0x7f84cc06b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.052+0000 7f84d116b700 1 -- 172.21.15.50:0/298082569 >> 172.21.15.50:0/298082569 conn(0x7f84cc0783d0 msgr2=0x7f84cc0787e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:27.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.052+0000 7f84d116b700 1 -- 172.21.15.50:0/298082569 shutdown_connections 2024-06-06T03:32:27.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.055+0000 7f84d116b700 1 -- 172.21.15.50:0/298082569 wait complete. 2024-06-06T03:32:27.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.056+0000 7f84d116b700 1 Processor -- start 2024-06-06T03:32:27.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.058+0000 7f84d116b700 1 -- start start 2024-06-06T03:32:27.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.058+0000 7f84d116b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84cc06b0d0 0x7f84cc19f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:27.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.058+0000 7f84d116b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84cc104f00 0x7f84cc19f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:27.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.058+0000 7f84d116b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84cc1073f0 0x7f84cc1a3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:27.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.058+0000 7f84d116b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f84cc118da0 con 0x7f84cc1073f0 2024-06-06T03:32:27.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.058+0000 7f84d116b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f84cc118c20 con 0x7f84cc104f00 2024-06-06T03:32:27.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.058+0000 7f84d116b700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f84cc118f20 con 0x7f84cc06b0d0 2024-06-06T03:32:27.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.059+0000 7f84cb59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84cc1073f0 0x7f84cc1a3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:27.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.059+0000 7f84cb59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84cc1073f0 0x7f84cc1a3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44694/0 (socket says 172.21.15.50:44694) 2024-06-06T03:32:27.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.059+0000 7f84cb59e700 1 -- 172.21.15.50:0/2793298487 learned_addr learned my addr 172.21.15.50:0/2793298487 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:27.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.059+0000 7f84ca59c700 1 --2- 172.21.15.50:0/2793298487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84cc104f00 0x7f84cc19f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:27.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.059+0000 7f84cad9d700 1 --2- 172.21.15.50:0/2793298487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84cc06b0d0 0x7f84cc19f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:27.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.060+0000 7f84cb59e700 1 -- 172.21.15.50:0/2793298487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84cc06b0d0 msgr2=0x7f84cc19f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:27.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.060+0000 7f84cb59e700 1 --2- 172.21.15.50:0/2793298487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84cc06b0d0 0x7f84cc19f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.060+0000 7f84cb59e700 1 -- 172.21.15.50:0/2793298487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84cc104f00 msgr2=0x7f84cc19f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:27.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.060+0000 7f84cb59e700 1 --2- 172.21.15.50:0/2793298487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84cc104f00 0x7f84cc19f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.060+0000 7f84cb59e700 1 -- 172.21.15.50:0/2793298487 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84cc1a4300 con 0x7f84cc1073f0 2024-06-06T03:32:27.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.060+0000 7f84cb59e700 1 --2- 172.21.15.50:0/2793298487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84cc1073f0 0x7f84cc1a3bc0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f84c400b970 tx=0x7f84c400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:27.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.061+0000 7f84b3fff700 1 -- 172.21.15.50:0/2793298487 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c4019070 con 0x7f84cc1073f0 2024-06-06T03:32:27.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.061+0000 7f84b3fff700 1 -- 172.21.15.50:0/2793298487 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f84c400cde0 con 0x7f84cc1073f0 2024-06-06T03:32:27.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.061+0000 7f84b3fff700 1 -- 172.21.15.50:0/2793298487 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c4007370 con 0x7f84cc1073f0 2024-06-06T03:32:27.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.061+0000 7f84d116b700 1 -- 172.21.15.50:0/2793298487 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84cc1a45f0 con 0x7f84cc1073f0 2024-06-06T03:32:27.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.061+0000 7f84d116b700 1 -- 172.21.15.50:0/2793298487 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84cc06beb0 con 0x7f84cc1073f0 2024-06-06T03:32:27.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.065+0000 7f84b3fff700 1 -- 172.21.15.50:0/2793298487 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f84c401c070 con 0x7f84cc1073f0 2024-06-06T03:32:27.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.066+0000 7f84b3fff700 1 --2- 172.21.15.50:0/2793298487 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f84b40a2d70 0x7f84b40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:27.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.067+0000 7f84cad9d700 1 --2- 172.21.15.50:0/2793298487 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f84b40a2d70 0x7f84b40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:27.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.070+0000 7f84cad9d700 1 --2- 172.21.15.50:0/2793298487 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f84b40a2d70 0x7f84b40a5230 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f84bc000c00 tx=0x7f84bc005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:27.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.071+0000 7f84b3fff700 1 -- 172.21.15.50:0/2793298487 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f84c4099ba0 con 0x7f84cc1073f0 2024-06-06T03:32:27.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.072+0000 7f84db9eeb80 1 Processor -- start 2024-06-06T03:32:27.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.074+0000 7f84db9eeb80 1 -- start start 2024-06-06T03:32:27.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.074+0000 7f84db9eeb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d17a4e6640 0x55d17a4e6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:27.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.074+0000 7f84db9eeb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a4e6f60 0x55d17a4e09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:27.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.074+0000 7f84db9eeb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d17a4e0f20 0x55d17a4e1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:27.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.075+0000 7f84db9eeb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d17a432810 con 0x55d17a4e0f20 2024-06-06T03:32:27.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.075+0000 7f84ca59c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a4e6f60 0x55d17a4e09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:27.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.075+0000 7f84ca59c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a4e6f60 0x55d17a4e09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:50314/0 (socket says 172.21.15.50:50314) 2024-06-06T03:32:27.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.075+0000 7f84ca59c700 1 -- 172.21.15.50:0/2168364830 learned_addr learned my addr 172.21.15.50:0/2168364830 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:27.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.075+0000 7f84db9eeb80 1 -- 172.21.15.50:0/2168364830 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d17a3da720 con 0x55d17a4e6640 2024-06-06T03:32:27.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.075+0000 7f84db9eeb80 1 -- 172.21.15.50:0/2168364830 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d17a42e7d0 con 0x55d17a4e6f60 2024-06-06T03:32:27.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.076+0000 7f84cb59e700 1 --2- 172.21.15.50:0/2168364830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d17a4e0f20 0x55d17a4e1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:27.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.076+0000 7f84cad9d700 1 --2- 172.21.15.50:0/2168364830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d17a4e6640 0x55d17a4e6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:27.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.076+0000 7f84cb59e700 1 -- 172.21.15.50:0/2168364830 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a4e6f60 msgr2=0x55d17a4e09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:27.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.076+0000 7f84cb59e700 1 --2- 172.21.15.50:0/2168364830 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a4e6f60 0x55d17a4e09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.076+0000 7f84cb59e700 1 -- 172.21.15.50:0/2168364830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d17a4e6640 msgr2=0x55d17a4e6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:27.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.077+0000 7f84cb59e700 1 --2- 172.21.15.50:0/2168364830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d17a4e6640 0x55d17a4e6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.077+0000 7f84cb59e700 1 -- 172.21.15.50:0/2168364830 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d17a3d0f50 con 0x55d17a4e0f20 2024-06-06T03:32:27.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.077+0000 7f84cad9d700 1 --2- 172.21.15.50:0/2168364830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d17a4e6640 0x55d17a4e6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:32:27.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.077+0000 7f84ca59c700 1 --2- 172.21.15.50:0/2168364830 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a4e6f60 0x55d17a4e09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:32:27.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.077+0000 7f84cb59e700 1 --2- 172.21.15.50:0/2168364830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d17a4e0f20 0x55d17a4e1340 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f84c4097f60 tx=0x7f84c409c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41cb1b9073d1f1b5 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:27.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.077+0000 7f84b17fa700 1 -- 172.21.15.50:0/2168364830 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c40a4770 con 0x55d17a4e0f20 2024-06-06T03:32:27.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.077+0000 7f84b17fa700 1 -- 172.21.15.50:0/2168364830 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f84c40a42e0 con 0x55d17a4e0f20 2024-06-06T03:32:27.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.078+0000 7f84db9eeb80 1 -- 172.21.15.50:0/2168364830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d17a4e0f20 msgr2=0x55d17a4e1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:27.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.078+0000 7f84db9eeb80 1 --2- 172.21.15.50:0/2168364830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d17a4e0f20 0x55d17a4e1340 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f84c4097f60 tx=0x7f84c409c280 comp rx=0 tx=0).stop 2024-06-06T03:32:27.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.083+0000 7f84db9eeb80 1 -- 172.21.15.50:0/2168364830 shutdown_connections 2024-06-06T03:32:27.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.083+0000 7f84db9eeb80 1 --2- 172.21.15.50:0/2168364830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d17a4e0f20 0x55d17a4e1340 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.083+0000 7f84db9eeb80 1 --2- 172.21.15.50:0/2168364830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d17a4e6640 0x55d17a4e6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.083+0000 7f84db9eeb80 1 --2- 172.21.15.50:0/2168364830 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a4e6f60 0x55d17a4e09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.083+0000 7f84db9eeb80 1 -- 172.21.15.50:0/2168364830 >> 172.21.15.50:0/2168364830 conn(0x55d17a40bcc0 msgr2=0x55d17a4db850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:27.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.089+0000 7f84db9eeb80 1 -- 172.21.15.50:0/2168364830 shutdown_connections 2024-06-06T03:32:27.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.089+0000 7f84db9eeb80 1 -- 172.21.15.50:0/2168364830 wait complete. 2024-06-06T03:32:27.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.090+0000 7f84db9eeb80 1 -- start start 2024-06-06T03:32:27.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.090+0000 7f84db9eeb80 1 Processor -- start 2024-06-06T03:32:27.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.090+0000 7f84db9eeb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d17a4e0f20 0x55d17a4ecd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:27.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.091+0000 7f84db9eeb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d17a4e6640 0x55d17a4ea010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:27.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.091+0000 7f84db9eeb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a4e6f60 0x55d17a4ea550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:27.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.091+0000 7f84db9eeb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d17a4eda70 con 0x55d17a4e6640 2024-06-06T03:32:27.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.091+0000 7f84db9eeb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d17a3d2bf0 con 0x55d17a4e0f20 2024-06-06T03:32:27.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.091+0000 7f84db9eeb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d17a4edbf0 con 0x55d17a4e6f60 2024-06-06T03:32:27.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.091+0000 7f84db9eeb80 10 client.0 _ll_register_callbacks cb 0x55d17a3cc920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:32:27.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.092+0000 7f84ca59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d17a4e6640 0x55d17a4ea010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:27.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.092+0000 7f84ca59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d17a4e6640 0x55d17a4ea010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44702/0 (socket says 172.21.15.50:44702) 2024-06-06T03:32:27.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.092+0000 7f84ca59c700 1 -- 172.21.15.50:0/923533816 learned_addr learned my addr 172.21.15.50:0/923533816 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:27.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.092+0000 7f84ca59c700 1 -- 172.21.15.50:0/923533816 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a4e6f60 msgr2=0x55d17a4ea550 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:32:27.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.092+0000 7f84ca59c700 1 --2- 172.21.15.50:0/923533816 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a4e6f60 0x55d17a4ea550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.092+0000 7f84ca59c700 1 -- 172.21.15.50:0/923533816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d17a4e0f20 msgr2=0x55d17a4ecd10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:32:27.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.092+0000 7f84ca59c700 1 --2- 172.21.15.50:0/923533816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d17a4e0f20 0x55d17a4ecd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.093+0000 7f84ca59c700 1 -- 172.21.15.50:0/923533816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d17a3818d0 con 0x55d17a4e6640 2024-06-06T03:32:27.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.093+0000 7f84ca59c700 1 --2- 172.21.15.50:0/923533816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d17a4e6640 0x55d17a4ea010 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f84c00104a0 tx=0x7f84c0010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d52a947de84ed191 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:27.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.093+0000 7f84aeff5700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:32:27.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.094+0000 7f84aeff5700 1 -- 172.21.15.50:0/923533816 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c0018070 con 0x55d17a4e6640 2024-06-06T03:32:27.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.094+0000 7f84db9eeb80 1 -- 172.21.15.50:0/923533816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d17a43fd10 con 0x55d17a4e6640 2024-06-06T03:32:27.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.094+0000 7f84aeff5700 1 -- 172.21.15.50:0/923533816 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f84c0014800 con 0x55d17a4e6640 2024-06-06T03:32:27.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.095+0000 7f84aeff5700 1 -- 172.21.15.50:0/923533816 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f84c0024050 con 0x55d17a4e6640 2024-06-06T03:32:27.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.095+0000 7f84db9eeb80 10 client.16263 fetch_fsmap learned FSMap version 33 2024-06-06T03:32:27.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.095+0000 7f84db9eeb80 1 -- 172.21.15.50:0/923533816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55d17a4f8500 con 0x55d17a4e6640 2024-06-06T03:32:27.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.096+0000 7f84aeff5700 1 -- 172.21.15.50:0/923533816 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55d17a43fd10 con 0x55d17a4e6640 2024-06-06T03:32:27.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.096+0000 7f84aeff5700 1 -- 172.21.15.50:0/923533816 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f84c001c990 con 0x55d17a4e6640 2024-06-06T03:32:27.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.096+0000 7f84db9eeb80 10 client.16263 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:32:27.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.096+0000 7f84db9eeb80 10 client.16263 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:32:27.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.096+0000 7f84db9eeb80 20 client.16263 populate_metadata read hostname 'smithi050' 2024-06-06T03:32:27.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.096+0000 7f84db9eeb80 1 --2- 172.21.15.50:0/923533816 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d17a4faf20 0x55d17a4fd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:27.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.096+0000 7f84db9eeb80 4 client.16263 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:32:27.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.096+0000 7f84db9eeb80 1 -- 172.21.15.50:0/923533816 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d17a43a290 con 0x55d17a4faf20 2024-06-06T03:32:27.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.100+0000 7f84cad9d700 1 --2- 172.21.15.50:0/923533816 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d17a4faf20 0x55d17a4fd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:27.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.101+0000 7f84cad9d700 1 --2- 172.21.15.50:0/923533816 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d17a4faf20 0x55d17a4fd340 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afe1c97ce161f6bc server_cookie=f35af4d76398d88d in_seq=0 out_seq=0 2024-06-06T03:32:27.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.101+0000 7f84aeff5700 10 client.16263 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:32:27.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.102+0000 7f84aeff5700 1 -- 172.21.15.50:0/923533816 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d17a43a290 con 0x55d17a4faf20 2024-06-06T03:32:27.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.102+0000 7f84aeff5700 10 client.16263 handle_command_reply: tid=0 2024-06-06T03:32:27.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.102+0000 7f84db9eeb80 1 client.16263 shutdown 2024-06-06T03:32:27.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.102+0000 7f84db9eeb80 1 -- 172.21.15.50:0/923533816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d17a4e6640 msgr2=0x55d17a4ea010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:27.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.102+0000 7f84db9eeb80 1 --2- 172.21.15.50:0/923533816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d17a4e6640 0x55d17a4ea010 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f84c00104a0 tx=0x7f84c0010860 comp rx=0 tx=0).stop 2024-06-06T03:32:27.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.102+0000 7f84db9eeb80 1 -- 172.21.15.50:0/923533816 shutdown_connections 2024-06-06T03:32:27.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.102+0000 7f84db9eeb80 1 --2- 172.21.15.50:0/923533816 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d17a4faf20 0x55d17a4fd340 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.102+0000 7f84db9eeb80 1 --2- 172.21.15.50:0/923533816 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a4e6f60 0x55d17a4ea550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.102+0000 7f84db9eeb80 1 --2- 172.21.15.50:0/923533816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d17a4e0f20 0x55d17a4ecd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.102+0000 7f84db9eeb80 1 --2- 172.21.15.50:0/923533816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d17a4e6640 0x55d17a4ea010 secure :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f84c00104a0 tx=0x7f84c0010860 comp rx=0 tx=0).stop 2024-06-06T03:32:27.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.102+0000 7f84db9eeb80 1 -- 172.21.15.50:0/923533816 >> 172.21.15.50:0/923533816 conn(0x55d17a40bcc0 msgr2=0x55d17a4df9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.102+0000 7f84aeff5700 0 client.16263 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:32:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.103+0000 7f84db9eeb80 1 -- 172.21.15.50:0/923533816 shutdown_connections 2024-06-06T03:32:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.109+0000 7f84db9eeb80 1 -- 172.21.15.50:0/923533816 wait complete. 2024-06-06T03:32:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.109+0000 7f84db9eeb80 20 client.16263 trim_cache size 0 max 16384 2024-06-06T03:32:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.144+0000 7f84db9eeb80 1 Processor -- start 2024-06-06T03:32:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.144+0000 7f84db9eeb80 1 -- start start 2024-06-06T03:32:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.145+0000 7f84db9eeb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d17a4e0f20 0x55d17a4e09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.145+0000 7f84db9eeb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a4e6f60 0x55d17a4ea6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.145+0000 7f84db9eeb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d17a4f6dc0 0x55d17a502c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.145+0000 7f84db9eeb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f84b8011420 con 0x55d17a4f6dc0 2024-06-06T03:32:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.145+0000 7f84db9eeb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f84b800ecb0 con 0x55d17a4e0f20 2024-06-06T03:32:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.145+0000 7f84db9eeb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f84b800cb00 con 0x55d17a4e6f60 2024-06-06T03:32:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.145+0000 7f84cb59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d17a4f6dc0 0x55d17a502c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:27.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.145+0000 7f84cb59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d17a4f6dc0 0x55d17a502c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44712/0 (socket says 172.21.15.50:44712) 2024-06-06T03:32:27.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.145+0000 7f84cb59e700 1 -- 172.21.15.50:0/3809248045 learned_addr learned my addr 172.21.15.50:0/3809248045 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:27.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.145+0000 7f84cad9d700 1 --2- 172.21.15.50:0/3809248045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d17a4e0f20 0x55d17a4e09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:27.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.145+0000 7f84ca59c700 1 --2- 172.21.15.50:0/3809248045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a4e6f60 0x55d17a4ea6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:27.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.145+0000 7f84cb59e700 1 -- 172.21.15.50:0/3809248045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a4e6f60 msgr2=0x55d17a4ea6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:27.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.145+0000 7f84cb59e700 1 --2- 172.21.15.50:0/3809248045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a4e6f60 0x55d17a4ea6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.145+0000 7f84cb59e700 1 -- 172.21.15.50:0/3809248045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d17a4e0f20 msgr2=0x55d17a4e09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:27.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.145+0000 7f84cb59e700 1 --2- 172.21.15.50:0/3809248045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d17a4e0f20 0x55d17a4e09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.145+0000 7f84cb59e700 1 -- 172.21.15.50:0/3809248045 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d17a4dc500 con 0x55d17a4f6dc0 2024-06-06T03:32:27.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.145+0000 7f84cb59e700 1 --2- 172.21.15.50:0/3809248045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d17a4f6dc0 0x55d17a502c50 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f84c400bfd0 tx=0x7f84c4009690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fbd211ab49f766 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:27.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.146+0000 7f84b0ff9700 1 -- 172.21.15.50:0/3809248045 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c40b8070 con 0x55d17a4f6dc0 2024-06-06T03:32:27.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.146+0000 7f84b0ff9700 1 -- 172.21.15.50:0/3809248045 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f84c40a4770 con 0x55d17a4f6dc0 2024-06-06T03:32:27.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.146+0000 7f84b0ff9700 1 -- 172.21.15.50:0/3809248045 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c409af50 con 0x55d17a4f6dc0 2024-06-06T03:32:27.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.146+0000 7f84db9eeb80 1 -- 172.21.15.50:0/3809248045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d17a4f6dc0 msgr2=0x55d17a502c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:27.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.146+0000 7f84db9eeb80 1 --2- 172.21.15.50:0/3809248045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d17a4f6dc0 0x55d17a502c50 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f84c400bfd0 tx=0x7f84c4009690 comp rx=0 tx=0).stop 2024-06-06T03:32:27.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.146+0000 7f84db9eeb80 1 -- 172.21.15.50:0/3809248045 shutdown_connections 2024-06-06T03:32:27.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.146+0000 7f84db9eeb80 1 --2- 172.21.15.50:0/3809248045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d17a4f6dc0 0x55d17a502c50 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.146+0000 7f84db9eeb80 1 --2- 172.21.15.50:0/3809248045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d17a4e0f20 0x55d17a4e09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.146+0000 7f84db9eeb80 1 --2- 172.21.15.50:0/3809248045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a4e6f60 0x55d17a4ea6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.146+0000 7f84db9eeb80 1 -- 172.21.15.50:0/3809248045 >> 172.21.15.50:0/3809248045 conn(0x55d17a40bcc0 msgr2=0x55d17a4e9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:27.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.147+0000 7f84db9eeb80 1 -- 172.21.15.50:0/3809248045 shutdown_connections 2024-06-06T03:32:27.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.147+0000 7f84db9eeb80 1 -- 172.21.15.50:0/3809248045 wait complete. 2024-06-06T03:32:27.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.147+0000 7f84db9eeb80 1 -- start start 2024-06-06T03:32:27.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.147+0000 7f84db9eeb80 1 Processor -- start 2024-06-06T03:32:27.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.147+0000 7f84db9eeb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a4e0f20 0x55d17a4f3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:27.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.147+0000 7f84db9eeb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d17a4e6f60 0x55d17a502620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:27.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.147+0000 7f84db9eeb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d17a4f6dc0 0x55d17a502ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:27.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.147+0000 7f84db9eeb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f84b800d170 con 0x55d17a4f6dc0 2024-06-06T03:32:27.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.147+0000 7f84db9eeb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f84b800e5e0 con 0x55d17a4e6f60 2024-06-06T03:32:27.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.147+0000 7f84db9eeb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f84b800d840 con 0x55d17a4e0f20 2024-06-06T03:32:27.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.147+0000 7f84cb59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d17a4f6dc0 0x55d17a502ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:27.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.147+0000 7f84cb59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d17a4f6dc0 0x55d17a502ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44716/0 (socket says 172.21.15.50:44716) 2024-06-06T03:32:27.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.147+0000 7f84cb59e700 1 -- 172.21.15.50:0/2257793203 learned_addr learned my addr 172.21.15.50:0/2257793203 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:27.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.147+0000 7f84db9eeb80 10 client.0 _ll_register_callbacks cb 0x55d17a3cc920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:32:27.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.147+0000 7f84ca59c700 1 --2- 172.21.15.50:0/2257793203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d17a4e6f60 0x55d17a502620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:27.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.147+0000 7f84cad9d700 1 --2- 172.21.15.50:0/2257793203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a4e0f20 0x55d17a4f3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:27.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.148+0000 7f84cb59e700 1 -- 172.21.15.50:0/2257793203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a4e0f20 msgr2=0x55d17a4f3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:27.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.148+0000 7f84cb59e700 1 --2- 172.21.15.50:0/2257793203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a4e0f20 0x55d17a4f3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.148+0000 7f84cb59e700 1 -- 172.21.15.50:0/2257793203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d17a4e6f60 msgr2=0x55d17a502620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:27.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.148+0000 7f84cb59e700 1 --2- 172.21.15.50:0/2257793203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d17a4e6f60 0x55d17a502620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.148+0000 7f84cb59e700 1 -- 172.21.15.50:0/2257793203 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d17a5033e0 con 0x55d17a4f6dc0 2024-06-06T03:32:27.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.148+0000 7f84cad9d700 1 --2- 172.21.15.50:0/2257793203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a4e0f20 0x55d17a4f3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:32:27.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.148+0000 7f84cb59e700 1 --2- 172.21.15.50:0/2257793203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d17a4f6dc0 0x55d17a502ba0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f84c40a4240 tx=0x7f84c40ba5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53caf5749446edb9 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:27.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.148+0000 7f84aeff5700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:32:27.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.148+0000 7f84aeff5700 1 -- 172.21.15.50:0/2257793203 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c40b8040 con 0x55d17a4f6dc0 2024-06-06T03:32:27.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.148+0000 7f84aeff5700 1 -- 172.21.15.50:0/2257793203 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f84c400c930 con 0x55d17a4f6dc0 2024-06-06T03:32:27.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.148+0000 7f84db9eeb80 1 -- 172.21.15.50:0/2257793203 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84c40a4770 con 0x55d17a4f6dc0 2024-06-06T03:32:27.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.148+0000 7f84aeff5700 1 -- 172.21.15.50:0/2257793203 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f84c400cb30 con 0x55d17a4f6dc0 2024-06-06T03:32:27.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.148+0000 7f84db9eeb80 10 client.16269 fetch_fsmap learned FSMap version 33 2024-06-06T03:32:27.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.148+0000 7f84db9eeb80 1 -- 172.21.15.50:0/2257793203 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55d17a565ce0 con 0x55d17a4f6dc0 2024-06-06T03:32:27.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.148+0000 7f84aeff5700 1 -- 172.21.15.50:0/2257793203 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f84c40a4770 con 0x55d17a4f6dc0 2024-06-06T03:32:27.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.148+0000 7f84aeff5700 1 -- 172.21.15.50:0/2257793203 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f84c40a10f0 con 0x55d17a4f6dc0 2024-06-06T03:32:27.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.149+0000 7f84db9eeb80 10 client.16269 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:32:27.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.149+0000 7f84db9eeb80 10 client.16269 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:32:27.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.149+0000 7f84db9eeb80 20 client.16269 populate_metadata read hostname 'smithi050' 2024-06-06T03:32:27.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.149+0000 7f84db9eeb80 1 --2- 172.21.15.50:0/2257793203 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d17a565ce0 0x55d17a5680d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:27.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.149+0000 7f84db9eeb80 4 client.16269 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-06T03:32:27.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.149+0000 7f84db9eeb80 1 -- 172.21.15.50:0/2257793203 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d17a2b4250 con 0x55d17a565ce0 2024-06-06T03:32:27.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.149+0000 7f84cad9d700 1 --2- 172.21.15.50:0/2257793203 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d17a565ce0 0x55d17a5680d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:27.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.149+0000 7f84aeff5700 10 client.16269 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:32:27.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.149+0000 7f84cad9d700 1 --2- 172.21.15.50:0/2257793203 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d17a565ce0 0x55d17a5680d0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e986160a1e0d3e90 server_cookie=467a77a28aa00b5d in_seq=0 out_seq=0 2024-06-06T03:32:27.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.150+0000 7f84aeff5700 1 -- 172.21.15.50:0/2257793203 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d17a2b4250 con 0x55d17a565ce0 2024-06-06T03:32:27.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.150+0000 7f84aeff5700 10 client.16269 handle_command_reply: tid=0 2024-06-06T03:32:27.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.150+0000 7f84db9eeb80 1 client.16269 shutdown 2024-06-06T03:32:27.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.150+0000 7f84db9eeb80 1 -- 172.21.15.50:0/2257793203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d17a4f6dc0 msgr2=0x55d17a502ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:27.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.150+0000 7f84db9eeb80 1 --2- 172.21.15.50:0/2257793203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d17a4f6dc0 0x55d17a502ba0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f84c40a4240 tx=0x7f84c40ba5b0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.150+0000 7f84db9eeb80 1 -- 172.21.15.50:0/2257793203 shutdown_connections 2024-06-06T03:32:27.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.150+0000 7f84db9eeb80 1 --2- 172.21.15.50:0/2257793203 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d17a565ce0 0x55d17a5680d0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.150+0000 7f84db9eeb80 1 --2- 172.21.15.50:0/2257793203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d17a4f6dc0 0x55d17a502ba0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.150+0000 7f84db9eeb80 1 --2- 172.21.15.50:0/2257793203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d17a4e0f20 0x55d17a4f3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.150+0000 7f84aeff5700 0 client.16269 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:32:27.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.150+0000 7f84db9eeb80 1 --2- 172.21.15.50:0/2257793203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d17a4e6f60 0x55d17a502620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.150+0000 7f84db9eeb80 1 -- 172.21.15.50:0/2257793203 >> 172.21.15.50:0/2257793203 conn(0x55d17a40bcc0 msgr2=0x55d17a4d4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:27.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.150+0000 7f84db9eeb80 1 -- 172.21.15.50:0/2257793203 shutdown_connections 2024-06-06T03:32:27.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.150+0000 7f84db9eeb80 1 -- 172.21.15.50:0/2257793203 wait complete. 2024-06-06T03:32:27.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.150+0000 7f84db9eeb80 20 client.16269 trim_cache size 0 max 16384 2024-06-06T03:32:27.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.151+0000 7f84d116b700 1 -- 172.21.15.50:0/2793298487 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f84b40a2d70 msgr2=0x7f84b40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:27.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.151+0000 7f84d116b700 1 --2- 172.21.15.50:0/2793298487 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f84b40a2d70 0x7f84b40a5230 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f84bc000c00 tx=0x7f84bc005fd0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.151+0000 7f84d116b700 1 -- 172.21.15.50:0/2793298487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84cc1073f0 msgr2=0x7f84cc1a3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:27.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.151+0000 7f84d116b700 1 --2- 172.21.15.50:0/2793298487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84cc1073f0 0x7f84cc1a3bc0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f84c400b970 tx=0x7f84c400bc80 comp rx=0 tx=0).stop 2024-06-06T03:32:27.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.151+0000 7f84d116b700 1 -- 172.21.15.50:0/2793298487 shutdown_connections 2024-06-06T03:32:27.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.151+0000 7f84d116b700 1 --2- 172.21.15.50:0/2793298487 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f84b40a2d70 0x7f84b40a5230 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.151+0000 7f84d116b700 1 --2- 172.21.15.50:0/2793298487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84cc1073f0 0x7f84cc1a3bc0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.151+0000 7f84d116b700 1 --2- 172.21.15.50:0/2793298487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84cc06b0d0 0x7f84cc19f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.151+0000 7f84d116b700 1 --2- 172.21.15.50:0/2793298487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84cc104f00 0x7f84cc19f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:27.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.151+0000 7f84d116b700 1 -- 172.21.15.50:0/2793298487 >> 172.21.15.50:0/2793298487 conn(0x7f84cc0783d0 msgr2=0x7f84cc1035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:27.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.151+0000 7f84d116b700 1 -- 172.21.15.50:0/2793298487 shutdown_connections 2024-06-06T03:32:27.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:26.151+0000 7f84d116b700 1 -- 172.21.15.50:0/2793298487 wait complete. 2024-06-06T03:32:27.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:27 smithi050 ceph-mon[32421]: pgmap v605: 129 pgs: 129 active+clean; 10 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 48 MiB/s wr, 784 op/s 2024-06-06T03:32:27.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:27 smithi079 ceph-mon[35478]: pgmap v605: 129 pgs: 129 active+clean; 10 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 48 MiB/s wr, 784 op/s 2024-06-06T03:32:27.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:27 smithi122 ceph-mon[35759]: pgmap v605: 129 pgs: 129 active+clean; 10 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 48 MiB/s wr, 784 op/s 2024-06-06T03:32:29.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:29 smithi050 ceph-mon[32421]: pgmap v606: 129 pgs: 129 active+clean; 10 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 38 MiB/s wr, 616 op/s 2024-06-06T03:32:29.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:29 smithi079 ceph-mon[35478]: pgmap v606: 129 pgs: 129 active+clean; 10 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 38 MiB/s wr, 616 op/s 2024-06-06T03:32:29.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:29 smithi122 ceph-mon[35759]: pgmap v606: 129 pgs: 129 active+clean; 10 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 38 MiB/s wr, 616 op/s 2024-06-06T03:32:30.176 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-06T03:32:30.177 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T03:32:30.876 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:32:31.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:31 smithi050 ceph-mon[32421]: pgmap v607: 129 pgs: 129 active+clean; 10 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 48 MiB/s wr, 793 op/s 2024-06-06T03:32:31.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:31 smithi079 ceph-mon[35478]: pgmap v607: 129 pgs: 129 active+clean; 10 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 48 MiB/s wr, 793 op/s 2024-06-06T03:32:31.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:31 smithi122 ceph-mon[35759]: pgmap v607: 129 pgs: 129 active+clean; 10 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 48 MiB/s wr, 793 op/s 2024-06-06T03:32:33.307 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:33 smithi050 ceph-mon[32421]: pgmap v608: 129 pgs: 129 active+clean; 10 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 35 MiB/s wr, 590 op/s 2024-06-06T03:32:33.482 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:33 smithi122 ceph-mon[35759]: pgmap v608: 129 pgs: 129 active+clean; 10 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 35 MiB/s wr, 590 op/s 2024-06-06T03:32:33.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:33 smithi079 ceph-mon[35478]: pgmap v608: 129 pgs: 129 active+clean; 10 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 35 MiB/s wr, 590 op/s 2024-06-06T03:32:33.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.652+0000 7f990c221700 1 -- 172.21.15.50:0/3985541087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98fc0a4e10 msgr2=0x7f98fc0a5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:33.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.652+0000 7f990c221700 1 --2- 172.21.15.50:0/3985541087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98fc0a4e10 0x7f98fc0a5290 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9904067f10 tx=0x7f9904068aa0 comp rx=0 tx=0).stop 2024-06-06T03:32:33.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.653+0000 7f990c221700 1 -- 172.21.15.50:0/3985541087 shutdown_connections 2024-06-06T03:32:33.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.653+0000 7f990c221700 1 --2- 172.21.15.50:0/3985541087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98fc0a57d0 0x7f98fc00bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:33.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.653+0000 7f990c221700 1 --2- 172.21.15.50:0/3985541087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98fc0aabb0 0x7f98fc0aaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:33.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.653+0000 7f990c221700 1 --2- 172.21.15.50:0/3985541087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98fc0a4e10 0x7f98fc0a5290 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:33.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.653+0000 7f990c221700 1 -- 172.21.15.50:0/3985541087 >> 172.21.15.50:0/3985541087 conn(0x7f98fc01a6d0 msgr2=0x7f98fc01aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:33.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.653+0000 7f990c221700 1 -- 172.21.15.50:0/3985541087 shutdown_connections 2024-06-06T03:32:33.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.653+0000 7f990c221700 1 -- 172.21.15.50:0/3985541087 wait complete. 2024-06-06T03:32:33.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.654+0000 7f990c221700 1 Processor -- start 2024-06-06T03:32:33.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.654+0000 7f990c221700 1 -- start start 2024-06-06T03:32:33.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.655+0000 7f990c221700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98fc0a4e10 0x7f98fc016630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:33.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.655+0000 7f990c221700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98fc0a57d0 0x7f98fc0106b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:33.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.655+0000 7f990c221700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98fc0aabb0 0x7f98fc010bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:33.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.655+0000 7f990c221700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc00f060 con 0x7f98fc0aabb0 2024-06-06T03:32:33.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.655+0000 7f990c221700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc00eee0 con 0x7f98fc0a57d0 2024-06-06T03:32:33.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.655+0000 7f990c221700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc00f1e0 con 0x7f98fc0a4e10 2024-06-06T03:32:33.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.655+0000 7f9909fbd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98fc0a4e10 0x7f98fc016630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:33.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.655+0000 7f9909fbd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98fc0a4e10 0x7f98fc016630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:60674/0 (socket says 172.21.15.50:60674) 2024-06-06T03:32:33.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.655+0000 7f9909fbd700 1 -- 172.21.15.50:0/208121428 learned_addr learned my addr 172.21.15.50:0/208121428 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:33.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.655+0000 7f99097bc700 1 --2- 172.21.15.50:0/208121428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98fc0a57d0 0x7f98fc0106b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:33.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.656+0000 7f990a7be700 1 --2- 172.21.15.50:0/208121428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98fc0aabb0 0x7f98fc010bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:33.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.656+0000 7f99097bc700 1 -- 172.21.15.50:0/208121428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98fc0a4e10 msgr2=0x7f98fc016630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:33.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.656+0000 7f99097bc700 1 --2- 172.21.15.50:0/208121428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98fc0a4e10 0x7f98fc016630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:33.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.656+0000 7f99097bc700 1 -- 172.21.15.50:0/208121428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98fc0aabb0 msgr2=0x7f98fc010bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:33.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.656+0000 7f99097bc700 1 --2- 172.21.15.50:0/208121428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98fc0aabb0 0x7f98fc010bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:33.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.656+0000 7f99097bc700 1 -- 172.21.15.50:0/208121428 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98fc011460 con 0x7f98fc0a57d0 2024-06-06T03:32:33.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.656+0000 7f99097bc700 1 --2- 172.21.15.50:0/208121428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98fc0a57d0 0x7f98fc0106b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9904067f10 tx=0x7f99040756c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:33.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.656+0000 7f98faffd700 1 -- 172.21.15.50:0/208121428 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f990407c040 con 0x7f98fc0a57d0 2024-06-06T03:32:33.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.657+0000 7f98faffd700 1 -- 172.21.15.50:0/208121428 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9904073470 con 0x7f98fc0a57d0 2024-06-06T03:32:33.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.658+0000 7f98faffd700 1 -- 172.21.15.50:0/208121428 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99040696a0 con 0x7f98fc0a57d0 2024-06-06T03:32:33.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.658+0000 7f990c221700 1 -- 172.21.15.50:0/208121428 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98fc0d3a80 con 0x7f98fc0a57d0 2024-06-06T03:32:33.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.658+0000 7f990c221700 1 -- 172.21.15.50:0/208121428 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98fc0d3e80 con 0x7f98fc0a57d0 2024-06-06T03:32:33.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.660+0000 7f990c221700 1 -- 172.21.15.50:0/208121428 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98fc0a6260 con 0x7f98fc0a57d0 2024-06-06T03:32:33.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.662+0000 7f98faffd700 1 -- 172.21.15.50:0/208121428 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9904075a60 con 0x7f98fc0a57d0 2024-06-06T03:32:33.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.663+0000 7f98faffd700 1 --2- 172.21.15.50:0/208121428 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f98f00a2c90 0x7f98f00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:33.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.663+0000 7f98faffd700 1 -- 172.21.15.50:0/208121428 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f9904132830 con 0x7f98fc0a57d0 2024-06-06T03:32:33.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.671+0000 7f9909fbd700 1 --2- 172.21.15.50:0/208121428 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f98f00a2c90 0x7f98f00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:33.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.671+0000 7f98faffd700 1 -- 172.21.15.50:0/208121428 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f99040ff4a0 con 0x7f98fc0a57d0 2024-06-06T03:32:33.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:33.676+0000 7f9909fbd700 1 --2- 172.21.15.50:0/208121428 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f98f00a2c90 0x7f98f00a5150 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f98f400aca0 tx=0x7f98f4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:34.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:34.180+0000 7f990c221700 1 -- 172.21.15.50:0/208121428 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98fc005180 con 0x7f98fc0a57d0 2024-06-06T03:32:34.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:34.184+0000 7f98faffd700 1 -- 172.21.15.50:0/208121428 <== mon.2 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11855 (secure 0 0 0) 0x7f98fc005180 con 0x7f98fc0a57d0 2024-06-06T03:32:34.187 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:32:34.187 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1667847852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1667847852},{"type":"v1","addr":"172.21.15.50:6835","nonce":1667847852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/239971838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":239971838},{"type":"v1","addr":"172.21.15.50:6837","nonce":239971838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/2188134216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2188134216},{"type":"v1","addr":"172.21.15.50:6839","nonce":2188134216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/632572420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":632572420},{"type":"v1","addr":"172.21.15.50:6841","nonce":632572420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/864537078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":864537078},{"type":"v1","addr":"172.21.15.79:6833","nonce":864537078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/279268898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":279268898},{"type":"v1","addr":"172.21.15.79:6835","nonce":279268898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T03:22:36.202061+0000","modified":"2024-06-06T03:32:16.979722+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24490,"mds_1":24472,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/57533154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":57533154},{"type":"v1","addr":"172.21.15.122:6833","nonce":57533154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/3286722213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3286722213},{"type":"v1","addr":"172.21.15.79:6837","nonce":3286722213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/768067336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":768067336},{"type":"v1","addr":"172.21.15.79:6839","nonce":768067336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.122:6835/2987597320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2987597320},{"type":"v1","addr":"172.21.15.122:6835","nonce":2987597320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":23,"addr":"172.21.15.122:6837/1604366318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1604366318},{"type":"v1","addr":"172.21.15.122:6837","nonce":1604366318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6839/4129732900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":4129732900},{"type":"v1","addr":"172.21.15.122:6839","nonce":4129732900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24466,24472,24490]},"id":1}]} 2024-06-06T03:32:34.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:34.192+0000 7f990c221700 1 -- 172.21.15.50:0/208121428 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f98f00a2c90 msgr2=0x7f98f00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:34.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:34.192+0000 7f990c221700 1 --2- 172.21.15.50:0/208121428 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f98f00a2c90 0x7f98f00a5150 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f98f400aca0 tx=0x7f98f4005f90 comp rx=0 tx=0).stop 2024-06-06T03:32:34.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:34.192+0000 7f990c221700 1 -- 172.21.15.50:0/208121428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98fc0a57d0 msgr2=0x7f98fc0106b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:34.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:34.192+0000 7f990c221700 1 --2- 172.21.15.50:0/208121428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98fc0a57d0 0x7f98fc0106b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9904067f10 tx=0x7f99040756c0 comp rx=0 tx=0).stop 2024-06-06T03:32:34.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:34.192+0000 7f990c221700 1 -- 172.21.15.50:0/208121428 shutdown_connections 2024-06-06T03:32:34.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:34.192+0000 7f990c221700 1 --2- 172.21.15.50:0/208121428 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f98f00a2c90 0x7f98f00a5150 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:34.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:34.192+0000 7f990c221700 1 --2- 172.21.15.50:0/208121428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98fc0aabb0 0x7f98fc010bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:34.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:34.192+0000 7f990c221700 1 --2- 172.21.15.50:0/208121428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98fc0a4e10 0x7f98fc016630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:34.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:34.192+0000 7f990c221700 1 --2- 172.21.15.50:0/208121428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98fc0a57d0 0x7f98fc0106b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:34.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:34.193+0000 7f990c221700 1 -- 172.21.15.50:0/208121428 >> 172.21.15.50:0/208121428 conn(0x7f98fc01a6d0 msgr2=0x7f98fc0a6750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:34.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:34.195+0000 7f990c221700 1 -- 172.21.15.50:0/208121428 shutdown_connections 2024-06-06T03:32:34.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:34.195+0000 7f990c221700 1 -- 172.21.15.50:0/208121428 wait complete. 2024-06-06T03:32:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 33 2024-06-06T03:32:34.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:34 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/208121428' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:32:34.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:34 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/208121428' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:32:34.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:34 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/208121428' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:32:35.060 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-06-06T03:32:35.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:35 smithi050 ceph-mon[32421]: pgmap v609: 129 pgs: 129 active+clean; 10 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 36 MiB/s wr, 604 op/s 2024-06-06T03:32:35.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:35 smithi079 ceph-mon[35478]: pgmap v609: 129 pgs: 129 active+clean; 10 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 36 MiB/s wr, 604 op/s 2024-06-06T03:32:35.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:35 smithi122 ceph-mon[35759]: pgmap v609: 129 pgs: 129 active+clean; 10 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 36 MiB/s wr, 604 op/s 2024-06-06T03:32:35.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.703+0000 7f919a2e7640 1 -- 172.21.15.50:0/1860074714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9194072d90 msgr2=0x7f91940731b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:35.703 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.703+0000 7f919a2e7640 1 --2- 172.21.15.50:0/1860074714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9194072d90 0x7f91940731b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f9184009900 tx=0x7f918402a420 comp rx=0 tx=0).stop 2024-06-06T03:32:35.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.710+0000 7f919a2e7640 1 -- 172.21.15.50:0/1860074714 shutdown_connections 2024-06-06T03:32:35.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.710+0000 7f919a2e7640 1 --2- 172.21.15.50:0/1860074714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91941099e0 0x7f919410e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.710+0000 7f919a2e7640 1 --2- 172.21.15.50:0/1860074714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9194109040 0x7f91941094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.710+0000 7f919a2e7640 1 --2- 172.21.15.50:0/1860074714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9194072d90 0x7f91940731b0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.710+0000 7f919a2e7640 1 -- 172.21.15.50:0/1860074714 >> 172.21.15.50:0/1860074714 conn(0x7f919406e840 msgr2=0x7f9194070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:35.712 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.712+0000 7f919a2e7640 1 -- 172.21.15.50:0/1860074714 shutdown_connections 2024-06-06T03:32:35.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.712+0000 7f919a2e7640 1 -- 172.21.15.50:0/1860074714 wait complete. 2024-06-06T03:32:35.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.713+0000 7f919a2e7640 1 Processor -- start 2024-06-06T03:32:35.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.713+0000 7f919a2e7640 1 -- start start 2024-06-06T03:32:35.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.714+0000 7f919a2e7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9194072d90 0x7f9194115100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:35.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.714+0000 7f919a2e7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9194109040 0x7f9194115640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:35.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.714+0000 7f919a2e7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91941099e0 0x7f91941a59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:35.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.714+0000 7f919a2e7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f919411c2d0 con 0x7f91941099e0 2024-06-06T03:32:35.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.714+0000 7f919a2e7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f919411c150 con 0x7f9194109040 2024-06-06T03:32:35.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.714+0000 7f919a2e7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f919411c450 con 0x7f9194072d90 2024-06-06T03:32:35.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.714+0000 7f9198884640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91941099e0 0x7f91941a59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:35.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.714+0000 7f9193fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9194072d90 0x7f9194115100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:35.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.714+0000 7f9198884640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91941099e0 0x7f91941a59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54284/0 (socket says 172.21.15.50:54284) 2024-06-06T03:32:35.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.714+0000 7f9198884640 1 -- 172.21.15.50:0/2769324108 learned_addr learned my addr 172.21.15.50:0/2769324108 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:35.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.714+0000 7f91937fe640 1 --2- 172.21.15.50:0/2769324108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9194109040 0x7f9194115640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:35.718 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.715+0000 7f9198884640 1 -- 172.21.15.50:0/2769324108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9194072d90 msgr2=0x7f9194115100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:35.718 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.715+0000 7f9198884640 1 --2- 172.21.15.50:0/2769324108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9194072d90 0x7f9194115100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.718 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.715+0000 7f9198884640 1 -- 172.21.15.50:0/2769324108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9194109040 msgr2=0x7f9194115640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:35.718 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.715+0000 7f9198884640 1 --2- 172.21.15.50:0/2769324108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9194109040 0x7f9194115640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.718 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.715+0000 7f9198884640 1 -- 172.21.15.50:0/2769324108 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91941a5f10 con 0x7f91941099e0 2024-06-06T03:32:35.718 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.715+0000 7f91937fe640 1 --2- 172.21.15.50:0/2769324108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9194109040 0x7f9194115640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:32:35.718 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.716+0000 7f9198884640 1 --2- 172.21.15.50:0/2769324108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91941099e0 0x7f91941a59d0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f918c00b970 tx=0x7f918c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:35.721 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.718+0000 7f91917fa640 1 -- 172.21.15.50:0/2769324108 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c019070 con 0x7f91941099e0 2024-06-06T03:32:35.721 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.718+0000 7f919a2e7640 1 -- 172.21.15.50:0/2769324108 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91941a6200 con 0x7f91941099e0 2024-06-06T03:32:35.721 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.719+0000 7f919a2e7640 1 -- 172.21.15.50:0/2769324108 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91941a67a0 con 0x7f91941099e0 2024-06-06T03:32:35.721 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.719+0000 7f91917fa640 1 -- 172.21.15.50:0/2769324108 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f918c014440 con 0x7f91941099e0 2024-06-06T03:32:35.721 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.719+0000 7f91917fa640 1 -- 172.21.15.50:0/2769324108 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c0075b0 con 0x7f91941099e0 2024-06-06T03:32:35.726 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.724+0000 7f91917fa640 1 -- 172.21.15.50:0/2769324108 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f918c01c070 con 0x7f91941099e0 2024-06-06T03:32:35.726 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.726+0000 7f91917fa640 1 --2- 172.21.15.50:0/2769324108 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f917c0a2d90 0x7f917c0a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:35.729 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.726+0000 7f91917fa640 1 -- 172.21.15.50:0/2769324108 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f918c0ce7d0 con 0x7f91941099e0 2024-06-06T03:32:35.729 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.729+0000 7f9193fff640 1 --2- 172.21.15.50:0/2769324108 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f917c0a2d90 0x7f917c0a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:35.733 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.733+0000 7f919cff0740 1 Processor -- start 2024-06-06T03:32:35.733 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.733+0000 7f919cff0740 1 -- start start 2024-06-06T03:32:35.733 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.733+0000 7f919cff0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fba2f621e0 0x55fba2f62600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:35.734 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.733+0000 7f919cff0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fba2f62bd0 0x55fba2f676d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:35.734 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.733+0000 7f919cff0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fba2f67d40 0x55fba2f6a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:35.734 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.733+0000 7f919cff0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fba2ec54f0 con 0x55fba2f62bd0 2024-06-06T03:32:35.734 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.733+0000 7f919cff0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fba2e63870 con 0x55fba2f621e0 2024-06-06T03:32:35.734 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.733+0000 7f919cff0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fba2ec14b0 con 0x55fba2f67d40 2024-06-06T03:32:35.735 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.734+0000 7f91937fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fba2f62bd0 0x55fba2f676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:35.735 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.734+0000 7f91937fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fba2f62bd0 0x55fba2f676d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54300/0 (socket says 172.21.15.50:54300) 2024-06-06T03:32:35.735 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.734+0000 7f91937fe640 1 -- 172.21.15.50:0/3046298257 learned_addr learned my addr 172.21.15.50:0/3046298257 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:35.735 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.734+0000 7f9198884640 1 --2- 172.21.15.50:0/3046298257 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fba2f67d40 0x55fba2f6a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:35.735 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.735+0000 7f9198884640 1 -- 172.21.15.50:0/3046298257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fba2f621e0 msgr2=0x55fba2f62600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:32:35.735 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.735+0000 7f9198884640 1 --2- 172.21.15.50:0/3046298257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fba2f621e0 0x55fba2f62600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.735 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.735+0000 7f9198884640 1 -- 172.21.15.50:0/3046298257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fba2f62bd0 msgr2=0x55fba2f676d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:35.735 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.735+0000 7f9198884640 1 --2- 172.21.15.50:0/3046298257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fba2f62bd0 0x55fba2f676d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.735 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.735+0000 7f9198884640 1 -- 172.21.15.50:0/3046298257 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fba2e7f9b0 con 0x55fba2f67d40 2024-06-06T03:32:35.736 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.736+0000 7f9198884640 1 --2- 172.21.15.50:0/3046298257 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fba2f67d40 0x55fba2f6a1d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f918c09ac90 tx=0x7f918c09a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8b6e3923b552ea2 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:35.736 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.737+0000 7f917a7fc640 1 -- 172.21.15.50:0/3046298257 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c0b0070 con 0x55fba2f67d40 2024-06-06T03:32:35.736 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.737+0000 7f917a7fc640 1 -- 172.21.15.50:0/3046298257 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f918c09f000 con 0x55fba2f67d40 2024-06-06T03:32:35.742 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.743+0000 7f919cff0740 1 -- 172.21.15.50:0/3046298257 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fba2f67d40 msgr2=0x55fba2f6a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:35.742 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.743+0000 7f919cff0740 1 --2- 172.21.15.50:0/3046298257 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fba2f67d40 0x55fba2f6a1d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f918c09ac90 tx=0x7f918c09a660 comp rx=0 tx=0).stop 2024-06-06T03:32:35.743 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.743+0000 7f9193fff640 1 --2- 172.21.15.50:0/2769324108 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f917c0a2d90 0x7f917c0a5250 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9184005ab0 tx=0x7f9184000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:35.755 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.750+0000 7f919cff0740 1 -- 172.21.15.50:0/3046298257 shutdown_connections 2024-06-06T03:32:35.755 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.750+0000 7f919cff0740 1 --2- 172.21.15.50:0/3046298257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fba2f62bd0 0x55fba2f676d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.755 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.750+0000 7f919cff0740 1 --2- 172.21.15.50:0/3046298257 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fba2f67d40 0x55fba2f6a1d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.755 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.750+0000 7f919cff0740 1 --2- 172.21.15.50:0/3046298257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fba2f621e0 0x55fba2f62600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.755 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.750+0000 7f919cff0740 1 -- 172.21.15.50:0/3046298257 >> 172.21.15.50:0/3046298257 conn(0x55fba2f5d850 msgr2=0x55fba2f5dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:35.756 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.755+0000 7f919cff0740 1 -- 172.21.15.50:0/3046298257 shutdown_connections 2024-06-06T03:32:35.756 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.755+0000 7f919cff0740 1 -- 172.21.15.50:0/3046298257 wait complete. 2024-06-06T03:32:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.756+0000 7f919cff0740 1 -- start start 2024-06-06T03:32:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.756+0000 7f919cff0740 1 Processor -- start 2024-06-06T03:32:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.757+0000 7f919cff0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fba2f621e0 0x55fba2f6c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.757+0000 7f919cff0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fba2f62bd0 0x55fba2f6ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.757+0000 7f919cff0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fba2f67d40 0x55fba2f73a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.757+0000 7f919cff0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fba2f6ad40 con 0x55fba2f62bd0 2024-06-06T03:32:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.757+0000 7f919cff0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fba2e4eae0 con 0x55fba2f67d40 2024-06-06T03:32:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.757+0000 7f919cff0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fba2f6aec0 con 0x55fba2f621e0 2024-06-06T03:32:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.757+0000 7f919cff0740 10 client.0 _ll_register_callbacks cb 0x55fba2e879b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:32:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.757+0000 7f9198884640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fba2f67d40 0x55fba2f73a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.757+0000 7f9198884640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fba2f67d40 0x55fba2f73a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:36198/0 (socket says 172.21.15.50:36198) 2024-06-06T03:32:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.757+0000 7f9198884640 1 -- 172.21.15.50:0/3702020715 learned_addr learned my addr 172.21.15.50:0/3702020715 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.757+0000 7f9193fff640 1 --2- 172.21.15.50:0/3702020715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fba2f621e0 0x55fba2f6c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.758+0000 7f9198884640 1 -- 172.21.15.50:0/3702020715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fba2f621e0 msgr2=0x55fba2f6c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.758+0000 7f9198884640 1 --2- 172.21.15.50:0/3702020715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fba2f621e0 0x55fba2f6c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.758+0000 7f9198884640 1 -- 172.21.15.50:0/3702020715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fba2f62bd0 msgr2=0x55fba2f6ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:35.760 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.758+0000 7f9198884640 1 --2- 172.21.15.50:0/3702020715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fba2f62bd0 0x55fba2f6ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.760 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.758+0000 7f9198884640 1 -- 172.21.15.50:0/3702020715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fba2bd9210 con 0x55fba2f67d40 2024-06-06T03:32:35.760 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.758+0000 7f9198884640 1 --2- 172.21.15.50:0/3702020715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fba2f67d40 0x55fba2f73a50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f918c0a3830 tx=0x7f918c0970d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23b16e211ca56073 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:35.784 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.783+0000 7f91737fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:32:35.784 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.783+0000 7f91737fe640 1 -- 172.21.15.50:0/3702020715 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c0b0040 con 0x55fba2f67d40 2024-06-06T03:32:35.784 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.783+0000 7f91737fe640 1 -- 172.21.15.50:0/3702020715 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f918c096a50 con 0x55fba2f67d40 2024-06-06T03:32:35.785 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.785+0000 7f919cff0740 1 -- 172.21.15.50:0/3702020715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f918c09f000 con 0x55fba2f67d40 2024-06-06T03:32:35.786 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.787+0000 7f91737fe640 1 -- 172.21.15.50:0/3702020715 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f918c096c50 con 0x55fba2f67d40 2024-06-06T03:32:35.787 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.787+0000 7f919cff0740 10 client.25907 fetch_fsmap learned FSMap version 33 2024-06-06T03:32:35.787 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.787+0000 7f919cff0740 1 -- 172.21.15.50:0/3702020715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55fba2ca5620 con 0x55fba2f67d40 2024-06-06T03:32:35.788 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.788+0000 7f91737fe640 1 -- 172.21.15.50:0/3702020715 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f918c09f000 con 0x55fba2f67d40 2024-06-06T03:32:35.788 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.788+0000 7f91737fe640 1 -- 172.21.15.50:0/3702020715 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f918c0a0260 con 0x55fba2f67d40 2024-06-06T03:32:35.788 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.788+0000 7f919cff0740 10 client.25907 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:32:35.788 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.788+0000 7f919cff0740 10 client.25907 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:32:35.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.788+0000 7f919cff0740 20 client.25907 populate_metadata read hostname 'smithi050' 2024-06-06T03:32:35.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.788+0000 7f919cff0740 1 --2- 172.21.15.50:0/3702020715 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fba2f784d0 0x55fba2f7a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:35.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.788+0000 7f919cff0740 4 client.25907 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:32:35.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.788+0000 7f919cff0740 1 -- 172.21.15.50:0/3702020715 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fba2ed8f10 con 0x55fba2f784d0 2024-06-06T03:32:35.792 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.792+0000 7f9193fff640 1 --2- 172.21.15.50:0/3702020715 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fba2f784d0 0x55fba2f7a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.794+0000 7f9193fff640 1 --2- 172.21.15.50:0/3702020715 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fba2f784d0 0x55fba2f7a930 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d81a723c801d6925 server_cookie=f20a6c67cc805879 in_seq=0 out_seq=0 2024-06-06T03:32:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.794+0000 7f91737fe640 10 client.25907 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:32:35.796 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.796+0000 7f91737fe640 1 -- 172.21.15.50:0/3702020715 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55fba2ed8f10 con 0x55fba2f784d0 2024-06-06T03:32:35.796 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.796+0000 7f91737fe640 10 client.25907 handle_command_reply: tid=0 2024-06-06T03:32:35.796 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.796+0000 7f919cff0740 1 client.25907 shutdown 2024-06-06T03:32:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.803+0000 7f919cff0740 1 -- 172.21.15.50:0/3702020715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fba2f67d40 msgr2=0x55fba2f73a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.803+0000 7f919cff0740 1 --2- 172.21.15.50:0/3702020715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fba2f67d40 0x55fba2f73a50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f918c0a3830 tx=0x7f918c0970d0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.804+0000 7f919cff0740 1 -- 172.21.15.50:0/3702020715 shutdown_connections 2024-06-06T03:32:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.804+0000 7f919cff0740 1 --2- 172.21.15.50:0/3702020715 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fba2f784d0 0x55fba2f7a930 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.804+0000 7f919cff0740 1 --2- 172.21.15.50:0/3702020715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fba2f62bd0 0x55fba2f6ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.804+0000 7f919cff0740 1 --2- 172.21.15.50:0/3702020715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fba2f67d40 0x55fba2f73a50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.804+0000 7f919cff0740 1 --2- 172.21.15.50:0/3702020715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fba2f621e0 0x55fba2f6c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.804+0000 7f919cff0740 1 -- 172.21.15.50:0/3702020715 >> 172.21.15.50:0/3702020715 conn(0x55fba2f5d850 msgr2=0x55fba2f5c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.804+0000 7f91737fe640 0 client.25907 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:32:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.804+0000 7f919cff0740 1 -- 172.21.15.50:0/3702020715 shutdown_connections 2024-06-06T03:32:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.804+0000 7f919cff0740 1 -- 172.21.15.50:0/3702020715 wait complete. 2024-06-06T03:32:35.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.804+0000 7f919cff0740 20 client.25907 trim_cache size 0 max 16384 2024-06-06T03:32:35.814 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:32:35.886 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.887+0000 7f919cff0740 1 Processor -- start 2024-06-06T03:32:35.888 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.889+0000 7f919cff0740 1 -- start start 2024-06-06T03:32:35.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.890+0000 7f919cff0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fba2f621e0 0x55fba2f7a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:35.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.890+0000 7f919cff0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fba2f62bd0 0x55fba2f73a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:35.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.890+0000 7f919cff0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fba2f67d40 0x55fba2f60760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:35.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.890+0000 7f919cff0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9180012570 con 0x55fba2f67d40 2024-06-06T03:32:35.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.890+0000 7f919cff0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f918000fe40 con 0x55fba2f621e0 2024-06-06T03:32:35.891 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.890+0000 7f919cff0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f918000dc90 con 0x55fba2f62bd0 2024-06-06T03:32:35.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.892+0000 7f91937fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fba2f62bd0 0x55fba2f73a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:35.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.892+0000 7f91937fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fba2f62bd0 0x55fba2f73a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:60724/0 (socket says 172.21.15.50:60724) 2024-06-06T03:32:35.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.892+0000 7f91937fe640 1 -- 172.21.15.50:0/3332438858 learned_addr learned my addr 172.21.15.50:0/3332438858 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:35.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.892+0000 7f9198884640 1 --2- 172.21.15.50:0/3332438858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fba2f67d40 0x55fba2f60760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:35.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.895+0000 7f9193fff640 1 --2- 172.21.15.50:0/3332438858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fba2f621e0 0x55fba2f7a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:35.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.895+0000 7f91937fe640 1 -- 172.21.15.50:0/3332438858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fba2f621e0 msgr2=0x55fba2f7a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:35.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.895+0000 7f91937fe640 1 --2- 172.21.15.50:0/3332438858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fba2f621e0 0x55fba2f7a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.895+0000 7f91937fe640 1 -- 172.21.15.50:0/3332438858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fba2f67d40 msgr2=0x55fba2f60760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:35.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.895+0000 7f91937fe640 1 --2- 172.21.15.50:0/3332438858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fba2f67d40 0x55fba2f60760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.895+0000 7f91937fe640 1 -- 172.21.15.50:0/3332438858 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fba2f5d680 con 0x55fba2f62bd0 2024-06-06T03:32:35.898 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.898+0000 7f91937fe640 1 --2- 172.21.15.50:0/3332438858 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fba2f62bd0 0x55fba2f73a10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9188009c20 tx=0x7f9188011630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e306379fce466d9c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:35.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.900+0000 7f9179ffb640 1 -- 172.21.15.50:0/3332438858 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9188019070 con 0x55fba2f62bd0 2024-06-06T03:32:35.900 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.900+0000 7f9179ffb640 1 -- 172.21.15.50:0/3332438858 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9188009e30 con 0x55fba2f62bd0 2024-06-06T03:32:35.900 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.900+0000 7f9179ffb640 1 -- 172.21.15.50:0/3332438858 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91880146d0 con 0x55fba2f62bd0 2024-06-06T03:32:35.905 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.905+0000 7f919cff0740 1 -- 172.21.15.50:0/3332438858 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fba2f62bd0 msgr2=0x55fba2f73a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:35.905 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.905+0000 7f919cff0740 1 --2- 172.21.15.50:0/3332438858 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fba2f62bd0 0x55fba2f73a10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9188009c20 tx=0x7f9188011630 comp rx=0 tx=0).stop 2024-06-06T03:32:35.906 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.906+0000 7f919cff0740 1 -- 172.21.15.50:0/3332438858 shutdown_connections 2024-06-06T03:32:35.906 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.906+0000 7f919cff0740 1 --2- 172.21.15.50:0/3332438858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fba2f67d40 0x55fba2f60760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.907 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.906+0000 7f919cff0740 1 --2- 172.21.15.50:0/3332438858 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fba2f62bd0 0x55fba2f73a10 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.907 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.906+0000 7f919cff0740 1 --2- 172.21.15.50:0/3332438858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fba2f621e0 0x55fba2f7a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.907 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.906+0000 7f919cff0740 1 -- 172.21.15.50:0/3332438858 >> 172.21.15.50:0/3332438858 conn(0x55fba2f5d850 msgr2=0x55fba2f6c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:35.907 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.906+0000 7f919cff0740 1 -- 172.21.15.50:0/3332438858 shutdown_connections 2024-06-06T03:32:35.907 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.907+0000 7f919cff0740 1 -- 172.21.15.50:0/3332438858 wait complete. 2024-06-06T03:32:35.908 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.908+0000 7f919cff0740 1 -- start start 2024-06-06T03:32:35.908 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.909+0000 7f919cff0740 1 Processor -- start 2024-06-06T03:32:35.909 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.909+0000 7f919cff0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fba2f621e0 0x55fba2f73770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:35.909 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.909+0000 7f919cff0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fba2f62bd0 0x55fba2f70210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:35.910 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.909+0000 7f919cff0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fba2f67d40 0x55fba2f70750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:35.910 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.909+0000 7f919cff0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f918000e300 con 0x55fba2f62bd0 2024-06-06T03:32:35.910 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.909+0000 7f919cff0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f918000f770 con 0x55fba2f621e0 2024-06-06T03:32:35.910 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.909+0000 7f919cff0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f918000e9d0 con 0x55fba2f67d40 2024-06-06T03:32:35.910 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.909+0000 7f919cff0740 10 client.0 _ll_register_callbacks cb 0x7f918c09ab80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:32:35.912 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.912+0000 7f9198884640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fba2f67d40 0x55fba2f70750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:35.913 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.913+0000 7f9193fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fba2f621e0 0x55fba2f73770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:35.913 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.913+0000 7f9193fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fba2f621e0 0x55fba2f73770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:36210/0 (socket says 172.21.15.50:36210) 2024-06-06T03:32:35.913 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.913+0000 7f9198884640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fba2f67d40 0x55fba2f70750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:60726/0 (socket says 172.21.15.50:60726) 2024-06-06T03:32:35.913 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.913+0000 7f9193fff640 1 -- 172.21.15.50:0/2201215087 learned_addr learned my addr 172.21.15.50:0/2201215087 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:35.916 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.913+0000 7f9193fff640 1 -- 172.21.15.50:0/2201215087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fba2f67d40 msgr2=0x55fba2f70750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:35.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.913+0000 7f9193fff640 1 --2- 172.21.15.50:0/2201215087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fba2f67d40 0x55fba2f70750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.913+0000 7f9193fff640 1 -- 172.21.15.50:0/2201215087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fba2f62bd0 msgr2=0x55fba2f70210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:35.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.913+0000 7f9193fff640 1 --2- 172.21.15.50:0/2201215087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fba2f62bd0 0x55fba2f70210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.913+0000 7f9193fff640 1 -- 172.21.15.50:0/2201215087 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fba2f638a0 con 0x55fba2f621e0 2024-06-06T03:32:35.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.915+0000 7f9193fff640 1 --2- 172.21.15.50:0/2201215087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fba2f621e0 0x55fba2f73770 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9184053fd0 tx=0x7f9184009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1dec463e8e6b48c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:35.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.915+0000 7f91737fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:32:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.916+0000 7f91737fe640 1 -- 172.21.15.50:0/2201215087 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9184035050 con 0x55fba2f621e0 2024-06-06T03:32:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.916+0000 7f91737fe640 1 -- 172.21.15.50:0/2201215087 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f9184031990 con 0x55fba2f621e0 2024-06-06T03:32:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.916+0000 7f919cff0740 1 -- 172.21.15.50:0/2201215087 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9188009e30 con 0x55fba2f621e0 2024-06-06T03:32:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.916+0000 7f91737fe640 1 -- 172.21.15.50:0/2201215087 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f9184031b90 con 0x55fba2f621e0 2024-06-06T03:32:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.916+0000 7f919cff0740 10 client.25913 fetch_fsmap learned FSMap version 33 2024-06-06T03:32:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.916+0000 7f919cff0740 1 -- 172.21.15.50:0/2201215087 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55fba2fe2140 con 0x55fba2f621e0 2024-06-06T03:32:35.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.918+0000 7f91737fe640 1 -- 172.21.15.50:0/2201215087 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9184057070 con 0x55fba2f621e0 2024-06-06T03:32:35.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.918+0000 7f91737fe640 1 -- 172.21.15.50:0/2201215087 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f918405c470 con 0x55fba2f621e0 2024-06-06T03:32:35.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.918+0000 7f919cff0740 10 client.25913 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:32:35.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.918+0000 7f919cff0740 10 client.25913 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:32:35.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.918+0000 7f919cff0740 20 client.25913 populate_metadata read hostname 'smithi050' 2024-06-06T03:32:35.920 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.918+0000 7f919cff0740 1 --2- 172.21.15.50:0/2201215087 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fba2fe2ad0 0x55fba2fe4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:35.920 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.918+0000 7f919cff0740 4 client.25913 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:32:35.920 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.918+0000 7f919cff0740 1 -- 172.21.15.50:0/2201215087 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f9188009e30 con 0x55fba2fe2ad0 2024-06-06T03:32:35.921 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.919+0000 7f91937fe640 1 --2- 172.21.15.50:0/2201215087 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fba2fe2ad0 0x55fba2fe4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:35.923 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.923+0000 7f91937fe640 1 --2- 172.21.15.50:0/2201215087 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fba2fe2ad0 0x55fba2fe4ef0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7025760b963dbd1a server_cookie=74d91de0e10e8624 in_seq=0 out_seq=0 2024-06-06T03:32:35.923 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.924+0000 7f91737fe640 10 client.25913 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:32:35.932 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.932+0000 7f91737fe640 1 -- 172.21.15.50:0/2201215087 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x7f9188009e30 con 0x55fba2fe2ad0 2024-06-06T03:32:35.932 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.932+0000 7f91737fe640 10 client.25913 handle_command_reply: tid=0 2024-06-06T03:32:35.933 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.932+0000 7f919cff0740 1 client.25913 shutdown 2024-06-06T03:32:35.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.935+0000 7f919cff0740 1 -- 172.21.15.50:0/2201215087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fba2f621e0 msgr2=0x55fba2f73770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:35.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.935+0000 7f919cff0740 1 --2- 172.21.15.50:0/2201215087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fba2f621e0 0x55fba2f73770 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9184053fd0 tx=0x7f9184009260 comp rx=0 tx=0).stop 2024-06-06T03:32:35.939 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.938+0000 7f919cff0740 1 -- 172.21.15.50:0/2201215087 shutdown_connections 2024-06-06T03:32:35.939 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.939+0000 7f919cff0740 1 --2- 172.21.15.50:0/2201215087 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fba2fe2ad0 0x55fba2fe4ef0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.939 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.939+0000 7f91737fe640 0 client.25913 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:32:35.939 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.939+0000 7f919cff0740 1 --2- 172.21.15.50:0/2201215087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fba2f62bd0 0x55fba2f70210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.939 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.939+0000 7f919cff0740 1 --2- 172.21.15.50:0/2201215087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fba2f67d40 0x55fba2f70750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.940 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.939+0000 7f919cff0740 1 --2- 172.21.15.50:0/2201215087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fba2f621e0 0x55fba2f73770 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.940 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.939+0000 7f919cff0740 1 -- 172.21.15.50:0/2201215087 >> 172.21.15.50:0/2201215087 conn(0x55fba2f5d850 msgr2=0x55fba2f60760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:35.940 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.939+0000 7f919cff0740 1 -- 172.21.15.50:0/2201215087 shutdown_connections 2024-06-06T03:32:35.940 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.939+0000 7f919cff0740 1 -- 172.21.15.50:0/2201215087 wait complete. 2024-06-06T03:32:35.940 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.939+0000 7f919cff0740 20 client.25913 trim_cache size 0 max 16384 2024-06-06T03:32:35.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:32:35.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:32:35.944 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:32:35.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.949+0000 7f919a2e7640 1 -- 172.21.15.50:0/2769324108 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f917c0a2d90 msgr2=0x7f917c0a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:35.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.949+0000 7f919a2e7640 1 --2- 172.21.15.50:0/2769324108 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f917c0a2d90 0x7f917c0a5250 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9184005ab0 tx=0x7f9184000bc0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.950+0000 7f919a2e7640 1 -- 172.21.15.50:0/2769324108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91941099e0 msgr2=0x7f91941a59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:35.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.950+0000 7f919a2e7640 1 --2- 172.21.15.50:0/2769324108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91941099e0 0x7f91941a59d0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f918c00b970 tx=0x7f918c00be30 comp rx=0 tx=0).stop 2024-06-06T03:32:35.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.951+0000 7f919a2e7640 1 -- 172.21.15.50:0/2769324108 shutdown_connections 2024-06-06T03:32:35.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.951+0000 7f919a2e7640 1 --2- 172.21.15.50:0/2769324108 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f917c0a2d90 0x7f917c0a5250 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.951+0000 7f919a2e7640 1 --2- 172.21.15.50:0/2769324108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91941099e0 0x7f91941a59d0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.951+0000 7f919a2e7640 1 --2- 172.21.15.50:0/2769324108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9194109040 0x7f9194115640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.951+0000 7f919a2e7640 1 --2- 172.21.15.50:0/2769324108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9194072d90 0x7f9194115100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:35.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.951+0000 7f919a2e7640 1 -- 172.21.15.50:0/2769324108 >> 172.21.15.50:0/2769324108 conn(0x7f919406e840 msgr2=0x7f919406f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:35.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.954+0000 7f919a2e7640 1 -- 172.21.15.50:0/2769324108 shutdown_connections 2024-06-06T03:32:35.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:35.954+0000 7f919a2e7640 1 -- 172.21.15.50:0/2769324108 wait complete. 2024-06-06T03:32:37.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:37 smithi050 ceph-mon[32421]: pgmap v610: 129 pgs: 129 active+clean; 10 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 43 MiB/s wr, 726 op/s 2024-06-06T03:32:37.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:37 smithi079 ceph-mon[35478]: pgmap v610: 129 pgs: 129 active+clean; 10 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 43 MiB/s wr, 726 op/s 2024-06-06T03:32:37.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:37 smithi122 ceph-mon[35759]: pgmap v610: 129 pgs: 129 active+clean; 10 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 43 MiB/s wr, 726 op/s 2024-06-06T03:32:39.231 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:39 smithi050 ceph-mon[32421]: pgmap v611: 129 pgs: 129 active+clean; 10 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 33 MiB/s wr, 554 op/s 2024-06-06T03:32:39.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:39 smithi079 ceph-mon[35478]: pgmap v611: 129 pgs: 129 active+clean; 10 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 33 MiB/s wr, 554 op/s 2024-06-06T03:32:39.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:39 smithi122 ceph-mon[35759]: pgmap v611: 129 pgs: 129 active+clean; 10 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 33 MiB/s wr, 554 op/s 2024-06-06T03:32:41.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:41 smithi050 ceph-mon[32421]: pgmap v612: 129 pgs: 129 active+clean; 10 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 44 MiB/s wr, 744 op/s 2024-06-06T03:32:41.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:41 smithi079 ceph-mon[35478]: pgmap v612: 129 pgs: 129 active+clean; 10 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 44 MiB/s wr, 744 op/s 2024-06-06T03:32:41.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:41 smithi122 ceph-mon[35759]: pgmap v612: 129 pgs: 129 active+clean; 10 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 44 MiB/s wr, 744 op/s 2024-06-06T03:32:43.461 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:43 smithi050 ceph-mon[32421]: pgmap v613: 129 pgs: 129 active+clean; 10 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 35 MiB/s wr, 589 op/s 2024-06-06T03:32:43.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:43 smithi079 ceph-mon[35478]: pgmap v613: 129 pgs: 129 active+clean; 10 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 35 MiB/s wr, 589 op/s 2024-06-06T03:32:43.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:43 smithi122 ceph-mon[35759]: pgmap v613: 129 pgs: 129 active+clean; 10 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 35 MiB/s wr, 589 op/s 2024-06-06T03:32:44.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.022+0000 7f073a633700 1 -- 172.21.15.50:0/953956651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f072c0981c0 msgr2=0x7f072c0985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:44.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.022+0000 7f073a633700 1 --2- 172.21.15.50:0/953956651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f072c0981c0 0x7f072c0985a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0734067f10 tx=0x7f0734068aa0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.025+0000 7f073a633700 1 -- 172.21.15.50:0/953956651 shutdown_connections 2024-06-06T03:32:44.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.025+0000 7f073a633700 1 --2- 172.21.15.50:0/953956651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f072c09d2a0 0x7f072c0a4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.025+0000 7f073a633700 1 --2- 172.21.15.50:0/953956651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f072c0981c0 0x7f072c0985a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.025+0000 7f073a633700 1 --2- 172.21.15.50:0/953956651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f072c098b70 0x7f072c09cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.025+0000 7f073a633700 1 -- 172.21.15.50:0/953956651 >> 172.21.15.50:0/953956651 conn(0x7f072c093a50 msgr2=0x7f072c095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:44.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.027+0000 7f073a633700 1 -- 172.21.15.50:0/953956651 shutdown_connections 2024-06-06T03:32:44.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.029+0000 7f073a633700 1 -- 172.21.15.50:0/953956651 wait complete. 2024-06-06T03:32:44.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.030+0000 7f073a633700 1 Processor -- start 2024-06-06T03:32:44.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.030+0000 7f073a633700 1 -- start start 2024-06-06T03:32:44.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.030+0000 7f073a633700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f072c0981c0 0x7f072c13b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:44.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.030+0000 7f073a633700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f072c098b70 0x7f072c13be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:44.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.030+0000 7f073a633700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f072c09d2a0 0x7f072c13fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:44.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.031+0000 7f073a633700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f072c00c4f0 con 0x7f072c09d2a0 2024-06-06T03:32:44.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.031+0000 7f073a633700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f072c00c370 con 0x7f072c098b70 2024-06-06T03:32:44.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.031+0000 7f073a633700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f072c00c670 con 0x7f072c0981c0 2024-06-06T03:32:44.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.033+0000 7f0738e30700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f072c098b70 0x7f072c13be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:44.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.033+0000 7f0739631700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f072c0981c0 0x7f072c13b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:44.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.033+0000 7f0739631700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f072c0981c0 0x7f072c13b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:36138/0 (socket says 172.21.15.50:36138) 2024-06-06T03:32:44.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.033+0000 7f0739631700 1 -- 172.21.15.50:0/1896967969 learned_addr learned my addr 172.21.15.50:0/1896967969 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:44.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.033+0000 7f0739e32700 1 --2- 172.21.15.50:0/1896967969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f072c09d2a0 0x7f072c13fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:44.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.034+0000 7f0739631700 1 -- 172.21.15.50:0/1896967969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f072c098b70 msgr2=0x7f072c13be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:44.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.034+0000 7f0739631700 1 --2- 172.21.15.50:0/1896967969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f072c098b70 0x7f072c13be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.034+0000 7f0739631700 1 -- 172.21.15.50:0/1896967969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f072c09d2a0 msgr2=0x7f072c13fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:44.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.034+0000 7f0739631700 1 --2- 172.21.15.50:0/1896967969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f072c09d2a0 0x7f072c13fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.034+0000 7f0739631700 1 -- 172.21.15.50:0/1896967969 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f072c1403f0 con 0x7f072c0981c0 2024-06-06T03:32:44.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.035+0000 7f0739631700 1 --2- 172.21.15.50:0/1896967969 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f072c0981c0 0x7f072c13b900 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0734067c00 tx=0x7f0734065700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:44.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.036+0000 7f072a7fc700 1 -- 172.21.15.50:0/1896967969 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0734092070 con 0x7f072c0981c0 2024-06-06T03:32:44.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.036+0000 7f072a7fc700 1 -- 172.21.15.50:0/1896967969 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f073408d430 con 0x7f072c0981c0 2024-06-06T03:32:44.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.036+0000 7f072a7fc700 1 -- 172.21.15.50:0/1896967969 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0734073680 con 0x7f072c0981c0 2024-06-06T03:32:44.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.037+0000 7f073a633700 1 -- 172.21.15.50:0/1896967969 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f072c140680 con 0x7f072c0981c0 2024-06-06T03:32:44.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.037+0000 7f073a633700 1 -- 172.21.15.50:0/1896967969 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f072c130750 con 0x7f072c0981c0 2024-06-06T03:32:44.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.042+0000 7f0746118b80 1 Processor -- start 2024-06-06T03:32:44.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.043+0000 7f0746118b80 1 -- start start 2024-06-06T03:32:44.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.043+0000 7f0746118b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56438bf697a0 0x56438bf67b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:44.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.043+0000 7f0746118b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56438bf68070 0x56438bf684f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:44.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.043+0000 7f0746118b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56438bf72d80 0x56438bf75170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:44.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.043+0000 7f0746118b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56438beba810 con 0x56438bf68070 2024-06-06T03:32:44.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.043+0000 7f0746118b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56438be62720 con 0x56438bf72d80 2024-06-06T03:32:44.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.043+0000 7f0746118b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56438beb67d0 con 0x56438bf697a0 2024-06-06T03:32:44.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.045+0000 7f0739e32700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56438bf697a0 0x56438bf67b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:44.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.045+0000 7f0738e30700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56438bf72d80 0x56438bf75170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:44.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.045+0000 7f0738e30700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56438bf72d80 0x56438bf75170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:45394/0 (socket says 172.21.15.50:45394) 2024-06-06T03:32:44.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.045+0000 7f0738e30700 1 -- 172.21.15.50:0/1304065607 learned_addr learned my addr 172.21.15.50:0/1304065607 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:44.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.048+0000 7f0739e32700 1 -- 172.21.15.50:0/1304065607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56438bf72d80 msgr2=0x56438bf75170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:44.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.048+0000 7f0739e32700 1 --2- 172.21.15.50:0/1304065607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56438bf72d80 0x56438bf75170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.048+0000 7f0739e32700 1 -- 172.21.15.50:0/1304065607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56438bf68070 msgr2=0x56438bf684f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:32:44.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.048+0000 7f0739e32700 1 --2- 172.21.15.50:0/1304065607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56438bf68070 0x56438bf684f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.048+0000 7f0739e32700 1 -- 172.21.15.50:0/1304065607 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56438be58f50 con 0x56438bf697a0 2024-06-06T03:32:44.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.049+0000 7f072a7fc700 1 -- 172.21.15.50:0/1896967969 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0734095070 con 0x7f072c0981c0 2024-06-06T03:32:44.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.049+0000 7f0739e32700 1 --2- 172.21.15.50:0/1304065607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56438bf697a0 0x56438bf67b30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0724009990 tx=0x7f0724009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b86fca0684b755f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:44.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.050+0000 7f072a7fc700 1 --2- 172.21.15.50:0/1896967969 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f07200a2d70 0x7f07200a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:44.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.051+0000 7f073a633700 1 -- 172.21.15.50:0/1304065607 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0724017070 con 0x56438bf697a0 2024-06-06T03:32:44.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.051+0000 7f072a7fc700 1 -- 172.21.15.50:0/1896967969 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f073413cee0 con 0x7f072c0981c0 2024-06-06T03:32:44.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.051+0000 7f073a633700 1 -- 172.21.15.50:0/1304065607 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f072400ebc0 con 0x56438bf697a0 2024-06-06T03:32:44.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.052+0000 7f0746118b80 1 -- 172.21.15.50:0/1304065607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56438bf697a0 msgr2=0x56438bf67b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:44.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.052+0000 7f0746118b80 1 --2- 172.21.15.50:0/1304065607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56438bf697a0 0x56438bf67b30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0724009990 tx=0x7f0724009ca0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.053+0000 7f0739631700 1 --2- 172.21.15.50:0/1896967969 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f07200a2d70 0x7f07200a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:44.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.054+0000 7f0746118b80 1 -- 172.21.15.50:0/1304065607 shutdown_connections 2024-06-06T03:32:44.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.054+0000 7f0746118b80 1 --2- 172.21.15.50:0/1304065607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56438bf72d80 0x56438bf75170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.054+0000 7f0746118b80 1 --2- 172.21.15.50:0/1304065607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56438bf697a0 0x56438bf67b30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.054+0000 7f0746118b80 1 --2- 172.21.15.50:0/1304065607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56438bf68070 0x56438bf684f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.055+0000 7f0746118b80 1 -- 172.21.15.50:0/1304065607 >> 172.21.15.50:0/1304065607 conn(0x56438be93cc0 msgr2=0x56438bf63f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:44.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.057+0000 7f0739631700 1 --2- 172.21.15.50:0/1896967969 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f07200a2d70 0x7f07200a5230 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f073408d040 tx=0x7f073408df90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:44.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.058+0000 7f0746118b80 1 -- 172.21.15.50:0/1304065607 shutdown_connections 2024-06-06T03:32:44.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.061+0000 7f0746118b80 1 -- 172.21.15.50:0/1304065607 wait complete. 2024-06-06T03:32:44.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.061+0000 7f0746118b80 1 -- start start 2024-06-06T03:32:44.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.062+0000 7f0746118b80 1 Processor -- start 2024-06-06T03:32:44.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.064+0000 7f0746118b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56438bf68070 0x56438bf724c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:44.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.064+0000 7f0746118b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56438bf697a0 0x56438bf6f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:44.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.064+0000 7f0746118b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56438bf72d80 0x56438bf6fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:44.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.064+0000 7f0746118b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56438bf75c40 con 0x56438bf697a0 2024-06-06T03:32:44.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.064+0000 7f0746118b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56438be5abf0 con 0x56438bf72d80 2024-06-06T03:32:44.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.064+0000 7f0746118b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56438bf75dc0 con 0x56438bf68070 2024-06-06T03:32:44.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.064+0000 7f0746118b80 10 client.0 _ll_register_callbacks cb 0x56438be54920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:32:44.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.065+0000 7f0738e30700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56438bf697a0 0x56438bf6f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:44.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.065+0000 7f0738e30700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56438bf697a0 0x56438bf6f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57768/0 (socket says 172.21.15.50:57768) 2024-06-06T03:32:44.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.065+0000 7f0738e30700 1 -- 172.21.15.50:0/826977184 learned_addr learned my addr 172.21.15.50:0/826977184 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:44.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.066+0000 7f0739e32700 1 --2- 172.21.15.50:0/826977184 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56438bf68070 0x56438bf724c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:44.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.066+0000 7f0739e32700 1 --2- 172.21.15.50:0/826977184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56438bf72d80 0x56438bf6fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:44.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.066+0000 7f0738e30700 1 -- 172.21.15.50:0/826977184 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56438bf68070 msgr2=0x56438bf724c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:44.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.066+0000 7f0738e30700 1 --2- 172.21.15.50:0/826977184 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56438bf68070 0x56438bf724c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.066+0000 7f0738e30700 1 -- 172.21.15.50:0/826977184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56438bf72d80 msgr2=0x56438bf6fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:44.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.066+0000 7f0738e30700 1 --2- 172.21.15.50:0/826977184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56438bf72d80 0x56438bf6fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.066+0000 7f0738e30700 1 -- 172.21.15.50:0/826977184 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56438be098d0 con 0x56438bf697a0 2024-06-06T03:32:44.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.067+0000 7f0738e30700 1 --2- 172.21.15.50:0/826977184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56438bf697a0 0x56438bf6f7c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0730006ad0 tx=0x7f07300107b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e95976503b72547 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:44.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.067+0000 7f071cff9700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:32:44.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.067+0000 7f071cff9700 1 -- 172.21.15.50:0/826977184 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0730018070 con 0x56438bf697a0 2024-06-06T03:32:44.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.068+0000 7f0746118b80 1 -- 172.21.15.50:0/826977184 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f072400ebc0 con 0x56438bf697a0 2024-06-06T03:32:44.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.068+0000 7f071cff9700 1 -- 172.21.15.50:0/826977184 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f0730014430 con 0x56438bf697a0 2024-06-06T03:32:44.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.068+0000 7f071cff9700 1 -- 172.21.15.50:0/826977184 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f0730024050 con 0x56438bf697a0 2024-06-06T03:32:44.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.070+0000 7f0746118b80 10 client.16290 fetch_fsmap learned FSMap version 33 2024-06-06T03:32:44.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.070+0000 7f0746118b80 1 -- 172.21.15.50:0/826977184 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56438bf80640 con 0x56438bf697a0 2024-06-06T03:32:44.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.074+0000 7f071cff9700 1 -- 172.21.15.50:0/826977184 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f072400ebc0 con 0x56438bf697a0 2024-06-06T03:32:44.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.075+0000 7f071cff9700 1 -- 172.21.15.50:0/826977184 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f07300137c0 con 0x56438bf697a0 2024-06-06T03:32:44.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.075+0000 7f0746118b80 10 client.16290 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:32:44.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.075+0000 7f0746118b80 10 client.16290 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-06-06T03:32:44.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.075+0000 7f0746118b80 20 client.16290 populate_metadata read hostname 'smithi050' 2024-06-06T03:32:44.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.075+0000 7f0746118b80 1 --2- 172.21.15.50:0/826977184 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x56438bf83020 0x56438bf85440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:44.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.075+0000 7f0746118b80 4 client.16290 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:32:44.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.075+0000 7f0746118b80 1 -- 172.21.15.50:0/826977184 --> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56438bec7d10 con 0x56438bf83020 2024-06-06T03:32:44.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.077+0000 7f0739e32700 1 --2- 172.21.15.50:0/826977184 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x56438bf83020 0x56438bf85440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:44.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.084+0000 7f0739e32700 1 --2- 172.21.15.50:0/826977184 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x56438bf83020 0x56438bf85440 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9674d3e94639add server_cookie=b2c98f73d2ae981d in_seq=0 out_seq=0 2024-06-06T03:32:44.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.084+0000 7f071cff9700 10 client.16290 ms_handle_connect on v2:172.21.15.122:6834/2987597320 2024-06-06T03:32:44.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.087+0000 7f071cff9700 1 -- 172.21.15.50:0/826977184 <== mds.2 v2:172.21.15.122:6834/2987597320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x56438bec7d10 con 0x56438bf83020 2024-06-06T03:32:44.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.087+0000 7f071cff9700 10 client.16290 handle_command_reply: tid=0 2024-06-06T03:32:44.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.087+0000 7f0746118b80 1 client.16290 shutdown 2024-06-06T03:32:44.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.088+0000 7f0746118b80 1 -- 172.21.15.50:0/826977184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56438bf697a0 msgr2=0x56438bf6f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:44.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.088+0000 7f0746118b80 1 --2- 172.21.15.50:0/826977184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56438bf697a0 0x56438bf6f7c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0730006ad0 tx=0x7f07300107b0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.090+0000 7f0746118b80 1 -- 172.21.15.50:0/826977184 shutdown_connections 2024-06-06T03:32:44.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.090+0000 7f0746118b80 1 --2- 172.21.15.50:0/826977184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56438bf72d80 0x56438bf6fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.090+0000 7f0746118b80 1 --2- 172.21.15.50:0/826977184 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56438bf68070 0x56438bf724c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.090+0000 7f0746118b80 1 --2- 172.21.15.50:0/826977184 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x56438bf83020 0x56438bf85440 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.090+0000 7f0746118b80 1 --2- 172.21.15.50:0/826977184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56438bf697a0 0x56438bf6f7c0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.090+0000 7f0746118b80 1 -- 172.21.15.50:0/826977184 >> 172.21.15.50:0/826977184 conn(0x56438be93cc0 msgr2=0x56438bf69b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:44.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.090+0000 7f071cff9700 0 client.16290 ms_handle_reset on v2:172.21.15.122:6834/2987597320 2024-06-06T03:32:44.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.096+0000 7f0746118b80 1 -- 172.21.15.50:0/826977184 shutdown_connections 2024-06-06T03:32:44.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.096+0000 7f0746118b80 1 -- 172.21.15.50:0/826977184 wait complete. 2024-06-06T03:32:44.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.100+0000 7f0746118b80 20 client.16290 trim_cache size 0 max 16384 2024-06-06T03:32:44.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.130+0000 7f0746118b80 1 Processor -- start 2024-06-06T03:32:44.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.130+0000 7f0746118b80 1 -- start start 2024-06-06T03:32:44.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.131+0000 7f0746118b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56438bf68070 0x56438bf63bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:44.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.131+0000 7f0746118b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56438bf697a0 0x56438bf8ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:44.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.131+0000 7f0746118b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56438bf72d80 0x56438bf8b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:44.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.132+0000 7f0738e30700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56438bf697a0 0x56438bf8ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:44.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.132+0000 7f0738e30700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56438bf697a0 0x56438bf8ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:45408/0 (socket says 172.21.15.50:45408) 2024-06-06T03:32:44.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.132+0000 7f0739e32700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56438bf72d80 0x56438bf8b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:44.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.132+0000 7f0739e32700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56438bf72d80 0x56438bf8b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:36168/0 (socket says 172.21.15.50:36168) 2024-06-06T03:32:44.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.132+0000 7f0738e30700 1 -- 172.21.15.50:0/1651351189 learned_addr learned my addr 172.21.15.50:0/1651351189 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:44.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.132+0000 7f0746118b80 1 -- 172.21.15.50:0/1651351189 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f072c163f90 con 0x56438bf68070 2024-06-06T03:32:44.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.132+0000 7f0746118b80 1 -- 172.21.15.50:0/1651351189 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f072c139000 con 0x56438bf697a0 2024-06-06T03:32:44.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.132+0000 7f0746118b80 1 -- 172.21.15.50:0/1651351189 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f072c136f00 con 0x56438bf72d80 2024-06-06T03:32:44.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.133+0000 7f0739e32700 1 --2- 172.21.15.50:0/1651351189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56438bf68070 0x56438bf63bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:44.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.133+0000 7f0738e30700 1 -- 172.21.15.50:0/1651351189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56438bf72d80 msgr2=0x56438bf8b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:44.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.133+0000 7f0738e30700 1 --2- 172.21.15.50:0/1651351189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56438bf72d80 0x56438bf8b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.133+0000 7f0738e30700 1 -- 172.21.15.50:0/1651351189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56438bf68070 msgr2=0x56438bf63bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:44.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.133+0000 7f0738e30700 1 --2- 172.21.15.50:0/1651351189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56438bf68070 0x56438bf63bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.133+0000 7f0738e30700 1 -- 172.21.15.50:0/1651351189 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56438bf693f0 con 0x56438bf697a0 2024-06-06T03:32:44.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.134+0000 7f0738e30700 1 --2- 172.21.15.50:0/1651351189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56438bf697a0 0x56438bf8ad10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0730001f70 tx=0x7f0730009340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c9caa2bd060107f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:44.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.134+0000 7f071effd700 1 -- 172.21.15.50:0/1651351189 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0730018070 con 0x56438bf697a0 2024-06-06T03:32:44.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.135+0000 7f071effd700 1 -- 172.21.15.50:0/1651351189 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0730013db0 con 0x56438bf697a0 2024-06-06T03:32:44.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.136+0000 7f0746118b80 1 -- 172.21.15.50:0/1651351189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56438bf697a0 msgr2=0x56438bf8ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:44.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.136+0000 7f0746118b80 1 --2- 172.21.15.50:0/1651351189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56438bf697a0 0x56438bf8ad10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0730001f70 tx=0x7f0730009340 comp rx=0 tx=0).stop 2024-06-06T03:32:44.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.136+0000 7f0746118b80 1 -- 172.21.15.50:0/1651351189 shutdown_connections 2024-06-06T03:32:44.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.136+0000 7f0746118b80 1 --2- 172.21.15.50:0/1651351189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56438bf72d80 0x56438bf8b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.136+0000 7f0746118b80 1 --2- 172.21.15.50:0/1651351189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56438bf68070 0x56438bf63bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.136+0000 7f0746118b80 1 --2- 172.21.15.50:0/1651351189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56438bf697a0 0x56438bf8ad10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.136+0000 7f0746118b80 1 -- 172.21.15.50:0/1651351189 >> 172.21.15.50:0/1651351189 conn(0x56438be93cc0 msgr2=0x56438bf634e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:44.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.138+0000 7f0746118b80 1 -- 172.21.15.50:0/1651351189 shutdown_connections 2024-06-06T03:32:44.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.138+0000 7f0746118b80 1 -- 172.21.15.50:0/1651351189 wait complete. 2024-06-06T03:32:44.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.139+0000 7f0746118b80 1 -- start start 2024-06-06T03:32:44.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.139+0000 7f0746118b80 1 Processor -- start 2024-06-06T03:32:44.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.139+0000 7f0746118b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56438bf68070 0x56438bf76230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:44.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.139+0000 7f0746118b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56438bf72d80 0x56438bf76770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:44.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.139+0000 7f0746118b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56438bf76dc0 0x56438bfebcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:44.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.139+0000 7f0746118b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f072c1374c0 con 0x56438bf72d80 2024-06-06T03:32:44.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.139+0000 7f0746118b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f072c138930 con 0x56438bf76dc0 2024-06-06T03:32:44.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.140+0000 7f0746118b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f072c137b90 con 0x56438bf68070 2024-06-06T03:32:44.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.140+0000 7f0746118b80 10 client.0 _ll_register_callbacks cb 0x56438be54920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:32:44.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.140+0000 7f0738e30700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56438bf72d80 0x56438bf76770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:44.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.140+0000 7f0738e30700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56438bf72d80 0x56438bf76770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57786/0 (socket says 172.21.15.50:57786) 2024-06-06T03:32:44.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.140+0000 7f0738e30700 1 -- 172.21.15.50:0/1078229215 learned_addr learned my addr 172.21.15.50:0/1078229215 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:44.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.141+0000 7f0738e30700 1 -- 172.21.15.50:0/1078229215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56438bf68070 msgr2=0x56438bf76230 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:32:44.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.141+0000 7f0738e30700 1 --2- 172.21.15.50:0/1078229215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56438bf68070 0x56438bf76230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.141+0000 7f0738e30700 1 -- 172.21.15.50:0/1078229215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56438bf76dc0 msgr2=0x56438bfebcd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:32:44.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.141+0000 7f0738e30700 1 --2- 172.21.15.50:0/1078229215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56438bf76dc0 0x56438bfebcd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.141+0000 7f0738e30700 1 -- 172.21.15.50:0/1078229215 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56438bf75e90 con 0x56438bf72d80 2024-06-06T03:32:44.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.142+0000 7f0738e30700 1 --2- 172.21.15.50:0/1078229215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56438bf72d80 0x56438bf76770 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0730010b00 tx=0x7f0730009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=913835003d60f426 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:44.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.142+0000 7f071cff9700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:32:44.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.144+0000 7f071cff9700 1 -- 172.21.15.50:0/1078229215 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0730018040 con 0x56438bf72d80 2024-06-06T03:32:44.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.144+0000 7f0746118b80 1 -- 172.21.15.50:0/1078229215 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56438bec2290 con 0x56438bf72d80 2024-06-06T03:32:44.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.144+0000 7f071cff9700 1 -- 172.21.15.50:0/1078229215 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f07300135e0 con 0x56438bf72d80 2024-06-06T03:32:44.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.148+0000 7f071cff9700 1 -- 172.21.15.50:0/1078229215 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f0730013840 con 0x56438bf72d80 2024-06-06T03:32:44.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.148+0000 7f0746118b80 10 client.16296 fetch_fsmap learned FSMap version 33 2024-06-06T03:32:44.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.148+0000 7f0746118b80 1 -- 172.21.15.50:0/1078229215 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56438bffe660 con 0x56438bf72d80 2024-06-06T03:32:44.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.150+0000 7f071cff9700 1 -- 172.21.15.50:0/1078229215 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x56438bec2290 con 0x56438bf72d80 2024-06-06T03:32:44.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.150+0000 7f071cff9700 1 -- 172.21.15.50:0/1078229215 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f0730030060 con 0x56438bf72d80 2024-06-06T03:32:44.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.152+0000 7f0746118b80 10 client.16296 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:32:44.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.152+0000 7f0746118b80 10 client.16296 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-06-06T03:32:44.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.152+0000 7f0746118b80 20 client.16296 populate_metadata read hostname 'smithi050' 2024-06-06T03:32:44.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.152+0000 7f0746118b80 1 --2- 172.21.15.50:0/1078229215 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x56438bffeb90 0x56438c000fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:44.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.152+0000 7f0746118b80 4 client.16296 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:32:44.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.152+0000 7f0746118b80 1 -- 172.21.15.50:0/1078229215 --> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56438bd3c250 con 0x56438bffeb90 2024-06-06T03:32:44.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.155+0000 7f0739e32700 1 --2- 172.21.15.50:0/1078229215 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x56438bffeb90 0x56438c000fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:44.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.160+0000 7f071cff9700 10 client.16296 ms_handle_connect on v2:172.21.15.122:6834/2987597320 2024-06-06T03:32:44.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.160+0000 7f0739e32700 1 --2- 172.21.15.50:0/1078229215 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x56438bffeb90 0x56438c000fb0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c6051901d9485a8a server_cookie=f1ef5ebb6cae9bc in_seq=0 out_seq=0 2024-06-06T03:32:44.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.161+0000 7f071cff9700 1 -- 172.21.15.50:0/1078229215 <== mds.2 v2:172.21.15.122:6834/2987597320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56438bd3c250 con 0x56438bffeb90 2024-06-06T03:32:44.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.161+0000 7f071cff9700 10 client.16296 handle_command_reply: tid=0 2024-06-06T03:32:44.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.161+0000 7f0746118b80 1 client.16296 shutdown 2024-06-06T03:32:44.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.162+0000 7f0746118b80 1 -- 172.21.15.50:0/1078229215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56438bf72d80 msgr2=0x56438bf76770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:44.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.162+0000 7f0746118b80 1 --2- 172.21.15.50:0/1078229215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56438bf72d80 0x56438bf76770 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0730010b00 tx=0x7f0730009620 comp rx=0 tx=0).stop 2024-06-06T03:32:44.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.165+0000 7f0746118b80 1 -- 172.21.15.50:0/1078229215 shutdown_connections 2024-06-06T03:32:44.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.165+0000 7f0746118b80 1 --2- 172.21.15.50:0/1078229215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56438bf76dc0 0x56438bfebcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.165+0000 7f0746118b80 1 --2- 172.21.15.50:0/1078229215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56438bf68070 0x56438bf76230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.165+0000 7f0746118b80 1 --2- 172.21.15.50:0/1078229215 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x56438bffeb90 0x56438c000fb0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.165+0000 7f0746118b80 1 --2- 172.21.15.50:0/1078229215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56438bf72d80 0x56438bf76770 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.165+0000 7f0746118b80 1 -- 172.21.15.50:0/1078229215 >> 172.21.15.50:0/1078229215 conn(0x56438be93cc0 msgr2=0x56438bf71880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:44.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.165+0000 7f071cff9700 0 client.16296 ms_handle_reset on v2:172.21.15.122:6834/2987597320 2024-06-06T03:32:44.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.166+0000 7f0746118b80 1 -- 172.21.15.50:0/1078229215 shutdown_connections 2024-06-06T03:32:44.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.167+0000 7f0746118b80 1 -- 172.21.15.50:0/1078229215 wait complete. 2024-06-06T03:32:44.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.168+0000 7f0746118b80 20 client.16296 trim_cache size 0 max 16384 2024-06-06T03:32:44.168 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:32:44.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.171+0000 7f071ffff700 1 -- 172.21.15.50:0/1896967969 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f07200a2d70 msgr2=0x7f07200a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:44.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.171+0000 7f071ffff700 1 --2- 172.21.15.50:0/1896967969 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f07200a2d70 0x7f07200a5230 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f073408d040 tx=0x7f073408df90 comp rx=0 tx=0).stop 2024-06-06T03:32:44.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.171+0000 7f071ffff700 1 -- 172.21.15.50:0/1896967969 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f072c0981c0 msgr2=0x7f072c13b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:44.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.171+0000 7f071ffff700 1 --2- 172.21.15.50:0/1896967969 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f072c0981c0 0x7f072c13b900 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0734067c00 tx=0x7f0734065700 comp rx=0 tx=0).stop 2024-06-06T03:32:44.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.172+0000 7f071ffff700 1 -- 172.21.15.50:0/1896967969 shutdown_connections 2024-06-06T03:32:44.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.172+0000 7f071ffff700 1 --2- 172.21.15.50:0/1896967969 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f07200a2d70 0x7f07200a5230 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.172+0000 7f071ffff700 1 --2- 172.21.15.50:0/1896967969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f072c09d2a0 0x7f072c13fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.172+0000 7f071ffff700 1 --2- 172.21.15.50:0/1896967969 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f072c0981c0 0x7f072c13b900 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.172+0000 7f071ffff700 1 --2- 172.21.15.50:0/1896967969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f072c098b70 0x7f072c13be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:44.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.172+0000 7f071ffff700 1 -- 172.21.15.50:0/1896967969 >> 172.21.15.50:0/1896967969 conn(0x7f072c093a50 msgr2=0x7f072c094170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:44.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.172+0000 7f071ffff700 1 -- 172.21.15.50:0/1896967969 shutdown_connections 2024-06-06T03:32:44.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:44.172+0000 7f071ffff700 1 -- 172.21.15.50:0/1896967969 wait complete. 2024-06-06T03:32:45.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:45 smithi079 ceph-mon[35478]: pgmap v614: 129 pgs: 129 active+clean; 10 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 35 MiB/s wr, 603 op/s 2024-06-06T03:32:45.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:45 smithi122 ceph-mon[35759]: pgmap v614: 129 pgs: 129 active+clean; 10 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 35 MiB/s wr, 603 op/s 2024-06-06T03:32:45.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:45 smithi050 ceph-mon[32421]: pgmap v614: 129 pgs: 129 active+clean; 10 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 35 MiB/s wr, 603 op/s 2024-06-06T03:32:46.698 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-06-06T03:32:47.305 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:32:47.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:47 smithi079 ceph-mon[35478]: pgmap v615: 129 pgs: 129 active+clean; 10 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 41 MiB/s wr, 704 op/s 2024-06-06T03:32:47.649 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:47 smithi050 ceph-mon[32421]: pgmap v615: 129 pgs: 129 active+clean; 10 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 41 MiB/s wr, 704 op/s 2024-06-06T03:32:47.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:47 smithi122 ceph-mon[35759]: pgmap v615: 129 pgs: 129 active+clean; 10 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 41 MiB/s wr, 704 op/s 2024-06-06T03:32:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.222+0000 7f0f5d384640 1 -- 172.21.15.50:0/4055711604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f5810dcc0 msgr2=0x7f0f5810e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.222+0000 7f0f5d384640 1 --2- 172.21.15.50:0/4055711604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f5810dcc0 0x7f0f5810e140 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f0f50009ca0 tx=0x7f0f5002a8d0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.228 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.226+0000 7f0f5d384640 1 -- 172.21.15.50:0/4055711604 shutdown_connections 2024-06-06T03:32:49.228 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.226+0000 7f0f5d384640 1 --2- 172.21.15.50:0/4055711604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f5810dcc0 0x7f0f5810e140 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.226+0000 7f0f5d384640 1 --2- 172.21.15.50:0/4055711604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f5810b310 0x7f0f5810d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.226+0000 7f0f5d384640 1 --2- 172.21.15.50:0/4055711604 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f581089a0 0x7f0f5810add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.226+0000 7f0f5d384640 1 -- 172.21.15.50:0/4055711604 >> 172.21.15.50:0/4055711604 conn(0x7f0f5806ea10 msgr2=0x7f0f58070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.234+0000 7f0f5d384640 1 -- 172.21.15.50:0/4055711604 shutdown_connections 2024-06-06T03:32:49.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.237+0000 7f0f5d384640 1 -- 172.21.15.50:0/4055711604 wait complete. 2024-06-06T03:32:49.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.239+0000 7f0f5d384640 1 Processor -- start 2024-06-06T03:32:49.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.241+0000 7f0f5d384640 1 -- start start 2024-06-06T03:32:49.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.241+0000 7f0f5d384640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f581089a0 0x7f0f58114f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.241+0000 7f0f5d384640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f5810b310 0x7f0f581154d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.241+0000 7f0f5d384640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f5810dcc0 0x7f0f581a5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.241+0000 7f0f5d384640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5811c390 con 0x7f0f5810b310 2024-06-06T03:32:49.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.241+0000 7f0f5d384640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5811c210 con 0x7f0f5810dcc0 2024-06-06T03:32:49.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.241+0000 7f0f5d384640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5811c510 con 0x7f0f581089a0 2024-06-06T03:32:49.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.242+0000 7f0f577fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f5810dcc0 0x7f0f581a5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:49.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.242+0000 7f0f577fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f5810dcc0 0x7f0f581a5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:43306/0 (socket says 172.21.15.50:43306) 2024-06-06T03:32:49.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.242+0000 7f0f577fe640 1 -- 172.21.15.50:0/1582530269 learned_addr learned my addr 172.21.15.50:0/1582530269 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:49.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.242+0000 7f0f56ffd640 1 --2- 172.21.15.50:0/1582530269 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f581089a0 0x7f0f58114f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:49.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.244+0000 7f0f577fe640 1 -- 172.21.15.50:0/1582530269 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f581089a0 msgr2=0x7f0f58114f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:49.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.244+0000 7f0f577fe640 1 --2- 172.21.15.50:0/1582530269 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f581089a0 0x7f0f58114f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.244+0000 7f0f577fe640 1 -- 172.21.15.50:0/1582530269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f5810b310 msgr2=0x7f0f581154d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T03:32:49.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.244+0000 7f0f577fe640 1 --2- 172.21.15.50:0/1582530269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f5810b310 0x7f0f581154d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.244+0000 7f0f577fe640 1 -- 172.21.15.50:0/1582530269 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f58118670 con 0x7f0f5810dcc0 2024-06-06T03:32:49.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.250+0000 7f0f577fe640 1 --2- 172.21.15.50:0/1582530269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f5810dcc0 0x7f0f581a5a30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0f5002adf0 tx=0x7f0f50003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.250+0000 7f0f3ffff640 1 -- 172.21.15.50:0/1582530269 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f50004040 con 0x7f0f5810dcc0 2024-06-06T03:32:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.250+0000 7f0f3ffff640 1 -- 172.21.15.50:0/1582530269 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0f50004690 con 0x7f0f5810dcc0 2024-06-06T03:32:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.250+0000 7f0f3ffff640 1 -- 172.21.15.50:0/1582530269 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f50030e60 con 0x7f0f5810dcc0 2024-06-06T03:32:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.251+0000 7f0f5d384640 1 -- 172.21.15.50:0/1582530269 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f581a5fd0 con 0x7f0f5810dcc0 2024-06-06T03:32:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.251+0000 7f0f5d384640 1 -- 172.21.15.50:0/1582530269 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f581a64d0 con 0x7f0f5810dcc0 2024-06-06T03:32:49.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.259+0000 7f0f3ffff640 1 -- 172.21.15.50:0/1582530269 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0f5004e430 con 0x7f0f5810dcc0 2024-06-06T03:32:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.260+0000 7f0f3ffff640 1 --2- 172.21.15.50:0/1582530269 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f0f400a2e20 0x7f0f400a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.260+0000 7f0f3ffff640 1 -- 172.21.15.50:0/1582530269 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f0f500f1a40 con 0x7f0f5810dcc0 2024-06-06T03:32:49.270 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.265+0000 7f0f60168740 1 Processor -- start 2024-06-06T03:32:49.270 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.265+0000 7f0f60168740 1 -- start start 2024-06-06T03:32:49.270 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.265+0000 7f0f60168740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612db7ea010 0x5612db7ea430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.265+0000 7f0f60168740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612db7eaa00 0x5612db7ef500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.265+0000 7f0f60168740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5612db7efb70 0x5612db7f2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.266+0000 7f0f60168740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5612db74d4f0 con 0x5612db7eaa00 2024-06-06T03:32:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.266+0000 7f0f60168740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5612db6eb870 con 0x5612db7ea010 2024-06-06T03:32:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.266+0000 7f0f60168740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5612db7494b0 con 0x5612db7efb70 2024-06-06T03:32:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.267+0000 7f0f567fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612db7eaa00 0x5612db7ef500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.267+0000 7f0f567fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612db7eaa00 0x5612db7ef500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55608/0 (socket says 172.21.15.50:55608) 2024-06-06T03:32:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.267+0000 7f0f567fc640 1 -- 172.21.15.50:0/1464473284 learned_addr learned my addr 172.21.15.50:0/1464473284 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.268+0000 7f0f567fc640 1 -- 172.21.15.50:0/1464473284 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5612db7efb70 msgr2=0x5612db7f2000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:32:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.268+0000 7f0f567fc640 1 --2- 172.21.15.50:0/1464473284 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5612db7efb70 0x5612db7f2000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.268+0000 7f0f567fc640 1 -- 172.21.15.50:0/1464473284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612db7ea010 msgr2=0x5612db7ea430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:32:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.268+0000 7f0f567fc640 1 --2- 172.21.15.50:0/1464473284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612db7ea010 0x5612db7ea430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.268+0000 7f0f567fc640 1 -- 172.21.15.50:0/1464473284 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612db7079b0 con 0x5612db7eaa00 2024-06-06T03:32:49.272 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.269+0000 7f0f567fc640 1 --2- 172.21.15.50:0/1464473284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612db7eaa00 0x5612db7ef500 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0f48009b70 tx=0x7f0f48030730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=439a17b264ac3b64 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:49.281 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.282+0000 7f0f3d7fa640 1 -- 172.21.15.50:0/1464473284 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f48009e60 con 0x5612db7eaa00 2024-06-06T03:32:49.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.282+0000 7f0f3d7fa640 1 -- 172.21.15.50:0/1464473284 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0f480054d0 con 0x5612db7eaa00 2024-06-06T03:32:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.283+0000 7f0f60168740 1 -- 172.21.15.50:0/1464473284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612db7eaa00 msgr2=0x5612db7ef500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.283+0000 7f0f60168740 1 --2- 172.21.15.50:0/1464473284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612db7eaa00 0x5612db7ef500 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0f48009b70 tx=0x7f0f48030730 comp rx=0 tx=0).stop 2024-06-06T03:32:49.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.287+0000 7f0f56ffd640 1 --2- 172.21.15.50:0/1582530269 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f0f400a2e20 0x7f0f400a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.287+0000 7f0f60168740 1 -- 172.21.15.50:0/1464473284 shutdown_connections 2024-06-06T03:32:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.287+0000 7f0f60168740 1 --2- 172.21.15.50:0/1464473284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612db7eaa00 0x5612db7ef500 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.287+0000 7f0f60168740 1 --2- 172.21.15.50:0/1464473284 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5612db7efb70 0x5612db7f2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.287+0000 7f0f60168740 1 --2- 172.21.15.50:0/1464473284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612db7ea010 0x5612db7ea430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.287+0000 7f0f60168740 1 -- 172.21.15.50:0/1464473284 >> 172.21.15.50:0/1464473284 conn(0x5612db7e5680 msgr2=0x5612db7e5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.292+0000 7f0f60168740 1 -- 172.21.15.50:0/1464473284 shutdown_connections 2024-06-06T03:32:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.296+0000 7f0f60168740 1 -- 172.21.15.50:0/1464473284 wait complete. 2024-06-06T03:32:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.296+0000 7f0f60168740 1 -- start start 2024-06-06T03:32:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.297+0000 7f0f60168740 1 Processor -- start 2024-06-06T03:32:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.297+0000 7f0f60168740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612db7ea010 0x5612db7f4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.297+0000 7f0f60168740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5612db7eaa00 0x5612db7f4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.297+0000 7f0f60168740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612db7efb70 0x5612db7fb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.297+0000 7f0f60168740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5612db7f2b70 con 0x5612db7ea010 2024-06-06T03:32:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.297+0000 7f0f60168740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5612db6d6ae0 con 0x5612db7efb70 2024-06-06T03:32:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.297+0000 7f0f60168740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5612db7f2cf0 con 0x5612db7eaa00 2024-06-06T03:32:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.297+0000 7f0f60168740 10 client.0 _ll_register_callbacks cb 0x5612db70f9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:32:49.300 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.299+0000 7f0f567fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5612db7eaa00 0x5612db7f4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:49.300 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.299+0000 7f0f577fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612db7efb70 0x5612db7fb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.301+0000 7f0f567fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5612db7eaa00 0x5612db7f4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:60652/0 (socket says 172.21.15.50:60652) 2024-06-06T03:32:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.301+0000 7f0f567fc640 1 -- 172.21.15.50:0/2869086332 learned_addr learned my addr 172.21.15.50:0/2869086332 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.302+0000 7f0f56ffd640 1 --2- 172.21.15.50:0/1582530269 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f0f400a2e20 0x7f0f400a52e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x5612db7eb260 tx=0x7f0f4c005b80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.302+0000 7f0f56ffd640 1 --2- 172.21.15.50:0/2869086332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612db7ea010 0x5612db7f4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.302+0000 7f0f567fc640 1 -- 172.21.15.50:0/2869086332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612db7efb70 msgr2=0x5612db7fb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.302+0000 7f0f567fc640 1 --2- 172.21.15.50:0/2869086332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612db7efb70 0x5612db7fb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.302+0000 7f0f567fc640 1 -- 172.21.15.50:0/2869086332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612db7ea010 msgr2=0x5612db7f4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.302+0000 7f0f567fc640 1 --2- 172.21.15.50:0/2869086332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612db7ea010 0x5612db7f4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.302+0000 7f0f567fc640 1 -- 172.21.15.50:0/2869086332 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612db461210 con 0x5612db7eaa00 2024-06-06T03:32:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.303+0000 7f0f56ffd640 1 --2- 172.21.15.50:0/2869086332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612db7ea010 0x5612db7f4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:32:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.303+0000 7f0f567fc640 1 --2- 172.21.15.50:0/2869086332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5612db7eaa00 0x5612db7f4850 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0f48009b40 tx=0x7f0f48004830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9837d2dd110c7290 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.303+0000 7f0f3aff5640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:32:49.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.306+0000 7f0f3aff5640 1 -- 172.21.15.50:0/2869086332 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4803f040 con 0x5612db7eaa00 2024-06-06T03:32:49.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.306+0000 7f0f60168740 1 -- 172.21.15.50:0/2869086332 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f480054d0 con 0x5612db7eaa00 2024-06-06T03:32:49.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.306+0000 7f0f3aff5640 1 -- 172.21.15.50:0/2869086332 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f0f48004e50 con 0x5612db7eaa00 2024-06-06T03:32:49.307 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.306+0000 7f0f3aff5640 1 -- 172.21.15.50:0/2869086332 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f0f48052050 con 0x5612db7eaa00 2024-06-06T03:32:49.307 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.307+0000 7f0f60168740 10 client.25912 fetch_fsmap learned FSMap version 33 2024-06-06T03:32:49.307 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.307+0000 7f0f60168740 1 -- 172.21.15.50:0/2869086332 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5612db52d620 con 0x5612db7eaa00 2024-06-06T03:32:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.310+0000 7f0f3aff5640 1 -- 172.21.15.50:0/2869086332 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0f480054d0 con 0x5612db7eaa00 2024-06-06T03:32:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.310+0000 7f0f3aff5640 1 -- 172.21.15.50:0/2869086332 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f0f4803a430 con 0x5612db7eaa00 2024-06-06T03:32:49.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.311+0000 7f0f60168740 10 client.25912 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:32:49.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.311+0000 7f0f60168740 10 client.25912 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:32:49.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.311+0000 7f0f60168740 20 client.25912 populate_metadata read hostname 'smithi050' 2024-06-06T03:32:49.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.311+0000 7f0f60168740 1 --2- 172.21.15.50:0/2869086332 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5612db800480 0x5612db8028a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.311+0000 7f0f60168740 4 client.25912 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:32:49.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.311+0000 7f0f60168740 1 -- 172.21.15.50:0/2869086332 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5612db760f10 con 0x5612db800480 2024-06-06T03:32:49.312 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.312+0000 7f0f56ffd640 1 --2- 172.21.15.50:0/2869086332 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5612db800480 0x5612db8028a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.313+0000 7f0f56ffd640 1 --2- 172.21.15.50:0/2869086332 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5612db800480 0x5612db8028a0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a24f7b0f9708f3a server_cookie=b5b629363dc194d6 in_seq=0 out_seq=0 2024-06-06T03:32:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.316+0000 7f0f3aff5640 10 client.25912 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:32:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.316+0000 7f0f3aff5640 1 -- 172.21.15.50:0/2869086332 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5612db760f10 con 0x5612db800480 2024-06-06T03:32:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.316+0000 7f0f3aff5640 10 client.25912 handle_command_reply: tid=0 2024-06-06T03:32:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.316+0000 7f0f60168740 1 client.25912 shutdown 2024-06-06T03:32:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.322+0000 7f0f60168740 1 -- 172.21.15.50:0/2869086332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5612db7eaa00 msgr2=0x5612db7f4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.322+0000 7f0f60168740 1 --2- 172.21.15.50:0/2869086332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5612db7eaa00 0x5612db7f4850 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0f48009b40 tx=0x7f0f48004830 comp rx=0 tx=0).stop 2024-06-06T03:32:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.322+0000 7f0f60168740 1 -- 172.21.15.50:0/2869086332 shutdown_connections 2024-06-06T03:32:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.322+0000 7f0f60168740 1 --2- 172.21.15.50:0/2869086332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612db7efb70 0x5612db7fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.322+0000 7f0f60168740 1 --2- 172.21.15.50:0/2869086332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5612db7eaa00 0x5612db7f4850 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.322+0000 7f0f60168740 1 --2- 172.21.15.50:0/2869086332 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5612db800480 0x5612db8028a0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.322+0000 7f0f60168740 1 --2- 172.21.15.50:0/2869086332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612db7ea010 0x5612db7f4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.322+0000 7f0f60168740 1 -- 172.21.15.50:0/2869086332 >> 172.21.15.50:0/2869086332 conn(0x5612db7e5680 msgr2=0x5612db7e47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.322+0000 7f0f3aff5640 0 client.25912 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:32:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.322+0000 7f0f60168740 1 -- 172.21.15.50:0/2869086332 shutdown_connections 2024-06-06T03:32:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.322+0000 7f0f60168740 1 -- 172.21.15.50:0/2869086332 wait complete. 2024-06-06T03:32:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.323+0000 7f0f60168740 20 client.25912 trim_cache size 0 max 16384 2024-06-06T03:32:49.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.399+0000 7f0f60168740 1 Processor -- start 2024-06-06T03:32:49.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.400+0000 7f0f60168740 1 -- start start 2024-06-06T03:32:49.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.400+0000 7f0f60168740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5612db7ea010 0x5612db7ebbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.401 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.400+0000 7f0f60168740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612db7eaa00 0x5612db7fb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.401 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.400+0000 7f0f60168740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612db7efb70 0x5612db7ec120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.401 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.401+0000 7f0f60168740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0f44012570 con 0x5612db7efb70 2024-06-06T03:32:49.401 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.401+0000 7f0f60168740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4400fe40 con 0x5612db7eaa00 2024-06-06T03:32:49.401 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.401+0000 7f0f60168740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4400dc90 con 0x5612db7ea010 2024-06-06T03:32:49.408 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.401+0000 7f0f577fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612db7efb70 0x5612db7ec120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:49.408 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.401+0000 7f0f577fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612db7efb70 0x5612db7ec120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55612/0 (socket says 172.21.15.50:55612) 2024-06-06T03:32:49.408 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.401+0000 7f0f577fe640 1 -- 172.21.15.50:0/15008375 learned_addr learned my addr 172.21.15.50:0/15008375 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.401+0000 7f0f567fc640 1 --2- 172.21.15.50:0/15008375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612db7eaa00 0x5612db7fb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.402+0000 7f0f56ffd640 1 --2- 172.21.15.50:0/15008375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5612db7ea010 0x5612db7ebbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.402+0000 7f0f567fc640 1 -- 172.21.15.50:0/15008375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5612db7ea010 msgr2=0x5612db7ebbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.402+0000 7f0f567fc640 1 --2- 172.21.15.50:0/15008375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5612db7ea010 0x5612db7ebbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.402+0000 7f0f567fc640 1 -- 172.21.15.50:0/15008375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612db7efb70 msgr2=0x5612db7ec120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.402+0000 7f0f567fc640 1 --2- 172.21.15.50:0/15008375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612db7efb70 0x5612db7ec120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.402+0000 7f0f567fc640 1 -- 172.21.15.50:0/15008375 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612db7f1f80 con 0x5612db7eaa00 2024-06-06T03:32:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.402+0000 7f0f567fc640 1 --2- 172.21.15.50:0/15008375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612db7eaa00 0x5612db7fb820 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x5612db7dfd20 tx=0x7f0f480049a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15c7494f461f3779 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.403+0000 7f0f3cff9640 1 -- 172.21.15.50:0/15008375 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f48009800 con 0x5612db7eaa00 2024-06-06T03:32:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.403+0000 7f0f3cff9640 1 -- 172.21.15.50:0/15008375 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0f4803be50 con 0x5612db7eaa00 2024-06-06T03:32:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.403+0000 7f0f3cff9640 1 -- 172.21.15.50:0/15008375 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4803a630 con 0x5612db7eaa00 2024-06-06T03:32:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.406+0000 7f0f60168740 1 -- 172.21.15.50:0/15008375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612db7eaa00 msgr2=0x5612db7fb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.406+0000 7f0f60168740 1 --2- 172.21.15.50:0/15008375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612db7eaa00 0x5612db7fb820 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x5612db7dfd20 tx=0x7f0f480049a0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.410 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.409+0000 7f0f60168740 1 -- 172.21.15.50:0/15008375 shutdown_connections 2024-06-06T03:32:49.411 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.410+0000 7f0f60168740 1 --2- 172.21.15.50:0/15008375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612db7efb70 0x5612db7ec120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.411 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.410+0000 7f0f60168740 1 --2- 172.21.15.50:0/15008375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612db7eaa00 0x5612db7fb820 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.411 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.410+0000 7f0f60168740 1 --2- 172.21.15.50:0/15008375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5612db7ea010 0x5612db7ebbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.411 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.410+0000 7f0f60168740 1 -- 172.21.15.50:0/15008375 >> 172.21.15.50:0/15008375 conn(0x5612db7e5680 msgr2=0x5612db7ef240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:49.411 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.410+0000 7f0f60168740 1 -- 172.21.15.50:0/15008375 shutdown_connections 2024-06-06T03:32:49.411 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.411+0000 7f0f60168740 1 -- 172.21.15.50:0/15008375 wait complete. 2024-06-06T03:32:49.412 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.413+0000 7f0f60168740 1 -- start start 2024-06-06T03:32:49.413 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.414+0000 7f0f60168740 1 Processor -- start 2024-06-06T03:32:49.414 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.414+0000 7f0f60168740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612db7ea010 0x5612db7fb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.414 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.415+0000 7f0f60168740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612db7eaa00 0x5612db7fb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.415 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.415+0000 7f0f60168740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5612db7efb70 0x5612db7f7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.415 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.415+0000 7f0f60168740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4400e300 con 0x5612db7eaa00 2024-06-06T03:32:49.415 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.415+0000 7f0f60168740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4400f770 con 0x5612db7ea010 2024-06-06T03:32:49.415 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.415+0000 7f0f60168740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4400e9d0 con 0x5612db7efb70 2024-06-06T03:32:49.416 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.416+0000 7f0f60168740 10 client.0 _ll_register_callbacks cb 0x7f0f48009a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:32:49.416 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.416+0000 7f0f56ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612db7ea010 0x5612db7fb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:49.416 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.417+0000 7f0f56ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612db7ea010 0x5612db7fb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:43332/0 (socket says 172.21.15.50:43332) 2024-06-06T03:32:49.416 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.417+0000 7f0f56ffd640 1 -- 172.21.15.50:0/2635071928 learned_addr learned my addr 172.21.15.50:0/2635071928 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:49.417 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.417+0000 7f0f567fc640 1 --2- 172.21.15.50:0/2635071928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612db7eaa00 0x5612db7fb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:49.417 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.418+0000 7f0f56ffd640 1 -- 172.21.15.50:0/2635071928 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5612db7efb70 msgr2=0x5612db7f7b10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:32:49.418 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.418+0000 7f0f56ffd640 1 --2- 172.21.15.50:0/2635071928 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5612db7efb70 0x5612db7f7b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.418 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.418+0000 7f0f56ffd640 1 -- 172.21.15.50:0/2635071928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612db7eaa00 msgr2=0x5612db7fb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:49.418 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.418+0000 7f0f56ffd640 1 --2- 172.21.15.50:0/2635071928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612db7eaa00 0x5612db7fb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.418 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.418+0000 7f0f56ffd640 1 -- 172.21.15.50:0/2635071928 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612db7f8150 con 0x5612db7ea010 2024-06-06T03:32:49.421 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.421+0000 7f0f56ffd640 1 --2- 172.21.15.50:0/2635071928 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612db7ea010 0x5612db7fb070 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c024fd0 tx=0x7f0f4c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dbedbd3c3aa6e0a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:49.421 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.422+0000 7f0f3aff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:32:49.423 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.423+0000 7f0f3aff5640 1 -- 172.21.15.50:0/2635071928 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c01bdc0 con 0x5612db7ea010 2024-06-06T03:32:49.423 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.424+0000 7f0f3aff5640 1 -- 172.21.15.50:0/2635071928 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f0f4c005020 con 0x5612db7ea010 2024-06-06T03:32:49.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.424+0000 7f0f60168740 1 -- 172.21.15.50:0/2635071928 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f4803be50 con 0x5612db7ea010 2024-06-06T03:32:49.427 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.427+0000 7f0f3aff5640 1 -- 172.21.15.50:0/2635071928 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f0f4c032050 con 0x5612db7ea010 2024-06-06T03:32:49.427 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.427+0000 7f0f60168740 10 client.25943 fetch_fsmap learned FSMap version 33 2024-06-06T03:32:49.427 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.427+0000 7f0f60168740 1 -- 172.21.15.50:0/2635071928 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5612db869db0 con 0x5612db7ea010 2024-06-06T03:32:49.428 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.428+0000 7f0f3aff5640 1 -- 172.21.15.50:0/2635071928 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0f4803be50 con 0x5612db7ea010 2024-06-06T03:32:49.429 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.430+0000 7f0f3aff5640 1 -- 172.21.15.50:0/2635071928 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f0f4c024330 con 0x5612db7ea010 2024-06-06T03:32:49.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.430+0000 7f0f60168740 10 client.25943 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:32:49.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.430+0000 7f0f60168740 10 client.25943 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:32:49.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.430+0000 7f0f60168740 20 client.25943 populate_metadata read hostname 'smithi050' 2024-06-06T03:32:49.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.430+0000 7f0f60168740 1 --2- 172.21.15.50:0/2635071928 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5612db86a790 0x5612db86cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.430+0000 7f0f60168740 4 client.25943 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:32:49.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.430+0000 7f0f60168740 1 -- 172.21.15.50:0/2635071928 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5612db75ac20 con 0x5612db86a790 2024-06-06T03:32:49.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.430+0000 7f0f567fc640 1 --2- 172.21.15.50:0/2635071928 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5612db86a790 0x5612db86cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:49.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.431+0000 7f0f567fc640 1 --2- 172.21.15.50:0/2635071928 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5612db86a790 0x5612db86cbb0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3d39c19040f53ff server_cookie=1d3b1f52341ea4fc in_seq=0 out_seq=0 2024-06-06T03:32:49.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.431+0000 7f0f3aff5640 10 client.25943 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:32:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.444+0000 7f0f3aff5640 1 -- 172.21.15.50:0/2635071928 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5612db75ac20 con 0x5612db86a790 2024-06-06T03:32:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.445+0000 7f0f3aff5640 10 client.25943 handle_command_reply: tid=0 2024-06-06T03:32:49.445 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.445+0000 7f0f60168740 1 client.25943 shutdown 2024-06-06T03:32:49.446 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.445+0000 7f0f60168740 1 -- 172.21.15.50:0/2635071928 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612db7ea010 msgr2=0x5612db7fb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:49.446 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.445+0000 7f0f60168740 1 --2- 172.21.15.50:0/2635071928 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612db7ea010 0x5612db7fb070 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c024fd0 tx=0x7f0f4c004730 comp rx=0 tx=0).stop 2024-06-06T03:32:49.446 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.445+0000 7f0f60168740 1 -- 172.21.15.50:0/2635071928 shutdown_connections 2024-06-06T03:32:49.446 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.445+0000 7f0f60168740 1 --2- 172.21.15.50:0/2635071928 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5612db86a790 0x5612db86cbb0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.446 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.445+0000 7f0f60168740 1 --2- 172.21.15.50:0/2635071928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612db7eaa00 0x5612db7fb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.446 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.445+0000 7f0f3aff5640 0 client.25943 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:32:49.446 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.445+0000 7f0f60168740 1 --2- 172.21.15.50:0/2635071928 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5612db7efb70 0x5612db7f7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.446 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.445+0000 7f0f60168740 1 --2- 172.21.15.50:0/2635071928 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612db7ea010 0x5612db7fb070 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.446 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.446+0000 7f0f60168740 1 -- 172.21.15.50:0/2635071928 >> 172.21.15.50:0/2635071928 conn(0x5612db7e5680 msgr2=0x5612db7ebbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:49.448 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.448+0000 7f0f60168740 1 -- 172.21.15.50:0/2635071928 shutdown_connections 2024-06-06T03:32:49.448 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.449+0000 7f0f60168740 1 -- 172.21.15.50:0/2635071928 wait complete. 2024-06-06T03:32:49.450 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.451+0000 7f0f60168740 20 client.25943 trim_cache size 0 max 16384 2024-06-06T03:32:49.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:32:49.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:32:49.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:32:49.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.451+0000 7f0f5d384640 1 -- 172.21.15.50:0/1582530269 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f0f400a2e20 msgr2=0x7f0f400a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:49.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.452+0000 7f0f5d384640 1 --2- 172.21.15.50:0/1582530269 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f0f400a2e20 0x7f0f400a52e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x5612db7eb260 tx=0x7f0f4c005b80 comp rx=0 tx=0).stop 2024-06-06T03:32:49.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.452+0000 7f0f5d384640 1 -- 172.21.15.50:0/1582530269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f5810dcc0 msgr2=0x7f0f581a5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:49.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.452+0000 7f0f5d384640 1 --2- 172.21.15.50:0/1582530269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f5810dcc0 0x7f0f581a5a30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0f5002adf0 tx=0x7f0f50003ba0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.462 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.462+0000 7f0f5d384640 1 -- 172.21.15.50:0/1582530269 shutdown_connections 2024-06-06T03:32:49.462 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.462+0000 7f0f5d384640 1 --2- 172.21.15.50:0/1582530269 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f0f400a2e20 0x7f0f400a52e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.462+0000 7f0f5d384640 1 --2- 172.21.15.50:0/1582530269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f5810b310 0x7f0f581154d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.462+0000 7f0f5d384640 1 --2- 172.21.15.50:0/1582530269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f5810dcc0 0x7f0f581a5a30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.462+0000 7f0f5d384640 1 --2- 172.21.15.50:0/1582530269 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f581089a0 0x7f0f58114f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.462+0000 7f0f5d384640 1 -- 172.21.15.50:0/1582530269 >> 172.21.15.50:0/1582530269 conn(0x7f0f5806ea10 msgr2=0x7f0f5810d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:49.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.464+0000 7f0f5d384640 1 -- 172.21.15.50:0/1582530269 shutdown_connections 2024-06-06T03:32:49.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:32:49.464+0000 7f0f5d384640 1 -- 172.21.15.50:0/1582530269 wait complete. 2024-06-06T03:32:49.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.487+0000 7f791b52a700 1 -- 172.21.15.50:0/2544455891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f791410a360 msgr2=0x7f79141154a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:49.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.487+0000 7f791b52a700 1 --2- 172.21.15.50:0/2544455891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f791410a360 0x7f79141154a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f790c00b0a0 tx=0x7f790c00b3b0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.489+0000 7f791b52a700 1 -- 172.21.15.50:0/2544455891 shutdown_connections 2024-06-06T03:32:49.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.489+0000 7f791b52a700 1 --2- 172.21.15.50:0/2544455891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f791410a360 0x7f79141154a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.489+0000 7f791b52a700 1 --2- 172.21.15.50:0/2544455891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7914101180 0x7f7914101560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.489+0000 7f791b52a700 1 --2- 172.21.15.50:0/2544455891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7914101b30 0x7f7914112f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.489+0000 7f791b52a700 1 -- 172.21.15.50:0/2544455891 >> 172.21.15.50:0/2544455891 conn(0x7f79140fcd70 msgr2=0x7f79140ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:49.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.494+0000 7f791b52a700 1 -- 172.21.15.50:0/2544455891 shutdown_connections 2024-06-06T03:32:49.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.494+0000 7f791b52a700 1 -- 172.21.15.50:0/2544455891 wait complete. 2024-06-06T03:32:49.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.495+0000 7f791b52a700 1 Processor -- start 2024-06-06T03:32:49.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.495+0000 7f791b52a700 1 -- start start 2024-06-06T03:32:49.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.495+0000 7f791b52a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7914101180 0x7f7914114e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.495+0000 7f791b52a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7914101b30 0x7f7914115340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.495+0000 7f791b52a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f791410a360 0x7f791410df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.495+0000 7f791b52a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7914118bf0 con 0x7f7914101180 2024-06-06T03:32:49.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.495+0000 7f791b52a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7914118a70 con 0x7f7914101b30 2024-06-06T03:32:49.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.495+0000 7f791b52a700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7914118d70 con 0x7f791410a360 2024-06-06T03:32:49.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.497+0000 7f791a528700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7914101180 0x7f7914114e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:49.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.497+0000 7f791a528700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7914101180 0x7f7914114e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55650/0 (socket says 172.21.15.50:55650) 2024-06-06T03:32:49.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.497+0000 7f791a528700 1 -- 172.21.15.50:0/87763557 learned_addr learned my addr 172.21.15.50:0/87763557 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:49.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.498+0000 7f791a528700 1 -- 172.21.15.50:0/87763557 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f791410a360 msgr2=0x7f791410df30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-06T03:32:49.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.498+0000 7f791a528700 1 --2- 172.21.15.50:0/87763557 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f791410a360 0x7f791410df30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.498+0000 7f791a528700 1 -- 172.21.15.50:0/87763557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7914101b30 msgr2=0x7f7914115340 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-06T03:32:49.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.498+0000 7f791a528700 1 --2- 172.21.15.50:0/87763557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7914101b30 0x7f7914115340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.498+0000 7f791a528700 1 -- 172.21.15.50:0/87763557 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f791410e830 con 0x7f7914101180 2024-06-06T03:32:49.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.501+0000 7f791a528700 1 --2- 172.21.15.50:0/87763557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7914101180 0x7f7914114e00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f791000e9a0 tx=0x7f791000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:49.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.502+0000 7f790b7fe700 1 -- 172.21.15.50:0/87763557 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791000cbd0 con 0x7f7914101180 2024-06-06T03:32:49.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.502+0000 7f790b7fe700 1 -- 172.21.15.50:0/87763557 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f791000cd70 con 0x7f7914101180 2024-06-06T03:32:49.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.503+0000 7f790b7fe700 1 -- 172.21.15.50:0/87763557 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7910018710 con 0x7f7914101180 2024-06-06T03:32:49.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.503+0000 7f791b52a700 1 -- 172.21.15.50:0/87763557 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f791410eb20 con 0x7f7914101180 2024-06-06T03:32:49.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.503+0000 7f791b52a700 1 -- 172.21.15.50:0/87763557 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7914112b00 con 0x7f7914101180 2024-06-06T03:32:49.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.509+0000 7f792700fb80 1 Processor -- start 2024-06-06T03:32:49.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.509+0000 7f792700fb80 1 -- start start 2024-06-06T03:32:49.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.510+0000 7f792700fb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559beb8b28f0 0x559beb8b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.510+0000 7f792700fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559beb8b3210 0x559beb8acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.510+0000 7f792700fb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559beb8ad080 0x559beb8ad4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.510+0000 7f791ad29700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559beb8b28f0 0x559beb8b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:49.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.510+0000 7f791ad29700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559beb8b28f0 0x559beb8b2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55658/0 (socket says 172.21.15.50:55658) 2024-06-06T03:32:49.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.510+0000 7f791ad29700 1 -- 172.21.15.50:0/2576572859 learned_addr learned my addr 172.21.15.50:0/2576572859 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:49.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.510+0000 7f792700fb80 1 -- 172.21.15.50:0/2576572859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559beb7fe810 con 0x559beb8b28f0 2024-06-06T03:32:49.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.510+0000 7f792700fb80 1 -- 172.21.15.50:0/2576572859 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559beb7a6720 con 0x559beb8b3210 2024-06-06T03:32:49.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.510+0000 7f792700fb80 1 -- 172.21.15.50:0/2576572859 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559beb7fa7d0 con 0x559beb8ad080 2024-06-06T03:32:49.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.511+0000 7f791ad29700 1 -- 172.21.15.50:0/2576572859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559beb8ad080 msgr2=0x559beb8ad4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:32:49.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.511+0000 7f791ad29700 1 --2- 172.21.15.50:0/2576572859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559beb8ad080 0x559beb8ad4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.511+0000 7f791ad29700 1 -- 172.21.15.50:0/2576572859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559beb8b3210 msgr2=0x559beb8acb40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:32:49.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.511+0000 7f791ad29700 1 --2- 172.21.15.50:0/2576572859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559beb8b3210 0x559beb8acb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.511+0000 7f791ad29700 1 -- 172.21.15.50:0/2576572859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559beb79cf50 con 0x559beb8b28f0 2024-06-06T03:32:49.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.513+0000 7f790b7fe700 1 -- 172.21.15.50:0/87763557 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f791001f020 con 0x7f7914101180 2024-06-06T03:32:49.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:49 smithi050 ceph-mon[32421]: pgmap v616: 129 pgs: 129 active+clean; 10 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 31 MiB/s wr, 541 op/s 2024-06-06T03:32:49.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.514+0000 7f790b7fe700 1 --2- 172.21.15.50:0/87763557 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f79000a2c80 0x7f79000a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.514+0000 7f790b7fe700 1 -- 172.21.15.50:0/87763557 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f79100cf320 con 0x7f7914101180 2024-06-06T03:32:49.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.518+0000 7f791ad29700 1 --2- 172.21.15.50:0/2576572859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559beb8b28f0 0x559beb8b2cd0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f790c0062a0 tx=0x7f790c009d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=650a6d1f8adc597e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:49.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.518+0000 7f791a528700 1 --2- 172.21.15.50:0/87763557 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f79000a2c80 0x7f79000a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:49.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.519+0000 7f7908ff9700 1 -- 172.21.15.50:0/2576572859 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c00bab0 con 0x559beb8b28f0 2024-06-06T03:32:49.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.519+0000 7f7908ff9700 1 -- 172.21.15.50:0/2576572859 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f790c00bc50 con 0x559beb8b28f0 2024-06-06T03:32:49.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.519+0000 7f7908ff9700 1 -- 172.21.15.50:0/2576572859 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c0074a0 con 0x559beb8b28f0 2024-06-06T03:32:49.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.520+0000 7f791a528700 1 --2- 172.21.15.50:0/87763557 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f79000a2c80 0x7f79000a5140 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x559beb8b35f0 tx=0x7f79100092d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:49.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.522+0000 7f792700fb80 1 -- 172.21.15.50:0/2576572859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559beb8b28f0 msgr2=0x559beb8b2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:49.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.522+0000 7f792700fb80 1 --2- 172.21.15.50:0/2576572859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559beb8b28f0 0x559beb8b2cd0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f790c0062a0 tx=0x7f790c009d10 comp rx=0 tx=0).stop 2024-06-06T03:32:49.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.524+0000 7f792700fb80 1 -- 172.21.15.50:0/2576572859 shutdown_connections 2024-06-06T03:32:49.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.524+0000 7f792700fb80 1 --2- 172.21.15.50:0/2576572859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559beb8ad080 0x559beb8ad4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.524+0000 7f792700fb80 1 --2- 172.21.15.50:0/2576572859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559beb8b28f0 0x559beb8b2cd0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.524+0000 7f792700fb80 1 --2- 172.21.15.50:0/2576572859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559beb8b3210 0x559beb8acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.524+0000 7f792700fb80 1 -- 172.21.15.50:0/2576572859 >> 172.21.15.50:0/2576572859 conn(0x559beb7d7cc0 msgr2=0x559beb8a7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:49.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.534+0000 7f792700fb80 1 -- 172.21.15.50:0/2576572859 shutdown_connections 2024-06-06T03:32:49.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.535+0000 7f792700fb80 1 -- 172.21.15.50:0/2576572859 wait complete. 2024-06-06T03:32:49.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.535+0000 7f792700fb80 1 -- start start 2024-06-06T03:32:49.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.536+0000 7f792700fb80 1 Processor -- start 2024-06-06T03:32:49.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.536+0000 7f792700fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559beb8ad080 0x559beb8b8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.536+0000 7f792700fb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559beb8b28f0 0x559beb8b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.536+0000 7f792700fb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559beb8b3210 0x559beb8b67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.536+0000 7f792700fb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559beb8cab80 con 0x559beb8b3210 2024-06-06T03:32:49.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.536+0000 7f792700fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559beb79ebf0 con 0x559beb8ad080 2024-06-06T03:32:49.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.536+0000 7f792700fb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559beb8cad00 con 0x559beb8b28f0 2024-06-06T03:32:49.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.536+0000 7f792700fb80 10 client.0 _ll_register_callbacks cb 0x559beb798920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:32:49.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.536+0000 7f7919d27700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559beb8b28f0 0x559beb8b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:49.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.536+0000 7f7919d27700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559beb8b28f0 0x559beb8b62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:60710/0 (socket says 172.21.15.50:60710) 2024-06-06T03:32:49.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.536+0000 7f7919d27700 1 -- 172.21.15.50:0/3661885696 learned_addr learned my addr 172.21.15.50:0/3661885696 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:49.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.536+0000 7f791ad29700 1 --2- 172.21.15.50:0/3661885696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559beb8ad080 0x559beb8b8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:49.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.536+0000 7f791ad29700 1 --2- 172.21.15.50:0/3661885696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559beb8b3210 0x559beb8b67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:49.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.537+0000 7f7919d27700 1 -- 172.21.15.50:0/3661885696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559beb8ad080 msgr2=0x559beb8b8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:49.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.537+0000 7f7919d27700 1 --2- 172.21.15.50:0/3661885696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559beb8ad080 0x559beb8b8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.537+0000 7f7919d27700 1 -- 172.21.15.50:0/3661885696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559beb8b3210 msgr2=0x559beb8b67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:49.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.537+0000 7f7919d27700 1 --2- 172.21.15.50:0/3661885696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559beb8b3210 0x559beb8b67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.537+0000 7f7919d27700 1 -- 172.21.15.50:0/3661885696 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559beb74d8d0 con 0x559beb8b28f0 2024-06-06T03:32:49.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.546+0000 7f7919d27700 1 --2- 172.21.15.50:0/3661885696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559beb8b28f0 0x559beb8b62a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f790400c380 tx=0x7f790400c690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e591b9e46e43672b server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:49.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.549+0000 7f78fdffb700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:32:49.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.549+0000 7f78fdffb700 1 -- 172.21.15.50:0/3661885696 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790400f660 con 0x559beb8b28f0 2024-06-06T03:32:49.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.549+0000 7f78fdffb700 1 -- 172.21.15.50:0/3661885696 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f790400f800 con 0x559beb8b28f0 2024-06-06T03:32:49.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.551+0000 7f792700fb80 1 -- 172.21.15.50:0/3661885696 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f790c00bc50 con 0x559beb8b28f0 2024-06-06T03:32:49.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.551+0000 7f78fdffb700 1 -- 172.21.15.50:0/3661885696 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f790400fa00 con 0x559beb8b28f0 2024-06-06T03:32:49.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.552+0000 7f792700fb80 10 client.25921 fetch_fsmap learned FSMap version 33 2024-06-06T03:32:49.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.552+0000 7f792700fb80 1 -- 172.21.15.50:0/3661885696 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x559beb8d55c0 con 0x559beb8b28f0 2024-06-06T03:32:49.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.556+0000 7f78fdffb700 1 -- 172.21.15.50:0/3661885696 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f790c00bc50 con 0x559beb8b28f0 2024-06-06T03:32:49.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.556+0000 7f78fdffb700 1 -- 172.21.15.50:0/3661885696 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f7904018400 con 0x559beb8b28f0 2024-06-06T03:32:49.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.556+0000 7f792700fb80 10 client.25921 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:32:49.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.556+0000 7f792700fb80 10 client.25921 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-06-06T03:32:49.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.556+0000 7f792700fb80 20 client.25921 populate_metadata read hostname 'smithi050' 2024-06-06T03:32:49.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.556+0000 7f792700fb80 1 --2- 172.21.15.50:0/3661885696 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x559beb8d7f60 0x559beb8da380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.556+0000 7f792700fb80 4 client.25921 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:32:49.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.556+0000 7f792700fb80 1 -- 172.21.15.50:0/3661885696 --> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559beb80bd10 con 0x559beb8d7f60 2024-06-06T03:32:49.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.557+0000 7f791ad29700 1 --2- 172.21.15.50:0/3661885696 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x559beb8d7f60 0x559beb8da380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:49.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.569+0000 7f791ad29700 1 --2- 172.21.15.50:0/3661885696 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x559beb8d7f60 0x559beb8da380 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=adffe79b3f800379 server_cookie=8fe9ffdd5794adb1 in_seq=0 out_seq=0 2024-06-06T03:32:49.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.569+0000 7f78fdffb700 10 client.25921 ms_handle_connect on v2:172.21.15.122:6836/1604366318 2024-06-06T03:32:49.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.572+0000 7f78fdffb700 1 -- 172.21.15.50:0/3661885696 <== mds.1 v2:172.21.15.122:6836/1604366318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x559beb80bd10 con 0x559beb8d7f60 2024-06-06T03:32:49.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.572+0000 7f78fdffb700 10 client.25921 handle_command_reply: tid=0 2024-06-06T03:32:49.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.575+0000 7f792700fb80 1 client.25921 shutdown 2024-06-06T03:32:49.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.577+0000 7f792700fb80 1 -- 172.21.15.50:0/3661885696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559beb8b28f0 msgr2=0x559beb8b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:49.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.577+0000 7f792700fb80 1 --2- 172.21.15.50:0/3661885696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559beb8b28f0 0x559beb8b62a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f790400c380 tx=0x7f790400c690 comp rx=0 tx=0).stop 2024-06-06T03:32:49.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.578+0000 7f792700fb80 1 -- 172.21.15.50:0/3661885696 shutdown_connections 2024-06-06T03:32:49.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.578+0000 7f792700fb80 1 --2- 172.21.15.50:0/3661885696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559beb8b3210 0x559beb8b67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.578+0000 7f792700fb80 1 --2- 172.21.15.50:0/3661885696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559beb8ad080 0x559beb8b8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.578+0000 7f792700fb80 1 --2- 172.21.15.50:0/3661885696 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x559beb8d7f60 0x559beb8da380 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.578+0000 7f792700fb80 1 --2- 172.21.15.50:0/3661885696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559beb8b28f0 0x559beb8b62a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.578+0000 7f792700fb80 1 -- 172.21.15.50:0/3661885696 >> 172.21.15.50:0/3661885696 conn(0x559beb7d7cc0 msgr2=0x559beb8abb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:49.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.578+0000 7f78fdffb700 0 client.25921 ms_handle_reset on v2:172.21.15.122:6836/1604366318 2024-06-06T03:32:49.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.578+0000 7f792700fb80 1 -- 172.21.15.50:0/3661885696 shutdown_connections 2024-06-06T03:32:49.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.578+0000 7f792700fb80 1 -- 172.21.15.50:0/3661885696 wait complete. 2024-06-06T03:32:49.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.578+0000 7f792700fb80 20 client.25921 trim_cache size 0 max 16384 2024-06-06T03:32:49.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:49 smithi079 ceph-mon[35478]: pgmap v616: 129 pgs: 129 active+clean; 10 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 31 MiB/s wr, 541 op/s 2024-06-06T03:32:49.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.612+0000 7f792700fb80 1 Processor -- start 2024-06-06T03:32:49.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.612+0000 7f792700fb80 1 -- start start 2024-06-06T03:32:49.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.613+0000 7f792700fb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559beb8ad080 0x559beb8d3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.613+0000 7f792700fb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559beb8b28f0 0x559beb8b0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.613+0000 7f792700fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559beb8b3210 0x559beb8b0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.613+0000 7f792700fb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f79141a6010 con 0x559beb8ad080 2024-06-06T03:32:49.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.613+0000 7f792700fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7914073b20 con 0x559beb8b3210 2024-06-06T03:32:49.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.613+0000 7f792700fb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7914071970 con 0x559beb8b28f0 2024-06-06T03:32:49.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.613+0000 7f791ad29700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559beb8b3210 0x559beb8b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:49.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.613+0000 7f791ad29700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559beb8b3210 0x559beb8b0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:43386/0 (socket says 172.21.15.50:43386) 2024-06-06T03:32:49.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.613+0000 7f791ad29700 1 -- 172.21.15.50:0/3556775920 learned_addr learned my addr 172.21.15.50:0/3556775920 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:49.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.613+0000 7f7919d27700 1 --2- 172.21.15.50:0/3556775920 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559beb8b28f0 0x559beb8b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:49.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.614+0000 7f791ad29700 1 -- 172.21.15.50:0/3556775920 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559beb8b28f0 msgr2=0x559beb8b0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:49.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.614+0000 7f791ad29700 1 --2- 172.21.15.50:0/3556775920 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559beb8b28f0 0x559beb8b0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.614+0000 7f791ad29700 1 -- 172.21.15.50:0/3556775920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559beb8ad080 msgr2=0x559beb8d3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:49.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.614+0000 7f791ad29700 1 --2- 172.21.15.50:0/3556775920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559beb8ad080 0x559beb8d3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.614+0000 7f791ad29700 1 -- 172.21.15.50:0/3556775920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559beb8b24f0 con 0x559beb8b3210 2024-06-06T03:32:49.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.614+0000 7f7919d27700 1 --2- 172.21.15.50:0/3556775920 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559beb8b28f0 0x559beb8b0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:32:49.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.617+0000 7f791ad29700 1 --2- 172.21.15.50:0/3556775920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559beb8b3210 0x559beb8b0870 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f790c0062a0 tx=0x7f790c00afe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3466afc9b1a3e771 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:49.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.622+0000 7f78fffff700 1 -- 172.21.15.50:0/3556775920 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c00bc10 con 0x559beb8b3210 2024-06-06T03:32:49.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.622+0000 7f78fffff700 1 -- 172.21.15.50:0/3556775920 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f790c01f070 con 0x559beb8b3210 2024-06-06T03:32:49.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.622+0000 7f78fffff700 1 -- 172.21.15.50:0/3556775920 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c007ca0 con 0x559beb8b3210 2024-06-06T03:32:49.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.623+0000 7f792700fb80 1 -- 172.21.15.50:0/3556775920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559beb8b3210 msgr2=0x559beb8b0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:49.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.623+0000 7f792700fb80 1 --2- 172.21.15.50:0/3556775920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559beb8b3210 0x559beb8b0870 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f790c0062a0 tx=0x7f790c00afe0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.625+0000 7f792700fb80 1 -- 172.21.15.50:0/3556775920 shutdown_connections 2024-06-06T03:32:49.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.625+0000 7f792700fb80 1 --2- 172.21.15.50:0/3556775920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559beb8b3210 0x559beb8b0870 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.625+0000 7f792700fb80 1 --2- 172.21.15.50:0/3556775920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559beb8ad080 0x559beb8d3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.625+0000 7f792700fb80 1 --2- 172.21.15.50:0/3556775920 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559beb8b28f0 0x559beb8b0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.625+0000 7f792700fb80 1 -- 172.21.15.50:0/3556775920 >> 172.21.15.50:0/3556775920 conn(0x559beb7d7cc0 msgr2=0x559beb8ac520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:49.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.625+0000 7f792700fb80 1 -- 172.21.15.50:0/3556775920 shutdown_connections 2024-06-06T03:32:49.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.628+0000 7f792700fb80 1 -- 172.21.15.50:0/3556775920 wait complete. 2024-06-06T03:32:49.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.628+0000 7f792700fb80 1 -- start start 2024-06-06T03:32:49.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.628+0000 7f792700fb80 1 Processor -- start 2024-06-06T03:32:49.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.629+0000 7f792700fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559beb8ad080 0x559beb8cff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.629+0000 7f792700fb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559beb8b28f0 0x559beb8d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.629+0000 7f792700fb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559beb8b3210 0x559beb8dec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.629+0000 7f792700fb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7914071fe0 con 0x559beb8b28f0 2024-06-06T03:32:49.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.629+0000 7f792700fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7914073450 con 0x559beb8ad080 2024-06-06T03:32:49.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.629+0000 7f792700fb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f79140726b0 con 0x559beb8b3210 2024-06-06T03:32:49.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.629+0000 7f792700fb80 10 client.0 _ll_register_callbacks cb 0x559beb798920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:32:49.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.629+0000 7f7919d27700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559beb8b28f0 0x559beb8d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:49.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.630+0000 7f7919d27700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559beb8b28f0 0x559beb8d04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55694/0 (socket says 172.21.15.50:55694) 2024-06-06T03:32:49.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.630+0000 7f7919d27700 1 -- 172.21.15.50:0/2114658165 learned_addr learned my addr 172.21.15.50:0/2114658165 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:49.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.630+0000 7f791ad29700 1 --2- 172.21.15.50:0/2114658165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559beb8ad080 0x559beb8cff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:49.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.630+0000 7f791ad29700 1 --2- 172.21.15.50:0/2114658165 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559beb8b3210 0x559beb8dec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:49.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.631+0000 7f7919d27700 1 -- 172.21.15.50:0/2114658165 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559beb8b3210 msgr2=0x559beb8dec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:49.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.631+0000 7f7919d27700 1 --2- 172.21.15.50:0/2114658165 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559beb8b3210 0x559beb8dec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.631+0000 7f7919d27700 1 -- 172.21.15.50:0/2114658165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559beb8ad080 msgr2=0x559beb8cff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:49.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.631+0000 7f7919d27700 1 --2- 172.21.15.50:0/2114658165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559beb8ad080 0x559beb8cff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.631+0000 7f7919d27700 1 -- 172.21.15.50:0/2114658165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559beb8d0b10 con 0x559beb8b28f0 2024-06-06T03:32:49.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.633+0000 7f7919d27700 1 --2- 172.21.15.50:0/2114658165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559beb8b28f0 0x559beb8d04d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f790400c350 tx=0x7f7904005c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=310fa2d4aed8848c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:49.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.633+0000 7f78fdffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:32:49.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.635+0000 7f78fdffb700 1 -- 172.21.15.50:0/2114658165 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7904030060 con 0x559beb8b28f0 2024-06-06T03:32:49.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.635+0000 7f792700fb80 1 -- 172.21.15.50:0/2114658165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f790c01f070 con 0x559beb8b28f0 2024-06-06T03:32:49.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.635+0000 7f78fdffb700 1 -- 172.21.15.50:0/2114658165 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f79040189f0 con 0x559beb8b28f0 2024-06-06T03:32:49.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.636+0000 7f78fdffb700 1 -- 172.21.15.50:0/2114658165 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7904037050 con 0x559beb8b28f0 2024-06-06T03:32:49.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.641+0000 7f792700fb80 10 client.16317 fetch_fsmap learned FSMap version 33 2024-06-06T03:32:49.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.641+0000 7f792700fb80 1 -- 172.21.15.50:0/2114658165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x559beb9420b0 con 0x559beb8b28f0 2024-06-06T03:32:49.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.642+0000 7f78fdffb700 1 -- 172.21.15.50:0/2114658165 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f790c01f070 con 0x559beb8b28f0 2024-06-06T03:32:49.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.642+0000 7f78fdffb700 1 -- 172.21.15.50:0/2114658165 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f790400fc00 con 0x559beb8b28f0 2024-06-06T03:32:49.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.642+0000 7f792700fb80 10 client.16317 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:32:49.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.642+0000 7f792700fb80 10 client.16317 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-06-06T03:32:49.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.642+0000 7f792700fb80 20 client.16317 populate_metadata read hostname 'smithi050' 2024-06-06T03:32:49.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.642+0000 7f792700fb80 1 --2- 172.21.15.50:0/2114658165 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x559beb9427a0 0x559beb944bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:49.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.642+0000 7f792700fb80 4 client.16317 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:32:49.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.642+0000 7f792700fb80 1 -- 172.21.15.50:0/2114658165 --> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559beb806290 con 0x559beb9427a0 2024-06-06T03:32:49.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.647+0000 7f791ad29700 1 --2- 172.21.15.50:0/2114658165 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x559beb9427a0 0x559beb944bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:49.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.656+0000 7f78fdffb700 10 client.16317 ms_handle_connect on v2:172.21.15.122:6836/1604366318 2024-06-06T03:32:49.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.656+0000 7f791ad29700 1 --2- 172.21.15.50:0/2114658165 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x559beb9427a0 0x559beb944bc0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c02779673e8c225d server_cookie=2bda1483c589e8ca in_seq=0 out_seq=0 2024-06-06T03:32:49.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.657+0000 7f78fdffb700 1 -- 172.21.15.50:0/2114658165 <== mds.1 v2:172.21.15.122:6836/1604366318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559beb806290 con 0x559beb9427a0 2024-06-06T03:32:49.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.657+0000 7f78fdffb700 10 client.16317 handle_command_reply: tid=0 2024-06-06T03:32:49.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.657+0000 7f792700fb80 1 client.16317 shutdown 2024-06-06T03:32:49.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.658+0000 7f792700fb80 1 -- 172.21.15.50:0/2114658165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559beb8b28f0 msgr2=0x559beb8d04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:49.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.658+0000 7f792700fb80 1 --2- 172.21.15.50:0/2114658165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559beb8b28f0 0x559beb8d04d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f790400c350 tx=0x7f7904005c10 comp rx=0 tx=0).stop 2024-06-06T03:32:49.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.658+0000 7f792700fb80 1 -- 172.21.15.50:0/2114658165 shutdown_connections 2024-06-06T03:32:49.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.658+0000 7f792700fb80 1 --2- 172.21.15.50:0/2114658165 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x559beb9427a0 0x559beb944bc0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.658+0000 7f792700fb80 1 --2- 172.21.15.50:0/2114658165 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559beb8b3210 0x559beb8dec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.658+0000 7f792700fb80 1 --2- 172.21.15.50:0/2114658165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559beb8ad080 0x559beb8cff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.658+0000 7f792700fb80 1 --2- 172.21.15.50:0/2114658165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559beb8b28f0 0x559beb8d04d0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.658+0000 7f78fdffb700 0 client.16317 ms_handle_reset on v2:172.21.15.122:6836/1604366318 2024-06-06T03:32:49.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.658+0000 7f792700fb80 1 -- 172.21.15.50:0/2114658165 >> 172.21.15.50:0/2114658165 conn(0x559beb7d7cc0 msgr2=0x559beb8a74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:49.663 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:32:49.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.659+0000 7f792700fb80 1 -- 172.21.15.50:0/2114658165 shutdown_connections 2024-06-06T03:32:49.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.659+0000 7f792700fb80 1 -- 172.21.15.50:0/2114658165 wait complete. 2024-06-06T03:32:49.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.659+0000 7f792700fb80 20 client.16317 trim_cache size 0 max 16384 2024-06-06T03:32:49.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.661+0000 7f791b52a700 1 -- 172.21.15.50:0/87763557 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f79000a2c80 msgr2=0x7f79000a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:49.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.661+0000 7f791b52a700 1 --2- 172.21.15.50:0/87763557 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f79000a2c80 0x7f79000a5140 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x559beb8b35f0 tx=0x7f79100092d0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.661+0000 7f791b52a700 1 -- 172.21.15.50:0/87763557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7914101180 msgr2=0x7f7914114e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:49.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.661+0000 7f791b52a700 1 --2- 172.21.15.50:0/87763557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7914101180 0x7f7914114e00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f791000e9a0 tx=0x7f791000ed60 comp rx=0 tx=0).stop 2024-06-06T03:32:49.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.661+0000 7f791b52a700 1 -- 172.21.15.50:0/87763557 shutdown_connections 2024-06-06T03:32:49.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.661+0000 7f791b52a700 1 --2- 172.21.15.50:0/87763557 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f791410a360 0x7f791410df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.661+0000 7f791b52a700 1 --2- 172.21.15.50:0/87763557 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f79000a2c80 0x7f79000a5140 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.661+0000 7f791b52a700 1 --2- 172.21.15.50:0/87763557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7914101180 0x7f7914114e00 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.662+0000 7f791b52a700 1 --2- 172.21.15.50:0/87763557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7914101b30 0x7f7914115340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:49.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.662+0000 7f791b52a700 1 -- 172.21.15.50:0/87763557 >> 172.21.15.50:0/87763557 conn(0x7f79140fcd70 msgr2=0x7f7914102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:49.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.662+0000 7f791b52a700 1 -- 172.21.15.50:0/87763557 shutdown_connections 2024-06-06T03:32:49.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:49.662+0000 7f791b52a700 1 -- 172.21.15.50:0/87763557 wait complete. 2024-06-06T03:32:49.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:49 smithi122 ceph-mon[35759]: pgmap v616: 129 pgs: 129 active+clean; 10 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 31 MiB/s wr, 541 op/s 2024-06-06T03:32:50.574 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-06-06T03:32:51.266 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:32:51.584 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:51 smithi050 ceph-mon[32421]: pgmap v617: 129 pgs: 129 active+clean; 10 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 43 MiB/s wr, 741 op/s 2024-06-06T03:32:51.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:51 smithi079 ceph-mon[35478]: pgmap v617: 129 pgs: 129 active+clean; 10 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 43 MiB/s wr, 741 op/s 2024-06-06T03:32:51.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:51 smithi122 ceph-mon[35759]: pgmap v617: 129 pgs: 129 active+clean; 10 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 43 MiB/s wr, 741 op/s 2024-06-06T03:32:53.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.457+0000 7f8ea87e4700 1 -- 172.21.15.50:0/2140068262 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ea01099d0 msgr2=0x7f8ea0109e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:53.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.457+0000 7f8ea87e4700 1 --2- 172.21.15.50:0/2140068262 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ea01099d0 0x7f8ea0109e50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8e900098f0 tx=0x7f8e90009c00 comp rx=0 tx=0).stop 2024-06-06T03:32:53.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.459+0000 7f8ea87e4700 1 -- 172.21.15.50:0/2140068262 shutdown_connections 2024-06-06T03:32:53.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.459+0000 7f8ea87e4700 1 --2- 172.21.15.50:0/2140068262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ea011bc70 0x7f8ea011e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.459+0000 7f8ea87e4700 1 --2- 172.21.15.50:0/2140068262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ea0110c70 0x7f8ea0109490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.459+0000 7f8ea87e4700 1 --2- 172.21.15.50:0/2140068262 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ea01099d0 0x7f8ea0109e50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.459+0000 7f8ea87e4700 1 -- 172.21.15.50:0/2140068262 >> 172.21.15.50:0/2140068262 conn(0x7f8ea006d600 msgr2=0x7f8ea006da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:53.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.461+0000 7f8ea87e4700 1 -- 172.21.15.50:0/2140068262 shutdown_connections 2024-06-06T03:32:53.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.461+0000 7f8ea87e4700 1 -- 172.21.15.50:0/2140068262 wait complete. 2024-06-06T03:32:53.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.462+0000 7f8ea87e4700 1 Processor -- start 2024-06-06T03:32:53.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.462+0000 7f8ea87e4700 1 -- start start 2024-06-06T03:32:53.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.463+0000 7f8ea87e4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ea01099d0 0x7f8ea011b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:53.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.463+0000 7f8ea87e4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ea0110c70 0x7f8ea011b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:53.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.463+0000 7f8ea87e4700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ea011bc70 0x7f8ea0115430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:53.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.463+0000 7f8ea6580700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ea01099d0 0x7f8ea011b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:53.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.463+0000 7f8ea6580700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ea01099d0 0x7f8ea011b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:43410/0 (socket says 172.21.15.50:43410) 2024-06-06T03:32:53.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.464+0000 7f8ea6580700 1 -- 172.21.15.50:0/106086288 learned_addr learned my addr 172.21.15.50:0/106086288 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:53.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.464+0000 7f8ea87e4700 1 -- 172.21.15.50:0/106086288 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea0111b90 con 0x7f8ea0110c70 2024-06-06T03:32:53.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.464+0000 7f8ea87e4700 1 -- 172.21.15.50:0/106086288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea0111a10 con 0x7f8ea01099d0 2024-06-06T03:32:53.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.464+0000 7f8ea87e4700 1 -- 172.21.15.50:0/106086288 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea0111d10 con 0x7f8ea011bc70 2024-06-06T03:32:53.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.465+0000 7f8ea5d7f700 1 --2- 172.21.15.50:0/106086288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ea0110c70 0x7f8ea011b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:53.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.465+0000 7f8ea6580700 1 -- 172.21.15.50:0/106086288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ea011bc70 msgr2=0x7f8ea0115430 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-06T03:32:53.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.465+0000 7f8ea6580700 1 --2- 172.21.15.50:0/106086288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ea011bc70 0x7f8ea0115430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.465+0000 7f8ea6580700 1 -- 172.21.15.50:0/106086288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ea0110c70 msgr2=0x7f8ea011b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:53.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.465+0000 7f8ea6580700 1 --2- 172.21.15.50:0/106086288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ea0110c70 0x7f8ea011b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.465+0000 7f8ea6580700 1 -- 172.21.15.50:0/106086288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea0115d30 con 0x7f8ea01099d0 2024-06-06T03:32:53.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.466+0000 7f8ea6580700 1 --2- 172.21.15.50:0/106086288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ea01099d0 0x7f8ea011b180 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c00d950 tx=0x7f8e9c00dd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:53.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.468+0000 7f8e977fe700 1 -- 172.21.15.50:0/106086288 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c016070 con 0x7f8ea01099d0 2024-06-06T03:32:53.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.468+0000 7f8ea87e4700 1 -- 172.21.15.50:0/106086288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea0116020 con 0x7f8ea01099d0 2024-06-06T03:32:53.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.468+0000 7f8ea87e4700 1 -- 172.21.15.50:0/106086288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ea01bce10 con 0x7f8ea01099d0 2024-06-06T03:32:53.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.468+0000 7f8e977fe700 1 -- 172.21.15.50:0/106086288 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8e9c010460 con 0x7f8ea01099d0 2024-06-06T03:32:53.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.468+0000 7f8e977fe700 1 -- 172.21.15.50:0/106086288 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c00f620 con 0x7f8ea01099d0 2024-06-06T03:32:53.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.473+0000 7f8e977fe700 1 -- 172.21.15.50:0/106086288 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8e9c019070 con 0x7f8ea01099d0 2024-06-06T03:32:53.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.477+0000 7f8eb3067b80 1 Processor -- start 2024-06-06T03:32:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.478+0000 7f8eb3067b80 1 -- start start 2024-06-06T03:32:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.478+0000 7f8eb3067b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd4253640 0x556cd4253a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.478+0000 7f8eb3067b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556cd4253f60 0x556cd424d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.478+0000 7f8eb3067b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cd424df20 0x556cd424e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.478+0000 7f8eb3067b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556cd419f810 con 0x556cd424df20 2024-06-06T03:32:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.478+0000 7f8eb3067b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556cd4147720 con 0x556cd4253f60 2024-06-06T03:32:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.478+0000 7f8eb3067b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556cd419b7d0 con 0x556cd4253640 2024-06-06T03:32:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.479+0000 7f8ea6d81700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd4253640 0x556cd4253a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.479+0000 7f8ea6d81700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd4253640 0x556cd4253a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:60750/0 (socket says 172.21.15.50:60750) 2024-06-06T03:32:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.479+0000 7f8ea6d81700 1 -- 172.21.15.50:0/2292676850 learned_addr learned my addr 172.21.15.50:0/2292676850 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.479+0000 7f8e977fe700 1 --2- 172.21.15.50:0/106086288 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8e8c0a2da0 0x7f8e8c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.480+0000 7f8e977fe700 1 -- 172.21.15.50:0/106086288 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f8e9c0ced30 con 0x7f8ea01099d0 2024-06-06T03:32:53.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.480+0000 7f8ea6580700 1 --2- 172.21.15.50:0/2292676850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556cd4253f60 0x556cd424d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:53.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.480+0000 7f8ea5d7f700 1 --2- 172.21.15.50:0/2292676850 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cd424df20 0x556cd424e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:53.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.481+0000 7f8ea5d7f700 1 -- 172.21.15.50:0/2292676850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd4253640 msgr2=0x556cd4253a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:53.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.481+0000 7f8ea5d7f700 1 --2- 172.21.15.50:0/2292676850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd4253640 0x556cd4253a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.481+0000 7f8ea5d7f700 1 -- 172.21.15.50:0/2292676850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556cd4253f60 msgr2=0x556cd424d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:53.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.481+0000 7f8ea5d7f700 1 --2- 172.21.15.50:0/2292676850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556cd4253f60 0x556cd424d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.481+0000 7f8ea5d7f700 1 -- 172.21.15.50:0/2292676850 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cd413df50 con 0x556cd424df20 2024-06-06T03:32:53.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.481+0000 7f8ea6580700 1 --2- 172.21.15.50:0/2292676850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556cd4253f60 0x556cd424d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:32:53.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.481+0000 7f8ea5d7f700 1 --2- 172.21.15.50:0/2292676850 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cd424df20 0x556cd424e340 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f8e900098c0 tx=0x7f8e900095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8948bfcde93033e9 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:53.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.483+0000 7f8ea6d81700 1 --2- 172.21.15.50:0/106086288 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8e8c0a2da0 0x7f8e8c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:53.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.483+0000 7f8e94ff9700 1 -- 172.21.15.50:0/2292676850 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e90027070 con 0x556cd424df20 2024-06-06T03:32:53.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.483+0000 7f8e94ff9700 1 -- 172.21.15.50:0/2292676850 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8e9000f910 con 0x556cd424df20 2024-06-06T03:32:53.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.484+0000 7f8ea6d81700 1 --2- 172.21.15.50:0/106086288 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8e8c0a2da0 0x7f8e8c0a5260 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8e98009fd0 tx=0x7f8e98009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:53.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.484+0000 7f8eb3067b80 1 -- 172.21.15.50:0/2292676850 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cd424df20 msgr2=0x556cd424e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:53.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.484+0000 7f8eb3067b80 1 --2- 172.21.15.50:0/2292676850 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cd424df20 0x556cd424e340 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f8e900098c0 tx=0x7f8e900095f0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.486+0000 7f8eb3067b80 1 -- 172.21.15.50:0/2292676850 shutdown_connections 2024-06-06T03:32:53.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.486+0000 7f8eb3067b80 1 --2- 172.21.15.50:0/2292676850 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cd424df20 0x556cd424e340 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.486+0000 7f8eb3067b80 1 --2- 172.21.15.50:0/2292676850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd4253640 0x556cd4253a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.486+0000 7f8eb3067b80 1 --2- 172.21.15.50:0/2292676850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556cd4253f60 0x556cd424d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.486+0000 7f8eb3067b80 1 -- 172.21.15.50:0/2292676850 >> 172.21.15.50:0/2292676850 conn(0x556cd4178cc0 msgr2=0x556cd4248850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:53.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.487+0000 7f8eb3067b80 1 -- 172.21.15.50:0/2292676850 shutdown_connections 2024-06-06T03:32:53.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.488+0000 7f8eb3067b80 1 -- 172.21.15.50:0/2292676850 wait complete. 2024-06-06T03:32:53.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.488+0000 7f8eb3067b80 1 -- start start 2024-06-06T03:32:53.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.488+0000 7f8eb3067b80 1 Processor -- start 2024-06-06T03:32:53.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.492+0000 7f8eb3067b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd424df20 0x556cd4259cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:53.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.492+0000 7f8eb3067b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556cd4253640 0x556cd4256fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:53.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.492+0000 7f8eb3067b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cd4253f60 0x556cd4257510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:53.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.492+0000 7f8eb3067b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556cd425a970 con 0x556cd4253f60 2024-06-06T03:32:53.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.492+0000 7f8eb3067b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556cd413fbf0 con 0x556cd4253640 2024-06-06T03:32:53.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.492+0000 7f8eb3067b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556cd425aaf0 con 0x556cd424df20 2024-06-06T03:32:53.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.492+0000 7f8eb3067b80 10 client.0 _ll_register_callbacks cb 0x556cd4139920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:32:53.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.493+0000 7f8ea6d81700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cd4253f60 0x556cd4257510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:53.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.493+0000 7f8ea6d81700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cd4253f60 0x556cd4257510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55736/0 (socket says 172.21.15.50:55736) 2024-06-06T03:32:53.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.493+0000 7f8ea6d81700 1 -- 172.21.15.50:0/1702728346 learned_addr learned my addr 172.21.15.50:0/1702728346 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:53.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.493+0000 7f8ea5d7f700 1 --2- 172.21.15.50:0/1702728346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556cd4253640 0x556cd4256fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:53.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.493+0000 7f8ea6580700 1 --2- 172.21.15.50:0/1702728346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd424df20 0x556cd4259cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:53.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.494+0000 7f8ea6580700 1 -- 172.21.15.50:0/1702728346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556cd4253640 msgr2=0x556cd4256fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:53.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.494+0000 7f8ea6580700 1 --2- 172.21.15.50:0/1702728346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556cd4253640 0x556cd4256fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.494+0000 7f8ea6580700 1 -- 172.21.15.50:0/1702728346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cd4253f60 msgr2=0x556cd4257510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:53.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.494+0000 7f8ea6580700 1 --2- 172.21.15.50:0/1702728346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cd4253f60 0x556cd4257510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.494+0000 7f8ea6580700 1 -- 172.21.15.50:0/1702728346 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cd40ee8d0 con 0x556cd424df20 2024-06-06T03:32:53.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.494+0000 7f8ea6580700 1 --2- 172.21.15.50:0/1702728346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd424df20 0x556cd4259cd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c0cc500 tx=0x7f8e9c09ac90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44e1f27f086862f7 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:53.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.494+0000 7f8e89ffb700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:32:53.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.495+0000 7f8e89ffb700 1 -- 172.21.15.50:0/1702728346 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c020070 con 0x556cd424df20 2024-06-06T03:32:53.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.495+0000 7f8eb3067b80 1 -- 172.21.15.50:0/1702728346 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e9000f910 con 0x556cd424df20 2024-06-06T03:32:53.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.495+0000 7f8e89ffb700 1 -- 172.21.15.50:0/1702728346 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f8e9c0bb0c0 con 0x556cd424df20 2024-06-06T03:32:53.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.495+0000 7f8e89ffb700 1 -- 172.21.15.50:0/1702728346 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8e9c09f420 con 0x556cd424df20 2024-06-06T03:32:53.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.495+0000 7f8eb3067b80 10 client.25936 fetch_fsmap learned FSMap version 33 2024-06-06T03:32:53.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.495+0000 7f8eb3067b80 1 -- 172.21.15.50:0/1702728346 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x556cd42651f0 con 0x556cd424df20 2024-06-06T03:32:53.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.496+0000 7f8e89ffb700 1 -- 172.21.15.50:0/1702728346 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8e9000f910 con 0x556cd424df20 2024-06-06T03:32:53.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.499+0000 7f8e89ffb700 1 -- 172.21.15.50:0/1702728346 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f8e9c09b510 con 0x556cd424df20 2024-06-06T03:32:53.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.499+0000 7f8eb3067b80 10 client.25936 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:32:53.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.499+0000 7f8eb3067b80 10 client.25936 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:32:53.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.499+0000 7f8eb3067b80 20 client.25936 populate_metadata read hostname 'smithi050' 2024-06-06T03:32:53.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.499+0000 7f8eb3067b80 1 --2- 172.21.15.50:0/1702728346 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x556cd4267b50 0x556cd4269f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:53.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.499+0000 7f8eb3067b80 4 client.25936 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:32:53.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.499+0000 7f8eb3067b80 1 -- 172.21.15.50:0/1702728346 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556cd41acd10 con 0x556cd4267b50 2024-06-06T03:32:53.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.503+0000 7f8ea5d7f700 1 --2- 172.21.15.50:0/1702728346 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x556cd4267b50 0x556cd4269f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:53.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.505+0000 7f8ea5d7f700 1 --2- 172.21.15.50:0/1702728346 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x556cd4267b50 0x556cd4269f90 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9986b71850a4df9b server_cookie=5a949ad63a31e904 in_seq=0 out_seq=0 2024-06-06T03:32:53.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.505+0000 7f8e89ffb700 10 client.25936 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:32:53.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.505+0000 7f8e89ffb700 1 -- 172.21.15.50:0/1702728346 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x556cd41acd10 con 0x556cd4267b50 2024-06-06T03:32:53.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.505+0000 7f8e89ffb700 10 client.25936 handle_command_reply: tid=0 2024-06-06T03:32:53.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.506+0000 7f8eb3067b80 1 client.25936 shutdown 2024-06-06T03:32:53.509 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:53 smithi050 ceph-mon[32421]: pgmap v618: 129 pgs: 129 active+clean; 10 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 33 MiB/s wr, 580 op/s 2024-06-06T03:32:53.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.508+0000 7f8eb3067b80 1 -- 172.21.15.50:0/1702728346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd424df20 msgr2=0x556cd4259cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:53.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.508+0000 7f8eb3067b80 1 --2- 172.21.15.50:0/1702728346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd424df20 0x556cd4259cd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c0cc500 tx=0x7f8e9c09ac90 comp rx=0 tx=0).stop 2024-06-06T03:32:53.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.511+0000 7f8eb3067b80 1 -- 172.21.15.50:0/1702728346 shutdown_connections 2024-06-06T03:32:53.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.511+0000 7f8eb3067b80 1 --2- 172.21.15.50:0/1702728346 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x556cd4267b50 0x556cd4269f90 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.511+0000 7f8eb3067b80 1 --2- 172.21.15.50:0/1702728346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cd4253f60 0x556cd4257510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.511+0000 7f8eb3067b80 1 --2- 172.21.15.50:0/1702728346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd424df20 0x556cd4259cd0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.511+0000 7f8eb3067b80 1 --2- 172.21.15.50:0/1702728346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556cd4253640 0x556cd4256fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.511+0000 7f8eb3067b80 1 -- 172.21.15.50:0/1702728346 >> 172.21.15.50:0/1702728346 conn(0x556cd4178cc0 msgr2=0x556cd424c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:53.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.511+0000 7f8e89ffb700 0 client.25936 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:32:53.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.512+0000 7f8eb3067b80 1 -- 172.21.15.50:0/1702728346 shutdown_connections 2024-06-06T03:32:53.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.512+0000 7f8eb3067b80 1 -- 172.21.15.50:0/1702728346 wait complete. 2024-06-06T03:32:53.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.512+0000 7f8eb3067b80 20 client.25936 trim_cache size 0 max 16384 2024-06-06T03:32:53.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.543+0000 7f8eb3067b80 1 Processor -- start 2024-06-06T03:32:53.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.543+0000 7f8eb3067b80 1 -- start start 2024-06-06T03:32:53.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.543+0000 7f8eb3067b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556cd424df20 0x556cd424d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:53.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.543+0000 7f8eb3067b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd4253640 0x556cd4254340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:53.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.543+0000 7f8eb3067b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cd4253f60 0x556cd4254880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:53.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.543+0000 7f8eb3067b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8e84011240 con 0x556cd4253f60 2024-06-06T03:32:53.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.543+0000 7f8eb3067b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8400ead0 con 0x556cd424df20 2024-06-06T03:32:53.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.543+0000 7f8eb3067b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8400c9d0 con 0x556cd4253640 2024-06-06T03:32:53.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.543+0000 7f8ea5d7f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd4253640 0x556cd4254340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:53.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.543+0000 7f8ea5d7f700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd4253640 0x556cd4254340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:60778/0 (socket says 172.21.15.50:60778) 2024-06-06T03:32:53.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.543+0000 7f8ea5d7f700 1 -- 172.21.15.50:0/382869440 learned_addr learned my addr 172.21.15.50:0/382869440 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:53.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.544+0000 7f8ea5d7f700 1 -- 172.21.15.50:0/382869440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556cd424df20 msgr2=0x556cd424d9e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:32:53.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.544+0000 7f8ea5d7f700 1 --2- 172.21.15.50:0/382869440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556cd424df20 0x556cd424d9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.544+0000 7f8ea5d7f700 1 -- 172.21.15.50:0/382869440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cd4253f60 msgr2=0x556cd4254880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:53.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.544+0000 7f8ea5d7f700 1 --2- 172.21.15.50:0/382869440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cd4253f60 0x556cd4254880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.544+0000 7f8ea5d7f700 1 -- 172.21.15.50:0/382869440 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cd4259910 con 0x556cd4253640 2024-06-06T03:32:53.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.544+0000 7f8ea5d7f700 1 --2- 172.21.15.50:0/382869440 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd4253640 0x556cd4254340 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8e900098f0 tx=0x7f8e90009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=657296a4f637ab00 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:53.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.546+0000 7f8e8bfff700 1 -- 172.21.15.50:0/382869440 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e90027040 con 0x556cd4253640 2024-06-06T03:32:53.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.546+0000 7f8e8bfff700 1 -- 172.21.15.50:0/382869440 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8e9000f7a0 con 0x556cd4253640 2024-06-06T03:32:53.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.546+0000 7f8e8bfff700 1 -- 172.21.15.50:0/382869440 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e90022690 con 0x556cd4253640 2024-06-06T03:32:53.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.547+0000 7f8eb3067b80 1 -- 172.21.15.50:0/382869440 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd4253640 msgr2=0x556cd4254340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:53.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.547+0000 7f8eb3067b80 1 --2- 172.21.15.50:0/382869440 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd4253640 0x556cd4254340 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8e900098f0 tx=0x7f8e90009260 comp rx=0 tx=0).stop 2024-06-06T03:32:53.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.547+0000 7f8eb3067b80 1 -- 172.21.15.50:0/382869440 shutdown_connections 2024-06-06T03:32:53.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.547+0000 7f8eb3067b80 1 --2- 172.21.15.50:0/382869440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cd4253f60 0x556cd4254880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.547+0000 7f8eb3067b80 1 --2- 172.21.15.50:0/382869440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556cd424df20 0x556cd424d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.547+0000 7f8eb3067b80 1 --2- 172.21.15.50:0/382869440 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd4253640 0x556cd4254340 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.547+0000 7f8eb3067b80 1 -- 172.21.15.50:0/382869440 >> 172.21.15.50:0/382869440 conn(0x556cd4178cc0 msgr2=0x556cd42558c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:53.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.550+0000 7f8eb3067b80 1 -- 172.21.15.50:0/382869440 shutdown_connections 2024-06-06T03:32:53.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.550+0000 7f8eb3067b80 1 -- 172.21.15.50:0/382869440 wait complete. 2024-06-06T03:32:53.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.551+0000 7f8eb3067b80 1 -- start start 2024-06-06T03:32:53.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.551+0000 7f8eb3067b80 1 Processor -- start 2024-06-06T03:32:53.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.551+0000 7f8eb3067b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd424df20 0x556cd425fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:53.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.551+0000 7f8eb3067b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cd4253640 0x556cd4260370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:53.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.551+0000 7f8eb3067b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556cd4253f60 0x556cd426e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:53.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.551+0000 7f8eb3067b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8400cf90 con 0x556cd4253640 2024-06-06T03:32:53.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.551+0000 7f8eb3067b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8400e400 con 0x556cd4253f60 2024-06-06T03:32:53.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.551+0000 7f8eb3067b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8400d660 con 0x556cd424df20 2024-06-06T03:32:53.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.551+0000 7f8eb3067b80 10 client.0 _ll_register_callbacks cb 0x556cd4139920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:32:53.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.552+0000 7f8ea5d7f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cd4253640 0x556cd4260370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:53.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.552+0000 7f8ea6d81700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556cd4253f60 0x556cd426e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:53.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.552+0000 7f8ea6d81700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556cd4253f60 0x556cd426e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:43442/0 (socket says 172.21.15.50:43442) 2024-06-06T03:32:53.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.552+0000 7f8ea6d81700 1 -- 172.21.15.50:0/948444063 learned_addr learned my addr 172.21.15.50:0/948444063 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:53.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.552+0000 7f8ea6580700 1 --2- 172.21.15.50:0/948444063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd424df20 0x556cd425fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:53.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.554+0000 7f8ea5d7f700 1 -- 172.21.15.50:0/948444063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd424df20 msgr2=0x556cd425fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:53.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.554+0000 7f8ea5d7f700 1 --2- 172.21.15.50:0/948444063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd424df20 0x556cd425fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.554+0000 7f8ea5d7f700 1 -- 172.21.15.50:0/948444063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556cd4253f60 msgr2=0x556cd426e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:53.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.554+0000 7f8ea5d7f700 1 --2- 172.21.15.50:0/948444063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556cd4253f60 0x556cd426e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.554+0000 7f8ea5d7f700 1 -- 172.21.15.50:0/948444063 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cd42703f0 con 0x556cd4253640 2024-06-06T03:32:53.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.554+0000 7f8ea5d7f700 1 --2- 172.21.15.50:0/948444063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cd4253640 0x556cd4260370 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x556cd42584a0 tx=0x7f8e9000ff60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb161d5505749c5 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:53.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.554+0000 7f8e89ffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:32:53.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.555+0000 7f8e89ffb700 1 -- 172.21.15.50:0/948444063 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e90027040 con 0x556cd4253640 2024-06-06T03:32:53.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.555+0000 7f8e89ffb700 1 -- 172.21.15.50:0/948444063 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f8e9000b560 con 0x556cd4253640 2024-06-06T03:32:53.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.555+0000 7f8eb3067b80 1 -- 172.21.15.50:0/948444063 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e9000f7a0 con 0x556cd4253640 2024-06-06T03:32:53.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.556+0000 7f8e89ffb700 1 -- 172.21.15.50:0/948444063 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8e9000f9d0 con 0x556cd4253640 2024-06-06T03:32:53.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.560+0000 7f8eb3067b80 10 client.16332 fetch_fsmap learned FSMap version 33 2024-06-06T03:32:53.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.560+0000 7f8eb3067b80 1 -- 172.21.15.50:0/948444063 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x556cd42d1d80 con 0x556cd4253640 2024-06-06T03:32:53.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.560+0000 7f8e89ffb700 1 -- 172.21.15.50:0/948444063 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8e9000f7a0 con 0x556cd4253640 2024-06-06T03:32:53.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.560+0000 7f8e89ffb700 1 -- 172.21.15.50:0/948444063 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f8e90021070 con 0x556cd4253640 2024-06-06T03:32:53.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.561+0000 7f8eb3067b80 10 client.16332 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:32:53.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.561+0000 7f8eb3067b80 10 client.16332 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:32:53.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.561+0000 7f8eb3067b80 20 client.16332 populate_metadata read hostname 'smithi050' 2024-06-06T03:32:53.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.561+0000 7f8eb3067b80 1 --2- 172.21.15.50:0/948444063 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x556cd42d22d0 0x556cd42d46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:53.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.561+0000 7f8eb3067b80 4 client.16332 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:32:53.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.561+0000 7f8eb3067b80 1 -- 172.21.15.50:0/948444063 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556cd41a7290 con 0x556cd42d22d0 2024-06-06T03:32:53.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.561+0000 7f8ea6580700 1 --2- 172.21.15.50:0/948444063 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x556cd42d22d0 0x556cd42d46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:53.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.565+0000 7f8ea6580700 1 --2- 172.21.15.50:0/948444063 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x556cd42d22d0 0x556cd42d46f0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53226c25a54bcf36 server_cookie=fda0673a65349cc in_seq=0 out_seq=0 2024-06-06T03:32:53.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.565+0000 7f8e89ffb700 10 client.16332 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:32:53.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.567+0000 7f8e89ffb700 1 -- 172.21.15.50:0/948444063 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556cd41a7290 con 0x556cd42d22d0 2024-06-06T03:32:53.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.567+0000 7f8e89ffb700 10 client.16332 handle_command_reply: tid=0 2024-06-06T03:32:53.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.567+0000 7f8eb3067b80 1 client.16332 shutdown 2024-06-06T03:32:53.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.568+0000 7f8eb3067b80 1 -- 172.21.15.50:0/948444063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cd4253640 msgr2=0x556cd4260370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:53.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.568+0000 7f8eb3067b80 1 --2- 172.21.15.50:0/948444063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cd4253640 0x556cd4260370 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x556cd42584a0 tx=0x7f8e9000ff60 comp rx=0 tx=0).stop 2024-06-06T03:32:53.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.568+0000 7f8eb3067b80 1 -- 172.21.15.50:0/948444063 shutdown_connections 2024-06-06T03:32:53.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.568+0000 7f8eb3067b80 1 --2- 172.21.15.50:0/948444063 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x556cd42d22d0 0x556cd42d46f0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.568+0000 7f8eb3067b80 1 --2- 172.21.15.50:0/948444063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556cd4253f60 0x556cd426e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.568+0000 7f8eb3067b80 1 --2- 172.21.15.50:0/948444063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556cd424df20 0x556cd425fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.568+0000 7f8e89ffb700 0 client.16332 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:32:53.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.568+0000 7f8eb3067b80 1 --2- 172.21.15.50:0/948444063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cd4253640 0x556cd4260370 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.568+0000 7f8eb3067b80 1 -- 172.21.15.50:0/948444063 >> 172.21.15.50:0/948444063 conn(0x556cd4178cc0 msgr2=0x556cd4241e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:53.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.568+0000 7f8eb3067b80 1 -- 172.21.15.50:0/948444063 shutdown_connections 2024-06-06T03:32:53.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.568+0000 7f8eb3067b80 1 -- 172.21.15.50:0/948444063 wait complete. 2024-06-06T03:32:53.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.568+0000 7f8eb3067b80 20 client.16332 trim_cache size 0 max 16384 2024-06-06T03:32:53.571 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:32:53.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.573+0000 7f8ea87e4700 1 -- 172.21.15.50:0/106086288 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8e8c0a2da0 msgr2=0x7f8e8c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:53.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.573+0000 7f8ea87e4700 1 --2- 172.21.15.50:0/106086288 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8e8c0a2da0 0x7f8e8c0a5260 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8e98009fd0 tx=0x7f8e98009040 comp rx=0 tx=0).stop 2024-06-06T03:32:53.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.573+0000 7f8ea87e4700 1 -- 172.21.15.50:0/106086288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ea01099d0 msgr2=0x7f8ea011b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:53.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.573+0000 7f8ea87e4700 1 --2- 172.21.15.50:0/106086288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ea01099d0 0x7f8ea011b180 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c00d950 tx=0x7f8e9c00dd10 comp rx=0 tx=0).stop 2024-06-06T03:32:53.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.573+0000 7f8ea87e4700 1 -- 172.21.15.50:0/106086288 shutdown_connections 2024-06-06T03:32:53.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.573+0000 7f8ea87e4700 1 --2- 172.21.15.50:0/106086288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ea011bc70 0x7f8ea0115430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.573+0000 7f8ea87e4700 1 --2- 172.21.15.50:0/106086288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ea01099d0 0x7f8ea011b180 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.573+0000 7f8ea87e4700 1 --2- 172.21.15.50:0/106086288 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8e8c0a2da0 0x7f8e8c0a5260 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.573+0000 7f8ea87e4700 1 --2- 172.21.15.50:0/106086288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ea0110c70 0x7f8ea011b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:53.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.573+0000 7f8ea87e4700 1 -- 172.21.15.50:0/106086288 >> 172.21.15.50:0/106086288 conn(0x7f8ea006d600 msgr2=0x7f8ea011d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:53.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.575+0000 7f8ea87e4700 1 -- 172.21.15.50:0/106086288 shutdown_connections 2024-06-06T03:32:53.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:53.575+0000 7f8ea87e4700 1 -- 172.21.15.50:0/106086288 wait complete. 2024-06-06T03:32:53.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:53 smithi079 ceph-mon[35478]: pgmap v618: 129 pgs: 129 active+clean; 10 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 33 MiB/s wr, 580 op/s 2024-06-06T03:32:53.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:53 smithi122 ceph-mon[35759]: pgmap v618: 129 pgs: 129 active+clean; 10 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 33 MiB/s wr, 580 op/s 2024-06-06T03:32:55.450 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-06T03:32:55.450 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-06-06T03:32:55.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:55 smithi079 ceph-mon[35478]: pgmap v619: 129 pgs: 129 active+clean; 10 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 35 MiB/s wr, 603 op/s 2024-06-06T03:32:55.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:55 smithi122 ceph-mon[35759]: pgmap v619: 129 pgs: 129 active+clean; 10 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 35 MiB/s wr, 603 op/s 2024-06-06T03:32:55.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:55 smithi050 ceph-mon[32421]: pgmap v619: 129 pgs: 129 active+clean; 10 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 35 MiB/s wr, 603 op/s 2024-06-06T03:32:56.071 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:32:57.556 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:57 smithi050 ceph-mon[32421]: pgmap v620: 129 pgs: 129 active+clean; 10 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 43 MiB/s wr, 743 op/s 2024-06-06T03:32:57.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:57 smithi079 ceph-mon[35478]: pgmap v620: 129 pgs: 129 active+clean; 10 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 43 MiB/s wr, 743 op/s 2024-06-06T03:32:57.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:57 smithi122 ceph-mon[35759]: pgmap v620: 129 pgs: 129 active+clean; 10 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 43 MiB/s wr, 743 op/s 2024-06-06T03:32:59.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.073+0000 7f22aa6bd700 1 -- 172.21.15.50:0/3502125259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22a4101d40 msgr2=0x7f22a410e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:59.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.073+0000 7f22aa6bd700 1 --2- 172.21.15.50:0/3502125259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22a4101d40 0x7f22a410e230 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f229c00b0a0 tx=0x7f229c00b3b0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.073+0000 7f22aa6bd700 1 -- 172.21.15.50:0/3502125259 shutdown_connections 2024-06-06T03:32:59.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.073+0000 7f22aa6bd700 1 --2- 172.21.15.50:0/3502125259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22a4101d40 0x7f22a410e230 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.073+0000 7f22aa6bd700 1 --2- 172.21.15.50:0/3502125259 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22a41073f0 0x7f22a41077d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.073+0000 7f22aa6bd700 1 --2- 172.21.15.50:0/3502125259 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22a4101380 0x7f22a4101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.073+0000 7f22aa6bd700 1 -- 172.21.15.50:0/3502125259 >> 172.21.15.50:0/3502125259 conn(0x7f22a4078300 msgr2=0x7f22a4078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:59.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.077+0000 7f22aa6bd700 1 -- 172.21.15.50:0/3502125259 shutdown_connections 2024-06-06T03:32:59.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.078+0000 7f22aa6bd700 1 -- 172.21.15.50:0/3502125259 wait complete. 2024-06-06T03:32:59.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.079+0000 7f22aa6bd700 1 Processor -- start 2024-06-06T03:32:59.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.083+0000 7f22aa6bd700 1 -- start start 2024-06-06T03:32:59.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.083+0000 7f22aa6bd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22a4101380 0x7f22a4073fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:59.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.083+0000 7f22aa6bd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22a4101d40 0x7f22a41082d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:59.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.083+0000 7f22aa6bd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22a41073f0 0x7f22a4108810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:59.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.083+0000 7f22aa6bd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f22a406c7b0 con 0x7f22a4101d40 2024-06-06T03:32:59.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.083+0000 7f22aa6bd700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f22a406c630 con 0x7f22a41073f0 2024-06-06T03:32:59.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.083+0000 7f22aa6bd700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f22a406c930 con 0x7f22a4101380 2024-06-06T03:32:59.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.085+0000 7f22a8c5a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22a41073f0 0x7f22a4108810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:59.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.085+0000 7f22a37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22a4101d40 0x7f22a41082d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:59.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.085+0000 7f22a37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22a4101d40 0x7f22a41082d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60478/0 (socket says 172.21.15.50:60478) 2024-06-06T03:32:59.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.085+0000 7f22a37fe700 1 -- 172.21.15.50:0/3110346619 learned_addr learned my addr 172.21.15.50:0/3110346619 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:59.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.086+0000 7f22a8c5a700 1 -- 172.21.15.50:0/3110346619 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22a4101380 msgr2=0x7f22a4073fe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T03:32:59.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.086+0000 7f22a8c5a700 1 --2- 172.21.15.50:0/3110346619 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22a4101380 0x7f22a4073fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.086+0000 7f22a8c5a700 1 -- 172.21.15.50:0/3110346619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22a4101d40 msgr2=0x7f22a41082d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:59.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.086+0000 7f22a8c5a700 1 --2- 172.21.15.50:0/3110346619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22a4101d40 0x7f22a41082d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.086+0000 7f22a8c5a700 1 -- 172.21.15.50:0/3110346619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a4108d50 con 0x7f22a41073f0 2024-06-06T03:32:59.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.087+0000 7f22a8c5a700 1 --2- 172.21.15.50:0/3110346619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22a41073f0 0x7f22a4108810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f229c009fd0 tx=0x7f229c00cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:59.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.087+0000 7f22a17fa700 1 -- 172.21.15.50:0/3110346619 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229c021070 con 0x7f22a41073f0 2024-06-06T03:32:59.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.087+0000 7f22aa6bd700 1 -- 172.21.15.50:0/3110346619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22a4108fe0 con 0x7f22a41073f0 2024-06-06T03:32:59.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.087+0000 7f22aa6bd700 1 -- 172.21.15.50:0/3110346619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22a41a7df0 con 0x7f22a41073f0 2024-06-06T03:32:59.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.087+0000 7f22a17fa700 1 -- 172.21.15.50:0/3110346619 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f229c0074e0 con 0x7f22a41073f0 2024-06-06T03:32:59.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.087+0000 7f22a17fa700 1 -- 172.21.15.50:0/3110346619 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229c021070 con 0x7f22a41073f0 2024-06-06T03:32:59.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.091+0000 7f22a17fa700 1 -- 172.21.15.50:0/3110346619 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f229c024070 con 0x7f22a41073f0 2024-06-06T03:32:59.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.098+0000 7f22a17fa700 1 --2- 172.21.15.50:0/3110346619 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f22880a3060 0x7f22880a5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:59.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.098+0000 7f22a17fa700 1 -- 172.21.15.50:0/3110346619 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f229c00f020 con 0x7f22a41073f0 2024-06-06T03:32:59.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.102+0000 7f22b4f40b80 1 Processor -- start 2024-06-06T03:32:59.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.105+0000 7f22b4f40b80 1 -- start start 2024-06-06T03:32:59.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.105+0000 7f22b4f40b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560bf0acbfe0 0x560bf0acc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:59.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.105+0000 7f22b4f40b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560bf0acc900 0x560bf0ac62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:59.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.105+0000 7f22b4f40b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf0ac6820 0x560bf0ac6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:59.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.105+0000 7f22b4f40b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560bf09b8fe0 con 0x560bf0acbfe0 2024-06-06T03:32:59.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.105+0000 7f22b4f40b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560bf0a178d0 con 0x560bf0ac6820 2024-06-06T03:32:59.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.105+0000 7f22b4f40b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560bf097f4e0 con 0x560bf0acc900 2024-06-06T03:32:59.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.105+0000 7f22a8c5a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf0ac6820 0x560bf0ac6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:59.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.105+0000 7f22a8c5a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf0ac6820 0x560bf0ac6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:47560/0 (socket says 172.21.15.50:47560) 2024-06-06T03:32:59.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.105+0000 7f22a8c5a700 1 -- 172.21.15.50:0/2292498422 learned_addr learned my addr 172.21.15.50:0/2292498422 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:59.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.106+0000 7f22a3fff700 1 --2- 172.21.15.50:0/3110346619 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f22880a3060 0x7f22880a5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:59.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.106+0000 7f22a8c5a700 1 -- 172.21.15.50:0/2292498422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560bf0acc900 msgr2=0x560bf0ac62e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:32:59.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.106+0000 7f22a8c5a700 1 --2- 172.21.15.50:0/2292498422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560bf0acc900 0x560bf0ac62e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.106+0000 7f22a8c5a700 1 -- 172.21.15.50:0/2292498422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560bf0acbfe0 msgr2=0x560bf0acc3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:32:59.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.106+0000 7f22a8c5a700 1 --2- 172.21.15.50:0/2292498422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560bf0acbfe0 0x560bf0acc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.106+0000 7f22a8c5a700 1 -- 172.21.15.50:0/2292498422 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bf0966950 con 0x560bf0ac6820 2024-06-06T03:32:59.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.111+0000 7f22a8c5a700 1 --2- 172.21.15.50:0/2292498422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf0ac6820 0x560bf0ac6c40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f229c09d500 tx=0x7f229c00b3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efdbcf51d0a4abe0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:59.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.111+0000 7f22a3fff700 1 --2- 172.21.15.50:0/3110346619 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f22880a3060 0x7f22880a5520 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2294009820 tx=0x7f2294009210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:59.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.112+0000 7f229a7fc700 1 -- 172.21.15.50:0/2292498422 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229c021070 con 0x560bf0ac6820 2024-06-06T03:32:59.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.112+0000 7f229a7fc700 1 -- 172.21.15.50:0/2292498422 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f229c09d800 con 0x560bf0ac6820 2024-06-06T03:32:59.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.112+0000 7f229a7fc700 1 -- 172.21.15.50:0/2292498422 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229c09bb00 con 0x560bf0ac6820 2024-06-06T03:32:59.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.113+0000 7f22b4f40b80 1 -- 172.21.15.50:0/2292498422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf0ac6820 msgr2=0x560bf0ac6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:59.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.113+0000 7f22b4f40b80 1 --2- 172.21.15.50:0/2292498422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf0ac6820 0x560bf0ac6c40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f229c09d500 tx=0x7f229c00b3b0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.113+0000 7f22b4f40b80 1 -- 172.21.15.50:0/2292498422 shutdown_connections 2024-06-06T03:32:59.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.113+0000 7f22b4f40b80 1 --2- 172.21.15.50:0/2292498422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf0ac6820 0x560bf0ac6c40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.113+0000 7f22b4f40b80 1 --2- 172.21.15.50:0/2292498422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560bf0acbfe0 0x560bf0acc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.113+0000 7f22b4f40b80 1 --2- 172.21.15.50:0/2292498422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560bf0acc900 0x560bf0ac62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.113+0000 7f22b4f40b80 1 -- 172.21.15.50:0/2292498422 >> 172.21.15.50:0/2292498422 conn(0x560bf09f3100 msgr2=0x560bf0ac12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:59.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.114+0000 7f22b4f40b80 1 -- 172.21.15.50:0/2292498422 shutdown_connections 2024-06-06T03:32:59.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.115+0000 7f22b4f40b80 1 -- 172.21.15.50:0/2292498422 wait complete. 2024-06-06T03:32:59.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.115+0000 7f22b4f40b80 1 -- start start 2024-06-06T03:32:59.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.115+0000 7f22b4f40b80 1 Processor -- start 2024-06-06T03:32:59.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.116+0000 7f22b4f40b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560bf0ac6820 0x560bf0ad2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:59.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.116+0000 7f22b4f40b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560bf0acbfe0 0x560bf0acfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:59.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.116+0000 7f22b4f40b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf0acc900 0x560bf0acff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:59.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.116+0000 7f22b4f40b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560bf09b8040 con 0x560bf0acbfe0 2024-06-06T03:32:59.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.116+0000 7f22b4f40b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560bf0a13890 con 0x560bf0acc900 2024-06-06T03:32:59.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.116+0000 7f22b4f40b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560bf0ad3090 con 0x560bf0ac6820 2024-06-06T03:32:59.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.116+0000 7f22b4f40b80 10 client.0 _ll_register_callbacks cb 0x560bf09ad630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:32:59.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.117+0000 7f22a8c5a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf0acc900 0x560bf0acff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:59.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.117+0000 7f22a37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560bf0acbfe0 0x560bf0acfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:59.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.117+0000 7f22a37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560bf0acbfe0 0x560bf0acfa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60506/0 (socket says 172.21.15.50:60506) 2024-06-06T03:32:59.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.117+0000 7f22a37fe700 1 -- 172.21.15.50:0/1020606017 learned_addr learned my addr 172.21.15.50:0/1020606017 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:59.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.117+0000 7f22a3fff700 1 --2- 172.21.15.50:0/1020606017 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560bf0ac6820 0x560bf0ad2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:59.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.119+0000 7f22a8c5a700 1 -- 172.21.15.50:0/1020606017 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560bf0ac6820 msgr2=0x560bf0ad2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:59.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.119+0000 7f22a8c5a700 1 --2- 172.21.15.50:0/1020606017 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560bf0ac6820 0x560bf0ad2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.119+0000 7f22a8c5a700 1 -- 172.21.15.50:0/1020606017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560bf0acbfe0 msgr2=0x560bf0acfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:59.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.119+0000 7f22a8c5a700 1 --2- 172.21.15.50:0/1020606017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560bf0acbfe0 0x560bf0acfa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.119+0000 7f22a8c5a700 1 -- 172.21.15.50:0/1020606017 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bf09dd7d0 con 0x560bf0acc900 2024-06-06T03:32:59.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.119+0000 7f22a8c5a700 1 --2- 172.21.15.50:0/1020606017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf0acc900 0x560bf0acff60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f229c09d500 tx=0x7f229c0a1d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4dc6cf9137db1af server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:59.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.119+0000 7f22877fe700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:32:59.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.120+0000 7f22877fe700 1 -- 172.21.15.50:0/1020606017 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229c0b5020 con 0x560bf0acc900 2024-06-06T03:32:59.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.120+0000 7f22b4f40b80 1 -- 172.21.15.50:0/1020606017 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f229c09d800 con 0x560bf0acc900 2024-06-06T03:32:59.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.120+0000 7f22877fe700 1 -- 172.21.15.50:0/1020606017 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f229c09bb00 con 0x560bf0acc900 2024-06-06T03:32:59.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.120+0000 7f22877fe700 1 -- 172.21.15.50:0/1020606017 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f229c021050 con 0x560bf0acc900 2024-06-06T03:32:59.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.120+0000 7f22b4f40b80 10 client.25976 fetch_fsmap learned FSMap version 33 2024-06-06T03:32:59.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.120+0000 7f22b4f40b80 1 -- 172.21.15.50:0/1020606017 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560bf0add910 con 0x560bf0acc900 2024-06-06T03:32:59.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.121+0000 7f22877fe700 1 -- 172.21.15.50:0/1020606017 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f229c09d800 con 0x560bf0acc900 2024-06-06T03:32:59.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.121+0000 7f22877fe700 1 -- 172.21.15.50:0/1020606017 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f229c011070 con 0x560bf0acc900 2024-06-06T03:32:59.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.121+0000 7f22b4f40b80 10 client.25976 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:32:59.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.121+0000 7f22b4f40b80 10 client.25976 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:32:59.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.121+0000 7f22b4f40b80 20 client.25976 populate_metadata read hostname 'smithi050' 2024-06-06T03:32:59.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.121+0000 7f22b4f40b80 1 --2- 172.21.15.50:0/1020606017 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x560bf0adfc60 0x560bf0ae2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:59.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.121+0000 7f22b4f40b80 4 client.25976 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:32:59.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.121+0000 7f22b4f40b80 1 -- 172.21.15.50:0/1020606017 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560bf0a24dd0 con 0x560bf0adfc60 2024-06-06T03:32:59.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.122+0000 7f22a3fff700 1 --2- 172.21.15.50:0/1020606017 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x560bf0adfc60 0x560bf0ae2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:59.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.122+0000 7f22a3fff700 1 --2- 172.21.15.50:0/1020606017 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x560bf0adfc60 0x560bf0ae2050 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89bf41e6b00458f7 server_cookie=fbfa2e7e5c2000ab in_seq=0 out_seq=0 2024-06-06T03:32:59.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.123+0000 7f22877fe700 10 client.25976 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:32:59.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.123+0000 7f22877fe700 1 -- 172.21.15.50:0/1020606017 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x560bf0a24dd0 con 0x560bf0adfc60 2024-06-06T03:32:59.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.123+0000 7f22877fe700 10 client.25976 handle_command_reply: tid=0 2024-06-06T03:32:59.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.123+0000 7f22b4f40b80 1 client.25976 shutdown 2024-06-06T03:32:59.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.130+0000 7f22b4f40b80 1 -- 172.21.15.50:0/1020606017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf0acc900 msgr2=0x560bf0acff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:59.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.130+0000 7f22b4f40b80 1 --2- 172.21.15.50:0/1020606017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf0acc900 0x560bf0acff60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f229c09d500 tx=0x7f229c0a1d00 comp rx=0 tx=0).stop 2024-06-06T03:32:59.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.133+0000 7f22b4f40b80 1 -- 172.21.15.50:0/1020606017 shutdown_connections 2024-06-06T03:32:59.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.133+0000 7f22b4f40b80 1 --2- 172.21.15.50:0/1020606017 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x560bf0adfc60 0x560bf0ae2050 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.133+0000 7f22b4f40b80 1 --2- 172.21.15.50:0/1020606017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf0acc900 0x560bf0acff60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.133+0000 7f22b4f40b80 1 --2- 172.21.15.50:0/1020606017 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560bf0ac6820 0x560bf0ad2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.133+0000 7f22b4f40b80 1 --2- 172.21.15.50:0/1020606017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560bf0acbfe0 0x560bf0acfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.133+0000 7f22877fe700 0 client.25976 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:32:59.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.133+0000 7f22b4f40b80 1 -- 172.21.15.50:0/1020606017 >> 172.21.15.50:0/1020606017 conn(0x560bf09f3100 msgr2=0x560bf0ac0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:59.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.138+0000 7f22b4f40b80 1 -- 172.21.15.50:0/1020606017 shutdown_connections 2024-06-06T03:32:59.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.138+0000 7f22b4f40b80 1 -- 172.21.15.50:0/1020606017 wait complete. 2024-06-06T03:32:59.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.138+0000 7f22b4f40b80 20 client.25976 trim_cache size 0 max 16384 2024-06-06T03:32:59.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.184+0000 7f22b4f40b80 1 Processor -- start 2024-06-06T03:32:59.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.186+0000 7f22b4f40b80 1 -- start start 2024-06-06T03:32:59.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.187+0000 7f22b4f40b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560bf0ac6820 0x560bf0ac62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:59.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.187+0000 7f22b4f40b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf0acbfe0 0x560bf0ac0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:59.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.187+0000 7f22b4f40b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560bf0acc900 0x560bf0ac1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:59.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.187+0000 7f22a37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf0acbfe0 0x560bf0ac0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:59.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.187+0000 7f22a37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf0acbfe0 0x560bf0ac0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:47590/0 (socket says 172.21.15.50:47590) 2024-06-06T03:32:59.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.187+0000 7f22a37fe700 1 -- 172.21.15.50:0/3717294300 learned_addr learned my addr 172.21.15.50:0/3717294300 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:59.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.188+0000 7f22a8c5a700 1 --2- 172.21.15.50:0/3717294300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560bf0acc900 0x560bf0ac1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:59.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.188+0000 7f22b4f40b80 1 -- 172.21.15.50:0/3717294300 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f228c011430 con 0x560bf0ac6820 2024-06-06T03:32:59.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.188+0000 7f22b4f40b80 1 -- 172.21.15.50:0/3717294300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f228c00ecc0 con 0x560bf0acbfe0 2024-06-06T03:32:59.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.188+0000 7f22b4f40b80 1 -- 172.21.15.50:0/3717294300 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f228c00cb10 con 0x560bf0acc900 2024-06-06T03:32:59.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.190+0000 7f22a37fe700 1 -- 172.21.15.50:0/3717294300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560bf0acc900 msgr2=0x560bf0ac1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:59.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.190+0000 7f22a37fe700 1 --2- 172.21.15.50:0/3717294300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560bf0acc900 0x560bf0ac1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.190+0000 7f22a37fe700 1 -- 172.21.15.50:0/3717294300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560bf0ac6820 msgr2=0x560bf0ac62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:59.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.190+0000 7f22a37fe700 1 --2- 172.21.15.50:0/3717294300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560bf0ac6820 0x560bf0ac62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.190+0000 7f22a37fe700 1 -- 172.21.15.50:0/3717294300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bf0ae26d0 con 0x560bf0acbfe0 2024-06-06T03:32:59.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.191+0000 7f22a8c5a700 1 --2- 172.21.15.50:0/3717294300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560bf0acc900 0x560bf0ac1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:32:59.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.192+0000 7f22a37fe700 1 --2- 172.21.15.50:0/3717294300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf0acbfe0 0x560bf0ac0f00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2290009af0 tx=0x7f2290009e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfdf7b7692cb0b87 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:59.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.192+0000 7f2299ffb700 1 -- 172.21.15.50:0/3717294300 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2290011940 con 0x560bf0acbfe0 2024-06-06T03:32:59.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.193+0000 7f2299ffb700 1 -- 172.21.15.50:0/3717294300 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2290014440 con 0x560bf0acbfe0 2024-06-06T03:32:59.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.193+0000 7f2299ffb700 1 -- 172.21.15.50:0/3717294300 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2290013600 con 0x560bf0acbfe0 2024-06-06T03:32:59.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.194+0000 7f22b4f40b80 1 -- 172.21.15.50:0/3717294300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf0acbfe0 msgr2=0x560bf0ac0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:59.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.194+0000 7f22b4f40b80 1 --2- 172.21.15.50:0/3717294300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf0acbfe0 0x560bf0ac0f00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2290009af0 tx=0x7f2290009e00 comp rx=0 tx=0).stop 2024-06-06T03:32:59.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.195+0000 7f22b4f40b80 1 -- 172.21.15.50:0/3717294300 shutdown_connections 2024-06-06T03:32:59.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.195+0000 7f22b4f40b80 1 --2- 172.21.15.50:0/3717294300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560bf0acc900 0x560bf0ac1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.195+0000 7f22b4f40b80 1 --2- 172.21.15.50:0/3717294300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560bf0ac6820 0x560bf0ac62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.195+0000 7f22b4f40b80 1 --2- 172.21.15.50:0/3717294300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf0acbfe0 0x560bf0ac0f00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.195+0000 7f22b4f40b80 1 -- 172.21.15.50:0/3717294300 >> 172.21.15.50:0/3717294300 conn(0x560bf09f3100 msgr2=0x560bf0adb1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:59.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.199+0000 7f22b4f40b80 1 -- 172.21.15.50:0/3717294300 shutdown_connections 2024-06-06T03:32:59.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.199+0000 7f22b4f40b80 1 -- 172.21.15.50:0/3717294300 wait complete. 2024-06-06T03:32:59.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.199+0000 7f22b4f40b80 1 -- start start 2024-06-06T03:32:59.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.199+0000 7f22b4f40b80 1 Processor -- start 2024-06-06T03:32:59.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.200+0000 7f22b4f40b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560bf0ac6820 0x560bf0ad5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:59.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.200+0000 7f22b4f40b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf0acbfe0 0x560bf0ad5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:59.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.200+0000 7f22b4f40b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560bf0acc900 0x560bf0ad5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:59.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.200+0000 7f22b4f40b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f228c00d180 con 0x560bf0acc900 2024-06-06T03:32:59.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.200+0000 7f22b4f40b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f228c00e5f0 con 0x560bf0acbfe0 2024-06-06T03:32:59.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.200+0000 7f22b4f40b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f228c00d850 con 0x560bf0ac6820 2024-06-06T03:32:59.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.200+0000 7f22b4f40b80 10 client.0 _ll_register_callbacks cb 0x560bf0ad03f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:32:59.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.200+0000 7f22a8c5a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560bf0acc900 0x560bf0ad5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:59.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.200+0000 7f22a3fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560bf0ac6820 0x560bf0ad5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:59.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.201+0000 7f22a3fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560bf0ac6820 0x560bf0ad5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:37876/0 (socket says 172.21.15.50:37876) 2024-06-06T03:32:59.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.201+0000 7f22a3fff700 1 -- 172.21.15.50:0/2101193657 learned_addr learned my addr 172.21.15.50:0/2101193657 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:32:59.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.201+0000 7f22a3fff700 1 -- 172.21.15.50:0/2101193657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf0acbfe0 msgr2=0x560bf0ad5880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:32:59.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.201+0000 7f22a3fff700 1 --2- 172.21.15.50:0/2101193657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf0acbfe0 0x560bf0ad5880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.201+0000 7f22a3fff700 1 -- 172.21.15.50:0/2101193657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560bf0acc900 msgr2=0x560bf0ad5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:32:59.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.201+0000 7f22a3fff700 1 --2- 172.21.15.50:0/2101193657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560bf0acc900 0x560bf0ad5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.201+0000 7f22a3fff700 1 -- 172.21.15.50:0/2101193657 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bf0abd890 con 0x560bf0ac6820 2024-06-06T03:32:59.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.201+0000 7f22a8c5a700 1 --2- 172.21.15.50:0/2101193657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560bf0acc900 0x560bf0ad5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:32:59.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.202+0000 7f22a3fff700 1 --2- 172.21.15.50:0/2101193657 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560bf0ac6820 0x560bf0ad5340 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2294006fd0 tx=0x7f2294004790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94e99b5e160a6776 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:32:59.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.202+0000 7f22877fe700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:32:59.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.205+0000 7f22877fe700 1 -- 172.21.15.50:0/2101193657 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2294015e40 con 0x560bf0ac6820 2024-06-06T03:32:59.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.206+0000 7f22b4f40b80 1 -- 172.21.15.50:0/2101193657 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2290014440 con 0x560bf0ac6820 2024-06-06T03:32:59.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.206+0000 7f22877fe700 1 -- 172.21.15.50:0/2101193657 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f2294005a20 con 0x560bf0ac6820 2024-06-06T03:32:59.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.206+0000 7f22877fe700 1 -- 172.21.15.50:0/2101193657 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f2294034050 con 0x560bf0ac6820 2024-06-06T03:32:59.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.207+0000 7f22b4f40b80 10 client.25951 fetch_fsmap learned FSMap version 33 2024-06-06T03:32:59.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.207+0000 7f22b4f40b80 1 -- 172.21.15.50:0/2101193657 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560bf0b4ba90 con 0x560bf0ac6820 2024-06-06T03:32:59.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.210+0000 7f22877fe700 1 -- 172.21.15.50:0/2101193657 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2290014440 con 0x560bf0ac6820 2024-06-06T03:32:59.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.210+0000 7f22877fe700 1 -- 172.21.15.50:0/2101193657 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f229c0880d0 con 0x560bf0ac6820 2024-06-06T03:32:59.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.210+0000 7f22b4f40b80 10 client.25951 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:32:59.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.210+0000 7f22b4f40b80 10 client.25951 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:32:59.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.210+0000 7f22b4f40b80 20 client.25951 populate_metadata read hostname 'smithi050' 2024-06-06T03:32:59.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.210+0000 7f22b4f40b80 1 --2- 172.21.15.50:0/2101193657 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x560bf0b4c200 0x560bf0b4e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:32:59.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.210+0000 7f22b4f40b80 4 client.25951 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-06T03:32:59.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.210+0000 7f22b4f40b80 1 -- 172.21.15.50:0/2101193657 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560bf0a1f350 con 0x560bf0b4c200 2024-06-06T03:32:59.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.211+0000 7f22a37fe700 1 --2- 172.21.15.50:0/2101193657 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x560bf0b4c200 0x560bf0b4e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:32:59.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.215+0000 7f22a37fe700 1 --2- 172.21.15.50:0/2101193657 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x560bf0b4c200 0x560bf0b4e620 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ac407134c49c5b7 server_cookie=ed1354b2ebf1da0f in_seq=0 out_seq=0 2024-06-06T03:32:59.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.215+0000 7f22877fe700 10 client.25951 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:32:59.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.215+0000 7f22877fe700 1 -- 172.21.15.50:0/2101193657 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560bf0a1f350 con 0x560bf0b4c200 2024-06-06T03:32:59.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.216+0000 7f22877fe700 10 client.25951 handle_command_reply: tid=0 2024-06-06T03:32:59.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.216+0000 7f22b4f40b80 1 client.25951 shutdown 2024-06-06T03:32:59.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.217+0000 7f22b4f40b80 1 -- 172.21.15.50:0/2101193657 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560bf0ac6820 msgr2=0x560bf0ad5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:59.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.217+0000 7f22b4f40b80 1 --2- 172.21.15.50:0/2101193657 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560bf0ac6820 0x560bf0ad5340 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2294006fd0 tx=0x7f2294004790 comp rx=0 tx=0).stop 2024-06-06T03:32:59.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.217+0000 7f22b4f40b80 1 -- 172.21.15.50:0/2101193657 shutdown_connections 2024-06-06T03:32:59.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.217+0000 7f22b4f40b80 1 --2- 172.21.15.50:0/2101193657 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x560bf0b4c200 0x560bf0b4e620 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.217+0000 7f22b4f40b80 1 --2- 172.21.15.50:0/2101193657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560bf0acc900 0x560bf0ad5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.217+0000 7f22b4f40b80 1 --2- 172.21.15.50:0/2101193657 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560bf0ac6820 0x560bf0ad5340 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.217+0000 7f22b4f40b80 1 --2- 172.21.15.50:0/2101193657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf0acbfe0 0x560bf0ad5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.217+0000 7f22b4f40b80 1 -- 172.21.15.50:0/2101193657 >> 172.21.15.50:0/2101193657 conn(0x560bf09f3100 msgr2=0x560bf0ac5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:59.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.217+0000 7f22877fe700 0 client.25951 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:32:59.222 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:32:59.223 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-06-06T03:32:59.223 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "86b4c804-91e0-4449-8cff-def8c9b51667", 2024-06-06T03:32:59.223 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-06-06T03:32:59.223 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:32:59.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.218+0000 7f22b4f40b80 1 -- 172.21.15.50:0/2101193657 shutdown_connections 2024-06-06T03:32:59.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.220+0000 7f22b4f40b80 1 -- 172.21.15.50:0/2101193657 wait complete. 2024-06-06T03:32:59.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.220+0000 7f22b4f40b80 20 client.25951 trim_cache size 0 max 16384 2024-06-06T03:32:59.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.226+0000 7f22aa6bd700 1 -- 172.21.15.50:0/3110346619 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f22880a3060 msgr2=0x7f22880a5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:59.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.226+0000 7f22aa6bd700 1 --2- 172.21.15.50:0/3110346619 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f22880a3060 0x7f22880a5520 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2294009820 tx=0x7f2294009210 comp rx=0 tx=0).stop 2024-06-06T03:32:59.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.226+0000 7f22aa6bd700 1 -- 172.21.15.50:0/3110346619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22a41073f0 msgr2=0x7f22a4108810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:32:59.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.226+0000 7f22aa6bd700 1 --2- 172.21.15.50:0/3110346619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22a41073f0 0x7f22a4108810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f229c009fd0 tx=0x7f229c00cea0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.227+0000 7f22aa6bd700 1 -- 172.21.15.50:0/3110346619 shutdown_connections 2024-06-06T03:32:59.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.227+0000 7f22aa6bd700 1 --2- 172.21.15.50:0/3110346619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22a41073f0 0x7f22a4108810 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.227+0000 7f22aa6bd700 1 --2- 172.21.15.50:0/3110346619 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22a4101380 0x7f22a4073fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.227+0000 7f22aa6bd700 1 --2- 172.21.15.50:0/3110346619 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f22880a3060 0x7f22880a5520 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.227+0000 7f22aa6bd700 1 --2- 172.21.15.50:0/3110346619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22a4101d40 0x7f22a41082d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:32:59.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.227+0000 7f22aa6bd700 1 -- 172.21.15.50:0/3110346619 >> 172.21.15.50:0/3110346619 conn(0x7f22a4078300 msgr2=0x7f22a410ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:32:59.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.227+0000 7f22aa6bd700 1 -- 172.21.15.50:0/3110346619 shutdown_connections 2024-06-06T03:32:59.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:32:59.228+0000 7f22aa6bd700 1 -- 172.21.15.50:0/3110346619 wait complete. 2024-06-06T03:32:59.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:32:59 smithi050 ceph-mon[32421]: pgmap v621: 129 pgs: 129 active+clean; 10 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 34 MiB/s wr, 601 op/s 2024-06-06T03:32:59.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:32:59 smithi079 ceph-mon[35478]: pgmap v621: 129 pgs: 129 active+clean; 10 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 34 MiB/s wr, 601 op/s 2024-06-06T03:32:59.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:32:59 smithi122 ceph-mon[35759]: pgmap v621: 129 pgs: 129 active+clean; 10 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 34 MiB/s wr, 601 op/s 2024-06-06T03:33:00.066 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-06T03:33:00.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:00 smithi079 ceph-mon[35478]: scrub queued for path: / 2024-06-06T03:33:00.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:00 smithi079 ceph-mon[35478]: scrub summary: idle+waiting paths [/] 2024-06-06T03:33:00.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:00 smithi079 ceph-mon[35478]: scrub summary: active paths [/] 2024-06-06T03:33:00.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:00 smithi079 ceph-mon[35478]: scrub summary: active paths [/] 2024-06-06T03:33:00.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:00 smithi079 ceph-mon[35478]: scrub summary: idle+waiting paths [/] 2024-06-06T03:33:00.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:00 smithi079 ceph-mon[35478]: scrub summary: idle+waiting paths [/] 2024-06-06T03:33:00.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:00 smithi122 ceph-mon[35759]: scrub queued for path: / 2024-06-06T03:33:00.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:00 smithi122 ceph-mon[35759]: scrub summary: idle+waiting paths [/] 2024-06-06T03:33:00.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:00 smithi122 ceph-mon[35759]: scrub summary: active paths [/] 2024-06-06T03:33:00.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:00 smithi122 ceph-mon[35759]: scrub summary: active paths [/] 2024-06-06T03:33:00.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:00 smithi122 ceph-mon[35759]: scrub summary: idle+waiting paths [/] 2024-06-06T03:33:00.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:00 smithi122 ceph-mon[35759]: scrub summary: idle+waiting paths [/] 2024-06-06T03:33:00.704 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:33:00.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:00 smithi050 ceph-mon[32421]: scrub queued for path: / 2024-06-06T03:33:00.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:00 smithi050 ceph-mon[32421]: scrub summary: idle+waiting paths [/] 2024-06-06T03:33:00.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:00 smithi050 ceph-mon[32421]: scrub summary: active paths [/] 2024-06-06T03:33:00.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:00 smithi050 ceph-mon[32421]: scrub summary: active paths [/] 2024-06-06T03:33:00.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:00 smithi050 ceph-mon[32421]: scrub summary: idle+waiting paths [/] 2024-06-06T03:33:00.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:00 smithi050 ceph-mon[32421]: scrub summary: idle+waiting paths [/] 2024-06-06T03:33:01.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:01 smithi050 ceph-mon[32421]: pgmap v622: 129 pgs: 129 active+clean; 10 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 46 MiB/s wr, 806 op/s 2024-06-06T03:33:01.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:01 smithi079 ceph-mon[35478]: pgmap v622: 129 pgs: 129 active+clean; 10 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 46 MiB/s wr, 806 op/s 2024-06-06T03:33:01.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:01 smithi122 ceph-mon[35759]: pgmap v622: 129 pgs: 129 active+clean; 10 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 46 MiB/s wr, 806 op/s 2024-06-06T03:33:02.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.688+0000 7f5d4f59e640 1 -- 172.21.15.50:0/32360579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d50108fb0 msgr2=0x7f5d50109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:02.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.688+0000 7f5d4f59e640 1 --2- 172.21.15.50:0/32360579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d50108fb0 0x7f5d50109430 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5d4801acb0 tx=0x7f5d4803b920 comp rx=0 tx=0).stop 2024-06-06T03:33:02.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.688+0000 7f5d4f59e640 1 -- 172.21.15.50:0/32360579 shutdown_connections 2024-06-06T03:33:02.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.688+0000 7f5d4f59e640 1 --2- 172.21.15.50:0/32360579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d50109970 0x7f5d5010e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.688+0000 7f5d4f59e640 1 --2- 172.21.15.50:0/32360579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d50108fb0 0x7f5d50109430 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.688+0000 7f5d4f59e640 1 --2- 172.21.15.50:0/32360579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d50072cd0 0x7f5d500730f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.688+0000 7f5d4f59e640 1 -- 172.21.15.50:0/32360579 >> 172.21.15.50:0/32360579 conn(0x7f5d5006e840 msgr2=0x7f5d50070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:02.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.689+0000 7f5d4f59e640 1 -- 172.21.15.50:0/32360579 shutdown_connections 2024-06-06T03:33:02.693 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.692+0000 7f5d4f59e640 1 -- 172.21.15.50:0/32360579 wait complete. 2024-06-06T03:33:02.693 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.693+0000 7f5d4f59e640 1 Processor -- start 2024-06-06T03:33:02.694 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.695+0000 7f5d4f59e640 1 -- start start 2024-06-06T03:33:02.694 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.695+0000 7f5d4f59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d50072cd0 0x7f5d5019e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:02.694 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.695+0000 7f5d4f59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d50108fb0 0x7f5d5019e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:02.694 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.695+0000 7f5d4f59e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d50109970 0x7f5d501a5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:02.694 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.695+0000 7f5d4f59e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5d501119f0 con 0x7f5d50108fb0 2024-06-06T03:33:02.694 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.695+0000 7f5d4f59e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5d50111870 con 0x7f5d50072cd0 2024-06-06T03:33:02.694 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.695+0000 7f5d4f59e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5d50111b70 con 0x7f5d50109970 2024-06-06T03:33:02.695 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.696+0000 7f5d4ed9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d50109970 0x7f5d501a5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:02.695 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.696+0000 7f5d4ed9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d50109970 0x7f5d501a5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:37898/0 (socket says 172.21.15.50:37898) 2024-06-06T03:33:02.695 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.697+0000 7f5d4ed9d640 1 -- 172.21.15.50:0/4222183720 learned_addr learned my addr 172.21.15.50:0/4222183720 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:02.697 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.699+0000 7f5d4ed9d640 1 -- 172.21.15.50:0/4222183720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d50072cd0 msgr2=0x7f5d5019e0d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T03:33:02.698 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.699+0000 7f5d4ed9d640 1 --2- 172.21.15.50:0/4222183720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d50072cd0 0x7f5d5019e0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.698 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.699+0000 7f5d4ed9d640 1 -- 172.21.15.50:0/4222183720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d50108fb0 msgr2=0x7f5d5019e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:02.698 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.699+0000 7f5d4ed9d640 1 --2- 172.21.15.50:0/4222183720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d50108fb0 0x7f5d5019e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.698 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.699+0000 7f5d4ed9d640 1 -- 172.21.15.50:0/4222183720 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d501a5cf0 con 0x7f5d50109970 2024-06-06T03:33:02.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.700+0000 7f5d4ed9d640 1 --2- 172.21.15.50:0/4222183720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d50109970 0x7f5d501a5680 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5d40009fd0 tx=0x7f5d4000b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:02.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.701+0000 7f5d3f7fe640 1 -- 172.21.15.50:0/4222183720 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d40011830 con 0x7f5d50109970 2024-06-06T03:33:02.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.701+0000 7f5d3f7fe640 1 -- 172.21.15.50:0/4222183720 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5d40016070 con 0x7f5d50109970 2024-06-06T03:33:02.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.705+0000 7f5d3f7fe640 1 -- 172.21.15.50:0/4222183720 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d40010e50 con 0x7f5d50109970 2024-06-06T03:33:02.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.705+0000 7f5d4f59e640 1 -- 172.21.15.50:0/4222183720 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d501a5fe0 con 0x7f5d50109970 2024-06-06T03:33:02.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.706+0000 7f5d4f59e640 1 -- 172.21.15.50:0/4222183720 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d501a6390 con 0x7f5d50109970 2024-06-06T03:33:02.708 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.709+0000 7f5d577a8740 1 Processor -- start 2024-06-06T03:33:02.709 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.710+0000 7f5d577a8740 1 -- start start 2024-06-06T03:33:02.709 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.710+0000 7f5d577a8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f225fae200 0x55f225fae620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:02.709 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.710+0000 7f5d577a8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f225faebf0 0x55f225fb36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:02.710 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.710+0000 7f5d577a8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f225fb3d60 0x55f225fb61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:02.710 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.710+0000 7f5d577a8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f225f114f0 con 0x55f225fae200 2024-06-06T03:33:02.710 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.710+0000 7f5d577a8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f225eaf870 con 0x55f225fb3d60 2024-06-06T03:33:02.710 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.710+0000 7f5d577a8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f225f0d4b0 con 0x55f225faebf0 2024-06-06T03:33:02.741 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.713+0000 7f5d3f7fe640 1 -- 172.21.15.50:0/4222183720 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5d40010380 con 0x7f5d50109970 2024-06-06T03:33:02.741 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.717+0000 7f5d4dd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f225fb3d60 0x55f225fb61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:02.742 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.721+0000 7f5d4e59c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f225faebf0 0x55f225fb36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:02.742 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.721+0000 7f5d4dd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f225fb3d60 0x55f225fb61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:47618/0 (socket says 172.21.15.50:47618) 2024-06-06T03:33:02.742 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.721+0000 7f5d4dd9b640 1 -- 172.21.15.50:0/3642350654 learned_addr learned my addr 172.21.15.50:0/3642350654 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:02.742 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.721+0000 7f5d4dd9b640 1 --2- 172.21.15.50:0/3642350654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f225fae200 0x55f225fae620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:02.742 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.723+0000 7f5d3f7fe640 1 --2- 172.21.15.50:0/4222183720 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f5d380a2da0 0x7f5d380a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:02.742 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.724+0000 7f5d3f7fe640 1 -- 172.21.15.50:0/4222183720 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f5d400ce180 con 0x7f5d50109970 2024-06-06T03:33:02.742 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.724+0000 7f5d4dd9b640 1 -- 172.21.15.50:0/3642350654 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f225faebf0 msgr2=0x55f225fb36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:02.742 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.724+0000 7f5d4dd9b640 1 --2- 172.21.15.50:0/3642350654 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f225faebf0 0x55f225fb36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.742 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.724+0000 7f5d4dd9b640 1 -- 172.21.15.50:0/3642350654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f225fae200 msgr2=0x55f225fae620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:02.742 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.724+0000 7f5d4dd9b640 1 --2- 172.21.15.50:0/3642350654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f225fae200 0x55f225fae620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.742 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.724+0000 7f5d4dd9b640 1 -- 172.21.15.50:0/3642350654 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f225ecb9b0 con 0x55f225fb3d60 2024-06-06T03:33:02.742 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.726+0000 7f5d4ed9d640 1 --2- 172.21.15.50:0/4222183720 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f5d380a2da0 0x7f5d380a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.727+0000 7f5d4dd9b640 1 --2- 172.21.15.50:0/3642350654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f225fb3d60 0x55f225fb61f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5d48005e30 tx=0x7f5d48005d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d34d48a7a0b3fb server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.730+0000 7f5d3cff9640 1 -- 172.21.15.50:0/3642350654 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d48045040 con 0x55f225fb3d60 2024-06-06T03:33:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.731+0000 7f5d3cff9640 1 -- 172.21.15.50:0/3642350654 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5d48003e20 con 0x55f225fb3d60 2024-06-06T03:33:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.732+0000 7f5d577a8740 1 -- 172.21.15.50:0/3642350654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f225fb3d60 msgr2=0x55f225fb61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.732+0000 7f5d577a8740 1 --2- 172.21.15.50:0/3642350654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f225fb3d60 0x55f225fb61f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5d48005e30 tx=0x7f5d48005d80 comp rx=0 tx=0).stop 2024-06-06T03:33:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.732+0000 7f5d577a8740 1 -- 172.21.15.50:0/3642350654 shutdown_connections 2024-06-06T03:33:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.732+0000 7f5d577a8740 1 --2- 172.21.15.50:0/3642350654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f225fb3d60 0x55f225fb61f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.732+0000 7f5d577a8740 1 --2- 172.21.15.50:0/3642350654 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f225faebf0 0x55f225fb36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.732+0000 7f5d577a8740 1 --2- 172.21.15.50:0/3642350654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f225fae200 0x55f225fae620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.732+0000 7f5d577a8740 1 -- 172.21.15.50:0/3642350654 >> 172.21.15.50:0/3642350654 conn(0x55f225fa9870 msgr2=0x55f225fa9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.732+0000 7f5d577a8740 1 -- 172.21.15.50:0/3642350654 shutdown_connections 2024-06-06T03:33:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.732+0000 7f5d577a8740 1 -- 172.21.15.50:0/3642350654 wait complete. 2024-06-06T03:33:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.733+0000 7f5d577a8740 1 -- start start 2024-06-06T03:33:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.733+0000 7f5d577a8740 1 Processor -- start 2024-06-06T03:33:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.737+0000 7f5d577a8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f225fae200 0x55f225fb8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.737+0000 7f5d577a8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f225faebf0 0x55f225fb8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.737+0000 7f5d577a8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f225fb3d60 0x55f225fbf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.737+0000 7f5d577a8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f225fb6d00 con 0x55f225faebf0 2024-06-06T03:33:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.737+0000 7f5d577a8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f225e9aae0 con 0x55f225fb3d60 2024-06-06T03:33:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.737+0000 7f5d577a8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f225fb6e80 con 0x55f225fae200 2024-06-06T03:33:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.737+0000 7f5d577a8740 10 client.0 _ll_register_callbacks cb 0x55f225ed39b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:33:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.741+0000 7f5d4e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f225faebf0 0x55f225fb8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.741+0000 7f5d4e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f225faebf0 0x55f225fb8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60548/0 (socket says 172.21.15.50:60548) 2024-06-06T03:33:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.741+0000 7f5d4e59c640 1 -- 172.21.15.50:0/4145380689 learned_addr learned my addr 172.21.15.50:0/4145380689 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.741+0000 7f5d4dd9b640 1 --2- 172.21.15.50:0/4145380689 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f225fae200 0x55f225fb8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.741+0000 7f5d4dd9b640 1 --2- 172.21.15.50:0/4145380689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f225fb3d60 0x55f225fbf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.744+0000 7f5d4ed9d640 1 --2- 172.21.15.50:0/4222183720 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f5d380a2da0 0x7f5d380a5260 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5d4009a620 tx=0x7f5d400046c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.744+0000 7f5d4e59c640 1 -- 172.21.15.50:0/4145380689 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f225fae200 msgr2=0x55f225fb8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.744+0000 7f5d4e59c640 1 --2- 172.21.15.50:0/4145380689 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f225fae200 0x55f225fb8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.744+0000 7f5d4e59c640 1 -- 172.21.15.50:0/4145380689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f225fb3d60 msgr2=0x55f225fbf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.744+0000 7f5d4e59c640 1 --2- 172.21.15.50:0/4145380689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f225fb3d60 0x55f225fbf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.744+0000 7f5d4e59c640 1 -- 172.21.15.50:0/4145380689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f225c25210 con 0x55f225faebf0 2024-06-06T03:33:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.745+0000 7f5d4e59c640 1 --2- 172.21.15.50:0/4145380689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f225faebf0 0x55f225fb8960 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5d44011430 tx=0x7f5d440118f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d39c9ef650a3cf3 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.745+0000 7f5d4dd9b640 1 --2- 172.21.15.50:0/4145380689 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f225fae200 0x55f225fb8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:33:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.745+0000 7f5d35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:33:02.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.745+0000 7f5d35ffb640 1 -- 172.21.15.50:0/4145380689 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d44012920 con 0x55f225faebf0 2024-06-06T03:33:02.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.745+0000 7f5d35ffb640 1 -- 172.21.15.50:0/4145380689 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f5d44012ac0 con 0x55f225faebf0 2024-06-06T03:33:02.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.745+0000 7f5d577a8740 1 -- 172.21.15.50:0/4145380689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d48003e20 con 0x55f225faebf0 2024-06-06T03:33:02.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.746+0000 7f5d35ffb640 1 -- 172.21.15.50:0/4145380689 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f5d44012cc0 con 0x55f225faebf0 2024-06-06T03:33:02.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.746+0000 7f5d577a8740 10 client.16350 fetch_fsmap learned FSMap version 33 2024-06-06T03:33:02.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.746+0000 7f5d577a8740 1 -- 172.21.15.50:0/4145380689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55f225cf1620 con 0x55f225faebf0 2024-06-06T03:33:02.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.746+0000 7f5d35ffb640 1 -- 172.21.15.50:0/4145380689 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5d48003e20 con 0x55f225faebf0 2024-06-06T03:33:02.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.746+0000 7f5d35ffb640 1 -- 172.21.15.50:0/4145380689 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f5d44004b70 con 0x55f225faebf0 2024-06-06T03:33:02.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.747+0000 7f5d577a8740 10 client.16350 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:33:02.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.747+0000 7f5d577a8740 10 client.16350 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:33:02.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.747+0000 7f5d577a8740 20 client.16350 populate_metadata read hostname 'smithi050' 2024-06-06T03:33:02.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.747+0000 7f5d577a8740 1 --2- 172.21.15.50:0/4145380689 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55f225fc4810 0x55f225fc6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:02.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.747+0000 7f5d577a8740 4 client.16350 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:33:02.748 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.747+0000 7f5d577a8740 1 -- 172.21.15.50:0/4145380689 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f225f24f10 con 0x55f225fc4810 2024-06-06T03:33:02.748 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.748+0000 7f5d4dd9b640 1 --2- 172.21.15.50:0/4145380689 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55f225fc4810 0x55f225fc6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:02.748 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.749+0000 7f5d35ffb640 10 client.16350 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:33:02.748 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.749+0000 7f5d4dd9b640 1 --2- 172.21.15.50:0/4145380689 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55f225fc4810 0x55f225fc6c30 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e900dcef4b51eb39 server_cookie=2554f7b645526633 in_seq=0 out_seq=0 2024-06-06T03:33:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.750+0000 7f5d35ffb640 1 -- 172.21.15.50:0/4145380689 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55f225f24f10 con 0x55f225fc4810 2024-06-06T03:33:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.750+0000 7f5d35ffb640 10 client.16350 handle_command_reply: tid=0 2024-06-06T03:33:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.750+0000 7f5d577a8740 1 client.16350 shutdown 2024-06-06T03:33:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.750+0000 7f5d577a8740 1 -- 172.21.15.50:0/4145380689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f225faebf0 msgr2=0x55f225fb8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.750+0000 7f5d577a8740 1 --2- 172.21.15.50:0/4145380689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f225faebf0 0x55f225fb8960 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5d44011430 tx=0x7f5d440118f0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.750+0000 7f5d577a8740 1 -- 172.21.15.50:0/4145380689 shutdown_connections 2024-06-06T03:33:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.750+0000 7f5d577a8740 1 --2- 172.21.15.50:0/4145380689 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55f225fc4810 0x55f225fc6c30 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.750+0000 7f5d577a8740 1 --2- 172.21.15.50:0/4145380689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f225faebf0 0x55f225fb8960 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.750+0000 7f5d577a8740 1 --2- 172.21.15.50:0/4145380689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f225fb3d60 0x55f225fbf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.750+0000 7f5d577a8740 1 --2- 172.21.15.50:0/4145380689 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f225fae200 0x55f225fb8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.750+0000 7f5d577a8740 1 -- 172.21.15.50:0/4145380689 >> 172.21.15.50:0/4145380689 conn(0x55f225fa9870 msgr2=0x55f225fa89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.750+0000 7f5d35ffb640 0 client.16350 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:33:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.750+0000 7f5d577a8740 1 -- 172.21.15.50:0/4145380689 shutdown_connections 2024-06-06T03:33:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.750+0000 7f5d577a8740 1 -- 172.21.15.50:0/4145380689 wait complete. 2024-06-06T03:33:02.751 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.750+0000 7f5d577a8740 20 client.16350 trim_cache size 0 max 16384 2024-06-06T03:33:02.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.767+0000 7f5d577a8740 1 Processor -- start 2024-06-06T03:33:02.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.767+0000 7f5d577a8740 1 -- start start 2024-06-06T03:33:02.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.767+0000 7f5d577a8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f225fae200 0x55f225fafd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:02.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.767+0000 7f5d577a8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f225faebf0 0x55f225fb02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:02.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.767+0000 7f5d577a8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f225fb3d60 0x55f225fbf960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:02.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.767+0000 7f5d577a8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5d501b3150 con 0x55f225fb3d60 2024-06-06T03:33:02.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.767+0000 7f5d577a8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5d501b0a20 con 0x55f225faebf0 2024-06-06T03:33:02.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.767+0000 7f5d577a8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5d501ae870 con 0x55f225fae200 2024-06-06T03:33:02.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.767+0000 7f5d4dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f225fb3d60 0x55f225fbf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:02.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.767+0000 7f5d4dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f225fb3d60 0x55f225fbf960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60550/0 (socket says 172.21.15.50:60550) 2024-06-06T03:33:02.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.767+0000 7f5d4dd9b640 1 -- 172.21.15.50:0/3862966600 learned_addr learned my addr 172.21.15.50:0/3862966600 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:02.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.767+0000 7f5d4dd9b640 1 --2- 172.21.15.50:0/3862966600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f225fae200 0x55f225fafd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:02.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.767+0000 7f5d4e59c640 1 --2- 172.21.15.50:0/3862966600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f225faebf0 0x55f225fb02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:02.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.768+0000 7f5d4dd9b640 1 -- 172.21.15.50:0/3862966600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f225fae200 msgr2=0x55f225fafd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:02.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.768+0000 7f5d4dd9b640 1 --2- 172.21.15.50:0/3862966600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f225fae200 0x55f225fafd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.768+0000 7f5d4dd9b640 1 -- 172.21.15.50:0/3862966600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f225faebf0 msgr2=0x55f225fb02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:02.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.768+0000 7f5d4dd9b640 1 --2- 172.21.15.50:0/3862966600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f225faebf0 0x55f225fb02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.768+0000 7f5d4dd9b640 1 -- 172.21.15.50:0/3862966600 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f225fad7b0 con 0x55f225fb3d60 2024-06-06T03:33:02.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.768+0000 7f5d4dd9b640 1 --2- 172.21.15.50:0/3862966600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f225fb3d60 0x55f225fbf960 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f5d48041040 tx=0x7f5d48000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1277999c8a5655d server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:02.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.768+0000 7f5d37fff640 1 -- 172.21.15.50:0/3862966600 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d48045030 con 0x55f225fb3d60 2024-06-06T03:33:02.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.768+0000 7f5d37fff640 1 -- 172.21.15.50:0/3862966600 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5d48041ad0 con 0x55f225fb3d60 2024-06-06T03:33:02.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.768+0000 7f5d37fff640 1 -- 172.21.15.50:0/3862966600 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d480664b0 con 0x55f225fb3d60 2024-06-06T03:33:02.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.769+0000 7f5d577a8740 1 -- 172.21.15.50:0/3862966600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f225fb3d60 msgr2=0x55f225fbf960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:02.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.769+0000 7f5d577a8740 1 --2- 172.21.15.50:0/3862966600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f225fb3d60 0x55f225fbf960 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f5d48041040 tx=0x7f5d48000f40 comp rx=0 tx=0).stop 2024-06-06T03:33:02.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.769+0000 7f5d577a8740 1 -- 172.21.15.50:0/3862966600 shutdown_connections 2024-06-06T03:33:02.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.769+0000 7f5d577a8740 1 --2- 172.21.15.50:0/3862966600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f225fb3d60 0x55f225fbf960 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.773 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.769+0000 7f5d577a8740 1 --2- 172.21.15.50:0/3862966600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f225faebf0 0x55f225fb02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.773 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.769+0000 7f5d577a8740 1 --2- 172.21.15.50:0/3862966600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f225fae200 0x55f225fafd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.773 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.769+0000 7f5d577a8740 1 -- 172.21.15.50:0/3862966600 >> 172.21.15.50:0/3862966600 conn(0x55f225fa9870 msgr2=0x55f225fb8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:02.773 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.769+0000 7f5d577a8740 1 -- 172.21.15.50:0/3862966600 shutdown_connections 2024-06-06T03:33:02.773 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.769+0000 7f5d577a8740 1 -- 172.21.15.50:0/3862966600 wait complete. 2024-06-06T03:33:02.773 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.769+0000 7f5d577a8740 1 -- start start 2024-06-06T03:33:02.773 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.769+0000 7f5d577a8740 1 Processor -- start 2024-06-06T03:33:02.773 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.769+0000 7f5d577a8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f225fae200 0x55f225fbf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:02.773 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.769+0000 7f5d577a8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f225faebf0 0x55f225fbc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:02.773 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.769+0000 7f5d577a8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f225fb3d60 0x55f225fbc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:02.773 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.770+0000 7f5d577a8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5d501aeee0 con 0x55f225fb3d60 2024-06-06T03:33:02.773 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.770+0000 7f5d577a8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5d501b0350 con 0x55f225faebf0 2024-06-06T03:33:02.773 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.770+0000 7f5d577a8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5d501af5b0 con 0x55f225fae200 2024-06-06T03:33:02.774 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.770+0000 7f5d577a8740 10 client.0 _ll_register_callbacks cb 0x7f5d44009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:33:02.774 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.770+0000 7f5d4dd9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f225fae200 0x55f225fbf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:02.774 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.770+0000 7f5d4dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f225fb3d60 0x55f225fbc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:02.774 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.770+0000 7f5d4dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f225fb3d60 0x55f225fbc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60562/0 (socket says 172.21.15.50:60562) 2024-06-06T03:33:02.774 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.770+0000 7f5d4dd9b640 1 -- 172.21.15.50:0/857341525 learned_addr learned my addr 172.21.15.50:0/857341525 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:02.774 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.770+0000 7f5d4e59c640 1 --2- 172.21.15.50:0/857341525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f225faebf0 0x55f225fbc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:02.774 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.770+0000 7f5d4dd9b640 1 -- 172.21.15.50:0/857341525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f225fae200 msgr2=0x55f225fbf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:02.774 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.770+0000 7f5d4dd9b640 1 --2- 172.21.15.50:0/857341525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f225fae200 0x55f225fbf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.774 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.770+0000 7f5d4dd9b640 1 -- 172.21.15.50:0/857341525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f225faebf0 msgr2=0x55f225fbc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:02.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.770+0000 7f5d4dd9b640 1 --2- 172.21.15.50:0/857341525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f225faebf0 0x55f225fbc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.770+0000 7f5d4dd9b640 1 -- 172.21.15.50:0/857341525 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f225fbcba0 con 0x55f225fb3d60 2024-06-06T03:33:02.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.770+0000 7f5d4dd9b640 1 --2- 172.21.15.50:0/857341525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f225fb3d60 0x55f225fbc5e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5d4801acb0 tx=0x7f5d48005df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b30494d1977cfde0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:02.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.770+0000 7f5d35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:33:02.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.770+0000 7f5d35ffb640 1 -- 172.21.15.50:0/857341525 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d48045040 con 0x55f225fb3d60 2024-06-06T03:33:02.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.770+0000 7f5d35ffb640 1 -- 172.21.15.50:0/857341525 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f5d48066e80 con 0x55f225fb3d60 2024-06-06T03:33:02.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.770+0000 7f5d577a8740 1 -- 172.21.15.50:0/857341525 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d48041ad0 con 0x55f225fb3d60 2024-06-06T03:33:02.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.771+0000 7f5d35ffb640 1 -- 172.21.15.50:0/857341525 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f5d48040c80 con 0x55f225fb3d60 2024-06-06T03:33:02.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.771+0000 7f5d577a8740 10 client.16356 fetch_fsmap learned FSMap version 33 2024-06-06T03:33:02.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.771+0000 7f5d577a8740 1 -- 172.21.15.50:0/857341525 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55f22602e510 con 0x55f225fb3d60 2024-06-06T03:33:02.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.771+0000 7f5d35ffb640 1 -- 172.21.15.50:0/857341525 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5d48041ad0 con 0x55f225fb3d60 2024-06-06T03:33:02.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.771+0000 7f5d35ffb640 1 -- 172.21.15.50:0/857341525 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f5d48071030 con 0x55f225fb3d60 2024-06-06T03:33:02.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.771+0000 7f5d577a8740 10 client.16356 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:33:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.771+0000 7f5d577a8740 10 client.16356 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:33:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.771+0000 7f5d577a8740 20 client.16356 populate_metadata read hostname 'smithi050' 2024-06-06T03:33:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.771+0000 7f5d577a8740 1 --2- 172.21.15.50:0/857341525 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55f22602e960 0x55f226030d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.771+0000 7f5d577a8740 4 client.16356 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:33:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.771+0000 7f5d577a8740 1 -- 172.21.15.50:0/857341525 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f225f1ec20 con 0x55f22602e960 2024-06-06T03:33:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.771+0000 7f5d4e59c640 1 --2- 172.21.15.50:0/857341525 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55f22602e960 0x55f226030d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.772+0000 7f5d4e59c640 1 --2- 172.21.15.50:0/857341525 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55f22602e960 0x55f226030d50 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9e8db7b65a27016 server_cookie=cb7b39c5603224cd in_seq=0 out_seq=0 2024-06-06T03:33:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.772+0000 7f5d35ffb640 10 client.16356 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:33:02.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.775+0000 7f5d35ffb640 1 -- 172.21.15.50:0/857341525 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55f225f1ec20 con 0x55f22602e960 2024-06-06T03:33:02.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.775+0000 7f5d35ffb640 10 client.16356 handle_command_reply: tid=0 2024-06-06T03:33:02.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.775+0000 7f5d577a8740 1 client.16356 shutdown 2024-06-06T03:33:02.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.775+0000 7f5d577a8740 1 -- 172.21.15.50:0/857341525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f225fb3d60 msgr2=0x55f225fbc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:02.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.775+0000 7f5d577a8740 1 --2- 172.21.15.50:0/857341525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f225fb3d60 0x55f225fbc5e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5d4801acb0 tx=0x7f5d48005df0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.775+0000 7f5d577a8740 1 -- 172.21.15.50:0/857341525 shutdown_connections 2024-06-06T03:33:02.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.775+0000 7f5d577a8740 1 --2- 172.21.15.50:0/857341525 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55f22602e960 0x55f226030d50 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.775+0000 7f5d577a8740 1 --2- 172.21.15.50:0/857341525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f225fb3d60 0x55f225fbc5e0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.775+0000 7f5d35ffb640 0 client.16356 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:33:02.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.775+0000 7f5d577a8740 1 --2- 172.21.15.50:0/857341525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f225faebf0 0x55f225fbc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.779 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.775+0000 7f5d577a8740 1 --2- 172.21.15.50:0/857341525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f225fae200 0x55f225fbf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.779 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.775+0000 7f5d577a8740 1 -- 172.21.15.50:0/857341525 >> 172.21.15.50:0/857341525 conn(0x55f225fa9870 msgr2=0x55f225fafd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:02.779 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.775+0000 7f5d577a8740 1 -- 172.21.15.50:0/857341525 shutdown_connections 2024-06-06T03:33:02.779 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.775+0000 7f5d577a8740 1 -- 172.21.15.50:0/857341525 wait complete. 2024-06-06T03:33:02.779 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.775+0000 7f5d577a8740 20 client.16356 trim_cache size 0 max 16384 2024-06-06T03:33:02.779 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:33:02.779 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:33:02.779 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:33:02.780 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.775+0000 7f5d4f59e640 1 -- 172.21.15.50:0/4222183720 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f5d380a2da0 msgr2=0x7f5d380a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:02.780 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.775+0000 7f5d4f59e640 1 --2- 172.21.15.50:0/4222183720 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f5d380a2da0 0x7f5d380a5260 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5d4009a620 tx=0x7f5d400046c0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.780 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.775+0000 7f5d4f59e640 1 -- 172.21.15.50:0/4222183720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d50109970 msgr2=0x7f5d501a5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:02.780 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.775+0000 7f5d4f59e640 1 --2- 172.21.15.50:0/4222183720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d50109970 0x7f5d501a5680 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5d40009fd0 tx=0x7f5d4000b8e0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.780 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.776+0000 7f5d4f59e640 1 -- 172.21.15.50:0/4222183720 shutdown_connections 2024-06-06T03:33:02.780 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.776+0000 7f5d4f59e640 1 --2- 172.21.15.50:0/4222183720 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f5d380a2da0 0x7f5d380a5260 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.780 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.776+0000 7f5d4f59e640 1 --2- 172.21.15.50:0/4222183720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d50108fb0 0x7f5d5019e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.776+0000 7f5d4f59e640 1 --2- 172.21.15.50:0/4222183720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d50109970 0x7f5d501a5680 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.776+0000 7f5d4f59e640 1 --2- 172.21.15.50:0/4222183720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d50072cd0 0x7f5d5019e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.776+0000 7f5d4f59e640 1 -- 172.21.15.50:0/4222183720 >> 172.21.15.50:0/4222183720 conn(0x7f5d5006e840 msgr2=0x7f5d5010c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.776+0000 7f5d4f59e640 1 -- 172.21.15.50:0/4222183720 shutdown_connections 2024-06-06T03:33:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:02.776+0000 7f5d4f59e640 1 -- 172.21.15.50:0/4222183720 wait complete. 2024-06-06T03:33:03.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.228+0000 7fbf65a38700 1 -- 172.21.15.50:0/3911168374 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbf60113330 msgr2=0x7fbf60115720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:03.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.228+0000 7fbf65a38700 1 --2- 172.21.15.50:0/3911168374 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbf60113330 0x7fbf60115720 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbf5800b0a0 tx=0x7fbf5800b3b0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.228+0000 7fbf65a38700 1 -- 172.21.15.50:0/3911168374 shutdown_connections 2024-06-06T03:33:03.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.228+0000 7fbf65a38700 1 --2- 172.21.15.50:0/3911168374 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbf60113330 0x7fbf60115720 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.228+0000 7fbf65a38700 1 --2- 172.21.15.50:0/3911168374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf60100610 0x7fbf601009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.228+0000 7fbf65a38700 1 --2- 172.21.15.50:0/3911168374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf60100f30 0x7fbf60112df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.228+0000 7fbf65a38700 1 -- 172.21.15.50:0/3911168374 >> 172.21.15.50:0/3911168374 conn(0x7fbf60077590 msgr2=0x7fbf600fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:03.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.231+0000 7fbf65a38700 1 -- 172.21.15.50:0/3911168374 shutdown_connections 2024-06-06T03:33:03.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.235+0000 7fbf65a38700 1 -- 172.21.15.50:0/3911168374 wait complete. 2024-06-06T03:33:03.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.236+0000 7fbf65a38700 1 Processor -- start 2024-06-06T03:33:03.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.236+0000 7fbf65a38700 1 -- start start 2024-06-06T03:33:03.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.237+0000 7fbf65a38700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf60100610 0x7fbf6019f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:03.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.237+0000 7fbf65a38700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf60100f30 0x7fbf6019f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:03.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.237+0000 7fbf65a38700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbf601a38f0 0x7fbf601a3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:03.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.237+0000 7fbf65a38700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbf60118d70 con 0x7fbf60100610 2024-06-06T03:33:03.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.237+0000 7fbf5f7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbf601a38f0 0x7fbf601a3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:03.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.237+0000 7fbf5f7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbf601a38f0 0x7fbf601a3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:37946/0 (socket says 172.21.15.50:37946) 2024-06-06T03:33:03.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.237+0000 7fbf5f7fe700 1 -- 172.21.15.50:0/752589173 learned_addr learned my addr 172.21.15.50:0/752589173 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:03.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.238+0000 7fbf65a38700 1 -- 172.21.15.50:0/752589173 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbf60118bf0 con 0x7fbf60100f30 2024-06-06T03:33:03.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.238+0000 7fbf65a38700 1 -- 172.21.15.50:0/752589173 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbf60118ef0 con 0x7fbf601a38f0 2024-06-06T03:33:03.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.240+0000 7fbf5effd700 1 --2- 172.21.15.50:0/752589173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf60100610 0x7fbf6019f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:03.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.240+0000 7fbf5f7fe700 1 -- 172.21.15.50:0/752589173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf60100f30 msgr2=0x7fbf6019f560 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-06T03:33:03.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.240+0000 7fbf5f7fe700 1 --2- 172.21.15.50:0/752589173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf60100f30 0x7fbf6019f560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.240+0000 7fbf5f7fe700 1 -- 172.21.15.50:0/752589173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf60100610 msgr2=0x7fbf6019f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:03.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.240+0000 7fbf5f7fe700 1 --2- 172.21.15.50:0/752589173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf60100610 0x7fbf6019f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.240+0000 7fbf5f7fe700 1 -- 172.21.15.50:0/752589173 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf601a4410 con 0x7fbf601a38f0 2024-06-06T03:33:03.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.241+0000 7fbf5f7fe700 1 --2- 172.21.15.50:0/752589173 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbf601a38f0 0x7fbf601a3d70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbf58009750 tx=0x7fbf58004c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:03.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.241+0000 7fbf64a36700 1 -- 172.21.15.50:0/752589173 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5801f070 con 0x7fbf601a38f0 2024-06-06T03:33:03.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.242+0000 7fbf65a38700 1 -- 172.21.15.50:0/752589173 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf601a46a0 con 0x7fbf601a38f0 2024-06-06T03:33:03.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.242+0000 7fbf65a38700 1 -- 172.21.15.50:0/752589173 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf601abe80 con 0x7fbf601a38f0 2024-06-06T03:33:03.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.242+0000 7fbf64a36700 1 -- 172.21.15.50:0/752589173 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbf58012cc0 con 0x7fbf601a38f0 2024-06-06T03:33:03.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.242+0000 7fbf64a36700 1 -- 172.21.15.50:0/752589173 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf58004690 con 0x7fbf601a38f0 2024-06-06T03:33:03.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.245+0000 7fbf64a36700 1 -- 172.21.15.50:0/752589173 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbf580074e0 con 0x7fbf601a38f0 2024-06-06T03:33:03.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.252+0000 7fbf702bbb80 1 Processor -- start 2024-06-06T03:33:03.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.253+0000 7fbf702bbb80 1 -- start start 2024-06-06T03:33:03.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.253+0000 7fbf702bbb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad7ee92f60 0x55ad7ee93340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:03.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.253+0000 7fbf702bbb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad7ee93880 0x55ad7ee8d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:03.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.253+0000 7fbf702bbb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad7ee8d7a0 0x55ad7ee8dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:03.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.253+0000 7fbf5e7fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad7ee92f60 0x55ad7ee93340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:03.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.253+0000 7fbf5e7fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad7ee92f60 0x55ad7ee93340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:37950/0 (socket says 172.21.15.50:37950) 2024-06-06T03:33:03.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.253+0000 7fbf5e7fc700 1 -- 172.21.15.50:0/3751653072 learned_addr learned my addr 172.21.15.50:0/3751653072 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:03.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.253+0000 7fbf702bbb80 1 -- 172.21.15.50:0/3751653072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ad7ed7ff60 con 0x55ad7ee93880 2024-06-06T03:33:03.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.253+0000 7fbf702bbb80 1 -- 172.21.15.50:0/3751653072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ad7edde850 con 0x55ad7ee8d7a0 2024-06-06T03:33:03.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.253+0000 7fbf702bbb80 1 -- 172.21.15.50:0/3751653072 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ad7ed46460 con 0x55ad7ee92f60 2024-06-06T03:33:03.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.254+0000 7fbf5e7fc700 1 -- 172.21.15.50:0/3751653072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad7ee8d7a0 msgr2=0x55ad7ee8dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:03.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.254+0000 7fbf5e7fc700 1 --2- 172.21.15.50:0/3751653072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad7ee8d7a0 0x55ad7ee8dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.254+0000 7fbf5e7fc700 1 -- 172.21.15.50:0/3751653072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad7ee93880 msgr2=0x55ad7ee8d260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:33:03.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.254+0000 7fbf5effd700 1 --2- 172.21.15.50:0/3751653072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad7ee93880 0x55ad7ee8d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:03.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.254+0000 7fbf5e7fc700 1 --2- 172.21.15.50:0/3751653072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad7ee93880 0x55ad7ee8d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.254+0000 7fbf5e7fc700 1 -- 172.21.15.50:0/3751653072 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad7ed2d8d0 con 0x55ad7ee92f60 2024-06-06T03:33:03.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.254+0000 7fbf5effd700 1 --2- 172.21.15.50:0/3751653072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad7ee93880 0x55ad7ee8d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:33:03.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.254+0000 7fbf5e7fc700 1 --2- 172.21.15.50:0/3751653072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad7ee92f60 0x55ad7ee93340 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbf5000acc0 tx=0x7fbf5000c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67f751811c34452d server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:03.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.255+0000 7fbf64a36700 1 --2- 172.21.15.50:0/752589173 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbf480a2e30 0x7fbf480a52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:03.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.255+0000 7fbf64a36700 1 -- 172.21.15.50:0/752589173 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fbf580d0c30 con 0x7fbf601a38f0 2024-06-06T03:33:03.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.256+0000 7fbf45ffb700 1 -- 172.21.15.50:0/3751653072 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5000cde0 con 0x55ad7ee92f60 2024-06-06T03:33:03.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.256+0000 7fbf45ffb700 1 -- 172.21.15.50:0/3751653072 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbf500044d0 con 0x55ad7ee92f60 2024-06-06T03:33:03.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.256+0000 7fbf45ffb700 1 -- 172.21.15.50:0/3751653072 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5000f6b0 con 0x55ad7ee92f60 2024-06-06T03:33:03.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.257+0000 7fbf702bbb80 1 -- 172.21.15.50:0/3751653072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad7ee92f60 msgr2=0x55ad7ee93340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:03.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.257+0000 7fbf702bbb80 1 --2- 172.21.15.50:0/3751653072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad7ee92f60 0x55ad7ee93340 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbf5000acc0 tx=0x7fbf5000c2d0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.258+0000 7fbf5effd700 1 --2- 172.21.15.50:0/752589173 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbf480a2e30 0x7fbf480a52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:03.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.261+0000 7fbf702bbb80 1 -- 172.21.15.50:0/3751653072 shutdown_connections 2024-06-06T03:33:03.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.261+0000 7fbf702bbb80 1 --2- 172.21.15.50:0/3751653072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad7ee8d7a0 0x55ad7ee8dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.261+0000 7fbf702bbb80 1 --2- 172.21.15.50:0/3751653072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad7ee92f60 0x55ad7ee93340 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.261+0000 7fbf702bbb80 1 --2- 172.21.15.50:0/3751653072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad7ee93880 0x55ad7ee8d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.261+0000 7fbf702bbb80 1 -- 172.21.15.50:0/3751653072 >> 172.21.15.50:0/3751653072 conn(0x55ad7edba080 msgr2=0x55ad7ee88220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:03.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.264+0000 7fbf702bbb80 1 -- 172.21.15.50:0/3751653072 shutdown_connections 2024-06-06T03:33:03.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.264+0000 7fbf702bbb80 1 -- 172.21.15.50:0/3751653072 wait complete. 2024-06-06T03:33:03.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.265+0000 7fbf702bbb80 1 -- start start 2024-06-06T03:33:03.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.265+0000 7fbf702bbb80 1 Processor -- start 2024-06-06T03:33:03.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.266+0000 7fbf702bbb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad7ee8d7a0 0x55ad7ee996f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:03.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.266+0000 7fbf702bbb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad7ee92f60 0x55ad7ee969f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:03.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.266+0000 7fbf702bbb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad7ee93880 0x55ad7ee96f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:03.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.266+0000 7fbf702bbb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ad7ed7efc0 con 0x55ad7ee92f60 2024-06-06T03:33:03.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.268+0000 7fbf5f7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad7ee93880 0x55ad7ee96f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:03.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.268+0000 7fbf5f7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad7ee93880 0x55ad7ee96f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:37964/0 (socket says 172.21.15.50:37964) 2024-06-06T03:33:03.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.268+0000 7fbf5f7fe700 1 -- 172.21.15.50:0/2502424737 learned_addr learned my addr 172.21.15.50:0/2502424737 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:03.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.268+0000 7fbf702bbb80 1 -- 172.21.15.50:0/2502424737 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ad7edda810 con 0x55ad7ee8d7a0 2024-06-06T03:33:03.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.268+0000 7fbf702bbb80 1 -- 172.21.15.50:0/2502424737 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ad7ee9a260 con 0x55ad7ee93880 2024-06-06T03:33:03.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.268+0000 7fbf702bbb80 10 client.0 _ll_register_callbacks cb 0x55ad7ed745b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:33:03.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.269+0000 7fbf5f7fe700 1 -- 172.21.15.50:0/2502424737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad7ee8d7a0 msgr2=0x55ad7ee996f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:33:03.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.269+0000 7fbf5f7fe700 1 --2- 172.21.15.50:0/2502424737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad7ee8d7a0 0x55ad7ee996f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.269+0000 7fbf5f7fe700 1 -- 172.21.15.50:0/2502424737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad7ee92f60 msgr2=0x55ad7ee969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:03.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.269+0000 7fbf5f7fe700 1 --2- 172.21.15.50:0/2502424737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad7ee92f60 0x55ad7ee969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.269+0000 7fbf5f7fe700 1 -- 172.21.15.50:0/2502424737 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad7eda4750 con 0x55ad7ee93880 2024-06-06T03:33:03.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.269+0000 7fbf5f7fe700 1 --2- 172.21.15.50:0/2502424737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad7ee93880 0x55ad7ee96f30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbf58099b10 tx=0x7fbf5809cb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f82256094bf80f4 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:03.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.269+0000 7fbf702bbb80 1 -- 172.21.15.50:0/2502424737 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf500044d0 con 0x55ad7ee93880 2024-06-06T03:33:03.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.270+0000 7fbf5effd700 1 --2- 172.21.15.50:0/752589173 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbf480a2e30 0x7fbf480a52f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbf54006fd0 tx=0x7fbf54008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:03.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.271+0000 7fbf3effd700 10 client.25981 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:33:03.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.271+0000 7fbf3effd700 1 -- 172.21.15.50:0/2502424737 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf58028070 con 0x55ad7ee93880 2024-06-06T03:33:03.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.271+0000 7fbf3effd700 1 -- 172.21.15.50:0/2502424737 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fbf58004000 con 0x55ad7ee93880 2024-06-06T03:33:03.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.271+0000 7fbf3effd700 1 -- 172.21.15.50:0/2502424737 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fbf5809d140 con 0x55ad7ee93880 2024-06-06T03:33:03.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.272+0000 7fbf702bbb80 10 client.25981 fetch_fsmap learned FSMap version 33 2024-06-06T03:33:03.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.272+0000 7fbf702bbb80 1 -- 172.21.15.50:0/2502424737 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({fsmap=33}) -- 0x55ad7eea4770 con 0x55ad7ee93880 2024-06-06T03:33:03.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.273+0000 7fbf3effd700 1 -- 172.21.15.50:0/2502424737 <== mon.1 v2:172.21.15.122:3300/0 4 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fbf58011070 con 0x55ad7ee93880 2024-06-06T03:33:03.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.274+0000 7fbf702bbb80 10 client.25981 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:33:03.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.274+0000 7fbf702bbb80 10 client.25981 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:33:03.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.274+0000 7fbf702bbb80 20 client.25981 populate_metadata read hostname 'smithi050' 2024-06-06T03:33:03.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.274+0000 7fbf702bbb80 1 --2- 172.21.15.50:0/2502424737 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ad7eea6c40 0x55ad7eea90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:03.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.274+0000 7fbf702bbb80 4 client.25981 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:33:03.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.274+0000 7fbf702bbb80 1 -- 172.21.15.50:0/2502424737 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fbf500044d0 con 0x55ad7eea6c40 2024-06-06T03:33:03.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.277+0000 7fbf5effd700 1 --2- 172.21.15.50:0/2502424737 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ad7eea6c40 0x55ad7eea90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:03.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.278+0000 7fbf5effd700 1 --2- 172.21.15.50:0/2502424737 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ad7eea6c40 0x55ad7eea90e0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b60692d0fb0a2b51 server_cookie=1fc9f2f187b27237 in_seq=0 out_seq=0 2024-06-06T03:33:03.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.280+0000 7fbf3effd700 10 client.25981 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:33:03.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.280+0000 7fbf3effd700 1 -- 172.21.15.50:0/2502424737 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x7fbf500044d0 con 0x55ad7eea6c40 2024-06-06T03:33:03.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.280+0000 7fbf3effd700 10 client.25981 handle_command_reply: tid=0 2024-06-06T03:33:03.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.281+0000 7fbf702bbb80 1 client.25981 shutdown 2024-06-06T03:33:03.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.285+0000 7fbf702bbb80 1 -- 172.21.15.50:0/2502424737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad7ee93880 msgr2=0x55ad7ee96f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:03.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.285+0000 7fbf702bbb80 1 --2- 172.21.15.50:0/2502424737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad7ee93880 0x55ad7ee96f30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbf58099b10 tx=0x7fbf5809cb50 comp rx=0 tx=0).stop 2024-06-06T03:33:03.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.285+0000 7fbf702bbb80 1 -- 172.21.15.50:0/2502424737 shutdown_connections 2024-06-06T03:33:03.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.285+0000 7fbf702bbb80 1 --2- 172.21.15.50:0/2502424737 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ad7eea6c40 0x55ad7eea90e0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.285+0000 7fbf702bbb80 1 --2- 172.21.15.50:0/2502424737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad7ee93880 0x55ad7ee96f30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.285+0000 7fbf702bbb80 1 --2- 172.21.15.50:0/2502424737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad7ee8d7a0 0x55ad7ee996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.285+0000 7fbf702bbb80 1 --2- 172.21.15.50:0/2502424737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad7ee92f60 0x55ad7ee969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.285+0000 7fbf702bbb80 1 -- 172.21.15.50:0/2502424737 >> 172.21.15.50:0/2502424737 conn(0x55ad7edba080 msgr2=0x55ad7ee87700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:03.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.287+0000 7fbf3effd700 0 client.25981 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:33:03.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.287+0000 7fbf702bbb80 1 -- 172.21.15.50:0/2502424737 shutdown_connections 2024-06-06T03:33:03.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.293+0000 7fbf702bbb80 1 -- 172.21.15.50:0/2502424737 wait complete. 2024-06-06T03:33:03.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.293+0000 7fbf702bbb80 20 client.25981 trim_cache size 0 max 16384 2024-06-06T03:33:03.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.335+0000 7fbf702bbb80 1 Processor -- start 2024-06-06T03:33:03.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.335+0000 7fbf702bbb80 1 -- start start 2024-06-06T03:33:03.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.335+0000 7fbf702bbb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad7ee8d7a0 0x55ad7eea3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:03.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.336+0000 7fbf702bbb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad7ee92f60 0x55ad7ee87e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:03.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.336+0000 7fbf702bbb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad7ee93880 0x55ad7ee921f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:03.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.336+0000 7fbf5e7fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad7ee92f60 0x55ad7ee87e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:03.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.336+0000 7fbf5e7fc700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad7ee92f60 0x55ad7ee87e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:37970/0 (socket says 172.21.15.50:37970) 2024-06-06T03:33:03.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.336+0000 7fbf5f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad7ee93880 0x55ad7ee921f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:03.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.336+0000 7fbf5f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad7ee93880 0x55ad7ee921f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:47654/0 (socket says 172.21.15.50:47654) 2024-06-06T03:33:03.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.336+0000 7fbf5e7fc700 1 -- 172.21.15.50:0/865200378 learned_addr learned my addr 172.21.15.50:0/865200378 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:03.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.337+0000 7fbf702bbb80 1 -- 172.21.15.50:0/865200378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c011380 con 0x55ad7ee8d7a0 2024-06-06T03:33:03.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.337+0000 7fbf702bbb80 1 -- 172.21.15.50:0/865200378 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c00ec10 con 0x55ad7ee93880 2024-06-06T03:33:03.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.337+0000 7fbf702bbb80 1 -- 172.21.15.50:0/865200378 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c00ca60 con 0x55ad7ee92f60 2024-06-06T03:33:03.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.337+0000 7fbf5e7fc700 1 -- 172.21.15.50:0/865200378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad7ee93880 msgr2=0x55ad7ee921f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:03.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.337+0000 7fbf5e7fc700 1 --2- 172.21.15.50:0/865200378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad7ee93880 0x55ad7ee921f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.337+0000 7fbf5e7fc700 1 -- 172.21.15.50:0/865200378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad7ee8d7a0 msgr2=0x55ad7eea3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:03.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.337+0000 7fbf5e7fc700 1 --2- 172.21.15.50:0/865200378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad7ee8d7a0 0x55ad7eea3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.337+0000 7fbf5e7fc700 1 -- 172.21.15.50:0/865200378 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad7ee909e0 con 0x55ad7ee92f60 2024-06-06T03:33:03.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.338+0000 7fbf5e7fc700 1 --2- 172.21.15.50:0/865200378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad7ee92f60 0x55ad7ee87e80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbf50005dd0 tx=0x7fbf5000cbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=767a54d8d8c95380 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:03.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.342+0000 7fbf457fa700 1 -- 172.21.15.50:0/865200378 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf500052e0 con 0x55ad7ee92f60 2024-06-06T03:33:03.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.342+0000 7fbf457fa700 1 -- 172.21.15.50:0/865200378 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbf50005480 con 0x55ad7ee92f60 2024-06-06T03:33:03.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.342+0000 7fbf457fa700 1 -- 172.21.15.50:0/865200378 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5000f870 con 0x55ad7ee92f60 2024-06-06T03:33:03.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.343+0000 7fbf702bbb80 1 -- 172.21.15.50:0/865200378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad7ee92f60 msgr2=0x55ad7ee87e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:03.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.343+0000 7fbf702bbb80 1 --2- 172.21.15.50:0/865200378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad7ee92f60 0x55ad7ee87e80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbf50005dd0 tx=0x7fbf5000cbe0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.344+0000 7fbf702bbb80 1 -- 172.21.15.50:0/865200378 shutdown_connections 2024-06-06T03:33:03.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.344+0000 7fbf702bbb80 1 --2- 172.21.15.50:0/865200378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad7ee93880 0x55ad7ee921f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.344+0000 7fbf702bbb80 1 --2- 172.21.15.50:0/865200378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad7ee8d7a0 0x55ad7eea3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.344+0000 7fbf702bbb80 1 --2- 172.21.15.50:0/865200378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad7ee92f60 0x55ad7ee87e80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.344+0000 7fbf702bbb80 1 -- 172.21.15.50:0/865200378 >> 172.21.15.50:0/865200378 conn(0x55ad7edba080 msgr2=0x55ad7ee91ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:03.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.348+0000 7fbf702bbb80 1 -- 172.21.15.50:0/865200378 shutdown_connections 2024-06-06T03:33:03.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.348+0000 7fbf702bbb80 1 -- 172.21.15.50:0/865200378 wait complete. 2024-06-06T03:33:03.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.348+0000 7fbf702bbb80 1 -- start start 2024-06-06T03:33:03.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.349+0000 7fbf702bbb80 1 Processor -- start 2024-06-06T03:33:03.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.349+0000 7fbf702bbb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad7ee8d7a0 0x55ad7eeae670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:03.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.349+0000 7fbf702bbb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad7ee92f60 0x55ad7eeaebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:03.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.349+0000 7fbf702bbb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad7ee93880 0x55ad7eeaf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:03.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.349+0000 7fbf702bbb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c00d0d0 con 0x55ad7ee8d7a0 2024-06-06T03:33:03.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.349+0000 7fbf702bbb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c00e540 con 0x55ad7ee92f60 2024-06-06T03:33:03.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.349+0000 7fbf702bbb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c00d7a0 con 0x55ad7ee93880 2024-06-06T03:33:03.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.349+0000 7fbf702bbb80 10 client.0 _ll_register_callbacks cb 0x55ad7ed745b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:33:03.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.350+0000 7fbf5f7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad7ee93880 0x55ad7eeaf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:03.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.350+0000 7fbf5f7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad7ee93880 0x55ad7eeaf0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:37986/0 (socket says 172.21.15.50:37986) 2024-06-06T03:33:03.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.350+0000 7fbf5f7fe700 1 -- 172.21.15.50:0/3444409002 learned_addr learned my addr 172.21.15.50:0/3444409002 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:03.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.350+0000 7fbf5effd700 1 --2- 172.21.15.50:0/3444409002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad7ee8d7a0 0x55ad7eeae670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:03.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.351+0000 7fbf5f7fe700 1 -- 172.21.15.50:0/3444409002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad7ee92f60 msgr2=0x55ad7eeaebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:33:03.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.351+0000 7fbf5f7fe700 1 --2- 172.21.15.50:0/3444409002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad7ee92f60 0x55ad7eeaebb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.351+0000 7fbf5f7fe700 1 -- 172.21.15.50:0/3444409002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad7ee8d7a0 msgr2=0x55ad7eeae670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:03.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.351+0000 7fbf5f7fe700 1 --2- 172.21.15.50:0/3444409002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad7ee8d7a0 0x55ad7eeae670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.351+0000 7fbf5f7fe700 1 -- 172.21.15.50:0/3444409002 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad7ef21a20 con 0x55ad7ee93880 2024-06-06T03:33:03.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.351+0000 7fbf5f7fe700 1 --2- 172.21.15.50:0/3444409002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad7ee93880 0x55ad7eeaf0f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbf58004f50 tx=0x7fbf580099e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f887f4c56994333 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:03.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.351+0000 7fbf3effd700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:33:03.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.352+0000 7fbf3effd700 1 -- 172.21.15.50:0/3444409002 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf580a1120 con 0x55ad7ee93880 2024-06-06T03:33:03.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.352+0000 7fbf702bbb80 1 -- 172.21.15.50:0/3444409002 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf50005480 con 0x55ad7ee93880 2024-06-06T03:33:03.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.352+0000 7fbf3effd700 1 -- 172.21.15.50:0/3444409002 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fbf580b6020 con 0x55ad7ee93880 2024-06-06T03:33:03.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.352+0000 7fbf3effd700 1 -- 172.21.15.50:0/3444409002 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fbf580a12c0 con 0x55ad7ee93880 2024-06-06T03:33:03.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.352+0000 7fbf702bbb80 10 client.25987 fetch_fsmap learned FSMap version 33 2024-06-06T03:33:03.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.352+0000 7fbf702bbb80 1 -- 172.21.15.50:0/3444409002 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ad7ef22d20 con 0x55ad7ee93880 2024-06-06T03:33:03.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.355+0000 7fbf3effd700 1 -- 172.21.15.50:0/3444409002 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbf50005480 con 0x55ad7ee93880 2024-06-06T03:33:03.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.355+0000 7fbf3effd700 1 -- 172.21.15.50:0/3444409002 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fbf58011040 con 0x55ad7ee93880 2024-06-06T03:33:03.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.355+0000 7fbf702bbb80 10 client.25987 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:33:03.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.355+0000 7fbf702bbb80 10 client.25987 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:33:03.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.355+0000 7fbf702bbb80 20 client.25987 populate_metadata read hostname 'smithi050' 2024-06-06T03:33:03.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.355+0000 7fbf702bbb80 1 --2- 172.21.15.50:0/3444409002 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ad7ef23270 0x55ad7ef25690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:03.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.355+0000 7fbf702bbb80 4 client.25987 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-06T03:33:03.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.355+0000 7fbf702bbb80 1 -- 172.21.15.50:0/3444409002 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ad7edebd50 con 0x55ad7ef23270 2024-06-06T03:33:03.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.356+0000 7fbf5effd700 1 --2- 172.21.15.50:0/3444409002 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ad7ef23270 0x55ad7ef25690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:03.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.357+0000 7fbf5effd700 1 --2- 172.21.15.50:0/3444409002 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ad7ef23270 0x55ad7ef25690 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=720c04a31dda7d58 server_cookie=d4c8716493fa9f4d in_seq=0 out_seq=0 2024-06-06T03:33:03.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.357+0000 7fbf3effd700 10 client.25987 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:33:03.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.357+0000 7fbf3effd700 1 -- 172.21.15.50:0/3444409002 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55ad7edebd50 con 0x55ad7ef23270 2024-06-06T03:33:03.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.357+0000 7fbf3effd700 10 client.25987 handle_command_reply: tid=0 2024-06-06T03:33:03.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.357+0000 7fbf702bbb80 1 client.25987 shutdown 2024-06-06T03:33:03.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.357+0000 7fbf702bbb80 1 -- 172.21.15.50:0/3444409002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad7ee93880 msgr2=0x55ad7eeaf0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:03.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.357+0000 7fbf702bbb80 1 --2- 172.21.15.50:0/3444409002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad7ee93880 0x55ad7eeaf0f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbf58004f50 tx=0x7fbf580099e0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.357+0000 7fbf702bbb80 1 -- 172.21.15.50:0/3444409002 shutdown_connections 2024-06-06T03:33:03.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.357+0000 7fbf702bbb80 1 --2- 172.21.15.50:0/3444409002 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ad7ef23270 0x55ad7ef25690 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.358+0000 7fbf702bbb80 1 --2- 172.21.15.50:0/3444409002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad7ee93880 0x55ad7eeaf0f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.358+0000 7fbf702bbb80 1 --2- 172.21.15.50:0/3444409002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad7ee8d7a0 0x55ad7eeae670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.358+0000 7fbf702bbb80 1 --2- 172.21.15.50:0/3444409002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad7ee92f60 0x55ad7eeaebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.358+0000 7fbf702bbb80 1 -- 172.21.15.50:0/3444409002 >> 172.21.15.50:0/3444409002 conn(0x55ad7edba080 msgr2=0x55ad7ee92370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:03.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.358+0000 7fbf3effd700 0 client.25987 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:33:03.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.358+0000 7fbf702bbb80 1 -- 172.21.15.50:0/3444409002 shutdown_connections 2024-06-06T03:33:03.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.358+0000 7fbf702bbb80 1 -- 172.21.15.50:0/3444409002 wait complete. 2024-06-06T03:33:03.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.359+0000 7fbf702bbb80 20 client.25987 trim_cache size 0 max 16384 2024-06-06T03:33:03.365 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:33:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-06T03:33:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2024-06-06T03:33:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: "86b4c804-91e0-4449-8cff-def8c9b51667": { 2024-06-06T03:33:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2024-06-06T03:33:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "86b4c804-91e0-4449-8cff-def8c9b51667", 2024-06-06T03:33:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "recursive,force" 2024-06-06T03:33:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:33:03.366 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:33:03.366 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:33:03.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.366+0000 7fbf65a38700 1 -- 172.21.15.50:0/752589173 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbf480a2e30 msgr2=0x7fbf480a52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:03.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.366+0000 7fbf65a38700 1 --2- 172.21.15.50:0/752589173 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbf480a2e30 0x7fbf480a52f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbf54006fd0 tx=0x7fbf54008040 comp rx=0 tx=0).stop 2024-06-06T03:33:03.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.366+0000 7fbf65a38700 1 -- 172.21.15.50:0/752589173 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbf601a38f0 msgr2=0x7fbf601a3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:03.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.366+0000 7fbf65a38700 1 --2- 172.21.15.50:0/752589173 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbf601a38f0 0x7fbf601a3d70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbf58009750 tx=0x7fbf58004c80 comp rx=0 tx=0).stop 2024-06-06T03:33:03.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.367+0000 7fbf65a38700 1 -- 172.21.15.50:0/752589173 shutdown_connections 2024-06-06T03:33:03.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.367+0000 7fbf65a38700 1 --2- 172.21.15.50:0/752589173 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbf601a38f0 0x7fbf601a3d70 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.367+0000 7fbf65a38700 1 --2- 172.21.15.50:0/752589173 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbf480a2e30 0x7fbf480a52f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.367+0000 7fbf65a38700 1 --2- 172.21.15.50:0/752589173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf60100610 0x7fbf6019f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.367+0000 7fbf65a38700 1 --2- 172.21.15.50:0/752589173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf60100f30 0x7fbf6019f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:03.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.367+0000 7fbf65a38700 1 -- 172.21.15.50:0/752589173 >> 172.21.15.50:0/752589173 conn(0x7fbf60077590 msgr2=0x7fbf600ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:03.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.367+0000 7fbf65a38700 1 -- 172.21.15.50:0/752589173 shutdown_connections 2024-06-06T03:33:03.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:03.367+0000 7fbf65a38700 1 -- 172.21.15.50:0/752589173 wait complete. 2024-06-06T03:33:03.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:03 smithi079 ceph-mon[35478]: pgmap v623: 129 pgs: 129 active+clean; 10 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 36 MiB/s wr, 630 op/s 2024-06-06T03:33:03.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:03 smithi122 ceph-mon[35759]: pgmap v623: 129 pgs: 129 active+clean; 10 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 36 MiB/s wr, 630 op/s 2024-06-06T03:33:03.754 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:03 smithi050 ceph-mon[32421]: pgmap v623: 129 pgs: 129 active+clean; 10 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 36 MiB/s wr, 630 op/s 2024-06-06T03:33:05.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:05 smithi079 ceph-mon[35478]: pgmap v624: 129 pgs: 129 active+clean; 10 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 37 MiB/s wr, 649 op/s 2024-06-06T03:33:05.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:05 smithi122 ceph-mon[35759]: pgmap v624: 129 pgs: 129 active+clean; 10 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 37 MiB/s wr, 649 op/s 2024-06-06T03:33:05.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:05 smithi050 ceph-mon[32421]: pgmap v624: 129 pgs: 129 active+clean; 10 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 37 MiB/s wr, 649 op/s 2024-06-06T03:33:07.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:07 smithi079 ceph-mon[35478]: pgmap v625: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 43 MiB/s wr, 766 op/s 2024-06-06T03:33:07.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:07 smithi079 ceph-mon[35478]: scrub summary: idle 2024-06-06T03:33:07.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:07 smithi079 ceph-mon[35478]: scrub summary: idle 2024-06-06T03:33:07.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:07 smithi122 ceph-mon[35759]: pgmap v625: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 43 MiB/s wr, 766 op/s 2024-06-06T03:33:07.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:07 smithi122 ceph-mon[35759]: scrub summary: idle 2024-06-06T03:33:07.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:07 smithi122 ceph-mon[35759]: scrub summary: idle 2024-06-06T03:33:07.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:07 smithi050 ceph-mon[32421]: pgmap v625: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 43 MiB/s wr, 766 op/s 2024-06-06T03:33:07.754 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:07 smithi050 ceph-mon[32421]: scrub summary: idle 2024-06-06T03:33:07.754 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:07 smithi050 ceph-mon[32421]: scrub summary: idle 2024-06-06T03:33:08.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:08 smithi079 ceph-mon[35478]: pgmap v626: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 33 MiB/s wr, 590 op/s 2024-06-06T03:33:08.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:08 smithi122 ceph-mon[35759]: pgmap v626: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 33 MiB/s wr, 590 op/s 2024-06-06T03:33:08.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:08 smithi050 ceph-mon[32421]: pgmap v626: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 33 MiB/s wr, 590 op/s 2024-06-06T03:33:10.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:10 smithi122 ceph-mon[35759]: pgmap v627: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 42 MiB/s wr, 753 op/s 2024-06-06T03:33:11.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:10 smithi050 ceph-mon[32421]: pgmap v627: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 42 MiB/s wr, 753 op/s 2024-06-06T03:33:11.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:10 smithi079 ceph-mon[35478]: pgmap v627: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 42 MiB/s wr, 753 op/s 2024-06-06T03:33:12.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:12 smithi122 ceph-mon[35759]: pgmap v628: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 31 MiB/s wr, 558 op/s 2024-06-06T03:33:13.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:12 smithi050 ceph-mon[32421]: pgmap v628: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 31 MiB/s wr, 558 op/s 2024-06-06T03:33:13.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:12 smithi079 ceph-mon[35478]: pgmap v628: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 31 MiB/s wr, 558 op/s 2024-06-06T03:33:14.638 INFO:tasks.cephfs.filesystem:scrub status for tag:86b4c804-91e0-4449-8cff-def8c9b51667 - {'path': '/', 'tag': '86b4c804-91e0-4449-8cff-def8c9b51667', 'options': 'recursive,force'} 2024-06-06T03:33:14.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:14 smithi122 ceph-mon[35759]: pgmap v629: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 31 MiB/s wr, 564 op/s 2024-06-06T03:33:15.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:14 smithi050 ceph-mon[32421]: pgmap v629: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 31 MiB/s wr, 564 op/s 2024-06-06T03:33:15.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:14 smithi079 ceph-mon[35478]: pgmap v629: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 31 MiB/s wr, 564 op/s 2024-06-06T03:33:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.968+0000 7f2991dca640 1 -- 172.21.15.50:0/3890061159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f298c10ded0 msgr2=0x7f298c110390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.968+0000 7f2991dca640 1 --2- 172.21.15.50:0/3890061159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f298c10ded0 0x7f298c110390 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2978009860 tx=0x7f297802a380 comp rx=0 tx=0).stop 2024-06-06T03:33:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.968+0000 7f2991dca640 1 -- 172.21.15.50:0/3890061159 shutdown_connections 2024-06-06T03:33:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.968+0000 7f2991dca640 1 --2- 172.21.15.50:0/3890061159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f298c10ded0 0x7f298c110390 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.968+0000 7f2991dca640 1 --2- 172.21.15.50:0/3890061159 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f298c10b3f0 0x7f298c10d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:15.970 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.968+0000 7f2991dca640 1 --2- 172.21.15.50:0/3890061159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f298c108a30 0x7f298c10ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:15.970 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.968+0000 7f2991dca640 1 -- 172.21.15.50:0/3890061159 >> 172.21.15.50:0/3890061159 conn(0x7f298c06ea00 msgr2=0x7f298c070e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:15.970 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.969+0000 7f2991dca640 1 -- 172.21.15.50:0/3890061159 shutdown_connections 2024-06-06T03:33:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.969+0000 7f2991dca640 1 -- 172.21.15.50:0/3890061159 wait complete. 2024-06-06T03:33:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.970+0000 7f2991dca640 1 Processor -- start 2024-06-06T03:33:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.970+0000 7f2991dca640 1 -- start start 2024-06-06T03:33:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.970+0000 7f2991dca640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f298c108a30 0x7f298c19f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.970+0000 7f2991dca640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f298c10b3f0 0x7f298c19dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.970+0000 7f2991dca640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f298c10ded0 0x7f298c19e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.970+0000 7f2991dca640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f298c1139c0 con 0x7f298c10b3f0 2024-06-06T03:33:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.970+0000 7f2991dca640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f298c113840 con 0x7f298c108a30 2024-06-06T03:33:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.970+0000 7f2991dca640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f298c113b40 con 0x7f298c10ded0 2024-06-06T03:33:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.971+0000 7f2990dc8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f298c108a30 0x7f298c19f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.971+0000 7f2990dc8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f298c108a30 0x7f298c19f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:59982/0 (socket says 172.21.15.50:59982) 2024-06-06T03:33:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.971+0000 7f29915c9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f298c10ded0 0x7f298c19e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:15.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.971+0000 7f29915c9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f298c10ded0 0x7f298c19e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:34346/0 (socket says 172.21.15.50:34346) 2024-06-06T03:33:15.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.971+0000 7f29915c9640 1 -- 172.21.15.50:0/1870345413 learned_addr learned my addr 172.21.15.50:0/1870345413 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:15.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.971+0000 7f29915c9640 1 -- 172.21.15.50:0/1870345413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f298c108a30 msgr2=0x7f298c19f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:15.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.971+0000 7f29915c9640 1 --2- 172.21.15.50:0/1870345413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f298c108a30 0x7f298c19f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:15.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.971+0000 7f29915c9640 1 -- 172.21.15.50:0/1870345413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f298c10b3f0 msgr2=0x7f298c19dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:15.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.971+0000 7f29915c9640 1 --2- 172.21.15.50:0/1870345413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f298c10b3f0 0x7f298c19dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:15.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.971+0000 7f29915c9640 1 -- 172.21.15.50:0/1870345413 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f298c1a4330 con 0x7f298c10ded0 2024-06-06T03:33:15.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.972+0000 7f29915c9640 1 --2- 172.21.15.50:0/1870345413 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f298c10ded0 0x7f298c19e420 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2978035040 tx=0x7f2978033e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:15.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.976+0000 7f2989ffb640 1 -- 172.21.15.50:0/1870345413 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297803f030 con 0x7f298c10ded0 2024-06-06T03:33:15.976 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.976+0000 7f2989ffb640 1 -- 172.21.15.50:0/1870345413 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2978004020 con 0x7f298c10ded0 2024-06-06T03:33:15.977 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.977+0000 7f2989ffb640 1 -- 172.21.15.50:0/1870345413 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2978037040 con 0x7f298c10ded0 2024-06-06T03:33:15.980 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.980+0000 7f2991dca640 1 -- 172.21.15.50:0/1870345413 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f298c1a45c0 con 0x7f298c10ded0 2024-06-06T03:33:15.980 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.980+0000 7f2991dca640 1 -- 172.21.15.50:0/1870345413 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f298c1a4a30 con 0x7f298c10ded0 2024-06-06T03:33:15.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.984+0000 7f2995e0f740 1 Processor -- start 2024-06-06T03:33:15.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.986+0000 7f2995e0f740 1 -- start start 2024-06-06T03:33:15.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.986+0000 7f2995e0f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f330a201e0 0x55f330a20600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:15.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.986+0000 7f2995e0f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f330a20bd0 0x55f330a256d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.986+0000 7f2995e0f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f330a25d40 0x55f330a281d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.986+0000 7f2995e0f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f3309834f0 con 0x55f330a201e0 2024-06-06T03:33:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.986+0000 7f2995e0f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f330921870 con 0x55f330a20bd0 2024-06-06T03:33:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.986+0000 7f2995e0f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f33097f4b0 con 0x55f330a25d40 2024-06-06T03:33:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.989+0000 7f298bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f330a25d40 0x55f330a281d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.989+0000 7f298bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f330a201e0 0x55f330a20600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.989+0000 7f298bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f330a201e0 0x55f330a20600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40784/0 (socket says 172.21.15.50:40784) 2024-06-06T03:33:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.989+0000 7f298bfff640 1 -- 172.21.15.50:0/1878627806 learned_addr learned my addr 172.21.15.50:0/1878627806 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.989+0000 7f2990dc8640 1 --2- 172.21.15.50:0/1878627806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f330a20bd0 0x55f330a256d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.990+0000 7f2989ffb640 1 -- 172.21.15.50:0/1870345413 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2978042070 con 0x7f298c10ded0 2024-06-06T03:33:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.991+0000 7f2989ffb640 1 --2- 172.21.15.50:0/1870345413 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f29700a2c00 0x7f29700a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.991+0000 7f298bfff640 1 -- 172.21.15.50:0/1878627806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f330a20bd0 msgr2=0x55f330a256d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.991+0000 7f298bfff640 1 --2- 172.21.15.50:0/1878627806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f330a20bd0 0x55f330a256d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.991+0000 7f298bfff640 1 -- 172.21.15.50:0/1878627806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f330a201e0 msgr2=0x55f330a20600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.991+0000 7f298bfff640 1 --2- 172.21.15.50:0/1878627806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f330a201e0 0x55f330a20600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.991+0000 7f298bfff640 1 -- 172.21.15.50:0/1878627806 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f33093d9b0 con 0x55f330a25d40 2024-06-06T03:33:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.991+0000 7f2989ffb640 1 -- 172.21.15.50:0/1870345413 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f29780ee800 con 0x7f298c10ded0 2024-06-06T03:33:15.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.994+0000 7f29915c9640 1 --2- 172.21.15.50:0/1870345413 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f29700a2c00 0x7f29700a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:15.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.994+0000 7f298bfff640 1 --2- 172.21.15.50:0/1878627806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f330a25d40 0x55f330a281d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f29840095a0 tx=0x7f2984005da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d46138c92438fe9 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:15.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.997+0000 7f2982ffd640 1 -- 172.21.15.50:0/1878627806 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f298401d070 con 0x55f330a25d40 2024-06-06T03:33:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.997+0000 7f29915c9640 1 --2- 172.21.15.50:0/1870345413 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f29700a2c00 0x7f29700a50c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f29780c3440 tx=0x7f2978005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.997+0000 7f2982ffd640 1 -- 172.21.15.50:0/1878627806 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2984014b30 con 0x55f330a25d40 2024-06-06T03:33:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.998+0000 7f2995e0f740 1 -- 172.21.15.50:0/1878627806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f330a25d40 msgr2=0x55f330a281d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:15.998+0000 7f2995e0f740 1 --2- 172.21.15.50:0/1878627806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f330a25d40 0x55f330a281d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f29840095a0 tx=0x7f2984005da0 comp rx=0 tx=0).stop 2024-06-06T03:33:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.000+0000 7f2995e0f740 1 -- 172.21.15.50:0/1878627806 shutdown_connections 2024-06-06T03:33:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.000+0000 7f2995e0f740 1 --2- 172.21.15.50:0/1878627806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f330a25d40 0x55f330a281d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.000+0000 7f2995e0f740 1 --2- 172.21.15.50:0/1878627806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f330a20bd0 0x55f330a256d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.000+0000 7f2995e0f740 1 --2- 172.21.15.50:0/1878627806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f330a201e0 0x55f330a20600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.000+0000 7f2995e0f740 1 -- 172.21.15.50:0/1878627806 >> 172.21.15.50:0/1878627806 conn(0x55f330a1b850 msgr2=0x55f330a1bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:16.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.004+0000 7f2995e0f740 1 -- 172.21.15.50:0/1878627806 shutdown_connections 2024-06-06T03:33:16.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.006+0000 7f2995e0f740 1 -- 172.21.15.50:0/1878627806 wait complete. 2024-06-06T03:33:16.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.007+0000 7f2995e0f740 1 -- start start 2024-06-06T03:33:16.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.007+0000 7f2995e0f740 1 Processor -- start 2024-06-06T03:33:16.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.008+0000 7f2995e0f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f330a201e0 0x55f330a2a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:16.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.008+0000 7f2995e0f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f330a20bd0 0x55f330a2a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.008+0000 7f2995e0f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f330a25d40 0x55f330a31a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.008+0000 7f2995e0f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f330a28d40 con 0x55f330a25d40 2024-06-06T03:33:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.008+0000 7f2995e0f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f33090cae0 con 0x55f330a20bd0 2024-06-06T03:33:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.008+0000 7f2995e0f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f330a28ec0 con 0x55f330a201e0 2024-06-06T03:33:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.008+0000 7f2995e0f740 10 client.0 _ll_register_callbacks cb 0x55f3309459b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:33:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.009+0000 7f298bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f330a201e0 0x55f330a2a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.011+0000 7f298bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f330a201e0 0x55f330a2a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:34376/0 (socket says 172.21.15.50:34376) 2024-06-06T03:33:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.011+0000 7f298bfff640 1 -- 172.21.15.50:0/2273549248 learned_addr learned my addr 172.21.15.50:0/2273549248 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.011+0000 7f2990dc8640 1 --2- 172.21.15.50:0/2273549248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f330a20bd0 0x55f330a2a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.011+0000 7f298bfff640 1 -- 172.21.15.50:0/2273549248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f330a20bd0 msgr2=0x55f330a2a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.011+0000 7f298bfff640 1 --2- 172.21.15.50:0/2273549248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f330a20bd0 0x55f330a2a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.011+0000 7f298bfff640 1 -- 172.21.15.50:0/2273549248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f330a25d40 msgr2=0x55f330a31a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.011+0000 7f298bfff640 1 --2- 172.21.15.50:0/2273549248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f330a25d40 0x55f330a31a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:16.013 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.011+0000 7f298bfff640 1 -- 172.21.15.50:0/2273549248 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f330697210 con 0x55f330a201e0 2024-06-06T03:33:16.013 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.012+0000 7f298bfff640 1 --2- 172.21.15.50:0/2273549248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f330a201e0 0x55f330a2a490 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2984005e30 tx=0x7f29840021d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1624cf3a3caf2ec7 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:16.013 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.012+0000 7f296ffff640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:33:16.013 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.012+0000 7f296ffff640 1 -- 172.21.15.50:0/2273549248 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2984028020 con 0x55f330a201e0 2024-06-06T03:33:16.013 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.013+0000 7f2995e0f740 1 -- 172.21.15.50:0/2273549248 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2984014b30 con 0x55f330a201e0 2024-06-06T03:33:16.015 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.013+0000 7f296ffff640 1 -- 172.21.15.50:0/2273549248 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f2984014540 con 0x55f330a201e0 2024-06-06T03:33:16.016 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.013+0000 7f296ffff640 1 -- 172.21.15.50:0/2273549248 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f2984033050 con 0x55f330a201e0 2024-06-06T03:33:16.016 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.016+0000 7f2995e0f740 10 client.25999 fetch_fsmap learned FSMap version 33 2024-06-06T03:33:16.016 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.016+0000 7f2995e0f740 1 -- 172.21.15.50:0/2273549248 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55f330763620 con 0x55f330a201e0 2024-06-06T03:33:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.018+0000 7f296ffff640 1 -- 172.21.15.50:0/2273549248 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2984014b30 con 0x55f330a201e0 2024-06-06T03:33:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.018+0000 7f296ffff640 1 -- 172.21.15.50:0/2273549248 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f2984023070 con 0x55f330a201e0 2024-06-06T03:33:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.019+0000 7f2995e0f740 10 client.25999 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:33:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.019+0000 7f2995e0f740 10 client.25999 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:33:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.019+0000 7f2995e0f740 20 client.25999 populate_metadata read hostname 'smithi050' 2024-06-06T03:33:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.019+0000 7f2995e0f740 1 --2- 172.21.15.50:0/2273549248 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55f330a36000 0x55f330a383f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:16.020 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.019+0000 7f2995e0f740 4 client.25999 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:33:16.020 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.019+0000 7f2995e0f740 1 -- 172.21.15.50:0/2273549248 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f330996f10 con 0x55f330a36000 2024-06-06T03:33:16.025 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.025+0000 7f2990dc8640 1 --2- 172.21.15.50:0/2273549248 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55f330a36000 0x55f330a383f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:16.030 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.029+0000 7f2990dc8640 1 --2- 172.21.15.50:0/2273549248 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55f330a36000 0x55f330a383f0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6c4a561557b294a server_cookie=36aa41d8ecece2f in_seq=0 out_seq=0 2024-06-06T03:33:16.032 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.032+0000 7f296ffff640 10 client.25999 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:33:16.032 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.032+0000 7f296ffff640 1 -- 172.21.15.50:0/2273549248 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55f330996f10 con 0x55f330a36000 2024-06-06T03:33:16.032 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.032+0000 7f296ffff640 10 client.25999 handle_command_reply: tid=0 2024-06-06T03:33:16.032 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.032+0000 7f2995e0f740 1 client.25999 shutdown 2024-06-06T03:33:16.032 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.032+0000 7f2995e0f740 1 -- 172.21.15.50:0/2273549248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f330a201e0 msgr2=0x55f330a2a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:16.032 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.032+0000 7f2995e0f740 1 --2- 172.21.15.50:0/2273549248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f330a201e0 0x55f330a2a490 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2984005e30 tx=0x7f29840021d0 comp rx=0 tx=0).stop 2024-06-06T03:33:16.032 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.032+0000 7f2995e0f740 1 -- 172.21.15.50:0/2273549248 shutdown_connections 2024-06-06T03:33:16.033 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.032+0000 7f2995e0f740 1 --2- 172.21.15.50:0/2273549248 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55f330a36000 0x55f330a383f0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:16.033 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.032+0000 7f2995e0f740 1 --2- 172.21.15.50:0/2273549248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f330a25d40 0x55f330a31a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:16.033 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.032+0000 7f2995e0f740 1 --2- 172.21.15.50:0/2273549248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f330a20bd0 0x55f330a2a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:16.033 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.032+0000 7f2995e0f740 1 --2- 172.21.15.50:0/2273549248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f330a201e0 0x55f330a2a490 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:16.033 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.032+0000 7f2995e0f740 1 -- 172.21.15.50:0/2273549248 >> 172.21.15.50:0/2273549248 conn(0x55f330a1b850 msgr2=0x55f330a1a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:16.033 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.032+0000 7f296ffff640 0 client.25999 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:33:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.036+0000 7f2995e0f740 1 -- 172.21.15.50:0/2273549248 shutdown_connections 2024-06-06T03:33:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.037+0000 7f2995e0f740 1 -- 172.21.15.50:0/2273549248 wait complete. 2024-06-06T03:33:16.037 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.037+0000 7f2995e0f740 20 client.25999 trim_cache size 0 max 16384 2024-06-06T03:33:16.078 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.078+0000 7f2995e0f740 1 Processor -- start 2024-06-06T03:33:16.079 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.080+0000 7f2995e0f740 1 -- start start 2024-06-06T03:33:16.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.080+0000 7f2995e0f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f330a201e0 0x55f330a25410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:16.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.081+0000 7f298bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f330a201e0 0x55f330a25410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.081+0000 7f2995e0f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f330a20bd0 0x55f330a319a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.081+0000 7f2995e0f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f330a25d40 0x55f330a1e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.081+0000 7f2995e0f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f298c1c3c10 con 0x55f330a20bd0 2024-06-06T03:33:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.081+0000 7f2995e0f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f298c1c42e0 con 0x55f330a25d40 2024-06-06T03:33:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.081+0000 7f2995e0f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f298c1c1bb0 con 0x55f330a201e0 2024-06-06T03:33:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.083+0000 7f2990dc8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f330a20bd0 0x55f330a319a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.083+0000 7f2990dc8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f330a20bd0 0x55f330a319a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40800/0 (socket says 172.21.15.50:40800) 2024-06-06T03:33:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.083+0000 7f2990dc8640 1 -- 172.21.15.50:0/1609876074 learned_addr learned my addr 172.21.15.50:0/1609876074 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.083+0000 7f298bfff640 1 --2- 172.21.15.50:0/1609876074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f330a25d40 0x55f330a1e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.083+0000 7f298bfff640 1 -- 172.21.15.50:0/1609876074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f330a25d40 msgr2=0x55f330a1e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.083+0000 7f298bfff640 1 --2- 172.21.15.50:0/1609876074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f330a25d40 0x55f330a1e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.083+0000 7f298bfff640 1 -- 172.21.15.50:0/1609876074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f330a20bd0 msgr2=0x55f330a319a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.083+0000 7f298bfff640 1 --2- 172.21.15.50:0/1609876074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f330a20bd0 0x55f330a319a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:16.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.083+0000 7f298bfff640 1 -- 172.21.15.50:0/1609876074 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f330a1b680 con 0x55f330a201e0 2024-06-06T03:33:16.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.084+0000 7f298bfff640 1 --2- 172.21.15.50:0/1609876074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f330a201e0 0x55f330a25410 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2984006010 tx=0x7f2984018e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f97560f82c91035a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:16.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.085+0000 7f29827fc640 1 -- 172.21.15.50:0/1609876074 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2984028040 con 0x55f330a201e0 2024-06-06T03:33:16.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.085+0000 7f29827fc640 1 -- 172.21.15.50:0/1609876074 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f298400adf0 con 0x55f330a201e0 2024-06-06T03:33:16.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.086+0000 7f2995e0f740 1 -- 172.21.15.50:0/1609876074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f330a201e0 msgr2=0x55f330a25410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:16.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.086+0000 7f2995e0f740 1 --2- 172.21.15.50:0/1609876074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f330a201e0 0x55f330a25410 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2984006010 tx=0x7f2984018e60 comp rx=0 tx=0).stop 2024-06-06T03:33:16.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.091+0000 7f2995e0f740 1 -- 172.21.15.50:0/1609876074 shutdown_connections 2024-06-06T03:33:16.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.091+0000 7f2995e0f740 1 --2- 172.21.15.50:0/1609876074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f330a20bd0 0x55f330a319a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:16.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.091+0000 7f2995e0f740 1 --2- 172.21.15.50:0/1609876074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f330a25d40 0x55f330a1e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:16.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.091+0000 7f2995e0f740 1 --2- 172.21.15.50:0/1609876074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f330a201e0 0x55f330a25410 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:16.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.091+0000 7f2995e0f740 1 -- 172.21.15.50:0/1609876074 >> 172.21.15.50:0/1609876074 conn(0x55f330a1b850 msgr2=0x55f330a1bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:16.093 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.093+0000 7f2995e0f740 1 -- 172.21.15.50:0/1609876074 shutdown_connections 2024-06-06T03:33:16.093 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.093+0000 7f2995e0f740 1 -- 172.21.15.50:0/1609876074 wait complete. 2024-06-06T03:33:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.094+0000 7f2995e0f740 1 -- start start 2024-06-06T03:33:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.095+0000 7f2995e0f740 1 Processor -- start 2024-06-06T03:33:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.095+0000 7f2995e0f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f330a201e0 0x55f330a316a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.095+0000 7f2995e0f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f330a20bd0 0x55f330a2e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.095+0000 7f2995e0f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f330a25d40 0x55f330a2e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.096+0000 7f2995e0f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f298c1c0070 con 0x55f330a20bd0 2024-06-06T03:33:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.096+0000 7f2995e0f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f298c1c14e0 con 0x55f330a201e0 2024-06-06T03:33:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.096+0000 7f298bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f330a201e0 0x55f330a316a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.096+0000 7f298bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f330a201e0 0x55f330a316a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:60038/0 (socket says 172.21.15.50:60038) 2024-06-06T03:33:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.096+0000 7f298bfff640 1 -- 172.21.15.50:0/2281030470 learned_addr learned my addr 172.21.15.50:0/2281030470 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.096+0000 7f2995e0f740 1 -- 172.21.15.50:0/2281030470 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f298c1c0740 con 0x55f330a25d40 2024-06-06T03:33:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.096+0000 7f2995e0f740 10 client.0 _ll_register_callbacks cb 0x7f298401b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:33:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.096+0000 7f298bfff640 1 --2- 172.21.15.50:0/2281030470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f330a25d40 0x55f330a2e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.096+0000 7f298bfff640 1 -- 172.21.15.50:0/2281030470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f330a25d40 msgr2=0x55f330a2e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.096+0000 7f298bfff640 1 --2- 172.21.15.50:0/2281030470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f330a25d40 0x55f330a2e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.096+0000 7f298bfff640 1 -- 172.21.15.50:0/2281030470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f330a20bd0 msgr2=0x55f330a2e140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:33:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.096+0000 7f298bfff640 1 --2- 172.21.15.50:0/2281030470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f330a20bd0 0x55f330a2e140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.096+0000 7f298bfff640 1 -- 172.21.15.50:0/2281030470 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f330a2ec40 con 0x55f330a201e0 2024-06-06T03:33:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.097+0000 7f298bfff640 1 --2- 172.21.15.50:0/2281030470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f330a201e0 0x55f330a316a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f298402f7e0 tx=0x7f2984005c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a515d292e3128c5f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.097+0000 7f296ffff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:33:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.104+0000 7f296ffff640 1 -- 172.21.15.50:0/2281030470 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2984028070 con 0x55f330a201e0 2024-06-06T03:33:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.104+0000 7f296ffff640 1 -- 172.21.15.50:0/2281030470 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f298401e040 con 0x55f330a201e0 2024-06-06T03:33:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.104+0000 7f2995e0f740 1 -- 172.21.15.50:0/2281030470 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f298400adf0 con 0x55f330a201e0 2024-06-06T03:33:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.108+0000 7f296ffff640 1 -- 172.21.15.50:0/2281030470 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f2984004b20 con 0x55f330a201e0 2024-06-06T03:33:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.111+0000 7f2995e0f740 10 client.26012 fetch_fsmap learned FSMap version 33 2024-06-06T03:33:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.111+0000 7f2995e0f740 1 -- 172.21.15.50:0/2281030470 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55f330a9fcf0 con 0x55f330a201e0 2024-06-06T03:33:16.112 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.112+0000 7f296ffff640 1 -- 172.21.15.50:0/2281030470 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f298400adf0 con 0x55f330a201e0 2024-06-06T03:33:16.112 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.112+0000 7f296ffff640 1 -- 172.21.15.50:0/2281030470 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f2984023040 con 0x55f330a201e0 2024-06-06T03:33:16.114 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.113+0000 7f2995e0f740 10 client.26012 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:33:16.114 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.113+0000 7f2995e0f740 10 client.26012 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:33:16.114 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.113+0000 7f2995e0f740 20 client.26012 populate_metadata read hostname 'smithi050' 2024-06-06T03:33:16.114 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.114+0000 7f2995e0f740 1 --2- 172.21.15.50:0/2281030470 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55f330aa04e0 0x55f330aa2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:16.114 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.114+0000 7f2995e0f740 4 client.26012 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:33:16.114 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.114+0000 7f2995e0f740 1 -- 172.21.15.50:0/2281030470 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f330990c20 con 0x55f330aa04e0 2024-06-06T03:33:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.116+0000 7f2990dc8640 1 --2- 172.21.15.50:0/2281030470 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55f330aa04e0 0x55f330aa2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:16.117 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.117+0000 7f2990dc8640 1 --2- 172.21.15.50:0/2281030470 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55f330aa04e0 0x55f330aa2900 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7456e7f41a09ca9 server_cookie=dfb027914d2e5a7f in_seq=0 out_seq=0 2024-06-06T03:33:16.117 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.117+0000 7f296ffff640 10 client.26012 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:33:16.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.128+0000 7f296ffff640 1 -- 172.21.15.50:0/2281030470 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55f330990c20 con 0x55f330aa04e0 2024-06-06T03:33:16.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.128+0000 7f296ffff640 10 client.26012 handle_command_reply: tid=0 2024-06-06T03:33:16.129 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.129+0000 7f2995e0f740 1 client.26012 shutdown 2024-06-06T03:33:16.129 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.129+0000 7f2995e0f740 1 -- 172.21.15.50:0/2281030470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f330a201e0 msgr2=0x55f330a316a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:16.129 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.130+0000 7f2995e0f740 1 --2- 172.21.15.50:0/2281030470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f330a201e0 0x55f330a316a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f298402f7e0 tx=0x7f2984005c80 comp rx=0 tx=0).stop 2024-06-06T03:33:16.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.131+0000 7f2995e0f740 1 -- 172.21.15.50:0/2281030470 shutdown_connections 2024-06-06T03:33:16.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.131+0000 7f2995e0f740 1 --2- 172.21.15.50:0/2281030470 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55f330aa04e0 0x55f330aa2900 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:16.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.131+0000 7f2995e0f740 1 --2- 172.21.15.50:0/2281030470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f330a20bd0 0x55f330a2e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:16.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.131+0000 7f2995e0f740 1 --2- 172.21.15.50:0/2281030470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f330a25d40 0x55f330a2e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:16.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.131+0000 7f2995e0f740 1 --2- 172.21.15.50:0/2281030470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f330a201e0 0x55f330a316a0 secure :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f298402f7e0 tx=0x7f2984005c80 comp rx=0 tx=0).stop 2024-06-06T03:33:16.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.131+0000 7f2995e0f740 1 -- 172.21.15.50:0/2281030470 >> 172.21.15.50:0/2281030470 conn(0x55f330a1b850 msgr2=0x55f330a21db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:16.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.131+0000 7f296ffff640 0 client.26012 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:33:16.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.131+0000 7f2995e0f740 1 -- 172.21.15.50:0/2281030470 shutdown_connections 2024-06-06T03:33:16.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.131+0000 7f2995e0f740 1 -- 172.21.15.50:0/2281030470 wait complete. 2024-06-06T03:33:16.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.132+0000 7f2995e0f740 20 client.26012 trim_cache size 0 max 16384 2024-06-06T03:33:16.135 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:33:16.135 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:33:16.135 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:33:16.137 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.136+0000 7f2991dca640 1 -- 172.21.15.50:0/1870345413 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f29700a2c00 msgr2=0x7f29700a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:16.137 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.136+0000 7f2991dca640 1 --2- 172.21.15.50:0/1870345413 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f29700a2c00 0x7f29700a50c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f29780c3440 tx=0x7f2978005f90 comp rx=0 tx=0).stop 2024-06-06T03:33:16.137 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.136+0000 7f2991dca640 1 -- 172.21.15.50:0/1870345413 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f298c10ded0 msgr2=0x7f298c19e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:16.137 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.136+0000 7f2991dca640 1 --2- 172.21.15.50:0/1870345413 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f298c10ded0 0x7f298c19e420 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2978035040 tx=0x7f2978033e00 comp rx=0 tx=0).stop 2024-06-06T03:33:16.137 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.137+0000 7f2991dca640 1 -- 172.21.15.50:0/1870345413 shutdown_connections 2024-06-06T03:33:16.138 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.137+0000 7f2991dca640 1 --2- 172.21.15.50:0/1870345413 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f29700a2c00 0x7f29700a50c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:16.138 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.137+0000 7f2991dca640 1 --2- 172.21.15.50:0/1870345413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f298c10b3f0 0x7f298c19dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:16.138 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.137+0000 7f2991dca640 1 --2- 172.21.15.50:0/1870345413 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f298c10ded0 0x7f298c19e420 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:16.138 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.137+0000 7f2991dca640 1 --2- 172.21.15.50:0/1870345413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f298c108a30 0x7f298c19f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:16.138 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.137+0000 7f2991dca640 1 -- 172.21.15.50:0/1870345413 >> 172.21.15.50:0/1870345413 conn(0x7f298c06ea00 msgr2=0x7f298c109570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:16.138 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.137+0000 7f2991dca640 1 -- 172.21.15.50:0/1870345413 shutdown_connections 2024-06-06T03:33:16.138 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:16.138+0000 7f2991dca640 1 -- 172.21.15.50:0/1870345413 wait complete. 2024-06-06T03:33:16.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:16 smithi122 ceph-mon[35759]: pgmap v630: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 35 MiB/s wr, 633 op/s 2024-06-06T03:33:17.003 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:16 smithi050 ceph-mon[32421]: pgmap v630: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 35 MiB/s wr, 633 op/s 2024-06-06T03:33:17.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:16 smithi079 ceph-mon[35478]: pgmap v630: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 35 MiB/s wr, 633 op/s 2024-06-06T03:33:18.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:18 smithi122 ceph-mon[35759]: pgmap v631: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 26 MiB/s wr, 468 op/s 2024-06-06T03:33:19.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:18 smithi050 ceph-mon[32421]: pgmap v631: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 26 MiB/s wr, 468 op/s 2024-06-06T03:33:19.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:18 smithi079 ceph-mon[35478]: pgmap v631: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 26 MiB/s wr, 468 op/s 2024-06-06T03:33:20.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:20 smithi122 ceph-mon[35759]: pgmap v632: 129 pgs: 129 active+clean; 10 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 37 MiB/s wr, 675 op/s 2024-06-06T03:33:21.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:20 smithi050 ceph-mon[32421]: pgmap v632: 129 pgs: 129 active+clean; 10 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 37 MiB/s wr, 675 op/s 2024-06-06T03:33:21.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:20 smithi079 ceph-mon[35478]: pgmap v632: 129 pgs: 129 active+clean; 10 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 37 MiB/s wr, 675 op/s 2024-06-06T03:33:22.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:22 smithi122 ceph-mon[35759]: pgmap v633: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 30 MiB/s wr, 540 op/s 2024-06-06T03:33:23.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:22 smithi050 ceph-mon[32421]: pgmap v633: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 30 MiB/s wr, 540 op/s 2024-06-06T03:33:23.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:22 smithi079 ceph-mon[35478]: pgmap v633: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 30 MiB/s wr, 540 op/s 2024-06-06T03:33:24.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:24 smithi122 ceph-mon[35759]: pgmap v634: 129 pgs: 129 active+clean; 10 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 31 MiB/s wr, 571 op/s 2024-06-06T03:33:25.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:24 smithi050 ceph-mon[32421]: pgmap v634: 129 pgs: 129 active+clean; 10 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 31 MiB/s wr, 571 op/s 2024-06-06T03:33:25.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:24 smithi079 ceph-mon[35478]: pgmap v634: 129 pgs: 129 active+clean; 10 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 31 MiB/s wr, 571 op/s 2024-06-06T03:33:25.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:25 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:33:25.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:25 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:33:26.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:25 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:33:26.680 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:26 smithi050 ceph-mon[32421]: pgmap v635: 129 pgs: 129 active+clean; 10 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 39 MiB/s wr, 710 op/s 2024-06-06T03:33:26.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:26 smithi122 ceph-mon[35759]: pgmap v635: 129 pgs: 129 active+clean; 10 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 39 MiB/s wr, 710 op/s 2024-06-06T03:33:27.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:26 smithi079 ceph-mon[35478]: pgmap v635: 129 pgs: 129 active+clean; 10 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 39 MiB/s wr, 710 op/s 2024-06-06T03:33:28.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:27 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:33:28.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:27 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:33:28.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:27 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:33:28.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:27 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:33:28.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:27 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:33:28.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:27 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:33:28.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:27 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:33:28.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:27 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:33:28.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:27 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:33:29.345 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.342+0000 7fce4b3a5640 1 -- 172.21.15.50:0/1885892078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce4410b310 msgr2=0x7fce4410d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:29.345 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.342+0000 7fce4b3a5640 1 --2- 172.21.15.50:0/1885892078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce4410b310 0x7fce4410d780 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fce3c009860 tx=0x7fce3c02a360 comp rx=0 tx=0).stop 2024-06-06T03:33:29.346 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.345+0000 7fce4b3a5640 1 -- 172.21.15.50:0/1885892078 shutdown_connections 2024-06-06T03:33:29.346 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.345+0000 7fce4b3a5640 1 --2- 172.21.15.50:0/1885892078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce4410b310 0x7fce4410d780 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.346 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.345+0000 7fce4b3a5640 1 --2- 172.21.15.50:0/1885892078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce4410dcc0 0x7fce4410e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.346 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.345+0000 7fce4b3a5640 1 --2- 172.21.15.50:0/1885892078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce441089a0 0x7fce4410add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.346 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.345+0000 7fce4b3a5640 1 -- 172.21.15.50:0/1885892078 >> 172.21.15.50:0/1885892078 conn(0x7fce4406ea10 msgr2=0x7fce44070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:29.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.348+0000 7fce4b3a5640 1 -- 172.21.15.50:0/1885892078 shutdown_connections 2024-06-06T03:33:29.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:29 smithi079 ceph-mon[35478]: pgmap v636: 129 pgs: 129 active+clean; 10 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 33 MiB/s wr, 595 op/s 2024-06-06T03:33:29.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.348+0000 7fce4b3a5640 1 -- 172.21.15.50:0/1885892078 wait complete. 2024-06-06T03:33:29.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.349+0000 7fce4b3a5640 1 Processor -- start 2024-06-06T03:33:29.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.349+0000 7fce4b3a5640 1 -- start start 2024-06-06T03:33:29.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.350+0000 7fce4b3a5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce441089a0 0x7fce4419e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:29.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.350+0000 7fce4b3a5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce4410b310 0x7fce4419e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:29.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.350+0000 7fce4b3a5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce4410dcc0 0x7fce441a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:29.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.350+0000 7fce4b3a5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fce44111bb0 con 0x7fce441089a0 2024-06-06T03:33:29.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.350+0000 7fce4b3a5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fce44111a30 con 0x7fce4410b310 2024-06-06T03:33:29.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.350+0000 7fce4b3a5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fce44111d30 con 0x7fce4410dcc0 2024-06-06T03:33:29.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.350+0000 7fce49141640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce441089a0 0x7fce4419e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:29.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.350+0000 7fce49141640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce441089a0 0x7fce4419e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47050/0 (socket says 172.21.15.50:47050) 2024-06-06T03:33:29.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.350+0000 7fce49141640 1 -- 172.21.15.50:0/3674430623 learned_addr learned my addr 172.21.15.50:0/3674430623 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:29.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.351+0000 7fce49141640 1 -- 172.21.15.50:0/3674430623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce4410dcc0 msgr2=0x7fce441a57f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-06T03:33:29.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.351+0000 7fce49141640 1 --2- 172.21.15.50:0/3674430623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce4410dcc0 0x7fce441a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.351+0000 7fce48940640 1 --2- 172.21.15.50:0/3674430623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce4410b310 0x7fce4419e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:29.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.351+0000 7fce49141640 1 -- 172.21.15.50:0/3674430623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce4410b310 msgr2=0x7fce4419e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:29.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.351+0000 7fce49141640 1 --2- 172.21.15.50:0/3674430623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce4410b310 0x7fce4419e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.351+0000 7fce49141640 1 -- 172.21.15.50:0/3674430623 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce441a5e60 con 0x7fce441089a0 2024-06-06T03:33:29.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.351+0000 7fce49141640 1 --2- 172.21.15.50:0/3674430623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce441089a0 0x7fce4419e240 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fce3000b450 tx=0x7fce3000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:29.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.352+0000 7fce427fc640 1 -- 172.21.15.50:0/3674430623 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce30015020 con 0x7fce441089a0 2024-06-06T03:33:29.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.352+0000 7fce4b3a5640 1 -- 172.21.15.50:0/3674430623 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce441a6150 con 0x7fce441089a0 2024-06-06T03:33:29.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.352+0000 7fce4b3a5640 1 -- 172.21.15.50:0/3674430623 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce441a66a0 con 0x7fce441089a0 2024-06-06T03:33:29.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.353+0000 7fce427fc640 1 -- 172.21.15.50:0/3674430623 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fce30011d40 con 0x7fce441089a0 2024-06-06T03:33:29.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.353+0000 7fce427fc640 1 -- 172.21.15.50:0/3674430623 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3000f340 con 0x7fce441089a0 2024-06-06T03:33:29.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.353+0000 7fce48940640 1 --2- 172.21.15.50:0/3674430623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce4410b310 0x7fce4419e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:33:29.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.358+0000 7fce427fc640 1 -- 172.21.15.50:0/3674430623 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fce30018020 con 0x7fce441089a0 2024-06-06T03:33:29.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.361+0000 7fce427fc640 1 --2- 172.21.15.50:0/3674430623 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fce340a2e70 0x7fce340a5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:29.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.361+0000 7fce427fc640 1 -- 172.21.15.50:0/3674430623 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fce300cfe30 con 0x7fce441089a0 2024-06-06T03:33:29.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.362+0000 7fce4e18e740 1 Processor -- start 2024-06-06T03:33:29.363 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.362+0000 7fce4e18e740 1 -- start start 2024-06-06T03:33:29.363 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.363+0000 7fce4e18e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f80064010 0x564f80064430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:29.363 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.363+0000 7fce4e18e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f80064a00 0x564f80069500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:29.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.363+0000 7fce4e18e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f80069b70 0x564f8006c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:29.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.363+0000 7fce4e18e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564f7ffc74f0 con 0x564f80064a00 2024-06-06T03:33:29.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.363+0000 7fce4e18e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564f7ff65870 con 0x564f80069b70 2024-06-06T03:33:29.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.363+0000 7fce4e18e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564f7ffc34b0 con 0x564f80064010 2024-06-06T03:33:29.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.364+0000 7fce48940640 1 --2- 172.21.15.50:0/3674430623 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fce340a2e70 0x7fce340a5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:29.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.364+0000 7fce48940640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f80064a00 0x564f80069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:29.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.364+0000 7fce48940640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f80064a00 0x564f80069500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47056/0 (socket says 172.21.15.50:47056) 2024-06-06T03:33:29.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.364+0000 7fce48940640 1 -- 172.21.15.50:0/3989253956 learned_addr learned my addr 172.21.15.50:0/3989253956 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:29.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.364+0000 7fce49942640 1 --2- 172.21.15.50:0/3989253956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f80069b70 0x564f8006c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:29.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.364+0000 7fce48940640 1 -- 172.21.15.50:0/3989253956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f80064010 msgr2=0x564f80064430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:33:29.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.364+0000 7fce48940640 1 --2- 172.21.15.50:0/3989253956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f80064010 0x564f80064430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.364+0000 7fce48940640 1 -- 172.21.15.50:0/3989253956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f80069b70 msgr2=0x564f8006c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:29.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.364+0000 7fce48940640 1 --2- 172.21.15.50:0/3989253956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f80069b70 0x564f8006c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.364+0000 7fce48940640 1 -- 172.21.15.50:0/3989253956 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f7ff819b0 con 0x564f80064a00 2024-06-06T03:33:29.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.365+0000 7fce49942640 1 --2- 172.21.15.50:0/3989253956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f80069b70 0x564f8006c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:33:29.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.365+0000 7fce48940640 1 --2- 172.21.15.50:0/3989253956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f80064a00 0x564f80069500 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fce3c034000 tx=0x7fce3c003800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a1c40c2a15243b server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:29.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.366+0000 7fce2f7fe640 1 -- 172.21.15.50:0/3989253956 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3c003d40 con 0x564f80064a00 2024-06-06T03:33:29.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.366+0000 7fce2f7fe640 1 -- 172.21.15.50:0/3989253956 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fce3c038070 con 0x564f80064a00 2024-06-06T03:33:29.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.366+0000 7fce48940640 1 --2- 172.21.15.50:0/3674430623 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fce340a2e70 0x7fce340a5330 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fce3c03c000 tx=0x7fce3c045000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:29.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.367+0000 7fce4e18e740 1 -- 172.21.15.50:0/3989253956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f80064a00 msgr2=0x564f80069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:29.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.367+0000 7fce4e18e740 1 --2- 172.21.15.50:0/3989253956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f80064a00 0x564f80069500 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fce3c034000 tx=0x7fce3c003800 comp rx=0 tx=0).stop 2024-06-06T03:33:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.371+0000 7fce4e18e740 1 -- 172.21.15.50:0/3989253956 shutdown_connections 2024-06-06T03:33:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.372+0000 7fce4e18e740 1 --2- 172.21.15.50:0/3989253956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f80064a00 0x564f80069500 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.372+0000 7fce4e18e740 1 --2- 172.21.15.50:0/3989253956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f80069b70 0x564f8006c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.372+0000 7fce4e18e740 1 --2- 172.21.15.50:0/3989253956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f80064010 0x564f80064430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.372+0000 7fce4e18e740 1 -- 172.21.15.50:0/3989253956 >> 172.21.15.50:0/3989253956 conn(0x564f8005f680 msgr2=0x564f8005fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:29.380 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.381+0000 7fce4e18e740 1 -- 172.21.15.50:0/3989253956 shutdown_connections 2024-06-06T03:33:29.385 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.386+0000 7fce4e18e740 1 -- 172.21.15.50:0/3989253956 wait complete. 2024-06-06T03:33:29.386 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.386+0000 7fce4e18e740 1 -- start start 2024-06-06T03:33:29.386 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.386+0000 7fce4e18e740 1 Processor -- start 2024-06-06T03:33:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.387+0000 7fce4e18e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f80064010 0x564f8006e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.387+0000 7fce4e18e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f80064a00 0x564f8006e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.388+0000 7fce4e18e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f80069b70 0x564f800758a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.388+0000 7fce4e18e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564f8006cb10 con 0x564f80069b70 2024-06-06T03:33:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.388+0000 7fce4e18e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564f7ff50ae0 con 0x564f80064010 2024-06-06T03:33:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.388+0000 7fce48940640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f80064a00 0x564f8006e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.388+0000 7fce48940640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f80064a00 0x564f8006e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:45356/0 (socket says 172.21.15.50:45356) 2024-06-06T03:33:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.388+0000 7fce48940640 1 -- 172.21.15.50:0/2601782458 learned_addr learned my addr 172.21.15.50:0/2601782458 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.388+0000 7fce4e18e740 1 -- 172.21.15.50:0/2601782458 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564f8006cc90 con 0x564f80064a00 2024-06-06T03:33:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.388+0000 7fce4e18e740 10 client.0 _ll_register_callbacks cb 0x564f7ff899b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:33:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.389+0000 7fce48940640 1 -- 172.21.15.50:0/2601782458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f80064010 msgr2=0x564f8006e320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:33:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.389+0000 7fce48940640 1 --2- 172.21.15.50:0/2601782458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f80064010 0x564f8006e320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.389+0000 7fce48940640 1 -- 172.21.15.50:0/2601782458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f80069b70 msgr2=0x564f800758a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.389+0000 7fce48940640 1 --2- 172.21.15.50:0/2601782458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f80069b70 0x564f800758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.389+0000 7fce48940640 1 -- 172.21.15.50:0/2601782458 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f7fcdb210 con 0x564f80064a00 2024-06-06T03:33:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.389+0000 7fce48940640 1 --2- 172.21.15.50:0/2601782458 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f80064a00 0x564f8006e860 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fce3c004fd0 tx=0x7fce3c003df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b397b7a28ce7306 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.390+0000 7fce2cff9640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:33:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.390+0000 7fce2cff9640 1 -- 172.21.15.50:0/2601782458 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3c057020 con 0x564f80064a00 2024-06-06T03:33:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.390+0000 7fce4e18e740 1 -- 172.21.15.50:0/2601782458 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce3c038070 con 0x564f80064a00 2024-06-06T03:33:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.390+0000 7fce2cff9640 1 -- 172.21.15.50:0/2601782458 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fce3c005250 con 0x564f80064a00 2024-06-06T03:33:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.397+0000 7fce2cff9640 1 -- 172.21.15.50:0/2601782458 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fce3c005490 con 0x564f80064a00 2024-06-06T03:33:29.397 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.397+0000 7fce4e18e740 10 client.26008 fetch_fsmap learned FSMap version 33 2024-06-06T03:33:29.397 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.397+0000 7fce4e18e740 1 -- 172.21.15.50:0/2601782458 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564f7fda7620 con 0x564f80064a00 2024-06-06T03:33:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.399+0000 7fce2cff9640 1 -- 172.21.15.50:0/2601782458 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fce3c038070 con 0x564f80064a00 2024-06-06T03:33:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.399+0000 7fce2cff9640 1 -- 172.21.15.50:0/2601782458 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fce3c049070 con 0x564f80064a00 2024-06-06T03:33:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.399+0000 7fce4e18e740 10 client.26008 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:33:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.399+0000 7fce4e18e740 10 client.26008 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:33:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.399+0000 7fce4e18e740 20 client.26008 populate_metadata read hostname 'smithi050' 2024-06-06T03:33:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.399+0000 7fce4e18e740 1 --2- 172.21.15.50:0/2601782458 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564f8007a030 0x564f8007c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.399+0000 7fce4e18e740 4 client.26008 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:33:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.399+0000 7fce4e18e740 1 -- 172.21.15.50:0/2601782458 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f7ffdaf10 con 0x564f8007a030 2024-06-06T03:33:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.399+0000 7fce49141640 1 --2- 172.21.15.50:0/2601782458 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564f8007a030 0x564f8007c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:29.401 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.402+0000 7fce2cff9640 10 client.26008 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:33:29.402 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.402+0000 7fce49141640 1 --2- 172.21.15.50:0/2601782458 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564f8007a030 0x564f8007c4f0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67836b69abf5bb6b server_cookie=9c854628716f6d4d in_seq=0 out_seq=0 2024-06-06T03:33:29.404 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.405+0000 7fce2cff9640 1 -- 172.21.15.50:0/2601782458 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x564f7ffdaf10 con 0x564f8007a030 2024-06-06T03:33:29.405 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.405+0000 7fce2cff9640 10 client.26008 handle_command_reply: tid=0 2024-06-06T03:33:29.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.405+0000 7fce4e18e740 1 client.26008 shutdown 2024-06-06T03:33:29.408 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.408+0000 7fce4e18e740 1 -- 172.21.15.50:0/2601782458 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f80064a00 msgr2=0x564f8006e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:29.408 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.408+0000 7fce4e18e740 1 --2- 172.21.15.50:0/2601782458 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f80064a00 0x564f8006e860 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fce3c004fd0 tx=0x7fce3c003df0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.415 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.415+0000 7fce4e18e740 1 -- 172.21.15.50:0/2601782458 shutdown_connections 2024-06-06T03:33:29.415 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.415+0000 7fce4e18e740 1 --2- 172.21.15.50:0/2601782458 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564f8007a030 0x564f8007c4f0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.415 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.415+0000 7fce4e18e740 1 --2- 172.21.15.50:0/2601782458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f80069b70 0x564f800758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.415 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.415+0000 7fce4e18e740 1 --2- 172.21.15.50:0/2601782458 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f80064a00 0x564f8006e860 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.415 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.415+0000 7fce4e18e740 1 --2- 172.21.15.50:0/2601782458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f80064010 0x564f8006e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.416 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.415+0000 7fce4e18e740 1 -- 172.21.15.50:0/2601782458 >> 172.21.15.50:0/2601782458 conn(0x564f8005f680 msgr2=0x564f8005e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.416+0000 7fce2cff9640 0 client.26008 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:33:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.416+0000 7fce4e18e740 1 -- 172.21.15.50:0/2601782458 shutdown_connections 2024-06-06T03:33:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.418+0000 7fce4e18e740 1 -- 172.21.15.50:0/2601782458 wait complete. 2024-06-06T03:33:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.420+0000 7fce4e18e740 20 client.26008 trim_cache size 0 max 16384 2024-06-06T03:33:29.430 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:29 smithi122 ceph-mon[35759]: pgmap v636: 129 pgs: 129 active+clean; 10 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 33 MiB/s wr, 595 op/s 2024-06-06T03:33:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.467+0000 7fce4e18e740 1 Processor -- start 2024-06-06T03:33:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.467+0000 7fce4e18e740 1 -- start start 2024-06-06T03:33:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.468+0000 7fce4e18e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f80064010 0x564f8005f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.468+0000 7fce4e18e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f80064a00 0x564f80075860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.468+0000 7fce4e18e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f80069b70 0x564f80062590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.468+0000 7fce4e18e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fce28012520 con 0x564f80064010 2024-06-06T03:33:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.468+0000 7fce4e18e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fce2800fdf0 con 0x564f80064a00 2024-06-06T03:33:29.470 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.468+0000 7fce4e18e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fce2800dc40 con 0x564f80069b70 2024-06-06T03:33:29.470 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.469+0000 7fce48940640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f80064a00 0x564f80075860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:29.470 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.469+0000 7fce48940640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f80064a00 0x564f80075860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:43926/0 (socket says 172.21.15.50:43926) 2024-06-06T03:33:29.470 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.469+0000 7fce48940640 1 -- 172.21.15.50:0/4133570097 learned_addr learned my addr 172.21.15.50:0/4133570097 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:29.470 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.469+0000 7fce49942640 1 --2- 172.21.15.50:0/4133570097 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f80069b70 0x564f80062590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:29.470 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.469+0000 7fce49141640 1 --2- 172.21.15.50:0/4133570097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f80064010 0x564f8005f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:29.471 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.469+0000 7fce49942640 1 -- 172.21.15.50:0/4133570097 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f80064a00 msgr2=0x564f80075860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:29.471 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.469+0000 7fce49942640 1 --2- 172.21.15.50:0/4133570097 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f80064a00 0x564f80075860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.471 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.469+0000 7fce49942640 1 -- 172.21.15.50:0/4133570097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f80064010 msgr2=0x564f8005f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:29.472 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.469+0000 7fce49942640 1 --2- 172.21.15.50:0/4133570097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f80064010 0x564f8005f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.472 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.469+0000 7fce49942640 1 -- 172.21.15.50:0/4133570097 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f8006ebb0 con 0x564f80069b70 2024-06-06T03:33:29.472 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.470+0000 7fce49942640 1 --2- 172.21.15.50:0/4133570097 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f80069b70 0x564f80062590 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fce38021420 tx=0x7fce38021510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba17ee7989f5e7b2 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:29.472 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.470+0000 7fce2effd640 1 -- 172.21.15.50:0/4133570097 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce38004b20 con 0x564f80069b70 2024-06-06T03:33:29.472 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.471+0000 7fce2effd640 1 -- 172.21.15.50:0/4133570097 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fce38003e20 con 0x564f80069b70 2024-06-06T03:33:29.472 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.472+0000 7fce2effd640 1 -- 172.21.15.50:0/4133570097 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3801f690 con 0x564f80069b70 2024-06-06T03:33:29.473 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.473+0000 7fce4e18e740 1 -- 172.21.15.50:0/4133570097 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f80069b70 msgr2=0x564f80062590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:29.473 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.473+0000 7fce4e18e740 1 --2- 172.21.15.50:0/4133570097 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f80069b70 0x564f80062590 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fce38021420 tx=0x7fce38021510 comp rx=0 tx=0).stop 2024-06-06T03:33:29.476 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.476+0000 7fce4e18e740 1 -- 172.21.15.50:0/4133570097 shutdown_connections 2024-06-06T03:33:29.476 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.476+0000 7fce4e18e740 1 --2- 172.21.15.50:0/4133570097 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f80069b70 0x564f80062590 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.476 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.476+0000 7fce4e18e740 1 --2- 172.21.15.50:0/4133570097 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f80064a00 0x564f80075860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.476 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.476+0000 7fce4e18e740 1 --2- 172.21.15.50:0/4133570097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f80064010 0x564f8005f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.476 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.476+0000 7fce4e18e740 1 -- 172.21.15.50:0/4133570097 >> 172.21.15.50:0/4133570097 conn(0x564f8005f680 msgr2=0x564f80065c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:29.478 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.478+0000 7fce4e18e740 1 -- 172.21.15.50:0/4133570097 shutdown_connections 2024-06-06T03:33:29.478 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.478+0000 7fce4e18e740 1 -- 172.21.15.50:0/4133570097 wait complete. 2024-06-06T03:33:29.478 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.478+0000 7fce4e18e740 1 -- start start 2024-06-06T03:33:29.479 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.479+0000 7fce4e18e740 1 Processor -- start 2024-06-06T03:33:29.479 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.479+0000 7fce4e18e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f80064010 0x564f80075190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:29.479 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.479+0000 7fce4e18e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f80064a00 0x564f800756d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:29.479 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.479+0000 7fce4e18e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f80069b70 0x564f80071c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:29.479 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.479+0000 7fce4e18e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fce2800e2b0 con 0x564f80069b70 2024-06-06T03:33:29.479 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.479+0000 7fce4e18e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fce2800f720 con 0x564f80064010 2024-06-06T03:33:29.479 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.479+0000 7fce4e18e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fce2800e980 con 0x564f80064a00 2024-06-06T03:33:29.480 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.479+0000 7fce4e18e740 10 client.0 _ll_register_callbacks cb 0x7fce3801a470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:33:29.480 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.480+0000 7fce49141640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f80064010 0x564f80075190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:29.480 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.480+0000 7fce49141640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f80064010 0x564f80075190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:43934/0 (socket says 172.21.15.50:43934) 2024-06-06T03:33:29.481 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.480+0000 7fce49141640 1 -- 172.21.15.50:0/1352787241 learned_addr learned my addr 172.21.15.50:0/1352787241 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:29.481 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.480+0000 7fce48940640 1 --2- 172.21.15.50:0/1352787241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f80064a00 0x564f800756d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:29.481 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.480+0000 7fce49942640 1 --2- 172.21.15.50:0/1352787241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f80069b70 0x564f80071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:29.481 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.480+0000 7fce49141640 1 -- 172.21.15.50:0/1352787241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f80064a00 msgr2=0x564f800756d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:29.481 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.480+0000 7fce49141640 1 --2- 172.21.15.50:0/1352787241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f80064a00 0x564f800756d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.481 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.480+0000 7fce49141640 1 -- 172.21.15.50:0/1352787241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f80069b70 msgr2=0x564f80071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:29.481 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.480+0000 7fce49141640 1 --2- 172.21.15.50:0/1352787241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f80069b70 0x564f80071c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.481 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.480+0000 7fce49141640 1 -- 172.21.15.50:0/1352787241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f800723a0 con 0x564f80064010 2024-06-06T03:33:29.481 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.480+0000 7fce49141640 1 --2- 172.21.15.50:0/1352787241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f80064010 0x564f80075190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fce30009fd0 tx=0x7fce30006df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cca7d3a509e77c7 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:29.481 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.480+0000 7fce2cff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:33:29.484 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.484+0000 7fce2cff9640 1 -- 172.21.15.50:0/1352787241 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce300abe80 con 0x564f80064010 2024-06-06T03:33:29.484 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.484+0000 7fce4e18e740 1 -- 172.21.15.50:0/1352787241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce38003e20 con 0x564f80064010 2024-06-06T03:33:29.484 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.485+0000 7fce2cff9640 1 -- 172.21.15.50:0/1352787241 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fce30098920 con 0x564f80064010 2024-06-06T03:33:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.485+0000 7fce2cff9640 1 -- 172.21.15.50:0/1352787241 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fce300a6030 con 0x564f80064010 2024-06-06T03:33:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.486+0000 7fce4e18e740 10 client.26021 fetch_fsmap learned FSMap version 33 2024-06-06T03:33:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.486+0000 7fce4e18e740 1 -- 172.21.15.50:0/1352787241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564f800e3b30 con 0x564f80064010 2024-06-06T03:33:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.490+0000 7fce2cff9640 1 -- 172.21.15.50:0/1352787241 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fce38003e20 con 0x564f80064010 2024-06-06T03:33:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.490+0000 7fce2cff9640 1 -- 172.21.15.50:0/1352787241 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fce300103e0 con 0x564f80064010 2024-06-06T03:33:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.492+0000 7fce4e18e740 10 client.26021 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:33:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.492+0000 7fce4e18e740 10 client.26021 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:33:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.492+0000 7fce4e18e740 20 client.26021 populate_metadata read hostname 'smithi050' 2024-06-06T03:33:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.492+0000 7fce4e18e740 1 --2- 172.21.15.50:0/1352787241 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564f800e4460 0x564f800e6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.492+0000 7fce4e18e740 4 client.26021 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:33:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.492+0000 7fce4e18e740 1 -- 172.21.15.50:0/1352787241 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564f7ffd4c20 con 0x564f800e4460 2024-06-06T03:33:29.494 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.492+0000 7fce48940640 1 --2- 172.21.15.50:0/1352787241 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564f800e4460 0x564f800e6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:29.494 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.493+0000 7fce48940640 1 --2- 172.21.15.50:0/1352787241 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564f800e4460 0x564f800e6880 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d70ab26ea273098 server_cookie=17d699d3b4c04d63 in_seq=0 out_seq=0 2024-06-06T03:33:29.494 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.494+0000 7fce2cff9640 10 client.26021 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:33:29.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.504+0000 7fce2cff9640 1 -- 172.21.15.50:0/1352787241 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x564f7ffd4c20 con 0x564f800e4460 2024-06-06T03:33:29.504 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.504+0000 7fce2cff9640 10 client.26021 handle_command_reply: tid=0 2024-06-06T03:33:29.504 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:29 smithi050 ceph-mon[32421]: pgmap v636: 129 pgs: 129 active+clean; 10 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 33 MiB/s wr, 595 op/s 2024-06-06T03:33:29.505 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.505+0000 7fce4e18e740 1 client.26021 shutdown 2024-06-06T03:33:29.505 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.505+0000 7fce4e18e740 1 -- 172.21.15.50:0/1352787241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f80064010 msgr2=0x564f80075190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:29.505 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.505+0000 7fce4e18e740 1 --2- 172.21.15.50:0/1352787241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f80064010 0x564f80075190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fce30009fd0 tx=0x7fce30006df0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.505 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.505+0000 7fce4e18e740 1 -- 172.21.15.50:0/1352787241 shutdown_connections 2024-06-06T03:33:29.505 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.505+0000 7fce4e18e740 1 --2- 172.21.15.50:0/1352787241 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564f800e4460 0x564f800e6880 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.506 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.505+0000 7fce4e18e740 1 --2- 172.21.15.50:0/1352787241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f80069b70 0x564f80071c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.506 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.505+0000 7fce4e18e740 1 --2- 172.21.15.50:0/1352787241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f80064a00 0x564f800756d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.506 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.505+0000 7fce4e18e740 1 --2- 172.21.15.50:0/1352787241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f80064010 0x564f80075190 secure :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fce30009fd0 tx=0x7fce30006df0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.506 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.505+0000 7fce4e18e740 1 -- 172.21.15.50:0/1352787241 >> 172.21.15.50:0/1352787241 conn(0x564f8005f680 msgr2=0x564f8005df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:29.506 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.505+0000 7fce2cff9640 0 client.26021 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:33:29.506 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.506+0000 7fce4e18e740 1 -- 172.21.15.50:0/1352787241 shutdown_connections 2024-06-06T03:33:29.507 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.507+0000 7fce4e18e740 1 -- 172.21.15.50:0/1352787241 wait complete. 2024-06-06T03:33:29.507 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.508+0000 7fce4e18e740 20 client.26021 trim_cache size 0 max 16384 2024-06-06T03:33:29.509 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:33:29.509 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:33:29.509 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:33:29.512 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.511+0000 7fce4b3a5640 1 -- 172.21.15.50:0/3674430623 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fce340a2e70 msgr2=0x7fce340a5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:29.513 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.511+0000 7fce4b3a5640 1 --2- 172.21.15.50:0/3674430623 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fce340a2e70 0x7fce340a5330 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fce3c03c000 tx=0x7fce3c045000 comp rx=0 tx=0).stop 2024-06-06T03:33:29.513 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.511+0000 7fce4b3a5640 1 -- 172.21.15.50:0/3674430623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce441089a0 msgr2=0x7fce4419e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:29.513 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.511+0000 7fce4b3a5640 1 --2- 172.21.15.50:0/3674430623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce441089a0 0x7fce4419e240 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fce3000b450 tx=0x7fce3000b910 comp rx=0 tx=0).stop 2024-06-06T03:33:29.513 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.513+0000 7fce4b3a5640 1 -- 172.21.15.50:0/3674430623 shutdown_connections 2024-06-06T03:33:29.513 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.513+0000 7fce4b3a5640 1 --2- 172.21.15.50:0/3674430623 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fce340a2e70 0x7fce340a5330 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.513 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.513+0000 7fce4b3a5640 1 --2- 172.21.15.50:0/3674430623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce4410dcc0 0x7fce441a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.513 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.513+0000 7fce4b3a5640 1 --2- 172.21.15.50:0/3674430623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce4410b310 0x7fce4419e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.513 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.513+0000 7fce4b3a5640 1 --2- 172.21.15.50:0/3674430623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce441089a0 0x7fce4419e240 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:29.513 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.513+0000 7fce4b3a5640 1 -- 172.21.15.50:0/3674430623 >> 172.21.15.50:0/3674430623 conn(0x7fce4406ea10 msgr2=0x7fce4410bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:29.514 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.514+0000 7fce4b3a5640 1 -- 172.21.15.50:0/3674430623 shutdown_connections 2024-06-06T03:33:29.514 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:29.514+0000 7fce4b3a5640 1 -- 172.21.15.50:0/3674430623 wait complete. 2024-06-06T03:33:31.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:31 smithi079 ceph-mon[35478]: pgmap v637: 129 pgs: 129 active+clean; 10 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 44 MiB/s wr, 796 op/s 2024-06-06T03:33:31.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:31 smithi122 ceph-mon[35759]: pgmap v637: 129 pgs: 129 active+clean; 10 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 44 MiB/s wr, 796 op/s 2024-06-06T03:33:31.503 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:31 smithi050 ceph-mon[32421]: pgmap v637: 129 pgs: 129 active+clean; 10 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 44 MiB/s wr, 796 op/s 2024-06-06T03:33:33.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:33 smithi079 ceph-mon[35478]: pgmap v638: 129 pgs: 129 active+clean; 10 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 34 MiB/s wr, 619 op/s 2024-06-06T03:33:33.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:33 smithi122 ceph-mon[35759]: pgmap v638: 129 pgs: 129 active+clean; 10 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 34 MiB/s wr, 619 op/s 2024-06-06T03:33:33.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:33 smithi050 ceph-mon[32421]: pgmap v638: 129 pgs: 129 active+clean; 10 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 34 MiB/s wr, 619 op/s 2024-06-06T03:33:35.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:35 smithi079 ceph-mon[35478]: pgmap v639: 129 pgs: 129 active+clean; 10 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 35 MiB/s wr, 637 op/s 2024-06-06T03:33:35.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:35 smithi122 ceph-mon[35759]: pgmap v639: 129 pgs: 129 active+clean; 10 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 35 MiB/s wr, 637 op/s 2024-06-06T03:33:35.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:35 smithi050 ceph-mon[32421]: pgmap v639: 129 pgs: 129 active+clean; 10 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 35 MiB/s wr, 637 op/s 2024-06-06T03:33:37.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:37 smithi050 ceph-mon[32421]: pgmap v640: 129 pgs: 129 active+clean; 10 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 42 MiB/s wr, 764 op/s 2024-06-06T03:33:37.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:37 smithi079 ceph-mon[35478]: pgmap v640: 129 pgs: 129 active+clean; 10 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 42 MiB/s wr, 764 op/s 2024-06-06T03:33:37.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:37 smithi122 ceph-mon[35759]: pgmap v640: 129 pgs: 129 active+clean; 10 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 42 MiB/s wr, 764 op/s 2024-06-06T03:33:39.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:39 smithi079 ceph-mon[35478]: pgmap v641: 129 pgs: 129 active+clean; 10 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 33 MiB/s wr, 596 op/s 2024-06-06T03:33:39.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:39 smithi122 ceph-mon[35759]: pgmap v641: 129 pgs: 129 active+clean; 10 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 33 MiB/s wr, 596 op/s 2024-06-06T03:33:39.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:39 smithi050 ceph-mon[32421]: pgmap v641: 129 pgs: 129 active+clean; 10 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 33 MiB/s wr, 596 op/s 2024-06-06T03:33:41.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:41 smithi079 ceph-mon[35478]: pgmap v642: 129 pgs: 129 active+clean; 10 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 44 MiB/s wr, 807 op/s 2024-06-06T03:33:41.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:41 smithi122 ceph-mon[35759]: pgmap v642: 129 pgs: 129 active+clean; 10 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 44 MiB/s wr, 807 op/s 2024-06-06T03:33:41.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:41 smithi050 ceph-mon[32421]: pgmap v642: 129 pgs: 129 active+clean; 10 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 44 MiB/s wr, 807 op/s 2024-06-06T03:33:42.763 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.764+0000 7ff3bffff640 1 -- 172.21.15.50:0/932563920 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3c0072cd0 msgr2=0x7ff3c00730f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:42.763 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.764+0000 7ff3bffff640 1 --2- 172.21.15.50:0/932563920 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3c0072cd0 0x7ff3c00730f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8009ca0 tx=0x7ff3b802a8d0 comp rx=0 tx=0).stop 2024-06-06T03:33:42.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.769+0000 7ff3bffff640 1 -- 172.21.15.50:0/932563920 shutdown_connections 2024-06-06T03:33:42.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.769+0000 7ff3bffff640 1 --2- 172.21.15.50:0/932563920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3c0109970 0x7ff3c010e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:42.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.769+0000 7ff3bffff640 1 --2- 172.21.15.50:0/932563920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3c0108fb0 0x7ff3c0109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:42.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.769+0000 7ff3bffff640 1 --2- 172.21.15.50:0/932563920 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3c0072cd0 0x7ff3c00730f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:42.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.769+0000 7ff3bffff640 1 -- 172.21.15.50:0/932563920 >> 172.21.15.50:0/932563920 conn(0x7ff3c006e840 msgr2=0x7ff3c0070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:42.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.772+0000 7ff3bffff640 1 -- 172.21.15.50:0/932563920 shutdown_connections 2024-06-06T03:33:42.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.779+0000 7ff3bffff640 1 -- 172.21.15.50:0/932563920 wait complete. 2024-06-06T03:33:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.780+0000 7ff3bffff640 1 Processor -- start 2024-06-06T03:33:42.780 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.781+0000 7ff3bffff640 1 -- start start 2024-06-06T03:33:42.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.782+0000 7ff3bffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3c0072cd0 0x7ff3c01a6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:42.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.782+0000 7ff3bffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3c0108fb0 0x7ff3c01a6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:42.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.782+0000 7ff3bffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3c0109970 0x7ff3c01ade10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:42.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.782+0000 7ff3bffff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c011c190 con 0x7ff3c0108fb0 2024-06-06T03:33:42.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.782+0000 7ff3bffff640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c011c010 con 0x7ff3c0109970 2024-06-06T03:33:42.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.782+0000 7ff3bffff640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c011c310 con 0x7ff3c0072cd0 2024-06-06T03:33:42.783 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.782+0000 7ff3bf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3c0109970 0x7ff3c01ade10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:42.783 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.782+0000 7ff3bf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3c0109970 0x7ff3c01ade10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:45026/0 (socket says 172.21.15.50:45026) 2024-06-06T03:33:42.783 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.782+0000 7ff3bf7fe640 1 -- 172.21.15.50:0/2798447595 learned_addr learned my addr 172.21.15.50:0/2798447595 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:42.783 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.783+0000 7ff3bf7fe640 1 -- 172.21.15.50:0/2798447595 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3c0072cd0 msgr2=0x7ff3c01a6860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T03:33:42.783 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.783+0000 7ff3bf7fe640 1 --2- 172.21.15.50:0/2798447595 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3c0072cd0 0x7ff3c01a6860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:42.783 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.783+0000 7ff3bf7fe640 1 -- 172.21.15.50:0/2798447595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3c0108fb0 msgr2=0x7ff3c01a6da0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T03:33:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.783+0000 7ff3bf7fe640 1 --2- 172.21.15.50:0/2798447595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3c0108fb0 0x7ff3c01a6da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.783+0000 7ff3bf7fe640 1 -- 172.21.15.50:0/2798447595 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c01ae480 con 0x7ff3c0109970 2024-06-06T03:33:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.783+0000 7ff3bf7fe640 1 --2- 172.21.15.50:0/2798447595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3c0109970 0x7ff3c01ade10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff3b000d750 tx=0x7ff3b000dc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:42.787 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.786+0000 7ff3c49a0640 1 -- 172.21.15.50:0/2798447595 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b0017070 con 0x7ff3c0109970 2024-06-06T03:33:42.787 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.786+0000 7ff3bffff640 1 -- 172.21.15.50:0/2798447595 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3c01ae770 con 0x7ff3c0109970 2024-06-06T03:33:42.787 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.786+0000 7ff3bffff640 1 -- 172.21.15.50:0/2798447595 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3c01aecc0 con 0x7ff3c0109970 2024-06-06T03:33:42.787 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.786+0000 7ff3c49a0640 1 -- 172.21.15.50:0/2798447595 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff3b00054d0 con 0x7ff3c0109970 2024-06-06T03:33:42.787 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.787+0000 7ff3c49a0640 1 -- 172.21.15.50:0/2798447595 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b0004c30 con 0x7ff3c0109970 2024-06-06T03:33:42.795 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.793+0000 7ff3c8792740 1 Processor -- start 2024-06-06T03:33:42.795 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.796+0000 7ff3c49a0640 1 -- 172.21.15.50:0/2798447595 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff3b0004dd0 con 0x7ff3c0109970 2024-06-06T03:33:42.798 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.798+0000 7ff3c49a0640 1 --2- 172.21.15.50:0/2798447595 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff3a80a2c00 0x7ff3a80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:42.798 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.798+0000 7ff3c49a0640 1 -- 172.21.15.50:0/2798447595 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7ff3b00cf090 con 0x7ff3c0109970 2024-06-06T03:33:42.802 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.802+0000 7ff3c8792740 1 -- start start 2024-06-06T03:33:42.803 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.802+0000 7ff3be7fc640 1 --2- 172.21.15.50:0/2798447595 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff3a80a2c00 0x7ff3a80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:42.803 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.802+0000 7ff3c8792740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f34e8200 0x5570f34e8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:42.803 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.802+0000 7ff3c8792740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5570f34e8bf0 0x5570f34ed6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:42.803 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.802+0000 7ff3c8792740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5570f34edd60 0x5570f34f01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:42.803 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.802+0000 7ff3c8792740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5570f344b4f0 con 0x5570f34e8bf0 2024-06-06T03:33:42.803 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.802+0000 7ff3c8792740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5570f33e9870 con 0x5570f34edd60 2024-06-06T03:33:42.803 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.802+0000 7ff3c8792740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5570f34474b0 con 0x5570f34e8200 2024-06-06T03:33:42.804 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.806+0000 7ff3be7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5570f34e8bf0 0x5570f34ed6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:42.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.806+0000 7ff3bf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5570f34edd60 0x5570f34f01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:42.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.806+0000 7ff3be7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5570f34e8bf0 0x5570f34ed6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57452/0 (socket says 172.21.15.50:57452) 2024-06-06T03:33:42.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.806+0000 7ff3be7fc640 1 -- 172.21.15.50:0/4054374897 learned_addr learned my addr 172.21.15.50:0/4054374897 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:42.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.811+0000 7ff3bf7fe640 1 -- 172.21.15.50:0/4054374897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f34e8200 msgr2=0x5570f34e8620 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:33:42.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.811+0000 7ff3bf7fe640 1 --2- 172.21.15.50:0/4054374897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f34e8200 0x5570f34e8620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:42.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.811+0000 7ff3bf7fe640 1 -- 172.21.15.50:0/4054374897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5570f34e8bf0 msgr2=0x5570f34ed6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:42.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.811+0000 7ff3bf7fe640 1 --2- 172.21.15.50:0/4054374897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5570f34e8bf0 0x5570f34ed6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:42.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.811+0000 7ff3bf7fe640 1 -- 172.21.15.50:0/4054374897 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570f34059b0 con 0x5570f34edd60 2024-06-06T03:33:42.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.811+0000 7ff3bf7fe640 1 --2- 172.21.15.50:0/4054374897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5570f34edd60 0x5570f34f01f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff3b009b520 tx=0x7ff3b009bd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbec59bfc441ff74 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:42.811 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.812+0000 7ff3be7fc640 1 --2- 172.21.15.50:0/2798447595 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff3a80a2c00 0x7ff3a80a50c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff3b40137b0 tx=0x7ff3b4009a90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:42.811 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.813+0000 7ff3a5ffb640 1 -- 172.21.15.50:0/4054374897 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b00b3070 con 0x5570f34edd60 2024-06-06T03:33:42.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.813+0000 7ff3a5ffb640 1 -- 172.21.15.50:0/4054374897 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff3b00a4200 con 0x5570f34edd60 2024-06-06T03:33:42.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.813+0000 7ff3a5ffb640 1 -- 172.21.15.50:0/4054374897 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b009b7f0 con 0x5570f34edd60 2024-06-06T03:33:42.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.835+0000 7ff3c8792740 1 -- 172.21.15.50:0/4054374897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5570f34edd60 msgr2=0x5570f34f01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:42.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.835+0000 7ff3c8792740 1 --2- 172.21.15.50:0/4054374897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5570f34edd60 0x5570f34f01f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff3b009b520 tx=0x7ff3b009bd50 comp rx=0 tx=0).stop 2024-06-06T03:33:42.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.835+0000 7ff3c8792740 1 -- 172.21.15.50:0/4054374897 shutdown_connections 2024-06-06T03:33:42.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.835+0000 7ff3c8792740 1 --2- 172.21.15.50:0/4054374897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5570f34e8bf0 0x5570f34ed6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:42.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.835+0000 7ff3c8792740 1 --2- 172.21.15.50:0/4054374897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5570f34edd60 0x5570f34f01f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:42.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.835+0000 7ff3c8792740 1 --2- 172.21.15.50:0/4054374897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f34e8200 0x5570f34e8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:42.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.835+0000 7ff3c8792740 1 -- 172.21.15.50:0/4054374897 >> 172.21.15.50:0/4054374897 conn(0x5570f34e3870 msgr2=0x5570f34e3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:42.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.838+0000 7ff3c8792740 1 -- 172.21.15.50:0/4054374897 shutdown_connections 2024-06-06T03:33:42.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.839+0000 7ff3c8792740 1 -- 172.21.15.50:0/4054374897 wait complete. 2024-06-06T03:33:42.840 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.840+0000 7ff3c8792740 1 -- start start 2024-06-06T03:33:42.840 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.840+0000 7ff3c8792740 1 Processor -- start 2024-06-06T03:33:42.840 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.840+0000 7ff3c8792740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5570f34e8200 0x5570f34f24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:42.840 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.841+0000 7ff3c8792740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f34e8bf0 0x5570f34f2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.841+0000 7ff3c8792740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5570f34edd60 0x5570f34f9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.841+0000 7ff3c8792740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5570f34f0d10 con 0x5570f34e8200 2024-06-06T03:33:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.841+0000 7ff3bf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5570f34edd60 0x5570f34f9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.841+0000 7ff3bf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5570f34edd60 0x5570f34f9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:45040/0 (socket says 172.21.15.50:45040) 2024-06-06T03:33:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.841+0000 7ff3bf7fe640 1 -- 172.21.15.50:0/172493819 learned_addr learned my addr 172.21.15.50:0/172493819 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.841+0000 7ff3c8792740 1 -- 172.21.15.50:0/172493819 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5570f33d4ae0 con 0x5570f34edd60 2024-06-06T03:33:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.841+0000 7ff3c8792740 1 -- 172.21.15.50:0/172493819 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5570f34f0e90 con 0x5570f34e8bf0 2024-06-06T03:33:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.842+0000 7ff3c8792740 10 client.0 _ll_register_callbacks cb 0x5570f340d9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:33:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.842+0000 7ff3beffd640 1 --2- 172.21.15.50:0/172493819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5570f34e8200 0x5570f34f24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.843+0000 7ff3beffd640 1 -- 172.21.15.50:0/172493819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f34e8bf0 msgr2=0x5570f34f2a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:33:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.843+0000 7ff3beffd640 1 --2- 172.21.15.50:0/172493819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f34e8bf0 0x5570f34f2a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.843+0000 7ff3beffd640 1 -- 172.21.15.50:0/172493819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5570f34edd60 msgr2=0x5570f34f9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.843+0000 7ff3beffd640 1 --2- 172.21.15.50:0/172493819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5570f34edd60 0x5570f34f9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.843+0000 7ff3beffd640 1 -- 172.21.15.50:0/172493819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570f315f210 con 0x5570f34e8200 2024-06-06T03:33:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.843+0000 7ff3beffd640 1 --2- 172.21.15.50:0/172493819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5570f34e8200 0x5570f34f24e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8009bf0 tx=0x7ff3b8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68006ba44735bc54 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.843+0000 7ff39effd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:33:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.843+0000 7ff3bf7fe640 1 --2- 172.21.15.50:0/172493819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5570f34edd60 0x5570f34f9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:33:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.853+0000 7ff39effd640 1 -- 172.21.15.50:0/172493819 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8031e60 con 0x5570f34e8200 2024-06-06T03:33:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.853+0000 7ff39effd640 1 -- 172.21.15.50:0/172493819 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7ff3b8003970 con 0x5570f34e8200 2024-06-06T03:33:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.853+0000 7ff3c8792740 1 -- 172.21.15.50:0/172493819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3b00a4200 con 0x5570f34e8200 2024-06-06T03:33:42.858 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.860+0000 7ff39effd640 1 -- 172.21.15.50:0/172493819 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7ff3b8003b70 con 0x5570f34e8200 2024-06-06T03:33:42.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.860+0000 7ff3c8792740 10 client.16392 fetch_fsmap learned FSMap version 33 2024-06-06T03:33:42.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.860+0000 7ff3c8792740 1 -- 172.21.15.50:0/172493819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5570f322b620 con 0x5570f34e8200 2024-06-06T03:33:42.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.862+0000 7ff39effd640 1 -- 172.21.15.50:0/172493819 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff3b00a4200 con 0x5570f34e8200 2024-06-06T03:33:42.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.862+0000 7ff39effd640 1 -- 172.21.15.50:0/172493819 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7ff3b80305d0 con 0x5570f34e8200 2024-06-06T03:33:42.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.862+0000 7ff3c8792740 10 client.16392 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:33:42.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.862+0000 7ff3c8792740 10 client.16392 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:33:42.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.862+0000 7ff3c8792740 20 client.16392 populate_metadata read hostname 'smithi050' 2024-06-06T03:33:42.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.863+0000 7ff3c8792740 1 --2- 172.21.15.50:0/172493819 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5570f34fe340 0x5570f35007a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:42.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.863+0000 7ff3c8792740 4 client.16392 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:33:42.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.863+0000 7ff3c8792740 1 -- 172.21.15.50:0/172493819 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570f345ef10 con 0x5570f34fe340 2024-06-06T03:33:42.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.870+0000 7ff3be7fc640 1 --2- 172.21.15.50:0/172493819 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5570f34fe340 0x5570f35007a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:42.875 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.876+0000 7ff3be7fc640 1 --2- 172.21.15.50:0/172493819 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5570f34fe340 0x5570f35007a0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c60ce6c7d9df218 server_cookie=dd2dd379e27a02a1 in_seq=0 out_seq=0 2024-06-06T03:33:42.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.876+0000 7ff39effd640 10 client.16392 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:33:42.877 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.878+0000 7ff39effd640 1 -- 172.21.15.50:0/172493819 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5570f345ef10 con 0x5570f34fe340 2024-06-06T03:33:42.877 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.878+0000 7ff39effd640 10 client.16392 handle_command_reply: tid=0 2024-06-06T03:33:42.878 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.879+0000 7ff3c8792740 1 client.16392 shutdown 2024-06-06T03:33:42.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.883+0000 7ff3c8792740 1 -- 172.21.15.50:0/172493819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5570f34e8200 msgr2=0x5570f34f24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:42.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.883+0000 7ff3c8792740 1 --2- 172.21.15.50:0/172493819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5570f34e8200 0x5570f34f24e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8009bf0 tx=0x7ff3b8004ab0 comp rx=0 tx=0).stop 2024-06-06T03:33:42.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.883+0000 7ff3c8792740 1 -- 172.21.15.50:0/172493819 shutdown_connections 2024-06-06T03:33:42.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.883+0000 7ff3c8792740 1 --2- 172.21.15.50:0/172493819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5570f34edd60 0x5570f34f9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:42.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.883+0000 7ff3c8792740 1 --2- 172.21.15.50:0/172493819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f34e8bf0 0x5570f34f2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:42.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.883+0000 7ff3c8792740 1 --2- 172.21.15.50:0/172493819 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5570f34fe340 0x5570f35007a0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:42.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.883+0000 7ff3c8792740 1 --2- 172.21.15.50:0/172493819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5570f34e8200 0x5570f34f24e0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:42.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.883+0000 7ff3c8792740 1 -- 172.21.15.50:0/172493819 >> 172.21.15.50:0/172493819 conn(0x5570f34e3870 msgr2=0x5570f34e29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:42.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.884+0000 7ff39effd640 0 client.16392 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:33:42.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.884+0000 7ff3c8792740 1 -- 172.21.15.50:0/172493819 shutdown_connections 2024-06-06T03:33:42.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.884+0000 7ff3c8792740 1 -- 172.21.15.50:0/172493819 wait complete. 2024-06-06T03:33:42.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.884+0000 7ff3c8792740 20 client.16392 trim_cache size 0 max 16384 2024-06-06T03:33:42.928 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.929+0000 7ff3c8792740 1 Processor -- start 2024-06-06T03:33:42.928 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.929+0000 7ff3c8792740 1 -- start start 2024-06-06T03:33:42.929 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.930+0000 7ff3c8792740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5570f34e8200 0x5570f34e66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:42.929 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.930+0000 7ff3c8792740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5570f34e8bf0 0x5570f34f9a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:42.929 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.930+0000 7ff3beffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5570f34e8200 0x5570f34e66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:42.929 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.930+0000 7ff3beffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5570f34e8200 0x5570f34e66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:45052/0 (socket says 172.21.15.50:45052) 2024-06-06T03:33:42.929 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.930+0000 7ff3beffd640 1 -- 172.21.15.50:0/4085901239 learned_addr learned my addr 172.21.15.50:0/4085901239 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:42.929 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.930+0000 7ff3c8792740 1 --2- 172.21.15.50:0/4085901239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f34edd60 0x5570f34e6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:42.930 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.931+0000 7ff3be7fc640 1 --2- 172.21.15.50:0/4085901239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5570f34e8bf0 0x5570f34f9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:42.930 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.931+0000 7ff3c8792740 1 -- 172.21.15.50:0/4085901239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ac012530 con 0x5570f34e8bf0 2024-06-06T03:33:42.930 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.931+0000 7ff3c8792740 1 -- 172.21.15.50:0/4085901239 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ac00fe00 con 0x5570f34e8200 2024-06-06T03:33:42.930 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.931+0000 7ff3bf7fe640 1 --2- 172.21.15.50:0/4085901239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f34edd60 0x5570f34e6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:42.930 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.931+0000 7ff3c8792740 1 -- 172.21.15.50:0/4085901239 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ac00dc50 con 0x5570f34edd60 2024-06-06T03:33:42.932 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.932+0000 7ff3be7fc640 1 -- 172.21.15.50:0/4085901239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f34edd60 msgr2=0x5570f34e6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:42.932 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.932+0000 7ff3be7fc640 1 --2- 172.21.15.50:0/4085901239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f34edd60 0x5570f34e6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:42.932 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.932+0000 7ff3be7fc640 1 -- 172.21.15.50:0/4085901239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5570f34e8200 msgr2=0x5570f34e66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:42.932 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.932+0000 7ff3be7fc640 1 --2- 172.21.15.50:0/4085901239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5570f34e8200 0x5570f34e66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:42.932 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.932+0000 7ff3be7fc640 1 -- 172.21.15.50:0/4085901239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570f34e36a0 con 0x5570f34e8bf0 2024-06-06T03:33:42.932 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.933+0000 7ff3be7fc640 1 --2- 172.21.15.50:0/4085901239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5570f34e8bf0 0x5570f34f9a20 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x5570f34f39c0 tx=0x7ff3b401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=293f3ebdc963c8e2 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:42.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.935+0000 7ff3a57fa640 1 -- 172.21.15.50:0/4085901239 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4021850 con 0x5570f34e8bf0 2024-06-06T03:33:42.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.936+0000 7ff3a57fa640 1 -- 172.21.15.50:0/4085901239 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x5570f345ef10 con 0x5570f34e8bf0 2024-06-06T03:33:42.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.936+0000 7ff3a57fa640 1 -- 172.21.15.50:0/4085901239 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b401f9f0 con 0x5570f34e8bf0 2024-06-06T03:33:42.937 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.939+0000 7ff3c8792740 1 -- 172.21.15.50:0/4085901239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5570f34e8bf0 msgr2=0x5570f34f9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:42.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.939+0000 7ff3c8792740 1 --2- 172.21.15.50:0/4085901239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5570f34e8bf0 0x5570f34f9a20 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x5570f34f39c0 tx=0x7ff3b401e000 comp rx=0 tx=0).stop 2024-06-06T03:33:42.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.939+0000 7ff3c8792740 1 -- 172.21.15.50:0/4085901239 shutdown_connections 2024-06-06T03:33:42.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.939+0000 7ff3c8792740 1 --2- 172.21.15.50:0/4085901239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5570f34e8bf0 0x5570f34f9a20 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:42.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.939+0000 7ff3c8792740 1 --2- 172.21.15.50:0/4085901239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f34edd60 0x5570f34e6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:42.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.939+0000 7ff3c8792740 1 --2- 172.21.15.50:0/4085901239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5570f34e8200 0x5570f34e66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:42.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.939+0000 7ff3c8792740 1 -- 172.21.15.50:0/4085901239 >> 172.21.15.50:0/4085901239 conn(0x5570f34e3870 msgr2=0x5570f34e9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:42.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.944+0000 7ff3c8792740 1 -- 172.21.15.50:0/4085901239 shutdown_connections 2024-06-06T03:33:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.946+0000 7ff3c8792740 1 -- 172.21.15.50:0/4085901239 wait complete. 2024-06-06T03:33:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.947+0000 7ff3c8792740 1 -- start start 2024-06-06T03:33:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.947+0000 7ff3c8792740 1 Processor -- start 2024-06-06T03:33:42.947 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.948+0000 7ff3c8792740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5570f34e8200 0x5570f34f6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:42.947 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.948+0000 7ff3c8792740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f34e8bf0 0x5570f34f7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:42.947 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.948+0000 7ff3c8792740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5570f34edd60 0x5570f34f82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:42.947 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.948+0000 7ff3c8792740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ac00e2c0 con 0x5570f34e8200 2024-06-06T03:33:42.947 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.948+0000 7ff3c8792740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ac00f730 con 0x5570f34edd60 2024-06-06T03:33:42.948 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.948+0000 7ff3c8792740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ac00e990 con 0x5570f34e8bf0 2024-06-06T03:33:42.948 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.949+0000 7ff3c8792740 10 client.0 _ll_register_callbacks cb 0x7ff3b4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:33:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.949+0000 7ff3be7fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f34e8bf0 0x5570f34f7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.951+0000 7ff3be7fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f34e8bf0 0x5570f34f7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:52572/0 (socket says 172.21.15.50:52572) 2024-06-06T03:33:42.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.951+0000 7ff3be7fc640 1 -- 172.21.15.50:0/133133924 learned_addr learned my addr 172.21.15.50:0/133133924 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:42.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.951+0000 7ff3bf7fe640 1 --2- 172.21.15.50:0/133133924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5570f34edd60 0x5570f34f82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:42.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.951+0000 7ff3be7fc640 1 -- 172.21.15.50:0/133133924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5570f34edd60 msgr2=0x5570f34f82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:42.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.951+0000 7ff3be7fc640 1 --2- 172.21.15.50:0/133133924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5570f34edd60 0x5570f34f82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:42.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.951+0000 7ff3be7fc640 1 -- 172.21.15.50:0/133133924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5570f34e8200 msgr2=0x5570f34f6d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:33:42.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.951+0000 7ff3be7fc640 1 --2- 172.21.15.50:0/133133924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5570f34e8200 0x5570f34f6d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:42.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.951+0000 7ff3be7fc640 1 -- 172.21.15.50:0/133133924 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570f34f8890 con 0x5570f34e8bf0 2024-06-06T03:33:42.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.952+0000 7ff3be7fc640 1 --2- 172.21.15.50:0/133133924 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f34e8bf0 0x5570f34f7290 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4005940 tx=0x7ff3b4009600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac5648ff784e9652 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:42.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.953+0000 7ff39effd640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:33:42.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.953+0000 7ff39effd640 1 -- 172.21.15.50:0/133133924 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4009030 con 0x5570f34e8bf0 2024-06-06T03:33:42.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.953+0000 7ff39effd640 1 -- 172.21.15.50:0/133133924 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7ff3b4027040 con 0x5570f34e8bf0 2024-06-06T03:33:42.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.954+0000 7ff3c8792740 1 -- 172.21.15.50:0/133133924 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5570f345ef10 con 0x5570f34e8bf0 2024-06-06T03:33:42.955 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.955+0000 7ff39effd640 1 -- 172.21.15.50:0/133133924 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7ff3b401f970 con 0x5570f34e8bf0 2024-06-06T03:33:42.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.958+0000 7ff3c8792740 10 client.26023 fetch_fsmap learned FSMap version 33 2024-06-06T03:33:42.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.958+0000 7ff3c8792740 1 -- 172.21.15.50:0/133133924 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5570f34f9bd0 con 0x5570f34e8bf0 2024-06-06T03:33:42.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.959+0000 7ff39effd640 1 -- 172.21.15.50:0/133133924 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x5570f345ef10 con 0x5570f34e8bf0 2024-06-06T03:33:42.961 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.961+0000 7ff39effd640 1 -- 172.21.15.50:0/133133924 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7ff3b4021970 con 0x5570f34e8bf0 2024-06-06T03:33:42.961 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.962+0000 7ff3c8792740 10 client.26023 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:33:42.961 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.962+0000 7ff3c8792740 10 client.26023 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:33:42.961 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.962+0000 7ff3c8792740 20 client.26023 populate_metadata read hostname 'smithi050' 2024-06-06T03:33:42.961 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.962+0000 7ff3c8792740 1 --2- 172.21.15.50:0/133133924 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5570f3569680 0x5570f356baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:42.961 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.962+0000 7ff3c8792740 4 client.26023 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:33:42.961 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.962+0000 7ff3c8792740 1 -- 172.21.15.50:0/133133924 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5570f3458c20 con 0x5570f3569680 2024-06-06T03:33:42.962 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.963+0000 7ff3beffd640 1 --2- 172.21.15.50:0/133133924 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5570f3569680 0x5570f356baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:42.973 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.974+0000 7ff3beffd640 1 --2- 172.21.15.50:0/133133924 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5570f3569680 0x5570f356baa0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a971ce7c3791ded7 server_cookie=809a70793434bd6f in_seq=0 out_seq=0 2024-06-06T03:33:42.977 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.977+0000 7ff39effd640 10 client.26023 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:33:42.982 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.983+0000 7ff39effd640 1 -- 172.21.15.50:0/133133924 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5570f3458c20 con 0x5570f3569680 2024-06-06T03:33:42.982 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.983+0000 7ff39effd640 10 client.26023 handle_command_reply: tid=0 2024-06-06T03:33:42.983 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.983+0000 7ff3c8792740 1 client.26023 shutdown 2024-06-06T03:33:42.985 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.984+0000 7ff3c8792740 1 -- 172.21.15.50:0/133133924 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f34e8bf0 msgr2=0x5570f34f7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:42.985 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.984+0000 7ff3c8792740 1 --2- 172.21.15.50:0/133133924 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f34e8bf0 0x5570f34f7290 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4005940 tx=0x7ff3b4009600 comp rx=0 tx=0).stop 2024-06-06T03:33:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.984+0000 7ff3c8792740 1 -- 172.21.15.50:0/133133924 shutdown_connections 2024-06-06T03:33:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.984+0000 7ff3c8792740 1 --2- 172.21.15.50:0/133133924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5570f34edd60 0x5570f34f82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.984+0000 7ff3c8792740 1 --2- 172.21.15.50:0/133133924 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f34e8bf0 0x5570f34f7290 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.984+0000 7ff3c8792740 1 --2- 172.21.15.50:0/133133924 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5570f3569680 0x5570f356baa0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.984+0000 7ff3c8792740 1 --2- 172.21.15.50:0/133133924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5570f34e8200 0x5570f34f6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.984+0000 7ff3c8792740 1 -- 172.21.15.50:0/133133924 >> 172.21.15.50:0/133133924 conn(0x5570f34e3870 msgr2=0x5570f34e9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.985+0000 7ff39effd640 0 client.26023 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:33:42.988 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.987+0000 7ff3c8792740 1 -- 172.21.15.50:0/133133924 shutdown_connections 2024-06-06T03:33:42.988 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.988+0000 7ff3c8792740 1 -- 172.21.15.50:0/133133924 wait complete. 2024-06-06T03:33:42.988 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:42.989+0000 7ff3c8792740 20 client.26023 trim_cache size 0 max 16384 2024-06-06T03:33:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:33:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:33:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:33:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:43.005+0000 7ff3bffff640 1 -- 172.21.15.50:0/2798447595 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff3a80a2c00 msgr2=0x7ff3a80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:43.005+0000 7ff3bffff640 1 --2- 172.21.15.50:0/2798447595 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff3a80a2c00 0x7ff3a80a50c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff3b40137b0 tx=0x7ff3b4009a90 comp rx=0 tx=0).stop 2024-06-06T03:33:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:43.005+0000 7ff3bffff640 1 -- 172.21.15.50:0/2798447595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3c0109970 msgr2=0x7ff3c01ade10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:43.005+0000 7ff3bffff640 1 --2- 172.21.15.50:0/2798447595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3c0109970 0x7ff3c01ade10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff3b000d750 tx=0x7ff3b000dc10 comp rx=0 tx=0).stop 2024-06-06T03:33:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:43.005+0000 7ff3bffff640 1 -- 172.21.15.50:0/2798447595 shutdown_connections 2024-06-06T03:33:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:43.005+0000 7ff3bffff640 1 --2- 172.21.15.50:0/2798447595 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7ff3a80a2c00 0x7ff3a80a50c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:43.005+0000 7ff3bffff640 1 --2- 172.21.15.50:0/2798447595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3c0108fb0 0x7ff3c01a6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:43.005+0000 7ff3bffff640 1 --2- 172.21.15.50:0/2798447595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3c0109970 0x7ff3c01ade10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:43.005+0000 7ff3bffff640 1 --2- 172.21.15.50:0/2798447595 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3c0072cd0 0x7ff3c01a6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:43.005+0000 7ff3bffff640 1 -- 172.21.15.50:0/2798447595 >> 172.21.15.50:0/2798447595 conn(0x7ff3c006e840 msgr2=0x7ff3c0070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:43.008+0000 7ff3bffff640 1 -- 172.21.15.50:0/2798447595 shutdown_connections 2024-06-06T03:33:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:43.009+0000 7ff3bffff640 1 -- 172.21.15.50:0/2798447595 wait complete. 2024-06-06T03:33:43.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:43 smithi079 ceph-mon[35478]: pgmap v643: 129 pgs: 129 active+clean; 10 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 35 MiB/s wr, 638 op/s 2024-06-06T03:33:43.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:43 smithi122 ceph-mon[35759]: pgmap v643: 129 pgs: 129 active+clean; 10 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 35 MiB/s wr, 638 op/s 2024-06-06T03:33:43.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:43 smithi050 ceph-mon[32421]: pgmap v643: 129 pgs: 129 active+clean; 10 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 35 MiB/s wr, 638 op/s 2024-06-06T03:33:44.638 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-06T03:33:45.275 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:33:45.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:45 smithi079 ceph-mon[35478]: pgmap v644: 129 pgs: 129 active+clean; 10 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 36 MiB/s wr, 657 op/s 2024-06-06T03:33:45.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:45 smithi122 ceph-mon[35759]: pgmap v644: 129 pgs: 129 active+clean; 10 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 36 MiB/s wr, 657 op/s 2024-06-06T03:33:45.453 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:45 smithi050 ceph-mon[32421]: pgmap v644: 129 pgs: 129 active+clean; 10 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 36 MiB/s wr, 657 op/s 2024-06-06T03:33:47.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:47 smithi079 ceph-mon[35478]: pgmap v645: 129 pgs: 129 active+clean; 10 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 42 MiB/s wr, 776 op/s 2024-06-06T03:33:47.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:47 smithi122 ceph-mon[35759]: pgmap v645: 129 pgs: 129 active+clean; 10 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 42 MiB/s wr, 776 op/s 2024-06-06T03:33:47.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:47 smithi050 ceph-mon[32421]: pgmap v645: 129 pgs: 129 active+clean; 10 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 42 MiB/s wr, 776 op/s 2024-06-06T03:33:48.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.135+0000 7fdf1b35e700 1 -- 172.21.15.50:0/816584966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf1411bc70 msgr2=0x7fdf1411e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:48.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.137+0000 7fdf1b35e700 1 --2- 172.21.15.50:0/816584966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf1411bc70 0x7fdf1411e060 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c00b0a0 tx=0x7fdf0c00b3b0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.137+0000 7fdf1b35e700 1 -- 172.21.15.50:0/816584966 shutdown_connections 2024-06-06T03:33:48.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.137+0000 7fdf1b35e700 1 --2- 172.21.15.50:0/816584966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf1411bc70 0x7fdf1411e060 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.137+0000 7fdf1b35e700 1 --2- 172.21.15.50:0/816584966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf14110b80 0x7fdf14109490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.137+0000 7fdf1b35e700 1 --2- 172.21.15.50:0/816584966 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf14110ff0 0x7fdf141099d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.137+0000 7fdf1b35e700 1 -- 172.21.15.50:0/816584966 >> 172.21.15.50:0/816584966 conn(0x7fdf1406d470 msgr2=0x7fdf1406d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:48.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.143+0000 7fdf1b35e700 1 -- 172.21.15.50:0/816584966 shutdown_connections 2024-06-06T03:33:48.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.143+0000 7fdf1b35e700 1 -- 172.21.15.50:0/816584966 wait complete. 2024-06-06T03:33:48.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.144+0000 7fdf1b35e700 1 Processor -- start 2024-06-06T03:33:48.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.144+0000 7fdf1b35e700 1 -- start start 2024-06-06T03:33:48.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.145+0000 7fdf1b35e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf14110b80 0x7fdf141ad5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:48.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.145+0000 7fdf1b35e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf14110ff0 0x7fdf141adb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:48.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.145+0000 7fdf1b35e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf1411bc70 0x7fdf141a76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:48.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.145+0000 7fdf190fa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf14110b80 0x7fdf141ad5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:48.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.145+0000 7fdf190fa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf14110b80 0x7fdf141ad5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:56766/0 (socket says 172.21.15.50:56766) 2024-06-06T03:33:48.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.145+0000 7fdf190fa700 1 -- 172.21.15.50:0/3914518266 learned_addr learned my addr 172.21.15.50:0/3914518266 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:48.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.145+0000 7fdf1b35e700 1 -- 172.21.15.50:0/3914518266 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdf141213f0 con 0x7fdf1411bc70 2024-06-06T03:33:48.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.145+0000 7fdf1b35e700 1 -- 172.21.15.50:0/3914518266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdf14121270 con 0x7fdf14110b80 2024-06-06T03:33:48.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.145+0000 7fdf1b35e700 1 -- 172.21.15.50:0/3914518266 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdf14121570 con 0x7fdf14110ff0 2024-06-06T03:33:48.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.148+0000 7fdf198fb700 1 --2- 172.21.15.50:0/3914518266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf1411bc70 0x7fdf141a76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:48.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.148+0000 7fdf188f9700 1 --2- 172.21.15.50:0/3914518266 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf14110ff0 0x7fdf141adb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:48.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.148+0000 7fdf198fb700 1 -- 172.21.15.50:0/3914518266 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf14110ff0 msgr2=0x7fdf141adb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:48.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.148+0000 7fdf198fb700 1 --2- 172.21.15.50:0/3914518266 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf14110ff0 0x7fdf141adb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.148+0000 7fdf198fb700 1 -- 172.21.15.50:0/3914518266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf14110b80 msgr2=0x7fdf141ad5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:48.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.148+0000 7fdf198fb700 1 --2- 172.21.15.50:0/3914518266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf14110b80 0x7fdf141ad5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.148+0000 7fdf198fb700 1 -- 172.21.15.50:0/3914518266 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf141a7f90 con 0x7fdf1411bc70 2024-06-06T03:33:48.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.149+0000 7fdf198fb700 1 --2- 172.21.15.50:0/3914518266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf1411bc70 0x7fdf141a76b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c009fd0 tx=0x7fdf0c004d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:48.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.151+0000 7fdf0a7fc700 1 -- 172.21.15.50:0/3914518266 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c021070 con 0x7fdf1411bc70 2024-06-06T03:33:48.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.151+0000 7fdf1b35e700 1 -- 172.21.15.50:0/3914518266 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf141a8220 con 0x7fdf1411bc70 2024-06-06T03:33:48.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.151+0000 7fdf1b35e700 1 -- 172.21.15.50:0/3914518266 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf141b4560 con 0x7fdf1411bc70 2024-06-06T03:33:48.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.151+0000 7fdf0a7fc700 1 -- 172.21.15.50:0/3914518266 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdf0c007b80 con 0x7fdf1411bc70 2024-06-06T03:33:48.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.151+0000 7fdf0a7fc700 1 -- 172.21.15.50:0/3914518266 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c01de60 con 0x7fdf1411bc70 2024-06-06T03:33:48.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.162+0000 7fdf25be1b80 1 Processor -- start 2024-06-06T03:33:48.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.164+0000 7fdf25be1b80 1 -- start start 2024-06-06T03:33:48.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.165+0000 7fdf0a7fc700 1 -- 172.21.15.50:0/3914518266 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fdf0c024070 con 0x7fdf1411bc70 2024-06-06T03:33:48.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.165+0000 7fdf25be1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561adc4518f0 0x561adc451cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:48.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.165+0000 7fdf25be1b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561adc452210 0x561adc44bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:48.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.165+0000 7fdf25be1b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561adc44c080 0x561adc44c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:48.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.165+0000 7fdf25be1b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561adc39d810 con 0x561adc44c080 2024-06-06T03:33:48.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.165+0000 7fdf25be1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561adc345720 con 0x561adc4518f0 2024-06-06T03:33:48.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.165+0000 7fdf25be1b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561adc3997d0 con 0x561adc452210 2024-06-06T03:33:48.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.165+0000 7fdf188f9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561adc4518f0 0x561adc451cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:48.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.165+0000 7fdf188f9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561adc4518f0 0x561adc451cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:56772/0 (socket says 172.21.15.50:56772) 2024-06-06T03:33:48.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.165+0000 7fdf188f9700 1 -- 172.21.15.50:0/2103195910 learned_addr learned my addr 172.21.15.50:0/2103195910 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:48.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.165+0000 7fdf190fa700 1 --2- 172.21.15.50:0/2103195910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561adc452210 0x561adc44bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:48.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.166+0000 7fdf0a7fc700 1 --2- 172.21.15.50:0/3914518266 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fdf000a2e20 0x7fdf000a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:48.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.166+0000 7fdf198fb700 1 --2- 172.21.15.50:0/3914518266 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fdf000a2e20 0x7fdf000a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:48.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.166+0000 7fdf0a7fc700 1 -- 172.21.15.50:0/3914518266 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fdf0c0d06d0 con 0x7fdf1411bc70 2024-06-06T03:33:48.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.167+0000 7fdf188f9700 1 -- 172.21.15.50:0/2103195910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561adc452210 msgr2=0x561adc44bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:48.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.167+0000 7fdf188f9700 1 --2- 172.21.15.50:0/2103195910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561adc452210 0x561adc44bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.167+0000 7fdf188f9700 1 -- 172.21.15.50:0/2103195910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561adc44c080 msgr2=0x561adc44c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:48.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.167+0000 7fdf188f9700 1 --2- 172.21.15.50:0/2103195910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561adc44c080 0x561adc44c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.167+0000 7fdf188f9700 1 -- 172.21.15.50:0/2103195910 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561adc33bf50 con 0x561adc4518f0 2024-06-06T03:33:48.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.167+0000 7fdf188f9700 1 --2- 172.21.15.50:0/2103195910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561adc4518f0 0x561adc451cd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdf0400ccf0 tx=0x7fdf040113e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f93f3f26699cc66e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:48.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.168+0000 7fdf198fb700 1 --2- 172.21.15.50:0/3914518266 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fdf000a2e20 0x7fdf000a52e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c004fd0 tx=0x7fdf0c009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:48.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.168+0000 7fdeff7fe700 1 -- 172.21.15.50:0/2103195910 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf04011d10 con 0x561adc4518f0 2024-06-06T03:33:48.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.168+0000 7fdeff7fe700 1 -- 172.21.15.50:0/2103195910 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdf04016030 con 0x561adc4518f0 2024-06-06T03:33:48.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.168+0000 7fdeff7fe700 1 -- 172.21.15.50:0/2103195910 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0400f6a0 con 0x561adc4518f0 2024-06-06T03:33:48.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.169+0000 7fdf25be1b80 1 -- 172.21.15.50:0/2103195910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561adc4518f0 msgr2=0x561adc451cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:48.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.169+0000 7fdf25be1b80 1 --2- 172.21.15.50:0/2103195910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561adc4518f0 0x561adc451cd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdf0400ccf0 tx=0x7fdf040113e0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.173+0000 7fdf25be1b80 1 -- 172.21.15.50:0/2103195910 shutdown_connections 2024-06-06T03:33:48.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.173+0000 7fdf25be1b80 1 --2- 172.21.15.50:0/2103195910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561adc44c080 0x561adc44c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.173+0000 7fdf25be1b80 1 --2- 172.21.15.50:0/2103195910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561adc4518f0 0x561adc451cd0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.173+0000 7fdf25be1b80 1 --2- 172.21.15.50:0/2103195910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561adc452210 0x561adc44bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.173+0000 7fdf25be1b80 1 -- 172.21.15.50:0/2103195910 >> 172.21.15.50:0/2103195910 conn(0x561adc376cc0 msgr2=0x561adc446af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:48.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.173+0000 7fdf25be1b80 1 -- 172.21.15.50:0/2103195910 shutdown_connections 2024-06-06T03:33:48.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.173+0000 7fdf25be1b80 1 -- 172.21.15.50:0/2103195910 wait complete. 2024-06-06T03:33:48.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.174+0000 7fdf25be1b80 1 -- start start 2024-06-06T03:33:48.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.174+0000 7fdf25be1b80 1 Processor -- start 2024-06-06T03:33:48.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.174+0000 7fdf25be1b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561adc44c080 0x561adc457ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:48.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.174+0000 7fdf25be1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561adc4518f0 0x561adc4551d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:48.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.174+0000 7fdf25be1b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561adc452210 0x561adc455710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:48.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.174+0000 7fdf25be1b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561adc458bd0 con 0x561adc452210 2024-06-06T03:33:48.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.174+0000 7fdf25be1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561adc33dbf0 con 0x561adc4518f0 2024-06-06T03:33:48.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.174+0000 7fdf25be1b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561adc458d50 con 0x561adc44c080 2024-06-06T03:33:48.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.174+0000 7fdf25be1b80 10 client.0 _ll_register_callbacks cb 0x561adc337920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:33:48.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.175+0000 7fdf188f9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561adc452210 0x561adc455710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:48.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.175+0000 7fdf188f9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561adc452210 0x561adc455710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36098/0 (socket says 172.21.15.50:36098) 2024-06-06T03:33:48.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.175+0000 7fdf188f9700 1 -- 172.21.15.50:0/1939537579 learned_addr learned my addr 172.21.15.50:0/1939537579 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:48.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.175+0000 7fdf188f9700 1 --2- 172.21.15.50:0/1939537579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561adc44c080 0x561adc457ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:48.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.175+0000 7fdf190fa700 1 --2- 172.21.15.50:0/1939537579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561adc4518f0 0x561adc4551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:48.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.175+0000 7fdf188f9700 1 -- 172.21.15.50:0/1939537579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561adc44c080 msgr2=0x561adc457ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:48.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.175+0000 7fdf188f9700 1 --2- 172.21.15.50:0/1939537579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561adc44c080 0x561adc457ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.175+0000 7fdf188f9700 1 -- 172.21.15.50:0/1939537579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561adc4518f0 msgr2=0x561adc4551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:48.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.175+0000 7fdf188f9700 1 --2- 172.21.15.50:0/1939537579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561adc4518f0 0x561adc4551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.175+0000 7fdf188f9700 1 -- 172.21.15.50:0/1939537579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561adc2ec8d0 con 0x561adc452210 2024-06-06T03:33:48.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.176+0000 7fdf188f9700 1 --2- 172.21.15.50:0/1939537579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561adc452210 0x561adc455710 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fdf04012fa0 tx=0x7fdf04005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46dd850fd72409c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:48.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.176+0000 7fdefcff9700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:33:48.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.179+0000 7fdefcff9700 1 -- 172.21.15.50:0/1939537579 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf04011d90 con 0x561adc452210 2024-06-06T03:33:48.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.179+0000 7fdf25be1b80 1 -- 172.21.15.50:0/1939537579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf04016030 con 0x561adc452210 2024-06-06T03:33:48.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.179+0000 7fdefcff9700 1 -- 172.21.15.50:0/1939537579 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fdf04004030 con 0x561adc452210 2024-06-06T03:33:48.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.183+0000 7fdefcff9700 1 -- 172.21.15.50:0/1939537579 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fdf04004230 con 0x561adc452210 2024-06-06T03:33:48.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.185+0000 7fdf25be1b80 10 client.16404 fetch_fsmap learned FSMap version 33 2024-06-06T03:33:48.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.185+0000 7fdf25be1b80 1 -- 172.21.15.50:0/1939537579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x561adc463530 con 0x561adc452210 2024-06-06T03:33:48.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.186+0000 7fdefcff9700 1 -- 172.21.15.50:0/1939537579 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdf04016030 con 0x561adc452210 2024-06-06T03:33:48.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.188+0000 7fdefcff9700 1 -- 172.21.15.50:0/1939537579 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fdf04012450 con 0x561adc452210 2024-06-06T03:33:48.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.188+0000 7fdf25be1b80 10 client.16404 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:33:48.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.188+0000 7fdf25be1b80 10 client.16404 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:33:48.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.188+0000 7fdf25be1b80 20 client.16404 populate_metadata read hostname 'smithi050' 2024-06-06T03:33:48.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.188+0000 7fdf25be1b80 1 --2- 172.21.15.50:0/1939537579 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561adc465ed0 0x561adc4682f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:48.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.188+0000 7fdf25be1b80 4 client.16404 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:33:48.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.188+0000 7fdf25be1b80 1 -- 172.21.15.50:0/1939537579 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561adc3aad10 con 0x561adc465ed0 2024-06-06T03:33:48.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.191+0000 7fdf190fa700 1 --2- 172.21.15.50:0/1939537579 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561adc465ed0 0x561adc4682f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:48.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.197+0000 7fdf190fa700 1 --2- 172.21.15.50:0/1939537579 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561adc465ed0 0x561adc4682f0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b58d8fbbeb7b87d server_cookie=c0a8de569a99de9d in_seq=0 out_seq=0 2024-06-06T03:33:48.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.197+0000 7fdefcff9700 10 client.16404 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:33:48.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.199+0000 7fdefcff9700 1 -- 172.21.15.50:0/1939537579 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x561adc3aad10 con 0x561adc465ed0 2024-06-06T03:33:48.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.199+0000 7fdefcff9700 10 client.16404 handle_command_reply: tid=0 2024-06-06T03:33:48.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.200+0000 7fdf25be1b80 1 client.16404 shutdown 2024-06-06T03:33:48.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.203+0000 7fdf25be1b80 1 -- 172.21.15.50:0/1939537579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561adc452210 msgr2=0x561adc455710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:48.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.203+0000 7fdf25be1b80 1 --2- 172.21.15.50:0/1939537579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561adc452210 0x561adc455710 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fdf04012fa0 tx=0x7fdf04005d80 comp rx=0 tx=0).stop 2024-06-06T03:33:48.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.203+0000 7fdf25be1b80 1 -- 172.21.15.50:0/1939537579 shutdown_connections 2024-06-06T03:33:48.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.203+0000 7fdf25be1b80 1 --2- 172.21.15.50:0/1939537579 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561adc465ed0 0x561adc4682f0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.203+0000 7fdf25be1b80 1 --2- 172.21.15.50:0/1939537579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561adc452210 0x561adc455710 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.203+0000 7fdf25be1b80 1 --2- 172.21.15.50:0/1939537579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561adc44c080 0x561adc457ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.203+0000 7fdf25be1b80 1 --2- 172.21.15.50:0/1939537579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561adc4518f0 0x561adc4551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.203+0000 7fdf25be1b80 1 -- 172.21.15.50:0/1939537579 >> 172.21.15.50:0/1939537579 conn(0x561adc376cc0 msgr2=0x561adc44ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:48.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.204+0000 7fdefcff9700 0 client.16404 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:33:48.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.204+0000 7fdf25be1b80 1 -- 172.21.15.50:0/1939537579 shutdown_connections 2024-06-06T03:33:48.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.206+0000 7fdf25be1b80 1 -- 172.21.15.50:0/1939537579 wait complete. 2024-06-06T03:33:48.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.206+0000 7fdf25be1b80 20 client.16404 trim_cache size 0 max 16384 2024-06-06T03:33:48.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.257+0000 7fdf25be1b80 1 Processor -- start 2024-06-06T03:33:48.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.258+0000 7fdf25be1b80 1 -- start start 2024-06-06T03:33:48.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.258+0000 7fdf25be1b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561adc44c080 0x561adc44bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:48.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.258+0000 7fdf25be1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561adc4518f0 0x561adc452620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:48.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.258+0000 7fdf25be1b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561adc452210 0x561adc452b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:48.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.258+0000 7fdf25be1b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdef8022310 con 0x561adc452210 2024-06-06T03:33:48.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.258+0000 7fdf25be1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdef801fba0 con 0x561adc4518f0 2024-06-06T03:33:48.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.258+0000 7fdf25be1b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdef801d9f0 con 0x561adc44c080 2024-06-06T03:33:48.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.258+0000 7fdf188f9700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561adc44c080 0x561adc44bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:48.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.258+0000 7fdf188f9700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561adc44c080 0x561adc44bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:53468/0 (socket says 172.21.15.50:53468) 2024-06-06T03:33:48.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.258+0000 7fdf188f9700 1 -- 172.21.15.50:0/1575429425 learned_addr learned my addr 172.21.15.50:0/1575429425 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:48.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.258+0000 7fdf188f9700 1 --2- 172.21.15.50:0/1575429425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561adc452210 0x561adc452b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:48.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.259+0000 7fdf190fa700 1 --2- 172.21.15.50:0/1575429425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561adc4518f0 0x561adc452620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:48.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.259+0000 7fdf188f9700 1 -- 172.21.15.50:0/1575429425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561adc4518f0 msgr2=0x561adc452620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:48.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.259+0000 7fdf188f9700 1 --2- 172.21.15.50:0/1575429425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561adc4518f0 0x561adc452620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.259+0000 7fdf188f9700 1 -- 172.21.15.50:0/1575429425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561adc452210 msgr2=0x561adc452b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:48.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.259+0000 7fdf188f9700 1 --2- 172.21.15.50:0/1575429425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561adc452210 0x561adc452b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.259+0000 7fdf188f9700 1 -- 172.21.15.50:0/1575429425 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561adc453740 con 0x561adc44c080 2024-06-06T03:33:48.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.259+0000 7fdf188f9700 1 --2- 172.21.15.50:0/1575429425 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561adc44c080 0x561adc44bb40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdf04012fd0 tx=0x7fdf04014040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdca95b587314c5 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:48.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.261+0000 7fdefeffd700 1 -- 172.21.15.50:0/1575429425 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf04011dc0 con 0x561adc44c080 2024-06-06T03:33:48.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.262+0000 7fdefeffd700 1 -- 172.21.15.50:0/1575429425 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdf04016040 con 0x561adc44c080 2024-06-06T03:33:48.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.262+0000 7fdefeffd700 1 -- 172.21.15.50:0/1575429425 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf04012970 con 0x561adc44c080 2024-06-06T03:33:48.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.263+0000 7fdf25be1b80 1 -- 172.21.15.50:0/1575429425 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561adc44c080 msgr2=0x561adc44bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:48.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.263+0000 7fdf25be1b80 1 --2- 172.21.15.50:0/1575429425 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561adc44c080 0x561adc44bb40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdf04012fd0 tx=0x7fdf04014040 comp rx=0 tx=0).stop 2024-06-06T03:33:48.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.263+0000 7fdf25be1b80 1 -- 172.21.15.50:0/1575429425 shutdown_connections 2024-06-06T03:33:48.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.263+0000 7fdf25be1b80 1 --2- 172.21.15.50:0/1575429425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561adc452210 0x561adc452b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.263+0000 7fdf25be1b80 1 --2- 172.21.15.50:0/1575429425 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561adc44c080 0x561adc44bb40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.263+0000 7fdf25be1b80 1 --2- 172.21.15.50:0/1575429425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561adc4518f0 0x561adc452620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.263+0000 7fdf25be1b80 1 -- 172.21.15.50:0/1575429425 >> 172.21.15.50:0/1575429425 conn(0x561adc376cc0 msgr2=0x561adc4464e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:48.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.264+0000 7fdf25be1b80 1 -- 172.21.15.50:0/1575429425 shutdown_connections 2024-06-06T03:33:48.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.264+0000 7fdf25be1b80 1 -- 172.21.15.50:0/1575429425 wait complete. 2024-06-06T03:33:48.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.264+0000 7fdf25be1b80 1 -- start start 2024-06-06T03:33:48.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.265+0000 7fdf25be1b80 1 Processor -- start 2024-06-06T03:33:48.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.265+0000 7fdf25be1b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561adc44c080 0x561adc45e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:48.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.265+0000 7fdf25be1b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561adc4518f0 0x561adc45e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:48.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.265+0000 7fdf25be1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561adc452210 0x561adc46cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:48.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.265+0000 7fdf25be1b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdef801e060 con 0x561adc44c080 2024-06-06T03:33:48.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.265+0000 7fdf25be1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdef801f4d0 con 0x561adc452210 2024-06-06T03:33:48.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.265+0000 7fdf25be1b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdef801e730 con 0x561adc4518f0 2024-06-06T03:33:48.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.265+0000 7fdf25be1b80 10 client.0 _ll_register_callbacks cb 0x561adc337920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:33:48.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.266+0000 7fdf190fa700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561adc4518f0 0x561adc45e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:48.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.266+0000 7fdf190fa700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561adc4518f0 0x561adc45e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:53470/0 (socket says 172.21.15.50:53470) 2024-06-06T03:33:48.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.266+0000 7fdf190fa700 1 -- 172.21.15.50:0/4211220570 learned_addr learned my addr 172.21.15.50:0/4211220570 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:48.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.266+0000 7fdf188f9700 1 --2- 172.21.15.50:0/4211220570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561adc452210 0x561adc46cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:48.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.266+0000 7fdf190fa700 1 -- 172.21.15.50:0/4211220570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561adc452210 msgr2=0x561adc46cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:48.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.266+0000 7fdf190fa700 1 --2- 172.21.15.50:0/4211220570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561adc452210 0x561adc46cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.266+0000 7fdf190fa700 1 -- 172.21.15.50:0/4211220570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561adc44c080 msgr2=0x561adc45e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:48.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.266+0000 7fdf190fa700 1 --2- 172.21.15.50:0/4211220570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561adc44c080 0x561adc45e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.266+0000 7fdf190fa700 1 -- 172.21.15.50:0/4211220570 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561adc46d670 con 0x561adc4518f0 2024-06-06T03:33:48.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.266+0000 7fdf190fa700 1 --2- 172.21.15.50:0/4211220570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561adc4518f0 0x561adc45e790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x561adc448730 tx=0x7fdf10011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ae825a732600695 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:48.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.266+0000 7fdefcff9700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:33:48.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.268+0000 7fdefcff9700 1 -- 172.21.15.50:0/4211220570 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf10004220 con 0x561adc4518f0 2024-06-06T03:33:48.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.268+0000 7fdefcff9700 1 -- 172.21.15.50:0/4211220570 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fdf100043c0 con 0x561adc4518f0 2024-06-06T03:33:48.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.268+0000 7fdf25be1b80 1 -- 172.21.15.50:0/4211220570 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf04016040 con 0x561adc4518f0 2024-06-06T03:33:48.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.269+0000 7fdefcff9700 1 -- 172.21.15.50:0/4211220570 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fdf10003680 con 0x561adc4518f0 2024-06-06T03:33:48.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.270+0000 7fdf25be1b80 10 client.26041 fetch_fsmap learned FSMap version 33 2024-06-06T03:33:48.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.270+0000 7fdf25be1b80 1 -- 172.21.15.50:0/4211220570 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x561adc4d05d0 con 0x561adc4518f0 2024-06-06T03:33:48.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.270+0000 7fdefcff9700 1 -- 172.21.15.50:0/4211220570 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdf04016040 con 0x561adc4518f0 2024-06-06T03:33:48.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.270+0000 7fdefcff9700 1 -- 172.21.15.50:0/4211220570 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fdf1001d7e0 con 0x561adc4518f0 2024-06-06T03:33:48.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.270+0000 7fdf25be1b80 10 client.26041 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:33:48.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.270+0000 7fdf25be1b80 10 client.26041 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:33:48.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.270+0000 7fdf25be1b80 20 client.26041 populate_metadata read hostname 'smithi050' 2024-06-06T03:33:48.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.270+0000 7fdf25be1b80 1 --2- 172.21.15.50:0/4211220570 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561adc4d0cc0 0x561adc4d30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:48.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.270+0000 7fdf25be1b80 4 client.26041 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-06T03:33:48.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.270+0000 7fdf25be1b80 1 -- 172.21.15.50:0/4211220570 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561adc3a5290 con 0x561adc4d0cc0 2024-06-06T03:33:48.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.271+0000 7fdf188f9700 1 --2- 172.21.15.50:0/4211220570 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561adc4d0cc0 0x561adc4d30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:48.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.290+0000 7fdf188f9700 1 --2- 172.21.15.50:0/4211220570 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561adc4d0cc0 0x561adc4d30e0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b63dc0c0477f0145 server_cookie=598591e9ba484e11 in_seq=0 out_seq=0 2024-06-06T03:33:48.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.290+0000 7fdefcff9700 10 client.26041 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:33:48.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.291+0000 7fdefcff9700 1 -- 172.21.15.50:0/4211220570 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561adc3a5290 con 0x561adc4d0cc0 2024-06-06T03:33:48.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.291+0000 7fdefcff9700 10 client.26041 handle_command_reply: tid=0 2024-06-06T03:33:48.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.291+0000 7fdf25be1b80 1 client.26041 shutdown 2024-06-06T03:33:48.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.295+0000 7fdf25be1b80 1 -- 172.21.15.50:0/4211220570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561adc4518f0 msgr2=0x561adc45e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:48.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.295+0000 7fdf25be1b80 1 --2- 172.21.15.50:0/4211220570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561adc4518f0 0x561adc45e790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x561adc448730 tx=0x7fdf10011720 comp rx=0 tx=0).stop 2024-06-06T03:33:48.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.295+0000 7fdf25be1b80 1 -- 172.21.15.50:0/4211220570 shutdown_connections 2024-06-06T03:33:48.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.295+0000 7fdf25be1b80 1 --2- 172.21.15.50:0/4211220570 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561adc4d0cc0 0x561adc4d30e0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.295+0000 7fdf25be1b80 1 --2- 172.21.15.50:0/4211220570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561adc452210 0x561adc46cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.295+0000 7fdf25be1b80 1 --2- 172.21.15.50:0/4211220570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561adc44c080 0x561adc45e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.295+0000 7fdf25be1b80 1 --2- 172.21.15.50:0/4211220570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561adc4518f0 0x561adc45e790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.295+0000 7fdf25be1b80 1 -- 172.21.15.50:0/4211220570 >> 172.21.15.50:0/4211220570 conn(0x561adc376cc0 msgr2=0x561adc43ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:48.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.295+0000 7fdefcff9700 0 client.26041 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:33:48.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.298+0000 7fdf25be1b80 1 -- 172.21.15.50:0/4211220570 shutdown_connections 2024-06-06T03:33:48.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.298+0000 7fdf25be1b80 1 -- 172.21.15.50:0/4211220570 wait complete. 2024-06-06T03:33:48.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.298+0000 7fdf25be1b80 20 client.26041 trim_cache size 0 max 16384 2024-06-06T03:33:48.299 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:33:48.299 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2024-06-06T03:33:48.299 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-06-06T03:33:48.299 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:33:48.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.303+0000 7fdf1b35e700 1 -- 172.21.15.50:0/3914518266 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fdf000a2e20 msgr2=0x7fdf000a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:48.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.303+0000 7fdf1b35e700 1 --2- 172.21.15.50:0/3914518266 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fdf000a2e20 0x7fdf000a52e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c004fd0 tx=0x7fdf0c009040 comp rx=0 tx=0).stop 2024-06-06T03:33:48.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.303+0000 7fdf1b35e700 1 -- 172.21.15.50:0/3914518266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf1411bc70 msgr2=0x7fdf141a76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:48.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.303+0000 7fdf1b35e700 1 --2- 172.21.15.50:0/3914518266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf1411bc70 0x7fdf141a76b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c009fd0 tx=0x7fdf0c004d70 comp rx=0 tx=0).stop 2024-06-06T03:33:48.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.304+0000 7fdf1b35e700 1 -- 172.21.15.50:0/3914518266 shutdown_connections 2024-06-06T03:33:48.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.304+0000 7fdf1b35e700 1 --2- 172.21.15.50:0/3914518266 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fdf000a2e20 0x7fdf000a52e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.304+0000 7fdf1b35e700 1 --2- 172.21.15.50:0/3914518266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf1411bc70 0x7fdf141a76b0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.304+0000 7fdf1b35e700 1 --2- 172.21.15.50:0/3914518266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf14110b80 0x7fdf141ad5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.304+0000 7fdf1b35e700 1 --2- 172.21.15.50:0/3914518266 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf14110ff0 0x7fdf141adb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:48.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.304+0000 7fdf1b35e700 1 -- 172.21.15.50:0/3914518266 >> 172.21.15.50:0/3914518266 conn(0x7fdf1406d470 msgr2=0x7fdf1410e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:48.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.305+0000 7fdf1b35e700 1 -- 172.21.15.50:0/3914518266 shutdown_connections 2024-06-06T03:33:48.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:48.305+0000 7fdf1b35e700 1 -- 172.21.15.50:0/3914518266 wait complete. 2024-06-06T03:33:49.193 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-06T03:33:49.194 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T03:33:49.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:49 smithi079 ceph-mon[35478]: pgmap v646: 129 pgs: 129 active+clean; 10 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 33 MiB/s wr, 609 op/s 2024-06-06T03:33:49.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:49 smithi122 ceph-mon[35759]: pgmap v646: 129 pgs: 129 active+clean; 10 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 33 MiB/s wr, 609 op/s 2024-06-06T03:33:49.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:49 smithi050 ceph-mon[32421]: pgmap v646: 129 pgs: 129 active+clean; 10 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 33 MiB/s wr, 609 op/s 2024-06-06T03:33:49.783 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:33:51.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:51 smithi079 ceph-mon[35478]: pgmap v647: 129 pgs: 129 active+clean; 10 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 43 MiB/s wr, 811 op/s 2024-06-06T03:33:51.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:51 smithi122 ceph-mon[35759]: pgmap v647: 129 pgs: 129 active+clean; 10 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 43 MiB/s wr, 811 op/s 2024-06-06T03:33:51.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:51 smithi050 ceph-mon[32421]: pgmap v647: 129 pgs: 129 active+clean; 10 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 43 MiB/s wr, 811 op/s 2024-06-06T03:33:52.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.007+0000 7f03ad63d700 1 -- 172.21.15.50:0/1871875822 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03a811bc70 msgr2=0x7f03a811e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:52.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.007+0000 7f03ad63d700 1 --2- 172.21.15.50:0/1871875822 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03a811bc70 0x7f03a811e060 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f03980098f0 tx=0x7f0398009c00 comp rx=0 tx=0).stop 2024-06-06T03:33:52.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.009+0000 7f03ad63d700 1 -- 172.21.15.50:0/1871875822 shutdown_connections 2024-06-06T03:33:52.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.009+0000 7f03ad63d700 1 --2- 172.21.15.50:0/1871875822 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03a811bc70 0x7f03a811e060 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:52.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.009+0000 7f03ad63d700 1 --2- 172.21.15.50:0/1871875822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03a8110c70 0x7f03a8109490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:52.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.009+0000 7f03ad63d700 1 --2- 172.21.15.50:0/1871875822 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03a81099d0 0x7f03a8109e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:52.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.009+0000 7f03ad63d700 1 -- 172.21.15.50:0/1871875822 >> 172.21.15.50:0/1871875822 conn(0x7f03a806d600 msgr2=0x7f03a806da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:52.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.010+0000 7f03ad63d700 1 -- 172.21.15.50:0/1871875822 shutdown_connections 2024-06-06T03:33:52.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.011+0000 7f03ad63d700 1 -- 172.21.15.50:0/1871875822 wait complete. 2024-06-06T03:33:52.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.012+0000 7f03ad63d700 1 Processor -- start 2024-06-06T03:33:52.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.012+0000 7f03ad63d700 1 -- start start 2024-06-06T03:33:52.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.012+0000 7f03ad63d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03a81099d0 0x7f03a811a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:52.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.012+0000 7f03ad63d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03a8110c70 0x7f03a8113470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:52.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.013+0000 7f03ad63d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03a811bc70 0x7f03a81139b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:52.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.013+0000 7f03ad63d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f03a8121500 con 0x7f03a8110c70 2024-06-06T03:33:52.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.013+0000 7f03ad63d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f03a8121380 con 0x7f03a811bc70 2024-06-06T03:33:52.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.013+0000 7f03ad63d700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f03a8121680 con 0x7f03a81099d0 2024-06-06T03:33:52.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.013+0000 7f03a6ffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03a81099d0 0x7f03a811a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:52.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.013+0000 7f03a6ffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03a81099d0 0x7f03a811a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:53486/0 (socket says 172.21.15.50:53486) 2024-06-06T03:33:52.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.013+0000 7f03a6ffd700 1 -- 172.21.15.50:0/14671804 learned_addr learned my addr 172.21.15.50:0/14671804 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:52.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.013+0000 7f03a77fe700 1 --2- 172.21.15.50:0/14671804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03a811bc70 0x7f03a81139b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:52.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.013+0000 7f03a67fc700 1 --2- 172.21.15.50:0/14671804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03a8110c70 0x7f03a8113470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:52.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.013+0000 7f03a6ffd700 1 -- 172.21.15.50:0/14671804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03a811bc70 msgr2=0x7f03a81139b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:52.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.013+0000 7f03a6ffd700 1 --2- 172.21.15.50:0/14671804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03a811bc70 0x7f03a81139b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:52.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.013+0000 7f03a6ffd700 1 -- 172.21.15.50:0/14671804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03a8110c70 msgr2=0x7f03a8113470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:52.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.013+0000 7f03a6ffd700 1 --2- 172.21.15.50:0/14671804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03a8110c70 0x7f03a8113470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:52.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.013+0000 7f03a6ffd700 1 -- 172.21.15.50:0/14671804 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a8114050 con 0x7f03a81099d0 2024-06-06T03:33:52.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.017+0000 7f03a6ffd700 1 --2- 172.21.15.50:0/14671804 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03a81099d0 0x7f03a811a390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f03a0007fa0 tx=0x7f03a000d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:52.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.019+0000 7f038ffff700 1 -- 172.21.15.50:0/14671804 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a001a070 con 0x7f03a81099d0 2024-06-06T03:33:52.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.019+0000 7f038ffff700 1 -- 172.21.15.50:0/14671804 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f03a000dda0 con 0x7f03a81099d0 2024-06-06T03:33:52.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.019+0000 7f038ffff700 1 -- 172.21.15.50:0/14671804 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a00146d0 con 0x7f03a81099d0 2024-06-06T03:33:52.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.020+0000 7f03ad63d700 1 -- 172.21.15.50:0/14671804 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03a8117ec0 con 0x7f03a81099d0 2024-06-06T03:33:52.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.020+0000 7f03ad63d700 1 -- 172.21.15.50:0/14671804 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03a8118380 con 0x7f03a81099d0 2024-06-06T03:33:52.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.027+0000 7f03ad63d700 1 -- 172.21.15.50:0/14671804 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03a806eb90 con 0x7f03a81099d0 2024-06-06T03:33:52.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.028+0000 7f038ffff700 1 -- 172.21.15.50:0/14671804 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f03a0015a40 con 0x7f03a81099d0 2024-06-06T03:33:52.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.030+0000 7f038ffff700 1 --2- 172.21.15.50:0/14671804 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f03900a2d70 0x7f03900a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:52.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.030+0000 7f038ffff700 1 -- 172.21.15.50:0/14671804 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f03a00cec30 con 0x7f03a81099d0 2024-06-06T03:33:52.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.033+0000 7f03a67fc700 1 --2- 172.21.15.50:0/14671804 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f03900a2d70 0x7f03900a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:52.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.037+0000 7f03a67fc700 1 --2- 172.21.15.50:0/14671804 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f03900a2d70 0x7f03900a5230 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f03a8114be0 tx=0x7f039c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:52.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.038+0000 7f038ffff700 1 -- 172.21.15.50:0/14671804 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f03a0010070 con 0x7f03a81099d0 2024-06-06T03:33:52.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.535+0000 7f03ad63d700 1 -- 172.21.15.50:0/14671804 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f03a8114950 con 0x7f03a81099d0 2024-06-06T03:33:52.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.536+0000 7f038ffff700 1 -- 172.21.15.50:0/14671804 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11855 (secure 0 0 0) 0x7f03a009b7b0 con 0x7f03a81099d0 2024-06-06T03:33:52.538 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:33:52.539 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1667847852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1667847852},{"type":"v1","addr":"172.21.15.50:6835","nonce":1667847852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/239971838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":239971838},{"type":"v1","addr":"172.21.15.50:6837","nonce":239971838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/2188134216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2188134216},{"type":"v1","addr":"172.21.15.50:6839","nonce":2188134216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/632572420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":632572420},{"type":"v1","addr":"172.21.15.50:6841","nonce":632572420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/864537078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":864537078},{"type":"v1","addr":"172.21.15.79:6833","nonce":864537078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/279268898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":279268898},{"type":"v1","addr":"172.21.15.79:6835","nonce":279268898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T03:22:36.202061+0000","modified":"2024-06-06T03:32:16.979722+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24490,"mds_1":24472,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/57533154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":57533154},{"type":"v1","addr":"172.21.15.122:6833","nonce":57533154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/3286722213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3286722213},{"type":"v1","addr":"172.21.15.79:6837","nonce":3286722213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/768067336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":768067336},{"type":"v1","addr":"172.21.15.79:6839","nonce":768067336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.122:6835/2987597320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2987597320},{"type":"v1","addr":"172.21.15.122:6835","nonce":2987597320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":23,"addr":"172.21.15.122:6837/1604366318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1604366318},{"type":"v1","addr":"172.21.15.122:6837","nonce":1604366318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6839/4129732900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":4129732900},{"type":"v1","addr":"172.21.15.122:6839","nonce":4129732900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24466,24472,24490]},"id":1}]} 2024-06-06T03:33:52.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.541+0000 7f03ad63d700 1 -- 172.21.15.50:0/14671804 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f03900a2d70 msgr2=0x7f03900a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:52.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.541+0000 7f03ad63d700 1 --2- 172.21.15.50:0/14671804 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f03900a2d70 0x7f03900a5230 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f03a8114be0 tx=0x7f039c009260 comp rx=0 tx=0).stop 2024-06-06T03:33:52.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.541+0000 7f03ad63d700 1 -- 172.21.15.50:0/14671804 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03a81099d0 msgr2=0x7f03a811a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:52.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.541+0000 7f03ad63d700 1 --2- 172.21.15.50:0/14671804 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03a81099d0 0x7f03a811a390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f03a0007fa0 tx=0x7f03a000d3b0 comp rx=0 tx=0).stop 2024-06-06T03:33:52.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.541+0000 7f03ad63d700 1 -- 172.21.15.50:0/14671804 shutdown_connections 2024-06-06T03:33:52.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.541+0000 7f03ad63d700 1 --2- 172.21.15.50:0/14671804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03a811bc70 0x7f03a81139b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:52.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.541+0000 7f03ad63d700 1 --2- 172.21.15.50:0/14671804 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03a81099d0 0x7f03a811a390 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:52.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.541+0000 7f03ad63d700 1 --2- 172.21.15.50:0/14671804 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f03900a2d70 0x7f03900a5230 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:52.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.541+0000 7f03ad63d700 1 --2- 172.21.15.50:0/14671804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03a8110c70 0x7f03a8113470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:52.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.541+0000 7f03ad63d700 1 -- 172.21.15.50:0/14671804 >> 172.21.15.50:0/14671804 conn(0x7f03a806d600 msgr2=0x7f03a8071030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:52.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.542+0000 7f03ad63d700 1 -- 172.21.15.50:0/14671804 shutdown_connections 2024-06-06T03:33:52.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:52.542+0000 7f03ad63d700 1 -- 172.21.15.50:0/14671804 wait complete. 2024-06-06T03:33:52.549 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 33 2024-06-06T03:33:53.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:53 smithi122 ceph-mon[35759]: pgmap v648: 129 pgs: 129 active+clean; 10 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 33 MiB/s wr, 623 op/s 2024-06-06T03:33:53.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:53 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/14671804' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:33:53.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:53 smithi050 ceph-mon[32421]: pgmap v648: 129 pgs: 129 active+clean; 10 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 33 MiB/s wr, 623 op/s 2024-06-06T03:33:53.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:53 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/14671804' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:33:53.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:53 smithi079 ceph-mon[35478]: pgmap v648: 129 pgs: 129 active+clean; 10 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 33 MiB/s wr, 623 op/s 2024-06-06T03:33:53.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:53 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/14671804' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:33:53.961 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-06-06T03:33:54.593 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:33:55.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:55 smithi122 ceph-mon[35759]: pgmap v649: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 34 MiB/s wr, 636 op/s 2024-06-06T03:33:55.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:55 smithi050 ceph-mon[32421]: pgmap v649: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 34 MiB/s wr, 636 op/s 2024-06-06T03:33:55.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:55 smithi079 ceph-mon[35478]: pgmap v649: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 34 MiB/s wr, 636 op/s 2024-06-06T03:33:56.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.289+0000 7fb0c359e640 1 -- 172.21.15.50:0/3060226352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0c4100a10 msgr2=0x7fb0c4100e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:56.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.289+0000 7fb0c359e640 1 --2- 172.21.15.50:0/3060226352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0c4100a10 0x7fb0c4100e70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8009900 tx=0x7fb0b802a440 comp rx=0 tx=0).stop 2024-06-06T03:33:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.297+0000 7fb0c359e640 1 -- 172.21.15.50:0/3060226352 shutdown_connections 2024-06-06T03:33:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.297+0000 7fb0c359e640 1 --2- 172.21.15.50:0/3060226352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0c41013b0 0x7fb0c4101830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.297+0000 7fb0c359e640 1 --2- 172.21.15.50:0/3060226352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0c4100a10 0x7fb0c4100e70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.297+0000 7fb0c359e640 1 --2- 172.21.15.50:0/3060226352 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0c41000b0 0x7fb0c41004d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.298 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.297+0000 7fb0c359e640 1 -- 172.21.15.50:0/3060226352 >> 172.21.15.50:0/3060226352 conn(0x7fb0c40fbcd0 msgr2=0x7fb0c40fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:56.298 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.298+0000 7fb0c359e640 1 -- 172.21.15.50:0/3060226352 shutdown_connections 2024-06-06T03:33:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.301+0000 7fb0c359e640 1 -- 172.21.15.50:0/3060226352 wait complete. 2024-06-06T03:33:56.304 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.302+0000 7fb0c359e640 1 Processor -- start 2024-06-06T03:33:56.304 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.302+0000 7fb0c359e640 1 -- start start 2024-06-06T03:33:56.304 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.302+0000 7fb0c359e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0c41000b0 0x7fb0c406e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.304 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.302+0000 7fb0c359e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0c4100a10 0x7fb0c406eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.304 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.302+0000 7fb0c359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0c41013b0 0x7fb0c410f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.304 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.302+0000 7fb0c359e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c4103f40 con 0x7fb0c41013b0 2024-06-06T03:33:56.304 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.302+0000 7fb0c359e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c4103dc0 con 0x7fb0c4100a10 2024-06-06T03:33:56.304 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.302+0000 7fb0c359e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c41040c0 con 0x7fb0c41000b0 2024-06-06T03:33:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.304+0000 7fb0c2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0c41013b0 0x7fb0c410f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.304+0000 7fb0c2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0c41013b0 0x7fb0c410f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36142/0 (socket says 172.21.15.50:36142) 2024-06-06T03:33:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.305+0000 7fb0c2d9d640 1 -- 172.21.15.50:0/818261330 learned_addr learned my addr 172.21.15.50:0/818261330 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.305+0000 7fb0c259c640 1 --2- 172.21.15.50:0/818261330 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0c41000b0 0x7fb0c406e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.305+0000 7fb0c1d9b640 1 --2- 172.21.15.50:0/818261330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0c4100a10 0x7fb0c406eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.309+0000 7fb0c259c640 1 -- 172.21.15.50:0/818261330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0c4100a10 msgr2=0x7fb0c406eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.309+0000 7fb0c259c640 1 --2- 172.21.15.50:0/818261330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0c4100a10 0x7fb0c406eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.309+0000 7fb0c259c640 1 -- 172.21.15.50:0/818261330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0c41013b0 msgr2=0x7fb0c410f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.309+0000 7fb0c259c640 1 --2- 172.21.15.50:0/818261330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0c41013b0 0x7fb0c410f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.309+0000 7fb0c259c640 1 -- 172.21.15.50:0/818261330 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c410ff50 con 0x7fb0c41000b0 2024-06-06T03:33:56.325 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.325+0000 7fb0c259c640 1 --2- 172.21.15.50:0/818261330 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0c41000b0 0x7fb0c406e640 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00ea20 tx=0x7fb0bc00eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:56.328 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.328+0000 7fb0b37fe640 1 -- 172.21.15.50:0/818261330 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc00cde0 con 0x7fb0c41000b0 2024-06-06T03:33:56.329 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.328+0000 7fb0c359e640 1 -- 172.21.15.50:0/818261330 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0c4110240 con 0x7fb0c41000b0 2024-06-06T03:33:56.329 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.328+0000 7fb0c359e640 1 -- 172.21.15.50:0/818261330 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0c4110760 con 0x7fb0c41000b0 2024-06-06T03:33:56.329 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.328+0000 7fb0b37fe640 1 -- 172.21.15.50:0/818261330 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb0bc011920 con 0x7fb0c41000b0 2024-06-06T03:33:56.329 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.328+0000 7fb0b37fe640 1 -- 172.21.15.50:0/818261330 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc01a950 con 0x7fb0c41000b0 2024-06-06T03:33:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.332+0000 7fb0cb611740 1 Processor -- start 2024-06-06T03:33:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.332+0000 7fb0cb611740 1 -- start start 2024-06-06T03:33:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.333+0000 7fb0cb611740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d10d36b1e0 0x55d10d36b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.333+0000 7fb0cb611740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d10d36bbd0 0x55d10d3706d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.333+0000 7fb0cb611740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10d370d40 0x55d10d3731d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.333+0000 7fb0cb611740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d10d2ce4f0 con 0x55d10d370d40 2024-06-06T03:33:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.333+0000 7fb0cb611740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d10d26c870 con 0x55d10d36bbd0 2024-06-06T03:33:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.333+0000 7fb0cb611740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d10d2ca4b0 con 0x55d10d36b1e0 2024-06-06T03:33:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.334+0000 7fb0c2d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d10d36b1e0 0x55d10d36b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.335+0000 7fb0c2d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d10d36b1e0 0x55d10d36b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:53500/0 (socket says 172.21.15.50:53500) 2024-06-06T03:33:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.335+0000 7fb0c2d9d640 1 -- 172.21.15.50:0/1398542305 learned_addr learned my addr 172.21.15.50:0/1398542305 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.335+0000 7fb0c2d9d640 1 -- 172.21.15.50:0/1398542305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d10d36bbd0 msgr2=0x55d10d3706d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:33:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.335+0000 7fb0c2d9d640 1 --2- 172.21.15.50:0/1398542305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d10d36bbd0 0x55d10d3706d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.335+0000 7fb0c2d9d640 1 -- 172.21.15.50:0/1398542305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10d370d40 msgr2=0x55d10d3731d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:33:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.335+0000 7fb0c2d9d640 1 --2- 172.21.15.50:0/1398542305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10d370d40 0x55d10d3731d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.335+0000 7fb0c2d9d640 1 -- 172.21.15.50:0/1398542305 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d10d2889b0 con 0x55d10d36b1e0 2024-06-06T03:33:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.335+0000 7fb0c2d9d640 1 --2- 172.21.15.50:0/1398542305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d10d36b1e0 0x55d10d36b600 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb0b400bd50 tx=0x7fb0b40107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c629964a8ff64f7 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.336+0000 7fb0b37fe640 1 -- 172.21.15.50:0/818261330 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb0bc01ab10 con 0x7fb0c41000b0 2024-06-06T03:33:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.337+0000 7fb0b37fe640 1 --2- 172.21.15.50:0/818261330 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb0ac0a2d90 0x7fb0ac0a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.337+0000 7fb0b37fe640 1 -- 172.21.15.50:0/818261330 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fb0bc0cf750 con 0x7fb0c41000b0 2024-06-06T03:33:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.338+0000 7fb0b0ff9640 1 -- 172.21.15.50:0/1398542305 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b4005220 con 0x55d10d36b1e0 2024-06-06T03:33:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.338+0000 7fb0b0ff9640 1 -- 172.21.15.50:0/1398542305 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb0b400be40 con 0x55d10d36b1e0 2024-06-06T03:33:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.339+0000 7fb0cb611740 1 -- 172.21.15.50:0/1398542305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d10d36b1e0 msgr2=0x55d10d36b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.339+0000 7fb0cb611740 1 --2- 172.21.15.50:0/1398542305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d10d36b1e0 0x55d10d36b600 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb0b400bd50 tx=0x7fb0b40107a0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.343+0000 7fb0cb611740 1 -- 172.21.15.50:0/1398542305 shutdown_connections 2024-06-06T03:33:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.343+0000 7fb0cb611740 1 --2- 172.21.15.50:0/1398542305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10d370d40 0x55d10d3731d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.343+0000 7fb0cb611740 1 --2- 172.21.15.50:0/1398542305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d10d36bbd0 0x55d10d3706d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.343+0000 7fb0cb611740 1 --2- 172.21.15.50:0/1398542305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d10d36b1e0 0x55d10d36b600 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.343+0000 7fb0cb611740 1 -- 172.21.15.50:0/1398542305 >> 172.21.15.50:0/1398542305 conn(0x55d10d366850 msgr2=0x55d10d366c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.343+0000 7fb0c259c640 1 --2- 172.21.15.50:0/818261330 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb0ac0a2d90 0x7fb0ac0a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.344+0000 7fb0cb611740 1 -- 172.21.15.50:0/1398542305 shutdown_connections 2024-06-06T03:33:56.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.345+0000 7fb0cb611740 1 -- 172.21.15.50:0/1398542305 wait complete. 2024-06-06T03:33:56.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.345+0000 7fb0cb611740 1 -- start start 2024-06-06T03:33:56.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.345+0000 7fb0cb611740 1 Processor -- start 2024-06-06T03:33:56.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.346+0000 7fb0cb611740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d10d36b1e0 0x55d10d375490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.346+0000 7fb0cb611740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10d36bbd0 0x55d10d3759d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.346+0000 7fb0cb611740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d10d370d40 0x55d10d37ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.346+0000 7fb0cb611740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d10d373d40 con 0x55d10d36bbd0 2024-06-06T03:33:56.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.346+0000 7fb0cb611740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d10d257ae0 con 0x55d10d36b1e0 2024-06-06T03:33:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.346+0000 7fb0cb611740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d10d373ec0 con 0x55d10d370d40 2024-06-06T03:33:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.346+0000 7fb0cb611740 10 client.0 _ll_register_callbacks cb 0x55d10d2909b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:33:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.347+0000 7fb0c2d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d10d370d40 0x55d10d37ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.347+0000 7fb0c2d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d10d370d40 0x55d10d37ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:53504/0 (socket says 172.21.15.50:53504) 2024-06-06T03:33:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.347+0000 7fb0c2d9d640 1 -- 172.21.15.50:0/3615658474 learned_addr learned my addr 172.21.15.50:0/3615658474 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.347+0000 7fb0c1d9b640 1 --2- 172.21.15.50:0/3615658474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10d36bbd0 0x55d10d3759d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.347+0000 7fb0c259c640 1 --2- 172.21.15.50:0/818261330 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb0ac0a2d90 0x7fb0ac0a5250 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc009960 tx=0x7fb0bc097f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:56.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.348+0000 7fb0c1d9b640 1 -- 172.21.15.50:0/3615658474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d10d370d40 msgr2=0x55d10d37ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:56.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.348+0000 7fb0c1d9b640 1 --2- 172.21.15.50:0/3615658474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d10d370d40 0x55d10d37ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.348+0000 7fb0c1d9b640 1 -- 172.21.15.50:0/3615658474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d10d36b1e0 msgr2=0x55d10d375490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:56.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.348+0000 7fb0c1d9b640 1 --2- 172.21.15.50:0/3615658474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d10d36b1e0 0x55d10d375490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.348+0000 7fb0c1d9b640 1 -- 172.21.15.50:0/3615658474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d10cfe2210 con 0x55d10d36bbd0 2024-06-06T03:33:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.351+0000 7fb0c1d9b640 1 --2- 172.21.15.50:0/3615658474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10d36bbd0 0x55d10d3759d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8009850 tx=0x7fb0b8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=808180c56a56574d server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.354+0000 7fb0a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:33:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.354+0000 7fb0a9ffb640 1 -- 172.21.15.50:0/3615658474 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b8041070 con 0x55d10d36bbd0 2024-06-06T03:33:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.354+0000 7fb0cb611740 1 -- 172.21.15.50:0/3615658474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d10d2e1f10 con 0x55d10d36bbd0 2024-06-06T03:33:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.354+0000 7fb0a9ffb640 1 -- 172.21.15.50:0/3615658474 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fb0b80051e0 con 0x55d10d36bbd0 2024-06-06T03:33:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.358+0000 7fb0a9ffb640 1 -- 172.21.15.50:0/3615658474 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb0b80053e0 con 0x55d10d36bbd0 2024-06-06T03:33:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.358+0000 7fb0cb611740 10 client.16419 fetch_fsmap learned FSMap version 33 2024-06-06T03:33:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.358+0000 7fb0cb611740 1 -- 172.21.15.50:0/3615658474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55d10d0ae620 con 0x55d10d36bbd0 2024-06-06T03:33:56.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.360+0000 7fb0a9ffb640 1 -- 172.21.15.50:0/3615658474 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55d10d2e1f10 con 0x55d10d36bbd0 2024-06-06T03:33:56.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.360+0000 7fb0a9ffb640 1 -- 172.21.15.50:0/3615658474 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fb0b8031440 con 0x55d10d36bbd0 2024-06-06T03:33:56.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.361+0000 7fb0cb611740 10 client.16419 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:33:56.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.361+0000 7fb0cb611740 10 client.16419 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:33:56.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.361+0000 7fb0cb611740 20 client.16419 populate_metadata read hostname 'smithi050' 2024-06-06T03:33:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.361+0000 7fb0cb611740 1 --2- 172.21.15.50:0/3615658474 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d10d3a3740 0x55d10d3a5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.361+0000 7fb0cb611740 4 client.16419 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:33:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.361+0000 7fb0cb611740 1 -- 172.21.15.50:0/3615658474 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d10d2dbc20 con 0x55d10d3a3740 2024-06-06T03:33:56.363 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.362+0000 7fb0c2d9d640 1 --2- 172.21.15.50:0/3615658474 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d10d3a3740 0x55d10d3a5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.366+0000 7fb0a9ffb640 10 client.16419 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:33:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.367+0000 7fb0c2d9d640 1 --2- 172.21.15.50:0/3615658474 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d10d3a3740 0x55d10d3a5b80 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c405cfc9a30b6c4 server_cookie=739be45430e8bb1c in_seq=0 out_seq=0 2024-06-06T03:33:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.368+0000 7fb0a9ffb640 1 -- 172.21.15.50:0/3615658474 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d10d2dbc20 con 0x55d10d3a3740 2024-06-06T03:33:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.368+0000 7fb0a9ffb640 10 client.16419 handle_command_reply: tid=0 2024-06-06T03:33:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.368+0000 7fb0cb611740 1 client.16419 shutdown 2024-06-06T03:33:56.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.373+0000 7fb0cb611740 1 -- 172.21.15.50:0/3615658474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10d36bbd0 msgr2=0x55d10d3759d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:56.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.373+0000 7fb0cb611740 1 --2- 172.21.15.50:0/3615658474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10d36bbd0 0x55d10d3759d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8009850 tx=0x7fb0b8004270 comp rx=0 tx=0).stop 2024-06-06T03:33:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.380+0000 7fb0cb611740 1 -- 172.21.15.50:0/3615658474 shutdown_connections 2024-06-06T03:33:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.380+0000 7fb0cb611740 1 --2- 172.21.15.50:0/3615658474 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d10d3a3740 0x55d10d3a5b80 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.380+0000 7fb0cb611740 1 --2- 172.21.15.50:0/3615658474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10d36bbd0 0x55d10d3759d0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.380+0000 7fb0cb611740 1 --2- 172.21.15.50:0/3615658474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d10d370d40 0x55d10d37ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.380+0000 7fb0cb611740 1 --2- 172.21.15.50:0/3615658474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d10d36b1e0 0x55d10d375490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.380+0000 7fb0cb611740 1 -- 172.21.15.50:0/3615658474 >> 172.21.15.50:0/3615658474 conn(0x55d10d366850 msgr2=0x55d10d3659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.381+0000 7fb0a9ffb640 0 client.16419 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:33:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.384+0000 7fb0cb611740 1 -- 172.21.15.50:0/3615658474 shutdown_connections 2024-06-06T03:33:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.388+0000 7fb0cb611740 1 -- 172.21.15.50:0/3615658474 wait complete. 2024-06-06T03:33:56.393 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.393+0000 7fb0cb611740 20 client.16419 trim_cache size 0 max 16384 2024-06-06T03:33:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.426+0000 7fb0cb611740 1 Processor -- start 2024-06-06T03:33:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.429+0000 7fb0cb611740 1 -- start start 2024-06-06T03:33:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.429+0000 7fb0cb611740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10d36b1e0 0x55d10d36cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.429+0000 7fb0cb611740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d10d36bbd0 0x55d10d36d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.429+0000 7fb0cb611740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d10d370d40 0x55d10d37c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.429+0000 7fb0cb611740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a4012570 con 0x55d10d36b1e0 2024-06-06T03:33:56.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.429+0000 7fb0cb611740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a400fe40 con 0x55d10d370d40 2024-06-06T03:33:56.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.429+0000 7fb0cb611740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a400dc90 con 0x55d10d36bbd0 2024-06-06T03:33:56.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.429+0000 7fb0c2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10d36b1e0 0x55d10d36cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:56.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.429+0000 7fb0c2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10d36b1e0 0x55d10d36cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36152/0 (socket says 172.21.15.50:36152) 2024-06-06T03:33:56.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.429+0000 7fb0c2d9d640 1 -- 172.21.15.50:0/1321771157 learned_addr learned my addr 172.21.15.50:0/1321771157 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:56.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.429+0000 7fb0c2d9d640 1 --2- 172.21.15.50:0/1321771157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d10d370d40 0x55d10d37c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:56.432 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.430+0000 7fb0c2d9d640 1 -- 172.21.15.50:0/1321771157 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d10d36bbd0 msgr2=0x55d10d36d290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:33:56.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.430+0000 7fb0c2d9d640 1 --2- 172.21.15.50:0/1321771157 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d10d36bbd0 0x55d10d36d290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.430+0000 7fb0c2d9d640 1 -- 172.21.15.50:0/1321771157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10d36b1e0 msgr2=0x55d10d36cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:56.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.430+0000 7fb0c2d9d640 1 --2- 172.21.15.50:0/1321771157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10d36b1e0 0x55d10d36cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.430+0000 7fb0c2d9d640 1 -- 172.21.15.50:0/1321771157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d10d366680 con 0x55d10d370d40 2024-06-06T03:33:56.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.430+0000 7fb0c2d9d640 1 --2- 172.21.15.50:0/1321771157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d10d370d40 0x55d10d37c9d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4011530 tx=0x7fb0b4010fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8c5adaa9106028 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:56.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.431+0000 7fb0abfff640 1 -- 172.21.15.50:0/1321771157 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b4005640 con 0x55d10d370d40 2024-06-06T03:33:56.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.431+0000 7fb0abfff640 1 -- 172.21.15.50:0/1321771157 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb0b4027900 con 0x55d10d370d40 2024-06-06T03:33:56.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.432+0000 7fb0cb611740 1 -- 172.21.15.50:0/1321771157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d10d370d40 msgr2=0x55d10d37c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:56.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.432+0000 7fb0cb611740 1 --2- 172.21.15.50:0/1321771157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d10d370d40 0x55d10d37c9d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4011530 tx=0x7fb0b4010fd0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.432+0000 7fb0cb611740 1 -- 172.21.15.50:0/1321771157 shutdown_connections 2024-06-06T03:33:56.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.432+0000 7fb0cb611740 1 --2- 172.21.15.50:0/1321771157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d10d370d40 0x55d10d37c9d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.432+0000 7fb0cb611740 1 --2- 172.21.15.50:0/1321771157 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d10d36bbd0 0x55d10d36d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.432+0000 7fb0cb611740 1 --2- 172.21.15.50:0/1321771157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10d36b1e0 0x55d10d36cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.432+0000 7fb0cb611740 1 -- 172.21.15.50:0/1321771157 >> 172.21.15.50:0/1321771157 conn(0x55d10d366850 msgr2=0x55d10d375490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:56.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.432+0000 7fb0cb611740 1 -- 172.21.15.50:0/1321771157 shutdown_connections 2024-06-06T03:33:56.435 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.432+0000 7fb0cb611740 1 -- 172.21.15.50:0/1321771157 wait complete. 2024-06-06T03:33:56.435 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.432+0000 7fb0cb611740 1 -- start start 2024-06-06T03:33:56.435 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.433+0000 7fb0cb611740 1 Processor -- start 2024-06-06T03:33:56.436 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.433+0000 7fb0cb611740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d10d36b1e0 0x55d10d379780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.436 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.433+0000 7fb0cb611740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d10d36bbd0 0x55d10d379cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.436 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.433+0000 7fb0cb611740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10d370d40 0x55d10d40c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.436 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.433+0000 7fb0cb611740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a400e300 con 0x55d10d370d40 2024-06-06T03:33:56.436 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.433+0000 7fb0cb611740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a400f770 con 0x55d10d36b1e0 2024-06-06T03:33:56.437 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.433+0000 7fb0cb611740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a400e9d0 con 0x55d10d36bbd0 2024-06-06T03:33:56.437 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.433+0000 7fb0cb611740 10 client.0 _ll_register_callbacks cb 0x7fb0b8005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:33:56.437 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.433+0000 7fb0c2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10d370d40 0x55d10d40c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:56.437 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.434+0000 7fb0c2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10d370d40 0x55d10d40c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36164/0 (socket says 172.21.15.50:36164) 2024-06-06T03:33:56.437 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.434+0000 7fb0c2d9d640 1 -- 172.21.15.50:0/948921929 learned_addr learned my addr 172.21.15.50:0/948921929 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:56.437 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.434+0000 7fb0c2d9d640 1 --2- 172.21.15.50:0/948921929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d10d36b1e0 0x55d10d379780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:56.437 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.436+0000 7fb0c1d9b640 1 --2- 172.21.15.50:0/948921929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d10d36bbd0 0x55d10d379cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:56.438 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.438+0000 7fb0c1d9b640 1 -- 172.21.15.50:0/948921929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d10d36b1e0 msgr2=0x55d10d379780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:56.438 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.438+0000 7fb0c1d9b640 1 --2- 172.21.15.50:0/948921929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d10d36b1e0 0x55d10d379780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.438+0000 7fb0c1d9b640 1 -- 172.21.15.50:0/948921929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10d370d40 msgr2=0x55d10d40c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.438+0000 7fb0c1d9b640 1 --2- 172.21.15.50:0/948921929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10d370d40 0x55d10d40c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.438+0000 7fb0c1d9b640 1 -- 172.21.15.50:0/948921929 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d10d361f50 con 0x55d10d36bbd0 2024-06-06T03:33:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.439+0000 7fb0c1d9b640 1 --2- 172.21.15.50:0/948921929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d10d36bbd0 0x55d10d379cc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8005ab0 tx=0x7fb0b8031d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bad8f86109dcf3f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.442+0000 7fb0a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:33:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.442+0000 7fb0a9ffb640 1 -- 172.21.15.50:0/948921929 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b8041040 con 0x55d10d36bbd0 2024-06-06T03:33:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.442+0000 7fb0a9ffb640 1 -- 172.21.15.50:0/948921929 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fb0b80051e0 con 0x55d10d36bbd0 2024-06-06T03:33:56.445 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.444+0000 7fb0cb611740 1 -- 172.21.15.50:0/948921929 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d10d2d5f70 con 0x55d10d36bbd0 2024-06-06T03:33:56.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.453+0000 7fb0a9ffb640 1 -- 172.21.15.50:0/948921929 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb0b8009550 con 0x55d10d36bbd0 2024-06-06T03:33:56.465 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.460+0000 7fb0cb611740 10 client.26062 fetch_fsmap learned FSMap version 33 2024-06-06T03:33:56.465 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.460+0000 7fb0cb611740 1 -- 172.21.15.50:0/948921929 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55d10d366100 con 0x55d10d36bbd0 2024-06-06T03:33:56.474 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.472+0000 7fb0a9ffb640 1 -- 172.21.15.50:0/948921929 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55d10d2d5f70 con 0x55d10d36bbd0 2024-06-06T03:33:56.474 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.473+0000 7fb0a9ffb640 1 -- 172.21.15.50:0/948921929 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fb0b8003aa0 con 0x55d10d36bbd0 2024-06-06T03:33:56.474 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.474+0000 7fb0cb611740 10 client.26062 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:33:56.474 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.474+0000 7fb0cb611740 10 client.26062 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:33:56.474 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.474+0000 7fb0cb611740 20 client.26062 populate_metadata read hostname 'smithi050' 2024-06-06T03:33:56.474 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.474+0000 7fb0cb611740 1 --2- 172.21.15.50:0/948921929 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d10d40e110 0x55d10d410530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.474 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.474+0000 7fb0cb611740 4 client.26062 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:33:56.474 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.474+0000 7fb0cb611740 1 -- 172.21.15.50:0/948921929 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d10d2538e0 con 0x55d10d40e110 2024-06-06T03:33:56.478 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.479+0000 7fb0c2d9d640 1 --2- 172.21.15.50:0/948921929 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d10d40e110 0x55d10d410530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:56.489 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.490+0000 7fb0c2d9d640 1 --2- 172.21.15.50:0/948921929 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d10d40e110 0x55d10d410530 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22233a1364e728ce server_cookie=118a0226b0fea645 in_seq=0 out_seq=0 2024-06-06T03:33:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.490+0000 7fb0a9ffb640 10 client.26062 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:33:56.494 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.494+0000 7fb0a9ffb640 1 -- 172.21.15.50:0/948921929 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55d10d2538e0 con 0x55d10d40e110 2024-06-06T03:33:56.494 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.494+0000 7fb0a9ffb640 10 client.26062 handle_command_reply: tid=0 2024-06-06T03:33:56.496 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.496+0000 7fb0cb611740 1 client.26062 shutdown 2024-06-06T03:33:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.502+0000 7fb0cb611740 1 -- 172.21.15.50:0/948921929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d10d36bbd0 msgr2=0x55d10d379cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.502+0000 7fb0cb611740 1 --2- 172.21.15.50:0/948921929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d10d36bbd0 0x55d10d379cc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8005ab0 tx=0x7fb0b8031d00 comp rx=0 tx=0).stop 2024-06-06T03:33:56.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.521+0000 7fb0cb611740 1 -- 172.21.15.50:0/948921929 shutdown_connections 2024-06-06T03:33:56.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.521+0000 7fb0cb611740 1 --2- 172.21.15.50:0/948921929 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d10d40e110 0x55d10d410530 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.521+0000 7fb0cb611740 1 --2- 172.21.15.50:0/948921929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10d370d40 0x55d10d40c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.521+0000 7fb0cb611740 1 --2- 172.21.15.50:0/948921929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d10d36bbd0 0x55d10d379cc0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.521+0000 7fb0cb611740 1 --2- 172.21.15.50:0/948921929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d10d36b1e0 0x55d10d379780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.521+0000 7fb0cb611740 1 -- 172.21.15.50:0/948921929 >> 172.21.15.50:0/948921929 conn(0x55d10d366850 msgr2=0x55d10d375450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:56.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.521+0000 7fb0a9ffb640 0 client.26062 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:33:56.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.521+0000 7fb0cb611740 1 -- 172.21.15.50:0/948921929 shutdown_connections 2024-06-06T03:33:56.526 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:33:56.526 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:33:56.526 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:33:56.526 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.522+0000 7fb0cb611740 1 -- 172.21.15.50:0/948921929 wait complete. 2024-06-06T03:33:56.526 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.522+0000 7fb0cb611740 20 client.26062 trim_cache size 0 max 16384 2024-06-06T03:33:56.531 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.531+0000 7fb0c359e640 1 -- 172.21.15.50:0/818261330 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb0ac0a2d90 msgr2=0x7fb0ac0a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:56.531 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.531+0000 7fb0c359e640 1 --2- 172.21.15.50:0/818261330 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb0ac0a2d90 0x7fb0ac0a5250 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc009960 tx=0x7fb0bc097f00 comp rx=0 tx=0).stop 2024-06-06T03:33:56.531 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.531+0000 7fb0c359e640 1 -- 172.21.15.50:0/818261330 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0c41000b0 msgr2=0x7fb0c406e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:56.531 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.531+0000 7fb0c359e640 1 --2- 172.21.15.50:0/818261330 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0c41000b0 0x7fb0c406e640 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00ea20 tx=0x7fb0bc00eee0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.535 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.535+0000 7fb0c359e640 1 -- 172.21.15.50:0/818261330 shutdown_connections 2024-06-06T03:33:56.535 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.535+0000 7fb0c359e640 1 --2- 172.21.15.50:0/818261330 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb0ac0a2d90 0x7fb0ac0a5250 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.535 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.535+0000 7fb0c359e640 1 --2- 172.21.15.50:0/818261330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0c41013b0 0x7fb0c410f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.535 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.535+0000 7fb0c359e640 1 --2- 172.21.15.50:0/818261330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0c4100a10 0x7fb0c406eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.535 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.535+0000 7fb0c359e640 1 --2- 172.21.15.50:0/818261330 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0c41000b0 0x7fb0c406e640 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.535 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.535+0000 7fb0c359e640 1 -- 172.21.15.50:0/818261330 >> 172.21.15.50:0/818261330 conn(0x7fb0c40fbcd0 msgr2=0x7fb0c40fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:56.538 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.539+0000 7fb0c359e640 1 -- 172.21.15.50:0/818261330 shutdown_connections 2024-06-06T03:33:56.538 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:33:56.539+0000 7fb0c359e640 1 -- 172.21.15.50:0/818261330 wait complete. 2024-06-06T03:33:56.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.687+0000 7fcac8126700 1 -- 172.21.15.50:0/1337265203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcac01099d0 msgr2=0x7fcac0109e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:56.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.687+0000 7fcac8126700 1 --2- 172.21.15.50:0/1337265203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcac01099d0 0x7fcac0109e50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcab801afa0 tx=0x7fcab801c330 comp rx=0 tx=0).stop 2024-06-06T03:33:56.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.687+0000 7fcac8126700 1 -- 172.21.15.50:0/1337265203 shutdown_connections 2024-06-06T03:33:56.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.687+0000 7fcac8126700 1 --2- 172.21.15.50:0/1337265203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcac011bc70 0x7fcac011e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.687+0000 7fcac8126700 1 --2- 172.21.15.50:0/1337265203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcac0110c70 0x7fcac0109490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.687+0000 7fcac8126700 1 --2- 172.21.15.50:0/1337265203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcac01099d0 0x7fcac0109e50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.687+0000 7fcac8126700 1 -- 172.21.15.50:0/1337265203 >> 172.21.15.50:0/1337265203 conn(0x7fcac006d600 msgr2=0x7fcac006da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:56.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.690+0000 7fcac8126700 1 -- 172.21.15.50:0/1337265203 shutdown_connections 2024-06-06T03:33:56.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.690+0000 7fcac8126700 1 -- 172.21.15.50:0/1337265203 wait complete. 2024-06-06T03:33:56.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.691+0000 7fcac8126700 1 Processor -- start 2024-06-06T03:33:56.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.691+0000 7fcac8126700 1 -- start start 2024-06-06T03:33:56.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.692+0000 7fcac8126700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcac0110c70 0x7fcac011aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.692+0000 7fcac8126700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcac011bc70 0x7fcac011b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.692+0000 7fcac8126700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcac0117060 0x7fcac01174e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.692+0000 7fcac8126700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcac0113c90 con 0x7fcac0110c70 2024-06-06T03:33:56.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.692+0000 7fcac8126700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcac0113b10 con 0x7fcac011bc70 2024-06-06T03:33:56.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.692+0000 7fcac8126700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcac0113e10 con 0x7fcac0117060 2024-06-06T03:33:56.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.694+0000 7fcac56c1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcac011bc70 0x7fcac011b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:56.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.694+0000 7fcac56c1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcac011bc70 0x7fcac011b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:56888/0 (socket says 172.21.15.50:56888) 2024-06-06T03:33:56.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.694+0000 7fcac56c1700 1 -- 172.21.15.50:0/2914063221 learned_addr learned my addr 172.21.15.50:0/2914063221 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:56.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.694+0000 7fcac66c3700 1 --2- 172.21.15.50:0/2914063221 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcac0117060 0x7fcac01174e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:56.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.694+0000 7fcac5ec2700 1 --2- 172.21.15.50:0/2914063221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcac0110c70 0x7fcac011aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:56.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.694+0000 7fcac56c1700 1 -- 172.21.15.50:0/2914063221 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcac0117060 msgr2=0x7fcac01174e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:56.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.694+0000 7fcac56c1700 1 --2- 172.21.15.50:0/2914063221 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcac0117060 0x7fcac01174e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.694+0000 7fcac56c1700 1 -- 172.21.15.50:0/2914063221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcac0110c70 msgr2=0x7fcac011aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:56.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.694+0000 7fcac56c1700 1 --2- 172.21.15.50:0/2914063221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcac0110c70 0x7fcac011aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.694+0000 7fcac56c1700 1 -- 172.21.15.50:0/2914063221 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac0117de0 con 0x7fcac011bc70 2024-06-06T03:33:56.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.694+0000 7fcac56c1700 1 --2- 172.21.15.50:0/2914063221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcac011bc70 0x7fcac011b400 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcab8004fd0 tx=0x7fcab801cc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:56.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.695+0000 7fcab6ffd700 1 -- 172.21.15.50:0/2914063221 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab8030070 con 0x7fcac011bc70 2024-06-06T03:33:56.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.695+0000 7fcac8126700 1 -- 172.21.15.50:0/2914063221 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcac007a6f0 con 0x7fcac011bc70 2024-06-06T03:33:56.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.695+0000 7fcab6ffd700 1 -- 172.21.15.50:0/2914063221 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcab8023c80 con 0x7fcac011bc70 2024-06-06T03:33:56.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.695+0000 7fcab6ffd700 1 -- 172.21.15.50:0/2914063221 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab80052a0 con 0x7fcac011bc70 2024-06-06T03:33:56.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.695+0000 7fcac8126700 1 -- 172.21.15.50:0/2914063221 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcac007ac20 con 0x7fcac011bc70 2024-06-06T03:33:56.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.704+0000 7fcad29a9b80 1 Processor -- start 2024-06-06T03:33:56.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.704+0000 7fcad29a9b80 1 -- start start 2024-06-06T03:33:56.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.704+0000 7fcad29a9b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55810cab7770 0x55810cab7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.704+0000 7fcad29a9b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55810cab19e0 0x55810cab1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.704+0000 7fcad29a9b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55810cab23a0 0x55810cabe510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.705+0000 7fcad29a9b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55810ca03810 con 0x55810cab7770 2024-06-06T03:33:56.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.705+0000 7fcad29a9b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55810c9ab720 con 0x55810cab19e0 2024-06-06T03:33:56.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.705+0000 7fcad29a9b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55810c9ff7d0 con 0x55810cab23a0 2024-06-06T03:33:56.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.708+0000 7fcac56c1700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55810cab23a0 0x55810cabe510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:56.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.708+0000 7fcac56c1700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55810cab23a0 0x55810cabe510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:53540/0 (socket says 172.21.15.50:53540) 2024-06-06T03:33:56.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.708+0000 7fcac56c1700 1 -- 172.21.15.50:0/635143019 learned_addr learned my addr 172.21.15.50:0/635143019 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:56.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.710+0000 7fcac56c1700 1 -- 172.21.15.50:0/635143019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55810cab19e0 msgr2=0x55810cab1e60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:33:56.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.710+0000 7fcac56c1700 1 --2- 172.21.15.50:0/635143019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55810cab19e0 0x55810cab1e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.710+0000 7fcac56c1700 1 -- 172.21.15.50:0/635143019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55810cab7770 msgr2=0x55810cab7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:56.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.710+0000 7fcac56c1700 1 --2- 172.21.15.50:0/635143019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55810cab7770 0x55810cab7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.710+0000 7fcac56c1700 1 -- 172.21.15.50:0/635143019 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55810c9a1f50 con 0x55810cab23a0 2024-06-06T03:33:56.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.710+0000 7fcab6ffd700 1 -- 172.21.15.50:0/2914063221 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fcab8033070 con 0x7fcac011bc70 2024-06-06T03:33:56.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.714+0000 7fcab6ffd700 1 --2- 172.21.15.50:0/2914063221 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcaac0a2d60 0x7fcaac0a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.714+0000 7fcab6ffd700 1 -- 172.21.15.50:0/2914063221 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fcab805fe00 con 0x7fcac011bc70 2024-06-06T03:33:56.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.715+0000 7fcac56c1700 1 --2- 172.21.15.50:0/635143019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55810cab23a0 0x55810cabe510 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fcab80e53b0 tx=0x7fcab80e8240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe743883068777a8 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:56.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.715+0000 7fcac66c3700 1 --2- 172.21.15.50:0/2914063221 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcaac0a2d60 0x7fcaac0a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:56.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.716+0000 7fcac8126700 1 -- 172.21.15.50:0/635143019 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab80ee070 con 0x55810cab23a0 2024-06-06T03:33:56.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.716+0000 7fcac8126700 1 -- 172.21.15.50:0/635143019 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcab803a070 con 0x55810cab23a0 2024-06-06T03:33:56.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.717+0000 7fcad29a9b80 1 -- 172.21.15.50:0/635143019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55810cab23a0 msgr2=0x55810cabe510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:56.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.717+0000 7fcad29a9b80 1 --2- 172.21.15.50:0/635143019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55810cab23a0 0x55810cabe510 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fcab80e53b0 tx=0x7fcab80e8240 comp rx=0 tx=0).stop 2024-06-06T03:33:56.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.717+0000 7fcad29a9b80 1 -- 172.21.15.50:0/635143019 shutdown_connections 2024-06-06T03:33:56.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.717+0000 7fcad29a9b80 1 --2- 172.21.15.50:0/635143019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55810cab23a0 0x55810cabe510 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.717+0000 7fcad29a9b80 1 --2- 172.21.15.50:0/635143019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55810cab7770 0x55810cab7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.717+0000 7fcad29a9b80 1 --2- 172.21.15.50:0/635143019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55810cab19e0 0x55810cab1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.717+0000 7fcad29a9b80 1 -- 172.21.15.50:0/635143019 >> 172.21.15.50:0/635143019 conn(0x55810c9dccc0 msgr2=0x55810caacd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:56.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.717+0000 7fcac66c3700 1 --2- 172.21.15.50:0/2914063221 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcaac0a2d60 0x7fcaac0a5220 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcab0006b30 tx=0x7fcab0006ac0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:56.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.726+0000 7fcad29a9b80 1 -- 172.21.15.50:0/635143019 shutdown_connections 2024-06-06T03:33:56.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.726+0000 7fcad29a9b80 1 -- 172.21.15.50:0/635143019 wait complete. 2024-06-06T03:33:56.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.726+0000 7fcad29a9b80 1 -- start start 2024-06-06T03:33:56.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.726+0000 7fcad29a9b80 1 Processor -- start 2024-06-06T03:33:56.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.727+0000 7fcad29a9b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55810cab19e0 0x55810cabe0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.727+0000 7fcad29a9b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55810cab23a0 0x55810cabb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.727+0000 7fcad29a9b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55810cab7770 0x55810cabb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.727+0000 7fcad29a9b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55810cab8150 con 0x55810cab19e0 2024-06-06T03:33:56.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.727+0000 7fcad29a9b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55810c9a3bf0 con 0x55810cab7770 2024-06-06T03:33:56.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.727+0000 7fcad29a9b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55810cabea50 con 0x55810cab23a0 2024-06-06T03:33:56.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.727+0000 7fcad29a9b80 10 client.0 _ll_register_callbacks cb 0x55810c99d920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:33:56.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.728+0000 7fcac66c3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55810cab7770 0x55810cabb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:56.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.728+0000 7fcac66c3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55810cab7770 0x55810cabb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:56898/0 (socket says 172.21.15.50:56898) 2024-06-06T03:33:56.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.728+0000 7fcac66c3700 1 -- 172.21.15.50:0/1623102052 learned_addr learned my addr 172.21.15.50:0/1623102052 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:56.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.728+0000 7fcac66c3700 1 -- 172.21.15.50:0/1623102052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55810cab23a0 msgr2=0x55810cabb3f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:33:56.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.728+0000 7fcac66c3700 1 --2- 172.21.15.50:0/1623102052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55810cab23a0 0x55810cabb3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.728+0000 7fcac66c3700 1 -- 172.21.15.50:0/1623102052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55810cab19e0 msgr2=0x55810cabe0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:56.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.728+0000 7fcac66c3700 1 --2- 172.21.15.50:0/1623102052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55810cab19e0 0x55810cabe0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.728+0000 7fcac66c3700 1 -- 172.21.15.50:0/1623102052 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55810c9528d0 con 0x55810cab7770 2024-06-06T03:33:56.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.728+0000 7fcac66c3700 1 --2- 172.21.15.50:0/1623102052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55810cab7770 0x55810cabb930 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcab000f010 tx=0x7fcab0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=493c3a22fd2a08d6 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:56.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.730+0000 7fcaa97fa700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:33:56.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.730+0000 7fcaa97fa700 1 -- 172.21.15.50:0/1623102052 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab0023020 con 0x55810cab7770 2024-06-06T03:33:56.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.730+0000 7fcad29a9b80 1 -- 172.21.15.50:0/1623102052 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55810ca10d10 con 0x55810cab7770 2024-06-06T03:33:56.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.730+0000 7fcaa97fa700 1 -- 172.21.15.50:0/1623102052 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fcab0015a70 con 0x55810cab7770 2024-06-06T03:33:56.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.730+0000 7fcaa97fa700 1 -- 172.21.15.50:0/1623102052 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fcab002e050 con 0x55810cab7770 2024-06-06T03:33:56.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.737+0000 7fcad29a9b80 10 client.26078 fetch_fsmap learned FSMap version 33 2024-06-06T03:33:56.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.737+0000 7fcad29a9b80 1 -- 172.21.15.50:0/1623102052 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55810cac9120 con 0x55810cab7770 2024-06-06T03:33:56.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.740+0000 7fcaa97fa700 1 -- 172.21.15.50:0/1623102052 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55810ca10d10 con 0x55810cab7770 2024-06-06T03:33:56.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.741+0000 7fcaa97fa700 1 -- 172.21.15.50:0/1623102052 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fcab001e030 con 0x55810cab7770 2024-06-06T03:33:56.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.742+0000 7fcad29a9b80 10 client.26078 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:33:56.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.742+0000 7fcad29a9b80 10 client.26078 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-06-06T03:33:56.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.742+0000 7fcad29a9b80 20 client.26078 populate_metadata read hostname 'smithi050' 2024-06-06T03:33:56.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.742+0000 7fcad29a9b80 1 --2- 172.21.15.50:0/1623102052 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55810cacbb60 0x55810cace000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.742+0000 7fcad29a9b80 4 client.26078 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:33:56.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.742+0000 7fcad29a9b80 1 -- 172.21.15.50:0/1623102052 --> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55810ca0b290 con 0x55810cacbb60 2024-06-06T03:33:56.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.745+0000 7fcac5ec2700 1 --2- 172.21.15.50:0/1623102052 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55810cacbb60 0x55810cace000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:56.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.747+0000 7fcac5ec2700 1 --2- 172.21.15.50:0/1623102052 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55810cacbb60 0x55810cace000 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2e9846f96456e3b7 server_cookie=7599f0284465e615 in_seq=0 out_seq=0 2024-06-06T03:33:56.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.747+0000 7fcaa97fa700 10 client.26078 ms_handle_connect on v2:172.21.15.122:6834/2987597320 2024-06-06T03:33:56.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.748+0000 7fcaa97fa700 1 -- 172.21.15.50:0/1623102052 <== mds.2 v2:172.21.15.122:6834/2987597320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55810ca0b290 con 0x55810cacbb60 2024-06-06T03:33:56.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.748+0000 7fcaa97fa700 10 client.26078 handle_command_reply: tid=0 2024-06-06T03:33:56.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.748+0000 7fcad29a9b80 1 client.26078 shutdown 2024-06-06T03:33:56.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.751+0000 7fcad29a9b80 1 -- 172.21.15.50:0/1623102052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55810cab7770 msgr2=0x55810cabb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:56.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.752+0000 7fcad29a9b80 1 --2- 172.21.15.50:0/1623102052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55810cab7770 0x55810cabb930 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcab000f010 tx=0x7fcab0004750 comp rx=0 tx=0).stop 2024-06-06T03:33:56.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.753+0000 7fcad29a9b80 1 -- 172.21.15.50:0/1623102052 shutdown_connections 2024-06-06T03:33:56.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.753+0000 7fcad29a9b80 1 --2- 172.21.15.50:0/1623102052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55810cab7770 0x55810cabb930 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.753+0000 7fcad29a9b80 1 --2- 172.21.15.50:0/1623102052 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55810cacbb60 0x55810cace000 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.753+0000 7fcad29a9b80 1 --2- 172.21.15.50:0/1623102052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55810cab19e0 0x55810cabe0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.753+0000 7fcad29a9b80 1 --2- 172.21.15.50:0/1623102052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55810cab23a0 0x55810cabb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.753+0000 7fcad29a9b80 1 -- 172.21.15.50:0/1623102052 >> 172.21.15.50:0/1623102052 conn(0x55810c9dccc0 msgr2=0x55810cab09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:56.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.753+0000 7fcaa97fa700 0 client.26078 ms_handle_reset on v2:172.21.15.122:6834/2987597320 2024-06-06T03:33:56.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.757+0000 7fcad29a9b80 1 -- 172.21.15.50:0/1623102052 shutdown_connections 2024-06-06T03:33:56.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.761+0000 7fcad29a9b80 1 -- 172.21.15.50:0/1623102052 wait complete. 2024-06-06T03:33:56.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.761+0000 7fcad29a9b80 20 client.26078 trim_cache size 0 max 16384 2024-06-06T03:33:56.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.795+0000 7fcad29a9b80 1 Processor -- start 2024-06-06T03:33:56.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.795+0000 7fcad29a9b80 1 -- start start 2024-06-06T03:33:56.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.796+0000 7fcad29a9b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55810cab19e0 0x55810cab1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.796+0000 7fcad29a9b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55810cab23a0 0x55810cac77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.796+0000 7fcad29a9b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55810cab7770 0x55810cad3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.796+0000 7fcac56c1700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55810cab23a0 0x55810cac77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:56.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.796+0000 7fcac66c3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55810cab7770 0x55810cad3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:56.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.796+0000 7fcac66c3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55810cab7770 0x55810cad3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:56900/0 (socket says 172.21.15.50:56900) 2024-06-06T03:33:56.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.796+0000 7fcac66c3700 1 -- 172.21.15.50:0/3056401044 learned_addr learned my addr 172.21.15.50:0/3056401044 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:56.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.796+0000 7fcad29a9b80 1 -- 172.21.15.50:0/3056401044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcac01c8140 con 0x55810cab19e0 2024-06-06T03:33:56.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.797+0000 7fcac5ec2700 1 --2- 172.21.15.50:0/3056401044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55810cab19e0 0x55810cab1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:56.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.797+0000 7fcad29a9b80 1 -- 172.21.15.50:0/3056401044 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcac00835b0 con 0x55810cab7770 2024-06-06T03:33:56.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.797+0000 7fcad29a9b80 1 -- 172.21.15.50:0/3056401044 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcac00814b0 con 0x55810cab23a0 2024-06-06T03:33:56.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.798+0000 7fcac66c3700 1 -- 172.21.15.50:0/3056401044 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55810cab23a0 msgr2=0x55810cac77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:56.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.798+0000 7fcac66c3700 1 --2- 172.21.15.50:0/3056401044 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55810cab23a0 0x55810cac77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.798+0000 7fcac66c3700 1 -- 172.21.15.50:0/3056401044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55810cab19e0 msgr2=0x55810cab1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:56.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.798+0000 7fcac66c3700 1 --2- 172.21.15.50:0/3056401044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55810cab19e0 0x55810cab1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.798+0000 7fcac66c3700 1 -- 172.21.15.50:0/3056401044 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55810caae0e0 con 0x55810cab7770 2024-06-06T03:33:56.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.799+0000 7fcac66c3700 1 --2- 172.21.15.50:0/3056401044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55810cab7770 0x55810cad3910 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcab000efe0 tx=0x7fcab0013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b978079a88990d98 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:56.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.803+0000 7fcaab7fe700 1 -- 172.21.15.50:0/3056401044 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab0023040 con 0x55810cab7770 2024-06-06T03:33:56.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.803+0000 7fcaab7fe700 1 -- 172.21.15.50:0/3056401044 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcab001f560 con 0x55810cab7770 2024-06-06T03:33:56.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.803+0000 7fcaab7fe700 1 -- 172.21.15.50:0/3056401044 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab001b040 con 0x55810cab7770 2024-06-06T03:33:56.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.804+0000 7fcad29a9b80 1 -- 172.21.15.50:0/3056401044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55810cab7770 msgr2=0x55810cad3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:56.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.804+0000 7fcad29a9b80 1 --2- 172.21.15.50:0/3056401044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55810cab7770 0x55810cad3910 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcab000efe0 tx=0x7fcab0013000 comp rx=0 tx=0).stop 2024-06-06T03:33:56.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.805+0000 7fcad29a9b80 1 -- 172.21.15.50:0/3056401044 shutdown_connections 2024-06-06T03:33:56.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.805+0000 7fcad29a9b80 1 --2- 172.21.15.50:0/3056401044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55810cab7770 0x55810cad3910 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.805+0000 7fcad29a9b80 1 --2- 172.21.15.50:0/3056401044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55810cab19e0 0x55810cab1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.805+0000 7fcad29a9b80 1 --2- 172.21.15.50:0/3056401044 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55810cab23a0 0x55810cac77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.805+0000 7fcad29a9b80 1 -- 172.21.15.50:0/3056401044 >> 172.21.15.50:0/3056401044 conn(0x55810c9dccc0 msgr2=0x55810cab9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:56.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.810+0000 7fcad29a9b80 1 -- 172.21.15.50:0/3056401044 shutdown_connections 2024-06-06T03:33:56.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.810+0000 7fcad29a9b80 1 -- 172.21.15.50:0/3056401044 wait complete. 2024-06-06T03:33:56.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.810+0000 7fcad29a9b80 1 -- start start 2024-06-06T03:33:56.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.811+0000 7fcad29a9b80 1 Processor -- start 2024-06-06T03:33:56.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.811+0000 7fcad29a9b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55810cab19e0 0x55810cad3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.812+0000 7fcad29a9b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55810cab23a0 0x55810cac3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.812+0000 7fcac5ec2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55810cab19e0 0x55810cad3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:56.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.812+0000 7fcac5ec2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55810cab19e0 0x55810cad3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:56908/0 (socket says 172.21.15.50:56908) 2024-06-06T03:33:56.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.812+0000 7fcac5ec2700 1 -- 172.21.15.50:0/686375872 learned_addr learned my addr 172.21.15.50:0/686375872 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:33:56.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.812+0000 7fcad29a9b80 1 --2- 172.21.15.50:0/686375872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55810cab7770 0x55810cac3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.812+0000 7fcac56c1700 1 --2- 172.21.15.50:0/686375872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55810cab23a0 0x55810cac3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:56.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.812+0000 7fcad29a9b80 1 -- 172.21.15.50:0/686375872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcac0081a70 con 0x55810cab23a0 2024-06-06T03:33:56.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.812+0000 7fcad29a9b80 1 -- 172.21.15.50:0/686375872 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcac0082ee0 con 0x55810cab19e0 2024-06-06T03:33:56.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.812+0000 7fcad29a9b80 1 -- 172.21.15.50:0/686375872 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcac0082140 con 0x55810cab7770 2024-06-06T03:33:56.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.812+0000 7fcac66c3700 1 --2- 172.21.15.50:0/686375872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55810cab7770 0x55810cac3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:56.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.812+0000 7fcad29a9b80 10 client.0 _ll_register_callbacks cb 0x55810c99d920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:33:56.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.813+0000 7fcac5ec2700 1 -- 172.21.15.50:0/686375872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55810cab7770 msgr2=0x55810cac3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:56.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.813+0000 7fcac5ec2700 1 --2- 172.21.15.50:0/686375872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55810cab7770 0x55810cac3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.813+0000 7fcac5ec2700 1 -- 172.21.15.50:0/686375872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55810cab23a0 msgr2=0x55810cac3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:33:56.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.813+0000 7fcac5ec2700 1 --2- 172.21.15.50:0/686375872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55810cab23a0 0x55810cac3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.813+0000 7fcac5ec2700 1 -- 172.21.15.50:0/686375872 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55810cac4520 con 0x55810cab19e0 2024-06-06T03:33:56.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.818+0000 7fcac5ec2700 1 --2- 172.21.15.50:0/686375872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55810cab19e0 0x55810cad3f20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55810cace880 tx=0x7fcabc009f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a4b6accb17422e2 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:33:56.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.818+0000 7fcaa97fa700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:33:56.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.819+0000 7fcaa97fa700 1 -- 172.21.15.50:0/686375872 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcabc010da0 con 0x55810cab19e0 2024-06-06T03:33:56.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.819+0000 7fcaa97fa700 1 -- 172.21.15.50:0/686375872 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fcabc004830 con 0x55810cab19e0 2024-06-06T03:33:56.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.820+0000 7fcad29a9b80 1 -- 172.21.15.50:0/686375872 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcab001f560 con 0x55810cab19e0 2024-06-06T03:33:56.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.821+0000 7fcaa97fa700 1 -- 172.21.15.50:0/686375872 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fcabc004a30 con 0x55810cab19e0 2024-06-06T03:33:56.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.826+0000 7fcad29a9b80 10 client.26084 fetch_fsmap learned FSMap version 33 2024-06-06T03:33:56.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.827+0000 7fcad29a9b80 1 -- 172.21.15.50:0/686375872 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55810cb359a0 con 0x55810cab19e0 2024-06-06T03:33:56.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.827+0000 7fcaa97fa700 1 -- 172.21.15.50:0/686375872 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcabc01e070 con 0x55810cab19e0 2024-06-06T03:33:56.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.828+0000 7fcaa97fa700 1 -- 172.21.15.50:0/686375872 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fcabc01a3e0 con 0x55810cab19e0 2024-06-06T03:33:56.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.828+0000 7fcad29a9b80 10 client.26084 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:33:56.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.828+0000 7fcad29a9b80 10 client.26084 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-06-06T03:33:56.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.828+0000 7fcad29a9b80 20 client.26084 populate_metadata read hostname 'smithi050' 2024-06-06T03:33:56.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.828+0000 7fcad29a9b80 1 --2- 172.21.15.50:0/686375872 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55810cb35fc0 0x55810cb383e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:33:56.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.828+0000 7fcad29a9b80 4 client.26084 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:33:56.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.828+0000 7fcad29a9b80 1 -- 172.21.15.50:0/686375872 --> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fcab001f560 con 0x55810cb35fc0 2024-06-06T03:33:56.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.830+0000 7fcac56c1700 1 --2- 172.21.15.50:0/686375872 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55810cb35fc0 0x55810cb383e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:33:56.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.832+0000 7fcaa97fa700 10 client.26084 ms_handle_connect on v2:172.21.15.122:6834/2987597320 2024-06-06T03:33:56.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.832+0000 7fcac56c1700 1 --2- 172.21.15.50:0/686375872 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55810cb35fc0 0x55810cb383e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4bb0776d2e20a0be server_cookie=8472ad72f7ea4fa5 in_seq=0 out_seq=0 2024-06-06T03:33:56.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.833+0000 7fcaa97fa700 1 -- 172.21.15.50:0/686375872 <== mds.2 v2:172.21.15.122:6834/2987597320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fcab001f560 con 0x55810cb35fc0 2024-06-06T03:33:56.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.833+0000 7fcaa97fa700 10 client.26084 handle_command_reply: tid=0 2024-06-06T03:33:56.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.833+0000 7fcad29a9b80 1 client.26084 shutdown 2024-06-06T03:33:56.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.833+0000 7fcad29a9b80 1 -- 172.21.15.50:0/686375872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55810cab19e0 msgr2=0x55810cad3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:56.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.833+0000 7fcad29a9b80 1 --2- 172.21.15.50:0/686375872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55810cab19e0 0x55810cad3f20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55810cace880 tx=0x7fcabc009f80 comp rx=0 tx=0).stop 2024-06-06T03:33:56.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.833+0000 7fcad29a9b80 1 -- 172.21.15.50:0/686375872 shutdown_connections 2024-06-06T03:33:56.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.833+0000 7fcad29a9b80 1 --2- 172.21.15.50:0/686375872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55810cab7770 0x55810cac3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.833+0000 7fcad29a9b80 1 --2- 172.21.15.50:0/686375872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55810cab19e0 0x55810cad3f20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.833+0000 7fcad29a9b80 1 --2- 172.21.15.50:0/686375872 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55810cb35fc0 0x55810cb383e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.833+0000 7fcad29a9b80 1 --2- 172.21.15.50:0/686375872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55810cab23a0 0x55810cac3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.833+0000 7fcad29a9b80 1 -- 172.21.15.50:0/686375872 >> 172.21.15.50:0/686375872 conn(0x55810c9dccc0 msgr2=0x55810cab65c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:56.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.833+0000 7fcaa97fa700 0 client.26084 ms_handle_reset on v2:172.21.15.122:6834/2987597320 2024-06-06T03:33:56.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.834+0000 7fcad29a9b80 1 -- 172.21.15.50:0/686375872 shutdown_connections 2024-06-06T03:33:56.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.834+0000 7fcad29a9b80 1 -- 172.21.15.50:0/686375872 wait complete. 2024-06-06T03:33:56.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.834+0000 7fcad29a9b80 20 client.26084 trim_cache size 0 max 16384 2024-06-06T03:33:56.837 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:33:56.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.838+0000 7fcab4ff9700 1 -- 172.21.15.50:0/2914063221 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcaac0a2d60 msgr2=0x7fcaac0a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:56.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.838+0000 7fcab4ff9700 1 --2- 172.21.15.50:0/2914063221 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcaac0a2d60 0x7fcaac0a5220 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcab0006b30 tx=0x7fcab0006ac0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.838+0000 7fcab4ff9700 1 -- 172.21.15.50:0/2914063221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcac011bc70 msgr2=0x7fcac011b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:33:56.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.838+0000 7fcab4ff9700 1 --2- 172.21.15.50:0/2914063221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcac011bc70 0x7fcac011b400 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcab8004fd0 tx=0x7fcab801cc30 comp rx=0 tx=0).stop 2024-06-06T03:33:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.840+0000 7fcab4ff9700 1 -- 172.21.15.50:0/2914063221 shutdown_connections 2024-06-06T03:33:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.840+0000 7fcab4ff9700 1 --2- 172.21.15.50:0/2914063221 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcac0117060 0x7fcac01174e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.840+0000 7fcab4ff9700 1 --2- 172.21.15.50:0/2914063221 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcaac0a2d60 0x7fcaac0a5220 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.840+0000 7fcab4ff9700 1 --2- 172.21.15.50:0/2914063221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcac0110c70 0x7fcac011aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.840+0000 7fcab4ff9700 1 --2- 172.21.15.50:0/2914063221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcac011bc70 0x7fcac011b400 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:33:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.840+0000 7fcab4ff9700 1 -- 172.21.15.50:0/2914063221 >> 172.21.15.50:0/2914063221 conn(0x7fcac006d600 msgr2=0x7fcac0073040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:33:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.843+0000 7fcab4ff9700 1 -- 172.21.15.50:0/2914063221 shutdown_connections 2024-06-06T03:33:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:33:56.843+0000 7fcab4ff9700 1 -- 172.21.15.50:0/2914063221 wait complete. 2024-06-06T03:33:57.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:57 smithi122 ceph-mon[35759]: pgmap v650: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 39 MiB/s wr, 751 op/s 2024-06-06T03:33:57.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:57 smithi050 ceph-mon[32421]: pgmap v650: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 39 MiB/s wr, 751 op/s 2024-06-06T03:33:57.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:57 smithi079 ceph-mon[35478]: pgmap v650: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 39 MiB/s wr, 751 op/s 2024-06-06T03:33:57.929 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-06-06T03:33:58.652 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:33:59.126 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:33:59 smithi050 ceph-mon[32421]: pgmap v651: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 31 MiB/s wr, 586 op/s 2024-06-06T03:33:59.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:33:59 smithi122 ceph-mon[35759]: pgmap v651: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 31 MiB/s wr, 586 op/s 2024-06-06T03:33:59.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:33:59 smithi079 ceph-mon[35478]: pgmap v651: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 31 MiB/s wr, 586 op/s 2024-06-06T03:34:01.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:01 smithi122 ceph-mon[35759]: pgmap v652: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 41 MiB/s wr, 794 op/s 2024-06-06T03:34:01.506 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:01 smithi050 ceph-mon[32421]: pgmap v652: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 41 MiB/s wr, 794 op/s 2024-06-06T03:34:01.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:01 smithi079 ceph-mon[35478]: pgmap v652: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 41 MiB/s wr, 794 op/s 2024-06-06T03:34:02.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.187+0000 7f2226781700 1 -- 172.21.15.50:0/4233382464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f222011bc70 msgr2=0x7f222011e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:02.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.187+0000 7f2226781700 1 --2- 172.21.15.50:0/4233382464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f222011bc70 0x7f222011e060 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f220801a9a0 tx=0x7f220801acb0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.188+0000 7f2226781700 1 -- 172.21.15.50:0/4233382464 shutdown_connections 2024-06-06T03:34:02.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.188+0000 7f2226781700 1 --2- 172.21.15.50:0/4233382464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f222011bc70 0x7f222011e060 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.188+0000 7f2226781700 1 --2- 172.21.15.50:0/4233382464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2220110c70 0x7f2220109490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.188+0000 7f2226781700 1 --2- 172.21.15.50:0/4233382464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22201099d0 0x7f2220109e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.188+0000 7f2226781700 1 -- 172.21.15.50:0/4233382464 >> 172.21.15.50:0/4233382464 conn(0x7f222006d600 msgr2=0x7f222006da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:02.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.188+0000 7f2226781700 1 -- 172.21.15.50:0/4233382464 shutdown_connections 2024-06-06T03:34:02.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.188+0000 7f2226781700 1 -- 172.21.15.50:0/4233382464 wait complete. 2024-06-06T03:34:02.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.189+0000 7f2226781700 1 Processor -- start 2024-06-06T03:34:02.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.189+0000 7f2226781700 1 -- start start 2024-06-06T03:34:02.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.189+0000 7f2226781700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22201099d0 0x7f222011b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:02.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.189+0000 7f2226781700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2220110c70 0x7f222011b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:02.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.189+0000 7f2226781700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f222011bc70 0x7f2220117460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:02.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.189+0000 7f2226781700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2220113cc0 con 0x7f222011bc70 2024-06-06T03:34:02.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.189+0000 7f2226781700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2220113b40 con 0x7f22201099d0 2024-06-06T03:34:02.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.189+0000 7f2226781700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2220113e40 con 0x7f2220110c70 2024-06-06T03:34:02.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.190+0000 7f2224d1e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f222011bc70 0x7f2220117460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:02.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.190+0000 7f2224d1e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f222011bc70 0x7f2220117460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42364/0 (socket says 172.21.15.50:42364) 2024-06-06T03:34:02.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.190+0000 7f2224d1e700 1 -- 172.21.15.50:0/3475186428 learned_addr learned my addr 172.21.15.50:0/3475186428 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:02.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.190+0000 7f2224d1e700 1 -- 172.21.15.50:0/3475186428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2220110c70 msgr2=0x7f222011b700 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-06T03:34:02.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.190+0000 7f2224d1e700 1 --2- 172.21.15.50:0/3475186428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2220110c70 0x7f222011b700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.190+0000 7f2224d1e700 1 -- 172.21.15.50:0/3475186428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22201099d0 msgr2=0x7f222011b1c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-06T03:34:02.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.190+0000 7f2224d1e700 1 --2- 172.21.15.50:0/3475186428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22201099d0 0x7f222011b1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.190+0000 7f2224d1e700 1 -- 172.21.15.50:0/3475186428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2220117d60 con 0x7f222011bc70 2024-06-06T03:34:02.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.192+0000 7f2224d1e700 1 --2- 172.21.15.50:0/3475186428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f222011bc70 0x7f2220117460 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f220801a8f0 tx=0x7f22080286d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:02.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.194+0000 7f221d7fa700 1 -- 172.21.15.50:0/3475186428 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2208028b00 con 0x7f222011bc70 2024-06-06T03:34:02.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.194+0000 7f2226781700 1 -- 172.21.15.50:0/3475186428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2220117ff0 con 0x7f222011bc70 2024-06-06T03:34:02.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.194+0000 7f2226781700 1 -- 172.21.15.50:0/3475186428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22201abce0 con 0x7f222011bc70 2024-06-06T03:34:02.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.194+0000 7f221d7fa700 1 -- 172.21.15.50:0/3475186428 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2208035070 con 0x7f222011bc70 2024-06-06T03:34:02.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.195+0000 7f221d7fa700 1 -- 172.21.15.50:0/3475186428 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220801f650 con 0x7f222011bc70 2024-06-06T03:34:02.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.205+0000 7f2231004b80 1 Processor -- start 2024-06-06T03:34:02.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.205+0000 7f2231004b80 1 -- start start 2024-06-06T03:34:02.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.205+0000 7f221d7fa700 1 -- 172.21.15.50:0/3475186428 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2208028ca0 con 0x7f222011bc70 2024-06-06T03:34:02.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.209+0000 7f2231004b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56422e7de640 0x56422e7dea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:02.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.209+0000 7f2231004b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56422e7def60 0x56422e7d89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:02.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.210+0000 7f2231004b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422e7d8f20 0x56422e7d9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:02.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.210+0000 7f2231004b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56422e72a810 con 0x56422e7def60 2024-06-06T03:34:02.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.210+0000 7f2231004b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56422e6d2720 con 0x56422e7d8f20 2024-06-06T03:34:02.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.210+0000 7f2231004b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56422e7267d0 con 0x56422e7de640 2024-06-06T03:34:02.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.212+0000 7f221f7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56422e7de640 0x56422e7dea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:02.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.212+0000 7f221f7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56422e7de640 0x56422e7dea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:55386/0 (socket says 172.21.15.50:55386) 2024-06-06T03:34:02.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.212+0000 7f221f7fe700 1 -- 172.21.15.50:0/2400275862 learned_addr learned my addr 172.21.15.50:0/2400275862 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:02.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.212+0000 7f221f7fe700 1 --2- 172.21.15.50:0/2400275862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422e7d8f20 0x56422e7d9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:02.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.212+0000 7f221ffff700 1 --2- 172.21.15.50:0/2400275862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56422e7def60 0x56422e7d89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:02.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.212+0000 7f221d7fa700 1 --2- 172.21.15.50:0/3475186428 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f220c0a2c10 0x7f220c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:02.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.214+0000 7f221d7fa700 1 -- 172.21.15.50:0/3475186428 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f22080e1610 con 0x7f222011bc70 2024-06-06T03:34:02.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.215+0000 7f2224d1e700 1 --2- 172.21.15.50:0/3475186428 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f220c0a2c10 0x7f220c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:02.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.216+0000 7f221f7fe700 1 -- 172.21.15.50:0/2400275862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422e7d8f20 msgr2=0x56422e7d9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:02.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.216+0000 7f221f7fe700 1 --2- 172.21.15.50:0/2400275862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422e7d8f20 0x56422e7d9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.216+0000 7f221f7fe700 1 -- 172.21.15.50:0/2400275862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56422e7def60 msgr2=0x56422e7d89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:02.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.216+0000 7f221f7fe700 1 --2- 172.21.15.50:0/2400275862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56422e7def60 0x56422e7d89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.216+0000 7f221f7fe700 1 -- 172.21.15.50:0/2400275862 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56422e6c8f50 con 0x56422e7de640 2024-06-06T03:34:02.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.220+0000 7f2224d1e700 1 --2- 172.21.15.50:0/3475186428 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f220c0a2c10 0x7f220c0a50d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f220801c5d0 tx=0x7f2208028f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:02.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.220+0000 7f221f7fe700 1 --2- 172.21.15.50:0/2400275862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56422e7de640 0x56422e7dea20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f22180143d0 tx=0x7f22180090d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc445a4625f79e4f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:02.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.226+0000 7f22167fc700 1 -- 172.21.15.50:0/2400275862 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221801c070 con 0x56422e7de640 2024-06-06T03:34:02.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.226+0000 7f22167fc700 1 -- 172.21.15.50:0/2400275862 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f221800d070 con 0x56422e7de640 2024-06-06T03:34:02.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.226+0000 7f22167fc700 1 -- 172.21.15.50:0/2400275862 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221800f050 con 0x56422e7de640 2024-06-06T03:34:02.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.229+0000 7f2231004b80 1 -- 172.21.15.50:0/2400275862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56422e7de640 msgr2=0x56422e7dea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:02.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.229+0000 7f2231004b80 1 --2- 172.21.15.50:0/2400275862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56422e7de640 0x56422e7dea20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f22180143d0 tx=0x7f22180090d0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.232+0000 7f2231004b80 1 -- 172.21.15.50:0/2400275862 shutdown_connections 2024-06-06T03:34:02.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.232+0000 7f2231004b80 1 --2- 172.21.15.50:0/2400275862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422e7d8f20 0x56422e7d9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.232+0000 7f2231004b80 1 --2- 172.21.15.50:0/2400275862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56422e7de640 0x56422e7dea20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.232+0000 7f2231004b80 1 --2- 172.21.15.50:0/2400275862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56422e7def60 0x56422e7d89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.232+0000 7f2231004b80 1 -- 172.21.15.50:0/2400275862 >> 172.21.15.50:0/2400275862 conn(0x56422e703cc0 msgr2=0x56422e7d3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:02.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.239+0000 7f2231004b80 1 -- 172.21.15.50:0/2400275862 shutdown_connections 2024-06-06T03:34:02.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.243+0000 7f2231004b80 1 -- 172.21.15.50:0/2400275862 wait complete. 2024-06-06T03:34:02.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.243+0000 7f2231004b80 1 -- start start 2024-06-06T03:34:02.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.243+0000 7f2231004b80 1 Processor -- start 2024-06-06T03:34:02.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.244+0000 7f2231004b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422e7d8f20 0x56422e7e4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:02.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.244+0000 7f2231004b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56422e7de640 0x56422e7e1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:02.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.244+0000 7f2231004b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56422e7def60 0x56422e7e2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:02.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.244+0000 7f2231004b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56422e7e59d0 con 0x56422e7def60 2024-06-06T03:34:02.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.244+0000 7f2231004b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56422e6cabf0 con 0x56422e7d8f20 2024-06-06T03:34:02.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.244+0000 7f2231004b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56422e7e5b50 con 0x56422e7de640 2024-06-06T03:34:02.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.244+0000 7f2231004b80 10 client.0 _ll_register_callbacks cb 0x56422e6c4920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:34:02.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.245+0000 7f221f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422e7d8f20 0x56422e7e4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:02.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.245+0000 7f221f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422e7d8f20 0x56422e7e4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:46554/0 (socket says 172.21.15.50:46554) 2024-06-06T03:34:02.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.245+0000 7f221f7fe700 1 -- 172.21.15.50:0/1614505197 learned_addr learned my addr 172.21.15.50:0/1614505197 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:02.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.245+0000 7f221f7fe700 1 --2- 172.21.15.50:0/1614505197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56422e7def60 0x56422e7e2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:02.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.246+0000 7f221f7fe700 1 -- 172.21.15.50:0/1614505197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56422e7de640 msgr2=0x56422e7e1ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:34:02.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.246+0000 7f221f7fe700 1 --2- 172.21.15.50:0/1614505197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56422e7de640 0x56422e7e1ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.246+0000 7f221f7fe700 1 -- 172.21.15.50:0/1614505197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56422e7def60 msgr2=0x56422e7e2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:02.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.246+0000 7f221f7fe700 1 --2- 172.21.15.50:0/1614505197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56422e7def60 0x56422e7e2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.246+0000 7f221f7fe700 1 -- 172.21.15.50:0/1614505197 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56422e6798d0 con 0x56422e7d8f20 2024-06-06T03:34:02.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.246+0000 7f221f7fe700 1 --2- 172.21.15.50:0/1614505197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422e7d8f20 0x56422e7e4cf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2218006fd0 tx=0x7f221800b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dac265ff3666ab3d server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:02.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.247+0000 7f21ff7fe700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:34:02.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.248+0000 7f21ff7fe700 1 -- 172.21.15.50:0/1614505197 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221802a060 con 0x56422e7d8f20 2024-06-06T03:34:02.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.248+0000 7f21ff7fe700 1 -- 172.21.15.50:0/1614505197 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f22180176b0 con 0x56422e7d8f20 2024-06-06T03:34:02.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.248+0000 7f2231004b80 1 -- 172.21.15.50:0/1614505197 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f221800d070 con 0x56422e7d8f20 2024-06-06T03:34:02.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.255+0000 7f21ff7fe700 1 -- 172.21.15.50:0/1614505197 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f221800f070 con 0x56422e7d8f20 2024-06-06T03:34:02.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.255+0000 7f2231004b80 10 client.26090 fetch_fsmap learned FSMap version 33 2024-06-06T03:34:02.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.255+0000 7f2231004b80 1 -- 172.21.15.50:0/1614505197 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56422e7f0360 con 0x56422e7d8f20 2024-06-06T03:34:02.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.261+0000 7f21ff7fe700 1 -- 172.21.15.50:0/1614505197 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f221800d070 con 0x56422e7d8f20 2024-06-06T03:34:02.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.262+0000 7f21ff7fe700 1 -- 172.21.15.50:0/1614505197 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f2218022070 con 0x56422e7d8f20 2024-06-06T03:34:02.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.262+0000 7f2231004b80 10 client.26090 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:34:02.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.262+0000 7f2231004b80 10 client.26090 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-06-06T03:34:02.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.262+0000 7f2231004b80 20 client.26090 populate_metadata read hostname 'smithi050' 2024-06-06T03:34:02.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.262+0000 7f2231004b80 1 --2- 172.21.15.50:0/1614505197 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x56422e7f2890 0x56422e7f4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:02.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.262+0000 7f2231004b80 4 client.26090 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:34:02.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.262+0000 7f2231004b80 1 -- 172.21.15.50:0/1614505197 --> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56422e737d10 con 0x56422e7f2890 2024-06-06T03:34:02.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.265+0000 7f221ffff700 1 --2- 172.21.15.50:0/1614505197 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x56422e7f2890 0x56422e7f4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:02.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.267+0000 7f221ffff700 1 --2- 172.21.15.50:0/1614505197 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x56422e7f2890 0x56422e7f4c80 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e54d97d0fd2192c2 server_cookie=ad7e66af55183c62 in_seq=0 out_seq=0 2024-06-06T03:34:02.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.270+0000 7f21ff7fe700 10 client.26090 ms_handle_connect on v2:172.21.15.122:6836/1604366318 2024-06-06T03:34:02.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.270+0000 7f21ff7fe700 1 -- 172.21.15.50:0/1614505197 <== mds.1 v2:172.21.15.122:6836/1604366318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x56422e737d10 con 0x56422e7f2890 2024-06-06T03:34:02.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.270+0000 7f21ff7fe700 10 client.26090 handle_command_reply: tid=0 2024-06-06T03:34:02.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.270+0000 7f2231004b80 1 client.26090 shutdown 2024-06-06T03:34:02.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.273+0000 7f2231004b80 1 -- 172.21.15.50:0/1614505197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422e7d8f20 msgr2=0x56422e7e4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:02.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.273+0000 7f2231004b80 1 --2- 172.21.15.50:0/1614505197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422e7d8f20 0x56422e7e4cf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2218006fd0 tx=0x7f221800b040 comp rx=0 tx=0).stop 2024-06-06T03:34:02.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.273+0000 7f2231004b80 1 -- 172.21.15.50:0/1614505197 shutdown_connections 2024-06-06T03:34:02.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.273+0000 7f2231004b80 1 --2- 172.21.15.50:0/1614505197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56422e7def60 0x56422e7e2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.273+0000 7f2231004b80 1 --2- 172.21.15.50:0/1614505197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422e7d8f20 0x56422e7e4cf0 secure :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2218006fd0 tx=0x7f221800b040 comp rx=0 tx=0).stop 2024-06-06T03:34:02.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.273+0000 7f2231004b80 1 --2- 172.21.15.50:0/1614505197 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x56422e7f2890 0x56422e7f4c80 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.273+0000 7f2231004b80 1 --2- 172.21.15.50:0/1614505197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56422e7de640 0x56422e7e1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.273+0000 7f2231004b80 1 -- 172.21.15.50:0/1614505197 >> 172.21.15.50:0/1614505197 conn(0x56422e703cc0 msgr2=0x56422e7d35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:02.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.273+0000 7f21ff7fe700 0 client.26090 ms_handle_reset on v2:172.21.15.122:6836/1604366318 2024-06-06T03:34:02.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.279+0000 7f2231004b80 1 -- 172.21.15.50:0/1614505197 shutdown_connections 2024-06-06T03:34:02.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.280+0000 7f2231004b80 1 -- 172.21.15.50:0/1614505197 wait complete. 2024-06-06T03:34:02.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.280+0000 7f2231004b80 20 client.26090 trim_cache size 0 max 16384 2024-06-06T03:34:02.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.313+0000 7f2231004b80 1 Processor -- start 2024-06-06T03:34:02.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.313+0000 7f2231004b80 1 -- start start 2024-06-06T03:34:02.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.313+0000 7f2231004b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56422e7de640 0x56422e7d89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:02.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.313+0000 7f2231004b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56422e7def60 0x56422e7dfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:02.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.314+0000 7f2231004b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422e7f7ca0 0x56422e7f8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:02.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.314+0000 7f221f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56422e7de640 0x56422e7d89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:02.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.314+0000 7f221f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56422e7de640 0x56422e7d89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42394/0 (socket says 172.21.15.50:42394) 2024-06-06T03:34:02.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.314+0000 7f221f7fe700 1 -- 172.21.15.50:0/639788265 learned_addr learned my addr 172.21.15.50:0/639788265 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:02.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.314+0000 7f221ffff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56422e7def60 0x56422e7dfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:02.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.314+0000 7f2231004b80 1 -- 172.21.15.50:0/639788265 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f22000112a0 con 0x56422e7de640 2024-06-06T03:34:02.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.314+0000 7f2231004b80 1 -- 172.21.15.50:0/639788265 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f220000eb30 con 0x56422e7f7ca0 2024-06-06T03:34:02.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.314+0000 7f2231004b80 1 -- 172.21.15.50:0/639788265 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f220000ca30 con 0x56422e7def60 2024-06-06T03:34:02.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.314+0000 7f221f7fe700 1 --2- 172.21.15.50:0/639788265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422e7f7ca0 0x56422e7f8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:02.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.315+0000 7f221ffff700 1 -- 172.21.15.50:0/639788265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422e7f7ca0 msgr2=0x56422e7f8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:02.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.315+0000 7f221ffff700 1 --2- 172.21.15.50:0/639788265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422e7f7ca0 0x56422e7f8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.316+0000 7f221ffff700 1 -- 172.21.15.50:0/639788265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56422e7de640 msgr2=0x56422e7d89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:02.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.316+0000 7f221ffff700 1 --2- 172.21.15.50:0/639788265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56422e7de640 0x56422e7d89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.316+0000 7f221ffff700 1 -- 172.21.15.50:0/639788265 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56422e7e5a20 con 0x56422e7def60 2024-06-06T03:34:02.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.316+0000 7f221ffff700 1 --2- 172.21.15.50:0/639788265 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56422e7def60 0x56422e7dfa50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x56422e6cad40 tx=0x7f2210009650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef2789555cb83aaa server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:02.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.317+0000 7f2215ffb700 1 -- 172.21.15.50:0/639788265 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2210008030 con 0x56422e7def60 2024-06-06T03:34:02.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.317+0000 7f2215ffb700 1 -- 172.21.15.50:0/639788265 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f22100188d0 con 0x56422e7def60 2024-06-06T03:34:02.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.317+0000 7f2215ffb700 1 -- 172.21.15.50:0/639788265 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221001f950 con 0x56422e7def60 2024-06-06T03:34:02.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.319+0000 7f2231004b80 1 -- 172.21.15.50:0/639788265 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56422e7def60 msgr2=0x56422e7dfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:02.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.319+0000 7f2231004b80 1 --2- 172.21.15.50:0/639788265 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56422e7def60 0x56422e7dfa50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x56422e6cad40 tx=0x7f2210009650 comp rx=0 tx=0).stop 2024-06-06T03:34:02.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.319+0000 7f2231004b80 1 -- 172.21.15.50:0/639788265 shutdown_connections 2024-06-06T03:34:02.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.319+0000 7f2231004b80 1 --2- 172.21.15.50:0/639788265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422e7f7ca0 0x56422e7f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.319+0000 7f2231004b80 1 --2- 172.21.15.50:0/639788265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56422e7de640 0x56422e7d89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.319+0000 7f2231004b80 1 --2- 172.21.15.50:0/639788265 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56422e7def60 0x56422e7dfa50 secure :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0x56422e6cad40 tx=0x7f2210009650 comp rx=0 tx=0).stop 2024-06-06T03:34:02.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.319+0000 7f2231004b80 1 -- 172.21.15.50:0/639788265 >> 172.21.15.50:0/639788265 conn(0x56422e703cc0 msgr2=0x56422e7df340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:02.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.321+0000 7f2231004b80 1 -- 172.21.15.50:0/639788265 shutdown_connections 2024-06-06T03:34:02.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.321+0000 7f2231004b80 1 -- 172.21.15.50:0/639788265 wait complete. 2024-06-06T03:34:02.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.322+0000 7f2231004b80 1 -- start start 2024-06-06T03:34:02.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.322+0000 7f2231004b80 1 Processor -- start 2024-06-06T03:34:02.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.323+0000 7f2231004b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56422e7de640 0x56422e7f6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:02.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.323+0000 7f2231004b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422e7f7ca0 0x56422e7f6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:02.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.323+0000 7f2231004b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56422e7f6d80 0x56422e85c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:02.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.323+0000 7f221f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56422e7de640 0x56422e7f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:02.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.323+0000 7f2231004b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f220000cff0 con 0x56422e7de640 2024-06-06T03:34:02.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.323+0000 7f221f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56422e7de640 0x56422e7f6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42406/0 (socket says 172.21.15.50:42406) 2024-06-06T03:34:02.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.323+0000 7f221f7fe700 1 -- 172.21.15.50:0/3437510706 learned_addr learned my addr 172.21.15.50:0/3437510706 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:02.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.323+0000 7f2231004b80 1 -- 172.21.15.50:0/3437510706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f220000e460 con 0x56422e7f7ca0 2024-06-06T03:34:02.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.323+0000 7f2231004b80 1 -- 172.21.15.50:0/3437510706 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f220000d6c0 con 0x56422e7f6d80 2024-06-06T03:34:02.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.324+0000 7f221f7fe700 1 --2- 172.21.15.50:0/3437510706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56422e7f6d80 0x56422e85c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:02.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.324+0000 7f2231004b80 10 client.0 _ll_register_callbacks cb 0x56422e6c4920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:34:02.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.324+0000 7f221ffff700 1 --2- 172.21.15.50:0/3437510706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422e7f7ca0 0x56422e7f6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:02.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.325+0000 7f221f7fe700 1 -- 172.21.15.50:0/3437510706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56422e7f6d80 msgr2=0x56422e85c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:02.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.325+0000 7f221f7fe700 1 --2- 172.21.15.50:0/3437510706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56422e7f6d80 0x56422e85c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.325+0000 7f221f7fe700 1 -- 172.21.15.50:0/3437510706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422e7f7ca0 msgr2=0x56422e7f6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:02.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.325+0000 7f221f7fe700 1 --2- 172.21.15.50:0/3437510706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422e7f7ca0 0x56422e7f6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.325+0000 7f221f7fe700 1 -- 172.21.15.50:0/3437510706 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56422e85c710 con 0x56422e7de640 2024-06-06T03:34:02.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.328+0000 7f221f7fe700 1 --2- 172.21.15.50:0/3437510706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56422e7de640 0x56422e7f6300 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f22180149c0 tx=0x7f2218000e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d05a08734c5cf218 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:02.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.329+0000 7f21ff7fe700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:34:02.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.329+0000 7f21ff7fe700 1 -- 172.21.15.50:0/3437510706 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221803e060 con 0x56422e7de640 2024-06-06T03:34:02.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.329+0000 7f2231004b80 1 -- 172.21.15.50:0/3437510706 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22100188d0 con 0x56422e7de640 2024-06-06T03:34:02.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.329+0000 7f21ff7fe700 1 -- 172.21.15.50:0/3437510706 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f22180257b0 con 0x56422e7de640 2024-06-06T03:34:02.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.333+0000 7f21ff7fe700 1 -- 172.21.15.50:0/3437510706 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f2218045050 con 0x56422e7de640 2024-06-06T03:34:02.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.333+0000 7f2231004b80 10 client.16449 fetch_fsmap learned FSMap version 33 2024-06-06T03:34:02.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.333+0000 7f2231004b80 1 -- 172.21.15.50:0/3437510706 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56422e85d7d0 con 0x56422e7de640 2024-06-06T03:34:02.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.335+0000 7f21ff7fe700 1 -- 172.21.15.50:0/3437510706 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f221800d040 con 0x56422e7de640 2024-06-06T03:34:02.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.335+0000 7f21ff7fe700 1 -- 172.21.15.50:0/3437510706 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f2218022050 con 0x56422e7de640 2024-06-06T03:34:02.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.335+0000 7f2231004b80 10 client.16449 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:34:02.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.335+0000 7f2231004b80 10 client.16449 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-06-06T03:34:02.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.336+0000 7f2231004b80 20 client.16449 populate_metadata read hostname 'smithi050' 2024-06-06T03:34:02.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.336+0000 7f2231004b80 1 --2- 172.21.15.50:0/3437510706 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x56422e85dda0 0x56422e860190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:02.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.336+0000 7f2231004b80 4 client.16449 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:34:02.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.336+0000 7f2231004b80 1 -- 172.21.15.50:0/3437510706 --> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f22100188d0 con 0x56422e85dda0 2024-06-06T03:34:02.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.343+0000 7f221ffff700 1 --2- 172.21.15.50:0/3437510706 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x56422e85dda0 0x56422e860190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:02.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.347+0000 7f221ffff700 1 --2- 172.21.15.50:0/3437510706 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x56422e85dda0 0x56422e860190 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=93939ba2b1518764 server_cookie=ba8dea288bdb35c1 in_seq=0 out_seq=0 2024-06-06T03:34:02.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.347+0000 7f21ff7fe700 10 client.16449 ms_handle_connect on v2:172.21.15.122:6836/1604366318 2024-06-06T03:34:02.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.350+0000 7f21ff7fe700 1 -- 172.21.15.50:0/3437510706 <== mds.1 v2:172.21.15.122:6836/1604366318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f22100188d0 con 0x56422e85dda0 2024-06-06T03:34:02.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.350+0000 7f21ff7fe700 10 client.16449 handle_command_reply: tid=0 2024-06-06T03:34:02.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.350+0000 7f2231004b80 1 client.16449 shutdown 2024-06-06T03:34:02.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.350+0000 7f2231004b80 1 -- 172.21.15.50:0/3437510706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56422e7de640 msgr2=0x56422e7f6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:02.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.351+0000 7f2231004b80 1 --2- 172.21.15.50:0/3437510706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56422e7de640 0x56422e7f6300 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f22180149c0 tx=0x7f2218000e40 comp rx=0 tx=0).stop 2024-06-06T03:34:02.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.351+0000 7f2231004b80 1 -- 172.21.15.50:0/3437510706 shutdown_connections 2024-06-06T03:34:02.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.351+0000 7f2231004b80 1 --2- 172.21.15.50:0/3437510706 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x56422e85dda0 0x56422e860190 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.351+0000 7f2231004b80 1 --2- 172.21.15.50:0/3437510706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56422e7f6d80 0x56422e85c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.351+0000 7f21ff7fe700 0 client.16449 ms_handle_reset on v2:172.21.15.122:6836/1604366318 2024-06-06T03:34:02.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.351+0000 7f2231004b80 1 --2- 172.21.15.50:0/3437510706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56422e7de640 0x56422e7f6300 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.351+0000 7f2231004b80 1 --2- 172.21.15.50:0/3437510706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422e7f7ca0 0x56422e7f6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.351+0000 7f2231004b80 1 -- 172.21.15.50:0/3437510706 >> 172.21.15.50:0/3437510706 conn(0x56422e703cc0 msgr2=0x56422e7cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:02.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.353+0000 7f2231004b80 1 -- 172.21.15.50:0/3437510706 shutdown_connections 2024-06-06T03:34:02.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.353+0000 7f2231004b80 1 -- 172.21.15.50:0/3437510706 wait complete. 2024-06-06T03:34:02.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.353+0000 7f2231004b80 20 client.16449 trim_cache size 0 max 16384 2024-06-06T03:34:02.356 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:34:02.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.357+0000 7f2226781700 1 -- 172.21.15.50:0/3475186428 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f220c0a2c10 msgr2=0x7f220c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:02.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.357+0000 7f2226781700 1 --2- 172.21.15.50:0/3475186428 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f220c0a2c10 0x7f220c0a50d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f220801c5d0 tx=0x7f2208028f90 comp rx=0 tx=0).stop 2024-06-06T03:34:02.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.357+0000 7f2226781700 1 -- 172.21.15.50:0/3475186428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f222011bc70 msgr2=0x7f2220117460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:02.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.357+0000 7f2226781700 1 --2- 172.21.15.50:0/3475186428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f222011bc70 0x7f2220117460 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f220801a8f0 tx=0x7f22080286d0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.357+0000 7f2226781700 1 -- 172.21.15.50:0/3475186428 shutdown_connections 2024-06-06T03:34:02.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.357+0000 7f2226781700 1 --2- 172.21.15.50:0/3475186428 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f220c0a2c10 0x7f220c0a50d0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.357+0000 7f2226781700 1 --2- 172.21.15.50:0/3475186428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f222011bc70 0x7f2220117460 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.357+0000 7f2226781700 1 --2- 172.21.15.50:0/3475186428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22201099d0 0x7f222011b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.357+0000 7f2226781700 1 --2- 172.21.15.50:0/3475186428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2220110c70 0x7f222011b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:02.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.357+0000 7f2226781700 1 -- 172.21.15.50:0/3475186428 >> 172.21.15.50:0/3475186428 conn(0x7f222006d600 msgr2=0x7f222011d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:02.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.357+0000 7f2226781700 1 -- 172.21.15.50:0/3475186428 shutdown_connections 2024-06-06T03:34:02.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:02.357+0000 7f2226781700 1 -- 172.21.15.50:0/3475186428 wait complete. 2024-06-06T03:34:03.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:03 smithi050 ceph-mon[32421]: pgmap v653: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 32 MiB/s wr, 613 op/s 2024-06-06T03:34:03.400 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:03 smithi079 ceph-mon[35478]: pgmap v653: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 32 MiB/s wr, 613 op/s 2024-06-06T03:34:03.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:03 smithi122 ceph-mon[35759]: pgmap v653: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 32 MiB/s wr, 613 op/s 2024-06-06T03:34:03.771 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-06-06T03:34:04.598 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:34:05.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:05 smithi122 ceph-mon[35759]: pgmap v654: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 33 MiB/s wr, 627 op/s 2024-06-06T03:34:05.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:05 smithi050 ceph-mon[32421]: pgmap v654: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 33 MiB/s wr, 627 op/s 2024-06-06T03:34:05.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:05 smithi079 ceph-mon[35478]: pgmap v654: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 33 MiB/s wr, 627 op/s 2024-06-06T03:34:07.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:07 smithi122 ceph-mon[35759]: pgmap v655: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 39 MiB/s wr, 743 op/s 2024-06-06T03:34:07.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:07 smithi050 ceph-mon[32421]: pgmap v655: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 39 MiB/s wr, 743 op/s 2024-06-06T03:34:07.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:07 smithi079 ceph-mon[35478]: pgmap v655: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 39 MiB/s wr, 743 op/s 2024-06-06T03:34:09.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:09 smithi122 ceph-mon[35759]: pgmap v656: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 31 MiB/s wr, 581 op/s 2024-06-06T03:34:09.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:09 smithi050 ceph-mon[32421]: pgmap v656: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 31 MiB/s wr, 581 op/s 2024-06-06T03:34:09.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:09 smithi079 ceph-mon[35478]: pgmap v656: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 31 MiB/s wr, 581 op/s 2024-06-06T03:34:09.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.688+0000 7f84315b7640 1 -- 172.21.15.50:0/906243829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84240a5da0 msgr2=0x7f84240a6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:09.689 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.688+0000 7f8429ffb640 1 -- 172.21.15.50:0/906243829 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842c095070 con 0x7f84240a5da0 2024-06-06T03:34:09.689 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.688+0000 7f84315b7640 1 --2- 172.21.15.50:0/906243829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84240a5da0 0x7f84240a6200 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f842c04fa30 tx=0x7f842c08da60 comp rx=0 tx=0).stop 2024-06-06T03:34:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.690+0000 7f84315b7640 1 -- 172.21.15.50:0/906243829 shutdown_connections 2024-06-06T03:34:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.690+0000 7f84315b7640 1 --2- 172.21.15.50:0/906243829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84240a6740 0x7f84240ab000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.690+0000 7f84315b7640 1 --2- 172.21.15.50:0/906243829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84240a5da0 0x7f84240a6200 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.690+0000 7f84315b7640 1 --2- 172.21.15.50:0/906243829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84240a4c70 0x7f84240a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.690+0000 7f84315b7640 1 -- 172.21.15.50:0/906243829 >> 172.21.15.50:0/906243829 conn(0x7f84240a0100 msgr2=0x7f84240a2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:09.696 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.694+0000 7f84315b7640 1 -- 172.21.15.50:0/906243829 shutdown_connections 2024-06-06T03:34:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.698+0000 7f84315b7640 1 -- 172.21.15.50:0/906243829 wait complete. 2024-06-06T03:34:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.698+0000 7f84315b7640 1 Processor -- start 2024-06-06T03:34:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.699+0000 7f84315b7640 1 -- start start 2024-06-06T03:34:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.699+0000 7f84315b7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84240a4c70 0x7f84240b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.699+0000 7f84315b7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84240a5da0 0x7f84240b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.699+0000 7f84315b7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84240a6740 0x7f84241425e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.699+0000 7f84315b7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f84240b8ee0 con 0x7f84240a5da0 2024-06-06T03:34:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.699+0000 7f84315b7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f84240b8d60 con 0x7f84240a4c70 2024-06-06T03:34:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.699+0000 7f84315b7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f84240b9060 con 0x7f84240a6740 2024-06-06T03:34:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.699+0000 7f842affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84240a4c70 0x7f84240b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.701+0000 7f842affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84240a4c70 0x7f84240b17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:47072/0 (socket says 172.21.15.50:47072) 2024-06-06T03:34:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.701+0000 7f842affd640 1 -- 172.21.15.50:0/4016833619 learned_addr learned my addr 172.21.15.50:0/4016833619 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.701+0000 7f842affd640 1 -- 172.21.15.50:0/4016833619 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84240a6740 msgr2=0x7f84241425e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-06T03:34:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.701+0000 7f842affd640 1 --2- 172.21.15.50:0/4016833619 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84240a6740 0x7f84241425e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.701+0000 7f842affd640 1 -- 172.21.15.50:0/4016833619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84240a5da0 msgr2=0x7f84240b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.701+0000 7f842affd640 1 --2- 172.21.15.50:0/4016833619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84240a5da0 0x7f84240b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.702+0000 7f842affd640 1 -- 172.21.15.50:0/4016833619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8424142b20 con 0x7f84240a4c70 2024-06-06T03:34:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.705+0000 7f842affd640 1 --2- 172.21.15.50:0/4016833619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84240a4c70 0x7f84240b17f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f842000d950 tx=0x7f842000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.705+0000 7f8413fff640 1 -- 172.21.15.50:0/4016833619 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8420017070 con 0x7f84240a4c70 2024-06-06T03:34:09.706 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.705+0000 7f8413fff640 1 -- 172.21.15.50:0/4016833619 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8420009c30 con 0x7f84240a4c70 2024-06-06T03:34:09.706 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.705+0000 7f8413fff640 1 -- 172.21.15.50:0/4016833619 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842000f620 con 0x7f84240a4c70 2024-06-06T03:34:09.706 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.707+0000 7f84315b7640 1 -- 172.21.15.50:0/4016833619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8424142e10 con 0x7f84240a4c70 2024-06-06T03:34:09.706 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.707+0000 7f84315b7640 1 -- 172.21.15.50:0/4016833619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8424143310 con 0x7f84240a4c70 2024-06-06T03:34:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.712+0000 7f84343a4740 1 Processor -- start 2024-06-06T03:34:09.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.713+0000 7f8413fff640 1 -- 172.21.15.50:0/4016833619 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f84200109a0 con 0x7f84240a4c70 2024-06-06T03:34:09.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.713+0000 7f84343a4740 1 -- start start 2024-06-06T03:34:09.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.714+0000 7f84343a4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572b1c971e0 0x5572b1c97600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:09.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.714+0000 7f84343a4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572b1c97bd0 0x5572b1c9c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:09.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.714+0000 7f84343a4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572b1c9cd40 0x5572b1c9f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:09.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.714+0000 7f84343a4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5572b1bfa4f0 con 0x5572b1c9cd40 2024-06-06T03:34:09.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.714+0000 7f84343a4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5572b1b98870 con 0x5572b1c97bd0 2024-06-06T03:34:09.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.714+0000 7f84343a4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5572b1bf64b0 con 0x5572b1c971e0 2024-06-06T03:34:09.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.715+0000 7f842b7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572b1c971e0 0x5572b1c97600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:09.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.715+0000 7f842b7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572b1c971e0 0x5572b1c97600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:37462/0 (socket says 172.21.15.50:37462) 2024-06-06T03:34:09.716 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.715+0000 7f842b7fe640 1 -- 172.21.15.50:0/2723495021 learned_addr learned my addr 172.21.15.50:0/2723495021 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:09.716 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.715+0000 7f842b7fe640 1 -- 172.21.15.50:0/2723495021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572b1c97bd0 msgr2=0x5572b1c9c6d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:34:09.716 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.715+0000 7f842b7fe640 1 --2- 172.21.15.50:0/2723495021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572b1c97bd0 0x5572b1c9c6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.717 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.715+0000 7f842b7fe640 1 -- 172.21.15.50:0/2723495021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572b1c9cd40 msgr2=0x5572b1c9f1d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:34:09.717 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.715+0000 7f842b7fe640 1 --2- 172.21.15.50:0/2723495021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572b1c9cd40 0x5572b1c9f1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.717 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.715+0000 7f842b7fe640 1 -- 172.21.15.50:0/2723495021 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b1bb49b0 con 0x5572b1c971e0 2024-06-06T03:34:09.717 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.716+0000 7f842b7fe640 1 --2- 172.21.15.50:0/2723495021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572b1c971e0 0x5572b1c97600 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f841c00a8e0 tx=0x7f841c00ada0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=930e99177a91a9ae server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:09.717 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.717+0000 7f84117fa640 1 -- 172.21.15.50:0/2723495021 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c00cd80 con 0x5572b1c971e0 2024-06-06T03:34:09.717 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.718+0000 7f84117fa640 1 -- 172.21.15.50:0/2723495021 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f841c00f900 con 0x5572b1c971e0 2024-06-06T03:34:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.718+0000 7f84117fa640 1 -- 172.21.15.50:0/2723495021 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c00e960 con 0x5572b1c971e0 2024-06-06T03:34:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.719+0000 7f84343a4740 1 -- 172.21.15.50:0/2723495021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572b1c971e0 msgr2=0x5572b1c97600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.719+0000 7f84343a4740 1 --2- 172.21.15.50:0/2723495021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572b1c971e0 0x5572b1c97600 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f841c00a8e0 tx=0x7f841c00ada0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.721+0000 7f84343a4740 1 -- 172.21.15.50:0/2723495021 shutdown_connections 2024-06-06T03:34:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.721+0000 7f84343a4740 1 --2- 172.21.15.50:0/2723495021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572b1c9cd40 0x5572b1c9f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.721+0000 7f84343a4740 1 --2- 172.21.15.50:0/2723495021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572b1c97bd0 0x5572b1c9c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.721+0000 7f84343a4740 1 --2- 172.21.15.50:0/2723495021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572b1c971e0 0x5572b1c97600 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.721+0000 7f84343a4740 1 -- 172.21.15.50:0/2723495021 >> 172.21.15.50:0/2723495021 conn(0x5572b1c92850 msgr2=0x5572b1c92c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.721+0000 7f8413fff640 1 --2- 172.21.15.50:0/4016833619 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f84140a2d50 0x7f84140a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:09.722 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.721+0000 7f8413fff640 1 -- 172.21.15.50:0/4016833619 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f84200cf020 con 0x7f84240a4c70 2024-06-06T03:34:09.722 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.722+0000 7f842a7fc640 1 --2- 172.21.15.50:0/4016833619 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f84140a2d50 0x7f84140a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:09.725 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.726+0000 7f84343a4740 1 -- 172.21.15.50:0/2723495021 shutdown_connections 2024-06-06T03:34:09.728 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.728+0000 7f84343a4740 1 -- 172.21.15.50:0/2723495021 wait complete. 2024-06-06T03:34:09.729 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.729+0000 7f84343a4740 1 -- start start 2024-06-06T03:34:09.729 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.729+0000 7f842a7fc640 1 --2- 172.21.15.50:0/4016833619 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f84140a2d50 0x7f84140a5210 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f842c0676b0 tx=0x7f842c067af0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:09.729 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.729+0000 7f84343a4740 1 Processor -- start 2024-06-06T03:34:09.729 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.729+0000 7f84343a4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572b1c971e0 0x5572b1ca1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:09.729 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.729+0000 7f84343a4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572b1c97bd0 0x5572b1ca1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:09.729 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.729+0000 7f84343a4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572b1c9cd40 0x5572b1ca8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:09.730 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.729+0000 7f84343a4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5572b1c9fcf0 con 0x5572b1c9cd40 2024-06-06T03:34:09.730 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.729+0000 7f84343a4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5572b1b83ae0 con 0x5572b1c97bd0 2024-06-06T03:34:09.730 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.729+0000 7f84343a4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5572b1c9fe70 con 0x5572b1c971e0 2024-06-06T03:34:09.730 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.729+0000 7f84343a4740 10 client.0 _ll_register_callbacks cb 0x5572b1bbc9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:34:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.730+0000 7f842a7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572b1c97bd0 0x5572b1ca1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.730+0000 7f842a7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572b1c97bd0 0x5572b1ca1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:47084/0 (socket says 172.21.15.50:47084) 2024-06-06T03:34:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.730+0000 7f842a7fc640 1 -- 172.21.15.50:0/2755695179 learned_addr learned my addr 172.21.15.50:0/2755695179 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.730+0000 7f842affd640 1 --2- 172.21.15.50:0/2755695179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572b1c971e0 0x5572b1ca1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.730+0000 7f842a7fc640 1 -- 172.21.15.50:0/2755695179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572b1c971e0 msgr2=0x5572b1ca1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.730+0000 7f842a7fc640 1 --2- 172.21.15.50:0/2755695179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572b1c971e0 0x5572b1ca1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.730+0000 7f842a7fc640 1 -- 172.21.15.50:0/2755695179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572b1c9cd40 msgr2=0x5572b1ca8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:09.732 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.730+0000 7f842a7fc640 1 --2- 172.21.15.50:0/2755695179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572b1c9cd40 0x5572b1ca8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.732 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.730+0000 7f842a7fc640 1 -- 172.21.15.50:0/2755695179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572b190e210 con 0x5572b1c97bd0 2024-06-06T03:34:09.732 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.731+0000 7f842a7fc640 1 --2- 172.21.15.50:0/2755695179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572b1c97bd0 0x5572b1ca1ab0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f842c0507b0 tx=0x7f842c064c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f719b39414567461 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:09.732 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.731+0000 7f840eff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:34:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.734+0000 7f840eff5640 1 -- 172.21.15.50:0/2755695179 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842c095030 con 0x5572b1c97bd0 2024-06-06T03:34:09.735 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.734+0000 7f840eff5640 1 -- 172.21.15.50:0/2755695179 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f842c06e3a0 con 0x5572b1c97bd0 2024-06-06T03:34:09.735 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.735+0000 7f84343a4740 1 -- 172.21.15.50:0/2755695179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f841c00f900 con 0x5572b1c97bd0 2024-06-06T03:34:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.738+0000 7f840eff5640 1 -- 172.21.15.50:0/2755695179 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f842c091e40 con 0x5572b1c97bd0 2024-06-06T03:34:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.739+0000 7f84343a4740 10 client.26102 fetch_fsmap learned FSMap version 33 2024-06-06T03:34:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.740+0000 7f84343a4740 1 -- 172.21.15.50:0/2755695179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5572b19da620 con 0x5572b1c97bd0 2024-06-06T03:34:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.743+0000 7f840eff5640 1 -- 172.21.15.50:0/2755695179 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f841c00f900 con 0x5572b1c97bd0 2024-06-06T03:34:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.743+0000 7f840eff5640 1 -- 172.21.15.50:0/2755695179 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f842c0b9080 con 0x5572b1c97bd0 2024-06-06T03:34:09.745 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.746+0000 7f84343a4740 10 client.26102 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:34:09.745 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.746+0000 7f84343a4740 10 client.26102 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:34:09.746 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.746+0000 7f84343a4740 20 client.26102 populate_metadata read hostname 'smithi050' 2024-06-06T03:34:09.746 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.746+0000 7f84343a4740 1 --2- 172.21.15.50:0/2755695179 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5572b1cad450 0x5572b1caf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:09.746 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.746+0000 7f84343a4740 4 client.26102 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:34:09.746 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.746+0000 7f84343a4740 1 -- 172.21.15.50:0/2755695179 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572b1c0df10 con 0x5572b1cad450 2024-06-06T03:34:09.746 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.746+0000 7f842affd640 1 --2- 172.21.15.50:0/2755695179 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5572b1cad450 0x5572b1caf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:09.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.747+0000 7f840eff5640 10 client.26102 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:09.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.747+0000 7f842affd640 1 --2- 172.21.15.50:0/2755695179 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5572b1cad450 0x5572b1caf880 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=818591b7ca2f55f1 server_cookie=e8fb3aa3e7a3dba in_seq=0 out_seq=0 2024-06-06T03:34:09.748 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.748+0000 7f840eff5640 1 -- 172.21.15.50:0/2755695179 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5572b1c0df10 con 0x5572b1cad450 2024-06-06T03:34:09.748 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.748+0000 7f840eff5640 10 client.26102 handle_command_reply: tid=0 2024-06-06T03:34:09.749 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.749+0000 7f84343a4740 1 client.26102 shutdown 2024-06-06T03:34:09.749 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.749+0000 7f84343a4740 1 -- 172.21.15.50:0/2755695179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572b1c97bd0 msgr2=0x5572b1ca1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:09.749 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.749+0000 7f84343a4740 1 --2- 172.21.15.50:0/2755695179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572b1c97bd0 0x5572b1ca1ab0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f842c0507b0 tx=0x7f842c064c10 comp rx=0 tx=0).stop 2024-06-06T03:34:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.750+0000 7f84343a4740 1 -- 172.21.15.50:0/2755695179 shutdown_connections 2024-06-06T03:34:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.750+0000 7f84343a4740 1 --2- 172.21.15.50:0/2755695179 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5572b1cad450 0x5572b1caf880 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.750+0000 7f84343a4740 1 --2- 172.21.15.50:0/2755695179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572b1c9cd40 0x5572b1ca8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.750+0000 7f84343a4740 1 --2- 172.21.15.50:0/2755695179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572b1c97bd0 0x5572b1ca1ab0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.750+0000 7f84343a4740 1 --2- 172.21.15.50:0/2755695179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572b1c971e0 0x5572b1ca1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.750+0000 7f84343a4740 1 -- 172.21.15.50:0/2755695179 >> 172.21.15.50:0/2755695179 conn(0x5572b1c92850 msgr2=0x5572b1c919d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.750+0000 7f840eff5640 0 client.26102 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.750+0000 7f84343a4740 1 -- 172.21.15.50:0/2755695179 shutdown_connections 2024-06-06T03:34:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.750+0000 7f84343a4740 1 -- 172.21.15.50:0/2755695179 wait complete. 2024-06-06T03:34:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.750+0000 7f84343a4740 20 client.26102 trim_cache size 0 max 16384 2024-06-06T03:34:09.787 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.787+0000 7f84343a4740 1 Processor -- start 2024-06-06T03:34:09.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.789+0000 7f84343a4740 1 -- start start 2024-06-06T03:34:09.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.789+0000 7f84343a4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572b1c92850 0x5572b1ca02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:09.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.789+0000 7f84343a4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572b1c971e0 0x5572b1ca8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:09.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.789+0000 7f84343a4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572b1c97bd0 0x5572b1ca0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.789+0000 7f84343a4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8424172050 con 0x5572b1c971e0 2024-06-06T03:34:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.789+0000 7f84343a4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f842414d9c0 con 0x5572b1c92850 2024-06-06T03:34:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.789+0000 7f84343a4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f842414b850 con 0x5572b1c97bd0 2024-06-06T03:34:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.789+0000 7f842a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572b1c971e0 0x5572b1ca8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.789+0000 7f842a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572b1c971e0 0x5572b1ca8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34438/0 (socket says 172.21.15.50:34438) 2024-06-06T03:34:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.789+0000 7f842a7fc640 1 -- 172.21.15.50:0/3386954245 learned_addr learned my addr 172.21.15.50:0/3386954245 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.790+0000 7f842b7fe640 1 --2- 172.21.15.50:0/3386954245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572b1c97bd0 0x5572b1ca0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.790+0000 7f842b7fe640 1 -- 172.21.15.50:0/3386954245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572b1c92850 msgr2=0x5572b1ca02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.790+0000 7f842b7fe640 1 --2- 172.21.15.50:0/3386954245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572b1c92850 0x5572b1ca02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.790+0000 7f842b7fe640 1 -- 172.21.15.50:0/3386954245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572b1c971e0 msgr2=0x5572b1ca8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.790+0000 7f842b7fe640 1 --2- 172.21.15.50:0/3386954245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572b1c971e0 0x5572b1ca8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.790+0000 7f842b7fe640 1 -- 172.21.15.50:0/3386954245 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b1c92680 con 0x5572b1c97bd0 2024-06-06T03:34:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.791+0000 7f842b7fe640 1 --2- 172.21.15.50:0/3386954245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572b1c97bd0 0x5572b1ca0840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f841c00a8b0 tx=0x7f841c00cc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56d9ce3f0f813ae5 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:09.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.793+0000 7f8410ff9640 1 -- 172.21.15.50:0/3386954245 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c00cd20 con 0x5572b1c97bd0 2024-06-06T03:34:09.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.793+0000 7f8410ff9640 1 -- 172.21.15.50:0/3386954245 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f841c0054f0 con 0x5572b1c97bd0 2024-06-06T03:34:09.794 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.794+0000 7f8410ff9640 1 -- 172.21.15.50:0/3386954245 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c00f450 con 0x5572b1c97bd0 2024-06-06T03:34:09.794 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.795+0000 7f84343a4740 1 -- 172.21.15.50:0/3386954245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572b1c97bd0 msgr2=0x5572b1ca0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:09.794 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.795+0000 7f84343a4740 1 --2- 172.21.15.50:0/3386954245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572b1c97bd0 0x5572b1ca0840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f841c00a8b0 tx=0x7f841c00cc30 comp rx=0 tx=0).stop 2024-06-06T03:34:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.797+0000 7f84343a4740 1 -- 172.21.15.50:0/3386954245 shutdown_connections 2024-06-06T03:34:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.797+0000 7f84343a4740 1 --2- 172.21.15.50:0/3386954245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572b1c971e0 0x5572b1ca8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.797+0000 7f84343a4740 1 --2- 172.21.15.50:0/3386954245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572b1c97bd0 0x5572b1ca0840 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.797+0000 7f84343a4740 1 --2- 172.21.15.50:0/3386954245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572b1c92850 0x5572b1ca02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.797+0000 7f84343a4740 1 -- 172.21.15.50:0/3386954245 >> 172.21.15.50:0/3386954245 conn(0x5572b1c9c880 msgr2=0x5572b1ca1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.803+0000 7f84343a4740 1 -- 172.21.15.50:0/3386954245 shutdown_connections 2024-06-06T03:34:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.806+0000 7f84343a4740 1 -- 172.21.15.50:0/3386954245 wait complete. 2024-06-06T03:34:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.806+0000 7f84343a4740 1 -- start start 2024-06-06T03:34:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.806+0000 7f84343a4740 1 Processor -- start 2024-06-06T03:34:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.807+0000 7f84343a4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572b1c92850 0x5572b1ca8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.807+0000 7f84343a4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572b1c971e0 0x5572b1ca53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.807+0000 7f84343a4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572b1c97bd0 0x5572b1ca58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.807+0000 7f84343a4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f842414bea0 con 0x5572b1c97bd0 2024-06-06T03:34:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.807+0000 7f84343a4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f842414d2f0 con 0x5572b1c971e0 2024-06-06T03:34:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.807+0000 7f84343a4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f842414c550 con 0x5572b1c92850 2024-06-06T03:34:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.807+0000 7f84343a4740 10 client.0 _ll_register_callbacks cb 0x7f842c068180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:34:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.808+0000 7f842affd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572b1c92850 0x5572b1ca8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.808+0000 7f842affd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572b1c92850 0x5572b1ca8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:37494/0 (socket says 172.21.15.50:37494) 2024-06-06T03:34:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.808+0000 7f842affd640 1 -- 172.21.15.50:0/614705476 learned_addr learned my addr 172.21.15.50:0/614705476 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.810+0000 7f842b7fe640 1 --2- 172.21.15.50:0/614705476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572b1c97bd0 0x5572b1ca58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.810+0000 7f842a7fc640 1 --2- 172.21.15.50:0/614705476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572b1c971e0 0x5572b1ca53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:09.811 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.812+0000 7f842affd640 1 -- 172.21.15.50:0/614705476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572b1c971e0 msgr2=0x5572b1ca53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.812+0000 7f842affd640 1 --2- 172.21.15.50:0/614705476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572b1c971e0 0x5572b1ca53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.812+0000 7f842affd640 1 -- 172.21.15.50:0/614705476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572b1c97bd0 msgr2=0x5572b1ca58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.812+0000 7f842affd640 1 --2- 172.21.15.50:0/614705476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572b1c97bd0 0x5572b1ca58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.812+0000 7f842affd640 1 -- 172.21.15.50:0/614705476 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572b1d16150 con 0x5572b1c92850 2024-06-06T03:34:09.817 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.817+0000 7f842affd640 1 --2- 172.21.15.50:0/614705476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572b1c92850 0x5572b1ca8910 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8420097900 tx=0x7f842000d8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69313f9a9bca264e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:09.818 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.818+0000 7f840eff5640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:34:09.818 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.818+0000 7f840eff5640 1 -- 172.21.15.50:0/614705476 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84200b3070 con 0x5572b1c92850 2024-06-06T03:34:09.818 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.818+0000 7f84343a4740 1 -- 172.21.15.50:0/614705476 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f841c0054f0 con 0x5572b1c92850 2024-06-06T03:34:09.818 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.818+0000 7f840eff5640 1 -- 172.21.15.50:0/614705476 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f84200cc850 con 0x5572b1c92850 2024-06-06T03:34:09.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.821+0000 7f840eff5640 1 -- 172.21.15.50:0/614705476 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8420020040 con 0x5572b1c92850 2024-06-06T03:34:09.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.821+0000 7f84343a4740 10 client.26098 fetch_fsmap learned FSMap version 33 2024-06-06T03:34:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.821+0000 7f84343a4740 1 -- 172.21.15.50:0/614705476 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5572b1d173e0 con 0x5572b1c92850 2024-06-06T03:34:09.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.824+0000 7f840eff5640 1 -- 172.21.15.50:0/614705476 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f841c0054f0 con 0x5572b1c92850 2024-06-06T03:34:09.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.824+0000 7f840eff5640 1 -- 172.21.15.50:0/614705476 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f84200af420 con 0x5572b1c92850 2024-06-06T03:34:09.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.824+0000 7f84343a4740 10 client.26098 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:34:09.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.824+0000 7f84343a4740 10 client.26098 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:34:09.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.824+0000 7f84343a4740 20 client.26098 populate_metadata read hostname 'smithi050' 2024-06-06T03:34:09.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.824+0000 7f84343a4740 1 --2- 172.21.15.50:0/614705476 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5572b1c9cd40 0x5572b1d19e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:09.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.824+0000 7f84343a4740 4 client.26098 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:34:09.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.824+0000 7f84343a4740 1 -- 172.21.15.50:0/614705476 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5572b1c07c20 con 0x5572b1c9cd40 2024-06-06T03:34:09.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.826+0000 7f842a7fc640 1 --2- 172.21.15.50:0/614705476 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5572b1c9cd40 0x5572b1d19e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:09.834 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.834+0000 7f842a7fc640 1 --2- 172.21.15.50:0/614705476 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5572b1c9cd40 0x5572b1d19e70 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26e4ba3d496bb7d3 server_cookie=8e68055e64d3466f in_seq=0 out_seq=0 2024-06-06T03:34:09.834 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.834+0000 7f840eff5640 10 client.26098 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.863+0000 7f840eff5640 1 -- 172.21.15.50:0/614705476 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5572b1c07c20 con 0x5572b1c9cd40 2024-06-06T03:34:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.864+0000 7f840eff5640 10 client.26098 handle_command_reply: tid=0 2024-06-06T03:34:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.864+0000 7f84343a4740 1 client.26098 shutdown 2024-06-06T03:34:09.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.864+0000 7f84343a4740 1 -- 172.21.15.50:0/614705476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572b1c92850 msgr2=0x5572b1ca8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:09.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.864+0000 7f84343a4740 1 --2- 172.21.15.50:0/614705476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572b1c92850 0x5572b1ca8910 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8420097900 tx=0x7f842000d8d0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.864+0000 7f84343a4740 1 -- 172.21.15.50:0/614705476 shutdown_connections 2024-06-06T03:34:09.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.864+0000 7f84343a4740 1 --2- 172.21.15.50:0/614705476 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5572b1c9cd40 0x5572b1d19e70 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.864+0000 7f84343a4740 1 --2- 172.21.15.50:0/614705476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572b1c97bd0 0x5572b1ca58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.864+0000 7f84343a4740 1 --2- 172.21.15.50:0/614705476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572b1c971e0 0x5572b1ca53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.864+0000 7f84343a4740 1 --2- 172.21.15.50:0/614705476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572b1c92850 0x5572b1ca8910 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.864+0000 7f840eff5640 0 client.26098 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:09.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.864+0000 7f84343a4740 1 -- 172.21.15.50:0/614705476 >> 172.21.15.50:0/614705476 conn(0x5572b1c9c880 msgr2=0x5572b1ca0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:09.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.870+0000 7f84343a4740 1 -- 172.21.15.50:0/614705476 shutdown_connections 2024-06-06T03:34:09.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.870+0000 7f84343a4740 1 -- 172.21.15.50:0/614705476 wait complete. 2024-06-06T03:34:09.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.871+0000 7f84343a4740 20 client.26098 trim_cache size 0 max 16384 2024-06-06T03:34:09.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:34:09.875 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:34:09.875 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:34:09.879 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.879+0000 7f84315b7640 1 -- 172.21.15.50:0/4016833619 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f84140a2d50 msgr2=0x7f84140a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.879+0000 7f84315b7640 1 --2- 172.21.15.50:0/4016833619 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f84140a2d50 0x7f84140a5210 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f842c0676b0 tx=0x7f842c067af0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.879+0000 7f84315b7640 1 -- 172.21.15.50:0/4016833619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84240a4c70 msgr2=0x7f84240b17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.879+0000 7f84315b7640 1 --2- 172.21.15.50:0/4016833619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84240a4c70 0x7f84240b17f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f842000d950 tx=0x7f842000de10 comp rx=0 tx=0).stop 2024-06-06T03:34:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.881+0000 7f84315b7640 1 -- 172.21.15.50:0/4016833619 shutdown_connections 2024-06-06T03:34:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.881+0000 7f84315b7640 1 --2- 172.21.15.50:0/4016833619 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f84140a2d50 0x7f84140a5210 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.881+0000 7f84315b7640 1 --2- 172.21.15.50:0/4016833619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84240a5da0 0x7f84240b1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.882+0000 7f84315b7640 1 --2- 172.21.15.50:0/4016833619 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84240a6740 0x7f84241425e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.882+0000 7f84315b7640 1 --2- 172.21.15.50:0/4016833619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84240a4c70 0x7f84240b17f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.882+0000 7f84315b7640 1 -- 172.21.15.50:0/4016833619 >> 172.21.15.50:0/4016833619 conn(0x7f84240a0100 msgr2=0x7f84240a6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.886+0000 7f84315b7640 1 -- 172.21.15.50:0/4016833619 shutdown_connections 2024-06-06T03:34:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:09.888+0000 7f84315b7640 1 -- 172.21.15.50:0/4016833619 wait complete. 2024-06-06T03:34:11.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:11 smithi122 ceph-mon[35759]: pgmap v657: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 40 MiB/s wr, 758 op/s 2024-06-06T03:34:11.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:11 smithi050 ceph-mon[32421]: pgmap v657: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 40 MiB/s wr, 758 op/s 2024-06-06T03:34:11.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:11 smithi079 ceph-mon[35478]: pgmap v657: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 40 MiB/s wr, 758 op/s 2024-06-06T03:34:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.234+0000 7f78e51e3700 1 -- 172.21.15.50:0/2584192359 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78e0110b80 msgr2=0x7f78e0109490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.234+0000 7f78e51e3700 1 --2- 172.21.15.50:0/2584192359 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78e0110b80 0x7f78e0109490 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f78d801a9a0 tx=0x7f78d801acb0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.237+0000 7f78e51e3700 1 -- 172.21.15.50:0/2584192359 shutdown_connections 2024-06-06T03:34:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.237+0000 7f78e51e3700 1 --2- 172.21.15.50:0/2584192359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78e011bc70 0x7f78e011e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.237+0000 7f78e51e3700 1 --2- 172.21.15.50:0/2584192359 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78e0110b80 0x7f78e0109490 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.237+0000 7f78e51e3700 1 --2- 172.21.15.50:0/2584192359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78e0110ff0 0x7f78e01099d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.237+0000 7f78e51e3700 1 -- 172.21.15.50:0/2584192359 >> 172.21.15.50:0/2584192359 conn(0x7f78e006d470 msgr2=0x7f78e006d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:13.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.239+0000 7f78e51e3700 1 -- 172.21.15.50:0/2584192359 shutdown_connections 2024-06-06T03:34:13.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.239+0000 7f78e51e3700 1 -- 172.21.15.50:0/2584192359 wait complete. 2024-06-06T03:34:13.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.239+0000 7f78e51e3700 1 Processor -- start 2024-06-06T03:34:13.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.240+0000 7f78e51e3700 1 -- start start 2024-06-06T03:34:13.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.240+0000 7f78e51e3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78e0110b80 0x7f78e011b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:13.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.240+0000 7f78e51e3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78e0110ff0 0x7f78e011b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:13.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.240+0000 7f78e51e3700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78e011bc70 0x7f78e0117430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:13.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.240+0000 7f78e51e3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f78e0113cf0 con 0x7f78e0110ff0 2024-06-06T03:34:13.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.240+0000 7f78e51e3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f78e0113b70 con 0x7f78e0110b80 2024-06-06T03:34:13.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.240+0000 7f78e51e3700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f78e0113e70 con 0x7f78e011bc70 2024-06-06T03:34:13.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.240+0000 7f78e49e2700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78e011bc70 0x7f78e0117430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:13.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.241+0000 7f78e49e2700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78e011bc70 0x7f78e0117430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:37506/0 (socket says 172.21.15.50:37506) 2024-06-06T03:34:13.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.241+0000 7f78e49e2700 1 -- 172.21.15.50:0/1127272861 learned_addr learned my addr 172.21.15.50:0/1127272861 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:13.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.241+0000 7f78dffff700 1 --2- 172.21.15.50:0/1127272861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78e0110b80 0x7f78e011b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:13.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.242+0000 7f78e49e2700 1 -- 172.21.15.50:0/1127272861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78e0110b80 msgr2=0x7f78e011b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:13.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.242+0000 7f78e49e2700 1 --2- 172.21.15.50:0/1127272861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78e0110b80 0x7f78e011b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.242+0000 7f78e49e2700 1 -- 172.21.15.50:0/1127272861 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78e0110ff0 msgr2=0x7f78e011b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:13.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.242+0000 7f78e49e2700 1 --2- 172.21.15.50:0/1127272861 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78e0110ff0 0x7f78e011b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.242+0000 7f78e49e2700 1 -- 172.21.15.50:0/1127272861 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e0117d30 con 0x7f78e011bc70 2024-06-06T03:34:13.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.245+0000 7f78e49e2700 1 --2- 172.21.15.50:0/1127272861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78e011bc70 0x7f78e0117430 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f78c800b450 tx=0x7f78c800b760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:13.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.249+0000 7f78dd7fa700 1 -- 172.21.15.50:0/1127272861 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c8015020 con 0x7f78e011bc70 2024-06-06T03:34:13.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.249+0000 7f78dd7fa700 1 -- 172.21.15.50:0/1127272861 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f78c8011ce0 con 0x7f78e011bc70 2024-06-06T03:34:13.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.249+0000 7f78dd7fa700 1 -- 172.21.15.50:0/1127272861 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c8010c80 con 0x7f78e011bc70 2024-06-06T03:34:13.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.249+0000 7f78e51e3700 1 -- 172.21.15.50:0/1127272861 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78e0118020 con 0x7f78e011bc70 2024-06-06T03:34:13.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.249+0000 7f78e51e3700 1 -- 172.21.15.50:0/1127272861 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78e007a920 con 0x7f78e011bc70 2024-06-06T03:34:13.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.253+0000 7f78dd7fa700 1 -- 172.21.15.50:0/1127272861 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f78c8018020 con 0x7f78e011bc70 2024-06-06T03:34:13.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.254+0000 7f78dd7fa700 1 --2- 172.21.15.50:0/1127272861 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f78cc0a2e20 0x7f78cc0a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:13.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.254+0000 7f78dd7fa700 1 -- 172.21.15.50:0/1127272861 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f78c80ce990 con 0x7f78e011bc70 2024-06-06T03:34:13.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.255+0000 7f78dffff700 1 --2- 172.21.15.50:0/1127272861 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f78cc0a2e20 0x7f78cc0a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:13.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.258+0000 7f78f0cc8b80 1 Processor -- start 2024-06-06T03:34:13.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.258+0000 7f78f0cc8b80 1 -- start start 2024-06-06T03:34:13.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.259+0000 7f78f0cc8b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad90b490a0 0x55ad90b49480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:13.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.259+0000 7f78f0cc8b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad90b499c0 0x55ad90b444b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:13.260 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:13 smithi050 ceph-mon[32421]: pgmap v658: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 30 MiB/s wr, 564 op/s 2024-06-06T03:34:13.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.260+0000 7f78df7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad90b499c0 0x55ad90b444b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:13.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.260+0000 7f78df7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad90b499c0 0x55ad90b444b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34470/0 (socket says 172.21.15.50:34470) 2024-06-06T03:34:13.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.259+0000 7f78f0cc8b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad90b449f0 0x55ad90b44e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:13.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.260+0000 7f78df7fe700 1 -- 172.21.15.50:0/2646454726 learned_addr learned my addr 172.21.15.50:0/2646454726 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:13.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.260+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/2646454726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ad90a36f60 con 0x55ad90b499c0 2024-06-06T03:34:13.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.260+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/2646454726 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ad90a95850 con 0x55ad90b490a0 2024-06-06T03:34:13.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.260+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/2646454726 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ad909fd460 con 0x55ad90b449f0 2024-06-06T03:34:13.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.260+0000 7f78e49e2700 1 --2- 172.21.15.50:0/2646454726 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad90b449f0 0x55ad90b44e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:13.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.261+0000 7f78e49e2700 1 -- 172.21.15.50:0/2646454726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad90b490a0 msgr2=0x55ad90b49480 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:34:13.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.261+0000 7f78e49e2700 1 --2- 172.21.15.50:0/2646454726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad90b490a0 0x55ad90b49480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.261+0000 7f78e49e2700 1 -- 172.21.15.50:0/2646454726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad90b499c0 msgr2=0x55ad90b444b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:13.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.261+0000 7f78e49e2700 1 --2- 172.21.15.50:0/2646454726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad90b499c0 0x55ad90b444b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.261+0000 7f78e49e2700 1 -- 172.21.15.50:0/2646454726 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad909e48d0 con 0x55ad90b449f0 2024-06-06T03:34:13.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.262+0000 7f78e49e2700 1 --2- 172.21.15.50:0/2646454726 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad90b449f0 0x55ad90b44e50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f78c8009fd0 tx=0x7f78c809a770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbd5653fbe82767c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:13.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.262+0000 7f78d67fc700 1 -- 172.21.15.50:0/2646454726 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c809ae10 con 0x55ad90b449f0 2024-06-06T03:34:13.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.264+0000 7f78d67fc700 1 -- 172.21.15.50:0/2646454726 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f78c809f1c0 con 0x55ad90b449f0 2024-06-06T03:34:13.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.264+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/2646454726 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad90b449f0 msgr2=0x55ad90b44e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:13.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.264+0000 7f78f0cc8b80 1 --2- 172.21.15.50:0/2646454726 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad90b449f0 0x55ad90b44e50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f78c8009fd0 tx=0x7f78c809a770 comp rx=0 tx=0).stop 2024-06-06T03:34:13.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.266+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/2646454726 shutdown_connections 2024-06-06T03:34:13.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.266+0000 7f78f0cc8b80 1 --2- 172.21.15.50:0/2646454726 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad90b449f0 0x55ad90b44e50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.266+0000 7f78f0cc8b80 1 --2- 172.21.15.50:0/2646454726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad90b490a0 0x55ad90b49480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.266+0000 7f78f0cc8b80 1 --2- 172.21.15.50:0/2646454726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad90b499c0 0x55ad90b444b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.266+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/2646454726 >> 172.21.15.50:0/2646454726 conn(0x55ad90a71080 msgr2=0x55ad90b3f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:13.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.268+0000 7f78dffff700 1 --2- 172.21.15.50:0/1127272861 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f78cc0a2e20 0x7f78cc0a52e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x55ad90b40bd0 tx=0x7f78d802a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:13.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.269+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/2646454726 shutdown_connections 2024-06-06T03:34:13.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.269+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/2646454726 wait complete. 2024-06-06T03:34:13.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.269+0000 7f78f0cc8b80 1 -- start start 2024-06-06T03:34:13.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.270+0000 7f78f0cc8b80 1 Processor -- start 2024-06-06T03:34:13.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.270+0000 7f78f0cc8b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad90b449f0 0x55ad90b50710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:13.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.270+0000 7f78f0cc8b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad90b490a0 0x55ad90b4da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:13.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.271+0000 7f78dffff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad90b449f0 0x55ad90b50710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:13.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.271+0000 7f78dffff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad90b449f0 0x55ad90b50710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:37520/0 (socket says 172.21.15.50:37520) 2024-06-06T03:34:13.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.271+0000 7f78dffff700 1 -- 172.21.15.50:0/2915735525 learned_addr learned my addr 172.21.15.50:0/2915735525 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:13.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.271+0000 7f78f0cc8b80 1 --2- 172.21.15.50:0/2915735525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad90b499c0 0x55ad90b4df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:13.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.271+0000 7f78df7fe700 1 --2- 172.21.15.50:0/2915735525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad90b490a0 0x55ad90b4da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:13.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.271+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/2915735525 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ad90a35fc0 con 0x55ad90b490a0 2024-06-06T03:34:13.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.271+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/2915735525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ad90a91810 con 0x55ad90b499c0 2024-06-06T03:34:13.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.271+0000 7f78e49e2700 1 --2- 172.21.15.50:0/2915735525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad90b499c0 0x55ad90b4df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:13.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.271+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/2915735525 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ad90b51490 con 0x55ad90b449f0 2024-06-06T03:34:13.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.272+0000 7f78dffff700 1 -- 172.21.15.50:0/2915735525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad90b499c0 msgr2=0x55ad90b4df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:13.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.272+0000 7f78dffff700 1 --2- 172.21.15.50:0/2915735525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad90b499c0 0x55ad90b4df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.272+0000 7f78dffff700 1 -- 172.21.15.50:0/2915735525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad90b490a0 msgr2=0x55ad90b4da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:13.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.272+0000 7f78dffff700 1 --2- 172.21.15.50:0/2915735525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad90b490a0 0x55ad90b4da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.272+0000 7f78dffff700 1 -- 172.21.15.50:0/2915735525 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad90a5b750 con 0x55ad90b449f0 2024-06-06T03:34:13.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.273+0000 7f78dffff700 1 --2- 172.21.15.50:0/2915735525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad90b449f0 0x55ad90b50710 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f78d8026000 tx=0x7f78d801a320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=542e5bab0e505d60 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:13.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.273+0000 7f78f0cc8b80 10 client.0 _ll_register_callbacks cb 0x55ad90a2b5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:34:13.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.273+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/2915735525 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78c809f1c0 con 0x55ad90b449f0 2024-06-06T03:34:13.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.273+0000 7f78bf7fe700 10 client.26110 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:34:13.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.273+0000 7f78bf7fe700 1 -- 172.21.15.50:0/2915735525 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d803a040 con 0x55ad90b449f0 2024-06-06T03:34:13.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.273+0000 7f78bf7fe700 1 -- 172.21.15.50:0/2915735525 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f78d8034b60 con 0x55ad90b449f0 2024-06-06T03:34:13.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.274+0000 7f78bf7fe700 1 -- 172.21.15.50:0/2915735525 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f78d804c050 con 0x55ad90b449f0 2024-06-06T03:34:13.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.274+0000 7f78f0cc8b80 10 client.26110 fetch_fsmap learned FSMap version 33 2024-06-06T03:34:13.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.274+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/2915735525 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({fsmap=33}) -- 0x55ad90b5b820 con 0x55ad90b449f0 2024-06-06T03:34:13.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.275+0000 7f78bf7fe700 1 -- 172.21.15.50:0/2915735525 <== mon.1 v2:172.21.15.122:3300/0 4 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f78d803e420 con 0x55ad90b449f0 2024-06-06T03:34:13.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.275+0000 7f78f0cc8b80 10 client.26110 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:34:13.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.275+0000 7f78f0cc8b80 10 client.26110 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:34:13.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.275+0000 7f78f0cc8b80 20 client.26110 populate_metadata read hostname 'smithi050' 2024-06-06T03:34:13.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.275+0000 7f78f0cc8b80 1 --2- 172.21.15.50:0/2915735525 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ad90b5e1f0 0x55ad90b606b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:13.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.275+0000 7f78f0cc8b80 4 client.26110 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:34:13.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.275+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/2915735525 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f78c809f1c0 con 0x55ad90b5e1f0 2024-06-06T03:34:13.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.275+0000 7f78df7fe700 1 --2- 172.21.15.50:0/2915735525 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ad90b5e1f0 0x55ad90b606b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:13.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.276+0000 7f78df7fe700 1 --2- 172.21.15.50:0/2915735525 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ad90b5e1f0 0x55ad90b606b0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=643b429acc37ff37 server_cookie=5e72c51e080cfdcc in_seq=0 out_seq=0 2024-06-06T03:34:13.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.276+0000 7f78bf7fe700 10 client.26110 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:13.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.277+0000 7f78bf7fe700 1 -- 172.21.15.50:0/2915735525 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x7f78c809f1c0 con 0x55ad90b5e1f0 2024-06-06T03:34:13.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.277+0000 7f78bf7fe700 10 client.26110 handle_command_reply: tid=0 2024-06-06T03:34:13.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.277+0000 7f78f0cc8b80 1 client.26110 shutdown 2024-06-06T03:34:13.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.283+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/2915735525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad90b449f0 msgr2=0x55ad90b50710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:13.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.283+0000 7f78f0cc8b80 1 --2- 172.21.15.50:0/2915735525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad90b449f0 0x55ad90b50710 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f78d8026000 tx=0x7f78d801a320 comp rx=0 tx=0).stop 2024-06-06T03:34:13.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.288+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/2915735525 shutdown_connections 2024-06-06T03:34:13.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.288+0000 7f78f0cc8b80 1 --2- 172.21.15.50:0/2915735525 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ad90b5e1f0 0x55ad90b606b0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.288+0000 7f78f0cc8b80 1 --2- 172.21.15.50:0/2915735525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad90b499c0 0x55ad90b4df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.288+0000 7f78f0cc8b80 1 --2- 172.21.15.50:0/2915735525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad90b449f0 0x55ad90b50710 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.288+0000 7f78f0cc8b80 1 --2- 172.21.15.50:0/2915735525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad90b490a0 0x55ad90b4da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.288+0000 7f78bf7fe700 0 client.26110 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:13.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.288+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/2915735525 >> 172.21.15.50:0/2915735525 conn(0x55ad90a71080 msgr2=0x55ad90b3e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:13.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.292+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/2915735525 shutdown_connections 2024-06-06T03:34:13.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.292+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/2915735525 wait complete. 2024-06-06T03:34:13.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.293+0000 7f78f0cc8b80 20 client.26110 trim_cache size 0 max 16384 2024-06-06T03:34:13.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.326+0000 7f78f0cc8b80 1 Processor -- start 2024-06-06T03:34:13.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.327+0000 7f78f0cc8b80 1 -- start start 2024-06-06T03:34:13.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.328+0000 7f78f0cc8b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad90b449f0 0x55ad90b4cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:13.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.328+0000 7f78f0cc8b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad90b490a0 0x55ad90b4f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:13.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.328+0000 7f78f0cc8b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad90b499c0 0x55ad90b3f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:13.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.328+0000 7f78f0cc8b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f78e01c7fd0 con 0x55ad90b449f0 2024-06-06T03:34:13.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.328+0000 7f78f0cc8b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f78e0083540 con 0x55ad90b490a0 2024-06-06T03:34:13.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.328+0000 7f78f0cc8b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f78e0081390 con 0x55ad90b499c0 2024-06-06T03:34:13.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.328+0000 7f78e49e2700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad90b499c0 0x55ad90b3f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:13.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.328+0000 7f78e49e2700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad90b499c0 0x55ad90b3f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:37524/0 (socket says 172.21.15.50:37524) 2024-06-06T03:34:13.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.328+0000 7f78e49e2700 1 -- 172.21.15.50:0/2726224964 learned_addr learned my addr 172.21.15.50:0/2726224964 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:13.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.328+0000 7f78dffff700 1 --2- 172.21.15.50:0/2726224964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad90b449f0 0x55ad90b4cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:13.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.329+0000 7f78dffff700 1 -- 172.21.15.50:0/2726224964 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad90b499c0 msgr2=0x55ad90b3f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:13.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.329+0000 7f78dffff700 1 --2- 172.21.15.50:0/2726224964 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad90b499c0 0x55ad90b3f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.329+0000 7f78dffff700 1 -- 172.21.15.50:0/2726224964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad90b490a0 msgr2=0x55ad90b4f950 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:34:13.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.329+0000 7f78dffff700 1 --2- 172.21.15.50:0/2726224964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad90b490a0 0x55ad90b4f950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.329+0000 7f78dffff700 1 -- 172.21.15.50:0/2726224964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad90b60d30 con 0x55ad90b449f0 2024-06-06T03:34:13.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.332+0000 7f78dffff700 1 --2- 172.21.15.50:0/2726224964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad90b449f0 0x55ad90b4cb90 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f78d80349b0 tx=0x7f78d803b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801ed1bcce3e64f3 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:13.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.335+0000 7f78d5ffb700 1 -- 172.21.15.50:0/2726224964 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d803a040 con 0x55ad90b449f0 2024-06-06T03:34:13.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.335+0000 7f78d5ffb700 1 -- 172.21.15.50:0/2726224964 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f78d8043070 con 0x55ad90b449f0 2024-06-06T03:34:13.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.335+0000 7f78d5ffb700 1 -- 172.21.15.50:0/2726224964 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d8051860 con 0x55ad90b449f0 2024-06-06T03:34:13.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.336+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/2726224964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad90b449f0 msgr2=0x55ad90b4cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:13.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.336+0000 7f78f0cc8b80 1 --2- 172.21.15.50:0/2726224964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad90b449f0 0x55ad90b4cb90 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f78d80349b0 tx=0x7f78d803b000 comp rx=0 tx=0).stop 2024-06-06T03:34:13.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.337+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/2726224964 shutdown_connections 2024-06-06T03:34:13.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.337+0000 7f78f0cc8b80 1 --2- 172.21.15.50:0/2726224964 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad90b499c0 0x55ad90b3f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.337+0000 7f78f0cc8b80 1 --2- 172.21.15.50:0/2726224964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad90b449f0 0x55ad90b4cb90 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.337+0000 7f78f0cc8b80 1 --2- 172.21.15.50:0/2726224964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad90b490a0 0x55ad90b4f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.337+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/2726224964 >> 172.21.15.50:0/2726224964 conn(0x55ad90a71080 msgr2=0x55ad90b4f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:13.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.343+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/2726224964 shutdown_connections 2024-06-06T03:34:13.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.344+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/2726224964 wait complete. 2024-06-06T03:34:13.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.344+0000 7f78f0cc8b80 1 -- start start 2024-06-06T03:34:13.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.345+0000 7f78f0cc8b80 1 Processor -- start 2024-06-06T03:34:13.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.345+0000 7f78f0cc8b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad90b449f0 0x55ad90b56950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:13.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.345+0000 7f78f0cc8b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad90b490a0 0x55ad90b56e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:13.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.345+0000 7f78f0cc8b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad90b499c0 0x55ad90b4adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:13.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.345+0000 7f78f0cc8b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f78e0081a00 con 0x55ad90b490a0 2024-06-06T03:34:13.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.345+0000 7f78f0cc8b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f78e0082e70 con 0x55ad90b499c0 2024-06-06T03:34:13.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.345+0000 7f78f0cc8b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f78e00820d0 con 0x55ad90b449f0 2024-06-06T03:34:13.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.345+0000 7f78f0cc8b80 10 client.0 _ll_register_callbacks cb 0x55ad90a2b5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:34:13.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.346+0000 7f78dffff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad90b449f0 0x55ad90b56950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:13.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.346+0000 7f78dffff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad90b449f0 0x55ad90b56950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:37528/0 (socket says 172.21.15.50:37528) 2024-06-06T03:34:13.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.346+0000 7f78dffff700 1 -- 172.21.15.50:0/1692544002 learned_addr learned my addr 172.21.15.50:0/1692544002 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:13.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.346+0000 7f78e49e2700 1 --2- 172.21.15.50:0/1692544002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad90b499c0 0x55ad90b4adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:13.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.346+0000 7f78dffff700 1 -- 172.21.15.50:0/1692544002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad90b499c0 msgr2=0x55ad90b4adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:13.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.346+0000 7f78dffff700 1 --2- 172.21.15.50:0/1692544002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad90b499c0 0x55ad90b4adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.346+0000 7f78dffff700 1 -- 172.21.15.50:0/1692544002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad90b490a0 msgr2=0x55ad90b56e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:13.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.346+0000 7f78dffff700 1 --2- 172.21.15.50:0/1692544002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad90b490a0 0x55ad90b56e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.346+0000 7f78dffff700 1 -- 172.21.15.50:0/1692544002 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad90b4b3f0 con 0x55ad90b449f0 2024-06-06T03:34:13.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.347+0000 7f78dffff700 1 --2- 172.21.15.50:0/1692544002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad90b449f0 0x55ad90b56950 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f78d803e920 tx=0x7f78d8005dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b4ce9873fbe4283 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:13.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.349+0000 7f78bf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:34:13.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.353+0000 7f78bf7fe700 1 -- 172.21.15.50:0/1692544002 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d803a040 con 0x55ad90b449f0 2024-06-06T03:34:13.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.353+0000 7f78bf7fe700 1 -- 172.21.15.50:0/1692544002 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f78d8034be0 con 0x55ad90b449f0 2024-06-06T03:34:13.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.354+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/1692544002 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78d8043070 con 0x55ad90b449f0 2024-06-06T03:34:13.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.355+0000 7f78bf7fe700 1 -- 172.21.15.50:0/1692544002 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f78d8034de0 con 0x55ad90b449f0 2024-06-06T03:34:13.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.356+0000 7f78f0cc8b80 10 client.26116 fetch_fsmap learned FSMap version 33 2024-06-06T03:34:13.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.356+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/1692544002 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ad90b65e10 con 0x55ad90b449f0 2024-06-06T03:34:13.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.357+0000 7f78bf7fe700 1 -- 172.21.15.50:0/1692544002 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f78d8043070 con 0x55ad90b449f0 2024-06-06T03:34:13.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.357+0000 7f78bf7fe700 1 -- 172.21.15.50:0/1692544002 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f78d8048420 con 0x55ad90b449f0 2024-06-06T03:34:13.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.357+0000 7f78f0cc8b80 10 client.26116 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:34:13.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.357+0000 7f78f0cc8b80 10 client.26116 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:34:13.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.357+0000 7f78f0cc8b80 20 client.26116 populate_metadata read hostname 'smithi050' 2024-06-06T03:34:13.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.358+0000 7f78f0cc8b80 1 --2- 172.21.15.50:0/1692544002 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ad90bc9030 0x55ad90bcb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:13.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.358+0000 7f78f0cc8b80 4 client.26116 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:34:13.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.358+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/1692544002 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ad90aa2d50 con 0x55ad90bc9030 2024-06-06T03:34:13.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.358+0000 7f78df7fe700 1 --2- 172.21.15.50:0/1692544002 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ad90bc9030 0x55ad90bcb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:13.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.370+0000 7f78bf7fe700 10 client.26116 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:13.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.370+0000 7f78df7fe700 1 --2- 172.21.15.50:0/1692544002 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ad90bc9030 0x55ad90bcb420 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50f4391b5fd2ee16 server_cookie=d540a04db6bc3c5 in_seq=0 out_seq=0 2024-06-06T03:34:13.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.371+0000 7f78bf7fe700 1 -- 172.21.15.50:0/1692544002 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ad90aa2d50 con 0x55ad90bc9030 2024-06-06T03:34:13.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.371+0000 7f78bf7fe700 10 client.26116 handle_command_reply: tid=0 2024-06-06T03:34:13.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.375+0000 7f78f0cc8b80 1 client.26116 shutdown 2024-06-06T03:34:13.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.379+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/1692544002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad90b449f0 msgr2=0x55ad90b56950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:13.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.379+0000 7f78f0cc8b80 1 --2- 172.21.15.50:0/1692544002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad90b449f0 0x55ad90b56950 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f78d803e920 tx=0x7f78d8005dd0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.384 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:34:13.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.383+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/1692544002 shutdown_connections 2024-06-06T03:34:13.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.383+0000 7f78f0cc8b80 1 --2- 172.21.15.50:0/1692544002 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ad90bc9030 0x55ad90bcb420 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.383+0000 7f78f0cc8b80 1 --2- 172.21.15.50:0/1692544002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad90b499c0 0x55ad90b4adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.383+0000 7f78f0cc8b80 1 --2- 172.21.15.50:0/1692544002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad90b449f0 0x55ad90b56950 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.383+0000 7f78f0cc8b80 1 --2- 172.21.15.50:0/1692544002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad90b490a0 0x55ad90b56e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.383+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/1692544002 >> 172.21.15.50:0/1692544002 conn(0x55ad90a71080 msgr2=0x55ad90b4fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:13.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.383+0000 7f78bf7fe700 0 client.26116 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:13.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.384+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/1692544002 shutdown_connections 2024-06-06T03:34:13.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.384+0000 7f78f0cc8b80 1 -- 172.21.15.50:0/1692544002 wait complete. 2024-06-06T03:34:13.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.384+0000 7f78f0cc8b80 20 client.26116 trim_cache size 0 max 16384 2024-06-06T03:34:13.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.385+0000 7f78e51e3700 1 -- 172.21.15.50:0/1127272861 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f78cc0a2e20 msgr2=0x7f78cc0a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:13.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.385+0000 7f78e51e3700 1 --2- 172.21.15.50:0/1127272861 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f78cc0a2e20 0x7f78cc0a52e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x55ad90b40bd0 tx=0x7f78d802a040 comp rx=0 tx=0).stop 2024-06-06T03:34:13.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.385+0000 7f78e51e3700 1 -- 172.21.15.50:0/1127272861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78e011bc70 msgr2=0x7f78e0117430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:13.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.385+0000 7f78e51e3700 1 --2- 172.21.15.50:0/1127272861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78e011bc70 0x7f78e0117430 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f78c800b450 tx=0x7f78c800b760 comp rx=0 tx=0).stop 2024-06-06T03:34:13.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.385+0000 7f78e51e3700 1 -- 172.21.15.50:0/1127272861 shutdown_connections 2024-06-06T03:34:13.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.385+0000 7f78e51e3700 1 --2- 172.21.15.50:0/1127272861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78e011bc70 0x7f78e0117430 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.385+0000 7f78e51e3700 1 --2- 172.21.15.50:0/1127272861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78e0110b80 0x7f78e011b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.385+0000 7f78e51e3700 1 --2- 172.21.15.50:0/1127272861 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f78cc0a2e20 0x7f78cc0a52e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.385+0000 7f78e51e3700 1 --2- 172.21.15.50:0/1127272861 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78e0110ff0 0x7f78e011b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:13.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.385+0000 7f78e51e3700 1 -- 172.21.15.50:0/1127272861 >> 172.21.15.50:0/1127272861 conn(0x7f78e006d470 msgr2=0x7f78e0072e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:13.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.385+0000 7f78e51e3700 1 -- 172.21.15.50:0/1127272861 shutdown_connections 2024-06-06T03:34:13.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:13.385+0000 7f78e51e3700 1 -- 172.21.15.50:0/1127272861 wait complete. 2024-06-06T03:34:13.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:13 smithi122 ceph-mon[35759]: pgmap v658: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 30 MiB/s wr, 564 op/s 2024-06-06T03:34:13.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:13 smithi079 ceph-mon[35478]: pgmap v658: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 30 MiB/s wr, 564 op/s 2024-06-06T03:34:15.213 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-06T03:34:15.213 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-06-06T03:34:15.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:15 smithi122 ceph-mon[35759]: pgmap v659: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 31 MiB/s wr, 582 op/s 2024-06-06T03:34:15.503 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:15 smithi050 ceph-mon[32421]: pgmap v659: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 31 MiB/s wr, 582 op/s 2024-06-06T03:34:15.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:15 smithi079 ceph-mon[35478]: pgmap v659: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 31 MiB/s wr, 582 op/s 2024-06-06T03:34:15.897 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:34:17.231 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:17 smithi050 ceph-mon[32421]: pgmap v660: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 36 MiB/s wr, 697 op/s 2024-06-06T03:34:17.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:17 smithi122 ceph-mon[35759]: pgmap v660: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 36 MiB/s wr, 697 op/s 2024-06-06T03:34:17.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:17 smithi079 ceph-mon[35478]: pgmap v660: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 36 MiB/s wr, 697 op/s 2024-06-06T03:34:18.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.934+0000 7fc4b350b700 1 -- 172.21.15.50:0/1160633562 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4ac110b80 msgr2=0x7fc4ac109490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:18.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.934+0000 7fc4b350b700 1 --2- 172.21.15.50:0/1160633562 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4ac110b80 0x7fc4ac109490 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc49c009990 tx=0x7fc49c009ca0 comp rx=0 tx=0).stop 2024-06-06T03:34:18.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.934+0000 7fc4b350b700 1 -- 172.21.15.50:0/1160633562 shutdown_connections 2024-06-06T03:34:18.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.934+0000 7fc4b350b700 1 --2- 172.21.15.50:0/1160633562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4ac11bc70 0x7fc4ac11e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:18.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.934+0000 7fc4b350b700 1 --2- 172.21.15.50:0/1160633562 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4ac110b80 0x7fc4ac109490 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:18.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.934+0000 7fc4b350b700 1 --2- 172.21.15.50:0/1160633562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4ac110ff0 0x7fc4ac1099d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:18.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.934+0000 7fc4b350b700 1 -- 172.21.15.50:0/1160633562 >> 172.21.15.50:0/1160633562 conn(0x7fc4ac06d4a0 msgr2=0x7fc4ac06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:18.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.934+0000 7fc4b350b700 1 -- 172.21.15.50:0/1160633562 shutdown_connections 2024-06-06T03:34:18.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.935+0000 7fc4b350b700 1 -- 172.21.15.50:0/1160633562 wait complete. 2024-06-06T03:34:18.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.935+0000 7fc4b350b700 1 Processor -- start 2024-06-06T03:34:18.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.936+0000 7fc4b350b700 1 -- start start 2024-06-06T03:34:18.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.936+0000 7fc4b350b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4ac110b80 0x7fc4ac1ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:18.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.936+0000 7fc4b350b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4ac110ff0 0x7fc4ac1adc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:18.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.936+0000 7fc4b350b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4ac11bc70 0x7fc4ac1a7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:18.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.936+0000 7fc4b350b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ac121530 con 0x7fc4ac110ff0 2024-06-06T03:34:18.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.936+0000 7fc4b350b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ac1213b0 con 0x7fc4ac110b80 2024-06-06T03:34:18.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.936+0000 7fc4b350b700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ac1216b0 con 0x7fc4ac11bc70 2024-06-06T03:34:18.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.936+0000 7fc4b1aa8700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4ac11bc70 0x7fc4ac1a7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:18.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.937+0000 7fc4b1aa8700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4ac11bc70 0x7fc4ac1a7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:51500/0 (socket says 172.21.15.50:51500) 2024-06-06T03:34:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.937+0000 7fc4b1aa8700 1 -- 172.21.15.50:0/2692344341 learned_addr learned my addr 172.21.15.50:0/2692344341 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.937+0000 7fc4b12a7700 1 --2- 172.21.15.50:0/2692344341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4ac110b80 0x7fc4ac1ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.937+0000 7fc4b0aa6700 1 --2- 172.21.15.50:0/2692344341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4ac110ff0 0x7fc4ac1adc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.937+0000 7fc4b12a7700 1 -- 172.21.15.50:0/2692344341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4ac11bc70 msgr2=0x7fc4ac1a7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.937+0000 7fc4b12a7700 1 --2- 172.21.15.50:0/2692344341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4ac11bc70 0x7fc4ac1a7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.937+0000 7fc4b12a7700 1 -- 172.21.15.50:0/2692344341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4ac110ff0 msgr2=0x7fc4ac1adc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.937+0000 7fc4b12a7700 1 --2- 172.21.15.50:0/2692344341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4ac110ff0 0x7fc4ac1adc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.938+0000 7fc4b12a7700 1 -- 172.21.15.50:0/2692344341 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4ac1a7ff0 con 0x7fc4ac110b80 2024-06-06T03:34:18.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.938+0000 7fc4b12a7700 1 --2- 172.21.15.50:0/2692344341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4ac110b80 0x7fc4ac1ad6d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc49c005b40 tx=0x7fc49c0057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:18.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.939+0000 7fc4a27fc700 1 -- 172.21.15.50:0/2692344341 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49c027070 con 0x7fc4ac110b80 2024-06-06T03:34:18.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.939+0000 7fc4b350b700 1 -- 172.21.15.50:0/2692344341 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4ac1a8280 con 0x7fc4ac110b80 2024-06-06T03:34:18.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.939+0000 7fc4b350b700 1 -- 172.21.15.50:0/2692344341 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4ac1b45a0 con 0x7fc4ac110b80 2024-06-06T03:34:18.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.939+0000 7fc4a27fc700 1 -- 172.21.15.50:0/2692344341 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc49c022920 con 0x7fc4ac110b80 2024-06-06T03:34:18.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.939+0000 7fc4a27fc700 1 -- 172.21.15.50:0/2692344341 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49c027070 con 0x7fc4ac110b80 2024-06-06T03:34:18.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.946+0000 7fc4bdd8eb80 1 Processor -- start 2024-06-06T03:34:18.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.946+0000 7fc4bdd8eb80 1 -- start start 2024-06-06T03:34:18.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.947+0000 7fc4bdd8eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9b188b120 0x55a9b188b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:18.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.947+0000 7fc4bdd8eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9b188ba40 0x55a9b1886530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:18.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.947+0000 7fc4bdd8eb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9b1886a70 0x55a9b1886ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:18.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.947+0000 7fc4bdd8eb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a9b1778fe0 con 0x55a9b1886a70 2024-06-06T03:34:18.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.947+0000 7fc4bdd8eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a9b17d78d0 con 0x55a9b188b120 2024-06-06T03:34:18.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.947+0000 7fc4bdd8eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a9b173f4e0 con 0x55a9b188ba40 2024-06-06T03:34:18.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.948+0000 7fc4a27fc700 1 -- 172.21.15.50:0/2692344341 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc49c022470 con 0x7fc4ac110b80 2024-06-06T03:34:18.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.949+0000 7fc4a27fc700 1 --2- 172.21.15.50:0/2692344341 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc4980a3090 0x7fc4980a5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:18.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.949+0000 7fc4a27fc700 1 -- 172.21.15.50:0/2692344341 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fc49c01e030 con 0x7fc4ac110b80 2024-06-06T03:34:18.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.950+0000 7fc4b12a7700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9b188ba40 0x55a9b1886530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:18.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.950+0000 7fc4b12a7700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9b188ba40 0x55a9b1886530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:51512/0 (socket says 172.21.15.50:51512) 2024-06-06T03:34:18.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.950+0000 7fc4b12a7700 1 -- 172.21.15.50:0/2651508847 learned_addr learned my addr 172.21.15.50:0/2651508847 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:18.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.950+0000 7fc4b1aa8700 1 --2- 172.21.15.50:0/2651508847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9b188b120 0x55a9b188b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:18.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.951+0000 7fc4b1aa8700 1 -- 172.21.15.50:0/2651508847 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9b188ba40 msgr2=0x55a9b1886530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:18.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.951+0000 7fc4b1aa8700 1 --2- 172.21.15.50:0/2651508847 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9b188ba40 0x55a9b1886530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:18.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.951+0000 7fc4b1aa8700 1 -- 172.21.15.50:0/2651508847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9b1886a70 msgr2=0x55a9b1886ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:18.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.951+0000 7fc4b1aa8700 1 --2- 172.21.15.50:0/2651508847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9b1886a70 0x55a9b1886ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:18.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.951+0000 7fc4b1aa8700 1 -- 172.21.15.50:0/2651508847 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9b1726950 con 0x55a9b188b120 2024-06-06T03:34:18.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.951+0000 7fc4b1aa8700 1 --2- 172.21.15.50:0/2692344341 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc4980a3090 0x7fc4980a5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:18.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.951+0000 7fc4b1aa8700 1 --2- 172.21.15.50:0/2651508847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9b188b120 0x55a9b188b500 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4009f50 tx=0x7fc4a4008630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=900b52126e479025 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:18.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.952+0000 7fc4977fe700 1 -- 172.21.15.50:0/2651508847 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4017670 con 0x55a9b188b120 2024-06-06T03:34:18.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.952+0000 7fc4977fe700 1 -- 172.21.15.50:0/2651508847 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc4a401c020 con 0x55a9b188b120 2024-06-06T03:34:18.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.953+0000 7fc4bdd8eb80 1 -- 172.21.15.50:0/2651508847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9b188b120 msgr2=0x55a9b188b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:18.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.953+0000 7fc4bdd8eb80 1 --2- 172.21.15.50:0/2651508847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9b188b120 0x55a9b188b500 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4009f50 tx=0x7fc4a4008630 comp rx=0 tx=0).stop 2024-06-06T03:34:18.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.953+0000 7fc4b1aa8700 1 --2- 172.21.15.50:0/2692344341 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc4980a3090 0x7fc4980a5550 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc4a401d000 tx=0x7fc4a4016c40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:18.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.953+0000 7fc4bdd8eb80 1 -- 172.21.15.50:0/2651508847 shutdown_connections 2024-06-06T03:34:18.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.953+0000 7fc4bdd8eb80 1 --2- 172.21.15.50:0/2651508847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9b1886a70 0x55a9b1886ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:18.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.953+0000 7fc4bdd8eb80 1 --2- 172.21.15.50:0/2651508847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9b188b120 0x55a9b188b500 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:18.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.953+0000 7fc4bdd8eb80 1 --2- 172.21.15.50:0/2651508847 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9b188ba40 0x55a9b1886530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:18.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.953+0000 7fc4bdd8eb80 1 -- 172.21.15.50:0/2651508847 >> 172.21.15.50:0/2651508847 conn(0x55a9b17b3100 msgr2=0x55a9b1881410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:18.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.958+0000 7fc4bdd8eb80 1 -- 172.21.15.50:0/2651508847 shutdown_connections 2024-06-06T03:34:18.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.964+0000 7fc4bdd8eb80 1 -- 172.21.15.50:0/2651508847 wait complete. 2024-06-06T03:34:18.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.965+0000 7fc4bdd8eb80 1 -- start start 2024-06-06T03:34:18.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.965+0000 7fc4bdd8eb80 1 Processor -- start 2024-06-06T03:34:18.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.974+0000 7fc4bdd8eb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9b1886a70 0x55a9b1892780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:18.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.974+0000 7fc4bdd8eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9b188b120 0x55a9b188fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:18.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.974+0000 7fc4bdd8eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9b188ba40 0x55a9b188ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:18.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.974+0000 7fc4bdd8eb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a9b1778040 con 0x55a9b1886a70 2024-06-06T03:34:18.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.974+0000 7fc4bdd8eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a9b17d3890 con 0x55a9b188ba40 2024-06-06T03:34:18.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.974+0000 7fc4bdd8eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a9b1893520 con 0x55a9b188b120 2024-06-06T03:34:18.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.974+0000 7fc4bdd8eb80 10 client.0 _ll_register_callbacks cb 0x55a9b176d630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:34:18.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.975+0000 7fc4b0aa6700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9b188b120 0x55a9b188fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:18.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.975+0000 7fc4b0aa6700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9b188b120 0x55a9b188fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:51516/0 (socket says 172.21.15.50:51516) 2024-06-06T03:34:18.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.975+0000 7fc4b0aa6700 1 -- 172.21.15.50:0/2328651476 learned_addr learned my addr 172.21.15.50:0/2328651476 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:18.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.976+0000 7fc4b12a7700 1 --2- 172.21.15.50:0/2328651476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9b1886a70 0x55a9b1892780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:18.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.976+0000 7fc4b12a7700 1 -- 172.21.15.50:0/2328651476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9b188b120 msgr2=0x55a9b188fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:18.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.976+0000 7fc4b12a7700 1 --2- 172.21.15.50:0/2328651476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9b188b120 0x55a9b188fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:18.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.977+0000 7fc4b12a7700 1 -- 172.21.15.50:0/2328651476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9b188ba40 msgr2=0x55a9b188ffc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:34:18.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.977+0000 7fc4b12a7700 1 --2- 172.21.15.50:0/2328651476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9b188ba40 0x55a9b188ffc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:18.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.977+0000 7fc4b12a7700 1 -- 172.21.15.50:0/2328651476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9b179d7d0 con 0x55a9b1886a70 2024-06-06T03:34:18.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.977+0000 7fc4b12a7700 1 --2- 172.21.15.50:0/2328651476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9b1886a70 0x55a9b1892780 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc49c0a4370 tx=0x7fc49c09b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5051225cbc0a9d38 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:18.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.977+0000 7fc494ff9700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:34:18.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.978+0000 7fc494ff9700 1 -- 172.21.15.50:0/2328651476 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49c027040 con 0x55a9b1886a70 2024-06-06T03:34:18.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.978+0000 7fc4bdd8eb80 1 -- 172.21.15.50:0/2328651476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4a401c020 con 0x55a9b1886a70 2024-06-06T03:34:18.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.978+0000 7fc494ff9700 1 -- 172.21.15.50:0/2328651476 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fc49c09c120 con 0x55a9b1886a70 2024-06-06T03:34:18.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.978+0000 7fc494ff9700 1 -- 172.21.15.50:0/2328651476 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc49c09c3c0 con 0x55a9b1886a70 2024-06-06T03:34:18.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.978+0000 7fc4bdd8eb80 10 client.16473 fetch_fsmap learned FSMap version 33 2024-06-06T03:34:18.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.978+0000 7fc4bdd8eb80 1 -- 172.21.15.50:0/2328651476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55a9b18aec10 con 0x55a9b1886a70 2024-06-06T03:34:18.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.979+0000 7fc494ff9700 1 -- 172.21.15.50:0/2328651476 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc4a401c020 con 0x55a9b1886a70 2024-06-06T03:34:18.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.980+0000 7fc494ff9700 1 -- 172.21.15.50:0/2328651476 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fc49c09b110 con 0x55a9b1886a70 2024-06-06T03:34:18.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.980+0000 7fc4bdd8eb80 10 client.16473 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:34:18.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.980+0000 7fc4bdd8eb80 10 client.16473 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:34:18.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.980+0000 7fc4bdd8eb80 20 client.16473 populate_metadata read hostname 'smithi050' 2024-06-06T03:34:18.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.980+0000 7fc4bdd8eb80 1 --2- 172.21.15.50:0/2328651476 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55a9b18b11d0 0x55a9b18b3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:18.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.980+0000 7fc4bdd8eb80 4 client.16473 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:34:18.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.980+0000 7fc4bdd8eb80 1 -- 172.21.15.50:0/2328651476 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9b17e4dd0 con 0x55a9b18b11d0 2024-06-06T03:34:18.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.980+0000 7fc4b0aa6700 1 --2- 172.21.15.50:0/2328651476 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55a9b18b11d0 0x55a9b18b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:18.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.985+0000 7fc4b0aa6700 1 --2- 172.21.15.50:0/2328651476 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55a9b18b11d0 0x55a9b18b3640 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d15ebf3e0143692c server_cookie=46f8d8515aa149cf in_seq=0 out_seq=0 2024-06-06T03:34:18.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.985+0000 7fc494ff9700 10 client.16473 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:18.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.989+0000 7fc494ff9700 1 -- 172.21.15.50:0/2328651476 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55a9b17e4dd0 con 0x55a9b18b11d0 2024-06-06T03:34:18.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.989+0000 7fc494ff9700 10 client.16473 handle_command_reply: tid=0 2024-06-06T03:34:18.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.990+0000 7fc4bdd8eb80 1 client.16473 shutdown 2024-06-06T03:34:18.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.999+0000 7fc4bdd8eb80 1 -- 172.21.15.50:0/2328651476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9b1886a70 msgr2=0x55a9b1892780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:18.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.999+0000 7fc4bdd8eb80 1 --2- 172.21.15.50:0/2328651476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9b1886a70 0x55a9b1892780 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc49c0a4370 tx=0x7fc49c09b880 comp rx=0 tx=0).stop 2024-06-06T03:34:18.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.999+0000 7fc4bdd8eb80 1 -- 172.21.15.50:0/2328651476 shutdown_connections 2024-06-06T03:34:18.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.999+0000 7fc4bdd8eb80 1 --2- 172.21.15.50:0/2328651476 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55a9b18b11d0 0x55a9b18b3640 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:18.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.999+0000 7fc4bdd8eb80 1 --2- 172.21.15.50:0/2328651476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9b188ba40 0x55a9b188ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:18.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.999+0000 7fc4bdd8eb80 1 --2- 172.21.15.50:0/2328651476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9b1886a70 0x55a9b1892780 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:18.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.999+0000 7fc4bdd8eb80 1 --2- 172.21.15.50:0/2328651476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9b188b120 0x55a9b188fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:18.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.999+0000 7fc4bdd8eb80 1 -- 172.21.15.50:0/2328651476 >> 172.21.15.50:0/2328651476 conn(0x55a9b17b3100 msgr2=0x55a9b18809d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:18.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:18.999+0000 7fc494ff9700 0 client.16473 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:19.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.005+0000 7fc4bdd8eb80 1 -- 172.21.15.50:0/2328651476 shutdown_connections 2024-06-06T03:34:19.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.005+0000 7fc4bdd8eb80 1 -- 172.21.15.50:0/2328651476 wait complete. 2024-06-06T03:34:19.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.005+0000 7fc4bdd8eb80 20 client.16473 trim_cache size 0 max 16384 2024-06-06T03:34:19.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.045+0000 7fc4bdd8eb80 1 Processor -- start 2024-06-06T03:34:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.045+0000 7fc4bdd8eb80 1 -- start start 2024-06-06T03:34:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.046+0000 7fc4bdd8eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9b1886a70 0x55a9b1881150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.046+0000 7fc4bdd8eb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9b188b120 0x55a9b189be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.046+0000 7fc4b12a7700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9b1886a70 0x55a9b1881150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.046+0000 7fc4b12a7700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9b1886a70 0x55a9b1881150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:51518/0 (socket says 172.21.15.50:51518) 2024-06-06T03:34:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.047+0000 7fc4b0aa6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9b188b120 0x55a9b189be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.047+0000 7fc4bdd8eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9b188ba40 0x55a9b189c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.047+0000 7fc4bdd8eb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc4900112f0 con 0x55a9b188b120 2024-06-06T03:34:19.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.047+0000 7fc4bdd8eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc49000eb80 con 0x55a9b188ba40 2024-06-06T03:34:19.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.047+0000 7fc4bdd8eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc49000ca80 con 0x55a9b1886a70 2024-06-06T03:34:19.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.047+0000 7fc4b0aa6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9b188b120 0x55a9b189be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50604/0 (socket says 172.21.15.50:50604) 2024-06-06T03:34:19.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.047+0000 7fc4b0aa6700 1 -- 172.21.15.50:0/3202458927 learned_addr learned my addr 172.21.15.50:0/3202458927 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:19.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.048+0000 7fc4b0aa6700 1 -- 172.21.15.50:0/3202458927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9b1886a70 msgr2=0x55a9b1881150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:19.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.048+0000 7fc4b0aa6700 1 --2- 172.21.15.50:0/3202458927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9b1886a70 0x55a9b1881150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:19.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.048+0000 7fc4b0aa6700 1 -- 172.21.15.50:0/3202458927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9b188ba40 msgr2=0x55a9b189c360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:34:19.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.048+0000 7fc4b0aa6700 1 --2- 172.21.15.50:0/3202458927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9b188ba40 0x55a9b189c360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:19.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.048+0000 7fc4b0aa6700 1 -- 172.21.15.50:0/3202458927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9b18b3cc0 con 0x55a9b188b120 2024-06-06T03:34:19.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.048+0000 7fc4b0aa6700 1 --2- 172.21.15.50:0/3202458927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9b188b120 0x55a9b189be20 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x55a9b18b3ef0 tx=0x7fc4a8009e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77cc6bd2bc45e71f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:19.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.049+0000 7fc496ffd700 1 -- 172.21.15.50:0/3202458927 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8015780 con 0x55a9b188b120 2024-06-06T03:34:19.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.049+0000 7fc496ffd700 1 -- 172.21.15.50:0/3202458927 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc4a8015dd0 con 0x55a9b188b120 2024-06-06T03:34:19.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.050+0000 7fc496ffd700 1 -- 172.21.15.50:0/3202458927 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8023d50 con 0x55a9b188b120 2024-06-06T03:34:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.051+0000 7fc4bdd8eb80 1 -- 172.21.15.50:0/3202458927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9b188b120 msgr2=0x55a9b189be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.051+0000 7fc4bdd8eb80 1 --2- 172.21.15.50:0/3202458927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9b188b120 0x55a9b189be20 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x55a9b18b3ef0 tx=0x7fc4a8009e80 comp rx=0 tx=0).stop 2024-06-06T03:34:19.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.054+0000 7fc4bdd8eb80 1 -- 172.21.15.50:0/3202458927 shutdown_connections 2024-06-06T03:34:19.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.054+0000 7fc4bdd8eb80 1 --2- 172.21.15.50:0/3202458927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9b188ba40 0x55a9b189c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:19.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.054+0000 7fc4bdd8eb80 1 --2- 172.21.15.50:0/3202458927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9b1886a70 0x55a9b1881150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:19.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.054+0000 7fc4bdd8eb80 1 --2- 172.21.15.50:0/3202458927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9b188b120 0x55a9b189be20 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:19.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.054+0000 7fc4bdd8eb80 1 -- 172.21.15.50:0/3202458927 >> 172.21.15.50:0/3202458927 conn(0x55a9b17b3100 msgr2=0x55a9b189b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.057+0000 7fc4bdd8eb80 1 -- 172.21.15.50:0/3202458927 shutdown_connections 2024-06-06T03:34:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.057+0000 7fc4bdd8eb80 1 -- 172.21.15.50:0/3202458927 wait complete. 2024-06-06T03:34:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.057+0000 7fc4bdd8eb80 1 -- start start 2024-06-06T03:34:19.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.058+0000 7fc4bdd8eb80 1 Processor -- start 2024-06-06T03:34:19.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.058+0000 7fc4bdd8eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9b1886a70 0x55a9b1898890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:19.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.059+0000 7fc4bdd8eb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9b188b120 0x55a9b1898dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:19.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.059+0000 7fc4b12a7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9b1886a70 0x55a9b1898890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:19.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.059+0000 7fc4b12a7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9b1886a70 0x55a9b1898890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:57612/0 (socket says 172.21.15.50:57612) 2024-06-06T03:34:19.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.059+0000 7fc4b0aa6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9b188b120 0x55a9b1898dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:19.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.059+0000 7fc4b12a7700 1 -- 172.21.15.50:0/1014087173 learned_addr learned my addr 172.21.15.50:0/1014087173 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:19.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.059+0000 7fc4bdd8eb80 1 --2- 172.21.15.50:0/1014087173 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9b188ba40 0x55a9b18b7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:19.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.059+0000 7fc4bdd8eb80 1 -- 172.21.15.50:0/1014087173 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc49000d040 con 0x55a9b188b120 2024-06-06T03:34:19.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.059+0000 7fc4bdd8eb80 1 -- 172.21.15.50:0/1014087173 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc49000e4b0 con 0x55a9b1886a70 2024-06-06T03:34:19.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.060+0000 7fc4b1aa8700 1 --2- 172.21.15.50:0/1014087173 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9b188ba40 0x55a9b18b7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:19.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.060+0000 7fc4bdd8eb80 1 -- 172.21.15.50:0/1014087173 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc49000d710 con 0x55a9b188ba40 2024-06-06T03:34:19.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.060+0000 7fc4bdd8eb80 10 client.0 _ll_register_callbacks cb 0x55a9b176d630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:34:19.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.060+0000 7fc4b12a7700 1 -- 172.21.15.50:0/1014087173 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9b188ba40 msgr2=0x55a9b18b7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:19.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.060+0000 7fc4b12a7700 1 --2- 172.21.15.50:0/1014087173 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9b188ba40 0x55a9b18b7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:19.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.060+0000 7fc4b12a7700 1 -- 172.21.15.50:0/1014087173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9b188b120 msgr2=0x55a9b1898dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:19.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.060+0000 7fc4b12a7700 1 --2- 172.21.15.50:0/1014087173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9b188b120 0x55a9b1898dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:19.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.060+0000 7fc4b12a7700 1 -- 172.21.15.50:0/1014087173 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9b18b98a0 con 0x55a9b1886a70 2024-06-06T03:34:19.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.061+0000 7fc4bdd8eb80 1 -- 172.21.15.50:0/1014087173 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4a8015dd0 con 0x55a9b1886a70 2024-06-06T03:34:19.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.064+0000 7fc4b12a7700 1 --2- 172.21.15.50:0/1014087173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9b1886a70 0x55a9b1898890 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc49c099f70 tx=0x7fc49c09bb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c600c0ef9ef5af52 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.064+0000 7fc494ff9700 10 client.26123 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:34:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.065+0000 7fc494ff9700 1 -- 172.21.15.50:0/1014087173 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49c027070 con 0x55a9b1886a70 2024-06-06T03:34:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.065+0000 7fc494ff9700 1 -- 172.21.15.50:0/1014087173 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fc49c09bf20 con 0x55a9b1886a70 2024-06-06T03:34:19.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.065+0000 7fc494ff9700 1 -- 172.21.15.50:0/1014087173 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc49c09b620 con 0x55a9b1886a70 2024-06-06T03:34:19.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.067+0000 7fc4bdd8eb80 10 client.26123 fetch_fsmap learned FSMap version 33 2024-06-06T03:34:19.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.067+0000 7fc4bdd8eb80 1 -- 172.21.15.50:0/1014087173 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=33}) -- 0x55a9b18b98a0 con 0x55a9b1886a70 2024-06-06T03:34:19.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.071+0000 7fc494ff9700 1 -- 172.21.15.50:0/1014087173 <== mon.2 v2:172.21.15.79:3300/0 4 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fc49c0050d0 con 0x55a9b1886a70 2024-06-06T03:34:19.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.071+0000 7fc4bdd8eb80 10 client.26123 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:34:19.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.071+0000 7fc4bdd8eb80 10 client.26123 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:34:19.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.071+0000 7fc4bdd8eb80 20 client.26123 populate_metadata read hostname 'smithi050' 2024-06-06T03:34:19.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.071+0000 7fc4bdd8eb80 1 --2- 172.21.15.50:0/1014087173 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55a9b191d380 0x55a9b191f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:19.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.071+0000 7fc4bdd8eb80 4 client.26123 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-06T03:34:19.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.071+0000 7fc4bdd8eb80 1 -- 172.21.15.50:0/1014087173 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a9b17df350 con 0x55a9b191d380 2024-06-06T03:34:19.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.071+0000 7fc4b0aa6700 1 --2- 172.21.15.50:0/1014087173 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55a9b191d380 0x55a9b191f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:19.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.072+0000 7fc4b0aa6700 1 --2- 172.21.15.50:0/1014087173 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55a9b191d380 0x55a9b191f7c0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4de92dd0d804130 server_cookie=c6b3f30e85680a00 in_seq=0 out_seq=0 2024-06-06T03:34:19.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.072+0000 7fc494ff9700 10 client.26123 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:19.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.074+0000 7fc494ff9700 1 -- 172.21.15.50:0/1014087173 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a9b17df350 con 0x55a9b191d380 2024-06-06T03:34:19.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.074+0000 7fc494ff9700 10 client.26123 handle_command_reply: tid=0 2024-06-06T03:34:19.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.074+0000 7fc4bdd8eb80 1 client.26123 shutdown 2024-06-06T03:34:19.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.081+0000 7fc4bdd8eb80 1 -- 172.21.15.50:0/1014087173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9b1886a70 msgr2=0x55a9b1898890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:19.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.081+0000 7fc4bdd8eb80 1 --2- 172.21.15.50:0/1014087173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9b1886a70 0x55a9b1898890 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc49c099f70 tx=0x7fc49c09bb40 comp rx=0 tx=0).stop 2024-06-06T03:34:19.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.081+0000 7fc4bdd8eb80 1 -- 172.21.15.50:0/1014087173 shutdown_connections 2024-06-06T03:34:19.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.081+0000 7fc4bdd8eb80 1 --2- 172.21.15.50:0/1014087173 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55a9b191d380 0x55a9b191f7c0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:19.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.081+0000 7fc4bdd8eb80 1 --2- 172.21.15.50:0/1014087173 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9b188ba40 0x55a9b18b7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:19.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.081+0000 7fc494ff9700 0 client.26123 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:19.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.081+0000 7fc4bdd8eb80 1 --2- 172.21.15.50:0/1014087173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9b1886a70 0x55a9b1898890 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:19.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.081+0000 7fc4bdd8eb80 1 --2- 172.21.15.50:0/1014087173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9b188b120 0x55a9b1898dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:19.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.081+0000 7fc4bdd8eb80 1 -- 172.21.15.50:0/1014087173 >> 172.21.15.50:0/1014087173 conn(0x55a9b17b3100 msgr2=0x55a9b189bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:19.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.081+0000 7fc4bdd8eb80 1 -- 172.21.15.50:0/1014087173 shutdown_connections 2024-06-06T03:34:19.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.082+0000 7fc4bdd8eb80 1 -- 172.21.15.50:0/1014087173 wait complete. 2024-06-06T03:34:19.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.082+0000 7fc4bdd8eb80 20 client.26123 trim_cache size 0 max 16384 2024-06-06T03:34:19.085 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:34:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-06-06T03:34:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "b56fb2ce-9e4e-4f5d-9884-e8b342fd2682", 2024-06-06T03:34:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-06-06T03:34:19.086 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:34:19.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.088+0000 7fc4b350b700 1 -- 172.21.15.50:0/2692344341 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc4980a3090 msgr2=0x7fc4980a5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:19.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.088+0000 7fc4b350b700 1 --2- 172.21.15.50:0/2692344341 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc4980a3090 0x7fc4980a5550 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc4a401d000 tx=0x7fc4a4016c40 comp rx=0 tx=0).stop 2024-06-06T03:34:19.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.088+0000 7fc4b350b700 1 -- 172.21.15.50:0/2692344341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4ac110b80 msgr2=0x7fc4ac1ad6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:19.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.088+0000 7fc4b350b700 1 --2- 172.21.15.50:0/2692344341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4ac110b80 0x7fc4ac1ad6d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc49c005b40 tx=0x7fc49c0057c0 comp rx=0 tx=0).stop 2024-06-06T03:34:19.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.093+0000 7fc4b350b700 1 -- 172.21.15.50:0/2692344341 shutdown_connections 2024-06-06T03:34:19.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.093+0000 7fc4b350b700 1 --2- 172.21.15.50:0/2692344341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4ac11bc70 0x7fc4ac1a7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:19.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.093+0000 7fc4b350b700 1 --2- 172.21.15.50:0/2692344341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4ac110b80 0x7fc4ac1ad6d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:19.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.093+0000 7fc4b350b700 1 --2- 172.21.15.50:0/2692344341 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc4980a3090 0x7fc4980a5550 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:19.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.093+0000 7fc4b350b700 1 --2- 172.21.15.50:0/2692344341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4ac110ff0 0x7fc4ac1adc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:19.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.093+0000 7fc4b350b700 1 -- 172.21.15.50:0/2692344341 >> 172.21.15.50:0/2692344341 conn(0x7fc4ac06d4a0 msgr2=0x7fc4ac119c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:19.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.094+0000 7fc4b350b700 1 -- 172.21.15.50:0/2692344341 shutdown_connections 2024-06-06T03:34:19.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:19.094+0000 7fc4b350b700 1 -- 172.21.15.50:0/2692344341 wait complete. 2024-06-06T03:34:19.254 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:19 smithi050 ceph-mon[32421]: pgmap v661: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 28 MiB/s wr, 542 op/s 2024-06-06T03:34:19.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:19 smithi079 ceph-mon[35478]: pgmap v661: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 28 MiB/s wr, 542 op/s 2024-06-06T03:34:19.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:19 smithi122 ceph-mon[35759]: pgmap v661: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 28 MiB/s wr, 542 op/s 2024-06-06T03:34:19.949 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-06T03:34:20.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:20 smithi050 ceph-mon[32421]: scrub queued for path: / 2024-06-06T03:34:20.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:20 smithi050 ceph-mon[32421]: scrub summary: idle+waiting paths [/] 2024-06-06T03:34:20.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:20 smithi050 ceph-mon[32421]: scrub summary: active paths [/] 2024-06-06T03:34:20.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:20 smithi050 ceph-mon[32421]: scrub summary: active paths [/] 2024-06-06T03:34:20.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:20 smithi050 ceph-mon[32421]: scrub summary: idle+waiting paths [/] 2024-06-06T03:34:20.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:20 smithi050 ceph-mon[32421]: scrub summary: idle+waiting paths [/] 2024-06-06T03:34:20.590 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:34:20.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:20 smithi079 ceph-mon[35478]: scrub queued for path: / 2024-06-06T03:34:20.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:20 smithi079 ceph-mon[35478]: scrub summary: idle+waiting paths [/] 2024-06-06T03:34:20.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:20 smithi079 ceph-mon[35478]: scrub summary: active paths [/] 2024-06-06T03:34:20.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:20 smithi079 ceph-mon[35478]: scrub summary: active paths [/] 2024-06-06T03:34:20.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:20 smithi079 ceph-mon[35478]: scrub summary: idle+waiting paths [/] 2024-06-06T03:34:20.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:20 smithi079 ceph-mon[35478]: scrub summary: idle+waiting paths [/] 2024-06-06T03:34:20.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:20 smithi122 ceph-mon[35759]: scrub queued for path: / 2024-06-06T03:34:20.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:20 smithi122 ceph-mon[35759]: scrub summary: idle+waiting paths [/] 2024-06-06T03:34:20.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:20 smithi122 ceph-mon[35759]: scrub summary: active paths [/] 2024-06-06T03:34:20.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:20 smithi122 ceph-mon[35759]: scrub summary: active paths [/] 2024-06-06T03:34:20.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:20 smithi122 ceph-mon[35759]: scrub summary: idle+waiting paths [/] 2024-06-06T03:34:20.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:20 smithi122 ceph-mon[35759]: scrub summary: idle+waiting paths [/] 2024-06-06T03:34:21.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:21 smithi050 ceph-mon[32421]: pgmap v662: 129 pgs: 129 active+clean; 10 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 39 MiB/s wr, 745 op/s 2024-06-06T03:34:21.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:21 smithi079 ceph-mon[35478]: pgmap v662: 129 pgs: 129 active+clean; 10 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 39 MiB/s wr, 745 op/s 2024-06-06T03:34:21.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:21 smithi122 ceph-mon[35759]: pgmap v662: 129 pgs: 129 active+clean; 10 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 39 MiB/s wr, 745 op/s 2024-06-06T03:34:23.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.006+0000 7fcda34a6700 1 -- 172.21.15.50:0/391951036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd9c11bc70 msgr2=0x7fcd9c11e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:23.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.006+0000 7fcda34a6700 1 --2- 172.21.15.50:0/391951036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd9c11bc70 0x7fcd9c11e060 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcd94009f90 tx=0x7fcd9400b330 comp rx=0 tx=0).stop 2024-06-06T03:34:23.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.013+0000 7fcda34a6700 1 -- 172.21.15.50:0/391951036 shutdown_connections 2024-06-06T03:34:23.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.013+0000 7fcda34a6700 1 --2- 172.21.15.50:0/391951036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd9c11bc70 0x7fcd9c11e060 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.013+0000 7fcda34a6700 1 --2- 172.21.15.50:0/391951036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd9c110c70 0x7fcd9c109490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.013+0000 7fcda34a6700 1 --2- 172.21.15.50:0/391951036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd9c1099d0 0x7fcd9c109e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.013+0000 7fcda34a6700 1 -- 172.21.15.50:0/391951036 >> 172.21.15.50:0/391951036 conn(0x7fcd9c06d600 msgr2=0x7fcd9c06da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:23.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.016+0000 7fcda34a6700 1 -- 172.21.15.50:0/391951036 shutdown_connections 2024-06-06T03:34:23.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.018+0000 7fcda34a6700 1 -- 172.21.15.50:0/391951036 wait complete. 2024-06-06T03:34:23.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.019+0000 7fcda34a6700 1 Processor -- start 2024-06-06T03:34:23.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.019+0000 7fcda34a6700 1 -- start start 2024-06-06T03:34:23.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.020+0000 7fcda34a6700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd9c1099d0 0x7fcd9c117480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.020+0000 7fcda34a6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd9c110c70 0x7fcd9c1179c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.020+0000 7fcda34a6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd9c11bc70 0x7fcd9c1a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.020+0000 7fcda34a6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcd9c113c70 con 0x7fcd9c110c70 2024-06-06T03:34:23.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.020+0000 7fcda34a6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcd9c113af0 con 0x7fcd9c11bc70 2024-06-06T03:34:23.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.020+0000 7fcda34a6700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcd9c113df0 con 0x7fcd9c1099d0 2024-06-06T03:34:23.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.021+0000 7fcda1242700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd9c1099d0 0x7fcd9c117480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:23.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.021+0000 7fcda1242700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd9c1099d0 0x7fcd9c117480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:51542/0 (socket says 172.21.15.50:51542) 2024-06-06T03:34:23.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.021+0000 7fcda1242700 1 -- 172.21.15.50:0/39917179 learned_addr learned my addr 172.21.15.50:0/39917179 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:23.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.021+0000 7fcda1a43700 1 --2- 172.21.15.50:0/39917179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd9c11bc70 0x7fcd9c1a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:23.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.023+0000 7fcda1242700 1 -- 172.21.15.50:0/39917179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd9c11bc70 msgr2=0x7fcd9c1a3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:23.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.023+0000 7fcda1242700 1 --2- 172.21.15.50:0/39917179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd9c11bc70 0x7fcd9c1a3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.023+0000 7fcda1242700 1 -- 172.21.15.50:0/39917179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd9c110c70 msgr2=0x7fcd9c1179c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:23.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.023+0000 7fcda0a41700 1 --2- 172.21.15.50:0/39917179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd9c110c70 0x7fcd9c1179c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:23.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.024+0000 7fcda1242700 1 --2- 172.21.15.50:0/39917179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd9c110c70 0x7fcd9c1179c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.024+0000 7fcda1242700 1 -- 172.21.15.50:0/39917179 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd9c1a4330 con 0x7fcd9c1099d0 2024-06-06T03:34:23.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.025+0000 7fcda0a41700 1 --2- 172.21.15.50:0/39917179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd9c110c70 0x7fcd9c1179c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:34:23.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.025+0000 7fcda1242700 1 --2- 172.21.15.50:0/39917179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd9c1099d0 0x7fcd9c117480 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcd9801faf0 tx=0x7fcd9801feb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:23.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.025+0000 7fcd927fc700 1 -- 172.21.15.50:0/39917179 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9801dad0 con 0x7fcd9c1099d0 2024-06-06T03:34:23.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.026+0000 7fcda34a6700 1 -- 172.21.15.50:0/39917179 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd9c1a4620 con 0x7fcd9c1099d0 2024-06-06T03:34:23.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.026+0000 7fcda34a6700 1 -- 172.21.15.50:0/39917179 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd9c1abeb0 con 0x7fcd9c1099d0 2024-06-06T03:34:23.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.026+0000 7fcd927fc700 1 -- 172.21.15.50:0/39917179 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcd98004ce0 con 0x7fcd9c1099d0 2024-06-06T03:34:23.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.026+0000 7fcd927fc700 1 -- 172.21.15.50:0/39917179 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd98021440 con 0x7fcd9c1099d0 2024-06-06T03:34:23.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.034+0000 7fcd927fc700 1 -- 172.21.15.50:0/39917179 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fcd9801dc70 con 0x7fcd9c1099d0 2024-06-06T03:34:23.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.046+0000 7fcd927fc700 1 --2- 172.21.15.50:0/39917179 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcd880a2db0 0x7fcd880a5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.046+0000 7fcd927fc700 1 -- 172.21.15.50:0/39917179 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fcd980e0480 con 0x7fcd9c1099d0 2024-06-06T03:34:23.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.047+0000 7fcdadd29b80 1 Processor -- start 2024-06-06T03:34:23.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.049+0000 7fcda0a41700 1 --2- 172.21.15.50:0/39917179 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcd880a2db0 0x7fcd880a5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:23.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.050+0000 7fcdadd29b80 1 -- start start 2024-06-06T03:34:23.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.050+0000 7fcdadd29b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564fe8ae2f60 0x564fe8ae3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.050+0000 7fcdadd29b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fe8ae3880 0x564fe8add260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.051+0000 7fcda1242700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564fe8ae2f60 0x564fe8ae3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:23.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.051+0000 7fcda1242700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564fe8ae2f60 0x564fe8ae3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:57622/0 (socket says 172.21.15.50:57622) 2024-06-06T03:34:23.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.051+0000 7fcda0a41700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fe8ae3880 0x564fe8add260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:23.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.051+0000 7fcda1242700 1 -- 172.21.15.50:0/1369510592 learned_addr learned my addr 172.21.15.50:0/1369510592 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:23.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.051+0000 7fcdadd29b80 1 --2- 172.21.15.50:0/1369510592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fe8add7a0 0x564fe8addbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.051+0000 7fcdadd29b80 1 -- 172.21.15.50:0/1369510592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564fe89cff60 con 0x564fe8ae3880 2024-06-06T03:34:23.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.051+0000 7fcdadd29b80 1 -- 172.21.15.50:0/1369510592 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564fe8a2e850 con 0x564fe8ae2f60 2024-06-06T03:34:23.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.051+0000 7fcdadd29b80 1 -- 172.21.15.50:0/1369510592 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564fe8996460 con 0x564fe8add7a0 2024-06-06T03:34:23.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.052+0000 7fcda0a41700 1 -- 172.21.15.50:0/1369510592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fe8add7a0 msgr2=0x564fe8addbc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:34:23.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.052+0000 7fcda0a41700 1 --2- 172.21.15.50:0/1369510592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fe8add7a0 0x564fe8addbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.052+0000 7fcda0a41700 1 -- 172.21.15.50:0/1369510592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564fe8ae2f60 msgr2=0x564fe8ae3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:23.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.052+0000 7fcda0a41700 1 --2- 172.21.15.50:0/1369510592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564fe8ae2f60 0x564fe8ae3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.052+0000 7fcda0a41700 1 -- 172.21.15.50:0/1369510592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fe897d8d0 con 0x564fe8ae3880 2024-06-06T03:34:23.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.052+0000 7fcda0a41700 1 --2- 172.21.15.50:0/1369510592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fe8ae3880 0x564fe8add260 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c06de30 tx=0x7fcd8c012d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d73f8c51bd4c285 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:23.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.053+0000 7fcda0a41700 1 --2- 172.21.15.50:0/39917179 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcd880a2db0 0x7fcd880a5270 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c011000 tx=0x7fcd8c01b000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:23.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.053+0000 7fcd877fe700 1 -- 172.21.15.50:0/1369510592 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c012230 con 0x564fe8ae3880 2024-06-06T03:34:23.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.053+0000 7fcda1242700 1 --2- 172.21.15.50:0/1369510592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564fe8ae2f60 0x564fe8ae3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:34:23.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.054+0000 7fcd877fe700 1 -- 172.21.15.50:0/1369510592 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcd8c021070 con 0x564fe8ae3880 2024-06-06T03:34:23.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.055+0000 7fcdadd29b80 1 -- 172.21.15.50:0/1369510592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fe8ae3880 msgr2=0x564fe8add260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:23.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.055+0000 7fcdadd29b80 1 --2- 172.21.15.50:0/1369510592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fe8ae3880 0x564fe8add260 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c06de30 tx=0x7fcd8c012d50 comp rx=0 tx=0).stop 2024-06-06T03:34:23.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.055+0000 7fcdadd29b80 1 -- 172.21.15.50:0/1369510592 shutdown_connections 2024-06-06T03:34:23.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.055+0000 7fcdadd29b80 1 --2- 172.21.15.50:0/1369510592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fe8add7a0 0x564fe8addbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.055+0000 7fcdadd29b80 1 --2- 172.21.15.50:0/1369510592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564fe8ae2f60 0x564fe8ae3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.055+0000 7fcdadd29b80 1 --2- 172.21.15.50:0/1369510592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fe8ae3880 0x564fe8add260 secure :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c06de30 tx=0x7fcd8c012d50 comp rx=0 tx=0).stop 2024-06-06T03:34:23.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.055+0000 7fcdadd29b80 1 -- 172.21.15.50:0/1369510592 >> 172.21.15.50:0/1369510592 conn(0x564fe8a0a080 msgr2=0x564fe8ad8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:23.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.055+0000 7fcdadd29b80 1 -- 172.21.15.50:0/1369510592 shutdown_connections 2024-06-06T03:34:23.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.057+0000 7fcdadd29b80 1 -- 172.21.15.50:0/1369510592 wait complete. 2024-06-06T03:34:23.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.057+0000 7fcdadd29b80 1 -- start start 2024-06-06T03:34:23.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.058+0000 7fcdadd29b80 1 Processor -- start 2024-06-06T03:34:23.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.058+0000 7fcdadd29b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564fe8add7a0 0x564fe8ae94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.059+0000 7fcdadd29b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fe8ae2f60 0x564fe8ae67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.059+0000 7fcda1242700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564fe8add7a0 0x564fe8ae94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:23.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.059+0000 7fcda1242700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564fe8add7a0 0x564fe8ae94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:57624/0 (socket says 172.21.15.50:57624) 2024-06-06T03:34:23.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.059+0000 7fcda1242700 1 -- 172.21.15.50:0/1730897918 learned_addr learned my addr 172.21.15.50:0/1730897918 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:23.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.059+0000 7fcdadd29b80 1 --2- 172.21.15.50:0/1730897918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fe8ae6cf0 0x564fe8ae7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.059+0000 7fcdadd29b80 1 -- 172.21.15.50:0/1730897918 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564fe89cefc0 con 0x564fe8ae6cf0 2024-06-06T03:34:23.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.059+0000 7fcdadd29b80 1 -- 172.21.15.50:0/1730897918 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564fe8a2a810 con 0x564fe8add7a0 2024-06-06T03:34:23.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.059+0000 7fcdadd29b80 1 -- 172.21.15.50:0/1730897918 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564fe8aea2b0 con 0x564fe8ae2f60 2024-06-06T03:34:23.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.059+0000 7fcdadd29b80 10 client.0 _ll_register_callbacks cb 0x564fe89c45b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:34:23.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.059+0000 7fcda1242700 1 -- 172.21.15.50:0/1730897918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fe8ae2f60 msgr2=0x564fe8ae67b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:34:23.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.059+0000 7fcda1242700 1 --2- 172.21.15.50:0/1730897918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fe8ae2f60 0x564fe8ae67b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.059+0000 7fcda1242700 1 -- 172.21.15.50:0/1730897918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fe8ae6cf0 msgr2=0x564fe8ae7170 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:34:23.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.059+0000 7fcda1242700 1 --2- 172.21.15.50:0/1730897918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fe8ae6cf0 0x564fe8ae7170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.059+0000 7fcda1242700 1 -- 172.21.15.50:0/1730897918 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fe89f4750 con 0x564fe8add7a0 2024-06-06T03:34:23.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.060+0000 7fcda1242700 1 --2- 172.21.15.50:0/1730897918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564fe8add7a0 0x564fe8ae94b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcd980b50a0 tx=0x7fcd980ad1d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40ccd4170bbe5cb7 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:23.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.060+0000 7fcdadd29b80 1 -- 172.21.15.50:0/1730897918 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564fe8a3bd50 con 0x564fe8add7a0 2024-06-06T03:34:23.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.060+0000 7fcd84ff9700 10 client.26129 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:34:23.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.060+0000 7fcd84ff9700 1 -- 172.21.15.50:0/1730897918 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd980c4070 con 0x564fe8add7a0 2024-06-06T03:34:23.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.061+0000 7fcd84ff9700 1 -- 172.21.15.50:0/1730897918 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fcd98004e90 con 0x564fe8add7a0 2024-06-06T03:34:23.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.061+0000 7fcd84ff9700 1 -- 172.21.15.50:0/1730897918 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fcd980b55d0 con 0x564fe8add7a0 2024-06-06T03:34:23.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.062+0000 7fcdadd29b80 10 client.26129 fetch_fsmap learned FSMap version 33 2024-06-06T03:34:23.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.062+0000 7fcdadd29b80 1 -- 172.21.15.50:0/1730897918 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=33}) -- 0x564fe8af4d00 con 0x564fe8add7a0 2024-06-06T03:34:23.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.066+0000 7fcd84ff9700 1 -- 172.21.15.50:0/1730897918 <== mon.2 v2:172.21.15.79:3300/0 4 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fcd9801c2d0 con 0x564fe8add7a0 2024-06-06T03:34:23.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.069+0000 7fcdadd29b80 10 client.26129 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:34:23.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.069+0000 7fcdadd29b80 10 client.26129 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:34:23.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.069+0000 7fcdadd29b80 20 client.26129 populate_metadata read hostname 'smithi050' 2024-06-06T03:34:23.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.069+0000 7fcdadd29b80 1 --2- 172.21.15.50:0/1730897918 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564fe8af7230 0x564fe8af9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.069+0000 7fcdadd29b80 4 client.26129 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:34:23.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.069+0000 7fcdadd29b80 1 -- 172.21.15.50:0/1730897918 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564fe8a3bd50 con 0x564fe8af7230 2024-06-06T03:34:23.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.072+0000 7fcda0a41700 1 --2- 172.21.15.50:0/1730897918 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564fe8af7230 0x564fe8af9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:23.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.083+0000 7fcda0a41700 1 --2- 172.21.15.50:0/1730897918 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564fe8af7230 0x564fe8af9620 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f837414d866759a5 server_cookie=7eeebd6bdbf2cfaa in_seq=0 out_seq=0 2024-06-06T03:34:23.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.083+0000 7fcd84ff9700 10 client.26129 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:23.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.084+0000 7fcd84ff9700 1 -- 172.21.15.50:0/1730897918 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x564fe8a3bd50 con 0x564fe8af7230 2024-06-06T03:34:23.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.084+0000 7fcd84ff9700 10 client.26129 handle_command_reply: tid=0 2024-06-06T03:34:23.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.085+0000 7fcdadd29b80 1 client.26129 shutdown 2024-06-06T03:34:23.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.088+0000 7fcdadd29b80 1 -- 172.21.15.50:0/1730897918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564fe8add7a0 msgr2=0x564fe8ae94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:23.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.088+0000 7fcdadd29b80 1 --2- 172.21.15.50:0/1730897918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564fe8add7a0 0x564fe8ae94b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcd980b50a0 tx=0x7fcd980ad1d0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.089+0000 7fcdadd29b80 1 -- 172.21.15.50:0/1730897918 shutdown_connections 2024-06-06T03:34:23.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.089+0000 7fcdadd29b80 1 --2- 172.21.15.50:0/1730897918 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564fe8af7230 0x564fe8af9620 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.089+0000 7fcdadd29b80 1 --2- 172.21.15.50:0/1730897918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fe8ae6cf0 0x564fe8ae7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.089+0000 7fcdadd29b80 1 --2- 172.21.15.50:0/1730897918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564fe8add7a0 0x564fe8ae94b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.089+0000 7fcdadd29b80 1 --2- 172.21.15.50:0/1730897918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fe8ae2f60 0x564fe8ae67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.089+0000 7fcd84ff9700 0 client.26129 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:23.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.089+0000 7fcdadd29b80 1 -- 172.21.15.50:0/1730897918 >> 172.21.15.50:0/1730897918 conn(0x564fe8a0a080 msgr2=0x564fe8ad6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:23.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.090+0000 7fcdadd29b80 1 -- 172.21.15.50:0/1730897918 shutdown_connections 2024-06-06T03:34:23.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.092+0000 7fcdadd29b80 1 -- 172.21.15.50:0/1730897918 wait complete. 2024-06-06T03:34:23.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.092+0000 7fcdadd29b80 20 client.26129 trim_cache size 0 max 16384 2024-06-06T03:34:23.115 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.105+0000 7f8a85810640 1 -- 172.21.15.50:0/3985235915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a80072cd0 msgr2=0x7f8a800730f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.105+0000 7f8a85810640 1 --2- 172.21.15.50:0/3985235915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a80072cd0 0x7f8a800730f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8a68009900 tx=0x7f8a6802a440 comp rx=0 tx=0).stop 2024-06-06T03:34:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.112+0000 7f8a85810640 1 -- 172.21.15.50:0/3985235915 shutdown_connections 2024-06-06T03:34:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.112+0000 7f8a85810640 1 --2- 172.21.15.50:0/3985235915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a80109970 0x7f8a8010e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.112+0000 7f8a85810640 1 --2- 172.21.15.50:0/3985235915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a80108fb0 0x7f8a80109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.112+0000 7f8a85810640 1 --2- 172.21.15.50:0/3985235915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a80072cd0 0x7f8a800730f0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.112+0000 7f8a85810640 1 -- 172.21.15.50:0/3985235915 >> 172.21.15.50:0/3985235915 conn(0x7f8a8006e840 msgr2=0x7f8a80070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.113+0000 7f8a85810640 1 -- 172.21.15.50:0/3985235915 shutdown_connections 2024-06-06T03:34:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.116+0000 7f8a85810640 1 -- 172.21.15.50:0/3985235915 wait complete. 2024-06-06T03:34:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.117+0000 7f8a85810640 1 Processor -- start 2024-06-06T03:34:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.118+0000 7f8a85810640 1 -- start start 2024-06-06T03:34:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.118+0000 7f8a85810640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a80072cd0 0x7f8a80119b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.118+0000 7f8a85810640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a80108fb0 0x7f8a8011a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.118+0000 7f8a85810640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a80109970 0x7f8a80118200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.118+0000 7f8a85810640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8a801109d0 con 0x7f8a80072cd0 2024-06-06T03:34:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.118+0000 7f8a85810640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8a80110850 con 0x7f8a80108fb0 2024-06-06T03:34:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.118+0000 7f8a85810640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8a80110b50 con 0x7f8a80109970 2024-06-06T03:34:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.118+0000 7f8a7ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a80108fb0 0x7f8a8011a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.118+0000 7f8a7ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a80108fb0 0x7f8a8011a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:57630/0 (socket says 172.21.15.50:57630) 2024-06-06T03:34:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.118+0000 7f8a7ffff640 1 -- 172.21.15.50:0/617521375 learned_addr learned my addr 172.21.15.50:0/617521375 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.119+0000 7f8a7ffff640 1 -- 172.21.15.50:0/617521375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a80109970 msgr2=0x7f8a80118200 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-06T03:34:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.119+0000 7f8a7ffff640 1 --2- 172.21.15.50:0/617521375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a80109970 0x7f8a80118200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.120 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.119+0000 7f8a7ffff640 1 -- 172.21.15.50:0/617521375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a80072cd0 msgr2=0x7f8a80119b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:23.120 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.119+0000 7f8a7ffff640 1 --2- 172.21.15.50:0/617521375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a80072cd0 0x7f8a80119b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.120 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.119+0000 7f8a7ffff640 1 -- 172.21.15.50:0/617521375 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a801188e0 con 0x7f8a80108fb0 2024-06-06T03:34:23.120 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.121+0000 7f8a7ffff640 1 --2- 172.21.15.50:0/617521375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a80108fb0 0x7f8a8011a0b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000d770 tx=0x7f8a7000dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.122+0000 7f8a7dffb640 1 -- 172.21.15.50:0/617521375 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a70017070 con 0x7f8a80108fb0 2024-06-06T03:34:23.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.122+0000 7f8a85810640 1 -- 172.21.15.50:0/617521375 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a80118bd0 con 0x7f8a80108fb0 2024-06-06T03:34:23.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.123+0000 7f8a85810640 1 -- 172.21.15.50:0/617521375 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a801b7680 con 0x7f8a80108fb0 2024-06-06T03:34:23.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.123+0000 7f8a7dffb640 1 -- 172.21.15.50:0/617521375 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8a70009c30 con 0x7f8a80108fb0 2024-06-06T03:34:23.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.123+0000 7f8a7dffb640 1 -- 172.21.15.50:0/617521375 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a70003d00 con 0x7f8a80108fb0 2024-06-06T03:34:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.127+0000 7f8a89780740 1 Processor -- start 2024-06-06T03:34:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.128+0000 7f8a89780740 1 -- start start 2024-06-06T03:34:23.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.128+0000 7f8a89780740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d90c413200 0x55d90c413620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.128+0000 7f8a89780740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90c413bf0 0x55d90c4186f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.128+0000 7f8a89780740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d90c418d60 0x55d90c41b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.128+0000 7f8a89780740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d90c3764f0 con 0x55d90c418d60 2024-06-06T03:34:23.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.128+0000 7f8a89780740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d90c314870 con 0x55d90c413200 2024-06-06T03:34:23.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.128+0000 7f8a89780740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d90c3724b0 con 0x55d90c413bf0 2024-06-06T03:34:23.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.129+0000 7f8a8500f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d90c413200 0x55d90c413620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:23.129 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.130+0000 7f8a8480e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90c413bf0 0x55d90c4186f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:23.130 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.132+0000 7f8a8480e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90c413bf0 0x55d90c4186f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:51582/0 (socket says 172.21.15.50:51582) 2024-06-06T03:34:23.130 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.132+0000 7f8a8480e640 1 -- 172.21.15.50:0/1974359509 learned_addr learned my addr 172.21.15.50:0/1974359509 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:23.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.134+0000 7f8a7dffb640 1 -- 172.21.15.50:0/617521375 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8a70003ea0 con 0x7f8a80108fb0 2024-06-06T03:34:23.134 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.135+0000 7f8a7dffb640 1 --2- 172.21.15.50:0/617521375 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8a6c0a2d10 0x7f8a6c0a51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.135 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.136+0000 7f8a8500f640 1 --2- 172.21.15.50:0/617521375 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8a6c0a2d10 0x7f8a6c0a51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:23.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.136+0000 7fcdadd29b80 1 Processor -- start 2024-06-06T03:34:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.137+0000 7f8a8480e640 1 -- 172.21.15.50:0/1974359509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d90c413200 msgr2=0x55d90c413620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.137+0000 7f8a8480e640 1 --2- 172.21.15.50:0/1974359509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d90c413200 0x55d90c413620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.137+0000 7f8a8480e640 1 -- 172.21.15.50:0/1974359509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d90c418d60 msgr2=0x55d90c41b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.137+0000 7f8a8480e640 1 --2- 172.21.15.50:0/1974359509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d90c418d60 0x55d90c41b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.137+0000 7f8a8480e640 1 -- 172.21.15.50:0/1974359509 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d90c3309b0 con 0x55d90c413bf0 2024-06-06T03:34:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.138+0000 7f8a8480e640 1 --2- 172.21.15.50:0/1974359509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90c413bf0 0x55d90c4186f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8a680040f0 tx=0x7f8a68005be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50fac3cfbab477a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.138+0000 7f8a76ffd640 1 -- 172.21.15.50:0/1974359509 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6803f070 con 0x55d90c413bf0 2024-06-06T03:34:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.138+0000 7f8a76ffd640 1 -- 172.21.15.50:0/1974359509 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8a680054b0 con 0x55d90c413bf0 2024-06-06T03:34:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.139+0000 7f8a76ffd640 1 -- 172.21.15.50:0/1974359509 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a68035030 con 0x55d90c413bf0 2024-06-06T03:34:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.139+0000 7f8a89780740 1 -- 172.21.15.50:0/1974359509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90c413bf0 msgr2=0x55d90c4186f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.139+0000 7f8a89780740 1 --2- 172.21.15.50:0/1974359509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90c413bf0 0x55d90c4186f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8a680040f0 tx=0x7f8a68005be0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.142 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.140+0000 7f8a7dffb640 1 -- 172.21.15.50:0/617521375 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f8a700035f0 con 0x7f8a80108fb0 2024-06-06T03:34:23.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.138+0000 7fcdadd29b80 1 -- start start 2024-06-06T03:34:23.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.139+0000 7fcdadd29b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fe8add7a0 0x564fe8add260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.139+0000 7fcdadd29b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fe8ae2f60 0x564fe8ae4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.139+0000 7fcdadd29b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564fe8ae6cf0 0x564fe8af34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.139+0000 7fcda1242700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fe8add7a0 0x564fe8add260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:23.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.139+0000 7fcda1242700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fe8add7a0 0x564fe8add260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50694/0 (socket says 172.21.15.50:50694) 2024-06-06T03:34:23.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.140+0000 7fcda1242700 1 -- 172.21.15.50:0/3185728152 learned_addr learned my addr 172.21.15.50:0/3185728152 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:23.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.140+0000 7fcdadd29b80 1 -- 172.21.15.50:0/3185728152 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcd800113c0 con 0x564fe8add7a0 2024-06-06T03:34:23.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.140+0000 7fcdadd29b80 1 -- 172.21.15.50:0/3185728152 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8000ec50 con 0x564fe8ae6cf0 2024-06-06T03:34:23.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.140+0000 7fcdadd29b80 1 -- 172.21.15.50:0/3185728152 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8000caa0 con 0x564fe8ae2f60 2024-06-06T03:34:23.143 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.144+0000 7f8a89780740 1 -- 172.21.15.50:0/1974359509 shutdown_connections 2024-06-06T03:34:23.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.144+0000 7f8a89780740 1 --2- 172.21.15.50:0/1974359509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d90c418d60 0x55d90c41b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.144+0000 7f8a89780740 1 --2- 172.21.15.50:0/1974359509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90c413bf0 0x55d90c4186f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.144+0000 7f8a89780740 1 --2- 172.21.15.50:0/1974359509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d90c413200 0x55d90c413620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.144+0000 7f8a89780740 1 -- 172.21.15.50:0/1974359509 >> 172.21.15.50:0/1974359509 conn(0x55d90c40e870 msgr2=0x55d90c40ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:23.146 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.147+0000 7f8a89780740 1 -- 172.21.15.50:0/1974359509 shutdown_connections 2024-06-06T03:34:23.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.140+0000 7fcda1a43700 1 --2- 172.21.15.50:0/3185728152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564fe8ae6cf0 0x564fe8af34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:23.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.141+0000 7fcda0a41700 1 --2- 172.21.15.50:0/3185728152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fe8ae2f60 0x564fe8ae4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:23.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.144+0000 7fcda1a43700 1 -- 172.21.15.50:0/3185728152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fe8ae2f60 msgr2=0x564fe8ae4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:23.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.144+0000 7fcda1a43700 1 --2- 172.21.15.50:0/3185728152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fe8ae2f60 0x564fe8ae4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.144+0000 7fcda1a43700 1 -- 172.21.15.50:0/3185728152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fe8add7a0 msgr2=0x564fe8add260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:23.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.144+0000 7fcda1a43700 1 --2- 172.21.15.50:0/3185728152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fe8add7a0 0x564fe8add260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.144+0000 7fcda1a43700 1 -- 172.21.15.50:0/3185728152 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fe8ae9a90 con 0x564fe8ae6cf0 2024-06-06T03:34:23.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.149+0000 7fcda1a43700 1 --2- 172.21.15.50:0/3185728152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564fe8ae6cf0 0x564fe8af34b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c06bc00 tx=0x7fcd94009c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c6043f4769b2787 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:23.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.153+0000 7fcd86ffd700 1 -- 172.21.15.50:0/3185728152 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd940125f0 con 0x564fe8ae6cf0 2024-06-06T03:34:23.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.153+0000 7fcd86ffd700 1 -- 172.21.15.50:0/3185728152 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcd9400b9f0 con 0x564fe8ae6cf0 2024-06-06T03:34:23.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.153+0000 7fcd86ffd700 1 -- 172.21.15.50:0/3185728152 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd94012e00 con 0x564fe8ae6cf0 2024-06-06T03:34:23.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.154+0000 7f8a8500f640 1 --2- 172.21.15.50:0/617521375 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8a6c0a2d10 0x7f8a6c0a51d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x55d90c414450 tx=0x7f8a78004af0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:23.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.155+0000 7f8a89780740 1 -- 172.21.15.50:0/1974359509 wait complete. 2024-06-06T03:34:23.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.155+0000 7f8a89780740 1 -- start start 2024-06-06T03:34:23.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.155+0000 7f8a89780740 1 Processor -- start 2024-06-06T03:34:23.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.154+0000 7fcdadd29b80 1 -- 172.21.15.50:0/3185728152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564fe8ae6cf0 msgr2=0x564fe8af34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:23.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.154+0000 7fcdadd29b80 1 --2- 172.21.15.50:0/3185728152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564fe8ae6cf0 0x564fe8af34b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c06bc00 tx=0x7fcd94009c50 comp rx=0 tx=0).stop 2024-06-06T03:34:23.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.154+0000 7fcdadd29b80 1 -- 172.21.15.50:0/3185728152 shutdown_connections 2024-06-06T03:34:23.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.154+0000 7fcdadd29b80 1 --2- 172.21.15.50:0/3185728152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564fe8ae6cf0 0x564fe8af34b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.154+0000 7fcdadd29b80 1 --2- 172.21.15.50:0/3185728152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fe8add7a0 0x564fe8add260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.154+0000 7fcdadd29b80 1 --2- 172.21.15.50:0/3185728152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fe8ae2f60 0x564fe8ae4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.154+0000 7fcdadd29b80 1 -- 172.21.15.50:0/3185728152 >> 172.21.15.50:0/3185728152 conn(0x564fe8a0a080 msgr2=0x564fe8adffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:23.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.154+0000 7fcdadd29b80 1 -- 172.21.15.50:0/3185728152 shutdown_connections 2024-06-06T03:34:23.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.158+0000 7fcdadd29b80 1 -- 172.21.15.50:0/3185728152 wait complete. 2024-06-06T03:34:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.160+0000 7f8a89780740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d90c413200 0x55d90c41d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.160+0000 7f8a89780740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90c413bf0 0x55d90c41d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.160+0000 7f8a89780740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d90c418d60 0x55d90c424980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.160+0000 7f8a89780740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d90c41bd50 con 0x55d90c413200 2024-06-06T03:34:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.160+0000 7f8a89780740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d90c2ffae0 con 0x55d90c418d60 2024-06-06T03:34:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.160+0000 7f8a89780740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d90c41bed0 con 0x55d90c413bf0 2024-06-06T03:34:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.160+0000 7f8a89780740 10 client.0 _ll_register_callbacks cb 0x55d90c3389b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:34:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.160+0000 7f8a7ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90c413bf0 0x55d90c41d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.160+0000 7f8a7ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90c413bf0 0x55d90c41d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:51610/0 (socket says 172.21.15.50:51610) 2024-06-06T03:34:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.160+0000 7f8a7ffff640 1 -- 172.21.15.50:0/892412524 learned_addr learned my addr 172.21.15.50:0/892412524 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.160+0000 7f8a7ffff640 1 -- 172.21.15.50:0/892412524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d90c418d60 msgr2=0x55d90c424980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:34:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.160+0000 7f8a7ffff640 1 --2- 172.21.15.50:0/892412524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d90c418d60 0x55d90c424980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.160+0000 7f8a7ffff640 1 -- 172.21.15.50:0/892412524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d90c413200 msgr2=0x55d90c41d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.160+0000 7f8a8480e640 1 --2- 172.21.15.50:0/892412524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d90c413200 0x55d90c41d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:23.163 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.163+0000 7f8a7ffff640 1 --2- 172.21.15.50:0/892412524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d90c413200 0x55d90c41d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.163 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.163+0000 7f8a7ffff640 1 -- 172.21.15.50:0/892412524 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d90c08a210 con 0x55d90c413bf0 2024-06-06T03:34:23.163 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.163+0000 7f8a8480e640 1 --2- 172.21.15.50:0/892412524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d90c413200 0x55d90c41d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:34:23.163 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.163+0000 7f8a7ffff640 1 --2- 172.21.15.50:0/892412524 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90c413bf0 0x55d90c41d940 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8a70005fa0 tx=0x7f8a70009de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=527c3a8d69e0b09c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:23.163 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.163+0000 7f8a5ffff640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:34:23.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.159+0000 7fcdadd29b80 1 -- start start 2024-06-06T03:34:23.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.159+0000 7fcdadd29b80 1 Processor -- start 2024-06-06T03:34:23.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.160+0000 7fcdadd29b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564fe8add7a0 0x564fe8afec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.160+0000 7fcdadd29b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fe8ae2f60 0x564fe8aff1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.160+0000 7fcdadd29b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fe8ae6cf0 0x564fe8aff6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.160+0000 7fcdadd29b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8000d110 con 0x564fe8ae2f60 2024-06-06T03:34:23.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.160+0000 7fcdadd29b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8000e580 con 0x564fe8add7a0 2024-06-06T03:34:23.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.160+0000 7fcdadd29b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8000d7e0 con 0x564fe8ae6cf0 2024-06-06T03:34:23.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.161+0000 7fcdadd29b80 10 client.0 _ll_register_callbacks cb 0x564fe89c45b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:34:23.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.161+0000 7fcda1242700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564fe8add7a0 0x564fe8afec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:23.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.161+0000 7fcda1242700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564fe8add7a0 0x564fe8afec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:57660/0 (socket says 172.21.15.50:57660) 2024-06-06T03:34:23.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.161+0000 7fcda1242700 1 -- 172.21.15.50:0/3067703009 learned_addr learned my addr 172.21.15.50:0/3067703009 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:23.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.162+0000 7fcda1242700 1 -- 172.21.15.50:0/3067703009 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fe8ae6cf0 msgr2=0x564fe8aff6f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:34:23.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.162+0000 7fcda1242700 1 --2- 172.21.15.50:0/3067703009 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fe8ae6cf0 0x564fe8aff6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.162+0000 7fcda1242700 1 -- 172.21.15.50:0/3067703009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fe8ae2f60 msgr2=0x564fe8aff1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:23.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.162+0000 7fcda1242700 1 --2- 172.21.15.50:0/3067703009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fe8ae2f60 0x564fe8aff1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.162+0000 7fcda1242700 1 -- 172.21.15.50:0/3067703009 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fe8aede50 con 0x564fe8add7a0 2024-06-06T03:34:23.166 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.164+0000 7f8a5ffff640 1 -- 172.21.15.50:0/892412524 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a70020040 con 0x55d90c413bf0 2024-06-06T03:34:23.166 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.164+0000 7f8a5ffff640 1 -- 172.21.15.50:0/892412524 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f8a700b6510 con 0x55d90c413bf0 2024-06-06T03:34:23.166 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.166+0000 7f8a89780740 1 -- 172.21.15.50:0/892412524 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a680054b0 con 0x55d90c413bf0 2024-06-06T03:34:23.166 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.166+0000 7f8a5ffff640 1 -- 172.21.15.50:0/892412524 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8a700a6290 con 0x55d90c413bf0 2024-06-06T03:34:23.166 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.166+0000 7f8a89780740 10 client.26152 fetch_fsmap learned FSMap version 33 2024-06-06T03:34:23.166 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.166+0000 7f8a89780740 1 -- 172.21.15.50:0/892412524 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55d90c156620 con 0x55d90c413bf0 2024-06-06T03:34:23.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.166+0000 7f8a5ffff640 1 -- 172.21.15.50:0/892412524 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8a680054b0 con 0x55d90c413bf0 2024-06-06T03:34:23.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.166+0000 7f8a5ffff640 1 -- 172.21.15.50:0/892412524 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f8a700a5e70 con 0x55d90c413bf0 2024-06-06T03:34:23.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.167+0000 7f8a89780740 10 client.26152 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:34:23.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.167+0000 7f8a89780740 10 client.26152 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:34:23.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.167+0000 7f8a89780740 20 client.26152 populate_metadata read hostname 'smithi050' 2024-06-06T03:34:23.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.167+0000 7f8a89780740 1 --2- 172.21.15.50:0/892412524 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d90c429750 0x55d90c42bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.167+0000 7f8a89780740 4 client.26152 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:34:23.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.167+0000 7f8a89780740 1 -- 172.21.15.50:0/892412524 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d90c389f10 con 0x55d90c429750 2024-06-06T03:34:23.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.167+0000 7f8a8480e640 1 --2- 172.21.15.50:0/892412524 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d90c429750 0x55d90c42bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:23.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.166+0000 7fcda1242700 1 --2- 172.21.15.50:0/3067703009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564fe8add7a0 0x564fe8afec70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcd980a9330 tx=0x7fcd980ddad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf694442d25f699c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:23.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.166+0000 7fcd84ff9700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:34:23.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.166+0000 7fcd84ff9700 1 -- 172.21.15.50:0/3067703009 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd980c4040 con 0x564fe8add7a0 2024-06-06T03:34:23.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.166+0000 7fcdadd29b80 1 -- 172.21.15.50:0/3067703009 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd9400b9f0 con 0x564fe8add7a0 2024-06-06T03:34:23.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.166+0000 7fcd84ff9700 1 -- 172.21.15.50:0/3067703009 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fcd980b5140 con 0x564fe8add7a0 2024-06-06T03:34:23.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.172+0000 7fcd84ff9700 1 -- 172.21.15.50:0/3067703009 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fcd980056f0 con 0x564fe8add7a0 2024-06-06T03:34:23.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.174+0000 7fcdadd29b80 10 client.26141 fetch_fsmap learned FSMap version 33 2024-06-06T03:34:23.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.174+0000 7fcdadd29b80 1 -- 172.21.15.50:0/3067703009 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564fe8b62310 con 0x564fe8add7a0 2024-06-06T03:34:23.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.177+0000 7fcd84ff9700 1 -- 172.21.15.50:0/3067703009 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcd9400b9f0 con 0x564fe8add7a0 2024-06-06T03:34:23.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.177+0000 7fcd84ff9700 1 -- 172.21.15.50:0/3067703009 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fcd980c5b60 con 0x564fe8add7a0 2024-06-06T03:34:23.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.177+0000 7fcdadd29b80 10 client.26141 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:34:23.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.177+0000 7fcdadd29b80 10 client.26141 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:34:23.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.177+0000 7fcdadd29b80 20 client.26141 populate_metadata read hostname 'smithi050' 2024-06-06T03:34:23.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.177+0000 7fcdadd29b80 1 --2- 172.21.15.50:0/3067703009 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564fe8b629f0 0x564fe8b64e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.177+0000 7fcdadd29b80 4 client.26141 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-06T03:34:23.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.177+0000 7fcdadd29b80 1 -- 172.21.15.50:0/3067703009 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564fe8a362d0 con 0x564fe8b629f0 2024-06-06T03:34:23.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.177+0000 7fcda0a41700 1 --2- 172.21.15.50:0/3067703009 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564fe8b629f0 0x564fe8b64e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:23.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.178+0000 7fcd84ff9700 10 client.26141 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:23.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.178+0000 7fcda0a41700 1 --2- 172.21.15.50:0/3067703009 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564fe8b629f0 0x564fe8b64e70 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b1717f705f2ac9d server_cookie=2512ce5dd70a28da in_seq=0 out_seq=0 2024-06-06T03:34:23.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.178+0000 7fcd84ff9700 1 -- 172.21.15.50:0/3067703009 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x564fe8a362d0 con 0x564fe8b629f0 2024-06-06T03:34:23.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.178+0000 7fcd84ff9700 10 client.26141 handle_command_reply: tid=0 2024-06-06T03:34:23.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.178+0000 7fcdadd29b80 1 client.26141 shutdown 2024-06-06T03:34:23.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.178+0000 7fcdadd29b80 1 -- 172.21.15.50:0/3067703009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564fe8add7a0 msgr2=0x564fe8afec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:23.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.178+0000 7fcdadd29b80 1 --2- 172.21.15.50:0/3067703009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564fe8add7a0 0x564fe8afec70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcd980a9330 tx=0x7fcd980ddad0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.178+0000 7fcdadd29b80 1 -- 172.21.15.50:0/3067703009 shutdown_connections 2024-06-06T03:34:23.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.178+0000 7fcdadd29b80 1 --2- 172.21.15.50:0/3067703009 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564fe8b629f0 0x564fe8b64e70 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.179+0000 7fcdadd29b80 1 --2- 172.21.15.50:0/3067703009 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fe8ae6cf0 0x564fe8aff6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.179+0000 7fcdadd29b80 1 --2- 172.21.15.50:0/3067703009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564fe8add7a0 0x564fe8afec70 secure :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcd980a9330 tx=0x7fcd980ddad0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.179+0000 7fcdadd29b80 1 --2- 172.21.15.50:0/3067703009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fe8ae2f60 0x564fe8aff1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.179+0000 7fcdadd29b80 1 -- 172.21.15.50:0/3067703009 >> 172.21.15.50:0/3067703009 conn(0x564fe8a0a080 msgr2=0x564fe8ae09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:23.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.179+0000 7fcd84ff9700 0 client.26141 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:23.180 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.179+0000 7f8a8480e640 1 --2- 172.21.15.50:0/892412524 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d90c429750 0x55d90c42bc10 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85cbd688fbb67363 server_cookie=f98b8371869ae56a in_seq=0 out_seq=0 2024-06-06T03:34:23.180 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.179+0000 7f8a5ffff640 10 client.26152 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:23.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.180+0000 7fcdadd29b80 1 -- 172.21.15.50:0/3067703009 shutdown_connections 2024-06-06T03:34:23.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.180+0000 7fcdadd29b80 1 -- 172.21.15.50:0/3067703009 wait complete. 2024-06-06T03:34:23.181 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.181+0000 7f8a5ffff640 1 -- 172.21.15.50:0/892412524 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d90c389f10 con 0x55d90c429750 2024-06-06T03:34:23.181 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.181+0000 7f8a5ffff640 10 client.26152 handle_command_reply: tid=0 2024-06-06T03:34:23.181 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.181+0000 7f8a89780740 1 client.26152 shutdown 2024-06-06T03:34:23.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.183+0000 7fcdadd29b80 20 client.26141 trim_cache size 0 max 16384 2024-06-06T03:34:23.182 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:34:23.182 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-06T03:34:23.182 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2024-06-06T03:34:23.182 INFO:teuthology.orchestra.run.smithi050.stdout: "b56fb2ce-9e4e-4f5d-9884-e8b342fd2682": { 2024-06-06T03:34:23.183 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2024-06-06T03:34:23.183 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "b56fb2ce-9e4e-4f5d-9884-e8b342fd2682", 2024-06-06T03:34:23.183 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "recursive,force" 2024-06-06T03:34:23.183 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:34:23.183 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:34:23.183 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:34:23.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.183+0000 7fcda34a6700 1 -- 172.21.15.50:0/39917179 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcd880a2db0 msgr2=0x7fcd880a5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:23.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.183+0000 7fcda34a6700 1 --2- 172.21.15.50:0/39917179 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcd880a2db0 0x7fcd880a5270 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c011000 tx=0x7fcd8c01b000 comp rx=0 tx=0).stop 2024-06-06T03:34:23.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.184+0000 7fcda34a6700 1 -- 172.21.15.50:0/39917179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd9c1099d0 msgr2=0x7fcd9c117480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:23.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.184+0000 7fcda34a6700 1 --2- 172.21.15.50:0/39917179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd9c1099d0 0x7fcd9c117480 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcd9801faf0 tx=0x7fcd9801feb0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.184+0000 7fcda34a6700 1 -- 172.21.15.50:0/39917179 shutdown_connections 2024-06-06T03:34:23.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.184+0000 7fcda34a6700 1 --2- 172.21.15.50:0/39917179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd9c11bc70 0x7fcd9c1a3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.184+0000 7fcda34a6700 1 --2- 172.21.15.50:0/39917179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd9c1099d0 0x7fcd9c117480 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.184+0000 7fcda34a6700 1 --2- 172.21.15.50:0/39917179 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcd880a2db0 0x7fcd880a5270 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.184+0000 7fcda34a6700 1 --2- 172.21.15.50:0/39917179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd9c110c70 0x7fcd9c1179c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.184+0000 7fcda34a6700 1 -- 172.21.15.50:0/39917179 >> 172.21.15.50:0/39917179 conn(0x7fcd9c06d600 msgr2=0x7fcd9c11d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:23.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.184+0000 7fcda34a6700 1 -- 172.21.15.50:0/39917179 shutdown_connections 2024-06-06T03:34:23.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:23.184+0000 7fcda34a6700 1 -- 172.21.15.50:0/39917179 wait complete. 2024-06-06T03:34:23.190 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.190+0000 7f8a89780740 1 -- 172.21.15.50:0/892412524 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90c413bf0 msgr2=0x55d90c41d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:23.190 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.190+0000 7f8a89780740 1 --2- 172.21.15.50:0/892412524 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90c413bf0 0x55d90c41d940 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8a70005fa0 tx=0x7f8a70009de0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.193+0000 7f8a89780740 1 -- 172.21.15.50:0/892412524 shutdown_connections 2024-06-06T03:34:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.193+0000 7f8a89780740 1 --2- 172.21.15.50:0/892412524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d90c418d60 0x55d90c424980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.193+0000 7f8a89780740 1 --2- 172.21.15.50:0/892412524 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90c413bf0 0x55d90c41d940 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.193+0000 7f8a89780740 1 --2- 172.21.15.50:0/892412524 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d90c429750 0x55d90c42bc10 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.193+0000 7f8a89780740 1 --2- 172.21.15.50:0/892412524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d90c413200 0x55d90c41d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.193+0000 7f8a89780740 1 -- 172.21.15.50:0/892412524 >> 172.21.15.50:0/892412524 conn(0x55d90c40e870 msgr2=0x55d90c40d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.193+0000 7f8a5ffff640 0 client.26152 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.205+0000 7f8a89780740 1 -- 172.21.15.50:0/892412524 shutdown_connections 2024-06-06T03:34:23.206 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.207+0000 7f8a89780740 1 -- 172.21.15.50:0/892412524 wait complete. 2024-06-06T03:34:23.206 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.207+0000 7f8a89780740 20 client.26152 trim_cache size 0 max 16384 2024-06-06T03:34:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.246+0000 7f8a89780740 1 Processor -- start 2024-06-06T03:34:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.246+0000 7f8a89780740 1 -- start start 2024-06-06T03:34:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.247+0000 7f8a89780740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d90c413200 0x55d90c41d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.247+0000 7f8a89780740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d90c413bf0 0x55d90c424940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.247+0000 7f8a89780740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90c418d60 0x55d90c41d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.247+0000 7f8a89780740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8a60012430 con 0x55d90c413bf0 2024-06-06T03:34:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.247+0000 7f8a89780740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6000fd00 con 0x55d90c413200 2024-06-06T03:34:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.247+0000 7f8a89780740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6000db50 con 0x55d90c418d60 2024-06-06T03:34:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.249+0000 7f8a8500f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90c418d60 0x55d90c41d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.249+0000 7f8a8500f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90c418d60 0x55d90c41d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:51616/0 (socket says 172.21.15.50:51616) 2024-06-06T03:34:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.249+0000 7f8a8500f640 1 -- 172.21.15.50:0/3684714270 learned_addr learned my addr 172.21.15.50:0/3684714270 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:23.249 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.250+0000 7f8a8500f640 1 -- 172.21.15.50:0/3684714270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d90c413200 msgr2=0x55d90c41d400 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:34:23.249 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.250+0000 7f8a8500f640 1 --2- 172.21.15.50:0/3684714270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d90c413200 0x55d90c41d400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.249 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.250+0000 7f8a8500f640 1 -- 172.21.15.50:0/3684714270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d90c413bf0 msgr2=0x55d90c424940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:23.249 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.250+0000 7f8a8500f640 1 --2- 172.21.15.50:0/3684714270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d90c413bf0 0x55d90c424940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.249 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.250+0000 7f8a8500f640 1 -- 172.21.15.50:0/3684714270 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d90c414480 con 0x55d90c418d60 2024-06-06T03:34:23.249 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.250+0000 7f8a8500f640 1 --2- 172.21.15.50:0/3684714270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90c418d60 0x55d90c41d940 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8a78007090 tx=0x7f8a78009730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1293d57b052344b server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.250+0000 7f8a767fc640 1 -- 172.21.15.50:0/3684714270 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a78021070 con 0x55d90c418d60 2024-06-06T03:34:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.251+0000 7f8a767fc640 1 -- 172.21.15.50:0/3684714270 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8a7801b920 con 0x55d90c418d60 2024-06-06T03:34:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.252+0000 7f8a89780740 1 -- 172.21.15.50:0/3684714270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90c418d60 msgr2=0x55d90c41d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.252+0000 7f8a89780740 1 --2- 172.21.15.50:0/3684714270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90c418d60 0x55d90c41d940 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8a78007090 tx=0x7f8a78009730 comp rx=0 tx=0).stop 2024-06-06T03:34:23.251 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.252+0000 7f8a89780740 1 -- 172.21.15.50:0/3684714270 shutdown_connections 2024-06-06T03:34:23.251 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.252+0000 7f8a89780740 1 --2- 172.21.15.50:0/3684714270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d90c413bf0 0x55d90c424940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.251 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.252+0000 7f8a89780740 1 --2- 172.21.15.50:0/3684714270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90c418d60 0x55d90c41d940 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.251 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.252+0000 7f8a89780740 1 --2- 172.21.15.50:0/3684714270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d90c413200 0x55d90c41d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.251 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.252+0000 7f8a89780740 1 -- 172.21.15.50:0/3684714270 >> 172.21.15.50:0/3684714270 conn(0x55d90c40e870 msgr2=0x55d90c40ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:23.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.254+0000 7f8a89780740 1 -- 172.21.15.50:0/3684714270 shutdown_connections 2024-06-06T03:34:23.260 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.261+0000 7f8a89780740 1 -- 172.21.15.50:0/3684714270 wait complete. 2024-06-06T03:34:23.260 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.261+0000 7f8a89780740 1 -- start start 2024-06-06T03:34:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.262+0000 7f8a89780740 1 Processor -- start 2024-06-06T03:34:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.262+0000 7f8a89780740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90c413bf0 0x55d90c421600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.262+0000 7f8a89780740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d90c421b40 0x55d90c4904d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.262+0000 7f8a89780740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d90c421fc0 0x55d90c492a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.262+0000 7f8a89780740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6000e1c0 con 0x55d90c421fc0 2024-06-06T03:34:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.262+0000 7f8a89780740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6000f630 con 0x55d90c421b40 2024-06-06T03:34:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.262+0000 7f8a89780740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6000e890 con 0x55d90c413bf0 2024-06-06T03:34:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.262+0000 7f8a89780740 10 client.0 _ll_register_callbacks cb 0x7f8a70099200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:34:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.263+0000 7f8a8500f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d90c421fc0 0x55d90c492a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.263+0000 7f8a8500f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d90c421fc0 0x55d90c492a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50738/0 (socket says 172.21.15.50:50738) 2024-06-06T03:34:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.263+0000 7f8a8500f640 1 -- 172.21.15.50:0/1388036201 learned_addr learned my addr 172.21.15.50:0/1388036201 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.263+0000 7f8a8480e640 1 --2- 172.21.15.50:0/1388036201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90c413bf0 0x55d90c421600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.264+0000 7f8a8480e640 1 -- 172.21.15.50:0/1388036201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d90c421b40 msgr2=0x55d90c4904d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:34:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.264+0000 7f8a8480e640 1 --2- 172.21.15.50:0/1388036201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d90c421b40 0x55d90c4904d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.264+0000 7f8a8480e640 1 -- 172.21.15.50:0/1388036201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d90c421fc0 msgr2=0x55d90c492a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.264+0000 7f8a8480e640 1 --2- 172.21.15.50:0/1388036201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d90c421fc0 0x55d90c492a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.264+0000 7f8a8480e640 1 -- 172.21.15.50:0/1388036201 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d90c492f90 con 0x55d90c413bf0 2024-06-06T03:34:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.264+0000 7f8a8480e640 1 --2- 172.21.15.50:0/1388036201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90c413bf0 0x55d90c421600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55d90c40f740 tx=0x7f8a68009520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e8a03ee73e99603 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.267+0000 7f8a5ffff640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:34:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.268+0000 7f8a5ffff640 1 -- 172.21.15.50:0/1388036201 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6803f040 con 0x55d90c413bf0 2024-06-06T03:34:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.268+0000 7f8a5ffff640 1 -- 172.21.15.50:0/1388036201 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f8a68004460 con 0x55d90c413bf0 2024-06-06T03:34:23.267 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.268+0000 7f8a89780740 1 -- 172.21.15.50:0/1388036201 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d90c383c20 con 0x55d90c413bf0 2024-06-06T03:34:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.272+0000 7f8a5ffff640 1 -- 172.21.15.50:0/1388036201 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8a68035040 con 0x55d90c413bf0 2024-06-06T03:34:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.273+0000 7f8a89780740 10 client.26158 fetch_fsmap learned FSMap version 33 2024-06-06T03:34:23.272 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.273+0000 7f8a89780740 1 -- 172.21.15.50:0/1388036201 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55d90c494370 con 0x55d90c413bf0 2024-06-06T03:34:23.274 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.275+0000 7f8a5ffff640 1 -- 172.21.15.50:0/1388036201 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55d90c383c20 con 0x55d90c413bf0 2024-06-06T03:34:23.274 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.275+0000 7f8a5ffff640 1 -- 172.21.15.50:0/1388036201 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f8a6804d070 con 0x55d90c413bf0 2024-06-06T03:34:23.275 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.276+0000 7f8a89780740 10 client.26158 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:34:23.275 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.276+0000 7f8a89780740 10 client.26158 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:34:23.275 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.276+0000 7f8a89780740 20 client.26158 populate_metadata read hostname 'smithi050' 2024-06-06T03:34:23.275 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.276+0000 7f8a89780740 1 --2- 172.21.15.50:0/1388036201 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d90c494930 0x55d90c496d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:23.275 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.276+0000 7f8a89780740 4 client.26158 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:34:23.275 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.276+0000 7f8a89780740 1 -- 172.21.15.50:0/1388036201 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d90c37df70 con 0x55d90c494930 2024-06-06T03:34:23.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.284+0000 7f8a7ffff640 1 --2- 172.21.15.50:0/1388036201 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d90c494930 0x55d90c496d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.293+0000 7f8a7ffff640 1 --2- 172.21.15.50:0/1388036201 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d90c494930 0x55d90c496d20 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8e168da09d3cf5 server_cookie=7e8cde6daa8c5fda in_seq=0 out_seq=0 2024-06-06T03:34:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.293+0000 7f8a5ffff640 10 client.26158 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:23.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:34:23.359 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:34:23.359 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:34:23.359 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.356+0000 7f8a5ffff640 1 -- 172.21.15.50:0/1388036201 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55d90c37df70 con 0x55d90c494930 2024-06-06T03:34:23.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.356+0000 7f8a5ffff640 10 client.26158 handle_command_reply: tid=0 2024-06-06T03:34:23.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.356+0000 7f8a89780740 1 client.26158 shutdown 2024-06-06T03:34:23.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.356+0000 7f8a89780740 1 -- 172.21.15.50:0/1388036201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90c413bf0 msgr2=0x55d90c421600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:23.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.356+0000 7f8a89780740 1 --2- 172.21.15.50:0/1388036201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90c413bf0 0x55d90c421600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55d90c40f740 tx=0x7f8a68009520 comp rx=0 tx=0).stop 2024-06-06T03:34:23.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.356+0000 7f8a89780740 1 -- 172.21.15.50:0/1388036201 shutdown_connections 2024-06-06T03:34:23.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.356+0000 7f8a89780740 1 --2- 172.21.15.50:0/1388036201 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d90c494930 0x55d90c496d20 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.356+0000 7f8a89780740 1 --2- 172.21.15.50:0/1388036201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d90c421fc0 0x55d90c492a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.356+0000 7f8a89780740 1 --2- 172.21.15.50:0/1388036201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d90c421b40 0x55d90c4904d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.356+0000 7f8a89780740 1 --2- 172.21.15.50:0/1388036201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90c413bf0 0x55d90c421600 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.356+0000 7f8a89780740 1 -- 172.21.15.50:0/1388036201 >> 172.21.15.50:0/1388036201 conn(0x55d90c40e870 msgr2=0x55d90c41d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:23.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.356+0000 7f8a5ffff640 0 client.26158 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:23.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.356+0000 7f8a89780740 1 -- 172.21.15.50:0/1388036201 shutdown_connections 2024-06-06T03:34:23.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.356+0000 7f8a89780740 1 -- 172.21.15.50:0/1388036201 wait complete. 2024-06-06T03:34:23.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.356+0000 7f8a89780740 20 client.26158 trim_cache size 0 max 16384 2024-06-06T03:34:23.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.360+0000 7f8a85810640 1 -- 172.21.15.50:0/617521375 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8a6c0a2d10 msgr2=0x7f8a6c0a51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:23.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.360+0000 7f8a85810640 1 --2- 172.21.15.50:0/617521375 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8a6c0a2d10 0x7f8a6c0a51d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x55d90c414450 tx=0x7f8a78004af0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.360+0000 7f8a85810640 1 -- 172.21.15.50:0/617521375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a80108fb0 msgr2=0x7f8a8011a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:23.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.360+0000 7f8a85810640 1 --2- 172.21.15.50:0/617521375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a80108fb0 0x7f8a8011a0b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000d770 tx=0x7f8a7000dc30 comp rx=0 tx=0).stop 2024-06-06T03:34:23.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.364+0000 7f8a85810640 1 -- 172.21.15.50:0/617521375 shutdown_connections 2024-06-06T03:34:23.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.364+0000 7f8a85810640 1 --2- 172.21.15.50:0/617521375 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8a6c0a2d10 0x7f8a6c0a51d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.364+0000 7f8a85810640 1 --2- 172.21.15.50:0/617521375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a80109970 0x7f8a80118200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.365+0000 7f8a85810640 1 --2- 172.21.15.50:0/617521375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a80108fb0 0x7f8a8011a0b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.365+0000 7f8a85810640 1 --2- 172.21.15.50:0/617521375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a80072cd0 0x7f8a80119b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:23.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.365+0000 7f8a85810640 1 -- 172.21.15.50:0/617521375 >> 172.21.15.50:0/617521375 conn(0x7f8a8006e840 msgr2=0x7f8a8010c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:23.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.365+0000 7f8a85810640 1 -- 172.21.15.50:0/617521375 shutdown_connections 2024-06-06T03:34:23.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:23.365+0000 7f8a85810640 1 -- 172.21.15.50:0/617521375 wait complete. 2024-06-06T03:34:23.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:23 smithi050 ceph-mon[32421]: pgmap v663: 129 pgs: 129 active+clean; 10 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 30 MiB/s wr, 589 op/s 2024-06-06T03:34:23.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:23 smithi079 ceph-mon[35478]: pgmap v663: 129 pgs: 129 active+clean; 10 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 30 MiB/s wr, 589 op/s 2024-06-06T03:34:23.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:23 smithi122 ceph-mon[35759]: pgmap v663: 129 pgs: 129 active+clean; 10 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 30 MiB/s wr, 589 op/s 2024-06-06T03:34:24.088 INFO:tasks.cephfs.filesystem:scrub status for tag:b56fb2ce-9e4e-4f5d-9884-e8b342fd2682 - {'path': '/', 'tag': 'b56fb2ce-9e4e-4f5d-9884-e8b342fd2682', 'options': 'recursive,force'} 2024-06-06T03:34:25.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:25 smithi050 ceph-mon[32421]: pgmap v664: 129 pgs: 129 active+clean; 10 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 33 MiB/s wr, 642 op/s 2024-06-06T03:34:25.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:25 smithi079 ceph-mon[35478]: pgmap v664: 129 pgs: 129 active+clean; 10 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 33 MiB/s wr, 642 op/s 2024-06-06T03:34:25.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:25 smithi122 ceph-mon[35759]: pgmap v664: 129 pgs: 129 active+clean; 10 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 33 MiB/s wr, 642 op/s 2024-06-06T03:34:27.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:27 smithi050 ceph-mon[32421]: pgmap v665: 129 pgs: 129 active+clean; 10 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 37 MiB/s wr, 731 op/s 2024-06-06T03:34:27.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:27 smithi050 ceph-mon[32421]: scrub summary: idle 2024-06-06T03:34:27.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:27 smithi079 ceph-mon[35478]: pgmap v665: 129 pgs: 129 active+clean; 10 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 37 MiB/s wr, 731 op/s 2024-06-06T03:34:27.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:27 smithi079 ceph-mon[35478]: scrub summary: idle 2024-06-06T03:34:27.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:27 smithi122 ceph-mon[35759]: pgmap v665: 129 pgs: 129 active+clean; 10 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 37 MiB/s wr, 731 op/s 2024-06-06T03:34:27.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:27 smithi122 ceph-mon[35759]: scrub summary: idle 2024-06-06T03:34:28.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:28 smithi079 ceph-mon[35478]: scrub summary: idle 2024-06-06T03:34:28.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:28 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:34:28.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:28 smithi122 ceph-mon[35759]: scrub summary: idle 2024-06-06T03:34:28.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:28 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:34:28.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:28 smithi050 ceph-mon[32421]: scrub summary: idle 2024-06-06T03:34:28.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:28 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:34:29.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:29 smithi079 ceph-mon[35478]: pgmap v666: 129 pgs: 129 active+clean; 10 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 30 MiB/s wr, 578 op/s 2024-06-06T03:34:29.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:29 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:34:29.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:29 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:34:29.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:29 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:34:29.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:29 smithi122 ceph-mon[35759]: pgmap v666: 129 pgs: 129 active+clean; 10 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 30 MiB/s wr, 578 op/s 2024-06-06T03:34:29.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:29 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:34:29.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:29 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:34:29.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:29 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:34:29.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:29 smithi050 ceph-mon[32421]: pgmap v666: 129 pgs: 129 active+clean; 10 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 30 MiB/s wr, 578 op/s 2024-06-06T03:34:29.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:29 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:34:29.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:29 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:34:29.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:29 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:34:31.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:31 smithi079 ceph-mon[35478]: pgmap v667: 129 pgs: 129 active+clean; 10 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 40 MiB/s wr, 789 op/s 2024-06-06T03:34:31.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:31 smithi122 ceph-mon[35759]: pgmap v667: 129 pgs: 129 active+clean; 10 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 40 MiB/s wr, 789 op/s 2024-06-06T03:34:31.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:31 smithi050 ceph-mon[32421]: pgmap v667: 129 pgs: 129 active+clean; 10 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 40 MiB/s wr, 789 op/s 2024-06-06T03:34:33.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:33 smithi079 ceph-mon[35478]: pgmap v668: 129 pgs: 129 active+clean; 10 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 31 MiB/s wr, 612 op/s 2024-06-06T03:34:33.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:33 smithi122 ceph-mon[35759]: pgmap v668: 129 pgs: 129 active+clean; 10 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 31 MiB/s wr, 612 op/s 2024-06-06T03:34:33.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:33 smithi050 ceph-mon[32421]: pgmap v668: 129 pgs: 129 active+clean; 10 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 31 MiB/s wr, 612 op/s 2024-06-06T03:34:35.590 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:35 smithi050 ceph-mon[32421]: pgmap v669: 129 pgs: 129 active+clean; 10 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 33 MiB/s wr, 660 op/s 2024-06-06T03:34:35.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:35 smithi079 ceph-mon[35478]: pgmap v669: 129 pgs: 129 active+clean; 10 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 33 MiB/s wr, 660 op/s 2024-06-06T03:34:35.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:35 smithi122 ceph-mon[35759]: pgmap v669: 129 pgs: 129 active+clean; 10 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 33 MiB/s wr, 660 op/s 2024-06-06T03:34:36.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.604+0000 7f4e6359e640 1 -- 172.21.15.50:0/351808271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e64109970 msgr2=0x7f4e6410e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:36.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.604+0000 7f4e6359e640 1 --2- 172.21.15.50:0/351808271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e64109970 0x7f4e6410e2e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009900 tx=0x7f4e5802a400 comp rx=0 tx=0).stop 2024-06-06T03:34:36.614 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.612+0000 7f4e6359e640 1 -- 172.21.15.50:0/351808271 shutdown_connections 2024-06-06T03:34:36.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.612+0000 7f4e6359e640 1 --2- 172.21.15.50:0/351808271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e64108fb0 0x7f4e64109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.612+0000 7f4e6359e640 1 --2- 172.21.15.50:0/351808271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e64109970 0x7f4e6410e2e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.612+0000 7f4e6359e640 1 --2- 172.21.15.50:0/351808271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e64072cd0 0x7f4e640730f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.612+0000 7f4e6359e640 1 -- 172.21.15.50:0/351808271 >> 172.21.15.50:0/351808271 conn(0x7f4e6406e840 msgr2=0x7f4e64070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:36.618 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.618+0000 7f4e6359e640 1 -- 172.21.15.50:0/351808271 shutdown_connections 2024-06-06T03:34:36.618 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.619+0000 7f4e6359e640 1 -- 172.21.15.50:0/351808271 wait complete. 2024-06-06T03:34:36.620 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.620+0000 7f4e6359e640 1 Processor -- start 2024-06-06T03:34:36.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.622+0000 7f4e6359e640 1 -- start start 2024-06-06T03:34:36.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.622+0000 7f4e6359e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e64072cd0 0x7f4e641a67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:36.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.622+0000 7f4e6359e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e64108fb0 0x7f4e641a6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:36.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.622+0000 7f4e6359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e64109970 0x7f4e641add70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:36.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.622+0000 7f4e6359e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6411c140 con 0x7f4e64109970 2024-06-06T03:34:36.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.623+0000 7f4e6359e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6411bfc0 con 0x7f4e64108fb0 2024-06-06T03:34:36.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.623+0000 7f4e6359e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6411c2c0 con 0x7f4e64072cd0 2024-06-06T03:34:36.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.624+0000 7f4e62d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e64109970 0x7f4e641add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:36.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.624+0000 7f4e62d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e64109970 0x7f4e641add70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36548/0 (socket says 172.21.15.50:36548) 2024-06-06T03:34:36.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.624+0000 7f4e62d9d640 1 -- 172.21.15.50:0/294126619 learned_addr learned my addr 172.21.15.50:0/294126619 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:36.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.625+0000 7f4e61d9b640 1 --2- 172.21.15.50:0/294126619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e64108fb0 0x7f4e641a6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:36.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.625+0000 7f4e6259c640 1 --2- 172.21.15.50:0/294126619 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e64072cd0 0x7f4e641a67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:36.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.628+0000 7f4e62d9d640 1 -- 172.21.15.50:0/294126619 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e64072cd0 msgr2=0x7f4e641a67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:36.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.628+0000 7f4e62d9d640 1 --2- 172.21.15.50:0/294126619 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e64072cd0 0x7f4e641a67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.628+0000 7f4e62d9d640 1 -- 172.21.15.50:0/294126619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e64108fb0 msgr2=0x7f4e641a6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:36.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.628+0000 7f4e62d9d640 1 --2- 172.21.15.50:0/294126619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e64108fb0 0x7f4e641a6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.629+0000 7f4e62d9d640 1 -- 172.21.15.50:0/294126619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e641ae3e0 con 0x7f4e64109970 2024-06-06T03:34:36.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.629+0000 7f4e62d9d640 1 --2- 172.21.15.50:0/294126619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e64109970 0x7f4e641add70 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009850 tx=0x7f4e58003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:36.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.632+0000 7f4e537fe640 1 -- 172.21.15.50:0/294126619 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5803f070 con 0x7f4e64109970 2024-06-06T03:34:36.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.632+0000 7f4e537fe640 1 -- 172.21.15.50:0/294126619 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4e58031c30 con 0x7f4e64109970 2024-06-06T03:34:36.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.632+0000 7f4e537fe640 1 -- 172.21.15.50:0/294126619 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e58035030 con 0x7f4e64109970 2024-06-06T03:34:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.635+0000 7f4e6359e640 1 -- 172.21.15.50:0/294126619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e641ae670 con 0x7f4e64109970 2024-06-06T03:34:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.635+0000 7f4e6359e640 1 -- 172.21.15.50:0/294126619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e641aea20 con 0x7f4e64109970 2024-06-06T03:34:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.639+0000 7f4e6b97a740 1 Processor -- start 2024-06-06T03:34:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.641+0000 7f4e537fe640 1 -- 172.21.15.50:0/294126619 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4e58042070 con 0x7f4e64109970 2024-06-06T03:34:36.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.644+0000 7f4e6b97a740 1 -- start start 2024-06-06T03:34:36.651 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.644+0000 7f4e6b97a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9bfd6a200 0x55d9bfd6a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:36.651 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.644+0000 7f4e6b97a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9bfd6abf0 0x55d9bfd6f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:36.651 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.644+0000 7f4e6b97a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9bfd6fd60 0x55d9bfd721f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:36.651 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.644+0000 7f4e6b97a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d9bfccd4f0 con 0x55d9bfd6a200 2024-06-06T03:34:36.651 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.644+0000 7f4e6b97a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d9bfc6b870 con 0x55d9bfd6fd60 2024-06-06T03:34:36.651 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.645+0000 7f4e6b97a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d9bfcc94b0 con 0x55d9bfd6abf0 2024-06-06T03:34:36.651 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.647+0000 7f4e61d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9bfd6fd60 0x55d9bfd721f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:36.652 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.647+0000 7f4e61d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9bfd6a200 0x55d9bfd6a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:36.652 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.647+0000 7f4e61d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9bfd6a200 0x55d9bfd6a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36564/0 (socket says 172.21.15.50:36564) 2024-06-06T03:34:36.652 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.647+0000 7f4e61d9b640 1 -- 172.21.15.50:0/1688221619 learned_addr learned my addr 172.21.15.50:0/1688221619 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:36.652 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.647+0000 7f4e6259c640 1 --2- 172.21.15.50:0/1688221619 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9bfd6abf0 0x55d9bfd6f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.654+0000 7f4e537fe640 1 --2- 172.21.15.50:0/294126619 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4e4c0a2d90 0x7f4e4c0a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.654+0000 7f4e61d9b640 1 -- 172.21.15.50:0/1688221619 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9bfd6abf0 msgr2=0x55d9bfd6f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.654+0000 7f4e61d9b640 1 --2- 172.21.15.50:0/1688221619 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9bfd6abf0 0x55d9bfd6f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.654+0000 7f4e61d9b640 1 -- 172.21.15.50:0/1688221619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9bfd6a200 msgr2=0x55d9bfd6a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.654+0000 7f4e61d9b640 1 --2- 172.21.15.50:0/1688221619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9bfd6a200 0x55d9bfd6a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.654+0000 7f4e61d9b640 1 -- 172.21.15.50:0/1688221619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9bfc879b0 con 0x55d9bfd6fd60 2024-06-06T03:34:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.655+0000 7f4e537fe640 1 -- 172.21.15.50:0/294126619 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f4e580eff60 con 0x7f4e64109970 2024-06-06T03:34:36.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.659+0000 7f4e62d9d640 1 --2- 172.21.15.50:0/294126619 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4e4c0a2d90 0x7f4e4c0a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:36.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.659+0000 7f4e61d9b640 1 --2- 172.21.15.50:0/1688221619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9bfd6fd60 0x55d9bfd721f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c012a00 tx=0x7f4e5c0094a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd807b22c629f4d0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:36.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.661+0000 7f4e62d9d640 1 --2- 172.21.15.50:0/294126619 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4e4c0a2d90 0x7f4e4c0a5250 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4e58004650 tx=0x7f4e580b8040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:36.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.662+0000 7f4e50ff9640 1 -- 172.21.15.50:0/1688221619 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c003970 con 0x55d9bfd6fd60 2024-06-06T03:34:36.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.662+0000 7f4e50ff9640 1 -- 172.21.15.50:0/1688221619 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4e5c016070 con 0x55d9bfd6fd60 2024-06-06T03:34:36.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.663+0000 7f4e6b97a740 1 -- 172.21.15.50:0/1688221619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9bfd6fd60 msgr2=0x55d9bfd721f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:36.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.663+0000 7f4e6b97a740 1 --2- 172.21.15.50:0/1688221619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9bfd6fd60 0x55d9bfd721f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c012a00 tx=0x7f4e5c0094a0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.664+0000 7f4e6b97a740 1 -- 172.21.15.50:0/1688221619 shutdown_connections 2024-06-06T03:34:36.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.664+0000 7f4e6b97a740 1 --2- 172.21.15.50:0/1688221619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9bfd6fd60 0x55d9bfd721f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.664+0000 7f4e6b97a740 1 --2- 172.21.15.50:0/1688221619 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9bfd6abf0 0x55d9bfd6f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.664+0000 7f4e6b97a740 1 --2- 172.21.15.50:0/1688221619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9bfd6a200 0x55d9bfd6a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.664+0000 7f4e6b97a740 1 -- 172.21.15.50:0/1688221619 >> 172.21.15.50:0/1688221619 conn(0x55d9bfd65870 msgr2=0x55d9bfd65c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:36.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.668+0000 7f4e6b97a740 1 -- 172.21.15.50:0/1688221619 shutdown_connections 2024-06-06T03:34:36.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.668+0000 7f4e6b97a740 1 -- 172.21.15.50:0/1688221619 wait complete. 2024-06-06T03:34:36.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.668+0000 7f4e6b97a740 1 -- start start 2024-06-06T03:34:36.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.669+0000 7f4e6b97a740 1 Processor -- start 2024-06-06T03:34:36.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.669+0000 7f4e6b97a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9bfd6a200 0x55d9bfd85460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:36.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.669+0000 7f4e6b97a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9bfd6abf0 0x55d9bfd859a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:36.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.669+0000 7f4e6b97a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9bfd6fd60 0x55d9bfd8c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:36.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.669+0000 7f4e6b97a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d9bfd83d70 con 0x55d9bfd6a200 2024-06-06T03:34:36.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.669+0000 7f4e6b97a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d9bfc56ae0 con 0x55d9bfd6fd60 2024-06-06T03:34:36.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.669+0000 7f4e6b97a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d9bfd83ef0 con 0x55d9bfd6abf0 2024-06-06T03:34:36.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.669+0000 7f4e6b97a740 10 client.0 _ll_register_callbacks cb 0x55d9bfc8f9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:34:36.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.669+0000 7f4e6259c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9bfd6abf0 0x55d9bfd859a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:36.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.669+0000 7f4e6259c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9bfd6abf0 0x55d9bfd859a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:50806/0 (socket says 172.21.15.50:50806) 2024-06-06T03:34:36.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.670+0000 7f4e6259c640 1 -- 172.21.15.50:0/58058943 learned_addr learned my addr 172.21.15.50:0/58058943 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:36.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.671+0000 7f4e6259c640 1 -- 172.21.15.50:0/58058943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9bfd6fd60 msgr2=0x55d9bfd8c9e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:34:36.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.671+0000 7f4e6259c640 1 --2- 172.21.15.50:0/58058943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9bfd6fd60 0x55d9bfd8c9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.671+0000 7f4e6259c640 1 -- 172.21.15.50:0/58058943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9bfd6a200 msgr2=0x55d9bfd85460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:36.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.671+0000 7f4e6259c640 1 --2- 172.21.15.50:0/58058943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9bfd6a200 0x55d9bfd85460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.671+0000 7f4e6259c640 1 -- 172.21.15.50:0/58058943 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9bf9e1210 con 0x55d9bfd6abf0 2024-06-06T03:34:36.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.671+0000 7f4e6259c640 1 --2- 172.21.15.50:0/58058943 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9bfd6abf0 0x55d9bfd859a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4e54010420 tx=0x7f4e540108e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e49d2ee58472bb7a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:36.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.671+0000 7f4e49ffb640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:34:36.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.671+0000 7f4e49ffb640 1 -- 172.21.15.50:0/58058943 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e54005220 con 0x55d9bfd6abf0 2024-06-06T03:34:36.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.672+0000 7f4e49ffb640 1 -- 172.21.15.50:0/58058943 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f4e540053c0 con 0x55d9bfd6abf0 2024-06-06T03:34:36.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.673+0000 7f4e6b97a740 1 -- 172.21.15.50:0/58058943 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e5c016070 con 0x55d9bfd6abf0 2024-06-06T03:34:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.676+0000 7f4e49ffb640 1 -- 172.21.15.50:0/58058943 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f4e540055c0 con 0x55d9bfd6abf0 2024-06-06T03:34:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.677+0000 7f4e6b97a740 10 client.26167 fetch_fsmap learned FSMap version 33 2024-06-06T03:34:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.677+0000 7f4e6b97a740 1 -- 172.21.15.50:0/58058943 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55d9bfaad620 con 0x55d9bfd6abf0 2024-06-06T03:34:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.678+0000 7f4e49ffb640 1 -- 172.21.15.50:0/58058943 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4e5c016070 con 0x55d9bfd6abf0 2024-06-06T03:34:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.678+0000 7f4e49ffb640 1 -- 172.21.15.50:0/58058943 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f4e5400f040 con 0x55d9bfd6abf0 2024-06-06T03:34:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.678+0000 7f4e6b97a740 10 client.26167 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:34:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.678+0000 7f4e6b97a740 10 client.26167 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:34:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.678+0000 7f4e6b97a740 20 client.26167 populate_metadata read hostname 'smithi050' 2024-06-06T03:34:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.678+0000 7f4e6b97a740 1 --2- 172.21.15.50:0/58058943 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d9bfdb3860 0x55d9bfdb5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.678+0000 7f4e6b97a740 4 client.26167 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:34:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.678+0000 7f4e6b97a740 1 -- 172.21.15.50:0/58058943 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9bfce0f10 con 0x55d9bfdb3860 2024-06-06T03:34:36.680 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.680+0000 7f4e61d9b640 1 --2- 172.21.15.50:0/58058943 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d9bfdb3860 0x55d9bfdb5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:36.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.687+0000 7f4e61d9b640 1 --2- 172.21.15.50:0/58058943 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d9bfdb3860 0x55d9bfdb5d00 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c59d7a0d34fd49f3 server_cookie=7ce6e277c0a2a70d in_seq=0 out_seq=0 2024-06-06T03:34:36.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.687+0000 7f4e49ffb640 10 client.26167 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:36.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.689+0000 7f4e49ffb640 1 -- 172.21.15.50:0/58058943 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d9bfce0f10 con 0x55d9bfdb3860 2024-06-06T03:34:36.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.689+0000 7f4e49ffb640 10 client.26167 handle_command_reply: tid=0 2024-06-06T03:34:36.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.689+0000 7f4e6b97a740 1 client.26167 shutdown 2024-06-06T03:34:36.693 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.693+0000 7f4e6b97a740 1 -- 172.21.15.50:0/58058943 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9bfd6abf0 msgr2=0x55d9bfd859a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:36.693 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.693+0000 7f4e6b97a740 1 --2- 172.21.15.50:0/58058943 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9bfd6abf0 0x55d9bfd859a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4e54010420 tx=0x7f4e540108e0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.699+0000 7f4e6b97a740 1 -- 172.21.15.50:0/58058943 shutdown_connections 2024-06-06T03:34:36.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.699+0000 7f4e6b97a740 1 --2- 172.21.15.50:0/58058943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9bfd6fd60 0x55d9bfd8c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.699+0000 7f4e6b97a740 1 --2- 172.21.15.50:0/58058943 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9bfd6abf0 0x55d9bfd859a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.699+0000 7f4e6b97a740 1 --2- 172.21.15.50:0/58058943 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d9bfdb3860 0x55d9bfdb5d00 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.699+0000 7f4e6b97a740 1 --2- 172.21.15.50:0/58058943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9bfd6a200 0x55d9bfd85460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.699+0000 7f4e6b97a740 1 -- 172.21.15.50:0/58058943 >> 172.21.15.50:0/58058943 conn(0x55d9bfd65870 msgr2=0x55d9bfd649d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:36.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.699+0000 7f4e49ffb640 0 client.26167 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:36.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.699+0000 7f4e6b97a740 1 -- 172.21.15.50:0/58058943 shutdown_connections 2024-06-06T03:34:36.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.699+0000 7f4e6b97a740 1 -- 172.21.15.50:0/58058943 wait complete. 2024-06-06T03:34:36.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.699+0000 7f4e6b97a740 20 client.26167 trim_cache size 0 max 16384 2024-06-06T03:34:36.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.746+0000 7f4e6b97a740 1 Processor -- start 2024-06-06T03:34:36.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.746+0000 7f4e6b97a740 1 -- start start 2024-06-06T03:34:36.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.746+0000 7f4e6b97a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9bfd6a200 0x55d9bfd72190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:36.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.746+0000 7f4e6b97a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9bfd6abf0 0x55d9bfd8c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:36.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.746+0000 7f4e6b97a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9bfd6fd60 0x55d9bfdb5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:36.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.746+0000 7f4e6b97a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4e64078060 con 0x55d9bfd6fd60 2024-06-06T03:34:36.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.746+0000 7f4e6b97a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4e64075930 con 0x55d9bfd6abf0 2024-06-06T03:34:36.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.746+0000 7f4e6b97a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4e64118490 con 0x55d9bfd6a200 2024-06-06T03:34:36.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.747+0000 7f4e6259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9bfd6abf0 0x55d9bfd8c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:36.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.747+0000 7f4e6259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9bfd6abf0 0x55d9bfd8c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:53642/0 (socket says 172.21.15.50:53642) 2024-06-06T03:34:36.748 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.747+0000 7f4e6259c640 1 -- 172.21.15.50:0/3765276627 learned_addr learned my addr 172.21.15.50:0/3765276627 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:36.748 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.747+0000 7f4e61d9b640 1 --2- 172.21.15.50:0/3765276627 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9bfd6a200 0x55d9bfd72190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:36.748 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.747+0000 7f4e61d9b640 1 --2- 172.21.15.50:0/3765276627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9bfd6fd60 0x55d9bfdb5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:36.749 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.747+0000 7f4e6259c640 1 -- 172.21.15.50:0/3765276627 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9bfd6a200 msgr2=0x55d9bfd72190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:36.749 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.748+0000 7f4e6259c640 1 --2- 172.21.15.50:0/3765276627 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9bfd6a200 0x55d9bfd72190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.749 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.748+0000 7f4e6259c640 1 -- 172.21.15.50:0/3765276627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9bfd6fd60 msgr2=0x55d9bfdb5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:36.749 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.748+0000 7f4e6259c640 1 --2- 172.21.15.50:0/3765276627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9bfd6fd60 0x55d9bfdb5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.749 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.748+0000 7f4e6259c640 1 -- 172.21.15.50:0/3765276627 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9bfd84510 con 0x55d9bfd6abf0 2024-06-06T03:34:36.749 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.748+0000 7f4e61d9b640 1 --2- 172.21.15.50:0/3765276627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9bfd6fd60 0x55d9bfdb5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:34:36.749 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.748+0000 7f4e6259c640 1 --2- 172.21.15.50:0/3765276627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9bfd6abf0 0x55d9bfd8c9a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4e5400eb40 tx=0x7f4e540058d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=745165f746b6df9a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:36.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.749+0000 7f4e4bfff640 1 -- 172.21.15.50:0/3765276627 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e54012920 con 0x55d9bfd6abf0 2024-06-06T03:34:36.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.750+0000 7f4e4bfff640 1 -- 172.21.15.50:0/3765276627 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4e54012ac0 con 0x55d9bfd6abf0 2024-06-06T03:34:36.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.750+0000 7f4e4bfff640 1 -- 172.21.15.50:0/3765276627 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e540317f0 con 0x55d9bfd6abf0 2024-06-06T03:34:36.755 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.752+0000 7f4e6b97a740 1 -- 172.21.15.50:0/3765276627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9bfd6abf0 msgr2=0x55d9bfd8c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:36.755 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.752+0000 7f4e6b97a740 1 --2- 172.21.15.50:0/3765276627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9bfd6abf0 0x55d9bfd8c9a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4e5400eb40 tx=0x7f4e540058d0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.756 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.752+0000 7f4e6b97a740 1 -- 172.21.15.50:0/3765276627 shutdown_connections 2024-06-06T03:34:36.756 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.752+0000 7f4e6b97a740 1 --2- 172.21.15.50:0/3765276627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9bfd6fd60 0x55d9bfdb5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.756 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.752+0000 7f4e6b97a740 1 --2- 172.21.15.50:0/3765276627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9bfd6abf0 0x55d9bfd8c9a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.756 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.752+0000 7f4e6b97a740 1 --2- 172.21.15.50:0/3765276627 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9bfd6a200 0x55d9bfd72190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.756 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.752+0000 7f4e6b97a740 1 -- 172.21.15.50:0/3765276627 >> 172.21.15.50:0/3765276627 conn(0x55d9bfd65870 msgr2=0x55d9bfd65c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:36.756 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.756+0000 7f4e6b97a740 1 -- 172.21.15.50:0/3765276627 shutdown_connections 2024-06-06T03:34:36.756 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.756+0000 7f4e6b97a740 1 -- 172.21.15.50:0/3765276627 wait complete. 2024-06-06T03:34:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.756+0000 7f4e6b97a740 1 -- start start 2024-06-06T03:34:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.756+0000 7f4e6b97a740 1 Processor -- start 2024-06-06T03:34:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.756+0000 7f4e6b97a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9bfd6a200 0x55d9bfd88b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.756+0000 7f4e6b97a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9bfd6abf0 0x55d9bfd89070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.756+0000 7f4e6b97a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9bfd6fd60 0x55d9bfd8c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.756+0000 7f4e6b97a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4e64073df0 con 0x55d9bfd6fd60 2024-06-06T03:34:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.756+0000 7f4e6b97a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4e64075260 con 0x55d9bfd6a200 2024-06-06T03:34:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.756+0000 7f4e6b97a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4e640744c0 con 0x55d9bfd6abf0 2024-06-06T03:34:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.757+0000 7f4e6b97a740 10 client.0 _ll_register_callbacks cb 0x7f4e5400e2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:34:36.762 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.761+0000 7f4e6259c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9bfd6abf0 0x55d9bfd89070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:36.762 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.761+0000 7f4e6259c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9bfd6abf0 0x55d9bfd89070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:50832/0 (socket says 172.21.15.50:50832) 2024-06-06T03:34:36.762 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.761+0000 7f4e6259c640 1 -- 172.21.15.50:0/1831632550 learned_addr learned my addr 172.21.15.50:0/1831632550 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:36.762 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.761+0000 7f4e61d9b640 1 --2- 172.21.15.50:0/1831632550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9bfd6a200 0x55d9bfd88b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:36.762 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.761+0000 7f4e61d9b640 1 --2- 172.21.15.50:0/1831632550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9bfd6fd60 0x55d9bfd8c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:36.763 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.762+0000 7f4e61d9b640 1 -- 172.21.15.50:0/1831632550 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9bfd6abf0 msgr2=0x55d9bfd89070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:36.763 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.762+0000 7f4e61d9b640 1 --2- 172.21.15.50:0/1831632550 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9bfd6abf0 0x55d9bfd89070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.763 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.762+0000 7f4e61d9b640 1 -- 172.21.15.50:0/1831632550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9bfd6fd60 msgr2=0x55d9bfd8c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:36.763 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.762+0000 7f4e61d9b640 1 --2- 172.21.15.50:0/1831632550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9bfd6fd60 0x55d9bfd8c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.763 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.762+0000 7f4e61d9b640 1 -- 172.21.15.50:0/1831632550 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9bfd8c680 con 0x55d9bfd6a200 2024-06-06T03:34:36.763 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.763+0000 7f4e61d9b640 1 --2- 172.21.15.50:0/1831632550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9bfd6a200 0x55d9bfd88b30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c0124c0 tx=0x7f4e5c022040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d150560b9d442904 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:36.766 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.766+0000 7f4e49ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:34:36.766 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.766+0000 7f4e49ffb640 1 -- 172.21.15.50:0/1831632550 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c012250 con 0x55d9bfd6a200 2024-06-06T03:34:36.766 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.766+0000 7f4e6b97a740 1 -- 172.21.15.50:0/1831632550 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e54012ac0 con 0x55d9bfd6a200 2024-06-06T03:34:36.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.766+0000 7f4e49ffb640 1 -- 172.21.15.50:0/1831632550 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f4e5c004a00 con 0x55d9bfd6a200 2024-06-06T03:34:36.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.766+0000 7f4e49ffb640 1 -- 172.21.15.50:0/1831632550 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f4e5c004c00 con 0x55d9bfd6a200 2024-06-06T03:34:36.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.766+0000 7f4e6b97a740 10 client.26156 fetch_fsmap learned FSMap version 33 2024-06-06T03:34:36.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.767+0000 7f4e6b97a740 1 -- 172.21.15.50:0/1831632550 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55d9bfe1cff0 con 0x55d9bfd6a200 2024-06-06T03:34:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.768+0000 7f4e49ffb640 1 -- 172.21.15.50:0/1831632550 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4e54012ac0 con 0x55d9bfd6a200 2024-06-06T03:34:36.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.769+0000 7f4e49ffb640 1 -- 172.21.15.50:0/1831632550 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f4e5c0042f0 con 0x55d9bfd6a200 2024-06-06T03:34:36.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.769+0000 7f4e6b97a740 10 client.26156 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:34:36.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.769+0000 7f4e6b97a740 10 client.26156 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:34:36.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.769+0000 7f4e6b97a740 20 client.26156 populate_metadata read hostname 'smithi050' 2024-06-06T03:34:36.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.769+0000 7f4e6b97a740 1 --2- 172.21.15.50:0/1831632550 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d9bfe1d860 0x55d9bfe1fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:36.770 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.769+0000 7f4e6b97a740 4 client.26156 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:34:36.770 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.769+0000 7f4e6b97a740 1 -- 172.21.15.50:0/1831632550 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d9bfd83f70 con 0x55d9bfe1d860 2024-06-06T03:34:36.773 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.774+0000 7f4e6259c640 1 --2- 172.21.15.50:0/1831632550 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d9bfe1d860 0x55d9bfe1fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:36.779 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.779+0000 7f4e6259c640 1 --2- 172.21.15.50:0/1831632550 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d9bfe1d860 0x55d9bfe1fc80 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5c29839be28c876 server_cookie=f3d22c6d8780ac63 in_seq=0 out_seq=0 2024-06-06T03:34:36.779 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.779+0000 7f4e49ffb640 10 client.26156 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.784+0000 7f4e49ffb640 1 -- 172.21.15.50:0/1831632550 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55d9bfd83f70 con 0x55d9bfe1d860 2024-06-06T03:34:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.784+0000 7f4e49ffb640 10 client.26156 handle_command_reply: tid=0 2024-06-06T03:34:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.784+0000 7f4e6b97a740 1 client.26156 shutdown 2024-06-06T03:34:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.792+0000 7f4e6b97a740 1 -- 172.21.15.50:0/1831632550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9bfd6a200 msgr2=0x55d9bfd88b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:36.792 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.792+0000 7f4e6b97a740 1 --2- 172.21.15.50:0/1831632550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9bfd6a200 0x55d9bfd88b30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c0124c0 tx=0x7f4e5c022040 comp rx=0 tx=0).stop 2024-06-06T03:34:36.795 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.796+0000 7f4e6b97a740 1 -- 172.21.15.50:0/1831632550 shutdown_connections 2024-06-06T03:34:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.796+0000 7f4e6b97a740 1 --2- 172.21.15.50:0/1831632550 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55d9bfe1d860 0x55d9bfe1fc80 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.796+0000 7f4e6b97a740 1 --2- 172.21.15.50:0/1831632550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9bfd6fd60 0x55d9bfd8c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.796+0000 7f4e6b97a740 1 --2- 172.21.15.50:0/1831632550 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9bfd6abf0 0x55d9bfd89070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.796+0000 7f4e6b97a740 1 --2- 172.21.15.50:0/1831632550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9bfd6a200 0x55d9bfd88b30 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.796+0000 7f4e49ffb640 0 client.26156 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.796+0000 7f4e6b97a740 1 -- 172.21.15.50:0/1831632550 >> 172.21.15.50:0/1831632550 conn(0x55d9bfd65870 msgr2=0x55d9bfdb5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:36.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.805+0000 7f4e6b97a740 1 -- 172.21.15.50:0/1831632550 shutdown_connections 2024-06-06T03:34:36.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.810+0000 7f4e6b97a740 1 -- 172.21.15.50:0/1831632550 wait complete. 2024-06-06T03:34:36.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.810+0000 7f4e6b97a740 20 client.26156 trim_cache size 0 max 16384 2024-06-06T03:34:36.811 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:34:36.811 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:34:36.811 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:34:36.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.812+0000 7f4e6359e640 1 -- 172.21.15.50:0/294126619 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4e4c0a2d90 msgr2=0x7f4e4c0a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:36.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.812+0000 7f4e6359e640 1 --2- 172.21.15.50:0/294126619 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4e4c0a2d90 0x7f4e4c0a5250 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4e58004650 tx=0x7f4e580b8040 comp rx=0 tx=0).stop 2024-06-06T03:34:36.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.812+0000 7f4e6359e640 1 -- 172.21.15.50:0/294126619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e64109970 msgr2=0x7f4e641add70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:36.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.812+0000 7f4e6359e640 1 --2- 172.21.15.50:0/294126619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e64109970 0x7f4e641add70 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009850 tx=0x7f4e58003cd0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.816 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.816+0000 7f4e6359e640 1 -- 172.21.15.50:0/294126619 shutdown_connections 2024-06-06T03:34:36.817 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.817+0000 7f4e6359e640 1 --2- 172.21.15.50:0/294126619 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4e4c0a2d90 0x7f4e4c0a5250 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.817 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.817+0000 7f4e6359e640 1 --2- 172.21.15.50:0/294126619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e64109970 0x7f4e641add70 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.817 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.817+0000 7f4e6359e640 1 --2- 172.21.15.50:0/294126619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e64108fb0 0x7f4e641a6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.817 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.818+0000 7f4e6359e640 1 --2- 172.21.15.50:0/294126619 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e64072cd0 0x7f4e641a67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:36.817 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.818+0000 7f4e6359e640 1 -- 172.21.15.50:0/294126619 >> 172.21.15.50:0/294126619 conn(0x7f4e6406e840 msgr2=0x7f4e64070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:36.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.821+0000 7f4e6359e640 1 -- 172.21.15.50:0/294126619 shutdown_connections 2024-06-06T03:34:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:36.822+0000 7f4e6359e640 1 -- 172.21.15.50:0/294126619 wait complete. 2024-06-06T03:34:37.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:37 smithi079 ceph-mon[35478]: pgmap v670: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 37 MiB/s wr, 730 op/s 2024-06-06T03:34:37.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:37 smithi122 ceph-mon[35759]: pgmap v670: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 37 MiB/s wr, 730 op/s 2024-06-06T03:34:37.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:37 smithi050 ceph-mon[32421]: pgmap v670: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 37 MiB/s wr, 730 op/s 2024-06-06T03:34:39.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:39 smithi079 ceph-mon[35478]: pgmap v671: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 30 MiB/s wr, 601 op/s 2024-06-06T03:34:39.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:39 smithi122 ceph-mon[35759]: pgmap v671: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 30 MiB/s wr, 601 op/s 2024-06-06T03:34:39.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:39 smithi050 ceph-mon[32421]: pgmap v671: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 30 MiB/s wr, 601 op/s 2024-06-06T03:34:41.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:41 smithi079 ceph-mon[35478]: pgmap v672: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 41 MiB/s wr, 810 op/s 2024-06-06T03:34:41.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:41 smithi122 ceph-mon[35759]: pgmap v672: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 41 MiB/s wr, 810 op/s 2024-06-06T03:34:41.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:41 smithi050 ceph-mon[32421]: pgmap v672: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 41 MiB/s wr, 810 op/s 2024-06-06T03:34:43.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:43 smithi079 ceph-mon[35478]: pgmap v673: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 31 MiB/s wr, 627 op/s 2024-06-06T03:34:43.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:43 smithi122 ceph-mon[35759]: pgmap v673: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 31 MiB/s wr, 627 op/s 2024-06-06T03:34:43.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:43 smithi050 ceph-mon[32421]: pgmap v673: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 31 MiB/s wr, 627 op/s 2024-06-06T03:34:45.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:45 smithi079 ceph-mon[35478]: pgmap v674: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 34 MiB/s wr, 677 op/s 2024-06-06T03:34:45.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:45 smithi122 ceph-mon[35759]: pgmap v674: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 34 MiB/s wr, 677 op/s 2024-06-06T03:34:45.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:45 smithi050 ceph-mon[32421]: pgmap v674: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 34 MiB/s wr, 677 op/s 2024-06-06T03:34:47.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:47 smithi079 ceph-mon[35478]: pgmap v675: 129 pgs: 129 active+clean; 10 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 37 MiB/s wr, 742 op/s 2024-06-06T03:34:47.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:47 smithi122 ceph-mon[35759]: pgmap v675: 129 pgs: 129 active+clean; 10 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 37 MiB/s wr, 742 op/s 2024-06-06T03:34:47.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:47 smithi050 ceph-mon[32421]: pgmap v675: 129 pgs: 129 active+clean; 10 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 37 MiB/s wr, 742 op/s 2024-06-06T03:34:49.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:49 smithi079 ceph-mon[35478]: pgmap v676: 129 pgs: 129 active+clean; 10 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 30 MiB/s wr, 603 op/s 2024-06-06T03:34:49.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:49 smithi122 ceph-mon[35759]: pgmap v676: 129 pgs: 129 active+clean; 10 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 30 MiB/s wr, 603 op/s 2024-06-06T03:34:49.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:49 smithi050 ceph-mon[32421]: pgmap v676: 129 pgs: 129 active+clean; 10 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 30 MiB/s wr, 603 op/s 2024-06-06T03:34:50.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.082+0000 7fb6cb9f9640 1 -- 172.21.15.50:0/278355600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6c4101370 msgr2=0x7fb6c4105c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:50.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.082+0000 7fb6cb9f9640 1 --2- 172.21.15.50:0/278355600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6c4101370 0x7fb6c4105c30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0009860 tx=0x7fb6c002a380 comp rx=0 tx=0).stop 2024-06-06T03:34:50.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.082+0000 7fb6cb9f9640 1 -- 172.21.15.50:0/278355600 shutdown_connections 2024-06-06T03:34:50.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.082+0000 7fb6cb9f9640 1 --2- 172.21.15.50:0/278355600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6c41009d0 0x7fb6c4100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.082+0000 7fb6cb9f9640 1 --2- 172.21.15.50:0/278355600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6c4101370 0x7fb6c4105c30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.082+0000 7fb6cb9f9640 1 --2- 172.21.15.50:0/278355600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6c40ff8a0 0x7fb6c40ffcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.082+0000 7fb6cb9f9640 1 -- 172.21.15.50:0/278355600 >> 172.21.15.50:0/278355600 conn(0x7fb6c40fb1c0 msgr2=0x7fb6c40fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:50.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.082+0000 7fb6cb9f9640 1 -- 172.21.15.50:0/278355600 shutdown_connections 2024-06-06T03:34:50.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.083+0000 7fb6cb9f9640 1 -- 172.21.15.50:0/278355600 wait complete. 2024-06-06T03:34:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.083+0000 7fb6cb9f9640 1 Processor -- start 2024-06-06T03:34:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.084+0000 7fb6cb9f9640 1 -- start start 2024-06-06T03:34:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.084+0000 7fb6cb9f9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6c40ff8a0 0x7fb6c410f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.084+0000 7fb6cb9f9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6c41009d0 0x7fb6c410fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.084+0000 7fb6cb9f9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6c4101370 0x7fb6c4110c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.084+0000 7fb6cb9f9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c4107dc0 con 0x7fb6c4101370 2024-06-06T03:34:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.084+0000 7fb6cb9f9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c4107c40 con 0x7fb6c41009d0 2024-06-06T03:34:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.084+0000 7fb6cb9f9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c4107f40 con 0x7fb6c40ff8a0 2024-06-06T03:34:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.084+0000 7fb6c9f96640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6c4101370 0x7fb6c4110c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.084+0000 7fb6c9f96640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6c4101370 0x7fb6c4110c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50730/0 (socket says 172.21.15.50:50730) 2024-06-06T03:34:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.084+0000 7fb6c9f96640 1 -- 172.21.15.50:0/572816720 learned_addr learned my addr 172.21.15.50:0/572816720 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.085+0000 7fb6c9f96640 1 -- 172.21.15.50:0/572816720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6c40ff8a0 msgr2=0x7fb6c410f6a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T03:34:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.085+0000 7fb6c9f96640 1 --2- 172.21.15.50:0/572816720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6c40ff8a0 0x7fb6c410f6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.085+0000 7fb6c9f96640 1 -- 172.21.15.50:0/572816720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6c41009d0 msgr2=0x7fb6c410fbe0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-06T03:34:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.085+0000 7fb6c9f96640 1 --2- 172.21.15.50:0/572816720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6c41009d0 0x7fb6c410fbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.085+0000 7fb6c9f96640 1 -- 172.21.15.50:0/572816720 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c4111290 con 0x7fb6c4101370 2024-06-06T03:34:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.085+0000 7fb6c9f96640 1 --2- 172.21.15.50:0/572816720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6c4101370 0x7fb6c4110c20 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fb6c002a970 tx=0x7fb6c0032d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.086+0000 7fb6ba7fc640 1 -- 172.21.15.50:0/572816720 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0037030 con 0x7fb6c4101370 2024-06-06T03:34:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.086+0000 7fb6cb9f9640 1 -- 172.21.15.50:0/572816720 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c4111520 con 0x7fb6c4101370 2024-06-06T03:34:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.086+0000 7fb6cb9f9640 1 -- 172.21.15.50:0/572816720 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c4111a60 con 0x7fb6c4101370 2024-06-06T03:34:50.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.088+0000 7fb6ba7fc640 1 -- 172.21.15.50:0/572816720 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb6c0041070 con 0x7fb6c4101370 2024-06-06T03:34:50.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.088+0000 7fb6ba7fc640 1 -- 172.21.15.50:0/572816720 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0005450 con 0x7fb6c4101370 2024-06-06T03:34:50.093 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.093+0000 7fb6ba7fc640 1 -- 172.21.15.50:0/572816720 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb6c0004050 con 0x7fb6c4101370 2024-06-06T03:34:50.093 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.093+0000 7fb6ce7e9740 1 Processor -- start 2024-06-06T03:34:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.094+0000 7fb6ce7e9740 1 -- start start 2024-06-06T03:34:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.094+0000 7fb6ba7fc640 1 --2- 172.21.15.50:0/572816720 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb6b00a2d80 0x7fb6b00a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.095+0000 7fb6ba7fc640 1 -- 172.21.15.50:0/572816720 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fb6c00ef340 con 0x7fb6c4101370 2024-06-06T03:34:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.095+0000 7fb6ce7e9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557310e96010 0x557310e96430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.095+0000 7fb6ce7e9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557310e96a00 0x557310e9b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.095+0000 7fb6ce7e9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557310e9bb70 0x557310e9e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.095+0000 7fb6ce7e9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557310df94f0 con 0x557310e9bb70 2024-06-06T03:34:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.095+0000 7fb6ce7e9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557310d97870 con 0x557310e96010 2024-06-06T03:34:50.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.095+0000 7fb6ce7e9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557310df54b0 con 0x557310e96a00 2024-06-06T03:34:50.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.095+0000 7fb6c9795640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557310e96010 0x557310e96430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:50.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.095+0000 7fb6c9795640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557310e96010 0x557310e96430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:39126/0 (socket says 172.21.15.50:39126) 2024-06-06T03:34:50.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.095+0000 7fb6c9795640 1 -- 172.21.15.50:0/1541505729 learned_addr learned my addr 172.21.15.50:0/1541505729 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:50.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.096+0000 7fb6c9f96640 1 --2- 172.21.15.50:0/1541505729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557310e9bb70 0x557310e9e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:50.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.096+0000 7fb6c9795640 1 -- 172.21.15.50:0/1541505729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557310e96a00 msgr2=0x557310e9b500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:34:50.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.096+0000 7fb6c9795640 1 --2- 172.21.15.50:0/1541505729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557310e96a00 0x557310e9b500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.096+0000 7fb6c9795640 1 -- 172.21.15.50:0/1541505729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557310e9bb70 msgr2=0x557310e9e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:50.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.096+0000 7fb6c9795640 1 --2- 172.21.15.50:0/1541505729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557310e9bb70 0x557310e9e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.096+0000 7fb6c9795640 1 -- 172.21.15.50:0/1541505729 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557310db39b0 con 0x557310e96010 2024-06-06T03:34:50.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.096+0000 7fb6c9f96640 1 --2- 172.21.15.50:0/1541505729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557310e9bb70 0x557310e9e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:34:50.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.096+0000 7fb6c9795640 1 --2- 172.21.15.50:0/1541505729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557310e96010 0x557310e96430 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4009770 tx=0x7fb6b4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66b3849e0cc2e143 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:50.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.097+0000 7fb6c8f94640 1 --2- 172.21.15.50:0/572816720 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb6b00a2d80 0x7fb6b00a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:50.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.097+0000 7fb6af7fe640 1 -- 172.21.15.50:0/1541505729 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4015020 con 0x557310e96010 2024-06-06T03:34:50.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.097+0000 7fb6af7fe640 1 -- 172.21.15.50:0/1541505729 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb6b4011420 con 0x557310e96010 2024-06-06T03:34:50.098 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.098+0000 7fb6ce7e9740 1 -- 172.21.15.50:0/1541505729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557310e96010 msgr2=0x557310e96430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:50.098 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.098+0000 7fb6c8f94640 1 --2- 172.21.15.50:0/572816720 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb6b00a2d80 0x7fb6b00a5240 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x557310e96e00 tx=0x7fb6bc0095c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:50.098 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.098+0000 7fb6ce7e9740 1 --2- 172.21.15.50:0/1541505729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557310e96010 0x557310e96430 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4009770 tx=0x7fb6b4009c30 comp rx=0 tx=0).stop 2024-06-06T03:34:50.098 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.098+0000 7fb6ce7e9740 1 -- 172.21.15.50:0/1541505729 shutdown_connections 2024-06-06T03:34:50.099 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.098+0000 7fb6ce7e9740 1 --2- 172.21.15.50:0/1541505729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557310e9bb70 0x557310e9e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.099 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.098+0000 7fb6ce7e9740 1 --2- 172.21.15.50:0/1541505729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557310e96a00 0x557310e9b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.099 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.098+0000 7fb6ce7e9740 1 --2- 172.21.15.50:0/1541505729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557310e96010 0x557310e96430 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.099 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.098+0000 7fb6ce7e9740 1 -- 172.21.15.50:0/1541505729 >> 172.21.15.50:0/1541505729 conn(0x557310e91680 msgr2=0x557310e91a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:50.099 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.098+0000 7fb6ce7e9740 1 -- 172.21.15.50:0/1541505729 shutdown_connections 2024-06-06T03:34:50.099 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.099+0000 7fb6ce7e9740 1 -- 172.21.15.50:0/1541505729 wait complete. 2024-06-06T03:34:50.099 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.099+0000 7fb6ce7e9740 1 -- start start 2024-06-06T03:34:50.099 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.099+0000 7fb6ce7e9740 1 Processor -- start 2024-06-06T03:34:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.100+0000 7fb6ce7e9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557310e96010 0x557310ea04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.100+0000 7fb6ce7e9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557310e96a00 0x557310ea09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.100+0000 7fb6ce7e9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557310e9bb70 0x557310ea7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.100+0000 7fb6ce7e9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557310e9eb70 con 0x557310e9bb70 2024-06-06T03:34:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.100+0000 7fb6ce7e9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557310d82ae0 con 0x557310e96010 2024-06-06T03:34:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.100+0000 7fb6ce7e9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557310e9ecf0 con 0x557310e96a00 2024-06-06T03:34:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.100+0000 7fb6ce7e9740 10 client.0 _ll_register_callbacks cb 0x557310dbb9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:34:50.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.100+0000 7fb6c9f96640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557310e9bb70 0x557310ea7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:50.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.100+0000 7fb6c9f96640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557310e9bb70 0x557310ea7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50756/0 (socket says 172.21.15.50:50756) 2024-06-06T03:34:50.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.100+0000 7fb6c9f96640 1 -- 172.21.15.50:0/3938318320 learned_addr learned my addr 172.21.15.50:0/3938318320 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:50.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.100+0000 7fb6c9795640 1 --2- 172.21.15.50:0/3938318320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557310e96010 0x557310ea04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:50.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.100+0000 7fb6c8f94640 1 --2- 172.21.15.50:0/3938318320 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557310e96a00 0x557310ea09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:50.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.101+0000 7fb6c8f94640 1 -- 172.21.15.50:0/3938318320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557310e96010 msgr2=0x557310ea04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:50.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.101+0000 7fb6c8f94640 1 --2- 172.21.15.50:0/3938318320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557310e96010 0x557310ea04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.101+0000 7fb6c8f94640 1 -- 172.21.15.50:0/3938318320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557310e9bb70 msgr2=0x557310ea7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:50.102 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.101+0000 7fb6c8f94640 1 --2- 172.21.15.50:0/3938318320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557310e9bb70 0x557310ea7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.102 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.101+0000 7fb6c8f94640 1 -- 172.21.15.50:0/3938318320 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557310b0d210 con 0x557310e96a00 2024-06-06T03:34:50.102 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.101+0000 7fb6c8f94640 1 --2- 172.21.15.50:0/3938318320 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557310e96a00 0x557310ea09f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4110bb0 tx=0x7fb6bc004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b807801188b6c384 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:50.103 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.103+0000 7fb6c9795640 1 --2- 172.21.15.50:0/3938318320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557310e96010 0x557310ea04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:34:50.104 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.105+0000 7fb6acff9640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:34:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.105+0000 7fb6acff9640 1 -- 172.21.15.50:0/3938318320 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc00bac0 con 0x557310e96a00 2024-06-06T03:34:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.105+0000 7fb6acff9640 1 -- 172.21.15.50:0/3938318320 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fb6bc00bc60 con 0x557310e96a00 2024-06-06T03:34:50.106 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.106+0000 7fb6ce7e9740 1 -- 172.21.15.50:0/3938318320 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6b4011420 con 0x557310e96a00 2024-06-06T03:34:50.107 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.108+0000 7fb6acff9640 1 -- 172.21.15.50:0/3938318320 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb6bc00be60 con 0x557310e96a00 2024-06-06T03:34:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.108+0000 7fb6ce7e9740 10 client.26179 fetch_fsmap learned FSMap version 33 2024-06-06T03:34:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.108+0000 7fb6ce7e9740 1 -- 172.21.15.50:0/3938318320 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x557310bd9620 con 0x557310e96a00 2024-06-06T03:34:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.109+0000 7fb6acff9640 1 -- 172.21.15.50:0/3938318320 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb6b4011420 con 0x557310e96a00 2024-06-06T03:34:50.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.110+0000 7fb6acff9640 1 -- 172.21.15.50:0/3938318320 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fb6bc00b040 con 0x557310e96a00 2024-06-06T03:34:50.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.110+0000 7fb6ce7e9740 10 client.26179 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:34:50.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.110+0000 7fb6ce7e9740 10 client.26179 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:34:50.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.110+0000 7fb6ce7e9740 20 client.26179 populate_metadata read hostname 'smithi050' 2024-06-06T03:34:50.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.110+0000 7fb6ce7e9740 1 --2- 172.21.15.50:0/3938318320 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x557310eac780 0x557310eaec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:50.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.110+0000 7fb6ce7e9740 4 client.26179 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:34:50.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.110+0000 7fb6ce7e9740 1 -- 172.21.15.50:0/3938318320 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557310e0cf10 con 0x557310eac780 2024-06-06T03:34:50.116 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.116+0000 7fb6c9795640 1 --2- 172.21.15.50:0/3938318320 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x557310eac780 0x557310eaec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.121+0000 7fb6c9795640 1 --2- 172.21.15.50:0/3938318320 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x557310eac780 0x557310eaec00 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=779cc4d8cc0db4aa server_cookie=817572898591c895 in_seq=0 out_seq=0 2024-06-06T03:34:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.121+0000 7fb6acff9640 10 client.26179 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.124+0000 7fb6acff9640 1 -- 172.21.15.50:0/3938318320 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x557310e0cf10 con 0x557310eac780 2024-06-06T03:34:50.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.125+0000 7fb6acff9640 10 client.26179 handle_command_reply: tid=0 2024-06-06T03:34:50.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.125+0000 7fb6ce7e9740 1 client.26179 shutdown 2024-06-06T03:34:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.127+0000 7fb6ce7e9740 1 -- 172.21.15.50:0/3938318320 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557310e96a00 msgr2=0x557310ea09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.127+0000 7fb6ce7e9740 1 --2- 172.21.15.50:0/3938318320 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557310e96a00 0x557310ea09f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4110bb0 tx=0x7fb6bc004a40 comp rx=0 tx=0).stop 2024-06-06T03:34:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.136+0000 7fb6ce7e9740 1 -- 172.21.15.50:0/3938318320 shutdown_connections 2024-06-06T03:34:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.136+0000 7fb6ce7e9740 1 --2- 172.21.15.50:0/3938318320 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x557310eac780 0x557310eaec00 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.136+0000 7fb6ce7e9740 1 --2- 172.21.15.50:0/3938318320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557310e9bb70 0x557310ea7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.136+0000 7fb6ce7e9740 1 --2- 172.21.15.50:0/3938318320 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557310e96a00 0x557310ea09f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.136+0000 7fb6ce7e9740 1 --2- 172.21.15.50:0/3938318320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557310e96010 0x557310ea04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.136+0000 7fb6ce7e9740 1 -- 172.21.15.50:0/3938318320 >> 172.21.15.50:0/3938318320 conn(0x557310e91680 msgr2=0x557310e907e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:50.137 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.137+0000 7fb6acff9640 0 client.26179 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:50.140 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.141+0000 7fb6ce7e9740 1 -- 172.21.15.50:0/3938318320 shutdown_connections 2024-06-06T03:34:50.142 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.142+0000 7fb6ce7e9740 1 -- 172.21.15.50:0/3938318320 wait complete. 2024-06-06T03:34:50.142 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.143+0000 7fb6ce7e9740 20 client.26179 trim_cache size 0 max 16384 2024-06-06T03:34:50.191 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.191+0000 7fb6ce7e9740 1 Processor -- start 2024-06-06T03:34:50.191 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.191+0000 7fb6ce7e9740 1 -- start start 2024-06-06T03:34:50.191 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.191+0000 7fb6ce7e9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557310e96010 0x557310e8c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:50.192 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.191+0000 7fb6ce7e9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557310e96a00 0x557310ea79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:50.192 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.192+0000 7fb6c9795640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557310e96010 0x557310e8c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:50.192 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.192+0000 7fb6c9795640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557310e96010 0x557310e8c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:39134/0 (socket says 172.21.15.50:39134) 2024-06-06T03:34:50.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.192+0000 7fb6c9795640 1 -- 172.21.15.50:0/3867542280 learned_addr learned my addr 172.21.15.50:0/3867542280 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:50.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.192+0000 7fb6c8f94640 1 --2- 172.21.15.50:0/3867542280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557310e96a00 0x557310ea79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:50.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.192+0000 7fb6ce7e9740 1 --2- 172.21.15.50:0/3867542280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557310e9bb70 0x557310e9b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:50.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.192+0000 7fb6ce7e9740 1 -- 172.21.15.50:0/3867542280 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a80123e0 con 0x557310e96a00 2024-06-06T03:34:50.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.192+0000 7fb6c9f96640 1 --2- 172.21.15.50:0/3867542280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557310e9bb70 0x557310e9b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:50.196 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.192+0000 7fb6ce7e9740 1 -- 172.21.15.50:0/3867542280 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a800fcb0 con 0x557310e96010 2024-06-06T03:34:50.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.197+0000 7fb6ce7e9740 1 -- 172.21.15.50:0/3867542280 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a800dbb0 con 0x557310e9bb70 2024-06-06T03:34:50.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.197+0000 7fb6c9795640 1 -- 172.21.15.50:0/3867542280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557310e9bb70 msgr2=0x557310e9b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:50.198 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.197+0000 7fb6c9795640 1 --2- 172.21.15.50:0/3867542280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557310e9bb70 0x557310e9b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.198 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.197+0000 7fb6c9795640 1 -- 172.21.15.50:0/3867542280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557310e96a00 msgr2=0x557310ea79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:50.198 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.197+0000 7fb6c9795640 1 --2- 172.21.15.50:0/3867542280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557310e96a00 0x557310ea79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.198 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.197+0000 7fb6c9795640 1 -- 172.21.15.50:0/3867542280 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557310e963f0 con 0x557310e96010 2024-06-06T03:34:50.199 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.198+0000 7fb6c9795640 1 --2- 172.21.15.50:0/3867542280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557310e96010 0x557310e8c840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb6b400b4b0 tx=0x7fb6b4011ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9703e556a57e3699 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:50.199 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.198+0000 7fb6aeffd640 1 -- 172.21.15.50:0/3867542280 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4028070 con 0x557310e96010 2024-06-06T03:34:50.199 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.198+0000 7fb6aeffd640 1 -- 172.21.15.50:0/3867542280 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb6b4009e80 con 0x557310e96010 2024-06-06T03:34:50.199 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.199+0000 7fb6aeffd640 1 -- 172.21.15.50:0/3867542280 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4015040 con 0x557310e96010 2024-06-06T03:34:50.201 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.200+0000 7fb6ce7e9740 1 -- 172.21.15.50:0/3867542280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557310e96010 msgr2=0x557310e8c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:50.201 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.200+0000 7fb6ce7e9740 1 --2- 172.21.15.50:0/3867542280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557310e96010 0x557310e8c840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb6b400b4b0 tx=0x7fb6b4011ca0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.201 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.200+0000 7fb6ce7e9740 1 -- 172.21.15.50:0/3867542280 shutdown_connections 2024-06-06T03:34:50.201 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.200+0000 7fb6ce7e9740 1 --2- 172.21.15.50:0/3867542280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557310e96a00 0x557310ea79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.201 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.200+0000 7fb6ce7e9740 1 --2- 172.21.15.50:0/3867542280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557310e9bb70 0x557310e9b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.202 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.201+0000 7fb6ce7e9740 1 --2- 172.21.15.50:0/3867542280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557310e96010 0x557310e8c840 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.202 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.201+0000 7fb6ce7e9740 1 -- 172.21.15.50:0/3867542280 >> 172.21.15.50:0/3867542280 conn(0x557310e91680 msgr2=0x557310e91a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:50.203 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.202+0000 7fb6ce7e9740 1 -- 172.21.15.50:0/3867542280 shutdown_connections 2024-06-06T03:34:50.203 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.202+0000 7fb6ce7e9740 1 -- 172.21.15.50:0/3867542280 wait complete. 2024-06-06T03:34:50.203 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.203+0000 7fb6ce7e9740 1 -- start start 2024-06-06T03:34:50.203 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.203+0000 7fb6ce7e9740 1 Processor -- start 2024-06-06T03:34:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.204+0000 7fb6ce7e9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557310e96010 0x557310ea3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.204+0000 7fb6ce7e9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557310e96a00 0x557310ea4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.204+0000 7fb6ce7e9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557310e9bb70 0x557310ea7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.204+0000 7fb6ce7e9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a800e170 con 0x557310e96a00 2024-06-06T03:34:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.204+0000 7fb6ce7e9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a800f5e0 con 0x557310e96010 2024-06-06T03:34:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.204+0000 7fb6ce7e9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a800e840 con 0x557310e9bb70 2024-06-06T03:34:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.204+0000 7fb6c9795640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557310e96010 0x557310ea3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.204+0000 7fb6c9795640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557310e96010 0x557310ea3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:39148/0 (socket says 172.21.15.50:39148) 2024-06-06T03:34:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.204+0000 7fb6c9795640 1 -- 172.21.15.50:0/677525615 learned_addr learned my addr 172.21.15.50:0/677525615 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.204+0000 7fb6ce7e9740 10 client.0 _ll_register_callbacks cb 0x7fb6bc019a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:34:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.205+0000 7fb6c8f94640 1 --2- 172.21.15.50:0/677525615 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557310e96a00 0x557310ea4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.205+0000 7fb6c9f96640 1 --2- 172.21.15.50:0/677525615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557310e9bb70 0x557310ea7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.205+0000 7fb6c9795640 1 -- 172.21.15.50:0/677525615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557310e9bb70 msgr2=0x557310ea7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.205+0000 7fb6c9795640 1 --2- 172.21.15.50:0/677525615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557310e9bb70 0x557310ea7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.205+0000 7fb6c9795640 1 -- 172.21.15.50:0/677525615 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557310e96a00 msgr2=0x557310ea4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.205+0000 7fb6c9795640 1 --2- 172.21.15.50:0/677525615 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557310e96a00 0x557310ea4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.205+0000 7fb6c9795640 1 -- 172.21.15.50:0/677525615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557310ea7660 con 0x557310e96010 2024-06-06T03:34:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.205+0000 7fb6c9f96640 1 --2- 172.21.15.50:0/677525615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557310e9bb70 0x557310ea7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:34:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.208+0000 7fb6c9795640 1 --2- 172.21.15.50:0/677525615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557310e96010 0x557310ea3bd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4006a70 tx=0x7fb6b4006aa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=980b733fcf4b7801 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.208+0000 7fb6acff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:34:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.209+0000 7fb6acff9640 1 -- 172.21.15.50:0/677525615 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4031060 con 0x557310e96010 2024-06-06T03:34:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.209+0000 7fb6acff9640 1 -- 172.21.15.50:0/677525615 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fb6b40118d0 con 0x557310e96010 2024-06-06T03:34:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.209+0000 7fb6ce7e9740 1 -- 172.21.15.50:0/677525615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557310e06c20 con 0x557310e96010 2024-06-06T03:34:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.209+0000 7fb6acff9640 1 -- 172.21.15.50:0/677525615 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb6b4028040 con 0x557310e96010 2024-06-06T03:34:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.210+0000 7fb6ce7e9740 10 client.26168 fetch_fsmap learned FSMap version 33 2024-06-06T03:34:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.210+0000 7fb6ce7e9740 1 -- 172.21.15.50:0/677525615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x557310f15ea0 con 0x557310e96010 2024-06-06T03:34:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.210+0000 7fb6acff9640 1 -- 172.21.15.50:0/677525615 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb6b4004030 con 0x557310e96010 2024-06-06T03:34:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.210+0000 7fb6acff9640 1 -- 172.21.15.50:0/677525615 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fb6b4010a90 con 0x557310e96010 2024-06-06T03:34:50.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.214+0000 7fb6ce7e9740 10 client.26168 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:34:50.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.214+0000 7fb6ce7e9740 10 client.26168 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:34:50.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.214+0000 7fb6ce7e9740 20 client.26168 populate_metadata read hostname 'smithi050' 2024-06-06T03:34:50.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.214+0000 7fb6ce7e9740 1 --2- 172.21.15.50:0/677525615 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x557310f164b0 0x557310f188d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:50.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.214+0000 7fb6ce7e9740 4 client.26168 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:34:50.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.214+0000 7fb6ce7e9740 1 -- 172.21.15.50:0/677525615 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557310e06c20 con 0x557310f164b0 2024-06-06T03:34:50.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.215+0000 7fb6c8f94640 1 --2- 172.21.15.50:0/677525615 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x557310f164b0 0x557310f188d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:50.216 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.216+0000 7fb6c8f94640 1 --2- 172.21.15.50:0/677525615 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x557310f164b0 0x557310f188d0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=708aa5547aafc39c server_cookie=8a21b0262ae2b637 in_seq=0 out_seq=0 2024-06-06T03:34:50.216 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.216+0000 7fb6acff9640 10 client.26168 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:50.237 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.237+0000 7fb6acff9640 1 -- 172.21.15.50:0/677525615 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x557310e06c20 con 0x557310f164b0 2024-06-06T03:34:50.237 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.237+0000 7fb6acff9640 10 client.26168 handle_command_reply: tid=0 2024-06-06T03:34:50.237 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.238+0000 7fb6ce7e9740 1 client.26168 shutdown 2024-06-06T03:34:50.242 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.242+0000 7fb6ce7e9740 1 -- 172.21.15.50:0/677525615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557310e96010 msgr2=0x557310ea3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:50.242 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.242+0000 7fb6ce7e9740 1 --2- 172.21.15.50:0/677525615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557310e96010 0x557310ea3bd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4006a70 tx=0x7fb6b4006aa0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.243 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.242+0000 7fb6ce7e9740 1 -- 172.21.15.50:0/677525615 shutdown_connections 2024-06-06T03:34:50.243 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.242+0000 7fb6ce7e9740 1 --2- 172.21.15.50:0/677525615 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x557310f164b0 0x557310f188d0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.243 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.242+0000 7fb6acff9640 0 client.26168 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:50.243 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.242+0000 7fb6ce7e9740 1 --2- 172.21.15.50:0/677525615 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557310e96a00 0x557310ea4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.243 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.242+0000 7fb6ce7e9740 1 --2- 172.21.15.50:0/677525615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557310e9bb70 0x557310ea7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.243 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.242+0000 7fb6ce7e9740 1 --2- 172.21.15.50:0/677525615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557310e96010 0x557310ea3bd0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.243 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.242+0000 7fb6ce7e9740 1 -- 172.21.15.50:0/677525615 >> 172.21.15.50:0/677525615 conn(0x557310e91680 msgr2=0x557310e91a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:50.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.243+0000 7fb6ce7e9740 1 -- 172.21.15.50:0/677525615 shutdown_connections 2024-06-06T03:34:50.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.243+0000 7fb6ce7e9740 1 -- 172.21.15.50:0/677525615 wait complete. 2024-06-06T03:34:50.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.243+0000 7fb6ce7e9740 20 client.26168 trim_cache size 0 max 16384 2024-06-06T03:34:50.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:34:50.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:34:50.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:34:50.248 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.246+0000 7fb6cb9f9640 1 -- 172.21.15.50:0/572816720 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb6b00a2d80 msgr2=0x7fb6b00a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:50.248 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.246+0000 7fb6cb9f9640 1 --2- 172.21.15.50:0/572816720 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb6b00a2d80 0x7fb6b00a5240 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x557310e96e00 tx=0x7fb6bc0095c0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.248 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.246+0000 7fb6cb9f9640 1 -- 172.21.15.50:0/572816720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6c4101370 msgr2=0x7fb6c4110c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:50.248 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.246+0000 7fb6cb9f9640 1 --2- 172.21.15.50:0/572816720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6c4101370 0x7fb6c4110c20 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fb6c002a970 tx=0x7fb6c0032d40 comp rx=0 tx=0).stop 2024-06-06T03:34:50.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.249+0000 7fb6cb9f9640 1 -- 172.21.15.50:0/572816720 shutdown_connections 2024-06-06T03:34:50.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.249+0000 7fb6cb9f9640 1 --2- 172.21.15.50:0/572816720 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb6b00a2d80 0x7fb6b00a5240 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.249+0000 7fb6cb9f9640 1 --2- 172.21.15.50:0/572816720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6c4101370 0x7fb6c4110c20 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.249+0000 7fb6cb9f9640 1 --2- 172.21.15.50:0/572816720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6c41009d0 0x7fb6c410fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.249+0000 7fb6cb9f9640 1 --2- 172.21.15.50:0/572816720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6c40ff8a0 0x7fb6c410f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:50.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.249+0000 7fb6cb9f9640 1 -- 172.21.15.50:0/572816720 >> 172.21.15.50:0/572816720 conn(0x7fb6c40fb1c0 msgr2=0x7fb6c4103cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:50.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.250+0000 7fb6cb9f9640 1 -- 172.21.15.50:0/572816720 shutdown_connections 2024-06-06T03:34:50.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:34:50.250+0000 7fb6cb9f9640 1 -- 172.21.15.50:0/572816720 wait complete. 2024-06-06T03:34:51.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:51 smithi079 ceph-mon[35478]: pgmap v677: 129 pgs: 129 active+clean; 10 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 40 MiB/s wr, 816 op/s 2024-06-06T03:34:51.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:51 smithi122 ceph-mon[35759]: pgmap v677: 129 pgs: 129 active+clean; 10 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 40 MiB/s wr, 816 op/s 2024-06-06T03:34:51.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:51 smithi050 ceph-mon[32421]: pgmap v677: 129 pgs: 129 active+clean; 10 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 40 MiB/s wr, 816 op/s 2024-06-06T03:34:53.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:53 smithi079 ceph-mon[35478]: pgmap v678: 129 pgs: 129 active+clean; 10 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 31 MiB/s wr, 634 op/s 2024-06-06T03:34:53.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:53 smithi122 ceph-mon[35759]: pgmap v678: 129 pgs: 129 active+clean; 10 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 31 MiB/s wr, 634 op/s 2024-06-06T03:34:53.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:53 smithi050 ceph-mon[32421]: pgmap v678: 129 pgs: 129 active+clean; 10 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 31 MiB/s wr, 634 op/s 2024-06-06T03:34:54.088 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-06T03:34:54.775 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:34:55.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:55 smithi079 ceph-mon[35478]: pgmap v679: 129 pgs: 129 active+clean; 10 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 34 MiB/s wr, 681 op/s 2024-06-06T03:34:55.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:55 smithi122 ceph-mon[35759]: pgmap v679: 129 pgs: 129 active+clean; 10 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 34 MiB/s wr, 681 op/s 2024-06-06T03:34:55.755 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:55 smithi050 ceph-mon[32421]: pgmap v679: 129 pgs: 129 active+clean; 10 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 34 MiB/s wr, 681 op/s 2024-06-06T03:34:56.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.898+0000 7f5c9f59e700 1 -- 172.21.15.50:0/3801069103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c980b7af0 msgr2=0x7f5c980b9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:56.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.898+0000 7f5c9f59e700 1 --2- 172.21.15.50:0/3801069103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c980b7af0 0x7f5c980b9ee0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0068f20 tx=0x7f5ca00512d0 comp rx=0 tx=0).stop 2024-06-06T03:34:56.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.898+0000 7f5c9f59e700 1 -- 172.21.15.50:0/3801069103 shutdown_connections 2024-06-06T03:34:56.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.898+0000 7f5c9f59e700 1 --2- 172.21.15.50:0/3801069103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c980b7af0 0x7f5c980b9ee0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:56.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.898+0000 7f5c9f59e700 1 --2- 172.21.15.50:0/3801069103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c980a4dd0 0x7f5c980a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:56.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.898+0000 7f5c9f59e700 1 --2- 172.21.15.50:0/3801069103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c980a56f0 0x7f5c980b75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:56.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.898+0000 7f5c9f59e700 1 -- 172.21.15.50:0/3801069103 >> 172.21.15.50:0/3801069103 conn(0x7f5c9801a690 msgr2=0x7f5c9801aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:56.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.901+0000 7f5c9f59e700 1 -- 172.21.15.50:0/3801069103 shutdown_connections 2024-06-06T03:34:56.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.902+0000 7f5c9f59e700 1 -- 172.21.15.50:0/3801069103 wait complete. 2024-06-06T03:34:56.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.903+0000 7f5c9f59e700 1 Processor -- start 2024-06-06T03:34:56.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.903+0000 7f5c9f59e700 1 -- start start 2024-06-06T03:34:56.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.903+0000 7f5c9f59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c980a4dd0 0x7f5c980b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:56.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.903+0000 7f5c9f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c980a56f0 0x7f5c980b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:56.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.903+0000 7f5c9f59e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c98144b00 0x7f5c98146ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:56.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.903+0000 7f5c9f59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5c980af4e0 con 0x7f5c980a56f0 2024-06-06T03:34:56.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.903+0000 7f5c9f59e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5c980af360 con 0x7f5c980a4dd0 2024-06-06T03:34:56.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.903+0000 7f5c9f59e700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5c980af660 con 0x7f5c98144b00 2024-06-06T03:34:56.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.904+0000 7f5c9e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c980a4dd0 0x7f5c980b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:56.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.904+0000 7f5c9e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c980a4dd0 0x7f5c980b58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:39166/0 (socket says 172.21.15.50:39166) 2024-06-06T03:34:56.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.904+0000 7f5c9e59c700 1 -- 172.21.15.50:0/2508724301 learned_addr learned my addr 172.21.15.50:0/2508724301 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:56.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.904+0000 7f5c9dd9b700 1 --2- 172.21.15.50:0/2508724301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c980a56f0 0x7f5c980b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:56.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.904+0000 7f5c9ed9d700 1 --2- 172.21.15.50:0/2508724301 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c98144b00 0x7f5c98146ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:56.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.905+0000 7f5c9dd9b700 1 -- 172.21.15.50:0/2508724301 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c98144b00 msgr2=0x7f5c98146ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:56.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.905+0000 7f5c9dd9b700 1 --2- 172.21.15.50:0/2508724301 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c98144b00 0x7f5c98146ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:56.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.905+0000 7f5c9dd9b700 1 -- 172.21.15.50:0/2508724301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c980a4dd0 msgr2=0x7f5c980b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:56.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.905+0000 7f5c9dd9b700 1 --2- 172.21.15.50:0/2508724301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c980a4dd0 0x7f5c980b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:56.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.905+0000 7f5c9dd9b700 1 -- 172.21.15.50:0/2508724301 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c98147620 con 0x7f5c980a56f0 2024-06-06T03:34:56.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.905+0000 7f5c9dd9b700 1 --2- 172.21.15.50:0/2508724301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c980a56f0 0x7f5c980b5e00 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f5c9401fa40 tx=0x7f5c9401fd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:56.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.906+0000 7f5c8f7fe700 1 -- 172.21.15.50:0/2508724301 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9401d9e0 con 0x7f5c980a56f0 2024-06-06T03:34:56.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.906+0000 7f5c9f59e700 1 -- 172.21.15.50:0/2508724301 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c98147910 con 0x7f5c980a56f0 2024-06-06T03:34:56.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.906+0000 7f5c9f59e700 1 -- 172.21.15.50:0/2508724301 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c98147e20 con 0x7f5c980a56f0 2024-06-06T03:34:56.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.911+0000 7f5caf39cb80 1 Processor -- start 2024-06-06T03:34:56.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.911+0000 7f5caf39cb80 1 -- start start 2024-06-06T03:34:56.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.912+0000 7f5caf39cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ab480b0a0 0x562ab480b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:56.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.912+0000 7f5caf39cb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ab480b9c0 0x562ab48064b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:56.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.912+0000 7f5c9ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ab480b0a0 0x562ab480b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:56.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.912+0000 7f5c9ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ab480b0a0 0x562ab480b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:39174/0 (socket says 172.21.15.50:39174) 2024-06-06T03:34:56.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.912+0000 7f5c9ed9d700 1 -- 172.21.15.50:0/3401109618 learned_addr learned my addr 172.21.15.50:0/3401109618 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:56.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.912+0000 7f5caf39cb80 1 --2- 172.21.15.50:0/3401109618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ab48069f0 0x562ab4806e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:56.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.912+0000 7f5caf39cb80 1 -- 172.21.15.50:0/3401109618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562ab46f8f60 con 0x562ab480b9c0 2024-06-06T03:34:56.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.912+0000 7f5caf39cb80 1 -- 172.21.15.50:0/3401109618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562ab4757850 con 0x562ab480b0a0 2024-06-06T03:34:56.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.912+0000 7f5caf39cb80 1 -- 172.21.15.50:0/3401109618 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562ab46bf460 con 0x562ab48069f0 2024-06-06T03:34:56.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.912+0000 7f5c9dd9b700 1 --2- 172.21.15.50:0/3401109618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ab48069f0 0x562ab4806e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:56.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.912+0000 7f5c8f7fe700 1 -- 172.21.15.50:0/2508724301 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5c9401db80 con 0x7f5c980a56f0 2024-06-06T03:34:56.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.912+0000 7f5c8f7fe700 1 -- 172.21.15.50:0/2508724301 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c94029420 con 0x7f5c980a56f0 2024-06-06T03:34:56.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.913+0000 7f5c9ed9d700 1 -- 172.21.15.50:0/3401109618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ab48069f0 msgr2=0x562ab4806e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:56.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.913+0000 7f5c9ed9d700 1 --2- 172.21.15.50:0/3401109618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ab48069f0 0x562ab4806e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:56.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.913+0000 7f5c9ed9d700 1 -- 172.21.15.50:0/3401109618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ab480b9c0 msgr2=0x562ab48064b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:56.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.913+0000 7f5c9ed9d700 1 --2- 172.21.15.50:0/3401109618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ab480b9c0 0x562ab48064b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:56.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.913+0000 7f5c9ed9d700 1 -- 172.21.15.50:0/3401109618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ab46a68d0 con 0x562ab480b0a0 2024-06-06T03:34:56.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.913+0000 7f5c9ed9d700 1 --2- 172.21.15.50:0/3401109618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ab480b0a0 0x562ab480b480 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0067f80 tx=0x7f5ca0068610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6db21446d5dbea4a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:56.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.914+0000 7f5c8cff9700 1 -- 172.21.15.50:0/3401109618 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca006b070 con 0x562ab480b0a0 2024-06-06T03:34:56.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.914+0000 7f5c8cff9700 1 -- 172.21.15.50:0/3401109618 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5ca006b210 con 0x562ab480b0a0 2024-06-06T03:34:56.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.915+0000 7f5caf39cb80 1 -- 172.21.15.50:0/3401109618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ab480b0a0 msgr2=0x562ab480b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:56.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.915+0000 7f5caf39cb80 1 --2- 172.21.15.50:0/3401109618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ab480b0a0 0x562ab480b480 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0067f80 tx=0x7f5ca0068610 comp rx=0 tx=0).stop 2024-06-06T03:34:56.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.917+0000 7f5c8f7fe700 1 -- 172.21.15.50:0/2508724301 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5c940299f0 con 0x7f5c980a56f0 2024-06-06T03:34:56.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.917+0000 7f5caf39cb80 1 -- 172.21.15.50:0/3401109618 shutdown_connections 2024-06-06T03:34:56.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.917+0000 7f5caf39cb80 1 --2- 172.21.15.50:0/3401109618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ab48069f0 0x562ab4806e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:56.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.917+0000 7f5caf39cb80 1 --2- 172.21.15.50:0/3401109618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ab480b0a0 0x562ab480b480 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:56.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.917+0000 7f5caf39cb80 1 --2- 172.21.15.50:0/3401109618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ab480b9c0 0x562ab48064b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:56.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.917+0000 7f5caf39cb80 1 -- 172.21.15.50:0/3401109618 >> 172.21.15.50:0/3401109618 conn(0x562ab4733080 msgr2=0x562ab4801390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:56.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.918+0000 7f5c8f7fe700 1 --2- 172.21.15.50:0/2508724301 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f5c880a2e30 0x7f5c880a52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:56.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.918+0000 7f5c8f7fe700 1 -- 172.21.15.50:0/2508724301 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f5c940cfa50 con 0x7f5c980a56f0 2024-06-06T03:34:56.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.918+0000 7f5c9e59c700 1 --2- 172.21.15.50:0/2508724301 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f5c880a2e30 0x7f5c880a52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:56.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.919+0000 7f5c9e59c700 1 --2- 172.21.15.50:0/2508724301 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f5c880a2e30 0x7f5c880a52f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5c900048a0 tx=0x7f5c90009400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:56.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.923+0000 7f5caf39cb80 1 -- 172.21.15.50:0/3401109618 shutdown_connections 2024-06-06T03:34:56.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.923+0000 7f5caf39cb80 1 -- 172.21.15.50:0/3401109618 wait complete. 2024-06-06T03:34:56.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.923+0000 7f5caf39cb80 1 -- start start 2024-06-06T03:34:56.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.923+0000 7f5caf39cb80 1 Processor -- start 2024-06-06T03:34:56.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.924+0000 7f5caf39cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ab48069f0 0x562ab4812920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:56.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.924+0000 7f5caf39cb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ab480b0a0 0x562ab480fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:56.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.924+0000 7f5caf39cb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ab480b9c0 0x562ab4810160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:56.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.924+0000 7f5caf39cb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562ab46f7fc0 con 0x562ab480b9c0 2024-06-06T03:34:56.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.924+0000 7f5caf39cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562ab4753810 con 0x562ab48069f0 2024-06-06T03:34:56.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.924+0000 7f5caf39cb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562ab4813440 con 0x562ab480b0a0 2024-06-06T03:34:56.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.925+0000 7f5caf39cb80 10 client.0 _ll_register_callbacks cb 0x562ab46ed5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:34:56.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.925+0000 7f5c9e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ab48069f0 0x562ab4812920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:56.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.925+0000 7f5c9e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ab48069f0 0x562ab4812920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:39176/0 (socket says 172.21.15.50:39176) 2024-06-06T03:34:56.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.925+0000 7f5c9e59c700 1 -- 172.21.15.50:0/1374027103 learned_addr learned my addr 172.21.15.50:0/1374027103 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:56.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.925+0000 7f5c9dd9b700 1 --2- 172.21.15.50:0/1374027103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ab480b0a0 0x562ab480fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:56.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.927+0000 7f5c9ed9d700 1 --2- 172.21.15.50:0/1374027103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ab480b9c0 0x562ab4810160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:56.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.928+0000 7f5c9e59c700 1 -- 172.21.15.50:0/1374027103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ab480b0a0 msgr2=0x562ab480fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:56.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.928+0000 7f5c9e59c700 1 --2- 172.21.15.50:0/1374027103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ab480b0a0 0x562ab480fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:56.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.928+0000 7f5c9e59c700 1 -- 172.21.15.50:0/1374027103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ab480b9c0 msgr2=0x562ab4810160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:56.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.928+0000 7f5c9e59c700 1 --2- 172.21.15.50:0/1374027103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ab480b9c0 0x562ab4810160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:56.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.928+0000 7f5c9e59c700 1 -- 172.21.15.50:0/1374027103 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ab471d750 con 0x562ab48069f0 2024-06-06T03:34:56.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.932+0000 7f5c9e59c700 1 --2- 172.21.15.50:0/1374027103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ab48069f0 0x562ab4812920 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5c90006f60 tx=0x7f5c90004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b913f142b43bd167 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:56.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.935+0000 7f5c85ffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:34:56.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.938+0000 7f5c85ffb700 1 -- 172.21.15.50:0/1374027103 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c90023020 con 0x562ab48069f0 2024-06-06T03:34:56.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.938+0000 7f5c85ffb700 1 -- 172.21.15.50:0/1374027103 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f5c9000ee40 con 0x562ab48069f0 2024-06-06T03:34:56.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.938+0000 7f5caf39cb80 1 -- 172.21.15.50:0/1374027103 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ca006b210 con 0x562ab48069f0 2024-06-06T03:34:56.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.947+0000 7f5c85ffb700 1 -- 172.21.15.50:0/1374027103 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f5c9001b040 con 0x562ab48069f0 2024-06-06T03:34:56.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.951+0000 7f5caf39cb80 10 client.26180 fetch_fsmap learned FSMap version 33 2024-06-06T03:34:56.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.951+0000 7f5caf39cb80 1 -- 172.21.15.50:0/1374027103 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562ab481de00 con 0x562ab48069f0 2024-06-06T03:34:56.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.957+0000 7f5c85ffb700 1 -- 172.21.15.50:0/1374027103 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5ca006b210 con 0x562ab48069f0 2024-06-06T03:34:56.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.959+0000 7f5c85ffb700 1 -- 172.21.15.50:0/1374027103 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f5c9001e030 con 0x562ab48069f0 2024-06-06T03:34:56.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.959+0000 7f5caf39cb80 10 client.26180 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:34:56.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.959+0000 7f5caf39cb80 10 client.26180 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:34:56.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.959+0000 7f5caf39cb80 20 client.26180 populate_metadata read hostname 'smithi050' 2024-06-06T03:34:56.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.959+0000 7f5caf39cb80 1 --2- 172.21.15.50:0/1374027103 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562ab48202d0 0x562ab48226c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:56.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.959+0000 7f5caf39cb80 4 client.26180 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:34:56.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.959+0000 7f5caf39cb80 1 -- 172.21.15.50:0/1374027103 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ab4764d50 con 0x562ab48202d0 2024-06-06T03:34:56.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.965+0000 7f5c9dd9b700 1 --2- 172.21.15.50:0/1374027103 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562ab48202d0 0x562ab48226c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:56.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.968+0000 7f5c9dd9b700 1 --2- 172.21.15.50:0/1374027103 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562ab48202d0 0x562ab48226c0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ccc7e40f7b92793 server_cookie=5ef42ffbe7253ad7 in_seq=0 out_seq=0 2024-06-06T03:34:56.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.968+0000 7f5c85ffb700 10 client.26180 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:56.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.969+0000 7f5c85ffb700 1 -- 172.21.15.50:0/1374027103 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x562ab4764d50 con 0x562ab48202d0 2024-06-06T03:34:56.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.969+0000 7f5c85ffb700 10 client.26180 handle_command_reply: tid=0 2024-06-06T03:34:56.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.969+0000 7f5caf39cb80 1 client.26180 shutdown 2024-06-06T03:34:56.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.970+0000 7f5caf39cb80 1 -- 172.21.15.50:0/1374027103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ab48069f0 msgr2=0x562ab4812920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:56.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.970+0000 7f5caf39cb80 1 --2- 172.21.15.50:0/1374027103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ab48069f0 0x562ab4812920 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5c90006f60 tx=0x7f5c90004750 comp rx=0 tx=0).stop 2024-06-06T03:34:56.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.971+0000 7f5caf39cb80 1 -- 172.21.15.50:0/1374027103 shutdown_connections 2024-06-06T03:34:56.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.971+0000 7f5caf39cb80 1 --2- 172.21.15.50:0/1374027103 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562ab48202d0 0x562ab48226c0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:56.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.971+0000 7f5caf39cb80 1 --2- 172.21.15.50:0/1374027103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ab480b9c0 0x562ab4810160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:56.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.971+0000 7f5caf39cb80 1 --2- 172.21.15.50:0/1374027103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ab48069f0 0x562ab4812920 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:56.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.971+0000 7f5caf39cb80 1 --2- 172.21.15.50:0/1374027103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ab480b0a0 0x562ab480fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:56.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.971+0000 7f5caf39cb80 1 -- 172.21.15.50:0/1374027103 >> 172.21.15.50:0/1374027103 conn(0x562ab4733080 msgr2=0x562ab4800950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:56.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.971+0000 7f5c85ffb700 0 client.26180 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:56.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.972+0000 7f5caf39cb80 1 -- 172.21.15.50:0/1374027103 shutdown_connections 2024-06-06T03:34:56.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.975+0000 7f5caf39cb80 1 -- 172.21.15.50:0/1374027103 wait complete. 2024-06-06T03:34:56.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:56.975+0000 7f5caf39cb80 20 client.26180 trim_cache size 0 max 16384 2024-06-06T03:34:57.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.019+0000 7f5caf39cb80 1 Processor -- start 2024-06-06T03:34:57.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.020+0000 7f5caf39cb80 1 -- start start 2024-06-06T03:34:57.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.021+0000 7f5caf39cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ab48069f0 0x562ab4811b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:57.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.021+0000 7f5caf39cb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ab480b0a0 0x562ab48010d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:57.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.021+0000 7f5caf39cb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ab480b9c0 0x562ab4827f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:57.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.021+0000 7f5caf39cb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5c98153120 con 0x562ab480b0a0 2024-06-06T03:34:57.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.021+0000 7f5caf39cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5c981509b0 con 0x562ab48069f0 2024-06-06T03:34:57.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.021+0000 7f5caf39cb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5c9814e8b0 con 0x562ab480b9c0 2024-06-06T03:34:57.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.021+0000 7f5c9e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ab48069f0 0x562ab4811b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:57.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.021+0000 7f5c9e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ab48069f0 0x562ab4811b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:39186/0 (socket says 172.21.15.50:39186) 2024-06-06T03:34:57.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.021+0000 7f5c9e59c700 1 -- 172.21.15.50:0/2290452825 learned_addr learned my addr 172.21.15.50:0/2290452825 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:57.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.022+0000 7f5c9ed9d700 1 --2- 172.21.15.50:0/2290452825 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ab480b9c0 0x562ab4827f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:57.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.023+0000 7f5c9e59c700 1 -- 172.21.15.50:0/2290452825 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ab480b9c0 msgr2=0x562ab4827f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:57.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.023+0000 7f5c9e59c700 1 --2- 172.21.15.50:0/2290452825 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ab480b9c0 0x562ab4827f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:57.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.023+0000 7f5c9e59c700 1 -- 172.21.15.50:0/2290452825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ab480b0a0 msgr2=0x562ab48010d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:34:57.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.023+0000 7f5c9e59c700 1 --2- 172.21.15.50:0/2290452825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ab480b0a0 0x562ab48010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:57.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.023+0000 7f5c9e59c700 1 -- 172.21.15.50:0/2290452825 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ab480b690 con 0x562ab48069f0 2024-06-06T03:34:57.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.023+0000 7f5c9e59c700 1 --2- 172.21.15.50:0/2290452825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ab48069f0 0x562ab4811b60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5c9002a040 tx=0x7f5c90009950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=816c75aae9929315 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:57.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.024+0000 7f5c87fff700 1 -- 172.21.15.50:0/2290452825 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c90023070 con 0x562ab48069f0 2024-06-06T03:34:57.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.024+0000 7f5c87fff700 1 -- 172.21.15.50:0/2290452825 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5c90037070 con 0x562ab48069f0 2024-06-06T03:34:57.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.025+0000 7f5caf39cb80 1 -- 172.21.15.50:0/2290452825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ab48069f0 msgr2=0x562ab4811b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:57.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.025+0000 7f5caf39cb80 1 --2- 172.21.15.50:0/2290452825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ab48069f0 0x562ab4811b60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5c9002a040 tx=0x7f5c90009950 comp rx=0 tx=0).stop 2024-06-06T03:34:57.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.027+0000 7f5caf39cb80 1 -- 172.21.15.50:0/2290452825 shutdown_connections 2024-06-06T03:34:57.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.027+0000 7f5caf39cb80 1 --2- 172.21.15.50:0/2290452825 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ab480b9c0 0x562ab4827f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:57.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.027+0000 7f5caf39cb80 1 --2- 172.21.15.50:0/2290452825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ab48069f0 0x562ab4811b60 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:57.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.027+0000 7f5caf39cb80 1 --2- 172.21.15.50:0/2290452825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ab480b0a0 0x562ab48010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:57.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.027+0000 7f5caf39cb80 1 -- 172.21.15.50:0/2290452825 >> 172.21.15.50:0/2290452825 conn(0x562ab4733080 msgr2=0x562ab4811450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:57.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.028+0000 7f5caf39cb80 1 -- 172.21.15.50:0/2290452825 shutdown_connections 2024-06-06T03:34:57.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.028+0000 7f5caf39cb80 1 -- 172.21.15.50:0/2290452825 wait complete. 2024-06-06T03:34:57.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.029+0000 7f5caf39cb80 1 -- start start 2024-06-06T03:34:57.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.029+0000 7f5caf39cb80 1 Processor -- start 2024-06-06T03:34:57.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.029+0000 7f5caf39cb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ab48069f0 0x562ab48190c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:57.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.029+0000 7f5caf39cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ab480b0a0 0x562ab4816500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:57.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.029+0000 7f5caf39cb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ab480b9c0 0x562ab4816b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:57.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.029+0000 7f5caf39cb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5c9814ee70 con 0x562ab48069f0 2024-06-06T03:34:57.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.029+0000 7f5caf39cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5c981502e0 con 0x562ab480b0a0 2024-06-06T03:34:57.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.029+0000 7f5caf39cb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5c9814f540 con 0x562ab480b9c0 2024-06-06T03:34:57.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.029+0000 7f5caf39cb80 10 client.0 _ll_register_callbacks cb 0x562ab46ed5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:34:57.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.030+0000 7f5c9e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ab48069f0 0x562ab48190c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:57.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.030+0000 7f5c9e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ab48069f0 0x562ab48190c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50828/0 (socket says 172.21.15.50:50828) 2024-06-06T03:34:57.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.030+0000 7f5c9e59c700 1 -- 172.21.15.50:0/3210467687 learned_addr learned my addr 172.21.15.50:0/3210467687 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:34:57.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.031+0000 7f5c9e59c700 1 -- 172.21.15.50:0/3210467687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ab480b9c0 msgr2=0x562ab4816b30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:34:57.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.031+0000 7f5c9e59c700 1 --2- 172.21.15.50:0/3210467687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ab480b9c0 0x562ab4816b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:57.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.031+0000 7f5c9e59c700 1 -- 172.21.15.50:0/3210467687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ab480b0a0 msgr2=0x562ab4816500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:34:57.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.031+0000 7f5c9e59c700 1 --2- 172.21.15.50:0/3210467687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ab480b0a0 0x562ab4816500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:57.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.031+0000 7f5c9e59c700 1 -- 172.21.15.50:0/3210467687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ab4889f70 con 0x562ab48069f0 2024-06-06T03:34:57.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.032+0000 7f5c9e59c700 1 --2- 172.21.15.50:0/3210467687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ab48069f0 0x562ab48190c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f5c9001f4e0 tx=0x7f5c90013bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4255d9e91bab31 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:34:57.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.032+0000 7f5c85ffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:34:57.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.033+0000 7f5c85ffb700 1 -- 172.21.15.50:0/3210467687 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c90023040 con 0x562ab48069f0 2024-06-06T03:34:57.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.033+0000 7f5caf39cb80 1 -- 172.21.15.50:0/3210467687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c90037070 con 0x562ab48069f0 2024-06-06T03:34:57.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.033+0000 7f5c85ffb700 1 -- 172.21.15.50:0/3210467687 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f5c90015bf0 con 0x562ab48069f0 2024-06-06T03:34:57.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.042+0000 7f5c85ffb700 1 -- 172.21.15.50:0/3210467687 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f5c90027e60 con 0x562ab48069f0 2024-06-06T03:34:57.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.044+0000 7f5caf39cb80 10 client.16527 fetch_fsmap learned FSMap version 33 2024-06-06T03:34:57.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.044+0000 7f5caf39cb80 1 -- 172.21.15.50:0/3210467687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562ab48ad0f0 con 0x562ab48069f0 2024-06-06T03:34:57.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.051+0000 7f5c85ffb700 1 -- 172.21.15.50:0/3210467687 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5c90037070 con 0x562ab48069f0 2024-06-06T03:34:57.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.052+0000 7f5c85ffb700 1 -- 172.21.15.50:0/3210467687 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f5c9001e040 con 0x562ab48069f0 2024-06-06T03:34:57.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.053+0000 7f5caf39cb80 10 client.16527 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:34:57.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.053+0000 7f5caf39cb80 10 client.16527 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:34:57.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.053+0000 7f5caf39cb80 20 client.16527 populate_metadata read hostname 'smithi050' 2024-06-06T03:34:57.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.053+0000 7f5caf39cb80 1 --2- 172.21.15.50:0/3210467687 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562ab48ad6e0 0x562ab48afb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:34:57.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.053+0000 7f5caf39cb80 4 client.16527 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-06T03:34:57.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.053+0000 7f5caf39cb80 1 -- 172.21.15.50:0/3210467687 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562ab475f2d0 con 0x562ab48ad6e0 2024-06-06T03:34:57.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.056+0000 7f5c9dd9b700 1 --2- 172.21.15.50:0/3210467687 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562ab48ad6e0 0x562ab48afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:34:57.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.056+0000 7f5c9dd9b700 1 --2- 172.21.15.50:0/3210467687 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562ab48ad6e0 0x562ab48afb00 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f65db16528e006b0 server_cookie=238cbba1cab288f2 in_seq=0 out_seq=0 2024-06-06T03:34:57.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.056+0000 7f5c85ffb700 10 client.16527 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:57.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.056+0000 7f5c85ffb700 1 -- 172.21.15.50:0/3210467687 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562ab475f2d0 con 0x562ab48ad6e0 2024-06-06T03:34:57.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.056+0000 7f5c85ffb700 10 client.16527 handle_command_reply: tid=0 2024-06-06T03:34:57.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.057+0000 7f5caf39cb80 1 client.16527 shutdown 2024-06-06T03:34:57.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.062+0000 7f5caf39cb80 1 -- 172.21.15.50:0/3210467687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ab48069f0 msgr2=0x562ab48190c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:57.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.062+0000 7f5caf39cb80 1 --2- 172.21.15.50:0/3210467687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ab48069f0 0x562ab48190c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f5c9001f4e0 tx=0x7f5c90013bd0 comp rx=0 tx=0).stop 2024-06-06T03:34:57.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.062+0000 7f5caf39cb80 1 -- 172.21.15.50:0/3210467687 shutdown_connections 2024-06-06T03:34:57.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.062+0000 7f5caf39cb80 1 --2- 172.21.15.50:0/3210467687 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562ab48ad6e0 0x562ab48afb00 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:57.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.062+0000 7f5caf39cb80 1 --2- 172.21.15.50:0/3210467687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ab480b9c0 0x562ab4816b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:57.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.062+0000 7f5caf39cb80 1 --2- 172.21.15.50:0/3210467687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ab48069f0 0x562ab48190c0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:57.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.062+0000 7f5caf39cb80 1 --2- 172.21.15.50:0/3210467687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ab480b0a0 0x562ab4816500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:57.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.062+0000 7f5caf39cb80 1 -- 172.21.15.50:0/3210467687 >> 172.21.15.50:0/3210467687 conn(0x562ab4733080 msgr2=0x562ab480a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:57.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.062+0000 7f5c85ffb700 0 client.16527 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:34:57.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.063+0000 7f5caf39cb80 1 -- 172.21.15.50:0/3210467687 shutdown_connections 2024-06-06T03:34:57.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.063+0000 7f5caf39cb80 1 -- 172.21.15.50:0/3210467687 wait complete. 2024-06-06T03:34:57.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.064+0000 7f5caf39cb80 20 client.16527 trim_cache size 0 max 16384 2024-06-06T03:34:57.064 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:34:57.064 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2024-06-06T03:34:57.064 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-06-06T03:34:57.065 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:34:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.065+0000 7f5c9f59e700 1 -- 172.21.15.50:0/2508724301 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f5c880a2e30 msgr2=0x7f5c880a52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.065+0000 7f5c9f59e700 1 --2- 172.21.15.50:0/2508724301 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f5c880a2e30 0x7f5c880a52f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5c900048a0 tx=0x7f5c90009400 comp rx=0 tx=0).stop 2024-06-06T03:34:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.065+0000 7f5c9f59e700 1 -- 172.21.15.50:0/2508724301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c980a56f0 msgr2=0x7f5c980b5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:34:57.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.065+0000 7f5c9f59e700 1 --2- 172.21.15.50:0/2508724301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c980a56f0 0x7f5c980b5e00 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f5c9401fa40 tx=0x7f5c9401fd50 comp rx=0 tx=0).stop 2024-06-06T03:34:57.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.065+0000 7f5c9f59e700 1 -- 172.21.15.50:0/2508724301 shutdown_connections 2024-06-06T03:34:57.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.065+0000 7f5c9f59e700 1 --2- 172.21.15.50:0/2508724301 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c98144b00 0x7f5c98146ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:57.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.065+0000 7f5c9f59e700 1 --2- 172.21.15.50:0/2508724301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c980a4dd0 0x7f5c980b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:57.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.065+0000 7f5c9f59e700 1 --2- 172.21.15.50:0/2508724301 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f5c880a2e30 0x7f5c880a52f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:57.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.065+0000 7f5c9f59e700 1 --2- 172.21.15.50:0/2508724301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c980a56f0 0x7f5c980b5e00 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:34:57.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.065+0000 7f5c9f59e700 1 -- 172.21.15.50:0/2508724301 >> 172.21.15.50:0/2508724301 conn(0x7f5c9801a690 msgr2=0x7f5c980a6740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:34:57.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.065+0000 7f5c9f59e700 1 -- 172.21.15.50:0/2508724301 shutdown_connections 2024-06-06T03:34:57.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:34:57.065+0000 7f5c9f59e700 1 -- 172.21.15.50:0/2508724301 wait complete. 2024-06-06T03:34:57.598 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:57 smithi050 ceph-mon[32421]: pgmap v680: 129 pgs: 129 active+clean; 10 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 36 MiB/s wr, 740 op/s 2024-06-06T03:34:57.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:57 smithi079 ceph-mon[35478]: pgmap v680: 129 pgs: 129 active+clean; 10 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 36 MiB/s wr, 740 op/s 2024-06-06T03:34:57.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:57 smithi122 ceph-mon[35759]: pgmap v680: 129 pgs: 129 active+clean; 10 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 36 MiB/s wr, 740 op/s 2024-06-06T03:34:58.105 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-06T03:34:58.106 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T03:34:58.759 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:34:59.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:34:59 smithi079 ceph-mon[35478]: pgmap v681: 129 pgs: 129 active+clean; 10 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 30 MiB/s wr, 607 op/s 2024-06-06T03:34:59.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:34:59 smithi122 ceph-mon[35759]: pgmap v681: 129 pgs: 129 active+clean; 10 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 30 MiB/s wr, 607 op/s 2024-06-06T03:34:59.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:34:59 smithi050 ceph-mon[32421]: pgmap v681: 129 pgs: 129 active+clean; 10 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 30 MiB/s wr, 607 op/s 2024-06-06T03:35:01.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:01 smithi122 ceph-mon[35759]: pgmap v682: 129 pgs: 129 active+clean; 10 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 39 MiB/s wr, 806 op/s 2024-06-06T03:35:01.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:01 smithi050 ceph-mon[32421]: pgmap v682: 129 pgs: 129 active+clean; 10 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 39 MiB/s wr, 806 op/s 2024-06-06T03:35:01.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:01 smithi079 ceph-mon[35478]: pgmap v682: 129 pgs: 129 active+clean; 10 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 39 MiB/s wr, 806 op/s 2024-06-06T03:35:03.470 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:03 smithi050 ceph-mon[32421]: pgmap v683: 129 pgs: 129 active+clean; 10 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 30 MiB/s wr, 619 op/s 2024-06-06T03:35:03.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.582+0000 7f75c1ce1640 1 -- 172.21.15.50:0/3053380629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75bc10dcc0 msgr2=0x7f75bc10e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:03.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.582+0000 7f75c1ce1640 1 --2- 172.21.15.50:0/3053380629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75bc10dcc0 0x7f75bc10e140 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f75ac009900 tx=0x7f75ac02a440 comp rx=0 tx=0).stop 2024-06-06T03:35:03.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.583+0000 7f75c1ce1640 1 -- 172.21.15.50:0/3053380629 shutdown_connections 2024-06-06T03:35:03.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.583+0000 7f75c1ce1640 1 --2- 172.21.15.50:0/3053380629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75bc10dcc0 0x7f75bc10e140 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.583+0000 7f75c1ce1640 1 --2- 172.21.15.50:0/3053380629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75bc10b310 0x7f75bc10d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.583+0000 7f75c1ce1640 1 --2- 172.21.15.50:0/3053380629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75bc1089a0 0x7f75bc10add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.583+0000 7f75c1ce1640 1 -- 172.21.15.50:0/3053380629 >> 172.21.15.50:0/3053380629 conn(0x7f75bc06ea10 msgr2=0x7f75bc070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:03.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.586+0000 7f75c1ce1640 1 -- 172.21.15.50:0/3053380629 shutdown_connections 2024-06-06T03:35:03.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.586+0000 7f75c1ce1640 1 -- 172.21.15.50:0/3053380629 wait complete. 2024-06-06T03:35:03.586 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.587+0000 7f75c1ce1640 1 Processor -- start 2024-06-06T03:35:03.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.589+0000 7f75c1ce1640 1 -- start start 2024-06-06T03:35:03.590 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.590+0000 7f75c1ce1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75bc1089a0 0x7f75bc119bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:03.590 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.590+0000 7f75c1ce1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75bc10dcc0 0x7f75bc11a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:03.590 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.590+0000 7f75c1ce1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75bc118230 0x7f75bc1186e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:03.590 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.590+0000 7f75c1ce1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f75bc1109d0 con 0x7f75bc118230 2024-06-06T03:35:03.590 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.590+0000 7f75c1ce1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f75bc110850 con 0x7f75bc10dcc0 2024-06-06T03:35:03.590 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.590+0000 7f75c1ce1640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f75bc110b50 con 0x7f75bc1089a0 2024-06-06T03:35:03.590 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.590+0000 7f75baffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75bc10dcc0 0x7f75bc11a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:03.590 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.590+0000 7f75baffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75bc10dcc0 0x7f75bc11a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:55462/0 (socket says 172.21.15.50:55462) 2024-06-06T03:35:03.590 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.590+0000 7f75baffd640 1 -- 172.21.15.50:0/1439632153 learned_addr learned my addr 172.21.15.50:0/1439632153 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:03.590 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.591+0000 7f75bbfff640 1 --2- 172.21.15.50:0/1439632153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75bc118230 0x7f75bc1186e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:03.590 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.591+0000 7f75bb7fe640 1 --2- 172.21.15.50:0/1439632153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75bc1089a0 0x7f75bc119bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:03.591 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.591+0000 7f75baffd640 1 -- 172.21.15.50:0/1439632153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75bc1089a0 msgr2=0x7f75bc119bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:03.592 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.591+0000 7f75baffd640 1 --2- 172.21.15.50:0/1439632153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75bc1089a0 0x7f75bc119bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.592 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.591+0000 7f75baffd640 1 -- 172.21.15.50:0/1439632153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75bc118230 msgr2=0x7f75bc1186e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:03.592 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.591+0000 7f75baffd640 1 --2- 172.21.15.50:0/1439632153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75bc118230 0x7f75bc1186e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.592 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.591+0000 7f75baffd640 1 -- 172.21.15.50:0/1439632153 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75bc118d80 con 0x7f75bc10dcc0 2024-06-06T03:35:03.592 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.591+0000 7f75bb7fe640 1 --2- 172.21.15.50:0/1439632153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75bc1089a0 0x7f75bc119bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:35:03.592 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.591+0000 7f75baffd640 1 --2- 172.21.15.50:0/1439632153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75bc10dcc0 0x7f75bc11a130 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f75b400b990 tx=0x7f75b400be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:03.592 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.592+0000 7f75b8ff9640 1 -- 172.21.15.50:0/1439632153 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b4019070 con 0x7f75bc10dcc0 2024-06-06T03:35:03.592 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.592+0000 7f75c1ce1640 1 -- 172.21.15.50:0/1439632153 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75bc119070 con 0x7f75bc10dcc0 2024-06-06T03:35:03.592 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.592+0000 7f75c1ce1640 1 -- 172.21.15.50:0/1439632153 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75bc1b7c70 con 0x7f75bc10dcc0 2024-06-06T03:35:03.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.592+0000 7f75b8ff9640 1 -- 172.21.15.50:0/1439632153 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f75b4014440 con 0x7f75bc10dcc0 2024-06-06T03:35:03.594 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.593+0000 7f75b8ff9640 1 -- 172.21.15.50:0/1439632153 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b40125a0 con 0x7f75bc10dcc0 2024-06-06T03:35:03.594 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.595+0000 7f75b8ff9640 1 -- 172.21.15.50:0/1439632153 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f75b401c070 con 0x7f75bc10dcc0 2024-06-06T03:35:03.597 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.599+0000 7f75b8ff9640 1 --2- 172.21.15.50:0/1439632153 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f75a40a2e70 0x7f75a40a5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:03.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.599+0000 7f75b8ff9640 1 -- 172.21.15.50:0/1439632153 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f75b40cf920 con 0x7f75bc10dcc0 2024-06-06T03:35:03.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.600+0000 7f75c49f2740 1 Processor -- start 2024-06-06T03:35:03.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.600+0000 7f75bb7fe640 1 --2- 172.21.15.50:0/1439632153 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f75a40a2e70 0x7f75a40a5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:03.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.601+0000 7f75c49f2740 1 -- start start 2024-06-06T03:35:03.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.601+0000 7f75c49f2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe3fb0d010 0x55fe3fb0d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:03.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.601+0000 7f75c49f2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe3fb0da00 0x55fe3fb12500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:03.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.601+0000 7f75c49f2740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe3fb12b70 0x55fe3fb15000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:03.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.601+0000 7f75c49f2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fe3fa704f0 con 0x55fe3fb0d010 2024-06-06T03:35:03.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.601+0000 7f75c49f2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fe3fa0e870 con 0x55fe3fb0da00 2024-06-06T03:35:03.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.601+0000 7f75c49f2740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fe3fa6c4b0 con 0x55fe3fb12b70 2024-06-06T03:35:03.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.601+0000 7f75bbfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe3fb12b70 0x55fe3fb15000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:03.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.601+0000 7f75bbfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe3fb12b70 0x55fe3fb15000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:57722/0 (socket says 172.21.15.50:57722) 2024-06-06T03:35:03.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.601+0000 7f75bbfff640 1 -- 172.21.15.50:0/2844380496 learned_addr learned my addr 172.21.15.50:0/2844380496 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:03.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.602+0000 7f75baffd640 1 --2- 172.21.15.50:0/2844380496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe3fb0da00 0x55fe3fb12500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:03.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.602+0000 7f75bbfff640 1 -- 172.21.15.50:0/2844380496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe3fb0da00 msgr2=0x55fe3fb12500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:03.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.602+0000 7f75bbfff640 1 --2- 172.21.15.50:0/2844380496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe3fb0da00 0x55fe3fb12500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.602+0000 7f75bbfff640 1 -- 172.21.15.50:0/2844380496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe3fb0d010 msgr2=0x55fe3fb0d430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:35:03.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.602+0000 7f75bbfff640 1 --2- 172.21.15.50:0/2844380496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe3fb0d010 0x55fe3fb0d430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.602+0000 7f75bbfff640 1 -- 172.21.15.50:0/2844380496 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe3fa2a9b0 con 0x55fe3fb12b70 2024-06-06T03:35:03.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.602+0000 7f75bbfff640 1 --2- 172.21.15.50:0/2844380496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe3fb12b70 0x55fe3fb15000 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f75ac02a9b0 tx=0x7f75ac004180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c23cd49e4665a766 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:03.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.603+0000 7f75a1ffb640 1 -- 172.21.15.50:0/2844380496 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ac03f070 con 0x55fe3fb12b70 2024-06-06T03:35:03.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.603+0000 7f75a1ffb640 1 -- 172.21.15.50:0/2844380496 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f75ac0054f0 con 0x55fe3fb12b70 2024-06-06T03:35:03.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.604+0000 7f75c49f2740 1 -- 172.21.15.50:0/2844380496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe3fb12b70 msgr2=0x55fe3fb15000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:03.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.604+0000 7f75c49f2740 1 --2- 172.21.15.50:0/2844380496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe3fb12b70 0x55fe3fb15000 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f75ac02a9b0 tx=0x7f75ac004180 comp rx=0 tx=0).stop 2024-06-06T03:35:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.605+0000 7f75c49f2740 1 -- 172.21.15.50:0/2844380496 shutdown_connections 2024-06-06T03:35:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.605+0000 7f75c49f2740 1 --2- 172.21.15.50:0/2844380496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe3fb12b70 0x55fe3fb15000 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.605+0000 7f75c49f2740 1 --2- 172.21.15.50:0/2844380496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe3fb0da00 0x55fe3fb12500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.605+0000 7f75c49f2740 1 --2- 172.21.15.50:0/2844380496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe3fb0d010 0x55fe3fb0d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.605+0000 7f75c49f2740 1 -- 172.21.15.50:0/2844380496 >> 172.21.15.50:0/2844380496 conn(0x55fe3fb08680 msgr2=0x55fe3fb08a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.605+0000 7f75c49f2740 1 -- 172.21.15.50:0/2844380496 shutdown_connections 2024-06-06T03:35:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.605+0000 7f75c49f2740 1 -- 172.21.15.50:0/2844380496 wait complete. 2024-06-06T03:35:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.605+0000 7f75c49f2740 1 -- start start 2024-06-06T03:35:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.605+0000 7f75c49f2740 1 Processor -- start 2024-06-06T03:35:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.606+0000 7f75c49f2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe3fb0d010 0x55fe3fb17240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.606+0000 7f75c49f2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe3fb0da00 0x55fe3fb17780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.606+0000 7f75c49f2740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe3fb12b70 0x55fe3fb1e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.606+0000 7f75c49f2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fe3fb15b10 con 0x55fe3fb0da00 2024-06-06T03:35:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.606+0000 7f75c49f2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fe3f9f9ae0 con 0x55fe3fb0d010 2024-06-06T03:35:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.606+0000 7f75c49f2740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fe3fb15c90 con 0x55fe3fb12b70 2024-06-06T03:35:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.606+0000 7f75c49f2740 10 client.0 _ll_register_callbacks cb 0x55fe3fa329b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:35:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.606+0000 7f75bbfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe3fb12b70 0x55fe3fb1e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.606+0000 7f75bbfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe3fb12b70 0x55fe3fb1e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:57726/0 (socket says 172.21.15.50:57726) 2024-06-06T03:35:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.606+0000 7f75bbfff640 1 -- 172.21.15.50:0/3991168065 learned_addr learned my addr 172.21.15.50:0/3991168065 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.607+0000 7f75bb7fe640 1 --2- 172.21.15.50:0/3991168065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe3fb0d010 0x55fe3fb17240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.607+0000 7f75bb7fe640 1 -- 172.21.15.50:0/3991168065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe3fb12b70 msgr2=0x55fe3fb1e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.607+0000 7f75bb7fe640 1 --2- 172.21.15.50:0/3991168065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe3fb12b70 0x55fe3fb1e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.607+0000 7f75bb7fe640 1 -- 172.21.15.50:0/3991168065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe3fb0da00 msgr2=0x55fe3fb17780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.607+0000 7f75bb7fe640 1 --2- 172.21.15.50:0/3991168065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe3fb0da00 0x55fe3fb17780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.607+0000 7f75bb7fe640 1 -- 172.21.15.50:0/3991168065 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe3f784210 con 0x55fe3fb0d010 2024-06-06T03:35:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.608+0000 7f75bb7fe640 1 --2- 172.21.15.50:0/1439632153 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f75a40a2e70 0x7f75a40a5330 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55fe3fb0e260 tx=0x7f75b0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.608+0000 7f75bb7fe640 1 --2- 172.21.15.50:0/3991168065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe3fb0d010 0x55fe3fb17240 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f75b000c520 tx=0x7f75b00157e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e2c84d240d7e604 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.608+0000 7f759f7f6640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:35:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.608+0000 7f759f7f6640 1 -- 172.21.15.50:0/3991168065 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b0013830 con 0x55fe3fb0d010 2024-06-06T03:35:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.608+0000 7f759f7f6640 1 -- 172.21.15.50:0/3991168065 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f75b00139d0 con 0x55fe3fb0d010 2024-06-06T03:35:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.608+0000 7f75c49f2740 1 -- 172.21.15.50:0/3991168065 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75ac0054f0 con 0x55fe3fb0d010 2024-06-06T03:35:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.609+0000 7f759f7f6640 1 -- 172.21.15.50:0/3991168065 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f75b002b050 con 0x55fe3fb0d010 2024-06-06T03:35:03.613 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.614+0000 7f75c49f2740 10 client.26192 fetch_fsmap learned FSMap version 33 2024-06-06T03:35:03.613 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.614+0000 7f75c49f2740 1 -- 172.21.15.50:0/3991168065 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55fe3f850620 con 0x55fe3fb0d010 2024-06-06T03:35:03.616 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.618+0000 7f759f7f6640 1 -- 172.21.15.50:0/3991168065 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f75ac0054f0 con 0x55fe3fb0d010 2024-06-06T03:35:03.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.618+0000 7f759f7f6640 1 -- 172.21.15.50:0/3991168065 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f75b001c070 con 0x55fe3fb0d010 2024-06-06T03:35:03.618 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.619+0000 7f75c49f2740 10 client.26192 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:35:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.619+0000 7f75c49f2740 10 client.26192 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:35:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.619+0000 7f75c49f2740 20 client.26192 populate_metadata read hostname 'smithi050' 2024-06-06T03:35:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.619+0000 7f75c49f2740 1 --2- 172.21.15.50:0/3991168065 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fe3fb23170 0x55fe3fb255a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.619+0000 7f75c49f2740 4 client.26192 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:35:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.619+0000 7f75c49f2740 1 -- 172.21.15.50:0/3991168065 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe3fa83f10 con 0x55fe3fb23170 2024-06-06T03:35:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.620+0000 7f75baffd640 1 --2- 172.21.15.50:0/3991168065 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fe3fb23170 0x55fe3fb255a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.620+0000 7f75baffd640 1 --2- 172.21.15.50:0/3991168065 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fe3fb23170 0x55fe3fb255a0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1aa04028b327e3d1 server_cookie=9c624aa980a0bd73 in_seq=0 out_seq=0 2024-06-06T03:35:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.620+0000 7f759f7f6640 10 client.26192 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.621+0000 7f759f7f6640 1 -- 172.21.15.50:0/3991168065 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55fe3fa83f10 con 0x55fe3fb23170 2024-06-06T03:35:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.621+0000 7f759f7f6640 10 client.26192 handle_command_reply: tid=0 2024-06-06T03:35:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.621+0000 7f75c49f2740 1 client.26192 shutdown 2024-06-06T03:35:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.622+0000 7f75c49f2740 1 -- 172.21.15.50:0/3991168065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe3fb0d010 msgr2=0x55fe3fb17240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.622+0000 7f75c49f2740 1 --2- 172.21.15.50:0/3991168065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe3fb0d010 0x55fe3fb17240 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f75b000c520 tx=0x7f75b00157e0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.622+0000 7f75c49f2740 1 -- 172.21.15.50:0/3991168065 shutdown_connections 2024-06-06T03:35:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.622+0000 7f75c49f2740 1 --2- 172.21.15.50:0/3991168065 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fe3fb23170 0x55fe3fb255a0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.622+0000 7f75c49f2740 1 --2- 172.21.15.50:0/3991168065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe3fb0da00 0x55fe3fb17780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.622+0000 7f75c49f2740 1 --2- 172.21.15.50:0/3991168065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe3fb12b70 0x55fe3fb1e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.622+0000 7f75c49f2740 1 --2- 172.21.15.50:0/3991168065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe3fb0d010 0x55fe3fb17240 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.622+0000 7f75c49f2740 1 -- 172.21.15.50:0/3991168065 >> 172.21.15.50:0/3991168065 conn(0x55fe3fb08680 msgr2=0x55fe3fb077e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.623+0000 7f759f7f6640 0 client.26192 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.623+0000 7f75c49f2740 1 -- 172.21.15.50:0/3991168065 shutdown_connections 2024-06-06T03:35:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.623+0000 7f75c49f2740 1 -- 172.21.15.50:0/3991168065 wait complete. 2024-06-06T03:35:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.623+0000 7f75c49f2740 20 client.26192 trim_cache size 0 max 16384 2024-06-06T03:35:03.650 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:03 smithi079 ceph-mon[35478]: pgmap v683: 129 pgs: 129 active+clean; 10 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 30 MiB/s wr, 619 op/s 2024-06-06T03:35:03.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.658+0000 7f75c49f2740 1 Processor -- start 2024-06-06T03:35:03.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.658+0000 7f75c49f2740 1 -- start start 2024-06-06T03:35:03.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.659+0000 7f75c49f2740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe3fb0d010 0x55fe3fb25180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:03.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.659+0000 7f75c49f2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe3fb0da00 0x55fe3fb1e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:03.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.659+0000 7f75c49f2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe3fb12b70 0x55fe3fb0b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.659+0000 7f75c49f2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f75a8012520 con 0x55fe3fb12b70 2024-06-06T03:35:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.659+0000 7f75c49f2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f75a800fdf0 con 0x55fe3fb0da00 2024-06-06T03:35:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.659+0000 7f75c49f2740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f75a800dc40 con 0x55fe3fb0d010 2024-06-06T03:35:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.659+0000 7f75baffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe3fb0da00 0x55fe3fb1e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.659+0000 7f75baffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe3fb0da00 0x55fe3fb1e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:55478/0 (socket says 172.21.15.50:55478) 2024-06-06T03:35:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.659+0000 7f75baffd640 1 -- 172.21.15.50:0/2909351760 learned_addr learned my addr 172.21.15.50:0/2909351760 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.659+0000 7f75bb7fe640 1 --2- 172.21.15.50:0/2909351760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe3fb0d010 0x55fe3fb25180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.660+0000 7f75bbfff640 1 --2- 172.21.15.50:0/2909351760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe3fb12b70 0x55fe3fb0b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.660+0000 7f75baffd640 1 -- 172.21.15.50:0/2909351760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe3fb0d010 msgr2=0x55fe3fb25180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.660+0000 7f75baffd640 1 --2- 172.21.15.50:0/2909351760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe3fb0d010 0x55fe3fb25180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.660+0000 7f75baffd640 1 -- 172.21.15.50:0/2909351760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe3fb12b70 msgr2=0x55fe3fb0b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.660+0000 7f75baffd640 1 --2- 172.21.15.50:0/2909351760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe3fb12b70 0x55fe3fb0b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.660+0000 7f75baffd640 1 -- 172.21.15.50:0/2909351760 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe3fb0dde0 con 0x55fe3fb0da00 2024-06-06T03:35:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.660+0000 7f75baffd640 1 --2- 172.21.15.50:0/2909351760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe3fb0da00 0x55fe3fb1e780 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f75b409bd30 tx=0x7f75b40ccf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4a2f273d92edc22 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.661+0000 7f75a17fa640 1 -- 172.21.15.50:0/2909351760 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b40b9070 con 0x55fe3fb0da00 2024-06-06T03:35:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.661+0000 7f75a17fa640 1 -- 172.21.15.50:0/2909351760 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f75b40a0150 con 0x55fe3fb0da00 2024-06-06T03:35:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.662+0000 7f75c49f2740 1 -- 172.21.15.50:0/2909351760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe3fb0da00 msgr2=0x55fe3fb1e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.662+0000 7f75c49f2740 1 --2- 172.21.15.50:0/2909351760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe3fb0da00 0x55fe3fb1e780 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f75b409bd30 tx=0x7f75b40ccf10 comp rx=0 tx=0).stop 2024-06-06T03:35:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.662+0000 7f75c49f2740 1 -- 172.21.15.50:0/2909351760 shutdown_connections 2024-06-06T03:35:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.662+0000 7f75c49f2740 1 --2- 172.21.15.50:0/2909351760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe3fb12b70 0x55fe3fb0b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.662+0000 7f75c49f2740 1 --2- 172.21.15.50:0/2909351760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe3fb0da00 0x55fe3fb1e780 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.662+0000 7f75c49f2740 1 --2- 172.21.15.50:0/2909351760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe3fb0d010 0x55fe3fb25180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.662+0000 7f75c49f2740 1 -- 172.21.15.50:0/2909351760 >> 172.21.15.50:0/2909351760 conn(0x55fe3fb08680 msgr2=0x55fe3fb08a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:03.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.662+0000 7f75c49f2740 1 -- 172.21.15.50:0/2909351760 shutdown_connections 2024-06-06T03:35:03.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.662+0000 7f75c49f2740 1 -- 172.21.15.50:0/2909351760 wait complete. 2024-06-06T03:35:03.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.663+0000 7f75c49f2740 1 -- start start 2024-06-06T03:35:03.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.663+0000 7f75c49f2740 1 Processor -- start 2024-06-06T03:35:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.663+0000 7f75c49f2740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe3fb0d010 0x55fe3fb1e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.663+0000 7f75c49f2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe3fb12b70 0x55fe3fb1b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.663+0000 7f75c49f2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe3fb1b680 0x55fe3fb8be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.663+0000 7f75c49f2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f75a800e2b0 con 0x55fe3fb1b680 2024-06-06T03:35:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.663+0000 7f75c49f2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f75a800f720 con 0x55fe3fb12b70 2024-06-06T03:35:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.663+0000 7f75c49f2740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f75a800e980 con 0x55fe3fb0d010 2024-06-06T03:35:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.663+0000 7f75c49f2740 10 client.0 _ll_register_callbacks cb 0x7f75b000a5a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:35:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.664+0000 7f75baffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe3fb12b70 0x55fe3fb1b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.664+0000 7f75baffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe3fb12b70 0x55fe3fb1b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:55490/0 (socket says 172.21.15.50:55490) 2024-06-06T03:35:03.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.664+0000 7f75baffd640 1 -- 172.21.15.50:0/3707997782 learned_addr learned my addr 172.21.15.50:0/3707997782 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:03.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.664+0000 7f75bb7fe640 1 --2- 172.21.15.50:0/3707997782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe3fb0d010 0x55fe3fb1e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:03.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.664+0000 7f75baffd640 1 -- 172.21.15.50:0/3707997782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe3fb0d010 msgr2=0x55fe3fb1e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:03.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.664+0000 7f75baffd640 1 --2- 172.21.15.50:0/3707997782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe3fb0d010 0x55fe3fb1e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.664+0000 7f75baffd640 1 -- 172.21.15.50:0/3707997782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe3fb1b680 msgr2=0x55fe3fb8be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:03.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.664+0000 7f75baffd640 1 --2- 172.21.15.50:0/3707997782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe3fb1b680 0x55fe3fb8be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.664+0000 7f75baffd640 1 -- 172.21.15.50:0/3707997782 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe3fb1bd30 con 0x55fe3fb12b70 2024-06-06T03:35:03.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.665+0000 7f75baffd640 1 --2- 172.21.15.50:0/3707997782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe3fb12b70 0x55fe3fb1b140 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f75b4014cf0 tx=0x7f75b40ccf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0c9cc111dc51691 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:03.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.665+0000 7f759f7f6640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:35:03.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.665+0000 7f759f7f6640 1 -- 172.21.15.50:0/3707997782 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b40a9060 con 0x55fe3fb12b70 2024-06-06T03:35:03.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.665+0000 7f759f7f6640 1 -- 172.21.15.50:0/3707997782 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f75b409b1f0 con 0x55fe3fb12b70 2024-06-06T03:35:03.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.665+0000 7f75c49f2740 1 -- 172.21.15.50:0/3707997782 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fe3fa7dc20 con 0x55fe3fb12b70 2024-06-06T03:35:03.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.665+0000 7f759f7f6640 1 -- 172.21.15.50:0/3707997782 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f75b40b9070 con 0x55fe3fb12b70 2024-06-06T03:35:03.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.667+0000 7f75c49f2740 10 client.26198 fetch_fsmap learned FSMap version 33 2024-06-06T03:35:03.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.667+0000 7f75c49f2740 1 -- 172.21.15.50:0/3707997782 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55fe3fb8d560 con 0x55fe3fb12b70 2024-06-06T03:35:03.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.667+0000 7f759f7f6640 1 -- 172.21.15.50:0/3707997782 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55fe3fa7dc20 con 0x55fe3fb12b70 2024-06-06T03:35:03.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.668+0000 7f759f7f6640 1 -- 172.21.15.50:0/3707997782 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f75b4097b30 con 0x55fe3fb12b70 2024-06-06T03:35:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.668+0000 7f75c49f2740 10 client.26198 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:35:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.668+0000 7f75c49f2740 10 client.26198 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:35:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.668+0000 7f75c49f2740 20 client.26198 populate_metadata read hostname 'smithi050' 2024-06-06T03:35:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.668+0000 7f75c49f2740 1 --2- 172.21.15.50:0/3707997782 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fe3fb8df10 0x55fe3fb90330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.668+0000 7f75c49f2740 4 client.26198 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:35:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.668+0000 7f75c49f2740 1 -- 172.21.15.50:0/3707997782 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fe3fa77f70 con 0x55fe3fb8df10 2024-06-06T03:35:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.668+0000 7f75bb7fe640 1 --2- 172.21.15.50:0/3707997782 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fe3fb8df10 0x55fe3fb90330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:03.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.669+0000 7f292b7fe700 1 -- 172.21.15.50:0/295542029 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291c003b80 con 0x7f292c11bc70 2024-06-06T03:35:03.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.669+0000 7f2931da2700 1 -- 172.21.15.50:0/295542029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f292c11bc70 msgr2=0x7f292c11e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:03.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.669+0000 7f2931da2700 1 --2- 172.21.15.50:0/295542029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f292c11bc70 0x7f292c11e060 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f291c01a9a0 tx=0x7f291c01acb0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.670+0000 7f2931da2700 1 -- 172.21.15.50:0/295542029 shutdown_connections 2024-06-06T03:35:03.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.670+0000 7f2931da2700 1 --2- 172.21.15.50:0/295542029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f292c11bc70 0x7f292c11e060 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.670+0000 7f2931da2700 1 --2- 172.21.15.50:0/295542029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f292c110b80 0x7f292c109490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.670+0000 7f2931da2700 1 --2- 172.21.15.50:0/295542029 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f292c110ff0 0x7f292c1099d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.670+0000 7f2931da2700 1 -- 172.21.15.50:0/295542029 >> 172.21.15.50:0/295542029 conn(0x7f292c06d470 msgr2=0x7f292c06d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.670+0000 7f75bb7fe640 1 --2- 172.21.15.50:0/3707997782 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fe3fb8df10 0x55fe3fb90330 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c083a72f849ef831 server_cookie=5152a858ce0b8ebe in_seq=0 out_seq=0 2024-06-06T03:35:03.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.670+0000 7f2931da2700 1 -- 172.21.15.50:0/295542029 shutdown_connections 2024-06-06T03:35:03.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.670+0000 7f2931da2700 1 -- 172.21.15.50:0/295542029 wait complete. 2024-06-06T03:35:03.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.671+0000 7f759f7f6640 10 client.26198 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:03.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.671+0000 7f2931da2700 1 Processor -- start 2024-06-06T03:35:03.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.671+0000 7f2931da2700 1 -- start start 2024-06-06T03:35:03.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.672+0000 7f2931da2700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f292c110b80 0x7f292c117370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:03.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.672+0000 7f2931da2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f292c110ff0 0x7f292c1178b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:03.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.672+0000 7f2931da2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f292c11bc70 0x7f292c11ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:03.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.672+0000 7f2931da2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f292c113c50 con 0x7f292c11bc70 2024-06-06T03:35:03.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.672+0000 7f2931da2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f292c113ad0 con 0x7f292c110ff0 2024-06-06T03:35:03.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.672+0000 7f2931da2700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f292c113dd0 con 0x7f292c110b80 2024-06-06T03:35:03.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.672+0000 7f292bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f292c110ff0 0x7f292c1178b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:03.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.672+0000 7f292bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f292c110ff0 0x7f292c1178b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:55508/0 (socket says 172.21.15.50:55508) 2024-06-06T03:35:03.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.672+0000 7f292bfff700 1 -- 172.21.15.50:0/3196885111 learned_addr learned my addr 172.21.15.50:0/3196885111 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:03.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.673+0000 7f292bfff700 1 -- 172.21.15.50:0/3196885111 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f292c110b80 msgr2=0x7f292c117370 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-06T03:35:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.673+0000 7f292bfff700 1 --2- 172.21.15.50:0/3196885111 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f292c110b80 0x7f292c117370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.673+0000 7f292bfff700 1 -- 172.21.15.50:0/3196885111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f292c11bc70 msgr2=0x7f292c11ac50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T03:35:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.673+0000 7f292bfff700 1 --2- 172.21.15.50:0/3196885111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f292c11bc70 0x7f292c11ac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.673+0000 7f292bfff700 1 -- 172.21.15.50:0/3196885111 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f292c11b380 con 0x7f292c110ff0 2024-06-06T03:35:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.673+0000 7f292bfff700 1 --2- 172.21.15.50:0/3196885111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f292c110ff0 0x7f292c1178b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f292000e9a0 tx=0x7f292000ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.678+0000 7f759f7f6640 1 -- 172.21.15.50:0/3707997782 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55fe3fa77f70 con 0x55fe3fb8df10 2024-06-06T03:35:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.678+0000 7f759f7f6640 10 client.26198 handle_command_reply: tid=0 2024-06-06T03:35:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.678+0000 7f75c49f2740 1 client.26198 shutdown 2024-06-06T03:35:03.680 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.680+0000 7f75c49f2740 1 -- 172.21.15.50:0/3707997782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe3fb12b70 msgr2=0x55fe3fb1b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:03.680 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.680+0000 7f75c49f2740 1 --2- 172.21.15.50:0/3707997782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe3fb12b70 0x55fe3fb1b140 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f75b4014cf0 tx=0x7f75b40ccf80 comp rx=0 tx=0).stop 2024-06-06T03:35:03.680 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.680+0000 7f75c49f2740 1 -- 172.21.15.50:0/3707997782 shutdown_connections 2024-06-06T03:35:03.680 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.680+0000 7f75c49f2740 1 --2- 172.21.15.50:0/3707997782 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fe3fb8df10 0x55fe3fb90330 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.680 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.680+0000 7f75c49f2740 1 --2- 172.21.15.50:0/3707997782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe3fb1b680 0x55fe3fb8be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.680 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.680+0000 7f75c49f2740 1 --2- 172.21.15.50:0/3707997782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe3fb12b70 0x55fe3fb1b140 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.680 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.680+0000 7f75c49f2740 1 --2- 172.21.15.50:0/3707997782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe3fb0d010 0x55fe3fb1e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.680 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.680+0000 7f75c49f2740 1 -- 172.21.15.50:0/3707997782 >> 172.21.15.50:0/3707997782 conn(0x55fe3fb08680 msgr2=0x55fe3fb0eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:03.680 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.681+0000 7f759f7f6640 0 client.26198 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:03.680 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.681+0000 7f75c49f2740 1 -- 172.21.15.50:0/3707997782 shutdown_connections 2024-06-06T03:35:03.680 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.681+0000 7f75c49f2740 1 -- 172.21.15.50:0/3707997782 wait complete. 2024-06-06T03:35:03.681 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.681+0000 7f75c49f2740 20 client.26198 trim_cache size 0 max 16384 2024-06-06T03:35:03.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:03 smithi122 ceph-mon[35759]: pgmap v683: 129 pgs: 129 active+clean; 10 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 30 MiB/s wr, 619 op/s 2024-06-06T03:35:03.685 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:35:03.685 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:35:03.685 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:35:03.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.684+0000 7f2929ffb700 1 -- 172.21.15.50:0/3196885111 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292000cbd0 con 0x7f292c110ff0 2024-06-06T03:35:03.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.684+0000 7f2931da2700 1 -- 172.21.15.50:0/3196885111 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f292c11b610 con 0x7f292c110ff0 2024-06-06T03:35:03.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.684+0000 7f2931da2700 1 -- 172.21.15.50:0/3196885111 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f292c1abce0 con 0x7f292c110ff0 2024-06-06T03:35:03.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.685+0000 7f2929ffb700 1 -- 172.21.15.50:0/3196885111 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f292000cd70 con 0x7f292c110ff0 2024-06-06T03:35:03.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.685+0000 7f2929ffb700 1 -- 172.21.15.50:0/3196885111 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29200186f0 con 0x7f292c110ff0 2024-06-06T03:35:03.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.689+0000 7f75c1ce1640 1 -- 172.21.15.50:0/1439632153 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f75a40a2e70 msgr2=0x7f75a40a5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:03.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.689+0000 7f75c1ce1640 1 --2- 172.21.15.50:0/1439632153 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f75a40a2e70 0x7f75a40a5330 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55fe3fb0e260 tx=0x7f75b0008040 comp rx=0 tx=0).stop 2024-06-06T03:35:03.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.689+0000 7f75c1ce1640 1 -- 172.21.15.50:0/1439632153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75bc10dcc0 msgr2=0x7f75bc11a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:03.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.689+0000 7f75c1ce1640 1 --2- 172.21.15.50:0/1439632153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75bc10dcc0 0x7f75bc11a130 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f75b400b990 tx=0x7f75b400be50 comp rx=0 tx=0).stop 2024-06-06T03:35:03.689 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.689+0000 7f75c1ce1640 1 -- 172.21.15.50:0/1439632153 shutdown_connections 2024-06-06T03:35:03.689 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.689+0000 7f75c1ce1640 1 --2- 172.21.15.50:0/1439632153 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f75a40a2e70 0x7f75a40a5330 secure :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55fe3fb0e260 tx=0x7f75b0008040 comp rx=0 tx=0).stop 2024-06-06T03:35:03.689 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.689+0000 7f75c1ce1640 1 --2- 172.21.15.50:0/1439632153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75bc118230 0x7f75bc1186e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.689 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.689+0000 7f75c1ce1640 1 --2- 172.21.15.50:0/1439632153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75bc10dcc0 0x7f75bc11a130 secure :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f75b400b990 tx=0x7f75b400be50 comp rx=0 tx=0).stop 2024-06-06T03:35:03.689 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.689+0000 7f75c1ce1640 1 --2- 172.21.15.50:0/1439632153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75bc1089a0 0x7f75bc119bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:03.689 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.689+0000 7f75c1ce1640 1 -- 172.21.15.50:0/1439632153 >> 172.21.15.50:0/1439632153 conn(0x7f75bc06ea10 msgr2=0x7f75bc10bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:03.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.687+0000 7f2931da2700 1 -- 172.21.15.50:0/3196885111 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f292c069180 con 0x7f292c110ff0 2024-06-06T03:35:03.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.691+0000 7f2929ffb700 1 -- 172.21.15.50:0/3196885111 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2920010a70 con 0x7f292c110ff0 2024-06-06T03:35:03.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.693+0000 7f2929ffb700 1 --2- 172.21.15.50:0/3196885111 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f29140a2df0 0x7f29140a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:03.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.693+0000 7f2929ffb700 1 -- 172.21.15.50:0/3196885111 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f29200cfb10 con 0x7f292c110ff0 2024-06-06T03:35:03.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.695+0000 7f2929ffb700 1 -- 172.21.15.50:0/3196885111 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f292009c710 con 0x7f292c110ff0 2024-06-06T03:35:03.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.696+0000 7f2930da0700 1 --2- 172.21.15.50:0/3196885111 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f29140a2df0 0x7f29140a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:03.696 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.697+0000 7f75c1ce1640 1 -- 172.21.15.50:0/1439632153 shutdown_connections 2024-06-06T03:35:03.696 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:03.697+0000 7f75c1ce1640 1 -- 172.21.15.50:0/1439632153 wait complete. 2024-06-06T03:35:03.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:03.697+0000 7f2930da0700 1 --2- 172.21.15.50:0/3196885111 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f29140a2df0 0x7f29140a52b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f292400ab90 tx=0x7f2924009250 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:04.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:04.197+0000 7f2931da2700 1 -- 172.21.15.50:0/3196885111 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f292c1abf10 con 0x7f292c110ff0 2024-06-06T03:35:04.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:04.199+0000 7f2929ffb700 1 -- 172.21.15.50:0/3196885111 <== mon.2 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11855 (secure 0 0 0) 0x7f292009c010 con 0x7f292c110ff0 2024-06-06T03:35:04.199 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:35:04.199 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1667847852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1667847852},{"type":"v1","addr":"172.21.15.50:6835","nonce":1667847852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/239971838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":239971838},{"type":"v1","addr":"172.21.15.50:6837","nonce":239971838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/2188134216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2188134216},{"type":"v1","addr":"172.21.15.50:6839","nonce":2188134216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/632572420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":632572420},{"type":"v1","addr":"172.21.15.50:6841","nonce":632572420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/864537078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":864537078},{"type":"v1","addr":"172.21.15.79:6833","nonce":864537078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/279268898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":279268898},{"type":"v1","addr":"172.21.15.79:6835","nonce":279268898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T03:22:36.202061+0000","modified":"2024-06-06T03:32:16.979722+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24490,"mds_1":24472,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/57533154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":57533154},{"type":"v1","addr":"172.21.15.122:6833","nonce":57533154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/3286722213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3286722213},{"type":"v1","addr":"172.21.15.79:6837","nonce":3286722213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/768067336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":768067336},{"type":"v1","addr":"172.21.15.79:6839","nonce":768067336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.122:6835/2987597320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2987597320},{"type":"v1","addr":"172.21.15.122:6835","nonce":2987597320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":23,"addr":"172.21.15.122:6837/1604366318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1604366318},{"type":"v1","addr":"172.21.15.122:6837","nonce":1604366318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6839/4129732900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":4129732900},{"type":"v1","addr":"172.21.15.122:6839","nonce":4129732900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24466,24472,24490]},"id":1}]} 2024-06-06T03:35:04.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:04.204+0000 7f2931da2700 1 -- 172.21.15.50:0/3196885111 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f29140a2df0 msgr2=0x7f29140a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:04.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:04.204+0000 7f2931da2700 1 --2- 172.21.15.50:0/3196885111 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f29140a2df0 0x7f29140a52b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f292400ab90 tx=0x7f2924009250 comp rx=0 tx=0).stop 2024-06-06T03:35:04.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:04.204+0000 7f2931da2700 1 -- 172.21.15.50:0/3196885111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f292c110ff0 msgr2=0x7f292c1178b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:04.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:04.204+0000 7f2931da2700 1 --2- 172.21.15.50:0/3196885111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f292c110ff0 0x7f292c1178b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f292000e9a0 tx=0x7f292000ed60 comp rx=0 tx=0).stop 2024-06-06T03:35:04.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:04.204+0000 7f2931da2700 1 -- 172.21.15.50:0/3196885111 shutdown_connections 2024-06-06T03:35:04.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:04.204+0000 7f2931da2700 1 --2- 172.21.15.50:0/3196885111 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f29140a2df0 0x7f29140a52b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:04.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:04.204+0000 7f2931da2700 1 --2- 172.21.15.50:0/3196885111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f292c11bc70 0x7f292c11ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:04.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:04.204+0000 7f2931da2700 1 --2- 172.21.15.50:0/3196885111 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f292c110b80 0x7f292c117370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:04.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:04.204+0000 7f2931da2700 1 --2- 172.21.15.50:0/3196885111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f292c110ff0 0x7f292c1178b0 secure :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f292000e9a0 tx=0x7f292000ed60 comp rx=0 tx=0).stop 2024-06-06T03:35:04.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:04.204+0000 7f2931da2700 1 -- 172.21.15.50:0/3196885111 >> 172.21.15.50:0/3196885111 conn(0x7f292c06d470 msgr2=0x7f292c072e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:04.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:04.207+0000 7f2931da2700 1 -- 172.21.15.50:0/3196885111 shutdown_connections 2024-06-06T03:35:04.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:04.207+0000 7f2931da2700 1 -- 172.21.15.50:0/3196885111 wait complete. 2024-06-06T03:35:04.213 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 33 2024-06-06T03:35:04.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:04 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3196885111' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:35:04.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:04 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/3196885111' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:35:04.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:04 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/3196885111' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:35:05.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:05 smithi050 ceph-mon[32421]: pgmap v684: 129 pgs: 129 active+clean; 10 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 29 MiB/s wr, 595 op/s 2024-06-06T03:35:05.627 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-06-06T03:35:05.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:05 smithi122 ceph-mon[35759]: pgmap v684: 129 pgs: 129 active+clean; 10 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 29 MiB/s wr, 595 op/s 2024-06-06T03:35:05.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:05 smithi079 ceph-mon[35478]: pgmap v684: 129 pgs: 129 active+clean; 10 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 29 MiB/s wr, 595 op/s 2024-06-06T03:35:06.353 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:35:06.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:06 smithi050 ceph-mon[32421]: pgmap v685: 129 pgs: 129 active+clean; 10 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 33 MiB/s wr, 698 op/s 2024-06-06T03:35:06.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:06 smithi079 ceph-mon[35478]: pgmap v685: 129 pgs: 129 active+clean; 10 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 33 MiB/s wr, 698 op/s 2024-06-06T03:35:06.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:06 smithi122 ceph-mon[35759]: pgmap v685: 129 pgs: 129 active+clean; 10 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 33 MiB/s wr, 698 op/s 2024-06-06T03:35:08.936 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:08 smithi050 ceph-mon[32421]: pgmap v686: 129 pgs: 129 active+clean; 10 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 27 MiB/s wr, 562 op/s 2024-06-06T03:35:09.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:08 smithi079 ceph-mon[35478]: pgmap v686: 129 pgs: 129 active+clean; 10 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 27 MiB/s wr, 562 op/s 2024-06-06T03:35:09.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:08 smithi122 ceph-mon[35759]: pgmap v686: 129 pgs: 129 active+clean; 10 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 27 MiB/s wr, 562 op/s 2024-06-06T03:35:10.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.239+0000 7f7381a40700 1 -- 172.21.15.50:0/2345083318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f737c105090 msgr2=0x7f737c1115a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:10.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.239+0000 7f7381a40700 1 --2- 172.21.15.50:0/2345083318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f737c105090 0x7f737c1115a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f737400b0a0 tx=0x7f737400b3b0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.242+0000 7f7381a40700 1 -- 172.21.15.50:0/2345083318 shutdown_connections 2024-06-06T03:35:10.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.242+0000 7f7381a40700 1 --2- 172.21.15.50:0/2345083318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f737c105090 0x7f737c1115a0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.242+0000 7f7381a40700 1 --2- 172.21.15.50:0/2345083318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f737c10a6d0 0x7f737c10aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.242+0000 7f7381a40700 1 --2- 172.21.15.50:0/2345083318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f737c1046d0 0x7f737c104b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.242+0000 7f7381a40700 1 -- 172.21.15.50:0/2345083318 >> 172.21.15.50:0/2345083318 conn(0x7f737c1001c0 msgr2=0x7f737c1025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:10.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.242+0000 7f7381a40700 1 -- 172.21.15.50:0/2345083318 shutdown_connections 2024-06-06T03:35:10.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.243+0000 7f7381a40700 1 -- 172.21.15.50:0/2345083318 wait complete. 2024-06-06T03:35:10.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.244+0000 7f7381a40700 1 Processor -- start 2024-06-06T03:35:10.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.244+0000 7f7381a40700 1 -- start start 2024-06-06T03:35:10.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.244+0000 7f7381a40700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f737c1046d0 0x7f737c111300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:10.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.244+0000 7f7381a40700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f737c105090 0x7f737c073b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:10.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.244+0000 7f7381a40700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f737c10a6d0 0x7f737c0740d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:10.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.244+0000 7f7381a40700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f737c06c380 con 0x7f737c10a6d0 2024-06-06T03:35:10.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.244+0000 7f7381a40700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f737c06c200 con 0x7f737c1046d0 2024-06-06T03:35:10.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.244+0000 7f7381a40700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f737c06c500 con 0x7f737c105090 2024-06-06T03:35:10.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.245+0000 7f737affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f737c1046d0 0x7f737c111300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:10.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.245+0000 7f737affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f737c1046d0 0x7f737c111300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:56884/0 (socket says 172.21.15.50:56884) 2024-06-06T03:35:10.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.245+0000 7f737affd700 1 -- 172.21.15.50:0/1155250932 learned_addr learned my addr 172.21.15.50:0/1155250932 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:10.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.247+0000 7f737a7fc700 1 --2- 172.21.15.50:0/1155250932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f737c105090 0x7f737c073b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:10.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.249+0000 7f737a7fc700 1 -- 172.21.15.50:0/1155250932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f737c1046d0 msgr2=0x7f737c111300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:10.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.249+0000 7f737a7fc700 1 --2- 172.21.15.50:0/1155250932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f737c1046d0 0x7f737c111300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.249+0000 7f737a7fc700 1 -- 172.21.15.50:0/1155250932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f737c10a6d0 msgr2=0x7f737c0740d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:10.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.250+0000 7f737a7fc700 1 --2- 172.21.15.50:0/1155250932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f737c10a6d0 0x7f737c0740d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.250+0000 7f737a7fc700 1 -- 172.21.15.50:0/1155250932 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f737c10e5e0 con 0x7f737c105090 2024-06-06T03:35:10.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.255+0000 7f737a7fc700 1 --2- 172.21.15.50:0/1155250932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f737c105090 0x7f737c073b90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7370006fd0 tx=0x7f737000b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:10.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.256+0000 7f7380a3e700 1 -- 172.21.15.50:0/1155250932 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7370015020 con 0x7f737c105090 2024-06-06T03:35:10.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.256+0000 7f7380a3e700 1 -- 172.21.15.50:0/1155250932 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7370011ce0 con 0x7f737c105090 2024-06-06T03:35:10.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.256+0000 7f7380a3e700 1 -- 172.21.15.50:0/1155250932 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7370010c70 con 0x7f737c105090 2024-06-06T03:35:10.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.256+0000 7f7381a40700 1 -- 172.21.15.50:0/1155250932 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f737c10e8d0 con 0x7f737c105090 2024-06-06T03:35:10.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.256+0000 7f7381a40700 1 -- 172.21.15.50:0/1155250932 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f737c10edc0 con 0x7f737c105090 2024-06-06T03:35:10.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.263+0000 7f738c2c3b80 1 Processor -- start 2024-06-06T03:35:10.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.266+0000 7f7380a3e700 1 -- 172.21.15.50:0/1155250932 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7370018020 con 0x7f737c105090 2024-06-06T03:35:10.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.267+0000 7f7380a3e700 1 --2- 172.21.15.50:0/1155250932 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f73640a2d60 0x7f73640a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:10.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.267+0000 7f7380a3e700 1 -- 172.21.15.50:0/1155250932 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f73700ce8e0 con 0x7f737c105090 2024-06-06T03:35:10.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.267+0000 7f738c2c3b80 1 -- start start 2024-06-06T03:35:10.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.267+0000 7f738c2c3b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56069c8c4640 0x56069c8c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:10.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.267+0000 7f738c2c3b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56069c8c4f60 0x56069c8be9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:10.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.267+0000 7f738c2c3b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56069c8bef20 0x56069c8bf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:10.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.267+0000 7f738c2c3b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56069c810810 con 0x56069c8bef20 2024-06-06T03:35:10.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.267+0000 7f738c2c3b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56069c7b8720 con 0x56069c8c4f60 2024-06-06T03:35:10.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.267+0000 7f738c2c3b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56069c80c7d0 con 0x56069c8c4640 2024-06-06T03:35:10.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.269+0000 7f737affd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56069c8c4640 0x56069c8c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:10.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.269+0000 7f737affd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56069c8c4640 0x56069c8c4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:35262/0 (socket says 172.21.15.50:35262) 2024-06-06T03:35:10.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.269+0000 7f737affd700 1 -- 172.21.15.50:0/237687324 learned_addr learned my addr 172.21.15.50:0/237687324 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:10.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.269+0000 7f737a7fc700 1 --2- 172.21.15.50:0/237687324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56069c8c4f60 0x56069c8be9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:10.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.269+0000 7f737b7fe700 1 --2- 172.21.15.50:0/1155250932 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f73640a2d60 0x7f73640a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:10.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.269+0000 7f737affd700 1 -- 172.21.15.50:0/237687324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56069c8c4f60 msgr2=0x56069c8be9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:10.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.269+0000 7f737affd700 1 --2- 172.21.15.50:0/237687324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56069c8c4f60 0x56069c8be9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.269+0000 7f737affd700 1 -- 172.21.15.50:0/237687324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56069c8bef20 msgr2=0x56069c8bf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:10.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.269+0000 7f737affd700 1 --2- 172.21.15.50:0/237687324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56069c8bef20 0x56069c8bf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.269+0000 7f737affd700 1 -- 172.21.15.50:0/237687324 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56069c7aef50 con 0x56069c8c4640 2024-06-06T03:35:10.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.270+0000 7f737affd700 1 --2- 172.21.15.50:0/237687324 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56069c8c4640 0x56069c8c4a20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f736c009ba0 tx=0x7f736c009eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3313e285f0d2425 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:10.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.270+0000 7f7361ffb700 1 -- 172.21.15.50:0/237687324 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736c017070 con 0x56069c8c4640 2024-06-06T03:35:10.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.270+0000 7f7361ffb700 1 -- 172.21.15.50:0/237687324 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f736c00edb0 con 0x56069c8c4640 2024-06-06T03:35:10.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.270+0000 7f7361ffb700 1 -- 172.21.15.50:0/237687324 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736c0123d0 con 0x56069c8c4640 2024-06-06T03:35:10.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.271+0000 7f737b7fe700 1 --2- 172.21.15.50:0/1155250932 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f73640a2d60 0x7f73640a5220 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f73740062a0 tx=0x7f7374006230 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:10.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.278+0000 7f738c2c3b80 1 -- 172.21.15.50:0/237687324 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56069c8c4640 msgr2=0x56069c8c4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:10.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.278+0000 7f738c2c3b80 1 --2- 172.21.15.50:0/237687324 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56069c8c4640 0x56069c8c4a20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f736c009ba0 tx=0x7f736c009eb0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.282+0000 7f738c2c3b80 1 -- 172.21.15.50:0/237687324 shutdown_connections 2024-06-06T03:35:10.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.282+0000 7f738c2c3b80 1 --2- 172.21.15.50:0/237687324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56069c8bef20 0x56069c8bf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.282+0000 7f738c2c3b80 1 --2- 172.21.15.50:0/237687324 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56069c8c4640 0x56069c8c4a20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.282+0000 7f738c2c3b80 1 --2- 172.21.15.50:0/237687324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56069c8c4f60 0x56069c8be9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.282+0000 7f738c2c3b80 1 -- 172.21.15.50:0/237687324 >> 172.21.15.50:0/237687324 conn(0x56069c7e9cc0 msgr2=0x56069c8b9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:10.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.285+0000 7f738c2c3b80 1 -- 172.21.15.50:0/237687324 shutdown_connections 2024-06-06T03:35:10.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.286+0000 7f738c2c3b80 1 -- 172.21.15.50:0/237687324 wait complete. 2024-06-06T03:35:10.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.287+0000 7f738c2c3b80 1 -- start start 2024-06-06T03:35:10.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.287+0000 7f738c2c3b80 1 Processor -- start 2024-06-06T03:35:10.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.288+0000 7f738c2c3b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56069c8bef20 0x56069c8cac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:10.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.288+0000 7f738c2c3b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56069c8c4640 0x56069c8c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:10.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.288+0000 7f738c2c3b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56069c8c4f60 0x56069c8c8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:10.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.288+0000 7f738c2c3b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56069c8cb9d0 con 0x56069c8bef20 2024-06-06T03:35:10.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.288+0000 7f738c2c3b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56069c7b0bf0 con 0x56069c8c4640 2024-06-06T03:35:10.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.288+0000 7f737b7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56069c8c4f60 0x56069c8c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:10.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.288+0000 7f737b7fe700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56069c8c4f60 0x56069c8c8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:35268/0 (socket says 172.21.15.50:35268) 2024-06-06T03:35:10.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.288+0000 7f737b7fe700 1 -- 172.21.15.50:0/2742529746 learned_addr learned my addr 172.21.15.50:0/2742529746 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:10.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.289+0000 7f737affd700 1 --2- 172.21.15.50:0/2742529746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56069c8bef20 0x56069c8cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:10.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.290+0000 7f737a7fc700 1 --2- 172.21.15.50:0/2742529746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56069c8c4640 0x56069c8c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:10.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.295+0000 7f738c2c3b80 1 -- 172.21.15.50:0/2742529746 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56069c8cbb50 con 0x56069c8c4f60 2024-06-06T03:35:10.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.296+0000 7f738c2c3b80 10 client.0 _ll_register_callbacks cb 0x56069c7aa920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:35:10.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.301+0000 7f737affd700 1 -- 172.21.15.50:0/2742529746 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56069c8c4f60 msgr2=0x56069c8c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:10.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.301+0000 7f737affd700 1 --2- 172.21.15.50:0/2742529746 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56069c8c4f60 0x56069c8c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.301+0000 7f737affd700 1 -- 172.21.15.50:0/2742529746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56069c8c4640 msgr2=0x56069c8c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:10.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.301+0000 7f737affd700 1 --2- 172.21.15.50:0/2742529746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56069c8c4640 0x56069c8c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.301+0000 7f737affd700 1 -- 172.21.15.50:0/2742529746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56069c75f8d0 con 0x56069c8bef20 2024-06-06T03:35:10.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.301+0000 7f737a7fc700 1 --2- 172.21.15.50:0/2742529746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56069c8c4640 0x56069c8c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:35:10.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.314+0000 7f737affd700 1 --2- 172.21.15.50:0/2742529746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56069c8bef20 0x56069c8cac40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f736c009b70 tx=0x7f736c00eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a3054438d17a4ff server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:10.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.314+0000 7f735affd700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:35:10.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.315+0000 7f735affd700 1 -- 172.21.15.50:0/2742529746 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736c017040 con 0x56069c8bef20 2024-06-06T03:35:10.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.315+0000 7f735affd700 1 -- 172.21.15.50:0/2742529746 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f736c01c450 con 0x56069c8bef20 2024-06-06T03:35:10.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.316+0000 7f738c2c3b80 1 -- 172.21.15.50:0/2742529746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f736c00edb0 con 0x56069c8bef20 2024-06-06T03:35:10.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.318+0000 7f735affd700 1 -- 172.21.15.50:0/2742529746 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f736c01c650 con 0x56069c8bef20 2024-06-06T03:35:10.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.319+0000 7f738c2c3b80 10 client.16536 fetch_fsmap learned FSMap version 33 2024-06-06T03:35:10.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.319+0000 7f738c2c3b80 1 -- 172.21.15.50:0/2742529746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56069c8d62a0 con 0x56069c8bef20 2024-06-06T03:35:10.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.327+0000 7f735affd700 1 -- 172.21.15.50:0/2742529746 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f736c01cca0 con 0x56069c8bef20 2024-06-06T03:35:10.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.327+0000 7f735affd700 1 -- 172.21.15.50:0/2742529746 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f736c023070 con 0x56069c8bef20 2024-06-06T03:35:10.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.328+0000 7f738c2c3b80 10 client.16536 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:35:10.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.328+0000 7f738c2c3b80 10 client.16536 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-06-06T03:35:10.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.328+0000 7f738c2c3b80 20 client.16536 populate_metadata read hostname 'smithi050' 2024-06-06T03:35:10.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.328+0000 7f738c2c3b80 1 --2- 172.21.15.50:0/2742529746 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x56069c8d8770 0x56069c8dab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:10.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.328+0000 7f738c2c3b80 4 client.16536 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:35:10.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.328+0000 7f738c2c3b80 1 -- 172.21.15.50:0/2742529746 --> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f736c00edb0 con 0x56069c8d8770 2024-06-06T03:35:10.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.328+0000 7f737a7fc700 1 --2- 172.21.15.50:0/2742529746 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x56069c8d8770 0x56069c8dab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:10.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.332+0000 7f737a7fc700 1 --2- 172.21.15.50:0/2742529746 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x56069c8d8770 0x56069c8dab60 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ee9d2346627d0cc6 server_cookie=a58a385594cac035 in_seq=0 out_seq=0 2024-06-06T03:35:10.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.332+0000 7f735affd700 10 client.16536 ms_handle_connect on v2:172.21.15.122:6834/2987597320 2024-06-06T03:35:10.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.332+0000 7f735affd700 1 -- 172.21.15.50:0/2742529746 <== mds.2 v2:172.21.15.122:6834/2987597320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x7f736c00edb0 con 0x56069c8d8770 2024-06-06T03:35:10.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.332+0000 7f735affd700 10 client.16536 handle_command_reply: tid=0 2024-06-06T03:35:10.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.332+0000 7f738c2c3b80 1 client.16536 shutdown 2024-06-06T03:35:10.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.333+0000 7f738c2c3b80 1 -- 172.21.15.50:0/2742529746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56069c8bef20 msgr2=0x56069c8cac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:10.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.333+0000 7f738c2c3b80 1 --2- 172.21.15.50:0/2742529746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56069c8bef20 0x56069c8cac40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f736c009b70 tx=0x7f736c00eb10 comp rx=0 tx=0).stop 2024-06-06T03:35:10.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.334+0000 7f738c2c3b80 1 -- 172.21.15.50:0/2742529746 shutdown_connections 2024-06-06T03:35:10.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.334+0000 7f738c2c3b80 1 --2- 172.21.15.50:0/2742529746 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56069c8c4f60 0x56069c8c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.334+0000 7f738c2c3b80 1 --2- 172.21.15.50:0/2742529746 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x56069c8d8770 0x56069c8dab60 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.334+0000 7f738c2c3b80 1 --2- 172.21.15.50:0/2742529746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56069c8bef20 0x56069c8cac40 secure :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f736c009b70 tx=0x7f736c00eb10 comp rx=0 tx=0).stop 2024-06-06T03:35:10.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.334+0000 7f735affd700 0 client.16536 ms_handle_reset on v2:172.21.15.122:6834/2987597320 2024-06-06T03:35:10.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.334+0000 7f738c2c3b80 1 --2- 172.21.15.50:0/2742529746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56069c8c4640 0x56069c8c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.334+0000 7f738c2c3b80 1 -- 172.21.15.50:0/2742529746 >> 172.21.15.50:0/2742529746 conn(0x56069c7e9cc0 msgr2=0x56069c8b95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:10.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.335+0000 7f738c2c3b80 1 -- 172.21.15.50:0/2742529746 shutdown_connections 2024-06-06T03:35:10.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.335+0000 7f738c2c3b80 1 -- 172.21.15.50:0/2742529746 wait complete. 2024-06-06T03:35:10.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.335+0000 7f738c2c3b80 20 client.16536 trim_cache size 0 max 16384 2024-06-06T03:35:10.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.366+0000 7f738c2c3b80 1 Processor -- start 2024-06-06T03:35:10.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.366+0000 7f738c2c3b80 1 -- start start 2024-06-06T03:35:10.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.366+0000 7f738c2c3b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56069c8c4640 0x56069c8be9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:10.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.366+0000 7f738c2c3b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56069c8c4f60 0x56069c8dab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:10.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.366+0000 7f738c2c3b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56069c8d8770 0x56069c8c5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:10.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.366+0000 7f738c2c3b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7368011350 con 0x56069c8d8770 2024-06-06T03:35:10.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.366+0000 7f738c2c3b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f736800ebe0 con 0x56069c8c4f60 2024-06-06T03:35:10.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.366+0000 7f738c2c3b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f736800ca30 con 0x56069c8c4640 2024-06-06T03:35:10.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.366+0000 7f737b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56069c8d8770 0x56069c8c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:10.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.366+0000 7f737b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56069c8d8770 0x56069c8c5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44902/0 (socket says 172.21.15.50:44902) 2024-06-06T03:35:10.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.366+0000 7f737b7fe700 1 -- 172.21.15.50:0/565417177 learned_addr learned my addr 172.21.15.50:0/565417177 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:10.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.367+0000 7f737b7fe700 1 -- 172.21.15.50:0/565417177 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56069c8c4640 msgr2=0x56069c8be9e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:35:10.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.367+0000 7f737b7fe700 1 --2- 172.21.15.50:0/565417177 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56069c8c4640 0x56069c8be9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.367+0000 7f737b7fe700 1 -- 172.21.15.50:0/565417177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56069c8c4f60 msgr2=0x56069c8dab60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:35:10.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.367+0000 7f737b7fe700 1 --2- 172.21.15.50:0/565417177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56069c8c4f60 0x56069c8dab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.367+0000 7f737b7fe700 1 -- 172.21.15.50:0/565417177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56069c8c64f0 con 0x56069c8d8770 2024-06-06T03:35:10.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.367+0000 7f737b7fe700 1 --2- 172.21.15.50:0/565417177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56069c8d8770 0x56069c8c5340 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7374009100 tx=0x7f737401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8431f503c6d3f0a7 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:10.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.368+0000 7f73617fa700 1 -- 172.21.15.50:0/565417177 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7374003d40 con 0x56069c8d8770 2024-06-06T03:35:10.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.368+0000 7f73617fa700 1 -- 172.21.15.50:0/565417177 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f737402d030 con 0x56069c8d8770 2024-06-06T03:35:10.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.368+0000 7f73617fa700 1 -- 172.21.15.50:0/565417177 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7374008c20 con 0x56069c8d8770 2024-06-06T03:35:10.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.369+0000 7f738c2c3b80 1 -- 172.21.15.50:0/565417177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56069c8d8770 msgr2=0x56069c8c5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:10.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.369+0000 7f738c2c3b80 1 --2- 172.21.15.50:0/565417177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56069c8d8770 0x56069c8c5340 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7374009100 tx=0x7f737401d000 comp rx=0 tx=0).stop 2024-06-06T03:35:10.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.371+0000 7f738c2c3b80 1 -- 172.21.15.50:0/565417177 shutdown_connections 2024-06-06T03:35:10.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.371+0000 7f738c2c3b80 1 --2- 172.21.15.50:0/565417177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56069c8d8770 0x56069c8c5340 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.371+0000 7f738c2c3b80 1 --2- 172.21.15.50:0/565417177 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56069c8c4640 0x56069c8be9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.371+0000 7f738c2c3b80 1 --2- 172.21.15.50:0/565417177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56069c8c4f60 0x56069c8dab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.371+0000 7f738c2c3b80 1 -- 172.21.15.50:0/565417177 >> 172.21.15.50:0/565417177 conn(0x56069c7e9cc0 msgr2=0x56069c8c6870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:10.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.371+0000 7f738c2c3b80 1 -- 172.21.15.50:0/565417177 shutdown_connections 2024-06-06T03:35:10.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.371+0000 7f738c2c3b80 1 -- 172.21.15.50:0/565417177 wait complete. 2024-06-06T03:35:10.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.372+0000 7f738c2c3b80 1 -- start start 2024-06-06T03:35:10.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.373+0000 7f738c2c3b80 1 Processor -- start 2024-06-06T03:35:10.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.373+0000 7f738c2c3b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56069c8c4640 0x56069c8d1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:10.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.374+0000 7f738c2c3b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56069c8c4f60 0x56069c8d1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:10.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.374+0000 7f737affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56069c8c4640 0x56069c8d1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:10.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.374+0000 7f737affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56069c8c4640 0x56069c8d1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:56916/0 (socket says 172.21.15.50:56916) 2024-06-06T03:35:10.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.374+0000 7f737affd700 1 -- 172.21.15.50:0/3485831162 learned_addr learned my addr 172.21.15.50:0/3485831162 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:10.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.374+0000 7f738c2c3b80 1 --2- 172.21.15.50:0/3485831162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56069c8d8770 0x56069c8df580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:10.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.374+0000 7f738c2c3b80 1 -- 172.21.15.50:0/3485831162 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f736800d0a0 con 0x56069c8c4f60 2024-06-06T03:35:10.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.374+0000 7f738c2c3b80 1 -- 172.21.15.50:0/3485831162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f736800e510 con 0x56069c8c4640 2024-06-06T03:35:10.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.374+0000 7f737b7fe700 1 --2- 172.21.15.50:0/3485831162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56069c8d8770 0x56069c8df580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:10.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.374+0000 7f738c2c3b80 1 -- 172.21.15.50:0/3485831162 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f736800d770 con 0x56069c8d8770 2024-06-06T03:35:10.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.375+0000 7f738c2c3b80 10 client.0 _ll_register_callbacks cb 0x56069c7aa920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:35:10.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.375+0000 7f737affd700 1 -- 172.21.15.50:0/3485831162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56069c8d8770 msgr2=0x56069c8df580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:10.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.375+0000 7f737affd700 1 --2- 172.21.15.50:0/3485831162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56069c8d8770 0x56069c8df580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.375+0000 7f737affd700 1 -- 172.21.15.50:0/3485831162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56069c8c4f60 msgr2=0x56069c8d1590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:35:10.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.375+0000 7f737affd700 1 --2- 172.21.15.50:0/3485831162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56069c8c4f60 0x56069c8d1590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.375+0000 7f737affd700 1 -- 172.21.15.50:0/3485831162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56069c8dfcb0 con 0x56069c8c4640 2024-06-06T03:35:10.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.375+0000 7f737affd700 1 --2- 172.21.15.50:0/3485831162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56069c8c4640 0x56069c8d1050 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f736c0090b0 tx=0x7f736c006e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fab11c0f1891de44 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:10.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.375+0000 7f738c2c3b80 1 -- 172.21.15.50:0/3485831162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f737402d030 con 0x56069c8c4640 2024-06-06T03:35:10.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.376+0000 7f735affd700 10 client.26216 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:35:10.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.376+0000 7f735affd700 1 -- 172.21.15.50:0/3485831162 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736c025440 con 0x56069c8c4640 2024-06-06T03:35:10.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.376+0000 7f735affd700 1 -- 172.21.15.50:0/3485831162 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f736c0255e0 con 0x56069c8c4640 2024-06-06T03:35:10.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.376+0000 7f735affd700 1 -- 172.21.15.50:0/3485831162 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f736c039050 con 0x56069c8c4640 2024-06-06T03:35:10.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.378+0000 7f738c2c3b80 10 client.26216 fetch_fsmap learned FSMap version 33 2024-06-06T03:35:10.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.378+0000 7f738c2c3b80 1 -- 172.21.15.50:0/3485831162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=33}) -- 0x56069c942a10 con 0x56069c8c4640 2024-06-06T03:35:10.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.378+0000 7f737b7fe700 1 --2- 172.21.15.50:0/3485831162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56069c8d8770 0x56069c8df580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:35:10.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.378+0000 7f735affd700 1 -- 172.21.15.50:0/3485831162 <== mon.2 v2:172.21.15.79:3300/0 4 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f736c023040 con 0x56069c8c4640 2024-06-06T03:35:10.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.378+0000 7f738c2c3b80 10 client.26216 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:35:10.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.378+0000 7f738c2c3b80 10 client.26216 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-06-06T03:35:10.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.378+0000 7f738c2c3b80 20 client.26216 populate_metadata read hostname 'smithi050' 2024-06-06T03:35:10.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.378+0000 7f738c2c3b80 1 --2- 172.21.15.50:0/3485831162 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x56069c942f10 0x56069c945300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:10.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.378+0000 7f738c2c3b80 4 client.26216 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:35:10.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.378+0000 7f738c2c3b80 1 -- 172.21.15.50:0/3485831162 --> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f737402d030 con 0x56069c942f10 2024-06-06T03:35:10.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.379+0000 7f737a7fc700 1 --2- 172.21.15.50:0/3485831162 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x56069c942f10 0x56069c945300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:10.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.379+0000 7f737a7fc700 1 --2- 172.21.15.50:0/3485831162 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x56069c942f10 0x56069c945300 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=868a3cc2210f2ba0 server_cookie=c5159b4206b501ba in_seq=0 out_seq=0 2024-06-06T03:35:10.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.380+0000 7f735affd700 10 client.26216 ms_handle_connect on v2:172.21.15.122:6834/2987597320 2024-06-06T03:35:10.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.380+0000 7f735affd700 1 -- 172.21.15.50:0/3485831162 <== mds.2 v2:172.21.15.122:6834/2987597320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f737402d030 con 0x56069c942f10 2024-06-06T03:35:10.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.380+0000 7f735affd700 10 client.26216 handle_command_reply: tid=0 2024-06-06T03:35:10.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.380+0000 7f738c2c3b80 1 client.26216 shutdown 2024-06-06T03:35:10.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.385+0000 7f738c2c3b80 1 -- 172.21.15.50:0/3485831162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56069c8c4640 msgr2=0x56069c8d1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:10.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.385+0000 7f738c2c3b80 1 --2- 172.21.15.50:0/3485831162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56069c8c4640 0x56069c8d1050 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f736c0090b0 tx=0x7f736c006e60 comp rx=0 tx=0).stop 2024-06-06T03:35:10.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.388+0000 7f738c2c3b80 1 -- 172.21.15.50:0/3485831162 shutdown_connections 2024-06-06T03:35:10.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.388+0000 7f738c2c3b80 1 --2- 172.21.15.50:0/3485831162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56069c8d8770 0x56069c8df580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.388+0000 7f738c2c3b80 1 --2- 172.21.15.50:0/3485831162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56069c8c4640 0x56069c8d1050 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.388+0000 7f738c2c3b80 1 --2- 172.21.15.50:0/3485831162 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x56069c942f10 0x56069c945300 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.388+0000 7f738c2c3b80 1 --2- 172.21.15.50:0/3485831162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56069c8c4f60 0x56069c8d1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.388+0000 7f738c2c3b80 1 -- 172.21.15.50:0/3485831162 >> 172.21.15.50:0/3485831162 conn(0x56069c7e9cc0 msgr2=0x56069c8c5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:10.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.388+0000 7f735affd700 0 client.26216 ms_handle_reset on v2:172.21.15.122:6834/2987597320 2024-06-06T03:35:10.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.388+0000 7f738c2c3b80 1 -- 172.21.15.50:0/3485831162 shutdown_connections 2024-06-06T03:35:10.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.392+0000 7f738c2c3b80 1 -- 172.21.15.50:0/3485831162 wait complete. 2024-06-06T03:35:10.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.392+0000 7f738c2c3b80 20 client.26216 trim_cache size 0 max 16384 2024-06-06T03:35:10.391 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:35:10.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.398+0000 7f7381a40700 1 -- 172.21.15.50:0/1155250932 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f73640a2d60 msgr2=0x7f73640a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:10.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.398+0000 7f7381a40700 1 --2- 172.21.15.50:0/1155250932 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f73640a2d60 0x7f73640a5220 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f73740062a0 tx=0x7f7374006230 comp rx=0 tx=0).stop 2024-06-06T03:35:10.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.398+0000 7f7381a40700 1 -- 172.21.15.50:0/1155250932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f737c105090 msgr2=0x7f737c073b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:10.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.398+0000 7f7381a40700 1 --2- 172.21.15.50:0/1155250932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f737c105090 0x7f737c073b90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7370006fd0 tx=0x7f737000b730 comp rx=0 tx=0).stop 2024-06-06T03:35:10.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.400+0000 7f7381a40700 1 -- 172.21.15.50:0/1155250932 shutdown_connections 2024-06-06T03:35:10.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.400+0000 7f7381a40700 1 --2- 172.21.15.50:0/1155250932 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f73640a2d60 0x7f73640a5220 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.400+0000 7f7381a40700 1 --2- 172.21.15.50:0/1155250932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f737c10a6d0 0x7f737c0740d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.400+0000 7f7381a40700 1 --2- 172.21.15.50:0/1155250932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f737c1046d0 0x7f737c111300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.400+0000 7f7381a40700 1 --2- 172.21.15.50:0/1155250932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f737c105090 0x7f737c073b90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:10.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.400+0000 7f7381a40700 1 -- 172.21.15.50:0/1155250932 >> 172.21.15.50:0/1155250932 conn(0x7f737c1001c0 msgr2=0x7f737c1006a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:10.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.401+0000 7f7381a40700 1 -- 172.21.15.50:0/1155250932 shutdown_connections 2024-06-06T03:35:10.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:10.402+0000 7f7381a40700 1 -- 172.21.15.50:0/1155250932 wait complete. 2024-06-06T03:35:11.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:10 smithi050 ceph-mon[32421]: pgmap v687: 129 pgs: 129 active+clean; 10 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 37 MiB/s wr, 759 op/s 2024-06-06T03:35:11.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:10 smithi079 ceph-mon[35478]: pgmap v687: 129 pgs: 129 active+clean; 10 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 37 MiB/s wr, 759 op/s 2024-06-06T03:35:11.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:10 smithi122 ceph-mon[35759]: pgmap v687: 129 pgs: 129 active+clean; 10 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 37 MiB/s wr, 759 op/s 2024-06-06T03:35:11.221 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-06-06T03:35:11.938 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:35:12.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:12 smithi050 ceph-mon[32421]: pgmap v688: 129 pgs: 129 active+clean; 10 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 28 MiB/s wr, 580 op/s 2024-06-06T03:35:13.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:12 smithi079 ceph-mon[35478]: pgmap v688: 129 pgs: 129 active+clean; 10 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 28 MiB/s wr, 580 op/s 2024-06-06T03:35:13.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:12 smithi122 ceph-mon[35759]: pgmap v688: 129 pgs: 129 active+clean; 10 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 28 MiB/s wr, 580 op/s 2024-06-06T03:35:14.937 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:14 smithi050 ceph-mon[32421]: pgmap v689: 129 pgs: 129 active+clean; 10 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 27 MiB/s wr, 560 op/s 2024-06-06T03:35:15.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:14 smithi079 ceph-mon[35478]: pgmap v689: 129 pgs: 129 active+clean; 10 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 27 MiB/s wr, 560 op/s 2024-06-06T03:35:15.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:14 smithi122 ceph-mon[35759]: pgmap v689: 129 pgs: 129 active+clean; 10 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 27 MiB/s wr, 560 op/s 2024-06-06T03:35:15.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.518+0000 7f7303a4e700 1 -- 172.21.15.50:0/1381842737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72fc107400 msgr2=0x7f72fc1077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:15.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.518+0000 7f7303a4e700 1 --2- 172.21.15.50:0/1381842737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72fc107400 0x7f72fc1077e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f72f801a9a0 tx=0x7f72f801acb0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.519+0000 7f7303a4e700 1 -- 172.21.15.50:0/1381842737 shutdown_connections 2024-06-06T03:35:15.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.519+0000 7f7303a4e700 1 --2- 172.21.15.50:0/1381842737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72fc101d60 0x7f72fc10e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.519+0000 7f7303a4e700 1 --2- 172.21.15.50:0/1381842737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72fc107400 0x7f72fc1077e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.519+0000 7f7303a4e700 1 --2- 172.21.15.50:0/1381842737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72fc1013c0 0x7f72fc101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.519+0000 7f7303a4e700 1 -- 172.21.15.50:0/1381842737 >> 172.21.15.50:0/1381842737 conn(0x7f72fc078330 msgr2=0x7f72fc078740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:15.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.519+0000 7f7303a4e700 1 -- 172.21.15.50:0/1381842737 shutdown_connections 2024-06-06T03:35:15.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.519+0000 7f7303a4e700 1 -- 172.21.15.50:0/1381842737 wait complete. 2024-06-06T03:35:15.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.520+0000 7f7303a4e700 1 Processor -- start 2024-06-06T03:35:15.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.520+0000 7f7303a4e700 1 -- start start 2024-06-06T03:35:15.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.520+0000 7f7303a4e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72fc1013c0 0x7f72fc1b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:15.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.520+0000 7f7303a4e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72fc101d60 0x7f72fc1b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:15.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.520+0000 7f7303a4e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72fc107400 0x7f72fc1b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:15.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.521+0000 7f7303a4e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f72fc06e6d0 con 0x7f72fc1013c0 2024-06-06T03:35:15.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.521+0000 7f7303a4e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f72fc06e550 con 0x7f72fc107400 2024-06-06T03:35:15.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.521+0000 7f7303a4e700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f72fc06e850 con 0x7f72fc101d60 2024-06-06T03:35:15.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.523+0000 7f7301feb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72fc107400 0x7f72fc1b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:15.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.523+0000 7f7301feb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72fc107400 0x7f72fc1b65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:56920/0 (socket says 172.21.15.50:56920) 2024-06-06T03:35:15.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.523+0000 7f7301feb700 1 -- 172.21.15.50:0/530290159 learned_addr learned my addr 172.21.15.50:0/530290159 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:15.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.523+0000 7f7301feb700 1 -- 172.21.15.50:0/530290159 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72fc101d60 msgr2=0x7f72fc1b6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:15.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.523+0000 7f7301feb700 1 --2- 172.21.15.50:0/530290159 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72fc101d60 0x7f72fc1b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.523+0000 7f7301feb700 1 -- 172.21.15.50:0/530290159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72fc1013c0 msgr2=0x7f72fc1b5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:15.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.523+0000 7f7301feb700 1 --2- 172.21.15.50:0/530290159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72fc1013c0 0x7f72fc1b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.523+0000 7f7301feb700 1 -- 172.21.15.50:0/530290159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72fc10cbe0 con 0x7f72fc107400 2024-06-06T03:35:15.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.531+0000 7f7301feb700 1 --2- 172.21.15.50:0/530290159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72fc107400 0x7f72fc1b65d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f72f4007ee0 tx=0x7f72f400d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:15.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.535+0000 7f72f27fc700 1 -- 172.21.15.50:0/530290159 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f400dbd0 con 0x7f72fc107400 2024-06-06T03:35:15.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.536+0000 7f72f27fc700 1 -- 172.21.15.50:0/530290159 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f72f400dd70 con 0x7f72fc107400 2024-06-06T03:35:15.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.537+0000 7f72f27fc700 1 -- 172.21.15.50:0/530290159 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f4005a20 con 0x7f72fc107400 2024-06-06T03:35:15.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.537+0000 7f7303a4e700 1 -- 172.21.15.50:0/530290159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72fc10ced0 con 0x7f72fc107400 2024-06-06T03:35:15.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.537+0000 7f7303a4e700 1 -- 172.21.15.50:0/530290159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72fc10d390 con 0x7f72fc107400 2024-06-06T03:35:15.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.543+0000 7f730e2d1b80 1 Processor -- start 2024-06-06T03:35:15.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.545+0000 7f72f27fc700 1 -- 172.21.15.50:0/530290159 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f72f401a060 con 0x7f72fc107400 2024-06-06T03:35:15.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.546+0000 7f72f27fc700 1 --2- 172.21.15.50:0/530290159 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f72e80a2c80 0x7f72e80a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:15.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.546+0000 7f72f27fc700 1 -- 172.21.15.50:0/530290159 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f72f40ce300 con 0x7f72fc107400 2024-06-06T03:35:15.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.548+0000 7f730e2d1b80 1 -- start start 2024-06-06T03:35:15.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.549+0000 7f730e2d1b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625fdb3ef60 0x5625fdb3f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:15.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.549+0000 7f730e2d1b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fdb3f880 0x5625fdb39260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:15.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.549+0000 7f730e2d1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625fdb397a0 0x5625fdb39bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:15.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.549+0000 7f730e2d1b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5625fda2bf60 con 0x5625fdb3f880 2024-06-06T03:35:15.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.549+0000 7f730e2d1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5625fda8a850 con 0x5625fdb397a0 2024-06-06T03:35:15.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.549+0000 7f730e2d1b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5625fd9f2460 con 0x5625fdb3ef60 2024-06-06T03:35:15.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.550+0000 7f73017ea700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625fdb3ef60 0x5625fdb3f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:15.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.550+0000 7f73017ea700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625fdb3ef60 0x5625fdb3f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:35284/0 (socket says 172.21.15.50:35284) 2024-06-06T03:35:15.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.550+0000 7f73017ea700 1 -- 172.21.15.50:0/2344691386 learned_addr learned my addr 172.21.15.50:0/2344691386 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:15.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.551+0000 7f7300fe9700 1 --2- 172.21.15.50:0/530290159 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f72e80a2c80 0x7f72e80a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:15.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.555+0000 7f7301feb700 1 --2- 172.21.15.50:0/2344691386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625fdb397a0 0x5625fdb39bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:15.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.556+0000 7f73017ea700 1 -- 172.21.15.50:0/2344691386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625fdb397a0 msgr2=0x5625fdb39bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:15.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.556+0000 7f73017ea700 1 --2- 172.21.15.50:0/2344691386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625fdb397a0 0x5625fdb39bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.556+0000 7f73017ea700 1 -- 172.21.15.50:0/2344691386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fdb3f880 msgr2=0x5625fdb39260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:15.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.556+0000 7f73017ea700 1 --2- 172.21.15.50:0/2344691386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fdb3f880 0x5625fdb39260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.556+0000 7f73017ea700 1 -- 172.21.15.50:0/2344691386 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625fd9d98d0 con 0x5625fdb3ef60 2024-06-06T03:35:15.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.557+0000 7f73017ea700 1 --2- 172.21.15.50:0/2344691386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625fdb3ef60 0x5625fdb3f340 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f72f8005b40 tx=0x7f72f8005c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=320a38b031f72980 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:15.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.557+0000 7f72e77fe700 1 -- 172.21.15.50:0/2344691386 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f8003a50 con 0x5625fdb3ef60 2024-06-06T03:35:15.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.557+0000 7f72e77fe700 1 -- 172.21.15.50:0/2344691386 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f72f8003bf0 con 0x5625fdb3ef60 2024-06-06T03:35:15.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.557+0000 7f72e77fe700 1 -- 172.21.15.50:0/2344691386 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f800f460 con 0x5625fdb3ef60 2024-06-06T03:35:15.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.563+0000 7f730e2d1b80 1 -- 172.21.15.50:0/2344691386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625fdb3ef60 msgr2=0x5625fdb3f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:15.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.563+0000 7f730e2d1b80 1 --2- 172.21.15.50:0/2344691386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625fdb3ef60 0x5625fdb3f340 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f72f8005b40 tx=0x7f72f8005c60 comp rx=0 tx=0).stop 2024-06-06T03:35:15.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.569+0000 7f730e2d1b80 1 -- 172.21.15.50:0/2344691386 shutdown_connections 2024-06-06T03:35:15.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.569+0000 7f730e2d1b80 1 --2- 172.21.15.50:0/2344691386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625fdb397a0 0x5625fdb39bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.569+0000 7f730e2d1b80 1 --2- 172.21.15.50:0/2344691386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625fdb3ef60 0x5625fdb3f340 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.569+0000 7f730e2d1b80 1 --2- 172.21.15.50:0/2344691386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fdb3f880 0x5625fdb39260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.569+0000 7f730e2d1b80 1 -- 172.21.15.50:0/2344691386 >> 172.21.15.50:0/2344691386 conn(0x5625fda66080 msgr2=0x5625fdb34220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:15.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.571+0000 7f7300fe9700 1 --2- 172.21.15.50:0/530290159 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f72e80a2c80 0x7f72e80a5140 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f72fc06b410 tx=0x7f72ec0092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:15.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.572+0000 7f730e2d1b80 1 -- 172.21.15.50:0/2344691386 shutdown_connections 2024-06-06T03:35:15.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.575+0000 7f730e2d1b80 1 -- 172.21.15.50:0/2344691386 wait complete. 2024-06-06T03:35:15.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.575+0000 7f730e2d1b80 1 -- start start 2024-06-06T03:35:15.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.576+0000 7f730e2d1b80 1 Processor -- start 2024-06-06T03:35:15.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.577+0000 7f730e2d1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625fdb397a0 0x5625fdb455d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:15.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.577+0000 7f730e2d1b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625fdb3ef60 0x5625fdb428d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:15.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.577+0000 7f730e2d1b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fdb3f880 0x5625fdb42e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:15.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.577+0000 7f730e2d1b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5625fda2afc0 con 0x5625fdb3f880 2024-06-06T03:35:15.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.577+0000 7f730e2d1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5625fda86810 con 0x5625fdb397a0 2024-06-06T03:35:15.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.577+0000 7f730e2d1b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5625fdb46200 con 0x5625fdb3ef60 2024-06-06T03:35:15.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.577+0000 7f730e2d1b80 10 client.0 _ll_register_callbacks cb 0x5625fda205b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:35:15.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.577+0000 7f7301feb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fdb3f880 0x5625fdb42e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.577+0000 7f7301feb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fdb3f880 0x5625fdb42e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44944/0 (socket says 172.21.15.50:44944) 2024-06-06T03:35:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.577+0000 7f7301feb700 1 -- 172.21.15.50:0/1883797926 learned_addr learned my addr 172.21.15.50:0/1883797926 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.577+0000 7f73017ea700 1 --2- 172.21.15.50:0/1883797926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625fdb397a0 0x5625fdb455d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.578+0000 7f7300fe9700 1 --2- 172.21.15.50:0/1883797926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625fdb3ef60 0x5625fdb428d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:15.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.582+0000 7f7301feb700 1 -- 172.21.15.50:0/1883797926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625fdb3ef60 msgr2=0x5625fdb428d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:15.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.582+0000 7f7301feb700 1 --2- 172.21.15.50:0/1883797926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625fdb3ef60 0x5625fdb428d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.582+0000 7f7301feb700 1 -- 172.21.15.50:0/1883797926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625fdb397a0 msgr2=0x5625fdb455d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:15.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.582+0000 7f7301feb700 1 --2- 172.21.15.50:0/1883797926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625fdb397a0 0x5625fdb455d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.582+0000 7f7301feb700 1 -- 172.21.15.50:0/1883797926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625fda50750 con 0x5625fdb3f880 2024-06-06T03:35:15.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.587+0000 7f7301feb700 1 --2- 172.21.15.50:0/1883797926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fdb3f880 0x5625fdb42e10 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f72f4005c30 tx=0x7f72f409a850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfcf9c43eefd6db8 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:15.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.591+0000 7f72e4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:35:15.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.591+0000 7f72e4ff9700 1 -- 172.21.15.50:0/1883797926 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f40b3060 con 0x5625fdb3f880 2024-06-06T03:35:15.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.591+0000 7f730e2d1b80 1 -- 172.21.15.50:0/1883797926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72f8003bf0 con 0x5625fdb3f880 2024-06-06T03:35:15.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.592+0000 7f72e4ff9700 1 -- 172.21.15.50:0/1883797926 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f72f409a9e0 con 0x5625fdb3f880 2024-06-06T03:35:15.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.596+0000 7f72e4ff9700 1 -- 172.21.15.50:0/1883797926 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f72f40b8050 con 0x5625fdb3f880 2024-06-06T03:35:15.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.596+0000 7f730e2d1b80 10 client.16542 fetch_fsmap learned FSMap version 33 2024-06-06T03:35:15.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.596+0000 7f730e2d1b80 1 -- 172.21.15.50:0/1883797926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5625fdb509a0 con 0x5625fdb3f880 2024-06-06T03:35:15.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.597+0000 7f72e4ff9700 1 -- 172.21.15.50:0/1883797926 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f72f8003bf0 con 0x5625fdb3f880 2024-06-06T03:35:15.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.598+0000 7f72e4ff9700 1 -- 172.21.15.50:0/1883797926 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f72f4096040 con 0x5625fdb3f880 2024-06-06T03:35:15.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.598+0000 7f730e2d1b80 10 client.16542 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:35:15.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.598+0000 7f730e2d1b80 10 client.16542 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-06-06T03:35:15.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.598+0000 7f730e2d1b80 20 client.16542 populate_metadata read hostname 'smithi050' 2024-06-06T03:35:15.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.598+0000 7f730e2d1b80 1 --2- 172.21.15.50:0/1883797926 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x5625fdb53390 0x5625fdb557d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:15.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.598+0000 7f730e2d1b80 4 client.16542 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:35:15.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.598+0000 7f730e2d1b80 1 -- 172.21.15.50:0/1883797926 --> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625fda97d50 con 0x5625fdb53390 2024-06-06T03:35:15.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.599+0000 7f73017ea700 1 --2- 172.21.15.50:0/1883797926 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x5625fdb53390 0x5625fdb557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:15.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.605+0000 7f73017ea700 1 --2- 172.21.15.50:0/1883797926 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x5625fdb53390 0x5625fdb557d0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c75deeaab24b99c6 server_cookie=de67082402f63b06 in_seq=0 out_seq=0 2024-06-06T03:35:15.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.605+0000 7f72e4ff9700 10 client.16542 ms_handle_connect on v2:172.21.15.122:6836/1604366318 2024-06-06T03:35:15.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.606+0000 7f72e4ff9700 1 -- 172.21.15.50:0/1883797926 <== mds.1 v2:172.21.15.122:6836/1604366318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5625fda97d50 con 0x5625fdb53390 2024-06-06T03:35:15.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.606+0000 7f72e4ff9700 10 client.16542 handle_command_reply: tid=0 2024-06-06T03:35:15.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.606+0000 7f730e2d1b80 1 client.16542 shutdown 2024-06-06T03:35:15.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.606+0000 7f730e2d1b80 1 -- 172.21.15.50:0/1883797926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fdb3f880 msgr2=0x5625fdb42e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:15.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.606+0000 7f730e2d1b80 1 --2- 172.21.15.50:0/1883797926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fdb3f880 0x5625fdb42e10 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f72f4005c30 tx=0x7f72f409a850 comp rx=0 tx=0).stop 2024-06-06T03:35:15.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.606+0000 7f730e2d1b80 1 -- 172.21.15.50:0/1883797926 shutdown_connections 2024-06-06T03:35:15.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.606+0000 7f730e2d1b80 1 --2- 172.21.15.50:0/1883797926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fdb3f880 0x5625fdb42e10 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.606+0000 7f730e2d1b80 1 --2- 172.21.15.50:0/1883797926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625fdb397a0 0x5625fdb455d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.606+0000 7f730e2d1b80 1 --2- 172.21.15.50:0/1883797926 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x5625fdb53390 0x5625fdb557d0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.606+0000 7f730e2d1b80 1 --2- 172.21.15.50:0/1883797926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625fdb3ef60 0x5625fdb428d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.606+0000 7f730e2d1b80 1 -- 172.21.15.50:0/1883797926 >> 172.21.15.50:0/1883797926 conn(0x5625fda66080 msgr2=0x5625fdb33700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:15.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.607+0000 7f72e4ff9700 0 client.16542 ms_handle_reset on v2:172.21.15.122:6836/1604366318 2024-06-06T03:35:15.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.607+0000 7f730e2d1b80 1 -- 172.21.15.50:0/1883797926 shutdown_connections 2024-06-06T03:35:15.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.608+0000 7f730e2d1b80 1 -- 172.21.15.50:0/1883797926 wait complete. 2024-06-06T03:35:15.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.609+0000 7f730e2d1b80 20 client.16542 trim_cache size 0 max 16384 2024-06-06T03:35:15.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.638+0000 7f730e2d1b80 1 Processor -- start 2024-06-06T03:35:15.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.640+0000 7f730e2d1b80 1 -- start start 2024-06-06T03:35:15.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.640+0000 7f730e2d1b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625fdb397a0 0x5625fdb40370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:15.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.640+0000 7f730e2d1b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fdb3ef60 0x5625fdb33e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:15.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.640+0000 7f730e2d1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625fdb3f880 0x5625fdb343c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:15.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.640+0000 7f730e2d1b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f72fc1d8d80 con 0x5625fdb3ef60 2024-06-06T03:35:15.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.640+0000 7f730e2d1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f72fc1c15e0 con 0x5625fdb3f880 2024-06-06T03:35:15.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.640+0000 7f730e2d1b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f72fc1bf430 con 0x5625fdb397a0 2024-06-06T03:35:15.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.640+0000 7f7301feb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625fdb3f880 0x5625fdb343c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:15.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.640+0000 7f7301feb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625fdb3f880 0x5625fdb343c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:56938/0 (socket says 172.21.15.50:56938) 2024-06-06T03:35:15.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.640+0000 7f7301feb700 1 -- 172.21.15.50:0/3299239494 learned_addr learned my addr 172.21.15.50:0/3299239494 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:15.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.641+0000 7f7301feb700 1 -- 172.21.15.50:0/3299239494 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625fdb397a0 msgr2=0x5625fdb40370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:15.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.641+0000 7f7301feb700 1 --2- 172.21.15.50:0/3299239494 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625fdb397a0 0x5625fdb40370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.641+0000 7f7301feb700 1 -- 172.21.15.50:0/3299239494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fdb3ef60 msgr2=0x5625fdb33e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:15.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.641+0000 7f7301feb700 1 --2- 172.21.15.50:0/3299239494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fdb3ef60 0x5625fdb33e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.641+0000 7f7301feb700 1 -- 172.21.15.50:0/3299239494 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625fdb395a0 con 0x5625fdb3f880 2024-06-06T03:35:15.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.643+0000 7f7301feb700 1 --2- 172.21.15.50:0/3299239494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625fdb3f880 0x5625fdb343c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f72f409a480 tx=0x7f72f40cbcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bffa97b2ba2f7a3 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:15.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.644+0000 7f72e6ffd700 1 -- 172.21.15.50:0/3299239494 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f40a2f60 con 0x5625fdb3f880 2024-06-06T03:35:15.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.644+0000 7f72e6ffd700 1 -- 172.21.15.50:0/3299239494 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f72f4005c60 con 0x5625fdb3f880 2024-06-06T03:35:15.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.645+0000 7f730e2d1b80 1 -- 172.21.15.50:0/3299239494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625fdb3f880 msgr2=0x5625fdb343c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:15.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.645+0000 7f730e2d1b80 1 --2- 172.21.15.50:0/3299239494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625fdb3f880 0x5625fdb343c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f72f409a480 tx=0x7f72f40cbcc0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.645+0000 7f730e2d1b80 1 -- 172.21.15.50:0/3299239494 shutdown_connections 2024-06-06T03:35:15.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.645+0000 7f730e2d1b80 1 --2- 172.21.15.50:0/3299239494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625fdb3f880 0x5625fdb343c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.645+0000 7f730e2d1b80 1 --2- 172.21.15.50:0/3299239494 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625fdb397a0 0x5625fdb40370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.645+0000 7f730e2d1b80 1 --2- 172.21.15.50:0/3299239494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fdb3ef60 0x5625fdb33e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.645+0000 7f730e2d1b80 1 -- 172.21.15.50:0/3299239494 >> 172.21.15.50:0/3299239494 conn(0x5625fda66080 msgr2=0x5625fdb3fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:15.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.646+0000 7f730e2d1b80 1 -- 172.21.15.50:0/3299239494 shutdown_connections 2024-06-06T03:35:15.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.650+0000 7f730e2d1b80 1 -- 172.21.15.50:0/3299239494 wait complete. 2024-06-06T03:35:15.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.650+0000 7f730e2d1b80 1 -- start start 2024-06-06T03:35:15.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.650+0000 7f730e2d1b80 1 Processor -- start 2024-06-06T03:35:15.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.651+0000 7f730e2d1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625fdb397a0 0x5625fdb4b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:15.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.651+0000 7f730e2d1b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625fdb4ba00 0x5625fdb5a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:15.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.651+0000 7f730e2d1b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fdb5a710 0x5625fdb5ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:15.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.651+0000 7f730e2d1b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f72fc1bfaa0 con 0x5625fdb5a710 2024-06-06T03:35:15.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.651+0000 7f730e2d1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f72fc1c0f10 con 0x5625fdb397a0 2024-06-06T03:35:15.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.651+0000 7f730e2d1b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f72fc1c0170 con 0x5625fdb4ba00 2024-06-06T03:35:15.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.651+0000 7f730e2d1b80 10 client.0 _ll_register_callbacks cb 0x5625fda205b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:35:15.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.652+0000 7f7301feb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fdb5a710 0x5625fdb5ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:15.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.652+0000 7f7301feb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fdb5a710 0x5625fdb5ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44956/0 (socket says 172.21.15.50:44956) 2024-06-06T03:35:15.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.652+0000 7f7301feb700 1 -- 172.21.15.50:0/3330295858 learned_addr learned my addr 172.21.15.50:0/3330295858 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:15.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.652+0000 7f7300fe9700 1 --2- 172.21.15.50:0/3330295858 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625fdb4ba00 0x5625fdb5a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:15.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.652+0000 7f73017ea700 1 --2- 172.21.15.50:0/3330295858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625fdb397a0 0x5625fdb4b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:15.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.656+0000 7f7300fe9700 1 -- 172.21.15.50:0/3330295858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625fdb397a0 msgr2=0x5625fdb4b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:15.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.656+0000 7f7300fe9700 1 --2- 172.21.15.50:0/3330295858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625fdb397a0 0x5625fdb4b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.656+0000 7f7300fe9700 1 -- 172.21.15.50:0/3330295858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fdb5a710 msgr2=0x5625fdb5ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:15.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.656+0000 7f7300fe9700 1 --2- 172.21.15.50:0/3330295858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fdb5a710 0x5625fdb5ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.656+0000 7f7300fe9700 1 -- 172.21.15.50:0/3330295858 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625fdb4c090 con 0x5625fdb4ba00 2024-06-06T03:35:15.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.663+0000 7f7300fe9700 1 --2- 172.21.15.50:0/3330295858 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625fdb4ba00 0x5625fdb5a1d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x5625fdb35ad0 tx=0x7f72ec0048d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce18d3dac799708d server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:15.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.663+0000 7f72e4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:35:15.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.664+0000 7f72e4ff9700 1 -- 172.21.15.50:0/3330295858 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ec025060 con 0x5625fdb4ba00 2024-06-06T03:35:15.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.665+0000 7f730e2d1b80 1 -- 172.21.15.50:0/3330295858 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5625fda922d0 con 0x5625fdb4ba00 2024-06-06T03:35:15.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.665+0000 7f72e4ff9700 1 -- 172.21.15.50:0/3330295858 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f72ec015c90 con 0x5625fdb4ba00 2024-06-06T03:35:15.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.674+0000 7f72e4ff9700 1 -- 172.21.15.50:0/3330295858 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f72ec02c050 con 0x5625fdb4ba00 2024-06-06T03:35:15.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.675+0000 7f730e2d1b80 10 client.26230 fetch_fsmap learned FSMap version 33 2024-06-06T03:35:15.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.675+0000 7f730e2d1b80 1 -- 172.21.15.50:0/3330295858 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5625fdbbe1a0 con 0x5625fdb4ba00 2024-06-06T03:35:15.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.684+0000 7f72e4ff9700 1 -- 172.21.15.50:0/3330295858 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x5625fda922d0 con 0x5625fdb4ba00 2024-06-06T03:35:15.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.684+0000 7f72e4ff9700 1 -- 172.21.15.50:0/3330295858 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f72ec01f070 con 0x5625fdb4ba00 2024-06-06T03:35:15.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.684+0000 7f730e2d1b80 10 client.26230 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:35:15.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.684+0000 7f730e2d1b80 10 client.26230 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-06-06T03:35:15.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.684+0000 7f730e2d1b80 20 client.26230 populate_metadata read hostname 'smithi050' 2024-06-06T03:35:15.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.684+0000 7f730e2d1b80 1 --2- 172.21.15.50:0/3330295858 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x5625fdbbe890 0x5625fdbc0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:15.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.684+0000 7f730e2d1b80 4 client.26230 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:35:15.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.684+0000 7f730e2d1b80 1 -- 172.21.15.50:0/3330295858 --> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5625fda45f50 con 0x5625fdbbe890 2024-06-06T03:35:15.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.686+0000 7f73017ea700 1 --2- 172.21.15.50:0/3330295858 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x5625fdbbe890 0x5625fdbc0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:15.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.688+0000 7f73017ea700 1 --2- 172.21.15.50:0/3330295858 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x5625fdbbe890 0x5625fdbc0cb0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b4682577f14a02ee server_cookie=17d9272b03d2fc7 in_seq=0 out_seq=0 2024-06-06T03:35:15.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.689+0000 7f72e4ff9700 10 client.26230 ms_handle_connect on v2:172.21.15.122:6836/1604366318 2024-06-06T03:35:15.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.689+0000 7f72e4ff9700 1 -- 172.21.15.50:0/3330295858 <== mds.1 v2:172.21.15.122:6836/1604366318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5625fda45f50 con 0x5625fdbbe890 2024-06-06T03:35:15.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.689+0000 7f72e4ff9700 10 client.26230 handle_command_reply: tid=0 2024-06-06T03:35:15.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.690+0000 7f730e2d1b80 1 client.26230 shutdown 2024-06-06T03:35:15.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.690+0000 7f730e2d1b80 1 -- 172.21.15.50:0/3330295858 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625fdb4ba00 msgr2=0x5625fdb5a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:15.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.690+0000 7f730e2d1b80 1 --2- 172.21.15.50:0/3330295858 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625fdb4ba00 0x5625fdb5a1d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x5625fdb35ad0 tx=0x7f72ec0048d0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.692+0000 7f730e2d1b80 1 -- 172.21.15.50:0/3330295858 shutdown_connections 2024-06-06T03:35:15.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.692+0000 7f730e2d1b80 1 --2- 172.21.15.50:0/3330295858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fdb5a710 0x5625fdb5ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.692+0000 7f730e2d1b80 1 --2- 172.21.15.50:0/3330295858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625fdb397a0 0x5625fdb4b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.692+0000 7f730e2d1b80 1 --2- 172.21.15.50:0/3330295858 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x5625fdbbe890 0x5625fdbc0cb0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.692+0000 7f730e2d1b80 1 --2- 172.21.15.50:0/3330295858 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625fdb4ba00 0x5625fdb5a1d0 secure :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0x5625fdb35ad0 tx=0x7f72ec0048d0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.692+0000 7f730e2d1b80 1 -- 172.21.15.50:0/3330295858 >> 172.21.15.50:0/3330295858 conn(0x5625fda66080 msgr2=0x5625fdb44990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:15.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.692+0000 7f72e4ff9700 0 client.26230 ms_handle_reset on v2:172.21.15.122:6836/1604366318 2024-06-06T03:35:15.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.693+0000 7f730e2d1b80 1 -- 172.21.15.50:0/3330295858 shutdown_connections 2024-06-06T03:35:15.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.693+0000 7f730e2d1b80 1 -- 172.21.15.50:0/3330295858 wait complete. 2024-06-06T03:35:15.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.694+0000 7f730e2d1b80 20 client.26230 trim_cache size 0 max 16384 2024-06-06T03:35:15.696 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:35:15.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.696+0000 7f7303a4e700 1 -- 172.21.15.50:0/530290159 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f72e80a2c80 msgr2=0x7f72e80a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:15.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.696+0000 7f7303a4e700 1 --2- 172.21.15.50:0/530290159 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f72e80a2c80 0x7f72e80a5140 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f72fc06b410 tx=0x7f72ec0092b0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.696+0000 7f7303a4e700 1 -- 172.21.15.50:0/530290159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72fc107400 msgr2=0x7f72fc1b65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:15.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.696+0000 7f7303a4e700 1 --2- 172.21.15.50:0/530290159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72fc107400 0x7f72fc1b65d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f72f4007ee0 tx=0x7f72f400d3b0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.697+0000 7f7303a4e700 1 -- 172.21.15.50:0/530290159 shutdown_connections 2024-06-06T03:35:15.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.697+0000 7f7303a4e700 1 --2- 172.21.15.50:0/530290159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72fc107400 0x7f72fc1b65d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.697+0000 7f7303a4e700 1 --2- 172.21.15.50:0/530290159 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f72e80a2c80 0x7f72e80a5140 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.697+0000 7f7303a4e700 1 --2- 172.21.15.50:0/530290159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72fc1013c0 0x7f72fc1b5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.697+0000 7f7303a4e700 1 --2- 172.21.15.50:0/530290159 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72fc101d60 0x7f72fc1b6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:15.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.697+0000 7f7303a4e700 1 -- 172.21.15.50:0/530290159 >> 172.21.15.50:0/530290159 conn(0x7f72fc078330 msgr2=0x7f72fc100010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:15.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.697+0000 7f7303a4e700 1 -- 172.21.15.50:0/530290159 shutdown_connections 2024-06-06T03:35:15.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:15.697+0000 7f7303a4e700 1 -- 172.21.15.50:0/530290159 wait complete. 2024-06-06T03:35:16.514 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-06-06T03:35:16.915 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.911+0000 7f5a182e7640 1 -- 172.21.15.50:0/3157333399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a1010b310 msgr2=0x7f5a1010d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:16.915 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.911+0000 7f5a182e7640 1 --2- 172.21.15.50:0/3157333399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a1010b310 0x7f5a1010d780 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f5a08009ca0 tx=0x7f5a0802a8d0 comp rx=0 tx=0).stop 2024-06-06T03:35:16.916 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.914+0000 7f5a182e7640 1 -- 172.21.15.50:0/3157333399 shutdown_connections 2024-06-06T03:35:16.916 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.914+0000 7f5a182e7640 1 --2- 172.21.15.50:0/3157333399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a1010b310 0x7f5a1010d780 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:16.916 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.914+0000 7f5a182e7640 1 --2- 172.21.15.50:0/3157333399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a1010dcc0 0x7f5a1010e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:16.916 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.914+0000 7f5a182e7640 1 --2- 172.21.15.50:0/3157333399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a101089a0 0x7f5a1010add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:16.916 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.914+0000 7f5a182e7640 1 -- 172.21.15.50:0/3157333399 >> 172.21.15.50:0/3157333399 conn(0x7f5a1006ea10 msgr2=0x7f5a10070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.921+0000 7f5a182e7640 1 -- 172.21.15.50:0/3157333399 shutdown_connections 2024-06-06T03:35:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.925+0000 7f5a182e7640 1 -- 172.21.15.50:0/3157333399 wait complete. 2024-06-06T03:35:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.925+0000 7f5a182e7640 1 Processor -- start 2024-06-06T03:35:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.930+0000 7f5a182e7640 1 -- start start 2024-06-06T03:35:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.930+0000 7f5a182e7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a101089a0 0x7f5a10117ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.930+0000 7f5a182e7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a1010b310 0x7f5a10118410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.930+0000 7f5a182e7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a1010dcc0 0x7f5a10119400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.930+0000 7f5a182e7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5a101105a0 con 0x7f5a1010dcc0 2024-06-06T03:35:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.930+0000 7f5a182e7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5a10110420 con 0x7f5a101089a0 2024-06-06T03:35:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.930+0000 7f5a182e7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5a10110720 con 0x7f5a1010b310 2024-06-06T03:35:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.932+0000 7f5a16884640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a1010dcc0 0x7f5a10119400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.932+0000 7f5a16884640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a1010dcc0 0x7f5a10119400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44980/0 (socket says 172.21.15.50:44980) 2024-06-06T03:35:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.932+0000 7f5a16884640 1 -- 172.21.15.50:0/2590108198 learned_addr learned my addr 172.21.15.50:0/2590108198 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.933+0000 7f5a16083640 1 --2- 172.21.15.50:0/2590108198 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a101089a0 0x7f5a10117ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.934+0000 7f5a15882640 1 --2- 172.21.15.50:0/2590108198 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a1010b310 0x7f5a10118410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.934+0000 7f5a16884640 1 -- 172.21.15.50:0/2590108198 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a1010b310 msgr2=0x7f5a10118410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.934+0000 7f5a16884640 1 --2- 172.21.15.50:0/2590108198 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a1010b310 0x7f5a10118410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.934+0000 7f5a16884640 1 -- 172.21.15.50:0/2590108198 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a101089a0 msgr2=0x7f5a10117ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.934+0000 7f5a16884640 1 --2- 172.21.15.50:0/2590108198 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a101089a0 0x7f5a10117ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.934+0000 7f5a16884640 1 -- 172.21.15.50:0/2590108198 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a10119a70 con 0x7f5a1010dcc0 2024-06-06T03:35:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.935+0000 7f5a16884640 1 --2- 172.21.15.50:0/2590108198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a1010dcc0 0x7f5a10119400 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f5a00009fd0 tx=0x7f5a0000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.937+0000 7f5a077fe640 1 -- 172.21.15.50:0/2590108198 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a00011830 con 0x7f5a1010dcc0 2024-06-06T03:35:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.938+0000 7f5a182e7640 1 -- 172.21.15.50:0/2590108198 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a10119d60 con 0x7f5a1010dcc0 2024-06-06T03:35:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.938+0000 7f5a182e7640 1 -- 172.21.15.50:0/2590108198 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a1011a330 con 0x7f5a1010dcc0 2024-06-06T03:35:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.938+0000 7f5a077fe640 1 -- 172.21.15.50:0/2590108198 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5a00016070 con 0x7f5a1010dcc0 2024-06-06T03:35:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.938+0000 7f5a077fe640 1 -- 172.21.15.50:0/2590108198 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a00010e20 con 0x7f5a1010dcc0 2024-06-06T03:35:16.944 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.943+0000 7f5a1aff1740 1 Processor -- start 2024-06-06T03:35:16.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.945+0000 7f5a1aff1740 1 -- start start 2024-06-06T03:35:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.945+0000 7f5a1aff1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c36bec6010 0x55c36bec6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.945+0000 7f5a1aff1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c36bec6a00 0x55c36becb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.945+0000 7f5a1aff1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c36becbb70 0x55c36bece000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.945+0000 7f5a1aff1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c36be294f0 con 0x55c36bec6010 2024-06-06T03:35:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.945+0000 7f5a1aff1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c36bdc7870 con 0x55c36becbb70 2024-06-06T03:35:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.945+0000 7f5a1aff1740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c36be254b0 con 0x55c36bec6a00 2024-06-06T03:35:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.947+0000 7f5a15882640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c36becbb70 0x55c36bece000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.947+0000 7f5a15882640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c36bec6010 0x55c36bec6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.947+0000 7f5a15882640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c36bec6010 0x55c36bec6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44984/0 (socket says 172.21.15.50:44984) 2024-06-06T03:35:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.947+0000 7f5a15882640 1 -- 172.21.15.50:0/1150525445 learned_addr learned my addr 172.21.15.50:0/1150525445 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.947+0000 7f5a15882640 1 -- 172.21.15.50:0/1150525445 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c36bec6a00 msgr2=0x55c36becb500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:35:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.947+0000 7f5a15882640 1 --2- 172.21.15.50:0/1150525445 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c36bec6a00 0x55c36becb500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.947+0000 7f5a15882640 1 -- 172.21.15.50:0/1150525445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c36bec6010 msgr2=0x55c36bec6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.947+0000 7f5a15882640 1 --2- 172.21.15.50:0/1150525445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c36bec6010 0x55c36bec6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.947+0000 7f5a15882640 1 -- 172.21.15.50:0/1150525445 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c36bde39b0 con 0x55c36becbb70 2024-06-06T03:35:16.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.948+0000 7f5a15882640 1 --2- 172.21.15.50:0/1150525445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c36becbb70 0x55c36bece000 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5a08031ab0 tx=0x7f5a080095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57934c7030b30a73 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:16.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.948+0000 7f5a04bfe640 1 -- 172.21.15.50:0/1150525445 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a08041070 con 0x55c36becbb70 2024-06-06T03:35:16.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.948+0000 7f5a04bfe640 1 -- 172.21.15.50:0/1150525445 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5a08036040 con 0x55c36becbb70 2024-06-06T03:35:16.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.948+0000 7f5a04bfe640 1 -- 172.21.15.50:0/1150525445 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a08004640 con 0x55c36becbb70 2024-06-06T03:35:16.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.949+0000 7f5a077fe640 1 -- 172.21.15.50:0/2590108198 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5a00010510 con 0x7f5a1010dcc0 2024-06-06T03:35:16.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.952+0000 7f5a1aff1740 1 -- 172.21.15.50:0/1150525445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c36becbb70 msgr2=0x55c36bece000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:16.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.952+0000 7f5a1aff1740 1 --2- 172.21.15.50:0/1150525445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c36becbb70 0x55c36bece000 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5a08031ab0 tx=0x7f5a080095c0 comp rx=0 tx=0).stop 2024-06-06T03:35:16.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.952+0000 7f5a1aff1740 1 -- 172.21.15.50:0/1150525445 shutdown_connections 2024-06-06T03:35:16.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.952+0000 7f5a1aff1740 1 --2- 172.21.15.50:0/1150525445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c36becbb70 0x55c36bece000 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:16.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.952+0000 7f5a1aff1740 1 --2- 172.21.15.50:0/1150525445 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c36bec6a00 0x55c36becb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:16.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.952+0000 7f5a1aff1740 1 --2- 172.21.15.50:0/1150525445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c36bec6010 0x55c36bec6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:16.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.952+0000 7f5a1aff1740 1 -- 172.21.15.50:0/1150525445 >> 172.21.15.50:0/1150525445 conn(0x55c36bec1680 msgr2=0x55c36bec1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:16.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.954+0000 7f5a077fe640 1 --2- 172.21.15.50:0/2590108198 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f59fc0a2e60 0x7f59fc0a5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.954+0000 7f5a077fe640 1 -- 172.21.15.50:0/2590108198 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f5a000ce1e0 con 0x7f5a1010dcc0 2024-06-06T03:35:16.955 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.955+0000 7f5a16083640 1 --2- 172.21.15.50:0/2590108198 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f59fc0a2e60 0x7f59fc0a5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:16.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.956+0000 7f5a16083640 1 --2- 172.21.15.50:0/2590108198 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f59fc0a2e60 0x7f59fc0a5320 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x55c36bec2550 tx=0x7f5a0c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:16.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.957+0000 7f5a1aff1740 1 -- 172.21.15.50:0/1150525445 shutdown_connections 2024-06-06T03:35:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.957+0000 7f5a1aff1740 1 -- 172.21.15.50:0/1150525445 wait complete. 2024-06-06T03:35:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.958+0000 7f5a1aff1740 1 -- start start 2024-06-06T03:35:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.958+0000 7f5a1aff1740 1 Processor -- start 2024-06-06T03:35:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.958+0000 7f5a1aff1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c36bec6010 0x55c36bed02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.958+0000 7f5a1aff1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c36bec6a00 0x55c36bed0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.959+0000 7f5a1aff1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c36becbb70 0x55c36bed7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.959+0000 7f5a1aff1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c36beceac0 con 0x55c36bec6a00 2024-06-06T03:35:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.959+0000 7f5a1aff1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c36bdb2ae0 con 0x55c36becbb70 2024-06-06T03:35:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.959+0000 7f5a1aff1740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c36becec40 con 0x55c36bec6010 2024-06-06T03:35:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.959+0000 7f5a1aff1740 10 client.0 _ll_register_callbacks cb 0x55c36bdeb9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:35:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.959+0000 7f5a16083640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c36bec6010 0x55c36bed02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.959+0000 7f5a16083640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c36bec6010 0x55c36bed02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:35314/0 (socket says 172.21.15.50:35314) 2024-06-06T03:35:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.959+0000 7f5a16083640 1 -- 172.21.15.50:0/491192110 learned_addr learned my addr 172.21.15.50:0/491192110 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.960+0000 7f5a16083640 1 -- 172.21.15.50:0/491192110 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c36becbb70 msgr2=0x55c36bed7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.960+0000 7f5a16083640 1 --2- 172.21.15.50:0/491192110 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c36becbb70 0x55c36bed7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.960+0000 7f5a16083640 1 -- 172.21.15.50:0/491192110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c36bec6a00 msgr2=0x55c36bed0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.960+0000 7f5a16083640 1 --2- 172.21.15.50:0/491192110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c36bec6a00 0x55c36bed0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.960+0000 7f5a16083640 1 -- 172.21.15.50:0/491192110 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c36bb3d210 con 0x55c36bec6010 2024-06-06T03:35:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.961+0000 7f5a16083640 1 --2- 172.21.15.50:0/491192110 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c36bec6010 0x55c36bed02e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c013c30 tx=0x7f5a0c004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45f425ad27dbb95c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.962+0000 7f59f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:35:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.962+0000 7f59f9ffb640 1 -- 172.21.15.50:0/491192110 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c021020 con 0x55c36bec6010 2024-06-06T03:35:16.964 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.962+0000 7f59f9ffb640 1 -- 172.21.15.50:0/491192110 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f5a0c01d3f0 con 0x55c36bec6010 2024-06-06T03:35:16.964 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.963+0000 7f5a1aff1740 1 -- 172.21.15.50:0/491192110 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a08036040 con 0x55c36bec6010 2024-06-06T03:35:16.964 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.963+0000 7f59f9ffb640 1 -- 172.21.15.50:0/491192110 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f5a0c019040 con 0x55c36bec6010 2024-06-06T03:35:16.964 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.964+0000 7f5a1aff1740 10 client.26233 fetch_fsmap learned FSMap version 33 2024-06-06T03:35:16.964 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.964+0000 7f5a1aff1740 1 -- 172.21.15.50:0/491192110 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55c36bc09620 con 0x55c36bec6010 2024-06-06T03:35:16.965 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.964+0000 7f59f9ffb640 1 -- 172.21.15.50:0/491192110 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5a08036040 con 0x55c36bec6010 2024-06-06T03:35:16.965 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.964+0000 7f59f9ffb640 1 -- 172.21.15.50:0/491192110 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f5a0c01c030 con 0x55c36bec6010 2024-06-06T03:35:16.965 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.964+0000 7f5a1aff1740 10 client.26233 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:35:16.965 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.964+0000 7f5a1aff1740 10 client.26233 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:35:16.965 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.964+0000 7f5a1aff1740 20 client.26233 populate_metadata read hostname 'smithi050' 2024-06-06T03:35:16.965 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.964+0000 7f5a1aff1740 1 --2- 172.21.15.50:0/491192110 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55c36bedc720 0x55c36bedebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:16.965 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.965+0000 7f5a1aff1740 4 client.26233 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:35:16.965 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.965+0000 7f5a1aff1740 1 -- 172.21.15.50:0/491192110 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c36be3cf10 con 0x55c36bedc720 2024-06-06T03:35:16.965 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.965+0000 7f5a15882640 1 --2- 172.21.15.50:0/491192110 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55c36bedc720 0x55c36bedebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.969+0000 7f5a15882640 1 --2- 172.21.15.50:0/491192110 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55c36bedc720 0x55c36bedebe0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb3e5f382ac48f27 server_cookie=33110ae07b7ebe13 in_seq=0 out_seq=0 2024-06-06T03:35:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.969+0000 7f59f9ffb640 10 client.26233 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.973+0000 7f59f9ffb640 1 -- 172.21.15.50:0/491192110 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55c36be3cf10 con 0x55c36bedc720 2024-06-06T03:35:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.974+0000 7f59f9ffb640 10 client.26233 handle_command_reply: tid=0 2024-06-06T03:35:16.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.974+0000 7f5a1aff1740 1 client.26233 shutdown 2024-06-06T03:35:16.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.974+0000 7f5a1aff1740 1 -- 172.21.15.50:0/491192110 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c36bec6010 msgr2=0x55c36bed02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:16.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.974+0000 7f5a1aff1740 1 --2- 172.21.15.50:0/491192110 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c36bec6010 0x55c36bed02e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c013c30 tx=0x7f5a0c004770 comp rx=0 tx=0).stop 2024-06-06T03:35:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.977+0000 7f5a1aff1740 1 -- 172.21.15.50:0/491192110 shutdown_connections 2024-06-06T03:35:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.977+0000 7f5a1aff1740 1 --2- 172.21.15.50:0/491192110 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55c36bedc720 0x55c36bedebe0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.977+0000 7f5a1aff1740 1 --2- 172.21.15.50:0/491192110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c36bec6a00 0x55c36bed0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.977+0000 7f5a1aff1740 1 --2- 172.21.15.50:0/491192110 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c36becbb70 0x55c36bed7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.977+0000 7f5a1aff1740 1 --2- 172.21.15.50:0/491192110 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c36bec6010 0x55c36bed02e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.977+0000 7f5a1aff1740 1 -- 172.21.15.50:0/491192110 >> 172.21.15.50:0/491192110 conn(0x55c36bec1680 msgr2=0x55c36bec07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.977+0000 7f59f9ffb640 0 client.26233 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:16.979 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.978+0000 7f5a1aff1740 1 -- 172.21.15.50:0/491192110 shutdown_connections 2024-06-06T03:35:16.979 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.979+0000 7f5a1aff1740 1 -- 172.21.15.50:0/491192110 wait complete. 2024-06-06T03:35:16.980 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:16.981+0000 7f5a1aff1740 20 client.26233 trim_cache size 0 max 16384 2024-06-06T03:35:17.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:16 smithi050 ceph-mon[32421]: pgmap v690: 129 pgs: 129 active+clean; 10 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 36 MiB/s wr, 749 op/s 2024-06-06T03:35:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.030+0000 7f5a1aff1740 1 Processor -- start 2024-06-06T03:35:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.030+0000 7f5a1aff1740 1 -- start start 2024-06-06T03:35:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.031+0000 7f5a1aff1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c36bec6010 0x55c36becea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.031+0000 7f5a1aff1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c36bec6a00 0x55c36bed7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.031+0000 7f5a1aff1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c36becbb70 0x55c36bede730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.031+0000 7f5a1aff1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f59f4012500 con 0x55c36bec6a00 2024-06-06T03:35:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.031+0000 7f5a1aff1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f59f400fdd0 con 0x55c36becbb70 2024-06-06T03:35:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.031+0000 7f5a1aff1740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f59f400dc20 con 0x55c36bec6010 2024-06-06T03:35:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.031+0000 7f5a16884640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c36becbb70 0x55c36bede730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.031+0000 7f5a16884640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c36becbb70 0x55c36bede730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:57002/0 (socket says 172.21.15.50:57002) 2024-06-06T03:35:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.031+0000 7f5a16884640 1 -- 172.21.15.50:0/5532497 learned_addr learned my addr 172.21.15.50:0/5532497 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.032+0000 7f5a16083640 1 --2- 172.21.15.50:0/5532497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c36bec6010 0x55c36becea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.033+0000 7f5a16884640 1 -- 172.21.15.50:0/5532497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c36bec6010 msgr2=0x55c36becea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.033+0000 7f5a16884640 1 --2- 172.21.15.50:0/5532497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c36bec6010 0x55c36becea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.033+0000 7f5a16884640 1 -- 172.21.15.50:0/5532497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c36bec6a00 msgr2=0x55c36bed7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.033+0000 7f5a16884640 1 --2- 172.21.15.50:0/5532497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c36bec6a00 0x55c36bed7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.033+0000 7f5a16884640 1 -- 172.21.15.50:0/5532497 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c36becf3a0 con 0x55c36becbb70 2024-06-06T03:35:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.033+0000 7f5a16083640 1 --2- 172.21.15.50:0/5532497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c36bec6010 0x55c36becea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:35:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.033+0000 7f5a16884640 1 --2- 172.21.15.50:0/5532497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c36becbb70 0x55c36bede730 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5a000cb900 tx=0x7f5a0009a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6afb24297054d7c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:17.034 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.035+0000 7f59fbfff640 1 -- 172.21.15.50:0/5532497 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0009adf0 con 0x55c36becbb70 2024-06-06T03:35:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.035+0000 7f59fbfff640 1 -- 172.21.15.50:0/5532497 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5a0009a6f0 con 0x55c36becbb70 2024-06-06T03:35:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.035+0000 7f59fbfff640 1 -- 172.21.15.50:0/5532497 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a00096440 con 0x55c36becbb70 2024-06-06T03:35:17.036 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.036+0000 7f5a1aff1740 1 -- 172.21.15.50:0/5532497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c36becbb70 msgr2=0x55c36bede730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:17.036 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.036+0000 7f5a1aff1740 1 --2- 172.21.15.50:0/5532497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c36becbb70 0x55c36bede730 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5a000cb900 tx=0x7f5a0009a5f0 comp rx=0 tx=0).stop 2024-06-06T03:35:17.036 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.036+0000 7f5a1aff1740 1 -- 172.21.15.50:0/5532497 shutdown_connections 2024-06-06T03:35:17.036 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.036+0000 7f5a1aff1740 1 --2- 172.21.15.50:0/5532497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c36bec6a00 0x55c36bed7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:17.037 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.036+0000 7f5a1aff1740 1 --2- 172.21.15.50:0/5532497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c36becbb70 0x55c36bede730 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:17.037 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.036+0000 7f5a1aff1740 1 --2- 172.21.15.50:0/5532497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c36bec6010 0x55c36becea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:17.037 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.036+0000 7f5a1aff1740 1 -- 172.21.15.50:0/5532497 >> 172.21.15.50:0/5532497 conn(0x55c36bec1680 msgr2=0x55c36bec1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:17.037 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.037+0000 7f5a1aff1740 1 -- 172.21.15.50:0/5532497 shutdown_connections 2024-06-06T03:35:17.037 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.037+0000 7f5a1aff1740 1 -- 172.21.15.50:0/5532497 wait complete. 2024-06-06T03:35:17.037 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.037+0000 7f5a1aff1740 1 -- start start 2024-06-06T03:35:17.037 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.037+0000 7f5a1aff1740 1 Processor -- start 2024-06-06T03:35:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.037+0000 7f5a1aff1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c36bec6010 0x55c36bed3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.038+0000 7f5a1aff1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c36bec6a00 0x55c36bed42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:17.042 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.038+0000 7f5a16083640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c36bec6010 0x55c36bed3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:17.042 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.038+0000 7f5a16083640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c36bec6010 0x55c36bed3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:35322/0 (socket says 172.21.15.50:35322) 2024-06-06T03:35:17.042 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.038+0000 7f5a16083640 1 -- 172.21.15.50:0/3055059069 learned_addr learned my addr 172.21.15.50:0/3055059069 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:17.042 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.038+0000 7f5a15882640 1 --2- 172.21.15.50:0/3055059069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c36bec6a00 0x55c36bed42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:17.042 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.038+0000 7f5a1aff1740 1 --2- 172.21.15.50:0/3055059069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c36becbb70 0x55c36bed6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:17.042 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.038+0000 7f5a1aff1740 1 -- 172.21.15.50:0/3055059069 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f59f400e290 con 0x55c36becbb70 2024-06-06T03:35:17.042 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.038+0000 7f5a1aff1740 1 -- 172.21.15.50:0/3055059069 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f59f400f700 con 0x55c36bec6a00 2024-06-06T03:35:17.043 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.038+0000 7f5a1aff1740 1 -- 172.21.15.50:0/3055059069 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f59f400e960 con 0x55c36bec6010 2024-06-06T03:35:17.043 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.038+0000 7f5a1aff1740 10 client.0 _ll_register_callbacks cb 0x7f5a0c006e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:35:17.043 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.039+0000 7f5a15882640 1 -- 172.21.15.50:0/3055059069 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c36bec6010 msgr2=0x55c36bed3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:17.043 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.039+0000 7f5a15882640 1 --2- 172.21.15.50:0/3055059069 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c36bec6010 0x55c36bed3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:17.043 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.039+0000 7f5a15882640 1 -- 172.21.15.50:0/3055059069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c36becbb70 msgr2=0x55c36bed6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:17.043 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.039+0000 7f5a15882640 1 --2- 172.21.15.50:0/3055059069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c36becbb70 0x55c36bed6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:17.043 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.039+0000 7f5a15882640 1 -- 172.21.15.50:0/3055059069 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c36bed7510 con 0x55c36bec6a00 2024-06-06T03:35:17.043 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.039+0000 7f5a15882640 1 --2- 172.21.15.50:0/3055059069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c36bec6a00 0x55c36bed42c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5a08009ca0 tx=0x7f5a08005c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2c638f15c737300 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:17.043 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.041+0000 7f59f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:35:17.043 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.042+0000 7f59f9ffb640 1 -- 172.21.15.50:0/3055059069 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a08041040 con 0x55c36bec6a00 2024-06-06T03:35:17.043 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.042+0000 7f5a1aff1740 1 -- 172.21.15.50:0/3055059069 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a0009a6f0 con 0x55c36bec6a00 2024-06-06T03:35:17.043 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.042+0000 7f59f9ffb640 1 -- 172.21.15.50:0/3055059069 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f5a08009890 con 0x55c36bec6a00 2024-06-06T03:35:17.043 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.042+0000 7f59f9ffb640 1 -- 172.21.15.50:0/3055059069 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f5a0805b050 con 0x55c36bec6a00 2024-06-06T03:35:17.044 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.044+0000 7f5a1aff1740 10 client.26240 fetch_fsmap learned FSMap version 33 2024-06-06T03:35:17.044 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.044+0000 7f5a1aff1740 1 -- 172.21.15.50:0/3055059069 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55c36bf45f80 con 0x55c36bec6a00 2024-06-06T03:35:17.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.045+0000 7f59f9ffb640 1 -- 172.21.15.50:0/3055059069 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5a0009a6f0 con 0x55c36bec6a00 2024-06-06T03:35:17.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.045+0000 7f59f9ffb640 1 -- 172.21.15.50:0/3055059069 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f5a08004490 con 0x55c36bec6a00 2024-06-06T03:35:17.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.046+0000 7f5a1aff1740 10 client.26240 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:35:17.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.046+0000 7f5a1aff1740 10 client.26240 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:35:17.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.046+0000 7f5a1aff1740 20 client.26240 populate_metadata read hostname 'smithi050' 2024-06-06T03:35:17.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.046+0000 7f5a1aff1740 1 --2- 172.21.15.50:0/3055059069 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55c36bf46460 0x55c36bf48850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:17.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.046+0000 7f5a1aff1740 4 client.26240 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:35:17.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.046+0000 7f5a1aff1740 1 -- 172.21.15.50:0/3055059069 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c36be36c20 con 0x55c36bf46460 2024-06-06T03:35:17.051 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.051+0000 7f5a16083640 1 --2- 172.21.15.50:0/3055059069 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55c36bf46460 0x55c36bf48850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:17.052 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.052+0000 7f5a16083640 1 --2- 172.21.15.50:0/3055059069 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55c36bf46460 0x55c36bf48850 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e072ee6bb13da5f0 server_cookie=fa8a4a9a302a734a in_seq=0 out_seq=0 2024-06-06T03:35:17.052 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.052+0000 7f59f9ffb640 10 client.26240 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.069+0000 7f59f9ffb640 1 -- 172.21.15.50:0/3055059069 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55c36be36c20 con 0x55c36bf46460 2024-06-06T03:35:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.069+0000 7f59f9ffb640 10 client.26240 handle_command_reply: tid=0 2024-06-06T03:35:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.070+0000 7f5a1aff1740 1 client.26240 shutdown 2024-06-06T03:35:17.070 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.070+0000 7f5a1aff1740 1 -- 172.21.15.50:0/3055059069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c36bec6a00 msgr2=0x55c36bed42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:17.071 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.070+0000 7f5a1aff1740 1 --2- 172.21.15.50:0/3055059069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c36bec6a00 0x55c36bed42c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5a08009ca0 tx=0x7f5a08005c70 comp rx=0 tx=0).stop 2024-06-06T03:35:17.071 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.070+0000 7f5a1aff1740 1 -- 172.21.15.50:0/3055059069 shutdown_connections 2024-06-06T03:35:17.071 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.070+0000 7f5a1aff1740 1 --2- 172.21.15.50:0/3055059069 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55c36bf46460 0x55c36bf48850 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:17.071 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.070+0000 7f5a1aff1740 1 --2- 172.21.15.50:0/3055059069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c36becbb70 0x55c36bed6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:17.071 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.070+0000 7f5a1aff1740 1 --2- 172.21.15.50:0/3055059069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c36bec6a00 0x55c36bed42c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:17.071 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.070+0000 7f5a1aff1740 1 --2- 172.21.15.50:0/3055059069 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c36bec6010 0x55c36bed3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:17.071 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.070+0000 7f5a1aff1740 1 -- 172.21.15.50:0/3055059069 >> 172.21.15.50:0/3055059069 conn(0x55c36bec1680 msgr2=0x55c36bede730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:17.071 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.070+0000 7f59f9ffb640 0 client.26240 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:17.071 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.070+0000 7f5a1aff1740 1 -- 172.21.15.50:0/3055059069 shutdown_connections 2024-06-06T03:35:17.071 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.070+0000 7f5a1aff1740 1 -- 172.21.15.50:0/3055059069 wait complete. 2024-06-06T03:35:17.071 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.070+0000 7f5a1aff1740 20 client.26240 trim_cache size 0 max 16384 2024-06-06T03:35:17.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:35:17.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:35:17.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:35:17.073 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.071+0000 7f5a182e7640 1 -- 172.21.15.50:0/2590108198 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f59fc0a2e60 msgr2=0x7f59fc0a5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:17.073 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.071+0000 7f5a182e7640 1 --2- 172.21.15.50:0/2590108198 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f59fc0a2e60 0x7f59fc0a5320 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x55c36bec2550 tx=0x7f5a0c008040 comp rx=0 tx=0).stop 2024-06-06T03:35:17.073 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.072+0000 7f5a182e7640 1 -- 172.21.15.50:0/2590108198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a1010dcc0 msgr2=0x7f5a10119400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:17.073 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.072+0000 7f5a182e7640 1 --2- 172.21.15.50:0/2590108198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a1010dcc0 0x7f5a10119400 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f5a00009fd0 tx=0x7f5a0000b8e0 comp rx=0 tx=0).stop 2024-06-06T03:35:17.073 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.072+0000 7f5a182e7640 1 -- 172.21.15.50:0/2590108198 shutdown_connections 2024-06-06T03:35:17.073 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.072+0000 7f5a182e7640 1 --2- 172.21.15.50:0/2590108198 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f59fc0a2e60 0x7f59fc0a5320 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:17.073 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.072+0000 7f5a182e7640 1 --2- 172.21.15.50:0/2590108198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a1010dcc0 0x7f5a10119400 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:17.074 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.072+0000 7f5a182e7640 1 --2- 172.21.15.50:0/2590108198 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a1010b310 0x7f5a10118410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:17.074 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.072+0000 7f5a182e7640 1 --2- 172.21.15.50:0/2590108198 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a101089a0 0x7f5a10117ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:17.074 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.072+0000 7f5a182e7640 1 -- 172.21.15.50:0/2590108198 >> 172.21.15.50:0/2590108198 conn(0x7f5a1006ea10 msgr2=0x7f5a1010ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:17.075 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.074+0000 7f5a182e7640 1 -- 172.21.15.50:0/2590108198 shutdown_connections 2024-06-06T03:35:17.075 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:17.075+0000 7f5a182e7640 1 -- 172.21.15.50:0/2590108198 wait complete. 2024-06-06T03:35:17.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:16 smithi079 ceph-mon[35478]: pgmap v690: 129 pgs: 129 active+clean; 10 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 36 MiB/s wr, 749 op/s 2024-06-06T03:35:17.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:16 smithi122 ceph-mon[35759]: pgmap v690: 129 pgs: 129 active+clean; 10 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 36 MiB/s wr, 749 op/s 2024-06-06T03:35:17.197 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:35:19.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:18 smithi050 ceph-mon[32421]: pgmap v691: 129 pgs: 129 active+clean; 10 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 28 MiB/s wr, 568 op/s 2024-06-06T03:35:19.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:18 smithi079 ceph-mon[35478]: pgmap v691: 129 pgs: 129 active+clean; 10 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 28 MiB/s wr, 568 op/s 2024-06-06T03:35:19.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:18 smithi122 ceph-mon[35759]: pgmap v691: 129 pgs: 129 active+clean; 10 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 28 MiB/s wr, 568 op/s 2024-06-06T03:35:19.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.640+0000 7fbb2f9b4700 1 -- 172.21.15.50:0/4101728173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb28109480 msgr2=0x7fbb28115990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:19.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.640+0000 7fbb2f9b4700 1 --2- 172.21.15.50:0/4101728173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb28109480 0x7fbb28115990 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fbb24009990 tx=0x7fbb24009ca0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.644+0000 7fbb2f9b4700 1 -- 172.21.15.50:0/4101728173 shutdown_connections 2024-06-06T03:35:19.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.644+0000 7fbb2f9b4700 1 --2- 172.21.15.50:0/4101728173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb28109480 0x7fbb28115990 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.644+0000 7fbb2f9b4700 1 --2- 172.21.15.50:0/4101728173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb2810eac0 0x7fbb2810eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.644+0000 7fbb2f9b4700 1 --2- 172.21.15.50:0/4101728173 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbb28108ac0 0x7fbb28108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.644+0000 7fbb2f9b4700 1 -- 172.21.15.50:0/4101728173 >> 172.21.15.50:0/4101728173 conn(0x7fbb28075c60 msgr2=0x7fbb28078080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:19.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.645+0000 7fbb2f9b4700 1 -- 172.21.15.50:0/4101728173 shutdown_connections 2024-06-06T03:35:19.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.645+0000 7fbb2f9b4700 1 -- 172.21.15.50:0/4101728173 wait complete. 2024-06-06T03:35:19.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.646+0000 7fbb2f9b4700 1 Processor -- start 2024-06-06T03:35:19.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.646+0000 7fbb2f9b4700 1 -- start start 2024-06-06T03:35:19.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.646+0000 7fbb2f9b4700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbb28108ac0 0x7fbb28082a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:19.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.646+0000 7fbb2f9b4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb28109480 0x7fbb28082f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:19.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.646+0000 7fbb2f9b4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb2810eac0 0x7fbb2807ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:19.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.646+0000 7fbb2f9b4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2807b5a0 con 0x7fbb2810eac0 2024-06-06T03:35:19.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.646+0000 7fbb2f9b4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2807b420 con 0x7fbb28109480 2024-06-06T03:35:19.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.646+0000 7fbb2f9b4700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2807b720 con 0x7fbb28108ac0 2024-06-06T03:35:19.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.647+0000 7fbb2d750700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbb28108ac0 0x7fbb28082a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:19.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.647+0000 7fbb2df51700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb2810eac0 0x7fbb2807ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:19.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.647+0000 7fbb2df51700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb2810eac0 0x7fbb2807ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49718/0 (socket says 172.21.15.50:49718) 2024-06-06T03:35:19.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.647+0000 7fbb2df51700 1 -- 172.21.15.50:0/1345237091 learned_addr learned my addr 172.21.15.50:0/1345237091 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:19.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.648+0000 7fbb2df51700 1 -- 172.21.15.50:0/1345237091 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbb28108ac0 msgr2=0x7fbb28082a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:19.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.648+0000 7fbb2df51700 1 --2- 172.21.15.50:0/1345237091 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbb28108ac0 0x7fbb28082a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.648+0000 7fbb2df51700 1 -- 172.21.15.50:0/1345237091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb28109480 msgr2=0x7fbb28082f80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T03:35:19.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.648+0000 7fbb2df51700 1 --2- 172.21.15.50:0/1345237091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb28109480 0x7fbb28082f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.648+0000 7fbb2df51700 1 -- 172.21.15.50:0/1345237091 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb2807d5c0 con 0x7fbb2810eac0 2024-06-06T03:35:19.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.649+0000 7fbb2df51700 1 --2- 172.21.15.50:0/1345237091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb2810eac0 0x7fbb2807ccc0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fbb2400b5c0 tx=0x7fbb24005660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:19.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.651+0000 7fbb1e7fc700 1 -- 172.21.15.50:0/1345237091 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb24003ba0 con 0x7fbb2810eac0 2024-06-06T03:35:19.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.651+0000 7fbb2f9b4700 1 -- 172.21.15.50:0/1345237091 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb2807d850 con 0x7fbb2810eac0 2024-06-06T03:35:19.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.651+0000 7fbb2f9b4700 1 -- 172.21.15.50:0/1345237091 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb281b4370 con 0x7fbb2810eac0 2024-06-06T03:35:19.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.651+0000 7fbb1e7fc700 1 -- 172.21.15.50:0/1345237091 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb240041f0 con 0x7fbb2810eac0 2024-06-06T03:35:19.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.651+0000 7fbb1e7fc700 1 -- 172.21.15.50:0/1345237091 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2400fe50 con 0x7fbb2810eac0 2024-06-06T03:35:19.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.657+0000 7fbb1e7fc700 1 -- 172.21.15.50:0/1345237091 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbb24003d40 con 0x7fbb2810eac0 2024-06-06T03:35:19.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.658+0000 7fbb1e7fc700 1 --2- 172.21.15.50:0/1345237091 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbb140a2fc0 0x7fbb140a5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:19.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.658+0000 7fbb1e7fc700 1 -- 172.21.15.50:0/1345237091 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fbb240d07c0 con 0x7fbb2810eac0 2024-06-06T03:35:19.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.660+0000 7fbb2d750700 1 --2- 172.21.15.50:0/1345237091 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbb140a2fc0 0x7fbb140a5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:19.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.662+0000 7fbb2d750700 1 --2- 172.21.15.50:0/1345237091 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbb140a2fc0 0x7fbb140a5480 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbb18005950 tx=0x7fbb180058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:19.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.666+0000 7fbb3a237b80 1 Processor -- start 2024-06-06T03:35:19.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.667+0000 7fbb3a237b80 1 -- start start 2024-06-06T03:35:19.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.667+0000 7fbb3a237b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615ebbd2640 0x5615ebbd2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:19.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.667+0000 7fbb3a237b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ebbd2f60 0x5615ebbcc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:19.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.667+0000 7fbb3a237b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5615ebbccf20 0x5615ebbcd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:19.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.668+0000 7fbb3a237b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5615ebb1e810 con 0x5615ebbccf20 2024-06-06T03:35:19.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.668+0000 7fbb3a237b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5615ebac6720 con 0x5615ebbd2f60 2024-06-06T03:35:19.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.668+0000 7fbb3a237b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5615ebb1a7d0 con 0x5615ebbd2640 2024-06-06T03:35:19.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.671+0000 7fbb2df51700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5615ebbccf20 0x5615ebbcd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:19.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.671+0000 7fbb2df51700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5615ebbccf20 0x5615ebbcd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49722/0 (socket says 172.21.15.50:49722) 2024-06-06T03:35:19.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.671+0000 7fbb2df51700 1 -- 172.21.15.50:0/778139151 learned_addr learned my addr 172.21.15.50:0/778139151 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:19.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.672+0000 7fbb2d750700 1 --2- 172.21.15.50:0/778139151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615ebbd2640 0x5615ebbd2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:19.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.673+0000 7fbb2df51700 1 -- 172.21.15.50:0/778139151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615ebbd2640 msgr2=0x5615ebbd2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:19.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.673+0000 7fbb2df51700 1 --2- 172.21.15.50:0/778139151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615ebbd2640 0x5615ebbd2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.673+0000 7fbb2df51700 1 -- 172.21.15.50:0/778139151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ebbd2f60 msgr2=0x5615ebbcc9e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:35:19.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.673+0000 7fbb2df51700 1 --2- 172.21.15.50:0/778139151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ebbd2f60 0x5615ebbcc9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.673+0000 7fbb2df51700 1 -- 172.21.15.50:0/778139151 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615ebabcf50 con 0x5615ebbccf20 2024-06-06T03:35:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.673+0000 7fbb2df51700 1 --2- 172.21.15.50:0/778139151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5615ebbccf20 0x5615ebbcd340 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fbb240996a0 tx=0x7fbb2409c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab8df4ed3b96aae server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.675+0000 7fbb137fe700 1 -- 172.21.15.50:0/778139151 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2409d3d0 con 0x5615ebbccf20 2024-06-06T03:35:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.675+0000 7fbb137fe700 1 -- 172.21.15.50:0/778139151 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb2409ccd0 con 0x5615ebbccf20 2024-06-06T03:35:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.676+0000 7fbb3a237b80 1 -- 172.21.15.50:0/778139151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5615ebbccf20 msgr2=0x5615ebbcd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.676+0000 7fbb3a237b80 1 --2- 172.21.15.50:0/778139151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5615ebbccf20 0x5615ebbcd340 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fbb240996a0 tx=0x7fbb2409c6b0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.676+0000 7fbb3a237b80 1 -- 172.21.15.50:0/778139151 shutdown_connections 2024-06-06T03:35:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.676+0000 7fbb3a237b80 1 --2- 172.21.15.50:0/778139151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5615ebbccf20 0x5615ebbcd340 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.676+0000 7fbb3a237b80 1 --2- 172.21.15.50:0/778139151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615ebbd2640 0x5615ebbd2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.676+0000 7fbb3a237b80 1 --2- 172.21.15.50:0/778139151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ebbd2f60 0x5615ebbcc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.676+0000 7fbb3a237b80 1 -- 172.21.15.50:0/778139151 >> 172.21.15.50:0/778139151 conn(0x5615ebaf7cc0 msgr2=0x5615ebbc7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.677+0000 7fbb3a237b80 1 -- 172.21.15.50:0/778139151 shutdown_connections 2024-06-06T03:35:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.678+0000 7fbb3a237b80 1 -- 172.21.15.50:0/778139151 wait complete. 2024-06-06T03:35:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.678+0000 7fbb3a237b80 1 -- start start 2024-06-06T03:35:19.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.678+0000 7fbb3a237b80 1 Processor -- start 2024-06-06T03:35:19.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.679+0000 7fbb3a237b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5615ebbccf20 0x5615ebbd8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:19.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.679+0000 7fbb3a237b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ebbd2f60 0x5615ebbd61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:19.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.679+0000 7fbb3a237b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615ebbd6760 0x5615ebbd6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:19.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.679+0000 7fbb3a237b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5615ebbd96f0 con 0x5615ebbccf20 2024-06-06T03:35:19.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.679+0000 7fbb3a237b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5615ebabebf0 con 0x5615ebbd2f60 2024-06-06T03:35:19.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.679+0000 7fbb3a237b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5615ebbd9870 con 0x5615ebbd6760 2024-06-06T03:35:19.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.679+0000 7fbb3a237b80 10 client.0 _ll_register_callbacks cb 0x5615ebab8920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:35:19.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.681+0000 7fbb2cf4f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ebbd2f60 0x5615ebbd61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:19.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.681+0000 7fbb2cf4f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ebbd2f60 0x5615ebbd61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:41628/0 (socket says 172.21.15.50:41628) 2024-06-06T03:35:19.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.681+0000 7fbb2cf4f700 1 -- 172.21.15.50:0/2942681126 learned_addr learned my addr 172.21.15.50:0/2942681126 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:19.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.681+0000 7fbb2df51700 1 --2- 172.21.15.50:0/2942681126 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615ebbd6760 0x5615ebbd6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:19.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.683+0000 7fbb2d750700 1 --2- 172.21.15.50:0/2942681126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5615ebbccf20 0x5615ebbd8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:19.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.683+0000 7fbb2df51700 1 -- 172.21.15.50:0/2942681126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ebbd2f60 msgr2=0x5615ebbd61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:19.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.683+0000 7fbb2df51700 1 --2- 172.21.15.50:0/2942681126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ebbd2f60 0x5615ebbd61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.683+0000 7fbb2df51700 1 -- 172.21.15.50:0/2942681126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5615ebbccf20 msgr2=0x5615ebbd8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:19.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.683+0000 7fbb2df51700 1 --2- 172.21.15.50:0/2942681126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5615ebbccf20 0x5615ebbd8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.683+0000 7fbb2df51700 1 -- 172.21.15.50:0/2942681126 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615eba6d8d0 con 0x5615ebbd6760 2024-06-06T03:35:19.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.687+0000 7fbb2df51700 1 --2- 172.21.15.50:0/2942681126 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615ebbd6760 0x5615ebbd6bc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbb240996a0 tx=0x7fbb2409caa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7606bb839010410 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:19.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.687+0000 7fbb10ff9700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:35:19.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.687+0000 7fbb10ff9700 1 -- 172.21.15.50:0/2942681126 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb240aa070 con 0x5615ebbd6760 2024-06-06T03:35:19.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.687+0000 7fbb10ff9700 1 -- 172.21.15.50:0/2942681126 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fbb240a5420 con 0x5615ebbd6760 2024-06-06T03:35:19.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.687+0000 7fbb3a237b80 1 -- 172.21.15.50:0/2942681126 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5615ebb2bd10 con 0x5615ebbd6760 2024-06-06T03:35:19.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.688+0000 7fbb10ff9700 1 -- 172.21.15.50:0/2942681126 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fbb2409ccd0 con 0x5615ebbd6760 2024-06-06T03:35:19.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.688+0000 7fbb3a237b80 10 client.26251 fetch_fsmap learned FSMap version 33 2024-06-06T03:35:19.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.688+0000 7fbb3a237b80 1 -- 172.21.15.50:0/2942681126 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5615ebbd96f0 con 0x5615ebbd6760 2024-06-06T03:35:19.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.689+0000 7fbb10ff9700 1 -- 172.21.15.50:0/2942681126 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x5615ebb2bd10 con 0x5615ebbd6760 2024-06-06T03:35:19.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.689+0000 7fbb10ff9700 1 -- 172.21.15.50:0/2942681126 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fbb240a3290 con 0x5615ebbd6760 2024-06-06T03:35:19.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.689+0000 7fbb3a237b80 10 client.26251 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:35:19.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.689+0000 7fbb3a237b80 10 client.26251 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:35:19.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.689+0000 7fbb3a237b80 20 client.26251 populate_metadata read hostname 'smithi050' 2024-06-06T03:35:19.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.689+0000 7fbb3a237b80 1 --2- 172.21.15.50:0/2942681126 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5615ebbe6d70 0x5615ebbe9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:19.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.689+0000 7fbb3a237b80 4 client.26251 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:35:19.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.689+0000 7fbb3a237b80 1 -- 172.21.15.50:0/2942681126 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5615ebb26290 con 0x5615ebbe6d70 2024-06-06T03:35:19.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.691+0000 7fbb2d750700 1 --2- 172.21.15.50:0/2942681126 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5615ebbe6d70 0x5615ebbe9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:19.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.692+0000 7fbb10ff9700 10 client.26251 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:19.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.692+0000 7fbb2d750700 1 --2- 172.21.15.50:0/2942681126 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5615ebbe6d70 0x5615ebbe9190 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46694f033de0aeb0 server_cookie=23ad0d05ddb03bfb in_seq=0 out_seq=0 2024-06-06T03:35:19.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.695+0000 7fbb10ff9700 1 -- 172.21.15.50:0/2942681126 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5615ebb26290 con 0x5615ebbe6d70 2024-06-06T03:35:19.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.695+0000 7fbb10ff9700 10 client.26251 handle_command_reply: tid=0 2024-06-06T03:35:19.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.695+0000 7fbb3a237b80 1 client.26251 shutdown 2024-06-06T03:35:19.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.700+0000 7fbb3a237b80 1 -- 172.21.15.50:0/2942681126 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615ebbd6760 msgr2=0x5615ebbd6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:19.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.700+0000 7fbb3a237b80 1 --2- 172.21.15.50:0/2942681126 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615ebbd6760 0x5615ebbd6bc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbb240996a0 tx=0x7fbb2409caa0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.703+0000 7fbb3a237b80 1 -- 172.21.15.50:0/2942681126 shutdown_connections 2024-06-06T03:35:19.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.703+0000 7fbb3a237b80 1 --2- 172.21.15.50:0/2942681126 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5615ebbe6d70 0x5615ebbe9190 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.703+0000 7fbb3a237b80 1 --2- 172.21.15.50:0/2942681126 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615ebbd6760 0x5615ebbd6bc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.703+0000 7fbb3a237b80 1 --2- 172.21.15.50:0/2942681126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5615ebbccf20 0x5615ebbd8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.703+0000 7fbb3a237b80 1 --2- 172.21.15.50:0/2942681126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ebbd2f60 0x5615ebbd61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.703+0000 7fbb3a237b80 1 -- 172.21.15.50:0/2942681126 >> 172.21.15.50:0/2942681126 conn(0x5615ebaf7cc0 msgr2=0x5615ebbcb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:19.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.703+0000 7fbb10ff9700 0 client.26251 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:19.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.708+0000 7fbb3a237b80 1 -- 172.21.15.50:0/2942681126 shutdown_connections 2024-06-06T03:35:19.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.711+0000 7fbb3a237b80 1 -- 172.21.15.50:0/2942681126 wait complete. 2024-06-06T03:35:19.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.715+0000 7fbb3a237b80 20 client.26251 trim_cache size 0 max 16384 2024-06-06T03:35:19.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.748+0000 7fbb3a237b80 1 Processor -- start 2024-06-06T03:35:19.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.749+0000 7fbb3a237b80 1 -- start start 2024-06-06T03:35:19.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.749+0000 7fbb3a237b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ebbccf20 0x5615ebbcc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:19.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.749+0000 7fbb3a237b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5615ebbd2f60 0x5615ebbd1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:19.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.749+0000 7fbb2d750700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ebbccf20 0x5615ebbcc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:19.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.749+0000 7fbb2d750700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ebbccf20 0x5615ebbcc9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:41630/0 (socket says 172.21.15.50:41630) 2024-06-06T03:35:19.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.749+0000 7fbb2d750700 1 -- 172.21.15.50:0/2231742133 learned_addr learned my addr 172.21.15.50:0/2231742133 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:19.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.750+0000 7fbb3a237b80 1 --2- 172.21.15.50:0/2231742133 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615ebbd6760 0x5615ebbd5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:19.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.750+0000 7fbb3a237b80 1 -- 172.21.15.50:0/2231742133 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0c011420 con 0x5615ebbd2f60 2024-06-06T03:35:19.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.750+0000 7fbb3a237b80 1 -- 172.21.15.50:0/2231742133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0c00ecb0 con 0x5615ebbccf20 2024-06-06T03:35:19.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.750+0000 7fbb3a237b80 1 -- 172.21.15.50:0/2231742133 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0c00cb00 con 0x5615ebbd6760 2024-06-06T03:35:19.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.750+0000 7fbb2df51700 1 --2- 172.21.15.50:0/2231742133 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615ebbd6760 0x5615ebbd5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:19.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.750+0000 7fbb2df51700 1 -- 172.21.15.50:0/2231742133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ebbccf20 msgr2=0x5615ebbcc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:19.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.750+0000 7fbb2df51700 1 --2- 172.21.15.50:0/2231742133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ebbccf20 0x5615ebbcc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.750+0000 7fbb2df51700 1 -- 172.21.15.50:0/2231742133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5615ebbd2f60 msgr2=0x5615ebbd1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:19.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.750+0000 7fbb2df51700 1 --2- 172.21.15.50:0/2231742133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5615ebbd2f60 0x5615ebbd1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.751+0000 7fbb2df51700 1 -- 172.21.15.50:0/2231742133 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615ebbd71a0 con 0x5615ebbd6760 2024-06-06T03:35:19.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.751+0000 7fbb2df51700 1 --2- 172.21.15.50:0/2231742133 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615ebbd6760 0x5615ebbd5af0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbb240a3600 tx=0x7fbb2409b1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a20510996d0ac4a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:19.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.751+0000 7fbb12ffd700 1 -- 172.21.15.50:0/2231742133 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb240aa040 con 0x5615ebbd6760 2024-06-06T03:35:19.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.751+0000 7fbb12ffd700 1 -- 172.21.15.50:0/2231742133 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb240bb650 con 0x5615ebbd6760 2024-06-06T03:35:19.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.752+0000 7fbb12ffd700 1 -- 172.21.15.50:0/2231742133 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb240a5420 con 0x5615ebbd6760 2024-06-06T03:35:19.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.753+0000 7fbb3a237b80 1 -- 172.21.15.50:0/2231742133 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615ebbd6760 msgr2=0x5615ebbd5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:19.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.753+0000 7fbb3a237b80 1 --2- 172.21.15.50:0/2231742133 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615ebbd6760 0x5615ebbd5af0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbb240a3600 tx=0x7fbb2409b1e0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.754+0000 7fbb3a237b80 1 -- 172.21.15.50:0/2231742133 shutdown_connections 2024-06-06T03:35:19.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.754+0000 7fbb3a237b80 1 --2- 172.21.15.50:0/2231742133 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615ebbd6760 0x5615ebbd5af0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.754+0000 7fbb3a237b80 1 --2- 172.21.15.50:0/2231742133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ebbccf20 0x5615ebbcc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.754+0000 7fbb3a237b80 1 --2- 172.21.15.50:0/2231742133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5615ebbd2f60 0x5615ebbd1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.754+0000 7fbb3a237b80 1 -- 172.21.15.50:0/2231742133 >> 172.21.15.50:0/2231742133 conn(0x5615ebaf7cc0 msgr2=0x5615ebbd1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:19.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.756+0000 7fbb3a237b80 1 -- 172.21.15.50:0/2231742133 shutdown_connections 2024-06-06T03:35:19.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.756+0000 7fbb3a237b80 1 -- 172.21.15.50:0/2231742133 wait complete. 2024-06-06T03:35:19.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.757+0000 7fbb3a237b80 1 -- start start 2024-06-06T03:35:19.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.757+0000 7fbb3a237b80 1 Processor -- start 2024-06-06T03:35:19.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.758+0000 7fbb3a237b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ebbccf20 0x5615ebbeedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:19.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.758+0000 7fbb3a237b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5615ebbd2f60 0x5615ebbef300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:19.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.758+0000 7fbb2d750700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ebbccf20 0x5615ebbeedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:19.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.758+0000 7fbb2d750700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ebbccf20 0x5615ebbeedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:41644/0 (socket says 172.21.15.50:41644) 2024-06-06T03:35:19.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.758+0000 7fbb2d750700 1 -- 172.21.15.50:0/3090818265 learned_addr learned my addr 172.21.15.50:0/3090818265 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:19.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.758+0000 7fbb3a237b80 1 --2- 172.21.15.50:0/3090818265 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615ebbd6760 0x5615ebbdedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:19.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.758+0000 7fbb3a237b80 1 -- 172.21.15.50:0/3090818265 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0c00d170 con 0x5615ebbd2f60 2024-06-06T03:35:19.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.758+0000 7fbb3a237b80 1 -- 172.21.15.50:0/3090818265 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0c00e5e0 con 0x5615ebbccf20 2024-06-06T03:35:19.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.758+0000 7fbb2df51700 1 --2- 172.21.15.50:0/3090818265 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615ebbd6760 0x5615ebbdedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:19.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.759+0000 7fbb3a237b80 1 -- 172.21.15.50:0/3090818265 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0c00d840 con 0x5615ebbd6760 2024-06-06T03:35:19.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.759+0000 7fbb3a237b80 10 client.0 _ll_register_callbacks cb 0x5615ebab8920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:35:19.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.759+0000 7fbb2d750700 1 -- 172.21.15.50:0/3090818265 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615ebbd6760 msgr2=0x5615ebbdedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:19.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.759+0000 7fbb2d750700 1 --2- 172.21.15.50:0/3090818265 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615ebbd6760 0x5615ebbdedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.759+0000 7fbb2d750700 1 -- 172.21.15.50:0/3090818265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5615ebbd2f60 msgr2=0x5615ebbef300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:19.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.759+0000 7fbb2d750700 1 --2- 172.21.15.50:0/3090818265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5615ebbd2f60 0x5615ebbef300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.759+0000 7fbb2d750700 1 -- 172.21.15.50:0/3090818265 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615ebbdf5b0 con 0x5615ebbccf20 2024-06-06T03:35:19.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.760+0000 7fbb3a237b80 1 -- 172.21.15.50:0/3090818265 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb240bb650 con 0x5615ebbccf20 2024-06-06T03:35:19.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.760+0000 7fbb2d750700 1 --2- 172.21.15.50:0/3090818265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ebbccf20 0x5615ebbeedc0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbb18005fb0 tx=0x7fbb18021730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2a5204d03457148 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:19.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.760+0000 7fbb10ff9700 10 client.26252 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:35:19.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.760+0000 7fbb10ff9700 1 -- 172.21.15.50:0/3090818265 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1800fe70 con 0x5615ebbccf20 2024-06-06T03:35:19.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.760+0000 7fbb10ff9700 1 -- 172.21.15.50:0/3090818265 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fbb1802b3f0 con 0x5615ebbccf20 2024-06-06T03:35:19.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.761+0000 7fbb10ff9700 1 -- 172.21.15.50:0/3090818265 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fbb1803d050 con 0x5615ebbccf20 2024-06-06T03:35:19.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.761+0000 7fbb3a237b80 10 client.26252 fetch_fsmap learned FSMap version 33 2024-06-06T03:35:19.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.761+0000 7fbb3a237b80 1 -- 172.21.15.50:0/3090818265 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=33}) -- 0x5615ebbee790 con 0x5615ebbccf20 2024-06-06T03:35:19.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.761+0000 7fbb10ff9700 1 -- 172.21.15.50:0/3090818265 <== mon.2 v2:172.21.15.79:3300/0 4 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fbb1802b5f0 con 0x5615ebbccf20 2024-06-06T03:35:19.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.761+0000 7fbb3a237b80 10 client.26252 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:35:19.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.761+0000 7fbb3a237b80 10 client.26252 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:35:19.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.761+0000 7fbb3a237b80 20 client.26252 populate_metadata read hostname 'smithi050' 2024-06-06T03:35:19.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.761+0000 7fbb3a237b80 1 --2- 172.21.15.50:0/3090818265 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5615ebc50cc0 0x5615ebc530e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:19.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.761+0000 7fbb3a237b80 4 client.26252 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:35:19.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.761+0000 7fbb3a237b80 1 -- 172.21.15.50:0/3090818265 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fbb240bb650 con 0x5615ebc50cc0 2024-06-06T03:35:19.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.762+0000 7fbb2cf4f700 1 --2- 172.21.15.50:0/3090818265 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5615ebc50cc0 0x5615ebc530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:19.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.766+0000 7fbb2cf4f700 1 --2- 172.21.15.50:0/3090818265 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5615ebc50cc0 0x5615ebc530e0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b43af99cc6ca4472 server_cookie=9d0ae3d877c012b6 in_seq=0 out_seq=0 2024-06-06T03:35:19.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.766+0000 7fbb10ff9700 10 client.26252 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:19.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.767+0000 7fbb10ff9700 1 -- 172.21.15.50:0/3090818265 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fbb240bb650 con 0x5615ebc50cc0 2024-06-06T03:35:19.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.767+0000 7fbb10ff9700 10 client.26252 handle_command_reply: tid=0 2024-06-06T03:35:19.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.767+0000 7fbb3a237b80 1 client.26252 shutdown 2024-06-06T03:35:19.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.773+0000 7fbb3a237b80 1 -- 172.21.15.50:0/3090818265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ebbccf20 msgr2=0x5615ebbeedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:19.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.773+0000 7fbb3a237b80 1 --2- 172.21.15.50:0/3090818265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ebbccf20 0x5615ebbeedc0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbb18005fb0 tx=0x7fbb18021730 comp rx=0 tx=0).stop 2024-06-06T03:35:19.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.773+0000 7fbb3a237b80 1 -- 172.21.15.50:0/3090818265 shutdown_connections 2024-06-06T03:35:19.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.773+0000 7fbb3a237b80 1 --2- 172.21.15.50:0/3090818265 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5615ebc50cc0 0x5615ebc530e0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.773+0000 7fbb3a237b80 1 --2- 172.21.15.50:0/3090818265 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615ebbd6760 0x5615ebbdedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.773+0000 7fbb10ff9700 0 client.26252 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:19.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.773+0000 7fbb3a237b80 1 --2- 172.21.15.50:0/3090818265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ebbccf20 0x5615ebbeedc0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.773+0000 7fbb3a237b80 1 --2- 172.21.15.50:0/3090818265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5615ebbd2f60 0x5615ebbef300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.773+0000 7fbb3a237b80 1 -- 172.21.15.50:0/3090818265 >> 172.21.15.50:0/3090818265 conn(0x5615ebaf7cc0 msgr2=0x5615ebbd1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:19.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.780+0000 7fbb3a237b80 1 -- 172.21.15.50:0/3090818265 shutdown_connections 2024-06-06T03:35:19.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.780+0000 7fbb3a237b80 1 -- 172.21.15.50:0/3090818265 wait complete. 2024-06-06T03:35:19.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.780+0000 7fbb3a237b80 20 client.26252 trim_cache size 0 max 16384 2024-06-06T03:35:19.789 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:35:19.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.789+0000 7fbb2f9b4700 1 -- 172.21.15.50:0/1345237091 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbb140a2fc0 msgr2=0x7fbb140a5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:19.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.789+0000 7fbb2f9b4700 1 --2- 172.21.15.50:0/1345237091 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbb140a2fc0 0x7fbb140a5480 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbb18005950 tx=0x7fbb180058e0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.789+0000 7fbb2f9b4700 1 -- 172.21.15.50:0/1345237091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb2810eac0 msgr2=0x7fbb2807ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:19.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.789+0000 7fbb2f9b4700 1 --2- 172.21.15.50:0/1345237091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb2810eac0 0x7fbb2807ccc0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fbb2400b5c0 tx=0x7fbb24005660 comp rx=0 tx=0).stop 2024-06-06T03:35:19.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.790+0000 7fbb2f9b4700 1 -- 172.21.15.50:0/1345237091 shutdown_connections 2024-06-06T03:35:19.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.790+0000 7fbb2f9b4700 1 --2- 172.21.15.50:0/1345237091 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbb140a2fc0 0x7fbb140a5480 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.790+0000 7fbb2f9b4700 1 --2- 172.21.15.50:0/1345237091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb2810eac0 0x7fbb2807ccc0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.790+0000 7fbb2f9b4700 1 --2- 172.21.15.50:0/1345237091 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbb28108ac0 0x7fbb28082a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.790+0000 7fbb2f9b4700 1 --2- 172.21.15.50:0/1345237091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb28109480 0x7fbb28082f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:19.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.790+0000 7fbb2f9b4700 1 -- 172.21.15.50:0/1345237091 >> 172.21.15.50:0/1345237091 conn(0x7fbb28075c60 msgr2=0x7fbb28076380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:19.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.790+0000 7fbb2f9b4700 1 -- 172.21.15.50:0/1345237091 shutdown_connections 2024-06-06T03:35:19.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:19.794+0000 7fbb2f9b4700 1 -- 172.21.15.50:0/1345237091 wait complete. 2024-06-06T03:35:21.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:20 smithi050 ceph-mon[32421]: pgmap v692: 129 pgs: 129 active+clean; 10 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 37 MiB/s wr, 772 op/s 2024-06-06T03:35:21.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:20 smithi079 ceph-mon[35478]: pgmap v692: 129 pgs: 129 active+clean; 10 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 37 MiB/s wr, 772 op/s 2024-06-06T03:35:21.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:20 smithi122 ceph-mon[35759]: pgmap v692: 129 pgs: 129 active+clean; 10 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 37 MiB/s wr, 772 op/s 2024-06-06T03:35:21.920 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-06T03:35:21.920 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-06-06T03:35:22.646 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:35:22.994 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:22 smithi050 ceph-mon[32421]: pgmap v693: 129 pgs: 129 active+clean; 10 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 29 MiB/s wr, 605 op/s 2024-06-06T03:35:23.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:22 smithi079 ceph-mon[35478]: pgmap v693: 129 pgs: 129 active+clean; 10 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 29 MiB/s wr, 605 op/s 2024-06-06T03:35:23.182 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:22 smithi122 ceph-mon[35759]: pgmap v693: 129 pgs: 129 active+clean; 10 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 29 MiB/s wr, 605 op/s 2024-06-06T03:35:25.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:24 smithi050 ceph-mon[32421]: pgmap v694: 129 pgs: 129 active+clean; 10 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 28 MiB/s wr, 590 op/s 2024-06-06T03:35:25.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:24 smithi079 ceph-mon[35478]: pgmap v694: 129 pgs: 129 active+clean; 10 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 28 MiB/s wr, 590 op/s 2024-06-06T03:35:25.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:24 smithi122 ceph-mon[35759]: pgmap v694: 129 pgs: 129 active+clean; 10 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 28 MiB/s wr, 590 op/s 2024-06-06T03:35:27.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:26 smithi050 ceph-mon[32421]: pgmap v695: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 37 MiB/s wr, 778 op/s 2024-06-06T03:35:27.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:26 smithi079 ceph-mon[35478]: pgmap v695: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 37 MiB/s wr, 778 op/s 2024-06-06T03:35:27.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:26 smithi122 ceph-mon[35759]: pgmap v695: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 37 MiB/s wr, 778 op/s 2024-06-06T03:35:28.806 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:28 smithi050 ceph-mon[32421]: pgmap v696: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 28 MiB/s wr, 583 op/s 2024-06-06T03:35:28.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.911+0000 7f3164944700 1 -- 172.21.15.50:0/919173859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3160107400 msgr2=0x7f31601077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:28.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.911+0000 7f3164944700 1 --2- 172.21.15.50:0/919173859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3160107400 0x7f31601077e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3150009990 tx=0x7f3150009ca0 comp rx=0 tx=0).stop 2024-06-06T03:35:28.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.911+0000 7f3164944700 1 -- 172.21.15.50:0/919173859 shutdown_connections 2024-06-06T03:35:28.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.911+0000 7f3164944700 1 --2- 172.21.15.50:0/919173859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3160101d50 0x7f316006a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:28.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.911+0000 7f3164944700 1 --2- 172.21.15.50:0/919173859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3160107400 0x7f31601077e0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:28.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.911+0000 7f3164944700 1 --2- 172.21.15.50:0/919173859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3160101390 0x7f3160101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:28.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.911+0000 7f3164944700 1 -- 172.21.15.50:0/919173859 >> 172.21.15.50:0/919173859 conn(0x7f3160078340 msgr2=0x7f3160078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:28.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.913+0000 7f3164944700 1 -- 172.21.15.50:0/919173859 shutdown_connections 2024-06-06T03:35:28.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.916+0000 7f3164944700 1 -- 172.21.15.50:0/919173859 wait complete. 2024-06-06T03:35:28.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.917+0000 7f3164944700 1 Processor -- start 2024-06-06T03:35:28.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.919+0000 7f3164944700 1 -- start start 2024-06-06T03:35:28.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.919+0000 7f3164944700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3160101390 0x7f3160110520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:28.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.919+0000 7f3164944700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3160101d50 0x7f3160110a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:28.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.919+0000 7f3164944700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3160107400 0x7f3160110fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:28.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.919+0000 7f3164944700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f31601149e0 con 0x7f3160107400 2024-06-06T03:35:28.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.919+0000 7f3164944700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3160114860 con 0x7f3160101390 2024-06-06T03:35:28.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.919+0000 7f3164944700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3160114b60 con 0x7f3160101d50 2024-06-06T03:35:28.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.920+0000 7f315e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3160101390 0x7f3160110520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:28.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.920+0000 7f315dd9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3160101d50 0x7f3160110a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:28.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.920+0000 7f315e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3160101390 0x7f3160110520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:36654/0 (socket says 172.21.15.50:36654) 2024-06-06T03:35:28.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.920+0000 7f315e59c700 1 -- 172.21.15.50:0/3470615058 learned_addr learned my addr 172.21.15.50:0/3470615058 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:28.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.920+0000 7f315ed9d700 1 --2- 172.21.15.50:0/3470615058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3160107400 0x7f3160110fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:28.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.921+0000 7f315ed9d700 1 -- 172.21.15.50:0/3470615058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3160101d50 msgr2=0x7f3160110a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:28.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.921+0000 7f315ed9d700 1 --2- 172.21.15.50:0/3470615058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3160101d50 0x7f3160110a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:28.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.921+0000 7f315ed9d700 1 -- 172.21.15.50:0/3470615058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3160101390 msgr2=0x7f3160110520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:28.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.921+0000 7f315ed9d700 1 --2- 172.21.15.50:0/3470615058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3160101390 0x7f3160110520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:28.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.921+0000 7f315ed9d700 1 -- 172.21.15.50:0/3470615058 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3160072d30 con 0x7f3160107400 2024-06-06T03:35:28.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.921+0000 7f315ed9d700 1 --2- 172.21.15.50:0/3470615058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3160107400 0x7f3160110fa0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3158007f10 tx=0x7f315800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:28.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.922+0000 7f314f7fe700 1 -- 172.21.15.50:0/3470615058 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3158004db0 con 0x7f3160107400 2024-06-06T03:35:28.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.922+0000 7f3164944700 1 -- 172.21.15.50:0/3470615058 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3160073020 con 0x7f3160107400 2024-06-06T03:35:28.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.923+0000 7f3164944700 1 -- 172.21.15.50:0/3470615058 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3160073560 con 0x7f3160107400 2024-06-06T03:35:28.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.923+0000 7f314f7fe700 1 -- 172.21.15.50:0/3470615058 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3158009e20 con 0x7f3160107400 2024-06-06T03:35:28.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.923+0000 7f314f7fe700 1 -- 172.21.15.50:0/3470615058 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3158015400 con 0x7f3160107400 2024-06-06T03:35:28.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.927+0000 7f314f7fe700 1 -- 172.21.15.50:0/3470615058 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f31580155a0 con 0x7f3160107400 2024-06-06T03:35:28.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.931+0000 7f316f1c7b80 1 Processor -- start 2024-06-06T03:35:28.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.931+0000 7f316f1c7b80 1 -- start start 2024-06-06T03:35:28.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.933+0000 7f316f1c7b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f598a16c0 0x561f598a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:28.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.933+0000 7f316f1c7b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f598a1fe0 0x561f5989ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:28.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.933+0000 7f316f1c7b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f5989bfa0 0x561f5989c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:28.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.933+0000 7f316f1c7b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561f597ed890 con 0x561f598a16c0 2024-06-06T03:35:28.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.933+0000 7f316f1c7b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561f597957a0 con 0x561f598a1fe0 2024-06-06T03:35:28.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.933+0000 7f316f1c7b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561f597e9850 con 0x561f5989bfa0 2024-06-06T03:35:28.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.933+0000 7f314f7fe700 1 --2- 172.21.15.50:0/3470615058 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f31480a2e20 0x7f31480a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:28.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.934+0000 7f315e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f598a16c0 0x561f598a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:28.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.934+0000 7f315e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f598a16c0 0x561f598a1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60684/0 (socket says 172.21.15.50:60684) 2024-06-06T03:35:28.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.934+0000 7f315e59c700 1 -- 172.21.15.50:0/1038784082 learned_addr learned my addr 172.21.15.50:0/1038784082 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:28.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.934+0000 7f315ed9d700 1 --2- 172.21.15.50:0/1038784082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f5989bfa0 0x561f5989c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:28.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.934+0000 7f314f7fe700 1 -- 172.21.15.50:0/3470615058 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f31580cfb80 con 0x7f3160107400 2024-06-06T03:35:28.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.934+0000 7f315e59c700 1 -- 172.21.15.50:0/1038784082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f5989bfa0 msgr2=0x561f5989c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:28.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.934+0000 7f315e59c700 1 --2- 172.21.15.50:0/1038784082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f5989bfa0 0x561f5989c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:28.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.934+0000 7f315e59c700 1 -- 172.21.15.50:0/1038784082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f598a1fe0 msgr2=0x561f5989ba60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:35:28.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.934+0000 7f315e59c700 1 --2- 172.21.15.50:0/1038784082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f598a1fe0 0x561f5989ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:28.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.934+0000 7f315e59c700 1 -- 172.21.15.50:0/1038784082 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f5978bfd0 con 0x561f598a16c0 2024-06-06T03:35:28.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.934+0000 7f315ed9d700 1 --2- 172.21.15.50:0/1038784082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f5989bfa0 0x561f5989c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:35:28.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.934+0000 7f315e59c700 1 --2- 172.21.15.50:0/1038784082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f598a16c0 0x561f598a1aa0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f3150005ca0 tx=0x7f3150009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d58203173f2f226 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:28.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.935+0000 7f314cff9700 1 -- 172.21.15.50:0/1038784082 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3150003a50 con 0x561f598a16c0 2024-06-06T03:35:28.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.935+0000 7f314cff9700 1 -- 172.21.15.50:0/1038784082 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3150026070 con 0x561f598a16c0 2024-06-06T03:35:28.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.936+0000 7f314cff9700 1 -- 172.21.15.50:0/1038784082 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315000bbf0 con 0x561f598a16c0 2024-06-06T03:35:28.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.936+0000 7f316f1c7b80 1 -- 172.21.15.50:0/1038784082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f598a16c0 msgr2=0x561f598a1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:28.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.936+0000 7f316f1c7b80 1 --2- 172.21.15.50:0/1038784082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f598a16c0 0x561f598a1aa0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f3150005ca0 tx=0x7f3150009530 comp rx=0 tx=0).stop 2024-06-06T03:35:28.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.936+0000 7f316f1c7b80 1 -- 172.21.15.50:0/1038784082 shutdown_connections 2024-06-06T03:35:28.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.936+0000 7f316f1c7b80 1 --2- 172.21.15.50:0/1038784082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f5989bfa0 0x561f5989c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:28.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.936+0000 7f316f1c7b80 1 --2- 172.21.15.50:0/1038784082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f598a16c0 0x561f598a1aa0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:28.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.936+0000 7f316f1c7b80 1 --2- 172.21.15.50:0/1038784082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f598a1fe0 0x561f5989ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:28.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.936+0000 7f316f1c7b80 1 -- 172.21.15.50:0/1038784082 >> 172.21.15.50:0/1038784082 conn(0x561f597c6d40 msgr2=0x561f598968d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:28.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.937+0000 7f316f1c7b80 1 -- 172.21.15.50:0/1038784082 shutdown_connections 2024-06-06T03:35:28.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.940+0000 7f315dd9b700 1 --2- 172.21.15.50:0/3470615058 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f31480a2e20 0x7f31480a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:28.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.940+0000 7f316f1c7b80 1 -- 172.21.15.50:0/1038784082 wait complete. 2024-06-06T03:35:28.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.941+0000 7f316f1c7b80 1 -- start start 2024-06-06T03:35:28.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.941+0000 7f316f1c7b80 1 Processor -- start 2024-06-06T03:35:28.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.941+0000 7f316f1c7b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f5989bfa0 0x561f598a7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:28.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.941+0000 7f316f1c7b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f598a16c0 0x561f598a5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:28.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.941+0000 7f316f1c7b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f598a5690 0x561f598a5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:28.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.941+0000 7f316f1c7b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561f598a8a40 con 0x561f5989bfa0 2024-06-06T03:35:28.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.941+0000 7f316f1c7b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561f5978dc70 con 0x561f598a5690 2024-06-06T03:35:28.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.941+0000 7f316f1c7b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561f598a8bc0 con 0x561f598a16c0 2024-06-06T03:35:28.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.942+0000 7f316f1c7b80 10 client.0 _ll_register_callbacks cb 0x561f597879a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:35:28.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.942+0000 7f315dd9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f598a16c0 0x561f598a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:28.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.942+0000 7f315dd9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f598a16c0 0x561f598a5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:37920/0 (socket says 172.21.15.50:37920) 2024-06-06T03:35:28.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.942+0000 7f315ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f598a5690 0x561f598a5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:28.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.942+0000 7f315dd9b700 1 -- 172.21.15.50:0/1522355826 learned_addr learned my addr 172.21.15.50:0/1522355826 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:28.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.942+0000 7f315e59c700 1 --2- 172.21.15.50:0/1522355826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f5989bfa0 0x561f598a7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:28.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.943+0000 7f315dd9b700 1 -- 172.21.15.50:0/1522355826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f598a5690 msgr2=0x561f598a5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:28.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.943+0000 7f315dd9b700 1 --2- 172.21.15.50:0/1522355826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f598a5690 0x561f598a5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:28.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.943+0000 7f315dd9b700 1 -- 172.21.15.50:0/1522355826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f5989bfa0 msgr2=0x561f598a7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:28.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.943+0000 7f315dd9b700 1 --2- 172.21.15.50:0/1522355826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f5989bfa0 0x561f598a7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:28.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.943+0000 7f315dd9b700 1 -- 172.21.15.50:0/1522355826 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f5973c950 con 0x561f598a16c0 2024-06-06T03:35:28.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.943+0000 7f315dd9b700 1 --2- 172.21.15.50:0/3470615058 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f31480a2e20 0x7f31480a52e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3160111d70 tx=0x7f3154014750 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:28.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.947+0000 7f315dd9b700 1 --2- 172.21.15.50:0/1522355826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f598a16c0 0x561f598a5150 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3154005950 tx=0x7f315401a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1e134ee4934feb server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:28.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.949+0000 7f3145ffb700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:35:28.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.949+0000 7f3145ffb700 1 -- 172.21.15.50:0/1522355826 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3154024070 con 0x561f598a16c0 2024-06-06T03:35:28.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.949+0000 7f316f1c7b80 1 -- 172.21.15.50:0/1522355826 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3150026070 con 0x561f598a16c0 2024-06-06T03:35:28.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.949+0000 7f3145ffb700 1 -- 172.21.15.50:0/1522355826 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f3154014170 con 0x561f598a16c0 2024-06-06T03:35:28.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.954+0000 7f3145ffb700 1 -- 172.21.15.50:0/1522355826 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f3154004830 con 0x561f598a16c0 2024-06-06T03:35:28.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.954+0000 7f316f1c7b80 10 client.26269 fetch_fsmap learned FSMap version 33 2024-06-06T03:35:28.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.954+0000 7f316f1c7b80 1 -- 172.21.15.50:0/1522355826 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x561f598b3980 con 0x561f598a16c0 2024-06-06T03:35:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.961+0000 7f3145ffb700 1 -- 172.21.15.50:0/1522355826 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3150026070 con 0x561f598a16c0 2024-06-06T03:35:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.961+0000 7f3145ffb700 1 -- 172.21.15.50:0/1522355826 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f3154027020 con 0x561f598a16c0 2024-06-06T03:35:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.962+0000 7f316f1c7b80 10 client.26269 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:35:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.962+0000 7f316f1c7b80 10 client.26269 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:35:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.962+0000 7f316f1c7b80 20 client.26269 populate_metadata read hostname 'smithi050' 2024-06-06T03:35:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.962+0000 7f316f1c7b80 1 --2- 172.21.15.50:0/1522355826 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561f598b5fb0 0x561f598b83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.962+0000 7f316f1c7b80 4 client.26269 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:35:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.962+0000 7f316f1c7b80 1 -- 172.21.15.50:0/1522355826 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f597fad90 con 0x561f598b5fb0 2024-06-06T03:35:28.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.964+0000 7f315e59c700 1 --2- 172.21.15.50:0/1522355826 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561f598b5fb0 0x561f598b83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:28.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.969+0000 7f315e59c700 1 --2- 172.21.15.50:0/1522355826 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561f598b5fb0 0x561f598b83d0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5328208812405b35 server_cookie=884079ffe1139b4e in_seq=0 out_seq=0 2024-06-06T03:35:28.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.970+0000 7f3145ffb700 10 client.26269 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:28.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.970+0000 7f3145ffb700 1 -- 172.21.15.50:0/1522355826 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x561f597fad90 con 0x561f598b5fb0 2024-06-06T03:35:28.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.970+0000 7f3145ffb700 10 client.26269 handle_command_reply: tid=0 2024-06-06T03:35:28.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.970+0000 7f316f1c7b80 1 client.26269 shutdown 2024-06-06T03:35:28.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.972+0000 7f316f1c7b80 1 -- 172.21.15.50:0/1522355826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f598a16c0 msgr2=0x561f598a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:28.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.972+0000 7f316f1c7b80 1 --2- 172.21.15.50:0/1522355826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f598a16c0 0x561f598a5150 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3154005950 tx=0x7f315401a000 comp rx=0 tx=0).stop 2024-06-06T03:35:28.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.972+0000 7f316f1c7b80 1 -- 172.21.15.50:0/1522355826 shutdown_connections 2024-06-06T03:35:28.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.972+0000 7f316f1c7b80 1 --2- 172.21.15.50:0/1522355826 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561f598b5fb0 0x561f598b83d0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:28.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.972+0000 7f316f1c7b80 1 --2- 172.21.15.50:0/1522355826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f598a5690 0x561f598a5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:28.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.972+0000 7f316f1c7b80 1 --2- 172.21.15.50:0/1522355826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f5989bfa0 0x561f598a7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:28.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.972+0000 7f316f1c7b80 1 --2- 172.21.15.50:0/1522355826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f598a16c0 0x561f598a5150 secure :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3154005950 tx=0x7f315401a000 comp rx=0 tx=0).stop 2024-06-06T03:35:28.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.972+0000 7f3145ffb700 0 client.26269 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:28.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.972+0000 7f316f1c7b80 1 -- 172.21.15.50:0/1522355826 >> 172.21.15.50:0/1522355826 conn(0x561f597c6d40 msgr2=0x561f5989aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:28.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.973+0000 7f316f1c7b80 1 -- 172.21.15.50:0/1522355826 shutdown_connections 2024-06-06T03:35:28.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.973+0000 7f316f1c7b80 1 -- 172.21.15.50:0/1522355826 wait complete. 2024-06-06T03:35:28.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:28.974+0000 7f316f1c7b80 20 client.26269 trim_cache size 0 max 16384 2024-06-06T03:35:29.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.020+0000 7f316f1c7b80 1 Processor -- start 2024-06-06T03:35:29.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.021+0000 7f316f1c7b80 1 -- start start 2024-06-06T03:35:29.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.022+0000 7f316f1c7b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f5989bfa0 0x561f5989ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:29.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.022+0000 7f316f1c7b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f598a5690 0x561f598a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:29.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.022+0000 7f316f1c7b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f598bdca0 0x561f598be100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:29.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.022+0000 7f316f1c7b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3140011300 con 0x561f598bdca0 2024-06-06T03:35:29.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.022+0000 7f316f1c7b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f314000eb90 con 0x561f598a5690 2024-06-06T03:35:29.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.022+0000 7f316f1c7b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f314000c9e0 con 0x561f5989bfa0 2024-06-06T03:35:29.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.023+0000 7f315ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f598bdca0 0x561f598be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:29.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.023+0000 7f315ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f598bdca0 0x561f598be100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60712/0 (socket says 172.21.15.50:60712) 2024-06-06T03:35:29.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.023+0000 7f315ed9d700 1 -- 172.21.15.50:0/4056607997 learned_addr learned my addr 172.21.15.50:0/4056607997 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:29.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.025+0000 7f315dd9b700 1 --2- 172.21.15.50:0/4056607997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f598a5690 0x561f598a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:29.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.025+0000 7f315e59c700 1 --2- 172.21.15.50:0/4056607997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f5989bfa0 0x561f5989ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:29.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.025+0000 7f315dd9b700 1 -- 172.21.15.50:0/4056607997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f5989bfa0 msgr2=0x561f5989ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:29.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.025+0000 7f315dd9b700 1 --2- 172.21.15.50:0/4056607997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f5989bfa0 0x561f5989ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:29.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.025+0000 7f315dd9b700 1 -- 172.21.15.50:0/4056607997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f598bdca0 msgr2=0x561f598be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:29.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.025+0000 7f315dd9b700 1 --2- 172.21.15.50:0/4056607997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f598bdca0 0x561f598be100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:29.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.025+0000 7f315dd9b700 1 -- 172.21.15.50:0/4056607997 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f59896e10 con 0x561f598a5690 2024-06-06T03:35:29.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.026+0000 7f315dd9b700 1 --2- 172.21.15.50:0/4056607997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f598a5690 0x561f598a2b50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x561f598a61e0 tx=0x7f3154014bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97dc581626c76152 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:29.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.027+0000 7f3147fff700 1 -- 172.21.15.50:0/4056607997 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3154024040 con 0x561f598a5690 2024-06-06T03:35:29.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.027+0000 7f3147fff700 1 -- 172.21.15.50:0/4056607997 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3154020d20 con 0x561f598a5690 2024-06-06T03:35:29.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.028+0000 7f316f1c7b80 1 -- 172.21.15.50:0/4056607997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f598a5690 msgr2=0x561f598a2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:29.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.028+0000 7f316f1c7b80 1 --2- 172.21.15.50:0/4056607997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f598a5690 0x561f598a2b50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x561f598a61e0 tx=0x7f3154014bd0 comp rx=0 tx=0).stop 2024-06-06T03:35:29.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.028+0000 7f316f1c7b80 1 -- 172.21.15.50:0/4056607997 shutdown_connections 2024-06-06T03:35:29.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.028+0000 7f316f1c7b80 1 --2- 172.21.15.50:0/4056607997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f598bdca0 0x561f598be100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:29.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.028+0000 7f316f1c7b80 1 --2- 172.21.15.50:0/4056607997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f5989bfa0 0x561f5989ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:29.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.028+0000 7f316f1c7b80 1 --2- 172.21.15.50:0/4056607997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f598a5690 0x561f598a2b50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:29.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.028+0000 7f316f1c7b80 1 -- 172.21.15.50:0/4056607997 >> 172.21.15.50:0/4056607997 conn(0x561f597c6d40 msgr2=0x561f598a2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:29.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.031+0000 7f316f1c7b80 1 -- 172.21.15.50:0/4056607997 shutdown_connections 2024-06-06T03:35:29.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.031+0000 7f316f1c7b80 1 -- 172.21.15.50:0/4056607997 wait complete. 2024-06-06T03:35:29.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.032+0000 7f316f1c7b80 1 -- start start 2024-06-06T03:35:29.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.032+0000 7f316f1c7b80 1 Processor -- start 2024-06-06T03:35:29.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.033+0000 7f316f1c7b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f5989bfa0 0x561f598aaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:29.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.033+0000 7f316f1c7b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f598a5690 0x561f598ab440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:29.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.033+0000 7f316f1c7b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f598bdca0 0x561f598ab980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:29.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.033+0000 7f316f1c7b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f314000d050 con 0x561f598a5690 2024-06-06T03:35:29.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.033+0000 7f316f1c7b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f314000e4c0 con 0x561f598bdca0 2024-06-06T03:35:29.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.033+0000 7f316f1c7b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f314000d720 con 0x561f5989bfa0 2024-06-06T03:35:29.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.033+0000 7f316f1c7b80 10 client.0 _ll_register_callbacks cb 0x561f597879a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:35:29.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.037+0000 7f315ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f598bdca0 0x561f598ab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:29.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.037+0000 7f315dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f598a5690 0x561f598ab440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:29.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.037+0000 7f315e59c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f5989bfa0 0x561f598aaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:29.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.037+0000 7f315dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f598a5690 0x561f598ab440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60718/0 (socket says 172.21.15.50:60718) 2024-06-06T03:35:29.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.037+0000 7f315dd9b700 1 -- 172.21.15.50:0/1127148718 learned_addr learned my addr 172.21.15.50:0/1127148718 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:29.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.039+0000 7f315dd9b700 1 -- 172.21.15.50:0/1127148718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f5989bfa0 msgr2=0x561f598aaf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:29.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.039+0000 7f315dd9b700 1 --2- 172.21.15.50:0/1127148718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f5989bfa0 0x561f598aaf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:29.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.039+0000 7f315dd9b700 1 -- 172.21.15.50:0/1127148718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f598bdca0 msgr2=0x561f598ab980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:29.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.039+0000 7f315dd9b700 1 --2- 172.21.15.50:0/1127148718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f598bdca0 0x561f598ab980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:29.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.039+0000 7f315dd9b700 1 -- 172.21.15.50:0/1127148718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f59920e60 con 0x561f598a5690 2024-06-06T03:35:29.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.039+0000 7f315e59c700 1 --2- 172.21.15.50:0/1127148718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f5989bfa0 0x561f598aaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:35:29.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.042+0000 7f315dd9b700 1 --2- 172.21.15.50:0/1127148718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f598a5690 0x561f598ab440 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3154022040 tx=0x7f3154010df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=485b191b88622b server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:29.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.043+0000 7f3145ffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:35:29.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.046+0000 7f3145ffb700 1 -- 172.21.15.50:0/1127148718 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3154024040 con 0x561f598a5690 2024-06-06T03:35:29.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.046+0000 7f3145ffb700 1 -- 172.21.15.50:0/1127148718 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f31540299e0 con 0x561f598a5690 2024-06-06T03:35:29.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.046+0000 7f316f1c7b80 1 -- 172.21.15.50:0/1127148718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3154020d20 con 0x561f598a5690 2024-06-06T03:35:29.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.050+0000 7f3145ffb700 1 -- 172.21.15.50:0/1127148718 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f3154020b40 con 0x561f598a5690 2024-06-06T03:35:29.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.055+0000 7f316f1c7b80 10 client.16584 fetch_fsmap learned FSMap version 33 2024-06-06T03:35:29.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.055+0000 7f316f1c7b80 1 -- 172.21.15.50:0/1127148718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x561f59922180 con 0x561f598a5690 2024-06-06T03:35:29.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.055+0000 7f3145ffb700 1 -- 172.21.15.50:0/1127148718 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3154020d20 con 0x561f598a5690 2024-06-06T03:35:29.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.055+0000 7f3145ffb700 1 -- 172.21.15.50:0/1127148718 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f3154027070 con 0x561f598a5690 2024-06-06T03:35:29.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.055+0000 7f316f1c7b80 10 client.16584 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:35:29.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.056+0000 7f316f1c7b80 10 client.16584 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:35:29.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.056+0000 7f316f1c7b80 20 client.16584 populate_metadata read hostname 'smithi050' 2024-06-06T03:35:29.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.056+0000 7f316f1c7b80 1 --2- 172.21.15.50:0/1127148718 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561f59922730 0x561f59924b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:29.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.056+0000 7f316f1c7b80 4 client.16584 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-06T03:35:29.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.056+0000 7f316f1c7b80 1 -- 172.21.15.50:0/1127148718 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561f597f5310 con 0x561f59922730 2024-06-06T03:35:29.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.057+0000 7f315e59c700 1 --2- 172.21.15.50:0/1127148718 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561f59922730 0x561f59924b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:29.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.063+0000 7f3145ffb700 10 client.16584 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:29.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.063+0000 7f315e59c700 1 --2- 172.21.15.50:0/1127148718 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561f59922730 0x561f59924b50 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f85ac9ea3f952e2c server_cookie=c01626a0dc2ea16a in_seq=0 out_seq=0 2024-06-06T03:35:29.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.064+0000 7f3145ffb700 1 -- 172.21.15.50:0/1127148718 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561f597f5310 con 0x561f59922730 2024-06-06T03:35:29.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.064+0000 7f3145ffb700 10 client.16584 handle_command_reply: tid=0 2024-06-06T03:35:29.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.065+0000 7f316f1c7b80 1 client.16584 shutdown 2024-06-06T03:35:29.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.068+0000 7f316f1c7b80 1 -- 172.21.15.50:0/1127148718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f598a5690 msgr2=0x561f598ab440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:29.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.068+0000 7f316f1c7b80 1 --2- 172.21.15.50:0/1127148718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f598a5690 0x561f598ab440 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3154022040 tx=0x7f3154010df0 comp rx=0 tx=0).stop 2024-06-06T03:35:29.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.068+0000 7f316f1c7b80 1 -- 172.21.15.50:0/1127148718 shutdown_connections 2024-06-06T03:35:29.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.068+0000 7f316f1c7b80 1 --2- 172.21.15.50:0/1127148718 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x561f59922730 0x561f59924b50 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:29.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.068+0000 7f316f1c7b80 1 --2- 172.21.15.50:0/1127148718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f598bdca0 0x561f598ab980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:29.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.068+0000 7f316f1c7b80 1 --2- 172.21.15.50:0/1127148718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f5989bfa0 0x561f598aaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:29.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.068+0000 7f316f1c7b80 1 --2- 172.21.15.50:0/1127148718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f598a5690 0x561f598ab440 secure :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3154022040 tx=0x7f3154010df0 comp rx=0 tx=0).stop 2024-06-06T03:35:29.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.068+0000 7f316f1c7b80 1 -- 172.21.15.50:0/1127148718 >> 172.21.15.50:0/1127148718 conn(0x561f597c6d40 msgr2=0x561f598a4710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:29.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.068+0000 7f3145ffb700 0 client.16584 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:29.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.069+0000 7f316f1c7b80 1 -- 172.21.15.50:0/1127148718 shutdown_connections 2024-06-06T03:35:29.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.069+0000 7f316f1c7b80 1 -- 172.21.15.50:0/1127148718 wait complete. 2024-06-06T03:35:29.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.069+0000 7f316f1c7b80 20 client.16584 trim_cache size 0 max 16384 2024-06-06T03:35:29.070 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:35:29.070 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-06-06T03:35:29.070 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "2c1efd9e-c170-44a6-96af-ec04fbc2ae9f", 2024-06-06T03:35:29.070 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-06-06T03:35:29.071 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:35:29.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.070+0000 7f3164944700 1 -- 172.21.15.50:0/3470615058 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f31480a2e20 msgr2=0x7f31480a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:29.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.070+0000 7f3164944700 1 --2- 172.21.15.50:0/3470615058 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f31480a2e20 0x7f31480a52e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3160111d70 tx=0x7f3154014750 comp rx=0 tx=0).stop 2024-06-06T03:35:29.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.070+0000 7f3164944700 1 -- 172.21.15.50:0/3470615058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3160107400 msgr2=0x7f3160110fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:29.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.070+0000 7f3164944700 1 --2- 172.21.15.50:0/3470615058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3160107400 0x7f3160110fa0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3158007f10 tx=0x7f315800d3b0 comp rx=0 tx=0).stop 2024-06-06T03:35:29.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.071+0000 7f3164944700 1 -- 172.21.15.50:0/3470615058 shutdown_connections 2024-06-06T03:35:29.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.071+0000 7f3164944700 1 --2- 172.21.15.50:0/3470615058 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f31480a2e20 0x7f31480a52e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:29.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.071+0000 7f3164944700 1 --2- 172.21.15.50:0/3470615058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3160107400 0x7f3160110fa0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:29.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.071+0000 7f3164944700 1 --2- 172.21.15.50:0/3470615058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3160101390 0x7f3160110520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:29.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.071+0000 7f3164944700 1 --2- 172.21.15.50:0/3470615058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3160101d50 0x7f3160110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:29.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.071+0000 7f3164944700 1 -- 172.21.15.50:0/3470615058 >> 172.21.15.50:0/3470615058 conn(0x7f3160078340 msgr2=0x7f3160102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:29.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.071+0000 7f3164944700 1 -- 172.21.15.50:0/3470615058 shutdown_connections 2024-06-06T03:35:29.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:29.071+0000 7f3164944700 1 -- 172.21.15.50:0/3470615058 wait complete. 2024-06-06T03:35:29.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:28 smithi079 ceph-mon[35478]: pgmap v696: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 28 MiB/s wr, 583 op/s 2024-06-06T03:35:29.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:28 smithi122 ceph-mon[35759]: pgmap v696: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 28 MiB/s wr, 583 op/s 2024-06-06T03:35:30.025 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:29 smithi050 ceph-mon[32421]: scrub queued for path: / 2024-06-06T03:35:30.025 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:29 smithi050 ceph-mon[32421]: scrub summary: idle+waiting paths [/] 2024-06-06T03:35:30.025 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:29 smithi050 ceph-mon[32421]: scrub summary: active paths [/] 2024-06-06T03:35:30.025 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:29 smithi050 ceph-mon[32421]: scrub summary: active paths [/] 2024-06-06T03:35:30.026 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:29 smithi050 ceph-mon[32421]: scrub summary: idle+waiting paths [/] 2024-06-06T03:35:30.026 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:29 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:35:30.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:29 smithi079 ceph-mon[35478]: scrub queued for path: / 2024-06-06T03:35:30.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:29 smithi079 ceph-mon[35478]: scrub summary: idle+waiting paths [/] 2024-06-06T03:35:30.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:29 smithi079 ceph-mon[35478]: scrub summary: active paths [/] 2024-06-06T03:35:30.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:29 smithi079 ceph-mon[35478]: scrub summary: active paths [/] 2024-06-06T03:35:30.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:29 smithi079 ceph-mon[35478]: scrub summary: idle+waiting paths [/] 2024-06-06T03:35:30.100 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:29 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:35:30.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:29 smithi122 ceph-mon[35759]: scrub queued for path: / 2024-06-06T03:35:30.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:29 smithi122 ceph-mon[35759]: scrub summary: idle+waiting paths [/] 2024-06-06T03:35:30.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:29 smithi122 ceph-mon[35759]: scrub summary: active paths [/] 2024-06-06T03:35:30.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:29 smithi122 ceph-mon[35759]: scrub summary: active paths [/] 2024-06-06T03:35:30.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:29 smithi122 ceph-mon[35759]: scrub summary: idle+waiting paths [/] 2024-06-06T03:35:30.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:29 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:35:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.345+0000 7f7eec54f640 1 -- 172.21.15.50:0/1930500623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ee410dcc0 msgr2=0x7f7ee410e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.345+0000 7f7eec54f640 1 --2- 172.21.15.50:0/1930500623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ee410dcc0 0x7f7ee410e140 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7edc009ca0 tx=0x7f7edc02a8f0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.354+0000 7f7eec54f640 1 -- 172.21.15.50:0/1930500623 shutdown_connections 2024-06-06T03:35:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.354+0000 7f7eec54f640 1 --2- 172.21.15.50:0/1930500623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ee410dcc0 0x7f7ee410e140 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.354+0000 7f7eec54f640 1 --2- 172.21.15.50:0/1930500623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ee410b310 0x7f7ee410d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.354+0000 7f7eec54f640 1 --2- 172.21.15.50:0/1930500623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ee41089a0 0x7f7ee410add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.354+0000 7f7eec54f640 1 -- 172.21.15.50:0/1930500623 >> 172.21.15.50:0/1930500623 conn(0x7f7ee406ea10 msgr2=0x7f7ee4070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:30.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.362+0000 7f7eec54f640 1 -- 172.21.15.50:0/1930500623 shutdown_connections 2024-06-06T03:35:30.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.366+0000 7f7eec54f640 1 -- 172.21.15.50:0/1930500623 wait complete. 2024-06-06T03:35:30.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.366+0000 7f7eec54f640 1 Processor -- start 2024-06-06T03:35:30.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.367+0000 7f7eec54f640 1 -- start start 2024-06-06T03:35:30.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.367+0000 7f7eec54f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ee41089a0 0x7f7ee41a68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:30.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.367+0000 7f7eec54f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ee410b310 0x7f7ee41a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:30.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.367+0000 7f7eec54f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ee410dcc0 0x7f7ee41ade50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:30.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.367+0000 7f7eec54f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee411c340 con 0x7f7ee410dcc0 2024-06-06T03:35:30.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.367+0000 7f7eec54f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee411c1c0 con 0x7f7ee41089a0 2024-06-06T03:35:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.367+0000 7f7eec54f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee411c4c0 con 0x7f7ee410b310 2024-06-06T03:35:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.368+0000 7f7ee9aea640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ee410b310 0x7f7ee41a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.368+0000 7f7ee9aea640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ee410b310 0x7f7ee41a6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:37956/0 (socket says 172.21.15.50:37956) 2024-06-06T03:35:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.368+0000 7f7ee9aea640 1 -- 172.21.15.50:0/3591982334 learned_addr learned my addr 172.21.15.50:0/3591982334 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.368+0000 7f7ee9aea640 1 -- 172.21.15.50:0/3591982334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ee41089a0 msgr2=0x7f7ee41a68f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T03:35:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.368+0000 7f7ee9aea640 1 --2- 172.21.15.50:0/3591982334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ee41089a0 0x7f7ee41a68f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.370 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.368+0000 7f7ee9aea640 1 -- 172.21.15.50:0/3591982334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ee410dcc0 msgr2=0x7f7ee41ade50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:30.370 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.368+0000 7f7ee9aea640 1 --2- 172.21.15.50:0/3591982334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ee410dcc0 0x7f7ee41ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.370 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.368+0000 7f7ee9aea640 1 -- 172.21.15.50:0/3591982334 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ee41ae4c0 con 0x7f7ee410b310 2024-06-06T03:35:30.370 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.368+0000 7f7ee9aea640 1 --2- 172.21.15.50:0/3591982334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ee410b310 0x7f7ee41a6e30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000e9f0 tx=0x7f7ee000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:30.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.370+0000 7f7edb7fe640 1 -- 172.21.15.50:0/3591982334 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee000cd80 con 0x7f7ee410b310 2024-06-06T03:35:30.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.370+0000 7f7edb7fe640 1 -- 172.21.15.50:0/3591982334 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7ee00108e0 con 0x7f7ee410b310 2024-06-06T03:35:30.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.371+0000 7f7edb7fe640 1 -- 172.21.15.50:0/3591982334 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0018810 con 0x7f7ee410b310 2024-06-06T03:35:30.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.372+0000 7f7eec54f640 1 -- 172.21.15.50:0/3591982334 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ee41ae7b0 con 0x7f7ee410b310 2024-06-06T03:35:30.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.372+0000 7f7eec54f640 1 -- 172.21.15.50:0/3591982334 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ee41aec80 con 0x7f7ee410b310 2024-06-06T03:35:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.378+0000 7f7eef256740 1 Processor -- start 2024-06-06T03:35:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.381+0000 7f7eef256740 1 -- start start 2024-06-06T03:35:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.381+0000 7f7eef256740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593dc8fc010 0x5593dc8fc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.381+0000 7f7eef256740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593dc8fca00 0x5593dc901500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.381+0000 7f7eef256740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593dc901b70 0x5593dc904000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.381+0000 7f7eef256740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5593dc85f4f0 con 0x5593dc8fc010 2024-06-06T03:35:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.381+0000 7f7eef256740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5593dc7fd870 con 0x5593dc8fca00 2024-06-06T03:35:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.381+0000 7f7eef256740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5593dc85b4b0 con 0x5593dc901b70 2024-06-06T03:35:30.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.381+0000 7f7ee9aea640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593dc901b70 0x5593dc904000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:30.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.381+0000 7f7ee9aea640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593dc901b70 0x5593dc904000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:37960/0 (socket says 172.21.15.50:37960) 2024-06-06T03:35:30.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.381+0000 7f7ee9aea640 1 -- 172.21.15.50:0/172124800 learned_addr learned my addr 172.21.15.50:0/172124800 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.384+0000 7f7eea2eb640 1 --2- 172.21.15.50:0/172124800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593dc8fca00 0x5593dc901500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.384+0000 7f7eea2eb640 1 -- 172.21.15.50:0/172124800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593dc901b70 msgr2=0x5593dc904000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.384+0000 7f7eea2eb640 1 --2- 172.21.15.50:0/172124800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593dc901b70 0x5593dc904000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.384+0000 7f7eea2eb640 1 -- 172.21.15.50:0/172124800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593dc8fc010 msgr2=0x5593dc8fc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.384+0000 7f7eea2eb640 1 --2- 172.21.15.50:0/172124800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593dc8fc010 0x5593dc8fc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.384+0000 7f7eea2eb640 1 -- 172.21.15.50:0/172124800 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593dc8199b0 con 0x5593dc8fca00 2024-06-06T03:35:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.384+0000 7f7eea2eb640 1 --2- 172.21.15.50:0/172124800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593dc8fca00 0x5593dc901500 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7ed400a8c0 tx=0x7f7ed400ad80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=441f4c93b53ce99c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.385+0000 7f7edb7fe640 1 -- 172.21.15.50:0/3591982334 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7ee001f020 con 0x7f7ee410b310 2024-06-06T03:35:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.386+0000 7f7edb7fe640 1 --2- 172.21.15.50:0/3591982334 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7ed00a2cc0 0x7f7ed00a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.386+0000 7f7edb7fe640 1 -- 172.21.15.50:0/3591982334 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f7ee00cf530 con 0x7f7ee410b310 2024-06-06T03:35:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.388+0000 7f7eeaaec640 1 --2- 172.21.15.50:0/3591982334 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7ed00a2cc0 0x7f7ed00a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:30.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.389+0000 7f7eeaaec640 1 --2- 172.21.15.50:0/3591982334 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7ed00a2cc0 0x7f7ed00a5180 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7edc02f570 tx=0x7f7edc02adf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.391+0000 7f7ed8bfe640 1 -- 172.21.15.50:0/172124800 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed400ccc0 con 0x5593dc8fca00 2024-06-06T03:35:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.391+0000 7f7ed8bfe640 1 -- 172.21.15.50:0/172124800 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7ed400f900 con 0x5593dc8fca00 2024-06-06T03:35:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.391+0000 7f7ed8bfe640 1 -- 172.21.15.50:0/172124800 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed400e7a0 con 0x5593dc8fca00 2024-06-06T03:35:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.392+0000 7f7eef256740 1 -- 172.21.15.50:0/172124800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593dc8fca00 msgr2=0x5593dc901500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.392+0000 7f7eef256740 1 --2- 172.21.15.50:0/172124800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593dc8fca00 0x5593dc901500 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7ed400a8c0 tx=0x7f7ed400ad80 comp rx=0 tx=0).stop 2024-06-06T03:35:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.393+0000 7f7eef256740 1 -- 172.21.15.50:0/172124800 shutdown_connections 2024-06-06T03:35:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.393+0000 7f7eef256740 1 --2- 172.21.15.50:0/172124800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593dc901b70 0x5593dc904000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.393+0000 7f7eef256740 1 --2- 172.21.15.50:0/172124800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593dc8fca00 0x5593dc901500 secure :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7ed400a8c0 tx=0x7f7ed400ad80 comp rx=0 tx=0).stop 2024-06-06T03:35:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.393+0000 7f7eef256740 1 --2- 172.21.15.50:0/172124800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593dc8fc010 0x5593dc8fc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.393+0000 7f7eef256740 1 -- 172.21.15.50:0/172124800 >> 172.21.15.50:0/172124800 conn(0x5593dc8f7680 msgr2=0x5593dc8f7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.412+0000 7f7eef256740 1 -- 172.21.15.50:0/172124800 shutdown_connections 2024-06-06T03:35:30.417 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.417+0000 7f7eef256740 1 -- 172.21.15.50:0/172124800 wait complete. 2024-06-06T03:35:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.418+0000 7f7eef256740 1 -- start start 2024-06-06T03:35:30.421 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.421+0000 7f7eef256740 1 Processor -- start 2024-06-06T03:35:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.424+0000 7f7eef256740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593dc8fc010 0x5593dc906500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.424+0000 7f7eef256740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593dc901b70 0x5593dc906a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.424+0000 7f7eef256740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593dc90ba70 0x5593dc90de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.424+0000 7f7eef256740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5593dc904b20 con 0x5593dc8fc010 2024-06-06T03:35:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.424+0000 7f7eef256740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5593dc7e8ae0 con 0x5593dc901b70 2024-06-06T03:35:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.424+0000 7f7eef256740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5593dc904ca0 con 0x5593dc90ba70 2024-06-06T03:35:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.424+0000 7f7eef256740 10 client.0 _ll_register_callbacks cb 0x5593dc8219b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:35:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.424+0000 7f7ee9aea640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593dc901b70 0x5593dc906a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:30.425 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.424+0000 7f7ee9aea640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593dc901b70 0x5593dc906a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:36728/0 (socket says 172.21.15.50:36728) 2024-06-06T03:35:30.425 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.424+0000 7f7ee9aea640 1 -- 172.21.15.50:0/919388697 learned_addr learned my addr 172.21.15.50:0/919388697 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:30.425 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.426+0000 7f7eeaaec640 1 --2- 172.21.15.50:0/919388697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593dc90ba70 0x5593dc90de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:30.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.429+0000 7f7ee9aea640 1 -- 172.21.15.50:0/919388697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593dc90ba70 msgr2=0x5593dc90de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:30.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.429+0000 7f7ee9aea640 1 --2- 172.21.15.50:0/919388697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593dc90ba70 0x5593dc90de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.429+0000 7f7ee9aea640 1 -- 172.21.15.50:0/919388697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593dc8fc010 msgr2=0x5593dc906500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:35:30.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.429+0000 7f7ee9aea640 1 --2- 172.21.15.50:0/919388697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593dc8fc010 0x5593dc906500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.429+0000 7f7ee9aea640 1 -- 172.21.15.50:0/919388697 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593dc573210 con 0x5593dc901b70 2024-06-06T03:35:30.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.430+0000 7f7ee9aea640 1 --2- 172.21.15.50:0/919388697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593dc901b70 0x5593dc906a40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000c6a0 tx=0x7f7ee0097d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da56f6519d329a28 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:30.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.430+0000 7f7ecdffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:35:30.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.430+0000 7f7ecdffb640 1 -- 172.21.15.50:0/919388697 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee009c0b0 con 0x5593dc901b70 2024-06-06T03:35:30.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.431+0000 7f7eef256740 1 -- 172.21.15.50:0/919388697 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ed400f900 con 0x5593dc901b70 2024-06-06T03:35:30.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.431+0000 7f7ecdffb640 1 -- 172.21.15.50:0/919388697 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f7ee009bc10 con 0x5593dc901b70 2024-06-06T03:35:30.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.431+0000 7f7ecdffb640 1 -- 172.21.15.50:0/919388697 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7ee009b9b0 con 0x5593dc901b70 2024-06-06T03:35:30.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.431+0000 7f7eef256740 10 client.26270 fetch_fsmap learned FSMap version 33 2024-06-06T03:35:30.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.431+0000 7f7eef256740 1 -- 172.21.15.50:0/919388697 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5593dc63f620 con 0x5593dc901b70 2024-06-06T03:35:30.432 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.431+0000 7f7ecdffb640 1 -- 172.21.15.50:0/919388697 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7ed400f900 con 0x5593dc901b70 2024-06-06T03:35:30.432 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.431+0000 7f7ecdffb640 1 -- 172.21.15.50:0/919388697 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f7ee009cce0 con 0x5593dc901b70 2024-06-06T03:35:30.432 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.431+0000 7f7eef256740 10 client.26270 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:35:30.432 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.431+0000 7f7eef256740 10 client.26270 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:35:30.432 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.431+0000 7f7eef256740 20 client.26270 populate_metadata read hostname 'smithi050' 2024-06-06T03:35:30.432 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.431+0000 7f7eef256740 1 --2- 172.21.15.50:0/919388697 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5593dc923ba0 0x5593dc926000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:30.432 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.431+0000 7f7eef256740 4 client.26270 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:35:30.432 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.431+0000 7f7eef256740 1 -- 172.21.15.50:0/919388697 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593dc872f10 con 0x5593dc923ba0 2024-06-06T03:35:30.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.434+0000 7f7eea2eb640 1 --2- 172.21.15.50:0/919388697 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5593dc923ba0 0x5593dc926000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:30.435 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.435+0000 7f7eea2eb640 1 --2- 172.21.15.50:0/919388697 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5593dc923ba0 0x5593dc926000 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=885416e27006dc5b server_cookie=7630b452165bd72e in_seq=0 out_seq=0 2024-06-06T03:35:30.435 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.435+0000 7f7ecdffb640 10 client.26270 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:30.436 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.436+0000 7f7ecdffb640 1 -- 172.21.15.50:0/919388697 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5593dc872f10 con 0x5593dc923ba0 2024-06-06T03:35:30.436 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.436+0000 7f7ecdffb640 10 client.26270 handle_command_reply: tid=0 2024-06-06T03:35:30.436 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.436+0000 7f7eef256740 1 client.26270 shutdown 2024-06-06T03:35:30.438 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.438+0000 7f7eef256740 1 -- 172.21.15.50:0/919388697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593dc901b70 msgr2=0x5593dc906a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:30.438 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.438+0000 7f7eef256740 1 --2- 172.21.15.50:0/919388697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593dc901b70 0x5593dc906a40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000c6a0 tx=0x7f7ee0097d40 comp rx=0 tx=0).stop 2024-06-06T03:35:30.438 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.438+0000 7f7eef256740 1 -- 172.21.15.50:0/919388697 shutdown_connections 2024-06-06T03:35:30.438 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.438+0000 7f7eef256740 1 --2- 172.21.15.50:0/919388697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593dc90ba70 0x5593dc90de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.438 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.438+0000 7f7eef256740 1 --2- 172.21.15.50:0/919388697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593dc901b70 0x5593dc906a40 secure :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000c6a0 tx=0x7f7ee0097d40 comp rx=0 tx=0).stop 2024-06-06T03:35:30.438 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.438+0000 7f7eef256740 1 --2- 172.21.15.50:0/919388697 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5593dc923ba0 0x5593dc926000 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.438 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.438+0000 7f7eef256740 1 --2- 172.21.15.50:0/919388697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593dc8fc010 0x5593dc906500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.438 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.438+0000 7f7eef256740 1 -- 172.21.15.50:0/919388697 >> 172.21.15.50:0/919388697 conn(0x5593dc8f7680 msgr2=0x5593dc8f67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:30.438 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.438+0000 7f7ecdffb640 0 client.26270 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:30.439 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.438+0000 7f7eef256740 1 -- 172.21.15.50:0/919388697 shutdown_connections 2024-06-06T03:35:30.439 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.438+0000 7f7eef256740 1 -- 172.21.15.50:0/919388697 wait complete. 2024-06-06T03:35:30.439 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.438+0000 7f7eef256740 20 client.26270 trim_cache size 0 max 16384 2024-06-06T03:35:30.456 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.455+0000 7f7eef256740 1 Processor -- start 2024-06-06T03:35:30.456 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.455+0000 7f7eef256740 1 -- start start 2024-06-06T03:35:30.456 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.455+0000 7f7eef256740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593dc8fc010 0x5593dc904f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:30.456 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.455+0000 7f7eef256740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593dc90ba70 0x5593dc9054d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:30.456 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.455+0000 7f7eef256740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593dc8fdf40 0x5593dc8fe3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:30.456 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.455+0000 7f7eef256740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee41b3230 con 0x5593dc8fc010 2024-06-06T03:35:30.456 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.455+0000 7f7eef256740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee41b0b00 con 0x5593dc90ba70 2024-06-06T03:35:30.456 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.455+0000 7f7eef256740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee4118280 con 0x5593dc8fdf40 2024-06-06T03:35:30.456 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.455+0000 7f7eea2eb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593dc8fc010 0x5593dc904f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:30.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.455+0000 7f7eeaaec640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593dc8fdf40 0x5593dc8fe3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:30.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.455+0000 7f7ee9aea640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593dc90ba70 0x5593dc9054d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:30.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.455+0000 7f7eeaaec640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593dc8fdf40 0x5593dc8fe3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:37988/0 (socket says 172.21.15.50:37988) 2024-06-06T03:35:30.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.455+0000 7f7ee9aea640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593dc90ba70 0x5593dc9054d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:36736/0 (socket says 172.21.15.50:36736) 2024-06-06T03:35:30.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.455+0000 7f7eeaaec640 1 -- 172.21.15.50:0/1170008630 learned_addr learned my addr 172.21.15.50:0/1170008630 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:30.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.456+0000 7f7ee9aea640 1 -- 172.21.15.50:0/1170008630 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593dc8fdf40 msgr2=0x5593dc8fe3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:30.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.456+0000 7f7ee9aea640 1 --2- 172.21.15.50:0/1170008630 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593dc8fdf40 0x5593dc8fe3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.456+0000 7f7ee9aea640 1 -- 172.21.15.50:0/1170008630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593dc8fc010 msgr2=0x5593dc904f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:30.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.456+0000 7f7ee9aea640 1 --2- 172.21.15.50:0/1170008630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593dc8fc010 0x5593dc904f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.456+0000 7f7ee9aea640 1 -- 172.21.15.50:0/1170008630 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593dc90e1d0 con 0x5593dc90ba70 2024-06-06T03:35:30.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.456+0000 7f7eea2eb640 1 --2- 172.21.15.50:0/1170008630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593dc8fc010 0x5593dc904f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:35:30.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.456+0000 7f7ee9aea640 1 --2- 172.21.15.50:0/1170008630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593dc90ba70 0x5593dc9054d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x5593dc907320 tx=0x7f7ee000cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9afd977111cf0430 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:30.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.456+0000 7f7ecffff640 1 -- 172.21.15.50:0/1170008630 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee009c0b0 con 0x5593dc90ba70 2024-06-06T03:35:30.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.456+0000 7f7ecffff640 1 -- 172.21.15.50:0/1170008630 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7ee00a4620 con 0x5593dc90ba70 2024-06-06T03:35:30.458 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.456+0000 7f7ecffff640 1 -- 172.21.15.50:0/1170008630 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee009b080 con 0x5593dc90ba70 2024-06-06T03:35:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.457+0000 7f7eef256740 1 -- 172.21.15.50:0/1170008630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593dc90ba70 msgr2=0x5593dc9054d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.457+0000 7f7eef256740 1 --2- 172.21.15.50:0/1170008630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593dc90ba70 0x5593dc9054d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x5593dc907320 tx=0x7f7ee000cf20 comp rx=0 tx=0).stop 2024-06-06T03:35:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.457+0000 7f7eef256740 1 -- 172.21.15.50:0/1170008630 shutdown_connections 2024-06-06T03:35:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.457+0000 7f7eef256740 1 --2- 172.21.15.50:0/1170008630 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593dc8fdf40 0x5593dc8fe3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.457+0000 7f7eef256740 1 --2- 172.21.15.50:0/1170008630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593dc90ba70 0x5593dc9054d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.457+0000 7f7eef256740 1 --2- 172.21.15.50:0/1170008630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593dc8fc010 0x5593dc904f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.457+0000 7f7eef256740 1 -- 172.21.15.50:0/1170008630 >> 172.21.15.50:0/1170008630 conn(0x5593dc8f7680 msgr2=0x5593dc906500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.457+0000 7f7eef256740 1 -- 172.21.15.50:0/1170008630 shutdown_connections 2024-06-06T03:35:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.457+0000 7f7eef256740 1 -- 172.21.15.50:0/1170008630 wait complete. 2024-06-06T03:35:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.457+0000 7f7eef256740 1 -- start start 2024-06-06T03:35:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.457+0000 7f7eef256740 1 Processor -- start 2024-06-06T03:35:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.458+0000 7f7eef256740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593dc8fc010 0x5593dc934e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.458+0000 7f7eef256740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593dc8fdf40 0x5593dc9353c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.458+0000 7f7eef256740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593dc90ba70 0x5593dc98c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.458+0000 7f7eef256740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee41aeff0 con 0x5593dc8fdf40 2024-06-06T03:35:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.458+0000 7f7eef256740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee41b0430 con 0x5593dc90ba70 2024-06-06T03:35:30.462 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.458+0000 7f7eef256740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee41af690 con 0x5593dc8fc010 2024-06-06T03:35:30.462 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.458+0000 7f7ee9aea640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593dc8fdf40 0x5593dc9353c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:30.462 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.458+0000 7f7eef256740 10 client.0 _ll_register_callbacks cb 0x7f7ee00d2b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:35:30.462 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.458+0000 7f7ee9aea640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593dc8fdf40 0x5593dc9353c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60758/0 (socket says 172.21.15.50:60758) 2024-06-06T03:35:30.462 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.458+0000 7f7eea2eb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593dc8fc010 0x5593dc934e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:30.462 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.458+0000 7f7ee9aea640 1 -- 172.21.15.50:0/2333271270 learned_addr learned my addr 172.21.15.50:0/2333271270 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:30.462 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.458+0000 7f7eeaaec640 1 --2- 172.21.15.50:0/2333271270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593dc90ba70 0x5593dc98c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:30.462 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.458+0000 7f7ee9aea640 1 -- 172.21.15.50:0/2333271270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593dc8fc010 msgr2=0x5593dc934e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:30.462 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.458+0000 7f7ee9aea640 1 --2- 172.21.15.50:0/2333271270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593dc8fc010 0x5593dc934e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.462 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.458+0000 7f7ee9aea640 1 -- 172.21.15.50:0/2333271270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593dc90ba70 msgr2=0x5593dc98c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:30.462 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.458+0000 7f7ee9aea640 1 --2- 172.21.15.50:0/2333271270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593dc90ba70 0x5593dc98c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.462 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.458+0000 7f7ee9aea640 1 -- 172.21.15.50:0/2333271270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593dc98cc90 con 0x5593dc8fdf40 2024-06-06T03:35:30.462 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.458+0000 7f7eeaaec640 1 --2- 172.21.15.50:0/2333271270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593dc90ba70 0x5593dc98c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:35:30.462 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.458+0000 7f7ee9aea640 1 --2- 172.21.15.50:0/2333271270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593dc8fdf40 0x5593dc9353c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f7ee00a40f0 tx=0x7f7ee000c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f95d959cf8a0684e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:30.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.458+0000 7f7ecdffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:35:30.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.458+0000 7f7ecdffb640 1 -- 172.21.15.50:0/2333271270 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee009c0b0 con 0x5593dc8fdf40 2024-06-06T03:35:30.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.458+0000 7f7ecdffb640 1 -- 172.21.15.50:0/2333271270 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f7ee009b020 con 0x5593dc8fdf40 2024-06-06T03:35:30.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.458+0000 7f7eef256740 1 -- 172.21.15.50:0/2333271270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ee00a4620 con 0x5593dc8fdf40 2024-06-06T03:35:30.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.459+0000 7f7ecdffb640 1 -- 172.21.15.50:0/2333271270 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7ee00a4410 con 0x5593dc8fdf40 2024-06-06T03:35:30.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.459+0000 7f7eef256740 10 client.16593 fetch_fsmap learned FSMap version 33 2024-06-06T03:35:30.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.459+0000 7f7eef256740 1 -- 172.21.15.50:0/2333271270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5593dc98def0 con 0x5593dc8fdf40 2024-06-06T03:35:30.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.459+0000 7f7ecdffb640 1 -- 172.21.15.50:0/2333271270 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7ee00a4620 con 0x5593dc8fdf40 2024-06-06T03:35:30.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.459+0000 7f7ecdffb640 1 -- 172.21.15.50:0/2333271270 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f7ee009cce0 con 0x5593dc8fdf40 2024-06-06T03:35:30.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.459+0000 7f7eef256740 10 client.16593 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:35:30.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.459+0000 7f7eef256740 10 client.16593 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:35:30.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.459+0000 7f7eef256740 20 client.16593 populate_metadata read hostname 'smithi050' 2024-06-06T03:35:30.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.459+0000 7f7eef256740 1 --2- 172.21.15.50:0/2333271270 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5593dc98e700 0x5593dc990b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:30.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.459+0000 7f7eef256740 4 client.16593 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:35:30.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.459+0000 7f7eef256740 1 -- 172.21.15.50:0/2333271270 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5593dc86cc20 con 0x5593dc98e700 2024-06-06T03:35:30.464 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.459+0000 7f7eea2eb640 1 --2- 172.21.15.50:0/2333271270 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5593dc98e700 0x5593dc990b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:30.464 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.459+0000 7f7ecdffb640 10 client.16593 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:30.464 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.459+0000 7f7eea2eb640 1 --2- 172.21.15.50:0/2333271270 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5593dc98e700 0x5593dc990b20 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1926a4780b8b6a0 server_cookie=9a274217262d8af6 in_seq=0 out_seq=0 2024-06-06T03:35:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.463+0000 7f7ecdffb640 1 -- 172.21.15.50:0/2333271270 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5593dc86cc20 con 0x5593dc98e700 2024-06-06T03:35:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.463+0000 7f7ecdffb640 10 client.16593 handle_command_reply: tid=0 2024-06-06T03:35:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.463+0000 7f7eef256740 1 client.16593 shutdown 2024-06-06T03:35:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.463+0000 7f7eef256740 1 -- 172.21.15.50:0/2333271270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593dc8fdf40 msgr2=0x5593dc9353c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.463+0000 7f7eef256740 1 --2- 172.21.15.50:0/2333271270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593dc8fdf40 0x5593dc9353c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f7ee00a40f0 tx=0x7f7ee000c7d0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.463+0000 7f7eef256740 1 -- 172.21.15.50:0/2333271270 shutdown_connections 2024-06-06T03:35:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.463+0000 7f7eef256740 1 --2- 172.21.15.50:0/2333271270 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5593dc98e700 0x5593dc990b20 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.463+0000 7f7ecdffb640 0 client.16593 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.463+0000 7f7eef256740 1 --2- 172.21.15.50:0/2333271270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593dc8fdf40 0x5593dc9353c0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.463+0000 7f7eef256740 1 --2- 172.21.15.50:0/2333271270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593dc90ba70 0x5593dc98c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.463+0000 7f7eef256740 1 --2- 172.21.15.50:0/2333271270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593dc8fc010 0x5593dc934e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.463+0000 7f7eef256740 1 -- 172.21.15.50:0/2333271270 >> 172.21.15.50:0/2333271270 conn(0x5593dc8f7680 msgr2=0x5593dc904f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.463+0000 7f7eef256740 1 -- 172.21.15.50:0/2333271270 shutdown_connections 2024-06-06T03:35:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.463+0000 7f7eef256740 1 -- 172.21.15.50:0/2333271270 wait complete. 2024-06-06T03:35:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.463+0000 7f7eef256740 20 client.16593 trim_cache size 0 max 16384 2024-06-06T03:35:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:35:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:35:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:35:30.467 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.463+0000 7f7eec54f640 1 -- 172.21.15.50:0/3591982334 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7ed00a2cc0 msgr2=0x7f7ed00a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:30.467 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.463+0000 7f7eec54f640 1 --2- 172.21.15.50:0/3591982334 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7ed00a2cc0 0x7f7ed00a5180 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7edc02f570 tx=0x7f7edc02adf0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.467 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.463+0000 7f7eec54f640 1 -- 172.21.15.50:0/3591982334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ee410b310 msgr2=0x7f7ee41a6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.463+0000 7f7eec54f640 1 --2- 172.21.15.50:0/3591982334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ee410b310 0x7f7ee41a6e30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000e9f0 tx=0x7f7ee000eeb0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.464+0000 7f7eec54f640 1 -- 172.21.15.50:0/3591982334 shutdown_connections 2024-06-06T03:35:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.464+0000 7f7eec54f640 1 --2- 172.21.15.50:0/3591982334 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f7ed00a2cc0 0x7f7ed00a5180 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.464+0000 7f7eec54f640 1 --2- 172.21.15.50:0/3591982334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ee410dcc0 0x7f7ee41ade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.464+0000 7f7eec54f640 1 --2- 172.21.15.50:0/3591982334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ee410b310 0x7f7ee41a6e30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.464+0000 7f7eec54f640 1 --2- 172.21.15.50:0/3591982334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ee41089a0 0x7f7ee41a68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.464+0000 7f7eec54f640 1 -- 172.21.15.50:0/3591982334 >> 172.21.15.50:0/3591982334 conn(0x7f7ee406ea10 msgr2=0x7f7ee410d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.464+0000 7f7eec54f640 1 -- 172.21.15.50:0/3591982334 shutdown_connections 2024-06-06T03:35:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:30.464+0000 7f7eec54f640 1 -- 172.21.15.50:0/3591982334 wait complete. 2024-06-06T03:35:31.009 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:30 smithi079 ceph-mon[35478]: scrub summary: idle+waiting paths [/] 2024-06-06T03:35:31.009 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:30 smithi079 ceph-mon[35478]: pgmap v697: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 36 MiB/s wr, 771 op/s 2024-06-06T03:35:31.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:30 smithi122 ceph-mon[35759]: scrub summary: idle+waiting paths [/] 2024-06-06T03:35:31.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:30 smithi122 ceph-mon[35759]: pgmap v697: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 36 MiB/s wr, 771 op/s 2024-06-06T03:35:31.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:30 smithi050 ceph-mon[32421]: scrub summary: idle+waiting paths [/] 2024-06-06T03:35:31.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:30 smithi050 ceph-mon[32421]: pgmap v697: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 36 MiB/s wr, 771 op/s 2024-06-06T03:35:31.419 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-06T03:35:32.381 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:35:33.085 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:32 smithi050 ceph-mon[32421]: pgmap v698: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 27 MiB/s wr, 588 op/s 2024-06-06T03:35:33.085 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:32 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:35:33.085 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:32 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:35:33.085 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:32 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:35:33.085 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:32 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:35:33.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:32 smithi079 ceph-mon[35478]: pgmap v698: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 27 MiB/s wr, 588 op/s 2024-06-06T03:35:33.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:32 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:35:33.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:32 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:35:33.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:32 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:35:33.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:32 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:35:33.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:32 smithi122 ceph-mon[35759]: pgmap v698: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 27 MiB/s wr, 588 op/s 2024-06-06T03:35:33.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:32 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:35:33.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:32 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:35:33.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:32 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:35:33.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:32 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:35:34.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.911+0000 7f3e25336700 1 -- 172.21.15.50:0/2525526138 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e18009480 con 0x7f3e20113660 2024-06-06T03:35:34.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.912+0000 7f3e2859c700 1 -- 172.21.15.50:0/2525526138 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e20113660 msgr2=0x7f3e20115a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:34.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.912+0000 7f3e2859c700 1 --2- 172.21.15.50:0/2525526138 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e20113660 0x7f3e20115a50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800b0a0 tx=0x7f3e1800b3b0 comp rx=0 tx=0).stop 2024-06-06T03:35:34.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.913+0000 7f3e2859c700 1 -- 172.21.15.50:0/2525526138 shutdown_connections 2024-06-06T03:35:34.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.913+0000 7f3e2859c700 1 --2- 172.21.15.50:0/2525526138 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e20113660 0x7f3e20115a50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:34.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.913+0000 7f3e2859c700 1 --2- 172.21.15.50:0/2525526138 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e200746c0 0x7f3e20074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:34.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.913+0000 7f3e2859c700 1 --2- 172.21.15.50:0/2525526138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e20074fe0 0x7f3e20113120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:34.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.913+0000 7f3e2859c700 1 -- 172.21.15.50:0/2525526138 >> 172.21.15.50:0/2525526138 conn(0x7f3e200795f0 msgr2=0x7f3e20079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:34.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.918+0000 7f3e2859c700 1 -- 172.21.15.50:0/2525526138 shutdown_connections 2024-06-06T03:35:34.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.918+0000 7f3e2859c700 1 -- 172.21.15.50:0/2525526138 wait complete. 2024-06-06T03:35:34.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.919+0000 7f3e2859c700 1 Processor -- start 2024-06-06T03:35:34.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.919+0000 7f3e2859c700 1 -- start start 2024-06-06T03:35:34.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.919+0000 7f3e2859c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e200746c0 0x7f3e2010e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:34.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.919+0000 7f3e2859c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e20074fe0 0x7f3e2010ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:34.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.919+0000 7f3e2859c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e20113660 0x7f3e20107900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:34.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.919+0000 7f3e2859c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3e20118cf0 con 0x7f3e200746c0 2024-06-06T03:35:34.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.919+0000 7f3e2859c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3e20118b70 con 0x7f3e20074fe0 2024-06-06T03:35:34.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.919+0000 7f3e2859c700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3e20118e70 con 0x7f3e20113660 2024-06-06T03:35:34.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.920+0000 7f3e26338700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e200746c0 0x7f3e2010e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:34.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.920+0000 7f3e26338700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e200746c0 0x7f3e2010e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60778/0 (socket says 172.21.15.50:60778) 2024-06-06T03:35:34.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.920+0000 7f3e26338700 1 -- 172.21.15.50:0/4136548923 learned_addr learned my addr 172.21.15.50:0/4136548923 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:34.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.920+0000 7f3e25b37700 1 --2- 172.21.15.50:0/4136548923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e20074fe0 0x7f3e2010ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:34.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.920+0000 7f3e26b39700 1 --2- 172.21.15.50:0/4136548923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e20113660 0x7f3e20107900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:34.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.921+0000 7f3e26338700 1 -- 172.21.15.50:0/4136548923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e20113660 msgr2=0x7f3e20107900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:34.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.921+0000 7f3e26338700 1 --2- 172.21.15.50:0/4136548923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e20113660 0x7f3e20107900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:34.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.921+0000 7f3e26338700 1 -- 172.21.15.50:0/4136548923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e20074fe0 msgr2=0x7f3e2010ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:34.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.921+0000 7f3e26338700 1 --2- 172.21.15.50:0/4136548923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e20074fe0 0x7f3e2010ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:34.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.921+0000 7f3e26338700 1 -- 172.21.15.50:0/4136548923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e20108200 con 0x7f3e200746c0 2024-06-06T03:35:34.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.923+0000 7f3e26338700 1 --2- 172.21.15.50:0/4136548923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e200746c0 0x7f3e2010e670 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00e9a0 tx=0x7f3e1c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:34.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.924+0000 7f3e177fe700 1 -- 172.21.15.50:0/4136548923 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c00cbd0 con 0x7f3e200746c0 2024-06-06T03:35:34.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.924+0000 7f3e2859c700 1 -- 172.21.15.50:0/4136548923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e201084f0 con 0x7f3e200746c0 2024-06-06T03:35:34.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.924+0000 7f3e2859c700 1 -- 172.21.15.50:0/4136548923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e2010c4c0 con 0x7f3e200746c0 2024-06-06T03:35:34.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.924+0000 7f3e177fe700 1 -- 172.21.15.50:0/4136548923 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3e1c00cd70 con 0x7f3e200746c0 2024-06-06T03:35:34.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.924+0000 7f3e177fe700 1 -- 172.21.15.50:0/4136548923 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c018710 con 0x7f3e200746c0 2024-06-06T03:35:34.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.931+0000 7f3e177fe700 1 -- 172.21.15.50:0/4136548923 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3e1c0188b0 con 0x7f3e200746c0 2024-06-06T03:35:34.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.933+0000 7f3e32e1fb80 1 Processor -- start 2024-06-06T03:35:34.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.938+0000 7f3e177fe700 1 --2- 172.21.15.50:0/4136548923 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f3e0c0a2df0 0x7f3e0c0a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:34.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.938+0000 7f3e177fe700 1 -- 172.21.15.50:0/4136548923 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f3e1c0cf4d0 con 0x7f3e200746c0 2024-06-06T03:35:34.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.938+0000 7f3e32e1fb80 1 -- start start 2024-06-06T03:35:34.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.939+0000 7f3e32e1fb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be9e847f60 0x55be9e848340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:34.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.939+0000 7f3e32e1fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be9e848880 0x55be9e842260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:34.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.939+0000 7f3e32e1fb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55be9e8427a0 0x55be9e842bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:34.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.939+0000 7f3e32e1fb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55be9e734f60 con 0x55be9e847f60 2024-06-06T03:35:34.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.939+0000 7f3e32e1fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55be9e793850 con 0x55be9e848880 2024-06-06T03:35:34.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.939+0000 7f3e32e1fb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55be9e6fb460 con 0x55be9e8427a0 2024-06-06T03:35:34.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.940+0000 7f3e25b37700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be9e848880 0x55be9e842260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:34.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.940+0000 7f3e26b39700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55be9e8427a0 0x55be9e842bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:34.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.940+0000 7f3e26b39700 1 --2- 172.21.15.50:0/4136548923 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f3e0c0a2df0 0x7f3e0c0a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:34.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.940+0000 7f3e26b39700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55be9e8427a0 0x55be9e842bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:38026/0 (socket says 172.21.15.50:38026) 2024-06-06T03:35:34.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.940+0000 7f3e26b39700 1 -- 172.21.15.50:0/3745040865 learned_addr learned my addr 172.21.15.50:0/3745040865 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:34.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.940+0000 7f3e26b39700 1 -- 172.21.15.50:0/3745040865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be9e848880 msgr2=0x55be9e842260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:34.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.940+0000 7f3e26b39700 1 --2- 172.21.15.50:0/3745040865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be9e848880 0x55be9e842260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:34.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.940+0000 7f3e26b39700 1 -- 172.21.15.50:0/3745040865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be9e847f60 msgr2=0x55be9e848340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:35:34.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.940+0000 7f3e26b39700 1 --2- 172.21.15.50:0/3745040865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be9e847f60 0x55be9e848340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:34.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.940+0000 7f3e26b39700 1 -- 172.21.15.50:0/3745040865 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be9e6e28d0 con 0x55be9e8427a0 2024-06-06T03:35:34.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.940+0000 7f3e26b39700 1 --2- 172.21.15.50:0/4136548923 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f3e0c0a2df0 0x7f3e0c0a52b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3e180062a0 tx=0x7f3e18009ba0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:34.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.943+0000 7f3e26b39700 1 --2- 172.21.15.50:0/3745040865 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55be9e8427a0 0x55be9e842bc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800b0a0 tx=0x7f3e18025000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8f7b27eb7f360a2 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:34.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.943+0000 7f3e14ff9700 1 -- 172.21.15.50:0/3745040865 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e18004e00 con 0x55be9e8427a0 2024-06-06T03:35:34.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.943+0000 7f3e14ff9700 1 -- 172.21.15.50:0/3745040865 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3e1800bab0 con 0x55be9e8427a0 2024-06-06T03:35:34.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.943+0000 7f3e14ff9700 1 -- 172.21.15.50:0/3745040865 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1801db30 con 0x55be9e8427a0 2024-06-06T03:35:34.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.947+0000 7f3e32e1fb80 1 -- 172.21.15.50:0/3745040865 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55be9e8427a0 msgr2=0x55be9e842bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:34.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.947+0000 7f3e32e1fb80 1 --2- 172.21.15.50:0/3745040865 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55be9e8427a0 0x55be9e842bc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800b0a0 tx=0x7f3e18025000 comp rx=0 tx=0).stop 2024-06-06T03:35:34.953 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:34 smithi050 ceph-mon[32421]: pgmap v699: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 26 MiB/s wr, 559 op/s 2024-06-06T03:35:34.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.953+0000 7f3e32e1fb80 1 -- 172.21.15.50:0/3745040865 shutdown_connections 2024-06-06T03:35:34.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.953+0000 7f3e32e1fb80 1 --2- 172.21.15.50:0/3745040865 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55be9e8427a0 0x55be9e842bc0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:34.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.953+0000 7f3e32e1fb80 1 --2- 172.21.15.50:0/3745040865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be9e847f60 0x55be9e848340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:34.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.953+0000 7f3e32e1fb80 1 --2- 172.21.15.50:0/3745040865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be9e848880 0x55be9e842260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:34.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.953+0000 7f3e32e1fb80 1 -- 172.21.15.50:0/3745040865 >> 172.21.15.50:0/3745040865 conn(0x55be9e76f080 msgr2=0x55be9e83d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:34.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.955+0000 7f3e32e1fb80 1 -- 172.21.15.50:0/3745040865 shutdown_connections 2024-06-06T03:35:34.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.959+0000 7f3e32e1fb80 1 -- 172.21.15.50:0/3745040865 wait complete. 2024-06-06T03:35:34.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.959+0000 7f3e32e1fb80 1 -- start start 2024-06-06T03:35:34.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.959+0000 7f3e32e1fb80 1 Processor -- start 2024-06-06T03:35:34.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.960+0000 7f3e32e1fb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55be9e8427a0 0x55be9e84e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:34.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.960+0000 7f3e32e1fb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be9e847f60 0x55be9e84b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:34.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.960+0000 7f3e26338700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55be9e8427a0 0x55be9e84e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:34.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.960+0000 7f3e26338700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55be9e8427a0 0x55be9e84e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:38038/0 (socket says 172.21.15.50:38038) 2024-06-06T03:35:34.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.960+0000 7f3e26338700 1 -- 172.21.15.50:0/3919448035 learned_addr learned my addr 172.21.15.50:0/3919448035 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:34.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.960+0000 7f3e32e1fb80 1 --2- 172.21.15.50:0/3919448035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be9e848880 0x55be9e84bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:34.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.961+0000 7f3e32e1fb80 1 -- 172.21.15.50:0/3919448035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55be9e733fc0 con 0x55be9e847f60 2024-06-06T03:35:34.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.961+0000 7f3e26b39700 1 --2- 172.21.15.50:0/3919448035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be9e848880 0x55be9e84bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:34.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.961+0000 7f3e32e1fb80 1 -- 172.21.15.50:0/3919448035 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55be9e78f810 con 0x55be9e848880 2024-06-06T03:35:34.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.961+0000 7f3e32e1fb80 1 -- 172.21.15.50:0/3919448035 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55be9e8601b0 con 0x55be9e8427a0 2024-06-06T03:35:34.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.961+0000 7f3e32e1fb80 10 client.0 _ll_register_callbacks cb 0x55be9e7295b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:35:34.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.961+0000 7f3e26338700 1 -- 172.21.15.50:0/3919448035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be9e848880 msgr2=0x55be9e84bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:34.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.961+0000 7f3e26338700 1 --2- 172.21.15.50:0/3919448035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be9e848880 0x55be9e84bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:34.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.961+0000 7f3e26338700 1 -- 172.21.15.50:0/3919448035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be9e847f60 msgr2=0x55be9e84b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:34.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.961+0000 7f3e26338700 1 --2- 172.21.15.50:0/3919448035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be9e847f60 0x55be9e84b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:34.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.961+0000 7f3e26338700 1 -- 172.21.15.50:0/3919448035 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be9e759750 con 0x55be9e8427a0 2024-06-06T03:35:34.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.962+0000 7f3e32e1fb80 1 -- 172.21.15.50:0/3919448035 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e1800bab0 con 0x55be9e8427a0 2024-06-06T03:35:34.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.962+0000 7f3e26b39700 1 --2- 172.21.15.50:0/3919448035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be9e848880 0x55be9e84bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:35:34.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.964+0000 7f3e26338700 1 --2- 172.21.15.50:0/3919448035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55be9e8427a0 0x55be9e84e6d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c09b8e0 tx=0x7f3e1c09b3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1968a0afe278de97 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:34.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.964+0000 7f3e09ffb700 10 client.26302 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:35:34.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.965+0000 7f3e09ffb700 1 -- 172.21.15.50:0/3919448035 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c0b9050 con 0x55be9e8427a0 2024-06-06T03:35:34.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.965+0000 7f3e09ffb700 1 -- 172.21.15.50:0/3919448035 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f3e1c018ba0 con 0x55be9e8427a0 2024-06-06T03:35:34.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.966+0000 7f3e09ffb700 1 -- 172.21.15.50:0/3919448035 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f3e1c0b4060 con 0x55be9e8427a0 2024-06-06T03:35:34.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.966+0000 7f3e32e1fb80 10 client.26302 fetch_fsmap learned FSMap version 33 2024-06-06T03:35:34.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.966+0000 7f3e32e1fb80 1 -- 172.21.15.50:0/3919448035 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({fsmap=33}) -- 0x55be9e86a7e0 con 0x55be9e8427a0 2024-06-06T03:35:34.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.968+0000 7f3e09ffb700 1 -- 172.21.15.50:0/3919448035 <== mon.1 v2:172.21.15.122:3300/0 4 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f3e1c0b4b50 con 0x55be9e8427a0 2024-06-06T03:35:34.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.968+0000 7f3e32e1fb80 10 client.26302 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:35:34.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.968+0000 7f3e32e1fb80 10 client.26302 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:35:34.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.968+0000 7f3e32e1fb80 20 client.26302 populate_metadata read hostname 'smithi050' 2024-06-06T03:35:34.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.968+0000 7f3e32e1fb80 1 --2- 172.21.15.50:0/3919448035 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55be9e86ccb0 0x55be9e86f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:34.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.968+0000 7f3e32e1fb80 4 client.26302 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:35:34.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.968+0000 7f3e32e1fb80 1 -- 172.21.15.50:0/3919448035 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be9e7a0d50 con 0x55be9e86ccb0 2024-06-06T03:35:34.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.971+0000 7f3e25b37700 1 --2- 172.21.15.50:0/3919448035 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55be9e86ccb0 0x55be9e86f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:34.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.974+0000 7f3e09ffb700 10 client.26302 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:34.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.974+0000 7f3e25b37700 1 --2- 172.21.15.50:0/3919448035 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55be9e86ccb0 0x55be9e86f110 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2e94668f679d03e server_cookie=2178d2c180c69611 in_seq=0 out_seq=0 2024-06-06T03:35:34.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.976+0000 7f3e09ffb700 1 -- 172.21.15.50:0/3919448035 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55be9e7a0d50 con 0x55be9e86ccb0 2024-06-06T03:35:34.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.976+0000 7f3e09ffb700 10 client.26302 handle_command_reply: tid=0 2024-06-06T03:35:34.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.976+0000 7f3e32e1fb80 1 client.26302 shutdown 2024-06-06T03:35:34.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.977+0000 7f3e32e1fb80 1 -- 172.21.15.50:0/3919448035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55be9e8427a0 msgr2=0x55be9e84e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:34.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.977+0000 7f3e32e1fb80 1 --2- 172.21.15.50:0/3919448035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55be9e8427a0 0x55be9e84e6d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c09b8e0 tx=0x7f3e1c09b3e0 comp rx=0 tx=0).stop 2024-06-06T03:35:34.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.977+0000 7f3e32e1fb80 1 -- 172.21.15.50:0/3919448035 shutdown_connections 2024-06-06T03:35:34.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.977+0000 7f3e32e1fb80 1 --2- 172.21.15.50:0/3919448035 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55be9e86ccb0 0x55be9e86f110 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:34.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.977+0000 7f3e32e1fb80 1 --2- 172.21.15.50:0/3919448035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be9e848880 0x55be9e84bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:34.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.977+0000 7f3e32e1fb80 1 --2- 172.21.15.50:0/3919448035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55be9e8427a0 0x55be9e84e6d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:34.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.977+0000 7f3e32e1fb80 1 --2- 172.21.15.50:0/3919448035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be9e847f60 0x55be9e84b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:34.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.977+0000 7f3e32e1fb80 1 -- 172.21.15.50:0/3919448035 >> 172.21.15.50:0/3919448035 conn(0x55be9e76f080 msgr2=0x55be9e83c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:34.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.978+0000 7f3e09ffb700 0 client.26302 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:34.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.978+0000 7f3e32e1fb80 1 -- 172.21.15.50:0/3919448035 shutdown_connections 2024-06-06T03:35:34.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.978+0000 7f3e32e1fb80 1 -- 172.21.15.50:0/3919448035 wait complete. 2024-06-06T03:35:34.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:34.979+0000 7f3e32e1fb80 20 client.26302 trim_cache size 0 max 16384 2024-06-06T03:35:35.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.030+0000 7f3e32e1fb80 1 Processor -- start 2024-06-06T03:35:35.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.030+0000 7f3e32e1fb80 1 -- start start 2024-06-06T03:35:35.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.031+0000 7f3e32e1fb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55be9e8427a0 0x55be9e869360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:35.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.031+0000 7f3e32e1fb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be9e847f60 0x55be9e849450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:35.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.031+0000 7f3e32e1fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be9e848880 0x55be9e84e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:35.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.031+0000 7f3e32e1fb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3e040113d0 con 0x55be9e847f60 2024-06-06T03:35:35.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.031+0000 7f3e32e1fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0400ec60 con 0x55be9e848880 2024-06-06T03:35:35.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.031+0000 7f3e32e1fb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0400cab0 con 0x55be9e8427a0 2024-06-06T03:35:35.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.031+0000 7f3e26b39700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be9e848880 0x55be9e84e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:35.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.031+0000 7f3e26b39700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be9e848880 0x55be9e84e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:36772/0 (socket says 172.21.15.50:36772) 2024-06-06T03:35:35.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.031+0000 7f3e26b39700 1 -- 172.21.15.50:0/2246372919 learned_addr learned my addr 172.21.15.50:0/2246372919 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:35.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.031+0000 7f3e25b37700 1 --2- 172.21.15.50:0/2246372919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be9e847f60 0x55be9e849450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:35.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.031+0000 7f3e26b39700 1 -- 172.21.15.50:0/2246372919 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55be9e8427a0 msgr2=0x55be9e869360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:35:35.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.031+0000 7f3e26b39700 1 --2- 172.21.15.50:0/2246372919 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55be9e8427a0 0x55be9e869360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:35.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.031+0000 7f3e26b39700 1 -- 172.21.15.50:0/2246372919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be9e847f60 msgr2=0x55be9e849450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:35.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.031+0000 7f3e26b39700 1 --2- 172.21.15.50:0/2246372919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be9e847f60 0x55be9e849450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:35.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.031+0000 7f3e26b39700 1 -- 172.21.15.50:0/2246372919 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be9e848590 con 0x55be9e848880 2024-06-06T03:35:35.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.034+0000 7f3e26b39700 1 --2- 172.21.15.50:0/2246372919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be9e848880 0x55be9e84e210 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800d010 tx=0x7f3e1801d450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b191b252e276d62 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:35.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.036+0000 7f3e0bfff700 1 -- 172.21.15.50:0/2246372919 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1803a070 con 0x55be9e848880 2024-06-06T03:35:35.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.036+0000 7f3e0bfff700 1 -- 172.21.15.50:0/2246372919 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3e18007c70 con 0x55be9e848880 2024-06-06T03:35:35.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.036+0000 7f3e0bfff700 1 -- 172.21.15.50:0/2246372919 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1801dd60 con 0x55be9e848880 2024-06-06T03:35:35.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.037+0000 7f3e32e1fb80 1 -- 172.21.15.50:0/2246372919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be9e848880 msgr2=0x55be9e84e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:35.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.037+0000 7f3e32e1fb80 1 --2- 172.21.15.50:0/2246372919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be9e848880 0x55be9e84e210 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800d010 tx=0x7f3e1801d450 comp rx=0 tx=0).stop 2024-06-06T03:35:35.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.041+0000 7f3e32e1fb80 1 -- 172.21.15.50:0/2246372919 shutdown_connections 2024-06-06T03:35:35.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.041+0000 7f3e32e1fb80 1 --2- 172.21.15.50:0/2246372919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be9e848880 0x55be9e84e210 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:35.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.041+0000 7f3e32e1fb80 1 --2- 172.21.15.50:0/2246372919 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55be9e8427a0 0x55be9e869360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:35.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.041+0000 7f3e32e1fb80 1 --2- 172.21.15.50:0/2246372919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be9e847f60 0x55be9e849450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:35.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.041+0000 7f3e32e1fb80 1 -- 172.21.15.50:0/2246372919 >> 172.21.15.50:0/2246372919 conn(0x55be9e76f080 msgr2=0x55be9e848d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:35.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.045+0000 7f3e32e1fb80 1 -- 172.21.15.50:0/2246372919 shutdown_connections 2024-06-06T03:35:35.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.047+0000 7f3e32e1fb80 1 -- 172.21.15.50:0/2246372919 wait complete. 2024-06-06T03:35:35.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.047+0000 7f3e32e1fb80 1 -- start start 2024-06-06T03:35:35.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.047+0000 7f3e32e1fb80 1 Processor -- start 2024-06-06T03:35:35.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.048+0000 7f3e32e1fb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55be9e8427a0 0x55be9e865920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:35.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.048+0000 7f3e32e1fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be9e847f60 0x55be9e873f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:35.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.048+0000 7f3e32e1fb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be9e848880 0x55be9e8744d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:35.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.048+0000 7f3e32e1fb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0400d120 con 0x55be9e848880 2024-06-06T03:35:35.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.048+0000 7f3e32e1fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0400e590 con 0x55be9e847f60 2024-06-06T03:35:35.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.048+0000 7f3e32e1fb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0400d7f0 con 0x55be9e8427a0 2024-06-06T03:35:35.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.048+0000 7f3e32e1fb80 10 client.0 _ll_register_callbacks cb 0x55be9e846600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:35:35.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.049+0000 7f3e26b39700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be9e848880 0x55be9e8744d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:35.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.049+0000 7f3e26b39700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be9e848880 0x55be9e8744d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60806/0 (socket says 172.21.15.50:60806) 2024-06-06T03:35:35.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.049+0000 7f3e26b39700 1 -- 172.21.15.50:0/4170316658 learned_addr learned my addr 172.21.15.50:0/4170316658 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:35.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.050+0000 7f3e26b39700 1 -- 172.21.15.50:0/4170316658 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55be9e8427a0 msgr2=0x55be9e865920 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:35:35.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.050+0000 7f3e26b39700 1 --2- 172.21.15.50:0/4170316658 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55be9e8427a0 0x55be9e865920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:35.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.050+0000 7f3e26b39700 1 -- 172.21.15.50:0/4170316658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be9e847f60 msgr2=0x55be9e873f90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:35:35.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.050+0000 7f3e26b39700 1 --2- 172.21.15.50:0/4170316658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be9e847f60 0x55be9e873f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:35.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.050+0000 7f3e26b39700 1 -- 172.21.15.50:0/4170316658 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be9e839810 con 0x55be9e848880 2024-06-06T03:35:35.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.050+0000 7f3e26b39700 1 --2- 172.21.15.50:0/4170316658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be9e848880 0x55be9e8744d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800b3f0 tx=0x7f3e1801d9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=559c38ac302a05c7 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:35.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.050+0000 7f3e09ffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:35:35.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.051+0000 7f3e09ffb700 1 -- 172.21.15.50:0/4170316658 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1803a070 con 0x55be9e848880 2024-06-06T03:35:35.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.051+0000 7f3e32e1fb80 1 -- 172.21.15.50:0/4170316658 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e18007c70 con 0x55be9e848880 2024-06-06T03:35:35.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.051+0000 7f3e09ffb700 1 -- 172.21.15.50:0/4170316658 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f3e18026040 con 0x55be9e848880 2024-06-06T03:35:35.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.055+0000 7f3e09ffb700 1 -- 172.21.15.50:0/4170316658 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f3e180077c0 con 0x55be9e848880 2024-06-06T03:35:35.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.055+0000 7f3e32e1fb80 10 client.16602 fetch_fsmap learned FSMap version 33 2024-06-06T03:35:35.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.055+0000 7f3e32e1fb80 1 -- 172.21.15.50:0/4170316658 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55be9e8d7500 con 0x55be9e848880 2024-06-06T03:35:35.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.058+0000 7f3e09ffb700 1 -- 172.21.15.50:0/4170316658 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3e18007c70 con 0x55be9e848880 2024-06-06T03:35:35.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.059+0000 7f3e09ffb700 1 -- 172.21.15.50:0/4170316658 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f3e18011070 con 0x55be9e848880 2024-06-06T03:35:35.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.059+0000 7f3e32e1fb80 10 client.16602 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:35:35.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.059+0000 7f3e32e1fb80 10 client.16602 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:35:35.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.059+0000 7f3e32e1fb80 20 client.16602 populate_metadata read hostname 'smithi050' 2024-06-06T03:35:35.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.059+0000 7f3e32e1fb80 1 --2- 172.21.15.50:0/4170316658 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55be9e8d7aa0 0x55be9e8d9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:35.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.059+0000 7f3e32e1fb80 4 client.16602 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-06T03:35:35.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.059+0000 7f3e32e1fb80 1 -- 172.21.15.50:0/4170316658 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55be9e79b2d0 con 0x55be9e8d7aa0 2024-06-06T03:35:35.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.060+0000 7f3e26338700 1 --2- 172.21.15.50:0/4170316658 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55be9e8d7aa0 0x55be9e8d9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:35.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.063+0000 7f3e26338700 1 --2- 172.21.15.50:0/4170316658 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55be9e8d7aa0 0x55be9e8d9ec0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10dfde576f7d5ed server_cookie=3113c0784b3401f9 in_seq=0 out_seq=0 2024-06-06T03:35:35.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.063+0000 7f3e09ffb700 10 client.16602 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:35.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.063+0000 7f3e09ffb700 1 -- 172.21.15.50:0/4170316658 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55be9e79b2d0 con 0x55be9e8d7aa0 2024-06-06T03:35:35.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.064+0000 7f3e09ffb700 10 client.16602 handle_command_reply: tid=0 2024-06-06T03:35:35.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.064+0000 7f3e32e1fb80 1 client.16602 shutdown 2024-06-06T03:35:35.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.070+0000 7f3e32e1fb80 1 -- 172.21.15.50:0/4170316658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be9e848880 msgr2=0x55be9e8744d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:35.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.070+0000 7f3e32e1fb80 1 --2- 172.21.15.50:0/4170316658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be9e848880 0x55be9e8744d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800b3f0 tx=0x7f3e1801d9e0 comp rx=0 tx=0).stop 2024-06-06T03:35:35.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.070+0000 7f3e32e1fb80 1 -- 172.21.15.50:0/4170316658 shutdown_connections 2024-06-06T03:35:35.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.070+0000 7f3e32e1fb80 1 --2- 172.21.15.50:0/4170316658 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55be9e8d7aa0 0x55be9e8d9ec0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:35.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.070+0000 7f3e32e1fb80 1 --2- 172.21.15.50:0/4170316658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be9e848880 0x55be9e8744d0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:35.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.070+0000 7f3e32e1fb80 1 --2- 172.21.15.50:0/4170316658 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55be9e8427a0 0x55be9e865920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:35.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.070+0000 7f3e32e1fb80 1 --2- 172.21.15.50:0/4170316658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be9e847f60 0x55be9e873f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:35.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.070+0000 7f3e32e1fb80 1 -- 172.21.15.50:0/4170316658 >> 172.21.15.50:0/4170316658 conn(0x55be9e76f080 msgr2=0x55be9e8494f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:35.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.070+0000 7f3e09ffb700 0 client.16602 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:35.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.070+0000 7f3e32e1fb80 1 -- 172.21.15.50:0/4170316658 shutdown_connections 2024-06-06T03:35:35.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.070+0000 7f3e32e1fb80 1 -- 172.21.15.50:0/4170316658 wait complete. 2024-06-06T03:35:35.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.070+0000 7f3e32e1fb80 20 client.16602 trim_cache size 0 max 16384 2024-06-06T03:35:35.073 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:35:35.073 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-06T03:35:35.073 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2024-06-06T03:35:35.074 INFO:teuthology.orchestra.run.smithi050.stdout: "2c1efd9e-c170-44a6-96af-ec04fbc2ae9f": { 2024-06-06T03:35:35.074 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2024-06-06T03:35:35.074 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "2c1efd9e-c170-44a6-96af-ec04fbc2ae9f", 2024-06-06T03:35:35.074 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "recursive,force" 2024-06-06T03:35:35.074 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:35:35.074 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:35:35.075 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:35:35.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.071+0000 7f3e2859c700 1 -- 172.21.15.50:0/4136548923 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f3e0c0a2df0 msgr2=0x7f3e0c0a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:35.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.071+0000 7f3e2859c700 1 --2- 172.21.15.50:0/4136548923 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f3e0c0a2df0 0x7f3e0c0a52b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3e180062a0 tx=0x7f3e18009ba0 comp rx=0 tx=0).stop 2024-06-06T03:35:35.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.071+0000 7f3e2859c700 1 -- 172.21.15.50:0/4136548923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e200746c0 msgr2=0x7f3e2010e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:35.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.071+0000 7f3e2859c700 1 --2- 172.21.15.50:0/4136548923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e200746c0 0x7f3e2010e670 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00e9a0 tx=0x7f3e1c00ecb0 comp rx=0 tx=0).stop 2024-06-06T03:35:35.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.074+0000 7f3e2859c700 1 -- 172.21.15.50:0/4136548923 shutdown_connections 2024-06-06T03:35:35.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.074+0000 7f3e2859c700 1 --2- 172.21.15.50:0/4136548923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e20113660 0x7f3e20107900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:35.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.074+0000 7f3e2859c700 1 --2- 172.21.15.50:0/4136548923 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f3e0c0a2df0 0x7f3e0c0a52b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:35.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.074+0000 7f3e2859c700 1 --2- 172.21.15.50:0/4136548923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e200746c0 0x7f3e2010e670 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:35.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.074+0000 7f3e2859c700 1 --2- 172.21.15.50:0/4136548923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e20074fe0 0x7f3e2010ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:35.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.074+0000 7f3e2859c700 1 -- 172.21.15.50:0/4136548923 >> 172.21.15.50:0/4136548923 conn(0x7f3e200795f0 msgr2=0x7f3e20112490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:35.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.074+0000 7f3e2859c700 1 -- 172.21.15.50:0/4136548923 shutdown_connections 2024-06-06T03:35:35.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:35:35.075+0000 7f3e2859c700 1 -- 172.21.15.50:0/4136548923 wait complete. 2024-06-06T03:35:35.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:34 smithi079 ceph-mon[35478]: pgmap v699: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 26 MiB/s wr, 559 op/s 2024-06-06T03:35:35.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:34 smithi122 ceph-mon[35759]: pgmap v699: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 26 MiB/s wr, 559 op/s 2024-06-06T03:35:35.905 INFO:tasks.cephfs.filesystem:scrub status for tag:2c1efd9e-c170-44a6-96af-ec04fbc2ae9f - {'path': '/', 'tag': '2c1efd9e-c170-44a6-96af-ec04fbc2ae9f', 'options': 'recursive,force'} 2024-06-06T03:35:37.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:37 smithi079 ceph-mon[35478]: pgmap v700: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 34 MiB/s wr, 736 op/s 2024-06-06T03:35:37.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:37 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:35:37.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:37 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:35:37.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:37 smithi122 ceph-mon[35759]: pgmap v700: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 34 MiB/s wr, 736 op/s 2024-06-06T03:35:37.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:37 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:35:37.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:37 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:35:37.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:37 smithi050 ceph-mon[32421]: pgmap v700: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 34 MiB/s wr, 736 op/s 2024-06-06T03:35:37.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:37 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:35:37.503 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:37 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:35:38.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:38 smithi079 ceph-mon[35478]: scrub summary: idle 2024-06-06T03:35:38.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:38 smithi079 ceph-mon[35478]: scrub summary: idle 2024-06-06T03:35:38.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:38 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:35:38.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:38 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:35:38.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:38 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:35:38.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:38 smithi122 ceph-mon[35759]: scrub summary: idle 2024-06-06T03:35:38.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:38 smithi122 ceph-mon[35759]: scrub summary: idle 2024-06-06T03:35:38.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:38 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:35:38.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:38 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:35:38.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:38 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:35:38.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:38 smithi050 ceph-mon[32421]: scrub summary: idle 2024-06-06T03:35:38.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:38 smithi050 ceph-mon[32421]: scrub summary: idle 2024-06-06T03:35:38.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:38 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:35:38.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:38 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:35:38.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:38 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:35:39.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:39 smithi079 ceph-mon[35478]: pgmap v701: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 26 MiB/s wr, 566 op/s 2024-06-06T03:35:39.474 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:39 smithi122 ceph-mon[35759]: pgmap v701: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 26 MiB/s wr, 566 op/s 2024-06-06T03:35:39.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:39 smithi050 ceph-mon[32421]: pgmap v701: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 26 MiB/s wr, 566 op/s 2024-06-06T03:35:41.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:41 smithi079 ceph-mon[35478]: pgmap v702: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 34 MiB/s wr, 739 op/s 2024-06-06T03:35:41.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:41 smithi122 ceph-mon[35759]: pgmap v702: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 34 MiB/s wr, 739 op/s 2024-06-06T03:35:41.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:41 smithi050 ceph-mon[32421]: pgmap v702: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 34 MiB/s wr, 739 op/s 2024-06-06T03:35:43.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:43 smithi079 ceph-mon[35478]: pgmap v703: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 27 MiB/s wr, 575 op/s 2024-06-06T03:35:43.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:43 smithi122 ceph-mon[35759]: pgmap v703: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 27 MiB/s wr, 575 op/s 2024-06-06T03:35:43.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:43 smithi050 ceph-mon[32421]: pgmap v703: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 27 MiB/s wr, 575 op/s 2024-06-06T03:35:43.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.667+0000 7fbc7f53b640 1 -- 172.21.15.50:0/3615903185 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc78072cd0 msgr2=0x7fbc780730f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:43.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.667+0000 7fbc7f53b640 1 --2- 172.21.15.50:0/3615903185 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc78072cd0 0x7fbc780730f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbc70009be0 tx=0x7fbc7002a6f0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.675 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.676+0000 7fbc7f53b640 1 -- 172.21.15.50:0/3615903185 shutdown_connections 2024-06-06T03:35:43.675 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.676+0000 7fbc7f53b640 1 --2- 172.21.15.50:0/3615903185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc78109970 0x7fbc7810e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.675 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.676+0000 7fbc7f53b640 1 --2- 172.21.15.50:0/3615903185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc78108fb0 0x7fbc78109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.675 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.676+0000 7fbc7f53b640 1 --2- 172.21.15.50:0/3615903185 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc78072cd0 0x7fbc780730f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.675 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.676+0000 7fbc7f53b640 1 -- 172.21.15.50:0/3615903185 >> 172.21.15.50:0/3615903185 conn(0x7fbc7806e840 msgr2=0x7fbc78070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:43.685 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.687+0000 7fbc7f53b640 1 -- 172.21.15.50:0/3615903185 shutdown_connections 2024-06-06T03:35:43.690 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.691+0000 7fbc7f53b640 1 -- 172.21.15.50:0/3615903185 wait complete. 2024-06-06T03:35:43.690 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.691+0000 7fbc7f53b640 1 Processor -- start 2024-06-06T03:35:43.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.692+0000 7fbc7f53b640 1 -- start start 2024-06-06T03:35:43.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.692+0000 7fbc7f53b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc78072cd0 0x7fbc7819e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:43.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.692+0000 7fbc7f53b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc78108fb0 0x7fbc7819e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:43.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.692+0000 7fbc7f53b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc78109970 0x7fbc781a5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:43.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.692+0000 7fbc7f53b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbc781119b0 con 0x7fbc78072cd0 2024-06-06T03:35:43.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.692+0000 7fbc7f53b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbc78111830 con 0x7fbc78109970 2024-06-06T03:35:43.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.692+0000 7fbc7f53b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbc78111b30 con 0x7fbc78108fb0 2024-06-06T03:35:43.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.693+0000 7fbc7dd38640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc78108fb0 0x7fbc7819e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:43.693 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.693+0000 7fbc7dd38640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc78108fb0 0x7fbc7819e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:41210/0 (socket says 172.21.15.50:41210) 2024-06-06T03:35:43.693 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.693+0000 7fbc7dd38640 1 -- 172.21.15.50:0/1180036529 learned_addr learned my addr 172.21.15.50:0/1180036529 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:43.693 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.693+0000 7fbc7ed3a640 1 --2- 172.21.15.50:0/1180036529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc78109970 0x7fbc781a5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:43.693 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.693+0000 7fbc7e539640 1 --2- 172.21.15.50:0/1180036529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc78072cd0 0x7fbc7819e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:43.693 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.694+0000 7fbc7e539640 1 -- 172.21.15.50:0/1180036529 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc78108fb0 msgr2=0x7fbc7819e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:43.693 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.694+0000 7fbc7e539640 1 --2- 172.21.15.50:0/1180036529 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc78108fb0 0x7fbc7819e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.693 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.694+0000 7fbc7e539640 1 -- 172.21.15.50:0/1180036529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc78109970 msgr2=0x7fbc781a5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:43.694 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.694+0000 7fbc7e539640 1 --2- 172.21.15.50:0/1180036529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc78109970 0x7fbc781a5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.694 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.694+0000 7fbc7e539640 1 -- 172.21.15.50:0/1180036529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc781a5cc0 con 0x7fbc78072cd0 2024-06-06T03:35:43.694 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.694+0000 7fbc7e539640 1 --2- 172.21.15.50:0/1180036529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc78072cd0 0x7fbc7819e0a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fbc70034040 tx=0x7fbc70003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:43.694 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.695+0000 7fbc6f7fe640 1 -- 172.21.15.50:0/1180036529 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc70041020 con 0x7fbc78072cd0 2024-06-06T03:35:43.695 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.695+0000 7fbc6f7fe640 1 -- 172.21.15.50:0/1180036529 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbc70037040 con 0x7fbc78072cd0 2024-06-06T03:35:43.695 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.696+0000 7fbc7f53b640 1 -- 172.21.15.50:0/1180036529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc781a5f50 con 0x7fbc78072cd0 2024-06-06T03:35:43.695 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.696+0000 7fbc7f53b640 1 -- 172.21.15.50:0/1180036529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc781a6360 con 0x7fbc78072cd0 2024-06-06T03:35:43.695 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.696+0000 7fbc6f7fe640 1 -- 172.21.15.50:0/1180036529 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc70036070 con 0x7fbc78072cd0 2024-06-06T03:35:43.701 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.702+0000 7fbc83582740 1 Processor -- start 2024-06-06T03:35:43.704 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.706+0000 7fbc6f7fe640 1 -- 172.21.15.50:0/1180036529 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbc70044020 con 0x7fbc78072cd0 2024-06-06T03:35:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.707+0000 7fbc6f7fe640 1 --2- 172.21.15.50:0/1180036529 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbc640a2d90 0x7fbc640a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:43.706 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.707+0000 7fbc6f7fe640 1 -- 172.21.15.50:0/1180036529 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fbc700efe40 con 0x7fbc78072cd0 2024-06-06T03:35:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.708+0000 7fbc83582740 1 -- start start 2024-06-06T03:35:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.708+0000 7fbc83582740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ef23e61e0 0x564ef23e6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.708+0000 7fbc83582740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ef23e6bd0 0x564ef23eb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.708+0000 7fbc83582740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ef23ebd40 0x564ef23ee1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.708+0000 7fbc83582740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564ef23494f0 con 0x564ef23e61e0 2024-06-06T03:35:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.708+0000 7fbc83582740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564ef22e7870 con 0x564ef23e6bd0 2024-06-06T03:35:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.708+0000 7fbc83582740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564ef23454b0 con 0x564ef23ebd40 2024-06-06T03:35:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.709+0000 7fbc7ed3a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ef23ebd40 0x564ef23ee1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.709+0000 7fbc7ed3a640 1 --2- 172.21.15.50:0/1180036529 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbc640a2d90 0x7fbc640a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.709+0000 7fbc7ed3a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ef23ebd40 0x564ef23ee1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:41222/0 (socket says 172.21.15.50:41222) 2024-06-06T03:35:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.709+0000 7fbc7ed3a640 1 -- 172.21.15.50:0/3759273054 learned_addr learned my addr 172.21.15.50:0/3759273054 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.709+0000 7fbc7dd38640 1 --2- 172.21.15.50:0/3759273054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ef23e6bd0 0x564ef23eb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.709+0000 7fbc7e539640 1 --2- 172.21.15.50:0/3759273054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ef23e61e0 0x564ef23e6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.710+0000 7fbc7dd38640 1 -- 172.21.15.50:0/3759273054 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ef23ebd40 msgr2=0x564ef23ee1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.710+0000 7fbc7dd38640 1 --2- 172.21.15.50:0/3759273054 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ef23ebd40 0x564ef23ee1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.710+0000 7fbc7dd38640 1 -- 172.21.15.50:0/3759273054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ef23e61e0 msgr2=0x564ef23e6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.710+0000 7fbc7dd38640 1 --2- 172.21.15.50:0/3759273054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ef23e61e0 0x564ef23e6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.710+0000 7fbc7dd38640 1 -- 172.21.15.50:0/3759273054 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ef23039b0 con 0x564ef23e6bd0 2024-06-06T03:35:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.710+0000 7fbc7dd38640 1 --2- 172.21.15.50:0/3759273054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ef23e6bd0 0x564ef23eb6d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbc7400abb0 tx=0x7fbc7400f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb2b2446ae0b9eb4 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.713+0000 7fbc6cff9640 1 -- 172.21.15.50:0/3759273054 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc74004220 con 0x564ef23e6bd0 2024-06-06T03:35:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.714+0000 7fbc6cff9640 1 -- 172.21.15.50:0/3759273054 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbc740043c0 con 0x564ef23e6bd0 2024-06-06T03:35:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.714+0000 7fbc6cff9640 1 -- 172.21.15.50:0/3759273054 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc74004e00 con 0x564ef23e6bd0 2024-06-06T03:35:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.715+0000 7fbc83582740 1 -- 172.21.15.50:0/3759273054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ef23e6bd0 msgr2=0x564ef23eb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.715+0000 7fbc83582740 1 --2- 172.21.15.50:0/3759273054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ef23e6bd0 0x564ef23eb6d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbc7400abb0 tx=0x7fbc7400f790 comp rx=0 tx=0).stop 2024-06-06T03:35:43.717 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.718+0000 7fbc83582740 1 -- 172.21.15.50:0/3759273054 shutdown_connections 2024-06-06T03:35:43.717 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.718+0000 7fbc83582740 1 --2- 172.21.15.50:0/3759273054 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ef23ebd40 0x564ef23ee1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.717 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.718+0000 7fbc83582740 1 --2- 172.21.15.50:0/3759273054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ef23e6bd0 0x564ef23eb6d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.717 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.718+0000 7fbc83582740 1 --2- 172.21.15.50:0/3759273054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ef23e61e0 0x564ef23e6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.717 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.718+0000 7fbc83582740 1 -- 172.21.15.50:0/3759273054 >> 172.21.15.50:0/3759273054 conn(0x564ef23e1850 msgr2=0x564ef23e1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:43.718 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.719+0000 7fbc7ed3a640 1 --2- 172.21.15.50:0/1180036529 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbc640a2d90 0x7fbc640a5250 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbc68022500 tx=0x7fbc68005d30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.722+0000 7fbc83582740 1 -- 172.21.15.50:0/3759273054 shutdown_connections 2024-06-06T03:35:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.722+0000 7fbc83582740 1 -- 172.21.15.50:0/3759273054 wait complete. 2024-06-06T03:35:43.722 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.723+0000 7fbc83582740 1 -- start start 2024-06-06T03:35:43.722 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.723+0000 7fbc83582740 1 Processor -- start 2024-06-06T03:35:43.722 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.723+0000 7fbc83582740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ef23e61e0 0x564ef23f0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:43.722 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.723+0000 7fbc83582740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ef23e6bd0 0x564ef23f09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:43.722 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.723+0000 7fbc83582740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ef23ebd40 0x564ef23f79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:43.723 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.723+0000 7fbc83582740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564ef23eed40 con 0x564ef23e6bd0 2024-06-06T03:35:43.723 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.723+0000 7fbc83582740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564ef22d2ae0 con 0x564ef23ebd40 2024-06-06T03:35:43.723 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.723+0000 7fbc83582740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564ef23eeec0 con 0x564ef23e61e0 2024-06-06T03:35:43.723 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.723+0000 7fbc83582740 10 client.0 _ll_register_callbacks cb 0x564ef230b9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:35:43.723 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.724+0000 7fbc7dd38640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ef23e6bd0 0x564ef23f09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:43.723 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.724+0000 7fbc7dd38640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ef23e6bd0 0x564ef23f09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55970/0 (socket says 172.21.15.50:55970) 2024-06-06T03:35:43.723 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.724+0000 7fbc7dd38640 1 -- 172.21.15.50:0/1895606823 learned_addr learned my addr 172.21.15.50:0/1895606823 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:43.723 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.724+0000 7fbc7ed3a640 1 --2- 172.21.15.50:0/1895606823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ef23ebd40 0x564ef23f79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:43.724 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.725+0000 7fbc7dd38640 1 -- 172.21.15.50:0/1895606823 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ef23e61e0 msgr2=0x564ef23f0470 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:35:43.724 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.725+0000 7fbc7dd38640 1 --2- 172.21.15.50:0/1895606823 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ef23e61e0 0x564ef23f0470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.724 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.725+0000 7fbc7dd38640 1 -- 172.21.15.50:0/1895606823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ef23ebd40 msgr2=0x564ef23f79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:43.724 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.725+0000 7fbc7dd38640 1 --2- 172.21.15.50:0/1895606823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ef23ebd40 0x564ef23f79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.724 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.725+0000 7fbc7dd38640 1 -- 172.21.15.50:0/1895606823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ef205d210 con 0x564ef23e6bd0 2024-06-06T03:35:43.725 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.725+0000 7fbc7dd38640 1 --2- 172.21.15.50:0/1895606823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ef23e6bd0 0x564ef23f09b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fbc74019000 tx=0x7fbc74018b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad59ae730034053f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:43.730 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.731+0000 7fbc61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:35:43.730 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.731+0000 7fbc61ffb640 1 -- 172.21.15.50:0/1895606823 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc74027020 con 0x564ef23e6bd0 2024-06-06T03:35:43.730 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.731+0000 7fbc83582740 1 -- 172.21.15.50:0/1895606823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc740043c0 con 0x564ef23e6bd0 2024-06-06T03:35:43.730 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.731+0000 7fbc61ffb640 1 -- 172.21.15.50:0/1895606823 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fbc74023430 con 0x564ef23e6bd0 2024-06-06T03:35:43.735 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.736+0000 7fbc61ffb640 1 -- 172.21.15.50:0/1895606823 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fbc74032050 con 0x564ef23e6bd0 2024-06-06T03:35:43.735 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.737+0000 7fbc83582740 10 client.16614 fetch_fsmap learned FSMap version 33 2024-06-06T03:35:43.736 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.737+0000 7fbc83582740 1 -- 172.21.15.50:0/1895606823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564ef2129620 con 0x564ef23e6bd0 2024-06-06T03:35:43.740 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.741+0000 7fbc61ffb640 1 -- 172.21.15.50:0/1895606823 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbc740043c0 con 0x564ef23e6bd0 2024-06-06T03:35:43.740 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.741+0000 7fbc61ffb640 1 -- 172.21.15.50:0/1895606823 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fbc74022070 con 0x564ef23e6bd0 2024-06-06T03:35:43.740 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.741+0000 7fbc83582740 10 client.16614 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:35:43.740 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.741+0000 7fbc83582740 10 client.16614 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:35:43.740 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.741+0000 7fbc83582740 20 client.16614 populate_metadata read hostname 'smithi050' 2024-06-06T03:35:43.740 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.741+0000 7fbc83582740 1 --2- 172.21.15.50:0/1895606823 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564ef23fc740 0x564ef23febc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:43.741 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.741+0000 7fbc83582740 4 client.16614 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:35:43.741 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.741+0000 7fbc83582740 1 -- 172.21.15.50:0/1895606823 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ef235cf10 con 0x564ef23fc740 2024-06-06T03:35:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.744+0000 7fbc7e539640 1 --2- 172.21.15.50:0/1895606823 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564ef23fc740 0x564ef23febc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:43.745 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.746+0000 7fbc7e539640 1 --2- 172.21.15.50:0/1895606823 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564ef23fc740 0x564ef23febc0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3439cffdae2590a5 server_cookie=eaff85d4af5c301c in_seq=0 out_seq=0 2024-06-06T03:35:43.745 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.746+0000 7fbc61ffb640 10 client.16614 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:43.746 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.747+0000 7fbc61ffb640 1 -- 172.21.15.50:0/1895606823 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x564ef235cf10 con 0x564ef23fc740 2024-06-06T03:35:43.746 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.747+0000 7fbc61ffb640 10 client.16614 handle_command_reply: tid=0 2024-06-06T03:35:43.746 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.747+0000 7fbc83582740 1 client.16614 shutdown 2024-06-06T03:35:43.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.748+0000 7fbc83582740 1 -- 172.21.15.50:0/1895606823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ef23e6bd0 msgr2=0x564ef23f09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:43.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.748+0000 7fbc83582740 1 --2- 172.21.15.50:0/1895606823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ef23e6bd0 0x564ef23f09b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fbc74019000 tx=0x7fbc74018b50 comp rx=0 tx=0).stop 2024-06-06T03:35:43.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.748+0000 7fbc83582740 1 -- 172.21.15.50:0/1895606823 shutdown_connections 2024-06-06T03:35:43.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.748+0000 7fbc83582740 1 --2- 172.21.15.50:0/1895606823 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564ef23fc740 0x564ef23febc0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.748+0000 7fbc83582740 1 --2- 172.21.15.50:0/1895606823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ef23e6bd0 0x564ef23f09b0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.748+0000 7fbc83582740 1 --2- 172.21.15.50:0/1895606823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ef23ebd40 0x564ef23f79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.748+0000 7fbc83582740 1 --2- 172.21.15.50:0/1895606823 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ef23e61e0 0x564ef23f0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.747 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.748+0000 7fbc83582740 1 -- 172.21.15.50:0/1895606823 >> 172.21.15.50:0/1895606823 conn(0x564ef23e1850 msgr2=0x564ef23e09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:43.751 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.750+0000 7fbc61ffb640 0 client.16614 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.753+0000 7fbc83582740 1 -- 172.21.15.50:0/1895606823 shutdown_connections 2024-06-06T03:35:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.754+0000 7fbc83582740 1 -- 172.21.15.50:0/1895606823 wait complete. 2024-06-06T03:35:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.754+0000 7fbc83582740 20 client.16614 trim_cache size 0 max 16384 2024-06-06T03:35:43.785 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.786+0000 7fbc83582740 1 Processor -- start 2024-06-06T03:35:43.785 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.786+0000 7fbc83582740 1 -- start start 2024-06-06T03:35:43.786 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.786+0000 7fbc83582740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ef23e61e0 0x564ef23dc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:43.786 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.786+0000 7fbc83582740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ef23e6bd0 0x564ef23f79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:43.786 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.786+0000 7fbc83582740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ef23ebd40 0x564ef23e7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:43.786 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.787+0000 7fbc83582740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c012530 con 0x564ef23e6bd0 2024-06-06T03:35:43.786 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.787+0000 7fbc83582740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c00fe00 con 0x564ef23ebd40 2024-06-06T03:35:43.786 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.787+0000 7fbc83582740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c00dc50 con 0x564ef23e61e0 2024-06-06T03:35:43.787 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.787+0000 7fbc7dd38640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ef23e6bd0 0x564ef23f79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:43.787 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.787+0000 7fbc7dd38640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ef23e6bd0 0x564ef23f79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55984/0 (socket says 172.21.15.50:55984) 2024-06-06T03:35:43.787 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.787+0000 7fbc7dd38640 1 -- 172.21.15.50:0/1582282449 learned_addr learned my addr 172.21.15.50:0/1582282449 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:43.787 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.788+0000 7fbc7ed3a640 1 --2- 172.21.15.50:0/1582282449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ef23ebd40 0x564ef23e7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:43.787 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.788+0000 7fbc7e539640 1 --2- 172.21.15.50:0/1582282449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ef23e61e0 0x564ef23dc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:43.787 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.788+0000 7fbc7dd38640 1 -- 172.21.15.50:0/1582282449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ef23e61e0 msgr2=0x564ef23dc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:43.787 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.788+0000 7fbc7dd38640 1 --2- 172.21.15.50:0/1582282449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ef23e61e0 0x564ef23dc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.787 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.788+0000 7fbc7dd38640 1 -- 172.21.15.50:0/1582282449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ef23ebd40 msgr2=0x564ef23e7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:43.787 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.788+0000 7fbc7dd38640 1 --2- 172.21.15.50:0/1582282449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ef23ebd40 0x564ef23e7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.787 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.788+0000 7fbc7dd38640 1 -- 172.21.15.50:0/1582282449 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ef23e1680 con 0x564ef23e6bd0 2024-06-06T03:35:43.788 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.788+0000 7fbc7dd38640 1 --2- 172.21.15.50:0/1582282449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ef23e6bd0 0x564ef23f79b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fbc74004810 tx=0x7fbc74005eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6089a1c455bc8e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:43.791 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.789+0000 7fbc63fff640 1 -- 172.21.15.50:0/1582282449 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7403a020 con 0x564ef23e6bd0 2024-06-06T03:35:43.791 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.789+0000 7fbc63fff640 1 -- 172.21.15.50:0/1582282449 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbc7400a7d0 con 0x564ef23e6bd0 2024-06-06T03:35:43.791 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.789+0000 7fbc63fff640 1 -- 172.21.15.50:0/1582282449 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc74027070 con 0x564ef23e6bd0 2024-06-06T03:35:43.792 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.793+0000 7fbc83582740 1 -- 172.21.15.50:0/1582282449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ef23e6bd0 msgr2=0x564ef23f79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:43.792 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.793+0000 7fbc83582740 1 --2- 172.21.15.50:0/1582282449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ef23e6bd0 0x564ef23f79b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fbc74004810 tx=0x7fbc74005eb0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.801 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.800+0000 7fbc83582740 1 -- 172.21.15.50:0/1582282449 shutdown_connections 2024-06-06T03:35:43.801 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.800+0000 7fbc83582740 1 --2- 172.21.15.50:0/1582282449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ef23e6bd0 0x564ef23f79b0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.801 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.800+0000 7fbc83582740 1 --2- 172.21.15.50:0/1582282449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ef23ebd40 0x564ef23e7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.801 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.800+0000 7fbc83582740 1 --2- 172.21.15.50:0/1582282449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ef23e61e0 0x564ef23dc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.801 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.800+0000 7fbc83582740 1 -- 172.21.15.50:0/1582282449 >> 172.21.15.50:0/1582282449 conn(0x564ef23e1850 msgr2=0x564ef23eb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:43.806 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.807+0000 7fbc83582740 1 -- 172.21.15.50:0/1582282449 shutdown_connections 2024-06-06T03:35:43.808 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.809+0000 7fbc83582740 1 -- 172.21.15.50:0/1582282449 wait complete. 2024-06-06T03:35:43.808 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.810+0000 7fbc83582740 1 -- start start 2024-06-06T03:35:43.809 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.810+0000 7fbc83582740 1 Processor -- start 2024-06-06T03:35:43.809 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.810+0000 7fbc83582740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ef23e61e0 0x564ef23f30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:43.809 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.810+0000 7fbc83582740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ef23e6bd0 0x564ef23f3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:43.809 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.810+0000 7fbc83582740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ef23ebd40 0x564ef23f6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:43.809 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.810+0000 7fbc83582740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c00e2c0 con 0x564ef23e6bd0 2024-06-06T03:35:43.809 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.810+0000 7fbc83582740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c00f730 con 0x564ef23ebd40 2024-06-06T03:35:43.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.810+0000 7fbc83582740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c00e990 con 0x564ef23e61e0 2024-06-06T03:35:43.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.810+0000 7fbc83582740 10 client.0 _ll_register_callbacks cb 0x7fbc7400aa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:35:43.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.812+0000 7fbc7ed3a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ef23ebd40 0x564ef23f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:43.811 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.812+0000 7fbc7e539640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ef23e61e0 0x564ef23f30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:43.811 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.812+0000 7fbc7e539640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ef23e61e0 0x564ef23f30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:41252/0 (socket says 172.21.15.50:41252) 2024-06-06T03:35:43.811 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.812+0000 7fbc7e539640 1 -- 172.21.15.50:0/1786318056 learned_addr learned my addr 172.21.15.50:0/1786318056 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:43.813 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.812+0000 7fbc7dd38640 1 --2- 172.21.15.50:0/1786318056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ef23e6bd0 0x564ef23f3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:43.814 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.815+0000 7fbc7e539640 1 -- 172.21.15.50:0/1786318056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ef23ebd40 msgr2=0x564ef23f6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:43.814 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.815+0000 7fbc7e539640 1 --2- 172.21.15.50:0/1786318056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ef23ebd40 0x564ef23f6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.814 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.815+0000 7fbc7e539640 1 -- 172.21.15.50:0/1786318056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ef23e6bd0 msgr2=0x564ef23f3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:43.814 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.815+0000 7fbc7e539640 1 --2- 172.21.15.50:0/1786318056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ef23e6bd0 0x564ef23f3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.814 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.815+0000 7fbc7e539640 1 -- 172.21.15.50:0/1786318056 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ef23f6c40 con 0x564ef23e61e0 2024-06-06T03:35:43.816 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.818+0000 7fbc7e539640 1 --2- 172.21.15.50:0/1786318056 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ef23e61e0 0x564ef23f30f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbc700bce20 tx=0x7fbc7003b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89afa9493069a2e0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.818+0000 7fbc61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:35:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.818+0000 7fbc61ffb640 1 -- 172.21.15.50:0/1786318056 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc700bca80 con 0x564ef23e61e0 2024-06-06T03:35:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.818+0000 7fbc83582740 1 -- 172.21.15.50:0/1786318056 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc7400a7d0 con 0x564ef23e61e0 2024-06-06T03:35:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.819+0000 7fbc61ffb640 1 -- 172.21.15.50:0/1786318056 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fbc700ed670 con 0x564ef23e61e0 2024-06-06T03:35:43.818 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.819+0000 7fbc61ffb640 1 -- 172.21.15.50:0/1786318056 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fbc700bd820 con 0x564ef23e61e0 2024-06-06T03:35:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.820+0000 7fbc83582740 10 client.26317 fetch_fsmap learned FSMap version 33 2024-06-06T03:35:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.820+0000 7fbc83582740 1 -- 172.21.15.50:0/1786318056 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564ef24655c0 con 0x564ef23e61e0 2024-06-06T03:35:43.824 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.825+0000 7fbc61ffb640 1 -- 172.21.15.50:0/1786318056 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbc7400a7d0 con 0x564ef23e61e0 2024-06-06T03:35:43.824 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.825+0000 7fbc61ffb640 1 -- 172.21.15.50:0/1786318056 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fbc7004e060 con 0x564ef23e61e0 2024-06-06T03:35:43.824 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.825+0000 7fbc83582740 10 client.26317 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:35:43.824 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.825+0000 7fbc83582740 10 client.26317 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:35:43.824 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.825+0000 7fbc83582740 20 client.26317 populate_metadata read hostname 'smithi050' 2024-06-06T03:35:43.824 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.825+0000 7fbc83582740 1 --2- 172.21.15.50:0/1786318056 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564ef2465f20 0x564ef2468340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:43.824 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.825+0000 7fbc83582740 4 client.26317 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:35:43.824 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.825+0000 7fbc83582740 1 -- 172.21.15.50:0/1786318056 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564ef2356c20 con 0x564ef2465f20 2024-06-06T03:35:43.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.826+0000 7fbc7dd38640 1 --2- 172.21.15.50:0/1786318056 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564ef2465f20 0x564ef2468340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:43.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.838+0000 7fbc7dd38640 1 --2- 172.21.15.50:0/1786318056 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564ef2465f20 0x564ef2468340 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0371b9b83113efb server_cookie=edc8d5f28190d1 in_seq=0 out_seq=0 2024-06-06T03:35:43.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.840+0000 7fbc61ffb640 10 client.26317 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.856+0000 7fbc61ffb640 1 -- 172.21.15.50:0/1786318056 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x564ef2356c20 con 0x564ef2465f20 2024-06-06T03:35:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.856+0000 7fbc61ffb640 10 client.26317 handle_command_reply: tid=0 2024-06-06T03:35:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.858+0000 7fbc83582740 1 client.26317 shutdown 2024-06-06T03:35:43.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.866+0000 7fbc83582740 1 -- 172.21.15.50:0/1786318056 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ef23e61e0 msgr2=0x564ef23f30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:43.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.866+0000 7fbc83582740 1 --2- 172.21.15.50:0/1786318056 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ef23e61e0 0x564ef23f30f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbc700bce20 tx=0x7fbc7003b000 comp rx=0 tx=0).stop 2024-06-06T03:35:43.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.866+0000 7fbc83582740 1 -- 172.21.15.50:0/1786318056 shutdown_connections 2024-06-06T03:35:43.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.866+0000 7fbc83582740 1 --2- 172.21.15.50:0/1786318056 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564ef2465f20 0x564ef2468340 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.866+0000 7fbc83582740 1 --2- 172.21.15.50:0/1786318056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ef23e6bd0 0x564ef23f3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.866+0000 7fbc83582740 1 --2- 172.21.15.50:0/1786318056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ef23ebd40 0x564ef23f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.866+0000 7fbc83582740 1 --2- 172.21.15.50:0/1786318056 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564ef23e61e0 0x564ef23f30f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.866+0000 7fbc83582740 1 -- 172.21.15.50:0/1786318056 >> 172.21.15.50:0/1786318056 conn(0x564ef23e1850 msgr2=0x564ef23e7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:43.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.867+0000 7fbc61ffb640 0 client.26317 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:43.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.868+0000 7fbc83582740 1 -- 172.21.15.50:0/1786318056 shutdown_connections 2024-06-06T03:35:43.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.868+0000 7fbc83582740 1 -- 172.21.15.50:0/1786318056 wait complete. 2024-06-06T03:35:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.871+0000 7fbc83582740 20 client.26317 trim_cache size 0 max 16384 2024-06-06T03:35:43.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:35:43.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:35:43.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:35:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.873+0000 7fbc7f53b640 1 -- 172.21.15.50:0/1180036529 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbc640a2d90 msgr2=0x7fbc640a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.873+0000 7fbc7f53b640 1 --2- 172.21.15.50:0/1180036529 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbc640a2d90 0x7fbc640a5250 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbc68022500 tx=0x7fbc68005d30 comp rx=0 tx=0).stop 2024-06-06T03:35:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.873+0000 7fbc7f53b640 1 -- 172.21.15.50:0/1180036529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc78072cd0 msgr2=0x7fbc7819e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.873+0000 7fbc7f53b640 1 --2- 172.21.15.50:0/1180036529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc78072cd0 0x7fbc7819e0a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fbc70034040 tx=0x7fbc70003ba0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.874+0000 7fbc7f53b640 1 -- 172.21.15.50:0/1180036529 shutdown_connections 2024-06-06T03:35:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.874+0000 7fbc7f53b640 1 --2- 172.21.15.50:0/1180036529 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fbc640a2d90 0x7fbc640a5250 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.874+0000 7fbc7f53b640 1 --2- 172.21.15.50:0/1180036529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc78109970 0x7fbc781a5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.874+0000 7fbc7f53b640 1 --2- 172.21.15.50:0/1180036529 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc78108fb0 0x7fbc7819e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.874+0000 7fbc7f53b640 1 --2- 172.21.15.50:0/1180036529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc78072cd0 0x7fbc7819e0a0 secure :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fbc70034040 tx=0x7fbc70003ba0 comp rx=0 tx=0).stop 2024-06-06T03:35:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.874+0000 7fbc7f53b640 1 -- 172.21.15.50:0/1180036529 >> 172.21.15.50:0/1180036529 conn(0x7fbc7806e840 msgr2=0x7fbc7810c470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:43.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.881+0000 7fbc7f53b640 1 -- 172.21.15.50:0/1180036529 shutdown_connections 2024-06-06T03:35:43.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:43.881+0000 7fbc7f53b640 1 -- 172.21.15.50:0/1180036529 wait complete. 2024-06-06T03:35:45.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:45 smithi079 ceph-mon[35478]: pgmap v704: 129 pgs: 129 active+clean; 10 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 28 MiB/s wr, 600 op/s 2024-06-06T03:35:45.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:45 smithi122 ceph-mon[35759]: pgmap v704: 129 pgs: 129 active+clean; 10 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 28 MiB/s wr, 600 op/s 2024-06-06T03:35:45.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:45 smithi050 ceph-mon[32421]: pgmap v704: 129 pgs: 129 active+clean; 10 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 28 MiB/s wr, 600 op/s 2024-06-06T03:35:47.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:47 smithi079 ceph-mon[35478]: pgmap v705: 129 pgs: 129 active+clean; 10 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 35 MiB/s wr, 767 op/s 2024-06-06T03:35:47.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:47 smithi122 ceph-mon[35759]: pgmap v705: 129 pgs: 129 active+clean; 10 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 35 MiB/s wr, 767 op/s 2024-06-06T03:35:47.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:47 smithi050 ceph-mon[32421]: pgmap v705: 129 pgs: 129 active+clean; 10 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 35 MiB/s wr, 767 op/s 2024-06-06T03:35:49.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:49 smithi079 ceph-mon[35478]: pgmap v706: 129 pgs: 129 active+clean; 10 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 29 MiB/s wr, 621 op/s 2024-06-06T03:35:49.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:49 smithi122 ceph-mon[35759]: pgmap v706: 129 pgs: 129 active+clean; 10 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 29 MiB/s wr, 621 op/s 2024-06-06T03:35:49.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:49 smithi050 ceph-mon[32421]: pgmap v706: 129 pgs: 129 active+clean; 10 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 29 MiB/s wr, 621 op/s 2024-06-06T03:35:51.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:51 smithi079 ceph-mon[35478]: pgmap v707: 129 pgs: 129 active+clean; 10 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 36 MiB/s wr, 776 op/s 2024-06-06T03:35:51.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:51 smithi122 ceph-mon[35759]: pgmap v707: 129 pgs: 129 active+clean; 10 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 36 MiB/s wr, 776 op/s 2024-06-06T03:35:51.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:51 smithi050 ceph-mon[32421]: pgmap v707: 129 pgs: 129 active+clean; 10 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 36 MiB/s wr, 776 op/s 2024-06-06T03:35:53.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:53 smithi079 ceph-mon[35478]: pgmap v708: 129 pgs: 129 active+clean; 10 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 29 MiB/s wr, 627 op/s 2024-06-06T03:35:53.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:53 smithi122 ceph-mon[35759]: pgmap v708: 129 pgs: 129 active+clean; 10 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 29 MiB/s wr, 627 op/s 2024-06-06T03:35:53.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:53 smithi050 ceph-mon[32421]: pgmap v708: 129 pgs: 129 active+clean; 10 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 29 MiB/s wr, 627 op/s 2024-06-06T03:35:55.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:55 smithi079 ceph-mon[35478]: pgmap v709: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 30 MiB/s wr, 647 op/s 2024-06-06T03:35:55.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:55 smithi122 ceph-mon[35759]: pgmap v709: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 30 MiB/s wr, 647 op/s 2024-06-06T03:35:55.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:55 smithi050 ceph-mon[32421]: pgmap v709: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 30 MiB/s wr, 647 op/s 2024-06-06T03:35:57.104 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.101+0000 7f80820c3640 1 -- 172.21.15.50:0/3762094394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f807c1035d0 msgr2=0x7f807c109e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:57.104 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.101+0000 7f80820c3640 1 --2- 172.21.15.50:0/3762094394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f807c1035d0 0x7f807c109e60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f806c009860 tx=0x7f806c02a380 comp rx=0 tx=0).stop 2024-06-06T03:35:57.107 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.107+0000 7f80820c3640 1 -- 172.21.15.50:0/3762094394 shutdown_connections 2024-06-06T03:35:57.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.107+0000 7f80820c3640 1 --2- 172.21.15.50:0/3762094394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f807c1035d0 0x7f807c109e60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.107+0000 7f80820c3640 1 --2- 172.21.15.50:0/3762094394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f807c102c10 0x7f807c103090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.107+0000 7f80820c3640 1 --2- 172.21.15.50:0/3762094394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f807c101a20 0x7f807c101e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.107+0000 7f80820c3640 1 -- 172.21.15.50:0/3762094394 >> 172.21.15.50:0/3762094394 conn(0x7f807c0fcf90 msgr2=0x7f807c0ff3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:57.115 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.115+0000 7f80820c3640 1 -- 172.21.15.50:0/3762094394 shutdown_connections 2024-06-06T03:35:57.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.119+0000 7f80820c3640 1 -- 172.21.15.50:0/3762094394 wait complete. 2024-06-06T03:35:57.120 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.119+0000 7f80820c3640 1 Processor -- start 2024-06-06T03:35:57.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.124+0000 7f80820c3640 1 -- start start 2024-06-06T03:35:57.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.124+0000 7f80820c3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f807c101a20 0x7f807c195a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:57.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.124+0000 7f80820c3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f807c102c10 0x7f807c195f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:57.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.124+0000 7f80820c3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f807c1035d0 0x7f807c1ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:57.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.124+0000 7f80820c3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f807c10b3b0 con 0x7f807c101a20 2024-06-06T03:35:57.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.124+0000 7f80820c3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f807c10b230 con 0x7f807c1035d0 2024-06-06T03:35:57.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.124+0000 7f80820c3640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f807c10b530 con 0x7f807c102c10 2024-06-06T03:35:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.125+0000 7f807affd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f807c102c10 0x7f807c195f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.126+0000 7f807affd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f807c102c10 0x7f807c195f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:37830/0 (socket says 172.21.15.50:37830) 2024-06-06T03:35:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.126+0000 7f807affd640 1 -- 172.21.15.50:0/1238855786 learned_addr learned my addr 172.21.15.50:0/1238855786 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.126+0000 7f807affd640 1 -- 172.21.15.50:0/1238855786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f807c1035d0 msgr2=0x7f807c1ae2d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-06T03:35:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.126+0000 7f807affd640 1 --2- 172.21.15.50:0/1238855786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f807c1035d0 0x7f807c1ae2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.126+0000 7f807affd640 1 -- 172.21.15.50:0/1238855786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f807c101a20 msgr2=0x7f807c195a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.126+0000 7f807affd640 1 --2- 172.21.15.50:0/1238855786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f807c101a20 0x7f807c195a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.126+0000 7f807affd640 1 -- 172.21.15.50:0/1238855786 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f807c06b3c0 con 0x7f807c102c10 2024-06-06T03:35:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.129+0000 7f807affd640 1 --2- 172.21.15.50:0/1238855786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f807c102c10 0x7f807c195f60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f807000b480 tx=0x7f807000b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.133+0000 7f8078ff9640 1 -- 172.21.15.50:0/1238855786 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8070014070 con 0x7f807c102c10 2024-06-06T03:35:57.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.133+0000 7f8078ff9640 1 -- 172.21.15.50:0/1238855786 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8070010d20 con 0x7f807c102c10 2024-06-06T03:35:57.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.133+0000 7f8078ff9640 1 -- 172.21.15.50:0/1238855786 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8070017360 con 0x7f807c102c10 2024-06-06T03:35:57.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.133+0000 7f80820c3640 1 -- 172.21.15.50:0/1238855786 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f807c06b6b0 con 0x7f807c102c10 2024-06-06T03:35:57.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.133+0000 7f80820c3640 1 -- 172.21.15.50:0/1238855786 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f807c06bbb0 con 0x7f807c102c10 2024-06-06T03:35:57.141 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.137+0000 7f8084dcb740 1 Processor -- start 2024-06-06T03:35:57.148 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.142+0000 7f8078ff9640 1 -- 172.21.15.50:0/1238855786 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8070017070 con 0x7f807c102c10 2024-06-06T03:35:57.148 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.142+0000 7f8084dcb740 1 -- start start 2024-06-06T03:35:57.148 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.143+0000 7f8084dcb740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe28278010 0x55fe28278430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:57.148 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.143+0000 7f8084dcb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe28278a00 0x55fe2827d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:57.148 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.143+0000 7f8084dcb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe2827db70 0x55fe28280000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:57.148 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.143+0000 7f8084dcb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fe281db4f0 con 0x55fe2827db70 2024-06-06T03:35:57.148 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.143+0000 7f8084dcb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fe28179870 con 0x55fe28278a00 2024-06-06T03:35:57.148 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.143+0000 7f8084dcb740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fe281d74b0 con 0x55fe28278010 2024-06-06T03:35:57.148 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.143+0000 7f8078ff9640 1 --2- 172.21.15.50:0/1238855786 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f80640a2e60 0x7f80640a5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:57.148 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.144+0000 7f807bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe28278010 0x55fe28278430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:57.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.144+0000 7f8078ff9640 1 -- 172.21.15.50:0/1238855786 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f80700cecd0 con 0x7f807c102c10 2024-06-06T03:35:57.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.144+0000 7f807bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe28278010 0x55fe28278430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:37844/0 (socket says 172.21.15.50:37844) 2024-06-06T03:35:57.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.144+0000 7f807bfff640 1 -- 172.21.15.50:0/873017850 learned_addr learned my addr 172.21.15.50:0/873017850 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:57.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.146+0000 7f807b7fe640 1 --2- 172.21.15.50:0/873017850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe28278a00 0x55fe2827d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:57.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.146+0000 7f807b7fe640 1 -- 172.21.15.50:0/873017850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe28278010 msgr2=0x55fe28278430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:57.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.146+0000 7f807b7fe640 1 --2- 172.21.15.50:0/873017850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe28278010 0x55fe28278430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.146+0000 7f807b7fe640 1 -- 172.21.15.50:0/873017850 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe2827db70 msgr2=0x55fe28280000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:57.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.146+0000 7f807b7fe640 1 --2- 172.21.15.50:0/873017850 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe2827db70 0x55fe28280000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.146+0000 7f807b7fe640 1 -- 172.21.15.50:0/873017850 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe281959b0 con 0x55fe28278a00 2024-06-06T03:35:57.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.146+0000 7f807b7fe640 1 --2- 172.21.15.50:0/873017850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe28278a00 0x55fe2827d500 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8074005fd0 tx=0x7f807400e7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c13a92b0d413c10 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:57.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.147+0000 7f807bfff640 1 --2- 172.21.15.50:0/1238855786 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f80640a2e60 0x7f80640a5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:57.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.147+0000 7f8061ffb640 1 -- 172.21.15.50:0/873017850 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807401b070 con 0x55fe28278a00 2024-06-06T03:35:57.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.147+0000 7f8061ffb640 1 -- 172.21.15.50:0/873017850 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f807400caf0 con 0x55fe28278a00 2024-06-06T03:35:57.151 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.148+0000 7f8084dcb740 1 -- 172.21.15.50:0/873017850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe28278a00 msgr2=0x55fe2827d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:57.151 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.148+0000 7f8084dcb740 1 --2- 172.21.15.50:0/873017850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe28278a00 0x55fe2827d500 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8074005fd0 tx=0x7f807400e7c0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.154+0000 7f8084dcb740 1 -- 172.21.15.50:0/873017850 shutdown_connections 2024-06-06T03:35:57.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.154+0000 7f8084dcb740 1 --2- 172.21.15.50:0/873017850 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe2827db70 0x55fe28280000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.154+0000 7f8084dcb740 1 --2- 172.21.15.50:0/873017850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe28278a00 0x55fe2827d500 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.154+0000 7f8084dcb740 1 --2- 172.21.15.50:0/873017850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe28278010 0x55fe28278430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.154+0000 7f8084dcb740 1 -- 172.21.15.50:0/873017850 >> 172.21.15.50:0/873017850 conn(0x55fe28273680 msgr2=0x55fe28273a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:57.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.154+0000 7f807bfff640 1 --2- 172.21.15.50:0/1238855786 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f80640a2e60 0x7f80640a5320 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f806c030570 tx=0x7f806c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:57.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.156+0000 7f8084dcb740 1 -- 172.21.15.50:0/873017850 shutdown_connections 2024-06-06T03:35:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.158+0000 7f8084dcb740 1 -- 172.21.15.50:0/873017850 wait complete. 2024-06-06T03:35:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.159+0000 7f8084dcb740 1 -- start start 2024-06-06T03:35:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.159+0000 7f8084dcb740 1 Processor -- start 2024-06-06T03:35:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.160+0000 7f8084dcb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe28278010 0x55fe28282380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.160+0000 7f8084dcb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe28278a00 0x55fe282828c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:57.162 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.160+0000 7f8084dcb740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe2827db70 0x55fe28289900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:57.162 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.160+0000 7f8084dcb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fe28280b70 con 0x55fe28278010 2024-06-06T03:35:57.162 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.160+0000 7f8084dcb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fe28164ae0 con 0x55fe28278a00 2024-06-06T03:35:57.162 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.160+0000 7f8084dcb740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fe28280cf0 con 0x55fe2827db70 2024-06-06T03:35:57.162 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.160+0000 7f8084dcb740 10 client.0 _ll_register_callbacks cb 0x55fe2819d9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:35:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.164+0000 7f807bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe2827db70 0x55fe28289900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.164+0000 7f807b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe28278010 0x55fe28282380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.164+0000 7f807b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe28278010 0x55fe28282380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45786/0 (socket says 172.21.15.50:45786) 2024-06-06T03:35:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.164+0000 7f807b7fe640 1 -- 172.21.15.50:0/2922953738 learned_addr learned my addr 172.21.15.50:0/2922953738 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.164+0000 7f807bfff640 1 -- 172.21.15.50:0/2922953738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe28278a00 msgr2=0x55fe282828c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:35:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.164+0000 7f807bfff640 1 --2- 172.21.15.50:0/2922953738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe28278a00 0x55fe282828c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.164+0000 7f807bfff640 1 -- 172.21.15.50:0/2922953738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe28278010 msgr2=0x55fe28282380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.164+0000 7f807bfff640 1 --2- 172.21.15.50:0/2922953738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe28278010 0x55fe28282380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.164+0000 7f807bfff640 1 -- 172.21.15.50:0/2922953738 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe27eef210 con 0x55fe2827db70 2024-06-06T03:35:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.165+0000 7f807bfff640 1 --2- 172.21.15.50:0/2922953738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe2827db70 0x55fe28289900 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f806c009830 tx=0x7f806c02a380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6867df7ad563fc3f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:57.168 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.165+0000 7f805affd640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:35:57.168 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.165+0000 7f805affd640 1 -- 172.21.15.50:0/2922953738 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806c04e060 con 0x55fe2827db70 2024-06-06T03:35:57.168 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.165+0000 7f805affd640 1 -- 172.21.15.50:0/2922953738 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f806c0037f0 con 0x55fe2827db70 2024-06-06T03:35:57.168 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.166+0000 7f8084dcb740 1 -- 172.21.15.50:0/2922953738 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f807400caf0 con 0x55fe2827db70 2024-06-06T03:35:57.169 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.169+0000 7f805affd640 1 -- 172.21.15.50:0/2922953738 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f806c045040 con 0x55fe2827db70 2024-06-06T03:35:57.170 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.170+0000 7f8084dcb740 10 client.26329 fetch_fsmap learned FSMap version 33 2024-06-06T03:35:57.170 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.170+0000 7f8084dcb740 1 -- 172.21.15.50:0/2922953738 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55fe27fbb620 con 0x55fe2827db70 2024-06-06T03:35:57.177 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.177+0000 7f805affd640 1 -- 172.21.15.50:0/2922953738 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f807400caf0 con 0x55fe2827db70 2024-06-06T03:35:57.178 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.177+0000 7f805affd640 1 -- 172.21.15.50:0/2922953738 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f806c048070 con 0x55fe2827db70 2024-06-06T03:35:57.178 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.177+0000 7f8084dcb740 10 client.26329 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:35:57.178 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.177+0000 7f8084dcb740 10 client.26329 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:35:57.178 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.177+0000 7f8084dcb740 20 client.26329 populate_metadata read hostname 'smithi050' 2024-06-06T03:35:57.178 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.177+0000 7f8084dcb740 1 --2- 172.21.15.50:0/2922953738 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fe282b0660 0x55fe282b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:57.178 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.177+0000 7f8084dcb740 4 client.26329 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:35:57.178 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.177+0000 7f8084dcb740 1 -- 172.21.15.50:0/2922953738 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe281eef10 con 0x55fe282b0660 2024-06-06T03:35:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.181+0000 7f807b7fe640 1 --2- 172.21.15.50:0/2922953738 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fe282b0660 0x55fe282b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.192+0000 7f807b7fe640 1 --2- 172.21.15.50:0/2922953738 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fe282b0660 0x55fe282b2ac0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7afb8cdac5cc8eb3 server_cookie=1e2cb13b979d4ff3 in_seq=0 out_seq=0 2024-06-06T03:35:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.194+0000 7f805affd640 10 client.26329 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.194+0000 7f805affd640 1 -- 172.21.15.50:0/2922953738 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55fe281eef10 con 0x55fe282b0660 2024-06-06T03:35:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.194+0000 7f805affd640 10 client.26329 handle_command_reply: tid=0 2024-06-06T03:35:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.194+0000 7f8084dcb740 1 client.26329 shutdown 2024-06-06T03:35:57.201 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.199+0000 7f8084dcb740 1 -- 172.21.15.50:0/2922953738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe2827db70 msgr2=0x55fe28289900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:57.201 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.199+0000 7f8084dcb740 1 --2- 172.21.15.50:0/2922953738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe2827db70 0x55fe28289900 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f806c009830 tx=0x7f806c02a380 comp rx=0 tx=0).stop 2024-06-06T03:35:57.201 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.201+0000 7f8084dcb740 1 -- 172.21.15.50:0/2922953738 shutdown_connections 2024-06-06T03:35:57.201 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.201+0000 7f8084dcb740 1 --2- 172.21.15.50:0/2922953738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe2827db70 0x55fe28289900 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.201 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.201+0000 7f8084dcb740 1 --2- 172.21.15.50:0/2922953738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe28278a00 0x55fe282828c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.201+0000 7f8084dcb740 1 --2- 172.21.15.50:0/2922953738 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fe282b0660 0x55fe282b2ac0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.201+0000 7f8084dcb740 1 --2- 172.21.15.50:0/2922953738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe28278010 0x55fe28282380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.201+0000 7f8084dcb740 1 -- 172.21.15.50:0/2922953738 >> 172.21.15.50:0/2922953738 conn(0x55fe28273680 msgr2=0x55fe282727e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.201+0000 7f805affd640 0 client.26329 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:57.205 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.202+0000 7f8084dcb740 1 -- 172.21.15.50:0/2922953738 shutdown_connections 2024-06-06T03:35:57.205 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.205+0000 7f8084dcb740 1 -- 172.21.15.50:0/2922953738 wait complete. 2024-06-06T03:35:57.205 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.205+0000 7f8084dcb740 20 client.26329 trim_cache size 0 max 16384 2024-06-06T03:35:57.222 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:57 smithi050 ceph-mon[32421]: pgmap v710: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 35 MiB/s wr, 773 op/s 2024-06-06T03:35:57.257 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.257+0000 7f8084dcb740 1 Processor -- start 2024-06-06T03:35:57.257 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.257+0000 7f8084dcb740 1 -- start start 2024-06-06T03:35:57.258 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.257+0000 7f8084dcb740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe28278010 0x55fe28282380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:57.258 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.257+0000 7f8084dcb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe28278a00 0x55fe282898c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:57.258 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.258+0000 7f8084dcb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe2827db70 0x55fe282828c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:57.258 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.258+0000 7f8084dcb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8068012570 con 0x55fe28278a00 2024-06-06T03:35:57.258 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.258+0000 7f807bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe2827db70 0x55fe282828c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:57.258 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.258+0000 7f807bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe2827db70 0x55fe282828c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:49432/0 (socket says 172.21.15.50:49432) 2024-06-06T03:35:57.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.258+0000 7f807bfff640 1 -- 172.21.15.50:0/3116978225 learned_addr learned my addr 172.21.15.50:0/3116978225 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:57.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.258+0000 7f8084dcb740 1 -- 172.21.15.50:0/3116978225 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f806800fe40 con 0x55fe2827db70 2024-06-06T03:35:57.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.258+0000 7f8084dcb740 1 -- 172.21.15.50:0/3116978225 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f806800dc90 con 0x55fe28278010 2024-06-06T03:35:57.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.259+0000 7f807bfff640 1 -- 172.21.15.50:0/3116978225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe28278010 msgr2=0x55fe28282380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:35:57.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.259+0000 7f807bfff640 1 --2- 172.21.15.50:0/3116978225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe28278010 0x55fe28282380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.259+0000 7f807bfff640 1 -- 172.21.15.50:0/3116978225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe28278a00 msgr2=0x55fe282898c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:35:57.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.259+0000 7f807bfff640 1 --2- 172.21.15.50:0/3116978225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe28278a00 0x55fe282898c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.259+0000 7f807bfff640 1 -- 172.21.15.50:0/3116978225 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe282b3140 con 0x55fe2827db70 2024-06-06T03:35:57.263 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.263+0000 7f807bfff640 1 --2- 172.21.15.50:0/3116978225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe2827db70 0x55fe282828c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f806c005b60 tx=0x7f806c02cfe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d9cbf2965223095 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:57.263 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.263+0000 7f80617fa640 1 -- 172.21.15.50:0/3116978225 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806c04e070 con 0x55fe2827db70 2024-06-06T03:35:57.263 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.263+0000 7f80617fa640 1 -- 172.21.15.50:0/3116978225 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f806c038040 con 0x55fe2827db70 2024-06-06T03:35:57.264 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.264+0000 7f8084dcb740 1 -- 172.21.15.50:0/3116978225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe2827db70 msgr2=0x55fe282828c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:57.264 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.264+0000 7f8084dcb740 1 --2- 172.21.15.50:0/3116978225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe2827db70 0x55fe282828c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f806c005b60 tx=0x7f806c02cfe0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.265 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.265+0000 7f8084dcb740 1 -- 172.21.15.50:0/3116978225 shutdown_connections 2024-06-06T03:35:57.265 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.265+0000 7f8084dcb740 1 --2- 172.21.15.50:0/3116978225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe28278a00 0x55fe282898c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.265 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.265+0000 7f8084dcb740 1 --2- 172.21.15.50:0/3116978225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe2827db70 0x55fe282828c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.265 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.265+0000 7f8084dcb740 1 --2- 172.21.15.50:0/3116978225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe28278010 0x55fe28282380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.265 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.265+0000 7f8084dcb740 1 -- 172.21.15.50:0/3116978225 >> 172.21.15.50:0/3116978225 conn(0x55fe28273680 msgr2=0x55fe28281170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.269+0000 7f8084dcb740 1 -- 172.21.15.50:0/3116978225 shutdown_connections 2024-06-06T03:35:57.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.271+0000 7f8084dcb740 1 -- 172.21.15.50:0/3116978225 wait complete. 2024-06-06T03:35:57.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.271+0000 7f8084dcb740 1 -- start start 2024-06-06T03:35:57.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.271+0000 7f8084dcb740 1 Processor -- start 2024-06-06T03:35:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.272+0000 7f8084dcb740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe28278010 0x55fe28289600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.272+0000 7f8084dcb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe28278a00 0x55fe282860a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.272+0000 7f8084dcb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe2827db70 0x55fe282865e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.272+0000 7f8084dcb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f806800e300 con 0x55fe28278a00 2024-06-06T03:35:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.272+0000 7f8084dcb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f806800f770 con 0x55fe2827db70 2024-06-06T03:35:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.272+0000 7f8084dcb740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f806800e9d0 con 0x55fe28278010 2024-06-06T03:35:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.272+0000 7f8084dcb740 10 client.0 _ll_register_callbacks cb 0x7f806c035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:35:57.274 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.274+0000 7f807bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe2827db70 0x55fe282865e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:57.274 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.274+0000 7f807affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe28278a00 0x55fe282860a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:57.274 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.274+0000 7f807affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe28278a00 0x55fe282860a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45802/0 (socket says 172.21.15.50:45802) 2024-06-06T03:35:57.274 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.274+0000 7f807affd640 1 -- 172.21.15.50:0/3025450349 learned_addr learned my addr 172.21.15.50:0/3025450349 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:35:57.274 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.274+0000 7f807b7fe640 1 --2- 172.21.15.50:0/3025450349 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe28278010 0x55fe28289600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:57.274 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.274+0000 7f807bfff640 1 -- 172.21.15.50:0/3025450349 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe28278010 msgr2=0x55fe28289600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:57.274 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.274+0000 7f807bfff640 1 --2- 172.21.15.50:0/3025450349 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe28278010 0x55fe28289600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.274+0000 7f807bfff640 1 -- 172.21.15.50:0/3025450349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe28278a00 msgr2=0x55fe282860a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:35:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.274+0000 7f807bfff640 1 --2- 172.21.15.50:0/3025450349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe28278a00 0x55fe282860a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.274+0000 7f807bfff640 1 -- 172.21.15.50:0/3025450349 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe28286c50 con 0x55fe2827db70 2024-06-06T03:35:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.275+0000 7f807bfff640 1 --2- 172.21.15.50:0/3025450349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe2827db70 0x55fe282865e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f806c009830 tx=0x7f806c009450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c83b454e359c506c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:35:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.275+0000 7f805affd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:35:57.276 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.275+0000 7f805affd640 1 -- 172.21.15.50:0/3025450349 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806c04e070 con 0x55fe2827db70 2024-06-06T03:35:57.276 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.276+0000 7f8084dcb740 1 -- 172.21.15.50:0/3025450349 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f806c038040 con 0x55fe2827db70 2024-06-06T03:35:57.276 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.276+0000 7f805affd640 1 -- 172.21.15.50:0/3025450349 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f806c032440 con 0x55fe2827db70 2024-06-06T03:35:57.276 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.276+0000 7f805affd640 1 -- 172.21.15.50:0/3025450349 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f806c068050 con 0x55fe2827db70 2024-06-06T03:35:57.276 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.277+0000 7f8084dcb740 10 client.26309 fetch_fsmap learned FSMap version 33 2024-06-06T03:35:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.277+0000 7f8084dcb740 1 -- 172.21.15.50:0/3025450349 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55fe2831a4a0 con 0x55fe2827db70 2024-06-06T03:35:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.283+0000 7f805affd640 1 -- 172.21.15.50:0/3025450349 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f806c038040 con 0x55fe2827db70 2024-06-06T03:35:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.283+0000 7f805affd640 1 -- 172.21.15.50:0/3025450349 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f806c048040 con 0x55fe2827db70 2024-06-06T03:35:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.283+0000 7f8084dcb740 10 client.26309 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:35:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.283+0000 7f8084dcb740 10 client.26309 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:35:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.283+0000 7f8084dcb740 20 client.26309 populate_metadata read hostname 'smithi050' 2024-06-06T03:35:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.283+0000 7f8084dcb740 1 --2- 172.21.15.50:0/3025450349 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fe2831ad50 0x55fe2831d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:35:57.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.283+0000 7f8084dcb740 4 client.26309 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:35:57.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.283+0000 7f8084dcb740 1 -- 172.21.15.50:0/3025450349 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fe281e8c20 con 0x55fe2831ad50 2024-06-06T03:35:57.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.283+0000 7f807b7fe640 1 --2- 172.21.15.50:0/3025450349 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fe2831ad50 0x55fe2831d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:35:57.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.284+0000 7f805affd640 10 client.26309 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:57.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.284+0000 7f807b7fe640 1 --2- 172.21.15.50:0/3025450349 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fe2831ad50 0x55fe2831d170 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c9948d854978fb9 server_cookie=940c36bb0b8be675 in_seq=0 out_seq=0 2024-06-06T03:35:57.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.290+0000 7f805affd640 1 -- 172.21.15.50:0/3025450349 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55fe281e8c20 con 0x55fe2831ad50 2024-06-06T03:35:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.290+0000 7f805affd640 10 client.26309 handle_command_reply: tid=0 2024-06-06T03:35:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.298+0000 7f8084dcb740 1 client.26309 shutdown 2024-06-06T03:35:57.302 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.301+0000 7f8084dcb740 1 -- 172.21.15.50:0/3025450349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe2827db70 msgr2=0x55fe282865e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:57.302 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.301+0000 7f8084dcb740 1 --2- 172.21.15.50:0/3025450349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe2827db70 0x55fe282865e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f806c009830 tx=0x7f806c009450 comp rx=0 tx=0).stop 2024-06-06T03:35:57.309 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.309+0000 7f8084dcb740 1 -- 172.21.15.50:0/3025450349 shutdown_connections 2024-06-06T03:35:57.309 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.309+0000 7f8084dcb740 1 --2- 172.21.15.50:0/3025450349 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55fe2831ad50 0x55fe2831d170 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.309 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.309+0000 7f8084dcb740 1 --2- 172.21.15.50:0/3025450349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe28278a00 0x55fe282860a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.309 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.309+0000 7f8084dcb740 1 --2- 172.21.15.50:0/3025450349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe2827db70 0x55fe282865e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.309 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.309+0000 7f8084dcb740 1 --2- 172.21.15.50:0/3025450349 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe28278010 0x55fe28289600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.309 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.309+0000 7f8084dcb740 1 -- 172.21.15.50:0/3025450349 >> 172.21.15.50:0/3025450349 conn(0x55fe28273680 msgr2=0x55fe28282380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:57.309 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.309+0000 7f805affd640 0 client.26309 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:35:57.310 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.310+0000 7f8084dcb740 1 -- 172.21.15.50:0/3025450349 shutdown_connections 2024-06-06T03:35:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.315+0000 7f8084dcb740 1 -- 172.21.15.50:0/3025450349 wait complete. 2024-06-06T03:35:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.318+0000 7f8084dcb740 20 client.26309 trim_cache size 0 max 16384 2024-06-06T03:35:57.321 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:35:57.321 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:35:57.321 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:35:57.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.322+0000 7f80820c3640 1 -- 172.21.15.50:0/1238855786 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f80640a2e60 msgr2=0x7f80640a5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:57.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.322+0000 7f80820c3640 1 --2- 172.21.15.50:0/1238855786 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f80640a2e60 0x7f80640a5320 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f806c030570 tx=0x7f806c005f90 comp rx=0 tx=0).stop 2024-06-06T03:35:57.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.322+0000 7f80820c3640 1 -- 172.21.15.50:0/1238855786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f807c102c10 msgr2=0x7f807c195f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:35:57.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.322+0000 7f80820c3640 1 --2- 172.21.15.50:0/1238855786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f807c102c10 0x7f807c195f60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f807000b480 tx=0x7f807000b940 comp rx=0 tx=0).stop 2024-06-06T03:35:57.327 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.327+0000 7f80820c3640 1 -- 172.21.15.50:0/1238855786 shutdown_connections 2024-06-06T03:35:57.327 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.327+0000 7f80820c3640 1 --2- 172.21.15.50:0/1238855786 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f80640a2e60 0x7f80640a5320 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.328 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.327+0000 7f80820c3640 1 --2- 172.21.15.50:0/1238855786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f807c1035d0 0x7f807c1ae2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.328 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.327+0000 7f80820c3640 1 --2- 172.21.15.50:0/1238855786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f807c102c10 0x7f807c195f60 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.328 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.327+0000 7f80820c3640 1 --2- 172.21.15.50:0/1238855786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f807c101a20 0x7f807c195a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:35:57.328 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.328+0000 7f80820c3640 1 -- 172.21.15.50:0/1238855786 >> 172.21.15.50:0/1238855786 conn(0x7f807c0fcf90 msgr2=0x7f807c105f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:35:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.330+0000 7f80820c3640 1 -- 172.21.15.50:0/1238855786 shutdown_connections 2024-06-06T03:35:57.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:35:57.334+0000 7f80820c3640 1 -- 172.21.15.50:0/1238855786 wait complete. 2024-06-06T03:35:57.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:57 smithi079 ceph-mon[35478]: pgmap v710: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 35 MiB/s wr, 773 op/s 2024-06-06T03:35:57.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:57 smithi122 ceph-mon[35759]: pgmap v710: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 35 MiB/s wr, 773 op/s 2024-06-06T03:35:59.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:35:59 smithi079 ceph-mon[35478]: pgmap v711: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 29 MiB/s wr, 639 op/s 2024-06-06T03:35:59.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:35:59 smithi122 ceph-mon[35759]: pgmap v711: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 29 MiB/s wr, 639 op/s 2024-06-06T03:35:59.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:35:59 smithi050 ceph-mon[32421]: pgmap v711: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 29 MiB/s wr, 639 op/s 2024-06-06T03:36:01.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:01 smithi079 ceph-mon[35478]: pgmap v712: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 35 MiB/s wr, 758 op/s 2024-06-06T03:36:01.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:01 smithi122 ceph-mon[35759]: pgmap v712: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 35 MiB/s wr, 758 op/s 2024-06-06T03:36:01.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:01 smithi050 ceph-mon[32421]: pgmap v712: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 35 MiB/s wr, 758 op/s 2024-06-06T03:36:03.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:03 smithi079 ceph-mon[35478]: pgmap v713: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 28 MiB/s wr, 603 op/s 2024-06-06T03:36:03.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:03 smithi122 ceph-mon[35759]: pgmap v713: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 28 MiB/s wr, 603 op/s 2024-06-06T03:36:03.504 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:03 smithi050 ceph-mon[32421]: pgmap v713: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 28 MiB/s wr, 603 op/s 2024-06-06T03:36:05.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:05 smithi122 ceph-mon[35759]: pgmap v714: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 29 MiB/s wr, 624 op/s 2024-06-06T03:36:05.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:05 smithi050 ceph-mon[32421]: pgmap v714: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 29 MiB/s wr, 624 op/s 2024-06-06T03:36:05.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:05 smithi079 ceph-mon[35478]: pgmap v714: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 29 MiB/s wr, 624 op/s 2024-06-06T03:36:05.906 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-06T03:36:06.522 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:36:07.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:07 smithi122 ceph-mon[35759]: pgmap v715: 129 pgs: 129 active+clean; 10 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 35 MiB/s wr, 744 op/s 2024-06-06T03:36:07.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:07 smithi050 ceph-mon[32421]: pgmap v715: 129 pgs: 129 active+clean; 10 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 35 MiB/s wr, 744 op/s 2024-06-06T03:36:07.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:07 smithi079 ceph-mon[35478]: pgmap v715: 129 pgs: 129 active+clean; 10 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 35 MiB/s wr, 744 op/s 2024-06-06T03:36:08.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.797+0000 7fce98729700 1 -- 172.21.15.50:0/3586181644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce90110c70 msgr2=0x7fce90109490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:08.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.797+0000 7fce98729700 1 --2- 172.21.15.50:0/3586181644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce90110c70 0x7fce90109490 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fce8c01a9a0 tx=0x7fce8c01acb0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.800+0000 7fce98729700 1 -- 172.21.15.50:0/3586181644 shutdown_connections 2024-06-06T03:36:08.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.800+0000 7fce98729700 1 --2- 172.21.15.50:0/3586181644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce9011bc70 0x7fce9011e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.800+0000 7fce98729700 1 --2- 172.21.15.50:0/3586181644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce90110c70 0x7fce90109490 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.800+0000 7fce98729700 1 --2- 172.21.15.50:0/3586181644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce901099d0 0x7fce90109e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.800+0000 7fce98729700 1 -- 172.21.15.50:0/3586181644 >> 172.21.15.50:0/3586181644 conn(0x7fce9006d600 msgr2=0x7fce9006da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:08.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.804+0000 7fce98729700 1 -- 172.21.15.50:0/3586181644 shutdown_connections 2024-06-06T03:36:08.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.804+0000 7fce98729700 1 -- 172.21.15.50:0/3586181644 wait complete. 2024-06-06T03:36:08.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.804+0000 7fce98729700 1 Processor -- start 2024-06-06T03:36:08.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.805+0000 7fce98729700 1 -- start start 2024-06-06T03:36:08.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.805+0000 7fce98729700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce901099d0 0x7fce9011b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:08.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.805+0000 7fce98729700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce90110c70 0x7fce901172f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:08.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.805+0000 7fce98729700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce9011bc70 0x7fce90117830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:08.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.805+0000 7fce98729700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fce90113cc0 con 0x7fce901099d0 2024-06-06T03:36:08.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.805+0000 7fce98729700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fce90113b40 con 0x7fce90110c70 2024-06-06T03:36:08.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.805+0000 7fce98729700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fce90113e40 con 0x7fce9011bc70 2024-06-06T03:36:08.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.805+0000 7fce95cc4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce90110c70 0x7fce901172f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:08.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.805+0000 7fce95cc4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce90110c70 0x7fce901172f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:45910/0 (socket says 172.21.15.50:45910) 2024-06-06T03:36:08.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.805+0000 7fce95cc4700 1 -- 172.21.15.50:0/1116028720 learned_addr learned my addr 172.21.15.50:0/1116028720 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:08.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.806+0000 7fce96cc6700 1 --2- 172.21.15.50:0/1116028720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce9011bc70 0x7fce90117830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.807+0000 7fce964c5700 1 --2- 172.21.15.50:0/1116028720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce901099d0 0x7fce9011b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:08.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.808+0000 7fce96cc6700 1 -- 172.21.15.50:0/1116028720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce90110c70 msgr2=0x7fce901172f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:08.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.808+0000 7fce96cc6700 1 --2- 172.21.15.50:0/1116028720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce90110c70 0x7fce901172f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.808+0000 7fce96cc6700 1 -- 172.21.15.50:0/1116028720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce901099d0 msgr2=0x7fce9011b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:08.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.808+0000 7fce96cc6700 1 --2- 172.21.15.50:0/1116028720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce901099d0 0x7fce9011b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.808+0000 7fce96cc6700 1 -- 172.21.15.50:0/1116028720 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce90117da0 con 0x7fce9011bc70 2024-06-06T03:36:08.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.810+0000 7fce96cc6700 1 --2- 172.21.15.50:0/1116028720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce9011bc70 0x7fce90117830 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fce8000c7a0 tx=0x7fce8000cab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:08.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.811+0000 7fce95cc4700 1 --2- 172.21.15.50:0/1116028720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce90110c70 0x7fce901172f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:36:08.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.813+0000 7fce877fe700 1 -- 172.21.15.50:0/1116028720 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce80004a30 con 0x7fce9011bc70 2024-06-06T03:36:08.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.813+0000 7fce877fe700 1 -- 172.21.15.50:0/1116028720 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fce800054d0 con 0x7fce9011bc70 2024-06-06T03:36:08.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.813+0000 7fce877fe700 1 -- 172.21.15.50:0/1116028720 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8000ebe0 con 0x7fce9011bc70 2024-06-06T03:36:08.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.813+0000 7fce98729700 1 -- 172.21.15.50:0/1116028720 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce90118090 con 0x7fce9011bc70 2024-06-06T03:36:08.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.813+0000 7fce98729700 1 -- 172.21.15.50:0/1116028720 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce901abda0 con 0x7fce9011bc70 2024-06-06T03:36:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.821+0000 7fcea2facb80 1 Processor -- start 2024-06-06T03:36:08.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.824+0000 7fce877fe700 1 -- 172.21.15.50:0/1116028720 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fce8000f450 con 0x7fce9011bc70 2024-06-06T03:36:08.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.825+0000 7fce877fe700 1 --2- 172.21.15.50:0/1116028720 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fce7c0a2df0 0x7fce7c0a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:08.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.825+0000 7fce877fe700 1 -- 172.21.15.50:0/1116028720 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fce800ceba0 con 0x7fce9011bc70 2024-06-06T03:36:08.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.825+0000 7fcea2facb80 1 -- start start 2024-06-06T03:36:08.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.826+0000 7fce95cc4700 1 --2- 172.21.15.50:0/1116028720 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fce7c0a2df0 0x7fce7c0a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:08.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.826+0000 7fcea2facb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55680a218640 0x55680a218a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:08.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.826+0000 7fcea2facb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55680a218f60 0x55680a2129e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:08.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.826+0000 7fcea2facb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55680a212f20 0x55680a213340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:08.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.826+0000 7fcea2facb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55680a164810 con 0x55680a218f60 2024-06-06T03:36:08.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.826+0000 7fcea2facb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55680a10c720 con 0x55680a218640 2024-06-06T03:36:08.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.826+0000 7fcea2facb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55680a1607d0 con 0x55680a212f20 2024-06-06T03:36:08.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.826+0000 7fce964c5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55680a218640 0x55680a218a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:08.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.826+0000 7fce964c5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55680a218640 0x55680a218a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:45922/0 (socket says 172.21.15.50:45922) 2024-06-06T03:36:08.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.826+0000 7fce964c5700 1 -- 172.21.15.50:0/1767286332 learned_addr learned my addr 172.21.15.50:0/1767286332 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:08.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.826+0000 7fce96cc6700 1 --2- 172.21.15.50:0/1767286332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55680a212f20 0x55680a213340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:08.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.826+0000 7fce95cc4700 1 --2- 172.21.15.50:0/1767286332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55680a218f60 0x55680a2129e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:08.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.827+0000 7fce964c5700 1 -- 172.21.15.50:0/1767286332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55680a212f20 msgr2=0x55680a213340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:08.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.827+0000 7fce964c5700 1 --2- 172.21.15.50:0/1767286332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55680a212f20 0x55680a213340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.827+0000 7fce964c5700 1 -- 172.21.15.50:0/1767286332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55680a218f60 msgr2=0x55680a2129e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:08.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.827+0000 7fce964c5700 1 --2- 172.21.15.50:0/1767286332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55680a218f60 0x55680a2129e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.827+0000 7fce964c5700 1 -- 172.21.15.50:0/1767286332 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55680a102f50 con 0x55680a218640 2024-06-06T03:36:08.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.827+0000 7fce95cc4700 1 --2- 172.21.15.50:0/1116028720 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fce7c0a2df0 0x7fce7c0a52b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fce90118a60 tx=0x7fce88009790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:08.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.827+0000 7fce964c5700 1 --2- 172.21.15.50:0/1767286332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55680a218640 0x55680a218a20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fce8c026000 tx=0x7fce8c01c550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13feb00a9bb498b2 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:08.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.828+0000 7fce84ff9700 1 -- 172.21.15.50:0/1767286332 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c037070 con 0x55680a218640 2024-06-06T03:36:08.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.828+0000 7fce84ff9700 1 -- 172.21.15.50:0/1767286332 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fce8c0038c0 con 0x55680a218640 2024-06-06T03:36:08.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.828+0000 7fce84ff9700 1 -- 172.21.15.50:0/1767286332 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c005330 con 0x55680a218640 2024-06-06T03:36:08.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.829+0000 7fcea2facb80 1 -- 172.21.15.50:0/1767286332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55680a218640 msgr2=0x55680a218a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:08.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.829+0000 7fcea2facb80 1 --2- 172.21.15.50:0/1767286332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55680a218640 0x55680a218a20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fce8c026000 tx=0x7fce8c01c550 comp rx=0 tx=0).stop 2024-06-06T03:36:08.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.830+0000 7fcea2facb80 1 -- 172.21.15.50:0/1767286332 shutdown_connections 2024-06-06T03:36:08.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.830+0000 7fcea2facb80 1 --2- 172.21.15.50:0/1767286332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55680a212f20 0x55680a213340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.830+0000 7fcea2facb80 1 --2- 172.21.15.50:0/1767286332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55680a218640 0x55680a218a20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.830+0000 7fcea2facb80 1 --2- 172.21.15.50:0/1767286332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55680a218f60 0x55680a2129e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.830+0000 7fcea2facb80 1 -- 172.21.15.50:0/1767286332 >> 172.21.15.50:0/1767286332 conn(0x55680a13dcc0 msgr2=0x55680a20d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:08.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.834+0000 7fcea2facb80 1 -- 172.21.15.50:0/1767286332 shutdown_connections 2024-06-06T03:36:08.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.835+0000 7fcea2facb80 1 -- 172.21.15.50:0/1767286332 wait complete. 2024-06-06T03:36:08.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.836+0000 7fcea2facb80 1 -- start start 2024-06-06T03:36:08.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.836+0000 7fcea2facb80 1 Processor -- start 2024-06-06T03:36:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.837+0000 7fcea2facb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55680a212f20 0x55680a21ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.837+0000 7fcea2facb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55680a218640 0x55680a21bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.837+0000 7fcea2facb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55680a218f60 0x55680a21c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.837+0000 7fcea2facb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55680a21f9c0 con 0x55680a218640 2024-06-06T03:36:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.837+0000 7fcea2facb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55680a104bf0 con 0x55680a212f20 2024-06-06T03:36:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.837+0000 7fcea2facb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55680a21fb40 con 0x55680a218f60 2024-06-06T03:36:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.837+0000 7fcea2facb80 10 client.0 _ll_register_callbacks cb 0x55680a0fe920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:36:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.839+0000 7fce96cc6700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55680a218f60 0x55680a21c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.840+0000 7fce96cc6700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55680a218f60 0x55680a21c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:53488/0 (socket says 172.21.15.50:53488) 2024-06-06T03:36:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.840+0000 7fce96cc6700 1 -- 172.21.15.50:0/2126180444 learned_addr learned my addr 172.21.15.50:0/2126180444 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.840+0000 7fce964c5700 1 --2- 172.21.15.50:0/2126180444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55680a212f20 0x55680a21ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.840+0000 7fce95cc4700 1 --2- 172.21.15.50:0/2126180444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55680a218640 0x55680a21bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.841+0000 7fce96cc6700 1 -- 172.21.15.50:0/2126180444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55680a212f20 msgr2=0x55680a21ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.841+0000 7fce96cc6700 1 --2- 172.21.15.50:0/2126180444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55680a212f20 0x55680a21ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.841+0000 7fce96cc6700 1 -- 172.21.15.50:0/2126180444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55680a218640 msgr2=0x55680a21bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.841+0000 7fce96cc6700 1 --2- 172.21.15.50:0/2126180444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55680a218640 0x55680a21bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.841+0000 7fce96cc6700 1 -- 172.21.15.50:0/2126180444 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55680a0b38d0 con 0x55680a218f60 2024-06-06T03:36:08.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.844+0000 7fce96cc6700 1 --2- 172.21.15.50:0/2126180444 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55680a218f60 0x55680a21c520 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fce800cc230 tx=0x7fce8009b020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e547c5a40100b7d server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:08.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.845+0000 7fce79ffb700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:36:08.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.845+0000 7fce79ffb700 1 -- 172.21.15.50:0/2126180444 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce800b3070 con 0x55680a218f60 2024-06-06T03:36:08.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.845+0000 7fcea2facb80 1 -- 172.21.15.50:0/2126180444 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce8c0038c0 con 0x55680a218f60 2024-06-06T03:36:08.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.845+0000 7fce79ffb700 1 -- 172.21.15.50:0/2126180444 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fce800cc3d0 con 0x55680a218f60 2024-06-06T03:36:08.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.846+0000 7fce79ffb700 1 -- 172.21.15.50:0/2126180444 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fce8009b280 con 0x55680a218f60 2024-06-06T03:36:08.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.846+0000 7fcea2facb80 10 client.26344 fetch_fsmap learned FSMap version 33 2024-06-06T03:36:08.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.846+0000 7fcea2facb80 1 -- 172.21.15.50:0/2126180444 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55680a22a3c0 con 0x55680a218f60 2024-06-06T03:36:08.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.850+0000 7fce79ffb700 1 -- 172.21.15.50:0/2126180444 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fce8c0038c0 con 0x55680a218f60 2024-06-06T03:36:08.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.850+0000 7fce79ffb700 1 -- 172.21.15.50:0/2126180444 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fce80095c20 con 0x55680a218f60 2024-06-06T03:36:08.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.850+0000 7fcea2facb80 10 client.26344 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:36:08.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.850+0000 7fcea2facb80 10 client.26344 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:36:08.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.850+0000 7fcea2facb80 20 client.26344 populate_metadata read hostname 'smithi050' 2024-06-06T03:36:08.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.850+0000 7fcea2facb80 1 --2- 172.21.15.50:0/2126180444 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55680a22ca50 0x55680a22ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:08.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.850+0000 7fcea2facb80 4 client.26344 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:36:08.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.850+0000 7fcea2facb80 1 -- 172.21.15.50:0/2126180444 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55680a171d10 con 0x55680a22ca50 2024-06-06T03:36:08.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.851+0000 7fce964c5700 1 --2- 172.21.15.50:0/2126180444 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55680a22ca50 0x55680a22ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:08.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.855+0000 7fce964c5700 1 --2- 172.21.15.50:0/2126180444 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55680a22ca50 0x55680a22ee40 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9985af32c94e26c3 server_cookie=b52d7fe6a79cb329 in_seq=0 out_seq=0 2024-06-06T03:36:08.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.856+0000 7fce79ffb700 10 client.26344 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:08.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.860+0000 7fce79ffb700 1 -- 172.21.15.50:0/2126180444 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55680a171d10 con 0x55680a22ca50 2024-06-06T03:36:08.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.860+0000 7fce79ffb700 10 client.26344 handle_command_reply: tid=0 2024-06-06T03:36:08.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.860+0000 7fcea2facb80 1 client.26344 shutdown 2024-06-06T03:36:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.865+0000 7fcea2facb80 1 -- 172.21.15.50:0/2126180444 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55680a218f60 msgr2=0x55680a21c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.865+0000 7fcea2facb80 1 --2- 172.21.15.50:0/2126180444 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55680a218f60 0x55680a21c520 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fce800cc230 tx=0x7fce8009b020 comp rx=0 tx=0).stop 2024-06-06T03:36:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.866+0000 7fcea2facb80 1 -- 172.21.15.50:0/2126180444 shutdown_connections 2024-06-06T03:36:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.866+0000 7fcea2facb80 1 --2- 172.21.15.50:0/2126180444 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55680a22ca50 0x55680a22ee40 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.866+0000 7fcea2facb80 1 --2- 172.21.15.50:0/2126180444 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55680a218f60 0x55680a21c520 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.866+0000 7fcea2facb80 1 --2- 172.21.15.50:0/2126180444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55680a212f20 0x55680a21ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.866+0000 7fcea2facb80 1 --2- 172.21.15.50:0/2126180444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55680a218640 0x55680a21bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.866+0000 7fcea2facb80 1 -- 172.21.15.50:0/2126180444 >> 172.21.15.50:0/2126180444 conn(0x55680a13dcc0 msgr2=0x55680a2119d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.866+0000 7fce79ffb700 0 client.26344 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.866+0000 7fcea2facb80 1 -- 172.21.15.50:0/2126180444 shutdown_connections 2024-06-06T03:36:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.866+0000 7fcea2facb80 1 -- 172.21.15.50:0/2126180444 wait complete. 2024-06-06T03:36:08.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.866+0000 7fcea2facb80 20 client.26344 trim_cache size 0 max 16384 2024-06-06T03:36:08.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.911+0000 7fcea2facb80 1 Processor -- start 2024-06-06T03:36:08.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.912+0000 7fcea2facb80 1 -- start start 2024-06-06T03:36:08.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.912+0000 7fcea2facb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55680a212f20 0x55680a2129e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:08.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.912+0000 7fcea2facb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55680a218640 0x55680a207690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:08.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.912+0000 7fcea2facb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55680a218f60 0x55680a20d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:08.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.912+0000 7fcea2facb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fce74011430 con 0x55680a218f60 2024-06-06T03:36:08.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.912+0000 7fcea2facb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fce7400ecc0 con 0x55680a212f20 2024-06-06T03:36:08.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.912+0000 7fcea2facb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fce7400cb10 con 0x55680a218640 2024-06-06T03:36:08.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.912+0000 7fce96cc6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55680a218f60 0x55680a20d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:08.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.912+0000 7fce96cc6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55680a218f60 0x55680a20d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45454/0 (socket says 172.21.15.50:45454) 2024-06-06T03:36:08.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.912+0000 7fce96cc6700 1 -- 172.21.15.50:0/3983419584 learned_addr learned my addr 172.21.15.50:0/3983419584 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:08.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.912+0000 7fce95cc4700 1 --2- 172.21.15.50:0/3983419584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55680a218640 0x55680a207690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:08.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.913+0000 7fce95cc4700 1 -- 172.21.15.50:0/3983419584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55680a212f20 msgr2=0x55680a2129e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:36:08.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.913+0000 7fce95cc4700 1 --2- 172.21.15.50:0/3983419584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55680a212f20 0x55680a2129e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.913+0000 7fce95cc4700 1 -- 172.21.15.50:0/3983419584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55680a218f60 msgr2=0x55680a20d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:08.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.913+0000 7fce95cc4700 1 --2- 172.21.15.50:0/3983419584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55680a218f60 0x55680a20d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.913+0000 7fce95cc4700 1 -- 172.21.15.50:0/3983419584 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55680a21fb90 con 0x55680a218640 2024-06-06T03:36:08.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.913+0000 7fce95cc4700 1 --2- 172.21.15.50:0/3983419584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55680a218640 0x55680a207690 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x55680a20f220 tx=0x7fce8800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b2beecfb5e88a2f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:08.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.914+0000 7fce7bfff700 1 -- 172.21.15.50:0/3983419584 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8801d040 con 0x55680a218640 2024-06-06T03:36:08.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.914+0000 7fce7bfff700 1 -- 172.21.15.50:0/3983419584 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fce88028070 con 0x55680a218640 2024-06-06T03:36:08.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.914+0000 7fce7bfff700 1 -- 172.21.15.50:0/3983419584 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce880239a0 con 0x55680a218640 2024-06-06T03:36:08.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.916+0000 7fcea2facb80 1 -- 172.21.15.50:0/3983419584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55680a218640 msgr2=0x55680a207690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:08.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.916+0000 7fcea2facb80 1 --2- 172.21.15.50:0/3983419584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55680a218640 0x55680a207690 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x55680a20f220 tx=0x7fce8800b040 comp rx=0 tx=0).stop 2024-06-06T03:36:08.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.917+0000 7fcea2facb80 1 -- 172.21.15.50:0/3983419584 shutdown_connections 2024-06-06T03:36:08.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.917+0000 7fcea2facb80 1 --2- 172.21.15.50:0/3983419584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55680a218f60 0x55680a20d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.917+0000 7fcea2facb80 1 --2- 172.21.15.50:0/3983419584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55680a212f20 0x55680a2129e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.917+0000 7fcea2facb80 1 --2- 172.21.15.50:0/3983419584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55680a218640 0x55680a207690 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.917+0000 7fcea2facb80 1 -- 172.21.15.50:0/3983419584 >> 172.21.15.50:0/3983419584 conn(0x55680a13dcc0 msgr2=0x55680a219360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:08.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.919+0000 7fcea2facb80 1 -- 172.21.15.50:0/3983419584 shutdown_connections 2024-06-06T03:36:08.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.919+0000 7fcea2facb80 1 -- 172.21.15.50:0/3983419584 wait complete. 2024-06-06T03:36:08.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.919+0000 7fcea2facb80 1 -- start start 2024-06-06T03:36:08.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.920+0000 7fcea2facb80 1 Processor -- start 2024-06-06T03:36:08.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.920+0000 7fcea2facb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55680a212f20 0x55680a234540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:08.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.920+0000 7fcea2facb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55680a218640 0x55680a234a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:08.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.920+0000 7fcea2facb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55680a218f60 0x55680a234fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:08.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.920+0000 7fcea2facb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fce7400d180 con 0x55680a218f60 2024-06-06T03:36:08.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.920+0000 7fcea2facb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fce7400e5f0 con 0x55680a212f20 2024-06-06T03:36:08.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.920+0000 7fcea2facb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fce7400d850 con 0x55680a218640 2024-06-06T03:36:08.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.920+0000 7fcea2facb80 10 client.0 _ll_register_callbacks cb 0x55680a0fe920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:36:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.922+0000 7fce964c5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55680a212f20 0x55680a234540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.922+0000 7fce964c5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55680a212f20 0x55680a234540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:45940/0 (socket says 172.21.15.50:45940) 2024-06-06T03:36:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.922+0000 7fce964c5700 1 -- 172.21.15.50:0/1337690417 learned_addr learned my addr 172.21.15.50:0/1337690417 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.922+0000 7fce95cc4700 1 --2- 172.21.15.50:0/1337690417 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55680a218640 0x55680a234a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.923+0000 7fce964c5700 1 -- 172.21.15.50:0/1337690417 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55680a218640 msgr2=0x55680a234a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.923+0000 7fce964c5700 1 --2- 172.21.15.50:0/1337690417 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55680a218640 0x55680a234a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.923+0000 7fce964c5700 1 -- 172.21.15.50:0/1337690417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55680a218f60 msgr2=0x55680a234fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.923+0000 7fce964c5700 1 --2- 172.21.15.50:0/1337690417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55680a218f60 0x55680a234fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.923+0000 7fce964c5700 1 -- 172.21.15.50:0/1337690417 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55680a296900 con 0x55680a212f20 2024-06-06T03:36:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.923+0000 7fce964c5700 1 --2- 172.21.15.50:0/1337690417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55680a212f20 0x55680a234540 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fce8c000c00 tx=0x7fce8c005a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba89c28e6a63f539 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.924+0000 7fce79ffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:36:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.924+0000 7fce79ffb700 1 -- 172.21.15.50:0/1337690417 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c037040 con 0x55680a212f20 2024-06-06T03:36:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.924+0000 7fcea2facb80 1 -- 172.21.15.50:0/1337690417 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce88028070 con 0x55680a212f20 2024-06-06T03:36:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.924+0000 7fce79ffb700 1 -- 172.21.15.50:0/1337690417 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fce8c01c9f0 con 0x55680a212f20 2024-06-06T03:36:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.924+0000 7fce79ffb700 1 -- 172.21.15.50:0/1337690417 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fce8c04b050 con 0x55680a212f20 2024-06-06T03:36:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.925+0000 7fcea2facb80 10 client.26321 fetch_fsmap learned FSMap version 33 2024-06-06T03:36:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.925+0000 7fcea2facb80 1 -- 172.21.15.50:0/1337690417 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55680a2b9c00 con 0x55680a212f20 2024-06-06T03:36:08.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.925+0000 7fce79ffb700 1 -- 172.21.15.50:0/1337690417 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fce88028070 con 0x55680a212f20 2024-06-06T03:36:08.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.926+0000 7fce79ffb700 1 -- 172.21.15.50:0/1337690417 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fce8c03e450 con 0x55680a212f20 2024-06-06T03:36:08.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.928+0000 7fcea2facb80 10 client.26321 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:36:08.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.928+0000 7fcea2facb80 10 client.26321 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:36:08.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.928+0000 7fcea2facb80 20 client.26321 populate_metadata read hostname 'smithi050' 2024-06-06T03:36:08.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.928+0000 7fcea2facb80 1 --2- 172.21.15.50:0/1337690417 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55680a2b9e30 0x55680a2bc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:08.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.928+0000 7fcea2facb80 4 client.26321 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-06T03:36:08.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.928+0000 7fcea2facb80 1 -- 172.21.15.50:0/1337690417 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55680a16c290 con 0x55680a2b9e30 2024-06-06T03:36:08.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.931+0000 7fce95cc4700 1 --2- 172.21.15.50:0/1337690417 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55680a2b9e30 0x55680a2bc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:08.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.932+0000 7fce95cc4700 1 --2- 172.21.15.50:0/1337690417 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55680a2b9e30 0x55680a2bc220 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=582d12568d6af18c server_cookie=f0a976bc48c5a4d in_seq=0 out_seq=0 2024-06-06T03:36:08.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.933+0000 7fce79ffb700 10 client.26321 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:08.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.933+0000 7fce79ffb700 1 -- 172.21.15.50:0/1337690417 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55680a16c290 con 0x55680a2b9e30 2024-06-06T03:36:08.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.933+0000 7fce79ffb700 10 client.26321 handle_command_reply: tid=0 2024-06-06T03:36:08.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.936+0000 7fcea2facb80 1 client.26321 shutdown 2024-06-06T03:36:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.940+0000 7fcea2facb80 1 -- 172.21.15.50:0/1337690417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55680a212f20 msgr2=0x55680a234540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.940+0000 7fcea2facb80 1 --2- 172.21.15.50:0/1337690417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55680a212f20 0x55680a234540 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fce8c000c00 tx=0x7fce8c005a00 comp rx=0 tx=0).stop 2024-06-06T03:36:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.940+0000 7fcea2facb80 1 -- 172.21.15.50:0/1337690417 shutdown_connections 2024-06-06T03:36:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.941+0000 7fcea2facb80 1 --2- 172.21.15.50:0/1337690417 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55680a2b9e30 0x55680a2bc220 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.941+0000 7fcea2facb80 1 --2- 172.21.15.50:0/1337690417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55680a218f60 0x55680a234fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.941+0000 7fcea2facb80 1 --2- 172.21.15.50:0/1337690417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55680a212f20 0x55680a234540 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.941+0000 7fcea2facb80 1 --2- 172.21.15.50:0/1337690417 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55680a218640 0x55680a234a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.941+0000 7fce79ffb700 0 client.26321 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.941+0000 7fcea2facb80 1 -- 172.21.15.50:0/1337690417 >> 172.21.15.50:0/1337690417 conn(0x55680a13dcc0 msgr2=0x55680a207510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.941+0000 7fcea2facb80 1 -- 172.21.15.50:0/1337690417 shutdown_connections 2024-06-06T03:36:08.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.941+0000 7fcea2facb80 1 -- 172.21.15.50:0/1337690417 wait complete. 2024-06-06T03:36:08.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.941+0000 7fcea2facb80 20 client.26321 trim_cache size 0 max 16384 2024-06-06T03:36:08.943 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:36:08.943 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2024-06-06T03:36:08.943 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-06-06T03:36:08.944 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:36:08.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.944+0000 7fce98729700 1 -- 172.21.15.50:0/1116028720 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fce7c0a2df0 msgr2=0x7fce7c0a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:08.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.944+0000 7fce98729700 1 --2- 172.21.15.50:0/1116028720 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fce7c0a2df0 0x7fce7c0a52b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fce90118a60 tx=0x7fce88009790 comp rx=0 tx=0).stop 2024-06-06T03:36:08.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.944+0000 7fce98729700 1 -- 172.21.15.50:0/1116028720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce9011bc70 msgr2=0x7fce90117830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:08.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.944+0000 7fce98729700 1 --2- 172.21.15.50:0/1116028720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce9011bc70 0x7fce90117830 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fce8000c7a0 tx=0x7fce8000cab0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.944+0000 7fce98729700 1 -- 172.21.15.50:0/1116028720 shutdown_connections 2024-06-06T03:36:08.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.944+0000 7fce98729700 1 --2- 172.21.15.50:0/1116028720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce9011bc70 0x7fce90117830 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.944+0000 7fce98729700 1 --2- 172.21.15.50:0/1116028720 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fce7c0a2df0 0x7fce7c0a52b0 secure :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fce90118a60 tx=0x7fce88009790 comp rx=0 tx=0).stop 2024-06-06T03:36:08.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.944+0000 7fce98729700 1 --2- 172.21.15.50:0/1116028720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce901099d0 0x7fce9011b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.944+0000 7fce98729700 1 --2- 172.21.15.50:0/1116028720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce90110c70 0x7fce901172f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:08.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.944+0000 7fce98729700 1 -- 172.21.15.50:0/1116028720 >> 172.21.15.50:0/1116028720 conn(0x7fce9006d600 msgr2=0x7fce9011d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:08.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.949+0000 7fce98729700 1 -- 172.21.15.50:0/1116028720 shutdown_connections 2024-06-06T03:36:08.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:08.949+0000 7fce98729700 1 -- 172.21.15.50:0/1116028720 wait complete. 2024-06-06T03:36:09.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:09 smithi122 ceph-mon[35759]: pgmap v716: 129 pgs: 129 active+clean; 10 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 29 MiB/s wr, 609 op/s 2024-06-06T03:36:09.437 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:09 smithi050 ceph-mon[32421]: pgmap v716: 129 pgs: 129 active+clean; 10 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 29 MiB/s wr, 609 op/s 2024-06-06T03:36:09.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:09 smithi079 ceph-mon[35478]: pgmap v716: 129 pgs: 129 active+clean; 10 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 29 MiB/s wr, 609 op/s 2024-06-06T03:36:10.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.513+0000 7fe93c522640 1 -- 172.21.15.50:0/206318338 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe93410b310 msgr2=0x7fe93410d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:10.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.513+0000 7fe93c522640 1 --2- 172.21.15.50:0/206318338 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe93410b310 0x7fe93410d780 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe930009860 tx=0x7fe93002a380 comp rx=0 tx=0).stop 2024-06-06T03:36:10.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.515+0000 7fe93c522640 1 -- 172.21.15.50:0/206318338 shutdown_connections 2024-06-06T03:36:10.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.515+0000 7fe93c522640 1 --2- 172.21.15.50:0/206318338 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe93410dcc0 0x7fe93410e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.515+0000 7fe93c522640 1 --2- 172.21.15.50:0/206318338 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe93410b310 0x7fe93410d780 secure :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe930009860 tx=0x7fe93002a380 comp rx=0 tx=0).stop 2024-06-06T03:36:10.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.515+0000 7fe93c522640 1 --2- 172.21.15.50:0/206318338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9341089a0 0x7fe93410add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.517 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.515+0000 7fe93c522640 1 -- 172.21.15.50:0/206318338 >> 172.21.15.50:0/206318338 conn(0x7fe93406ea10 msgr2=0x7fe934070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:10.520 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.520+0000 7fe93c522640 1 -- 172.21.15.50:0/206318338 shutdown_connections 2024-06-06T03:36:10.525 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.525+0000 7fe93c522640 1 -- 172.21.15.50:0/206318338 wait complete. 2024-06-06T03:36:10.525 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.525+0000 7fe93c522640 1 Processor -- start 2024-06-06T03:36:10.526 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.525+0000 7fe93c522640 1 -- start start 2024-06-06T03:36:10.526 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.526+0000 7fe93c522640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9341089a0 0x7fe93419e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:10.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.526+0000 7fe93c522640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe93410dcc0 0x7fe93419e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:10.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.526+0000 7fe93c522640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9341a3890 0x7fe9341a5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:10.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.527+0000 7fe93c522640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe934111b00 con 0x7fe9341a3890 2024-06-06T03:36:10.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.527+0000 7fe93c522640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe934111980 con 0x7fe93410dcc0 2024-06-06T03:36:10.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.527+0000 7fe939abd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe93410dcc0 0x7fe93419e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:10.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.527+0000 7fe939abd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe93410dcc0 0x7fe93419e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:45964/0 (socket says 172.21.15.50:45964) 2024-06-06T03:36:10.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.527+0000 7fe939abd640 1 -- 172.21.15.50:0/3229017504 learned_addr learned my addr 172.21.15.50:0/3229017504 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:10.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.527+0000 7fe93c522640 1 -- 172.21.15.50:0/3229017504 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe934111c80 con 0x7fe9341089a0 2024-06-06T03:36:10.528 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.528+0000 7fe93a2be640 1 --2- 172.21.15.50:0/3229017504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9341089a0 0x7fe93419e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.529+0000 7fe939abd640 1 -- 172.21.15.50:0/3229017504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9341089a0 msgr2=0x7fe93419e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.529+0000 7fe939abd640 1 --2- 172.21.15.50:0/3229017504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9341089a0 0x7fe93419e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.529+0000 7fe939abd640 1 -- 172.21.15.50:0/3229017504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9341a3890 msgr2=0x7fe9341a5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.529+0000 7fe939abd640 1 --2- 172.21.15.50:0/3229017504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9341a3890 0x7fe9341a5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.529+0000 7fe939abd640 1 -- 172.21.15.50:0/3229017504 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9341a62f0 con 0x7fe93410dcc0 2024-06-06T03:36:10.530 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.529+0000 7fe939abd640 1 --2- 172.21.15.50:0/3229017504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe93410dcc0 0x7fe93419e830 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe930000c00 tx=0x7fe9300058d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:10.530 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.530+0000 7fe92b7fe640 1 -- 172.21.15.50:0/3229017504 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe930040020 con 0x7fe93410dcc0 2024-06-06T03:36:10.530 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.530+0000 7fe92b7fe640 1 -- 172.21.15.50:0/3229017504 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe9300053d0 con 0x7fe93410dcc0 2024-06-06T03:36:10.530 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.530+0000 7fe92b7fe640 1 -- 172.21.15.50:0/3229017504 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe930037070 con 0x7fe93410dcc0 2024-06-06T03:36:10.530 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.530+0000 7fe93c522640 1 -- 172.21.15.50:0/3229017504 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9341a6580 con 0x7fe93410dcc0 2024-06-06T03:36:10.530 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.530+0000 7fe93c522640 1 -- 172.21.15.50:0/3229017504 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9341a6960 con 0x7fe93410dcc0 2024-06-06T03:36:10.535 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.534+0000 7fe93f235740 1 Processor -- start 2024-06-06T03:36:10.536 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.536+0000 7fe93f235740 1 -- start start 2024-06-06T03:36:10.536 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.536+0000 7fe93f235740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564dd89c6010 0x564dd89c6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:10.536 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.536+0000 7fe93f235740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564dd89c6a00 0x564dd89cb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:10.536 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.536+0000 7fe93f235740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd89cbb70 0x564dd89ce000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:10.536 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.536+0000 7fe93f235740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564dd89294f0 con 0x564dd89c6010 2024-06-06T03:36:10.536 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.536+0000 7fe93f235740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564dd88c7870 con 0x564dd89c6a00 2024-06-06T03:36:10.536 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.536+0000 7fe93f235740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564dd89254b0 con 0x564dd89cbb70 2024-06-06T03:36:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.537+0000 7fe93a2be640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564dd89c6a00 0x564dd89cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.537+0000 7fe939abd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd89cbb70 0x564dd89ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.537+0000 7fe93a2be640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564dd89c6a00 0x564dd89cb500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:45978/0 (socket says 172.21.15.50:45978) 2024-06-06T03:36:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.537+0000 7fe93a2be640 1 -- 172.21.15.50:0/2952979142 learned_addr learned my addr 172.21.15.50:0/2952979142 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.538+0000 7fe92b7fe640 1 -- 172.21.15.50:0/3229017504 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe930043020 con 0x7fe93410dcc0 2024-06-06T03:36:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.539+0000 7fe92b7fe640 1 --2- 172.21.15.50:0/3229017504 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe9200a2e20 0x7fe9200a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.539+0000 7fe92b7fe640 1 -- 172.21.15.50:0/3229017504 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fe9300ef850 con 0x7fe93410dcc0 2024-06-06T03:36:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.540+0000 7fe93aabf640 1 --2- 172.21.15.50:0/2952979142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564dd89c6010 0x564dd89c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.541+0000 7fe93a2be640 1 -- 172.21.15.50:0/2952979142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd89cbb70 msgr2=0x564dd89ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.541+0000 7fe93a2be640 1 --2- 172.21.15.50:0/2952979142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd89cbb70 0x564dd89ce000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.541+0000 7fe93a2be640 1 -- 172.21.15.50:0/2952979142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564dd89c6010 msgr2=0x564dd89c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.541+0000 7fe93a2be640 1 --2- 172.21.15.50:0/2952979142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564dd89c6010 0x564dd89c6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.541+0000 7fe93a2be640 1 -- 172.21.15.50:0/2952979142 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dd88e39b0 con 0x564dd89c6a00 2024-06-06T03:36:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.547+0000 7fe93a2be640 1 --2- 172.21.15.50:0/2952979142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564dd89c6a00 0x564dd89cb500 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe92c010400 tx=0x7fe92c0108c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=224b8e0f138963d0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:10.550 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.549+0000 7fe93aabf640 1 --2- 172.21.15.50:0/3229017504 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe9200a2e20 0x7fe9200a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:10.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.551+0000 7fe928bfe640 1 -- 172.21.15.50:0/2952979142 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92c003b70 con 0x564dd89c6a00 2024-06-06T03:36:10.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.551+0000 7fe928bfe640 1 -- 172.21.15.50:0/2952979142 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe92c003d10 con 0x564dd89c6a00 2024-06-06T03:36:10.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.552+0000 7fe93f235740 1 -- 172.21.15.50:0/2952979142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564dd89c6a00 msgr2=0x564dd89cb500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:10.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.552+0000 7fe93f235740 1 --2- 172.21.15.50:0/2952979142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564dd89c6a00 0x564dd89cb500 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe92c010400 tx=0x7fe92c0108c0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.552+0000 7fe93aabf640 1 --2- 172.21.15.50:0/3229017504 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe9200a2e20 0x7fe9200a52e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe92401a520 tx=0x7fe9240046c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.562+0000 7fe93f235740 1 -- 172.21.15.50:0/2952979142 shutdown_connections 2024-06-06T03:36:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.563+0000 7fe93f235740 1 --2- 172.21.15.50:0/2952979142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd89cbb70 0x564dd89ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.563+0000 7fe93f235740 1 --2- 172.21.15.50:0/2952979142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564dd89c6a00 0x564dd89cb500 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.563+0000 7fe93f235740 1 --2- 172.21.15.50:0/2952979142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564dd89c6010 0x564dd89c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.563+0000 7fe93f235740 1 -- 172.21.15.50:0/2952979142 >> 172.21.15.50:0/2952979142 conn(0x564dd89c1680 msgr2=0x564dd89c1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:10.568 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.568+0000 7fe93f235740 1 -- 172.21.15.50:0/2952979142 shutdown_connections 2024-06-06T03:36:10.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.571+0000 7fe93f235740 1 -- 172.21.15.50:0/2952979142 wait complete. 2024-06-06T03:36:10.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.571+0000 7fe93f235740 1 -- start start 2024-06-06T03:36:10.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.571+0000 7fe93f235740 1 Processor -- start 2024-06-06T03:36:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.572+0000 7fe93f235740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564dd89c6010 0x564dd89d0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.572+0000 7fe93f235740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd89c6a00 0x564dd89d0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.572+0000 7fe93f235740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564dd89cbb70 0x564dd89d7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.572+0000 7fe93f235740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564dd89ceb70 con 0x564dd89c6010 2024-06-06T03:36:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.572+0000 7fe93f235740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564dd88b2ae0 con 0x564dd89cbb70 2024-06-06T03:36:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.572+0000 7fe93f235740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564dd89cecf0 con 0x564dd89c6a00 2024-06-06T03:36:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.572+0000 7fe93f235740 10 client.0 _ll_register_callbacks cb 0x564dd88eb9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:36:10.575 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.575+0000 7fe93a2be640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564dd89c6010 0x564dd89d0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:10.575 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.575+0000 7fe93a2be640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564dd89c6010 0x564dd89d0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45506/0 (socket says 172.21.15.50:45506) 2024-06-06T03:36:10.575 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.575+0000 7fe93a2be640 1 -- 172.21.15.50:0/2010984488 learned_addr learned my addr 172.21.15.50:0/2010984488 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:10.575 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.575+0000 7fe93aabf640 1 --2- 172.21.15.50:0/2010984488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564dd89cbb70 0x564dd89d7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:10.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.575+0000 7fe939abd640 1 --2- 172.21.15.50:0/2010984488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd89c6a00 0x564dd89d0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:10.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.577+0000 7fe93aabf640 1 -- 172.21.15.50:0/2010984488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd89c6a00 msgr2=0x564dd89d0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.577+0000 7fe93aabf640 1 --2- 172.21.15.50:0/2010984488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd89c6a00 0x564dd89d0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.577+0000 7fe93aabf640 1 -- 172.21.15.50:0/2010984488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564dd89c6010 msgr2=0x564dd89d0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.577+0000 7fe93aabf640 1 --2- 172.21.15.50:0/2010984488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564dd89c6010 0x564dd89d0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.577+0000 7fe93aabf640 1 -- 172.21.15.50:0/2010984488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dd863d210 con 0x564dd89cbb70 2024-06-06T03:36:10.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.583+0000 7fe93aabf640 1 --2- 172.21.15.50:0/2010984488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564dd89cbb70 0x564dd89d7ab0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x564dd89c7260 tx=0x7fe92401a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=541d540bd27dcc59 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:10.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.583+0000 7fe91dffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:36:10.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.584+0000 7fe91dffb640 1 -- 172.21.15.50:0/2010984488 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92402d780 con 0x564dd89cbb70 2024-06-06T03:36:10.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.584+0000 7fe93f235740 1 -- 172.21.15.50:0/2010984488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe92c003d10 con 0x564dd89cbb70 2024-06-06T03:36:10.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.584+0000 7fe91dffb640 1 -- 172.21.15.50:0/2010984488 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fe92402d920 con 0x564dd89cbb70 2024-06-06T03:36:10.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.584+0000 7fe91dffb640 1 -- 172.21.15.50:0/2010984488 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fe92402db20 con 0x564dd89cbb70 2024-06-06T03:36:10.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.585+0000 7fe93f235740 10 client.26333 fetch_fsmap learned FSMap version 33 2024-06-06T03:36:10.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.585+0000 7fe93f235740 1 -- 172.21.15.50:0/2010984488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564dd8709620 con 0x564dd89cbb70 2024-06-06T03:36:10.586 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.587+0000 7fe91dffb640 1 -- 172.21.15.50:0/2010984488 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe92c003d10 con 0x564dd89cbb70 2024-06-06T03:36:10.586 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.587+0000 7fe91dffb640 1 -- 172.21.15.50:0/2010984488 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fe92402e420 con 0x564dd89cbb70 2024-06-06T03:36:10.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.587+0000 7fe93f235740 10 client.26333 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:36:10.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.587+0000 7fe93f235740 10 client.26333 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:36:10.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.587+0000 7fe93f235740 20 client.26333 populate_metadata read hostname 'smithi050' 2024-06-06T03:36:10.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.587+0000 7fe93f235740 1 --2- 172.21.15.50:0/2010984488 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564dd89dc880 0x564dd89dece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:10.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.587+0000 7fe93f235740 4 client.26333 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:36:10.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.587+0000 7fe93f235740 1 -- 172.21.15.50:0/2010984488 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564dd893cf10 con 0x564dd89dc880 2024-06-06T03:36:10.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.588+0000 7fe93a2be640 1 --2- 172.21.15.50:0/2010984488 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564dd89dc880 0x564dd89dece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.591+0000 7fe93a2be640 1 --2- 172.21.15.50:0/2010984488 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564dd89dc880 0x564dd89dece0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcd80c6924d1687d server_cookie=d7a447f76653e1ba in_seq=0 out_seq=0 2024-06-06T03:36:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.591+0000 7fe91dffb640 10 client.26333 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:10.594 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.594+0000 7fe91dffb640 1 -- 172.21.15.50:0/2010984488 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x564dd893cf10 con 0x564dd89dc880 2024-06-06T03:36:10.594 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.594+0000 7fe91dffb640 10 client.26333 handle_command_reply: tid=0 2024-06-06T03:36:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.596+0000 7fe93f235740 1 client.26333 shutdown 2024-06-06T03:36:10.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.598+0000 7fe93f235740 1 -- 172.21.15.50:0/2010984488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564dd89cbb70 msgr2=0x564dd89d7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:10.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.598+0000 7fe93f235740 1 --2- 172.21.15.50:0/2010984488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564dd89cbb70 0x564dd89d7ab0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x564dd89c7260 tx=0x7fe92401a270 comp rx=0 tx=0).stop 2024-06-06T03:36:10.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.598+0000 7fe93f235740 1 -- 172.21.15.50:0/2010984488 shutdown_connections 2024-06-06T03:36:10.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.598+0000 7fe93f235740 1 --2- 172.21.15.50:0/2010984488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564dd89cbb70 0x564dd89d7ab0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.598+0000 7fe93f235740 1 --2- 172.21.15.50:0/2010984488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd89c6a00 0x564dd89d0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.598+0000 7fe93f235740 1 --2- 172.21.15.50:0/2010984488 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564dd89dc880 0x564dd89dece0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.598+0000 7fe93f235740 1 --2- 172.21.15.50:0/2010984488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564dd89c6010 0x564dd89d0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.598+0000 7fe93f235740 1 -- 172.21.15.50:0/2010984488 >> 172.21.15.50:0/2010984488 conn(0x564dd89c1680 msgr2=0x564dd89c07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:10.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.598+0000 7fe91dffb640 0 client.26333 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:10.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.599+0000 7fe93f235740 1 -- 172.21.15.50:0/2010984488 shutdown_connections 2024-06-06T03:36:10.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.601+0000 7fe93f235740 1 -- 172.21.15.50:0/2010984488 wait complete. 2024-06-06T03:36:10.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.601+0000 7fe93f235740 20 client.26333 trim_cache size 0 max 16384 2024-06-06T03:36:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.638+0000 7fe93f235740 1 Processor -- start 2024-06-06T03:36:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.639+0000 7fe93f235740 1 -- start start 2024-06-06T03:36:10.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.639+0000 7fe93f235740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564dd89c6010 0x564dd89cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:10.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.639+0000 7fe93f235740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd89c6a00 0x564dd89d79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:10.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.639+0000 7fe93f235740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564dd89cbb70 0x564dd89d0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:10.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.639+0000 7fe93f235740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe918012570 con 0x564dd89c6010 2024-06-06T03:36:10.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.639+0000 7fe939abd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd89c6a00 0x564dd89d79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:10.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.639+0000 7fe939abd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd89c6a00 0x564dd89d79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:53558/0 (socket says 172.21.15.50:53558) 2024-06-06T03:36:10.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.639+0000 7fe939abd640 1 -- 172.21.15.50:0/1444817104 learned_addr learned my addr 172.21.15.50:0/1444817104 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:10.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.640+0000 7fe93aabf640 1 --2- 172.21.15.50:0/1444817104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564dd89cbb70 0x564dd89d0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:10.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.640+0000 7fe93f235740 1 -- 172.21.15.50:0/1444817104 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe91800fe40 con 0x564dd89cbb70 2024-06-06T03:36:10.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.640+0000 7fe93f235740 1 -- 172.21.15.50:0/1444817104 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe91800dc90 con 0x564dd89c6a00 2024-06-06T03:36:10.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.641+0000 7fe939abd640 1 -- 172.21.15.50:0/1444817104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564dd89cbb70 msgr2=0x564dd89d0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:10.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.641+0000 7fe939abd640 1 --2- 172.21.15.50:0/1444817104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564dd89cbb70 0x564dd89d0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.641+0000 7fe939abd640 1 -- 172.21.15.50:0/1444817104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564dd89c6010 msgr2=0x564dd89cdf60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:36:10.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.641+0000 7fe939abd640 1 --2- 172.21.15.50:0/1444817104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564dd89c6010 0x564dd89cdf60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.641+0000 7fe939abd640 1 -- 172.21.15.50:0/1444817104 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dd89cf880 con 0x564dd89c6a00 2024-06-06T03:36:10.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.642+0000 7fe939abd640 1 --2- 172.21.15.50:0/1444817104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd89c6a00 0x564dd89d79d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe930005940 tx=0x7fe93002a380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74b925dafbe5c247 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:10.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.643+0000 7fe91ffff640 1 -- 172.21.15.50:0/1444817104 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9300bb630 con 0x564dd89c6a00 2024-06-06T03:36:10.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.644+0000 7fe91ffff640 1 -- 172.21.15.50:0/1444817104 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe9300bc3d0 con 0x564dd89c6a00 2024-06-06T03:36:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.645+0000 7fe93f235740 1 -- 172.21.15.50:0/1444817104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd89c6a00 msgr2=0x564dd89d79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.645+0000 7fe93f235740 1 --2- 172.21.15.50:0/1444817104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd89c6a00 0x564dd89d79d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe930005940 tx=0x7fe93002a380 comp rx=0 tx=0).stop 2024-06-06T03:36:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.649+0000 7fe93f235740 1 -- 172.21.15.50:0/1444817104 shutdown_connections 2024-06-06T03:36:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.649+0000 7fe93f235740 1 --2- 172.21.15.50:0/1444817104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564dd89cbb70 0x564dd89d0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.649+0000 7fe93f235740 1 --2- 172.21.15.50:0/1444817104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd89c6a00 0x564dd89d79d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.649+0000 7fe93f235740 1 --2- 172.21.15.50:0/1444817104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564dd89c6010 0x564dd89cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.649+0000 7fe93f235740 1 -- 172.21.15.50:0/1444817104 >> 172.21.15.50:0/1444817104 conn(0x564dd89c1680 msgr2=0x564dd89cf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.651+0000 7fe93f235740 1 -- 172.21.15.50:0/1444817104 shutdown_connections 2024-06-06T03:36:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.651+0000 7fe93f235740 1 -- 172.21.15.50:0/1444817104 wait complete. 2024-06-06T03:36:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.651+0000 7fe93f235740 1 -- start start 2024-06-06T03:36:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.651+0000 7fe93f235740 1 Processor -- start 2024-06-06T03:36:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.652+0000 7fe93f235740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564dd89c6010 0x564dd89d77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.652+0000 7fe93f235740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564dd89c6a00 0x564dd89d4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.652+0000 7fe93f235740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd89cbb70 0x564dd89d47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.653+0000 7fe939abd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564dd89c6a00 0x564dd89d4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.653+0000 7fe939abd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564dd89c6a00 0x564dd89d4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:46002/0 (socket says 172.21.15.50:46002) 2024-06-06T03:36:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.653+0000 7fe939abd640 1 -- 172.21.15.50:0/3870496374 learned_addr learned my addr 172.21.15.50:0/3870496374 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.653+0000 7fe93aabf640 1 --2- 172.21.15.50:0/3870496374 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd89cbb70 0x564dd89d47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.653+0000 7fe93f235740 1 -- 172.21.15.50:0/3870496374 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe91800e300 con 0x564dd89c6010 2024-06-06T03:36:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.653+0000 7fe93f235740 1 -- 172.21.15.50:0/3870496374 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe91800f770 con 0x564dd89c6a00 2024-06-06T03:36:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.653+0000 7fe93f235740 1 -- 172.21.15.50:0/3870496374 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe91800e9d0 con 0x564dd89cbb70 2024-06-06T03:36:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.653+0000 7fe93f235740 10 client.0 _ll_register_callbacks cb 0x7fe92401a970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:36:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.654+0000 7fe939abd640 1 -- 172.21.15.50:0/3870496374 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd89cbb70 msgr2=0x564dd89d47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.654+0000 7fe939abd640 1 --2- 172.21.15.50:0/3870496374 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd89cbb70 0x564dd89d47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.654+0000 7fe939abd640 1 -- 172.21.15.50:0/3870496374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564dd89c6010 msgr2=0x564dd89d77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.654+0000 7fe939abd640 1 --2- 172.21.15.50:0/3870496374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564dd89c6010 0x564dd89d77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.655 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.654+0000 7fe939abd640 1 -- 172.21.15.50:0/3870496374 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dd8a455b0 con 0x564dd89c6a00 2024-06-06T03:36:10.655 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.655+0000 7fe939abd640 1 --2- 172.21.15.50:0/3870496374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564dd89c6a00 0x564dd89d4260 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe930030980 tx=0x7fe9300ecf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9691d0bc24202c9 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.667+0000 7fe91dffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:36:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.667+0000 7fe91dffb640 1 -- 172.21.15.50:0/3870496374 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9300bbcd0 con 0x564dd89c6a00 2024-06-06T03:36:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.667+0000 7fe91dffb640 1 -- 172.21.15.50:0/3870496374 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fe9300bbf30 con 0x564dd89c6a00 2024-06-06T03:36:10.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.669+0000 7fe93f235740 1 -- 172.21.15.50:0/3870496374 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9300bc3d0 con 0x564dd89c6a00 2024-06-06T03:36:10.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.670+0000 7fe91dffb640 1 -- 172.21.15.50:0/3870496374 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fe9300c0080 con 0x564dd89c6a00 2024-06-06T03:36:10.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.671+0000 7fe93f235740 10 client.26339 fetch_fsmap learned FSMap version 33 2024-06-06T03:36:10.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.671+0000 7fe93f235740 1 -- 172.21.15.50:0/3870496374 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564dd8a46760 con 0x564dd89c6a00 2024-06-06T03:36:10.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.674+0000 7fe91dffb640 1 -- 172.21.15.50:0/3870496374 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe9300bc3d0 con 0x564dd89c6a00 2024-06-06T03:36:10.675 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.675+0000 7fe91dffb640 1 -- 172.21.15.50:0/3870496374 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fe9300bab90 con 0x564dd89c6a00 2024-06-06T03:36:10.675 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.675+0000 7fe93f235740 10 client.26339 fetch_fsmap finished waiting for FSMap version 33 2024-06-06T03:36:10.675 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.675+0000 7fe93f235740 10 client.26339 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:36:10.675 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.675+0000 7fe93f235740 20 client.26339 populate_metadata read hostname 'smithi050' 2024-06-06T03:36:10.675 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.675+0000 7fe93f235740 1 --2- 172.21.15.50:0/3870496374 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564dd8a471e0 0x564dd8a49600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:10.676 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.675+0000 7fe93f235740 4 client.26339 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:36:10.676 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.675+0000 7fe93f235740 1 -- 172.21.15.50:0/3870496374 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564dd8936c20 con 0x564dd8a471e0 2024-06-06T03:36:10.679 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.679+0000 7fe93a2be640 1 --2- 172.21.15.50:0/3870496374 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564dd8a471e0 0x564dd8a49600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.683+0000 7fe93a2be640 1 --2- 172.21.15.50:0/3870496374 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564dd8a471e0 0x564dd8a49600 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fde2f9b48967a3e2 server_cookie=330ed116d747ed52 in_seq=0 out_seq=0 2024-06-06T03:36:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.683+0000 7fe91dffb640 10 client.26339 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.724+0000 7fe91dffb640 1 -- 172.21.15.50:0/3870496374 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x564dd8936c20 con 0x564dd8a471e0 2024-06-06T03:36:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.724+0000 7fe91dffb640 10 client.26339 handle_command_reply: tid=0 2024-06-06T03:36:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.725+0000 7fe93f235740 1 client.26339 shutdown 2024-06-06T03:36:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.725+0000 7fe93f235740 1 -- 172.21.15.50:0/3870496374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564dd89c6a00 msgr2=0x564dd89d4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.725+0000 7fe93f235740 1 --2- 172.21.15.50:0/3870496374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564dd89c6a00 0x564dd89d4260 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe930030980 tx=0x7fe9300ecf80 comp rx=0 tx=0).stop 2024-06-06T03:36:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.726+0000 7fe93f235740 1 -- 172.21.15.50:0/3870496374 shutdown_connections 2024-06-06T03:36:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.726+0000 7fe93f235740 1 --2- 172.21.15.50:0/3870496374 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd89cbb70 0x564dd89d47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.726+0000 7fe93f235740 1 --2- 172.21.15.50:0/3870496374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564dd89c6a00 0x564dd89d4260 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.726+0000 7fe93f235740 1 --2- 172.21.15.50:0/3870496374 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564dd8a471e0 0x564dd8a49600 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.726+0000 7fe93f235740 1 --2- 172.21.15.50:0/3870496374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564dd89c6010 0x564dd89d77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.726+0000 7fe93f235740 1 -- 172.21.15.50:0/3870496374 >> 172.21.15.50:0/3870496374 conn(0x564dd89c1680 msgr2=0x564dd89d0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.726+0000 7fe91dffb640 0 client.26339 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.726+0000 7fe93f235740 1 -- 172.21.15.50:0/3870496374 shutdown_connections 2024-06-06T03:36:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.726+0000 7fe93f235740 1 -- 172.21.15.50:0/3870496374 wait complete. 2024-06-06T03:36:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.727+0000 7fe93f235740 20 client.26339 trim_cache size 0 max 16384 2024-06-06T03:36:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:36:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:36:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:36:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.727+0000 7fe93c522640 1 -- 172.21.15.50:0/3229017504 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe9200a2e20 msgr2=0x7fe9200a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.727+0000 7fe93c522640 1 --2- 172.21.15.50:0/3229017504 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe9200a2e20 0x7fe9200a52e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe92401a520 tx=0x7fe9240046c0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.727+0000 7fe93c522640 1 -- 172.21.15.50:0/3229017504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe93410dcc0 msgr2=0x7fe93419e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.727+0000 7fe93c522640 1 --2- 172.21.15.50:0/3229017504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe93410dcc0 0x7fe93419e830 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe930000c00 tx=0x7fe9300058d0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.729 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.728+0000 7fe93c522640 1 -- 172.21.15.50:0/3229017504 shutdown_connections 2024-06-06T03:36:10.729 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.728+0000 7fe93c522640 1 --2- 172.21.15.50:0/3229017504 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe9200a2e20 0x7fe9200a52e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.729 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.728+0000 7fe93c522640 1 --2- 172.21.15.50:0/3229017504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9341a3890 0x7fe9341a5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.729 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.728+0000 7fe93c522640 1 --2- 172.21.15.50:0/3229017504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe93410dcc0 0x7fe93419e830 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.729 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.728+0000 7fe93c522640 1 --2- 172.21.15.50:0/3229017504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9341089a0 0x7fe93419e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:10.729 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.728+0000 7fe93c522640 1 -- 172.21.15.50:0/3229017504 >> 172.21.15.50:0/3229017504 conn(0x7fe93406ea10 msgr2=0x7fe93410bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:10.729 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.728+0000 7fe93c522640 1 -- 172.21.15.50:0/3229017504 shutdown_connections 2024-06-06T03:36:10.729 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:10.728+0000 7fe93c522640 1 -- 172.21.15.50:0/3229017504 wait complete. 2024-06-06T03:36:11.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:11 smithi050 ceph-mon[32421]: pgmap v717: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 34 MiB/s wr, 719 op/s 2024-06-06T03:36:11.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:11 smithi122 ceph-mon[35759]: pgmap v717: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 34 MiB/s wr, 719 op/s 2024-06-06T03:36:11.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:11 smithi079 ceph-mon[35478]: pgmap v717: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 34 MiB/s wr, 719 op/s 2024-06-06T03:36:12.275 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-06T03:36:12.275 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T03:36:12.921 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:36:13.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:13 smithi122 ceph-mon[35759]: pgmap v718: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 28 MiB/s wr, 601 op/s 2024-06-06T03:36:13.445 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:13 smithi050 ceph-mon[32421]: pgmap v718: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 28 MiB/s wr, 601 op/s 2024-06-06T03:36:13.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:13 smithi079 ceph-mon[35478]: pgmap v718: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 28 MiB/s wr, 601 op/s 2024-06-06T03:36:15.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.310+0000 7f351ed65700 1 -- 172.21.15.50:0/4258297232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3518108ac0 msgr2=0x7f3518108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:15.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.310+0000 7f351cb01700 1 --2- 172.21.15.50:0/4258297232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f351810eac0 0x7f351810eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:36:15.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.310+0000 7f351ed65700 1 --2- 172.21.15.50:0/4258297232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3518108ac0 0x7f3518108f40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f351001c0d0 tx=0x7f351001c3e0 comp rx=0 tx=0).stop 2024-06-06T03:36:15.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.310+0000 7f351d302700 1 --2- 172.21.15.50:0/4258297232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3518109480 0x7f3518115990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:36:15.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.310+0000 7f351ed65700 1 -- 172.21.15.50:0/4258297232 shutdown_connections 2024-06-06T03:36:15.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.310+0000 7f351ed65700 1 --2- 172.21.15.50:0/4258297232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3518109480 0x7f3518115990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:15.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.310+0000 7f351ed65700 1 --2- 172.21.15.50:0/4258297232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f351810eac0 0x7f351810eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:15.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.310+0000 7f351ed65700 1 --2- 172.21.15.50:0/4258297232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3518108ac0 0x7f3518108f40 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:15.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.310+0000 7f351ed65700 1 -- 172.21.15.50:0/4258297232 >> 172.21.15.50:0/4258297232 conn(0x7f3518075c60 msgr2=0x7f3518078080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:15.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.320+0000 7f351ed65700 1 -- 172.21.15.50:0/4258297232 shutdown_connections 2024-06-06T03:36:15.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.320+0000 7f351ed65700 1 -- 172.21.15.50:0/4258297232 wait complete. 2024-06-06T03:36:15.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.321+0000 7f351ed65700 1 Processor -- start 2024-06-06T03:36:15.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.321+0000 7f351ed65700 1 -- start start 2024-06-06T03:36:15.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.322+0000 7f351ed65700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3518108ac0 0x7f3518111710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.322+0000 7f351ed65700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3518109480 0x7f3518111c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.322+0000 7f351ed65700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f351810eac0 0x7f351819b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.322+0000 7f351ed65700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f351806e770 con 0x7f351810eac0 2024-06-06T03:36:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.322+0000 7f351ed65700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f351806e5f0 con 0x7f3518108ac0 2024-06-06T03:36:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.322+0000 7f351ed65700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f351806e8f0 con 0x7f3518109480 2024-06-06T03:36:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.322+0000 7f351cb01700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3518108ac0 0x7f3518111710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.322+0000 7f3517fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3518109480 0x7f3518111c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.322+0000 7f3517fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3518109480 0x7f3518111c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:53570/0 (socket says 172.21.15.50:53570) 2024-06-06T03:36:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.322+0000 7f3517fff700 1 -- 172.21.15.50:0/3528651449 learned_addr learned my addr 172.21.15.50:0/3528651449 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.323+0000 7f3517fff700 1 -- 172.21.15.50:0/3528651449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3518108ac0 msgr2=0x7f3518111710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.323+0000 7f3517fff700 1 --2- 172.21.15.50:0/3528651449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3518108ac0 0x7f3518111710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:15.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.323+0000 7f3517fff700 1 -- 172.21.15.50:0/3528651449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f351810eac0 msgr2=0x7f351819b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:15.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.323+0000 7f3517fff700 1 --2- 172.21.15.50:0/3528651449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f351810eac0 0x7f351819b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:15.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.323+0000 7f3517fff700 1 -- 172.21.15.50:0/3528651449 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f351819bb60 con 0x7f3518109480 2024-06-06T03:36:15.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.323+0000 7f3517fff700 1 --2- 172.21.15.50:0/3528651449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3518109480 0x7f3518111c50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f351001c860 tx=0x7f3510019790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:15.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.327+0000 7f3515ffb700 1 -- 172.21.15.50:0/3528651449 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3510019c60 con 0x7f3518109480 2024-06-06T03:36:15.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.327+0000 7f3515ffb700 1 -- 172.21.15.50:0/3528651449 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3510019e00 con 0x7f3518109480 2024-06-06T03:36:15.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.327+0000 7f3515ffb700 1 -- 172.21.15.50:0/3528651449 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35100055c0 con 0x7f3518109480 2024-06-06T03:36:15.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.329+0000 7f351ed65700 1 -- 172.21.15.50:0/3528651449 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f351819bdf0 con 0x7f3518109480 2024-06-06T03:36:15.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.329+0000 7f351ed65700 1 -- 172.21.15.50:0/3528651449 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35181a3520 con 0x7f3518109480 2024-06-06T03:36:15.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.331+0000 7f351ed65700 1 -- 172.21.15.50:0/3528651449 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f351810a200 con 0x7f3518109480 2024-06-06T03:36:15.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.336+0000 7f3515ffb700 1 -- 172.21.15.50:0/3528651449 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f35100193e0 con 0x7f3518109480 2024-06-06T03:36:15.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.337+0000 7f3515ffb700 1 --2- 172.21.15.50:0/3528651449 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f35000a2e20 0x7f35000a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:15.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.338+0000 7f3515ffb700 1 -- 172.21.15.50:0/3528651449 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f3510020030 con 0x7f3518109480 2024-06-06T03:36:15.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.338+0000 7f3515ffb700 1 -- 172.21.15.50:0/3528651449 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3510015060 con 0x7f3518109480 2024-06-06T03:36:15.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.341+0000 7f351cb01700 1 --2- 172.21.15.50:0/3528651449 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f35000a2e20 0x7f35000a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:15.349 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:15 smithi050 ceph-mon[32421]: pgmap v719: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 29 MiB/s wr, 614 op/s 2024-06-06T03:36:15.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.349+0000 7f351cb01700 1 --2- 172.21.15.50:0/3528651449 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f35000a2e20 0x7f35000a52e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f350c00abd0 tx=0x7f350c00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:15.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:15 smithi122 ceph-mon[35759]: pgmap v719: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 29 MiB/s wr, 614 op/s 2024-06-06T03:36:15.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:15 smithi079 ceph-mon[35478]: pgmap v719: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 29 MiB/s wr, 614 op/s 2024-06-06T03:36:15.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.848+0000 7f351ed65700 1 -- 172.21.15.50:0/3528651449 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35181a36f0 con 0x7f3518109480 2024-06-06T03:36:15.850 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:36:15.850 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1667847852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1667847852},{"type":"v1","addr":"172.21.15.50:6835","nonce":1667847852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/239971838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":239971838},{"type":"v1","addr":"172.21.15.50:6837","nonce":239971838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/2188134216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2188134216},{"type":"v1","addr":"172.21.15.50:6839","nonce":2188134216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/632572420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":632572420},{"type":"v1","addr":"172.21.15.50:6841","nonce":632572420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/864537078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":864537078},{"type":"v1","addr":"172.21.15.79:6833","nonce":864537078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/279268898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":279268898},{"type":"v1","addr":"172.21.15.79:6835","nonce":279268898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T03:22:36.202061+0000","modified":"2024-06-06T03:32:16.979722+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24490,"mds_1":24472,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/57533154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":57533154},{"type":"v1","addr":"172.21.15.122:6833","nonce":57533154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/3286722213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3286722213},{"type":"v1","addr":"172.21.15.79:6837","nonce":3286722213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/768067336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":768067336},{"type":"v1","addr":"172.21.15.79:6839","nonce":768067336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.122:6835/2987597320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2987597320},{"type":"v1","addr":"172.21.15.122:6835","nonce":2987597320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":23,"addr":"172.21.15.122:6837/1604366318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1604366318},{"type":"v1","addr":"172.21.15.122:6837","nonce":1604366318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6839/4129732900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":4129732900},{"type":"v1","addr":"172.21.15.122:6839","nonce":4129732900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24466,24472,24490]},"id":1}]} 2024-06-06T03:36:15.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.849+0000 7f3515ffb700 1 -- 172.21.15.50:0/3528651449 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11855 (secure 0 0 0) 0x7f35100bf8f0 con 0x7f3518109480 2024-06-06T03:36:15.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.854+0000 7f351ed65700 1 -- 172.21.15.50:0/3528651449 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f35000a2e20 msgr2=0x7f35000a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:15.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.855+0000 7f351ed65700 1 --2- 172.21.15.50:0/3528651449 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f35000a2e20 0x7f35000a52e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f350c00abd0 tx=0x7f350c00a380 comp rx=0 tx=0).stop 2024-06-06T03:36:15.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.855+0000 7f351ed65700 1 -- 172.21.15.50:0/3528651449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3518109480 msgr2=0x7f3518111c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:15.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.855+0000 7f351ed65700 1 --2- 172.21.15.50:0/3528651449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3518109480 0x7f3518111c50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f351001c860 tx=0x7f3510019790 comp rx=0 tx=0).stop 2024-06-06T03:36:15.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.856+0000 7f351ed65700 1 -- 172.21.15.50:0/3528651449 shutdown_connections 2024-06-06T03:36:15.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.856+0000 7f351ed65700 1 --2- 172.21.15.50:0/3528651449 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f35000a2e20 0x7f35000a52e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:15.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.856+0000 7f351ed65700 1 --2- 172.21.15.50:0/3528651449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f351810eac0 0x7f351819b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:15.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.856+0000 7f351ed65700 1 --2- 172.21.15.50:0/3528651449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3518108ac0 0x7f3518111710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:15.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.856+0000 7f351ed65700 1 --2- 172.21.15.50:0/3528651449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3518109480 0x7f3518111c50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:15.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.856+0000 7f351ed65700 1 -- 172.21.15.50:0/3528651449 >> 172.21.15.50:0/3528651449 conn(0x7f3518075c60 msgr2=0x7f35180760a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:15.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.857+0000 7f351ed65700 1 -- 172.21.15.50:0/3528651449 shutdown_connections 2024-06-06T03:36:15.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:15.857+0000 7f351ed65700 1 -- 172.21.15.50:0/3528651449 wait complete. 2024-06-06T03:36:15.860 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 33 2024-06-06T03:36:16.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:16 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/3528651449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:36:16.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:16 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3528651449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:36:16.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:16 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/3528651449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:36:16.733 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-06-06T03:36:17.330 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:36:17.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:17 smithi122 ceph-mon[35759]: pgmap v720: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 33 MiB/s wr, 701 op/s 2024-06-06T03:36:17.494 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:17 smithi050 ceph-mon[32421]: pgmap v720: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 33 MiB/s wr, 701 op/s 2024-06-06T03:36:17.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:17 smithi079 ceph-mon[35478]: pgmap v720: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 33 MiB/s wr, 701 op/s 2024-06-06T03:36:18.185 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:18 smithi050 ceph-mon[32421]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:36:18.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:18 smithi079 ceph-mon[35478]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:36:18.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:18 smithi122 ceph-mon[35759]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:36:19.220 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:19 smithi050 ceph-mon[32421]: pgmap v721: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 28 MiB/s wr, 586 op/s 2024-06-06T03:36:19.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:19 smithi079 ceph-mon[35478]: pgmap v721: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 28 MiB/s wr, 586 op/s 2024-06-06T03:36:19.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:19 smithi122 ceph-mon[35759]: pgmap v721: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 28 MiB/s wr, 586 op/s 2024-06-06T03:36:19.816 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:36:19.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.619+0000 7fedec827700 1 -- 172.21.15.50:0/3756774360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fede8110c70 msgr2=0x7fede8109490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:19.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.619+0000 7fedec827700 1 --2- 172.21.15.50:0/3756774360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fede8110c70 0x7fede8109490 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fedd8009990 tx=0x7fedd8009ca0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.622+0000 7fedec827700 1 -- 172.21.15.50:0/3756774360 shutdown_connections 2024-06-06T03:36:19.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.622+0000 7fedec827700 1 --2- 172.21.15.50:0/3756774360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede811bc70 0x7fede811e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.622+0000 7fedec827700 1 --2- 172.21.15.50:0/3756774360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fede8110c70 0x7fede8109490 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.622+0000 7fedec827700 1 --2- 172.21.15.50:0/3756774360 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fede81099d0 0x7fede8109e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.622+0000 7fedec827700 1 -- 172.21.15.50:0/3756774360 >> 172.21.15.50:0/3756774360 conn(0x7fede806d600 msgr2=0x7fede806da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:19.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.631+0000 7fedec827700 1 -- 172.21.15.50:0/3756774360 shutdown_connections 2024-06-06T03:36:19.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.631+0000 7fedec827700 1 -- 172.21.15.50:0/3756774360 wait complete. 2024-06-06T03:36:19.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.632+0000 7fedec827700 1 Processor -- start 2024-06-06T03:36:19.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.632+0000 7fedec827700 1 -- start start 2024-06-06T03:36:19.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.633+0000 7fedec827700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede8110c70 0x7fede811a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:19.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.633+0000 7fedec827700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fede811bc70 0x7fede81132e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:19.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.633+0000 7fedec827700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fede8113820 0x7fede8113ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:19.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.633+0000 7fedec827700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fede8121690 con 0x7fede811bc70 2024-06-06T03:36:19.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.633+0000 7fedec827700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fede8121510 con 0x7fede8110c70 2024-06-06T03:36:19.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.633+0000 7fedec827700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fede8121810 con 0x7fede8113820 2024-06-06T03:36:19.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.633+0000 7fede659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede8110c70 0x7fede811a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:19.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.633+0000 7fede659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede8110c70 0x7fede811a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:33108/0 (socket says 172.21.15.50:33108) 2024-06-06T03:36:19.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.633+0000 7fede659c700 1 -- 172.21.15.50:0/789758403 learned_addr learned my addr 172.21.15.50:0/789758403 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:19.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.634+0000 7fede659c700 1 -- 172.21.15.50:0/789758403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fede8113820 msgr2=0x7fede8113ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:19.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.633+0000 7fede6d9d700 1 --2- 172.21.15.50:0/789758403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fede8113820 0x7fede8113ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:19.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.634+0000 7fede659c700 1 --2- 172.21.15.50:0/789758403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fede8113820 0x7fede8113ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.634+0000 7fede659c700 1 -- 172.21.15.50:0/789758403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fede811bc70 msgr2=0x7fede81132e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:19.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.634+0000 7fede659c700 1 --2- 172.21.15.50:0/789758403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fede811bc70 0x7fede81132e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.634+0000 7fede659c700 1 -- 172.21.15.50:0/789758403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede8117d30 con 0x7fede8110c70 2024-06-06T03:36:19.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.634+0000 7fede659c700 1 --2- 172.21.15.50:0/789758403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede8110c70 0x7fede811a200 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fedd8009fb0 tx=0x7fedd800b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:19.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.634+0000 7fede6d9d700 1 --2- 172.21.15.50:0/789758403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fede8113820 0x7fede8113ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:36:19.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.634+0000 7feddf7fe700 1 -- 172.21.15.50:0/789758403 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd8026070 con 0x7fede8110c70 2024-06-06T03:36:19.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.635+0000 7feddf7fe700 1 -- 172.21.15.50:0/789758403 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fedd800bda0 con 0x7fede8110c70 2024-06-06T03:36:19.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.635+0000 7fedec827700 1 -- 172.21.15.50:0/789758403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fede8117fc0 con 0x7fede8110c70 2024-06-06T03:36:19.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.635+0000 7fedec827700 1 -- 172.21.15.50:0/789758403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fede81184a0 con 0x7fede8110c70 2024-06-06T03:36:19.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.636+0000 7feddf7fe700 1 -- 172.21.15.50:0/789758403 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd8021700 con 0x7fede8110c70 2024-06-06T03:36:19.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.640+0000 7feddf7fe700 1 -- 172.21.15.50:0/789758403 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fedd802a3f0 con 0x7fede8110c70 2024-06-06T03:36:19.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.643+0000 7feddf7fe700 1 --2- 172.21.15.50:0/789758403 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fedd40a2e30 0x7fedd40a52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:19.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.643+0000 7feddffff700 1 --2- 172.21.15.50:0/789758403 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fedd40a2e30 0x7fedd40a52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:19.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.644+0000 7fedf70aab80 1 Processor -- start 2024-06-06T03:36:19.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.644+0000 7feddf7fe700 1 -- 172.21.15.50:0/789758403 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fedd80d07b0 con 0x7fede8110c70 2024-06-06T03:36:19.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.644+0000 7fedf70aab80 1 -- start start 2024-06-06T03:36:19.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.644+0000 7fedf70aab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9810d9f60 0x55a9810da340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:19.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.645+0000 7fedf70aab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9810da880 0x55a9810d4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:19.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.645+0000 7fedf70aab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9810d47a0 0x55a9810d4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:19.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.645+0000 7fedf70aab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a980fc6f60 con 0x55a9810d47a0 2024-06-06T03:36:19.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.645+0000 7fedf70aab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a981025850 con 0x55a9810d9f60 2024-06-06T03:36:19.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.645+0000 7fedf70aab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a980f8d460 con 0x55a9810da880 2024-06-06T03:36:19.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.645+0000 7feddffff700 1 --2- 172.21.15.50:0/789758403 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fedd40a2e30 0x7fedd40a52f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fede8114a50 tx=0x7fedd0006c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:19.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.646+0000 7fede659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9810d9f60 0x55a9810da340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:19.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.646+0000 7fede659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9810d9f60 0x55a9810da340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:33124/0 (socket says 172.21.15.50:33124) 2024-06-06T03:36:19.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.646+0000 7fede659c700 1 -- 172.21.15.50:0/1480498342 learned_addr learned my addr 172.21.15.50:0/1480498342 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:19.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.646+0000 7fede6d9d700 1 --2- 172.21.15.50:0/1480498342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9810d47a0 0x55a9810d4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:19.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.647+0000 7fede659c700 1 -- 172.21.15.50:0/1480498342 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9810da880 msgr2=0x55a9810d4260 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:36:19.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.647+0000 7fede659c700 1 --2- 172.21.15.50:0/1480498342 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9810da880 0x55a9810d4260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.647+0000 7fede659c700 1 -- 172.21.15.50:0/1480498342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9810d47a0 msgr2=0x55a9810d4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:19.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.647+0000 7fede659c700 1 --2- 172.21.15.50:0/1480498342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9810d47a0 0x55a9810d4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.647+0000 7fede659c700 1 -- 172.21.15.50:0/1480498342 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a980f748d0 con 0x55a9810d9f60 2024-06-06T03:36:19.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.647+0000 7fede659c700 1 --2- 172.21.15.50:0/1480498342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9810d9f60 0x55a9810da340 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fedd8099120 tx=0x7fedd8003c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c45e8adb2481404 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:19.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.647+0000 7feddcff9700 1 -- 172.21.15.50:0/1480498342 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd809ccc0 con 0x55a9810d9f60 2024-06-06T03:36:19.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.647+0000 7feddcff9700 1 -- 172.21.15.50:0/1480498342 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fedd80a1070 con 0x55a9810d9f60 2024-06-06T03:36:19.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.648+0000 7fedf70aab80 1 -- 172.21.15.50:0/1480498342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9810d9f60 msgr2=0x55a9810da340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:19.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.648+0000 7fedf70aab80 1 --2- 172.21.15.50:0/1480498342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9810d9f60 0x55a9810da340 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fedd8099120 tx=0x7fedd8003c50 comp rx=0 tx=0).stop 2024-06-06T03:36:19.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.648+0000 7fedf70aab80 1 -- 172.21.15.50:0/1480498342 shutdown_connections 2024-06-06T03:36:19.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.648+0000 7fedf70aab80 1 --2- 172.21.15.50:0/1480498342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9810d47a0 0x55a9810d4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.648+0000 7fedf70aab80 1 --2- 172.21.15.50:0/1480498342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9810d9f60 0x55a9810da340 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.648+0000 7fedf70aab80 1 --2- 172.21.15.50:0/1480498342 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9810da880 0x55a9810d4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.648+0000 7fedf70aab80 1 -- 172.21.15.50:0/1480498342 >> 172.21.15.50:0/1480498342 conn(0x55a981001080 msgr2=0x55a9810cf220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:19.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.651+0000 7fedf70aab80 1 -- 172.21.15.50:0/1480498342 shutdown_connections 2024-06-06T03:36:19.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.660+0000 7fedf70aab80 1 -- 172.21.15.50:0/1480498342 wait complete. 2024-06-06T03:36:19.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.660+0000 7fedf70aab80 1 -- start start 2024-06-06T03:36:19.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.660+0000 7fedf70aab80 1 Processor -- start 2024-06-06T03:36:19.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.661+0000 7fedf70aab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9810d47a0 0x55a9810e04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:19.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.661+0000 7fedf70aab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9810e0a20 0x55a9810dd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:19.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.661+0000 7fedf70aab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9810dde80 0x55a9810ea430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:19.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.661+0000 7fedf70aab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a980fc5fc0 con 0x55a9810d47a0 2024-06-06T03:36:19.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.661+0000 7fedf70aab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a981021810 con 0x55a9810e0a20 2024-06-06T03:36:19.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.661+0000 7fedf70aab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a9810e10b0 con 0x55a9810dde80 2024-06-06T03:36:19.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.661+0000 7fedf70aab80 10 client.0 _ll_register_callbacks cb 0x55a980fbb5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:36:19.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.661+0000 7fede659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9810d47a0 0x55a9810e04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:19.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.661+0000 7fede659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9810d47a0 0x55a9810e04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37348/0 (socket says 172.21.15.50:37348) 2024-06-06T03:36:19.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.661+0000 7fede659c700 1 -- 172.21.15.50:0/2967914021 learned_addr learned my addr 172.21.15.50:0/2967914021 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:19.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.662+0000 7fede659c700 1 -- 172.21.15.50:0/2967914021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9810dde80 msgr2=0x55a9810ea430 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:36:19.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.662+0000 7fede659c700 1 --2- 172.21.15.50:0/2967914021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9810dde80 0x55a9810ea430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.662+0000 7fede659c700 1 -- 172.21.15.50:0/2967914021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9810e0a20 msgr2=0x55a9810dd7e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:36:19.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.662+0000 7fede659c700 1 --2- 172.21.15.50:0/2967914021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9810e0a20 0x55a9810dd7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.662+0000 7fede659c700 1 -- 172.21.15.50:0/2967914021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a980feb750 con 0x55a9810d47a0 2024-06-06T03:36:19.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.662+0000 7fede659c700 1 --2- 172.21.15.50:0/2967914021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9810d47a0 0x55a9810e04e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fedd801b010 tx=0x7fedd80a5730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c1d09793c3eaa95 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:19.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.662+0000 7fedcdffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:36:19.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.663+0000 7fedcdffb700 1 -- 172.21.15.50:0/2967914021 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd80a1070 con 0x55a9810d47a0 2024-06-06T03:36:19.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.663+0000 7fedf70aab80 1 -- 172.21.15.50:0/2967914021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a981032d50 con 0x55a9810d47a0 2024-06-06T03:36:19.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.663+0000 7fedcdffb700 1 -- 172.21.15.50:0/2967914021 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fedd809c320 con 0x55a9810d47a0 2024-06-06T03:36:19.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.663+0000 7fedcdffb700 1 -- 172.21.15.50:0/2967914021 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fedd80ad050 con 0x55a9810d47a0 2024-06-06T03:36:19.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.664+0000 7fedf70aab80 10 client.16662 fetch_fsmap learned FSMap version 34 2024-06-06T03:36:19.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.664+0000 7fedf70aab80 1 -- 172.21.15.50:0/2967914021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a9810ebfc0 con 0x55a9810d47a0 2024-06-06T03:36:19.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.664+0000 7fedcdffb700 1 -- 172.21.15.50:0/2967914021 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55a981032d50 con 0x55a9810d47a0 2024-06-06T03:36:19.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.664+0000 7fedcdffb700 1 -- 172.21.15.50:0/2967914021 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7fedd80a7ba0 con 0x55a9810d47a0 2024-06-06T03:36:19.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.665+0000 7fedf70aab80 10 client.16662 fetch_fsmap finished waiting for FSMap version 34 2024-06-06T03:36:19.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.665+0000 7fedf70aab80 10 client.16662 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-06-06T03:36:19.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.665+0000 7fedf70aab80 20 client.16662 populate_metadata read hostname 'smithi050' 2024-06-06T03:36:19.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.665+0000 7fedf70aab80 1 --2- 172.21.15.50:0/2967914021 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55a9810ee3b0 0x55a9810f0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:19.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.666+0000 7fedf70aab80 4 client.16662 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:36:19.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.666+0000 7fedf70aab80 1 -- 172.21.15.50:0/2967914021 --> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a98102d2d0 con 0x55a9810ee3b0 2024-06-06T03:36:19.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.675+0000 7feddffff700 1 --2- 172.21.15.50:0/2967914021 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55a9810ee3b0 0x55a9810f0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:19.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.689+0000 7feddffff700 1 --2- 172.21.15.50:0/2967914021 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55a9810ee3b0 0x55a9810f0850 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=821b4d3094667285 server_cookie=85056ac03935be6 in_seq=0 out_seq=0 2024-06-06T03:36:19.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.689+0000 7fedcdffb700 10 client.16662 ms_handle_connect on v2:172.21.15.122:6834/2987597320 2024-06-06T03:36:19.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.695+0000 7fedcdffb700 1 -- 172.21.15.50:0/2967914021 <== mds.2 v2:172.21.15.122:6834/2987597320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x7fedd0014430 con 0x55a9810ee3b0 2024-06-06T03:36:19.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.695+0000 7fedcdffb700 10 client.16662 handle_command_reply: tid=0 2024-06-06T03:36:19.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.695+0000 7fedf70aab80 1 client.16662 shutdown 2024-06-06T03:36:19.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.696+0000 7fedf70aab80 1 -- 172.21.15.50:0/2967914021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9810d47a0 msgr2=0x55a9810e04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:19.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.696+0000 7fedf70aab80 1 --2- 172.21.15.50:0/2967914021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9810d47a0 0x55a9810e04e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fedd801b010 tx=0x7fedd80a5730 comp rx=0 tx=0).stop 2024-06-06T03:36:19.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.704+0000 7fedf70aab80 1 -- 172.21.15.50:0/2967914021 shutdown_connections 2024-06-06T03:36:19.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.704+0000 7fedf70aab80 1 --2- 172.21.15.50:0/2967914021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9810dde80 0x55a9810ea430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.704+0000 7fedf70aab80 1 --2- 172.21.15.50:0/2967914021 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55a9810ee3b0 0x55a9810f0850 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.704+0000 7fedf70aab80 1 --2- 172.21.15.50:0/2967914021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9810d47a0 0x55a9810e04e0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.704+0000 7fedf70aab80 1 --2- 172.21.15.50:0/2967914021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9810e0a20 0x55a9810dd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.704+0000 7fedf70aab80 1 -- 172.21.15.50:0/2967914021 >> 172.21.15.50:0/2967914021 conn(0x55a981001080 msgr2=0x55a9810cde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:19.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.704+0000 7fedcdffb700 0 client.16662 ms_handle_reset on v2:172.21.15.122:6834/2987597320 2024-06-06T03:36:19.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.708+0000 7fedf70aab80 1 -- 172.21.15.50:0/2967914021 shutdown_connections 2024-06-06T03:36:19.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.710+0000 7fedf70aab80 1 -- 172.21.15.50:0/2967914021 wait complete. 2024-06-06T03:36:19.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.710+0000 7fedf70aab80 20 client.16662 trim_cache size 0 max 16384 2024-06-06T03:36:19.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.740+0000 7fedf70aab80 1 Processor -- start 2024-06-06T03:36:19.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.740+0000 7fedf70aab80 1 -- start start 2024-06-06T03:36:19.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.741+0000 7fedf70aab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9810d47a0 0x55a9810cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:19.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.741+0000 7fedf70aab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9810dde80 0x55a9810ea220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:19.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.741+0000 7fedf70aab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9810e0a20 0x55a9810ea760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:19.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.741+0000 7fedf70aab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fedc80113d0 con 0x55a9810e0a20 2024-06-06T03:36:19.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.741+0000 7fedf70aab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fedc800ec60 con 0x55a9810dde80 2024-06-06T03:36:19.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.741+0000 7fedf70aab80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fedc800cab0 con 0x55a9810d47a0 2024-06-06T03:36:19.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.742+0000 7feddffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9810dde80 0x55a9810ea220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:19.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.742+0000 7feddffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9810dde80 0x55a9810ea220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:33132/0 (socket says 172.21.15.50:33132) 2024-06-06T03:36:19.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.742+0000 7feddffff700 1 -- 172.21.15.50:0/2233423870 learned_addr learned my addr 172.21.15.50:0/2233423870 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:19.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.743+0000 7feddffff700 1 -- 172.21.15.50:0/2233423870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9810d47a0 msgr2=0x55a9810cee80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:36:19.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.743+0000 7feddffff700 1 --2- 172.21.15.50:0/2233423870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9810d47a0 0x55a9810cee80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.743+0000 7feddffff700 1 -- 172.21.15.50:0/2233423870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9810e0a20 msgr2=0x55a9810ea760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:36:19.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.743+0000 7feddffff700 1 --2- 172.21.15.50:0/2233423870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9810e0a20 0x55a9810ea760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.743+0000 7feddffff700 1 -- 172.21.15.50:0/2233423870 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9810cb810 con 0x55a9810dde80 2024-06-06T03:36:19.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.743+0000 7feddffff700 1 --2- 172.21.15.50:0/2233423870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9810dde80 0x55a9810ea220 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fede806e580 tx=0x7fedd0010000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0c78926d4dfaedc server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:19.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.744+0000 7fedcffff700 1 -- 172.21.15.50:0/2233423870 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd001f460 con 0x55a9810dde80 2024-06-06T03:36:19.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.744+0000 7fedcffff700 1 -- 172.21.15.50:0/2233423870 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55a98102d2d0 con 0x55a9810dde80 2024-06-06T03:36:19.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.744+0000 7fedcffff700 1 -- 172.21.15.50:0/2233423870 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd0013840 con 0x55a9810dde80 2024-06-06T03:36:19.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.746+0000 7fedf70aab80 1 -- 172.21.15.50:0/2233423870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9810dde80 msgr2=0x55a9810ea220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:19.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.746+0000 7fedf70aab80 1 --2- 172.21.15.50:0/2233423870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9810dde80 0x55a9810ea220 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fede806e580 tx=0x7fedd0010000 comp rx=0 tx=0).stop 2024-06-06T03:36:19.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.747+0000 7fedf70aab80 1 -- 172.21.15.50:0/2233423870 shutdown_connections 2024-06-06T03:36:19.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.747+0000 7fedf70aab80 1 --2- 172.21.15.50:0/2233423870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9810e0a20 0x55a9810ea760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.747+0000 7fedf70aab80 1 --2- 172.21.15.50:0/2233423870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9810d47a0 0x55a9810cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.747+0000 7fedf70aab80 1 --2- 172.21.15.50:0/2233423870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9810dde80 0x55a9810ea220 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.747+0000 7fedf70aab80 1 -- 172.21.15.50:0/2233423870 >> 172.21.15.50:0/2233423870 conn(0x55a981001080 msgr2=0x55a9810df8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:19.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.748+0000 7fedf70aab80 1 -- 172.21.15.50:0/2233423870 shutdown_connections 2024-06-06T03:36:19.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.749+0000 7fedf70aab80 1 -- 172.21.15.50:0/2233423870 wait complete. 2024-06-06T03:36:19.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.749+0000 7fedf70aab80 1 -- start start 2024-06-06T03:36:19.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.749+0000 7fedf70aab80 1 Processor -- start 2024-06-06T03:36:19.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.750+0000 7fedf70aab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9810d47a0 0x55a9810e6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:19.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.750+0000 7fedf70aab80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9810dde80 0x55a9810e68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:19.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.750+0000 7fede659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9810d47a0 0x55a9810e6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:19.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.750+0000 7fedf70aab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9810e0a20 0x55a9810f51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:19.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.750+0000 7fede659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9810d47a0 0x55a9810e6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37360/0 (socket says 172.21.15.50:37360) 2024-06-06T03:36:19.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.750+0000 7fedf70aab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fedc800d120 con 0x55a9810d47a0 2024-06-06T03:36:19.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.750+0000 7fede659c700 1 -- 172.21.15.50:0/267922845 learned_addr learned my addr 172.21.15.50:0/267922845 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:19.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.750+0000 7fedf70aab80 1 -- 172.21.15.50:0/267922845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fedc800e590 con 0x55a9810e0a20 2024-06-06T03:36:19.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.751+0000 7fedf70aab80 1 -- 172.21.15.50:0/267922845 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fedc800d7f0 con 0x55a9810dde80 2024-06-06T03:36:19.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.751+0000 7fedf70aab80 10 client.0 _ll_register_callbacks cb 0x55a980fbb5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:36:19.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.751+0000 7fede6d9d700 1 --2- 172.21.15.50:0/267922845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9810e0a20 0x55a9810f51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:19.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.751+0000 7feddffff700 1 --2- 172.21.15.50:0/267922845 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9810dde80 0x55a9810e68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:19.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.751+0000 7fede6d9d700 1 -- 172.21.15.50:0/267922845 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9810dde80 msgr2=0x55a9810e68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:19.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.751+0000 7fede6d9d700 1 --2- 172.21.15.50:0/267922845 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9810dde80 0x55a9810e68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.751+0000 7fede6d9d700 1 -- 172.21.15.50:0/267922845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9810d47a0 msgr2=0x55a9810e6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:19.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.751+0000 7fede6d9d700 1 --2- 172.21.15.50:0/267922845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9810d47a0 0x55a9810e6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.751+0000 7fede6d9d700 1 -- 172.21.15.50:0/267922845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9810f56f0 con 0x55a9810e0a20 2024-06-06T03:36:19.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.752+0000 7fede6d9d700 1 --2- 172.21.15.50:0/267922845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9810e0a20 0x55a9810f51b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55a9810e0f20 tx=0x7fede0008cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1eeab5bb0ad9e95 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:19.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.752+0000 7fedcdffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:36:19.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.752+0000 7fedcdffb700 1 -- 172.21.15.50:0/267922845 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede0004bb0 con 0x55a9810e0a20 2024-06-06T03:36:19.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.753+0000 7fedcdffb700 1 -- 172.21.15.50:0/267922845 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fede0011040 con 0x55a9810e0a20 2024-06-06T03:36:19.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.753+0000 7fedf70aab80 1 -- 172.21.15.50:0/267922845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a98102d2d0 con 0x55a9810e0a20 2024-06-06T03:36:19.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.753+0000 7fedcdffb700 1 -- 172.21.15.50:0/267922845 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fede0004d50 con 0x55a9810e0a20 2024-06-06T03:36:19.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.753+0000 7fedf70aab80 10 client.26354 fetch_fsmap learned FSMap version 34 2024-06-06T03:36:19.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.753+0000 7fedf70aab80 1 -- 172.21.15.50:0/267922845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a981158940 con 0x55a9810e0a20 2024-06-06T03:36:19.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.754+0000 7fedcdffb700 1 -- 172.21.15.50:0/267922845 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fede000fa50 con 0x55a9810e0a20 2024-06-06T03:36:19.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.754+0000 7fedcdffb700 1 -- 172.21.15.50:0/267922845 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7fede00157d0 con 0x55a9810e0a20 2024-06-06T03:36:19.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.754+0000 7fedf70aab80 10 client.26354 fetch_fsmap finished waiting for FSMap version 34 2024-06-06T03:36:19.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.754+0000 7fedf70aab80 10 client.26354 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-06-06T03:36:19.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.754+0000 7fedf70aab80 20 client.26354 populate_metadata read hostname 'smithi050' 2024-06-06T03:36:19.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.754+0000 7fedf70aab80 1 --2- 172.21.15.50:0/267922845 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55a981159100 0x55a98115b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:19.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.754+0000 7fedf70aab80 4 client.26354 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:36:19.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.754+0000 7fedf70aab80 1 -- 172.21.15.50:0/267922845 --> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a98102d2d0 con 0x55a981159100 2024-06-06T03:36:19.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.755+0000 7fede659c700 1 --2- 172.21.15.50:0/267922845 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55a981159100 0x55a98115b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:19.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.755+0000 7fede659c700 1 --2- 172.21.15.50:0/267922845 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55a981159100 0x55a98115b520 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1cca4ae1d6cbaa83 server_cookie=31ed0d4e3c55bab4 in_seq=0 out_seq=0 2024-06-06T03:36:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.755+0000 7fedcdffb700 10 client.26354 ms_handle_connect on v2:172.21.15.122:6834/2987597320 2024-06-06T03:36:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.755+0000 7fedcdffb700 1 -- 172.21.15.50:0/267922845 <== mds.2 v2:172.21.15.122:6834/2987597320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a98102d2d0 con 0x55a981159100 2024-06-06T03:36:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.755+0000 7fedcdffb700 10 client.26354 handle_command_reply: tid=0 2024-06-06T03:36:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.755+0000 7fedf70aab80 1 client.26354 shutdown 2024-06-06T03:36:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.756+0000 7fedf70aab80 1 -- 172.21.15.50:0/267922845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9810e0a20 msgr2=0x55a9810f51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.756+0000 7fedf70aab80 1 --2- 172.21.15.50:0/267922845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9810e0a20 0x55a9810f51b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55a9810e0f20 tx=0x7fede0008cc0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.756+0000 7fedf70aab80 1 -- 172.21.15.50:0/267922845 shutdown_connections 2024-06-06T03:36:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.756+0000 7fedf70aab80 1 --2- 172.21.15.50:0/267922845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a9810e0a20 0x55a9810f51b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.756+0000 7fedf70aab80 1 --2- 172.21.15.50:0/267922845 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x55a981159100 0x55a98115b520 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.756+0000 7fedcdffb700 0 client.26354 ms_handle_reset on v2:172.21.15.122:6834/2987597320 2024-06-06T03:36:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.756+0000 7fedf70aab80 1 --2- 172.21.15.50:0/267922845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a9810d47a0 0x55a9810e6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.756+0000 7fedf70aab80 1 --2- 172.21.15.50:0/267922845 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a9810dde80 0x55a9810e68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.757+0000 7fedf70aab80 1 -- 172.21.15.50:0/267922845 >> 172.21.15.50:0/267922845 conn(0x55a981001080 msgr2=0x55a9810d8920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.757+0000 7fedf70aab80 1 -- 172.21.15.50:0/267922845 shutdown_connections 2024-06-06T03:36:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.757+0000 7fedf70aab80 1 -- 172.21.15.50:0/267922845 wait complete. 2024-06-06T03:36:19.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.757+0000 7fedf70aab80 20 client.26354 trim_cache size 0 max 16384 2024-06-06T03:36:19.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.759+0000 7fedec827700 1 -- 172.21.15.50:0/789758403 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fedd40a2e30 msgr2=0x7fedd40a52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:19.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.759+0000 7fedec827700 1 --2- 172.21.15.50:0/789758403 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fedd40a2e30 0x7fedd40a52f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fede8114a50 tx=0x7fedd0006c80 comp rx=0 tx=0).stop 2024-06-06T03:36:19.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.759+0000 7fedec827700 1 -- 172.21.15.50:0/789758403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede8110c70 msgr2=0x7fede811a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:19.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.759+0000 7fedec827700 1 --2- 172.21.15.50:0/789758403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede8110c70 0x7fede811a200 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fedd8009fb0 tx=0x7fedd800b880 comp rx=0 tx=0).stop 2024-06-06T03:36:19.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.759+0000 7fedec827700 1 -- 172.21.15.50:0/789758403 shutdown_connections 2024-06-06T03:36:19.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.759+0000 7fedec827700 1 --2- 172.21.15.50:0/789758403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fede8113820 0x7fede8113ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.759+0000 7fedec827700 1 --2- 172.21.15.50:0/789758403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede8110c70 0x7fede811a200 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.759+0000 7fedec827700 1 --2- 172.21.15.50:0/789758403 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fedd40a2e30 0x7fedd40a52f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.759+0000 7fedec827700 1 --2- 172.21.15.50:0/789758403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fede811bc70 0x7fede81132e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:19.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.759+0000 7fedec827700 1 -- 172.21.15.50:0/789758403 >> 172.21.15.50:0/789758403 conn(0x7fede806d600 msgr2=0x7fede8071030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:19.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.759+0000 7fedec827700 1 -- 172.21.15.50:0/789758403 shutdown_connections 2024-06-06T03:36:19.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:19.759+0000 7fedec827700 1 -- 172.21.15.50:0/789758403 wait complete. 2024-06-06T03:36:21.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:21 smithi050 ceph-mon[32421]: pgmap v722: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 33 MiB/s wr, 694 op/s 2024-06-06T03:36:21.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:21 smithi079 ceph-mon[35478]: pgmap v722: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 33 MiB/s wr, 694 op/s 2024-06-06T03:36:21.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:21 smithi122 ceph-mon[35759]: pgmap v722: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 33 MiB/s wr, 694 op/s 2024-06-06T03:36:22.024 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-06-06T03:36:22.790 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:36:23.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:23 smithi050 ceph-mon[32421]: pgmap v723: 129 pgs: 129 active+clean; 10 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 28 MiB/s wr, 588 op/s 2024-06-06T03:36:23.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:23 smithi050 ceph-mon[32421]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:36:23.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:23 smithi079 ceph-mon[35478]: pgmap v723: 129 pgs: 129 active+clean; 10 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 28 MiB/s wr, 588 op/s 2024-06-06T03:36:23.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:23 smithi079 ceph-mon[35478]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:36:23.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:23 smithi122 ceph-mon[35759]: pgmap v723: 129 pgs: 129 active+clean; 10 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 28 MiB/s wr, 588 op/s 2024-06-06T03:36:23.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:23 smithi122 ceph-mon[35759]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:36:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.950+0000 7fb65f7fe640 1 -- 172.21.15.50:0/2540226846 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb650031800 con 0x7fb660073890 2024-06-06T03:36:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.951+0000 7fb666b90640 1 -- 172.21.15.50:0/2540226846 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb660073890 msgr2=0x7fb660073cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.951+0000 7fb666b90640 1 --2- 172.21.15.50:0/2540226846 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb660073890 0x7fb660073cb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb650009900 tx=0x7fb65002a440 comp rx=0 tx=0).stop 2024-06-06T03:36:23.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.961+0000 7fb666b90640 1 -- 172.21.15.50:0/2540226846 shutdown_connections 2024-06-06T03:36:23.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.961+0000 7fb666b90640 1 --2- 172.21.15.50:0/2540226846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb660079120 0x7fb66007b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:23.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.961+0000 7fb666b90640 1 --2- 172.21.15.50:0/2540226846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb660076770 0x7fb660078be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:23.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.961+0000 7fb666b90640 1 --2- 172.21.15.50:0/2540226846 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb660073890 0x7fb660073cb0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:23.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.961+0000 7fb666b90640 1 -- 172.21.15.50:0/2540226846 >> 172.21.15.50:0/2540226846 conn(0x7fb66006ea10 msgr2=0x7fb660070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:23.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.961+0000 7fb666b90640 1 -- 172.21.15.50:0/2540226846 shutdown_connections 2024-06-06T03:36:23.961 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.961+0000 7fb666b90640 1 -- 172.21.15.50:0/2540226846 wait complete. 2024-06-06T03:36:23.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.962+0000 7fb666b90640 1 Processor -- start 2024-06-06T03:36:23.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.962+0000 7fb666b90640 1 -- start start 2024-06-06T03:36:23.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.962+0000 7fb666b90640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb660073890 0x7fb66012abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:23.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.962+0000 7fb666b90640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb660076770 0x7fb66012b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:23.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.962+0000 7fb666b90640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb660079120 0x7fb660131a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:23.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.962+0000 7fb666b90640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb6600831f0 con 0x7fb660079120 2024-06-06T03:36:23.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.962+0000 7fb666b90640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb660083070 con 0x7fb660076770 2024-06-06T03:36:23.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.962+0000 7fb666b90640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb660083370 con 0x7fb660073890 2024-06-06T03:36:23.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.963+0000 7fb66492c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb660073890 0x7fb66012abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:23.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.963+0000 7fb66492c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb660073890 0x7fb66012abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:41924/0 (socket says 172.21.15.50:41924) 2024-06-06T03:36:23.964 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.963+0000 7fb66492c640 1 -- 172.21.15.50:0/2428945305 learned_addr learned my addr 172.21.15.50:0/2428945305 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:23.964 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.963+0000 7fb66492c640 1 -- 172.21.15.50:0/2428945305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb660076770 msgr2=0x7fb66012b110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T03:36:23.964 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.963+0000 7fb66492c640 1 --2- 172.21.15.50:0/2428945305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb660076770 0x7fb66012b110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:23.964 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.963+0000 7fb66492c640 1 -- 172.21.15.50:0/2428945305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb660079120 msgr2=0x7fb660131a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:23.964 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.963+0000 7fb66492c640 1 --2- 172.21.15.50:0/2428945305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb660079120 0x7fb660131a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:23.964 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.963+0000 7fb66492c640 1 -- 172.21.15.50:0/2428945305 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6601320f0 con 0x7fb660073890 2024-06-06T03:36:23.964 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.964+0000 7fb66492c640 1 --2- 172.21.15.50:0/2428945305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb660073890 0x7fb66012abd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb6500094a0 tx=0x7fb650003cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.965+0000 7fb65dffb640 1 -- 172.21.15.50:0/2428945305 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb65003f070 con 0x7fb660073890 2024-06-06T03:36:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.965+0000 7fb65dffb640 1 -- 172.21.15.50:0/2428945305 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb650003e40 con 0x7fb660073890 2024-06-06T03:36:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.965+0000 7fb666b90640 1 -- 172.21.15.50:0/2428945305 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb660132380 con 0x7fb660073890 2024-06-06T03:36:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.966+0000 7fb65dffb640 1 -- 172.21.15.50:0/2428945305 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb650035030 con 0x7fb660073890 2024-06-06T03:36:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.966+0000 7fb666b90640 1 -- 172.21.15.50:0/2428945305 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb660132870 con 0x7fb660073890 2024-06-06T03:36:23.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.970+0000 7fb66997f740 1 Processor -- start 2024-06-06T03:36:23.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.971+0000 7fb66997f740 1 -- start start 2024-06-06T03:36:23.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.971+0000 7fb66997f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09936d010 0x55e09936d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:23.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.971+0000 7fb66997f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e09936da00 0x55e099372500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:23.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.971+0000 7fb66997f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e099372b70 0x55e099375000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:23.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.971+0000 7fb66997f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e0992d04f0 con 0x55e099372b70 2024-06-06T03:36:23.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.971+0000 7fb66997f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e09926e870 con 0x55e09936d010 2024-06-06T03:36:23.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.971+0000 7fb66997f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e0992cc4b0 con 0x55e09936da00 2024-06-06T03:36:23.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.972+0000 7fb66492c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e09936da00 0x55e099372500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:23.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.972+0000 7fb66492c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e09936da00 0x55e099372500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:41940/0 (socket says 172.21.15.50:41940) 2024-06-06T03:36:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.972+0000 7fb66492c640 1 -- 172.21.15.50:0/1042375428 learned_addr learned my addr 172.21.15.50:0/1042375428 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.972+0000 7fb65dffb640 1 -- 172.21.15.50:0/2428945305 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb650042070 con 0x7fb660073890 2024-06-06T03:36:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.972+0000 7fb66492c640 1 -- 172.21.15.50:0/1042375428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09936d010 msgr2=0x55e09936d430 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:36:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.972+0000 7fb66492c640 1 --2- 172.21.15.50:0/1042375428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09936d010 0x55e09936d430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.972+0000 7fb66492c640 1 -- 172.21.15.50:0/1042375428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e099372b70 msgr2=0x55e099375000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:36:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.972+0000 7fb66492c640 1 --2- 172.21.15.50:0/1042375428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e099372b70 0x55e099375000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.972+0000 7fb66492c640 1 -- 172.21.15.50:0/1042375428 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e09928a9b0 con 0x55e09936da00 2024-06-06T03:36:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.972+0000 7fb66492c640 1 --2- 172.21.15.50:0/1042375428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e09936da00 0x55e099372500 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb6500f3e30 tx=0x7fb6500f3f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba2a9e189f3b4a61 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.973+0000 7fb646ffd640 1 -- 172.21.15.50:0/1042375428 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6500f8c50 con 0x55e09936da00 2024-06-06T03:36:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.973+0000 7fb646ffd640 1 -- 172.21.15.50:0/1042375428 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb6500fd070 con 0x55e09936da00 2024-06-06T03:36:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.973+0000 7fb646ffd640 1 -- 172.21.15.50:0/1042375428 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb650101630 con 0x55e09936da00 2024-06-06T03:36:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.973+0000 7fb65dffb640 1 --2- 172.21.15.50:0/2428945305 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb6480a2cc0 0x7fb6480a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.973+0000 7fb65dffb640 1 -- 172.21.15.50:0/2428945305 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fb6500efec0 con 0x7fb660073890 2024-06-06T03:36:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.974+0000 7fb66997f740 1 -- 172.21.15.50:0/1042375428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e09936da00 msgr2=0x55e099372500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.974+0000 7fb66997f740 1 --2- 172.21.15.50:0/1042375428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e09936da00 0x55e099372500 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb6500f3e30 tx=0x7fb6500f3f20 comp rx=0 tx=0).stop 2024-06-06T03:36:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.975+0000 7fb66997f740 1 -- 172.21.15.50:0/1042375428 shutdown_connections 2024-06-06T03:36:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.975+0000 7fb66997f740 1 --2- 172.21.15.50:0/1042375428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e099372b70 0x55e099375000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.975+0000 7fb66997f740 1 --2- 172.21.15.50:0/1042375428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e09936da00 0x55e099372500 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.975+0000 7fb66997f740 1 --2- 172.21.15.50:0/1042375428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09936d010 0x55e09936d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.975+0000 7fb66997f740 1 -- 172.21.15.50:0/1042375428 >> 172.21.15.50:0/1042375428 conn(0x55e099368680 msgr2=0x55e099368a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.975+0000 7fb66512d640 1 --2- 172.21.15.50:0/2428945305 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb6480a2cc0 0x7fb6480a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.975+0000 7fb66997f740 1 -- 172.21.15.50:0/1042375428 shutdown_connections 2024-06-06T03:36:23.980 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.979+0000 7fb66997f740 1 -- 172.21.15.50:0/1042375428 wait complete. 2024-06-06T03:36:23.980 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.980+0000 7fb66997f740 1 -- start start 2024-06-06T03:36:23.980 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.980+0000 7fb66997f740 1 Processor -- start 2024-06-06T03:36:23.983 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.983+0000 7fb66997f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e09936d010 0x55e099376fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:23.983 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.983+0000 7fb66997f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09936da00 0x55e0993774f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:23.983 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.983+0000 7fb66997f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e099372b70 0x55e09937e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:23.983 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.983+0000 7fb66997f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e0993758e0 con 0x55e09936d010 2024-06-06T03:36:23.983 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.983+0000 7fb66997f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e099259ae0 con 0x55e09936da00 2024-06-06T03:36:23.983 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.983+0000 7fb66997f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e099375a60 con 0x55e099372b70 2024-06-06T03:36:23.983 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.983+0000 7fb66997f740 10 client.0 _ll_register_callbacks cb 0x55e0992929b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:36:23.984 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.983+0000 7fb66512d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e099372b70 0x55e09937e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:23.984 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.983+0000 7fb66492c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e09936d010 0x55e099376fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:23.984 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.983+0000 7fb66492c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e09936d010 0x55e099376fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37392/0 (socket says 172.21.15.50:37392) 2024-06-06T03:36:23.984 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.983+0000 7fb66492c640 1 -- 172.21.15.50:0/3853047653 learned_addr learned my addr 172.21.15.50:0/3853047653 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:23.984 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.984+0000 7fb65ffff640 1 --2- 172.21.15.50:0/3853047653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09936da00 0x55e0993774f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:23.984 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.984+0000 7fb66492c640 1 -- 172.21.15.50:0/3853047653 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e099372b70 msgr2=0x55e09937e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:23.984 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.984+0000 7fb66492c640 1 --2- 172.21.15.50:0/3853047653 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e099372b70 0x55e09937e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:23.984 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.984+0000 7fb66492c640 1 -- 172.21.15.50:0/3853047653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09936da00 msgr2=0x55e0993774f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:23.984 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.984+0000 7fb66492c640 1 --2- 172.21.15.50:0/3853047653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09936da00 0x55e0993774f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:23.984 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.984+0000 7fb66492c640 1 -- 172.21.15.50:0/3853047653 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e098fe4210 con 0x55e09936d010 2024-06-06T03:36:23.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.985+0000 7fb66492c640 1 --2- 172.21.15.50:0/3853047653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e09936d010 0x55e099376fb0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fb650100fd0 tx=0x7fb65002a440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce02e9010a3d3bb server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:23.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.985+0000 7fb63ffff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:36:23.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.985+0000 7fb66512d640 1 --2- 172.21.15.50:0/2428945305 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb6480a2cc0 0x7fb6480a5180 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x55e09936e260 tx=0x7fb658009230 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:23.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.985+0000 7fb63ffff640 1 -- 172.21.15.50:0/3853047653 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6500b85e0 con 0x55e09936d010 2024-06-06T03:36:23.987 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.985+0000 7fb63ffff640 1 -- 172.21.15.50:0/3853047653 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fb6500b89b0 con 0x55e09936d010 2024-06-06T03:36:23.987 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.985+0000 7fb66997f740 1 -- 172.21.15.50:0/3853047653 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6500fd070 con 0x55e09936d010 2024-06-06T03:36:23.987 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.986+0000 7fb63ffff640 1 -- 172.21.15.50:0/3853047653 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb6500bbca0 con 0x55e09936d010 2024-06-06T03:36:23.987 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.986+0000 7fb66997f740 10 client.16668 fetch_fsmap learned FSMap version 35 2024-06-06T03:36:23.987 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.986+0000 7fb66997f740 1 -- 172.21.15.50:0/3853047653 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55e0990b0620 con 0x55e09936d010 2024-06-06T03:36:23.987 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.986+0000 7fb63ffff640 1 -- 172.21.15.50:0/3853047653 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb6500fd070 con 0x55e09936d010 2024-06-06T03:36:23.987 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.986+0000 7fb63ffff640 1 -- 172.21.15.50:0/3853047653 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 35) ==== 8354+0+0 (secure 0 0 0) 0x7fb6500f1030 con 0x55e09936d010 2024-06-06T03:36:23.987 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.986+0000 7fb66997f740 10 client.16668 fetch_fsmap finished waiting for FSMap version 35 2024-06-06T03:36:23.987 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.986+0000 7fb66997f740 10 client.16668 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:36:23.987 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.986+0000 7fb66997f740 20 client.16668 populate_metadata read hostname 'smithi050' 2024-06-06T03:36:23.987 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.986+0000 7fb66997f740 1 --2- 172.21.15.50:0/3853047653 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55e099382bb0 0x55e099385000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:23.987 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.987+0000 7fb66997f740 4 client.16668 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:36:23.987 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.987+0000 7fb66997f740 1 -- 172.21.15.50:0/3853047653 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0992e3f10 con 0x55e099382bb0 2024-06-06T03:36:23.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.992+0000 7fb65ffff640 1 --2- 172.21.15.50:0/3853047653 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55e099382bb0 0x55e099385000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:23.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.996+0000 7fb63ffff640 10 client.16668 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:23.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.996+0000 7fb65ffff640 1 --2- 172.21.15.50:0/3853047653 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55e099382bb0 0x55e099385000 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8b9074114362d0d server_cookie=c5ca0a1d8f976066 in_seq=0 out_seq=0 2024-06-06T03:36:23.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.997+0000 7fb63ffff640 1 -- 172.21.15.50:0/3853047653 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55e0992e3f10 con 0x55e099382bb0 2024-06-06T03:36:23.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.997+0000 7fb63ffff640 10 client.16668 handle_command_reply: tid=0 2024-06-06T03:36:24.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.997+0000 7fb66997f740 1 client.16668 shutdown 2024-06-06T03:36:24.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.997+0000 7fb66997f740 1 -- 172.21.15.50:0/3853047653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e09936d010 msgr2=0x55e099376fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:24.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.997+0000 7fb66997f740 1 --2- 172.21.15.50:0/3853047653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e09936d010 0x55e099376fb0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fb650100fd0 tx=0x7fb65002a440 comp rx=0 tx=0).stop 2024-06-06T03:36:24.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.997+0000 7fb66997f740 1 -- 172.21.15.50:0/3853047653 shutdown_connections 2024-06-06T03:36:24.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.997+0000 7fb66997f740 1 --2- 172.21.15.50:0/3853047653 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e099372b70 0x55e09937e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:24.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.997+0000 7fb66997f740 1 --2- 172.21.15.50:0/3853047653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09936da00 0x55e0993774f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:24.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.997+0000 7fb66997f740 1 --2- 172.21.15.50:0/3853047653 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55e099382bb0 0x55e099385000 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:24.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.997+0000 7fb66997f740 1 --2- 172.21.15.50:0/3853047653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e09936d010 0x55e099376fb0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:24.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.997+0000 7fb66997f740 1 -- 172.21.15.50:0/3853047653 >> 172.21.15.50:0/3853047653 conn(0x55e099368680 msgr2=0x55e0993677e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:24.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.997+0000 7fb63ffff640 0 client.16668 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:24.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.998+0000 7fb66997f740 1 -- 172.21.15.50:0/3853047653 shutdown_connections 2024-06-06T03:36:24.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.998+0000 7fb66997f740 1 -- 172.21.15.50:0/3853047653 wait complete. 2024-06-06T03:36:24.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:23.998+0000 7fb66997f740 20 client.16668 trim_cache size 0 max 16384 2024-06-06T03:36:24.038 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.033+0000 7fb66997f740 1 Processor -- start 2024-06-06T03:36:24.039 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.033+0000 7fb66997f740 1 -- start start 2024-06-06T03:36:24.039 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.033+0000 7fb66997f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e099368680 0x55e09936be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:24.039 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.033+0000 7fb66997f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09936d010 0x55e09937e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:24.039 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.034+0000 7fb66997f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e09936da00 0x55e099367660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:24.039 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.034+0000 7fb66997f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb6601d5240 con 0x55e099368680 2024-06-06T03:36:24.039 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.034+0000 7fb66997f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb6601d2b10 con 0x55e09936d010 2024-06-06T03:36:24.039 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.034+0000 7fb66997f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb6601d0960 con 0x55e09936da00 2024-06-06T03:36:24.039 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.035+0000 7fb66512d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e09936da00 0x55e099367660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:24.039 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.035+0000 7fb65ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09936d010 0x55e09937e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:24.039 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.035+0000 7fb66512d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e09936da00 0x55e099367660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:41970/0 (socket says 172.21.15.50:41970) 2024-06-06T03:36:24.039 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.035+0000 7fb66512d640 1 -- 172.21.15.50:0/2171246886 learned_addr learned my addr 172.21.15.50:0/2171246886 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:24.039 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.036+0000 7fb66492c640 1 --2- 172.21.15.50:0/2171246886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e099368680 0x55e09936be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:24.039 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.038+0000 7fb65ffff640 1 -- 172.21.15.50:0/2171246886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e09936da00 msgr2=0x55e099367660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:24.040 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.038+0000 7fb65ffff640 1 --2- 172.21.15.50:0/2171246886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e09936da00 0x55e099367660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:24.040 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.038+0000 7fb65ffff640 1 -- 172.21.15.50:0/2171246886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e099368680 msgr2=0x55e09936be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:24.040 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.038+0000 7fb65ffff640 1 --2- 172.21.15.50:0/2171246886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e099368680 0x55e09936be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:24.040 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.038+0000 7fb65ffff640 1 -- 172.21.15.50:0/2171246886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0993684b0 con 0x55e09936d010 2024-06-06T03:36:24.045 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.045+0000 7fb65ffff640 1 --2- 172.21.15.50:0/2171246886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09936d010 0x55e09937e510 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55e099385840 tx=0x7fb654004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62c091c6164422c6 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:24.049 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.051+0000 7fb6467fc640 1 -- 172.21.15.50:0/2171246886 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb654009e20 con 0x55e09936d010 2024-06-06T03:36:24.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.051+0000 7fb6467fc640 1 -- 172.21.15.50:0/2171246886 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb65401d070 con 0x55e09936d010 2024-06-06T03:36:24.051 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.052+0000 7fb66997f740 1 -- 172.21.15.50:0/2171246886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09936d010 msgr2=0x55e09937e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:24.051 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.052+0000 7fb66997f740 1 --2- 172.21.15.50:0/2171246886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09936d010 0x55e09937e510 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55e099385840 tx=0x7fb654004730 comp rx=0 tx=0).stop 2024-06-06T03:36:24.051 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.052+0000 7fb66997f740 1 -- 172.21.15.50:0/2171246886 shutdown_connections 2024-06-06T03:36:24.051 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.052+0000 7fb66997f740 1 --2- 172.21.15.50:0/2171246886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e09936da00 0x55e099367660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:24.051 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.052+0000 7fb66997f740 1 --2- 172.21.15.50:0/2171246886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09936d010 0x55e09937e510 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:24.051 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.052+0000 7fb66997f740 1 --2- 172.21.15.50:0/2171246886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e099368680 0x55e09936be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:24.052 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.052+0000 7fb66997f740 1 -- 172.21.15.50:0/2171246886 >> 172.21.15.50:0/2171246886 conn(0x55e09936e600 msgr2=0x55e099366f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:24.054 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.054+0000 7fb66997f740 1 -- 172.21.15.50:0/2171246886 shutdown_connections 2024-06-06T03:36:24.054 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.056+0000 7fb66997f740 1 -- 172.21.15.50:0/2171246886 wait complete. 2024-06-06T03:36:24.058 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.056+0000 7fb66997f740 1 -- start start 2024-06-06T03:36:24.058 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.056+0000 7fb66997f740 1 Processor -- start 2024-06-06T03:36:24.059 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.060+0000 7fb66997f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e099368680 0x55e09937b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:24.059 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.060+0000 7fb66997f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e09936da00 0x55e09937be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:24.060 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.060+0000 7fb66997f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e099372b70 0x55e09937ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:24.060 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.060+0000 7fb66997f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb6601d0fd0 con 0x55e09936da00 2024-06-06T03:36:24.060 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.060+0000 7fb66997f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb6601d2440 con 0x55e099372b70 2024-06-06T03:36:24.060 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.060+0000 7fb66997f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb6601d16a0 con 0x55e099368680 2024-06-06T03:36:24.060 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.060+0000 7fb66997f740 10 client.0 _ll_register_callbacks cb 0x7fb6500f3c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:36:24.061 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.062+0000 7fb66492c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e099368680 0x55e09937b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:24.061 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.062+0000 7fb66512d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e099372b70 0x55e09937ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:24.061 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.062+0000 7fb66492c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e099368680 0x55e09937b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:41984/0 (socket says 172.21.15.50:41984) 2024-06-06T03:36:24.061 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.062+0000 7fb66492c640 1 -- 172.21.15.50:0/379031757 learned_addr learned my addr 172.21.15.50:0/379031757 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:24.062 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.063+0000 7fb66492c640 1 -- 172.21.15.50:0/379031757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e099372b70 msgr2=0x55e09937ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:24.062 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.063+0000 7fb66492c640 1 --2- 172.21.15.50:0/379031757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e099372b70 0x55e09937ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:24.062 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.063+0000 7fb66492c640 1 -- 172.21.15.50:0/379031757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e09936da00 msgr2=0x55e09937be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:24.062 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.063+0000 7fb66492c640 1 --2- 172.21.15.50:0/379031757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e09936da00 0x55e09937be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:24.063 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.063+0000 7fb66492c640 1 -- 172.21.15.50:0/379031757 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e09937d450 con 0x55e099368680 2024-06-06T03:36:24.063 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.063+0000 7fb66492c640 1 --2- 172.21.15.50:0/379031757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e099368680 0x55e09937b910 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb6500c07a0 tx=0x7fb6500c5080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3ff9919f33de90d server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:24.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.066+0000 7fb63ffff640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:36:24.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.066+0000 7fb63ffff640 1 -- 172.21.15.50:0/379031757 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6500bbe80 con 0x55e099368680 2024-06-06T03:36:24.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.066+0000 7fb63ffff640 1 -- 172.21.15.50:0/379031757 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fb6500433b0 con 0x55e099368680 2024-06-06T03:36:24.069 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.068+0000 7fb66997f740 1 -- 172.21.15.50:0/379031757 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e0992ddc20 con 0x55e099368680 2024-06-06T03:36:24.069 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.068+0000 7fb63ffff640 1 -- 172.21.15.50:0/379031757 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb6500bc110 con 0x55e099368680 2024-06-06T03:36:24.069 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.069+0000 7fb66997f740 10 client.26392 fetch_fsmap learned FSMap version 35 2024-06-06T03:36:24.069 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.069+0000 7fb66997f740 1 -- 172.21.15.50:0/379031757 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55e09937d450 con 0x55e099368680 2024-06-06T03:36:24.071 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.072+0000 7fb63ffff640 1 -- 172.21.15.50:0/379031757 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55e0992ddc20 con 0x55e099368680 2024-06-06T03:36:24.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.073+0000 7fb63ffff640 1 -- 172.21.15.50:0/379031757 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 35) ==== 8354+0+0 (secure 0 0 0) 0x7fb6500bc5a0 con 0x55e099368680 2024-06-06T03:36:24.076 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.074+0000 7fb66997f740 10 client.26392 fetch_fsmap finished waiting for FSMap version 35 2024-06-06T03:36:24.076 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.074+0000 7fb66997f740 10 client.26392 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:36:24.076 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.074+0000 7fb66997f740 20 client.26392 populate_metadata read hostname 'smithi050' 2024-06-06T03:36:24.076 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.074+0000 7fb66997f740 1 --2- 172.21.15.50:0/379031757 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55e0993edd80 0x55e0993f01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:24.076 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.074+0000 7fb66997f740 4 client.26392 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:36:24.076 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.074+0000 7fb66997f740 1 -- 172.21.15.50:0/379031757 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e0992d7f70 con 0x55e0993edd80 2024-06-06T03:36:24.076 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.074+0000 7fb65ffff640 1 --2- 172.21.15.50:0/379031757 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55e0993edd80 0x55e0993f01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:24.079 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.080+0000 7fb65ffff640 1 --2- 172.21.15.50:0/379031757 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55e0993edd80 0x55e0993f01a0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81feaf5ae75d573 server_cookie=21d2774e79e44e2f in_seq=0 out_seq=0 2024-06-06T03:36:24.079 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.080+0000 7fb63ffff640 10 client.26392 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:24.112 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.114+0000 7fb63ffff640 1 -- 172.21.15.50:0/379031757 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55e0992d7f70 con 0x55e0993edd80 2024-06-06T03:36:24.113 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.114+0000 7fb63ffff640 10 client.26392 handle_command_reply: tid=0 2024-06-06T03:36:24.118 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.117+0000 7fb66997f740 1 client.26392 shutdown 2024-06-06T03:36:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.129+0000 7fb66997f740 1 -- 172.21.15.50:0/379031757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e099368680 msgr2=0x55e09937b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.129+0000 7fb66997f740 1 --2- 172.21.15.50:0/379031757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e099368680 0x55e09937b910 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb6500c07a0 tx=0x7fb6500c5080 comp rx=0 tx=0).stop 2024-06-06T03:36:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.129+0000 7fb66997f740 1 -- 172.21.15.50:0/379031757 shutdown_connections 2024-06-06T03:36:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.129+0000 7fb66997f740 1 --2- 172.21.15.50:0/379031757 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55e0993edd80 0x55e0993f01a0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.129+0000 7fb66997f740 1 --2- 172.21.15.50:0/379031757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e09936da00 0x55e09937be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.129+0000 7fb66997f740 1 --2- 172.21.15.50:0/379031757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e099372b70 0x55e09937ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.129+0000 7fb66997f740 1 --2- 172.21.15.50:0/379031757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e099368680 0x55e09937b910 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.129+0000 7fb66997f740 1 -- 172.21.15.50:0/379031757 >> 172.21.15.50:0/379031757 conn(0x55e09936e600 msgr2=0x55e0993677e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.131+0000 7fb63ffff640 0 client.26392 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.134+0000 7fb66997f740 1 -- 172.21.15.50:0/379031757 shutdown_connections 2024-06-06T03:36:24.138 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.140+0000 7fb66997f740 1 -- 172.21.15.50:0/379031757 wait complete. 2024-06-06T03:36:24.145 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.145+0000 7fb66997f740 20 client.26392 trim_cache size 0 max 16384 2024-06-06T03:36:24.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:36:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:36:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:36:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.156+0000 7fb666b90640 1 -- 172.21.15.50:0/2428945305 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb6480a2cc0 msgr2=0x7fb6480a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.156+0000 7fb666b90640 1 --2- 172.21.15.50:0/2428945305 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb6480a2cc0 0x7fb6480a5180 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x55e09936e260 tx=0x7fb658009230 comp rx=0 tx=0).stop 2024-06-06T03:36:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.157+0000 7fb666b90640 1 -- 172.21.15.50:0/2428945305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb660073890 msgr2=0x7fb66012abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.157+0000 7fb666b90640 1 --2- 172.21.15.50:0/2428945305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb660073890 0x7fb66012abd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb6500094a0 tx=0x7fb650003cd0 comp rx=0 tx=0).stop 2024-06-06T03:36:24.160 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.157+0000 7fb666b90640 1 -- 172.21.15.50:0/2428945305 shutdown_connections 2024-06-06T03:36:24.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.157+0000 7fb666b90640 1 --2- 172.21.15.50:0/2428945305 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fb6480a2cc0 0x7fb6480a5180 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:24.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.157+0000 7fb666b90640 1 --2- 172.21.15.50:0/2428945305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb660079120 0x7fb660131a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:24.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.157+0000 7fb666b90640 1 --2- 172.21.15.50:0/2428945305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb660076770 0x7fb66012b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:24.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.157+0000 7fb666b90640 1 --2- 172.21.15.50:0/2428945305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb660073890 0x7fb66012abd0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:24.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.157+0000 7fb666b90640 1 -- 172.21.15.50:0/2428945305 >> 172.21.15.50:0/2428945305 conn(0x7fb66006ea10 msgr2=0x7fb6600770f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:24.166 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.162+0000 7fb666b90640 1 -- 172.21.15.50:0/2428945305 shutdown_connections 2024-06-06T03:36:24.166 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:24.162+0000 7fb666b90640 1 -- 172.21.15.50:0/2428945305 wait complete. 2024-06-06T03:36:25.453 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:25 smithi050 ceph-mon[32421]: pgmap v724: 129 pgs: 129 active+clean; 10 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 28 MiB/s wr, 587 op/s 2024-06-06T03:36:25.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:25 smithi079 ceph-mon[35478]: pgmap v724: 129 pgs: 129 active+clean; 10 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 28 MiB/s wr, 587 op/s 2024-06-06T03:36:25.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:25 smithi122 ceph-mon[35759]: pgmap v724: 129 pgs: 129 active+clean; 10 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 28 MiB/s wr, 587 op/s 2024-06-06T03:36:26.132 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:36:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.453+0000 7f24b1b1b700 1 -- 172.21.15.50:0/3058478247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24ac10a0a0 msgr2=0x7f24ac10d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.453+0000 7f24b1b1b700 1 --2- 172.21.15.50:0/3058478247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24ac10a0a0 0x7f24ac10d720 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f24a400b0a0 tx=0x7f24a400b3b0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.454+0000 7f24b1b1b700 1 -- 172.21.15.50:0/3058478247 shutdown_connections 2024-06-06T03:36:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.454+0000 7f24b1b1b700 1 --2- 172.21.15.50:0/3058478247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24ac10de50 0x7f24ac07a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.454+0000 7f24b1b1b700 1 --2- 172.21.15.50:0/3058478247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24ac1096f0 0x7f24ac109ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.454+0000 7f24b1b1b700 1 --2- 172.21.15.50:0/3058478247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24ac10a0a0 0x7f24ac10d720 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.454+0000 7f24b1b1b700 1 -- 172.21.15.50:0/3058478247 >> 172.21.15.50:0/3058478247 conn(0x7f24ac06d600 msgr2=0x7f24ac06da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.454+0000 7f24b1b1b700 1 -- 172.21.15.50:0/3058478247 shutdown_connections 2024-06-06T03:36:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.454+0000 7f24b1b1b700 1 -- 172.21.15.50:0/3058478247 wait complete. 2024-06-06T03:36:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.455+0000 7f24b1b1b700 1 Processor -- start 2024-06-06T03:36:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.455+0000 7f24b1b1b700 1 -- start start 2024-06-06T03:36:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.456+0000 7f24b1b1b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24ac1096f0 0x7f24ac07a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.456+0000 7f24b1b1b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24ac10a0a0 0x7f24ac074750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.456+0000 7f24b1b1b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24ac10de50 0x7f24ac074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.456+0000 7f24b1b1b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac081f60 con 0x7f24ac10de50 2024-06-06T03:36:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.456+0000 7f24b1b1b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac081de0 con 0x7f24ac1096f0 2024-06-06T03:36:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.456+0000 7f24b1b1b700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac0820e0 con 0x7f24ac10a0a0 2024-06-06T03:36:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.457+0000 7f24aaffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24ac10a0a0 0x7f24ac074750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.457+0000 7f24ab7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24ac1096f0 0x7f24ac07a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.457+0000 7f24aaffd700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24ac10a0a0 0x7f24ac074750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:42012/0 (socket says 172.21.15.50:42012) 2024-06-06T03:36:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.457+0000 7f24aaffd700 1 -- 172.21.15.50:0/2017081739 learned_addr learned my addr 172.21.15.50:0/2017081739 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.457+0000 7f24aaffd700 1 -- 172.21.15.50:0/2017081739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24ac1096f0 msgr2=0x7f24ac07a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.457+0000 7f24aaffd700 1 --2- 172.21.15.50:0/2017081739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24ac1096f0 0x7f24ac07a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.457+0000 7f24aaffd700 1 -- 172.21.15.50:0/2017081739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24ac10de50 msgr2=0x7f24ac074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.457+0000 7f24aaffd700 1 --2- 172.21.15.50:0/2017081739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24ac10de50 0x7f24ac074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.458+0000 7f24aaffd700 1 -- 172.21.15.50:0/2017081739 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24ac137990 con 0x7f24ac10a0a0 2024-06-06T03:36:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.458+0000 7f24aaffd700 1 --2- 172.21.15.50:0/2017081739 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24ac10a0a0 0x7f24ac074750 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f24a400b070 tx=0x7f24a4004cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.458+0000 7f24a8ff9700 1 -- 172.21.15.50:0/2017081739 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a4043020 con 0x7f24ac10a0a0 2024-06-06T03:36:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.458+0000 7f24a8ff9700 1 -- 172.21.15.50:0/2017081739 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f24a4012cc0 con 0x7f24ac10a0a0 2024-06-06T03:36:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.458+0000 7f24a8ff9700 1 -- 172.21.15.50:0/2017081739 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a403da30 con 0x7f24ac10a0a0 2024-06-06T03:36:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.460+0000 7f24b1b1b700 1 -- 172.21.15.50:0/2017081739 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24ac137c20 con 0x7f24ac10a0a0 2024-06-06T03:36:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.460+0000 7f24b1b1b700 1 -- 172.21.15.50:0/2017081739 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24ac1380e0 con 0x7f24ac10a0a0 2024-06-06T03:36:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.467+0000 7f24a8ff9700 1 -- 172.21.15.50:0/2017081739 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f24a4046020 con 0x7f24ac10a0a0 2024-06-06T03:36:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.469+0000 7f24bc39eb80 1 Processor -- start 2024-06-06T03:36:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.470+0000 7f24a8ff9700 1 --2- 172.21.15.50:0/2017081739 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f24940a2d60 0x7f24940a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.470+0000 7f24bc39eb80 1 -- start start 2024-06-06T03:36:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.470+0000 7f24abfff700 1 --2- 172.21.15.50:0/2017081739 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f24940a2d60 0x7f24940a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.470+0000 7f24a8ff9700 1 -- 172.21.15.50:0/2017081739 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f24a400f030 con 0x7f24ac10a0a0 2024-06-06T03:36:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.471+0000 7f24bc39eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e41c3e2f60 0x55e41c3e3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.471+0000 7f24bc39eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e41c3e3880 0x55e41c3dd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.471+0000 7f24abfff700 1 --2- 172.21.15.50:0/2017081739 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f24940a2d60 0x7f24940a5220 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f24a0009730 tx=0x7f24a0006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.471+0000 7f24bc39eb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e41c3dd7a0 0x55e41c3ddbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.471+0000 7f24bc39eb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e41c2cff60 con 0x55e41c3dd7a0 2024-06-06T03:36:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.471+0000 7f24bc39eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e41c32e850 con 0x55e41c3e3880 2024-06-06T03:36:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.471+0000 7f24bc39eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e41c296460 con 0x55e41c3e2f60 2024-06-06T03:36:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.471+0000 7f24abfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e41c3dd7a0 0x55e41c3ddbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.471+0000 7f24abfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e41c3dd7a0 0x55e41c3ddbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37434/0 (socket says 172.21.15.50:37434) 2024-06-06T03:36:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.471+0000 7f24abfff700 1 -- 172.21.15.50:0/3503249438 learned_addr learned my addr 172.21.15.50:0/3503249438 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.471+0000 7f24ab7fe700 1 --2- 172.21.15.50:0/3503249438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e41c3e2f60 0x55e41c3e3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.471+0000 7f24aaffd700 1 --2- 172.21.15.50:0/3503249438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e41c3e3880 0x55e41c3dd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.471+0000 7f24abfff700 1 -- 172.21.15.50:0/3503249438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e41c3e2f60 msgr2=0x55e41c3e3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.471+0000 7f24abfff700 1 --2- 172.21.15.50:0/3503249438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e41c3e2f60 0x55e41c3e3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.471+0000 7f24abfff700 1 -- 172.21.15.50:0/3503249438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e41c3e3880 msgr2=0x55e41c3dd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.471+0000 7f24abfff700 1 --2- 172.21.15.50:0/3503249438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e41c3e3880 0x55e41c3dd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.471+0000 7f24abfff700 1 -- 172.21.15.50:0/3503249438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e41c27d8d0 con 0x55e41c3dd7a0 2024-06-06T03:36:26.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.472+0000 7f24abfff700 1 --2- 172.21.15.50:0/3503249438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e41c3dd7a0 0x55e41c3ddbc0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f24a00158f0 tx=0x7f24a000e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc098d035deeef4b server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:26.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.473+0000 7f2491ffb700 1 -- 172.21.15.50:0/3503249438 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a0023070 con 0x55e41c3dd7a0 2024-06-06T03:36:26.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.473+0000 7f2491ffb700 1 -- 172.21.15.50:0/3503249438 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f24a0012a20 con 0x55e41c3dd7a0 2024-06-06T03:36:26.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.473+0000 7f2491ffb700 1 -- 172.21.15.50:0/3503249438 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a0013970 con 0x55e41c3dd7a0 2024-06-06T03:36:26.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.473+0000 7f24bc39eb80 1 -- 172.21.15.50:0/3503249438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e41c3dd7a0 msgr2=0x55e41c3ddbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:26.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.473+0000 7f24bc39eb80 1 --2- 172.21.15.50:0/3503249438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e41c3dd7a0 0x55e41c3ddbc0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f24a00158f0 tx=0x7f24a000e000 comp rx=0 tx=0).stop 2024-06-06T03:36:26.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.473+0000 7f24bc39eb80 1 -- 172.21.15.50:0/3503249438 shutdown_connections 2024-06-06T03:36:26.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.473+0000 7f24bc39eb80 1 --2- 172.21.15.50:0/3503249438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e41c3dd7a0 0x55e41c3ddbc0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.473+0000 7f24bc39eb80 1 --2- 172.21.15.50:0/3503249438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e41c3e2f60 0x55e41c3e3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.473+0000 7f24bc39eb80 1 --2- 172.21.15.50:0/3503249438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e41c3e3880 0x55e41c3dd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.473+0000 7f24bc39eb80 1 -- 172.21.15.50:0/3503249438 >> 172.21.15.50:0/3503249438 conn(0x55e41c30a080 msgr2=0x55e41c3d8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:26.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.473+0000 7f24bc39eb80 1 -- 172.21.15.50:0/3503249438 shutdown_connections 2024-06-06T03:36:26.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.473+0000 7f24bc39eb80 1 -- 172.21.15.50:0/3503249438 wait complete. 2024-06-06T03:36:26.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.474+0000 7f24bc39eb80 1 -- start start 2024-06-06T03:36:26.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.474+0000 7f24bc39eb80 1 Processor -- start 2024-06-06T03:36:26.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.474+0000 7f24bc39eb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e41c3dd7a0 0x55e41c3e95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:26.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.474+0000 7f24bc39eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e41c3e2f60 0x55e41c3e68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:26.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.474+0000 7f24ab7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e41c3dd7a0 0x55e41c3e95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:26.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.474+0000 7f24bc39eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e41c3e3880 0x55e41c3e6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:26.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.474+0000 7f24ab7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e41c3dd7a0 0x55e41c3e95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37444/0 (socket says 172.21.15.50:37444) 2024-06-06T03:36:26.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.474+0000 7f24ab7fe700 1 -- 172.21.15.50:0/2710758335 learned_addr learned my addr 172.21.15.50:0/2710758335 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:26.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.474+0000 7f24bc39eb80 1 -- 172.21.15.50:0/2710758335 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e41c2cefc0 con 0x55e41c3dd7a0 2024-06-06T03:36:26.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.475+0000 7f24bc39eb80 1 -- 172.21.15.50:0/2710758335 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e41c32a810 con 0x55e41c3e2f60 2024-06-06T03:36:26.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.475+0000 7f24bc39eb80 1 -- 172.21.15.50:0/2710758335 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e41c3ea260 con 0x55e41c3e3880 2024-06-06T03:36:26.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.475+0000 7f24bc39eb80 10 client.0 _ll_register_callbacks cb 0x55e41c2c45b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:36:26.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.475+0000 7f24aaffd700 1 --2- 172.21.15.50:0/2710758335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e41c3e2f60 0x55e41c3e68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:26.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.475+0000 7f24abfff700 1 --2- 172.21.15.50:0/2710758335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e41c3e3880 0x55e41c3e6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.475+0000 7f24ab7fe700 1 -- 172.21.15.50:0/2710758335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e41c3e3880 msgr2=0x55e41c3e6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.475+0000 7f24ab7fe700 1 --2- 172.21.15.50:0/2710758335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e41c3e3880 0x55e41c3e6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.475+0000 7f24ab7fe700 1 -- 172.21.15.50:0/2710758335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e41c3e2f60 msgr2=0x55e41c3e68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.475+0000 7f24ab7fe700 1 --2- 172.21.15.50:0/2710758335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e41c3e2f60 0x55e41c3e68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.475+0000 7f24ab7fe700 1 -- 172.21.15.50:0/2710758335 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e41c2f4750 con 0x55e41c3dd7a0 2024-06-06T03:36:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.475+0000 7f24ab7fe700 1 --2- 172.21.15.50:0/2710758335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e41c3dd7a0 0x55e41c3e95e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f249c012740 tx=0x7f249c012a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a16ac45c4c7399 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.475+0000 7f248affd700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:36:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.475+0000 7f248affd700 1 -- 172.21.15.50:0/2710758335 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c00f4e0 con 0x55e41c3dd7a0 2024-06-06T03:36:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.475+0000 7f248affd700 1 -- 172.21.15.50:0/2710758335 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f249c00f680 con 0x55e41c3dd7a0 2024-06-06T03:36:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.475+0000 7f24bc39eb80 1 -- 172.21.15.50:0/2710758335 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24a0012a20 con 0x55e41c3dd7a0 2024-06-06T03:36:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.475+0000 7f248affd700 1 -- 172.21.15.50:0/2710758335 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f249c00f880 con 0x55e41c3dd7a0 2024-06-06T03:36:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.475+0000 7f24bc39eb80 10 client.16677 fetch_fsmap learned FSMap version 35 2024-06-06T03:36:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.475+0000 7f24bc39eb80 1 -- 172.21.15.50:0/2710758335 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55e41c3f4a20 con 0x55e41c3dd7a0 2024-06-06T03:36:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.476+0000 7f248affd700 1 -- 172.21.15.50:0/2710758335 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f24a0012a20 con 0x55e41c3dd7a0 2024-06-06T03:36:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.476+0000 7f248affd700 1 -- 172.21.15.50:0/2710758335 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 35) ==== 8354+0+0 (secure 0 0 0) 0x7f249c010b00 con 0x55e41c3dd7a0 2024-06-06T03:36:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.476+0000 7f24bc39eb80 10 client.16677 fetch_fsmap finished waiting for FSMap version 35 2024-06-06T03:36:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.476+0000 7f24bc39eb80 10 client.16677 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-06-06T03:36:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.476+0000 7f24bc39eb80 20 client.16677 populate_metadata read hostname 'smithi050' 2024-06-06T03:36:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.476+0000 7f24bc39eb80 1 --2- 172.21.15.50:0/2710758335 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55e41c3f7060 0x55e41c3f94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.476+0000 7f24bc39eb80 4 client.16677 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:36:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.476+0000 7f24bc39eb80 1 -- 172.21.15.50:0/2710758335 --> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e41c33bd50 con 0x55e41c3f7060 2024-06-06T03:36:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.476+0000 7f24aaffd700 1 --2- 172.21.15.50:0/2710758335 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55e41c3f7060 0x55e41c3f94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.476+0000 7f248affd700 10 client.16677 ms_handle_connect on v2:172.21.15.122:6836/1604366318 2024-06-06T03:36:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.477+0000 7f24aaffd700 1 --2- 172.21.15.50:0/2710758335 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55e41c3f7060 0x55e41c3f94f0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bc87cd71fd658787 server_cookie=b7804e71333d8aba in_seq=0 out_seq=0 2024-06-06T03:36:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.477+0000 7f248affd700 1 -- 172.21.15.50:0/2710758335 <== mds.1 v2:172.21.15.122:6836/1604366318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55e41c33bd50 con 0x55e41c3f7060 2024-06-06T03:36:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.477+0000 7f248affd700 10 client.16677 handle_command_reply: tid=0 2024-06-06T03:36:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.477+0000 7f24bc39eb80 1 client.16677 shutdown 2024-06-06T03:36:26.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.477+0000 7f24bc39eb80 1 -- 172.21.15.50:0/2710758335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e41c3dd7a0 msgr2=0x55e41c3e95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:26.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.477+0000 7f24bc39eb80 1 --2- 172.21.15.50:0/2710758335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e41c3dd7a0 0x55e41c3e95e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f249c012740 tx=0x7f249c012a50 comp rx=0 tx=0).stop 2024-06-06T03:36:26.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.477+0000 7f24bc39eb80 1 -- 172.21.15.50:0/2710758335 shutdown_connections 2024-06-06T03:36:26.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.477+0000 7f24bc39eb80 1 --2- 172.21.15.50:0/2710758335 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55e41c3f7060 0x55e41c3f94f0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.477+0000 7f248affd700 0 client.16677 ms_handle_reset on v2:172.21.15.122:6836/1604366318 2024-06-06T03:36:26.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.477+0000 7f24bc39eb80 1 --2- 172.21.15.50:0/2710758335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e41c3e3880 0x55e41c3e6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.477+0000 7f24bc39eb80 1 --2- 172.21.15.50:0/2710758335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e41c3dd7a0 0x55e41c3e95e0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.477+0000 7f24bc39eb80 1 --2- 172.21.15.50:0/2710758335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e41c3e2f60 0x55e41c3e68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.478+0000 7f24bc39eb80 1 -- 172.21.15.50:0/2710758335 >> 172.21.15.50:0/2710758335 conn(0x55e41c30a080 msgr2=0x55e41c3d7700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:26.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.478+0000 7f24bc39eb80 1 -- 172.21.15.50:0/2710758335 shutdown_connections 2024-06-06T03:36:26.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.478+0000 7f24bc39eb80 1 -- 172.21.15.50:0/2710758335 wait complete. 2024-06-06T03:36:26.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.478+0000 7f24bc39eb80 20 client.16677 trim_cache size 0 max 16384 2024-06-06T03:36:26.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.497+0000 7f24bc39eb80 1 Processor -- start 2024-06-06T03:36:26.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.497+0000 7f24bc39eb80 1 -- start start 2024-06-06T03:36:26.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.498+0000 7f24bc39eb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e41c3dd7a0 0x55e41c3dd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:26.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.498+0000 7f24bc39eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e41c3e2f60 0x55e41c3e89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:26.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.498+0000 7f24ab7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e41c3dd7a0 0x55e41c3dd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:26.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.498+0000 7f24ab7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e41c3dd7a0 0x55e41c3dd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37458/0 (socket says 172.21.15.50:37458) 2024-06-06T03:36:26.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.498+0000 7f24ab7fe700 1 -- 172.21.15.50:0/1504507476 learned_addr learned my addr 172.21.15.50:0/1504507476 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:26.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.498+0000 7f24bc39eb80 1 --2- 172.21.15.50:0/1504507476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e41c3e3880 0x55e41c3d7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:26.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.498+0000 7f24bc39eb80 1 -- 172.21.15.50:0/1504507476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac1c80a0 con 0x55e41c3dd7a0 2024-06-06T03:36:26.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.498+0000 7f24bc39eb80 1 -- 172.21.15.50:0/1504507476 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac1c5930 con 0x55e41c3e3880 2024-06-06T03:36:26.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.498+0000 7f24bc39eb80 1 -- 172.21.15.50:0/1504507476 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac1c37a0 con 0x55e41c3e2f60 2024-06-06T03:36:26.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.499+0000 7f24ab7fe700 1 -- 172.21.15.50:0/1504507476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e41c3e2f60 msgr2=0x55e41c3e89a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:36:26.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.499+0000 7f24ab7fe700 1 --2- 172.21.15.50:0/1504507476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e41c3e2f60 0x55e41c3e89a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.499+0000 7f24ab7fe700 1 -- 172.21.15.50:0/1504507476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e41c3e3880 msgr2=0x55e41c3d7e80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:36:26.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.499+0000 7f24ab7fe700 1 --2- 172.21.15.50:0/1504507476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e41c3e3880 0x55e41c3d7e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.499+0000 7f24ab7fe700 1 -- 172.21.15.50:0/1504507476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e41c3d99c0 con 0x55e41c3dd7a0 2024-06-06T03:36:26.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.499+0000 7f24ab7fe700 1 --2- 172.21.15.50:0/1504507476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e41c3dd7a0 0x55e41c3dd260 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f249c012ef0 tx=0x7f249c0122e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8e78163ca3a198 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:26.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.501+0000 7f24917fa700 1 -- 172.21.15.50:0/1504507476 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c01be90 con 0x55e41c3dd7a0 2024-06-06T03:36:26.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.501+0000 7f24917fa700 1 -- 172.21.15.50:0/1504507476 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f249c01c560 con 0x55e41c3dd7a0 2024-06-06T03:36:26.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.501+0000 7f24917fa700 1 -- 172.21.15.50:0/1504507476 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c005080 con 0x55e41c3dd7a0 2024-06-06T03:36:26.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.505+0000 7f24bc39eb80 1 -- 172.21.15.50:0/1504507476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e41c3dd7a0 msgr2=0x55e41c3dd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:26.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.505+0000 7f24bc39eb80 1 --2- 172.21.15.50:0/1504507476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e41c3dd7a0 0x55e41c3dd260 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f249c012ef0 tx=0x7f249c0122e0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.506+0000 7f24bc39eb80 1 -- 172.21.15.50:0/1504507476 shutdown_connections 2024-06-06T03:36:26.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.506+0000 7f24bc39eb80 1 --2- 172.21.15.50:0/1504507476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e41c3e3880 0x55e41c3d7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.506+0000 7f24bc39eb80 1 --2- 172.21.15.50:0/1504507476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e41c3dd7a0 0x55e41c3dd260 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.506+0000 7f24bc39eb80 1 --2- 172.21.15.50:0/1504507476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e41c3e2f60 0x55e41c3e89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.506+0000 7f24bc39eb80 1 -- 172.21.15.50:0/1504507476 >> 172.21.15.50:0/1504507476 conn(0x55e41c30a080 msgr2=0x55e41c3e0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:26.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.512+0000 7f24bc39eb80 1 -- 172.21.15.50:0/1504507476 shutdown_connections 2024-06-06T03:36:26.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.512+0000 7f24bc39eb80 1 -- 172.21.15.50:0/1504507476 wait complete. 2024-06-06T03:36:26.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.512+0000 7f24bc39eb80 1 -- start start 2024-06-06T03:36:26.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.513+0000 7f24bc39eb80 1 Processor -- start 2024-06-06T03:36:26.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.513+0000 7f24bc39eb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e41c3dd7a0 0x55e41c3efb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:26.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.514+0000 7f24bc39eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e41c3e2f60 0x55e41c3fe690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:26.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.514+0000 7f24bc39eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e41c3e3880 0x55e41c3febd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:26.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.514+0000 7f24bc39eb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac1c3df0 con 0x55e41c3dd7a0 2024-06-06T03:36:26.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.514+0000 7f24bc39eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac1c5260 con 0x55e41c3e2f60 2024-06-06T03:36:26.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.514+0000 7f24bc39eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac1c44c0 con 0x55e41c3e3880 2024-06-06T03:36:26.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.514+0000 7f24bc39eb80 10 client.0 _ll_register_callbacks cb 0x55e41c2c45b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:36:26.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.514+0000 7f24abfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e41c3e3880 0x55e41c3febd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.514+0000 7f24abfff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e41c3e3880 0x55e41c3febd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:42048/0 (socket says 172.21.15.50:42048) 2024-06-06T03:36:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.514+0000 7f24abfff700 1 -- 172.21.15.50:0/1795634946 learned_addr learned my addr 172.21.15.50:0/1795634946 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.515+0000 7f24ab7fe700 1 --2- 172.21.15.50:0/1795634946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e41c3dd7a0 0x55e41c3efb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.515+0000 7f24abfff700 1 -- 172.21.15.50:0/1795634946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e41c3e2f60 msgr2=0x55e41c3fe690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:36:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.515+0000 7f24abfff700 1 --2- 172.21.15.50:0/1795634946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e41c3e2f60 0x55e41c3fe690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.515+0000 7f24abfff700 1 -- 172.21.15.50:0/1795634946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e41c3dd7a0 msgr2=0x55e41c3efb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.515+0000 7f24abfff700 1 --2- 172.21.15.50:0/1795634946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e41c3dd7a0 0x55e41c3efb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.515+0000 7f24abfff700 1 -- 172.21.15.50:0/1795634946 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e41c3ff300 con 0x55e41c3e3880 2024-06-06T03:36:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.515+0000 7f24abfff700 1 --2- 172.21.15.50:0/1795634946 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e41c3e3880 0x55e41c3febd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f24a0021040 tx=0x7f24a0012c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b26f6faa9a5d4b01 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.516+0000 7f248affd700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:36:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.516+0000 7f248affd700 1 -- 172.21.15.50:0/1795634946 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a0023050 con 0x55e41c3e3880 2024-06-06T03:36:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.516+0000 7f248affd700 1 -- 172.21.15.50:0/1795634946 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f24a002a450 con 0x55e41c3e3880 2024-06-06T03:36:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.516+0000 7f24bc39eb80 1 -- 172.21.15.50:0/1795634946 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f249c01c560 con 0x55e41c3e3880 2024-06-06T03:36:26.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.517+0000 7f248affd700 1 -- 172.21.15.50:0/1795634946 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f24a002a650 con 0x55e41c3e3880 2024-06-06T03:36:26.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.518+0000 7f24bc39eb80 10 client.26407 fetch_fsmap learned FSMap version 35 2024-06-06T03:36:26.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.518+0000 7f24bc39eb80 1 -- 172.21.15.50:0/1795634946 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55e41c461ce0 con 0x55e41c3e3880 2024-06-06T03:36:26.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.519+0000 7f248affd700 1 -- 172.21.15.50:0/1795634946 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f24a002f070 con 0x55e41c3e3880 2024-06-06T03:36:26.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.520+0000 7f248affd700 1 -- 172.21.15.50:0/1795634946 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 35) ==== 8354+0+0 (secure 0 0 0) 0x7f24a00348b0 con 0x55e41c3e3880 2024-06-06T03:36:26.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.520+0000 7f24bc39eb80 10 client.26407 fetch_fsmap finished waiting for FSMap version 35 2024-06-06T03:36:26.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.520+0000 7f24bc39eb80 10 client.26407 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-06-06T03:36:26.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.520+0000 7f24bc39eb80 20 client.26407 populate_metadata read hostname 'smithi050' 2024-06-06T03:36:26.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.520+0000 7f24bc39eb80 1 --2- 172.21.15.50:0/1795634946 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55e41c462030 0x55e41c464450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:26.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.520+0000 7f24bc39eb80 4 client.26407 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:36:26.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.520+0000 7f24bc39eb80 1 -- 172.21.15.50:0/1795634946 --> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f249c01c560 con 0x55e41c462030 2024-06-06T03:36:26.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.520+0000 7f24ab7fe700 1 --2- 172.21.15.50:0/1795634946 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55e41c462030 0x55e41c464450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:26.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.530+0000 7f24ab7fe700 1 --2- 172.21.15.50:0/1795634946 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55e41c462030 0x55e41c464450 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=306a4c3563ba1ced server_cookie=711f7faad17124b6 in_seq=0 out_seq=0 2024-06-06T03:36:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.530+0000 7f248affd700 10 client.26407 ms_handle_connect on v2:172.21.15.122:6836/1604366318 2024-06-06T03:36:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.530+0000 7f248affd700 1 -- 172.21.15.50:0/1795634946 <== mds.1 v2:172.21.15.122:6836/1604366318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f249c01c560 con 0x55e41c462030 2024-06-06T03:36:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.530+0000 7f248affd700 10 client.26407 handle_command_reply: tid=0 2024-06-06T03:36:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.531+0000 7f24bc39eb80 1 client.26407 shutdown 2024-06-06T03:36:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.540+0000 7f24bc39eb80 1 -- 172.21.15.50:0/1795634946 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e41c3e3880 msgr2=0x55e41c3febd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.540+0000 7f24bc39eb80 1 --2- 172.21.15.50:0/1795634946 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e41c3e3880 0x55e41c3febd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f24a0021040 tx=0x7f24a0012c40 comp rx=0 tx=0).stop 2024-06-06T03:36:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.540+0000 7f24bc39eb80 1 -- 172.21.15.50:0/1795634946 shutdown_connections 2024-06-06T03:36:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.540+0000 7f24bc39eb80 1 --2- 172.21.15.50:0/1795634946 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x55e41c462030 0x55e41c464450 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.540+0000 7f24bc39eb80 1 --2- 172.21.15.50:0/1795634946 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e41c3e3880 0x55e41c3febd0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.540+0000 7f24bc39eb80 1 --2- 172.21.15.50:0/1795634946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e41c3dd7a0 0x55e41c3efb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.540+0000 7f24bc39eb80 1 --2- 172.21.15.50:0/1795634946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e41c3e2f60 0x55e41c3fe690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.540+0000 7f24bc39eb80 1 -- 172.21.15.50:0/1795634946 >> 172.21.15.50:0/1795634946 conn(0x55e41c30a080 msgr2=0x55e41c3e5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.540+0000 7f248affd700 0 client.26407 ms_handle_reset on v2:172.21.15.122:6836/1604366318 2024-06-06T03:36:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.540+0000 7f24bc39eb80 1 -- 172.21.15.50:0/1795634946 shutdown_connections 2024-06-06T03:36:26.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.540+0000 7f24bc39eb80 1 -- 172.21.15.50:0/1795634946 wait complete. 2024-06-06T03:36:26.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.540+0000 7f24bc39eb80 20 client.26407 trim_cache size 0 max 16384 2024-06-06T03:36:26.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.545+0000 7f24b1b1b700 1 -- 172.21.15.50:0/2017081739 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f24940a2d60 msgr2=0x7f24940a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:26.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.545+0000 7f24b1b1b700 1 --2- 172.21.15.50:0/2017081739 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f24940a2d60 0x7f24940a5220 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f24a0009730 tx=0x7f24a0006d20 comp rx=0 tx=0).stop 2024-06-06T03:36:26.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.545+0000 7f24b1b1b700 1 -- 172.21.15.50:0/2017081739 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24ac10a0a0 msgr2=0x7f24ac074750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:26.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.545+0000 7f24b1b1b700 1 --2- 172.21.15.50:0/2017081739 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24ac10a0a0 0x7f24ac074750 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f24a400b070 tx=0x7f24a4004cf0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.546+0000 7f24b1b1b700 1 -- 172.21.15.50:0/2017081739 shutdown_connections 2024-06-06T03:36:26.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.546+0000 7f24b1b1b700 1 --2- 172.21.15.50:0/2017081739 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f24940a2d60 0x7f24940a5220 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.546+0000 7f24b1b1b700 1 --2- 172.21.15.50:0/2017081739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24ac10de50 0x7f24ac074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.546+0000 7f24b1b1b700 1 --2- 172.21.15.50:0/2017081739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24ac1096f0 0x7f24ac07a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.546+0000 7f24b1b1b700 1 --2- 172.21.15.50:0/2017081739 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24ac10a0a0 0x7f24ac074750 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:26.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.546+0000 7f24b1b1b700 1 -- 172.21.15.50:0/2017081739 >> 172.21.15.50:0/2017081739 conn(0x7f24ac06d600 msgr2=0x7f24ac083be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:26.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.546+0000 7f24b1b1b700 1 -- 172.21.15.50:0/2017081739 shutdown_connections 2024-06-06T03:36:26.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:25.546+0000 7f24b1b1b700 1 -- 172.21.15.50:0/2017081739 wait complete. 2024-06-06T03:36:27.220 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-06-06T03:36:27.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:27 smithi050 ceph-mon[32421]: pgmap v725: 129 pgs: 129 active+clean; 10 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 32 MiB/s wr, 683 op/s 2024-06-06T03:36:27.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:27 smithi079 ceph-mon[35478]: pgmap v725: 129 pgs: 129 active+clean; 10 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 32 MiB/s wr, 683 op/s 2024-06-06T03:36:27.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:27 smithi122 ceph-mon[35759]: pgmap v725: 129 pgs: 129 active+clean; 10 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 32 MiB/s wr, 683 op/s 2024-06-06T03:36:27.928 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:36:29.503 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:29 smithi050 ceph-mon[32421]: pgmap v726: 129 pgs: 129 active+clean; 10 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 29 MiB/s wr, 598 op/s 2024-06-06T03:36:29.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:29 smithi079 ceph-mon[35478]: pgmap v726: 129 pgs: 129 active+clean; 10 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 29 MiB/s wr, 598 op/s 2024-06-06T03:36:29.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:29 smithi122 ceph-mon[35759]: pgmap v726: 129 pgs: 129 active+clean; 10 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 29 MiB/s wr, 598 op/s 2024-06-06T03:36:30.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.482+0000 7fcbca5a1700 1 -- 172.21.15.50:0/99603006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcbc4107400 msgr2=0x7fcbc41077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:30.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.482+0000 7fcbca5a1700 1 --2- 172.21.15.50:0/99603006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcbc4107400 0x7fcbc41077e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40098f0 tx=0x7fcbb4009c00 comp rx=0 tx=0).stop 2024-06-06T03:36:30.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.485+0000 7fcbca5a1700 1 -- 172.21.15.50:0/99603006 shutdown_connections 2024-06-06T03:36:30.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.485+0000 7fcbca5a1700 1 --2- 172.21.15.50:0/99603006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbc4101d50 0x7fcbc410e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.485+0000 7fcbca5a1700 1 --2- 172.21.15.50:0/99603006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcbc4107400 0x7fcbc41077e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.485+0000 7fcbca5a1700 1 --2- 172.21.15.50:0/99603006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbc4101390 0x7fcbc4101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.485+0000 7fcbca5a1700 1 -- 172.21.15.50:0/99603006 >> 172.21.15.50:0/99603006 conn(0x7fcbc4078340 msgr2=0x7fcbc4078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:30.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.489+0000 7fcbca5a1700 1 -- 172.21.15.50:0/99603006 shutdown_connections 2024-06-06T03:36:30.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.489+0000 7fcbca5a1700 1 -- 172.21.15.50:0/99603006 wait complete. 2024-06-06T03:36:30.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.490+0000 7fcbca5a1700 1 Processor -- start 2024-06-06T03:36:30.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.490+0000 7fcbca5a1700 1 -- start start 2024-06-06T03:36:30.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.491+0000 7fcbca5a1700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbc4101390 0x7fcbc4109eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:30.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.491+0000 7fcbca5a1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbc4101d50 0x7fcbc410a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:30.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.491+0000 7fcbca5a1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcbc4107400 0x7fcbc410d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:30.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.491+0000 7fcbc37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbc4101d50 0x7fcbc410a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:30.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.492+0000 7fcbc37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbc4101d50 0x7fcbc410a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54286/0 (socket says 172.21.15.50:54286) 2024-06-06T03:36:30.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.492+0000 7fcbc37fe700 1 -- 172.21.15.50:0/1898741923 learned_addr learned my addr 172.21.15.50:0/1898741923 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:30.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.492+0000 7fcbca5a1700 1 -- 172.21.15.50:0/1898741923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc406e660 con 0x7fcbc4101d50 2024-06-06T03:36:30.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.492+0000 7fcbca5a1700 1 -- 172.21.15.50:0/1898741923 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc406e4e0 con 0x7fcbc4107400 2024-06-06T03:36:30.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.492+0000 7fcbca5a1700 1 -- 172.21.15.50:0/1898741923 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc406e7e0 con 0x7fcbc4101390 2024-06-06T03:36:30.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.497+0000 7fcbc37fe700 1 -- 172.21.15.50:0/1898741923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbc4101390 msgr2=0x7fcbc4109eb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-06T03:36:30.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.497+0000 7fcbc37fe700 1 --2- 172.21.15.50:0/1898741923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbc4101390 0x7fcbc4109eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.497+0000 7fcbc37fe700 1 -- 172.21.15.50:0/1898741923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcbc4107400 msgr2=0x7fcbc410d770 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-06T03:36:30.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.497+0000 7fcbc37fe700 1 --2- 172.21.15.50:0/1898741923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcbc4107400 0x7fcbc410d770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.497+0000 7fcbc37fe700 1 -- 172.21.15.50:0/1898741923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbc410deb0 con 0x7fcbc4101d50 2024-06-06T03:36:30.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.499+0000 7fcbc37fe700 1 --2- 172.21.15.50:0/1898741923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbc4101d50 0x7fcbc410a3f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fcbb801faf0 tx=0x7fcbb801feb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:30.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.500+0000 7fcbc17fa700 1 -- 172.21.15.50:0/1898741923 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb801dad0 con 0x7fcbc4101d50 2024-06-06T03:36:30.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.500+0000 7fcbc17fa700 1 -- 172.21.15.50:0/1898741923 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcbb8004ce0 con 0x7fcbc4101d50 2024-06-06T03:36:30.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.500+0000 7fcbca5a1700 1 -- 172.21.15.50:0/1898741923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbc410e1a0 con 0x7fcbc4101d50 2024-06-06T03:36:30.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.500+0000 7fcbc17fa700 1 -- 172.21.15.50:0/1898741923 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8021440 con 0x7fcbc4101d50 2024-06-06T03:36:30.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.501+0000 7fcbca5a1700 1 -- 172.21.15.50:0/1898741923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbc419be50 con 0x7fcbc4101d50 2024-06-06T03:36:30.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.510+0000 7fcbc17fa700 1 -- 172.21.15.50:0/1898741923 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fcbb80215e0 con 0x7fcbc4101d50 2024-06-06T03:36:30.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.512+0000 7fcbc17fa700 1 --2- 172.21.15.50:0/1898741923 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcbac0a2cf0 0x7fcbac0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:30.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.512+0000 7fcbc17fa700 1 -- 172.21.15.50:0/1898741923 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fcbb80e0630 con 0x7fcbc4101d50 2024-06-06T03:36:30.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.515+0000 7fcbd4e24b80 1 Processor -- start 2024-06-06T03:36:30.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.517+0000 7fcbc3fff700 1 --2- 172.21.15.50:0/1898741923 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcbac0a2cf0 0x7fcbac0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:30.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.517+0000 7fcbd4e24b80 1 -- start start 2024-06-06T03:36:30.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.517+0000 7fcbd4e24b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560e4cc13000 0x560e4cc0f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:30.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.517+0000 7fcbd4e24b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e4cc0f7a0 0x560e4cc0fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:30.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.517+0000 7fcbd4e24b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e4cc21ec0 0x560e4cc242b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:30.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.517+0000 7fcbd4e24b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560e4cb01f60 con 0x560e4cc0f7a0 2024-06-06T03:36:30.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.517+0000 7fcbd4e24b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560e4cb60850 con 0x560e4cc21ec0 2024-06-06T03:36:30.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.517+0000 7fcbd4e24b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560e4cac8460 con 0x560e4cc13000 2024-06-06T03:36:30.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.518+0000 7fcbc3fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560e4cc13000 0x560e4cc0f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:30.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.518+0000 7fcbc3fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560e4cc13000 0x560e4cc0f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:32878/0 (socket says 172.21.15.50:32878) 2024-06-06T03:36:30.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.518+0000 7fcbc3fff700 1 -- 172.21.15.50:0/3852181259 learned_addr learned my addr 172.21.15.50:0/3852181259 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:30.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.518+0000 7fcbc8b3e700 1 --2- 172.21.15.50:0/3852181259 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e4cc21ec0 0x560e4cc242b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:30.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.518+0000 7fcbc3fff700 1 -- 172.21.15.50:0/3852181259 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e4cc21ec0 msgr2=0x560e4cc242b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:30.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.518+0000 7fcbc3fff700 1 --2- 172.21.15.50:0/3852181259 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e4cc21ec0 0x560e4cc242b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.518+0000 7fcbc3fff700 1 -- 172.21.15.50:0/3852181259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e4cc0f7a0 msgr2=0x560e4cc0fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:30.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.518+0000 7fcbc3fff700 1 --2- 172.21.15.50:0/3852181259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e4cc0f7a0 0x560e4cc0fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.518+0000 7fcbc3fff700 1 -- 172.21.15.50:0/3852181259 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e4caaf8d0 con 0x560e4cc13000 2024-06-06T03:36:30.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.518+0000 7fcbc3fff700 1 --2- 172.21.15.50:0/3852181259 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560e4cc13000 0x560e4cc0f260 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcbb400f490 tx=0x7fcbb400f4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27937ff3eb1f0e6 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:30.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.519+0000 7fcbaa7fc700 1 -- 172.21.15.50:0/3852181259 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb4020050 con 0x560e4cc13000 2024-06-06T03:36:30.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.519+0000 7fcbaa7fc700 1 -- 172.21.15.50:0/3852181259 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcbb4021040 con 0x560e4cc13000 2024-06-06T03:36:30.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.519+0000 7fcbaa7fc700 1 -- 172.21.15.50:0/3852181259 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb400b7c0 con 0x560e4cc13000 2024-06-06T03:36:30.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.519+0000 7fcbc3fff700 1 --2- 172.21.15.50:0/1898741923 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcbac0a2cf0 0x7fcbac0a51b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fcbb401b000 tx=0x7fcbb4025000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:30.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.520+0000 7fcbd4e24b80 1 -- 172.21.15.50:0/3852181259 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560e4cc13000 msgr2=0x560e4cc0f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:30.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.520+0000 7fcbd4e24b80 1 --2- 172.21.15.50:0/3852181259 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560e4cc13000 0x560e4cc0f260 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcbb400f490 tx=0x7fcbb400f4c0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.521+0000 7fcbd4e24b80 1 -- 172.21.15.50:0/3852181259 shutdown_connections 2024-06-06T03:36:30.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.521+0000 7fcbd4e24b80 1 --2- 172.21.15.50:0/3852181259 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e4cc21ec0 0x560e4cc242b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.521+0000 7fcbd4e24b80 1 --2- 172.21.15.50:0/3852181259 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560e4cc13000 0x560e4cc0f260 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.521+0000 7fcbd4e24b80 1 --2- 172.21.15.50:0/3852181259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e4cc0f7a0 0x560e4cc0fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.521+0000 7fcbd4e24b80 1 -- 172.21.15.50:0/3852181259 >> 172.21.15.50:0/3852181259 conn(0x560e4cb3c080 msgr2=0x560e4cc0a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:30.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.521+0000 7fcbd4e24b80 1 -- 172.21.15.50:0/3852181259 shutdown_connections 2024-06-06T03:36:30.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.521+0000 7fcbd4e24b80 1 -- 172.21.15.50:0/3852181259 wait complete. 2024-06-06T03:36:30.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.522+0000 7fcbd4e24b80 1 -- start start 2024-06-06T03:36:30.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.522+0000 7fcbd4e24b80 1 Processor -- start 2024-06-06T03:36:30.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.522+0000 7fcbd4e24b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e4cc0f7a0 0x560e4cc21650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:30.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.523+0000 7fcbd4e24b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e4cc13000 0x560e4cc1e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:30.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.523+0000 7fcbc3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e4cc0f7a0 0x560e4cc21650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:30.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.523+0000 7fcbc3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e4cc0f7a0 0x560e4cc21650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54306/0 (socket says 172.21.15.50:54306) 2024-06-06T03:36:30.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.523+0000 7fcbc3fff700 1 -- 172.21.15.50:0/2300226618 learned_addr learned my addr 172.21.15.50:0/2300226618 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:30.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.523+0000 7fcbd4e24b80 1 --2- 172.21.15.50:0/2300226618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560e4cc21ec0 0x560e4cc1ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:30.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.523+0000 7fcbd4e24b80 1 -- 172.21.15.50:0/2300226618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560e4cb00fc0 con 0x560e4cc0f7a0 2024-06-06T03:36:30.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.523+0000 7fcbd4e24b80 1 -- 172.21.15.50:0/2300226618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560e4cb5c810 con 0x560e4cc13000 2024-06-06T03:36:30.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.523+0000 7fcbd4e24b80 1 -- 172.21.15.50:0/2300226618 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560e4cc24a30 con 0x560e4cc21ec0 2024-06-06T03:36:30.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.523+0000 7fcbc37fe700 1 --2- 172.21.15.50:0/2300226618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e4cc13000 0x560e4cc1e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:30.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.523+0000 7fcbd4e24b80 10 client.0 _ll_register_callbacks cb 0x560e4caf65b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:36:30.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.523+0000 7fcbc8b3e700 1 --2- 172.21.15.50:0/2300226618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560e4cc21ec0 0x560e4cc1ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:30.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.525+0000 7fcbc8b3e700 1 -- 172.21.15.50:0/2300226618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e4cc13000 msgr2=0x560e4cc1e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:30.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.525+0000 7fcbc8b3e700 1 --2- 172.21.15.50:0/2300226618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e4cc13000 0x560e4cc1e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.525+0000 7fcbc8b3e700 1 -- 172.21.15.50:0/2300226618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e4cc0f7a0 msgr2=0x560e4cc21650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:30.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.525+0000 7fcbc8b3e700 1 --2- 172.21.15.50:0/2300226618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e4cc0f7a0 0x560e4cc21650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.525+0000 7fcbc8b3e700 1 -- 172.21.15.50:0/2300226618 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e4cb26750 con 0x560e4cc21ec0 2024-06-06T03:36:30.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.525+0000 7fcbc8b3e700 1 --2- 172.21.15.50:0/2300226618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560e4cc21ec0 0x560e4cc1ee90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc008a40 tx=0x7fcbbc008e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bd92b92ae132fb6 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:30.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.526+0000 7fcbc3fff700 1 --2- 172.21.15.50:0/2300226618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e4cc0f7a0 0x560e4cc21650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:36:30.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.532+0000 7fcba37fe700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:36:30.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.532+0000 7fcba37fe700 1 -- 172.21.15.50:0/2300226618 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc004bb0 con 0x560e4cc21ec0 2024-06-06T03:36:30.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.532+0000 7fcba37fe700 1 -- 172.21.15.50:0/2300226618 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fcbbc004d50 con 0x560e4cc21ec0 2024-06-06T03:36:30.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.535+0000 7fcbd4e24b80 1 -- 172.21.15.50:0/2300226618 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbb4021040 con 0x560e4cc21ec0 2024-06-06T03:36:30.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.541+0000 7fcba37fe700 1 -- 172.21.15.50:0/2300226618 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fcbbc00e890 con 0x560e4cc21ec0 2024-06-06T03:36:30.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.541+0000 7fcbd4e24b80 10 client.26413 fetch_fsmap learned FSMap version 35 2024-06-06T03:36:30.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.541+0000 7fcbd4e24b80 1 -- 172.21.15.50:0/2300226618 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x560e4cc2f080 con 0x560e4cc21ec0 2024-06-06T03:36:30.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.544+0000 7fcba37fe700 1 -- 172.21.15.50:0/2300226618 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcbb4021040 con 0x560e4cc21ec0 2024-06-06T03:36:30.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.544+0000 7fcba37fe700 1 -- 172.21.15.50:0/2300226618 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 35) ==== 8354+0+0 (secure 0 0 0) 0x7fcbbc0056d0 con 0x560e4cc21ec0 2024-06-06T03:36:30.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.544+0000 7fcbd4e24b80 10 client.26413 fetch_fsmap finished waiting for FSMap version 35 2024-06-06T03:36:30.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.544+0000 7fcbd4e24b80 10 client.26413 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:36:30.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.545+0000 7fcbd4e24b80 20 client.26413 populate_metadata read hostname 'smithi050' 2024-06-06T03:36:30.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.545+0000 7fcbd4e24b80 1 --2- 172.21.15.50:0/2300226618 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x560e4cc31710 0x560e4cc33b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:30.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.545+0000 7fcbd4e24b80 4 client.26413 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:36:30.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.545+0000 7fcbd4e24b80 1 -- 172.21.15.50:0/2300226618 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e4cb6dd50 con 0x560e4cc31710 2024-06-06T03:36:30.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.546+0000 7fcbc3fff700 1 --2- 172.21.15.50:0/2300226618 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x560e4cc31710 0x560e4cc33b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:30.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.558+0000 7fcbc3fff700 1 --2- 172.21.15.50:0/2300226618 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x560e4cc31710 0x560e4cc33b30 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63e318351509cd06 server_cookie=6666dd4d3cfc108a in_seq=0 out_seq=0 2024-06-06T03:36:30.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.559+0000 7fcba37fe700 10 client.26413 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:30.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.565+0000 7fcba37fe700 1 -- 172.21.15.50:0/2300226618 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x560e4cb6dd50 con 0x560e4cc31710 2024-06-06T03:36:30.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.565+0000 7fcba37fe700 10 client.26413 handle_command_reply: tid=0 2024-06-06T03:36:30.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.565+0000 7fcbd4e24b80 1 client.26413 shutdown 2024-06-06T03:36:30.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.565+0000 7fcbd4e24b80 1 -- 172.21.15.50:0/2300226618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560e4cc21ec0 msgr2=0x560e4cc1ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:30.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.565+0000 7fcbd4e24b80 1 --2- 172.21.15.50:0/2300226618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560e4cc21ec0 0x560e4cc1ee90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc008a40 tx=0x7fcbbc008e00 comp rx=0 tx=0).stop 2024-06-06T03:36:30.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.565+0000 7fcbd4e24b80 1 -- 172.21.15.50:0/2300226618 shutdown_connections 2024-06-06T03:36:30.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.566+0000 7fcbd4e24b80 1 --2- 172.21.15.50:0/2300226618 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x560e4cc31710 0x560e4cc33b30 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.566+0000 7fcbd4e24b80 1 --2- 172.21.15.50:0/2300226618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560e4cc21ec0 0x560e4cc1ee90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.566+0000 7fcba37fe700 0 client.26413 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:30.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.566+0000 7fcbd4e24b80 1 --2- 172.21.15.50:0/2300226618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e4cc0f7a0 0x560e4cc21650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.566+0000 7fcbd4e24b80 1 --2- 172.21.15.50:0/2300226618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e4cc13000 0x560e4cc1e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.566+0000 7fcbd4e24b80 1 -- 172.21.15.50:0/2300226618 >> 172.21.15.50:0/2300226618 conn(0x560e4cb3c080 msgr2=0x560e4cc09700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:30.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.570+0000 7fcbd4e24b80 1 -- 172.21.15.50:0/2300226618 shutdown_connections 2024-06-06T03:36:30.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.570+0000 7fcbd4e24b80 1 -- 172.21.15.50:0/2300226618 wait complete. 2024-06-06T03:36:30.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.570+0000 7fcbd4e24b80 20 client.26413 trim_cache size 0 max 16384 2024-06-06T03:36:30.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.602+0000 7fcbd4e24b80 1 Processor -- start 2024-06-06T03:36:30.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.603+0000 7fcbd4e24b80 1 -- start start 2024-06-06T03:36:30.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.603+0000 7fcbd4e24b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560e4cc0f7a0 0x560e4cc1c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:30.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.603+0000 7fcbd4e24b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e4cc13000 0x560e4cc1e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:30.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.604+0000 7fcbd4e24b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e4cc21ec0 0x560e4cc09e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:30.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.604+0000 7fcbd4e24b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb0011430 con 0x560e4cc13000 2024-06-06T03:36:30.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.604+0000 7fcbc37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e4cc13000 0x560e4cc1e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:30.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.604+0000 7fcbc37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e4cc13000 0x560e4cc1e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54310/0 (socket says 172.21.15.50:54310) 2024-06-06T03:36:30.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.604+0000 7fcbc37fe700 1 -- 172.21.15.50:0/1130101163 learned_addr learned my addr 172.21.15.50:0/1130101163 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:30.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.604+0000 7fcbd4e24b80 1 -- 172.21.15.50:0/1130101163 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb000ecc0 con 0x560e4cc21ec0 2024-06-06T03:36:30.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.604+0000 7fcbd4e24b80 1 -- 172.21.15.50:0/1130101163 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb000cb10 con 0x560e4cc0f7a0 2024-06-06T03:36:30.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.605+0000 7fcbc37fe700 1 -- 172.21.15.50:0/1130101163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560e4cc0f7a0 msgr2=0x560e4cc1c4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:36:30.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.605+0000 7fcbc37fe700 1 --2- 172.21.15.50:0/1130101163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560e4cc0f7a0 0x560e4cc1c4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.605+0000 7fcbc37fe700 1 -- 172.21.15.50:0/1130101163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e4cc21ec0 msgr2=0x560e4cc09e80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:36:30.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.605+0000 7fcbc37fe700 1 --2- 172.21.15.50:0/1130101163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e4cc21ec0 0x560e4cc09e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.605+0000 7fcbc37fe700 1 -- 172.21.15.50:0/1130101163 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e4cc34190 con 0x560e4cc13000 2024-06-06T03:36:30.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.606+0000 7fcbc37fe700 1 --2- 172.21.15.50:0/1130101163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e4cc13000 0x560e4cc1e290 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fcbb801a5d0 tx=0x7fcbb80ac540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c7282f29240167 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:30.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.606+0000 7fcba9ffb700 1 -- 172.21.15.50:0/1130101163 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb80c4020 con 0x560e4cc13000 2024-06-06T03:36:30.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.606+0000 7fcba9ffb700 1 -- 172.21.15.50:0/1130101163 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcbb80b0e60 con 0x560e4cc13000 2024-06-06T03:36:30.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.607+0000 7fcbd4e24b80 1 -- 172.21.15.50:0/1130101163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e4cc13000 msgr2=0x560e4cc1e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:30.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.607+0000 7fcbd4e24b80 1 --2- 172.21.15.50:0/1130101163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e4cc13000 0x560e4cc1e290 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fcbb801a5d0 tx=0x7fcbb80ac540 comp rx=0 tx=0).stop 2024-06-06T03:36:30.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.609+0000 7fcbd4e24b80 1 -- 172.21.15.50:0/1130101163 shutdown_connections 2024-06-06T03:36:30.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.609+0000 7fcbd4e24b80 1 --2- 172.21.15.50:0/1130101163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e4cc21ec0 0x560e4cc09e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.609+0000 7fcbd4e24b80 1 --2- 172.21.15.50:0/1130101163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560e4cc0f7a0 0x560e4cc1c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.609+0000 7fcbd4e24b80 1 --2- 172.21.15.50:0/1130101163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e4cc13000 0x560e4cc1e290 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.609+0000 7fcbd4e24b80 1 -- 172.21.15.50:0/1130101163 >> 172.21.15.50:0/1130101163 conn(0x560e4cb3c080 msgr2=0x560e4cc20a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:30.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.610+0000 7fcbd4e24b80 1 -- 172.21.15.50:0/1130101163 shutdown_connections 2024-06-06T03:36:30.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.610+0000 7fcbd4e24b80 1 -- 172.21.15.50:0/1130101163 wait complete. 2024-06-06T03:36:30.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.610+0000 7fcbd4e24b80 1 -- start start 2024-06-06T03:36:30.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.611+0000 7fcbd4e24b80 1 Processor -- start 2024-06-06T03:36:30.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.611+0000 7fcbd4e24b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560e4cc0f7a0 0x560e4cc0ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:30.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.611+0000 7fcbd4e24b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e4cc13000 0x560e4cc0d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:30.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.611+0000 7fcbd4e24b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e4cc21ec0 0x560e4cc0d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:30.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.611+0000 7fcbd4e24b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb000d180 con 0x560e4cc21ec0 2024-06-06T03:36:30.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.611+0000 7fcbd4e24b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb000e5f0 con 0x560e4cc13000 2024-06-06T03:36:30.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.611+0000 7fcbd4e24b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb000d850 con 0x560e4cc0f7a0 2024-06-06T03:36:30.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.611+0000 7fcbd4e24b80 10 client.0 _ll_register_callbacks cb 0x560e4caf65b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:36:30.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.612+0000 7fcbc8b3e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e4cc21ec0 0x560e4cc0d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:30.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.612+0000 7fcbc8b3e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e4cc21ec0 0x560e4cc0d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54318/0 (socket says 172.21.15.50:54318) 2024-06-06T03:36:30.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.612+0000 7fcbc8b3e700 1 -- 172.21.15.50:0/2393973544 learned_addr learned my addr 172.21.15.50:0/2393973544 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:30.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.612+0000 7fcbc8b3e700 1 -- 172.21.15.50:0/2393973544 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560e4cc0f7a0 msgr2=0x560e4cc0ce40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:36:30.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.612+0000 7fcbc8b3e700 1 --2- 172.21.15.50:0/2393973544 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560e4cc0f7a0 0x560e4cc0ce40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.612+0000 7fcbc8b3e700 1 -- 172.21.15.50:0/2393973544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e4cc13000 msgr2=0x560e4cc0d380 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:36:30.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.612+0000 7fcbc8b3e700 1 --2- 172.21.15.50:0/2393973544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e4cc13000 0x560e4cc0d380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.612+0000 7fcbc8b3e700 1 -- 172.21.15.50:0/2393973544 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e4cc9b3f0 con 0x560e4cc21ec0 2024-06-06T03:36:30.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.613+0000 7fcbc8b3e700 1 --2- 172.21.15.50:0/2393973544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e4cc21ec0 0x560e4cc0d8c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc008010 tx=0x7fcbbc005f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1edaa9d3d01cf495 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:30.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.616+0000 7fcba37fe700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:36:30.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.616+0000 7fcba37fe700 1 -- 172.21.15.50:0/2393973544 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc007830 con 0x560e4cc21ec0 2024-06-06T03:36:30.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.616+0000 7fcba37fe700 1 -- 172.21.15.50:0/2393973544 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fcbbc00ec40 con 0x560e4cc21ec0 2024-06-06T03:36:30.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.618+0000 7fcbd4e24b80 1 -- 172.21.15.50:0/2393973544 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbb80b0e60 con 0x560e4cc21ec0 2024-06-06T03:36:30.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.621+0000 7fcba37fe700 1 -- 172.21.15.50:0/2393973544 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fcbbc00ee80 con 0x560e4cc21ec0 2024-06-06T03:36:30.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.629+0000 7fcbd4e24b80 10 client.16695 fetch_fsmap learned FSMap version 35 2024-06-06T03:36:30.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.629+0000 7fcbd4e24b80 1 -- 172.21.15.50:0/2393973544 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x560e4cc9c6b0 con 0x560e4cc21ec0 2024-06-06T03:36:30.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.630+0000 7fcba37fe700 1 -- 172.21.15.50:0/2393973544 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcbb80b0e60 con 0x560e4cc21ec0 2024-06-06T03:36:30.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.631+0000 7fcba37fe700 1 -- 172.21.15.50:0/2393973544 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 35) ==== 8354+0+0 (secure 0 0 0) 0x7fcbbc025030 con 0x560e4cc21ec0 2024-06-06T03:36:30.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.631+0000 7fcbd4e24b80 10 client.16695 fetch_fsmap finished waiting for FSMap version 35 2024-06-06T03:36:30.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.631+0000 7fcbd4e24b80 10 client.16695 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:36:30.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.631+0000 7fcbd4e24b80 20 client.16695 populate_metadata read hostname 'smithi050' 2024-06-06T03:36:30.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.631+0000 7fcbd4e24b80 1 --2- 172.21.15.50:0/2393973544 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x560e4cc9cd60 0x560e4cc9f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:30.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.631+0000 7fcbd4e24b80 4 client.16695 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:36:30.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.631+0000 7fcbd4e24b80 1 -- 172.21.15.50:0/2393973544 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fcbb80e0420 con 0x560e4cc9cd60 2024-06-06T03:36:30.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.632+0000 7fcbc3fff700 1 --2- 172.21.15.50:0/2393973544 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x560e4cc9cd60 0x560e4cc9f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:30.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.633+0000 7fcbc3fff700 1 --2- 172.21.15.50:0/2393973544 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x560e4cc9cd60 0x560e4cc9f180 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e578e9a93488c35e server_cookie=3936229fbd5ea03c in_seq=0 out_seq=0 2024-06-06T03:36:30.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.634+0000 7fcba37fe700 10 client.16695 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:30.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.634+0000 7fcba37fe700 1 -- 172.21.15.50:0/2393973544 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fcbb80e0420 con 0x560e4cc9cd60 2024-06-06T03:36:30.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.634+0000 7fcba37fe700 10 client.16695 handle_command_reply: tid=0 2024-06-06T03:36:30.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.634+0000 7fcbd4e24b80 1 client.16695 shutdown 2024-06-06T03:36:30.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.639+0000 7fcbd4e24b80 1 -- 172.21.15.50:0/2393973544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e4cc21ec0 msgr2=0x560e4cc0d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:30.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.639+0000 7fcbd4e24b80 1 --2- 172.21.15.50:0/2393973544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e4cc21ec0 0x560e4cc0d8c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc008010 tx=0x7fcbbc005f40 comp rx=0 tx=0).stop 2024-06-06T03:36:30.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.640+0000 7fcbd4e24b80 1 -- 172.21.15.50:0/2393973544 shutdown_connections 2024-06-06T03:36:30.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.640+0000 7fcbd4e24b80 1 --2- 172.21.15.50:0/2393973544 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x560e4cc9cd60 0x560e4cc9f180 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.640+0000 7fcbd4e24b80 1 --2- 172.21.15.50:0/2393973544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e4cc21ec0 0x560e4cc0d8c0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.640+0000 7fcbd4e24b80 1 --2- 172.21.15.50:0/2393973544 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560e4cc0f7a0 0x560e4cc0ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.640+0000 7fcbd4e24b80 1 --2- 172.21.15.50:0/2393973544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e4cc13000 0x560e4cc0d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.640+0000 7fcba37fe700 0 client.16695 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:30.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.640+0000 7fcbd4e24b80 1 -- 172.21.15.50:0/2393973544 >> 172.21.15.50:0/2393973544 conn(0x560e4cb3c080 msgr2=0x560e4cc0e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:30.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.641+0000 7fcbd4e24b80 1 -- 172.21.15.50:0/2393973544 shutdown_connections 2024-06-06T03:36:30.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.642+0000 7fcbd4e24b80 1 -- 172.21.15.50:0/2393973544 wait complete. 2024-06-06T03:36:30.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.643+0000 7fcbd4e24b80 20 client.16695 trim_cache size 0 max 16384 2024-06-06T03:36:30.644 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:36:30.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.645+0000 7fcbca5a1700 1 -- 172.21.15.50:0/1898741923 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcbac0a2cf0 msgr2=0x7fcbac0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:30.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.645+0000 7fcbca5a1700 1 --2- 172.21.15.50:0/1898741923 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcbac0a2cf0 0x7fcbac0a51b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fcbb401b000 tx=0x7fcbb4025000 comp rx=0 tx=0).stop 2024-06-06T03:36:30.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.645+0000 7fcbca5a1700 1 -- 172.21.15.50:0/1898741923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbc4101d50 msgr2=0x7fcbc410a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:30.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.645+0000 7fcbca5a1700 1 --2- 172.21.15.50:0/1898741923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbc4101d50 0x7fcbc410a3f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fcbb801faf0 tx=0x7fcbb801feb0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.645+0000 7fcbca5a1700 1 -- 172.21.15.50:0/1898741923 shutdown_connections 2024-06-06T03:36:30.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.645+0000 7fcbca5a1700 1 --2- 172.21.15.50:0/1898741923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcbc4107400 0x7fcbc410d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.645+0000 7fcbca5a1700 1 --2- 172.21.15.50:0/1898741923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbc4101390 0x7fcbc4109eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.645+0000 7fcbca5a1700 1 --2- 172.21.15.50:0/1898741923 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcbac0a2cf0 0x7fcbac0a51b0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.645+0000 7fcbca5a1700 1 --2- 172.21.15.50:0/1898741923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbc4101d50 0x7fcbc410a3f0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:30.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.645+0000 7fcbca5a1700 1 -- 172.21.15.50:0/1898741923 >> 172.21.15.50:0/1898741923 conn(0x7fcbc4078340 msgr2=0x7fcbc4100220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:30.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.646+0000 7fcbca5a1700 1 -- 172.21.15.50:0/1898741923 shutdown_connections 2024-06-06T03:36:30.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:30.646+0000 7fcbca5a1700 1 -- 172.21.15.50:0/1898741923 wait complete. 2024-06-06T03:36:31.396 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:31 smithi050 ceph-mon[32421]: pgmap v727: 129 pgs: 129 active+clean; 10 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 33 MiB/s wr, 685 op/s 2024-06-06T03:36:31.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:31 smithi079 ceph-mon[35478]: pgmap v727: 129 pgs: 129 active+clean; 10 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 33 MiB/s wr, 685 op/s 2024-06-06T03:36:31.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:31 smithi122 ceph-mon[35759]: pgmap v727: 129 pgs: 129 active+clean; 10 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 33 MiB/s wr, 685 op/s 2024-06-06T03:36:32.475 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-06T03:36:32.476 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-06-06T03:36:33.142 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:36:33.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:33 smithi050 ceph-mon[32421]: pgmap v728: 129 pgs: 129 active+clean; 10 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 28 MiB/s wr, 576 op/s 2024-06-06T03:36:33.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:33 smithi079 ceph-mon[35478]: pgmap v728: 129 pgs: 129 active+clean; 10 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 28 MiB/s wr, 576 op/s 2024-06-06T03:36:33.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:33 smithi122 ceph-mon[35759]: pgmap v728: 129 pgs: 129 active+clean; 10 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 28 MiB/s wr, 576 op/s 2024-06-06T03:36:35.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:35 smithi079 ceph-mon[35478]: pgmap v729: 129 pgs: 129 active+clean; 10 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 28 MiB/s wr, 571 op/s 2024-06-06T03:36:35.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:35 smithi122 ceph-mon[35759]: pgmap v729: 129 pgs: 129 active+clean; 10 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 28 MiB/s wr, 571 op/s 2024-06-06T03:36:35.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:35 smithi050 ceph-mon[32421]: pgmap v729: 129 pgs: 129 active+clean; 10 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 28 MiB/s wr, 571 op/s 2024-06-06T03:36:37.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.335+0000 7fcba0c9e640 1 -- 172.21.15.50:0/4202690862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb9c100940 msgr2=0x7fcb9c100d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:37.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.335+0000 7fcba0c9e640 1 --2- 172.21.15.50:0/4202690862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb9c100940 0x7fcb9c100d60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c009900 tx=0x7fcb8c02a410 comp rx=0 tx=0).stop 2024-06-06T03:36:37.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.336+0000 7fcba0c9e640 1 -- 172.21.15.50:0/4202690862 shutdown_connections 2024-06-06T03:36:37.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.336+0000 7fcba0c9e640 1 --2- 172.21.15.50:0/4202690862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb9c1024f0 0x7fcb9c108d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.336+0000 7fcba0c9e640 1 --2- 172.21.15.50:0/4202690862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb9c101b30 0x7fcb9c101fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.336+0000 7fcba0c9e640 1 --2- 172.21.15.50:0/4202690862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb9c100940 0x7fcb9c100d60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.336+0000 7fcba0c9e640 1 -- 172.21.15.50:0/4202690862 >> 172.21.15.50:0/4202690862 conn(0x7fcb9c0fbeb0 msgr2=0x7fcb9c0fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.337+0000 7fcba0c9e640 1 -- 172.21.15.50:0/4202690862 shutdown_connections 2024-06-06T03:36:37.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.337+0000 7fcba0c9e640 1 -- 172.21.15.50:0/4202690862 wait complete. 2024-06-06T03:36:37.339 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.339+0000 7fcba0c9e640 1 Processor -- start 2024-06-06T03:36:37.340 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.340+0000 7fcba0c9e640 1 -- start start 2024-06-06T03:36:37.340 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.340+0000 7fcba0c9e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb9c100940 0x7fcb9c06a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:37.340 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.340+0000 7fcba0c9e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb9c101b30 0x7fcb9c19eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:37.340 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.340+0000 7fcba0c9e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb9c1024f0 0x7fcb9c1a13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:37.341 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.340+0000 7fcba0c9e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcb9c10c5b0 con 0x7fcb9c100940 2024-06-06T03:36:37.341 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.340+0000 7fcba0c9e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcb9c10c430 con 0x7fcb9c1024f0 2024-06-06T03:36:37.341 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.340+0000 7fcba0c9e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcb9c10c730 con 0x7fcb9c101b30 2024-06-06T03:36:37.341 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.341+0000 7fcb9a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb9c100940 0x7fcb9c06a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:37.341 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.341+0000 7fcb9a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb9c100940 0x7fcb9c06a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54336/0 (socket says 172.21.15.50:54336) 2024-06-06T03:36:37.341 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.341+0000 7fcb9a59c640 1 -- 172.21.15.50:0/1718777334 learned_addr learned my addr 172.21.15.50:0/1718777334 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:37.341 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.341+0000 7fcb9ad9d640 1 --2- 172.21.15.50:0/1718777334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb9c1024f0 0x7fcb9c1a13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:37.342 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.342+0000 7fcb9ad9d640 1 -- 172.21.15.50:0/1718777334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb9c101b30 msgr2=0x7fcb9c19eea0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T03:36:37.342 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.342+0000 7fcb9ad9d640 1 --2- 172.21.15.50:0/1718777334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb9c101b30 0x7fcb9c19eea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.342 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.342+0000 7fcb9ad9d640 1 -- 172.21.15.50:0/1718777334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb9c100940 msgr2=0x7fcb9c06a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:37.342 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.342+0000 7fcb9ad9d640 1 --2- 172.21.15.50:0/1718777334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb9c100940 0x7fcb9c06a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.343 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.342+0000 7fcb9ad9d640 1 -- 172.21.15.50:0/1718777334 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb9c1a1be0 con 0x7fcb9c1024f0 2024-06-06T03:36:37.343 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.342+0000 7fcb9ad9d640 1 --2- 172.21.15.50:0/1718777334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb9c1024f0 0x7fcb9c1a13f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400be20 tx=0x7fcb9400bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:37.343 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.343+0000 7fcb8b7fe640 1 -- 172.21.15.50:0/1718777334 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb94019070 con 0x7fcb9c1024f0 2024-06-06T03:36:37.345 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.343+0000 7fcba0c9e640 1 -- 172.21.15.50:0/1718777334 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb9c1a1e70 con 0x7fcb9c1024f0 2024-06-06T03:36:37.345 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.343+0000 7fcba0c9e640 1 -- 172.21.15.50:0/1718777334 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb9c1a2410 con 0x7fcb9c1024f0 2024-06-06T03:36:37.345 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.345+0000 7fcb8b7fe640 1 -- 172.21.15.50:0/1718777334 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcb940148f0 con 0x7fcb9c1024f0 2024-06-06T03:36:37.345 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.345+0000 7fcb8b7fe640 1 -- 172.21.15.50:0/1718777334 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb94012820 con 0x7fcb9c1024f0 2024-06-06T03:36:37.346 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.346+0000 7fcba39ae740 1 Processor -- start 2024-06-06T03:36:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.347+0000 7fcba39ae740 1 -- start start 2024-06-06T03:36:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.347+0000 7fcba39ae740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff0f1f820 0x562ff0f1fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.347+0000 7fcba39ae740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ff0f20210 0x562ff0f24d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.347+0000 7fcba39ae740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ff0f25380 0x562ff0f27810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.347+0000 7fcba39ae740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562ff0e7a4f0 con 0x562ff0f1f820 2024-06-06T03:36:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.347+0000 7fcba39ae740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562ff0e18870 con 0x562ff0f20210 2024-06-06T03:36:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.347+0000 7fcba39ae740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562ff0e764b0 con 0x562ff0f25380 2024-06-06T03:36:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.348+0000 7fcb9a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ff0f20210 0x562ff0f24d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.348+0000 7fcb9a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ff0f20210 0x562ff0f24d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:52536/0 (socket says 172.21.15.50:52536) 2024-06-06T03:36:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.348+0000 7fcb9a59c640 1 -- 172.21.15.50:0/3395450651 learned_addr learned my addr 172.21.15.50:0/3395450651 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:37.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.349+0000 7fcb8b7fe640 1 -- 172.21.15.50:0/1718777334 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fcb9401c070 con 0x7fcb9c1024f0 2024-06-06T03:36:37.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.350+0000 7fcb9a59c640 1 -- 172.21.15.50:0/3395450651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ff0f25380 msgr2=0x562ff0f27810 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:36:37.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.350+0000 7fcb9a59c640 1 --2- 172.21.15.50:0/3395450651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ff0f25380 0x562ff0f27810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.350+0000 7fcb99d9b640 1 --2- 172.21.15.50:0/3395450651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff0f1f820 0x562ff0f1fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:37.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.350+0000 7fcb9a59c640 1 -- 172.21.15.50:0/3395450651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff0f1f820 msgr2=0x562ff0f1fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:37.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.350+0000 7fcb9a59c640 1 --2- 172.21.15.50:0/3395450651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff0f1f820 0x562ff0f1fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.350+0000 7fcb9a59c640 1 -- 172.21.15.50:0/3395450651 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ff0e349b0 con 0x562ff0f20210 2024-06-06T03:36:37.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.350+0000 7fcb99d9b640 1 --2- 172.21.15.50:0/3395450651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff0f1f820 0x562ff0f1fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:36:37.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.351+0000 7fcb8b7fe640 1 --2- 172.21.15.50:0/1718777334 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcb840a2e80 0x7fcb840a5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:37.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.351+0000 7fcb8b7fe640 1 -- 172.21.15.50:0/1718777334 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fcb940cea70 con 0x7fcb9c1024f0 2024-06-06T03:36:37.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.354+0000 7fcb99d9b640 1 --2- 172.21.15.50:0/1718777334 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcb840a2e80 0x7fcb840a5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:37.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.356+0000 7fcb9a59c640 1 --2- 172.21.15.50:0/3395450651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ff0f20210 0x562ff0f24d10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c004310 tx=0x7fcb8c004340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d37a69cc4589a407 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:37.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.358+0000 7fcb88ff9640 1 -- 172.21.15.50:0/3395450651 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c035030 con 0x562ff0f20210 2024-06-06T03:36:37.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.358+0000 7fcb88ff9640 1 -- 172.21.15.50:0/3395450651 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcb8c003ca0 con 0x562ff0f20210 2024-06-06T03:36:37.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.358+0000 7fcb88ff9640 1 -- 172.21.15.50:0/3395450651 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c031de0 con 0x562ff0f20210 2024-06-06T03:36:37.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.359+0000 7fcba39ae740 1 -- 172.21.15.50:0/3395450651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ff0f20210 msgr2=0x562ff0f24d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:37.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.360+0000 7fcba39ae740 1 --2- 172.21.15.50:0/3395450651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ff0f20210 0x562ff0f24d10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c004310 tx=0x7fcb8c004340 comp rx=0 tx=0).stop 2024-06-06T03:36:37.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.360+0000 7fcba39ae740 1 -- 172.21.15.50:0/3395450651 shutdown_connections 2024-06-06T03:36:37.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.360+0000 7fcba39ae740 1 --2- 172.21.15.50:0/3395450651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ff0f25380 0x562ff0f27810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.360+0000 7fcba39ae740 1 --2- 172.21.15.50:0/3395450651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ff0f20210 0x562ff0f24d10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.360+0000 7fcba39ae740 1 --2- 172.21.15.50:0/3395450651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff0f1f820 0x562ff0f1fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.360+0000 7fcba39ae740 1 -- 172.21.15.50:0/3395450651 >> 172.21.15.50:0/3395450651 conn(0x562ff0f12680 msgr2=0x562ff0f12a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:37.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.366+0000 7fcb99d9b640 1 --2- 172.21.15.50:0/1718777334 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcb840a2e80 0x7fcb840a5340 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x562ff0f20a70 tx=0x7fcb90008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:37.376 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.376+0000 7fcba39ae740 1 -- 172.21.15.50:0/3395450651 shutdown_connections 2024-06-06T03:36:37.376 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.376+0000 7fcba39ae740 1 -- 172.21.15.50:0/3395450651 wait complete. 2024-06-06T03:36:37.377 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.377+0000 7fcba39ae740 1 -- start start 2024-06-06T03:36:37.377 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.377+0000 7fcba39ae740 1 Processor -- start 2024-06-06T03:36:37.379 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.378+0000 7fcba39ae740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ff0f1f820 0x562ff0f29ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:37.379 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.378+0000 7fcba39ae740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ff0f20210 0x562ff0f2a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:37.379 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.378+0000 7fcba39ae740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff0f25380 0x562ff0f31040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:37.379 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.378+0000 7fcba39ae740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562ff0f282d0 con 0x562ff0f25380 2024-06-06T03:36:37.379 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.378+0000 7fcba39ae740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562ff0e03ae0 con 0x562ff0f1f820 2024-06-06T03:36:37.379 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.378+0000 7fcba39ae740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562ff0f28450 con 0x562ff0f20210 2024-06-06T03:36:37.379 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.378+0000 7fcba39ae740 10 client.0 _ll_register_callbacks cb 0x562ff0e3c9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:36:37.379 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.379+0000 7fcb9a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ff0f1f820 0x562ff0f29ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:37.379 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.379+0000 7fcb9a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ff0f1f820 0x562ff0f29ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:52544/0 (socket says 172.21.15.50:52544) 2024-06-06T03:36:37.379 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.379+0000 7fcb9a59c640 1 -- 172.21.15.50:0/1888442050 learned_addr learned my addr 172.21.15.50:0/1888442050 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:37.379 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.379+0000 7fcb9ad9d640 1 --2- 172.21.15.50:0/1888442050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff0f25380 0x562ff0f31040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:37.379 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.379+0000 7fcb99d9b640 1 --2- 172.21.15.50:0/1888442050 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ff0f20210 0x562ff0f2a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:37.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.379+0000 7fcb9ad9d640 1 -- 172.21.15.50:0/1888442050 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ff0f20210 msgr2=0x562ff0f2a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:37.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.379+0000 7fcb9ad9d640 1 --2- 172.21.15.50:0/1888442050 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ff0f20210 0x562ff0f2a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.379+0000 7fcb9ad9d640 1 -- 172.21.15.50:0/1888442050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ff0f1f820 msgr2=0x562ff0f29ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:37.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.379+0000 7fcb9ad9d640 1 --2- 172.21.15.50:0/1888442050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ff0f1f820 0x562ff0f29ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.379+0000 7fcb9ad9d640 1 -- 172.21.15.50:0/1888442050 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ff0b8e210 con 0x562ff0f25380 2024-06-06T03:36:37.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.379+0000 7fcb9a59c640 1 --2- 172.21.15.50:0/1888442050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ff0f1f820 0x562ff0f29ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:36:37.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.380+0000 7fcb99d9b640 1 --2- 172.21.15.50:0/1888442050 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ff0f20210 0x562ff0f2a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:36:37.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.380+0000 7fcb9ad9d640 1 --2- 172.21.15.50:0/1888442050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff0f25380 0x562ff0f31040 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fcb9409abf0 tx=0x7fcb9409b5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf9e3245f790e14 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:37.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.380+0000 7fcb81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:36:37.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.380+0000 7fcb81ffb640 1 -- 172.21.15.50:0/1888442050 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb940a38d0 con 0x562ff0f25380 2024-06-06T03:36:37.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.380+0000 7fcba39ae740 1 -- 172.21.15.50:0/1888442050 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb8c003ca0 con 0x562ff0f25380 2024-06-06T03:36:37.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.380+0000 7fcb81ffb640 1 -- 172.21.15.50:0/1888442050 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fcb94014440 con 0x562ff0f25380 2024-06-06T03:36:37.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.380+0000 7fcb81ffb640 1 -- 172.21.15.50:0/1888442050 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fcb9409f2a0 con 0x562ff0f25380 2024-06-06T03:36:37.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.380+0000 7fcba39ae740 10 client.16701 fetch_fsmap learned FSMap version 35 2024-06-06T03:36:37.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.380+0000 7fcba39ae740 1 -- 172.21.15.50:0/1888442050 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562ff0c5a620 con 0x562ff0f25380 2024-06-06T03:36:37.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.381+0000 7fcb81ffb640 1 -- 172.21.15.50:0/1888442050 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcb8c003ca0 con 0x562ff0f25380 2024-06-06T03:36:37.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.381+0000 7fcb81ffb640 1 -- 172.21.15.50:0/1888442050 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 35) ==== 8354+0+0 (secure 0 0 0) 0x7fcb94096c40 con 0x562ff0f25380 2024-06-06T03:36:37.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.381+0000 7fcba39ae740 10 client.16701 fetch_fsmap finished waiting for FSMap version 35 2024-06-06T03:36:37.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.381+0000 7fcba39ae740 10 client.16701 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:36:37.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.381+0000 7fcba39ae740 20 client.16701 populate_metadata read hostname 'smithi050' 2024-06-06T03:36:37.383 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.381+0000 7fcba39ae740 1 --2- 172.21.15.50:0/1888442050 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562ff0f46e60 0x562ff0f492c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:37.383 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.381+0000 7fcba39ae740 4 client.16701 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:36:37.383 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.381+0000 7fcba39ae740 1 -- 172.21.15.50:0/1888442050 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ff0e8df10 con 0x562ff0f46e60 2024-06-06T03:36:37.383 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.381+0000 7fcb9a59c640 1 --2- 172.21.15.50:0/1888442050 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562ff0f46e60 0x562ff0f492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:37.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.382+0000 7fcb81ffb640 10 client.16701 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:37.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.382+0000 7fcb9a59c640 1 --2- 172.21.15.50:0/1888442050 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562ff0f46e60 0x562ff0f492c0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba2583f501614ff3 server_cookie=ea7939124f4277d9 in_seq=0 out_seq=0 2024-06-06T03:36:37.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.383+0000 7fcb81ffb640 1 -- 172.21.15.50:0/1888442050 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x562ff0e8df10 con 0x562ff0f46e60 2024-06-06T03:36:37.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.383+0000 7fcb81ffb640 10 client.16701 handle_command_reply: tid=0 2024-06-06T03:36:37.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.383+0000 7fcba39ae740 1 client.16701 shutdown 2024-06-06T03:36:37.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.383+0000 7fcba39ae740 1 -- 172.21.15.50:0/1888442050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff0f25380 msgr2=0x562ff0f31040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:37.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.383+0000 7fcba39ae740 1 --2- 172.21.15.50:0/1888442050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff0f25380 0x562ff0f31040 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fcb9409abf0 tx=0x7fcb9409b5f0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.383+0000 7fcba39ae740 1 -- 172.21.15.50:0/1888442050 shutdown_connections 2024-06-06T03:36:37.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.383+0000 7fcba39ae740 1 --2- 172.21.15.50:0/1888442050 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562ff0f46e60 0x562ff0f492c0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.383+0000 7fcba39ae740 1 --2- 172.21.15.50:0/1888442050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff0f25380 0x562ff0f31040 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.385 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.383+0000 7fcba39ae740 1 --2- 172.21.15.50:0/1888442050 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ff0f20210 0x562ff0f2a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.385 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.383+0000 7fcba39ae740 1 --2- 172.21.15.50:0/1888442050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ff0f1f820 0x562ff0f29ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.385 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.383+0000 7fcba39ae740 1 -- 172.21.15.50:0/1888442050 >> 172.21.15.50:0/1888442050 conn(0x562ff0f12680 msgr2=0x562ff0f117e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:37.385 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.383+0000 7fcb81ffb640 0 client.16701 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:37.385 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.383+0000 7fcba39ae740 1 -- 172.21.15.50:0/1888442050 shutdown_connections 2024-06-06T03:36:37.385 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.383+0000 7fcba39ae740 1 -- 172.21.15.50:0/1888442050 wait complete. 2024-06-06T03:36:37.385 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.383+0000 7fcba39ae740 20 client.16701 trim_cache size 0 max 16384 2024-06-06T03:36:37.413 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.412+0000 7fcba39ae740 1 Processor -- start 2024-06-06T03:36:37.413 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.412+0000 7fcba39ae740 1 -- start start 2024-06-06T03:36:37.413 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.412+0000 7fcba39ae740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ff0f1f820 0x562ff0f28d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:37.413 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.412+0000 7fcba39ae740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff0f20210 0x562ff0f31000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.412+0000 7fcba39ae740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ff0f25380 0x562ff0f292d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.412+0000 7fcba39ae740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c012310 con 0x562ff0f20210 2024-06-06T03:36:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.412+0000 7fcba39ae740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c00fbe0 con 0x562ff0f25380 2024-06-06T03:36:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.412+0000 7fcba39ae740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c00da30 con 0x562ff0f1f820 2024-06-06T03:36:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.412+0000 7fcb99d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff0f20210 0x562ff0f31000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.412+0000 7fcb99d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff0f20210 0x562ff0f31000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54346/0 (socket says 172.21.15.50:54346) 2024-06-06T03:36:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.412+0000 7fcb99d9b640 1 -- 172.21.15.50:0/221764449 learned_addr learned my addr 172.21.15.50:0/221764449 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.412+0000 7fcb9a59c640 1 --2- 172.21.15.50:0/221764449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ff0f1f820 0x562ff0f28d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.412+0000 7fcb9ad9d640 1 --2- 172.21.15.50:0/221764449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ff0f25380 0x562ff0f292d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.413+0000 7fcb99d9b640 1 -- 172.21.15.50:0/221764449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ff0f1f820 msgr2=0x562ff0f28d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.413+0000 7fcb99d9b640 1 --2- 172.21.15.50:0/221764449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ff0f1f820 0x562ff0f28d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.413+0000 7fcb99d9b640 1 -- 172.21.15.50:0/221764449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ff0f25380 msgr2=0x562ff0f292d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:37.415 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.413+0000 7fcb99d9b640 1 --2- 172.21.15.50:0/221764449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ff0f25380 0x562ff0f292d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.415 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.413+0000 7fcb99d9b640 1 -- 172.21.15.50:0/221764449 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ff0f124b0 con 0x562ff0f20210 2024-06-06T03:36:37.415 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.413+0000 7fcb99d9b640 1 --2- 172.21.15.50:0/221764449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff0f20210 0x562ff0f31000 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000ca00 tx=0x7fcb90012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2cc4b5a399fdc41 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:37.415 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.413+0000 7fcb83fff640 1 -- 172.21.15.50:0/221764449 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb90013bb0 con 0x562ff0f20210 2024-06-06T03:36:37.415 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.413+0000 7fcb83fff640 1 -- 172.21.15.50:0/221764449 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcb90024070 con 0x562ff0f20210 2024-06-06T03:36:37.415 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.413+0000 7fcb83fff640 1 -- 172.21.15.50:0/221764449 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb90011630 con 0x562ff0f20210 2024-06-06T03:36:37.418 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.414+0000 7fcba39ae740 1 -- 172.21.15.50:0/221764449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff0f20210 msgr2=0x562ff0f31000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:37.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.414+0000 7fcba39ae740 1 --2- 172.21.15.50:0/221764449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff0f20210 0x562ff0f31000 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000ca00 tx=0x7fcb90012000 comp rx=0 tx=0).stop 2024-06-06T03:36:37.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.414+0000 7fcba39ae740 1 -- 172.21.15.50:0/221764449 shutdown_connections 2024-06-06T03:36:37.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.414+0000 7fcba39ae740 1 --2- 172.21.15.50:0/221764449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff0f20210 0x562ff0f31000 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.414+0000 7fcba39ae740 1 --2- 172.21.15.50:0/221764449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ff0f25380 0x562ff0f292d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.414+0000 7fcba39ae740 1 --2- 172.21.15.50:0/221764449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ff0f1f820 0x562ff0f28d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.414+0000 7fcba39ae740 1 -- 172.21.15.50:0/221764449 >> 172.21.15.50:0/221764449 conn(0x562ff0f12680 msgr2=0x562ff0f21430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:37.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.414+0000 7fcba39ae740 1 -- 172.21.15.50:0/221764449 shutdown_connections 2024-06-06T03:36:37.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.414+0000 7fcba39ae740 1 -- 172.21.15.50:0/221764449 wait complete. 2024-06-06T03:36:37.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.415+0000 7fcba39ae740 1 -- start start 2024-06-06T03:36:37.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.415+0000 7fcba39ae740 1 Processor -- start 2024-06-06T03:36:37.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.415+0000 7fcba39ae740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ff0f1f820 0x562ff0f2dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:37.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.415+0000 7fcba39ae740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff0f20210 0x562ff0f2dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:37.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.415+0000 7fcba39ae740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ff0f25380 0x562ff0fafb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:37.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.415+0000 7fcba39ae740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c00e0a0 con 0x562ff0f20210 2024-06-06T03:36:37.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.415+0000 7fcba39ae740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c00f510 con 0x562ff0f1f820 2024-06-06T03:36:37.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.415+0000 7fcba39ae740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c00e770 con 0x562ff0f25380 2024-06-06T03:36:37.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.415+0000 7fcba39ae740 10 client.0 _ll_register_callbacks cb 0x7fcb94096a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:36:37.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.415+0000 7fcb9a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ff0f1f820 0x562ff0f2dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:37.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.415+0000 7fcb99d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff0f20210 0x562ff0f2dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:37.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.415+0000 7fcb9a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ff0f1f820 0x562ff0f2dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:52564/0 (socket says 172.21.15.50:52564) 2024-06-06T03:36:37.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.415+0000 7fcb99d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff0f20210 0x562ff0f2dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54356/0 (socket says 172.21.15.50:54356) 2024-06-06T03:36:37.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.415+0000 7fcb9a59c640 1 -- 172.21.15.50:0/820329731 learned_addr learned my addr 172.21.15.50:0/820329731 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:37.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.415+0000 7fcb9ad9d640 1 --2- 172.21.15.50:0/820329731 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ff0f25380 0x562ff0fafb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:37.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.416+0000 7fcb9a59c640 1 -- 172.21.15.50:0/820329731 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ff0f25380 msgr2=0x562ff0fafb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:37.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.416+0000 7fcb9a59c640 1 --2- 172.21.15.50:0/820329731 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ff0f25380 0x562ff0fafb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.416+0000 7fcb9a59c640 1 -- 172.21.15.50:0/820329731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff0f20210 msgr2=0x562ff0f2dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:37.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.416+0000 7fcb9a59c640 1 --2- 172.21.15.50:0/820329731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff0f20210 0x562ff0f2dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.421 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.416+0000 7fcb9a59c640 1 -- 172.21.15.50:0/820329731 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ff0f310c0 con 0x562ff0f1f820 2024-06-06T03:36:37.421 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.416+0000 7fcb9ad9d640 1 --2- 172.21.15.50:0/820329731 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ff0f25380 0x562ff0fafb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:36:37.421 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.416+0000 7fcb99d9b640 1 --2- 172.21.15.50:0/820329731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff0f20210 0x562ff0f2dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:36:37.421 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.416+0000 7fcb9a59c640 1 --2- 172.21.15.50:0/820329731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ff0f1f820 0x562ff0f2dab0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c0043b0 tx=0x7fcb8c005be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=146b6cb95fb0b0b8 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:37.421 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.416+0000 7fcb81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:36:37.421 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.416+0000 7fcb81ffb640 1 -- 172.21.15.50:0/820329731 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c035040 con 0x562ff0f1f820 2024-06-06T03:36:37.421 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.416+0000 7fcba39ae740 1 -- 172.21.15.50:0/820329731 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb90024070 con 0x562ff0f1f820 2024-06-06T03:36:37.421 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.416+0000 7fcb81ffb640 1 -- 172.21.15.50:0/820329731 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fcb8c005550 con 0x562ff0f1f820 2024-06-06T03:36:37.421 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.416+0000 7fcb81ffb640 1 -- 172.21.15.50:0/820329731 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fcb8c060050 con 0x562ff0f1f820 2024-06-06T03:36:37.421 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.416+0000 7fcba39ae740 10 client.26399 fetch_fsmap learned FSMap version 35 2024-06-06T03:36:37.421 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.416+0000 7fcba39ae740 1 -- 172.21.15.50:0/820329731 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562ff0fb0f90 con 0x562ff0f1f820 2024-06-06T03:36:37.421 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.416+0000 7fcb81ffb640 1 -- 172.21.15.50:0/820329731 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcb90024070 con 0x562ff0f1f820 2024-06-06T03:36:37.422 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.417+0000 7fcb81ffb640 1 -- 172.21.15.50:0/820329731 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 35) ==== 8354+0+0 (secure 0 0 0) 0x7fcb8c004b70 con 0x562ff0f1f820 2024-06-06T03:36:37.422 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.417+0000 7fcba39ae740 10 client.26399 fetch_fsmap finished waiting for FSMap version 35 2024-06-06T03:36:37.422 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.417+0000 7fcba39ae740 10 client.26399 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:36:37.422 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.417+0000 7fcba39ae740 20 client.26399 populate_metadata read hostname 'smithi050' 2024-06-06T03:36:37.422 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.417+0000 7fcba39ae740 1 --2- 172.21.15.50:0/820329731 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562ff0fb1560 0x562ff0fb3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:37.422 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.417+0000 7fcba39ae740 4 client.26399 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:36:37.422 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.417+0000 7fcba39ae740 1 -- 172.21.15.50:0/820329731 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562ff0e87c20 con 0x562ff0fb1560 2024-06-06T03:36:37.422 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.417+0000 7fcb99d9b640 1 --2- 172.21.15.50:0/820329731 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562ff0fb1560 0x562ff0fb3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:37.422 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.417+0000 7fcb81ffb640 10 client.26399 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:37.422 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.417+0000 7fcb99d9b640 1 --2- 172.21.15.50:0/820329731 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562ff0fb1560 0x562ff0fb3950 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f942cc53bbe1de19 server_cookie=4150fadf51cd823 in_seq=0 out_seq=0 2024-06-06T03:36:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.420+0000 7fcb81ffb640 1 -- 172.21.15.50:0/820329731 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x562ff0e87c20 con 0x562ff0fb1560 2024-06-06T03:36:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.420+0000 7fcb81ffb640 10 client.26399 handle_command_reply: tid=0 2024-06-06T03:36:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.420+0000 7fcba39ae740 1 client.26399 shutdown 2024-06-06T03:36:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.421+0000 7fcba39ae740 1 -- 172.21.15.50:0/820329731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ff0f1f820 msgr2=0x562ff0f2dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.421+0000 7fcba39ae740 1 --2- 172.21.15.50:0/820329731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ff0f1f820 0x562ff0f2dab0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c0043b0 tx=0x7fcb8c005be0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.421+0000 7fcba39ae740 1 -- 172.21.15.50:0/820329731 shutdown_connections 2024-06-06T03:36:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.421+0000 7fcba39ae740 1 --2- 172.21.15.50:0/820329731 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x562ff0fb1560 0x562ff0fb3950 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.421+0000 7fcba39ae740 1 --2- 172.21.15.50:0/820329731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff0f20210 0x562ff0f2dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.421+0000 7fcba39ae740 1 --2- 172.21.15.50:0/820329731 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ff0f25380 0x562ff0fafb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.421+0000 7fcb81ffb640 0 client.26399 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.421+0000 7fcba39ae740 1 --2- 172.21.15.50:0/820329731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ff0f1f820 0x562ff0f2dab0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.421+0000 7fcba39ae740 1 -- 172.21.15.50:0/820329731 >> 172.21.15.50:0/820329731 conn(0x562ff0f12680 msgr2=0x562ff0f21430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.421+0000 7fcba39ae740 1 -- 172.21.15.50:0/820329731 shutdown_connections 2024-06-06T03:36:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.421+0000 7fcba39ae740 1 -- 172.21.15.50:0/820329731 wait complete. 2024-06-06T03:36:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.421+0000 7fcba39ae740 20 client.26399 trim_cache size 0 max 16384 2024-06-06T03:36:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:36:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:36:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:36:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.422+0000 7fcba0c9e640 1 -- 172.21.15.50:0/1718777334 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcb840a2e80 msgr2=0x7fcb840a5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.422+0000 7fcba0c9e640 1 --2- 172.21.15.50:0/1718777334 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcb840a2e80 0x7fcb840a5340 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x562ff0f20a70 tx=0x7fcb90008040 comp rx=0 tx=0).stop 2024-06-06T03:36:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.422+0000 7fcba0c9e640 1 -- 172.21.15.50:0/1718777334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb9c1024f0 msgr2=0x7fcb9c1a13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.422+0000 7fcba0c9e640 1 --2- 172.21.15.50:0/1718777334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb9c1024f0 0x7fcb9c1a13f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400be20 tx=0x7fcb9400bf10 comp rx=0 tx=0).stop 2024-06-06T03:36:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.422+0000 7fcba0c9e640 1 -- 172.21.15.50:0/1718777334 shutdown_connections 2024-06-06T03:36:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.422+0000 7fcba0c9e640 1 --2- 172.21.15.50:0/1718777334 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fcb840a2e80 0x7fcb840a5340 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.422+0000 7fcba0c9e640 1 --2- 172.21.15.50:0/1718777334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb9c1024f0 0x7fcb9c1a13f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.422+0000 7fcba0c9e640 1 --2- 172.21.15.50:0/1718777334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb9c101b30 0x7fcb9c19eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.422+0000 7fcba0c9e640 1 --2- 172.21.15.50:0/1718777334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb9c100940 0x7fcb9c06a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.422+0000 7fcba0c9e640 1 -- 172.21.15.50:0/1718777334 >> 172.21.15.50:0/1718777334 conn(0x7fcb9c0fbeb0 msgr2=0x7fcb9c104e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.422+0000 7fcba0c9e640 1 -- 172.21.15.50:0/1718777334 shutdown_connections 2024-06-06T03:36:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:37.422+0000 7fcba0c9e640 1 -- 172.21.15.50:0/1718777334 wait complete. 2024-06-06T03:36:37.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:37 smithi079 ceph-mon[35478]: pgmap v730: 129 pgs: 129 active+clean; 10 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 32 MiB/s wr, 657 op/s 2024-06-06T03:36:37.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:37 smithi122 ceph-mon[35759]: pgmap v730: 129 pgs: 129 active+clean; 10 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 32 MiB/s wr, 657 op/s 2024-06-06T03:36:37.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:37 smithi050 ceph-mon[32421]: pgmap v730: 129 pgs: 129 active+clean; 10 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 32 MiB/s wr, 657 op/s 2024-06-06T03:36:38.503 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:38 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:36:38.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:38 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:36:38.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:38 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:36:39.280 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:39 smithi050 ceph-mon[32421]: pgmap v731: 129 pgs: 129 active+clean; 10 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 28 MiB/s wr, 567 op/s 2024-06-06T03:36:39.280 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:39 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:36:39.281 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:39 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:36:39.281 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:39 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:36:39.281 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:39 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:36:39.281 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:39 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:36:39.281 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:39 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:36:39.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:39 smithi079 ceph-mon[35478]: pgmap v731: 129 pgs: 129 active+clean; 10 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 28 MiB/s wr, 567 op/s 2024-06-06T03:36:39.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:39 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:36:39.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:39 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:36:39.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:39 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:36:39.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:39 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:36:39.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:39 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:36:39.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:39 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:36:39.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:39 smithi122 ceph-mon[35759]: pgmap v731: 129 pgs: 129 active+clean; 10 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 28 MiB/s wr, 567 op/s 2024-06-06T03:36:39.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:39 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:36:39.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:39 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:36:39.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:39 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:36:39.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:39 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:36:39.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:39 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:36:39.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:39 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:36:40.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.954+0000 7f4d8fe8c700 1 -- 172.21.15.50:0/2749645142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d8810d100 msgr2=0x7f4d8810d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:40.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.954+0000 7f4d8fe8c700 1 --2- 172.21.15.50:0/2749645142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d8810d100 0x7f4d8810d4e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4d84009920 tx=0x7f4d84009c30 comp rx=0 tx=0).stop 2024-06-06T03:36:40.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.957+0000 7f4d8fe8c700 1 -- 172.21.15.50:0/2749645142 shutdown_connections 2024-06-06T03:36:40.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.957+0000 7f4d8fe8c700 1 --2- 172.21.15.50:0/2749645142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d881121e0 0x7f4d88119db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.958+0000 7f4d8fe8c700 1 --2- 172.21.15.50:0/2749645142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d8810d100 0x7f4d8810d4e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.958+0000 7f4d8fe8c700 1 --2- 172.21.15.50:0/2749645142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d8810dab0 0x7f4d88111b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.958+0000 7f4d8fe8c700 1 -- 172.21.15.50:0/2749645142 >> 172.21.15.50:0/2749645142 conn(0x7f4d8806d6b0 msgr2=0x7f4d8810b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:40.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.961+0000 7f4d8fe8c700 1 -- 172.21.15.50:0/2749645142 shutdown_connections 2024-06-06T03:36:40.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.961+0000 7f4d8fe8c700 1 -- 172.21.15.50:0/2749645142 wait complete. 2024-06-06T03:36:40.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.968+0000 7f4d8fe8c700 1 Processor -- start 2024-06-06T03:36:40.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.973+0000 7f4d8fe8c700 1 -- start start 2024-06-06T03:36:40.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.973+0000 7f4d8fe8c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d8810d100 0x7f4d88123320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:40.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.973+0000 7f4d8fe8c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d8810dab0 0x7f4d881191a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:40.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.973+0000 7f4d8fe8c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d881121e0 0x7f4d881196e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:40.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.973+0000 7f4d8fe8c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8806fb00 con 0x7f4d8810d100 2024-06-06T03:36:40.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.973+0000 7f4d8fe8c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8806f980 con 0x7f4d881121e0 2024-06-06T03:36:40.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.973+0000 7f4d8fe8c700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8806fc80 con 0x7f4d8810dab0 2024-06-06T03:36:40.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.974+0000 7f4d8dc28700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d8810d100 0x7f4d88123320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:40.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.974+0000 7f4d8dc28700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d8810d100 0x7f4d88123320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60056/0 (socket says 172.21.15.50:60056) 2024-06-06T03:36:40.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.975+0000 7f4d8dc28700 1 -- 172.21.15.50:0/4003861678 learned_addr learned my addr 172.21.15.50:0/4003861678 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:40.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.975+0000 7f4d8dc28700 1 -- 172.21.15.50:0/4003861678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d8810dab0 msgr2=0x7f4d881191a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-06T03:36:40.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.975+0000 7f4d8dc28700 1 --2- 172.21.15.50:0/4003861678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d8810dab0 0x7f4d881191a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.975+0000 7f4d8dc28700 1 -- 172.21.15.50:0/4003861678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d881121e0 msgr2=0x7f4d881196e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T03:36:40.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.975+0000 7f4d8dc28700 1 --2- 172.21.15.50:0/4003861678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d881121e0 0x7f4d881196e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.975+0000 7f4d8dc28700 1 -- 172.21.15.50:0/4003861678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d88119ca0 con 0x7f4d8810d100 2024-06-06T03:36:40.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.975+0000 7f4d8dc28700 1 --2- 172.21.15.50:0/4003861678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d8810d100 0x7f4d88123320 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f4d84009840 tx=0x7f4d84005690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:40.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.977+0000 7f4d7effd700 1 -- 172.21.15.50:0/4003861678 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8400b970 con 0x7f4d8810d100 2024-06-06T03:36:40.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.977+0000 7f4d7effd700 1 -- 172.21.15.50:0/4003861678 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4d8400bb10 con 0x7f4d8810d100 2024-06-06T03:36:40.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.977+0000 7f4d7effd700 1 -- 172.21.15.50:0/4003861678 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d84021980 con 0x7f4d8810d100 2024-06-06T03:36:40.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.977+0000 7f4d8fe8c700 1 -- 172.21.15.50:0/4003861678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d88119f30 con 0x7f4d8810d100 2024-06-06T03:36:40.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.978+0000 7f4d8fe8c700 1 -- 172.21.15.50:0/4003861678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d8811f030 con 0x7f4d8810d100 2024-06-06T03:36:40.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.985+0000 7f4d9a70fb80 1 Processor -- start 2024-06-06T03:36:40.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.986+0000 7f4d9a70fb80 1 -- start start 2024-06-06T03:36:40.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.986+0000 7f4d9a70fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d04f1e6c0 0x555d04f1eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:40.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.986+0000 7f4d9a70fb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d04f1efe0 0x555d04f18a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:40.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.986+0000 7f4d9a70fb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d04f18fa0 0x555d04f193c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:40.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.986+0000 7f4d9a70fb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555d04e6a890 con 0x555d04f18fa0 2024-06-06T03:36:40.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.986+0000 7f4d9a70fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555d04e127a0 con 0x555d04f1e6c0 2024-06-06T03:36:40.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.986+0000 7f4d9a70fb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555d04e66850 con 0x555d04f1efe0 2024-06-06T03:36:40.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.989+0000 7f4d8e429700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d04f1e6c0 0x555d04f1eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:40.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.989+0000 7f4d8e429700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d04f1e6c0 0x555d04f1eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:44234/0 (socket says 172.21.15.50:44234) 2024-06-06T03:36:40.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.989+0000 7f4d8e429700 1 -- 172.21.15.50:0/1440546758 learned_addr learned my addr 172.21.15.50:0/1440546758 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:40.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.991+0000 7f4d8d427700 1 --2- 172.21.15.50:0/1440546758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d04f18fa0 0x555d04f193c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:40.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.995+0000 7f4d8e429700 1 -- 172.21.15.50:0/1440546758 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d04f1efe0 msgr2=0x555d04f18a60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:36:40.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.995+0000 7f4d8e429700 1 --2- 172.21.15.50:0/1440546758 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d04f1efe0 0x555d04f18a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.995+0000 7f4d8e429700 1 -- 172.21.15.50:0/1440546758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d04f18fa0 msgr2=0x555d04f193c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:40.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.995+0000 7f4d8e429700 1 --2- 172.21.15.50:0/1440546758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d04f18fa0 0x555d04f193c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.995+0000 7f4d8e429700 1 -- 172.21.15.50:0/1440546758 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d04e08fd0 con 0x555d04f1e6c0 2024-06-06T03:36:40.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.995+0000 7f4d8e429700 1 --2- 172.21.15.50:0/1440546758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d04f1e6c0 0x555d04f1eaa0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4d8000e4c0 tx=0x7f4d800099e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c5c376763046659 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:40.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.997+0000 7f4d7effd700 1 -- 172.21.15.50:0/4003861678 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4d84003c50 con 0x7f4d8810d100 2024-06-06T03:36:40.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.998+0000 7f4d73fff700 1 -- 172.21.15.50:0/1440546758 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d80018020 con 0x555d04f1e6c0 2024-06-06T03:36:40.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.998+0000 7f4d73fff700 1 -- 172.21.15.50:0/1440546758 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4d80004db0 con 0x555d04f1e6c0 2024-06-06T03:36:40.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.998+0000 7f4d7effd700 1 --2- 172.21.15.50:0/4003861678 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4d740a2e20 0x7f4d740a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:40.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.998+0000 7f4d7effd700 1 -- 172.21.15.50:0/4003861678 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f4d840d0dc0 con 0x7f4d8810d100 2024-06-06T03:36:40.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.999+0000 7f4d9a70fb80 1 -- 172.21.15.50:0/1440546758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d04f1e6c0 msgr2=0x555d04f1eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:40.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:39.999+0000 7f4d9a70fb80 1 --2- 172.21.15.50:0/1440546758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d04f1e6c0 0x555d04f1eaa0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4d8000e4c0 tx=0x7f4d800099e0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.000+0000 7f4d8dc28700 1 --2- 172.21.15.50:0/4003861678 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4d740a2e20 0x7f4d740a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:40.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.001+0000 7f4d8dc28700 1 --2- 172.21.15.50:0/4003861678 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4d740a2e20 0x7f4d740a52e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4d84099730 tx=0x7f4d84009c30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:40.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.003+0000 7f4d9a70fb80 1 -- 172.21.15.50:0/1440546758 shutdown_connections 2024-06-06T03:36:40.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.003+0000 7f4d9a70fb80 1 --2- 172.21.15.50:0/1440546758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d04f18fa0 0x555d04f193c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.003+0000 7f4d9a70fb80 1 --2- 172.21.15.50:0/1440546758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d04f1e6c0 0x555d04f1eaa0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.003+0000 7f4d9a70fb80 1 --2- 172.21.15.50:0/1440546758 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d04f1efe0 0x555d04f18a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.003+0000 7f4d9a70fb80 1 -- 172.21.15.50:0/1440546758 >> 172.21.15.50:0/1440546758 conn(0x555d04e43d40 msgr2=0x555d04f138d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.004+0000 7f4d9a70fb80 1 -- 172.21.15.50:0/1440546758 shutdown_connections 2024-06-06T03:36:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.005+0000 7f4d9a70fb80 1 -- 172.21.15.50:0/1440546758 wait complete. 2024-06-06T03:36:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.006+0000 7f4d9a70fb80 1 -- start start 2024-06-06T03:36:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.006+0000 7f4d9a70fb80 1 Processor -- start 2024-06-06T03:36:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.006+0000 7f4d9a70fb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d04f18fa0 0x555d04f24e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.006+0000 7f4d9a70fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d04f1e6c0 0x555d04f22120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.006+0000 7f4d9a70fb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d04f1efe0 0x555d04f22660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.006+0000 7f4d9a70fb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555d04f25aa0 con 0x555d04f18fa0 2024-06-06T03:36:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.006+0000 7f4d9a70fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555d04e0ac70 con 0x555d04f1e6c0 2024-06-06T03:36:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.006+0000 7f4d9a70fb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555d04f25c20 con 0x555d04f1efe0 2024-06-06T03:36:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.007+0000 7f4d9a70fb80 10 client.0 _ll_register_callbacks cb 0x555d04e049a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:36:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.007+0000 7f4d8e429700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d04f1efe0 0x555d04f22660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.007+0000 7f4d8e429700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d04f1efe0 0x555d04f22660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:57360/0 (socket says 172.21.15.50:57360) 2024-06-06T03:36:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.007+0000 7f4d8e429700 1 -- 172.21.15.50:0/3087166559 learned_addr learned my addr 172.21.15.50:0/3087166559 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.007+0000 7f4d8d427700 1 --2- 172.21.15.50:0/3087166559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d04f1e6c0 0x555d04f22120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.007+0000 7f4d8e429700 1 -- 172.21.15.50:0/3087166559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d04f1e6c0 msgr2=0x555d04f22120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.007+0000 7f4d8e429700 1 --2- 172.21.15.50:0/3087166559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d04f1e6c0 0x555d04f22120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.007+0000 7f4d8e429700 1 -- 172.21.15.50:0/3087166559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d04f18fa0 msgr2=0x555d04f24e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.007+0000 7f4d8e429700 1 --2- 172.21.15.50:0/3087166559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d04f18fa0 0x555d04f24e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.007+0000 7f4d8e429700 1 -- 172.21.15.50:0/3087166559 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d04db9950 con 0x555d04f1efe0 2024-06-06T03:36:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.008+0000 7f4d8e429700 1 --2- 172.21.15.50:0/3087166559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d04f1efe0 0x555d04f22660 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4d80009ed0 tx=0x7f4d800061a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1faf5451e109cd2 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.008+0000 7f4d717fa700 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:36:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.009+0000 7f4d717fa700 1 -- 172.21.15.50:0/3087166559 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d80018070 con 0x555d04f1efe0 2024-06-06T03:36:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.009+0000 7f4d717fa700 1 -- 172.21.15.50:0/3087166559 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f4d800077c0 con 0x555d04f1efe0 2024-06-06T03:36:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.009+0000 7f4d9a70fb80 1 -- 172.21.15.50:0/3087166559 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555d04e77d90 con 0x555d04f1efe0 2024-06-06T03:36:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.009+0000 7f4d717fa700 1 -- 172.21.15.50:0/3087166559 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f4d8002e050 con 0x555d04f1efe0 2024-06-06T03:36:40.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.009+0000 7f4d9a70fb80 10 client.26431 fetch_fsmap learned FSMap version 35 2024-06-06T03:36:40.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.009+0000 7f4d9a70fb80 1 -- 172.21.15.50:0/3087166559 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x555d04f30510 con 0x555d04f1efe0 2024-06-06T03:36:40.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.013+0000 7f4d717fa700 1 -- 172.21.15.50:0/3087166559 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x555d04e77d90 con 0x555d04f1efe0 2024-06-06T03:36:40.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.013+0000 7f4d717fa700 1 -- 172.21.15.50:0/3087166559 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 35) ==== 8354+0+0 (secure 0 0 0) 0x7f4d8001d050 con 0x555d04f1efe0 2024-06-06T03:36:40.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.014+0000 7f4d9a70fb80 10 client.26431 fetch_fsmap finished waiting for FSMap version 35 2024-06-06T03:36:40.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.014+0000 7f4d9a70fb80 10 client.26431 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:36:40.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.014+0000 7f4d9a70fb80 20 client.26431 populate_metadata read hostname 'smithi050' 2024-06-06T03:36:40.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.014+0000 7f4d9a70fb80 1 --2- 172.21.15.50:0/3087166559 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x555d04f32e30 0x555d04f35250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:40.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.014+0000 7f4d9a70fb80 4 client.26431 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:36:40.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.014+0000 7f4d9a70fb80 1 -- 172.21.15.50:0/3087166559 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d04e72310 con 0x555d04f32e30 2024-06-06T03:36:40.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.016+0000 7f4d8d427700 1 --2- 172.21.15.50:0/3087166559 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x555d04f32e30 0x555d04f35250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:40.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.032+0000 7f4d8d427700 1 --2- 172.21.15.50:0/3087166559 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x555d04f32e30 0x555d04f35250 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=537658a7af94b320 server_cookie=8536b0487e0662a5 in_seq=0 out_seq=0 2024-06-06T03:36:40.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.032+0000 7f4d717fa700 10 client.26431 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:40.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.033+0000 7f4d717fa700 1 -- 172.21.15.50:0/3087166559 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x555d04e72310 con 0x555d04f32e30 2024-06-06T03:36:40.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.033+0000 7f4d717fa700 10 client.26431 handle_command_reply: tid=0 2024-06-06T03:36:40.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.034+0000 7f4d9a70fb80 1 client.26431 shutdown 2024-06-06T03:36:40.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.037+0000 7f4d9a70fb80 1 -- 172.21.15.50:0/3087166559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d04f1efe0 msgr2=0x555d04f22660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:40.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.037+0000 7f4d9a70fb80 1 --2- 172.21.15.50:0/3087166559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d04f1efe0 0x555d04f22660 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4d80009ed0 tx=0x7f4d800061a0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.043+0000 7f4d9a70fb80 1 -- 172.21.15.50:0/3087166559 shutdown_connections 2024-06-06T03:36:40.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.043+0000 7f4d9a70fb80 1 --2- 172.21.15.50:0/3087166559 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x555d04f32e30 0x555d04f35250 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.043+0000 7f4d9a70fb80 1 --2- 172.21.15.50:0/3087166559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d04f1efe0 0x555d04f22660 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.043+0000 7f4d9a70fb80 1 --2- 172.21.15.50:0/3087166559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d04f18fa0 0x555d04f24e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.043+0000 7f4d9a70fb80 1 --2- 172.21.15.50:0/3087166559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d04f1e6c0 0x555d04f22120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.043+0000 7f4d9a70fb80 1 -- 172.21.15.50:0/3087166559 >> 172.21.15.50:0/3087166559 conn(0x555d04e43d40 msgr2=0x555d04f13670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:40.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.044+0000 7f4d717fa700 0 client.26431 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:40.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.044+0000 7f4d9a70fb80 1 -- 172.21.15.50:0/3087166559 shutdown_connections 2024-06-06T03:36:40.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.048+0000 7f4d9a70fb80 1 -- 172.21.15.50:0/3087166559 wait complete. 2024-06-06T03:36:40.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.048+0000 7f4d9a70fb80 20 client.26431 trim_cache size 0 max 16384 2024-06-06T03:36:40.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.094+0000 7f4d9a70fb80 1 Processor -- start 2024-06-06T03:36:40.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.094+0000 7f4d9a70fb80 1 -- start start 2024-06-06T03:36:40.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.095+0000 7f4d9a70fb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d04f18fa0 0x555d04f18a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:40.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.095+0000 7f4d9a70fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d04f1e6c0 0x555d04f1c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:40.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.095+0000 7f4d9a70fb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d04f1efe0 0x555d04f1fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:40.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.095+0000 7f4d9a70fb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4d881c7fe0 con 0x555d04f18fa0 2024-06-06T03:36:40.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.095+0000 7f4d9a70fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4d881c5870 con 0x555d04f1e6c0 2024-06-06T03:36:40.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.095+0000 7f4d8e429700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d04f1efe0 0x555d04f1fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:40.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.095+0000 7f4d8e429700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d04f1efe0 0x555d04f1fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:57372/0 (socket says 172.21.15.50:57372) 2024-06-06T03:36:40.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.095+0000 7f4d8e429700 1 -- 172.21.15.50:0/4089780707 learned_addr learned my addr 172.21.15.50:0/4089780707 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:40.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.096+0000 7f4d9a70fb80 1 -- 172.21.15.50:0/4089780707 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4d881c36c0 con 0x555d04f1efe0 2024-06-06T03:36:40.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.096+0000 7f4d8e429700 1 -- 172.21.15.50:0/4089780707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d04f1e6c0 msgr2=0x555d04f1c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:40.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.096+0000 7f4d8e429700 1 --2- 172.21.15.50:0/4089780707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d04f1e6c0 0x555d04f1c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.096+0000 7f4d8e429700 1 -- 172.21.15.50:0/4089780707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d04f18fa0 msgr2=0x555d04f18a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:40.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.096+0000 7f4d8e429700 1 --2- 172.21.15.50:0/4089780707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d04f18fa0 0x555d04f18a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.096+0000 7f4d8e429700 1 -- 172.21.15.50:0/4089780707 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d04f20690 con 0x555d04f1efe0 2024-06-06T03:36:40.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.097+0000 7f4d8e429700 1 --2- 172.21.15.50:0/4089780707 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d04f1efe0 0x555d04f1fcb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4d8000e4c0 tx=0x7f4d80020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46a6ca2145a69f9b server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:40.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.098+0000 7f4d737fe700 1 -- 172.21.15.50:0/4089780707 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d80018070 con 0x555d04f1efe0 2024-06-06T03:36:40.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.098+0000 7f4d737fe700 1 -- 172.21.15.50:0/4089780707 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4d80025070 con 0x555d04f1efe0 2024-06-06T03:36:40.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.098+0000 7f4d737fe700 1 -- 172.21.15.50:0/4089780707 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d80014840 con 0x555d04f1efe0 2024-06-06T03:36:40.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.099+0000 7f4d9a70fb80 1 -- 172.21.15.50:0/4089780707 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d04f1efe0 msgr2=0x555d04f1fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:40.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.099+0000 7f4d9a70fb80 1 --2- 172.21.15.50:0/4089780707 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d04f1efe0 0x555d04f1fcb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4d8000e4c0 tx=0x7f4d80020000 comp rx=0 tx=0).stop 2024-06-06T03:36:40.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.101+0000 7f4d9a70fb80 1 -- 172.21.15.50:0/4089780707 shutdown_connections 2024-06-06T03:36:40.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.101+0000 7f4d9a70fb80 1 --2- 172.21.15.50:0/4089780707 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d04f1efe0 0x555d04f1fcb0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.101+0000 7f4d9a70fb80 1 --2- 172.21.15.50:0/4089780707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d04f18fa0 0x555d04f18a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.101+0000 7f4d9a70fb80 1 --2- 172.21.15.50:0/4089780707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d04f1e6c0 0x555d04f1c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.101+0000 7f4d9a70fb80 1 -- 172.21.15.50:0/4089780707 >> 172.21.15.50:0/4089780707 conn(0x555d04e43d40 msgr2=0x555d04f0ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:40.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.101+0000 7f4d9a70fb80 1 -- 172.21.15.50:0/4089780707 shutdown_connections 2024-06-06T03:36:40.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.101+0000 7f4d9a70fb80 1 -- 172.21.15.50:0/4089780707 wait complete. 2024-06-06T03:36:40.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.102+0000 7f4d9a70fb80 1 -- start start 2024-06-06T03:36:40.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.102+0000 7f4d9a70fb80 1 Processor -- start 2024-06-06T03:36:40.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.104+0000 7f4d9a70fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d04f18fa0 0x555d04f2b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:40.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.105+0000 7f4d9a70fb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d04f1e6c0 0x555d04f3a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:40.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.105+0000 7f4d9a70fb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d04f1efe0 0x555d04f3a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:40.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.105+0000 7f4d9a70fb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4d881c3d30 con 0x555d04f1e6c0 2024-06-06T03:36:40.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.105+0000 7f4d9a70fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4d881c51a0 con 0x555d04f18fa0 2024-06-06T03:36:40.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.105+0000 7f4d9a70fb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4d881c4400 con 0x555d04f1efe0 2024-06-06T03:36:40.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.105+0000 7f4d9a70fb80 10 client.0 _ll_register_callbacks cb 0x555d04e049a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:36:40.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.106+0000 7f4d8d427700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d04f1e6c0 0x555d04f3a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:40.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.106+0000 7f4d8d427700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d04f1e6c0 0x555d04f3a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60084/0 (socket says 172.21.15.50:60084) 2024-06-06T03:36:40.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.106+0000 7f4d8d427700 1 -- 172.21.15.50:0/3763469225 learned_addr learned my addr 172.21.15.50:0/3763469225 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:40.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.107+0000 7f4d8d427700 1 -- 172.21.15.50:0/3763469225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d04f1efe0 msgr2=0x555d04f3a980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:36:40.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.107+0000 7f4d8d427700 1 --2- 172.21.15.50:0/3763469225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d04f1efe0 0x555d04f3a980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.107+0000 7f4d8d427700 1 -- 172.21.15.50:0/3763469225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d04f18fa0 msgr2=0x555d04f2b670 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:36:40.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.107+0000 7f4d8d427700 1 --2- 172.21.15.50:0/3763469225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d04f18fa0 0x555d04f2b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.107+0000 7f4d8d427700 1 -- 172.21.15.50:0/3763469225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d04f3b1b0 con 0x555d04f1e6c0 2024-06-06T03:36:40.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.115+0000 7f4d8d427700 1 --2- 172.21.15.50:0/3763469225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d04f1e6c0 0x555d04f3a440 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f4d78000c00 tx=0x7f4d78016700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac34f6ffe1b723d5 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:40.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.115+0000 7f4d717fa700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:36:40.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.118+0000 7f4d717fa700 1 -- 172.21.15.50:0/3763469225 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7801c2c0 con 0x555d04f1e6c0 2024-06-06T03:36:40.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.118+0000 7f4d717fa700 1 -- 172.21.15.50:0/3763469225 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f4d7801c460 con 0x555d04f1e6c0 2024-06-06T03:36:40.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.118+0000 7f4d9a70fb80 1 -- 172.21.15.50:0/3763469225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d80025070 con 0x555d04f1e6c0 2024-06-06T03:36:40.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.121+0000 7f4d717fa700 1 -- 172.21.15.50:0/3763469225 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f4d7802c050 con 0x555d04f1e6c0 2024-06-06T03:36:40.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.127+0000 7f4d9a70fb80 10 client.16719 fetch_fsmap learned FSMap version 35 2024-06-06T03:36:40.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.127+0000 7f4d9a70fb80 1 -- 172.21.15.50:0/3763469225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x555d04f9dbb0 con 0x555d04f1e6c0 2024-06-06T03:36:40.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.128+0000 7f4d717fa700 1 -- 172.21.15.50:0/3763469225 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4d7801cb10 con 0x555d04f1e6c0 2024-06-06T03:36:40.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.128+0000 7f4d717fa700 1 -- 172.21.15.50:0/3763469225 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 35) ==== 8354+0+0 (secure 0 0 0) 0x7f4d780148e0 con 0x555d04f1e6c0 2024-06-06T03:36:40.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.128+0000 7f4d9a70fb80 10 client.16719 fetch_fsmap finished waiting for FSMap version 35 2024-06-06T03:36:40.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.128+0000 7f4d9a70fb80 10 client.16719 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:36:40.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.128+0000 7f4d9a70fb80 20 client.16719 populate_metadata read hostname 'smithi050' 2024-06-06T03:36:40.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.128+0000 7f4d9a70fb80 1 --2- 172.21.15.50:0/3763469225 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x555d04f9e300 0x555d04fa0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:40.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.129+0000 7f4d9a70fb80 4 client.16719 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-06T03:36:40.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.129+0000 7f4d9a70fb80 1 -- 172.21.15.50:0/3763469225 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f4d80025070 con 0x555d04f9e300 2024-06-06T03:36:40.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.133+0000 7f4d8e429700 1 --2- 172.21.15.50:0/3763469225 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x555d04f9e300 0x555d04fa0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:40.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.133+0000 7f4d8e429700 1 --2- 172.21.15.50:0/3763469225 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x555d04f9e300 0x555d04fa0720 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd88b746bf511f21 server_cookie=3350a62a9a587fb8 in_seq=0 out_seq=0 2024-06-06T03:36:40.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.133+0000 7f4d717fa700 10 client.16719 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:40.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.137+0000 7f4d717fa700 1 -- 172.21.15.50:0/3763469225 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f4d80025070 con 0x555d04f9e300 2024-06-06T03:36:40.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.137+0000 7f4d717fa700 10 client.16719 handle_command_reply: tid=0 2024-06-06T03:36:40.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.137+0000 7f4d9a70fb80 1 client.16719 shutdown 2024-06-06T03:36:40.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.138+0000 7f4d9a70fb80 1 -- 172.21.15.50:0/3763469225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d04f1e6c0 msgr2=0x555d04f3a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:40.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.138+0000 7f4d9a70fb80 1 --2- 172.21.15.50:0/3763469225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d04f1e6c0 0x555d04f3a440 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f4d78000c00 tx=0x7f4d78016700 comp rx=0 tx=0).stop 2024-06-06T03:36:40.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.139+0000 7f4d9a70fb80 1 -- 172.21.15.50:0/3763469225 shutdown_connections 2024-06-06T03:36:40.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.139+0000 7f4d9a70fb80 1 --2- 172.21.15.50:0/3763469225 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x555d04f9e300 0x555d04fa0720 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.139+0000 7f4d9a70fb80 1 --2- 172.21.15.50:0/3763469225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d04f1efe0 0x555d04f3a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.139+0000 7f4d9a70fb80 1 --2- 172.21.15.50:0/3763469225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d04f18fa0 0x555d04f2b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.139+0000 7f4d9a70fb80 1 --2- 172.21.15.50:0/3763469225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d04f1e6c0 0x555d04f3a440 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.139+0000 7f4d9a70fb80 1 -- 172.21.15.50:0/3763469225 >> 172.21.15.50:0/3763469225 conn(0x555d04e43d40 msgr2=0x555d04f0d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:40.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.139+0000 7f4d717fa700 0 client.16719 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:40.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.139+0000 7f4d9a70fb80 1 -- 172.21.15.50:0/3763469225 shutdown_connections 2024-06-06T03:36:40.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.139+0000 7f4d9a70fb80 1 -- 172.21.15.50:0/3763469225 wait complete. 2024-06-06T03:36:40.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.139+0000 7f4d9a70fb80 20 client.16719 trim_cache size 0 max 16384 2024-06-06T03:36:40.141 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:36:40.141 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-06-06T03:36:40.141 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "12c1462f-42aa-49ea-8740-32d80bb329c5", 2024-06-06T03:36:40.141 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-06-06T03:36:40.141 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:36:40.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.140+0000 7f4d8fe8c700 1 -- 172.21.15.50:0/4003861678 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4d740a2e20 msgr2=0x7f4d740a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:40.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.140+0000 7f4d8fe8c700 1 --2- 172.21.15.50:0/4003861678 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4d740a2e20 0x7f4d740a52e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4d84099730 tx=0x7f4d84009c30 comp rx=0 tx=0).stop 2024-06-06T03:36:40.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.140+0000 7f4d8fe8c700 1 -- 172.21.15.50:0/4003861678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d8810d100 msgr2=0x7f4d88123320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:40.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.140+0000 7f4d8fe8c700 1 --2- 172.21.15.50:0/4003861678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d8810d100 0x7f4d88123320 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f4d84009840 tx=0x7f4d84005690 comp rx=0 tx=0).stop 2024-06-06T03:36:40.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.146+0000 7f4d8fe8c700 1 -- 172.21.15.50:0/4003861678 shutdown_connections 2024-06-06T03:36:40.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.146+0000 7f4d8fe8c700 1 --2- 172.21.15.50:0/4003861678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d881121e0 0x7f4d881196e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.146+0000 7f4d8fe8c700 1 --2- 172.21.15.50:0/4003861678 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f4d740a2e20 0x7f4d740a52e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.146+0000 7f4d8fe8c700 1 --2- 172.21.15.50:0/4003861678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d8810d100 0x7f4d88123320 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.146+0000 7f4d8fe8c700 1 --2- 172.21.15.50:0/4003861678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d8810dab0 0x7f4d881191a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:40.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.146+0000 7f4d8fe8c700 1 -- 172.21.15.50:0/4003861678 >> 172.21.15.50:0/4003861678 conn(0x7f4d8806d6b0 msgr2=0x7f4d8810eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:40.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.146+0000 7f4d8fe8c700 1 -- 172.21.15.50:0/4003861678 shutdown_connections 2024-06-06T03:36:40.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:40.146+0000 7f4d8fe8c700 1 -- 172.21.15.50:0/4003861678 wait complete. 2024-06-06T03:36:40.432 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:36:40 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-c[66218]: 2024-06-06T03:36:40.144+0000 7f4947d1d700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000201 [...2,head] /volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/ auth{0=1,2=1} v300 ap=1 f(v0 m2024-06-06T03:27:58.889485+0000 16=15+1) n(v1 rc2024-06-06T03:35:59.326447+0000 b7436759211 19=17+2) (inest mix) (ifile excl) caps={15231=pAsLsXsFsx/AsLsXsFsx@3},l=15231 | importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 authpin=1 discoverbase=0 scrubqueue=0 0x562af3b2d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000201:[<0x10000000006/iogen_3.1p0 v169>,<0x10000000005/tmp v25>,<0x10000000003/client.0 v18>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v34>,<0x10000000001/sv_0 v58>,<0x10000000000/qa v49>,<0x1/volumes v47>]//[]","memoryvalue":"(2)0x10000000201:[<0x10000000006/iogen_3.1p0 v300>,<0x10000000005/tmp v77>,<0x10000000003/client.0 v44>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v24>,<0x10000000001/sv_0 v35>,<0x10000000000/qa v32>,<0x1/volumes v33>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-06-06T03:27:58.889485+0000 16=15+1)","ondisk_value.rstat":"n(v0 rc2024-06-06T03:35:59.326447+0000 b7436759211 19=17+2)","memory_value.dirstat":"f(v0 m2024-06-06T03:27:58.889485+0000 16=15+1)","memory_value.rstat":"n(v1 rc2024-06-06T03:35:59.326447+0000 b7436759211 19=17+2)","error_str":""},"return_code":0} 2024-06-06T03:36:40.432 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:36:40 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-c[66218]: 2024-06-06T03:36:40.144+0000 7f4947d1d700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000213 [2,head] /volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95184.res auth v285 ap=1 s=562 n(v0 rc2024-06-06T03:35:59.260385+0000 b562 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15231=0-4194304@1} caps={15231=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15231 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562af3cbb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000213:[<0x10000000201/iogen_95184.res v48>,<0x10000000006/iogen_3.1p0 v169>,<0x10000000005/tmp v25>,<0x10000000003/client.0 v18>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v34>,<0x10000000001/sv_0 v58>,<0x10000000000/qa v49>,<0x1/volumes v47>]//[3]","memoryvalue":"(4)0x10000000213:[<0x10000000201/iogen_95184.res v285>,<0x10000000006/iogen_3.1p0 v300>,<0x10000000005/tmp v77>,<0x10000000003/client.0 v44>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v24>,<0x10000000001/sv_0 v35>,<0x10000000000/qa v32>,<0x1/volumes v33>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-06T03:36:40.432 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:36:40 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-c[66218]: 2024-06-06T03:36:40.144+0000 7f4947d1d700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000202 [...2,head] /volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/src/ auth{0=1,2=1} v142 ap=1 f(v0 m2024-06-06T03:27:58.255721+0000 2=2+0) n(v0 rc2024-06-06T03:27:58.258456+0000 b23855 3=2+1) (inest mix) caps={15231=pAsLsXs/-@1},l=15231 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 dirwaiter=0 replicated=1 authpin=1 discoverbase=0 scrubqueue=0 0x562af3cb8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000202:[<0x10000000201/src v142>,<0x10000000006/iogen_3.1p0 v169>,<0x10000000005/tmp v25>,<0x10000000003/client.0 v18>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v34>,<0x10000000001/sv_0 v58>,<0x10000000000/qa v49>,<0x1/volumes v47>]//[]","memoryvalue":"(2)0x10000000202:[<0x10000000201/src v142>,<0x10000000006/iogen_3.1p0 v300>,<0x10000000005/tmp v77>,<0x10000000003/client.0 v44>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v24>,<0x10000000001/sv_0 v35>,<0x10000000000/qa v32>,<0x1/volumes v33>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-06-06T03:27:58.255721+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-06-06T03:27:58.257937+0000 b23855 3=2+1)","memory_value.dirstat":"f(v0 m2024-06-06T03:27:58.255721+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-06-06T03:27:58.258456+0000 b23855 3=2+1)","error_str":""},"return_code":0} 2024-06-06T03:36:40.432 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:36:40 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-c[66218]: 2024-06-06T03:36:40.145+0000 7f4947d1d700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000210 [2,head] /volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95181.res auth v281 ap=1 s=562 n(v0 rc2024-06-06T03:35:59.134187+0000 b562 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15231=0-4194304@1} caps={15231=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15231 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562af3cb9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000210:[<0x10000000201/iogen_95181.res v42>,<0x10000000006/iogen_3.1p0 v169>,<0x10000000005/tmp v25>,<0x10000000003/client.0 v18>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v34>,<0x10000000001/sv_0 v58>,<0x10000000000/qa v49>,<0x1/volumes v47>]//[3]","memoryvalue":"(4)0x10000000210:[<0x10000000201/iogen_95181.res v281>,<0x10000000006/iogen_3.1p0 v300>,<0x10000000005/tmp v77>,<0x10000000003/client.0 v44>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v24>,<0x10000000001/sv_0 v35>,<0x10000000000/qa v32>,<0x1/volumes v33>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-06T03:36:40.432 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:36:40 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-c[66218]: 2024-06-06T03:36:40.145+0000 7f4947d1d700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020e [2,head] /volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95184.io auth v205 ap=1 s=1487339520 n(v0 rc2024-06-06T03:28:44.495018+0000 b1487339520 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15231=0-2977955840@1} caps={15231=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15231 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562af3cb9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000020e:[<0x10000000201/iogen_95184.io v165>,<0x10000000006/iogen_3.1p0 v169>,<0x10000000005/tmp v25>,<0x10000000003/client.0 v18>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v34>,<0x10000000001/sv_0 v58>,<0x10000000000/qa v49>,<0x1/volumes v47>]//[3]","memoryvalue":"(4)0x1000000020e:[<0x10000000201/iogen_95184.io v205>,<0x10000000006/iogen_3.1p0 v300>,<0x10000000005/tmp v77>,<0x10000000003/client.0 v44>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v24>,<0x10000000001/sv_0 v35>,<0x10000000000/qa v32>,<0x1/volumes v33>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-06T03:36:40.432 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:36:40 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-c[66218]: 2024-06-06T03:36:40.145+0000 7f4947d1d700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [2,head] /volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0.tar auth v6 ap=1 s=8071 n(v0 rc2024-06-06T03:27:58.180792+0000 b8071 1=1+0) caps={15231=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562af3d50000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000007:[<0x10000000006/iogen_3.1p0.tar v6>,<0x10000000005/tmp v25>,<0x10000000003/client.0 v18>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v34>,<0x10000000001/sv_0 v58>,<0x10000000000/qa v49>,<0x1/volumes v47>]//[3]","memoryvalue":"(4)0x10000000007:[<0x10000000006/iogen_3.1p0.tar v6>,<0x10000000005/tmp v77>,<0x10000000003/client.0 v44>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v24>,<0x10000000001/sv_0 v35>,<0x10000000000/qa v32>,<0x1/volumes v33>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-06T03:36:40.433 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:36:40 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-c[66218]: 2024-06-06T03:36:40.145+0000 7f4947d1d700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000208 [2,head] /volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen auth v28 ap=1 s=28896 n(v0 rc2024-06-06T03:27:58.626939+0000 b28896 1=1+0) (ifile excl) cr={15231=0-4194304@1} caps={15231=pAsLsXsFsxcrwb/pFscr@1},l=15231 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562af3cba100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000208:[<0x10000000201/iogen v28>,<0x10000000006/iogen_3.1p0 v169>,<0x10000000005/tmp v25>,<0x10000000003/client.0 v18>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v34>,<0x10000000001/sv_0 v58>,<0x10000000000/qa v49>,<0x1/volumes v47>]//[3]","memoryvalue":"(4)0x10000000208:[<0x10000000201/iogen v28>,<0x10000000006/iogen_3.1p0 v300>,<0x10000000005/tmp v77>,<0x10000000003/client.0 v44>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v24>,<0x10000000001/sv_0 v35>,<0x10000000000/qa v32>,<0x1/volumes v33>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-06T03:36:40.433 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:36:40 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-c[66218]: 2024-06-06T03:36:40.145+0000 7f4947d1d700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020d [2,head] /volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95182.io auth v209 ap=1 s=1487339520 n(v0 rc2024-06-06T03:28:44.572192+0000 b1487339520 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15231=0-2977955840@1} caps={15231=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15231 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562af3cbac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000020d:[<0x10000000201/iogen_95182.io v169>,<0x10000000006/iogen_3.1p0 v169>,<0x10000000005/tmp v25>,<0x10000000003/client.0 v18>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v34>,<0x10000000001/sv_0 v58>,<0x10000000000/qa v49>,<0x1/volumes v47>]//[3]","memoryvalue":"(4)0x1000000020d:[<0x10000000201/iogen_95182.io v209>,<0x10000000006/iogen_3.1p0 v300>,<0x10000000005/tmp v77>,<0x10000000003/client.0 v44>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v24>,<0x10000000001/sv_0 v35>,<0x10000000000/qa v32>,<0x1/volumes v33>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-06T03:36:40.433 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:36:40 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-c[66218]: 2024-06-06T03:36:40.145+0000 7f4947d1d700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000209 [2,head] /volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen.cat8 auth v148 ap=1 s=4826 n(v0 rc2024-06-06T03:27:58.870338+0000 b4826 1=1+0) caps={15231=pAsLsXsFs/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562af3cba680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000209:[<0x10000000201/iogen.cat8 v148>,<0x10000000006/iogen_3.1p0 v169>,<0x10000000005/tmp v25>,<0x10000000003/client.0 v18>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v34>,<0x10000000001/sv_0 v58>,<0x10000000000/qa v49>,<0x1/volumes v47>]//[3]","memoryvalue":"(4)0x10000000209:[<0x10000000201/iogen.cat8 v148>,<0x10000000006/iogen_3.1p0 v300>,<0x10000000005/tmp v77>,<0x10000000003/client.0 v44>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v24>,<0x10000000001/sv_0 v35>,<0x10000000000/qa v32>,<0x1/volumes v33>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-06T03:36:40.433 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:36:40 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-c[66218]: 2024-06-06T03:36:40.146+0000 7f4947d1d700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000207 [2,head] /volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/Makefile auth v16 ap=1 s=305 n(v0 rc2024-06-06T03:27:58.264866+0000 b305 1=1+0) caps={15231=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562af3d52100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000207:[<0x10000000201/Makefile v16>,<0x10000000006/iogen_3.1p0 v169>,<0x10000000005/tmp v25>,<0x10000000003/client.0 v18>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v34>,<0x10000000001/sv_0 v58>,<0x10000000000/qa v49>,<0x1/volumes v47>]//[3]","memoryvalue":"(4)0x10000000207:[<0x10000000201/Makefile v16>,<0x10000000006/iogen_3.1p0 v300>,<0x10000000005/tmp v77>,<0x10000000003/client.0 v44>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v24>,<0x10000000001/sv_0 v35>,<0x10000000000/qa v32>,<0x1/volumes v33>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-06T03:36:40.433 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:36:40 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-c[66218]: 2024-06-06T03:36:40.147+0000 7f4947d1d700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000205 [2,head] /volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/README auth v144 ap=1 s=383 n(v0 rc2024-06-06T03:27:58.260398+0000 b383 1=1+0) caps={15231=pAsLsXsFs/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562af3d50b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000205:[<0x10000000201/README v144>,<0x10000000006/iogen_3.1p0 v169>,<0x10000000005/tmp v25>,<0x10000000003/client.0 v18>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v34>,<0x10000000001/sv_0 v58>,<0x10000000000/qa v49>,<0x1/volumes v47>]//[3]","memoryvalue":"(4)0x10000000205:[<0x10000000201/README v144>,<0x10000000006/iogen_3.1p0 v300>,<0x10000000005/tmp v77>,<0x10000000003/client.0 v44>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v24>,<0x10000000001/sv_0 v35>,<0x10000000000/qa v32>,<0x1/volumes v33>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-06T03:36:40.433 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:36:40 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-c[66218]: 2024-06-06T03:36:40.147+0000 7f4947d1d700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000212 [2,head] /volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95182.res auth v289 ap=1 s=562 n(v0 rc2024-06-06T03:35:59.326447+0000 b562 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15231=0-4194304@1} caps={15231=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15231 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562af3d50580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000212:[<0x10000000201/iogen_95182.res v46>,<0x10000000006/iogen_3.1p0 v169>,<0x10000000005/tmp v25>,<0x10000000003/client.0 v18>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v34>,<0x10000000001/sv_0 v58>,<0x10000000000/qa v49>,<0x1/volumes v47>]//[3]","memoryvalue":"(4)0x10000000212:[<0x10000000201/iogen_95182.res v289>,<0x10000000006/iogen_3.1p0 v300>,<0x10000000005/tmp v77>,<0x10000000003/client.0 v44>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v24>,<0x10000000001/sv_0 v35>,<0x10000000000/qa v32>,<0x1/volumes v33>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-06T03:36:40.433 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:36:40 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-c[66218]: 2024-06-06T03:36:40.148+0000 7f4947d1d700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000211 [2,head] /volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95183.res auth v287 ap=1 s=562 n(v0 rc2024-06-06T03:35:59.285356+0000 b562 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15231=0-4194304@1} caps={15231=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15231 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562af3d51080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000211:[<0x10000000201/iogen_95183.res v44>,<0x10000000006/iogen_3.1p0 v169>,<0x10000000005/tmp v25>,<0x10000000003/client.0 v18>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v34>,<0x10000000001/sv_0 v58>,<0x10000000000/qa v49>,<0x1/volumes v47>]//[3]","memoryvalue":"(4)0x10000000211:[<0x10000000201/iogen_95183.res v287>,<0x10000000006/iogen_3.1p0 v300>,<0x10000000005/tmp v77>,<0x10000000003/client.0 v44>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v24>,<0x10000000001/sv_0 v35>,<0x10000000000/qa v32>,<0x1/volumes v33>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-06T03:36:40.433 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:36:40 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-c[66218]: 2024-06-06T03:36:40.148+0000 7f4947d1d700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020a [2,head] /volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95180.io auth v201 ap=1 s=1487339520 n(v0 rc2024-06-06T03:28:44.468168+0000 b1487339520 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15231=0-2977955840@1} caps={15231=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15231 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562af3d52680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000020a:[<0x10000000201/iogen_95180.io v161>,<0x10000000006/iogen_3.1p0 v169>,<0x10000000005/tmp v25>,<0x10000000003/client.0 v18>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v34>,<0x10000000001/sv_0 v58>,<0x10000000000/qa v49>,<0x1/volumes v47>]//[3]","memoryvalue":"(4)0x1000000020a:[<0x10000000201/iogen_95180.io v201>,<0x10000000006/iogen_3.1p0 v300>,<0x10000000005/tmp v77>,<0x10000000003/client.0 v44>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v24>,<0x10000000001/sv_0 v35>,<0x10000000000/qa v32>,<0x1/volumes v33>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-06T03:36:40.433 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:36:40 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-c[66218]: 2024-06-06T03:36:40.155+0000 7f4947d1d700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000206 [2,head] /volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/Makefile.bsd auth v146 ap=1 s=536 n(v0 rc2024-06-06T03:27:58.262729+0000 b536 1=1+0) caps={15231=pAsLsXsFs/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562af3cbb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000206:[<0x10000000201/Makefile.bsd v146>,<0x10000000006/iogen_3.1p0 v169>,<0x10000000005/tmp v25>,<0x10000000003/client.0 v18>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v34>,<0x10000000001/sv_0 v58>,<0x10000000000/qa v49>,<0x1/volumes v47>]//[3]","memoryvalue":"(4)0x10000000206:[<0x10000000201/Makefile.bsd v146>,<0x10000000006/iogen_3.1p0 v300>,<0x10000000005/tmp v77>,<0x10000000003/client.0 v44>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v24>,<0x10000000001/sv_0 v35>,<0x10000000000/qa v32>,<0x1/volumes v33>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-06T03:36:40.433 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:36:40 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-c[66218]: 2024-06-06T03:36:40.155+0000 7f4947d1d700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020b [2,head] /volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95181.io auth v207 ap=1 s=1487339520 n(v0 rc2024-06-06T03:28:44.497984+0000 b1487339520 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15231=0-2977955840@1} caps={15231=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15231 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562af3d51b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000020b:[<0x10000000201/iogen_95181.io v167>,<0x10000000006/iogen_3.1p0 v169>,<0x10000000005/tmp v25>,<0x10000000003/client.0 v18>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v34>,<0x10000000001/sv_0 v58>,<0x10000000000/qa v49>,<0x1/volumes v47>]//[3]","memoryvalue":"(4)0x1000000020b:[<0x10000000201/iogen_95181.io v207>,<0x10000000006/iogen_3.1p0 v300>,<0x10000000005/tmp v77>,<0x10000000003/client.0 v44>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v24>,<0x10000000001/sv_0 v35>,<0x10000000000/qa v32>,<0x1/volumes v33>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-06T03:36:40.433 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:36:40 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-c[66218]: 2024-06-06T03:36:40.158+0000 7f4947d1d700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020c [2,head] /volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95183.io auth v203 ap=1 s=1487339520 n(v0 rc2024-06-06T03:28:44.494069+0000 b1487339520 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15231=0-2977955840@1} caps={15231=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15231 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562af3d51600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000020c:[<0x10000000201/iogen_95183.io v163>,<0x10000000006/iogen_3.1p0 v169>,<0x10000000005/tmp v25>,<0x10000000003/client.0 v18>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v34>,<0x10000000001/sv_0 v58>,<0x10000000000/qa v49>,<0x1/volumes v47>]//[3]","memoryvalue":"(4)0x1000000020c:[<0x10000000201/iogen_95183.io v203>,<0x10000000006/iogen_3.1p0 v300>,<0x10000000005/tmp v77>,<0x10000000003/client.0 v44>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v24>,<0x10000000001/sv_0 v35>,<0x10000000000/qa v32>,<0x1/volumes v33>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-06T03:36:40.434 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:36:40 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-c[66218]: 2024-06-06T03:36:40.162+0000 7f4947d1d700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020f [2,head] /volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95180.res auth v283 ap=1 s=562 n(v0 rc2024-06-06T03:35:59.214519+0000 b562 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15231=0-4194304@1} caps={15231=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15231 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562af3b91700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000020f:[<0x10000000201/iogen_95180.res v40>,<0x10000000006/iogen_3.1p0 v169>,<0x10000000005/tmp v25>,<0x10000000003/client.0 v18>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v34>,<0x10000000001/sv_0 v58>,<0x10000000000/qa v49>,<0x1/volumes v47>]//[3]","memoryvalue":"(4)0x1000000020f:[<0x10000000201/iogen_95180.res v283>,<0x10000000006/iogen_3.1p0 v300>,<0x10000000005/tmp v77>,<0x10000000003/client.0 v44>,<0x10000000002/e20c3842-0277-4a93-ad2b-9ee2fe9f11df v24>,<0x10000000001/sv_0 v35>,<0x10000000000/qa v32>,<0x1/volumes v33>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-06T03:36:41.036 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-06T03:36:41.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:41 smithi079 ceph-mon[35478]: pgmap v732: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 31 MiB/s wr, 629 op/s 2024-06-06T03:36:41.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:41 smithi079 ceph-mon[35478]: scrub queued for path: / 2024-06-06T03:36:41.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:41 smithi079 ceph-mon[35478]: scrub summary: idle+waiting paths [/] 2024-06-06T03:36:41.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:41 smithi079 ceph-mon[35478]: scrub summary: active paths [/] 2024-06-06T03:36:41.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:41 smithi079 ceph-mon[35478]: scrub summary: active paths [/] 2024-06-06T03:36:41.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:41 smithi079 ceph-mon[35478]: Scrub error on inode 0x10000000201 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:41 smithi079 ceph-mon[35478]: Scrub error on inode 0x10000000213 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95184.res) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:41 smithi079 ceph-mon[35478]: Scrub error on inode 0x10000000202 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/src) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:41 smithi079 ceph-mon[35478]: Scrub error on inode 0x10000000210 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95181.res) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:41 smithi079 ceph-mon[35478]: Scrub error on inode 0x1000000020e (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95184.io) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:41 smithi079 ceph-mon[35478]: Scrub error on inode 0x10000000007 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0.tar) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:41 smithi079 ceph-mon[35478]: Scrub error on inode 0x10000000208 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:41 smithi079 ceph-mon[35478]: Scrub error on inode 0x1000000020d (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95182.io) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:41 smithi079 ceph-mon[35478]: Scrub error on inode 0x10000000209 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen.cat8) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:41 smithi079 ceph-mon[35478]: Scrub error on inode 0x10000000207 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/Makefile) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:41 smithi079 ceph-mon[35478]: Scrub error on inode 0x10000000205 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/README) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:41 smithi079 ceph-mon[35478]: Scrub error on inode 0x10000000212 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95182.res) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:41 smithi079 ceph-mon[35478]: Scrub error on inode 0x10000000211 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95183.res) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:41 smithi079 ceph-mon[35478]: Scrub error on inode 0x1000000020a (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95180.io) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:41 smithi079 ceph-mon[35478]: Scrub error on inode 0x10000000206 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/Makefile.bsd) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:41 smithi079 ceph-mon[35478]: Scrub error on inode 0x1000000020b (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95181.io) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:41 smithi079 ceph-mon[35478]: Scrub error on inode 0x1000000020c (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95183.io) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.601 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:41 smithi079 ceph-mon[35478]: Scrub error on inode 0x1000000020f (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95180.res) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.602 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:41 smithi079 ceph-mon[35478]: scrub summary: idle+waiting paths [/] 2024-06-06T03:36:41.602 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:41 smithi079 ceph-mon[35478]: scrub summary: idle+waiting paths [/] 2024-06-06T03:36:41.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:41 smithi122 ceph-mon[35759]: pgmap v732: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 31 MiB/s wr, 629 op/s 2024-06-06T03:36:41.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:41 smithi122 ceph-mon[35759]: scrub queued for path: / 2024-06-06T03:36:41.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:41 smithi122 ceph-mon[35759]: scrub summary: idle+waiting paths [/] 2024-06-06T03:36:41.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:41 smithi122 ceph-mon[35759]: scrub summary: active paths [/] 2024-06-06T03:36:41.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:41 smithi122 ceph-mon[35759]: scrub summary: active paths [/] 2024-06-06T03:36:41.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:41 smithi122 ceph-mon[35759]: Scrub error on inode 0x10000000201 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:41 smithi122 ceph-mon[35759]: Scrub error on inode 0x10000000213 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95184.res) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:41 smithi122 ceph-mon[35759]: Scrub error on inode 0x10000000202 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/src) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:41 smithi122 ceph-mon[35759]: Scrub error on inode 0x10000000210 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95181.res) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:41 smithi122 ceph-mon[35759]: Scrub error on inode 0x1000000020e (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95184.io) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:41 smithi122 ceph-mon[35759]: Scrub error on inode 0x10000000007 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0.tar) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:41 smithi122 ceph-mon[35759]: Scrub error on inode 0x10000000208 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:41 smithi122 ceph-mon[35759]: Scrub error on inode 0x1000000020d (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95182.io) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:41 smithi122 ceph-mon[35759]: Scrub error on inode 0x10000000209 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen.cat8) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:41 smithi122 ceph-mon[35759]: Scrub error on inode 0x10000000207 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/Makefile) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:41 smithi122 ceph-mon[35759]: Scrub error on inode 0x10000000205 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/README) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:41 smithi122 ceph-mon[35759]: Scrub error on inode 0x10000000212 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95182.res) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:41 smithi122 ceph-mon[35759]: Scrub error on inode 0x10000000211 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95183.res) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:41 smithi122 ceph-mon[35759]: Scrub error on inode 0x1000000020a (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95180.io) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:41 smithi122 ceph-mon[35759]: Scrub error on inode 0x10000000206 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/Makefile.bsd) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:41 smithi122 ceph-mon[35759]: Scrub error on inode 0x1000000020b (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95181.io) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:41 smithi122 ceph-mon[35759]: Scrub error on inode 0x1000000020c (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95183.io) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:41 smithi122 ceph-mon[35759]: Scrub error on inode 0x1000000020f (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95180.res) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:41 smithi122 ceph-mon[35759]: scrub summary: idle+waiting paths [/] 2024-06-06T03:36:41.683 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:41 smithi122 ceph-mon[35759]: scrub summary: idle+waiting paths [/] 2024-06-06T03:36:41.716 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:36:41.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:41 smithi050 ceph-mon[32421]: pgmap v732: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 31 MiB/s wr, 629 op/s 2024-06-06T03:36:41.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:41 smithi050 ceph-mon[32421]: scrub queued for path: / 2024-06-06T03:36:41.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:41 smithi050 ceph-mon[32421]: scrub summary: idle+waiting paths [/] 2024-06-06T03:36:41.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:41 smithi050 ceph-mon[32421]: scrub summary: active paths [/] 2024-06-06T03:36:41.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:41 smithi050 ceph-mon[32421]: scrub summary: active paths [/] 2024-06-06T03:36:41.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:41 smithi050 ceph-mon[32421]: Scrub error on inode 0x10000000201 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:41 smithi050 ceph-mon[32421]: Scrub error on inode 0x10000000213 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95184.res) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:41 smithi050 ceph-mon[32421]: Scrub error on inode 0x10000000202 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/src) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:41 smithi050 ceph-mon[32421]: Scrub error on inode 0x10000000210 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95181.res) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:41 smithi050 ceph-mon[32421]: Scrub error on inode 0x1000000020e (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95184.io) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:41 smithi050 ceph-mon[32421]: Scrub error on inode 0x10000000007 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0.tar) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:41 smithi050 ceph-mon[32421]: Scrub error on inode 0x10000000208 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:41 smithi050 ceph-mon[32421]: Scrub error on inode 0x1000000020d (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95182.io) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:41 smithi050 ceph-mon[32421]: Scrub error on inode 0x10000000209 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen.cat8) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:41 smithi050 ceph-mon[32421]: Scrub error on inode 0x10000000207 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/Makefile) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.754 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:41 smithi050 ceph-mon[32421]: Scrub error on inode 0x10000000205 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/README) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.754 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:41 smithi050 ceph-mon[32421]: Scrub error on inode 0x10000000212 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95182.res) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.754 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:41 smithi050 ceph-mon[32421]: Scrub error on inode 0x10000000211 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95183.res) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.754 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:41 smithi050 ceph-mon[32421]: Scrub error on inode 0x1000000020a (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95180.io) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.754 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:41 smithi050 ceph-mon[32421]: Scrub error on inode 0x10000000206 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/Makefile.bsd) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.754 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:41 smithi050 ceph-mon[32421]: Scrub error on inode 0x1000000020b (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95181.io) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.754 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:41 smithi050 ceph-mon[32421]: Scrub error on inode 0x1000000020c (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95183.io) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.754 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:41 smithi050 ceph-mon[32421]: Scrub error on inode 0x1000000020f (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95180.res) see mds.c log and `damage ls` output for details 2024-06-06T03:36:41.754 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:41 smithi050 ceph-mon[32421]: scrub summary: idle+waiting paths [/] 2024-06-06T03:36:41.754 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:41 smithi050 ceph-mon[32421]: scrub summary: idle+waiting paths [/] 2024-06-06T03:36:42.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:42 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:36:42.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:42 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:36:42.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:42 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:36:42.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:42 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:36:42.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:42 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:36:42.682 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:42 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:36:42.720 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:42 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:36:42.720 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:42 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:36:42.720 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:42 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:36:43.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:43 smithi122 ceph-mon[35759]: pgmap v733: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 26 MiB/s wr, 524 op/s 2024-06-06T03:36:43.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:43 smithi050 ceph-mon[32421]: pgmap v733: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 26 MiB/s wr, 524 op/s 2024-06-06T03:36:43.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:43 smithi079 ceph-mon[35478]: pgmap v733: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 26 MiB/s wr, 524 op/s 2024-06-06T03:36:44.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:44 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mon-a[32417]: 2024-06-06T03:36:44.428+0000 7fd89dfbc700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-06-06T03:36:44.691 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:44 smithi050 ceph-mon[32421]: pgmap v734: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 26 MiB/s wr, 518 op/s 2024-06-06T03:36:44.691 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:44 smithi050 ceph-mon[32421]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-06-06T03:36:44.691 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:44 smithi050 ceph-mon[32421]: mds.? [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] up:active 2024-06-06T03:36:44.691 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:44 smithi050 ceph-mon[32421]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:36:44.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:44 smithi079 ceph-mon[35478]: pgmap v734: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 26 MiB/s wr, 518 op/s 2024-06-06T03:36:44.849 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:44 smithi079 ceph-mon[35478]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-06-06T03:36:44.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:44 smithi079 ceph-mon[35478]: mds.? [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] up:active 2024-06-06T03:36:44.850 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:44 smithi079 ceph-mon[35478]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:36:44.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:44 smithi122 ceph-mon[35759]: pgmap v734: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 26 MiB/s wr, 518 op/s 2024-06-06T03:36:44.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:44 smithi122 ceph-mon[35759]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-06-06T03:36:44.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:44 smithi122 ceph-mon[35759]: mds.? [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] up:active 2024-06-06T03:36:44.931 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:44 smithi122 ceph-mon[35759]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:36:45.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.023+0000 7f5924a09700 1 -- 172.21.15.50:0/1653734857 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f592010de50 msgr2=0x7f592007a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:45.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.023+0000 7f5924a09700 1 --2- 172.21.15.50:0/1653734857 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f592010de50 0x7f592007a7a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5918009f90 tx=0x7f591800b780 comp rx=0 tx=0).stop 2024-06-06T03:36:45.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.024+0000 7f5924a09700 1 -- 172.21.15.50:0/1653734857 shutdown_connections 2024-06-06T03:36:45.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.024+0000 7f5924a09700 1 --2- 172.21.15.50:0/1653734857 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f592010de50 0x7f592007a7a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.024+0000 7f5924a09700 1 --2- 172.21.15.50:0/1653734857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59201096f0 0x7f5920109ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.024+0000 7f5924a09700 1 --2- 172.21.15.50:0/1653734857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f592010a0a0 0x7f592010d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.024+0000 7f5924a09700 1 -- 172.21.15.50:0/1653734857 >> 172.21.15.50:0/1653734857 conn(0x7f592006d600 msgr2=0x7f592006da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:45.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.027+0000 7f5924a09700 1 -- 172.21.15.50:0/1653734857 shutdown_connections 2024-06-06T03:36:45.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.028+0000 7f5924a09700 1 -- 172.21.15.50:0/1653734857 wait complete. 2024-06-06T03:36:45.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.029+0000 7f5924a09700 1 Processor -- start 2024-06-06T03:36:45.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.029+0000 7f5924a09700 1 -- start start 2024-06-06T03:36:45.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.029+0000 7f5924a09700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f59201096f0 0x7f59200850b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:45.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.029+0000 7f5924a09700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f592010a0a0 0x7f592007f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:45.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.029+0000 7f5924a09700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f592010de50 0x7f592007f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:45.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.029+0000 7f5924a09700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f592007db00 con 0x7f592010de50 2024-06-06T03:36:45.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.029+0000 7f5924a09700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f592007d980 con 0x7f592010a0a0 2024-06-06T03:36:45.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.029+0000 7f5924a09700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f592007dc80 con 0x7f59201096f0 2024-06-06T03:36:45.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.030+0000 7f591ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f592010de50 0x7f592007f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:45.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.030+0000 7f591ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f592010de50 0x7f592007f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60110/0 (socket says 172.21.15.50:60110) 2024-06-06T03:36:45.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.030+0000 7f591ed9d700 1 -- 172.21.15.50:0/246020811 learned_addr learned my addr 172.21.15.50:0/246020811 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:45.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.031+0000 7f591ed9d700 1 -- 172.21.15.50:0/246020811 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f59201096f0 msgr2=0x7f59200850b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:45.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.031+0000 7f591ed9d700 1 --2- 172.21.15.50:0/246020811 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f59201096f0 0x7f59200850b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.031+0000 7f591ed9d700 1 -- 172.21.15.50:0/246020811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f592010a0a0 msgr2=0x7f592007f130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T03:36:45.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.031+0000 7f591ed9d700 1 --2- 172.21.15.50:0/246020811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f592010a0a0 0x7f592007f130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.031+0000 7f591ed9d700 1 -- 172.21.15.50:0/246020811 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59201b6670 con 0x7f592010de50 2024-06-06T03:36:45.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.031+0000 7f591ed9d700 1 --2- 172.21.15.50:0/246020811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f592010de50 0x7f592007f770 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f5918004fd0 tx=0x7f591800cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:45.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.036+0000 7f590f7fe700 1 -- 172.21.15.50:0/246020811 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5918021070 con 0x7f592010de50 2024-06-06T03:36:45.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.036+0000 7f590f7fe700 1 -- 172.21.15.50:0/246020811 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5918007bb0 con 0x7f592010de50 2024-06-06T03:36:45.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.036+0000 7f590f7fe700 1 -- 172.21.15.50:0/246020811 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591801d6b0 con 0x7f592010de50 2024-06-06T03:36:45.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.036+0000 7f5924a09700 1 -- 172.21.15.50:0/246020811 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59201b6900 con 0x7f592010de50 2024-06-06T03:36:45.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.036+0000 7f5924a09700 1 -- 172.21.15.50:0/246020811 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59201b6df0 con 0x7f592010de50 2024-06-06T03:36:45.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.042+0000 7f592f28cb80 1 Processor -- start 2024-06-06T03:36:45.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.042+0000 7f592f28cb80 1 -- start start 2024-06-06T03:36:45.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.043+0000 7f592f28cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576502ebf60 0x5576502ec340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:45.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.043+0000 7f592f28cb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576502ec880 0x5576502e6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:45.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.043+0000 7f592f28cb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576502e67a0 0x5576502e6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:45.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.043+0000 7f592f28cb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5576501d8f60 con 0x5576502ec880 2024-06-06T03:36:45.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.043+0000 7f592f28cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557650237850 con 0x5576502ebf60 2024-06-06T03:36:45.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.043+0000 7f592f28cb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55765019f460 con 0x5576502e67a0 2024-06-06T03:36:45.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.046+0000 7f590f7fe700 1 -- 172.21.15.50:0/246020811 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5918024070 con 0x7f592010de50 2024-06-06T03:36:45.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.047+0000 7f590f7fe700 1 --2- 172.21.15.50:0/246020811 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f59080a2da0 0x7f59080a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:45.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.047+0000 7f590f7fe700 1 -- 172.21.15.50:0/246020811 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f591800f020 con 0x7f592010de50 2024-06-06T03:36:45.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.049+0000 7f591ed9d700 1 --2- 172.21.15.50:0/246020811 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f59080a2da0 0x7f59080a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:45.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.051+0000 7f591ed9d700 1 --2- 172.21.15.50:0/246020811 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f59080a2da0 0x7f59080a5260 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f59180991c0 tx=0x7f591800b780 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:45.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.053+0000 7f591e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576502ec880 0x5576502e6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:45.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.053+0000 7f591e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576502ec880 0x5576502e6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60114/0 (socket says 172.21.15.50:60114) 2024-06-06T03:36:45.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.053+0000 7f591e59c700 1 -- 172.21.15.50:0/3644778539 learned_addr learned my addr 172.21.15.50:0/3644778539 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:45.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.057+0000 7f591e59c700 1 -- 172.21.15.50:0/3644778539 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576502e67a0 msgr2=0x5576502e6bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:36:45.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.057+0000 7f591e59c700 1 --2- 172.21.15.50:0/3644778539 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576502e67a0 0x5576502e6bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.057+0000 7f591e59c700 1 -- 172.21.15.50:0/3644778539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576502ebf60 msgr2=0x5576502ec340 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:36:45.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.057+0000 7f591e59c700 1 --2- 172.21.15.50:0/3644778539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576502ebf60 0x5576502ec340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.057+0000 7f591e59c700 1 -- 172.21.15.50:0/3644778539 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576501868d0 con 0x5576502ec880 2024-06-06T03:36:45.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.057+0000 7f591e59c700 1 --2- 172.21.15.50:0/3644778539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576502ec880 0x5576502e6260 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f591000bb90 tx=0x7f591000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6d343a2f4e27eb server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:45.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.058+0000 7f590cff9700 1 -- 172.21.15.50:0/3644778539 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5910016070 con 0x5576502ec880 2024-06-06T03:36:45.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.058+0000 7f590cff9700 1 -- 172.21.15.50:0/3644778539 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5910004830 con 0x5576502ec880 2024-06-06T03:36:45.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.058+0000 7f590cff9700 1 -- 172.21.15.50:0/3644778539 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5910005510 con 0x5576502ec880 2024-06-06T03:36:45.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.059+0000 7f592f28cb80 1 -- 172.21.15.50:0/3644778539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576502ec880 msgr2=0x5576502e6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:45.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.059+0000 7f592f28cb80 1 --2- 172.21.15.50:0/3644778539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576502ec880 0x5576502e6260 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f591000bb90 tx=0x7f591000bea0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.059+0000 7f592f28cb80 1 -- 172.21.15.50:0/3644778539 shutdown_connections 2024-06-06T03:36:45.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.059+0000 7f592f28cb80 1 --2- 172.21.15.50:0/3644778539 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576502e67a0 0x5576502e6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.059+0000 7f592f28cb80 1 --2- 172.21.15.50:0/3644778539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576502ebf60 0x5576502ec340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.059+0000 7f592f28cb80 1 --2- 172.21.15.50:0/3644778539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576502ec880 0x5576502e6260 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.059+0000 7f592f28cb80 1 -- 172.21.15.50:0/3644778539 >> 172.21.15.50:0/3644778539 conn(0x557650213080 msgr2=0x5576502e1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:45.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.061+0000 7f592f28cb80 1 -- 172.21.15.50:0/3644778539 shutdown_connections 2024-06-06T03:36:45.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.061+0000 7f592f28cb80 1 -- 172.21.15.50:0/3644778539 wait complete. 2024-06-06T03:36:45.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.061+0000 7f592f28cb80 1 -- start start 2024-06-06T03:36:45.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.061+0000 7f592f28cb80 1 Processor -- start 2024-06-06T03:36:45.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.062+0000 7f592f28cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576502ec880 0x5576502f27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:45.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.062+0000 7f592f28cb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576502efae0 0x5576502eff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:45.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.062+0000 7f592f28cb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576502f04a0 0x5576502fc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:45.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.062+0000 7f592f28cb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5576501d7fc0 con 0x5576502efae0 2024-06-06T03:36:45.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.062+0000 7f592f28cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557650233810 con 0x5576502ec880 2024-06-06T03:36:45.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.062+0000 7f592f28cb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5576502f3260 con 0x5576502f04a0 2024-06-06T03:36:45.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.062+0000 7f592f28cb80 10 client.0 _ll_register_callbacks cb 0x5576501cd5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:36:45.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.062+0000 7f591dd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576502ec880 0x5576502f27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:45.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.062+0000 7f591dd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576502ec880 0x5576502f27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:44280/0 (socket says 172.21.15.50:44280) 2024-06-06T03:36:45.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.062+0000 7f591dd9b700 1 -- 172.21.15.50:0/2054191905 learned_addr learned my addr 172.21.15.50:0/2054191905 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:45.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.062+0000 7f591dd9b700 1 --2- 172.21.15.50:0/2054191905 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576502f04a0 0x5576502fc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:45.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.063+0000 7f591dd9b700 1 -- 172.21.15.50:0/2054191905 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576502f04a0 msgr2=0x5576502fc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:45.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.063+0000 7f591dd9b700 1 --2- 172.21.15.50:0/2054191905 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576502f04a0 0x5576502fc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.063+0000 7f591dd9b700 1 -- 172.21.15.50:0/2054191905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576502efae0 msgr2=0x5576502eff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:45.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.063+0000 7f591dd9b700 1 --2- 172.21.15.50:0/2054191905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576502efae0 0x5576502eff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.063+0000 7f591dd9b700 1 -- 172.21.15.50:0/2054191905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576501fd750 con 0x5576502ec880 2024-06-06T03:36:45.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.063+0000 7f591dd9b700 1 --2- 172.21.15.50:0/2054191905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576502ec880 0x5576502f27e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f592006bc00 tx=0x7f5914009530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e266af587d6cb373 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:45.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.068+0000 7f5905ffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:36:45.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.068+0000 7f5905ffb700 1 -- 172.21.15.50:0/2054191905 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5914004030 con 0x5576502ec880 2024-06-06T03:36:45.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.068+0000 7f5905ffb700 1 -- 172.21.15.50:0/2054191905 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f59140041d0 con 0x5576502ec880 2024-06-06T03:36:45.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.069+0000 7f592f28cb80 1 -- 172.21.15.50:0/2054191905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5910004830 con 0x5576502ec880 2024-06-06T03:36:45.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.069+0000 7f5905ffb700 1 -- 172.21.15.50:0/2054191905 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f59140043d0 con 0x5576502ec880 2024-06-06T03:36:45.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.071+0000 7f592f28cb80 10 client.26411 fetch_fsmap learned FSMap version 36 2024-06-06T03:36:45.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.071+0000 7f592f28cb80 1 -- 172.21.15.50:0/2054191905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5576502fe430 con 0x5576502ec880 2024-06-06T03:36:45.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.075+0000 7f5905ffb700 1 -- 172.21.15.50:0/2054191905 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5910004830 con 0x5576502ec880 2024-06-06T03:36:45.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.075+0000 7f5905ffb700 1 -- 172.21.15.50:0/2054191905 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7f59140036e0 con 0x5576502ec880 2024-06-06T03:36:45.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.076+0000 7f592f28cb80 10 client.26411 fetch_fsmap finished waiting for FSMap version 36 2024-06-06T03:36:45.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.076+0000 7f592f28cb80 10 client.26411 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:36:45.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.077+0000 7f592f28cb80 20 client.26411 populate_metadata read hostname 'smithi050' 2024-06-06T03:36:45.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.077+0000 7f592f28cb80 1 --2- 172.21.15.50:0/2054191905 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x557650300b10 0x557650302f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:45.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.077+0000 7f592f28cb80 4 client.26411 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:36:45.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.077+0000 7f592f28cb80 1 -- 172.21.15.50:0/2054191905 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557650244d50 con 0x557650300b10 2024-06-06T03:36:45.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.078+0000 7f591e59c700 1 --2- 172.21.15.50:0/2054191905 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x557650300b10 0x557650302f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:45.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.079+0000 7f591e59c700 1 --2- 172.21.15.50:0/2054191905 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x557650300b10 0x557650302f70 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=463d9830d2b01e2a server_cookie=ad67c14a37e97c73 in_seq=0 out_seq=0 2024-06-06T03:36:45.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.079+0000 7f5905ffb700 10 client.26411 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:45.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.083+0000 7f5905ffb700 1 -- 172.21.15.50:0/2054191905 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x557650244d50 con 0x557650300b10 2024-06-06T03:36:45.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.083+0000 7f5905ffb700 10 client.26411 handle_command_reply: tid=0 2024-06-06T03:36:45.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.084+0000 7f592f28cb80 1 client.26411 shutdown 2024-06-06T03:36:45.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.086+0000 7f592f28cb80 1 -- 172.21.15.50:0/2054191905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576502ec880 msgr2=0x5576502f27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:45.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.087+0000 7f592f28cb80 1 --2- 172.21.15.50:0/2054191905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576502ec880 0x5576502f27e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f592006bc00 tx=0x7f5914009530 comp rx=0 tx=0).stop 2024-06-06T03:36:45.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.093+0000 7f592f28cb80 1 -- 172.21.15.50:0/2054191905 shutdown_connections 2024-06-06T03:36:45.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.093+0000 7f592f28cb80 1 --2- 172.21.15.50:0/2054191905 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x557650300b10 0x557650302f70 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.093+0000 7f592f28cb80 1 --2- 172.21.15.50:0/2054191905 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576502f04a0 0x5576502fc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.093+0000 7f592f28cb80 1 --2- 172.21.15.50:0/2054191905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576502ec880 0x5576502f27e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.093+0000 7f592f28cb80 1 --2- 172.21.15.50:0/2054191905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576502efae0 0x5576502eff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.093+0000 7f592f28cb80 1 -- 172.21.15.50:0/2054191905 >> 172.21.15.50:0/2054191905 conn(0x557650213080 msgr2=0x5576502e0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:45.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.093+0000 7f5905ffb700 0 client.26411 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:45.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.093+0000 7f592f28cb80 1 -- 172.21.15.50:0/2054191905 shutdown_connections 2024-06-06T03:36:45.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.093+0000 7f592f28cb80 1 -- 172.21.15.50:0/2054191905 wait complete. 2024-06-06T03:36:45.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.094+0000 7f592f28cb80 20 client.26411 trim_cache size 0 max 16384 2024-06-06T03:36:45.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.135+0000 7f592f28cb80 1 Processor -- start 2024-06-06T03:36:45.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.135+0000 7f592f28cb80 1 -- start start 2024-06-06T03:36:45.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.136+0000 7f592f28cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576502ec880 0x5576502e6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:45.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.136+0000 7f592f28cb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576502efae0 0x5576502fc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:45.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.136+0000 7f592f28cb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576502f04a0 0x5576502eb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:45.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.136+0000 7f591e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576502efae0 0x5576502fc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:45.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.136+0000 7f591e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576502efae0 0x5576502fc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60140/0 (socket says 172.21.15.50:60140) 2024-06-06T03:36:45.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.137+0000 7f591e59c700 1 -- 172.21.15.50:0/2064028405 learned_addr learned my addr 172.21.15.50:0/2064028405 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:45.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.137+0000 7f592f28cb80 1 -- 172.21.15.50:0/2064028405 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5900011430 con 0x5576502efae0 2024-06-06T03:36:45.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.137+0000 7f592f28cb80 1 -- 172.21.15.50:0/2064028405 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f590000ecc0 con 0x5576502ec880 2024-06-06T03:36:45.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.137+0000 7f592f28cb80 1 -- 172.21.15.50:0/2064028405 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f590000cb10 con 0x5576502f04a0 2024-06-06T03:36:45.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.139+0000 7f591e59c700 1 -- 172.21.15.50:0/2064028405 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576502f04a0 msgr2=0x5576502eb2f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:36:45.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.139+0000 7f591e59c700 1 --2- 172.21.15.50:0/2064028405 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576502f04a0 0x5576502eb2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.139+0000 7f591e59c700 1 -- 172.21.15.50:0/2064028405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576502ec880 msgr2=0x5576502e6260 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:36:45.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.139+0000 7f591e59c700 1 --2- 172.21.15.50:0/2064028405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576502ec880 0x5576502e6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.139+0000 7f591e59c700 1 -- 172.21.15.50:0/2064028405 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576502f30a0 con 0x5576502efae0 2024-06-06T03:36:45.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.139+0000 7f591e59c700 1 --2- 172.21.15.50:0/2064028405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576502efae0 0x5576502fc430 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f5910017000 tx=0x7f5910005220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7525a860223758e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:45.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.140+0000 7f5907fff700 1 -- 172.21.15.50:0/2064028405 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5910016050 con 0x5576502efae0 2024-06-06T03:36:45.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.140+0000 7f5907fff700 1 -- 172.21.15.50:0/2064028405 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5910004da0 con 0x5576502efae0 2024-06-06T03:36:45.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.141+0000 7f592f28cb80 1 -- 172.21.15.50:0/2064028405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576502efae0 msgr2=0x5576502fc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:45.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.141+0000 7f592f28cb80 1 --2- 172.21.15.50:0/2064028405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576502efae0 0x5576502fc430 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f5910017000 tx=0x7f5910005220 comp rx=0 tx=0).stop 2024-06-06T03:36:45.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.144+0000 7f592f28cb80 1 -- 172.21.15.50:0/2064028405 shutdown_connections 2024-06-06T03:36:45.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.144+0000 7f592f28cb80 1 --2- 172.21.15.50:0/2064028405 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576502f04a0 0x5576502eb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.144+0000 7f592f28cb80 1 --2- 172.21.15.50:0/2064028405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576502ec880 0x5576502e6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.144+0000 7f592f28cb80 1 --2- 172.21.15.50:0/2064028405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576502efae0 0x5576502fc430 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.144+0000 7f592f28cb80 1 -- 172.21.15.50:0/2064028405 >> 172.21.15.50:0/2064028405 conn(0x557650213080 msgr2=0x5576502eabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:45.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.147+0000 7f592f28cb80 1 -- 172.21.15.50:0/2064028405 shutdown_connections 2024-06-06T03:36:45.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.147+0000 7f592f28cb80 1 -- 172.21.15.50:0/2064028405 wait complete. 2024-06-06T03:36:45.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.147+0000 7f592f28cb80 1 -- start start 2024-06-06T03:36:45.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.148+0000 7f592f28cb80 1 Processor -- start 2024-06-06T03:36:45.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.148+0000 7f592f28cb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576502ec880 0x5576502f85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:45.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.148+0000 7f592f28cb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576502efae0 0x5576502f8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:45.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.149+0000 7f592f28cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576502f04a0 0x5576502f5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:45.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.149+0000 7f591e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576502efae0 0x5576502f8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:45.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.149+0000 7f591e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576502efae0 0x5576502f8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60142/0 (socket says 172.21.15.50:60142) 2024-06-06T03:36:45.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.149+0000 7f591e59c700 1 -- 172.21.15.50:0/909829360 learned_addr learned my addr 172.21.15.50:0/909829360 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:45.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.149+0000 7f592f28cb80 1 -- 172.21.15.50:0/909829360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f590000d180 con 0x5576502efae0 2024-06-06T03:36:45.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.149+0000 7f592f28cb80 1 -- 172.21.15.50:0/909829360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f590000e5f0 con 0x5576502f04a0 2024-06-06T03:36:45.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.149+0000 7f592f28cb80 1 -- 172.21.15.50:0/909829360 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f590000d850 con 0x5576502ec880 2024-06-06T03:36:45.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.149+0000 7f592f28cb80 10 client.0 _ll_register_callbacks cb 0x5576501cd5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:36:45.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.149+0000 7f591dd9b700 1 --2- 172.21.15.50:0/909829360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576502f04a0 0x5576502f5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:45.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.150+0000 7f591dd9b700 1 -- 172.21.15.50:0/909829360 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576502ec880 msgr2=0x5576502f85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:45.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.150+0000 7f591dd9b700 1 --2- 172.21.15.50:0/909829360 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576502ec880 0x5576502f85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.150+0000 7f591dd9b700 1 -- 172.21.15.50:0/909829360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576502efae0 msgr2=0x5576502f8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:45.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.150+0000 7f591dd9b700 1 --2- 172.21.15.50:0/909829360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576502efae0 0x5576502f8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.150+0000 7f591dd9b700 1 -- 172.21.15.50:0/909829360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576502f5ab0 con 0x5576502f04a0 2024-06-06T03:36:45.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.150+0000 7f591dd9b700 1 --2- 172.21.15.50:0/909829360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576502f04a0 0x5576502f5570 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5914003ae0 tx=0x7f5914005b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cad4687452dcee12 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:45.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.153+0000 7f5905ffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:36:45.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.153+0000 7f5905ffb700 1 -- 172.21.15.50:0/909829360 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5914003cd0 con 0x5576502f04a0 2024-06-06T03:36:45.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.153+0000 7f5905ffb700 1 -- 172.21.15.50:0/909829360 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f5914003e70 con 0x5576502f04a0 2024-06-06T03:36:45.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.153+0000 7f592f28cb80 1 -- 172.21.15.50:0/909829360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55765023f2d0 con 0x5576502f04a0 2024-06-06T03:36:45.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.154+0000 7f5905ffb700 1 -- 172.21.15.50:0/909829360 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f5914004090 con 0x5576502f04a0 2024-06-06T03:36:45.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.158+0000 7f592f28cb80 10 client.26414 fetch_fsmap learned FSMap version 36 2024-06-06T03:36:45.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.158+0000 7f592f28cb80 1 -- 172.21.15.50:0/909829360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55765036bf50 con 0x5576502f04a0 2024-06-06T03:36:45.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.158+0000 7f5905ffb700 1 -- 172.21.15.50:0/909829360 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55765023f2d0 con 0x5576502f04a0 2024-06-06T03:36:45.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.159+0000 7f5905ffb700 1 -- 172.21.15.50:0/909829360 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7f59140051c0 con 0x5576502f04a0 2024-06-06T03:36:45.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.159+0000 7f592f28cb80 10 client.26414 fetch_fsmap finished waiting for FSMap version 36 2024-06-06T03:36:45.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.159+0000 7f592f28cb80 10 client.26414 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:36:45.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.159+0000 7f592f28cb80 20 client.26414 populate_metadata read hostname 'smithi050' 2024-06-06T03:36:45.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.159+0000 7f592f28cb80 1 --2- 172.21.15.50:0/909829360 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55765036c670 0x55765036ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:45.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.159+0000 7f592f28cb80 4 client.26414 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-06T03:36:45.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.159+0000 7f592f28cb80 1 -- 172.21.15.50:0/909829360 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5576501f2f50 con 0x55765036c670 2024-06-06T03:36:45.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.161+0000 7f591e59c700 1 --2- 172.21.15.50:0/909829360 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55765036c670 0x55765036ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:45.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.164+0000 7f591e59c700 1 --2- 172.21.15.50:0/909829360 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55765036c670 0x55765036ea90 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60b7548f454549c9 server_cookie=649be8965d17accd in_seq=0 out_seq=0 2024-06-06T03:36:45.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.164+0000 7f5905ffb700 10 client.26414 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:45.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.169+0000 7f5905ffb700 1 -- 172.21.15.50:0/909829360 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5576501f2f50 con 0x55765036c670 2024-06-06T03:36:45.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.169+0000 7f5905ffb700 10 client.26414 handle_command_reply: tid=0 2024-06-06T03:36:45.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.169+0000 7f592f28cb80 1 client.26414 shutdown 2024-06-06T03:36:45.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.171+0000 7f592f28cb80 1 -- 172.21.15.50:0/909829360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576502f04a0 msgr2=0x5576502f5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:45.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.171+0000 7f592f28cb80 1 --2- 172.21.15.50:0/909829360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576502f04a0 0x5576502f5570 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5914003ae0 tx=0x7f5914005b00 comp rx=0 tx=0).stop 2024-06-06T03:36:45.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.171+0000 7f592f28cb80 1 -- 172.21.15.50:0/909829360 shutdown_connections 2024-06-06T03:36:45.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.171+0000 7f592f28cb80 1 --2- 172.21.15.50:0/909829360 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55765036c670 0x55765036ea90 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.171+0000 7f592f28cb80 1 --2- 172.21.15.50:0/909829360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576502f04a0 0x5576502f5570 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.171+0000 7f592f28cb80 1 --2- 172.21.15.50:0/909829360 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5576502ec880 0x5576502f85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.171+0000 7f592f28cb80 1 --2- 172.21.15.50:0/909829360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576502efae0 0x5576502f8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.171+0000 7f592f28cb80 1 -- 172.21.15.50:0/909829360 >> 172.21.15.50:0/909829360 conn(0x557650213080 msgr2=0x5576502f1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:45.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.171+0000 7f5905ffb700 0 client.26414 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:45.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.174+0000 7f592f28cb80 1 -- 172.21.15.50:0/909829360 shutdown_connections 2024-06-06T03:36:45.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.175+0000 7f592f28cb80 1 -- 172.21.15.50:0/909829360 wait complete. 2024-06-06T03:36:45.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.175+0000 7f592f28cb80 20 client.26414 trim_cache size 0 max 16384 2024-06-06T03:36:45.177 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:36:45.177 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-06T03:36:45.177 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2024-06-06T03:36:45.177 INFO:teuthology.orchestra.run.smithi050.stdout: "12c1462f-42aa-49ea-8740-32d80bb329c5": { 2024-06-06T03:36:45.177 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2024-06-06T03:36:45.177 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "12c1462f-42aa-49ea-8740-32d80bb329c5", 2024-06-06T03:36:45.177 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "recursive,force" 2024-06-06T03:36:45.177 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:36:45.178 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:36:45.178 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:36:45.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.177+0000 7f5924a09700 1 -- 172.21.15.50:0/246020811 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f59080a2da0 msgr2=0x7f59080a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:45.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.177+0000 7f5924a09700 1 --2- 172.21.15.50:0/246020811 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f59080a2da0 0x7f59080a5260 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f59180991c0 tx=0x7f591800b780 comp rx=0 tx=0).stop 2024-06-06T03:36:45.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.177+0000 7f5924a09700 1 -- 172.21.15.50:0/246020811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f592010de50 msgr2=0x7f592007f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:45.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.177+0000 7f5924a09700 1 --2- 172.21.15.50:0/246020811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f592010de50 0x7f592007f770 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f5918004fd0 tx=0x7f591800cf70 comp rx=0 tx=0).stop 2024-06-06T03:36:45.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.177+0000 7f5924a09700 1 -- 172.21.15.50:0/246020811 shutdown_connections 2024-06-06T03:36:45.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.177+0000 7f5924a09700 1 --2- 172.21.15.50:0/246020811 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f59080a2da0 0x7f59080a5260 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.177+0000 7f5924a09700 1 --2- 172.21.15.50:0/246020811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f592010de50 0x7f592007f770 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.177+0000 7f5924a09700 1 --2- 172.21.15.50:0/246020811 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f59201096f0 0x7f59200850b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.177+0000 7f5924a09700 1 --2- 172.21.15.50:0/246020811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f592010a0a0 0x7f592007f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:45.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.177+0000 7f5924a09700 1 -- 172.21.15.50:0/246020811 >> 172.21.15.50:0/246020811 conn(0x7f592006d600 msgr2=0x7f59200794a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:45.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.180+0000 7f5924a09700 1 -- 172.21.15.50:0/246020811 shutdown_connections 2024-06-06T03:36:45.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:36:45.180+0000 7f5924a09700 1 -- 172.21.15.50:0/246020811 wait complete. 2024-06-06T03:36:46.006 INFO:tasks.cephfs.filesystem:scrub status for tag:12c1462f-42aa-49ea-8740-32d80bb329c5 - {'path': '/', 'tag': '12c1462f-42aa-49ea-8740-32d80bb329c5', 'options': 'recursive,force'} 2024-06-06T03:36:47.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:46 smithi050 ceph-mon[32421]: pgmap v735: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 30 MiB/s wr, 604 op/s 2024-06-06T03:36:47.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:46 smithi079 ceph-mon[35478]: pgmap v735: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 30 MiB/s wr, 604 op/s 2024-06-06T03:36:47.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:46 smithi122 ceph-mon[35759]: pgmap v735: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 30 MiB/s wr, 604 op/s 2024-06-06T03:36:48.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:47 smithi050 ceph-mon[32421]: scrub summary: idle 2024-06-06T03:36:48.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:47 smithi050 ceph-mon[32421]: scrub summary: idle 2024-06-06T03:36:48.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:47 smithi079 ceph-mon[35478]: scrub summary: idle 2024-06-06T03:36:48.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:47 smithi079 ceph-mon[35478]: scrub summary: idle 2024-06-06T03:36:48.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:47 smithi122 ceph-mon[35759]: scrub summary: idle 2024-06-06T03:36:48.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:47 smithi122 ceph-mon[35759]: scrub summary: idle 2024-06-06T03:36:49.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:48 smithi050 ceph-mon[32421]: pgmap v736: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 26 MiB/s wr, 526 op/s 2024-06-06T03:36:49.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:48 smithi079 ceph-mon[35478]: pgmap v736: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 26 MiB/s wr, 526 op/s 2024-06-06T03:36:49.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:48 smithi122 ceph-mon[35759]: pgmap v736: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 26 MiB/s wr, 526 op/s 2024-06-06T03:36:50.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.627+0000 7f9116610640 1 -- 172.21.15.50:0/2151112586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9110105590 msgr2=0x7f9110105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:50.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.627+0000 7f9116610640 1 --2- 172.21.15.50:0/2151112586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9110105590 0x7f9110105a10 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f9108009ca0 tx=0x7f910802a8f0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.630+0000 7f9116610640 1 -- 172.21.15.50:0/2151112586 shutdown_connections 2024-06-06T03:36:50.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.630+0000 7f9116610640 1 --2- 172.21.15.50:0/2151112586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9110105590 0x7f9110105a10 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.630+0000 7f9116610640 1 --2- 172.21.15.50:0/2151112586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9110102be0 0x7f9110105050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.630+0000 7f9116610640 1 --2- 172.21.15.50:0/2151112586 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9110100270 0x7f91101026a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.630+0000 7f9116610640 1 -- 172.21.15.50:0/2151112586 >> 172.21.15.50:0/2151112586 conn(0x7f91100fbe70 msgr2=0x7f91100fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:50.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.640+0000 7f9116610640 1 -- 172.21.15.50:0/2151112586 shutdown_connections 2024-06-06T03:36:50.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.645+0000 7f9116610640 1 -- 172.21.15.50:0/2151112586 wait complete. 2024-06-06T03:36:50.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.645+0000 7f9116610640 1 Processor -- start 2024-06-06T03:36:50.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.648+0000 7f9116610640 1 -- start start 2024-06-06T03:36:50.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.649+0000 7f9116610640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9110100270 0x7f911010eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:50.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.649+0000 7f9116610640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9110102be0 0x7f911010f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:50.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.649+0000 7f9116610640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9110105590 0x7f9110110040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.649+0000 7f9116610640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9110107190 con 0x7f9110102be0 2024-06-06T03:36:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.649+0000 7f9116610640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9110107010 con 0x7f9110105590 2024-06-06T03:36:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.649+0000 7f9116610640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9110107310 con 0x7f9110100270 2024-06-06T03:36:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.649+0000 7f910f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9110102be0 0x7f911010f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:50.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.649+0000 7f910f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9110102be0 0x7f911010f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58824/0 (socket says 172.21.15.50:58824) 2024-06-06T03:36:50.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.649+0000 7f910f7fe640 1 -- 172.21.15.50:0/618993459 learned_addr learned my addr 172.21.15.50:0/618993459 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:50.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.652+0000 7f9114bad640 1 --2- 172.21.15.50:0/618993459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9110105590 0x7f9110110040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:50.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.653+0000 7f910ffff640 1 --2- 172.21.15.50:0/618993459 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9110100270 0x7f911010eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:50.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.653+0000 7f910f7fe640 1 -- 172.21.15.50:0/618993459 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9110100270 msgr2=0x7f911010eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:50.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.653+0000 7f910f7fe640 1 --2- 172.21.15.50:0/618993459 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9110100270 0x7f911010eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.654+0000 7f910f7fe640 1 -- 172.21.15.50:0/618993459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9110105590 msgr2=0x7f9110110040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:50.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.654+0000 7f910f7fe640 1 --2- 172.21.15.50:0/618993459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9110105590 0x7f9110110040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.654+0000 7f910f7fe640 1 -- 172.21.15.50:0/618993459 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91101106b0 con 0x7f9110102be0 2024-06-06T03:36:50.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.656+0000 7f910f7fe640 1 --2- 172.21.15.50:0/618993459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9110102be0 0x7f911010f0a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f910000b450 tx=0x7f910000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:50.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.658+0000 7f910d7fa640 1 -- 172.21.15.50:0/618993459 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9100015020 con 0x7f9110102be0 2024-06-06T03:36:50.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.658+0000 7f910d7fa640 1 -- 172.21.15.50:0/618993459 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9100011d40 con 0x7f9110102be0 2024-06-06T03:36:50.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.658+0000 7f910d7fa640 1 -- 172.21.15.50:0/618993459 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910000f340 con 0x7f9110102be0 2024-06-06T03:36:50.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.662+0000 7f9116610640 1 -- 172.21.15.50:0/618993459 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9110110940 con 0x7f9110102be0 2024-06-06T03:36:50.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.662+0000 7f9116610640 1 -- 172.21.15.50:0/618993459 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9110110e90 con 0x7f9110102be0 2024-06-06T03:36:50.681 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.678+0000 7f91193f3740 1 Processor -- start 2024-06-06T03:36:50.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.682+0000 7f910d7fa640 1 -- 172.21.15.50:0/618993459 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9100018020 con 0x7f9110102be0 2024-06-06T03:36:50.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.683+0000 7f910d7fa640 1 --2- 172.21.15.50:0/618993459 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f90f80a2e70 0x7f90f80a5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:50.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.683+0000 7f910d7fa640 1 -- 172.21.15.50:0/618993459 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f91000ced10 con 0x7f9110102be0 2024-06-06T03:36:50.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.683+0000 7f91193f3740 1 -- start start 2024-06-06T03:36:50.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.683+0000 7f91193f3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647ddf12010 0x5647ddf12430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:50.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.683+0000 7f91193f3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5647ddf12a00 0x5647ddf17500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:50.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.683+0000 7f91193f3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647ddf17b70 0x5647ddf1a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:50.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.683+0000 7f91193f3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5647dde754f0 con 0x5647ddf17b70 2024-06-06T03:36:50.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.683+0000 7f91193f3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5647dde13870 con 0x5647ddf12010 2024-06-06T03:36:50.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.684+0000 7f91193f3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5647dde714b0 con 0x5647ddf12a00 2024-06-06T03:36:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.685+0000 7f910f7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5647ddf12a00 0x5647ddf17500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.686+0000 7f910ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647ddf12010 0x5647ddf12430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.686+0000 7f910f7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5647ddf12a00 0x5647ddf17500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:33918/0 (socket says 172.21.15.50:33918) 2024-06-06T03:36:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.686+0000 7f910f7fe640 1 -- 172.21.15.50:0/1960049893 learned_addr learned my addr 172.21.15.50:0/1960049893 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.686+0000 7f9114bad640 1 --2- 172.21.15.50:0/1960049893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647ddf17b70 0x5647ddf1a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.686+0000 7f9114bad640 1 --2- 172.21.15.50:0/618993459 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f90f80a2e70 0x7f90f80a5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.688+0000 7f910f7fe640 1 -- 172.21.15.50:0/1960049893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647ddf12010 msgr2=0x5647ddf12430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:50.690 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.688+0000 7f910f7fe640 1 --2- 172.21.15.50:0/1960049893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647ddf12010 0x5647ddf12430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.690 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.688+0000 7f910f7fe640 1 -- 172.21.15.50:0/1960049893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647ddf17b70 msgr2=0x5647ddf1a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:50.690 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.688+0000 7f910f7fe640 1 --2- 172.21.15.50:0/1960049893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647ddf17b70 0x5647ddf1a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.690 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.688+0000 7f910f7fe640 1 -- 172.21.15.50:0/1960049893 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647dde2f9b0 con 0x5647ddf12a00 2024-06-06T03:36:50.690 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.689+0000 7f910f7fe640 1 --2- 172.21.15.50:0/1960049893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5647ddf12a00 0x5647ddf17500 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f910009ae90 tx=0x7f9100010eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bca459bc217034ae server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:50.693 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.689+0000 7f90f67fc640 1 -- 172.21.15.50:0/1960049893 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910009b190 con 0x5647ddf12a00 2024-06-06T03:36:50.693 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.689+0000 7f90f67fc640 1 -- 172.21.15.50:0/1960049893 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f910009f540 con 0x5647ddf12a00 2024-06-06T03:36:50.693 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.689+0000 7f90f67fc640 1 -- 172.21.15.50:0/1960049893 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91000bb0b0 con 0x5647ddf12a00 2024-06-06T03:36:50.693 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.693+0000 7f91193f3740 1 -- 172.21.15.50:0/1960049893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5647ddf12a00 msgr2=0x5647ddf17500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:50.693 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.693+0000 7f91193f3740 1 --2- 172.21.15.50:0/1960049893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5647ddf12a00 0x5647ddf17500 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f910009ae90 tx=0x7f9100010eb0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.697+0000 7f9114bad640 1 --2- 172.21.15.50:0/618993459 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f90f80a2e70 0x7f90f80a5330 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f910802f570 tx=0x7f910802a8f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:50.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.697+0000 7f91193f3740 1 -- 172.21.15.50:0/1960049893 shutdown_connections 2024-06-06T03:36:50.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.697+0000 7f91193f3740 1 --2- 172.21.15.50:0/1960049893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647ddf17b70 0x5647ddf1a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.697+0000 7f91193f3740 1 --2- 172.21.15.50:0/1960049893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5647ddf12a00 0x5647ddf17500 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.697+0000 7f91193f3740 1 --2- 172.21.15.50:0/1960049893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647ddf12010 0x5647ddf12430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.697+0000 7f91193f3740 1 -- 172.21.15.50:0/1960049893 >> 172.21.15.50:0/1960049893 conn(0x5647ddf0d680 msgr2=0x5647ddf0da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:50.704 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.702+0000 7f91193f3740 1 -- 172.21.15.50:0/1960049893 shutdown_connections 2024-06-06T03:36:50.704 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.705+0000 7f91193f3740 1 -- 172.21.15.50:0/1960049893 wait complete. 2024-06-06T03:36:50.709 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.705+0000 7f91193f3740 1 -- start start 2024-06-06T03:36:50.709 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.705+0000 7f91193f3740 1 Processor -- start 2024-06-06T03:36:50.709 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.706+0000 7f91193f3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647ddf12010 0x5647ddf1c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:50.709 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.706+0000 7f91193f3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647ddf12a00 0x5647ddf1c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:50.710 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.706+0000 7f91193f3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5647ddf17b70 0x5647ddf237a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:50.710 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.706+0000 7f91193f3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5647ddf1ab20 con 0x5647ddf12a00 2024-06-06T03:36:50.710 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.706+0000 7f91193f3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5647dddfeae0 con 0x5647ddf12010 2024-06-06T03:36:50.710 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.706+0000 7f91193f3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5647ddf1aca0 con 0x5647ddf17b70 2024-06-06T03:36:50.710 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.706+0000 7f91193f3740 10 client.0 _ll_register_callbacks cb 0x5647dde379b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:36:50.710 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.707+0000 7f9114bad640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5647ddf17b70 0x5647ddf237a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:50.710 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.709+0000 7f9114bad640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5647ddf17b70 0x5647ddf237a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:33932/0 (socket says 172.21.15.50:33932) 2024-06-06T03:36:50.710 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.709+0000 7f9114bad640 1 -- 172.21.15.50:0/3193360703 learned_addr learned my addr 172.21.15.50:0/3193360703 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:50.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.710+0000 7f910f7fe640 1 --2- 172.21.15.50:0/3193360703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647ddf12a00 0x5647ddf1c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:50.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.712+0000 7f9114bad640 1 -- 172.21.15.50:0/3193360703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647ddf12010 msgr2=0x5647ddf1c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:50.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.712+0000 7f9114bad640 1 --2- 172.21.15.50:0/3193360703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647ddf12010 0x5647ddf1c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.712+0000 7f9114bad640 1 -- 172.21.15.50:0/3193360703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647ddf12a00 msgr2=0x5647ddf1c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:36:50.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.712+0000 7f9114bad640 1 --2- 172.21.15.50:0/3193360703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647ddf12a00 0x5647ddf1c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.712+0000 7f9114bad640 1 -- 172.21.15.50:0/3193360703 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647ddb89210 con 0x5647ddf17b70 2024-06-06T03:36:50.724 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.719+0000 7f9114bad640 1 --2- 172.21.15.50:0/3193360703 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5647ddf17b70 0x5647ddf237a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9108035000 tx=0x7f91080095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c12c28c96fc7d56 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:50.724 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.719+0000 7f90ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:36:50.724 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.722+0000 7f90ef7fe640 1 -- 172.21.15.50:0/3193360703 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910804f030 con 0x5647ddf17b70 2024-06-06T03:36:50.724 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.723+0000 7f91193f3740 1 -- 172.21.15.50:0/3193360703 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f910009f540 con 0x5647ddf17b70 2024-06-06T03:36:50.724 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.723+0000 7f90ef7fe640 1 -- 172.21.15.50:0/3193360703 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f9108003e00 con 0x5647ddf17b70 2024-06-06T03:36:50.724 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.725+0000 7f90ef7fe640 1 -- 172.21.15.50:0/3193360703 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f910805c050 con 0x5647ddf17b70 2024-06-06T03:36:50.733 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.731+0000 7f91193f3740 10 client.26446 fetch_fsmap learned FSMap version 36 2024-06-06T03:36:50.733 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.731+0000 7f91193f3740 1 -- 172.21.15.50:0/3193360703 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5647ddc55620 con 0x5647ddf17b70 2024-06-06T03:36:50.737 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.736+0000 7f90ef7fe640 1 -- 172.21.15.50:0/3193360703 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f910009f540 con 0x5647ddf17b70 2024-06-06T03:36:50.737 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.737+0000 7f90ef7fe640 1 -- 172.21.15.50:0/3193360703 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7f910804a040 con 0x5647ddf17b70 2024-06-06T03:36:50.737 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.737+0000 7f91193f3740 10 client.26446 fetch_fsmap finished waiting for FSMap version 36 2024-06-06T03:36:50.737 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.737+0000 7f91193f3740 10 client.26446 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:36:50.737 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.737+0000 7f91193f3740 20 client.26446 populate_metadata read hostname 'smithi050' 2024-06-06T03:36:50.737 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.737+0000 7f91193f3740 1 --2- 172.21.15.50:0/3193360703 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5647ddf285e0 0x5647ddf2aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:50.737 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.737+0000 7f91193f3740 4 client.26446 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:36:50.738 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.737+0000 7f91193f3740 1 -- 172.21.15.50:0/3193360703 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5647dde88f10 con 0x5647ddf285e0 2024-06-06T03:36:50.740 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.740+0000 7f910ffff640 1 --2- 172.21.15.50:0/3193360703 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5647ddf285e0 0x5647ddf2aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:50.741 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.742+0000 7f910ffff640 1 --2- 172.21.15.50:0/3193360703 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5647ddf285e0 0x5647ddf2aa80 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=255af525d7bdb6f4 server_cookie=49776c77d907d2ff in_seq=0 out_seq=0 2024-06-06T03:36:50.744 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.744+0000 7f90ef7fe640 10 client.26446 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:50.744 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.744+0000 7f90ef7fe640 1 -- 172.21.15.50:0/3193360703 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5647dde88f10 con 0x5647ddf285e0 2024-06-06T03:36:50.744 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.744+0000 7f90ef7fe640 10 client.26446 handle_command_reply: tid=0 2024-06-06T03:36:50.745 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.744+0000 7f91193f3740 1 client.26446 shutdown 2024-06-06T03:36:50.745 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.745+0000 7f91193f3740 1 -- 172.21.15.50:0/3193360703 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5647ddf17b70 msgr2=0x5647ddf237a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:50.745 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.745+0000 7f91193f3740 1 --2- 172.21.15.50:0/3193360703 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5647ddf17b70 0x5647ddf237a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9108035000 tx=0x7f91080095c0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.756 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.755+0000 7f91193f3740 1 -- 172.21.15.50:0/3193360703 shutdown_connections 2024-06-06T03:36:50.756 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.755+0000 7f91193f3740 1 --2- 172.21.15.50:0/3193360703 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5647ddf285e0 0x5647ddf2aa80 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.756 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.755+0000 7f91193f3740 1 --2- 172.21.15.50:0/3193360703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647ddf12a00 0x5647ddf1c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.756 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.755+0000 7f91193f3740 1 --2- 172.21.15.50:0/3193360703 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5647ddf17b70 0x5647ddf237a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.756 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.755+0000 7f91193f3740 1 --2- 172.21.15.50:0/3193360703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647ddf12010 0x5647ddf1c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.756 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.755+0000 7f91193f3740 1 -- 172.21.15.50:0/3193360703 >> 172.21.15.50:0/3193360703 conn(0x5647ddf0d680 msgr2=0x5647ddf0c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:50.756 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.755+0000 7f90ef7fe640 0 client.26446 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:50.758 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.758+0000 7f91193f3740 1 -- 172.21.15.50:0/3193360703 shutdown_connections 2024-06-06T03:36:50.760 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.760+0000 7f91193f3740 1 -- 172.21.15.50:0/3193360703 wait complete. 2024-06-06T03:36:50.761 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.761+0000 7f91193f3740 20 client.26446 trim_cache size 0 max 16384 2024-06-06T03:36:50.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.805+0000 7f91193f3740 1 Processor -- start 2024-06-06T03:36:50.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.805+0000 7f91193f3740 1 -- start start 2024-06-06T03:36:50.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.805+0000 7f91193f3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647ddf12010 0x5647ddf2a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:50.807 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.805+0000 7f91193f3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647ddf12a00 0x5647ddf23760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:50.807 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.805+0000 7f91193f3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5647ddf17b70 0x5647ddf1c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:50.807 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.805+0000 7f91193f3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f91101c42d0 con 0x5647ddf12010 2024-06-06T03:36:50.807 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.805+0000 7f91193f3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f91101c1ba0 con 0x5647ddf12a00 2024-06-06T03:36:50.807 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.805+0000 7f91193f3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f91100736b0 con 0x5647ddf17b70 2024-06-06T03:36:50.807 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.806+0000 7f910f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647ddf12a00 0x5647ddf23760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:50.807 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.806+0000 7f910f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647ddf12a00 0x5647ddf23760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:45640/0 (socket says 172.21.15.50:45640) 2024-06-06T03:36:50.808 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.806+0000 7f910f7fe640 1 -- 172.21.15.50:0/3405985420 learned_addr learned my addr 172.21.15.50:0/3405985420 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:50.808 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.806+0000 7f910f7fe640 1 -- 172.21.15.50:0/3405985420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5647ddf17b70 msgr2=0x5647ddf1c220 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:36:50.808 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.806+0000 7f910f7fe640 1 --2- 172.21.15.50:0/3405985420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5647ddf17b70 0x5647ddf1c220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.808 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.806+0000 7f910f7fe640 1 -- 172.21.15.50:0/3405985420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647ddf12010 msgr2=0x5647ddf2a5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:36:50.808 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.806+0000 7f910f7fe640 1 --2- 172.21.15.50:0/3405985420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647ddf12010 0x5647ddf2a5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.808 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.806+0000 7f910f7fe640 1 -- 172.21.15.50:0/3405985420 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647ddf136d0 con 0x5647ddf12a00 2024-06-06T03:36:50.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.812+0000 7f910f7fe640 1 --2- 172.21.15.50:0/3405985420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647ddf12a00 0x5647ddf23760 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f910009b120 tx=0x7f910009b950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a67b4a8ab6cb237e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.815+0000 7f90f5ffb640 1 -- 172.21.15.50:0/3405985420 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9100099490 con 0x5647ddf12a00 2024-06-06T03:36:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.815+0000 7f90f5ffb640 1 -- 172.21.15.50:0/3405985420 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9100097800 con 0x5647ddf12a00 2024-06-06T03:36:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.815+0000 7f90f5ffb640 1 -- 172.21.15.50:0/3405985420 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910009f330 con 0x5647ddf12a00 2024-06-06T03:36:50.817 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.816+0000 7f91193f3740 1 -- 172.21.15.50:0/3405985420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647ddf12a00 msgr2=0x5647ddf23760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:50.817 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.816+0000 7f91193f3740 1 --2- 172.21.15.50:0/3405985420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647ddf12a00 0x5647ddf23760 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f910009b120 tx=0x7f910009b950 comp rx=0 tx=0).stop 2024-06-06T03:36:50.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.820+0000 7f91193f3740 1 -- 172.21.15.50:0/3405985420 shutdown_connections 2024-06-06T03:36:50.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.820+0000 7f91193f3740 1 --2- 172.21.15.50:0/3405985420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5647ddf17b70 0x5647ddf1c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.820+0000 7f91193f3740 1 --2- 172.21.15.50:0/3405985420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647ddf12a00 0x5647ddf23760 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.820+0000 7f91193f3740 1 --2- 172.21.15.50:0/3405985420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647ddf12010 0x5647ddf2a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.822 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.820+0000 7f91193f3740 1 -- 172.21.15.50:0/3405985420 >> 172.21.15.50:0/3405985420 conn(0x5647ddf0d680 msgr2=0x5647ddf0da60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:50.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.825+0000 7f91193f3740 1 -- 172.21.15.50:0/3405985420 shutdown_connections 2024-06-06T03:36:50.831 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.831+0000 7f91193f3740 1 -- 172.21.15.50:0/3405985420 wait complete. 2024-06-06T03:36:50.831 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.831+0000 7f91193f3740 1 -- start start 2024-06-06T03:36:50.836 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.831+0000 7f91193f3740 1 Processor -- start 2024-06-06T03:36:50.836 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.832+0000 7f91193f3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647ddf12010 0x5647ddf23640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:50.836 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.832+0000 7f91193f3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647ddf12a00 0x5647ddf20130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:50.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.832+0000 7f91193f3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5647ddf17b70 0x5647ddf20670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:50.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.832+0000 7f91193f3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f91101c0090 con 0x5647ddf12010 2024-06-06T03:36:50.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.832+0000 7f91193f3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f91101c14d0 con 0x5647ddf12a00 2024-06-06T03:36:50.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.832+0000 7f91193f3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f91101c0730 con 0x5647ddf17b70 2024-06-06T03:36:50.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.832+0000 7f91193f3740 10 client.0 _ll_register_callbacks cb 0x7f9108031e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:36:50.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.832+0000 7f9114bad640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5647ddf17b70 0x5647ddf20670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:50.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.832+0000 7f9114bad640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5647ddf17b70 0x5647ddf20670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:33952/0 (socket says 172.21.15.50:33952) 2024-06-06T03:36:50.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.832+0000 7f9114bad640 1 -- 172.21.15.50:0/1392136941 learned_addr learned my addr 172.21.15.50:0/1392136941 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:36:50.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.833+0000 7f9114bad640 1 -- 172.21.15.50:0/1392136941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647ddf12a00 msgr2=0x5647ddf20130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:36:50.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.833+0000 7f9114bad640 1 --2- 172.21.15.50:0/1392136941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647ddf12a00 0x5647ddf20130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.833+0000 7f9114bad640 1 -- 172.21.15.50:0/1392136941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647ddf12010 msgr2=0x5647ddf23640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:36:50.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.833+0000 7f9114bad640 1 --2- 172.21.15.50:0/1392136941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647ddf12010 0x5647ddf23640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.833+0000 7f9114bad640 1 -- 172.21.15.50:0/1392136941 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647ddf91350 con 0x5647ddf17b70 2024-06-06T03:36:50.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.833+0000 7f9114bad640 1 --2- 172.21.15.50:0/1392136941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5647ddf17b70 0x5647ddf20670 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9108006010 tx=0x7f9108030900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56623b58bcc511ef server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:36:50.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.834+0000 7f90ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:36:50.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.835+0000 7f90ef7fe640 1 -- 172.21.15.50:0/1392136941 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910804f070 con 0x5647ddf17b70 2024-06-06T03:36:50.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.835+0000 7f91193f3740 1 -- 172.21.15.50:0/1392136941 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9100097800 con 0x5647ddf17b70 2024-06-06T03:36:50.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.835+0000 7f90ef7fe640 1 -- 172.21.15.50:0/1392136941 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f9108004540 con 0x5647ddf17b70 2024-06-06T03:36:50.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.835+0000 7f90ef7fe640 1 -- 172.21.15.50:0/1392136941 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f9108004740 con 0x5647ddf17b70 2024-06-06T03:36:50.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.835+0000 7f91193f3740 10 client.26449 fetch_fsmap learned FSMap version 36 2024-06-06T03:36:50.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.835+0000 7f91193f3740 1 -- 172.21.15.50:0/1392136941 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5647ddf92630 con 0x5647ddf17b70 2024-06-06T03:36:50.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.838+0000 7f90ef7fe640 1 -- 172.21.15.50:0/1392136941 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9100097800 con 0x5647ddf17b70 2024-06-06T03:36:50.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.838+0000 7f90ef7fe640 1 -- 172.21.15.50:0/1392136941 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7f910804a040 con 0x5647ddf17b70 2024-06-06T03:36:50.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.838+0000 7f91193f3740 10 client.26449 fetch_fsmap finished waiting for FSMap version 36 2024-06-06T03:36:50.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.838+0000 7f91193f3740 10 client.26449 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:36:50.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.838+0000 7f91193f3740 20 client.26449 populate_metadata read hostname 'smithi050' 2024-06-06T03:36:50.840 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.838+0000 7f91193f3740 1 --2- 172.21.15.50:0/1392136941 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5647ddf93070 0x5647ddf95490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:36:50.840 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.838+0000 7f91193f3740 4 client.26449 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:36:50.840 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.838+0000 7f91193f3740 1 -- 172.21.15.50:0/1392136941 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5647dde82c20 con 0x5647ddf93070 2024-06-06T03:36:50.840 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.839+0000 7f910ffff640 1 --2- 172.21.15.50:0/1392136941 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5647ddf93070 0x5647ddf95490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:36:50.840 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.840+0000 7f910ffff640 1 --2- 172.21.15.50:0/1392136941 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5647ddf93070 0x5647ddf95490 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=918efdf6bf4d2f40 server_cookie=157a124a2ca5c0b8 in_seq=0 out_seq=0 2024-06-06T03:36:50.841 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.842+0000 7f90ef7fe640 10 client.26449 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:50.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.860+0000 7f90ef7fe640 1 -- 172.21.15.50:0/1392136941 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5647dde82c20 con 0x5647ddf93070 2024-06-06T03:36:50.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.860+0000 7f90ef7fe640 10 client.26449 handle_command_reply: tid=0 2024-06-06T03:36:50.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.860+0000 7f91193f3740 1 client.26449 shutdown 2024-06-06T03:36:50.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.865+0000 7f91193f3740 1 -- 172.21.15.50:0/1392136941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5647ddf17b70 msgr2=0x5647ddf20670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:50.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.865+0000 7f91193f3740 1 --2- 172.21.15.50:0/1392136941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5647ddf17b70 0x5647ddf20670 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9108006010 tx=0x7f9108030900 comp rx=0 tx=0).stop 2024-06-06T03:36:50.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.865+0000 7f91193f3740 1 -- 172.21.15.50:0/1392136941 shutdown_connections 2024-06-06T03:36:50.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.865+0000 7f91193f3740 1 --2- 172.21.15.50:0/1392136941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5647ddf17b70 0x5647ddf20670 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.865+0000 7f91193f3740 1 --2- 172.21.15.50:0/1392136941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647ddf12a00 0x5647ddf20130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.865+0000 7f91193f3740 1 --2- 172.21.15.50:0/1392136941 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5647ddf93070 0x5647ddf95490 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.865+0000 7f91193f3740 1 --2- 172.21.15.50:0/1392136941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647ddf12010 0x5647ddf23640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.865+0000 7f91193f3740 1 -- 172.21.15.50:0/1392136941 >> 172.21.15.50:0/1392136941 conn(0x5647ddf0d680 msgr2=0x5647ddf2a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:50.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.865+0000 7f90ef7fe640 0 client.26449 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:36:50.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.866+0000 7f91193f3740 1 -- 172.21.15.50:0/1392136941 shutdown_connections 2024-06-06T03:36:50.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.866+0000 7f91193f3740 1 -- 172.21.15.50:0/1392136941 wait complete. 2024-06-06T03:36:50.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.867+0000 7f91193f3740 20 client.26449 trim_cache size 0 max 16384 2024-06-06T03:36:50.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:36:50.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:36:50.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:36:50.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.869+0000 7f9116610640 1 -- 172.21.15.50:0/618993459 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f90f80a2e70 msgr2=0x7f90f80a5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:50.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.869+0000 7f9116610640 1 --2- 172.21.15.50:0/618993459 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f90f80a2e70 0x7f90f80a5330 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f910802f570 tx=0x7f910802a8f0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.869+0000 7f9116610640 1 -- 172.21.15.50:0/618993459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9110102be0 msgr2=0x7f911010f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:36:50.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.869+0000 7f9116610640 1 --2- 172.21.15.50:0/618993459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9110102be0 0x7f911010f0a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f910000b450 tx=0x7f910000b910 comp rx=0 tx=0).stop 2024-06-06T03:36:50.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.870+0000 7f9116610640 1 -- 172.21.15.50:0/618993459 shutdown_connections 2024-06-06T03:36:50.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.870+0000 7f9116610640 1 --2- 172.21.15.50:0/618993459 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f90f80a2e70 0x7f90f80a5330 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.870+0000 7f9116610640 1 --2- 172.21.15.50:0/618993459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9110102be0 0x7f911010f0a0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.870+0000 7f9116610640 1 --2- 172.21.15.50:0/618993459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9110105590 0x7f9110110040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.870+0000 7f9116610640 1 --2- 172.21.15.50:0/618993459 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9110100270 0x7f911010eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:36:50.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.870+0000 7f9116610640 1 -- 172.21.15.50:0/618993459 >> 172.21.15.50:0/618993459 conn(0x7f91100fbe70 msgr2=0x7f91100fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:36:50.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.870+0000 7f9116610640 1 -- 172.21.15.50:0/618993459 shutdown_connections 2024-06-06T03:36:50.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:36:50.870+0000 7f9116610640 1 -- 172.21.15.50:0/618993459 wait complete. 2024-06-06T03:36:51.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:50 smithi050 ceph-mon[32421]: pgmap v737: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 31 MiB/s wr, 620 op/s 2024-06-06T03:36:51.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:50 smithi079 ceph-mon[35478]: pgmap v737: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 31 MiB/s wr, 620 op/s 2024-06-06T03:36:51.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:50 smithi122 ceph-mon[35759]: pgmap v737: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 31 MiB/s wr, 620 op/s 2024-06-06T03:36:53.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:52 smithi079 ceph-mon[35478]: pgmap v738: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 27 MiB/s wr, 550 op/s 2024-06-06T03:36:53.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:52 smithi122 ceph-mon[35759]: pgmap v738: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 27 MiB/s wr, 550 op/s 2024-06-06T03:36:53.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:52 smithi050 ceph-mon[32421]: pgmap v738: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 27 MiB/s wr, 550 op/s 2024-06-06T03:36:55.053 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:54 smithi050 ceph-mon[32421]: pgmap v739: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 28 MiB/s wr, 565 op/s 2024-06-06T03:36:55.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:54 smithi079 ceph-mon[35478]: pgmap v739: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 28 MiB/s wr, 565 op/s 2024-06-06T03:36:55.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:54 smithi122 ceph-mon[35759]: pgmap v739: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 28 MiB/s wr, 565 op/s 2024-06-06T03:36:57.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:56 smithi079 ceph-mon[35478]: pgmap v740: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 34 MiB/s wr, 667 op/s 2024-06-06T03:36:57.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:56 smithi122 ceph-mon[35759]: pgmap v740: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 34 MiB/s wr, 667 op/s 2024-06-06T03:36:57.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:56 smithi050 ceph-mon[32421]: pgmap v740: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 34 MiB/s wr, 667 op/s 2024-06-06T03:36:59.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:36:58 smithi079 ceph-mon[35478]: pgmap v741: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 28 MiB/s wr, 561 op/s 2024-06-06T03:36:59.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:36:58 smithi122 ceph-mon[35759]: pgmap v741: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 28 MiB/s wr, 561 op/s 2024-06-06T03:36:59.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:36:58 smithi050 ceph-mon[32421]: pgmap v741: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 28 MiB/s wr, 561 op/s 2024-06-06T03:37:01.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:00 smithi079 ceph-mon[35478]: pgmap v742: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 34 MiB/s wr, 678 op/s 2024-06-06T03:37:01.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:00 smithi122 ceph-mon[35759]: pgmap v742: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 34 MiB/s wr, 678 op/s 2024-06-06T03:37:01.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:00 smithi050 ceph-mon[32421]: pgmap v742: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 34 MiB/s wr, 678 op/s 2024-06-06T03:37:03.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:02 smithi079 ceph-mon[35478]: pgmap v743: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 30 MiB/s wr, 580 op/s 2024-06-06T03:37:03.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:02 smithi122 ceph-mon[35759]: pgmap v743: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 30 MiB/s wr, 580 op/s 2024-06-06T03:37:03.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:02 smithi050 ceph-mon[32421]: pgmap v743: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 30 MiB/s wr, 580 op/s 2024-06-06T03:37:04.078 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.076+0000 7f6dc3d9e640 1 -- 172.21.15.50:0/1995071323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dbc108ee0 msgr2=0x7f6dbc109340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:04.078 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.076+0000 7f6dc3d9e640 1 --2- 172.21.15.50:0/1995071323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dbc108ee0 0x7f6dbc109340 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6db4009ca0 tx=0x7f6db402a8d0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.078 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.078+0000 7f6dc3d9e640 1 -- 172.21.15.50:0/1995071323 shutdown_connections 2024-06-06T03:37:04.078 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.079+0000 7f6dc3d9e640 1 --2- 172.21.15.50:0/1995071323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6dbc1120e0 0x7f6dbc1144d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.078 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.079+0000 7f6dc3d9e640 1 --2- 172.21.15.50:0/1995071323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dbc108ee0 0x7f6dbc109340 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.078 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.079+0000 7f6dc3d9e640 1 --2- 172.21.15.50:0/1995071323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dbc073740 0x7f6dbc1089a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.078 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.079+0000 7f6dc3d9e640 1 -- 172.21.15.50:0/1995071323 >> 172.21.15.50:0/1995071323 conn(0x7f6dbc06e840 msgr2=0x7f6dbc070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:04.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.082+0000 7f6dc3d9e640 1 -- 172.21.15.50:0/1995071323 shutdown_connections 2024-06-06T03:37:04.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.084+0000 7f6dc3d9e640 1 -- 172.21.15.50:0/1995071323 wait complete. 2024-06-06T03:37:04.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.085+0000 7f6dc3d9e640 1 Processor -- start 2024-06-06T03:37:04.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.086+0000 7f6dc3d9e640 1 -- start start 2024-06-06T03:37:04.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.086+0000 7f6dc3d9e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dbc073740 0x7f6dbc1a68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:04.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.086+0000 7f6dc3d9e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dbc108ee0 0x7f6dbc1a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:04.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.086+0000 7f6dc3d9e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6dbc1120e0 0x7f6dbc1adea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:04.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.086+0000 7f6dc3d9e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6dbc10e830 con 0x7f6dbc073740 2024-06-06T03:37:04.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.086+0000 7f6dc3d9e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6dbc10e6b0 con 0x7f6dbc108ee0 2024-06-06T03:37:04.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.086+0000 7f6dc3d9e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6dbc10e9b0 con 0x7f6dbc1120e0 2024-06-06T03:37:04.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.087+0000 7f6dc1b3a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dbc073740 0x7f6dbc1a68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:04.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.087+0000 7f6dc1b3a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dbc073740 0x7f6dbc1a68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33384/0 (socket says 172.21.15.50:33384) 2024-06-06T03:37:04.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.087+0000 7f6dc1b3a640 1 -- 172.21.15.50:0/3330038985 learned_addr learned my addr 172.21.15.50:0/3330038985 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:04.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.088+0000 7f6dc1339640 1 --2- 172.21.15.50:0/3330038985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dbc108ee0 0x7f6dbc1a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:04.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.088+0000 7f6dc233b640 1 --2- 172.21.15.50:0/3330038985 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6dbc1120e0 0x7f6dbc1adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:04.093 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.094+0000 7f6dc1b3a640 1 -- 172.21.15.50:0/3330038985 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6dbc1120e0 msgr2=0x7f6dbc1adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:04.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.094+0000 7f6dc1b3a640 1 --2- 172.21.15.50:0/3330038985 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6dbc1120e0 0x7f6dbc1adea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.094+0000 7f6dc1b3a640 1 -- 172.21.15.50:0/3330038985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dbc108ee0 msgr2=0x7f6dbc1a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:04.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.094+0000 7f6dc1b3a640 1 --2- 172.21.15.50:0/3330038985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dbc108ee0 0x7f6dbc1a6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.094+0000 7f6dc1b3a640 1 -- 172.21.15.50:0/3330038985 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dbc1153e0 con 0x7f6dbc073740 2024-06-06T03:37:04.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.096+0000 7f6dc1339640 1 --2- 172.21.15.50:0/3330038985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dbc108ee0 0x7f6dbc1a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:37:04.099 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.100+0000 7f6dc1b3a640 1 --2- 172.21.15.50:0/3330038985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dbc073740 0x7f6dbc1a68f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f6dac00e9f0 tx=0x7f6dac00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:04.106 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.106+0000 7f6db2ffd640 1 -- 172.21.15.50:0/3330038985 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac00cd80 con 0x7f6dbc073740 2024-06-06T03:37:04.107 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.107+0000 7f6db2ffd640 1 -- 172.21.15.50:0/3330038985 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6dac0108e0 con 0x7f6dbc073740 2024-06-06T03:37:04.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.109+0000 7f6db2ffd640 1 -- 172.21.15.50:0/3330038985 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac0188e0 con 0x7f6dbc073740 2024-06-06T03:37:04.116 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.115+0000 7f6dc3d9e640 1 -- 172.21.15.50:0/3330038985 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dbc1156d0 con 0x7f6dbc073740 2024-06-06T03:37:04.116 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.115+0000 7f6dc3d9e640 1 -- 172.21.15.50:0/3330038985 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dbc115c20 con 0x7f6dbc073740 2024-06-06T03:37:04.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.124+0000 7f6dc6b87740 1 Processor -- start 2024-06-06T03:37:04.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.124+0000 7f6dc6b87740 1 -- start start 2024-06-06T03:37:04.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.125+0000 7f6dc6b87740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5641d60cb1e0 0x5641d60cb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:04.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.125+0000 7f6dc6b87740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5641d60cbbd0 0x5641d60d06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:04.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.125+0000 7f6dc6b87740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641d60d0d40 0x5641d60d31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:04.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.125+0000 7f6dc6b87740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5641d602e4f0 con 0x5641d60d0d40 2024-06-06T03:37:04.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.125+0000 7f6dc6b87740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5641d5fcc870 con 0x5641d60cb1e0 2024-06-06T03:37:04.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.125+0000 7f6dc6b87740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5641d602a4b0 con 0x5641d60cbbd0 2024-06-06T03:37:04.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.125+0000 7f6dc233b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5641d60cb1e0 0x5641d60cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:04.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.125+0000 7f6dc233b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5641d60cb1e0 0x5641d60cb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:43728/0 (socket says 172.21.15.50:43728) 2024-06-06T03:37:04.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.125+0000 7f6dc233b640 1 -- 172.21.15.50:0/3933516711 learned_addr learned my addr 172.21.15.50:0/3933516711 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:04.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.125+0000 7f6dc1b3a640 1 --2- 172.21.15.50:0/3933516711 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5641d60cbbd0 0x5641d60d06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:04.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.125+0000 7f6db2ffd640 1 -- 172.21.15.50:0/3330038985 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6dac018a80 con 0x7f6dbc073740 2024-06-06T03:37:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.125+0000 7f6dc233b640 1 -- 172.21.15.50:0/3933516711 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5641d60cbbd0 msgr2=0x5641d60d06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.125+0000 7f6dc233b640 1 --2- 172.21.15.50:0/3933516711 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5641d60cbbd0 0x5641d60d06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.125+0000 7f6dc233b640 1 -- 172.21.15.50:0/3933516711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641d60d0d40 msgr2=0x5641d60d31d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:37:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.125+0000 7f6dc233b640 1 --2- 172.21.15.50:0/3933516711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641d60d0d40 0x5641d60d31d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.125+0000 7f6dc233b640 1 -- 172.21.15.50:0/3933516711 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641d5fe89b0 con 0x5641d60cb1e0 2024-06-06T03:37:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.126+0000 7f6dc233b640 1 --2- 172.21.15.50:0/3933516711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5641d60cb1e0 0x5641d60cb600 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6db8009850 tx=0x7f6db8009d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9477c39ab3b93fa4 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.126+0000 7f6da7fff640 1 -- 172.21.15.50:0/3933516711 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db8039070 con 0x5641d60cb1e0 2024-06-06T03:37:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.127+0000 7f6da7fff640 1 -- 172.21.15.50:0/3933516711 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6db8030e70 con 0x5641d60cb1e0 2024-06-06T03:37:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.127+0000 7f6da7fff640 1 -- 172.21.15.50:0/3933516711 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db80343e0 con 0x5641d60cb1e0 2024-06-06T03:37:04.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.127+0000 7f6dc6b87740 1 -- 172.21.15.50:0/3933516711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5641d60cb1e0 msgr2=0x5641d60cb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:04.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.128+0000 7f6dc6b87740 1 --2- 172.21.15.50:0/3933516711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5641d60cb1e0 0x5641d60cb600 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6db8009850 tx=0x7f6db8009d10 comp rx=0 tx=0).stop 2024-06-06T03:37:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.132+0000 7f6dc6b87740 1 -- 172.21.15.50:0/3933516711 shutdown_connections 2024-06-06T03:37:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.132+0000 7f6dc6b87740 1 --2- 172.21.15.50:0/3933516711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641d60d0d40 0x5641d60d31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.132+0000 7f6dc6b87740 1 --2- 172.21.15.50:0/3933516711 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5641d60cbbd0 0x5641d60d06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.132+0000 7f6dc6b87740 1 --2- 172.21.15.50:0/3933516711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5641d60cb1e0 0x5641d60cb600 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.132+0000 7f6dc6b87740 1 -- 172.21.15.50:0/3933516711 >> 172.21.15.50:0/3933516711 conn(0x5641d60c6850 msgr2=0x5641d60c6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:04.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.134+0000 7f6db2ffd640 1 --2- 172.21.15.50:0/3330038985 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6da80a2d90 0x7f6da80a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:04.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.135+0000 7f6db2ffd640 1 -- 172.21.15.50:0/3330038985 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f6dac0cfc70 con 0x7f6dbc073740 2024-06-06T03:37:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.143+0000 7f6dc6b87740 1 -- 172.21.15.50:0/3933516711 shutdown_connections 2024-06-06T03:37:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.143+0000 7f6dc1339640 1 --2- 172.21.15.50:0/3330038985 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6da80a2d90 0x7f6da80a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:04.145 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.145+0000 7f6dc6b87740 1 -- 172.21.15.50:0/3933516711 wait complete. 2024-06-06T03:37:04.145 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.146+0000 7f6dc6b87740 1 -- start start 2024-06-06T03:37:04.145 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.146+0000 7f6dc6b87740 1 Processor -- start 2024-06-06T03:37:04.146 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.147+0000 7f6dc6b87740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641d60cb1e0 0x5641d60d54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:04.146 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.147+0000 7f6dc6b87740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5641d60cbbd0 0x5641d60d59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:04.146 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.147+0000 7f6dc6b87740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5641d60d0d40 0x5641d60dca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:04.147 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.147+0000 7f6dc6b87740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5641d60d3d40 con 0x5641d60cb1e0 2024-06-06T03:37:04.147 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.147+0000 7f6dc6b87740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5641d5fb7ae0 con 0x5641d60cbbd0 2024-06-06T03:37:04.147 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.148+0000 7f6dc6b87740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5641d60d3ec0 con 0x5641d60d0d40 2024-06-06T03:37:04.147 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.148+0000 7f6dc6b87740 10 client.0 _ll_register_callbacks cb 0x5641d5ff09b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:37:04.147 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.148+0000 7f6dc233b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5641d60d0d40 0x5641d60dca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:04.147 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.148+0000 7f6dc233b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5641d60d0d40 0x5641d60dca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:53842/0 (socket says 172.21.15.50:53842) 2024-06-06T03:37:04.147 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.148+0000 7f6dc233b640 1 -- 172.21.15.50:0/3141862767 learned_addr learned my addr 172.21.15.50:0/3141862767 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:04.150 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.150+0000 7f6dc1339640 1 --2- 172.21.15.50:0/3141862767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5641d60cbbd0 0x5641d60d59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:04.150 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.151+0000 7f6dc233b640 1 -- 172.21.15.50:0/3141862767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5641d60cbbd0 msgr2=0x5641d60d59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:04.150 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.151+0000 7f6dc233b640 1 --2- 172.21.15.50:0/3141862767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5641d60cbbd0 0x5641d60d59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.151 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.151+0000 7f6dc233b640 1 -- 172.21.15.50:0/3141862767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641d60cb1e0 msgr2=0x5641d60d54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:04.151 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.151+0000 7f6dc233b640 1 --2- 172.21.15.50:0/3141862767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641d60cb1e0 0x5641d60d54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.151 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.151+0000 7f6dc233b640 1 -- 172.21.15.50:0/3141862767 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641d5d42210 con 0x5641d60d0d40 2024-06-06T03:37:04.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.155+0000 7f6dc233b640 1 --2- 172.21.15.50:0/3141862767 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5641d60d0d40 0x5641d60dca20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6db8030d20 tx=0x7f6db80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=865ef2fb6dcb4493 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:04.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.156+0000 7f6da57fa640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:37:04.157 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.158+0000 7f6da57fa640 1 -- 172.21.15.50:0/3141862767 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db8039050 con 0x5641d60d0d40 2024-06-06T03:37:04.157 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.158+0000 7f6da57fa640 1 -- 172.21.15.50:0/3141862767 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f6db803e860 con 0x5641d60d0d40 2024-06-06T03:37:04.158 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.159+0000 7f6dc1339640 1 --2- 172.21.15.50:0/3330038985 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6da80a2d90 0x7f6da80a5250 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6db4006010 tx=0x7f6db4009780 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:04.160 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.161+0000 7f6dc6b87740 1 -- 172.21.15.50:0/3141862767 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6db8030e70 con 0x5641d60d0d40 2024-06-06T03:37:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.162+0000 7f6da57fa640 1 -- 172.21.15.50:0/3141862767 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f6db803ea60 con 0x5641d60d0d40 2024-06-06T03:37:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.165+0000 7f6dc6b87740 10 client.26458 fetch_fsmap learned FSMap version 36 2024-06-06T03:37:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.166+0000 7f6dc6b87740 1 -- 172.21.15.50:0/3141862767 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5641d5e0e620 con 0x5641d60d0d40 2024-06-06T03:37:04.169 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.170+0000 7f6da57fa640 1 -- 172.21.15.50:0/3141862767 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6db8030e70 con 0x5641d60d0d40 2024-06-06T03:37:04.173 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.171+0000 7f6da57fa640 1 -- 172.21.15.50:0/3141862767 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7f6db8046c90 con 0x5641d60d0d40 2024-06-06T03:37:04.174 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.175+0000 7f6dc6b87740 10 client.26458 fetch_fsmap finished waiting for FSMap version 36 2024-06-06T03:37:04.174 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.175+0000 7f6dc6b87740 10 client.26458 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:37:04.174 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.175+0000 7f6dc6b87740 20 client.26458 populate_metadata read hostname 'smithi050' 2024-06-06T03:37:04.174 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.175+0000 7f6dc6b87740 1 --2- 172.21.15.50:0/3141862767 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5641d60e0d50 0x5641d60e3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:04.174 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.175+0000 7f6dc6b87740 4 client.26458 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:37:04.175 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.175+0000 7f6dc6b87740 1 -- 172.21.15.50:0/3141862767 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641d6041f10 con 0x5641d60e0d50 2024-06-06T03:37:04.178 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.178+0000 7f6dc1b3a640 1 --2- 172.21.15.50:0/3141862767 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5641d60e0d50 0x5641d60e3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.180+0000 7f6dc1b3a640 1 --2- 172.21.15.50:0/3141862767 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5641d60e0d50 0x5641d60e3140 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ad416afa8ecb72d server_cookie=bc9b44cc79195744 in_seq=0 out_seq=0 2024-06-06T03:37:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.180+0000 7f6da57fa640 10 client.26458 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:37:04.180 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.181+0000 7f6da57fa640 1 -- 172.21.15.50:0/3141862767 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5641d6041f10 con 0x5641d60e0d50 2024-06-06T03:37:04.180 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.181+0000 7f6da57fa640 10 client.26458 handle_command_reply: tid=0 2024-06-06T03:37:04.180 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.181+0000 7f6dc6b87740 1 client.26458 shutdown 2024-06-06T03:37:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.189+0000 7f6dc6b87740 1 -- 172.21.15.50:0/3141862767 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5641d60d0d40 msgr2=0x5641d60dca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.189+0000 7f6dc6b87740 1 --2- 172.21.15.50:0/3141862767 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5641d60d0d40 0x5641d60dca20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6db8030d20 tx=0x7f6db80046c0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.192+0000 7f6dc6b87740 1 -- 172.21.15.50:0/3141862767 shutdown_connections 2024-06-06T03:37:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.192+0000 7f6dc6b87740 1 --2- 172.21.15.50:0/3141862767 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5641d60d0d40 0x5641d60dca20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.192+0000 7f6dc6b87740 1 --2- 172.21.15.50:0/3141862767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5641d60cbbd0 0x5641d60d59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.192+0000 7f6dc6b87740 1 --2- 172.21.15.50:0/3141862767 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5641d60e0d50 0x5641d60e3140 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.192+0000 7f6dc6b87740 1 --2- 172.21.15.50:0/3141862767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641d60cb1e0 0x5641d60d54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.192+0000 7f6dc6b87740 1 -- 172.21.15.50:0/3141862767 >> 172.21.15.50:0/3141862767 conn(0x5641d60c6850 msgr2=0x5641d60c59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:04.194 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.192+0000 7f6da57fa640 0 client.26458 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:37:04.200 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.198+0000 7f6dc6b87740 1 -- 172.21.15.50:0/3141862767 shutdown_connections 2024-06-06T03:37:04.200 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.202+0000 7f6dc6b87740 1 -- 172.21.15.50:0/3141862767 wait complete. 2024-06-06T03:37:04.205 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.206+0000 7f6dc6b87740 20 client.26458 trim_cache size 0 max 16384 2024-06-06T03:37:04.243 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.243+0000 7f6dc6b87740 1 Processor -- start 2024-06-06T03:37:04.246 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.247+0000 7f6dc6b87740 1 -- start start 2024-06-06T03:37:04.247 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.247+0000 7f6dc6b87740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5641d60cb1e0 0x5641d60ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:04.247 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.248+0000 7f6dc6b87740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641d60cbbd0 0x5641d60dc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:04.247 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.248+0000 7f6dc1b3a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5641d60cb1e0 0x5641d60ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:04.247 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.248+0000 7f6dc1b3a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5641d60cb1e0 0x5641d60ccdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:43742/0 (socket says 172.21.15.50:43742) 2024-06-06T03:37:04.247 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.248+0000 7f6dc1b3a640 1 -- 172.21.15.50:0/85802858 learned_addr learned my addr 172.21.15.50:0/85802858 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:04.247 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.248+0000 7f6dc6b87740 1 --2- 172.21.15.50:0/85802858 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5641d60d0d40 0x5641d60cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:04.247 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.248+0000 7f6dc6b87740 1 -- 172.21.15.50:0/85802858 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6dbc078a90 con 0x5641d60cbbd0 2024-06-06T03:37:04.247 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.248+0000 7f6dc6b87740 1 -- 172.21.15.50:0/85802858 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6dbc076360 con 0x5641d60cb1e0 2024-06-06T03:37:04.248 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.248+0000 7f6dc6b87740 1 -- 172.21.15.50:0/85802858 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6dbc11d870 con 0x5641d60d0d40 2024-06-06T03:37:04.248 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.250+0000 7f6dc1339640 1 --2- 172.21.15.50:0/85802858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641d60cbbd0 0x5641d60dc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:04.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.253+0000 7f6dc1b3a640 1 -- 172.21.15.50:0/85802858 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5641d60d0d40 msgr2=0x5641d60cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:04.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.253+0000 7f6dc1b3a640 1 --2- 172.21.15.50:0/85802858 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5641d60d0d40 0x5641d60cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.253+0000 7f6dc1b3a640 1 -- 172.21.15.50:0/85802858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641d60cbbd0 msgr2=0x5641d60dc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:04.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.253+0000 7f6dc1b3a640 1 --2- 172.21.15.50:0/85802858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641d60cbbd0 0x5641d60dc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.253+0000 7f6dc1b3a640 1 -- 172.21.15.50:0/85802858 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641d60d4000 con 0x5641d60cb1e0 2024-06-06T03:37:04.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.254+0000 7f6dc1b3a640 1 --2- 172.21.15.50:0/85802858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5641d60cb1e0 0x5641d60ccdb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6dac098ac0 tx=0x7f6dac01f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c198ba1b9d653585 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:04.255 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.255+0000 7f6da77fe640 1 -- 172.21.15.50:0/85802858 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac09ba50 con 0x5641d60cb1e0 2024-06-06T03:37:04.255 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.255+0000 7f6da77fe640 1 -- 172.21.15.50:0/85802858 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6dac010de0 con 0x5641d60cb1e0 2024-06-06T03:37:04.256 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.255+0000 7f6da77fe640 1 -- 172.21.15.50:0/85802858 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac09a220 con 0x5641d60cb1e0 2024-06-06T03:37:04.257 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.258+0000 7f6dc6b87740 1 -- 172.21.15.50:0/85802858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5641d60cb1e0 msgr2=0x5641d60ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:04.257 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.258+0000 7f6dc6b87740 1 --2- 172.21.15.50:0/85802858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5641d60cb1e0 0x5641d60ccdb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6dac098ac0 tx=0x7f6dac01f000 comp rx=0 tx=0).stop 2024-06-06T03:37:04.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.259+0000 7f6dc6b87740 1 -- 172.21.15.50:0/85802858 shutdown_connections 2024-06-06T03:37:04.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.259+0000 7f6dc6b87740 1 --2- 172.21.15.50:0/85802858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641d60cbbd0 0x5641d60dc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.259+0000 7f6dc6b87740 1 --2- 172.21.15.50:0/85802858 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5641d60d0d40 0x5641d60cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.259+0000 7f6dc6b87740 1 --2- 172.21.15.50:0/85802858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5641d60cb1e0 0x5641d60ccdb0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.259+0000 7f6dc6b87740 1 -- 172.21.15.50:0/85802858 >> 172.21.15.50:0/85802858 conn(0x5641d60c6850 msgr2=0x5641d60d5480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:04.262 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.260+0000 7f6dc6b87740 1 -- 172.21.15.50:0/85802858 shutdown_connections 2024-06-06T03:37:04.264 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.263+0000 7f6dc6b87740 1 -- 172.21.15.50:0/85802858 wait complete. 2024-06-06T03:37:04.265 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.264+0000 7f6dc6b87740 1 -- start start 2024-06-06T03:37:04.265 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.264+0000 7f6dc6b87740 1 Processor -- start 2024-06-06T03:37:04.265 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.265+0000 7f6dc6b87740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5641d60cb1e0 0x5641d60d9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:04.265 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.265+0000 7f6dc6b87740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641d60cbbd0 0x5641d60d9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:04.265 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.265+0000 7f6dc6b87740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5641d60d0d40 0x5641d61499b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:04.265 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.265+0000 7f6dc6b87740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6dbc074850 con 0x5641d60cbbd0 2024-06-06T03:37:04.265 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.265+0000 7f6dc6b87740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6dbc075c90 con 0x5641d60d0d40 2024-06-06T03:37:04.265 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.265+0000 7f6dc6b87740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6dbc074ef0 con 0x5641d60cb1e0 2024-06-06T03:37:04.265 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.265+0000 7f6dc6b87740 10 client.0 _ll_register_callbacks cb 0x7f6dac0d5160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:37:04.266 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.266+0000 7f6dc1b3a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5641d60cb1e0 0x5641d60d9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:04.266 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.266+0000 7f6dc1b3a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5641d60cb1e0 0x5641d60d9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:53858/0 (socket says 172.21.15.50:53858) 2024-06-06T03:37:04.266 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.266+0000 7f6dc1b3a640 1 -- 172.21.15.50:0/1306295979 learned_addr learned my addr 172.21.15.50:0/1306295979 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:04.266 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.268+0000 7f6dc1339640 1 --2- 172.21.15.50:0/1306295979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641d60cbbd0 0x5641d60d9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:04.269 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.269+0000 7f6dc1b3a640 1 -- 172.21.15.50:0/1306295979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5641d60d0d40 msgr2=0x5641d61499b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:04.269 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.269+0000 7f6dc1b3a640 1 --2- 172.21.15.50:0/1306295979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5641d60d0d40 0x5641d61499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.269 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.269+0000 7f6dc1b3a640 1 -- 172.21.15.50:0/1306295979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641d60cbbd0 msgr2=0x5641d60d9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:04.269 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.269+0000 7f6dc1b3a640 1 --2- 172.21.15.50:0/1306295979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641d60cbbd0 0x5641d60d9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.269 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.269+0000 7f6dc1b3a640 1 -- 172.21.15.50:0/1306295979 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641d60c1f50 con 0x5641d60cb1e0 2024-06-06T03:37:04.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.273+0000 7f6dc1b3a640 1 --2- 172.21.15.50:0/1306295979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5641d60cb1e0 0x5641d60d9600 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0cd360 tx=0x7f6dac09ba50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2f7dd25f1d2d1b1 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:04.274 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.274+0000 7f6da57fa640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:37:04.278 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.277+0000 7f6da57fa640 1 -- 172.21.15.50:0/1306295979 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac09c0f0 con 0x5641d60cb1e0 2024-06-06T03:37:04.278 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.277+0000 7f6da57fa640 1 -- 172.21.15.50:0/1306295979 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f6dac010a90 con 0x5641d60cb1e0 2024-06-06T03:37:04.278 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.278+0000 7f6dc6b87740 1 -- 172.21.15.50:0/1306295979 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5641d603bc20 con 0x5641d60cb1e0 2024-06-06T03:37:04.279 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.280+0000 7f6da57fa640 1 -- 172.21.15.50:0/1306295979 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f6dac0a04a0 con 0x5641d60cb1e0 2024-06-06T03:37:04.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.283+0000 7f6dc6b87740 10 client.26461 fetch_fsmap learned FSMap version 36 2024-06-06T03:37:04.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.283+0000 7f6dc6b87740 1 -- 172.21.15.50:0/1306295979 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5641d616cd10 con 0x5641d60cb1e0 2024-06-06T03:37:04.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.286+0000 7f6da57fa640 1 -- 172.21.15.50:0/1306295979 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x5641d603bc20 con 0x5641d60cb1e0 2024-06-06T03:37:04.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.287+0000 7f6da57fa640 1 -- 172.21.15.50:0/1306295979 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7f6dac0b6030 con 0x5641d60cb1e0 2024-06-06T03:37:04.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.287+0000 7f6dc6b87740 10 client.26461 fetch_fsmap finished waiting for FSMap version 36 2024-06-06T03:37:04.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.287+0000 7f6dc6b87740 10 client.26461 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:37:04.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.287+0000 7f6dc6b87740 20 client.26461 populate_metadata read hostname 'smithi050' 2024-06-06T03:37:04.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.287+0000 7f6dc6b87740 1 --2- 172.21.15.50:0/1306295979 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5641d616d740 0x5641d616fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:04.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.287+0000 7f6dc6b87740 4 client.26461 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:37:04.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.287+0000 7f6dc6b87740 1 -- 172.21.15.50:0/1306295979 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5641d6035f70 con 0x5641d616d740 2024-06-06T03:37:04.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.288+0000 7f6dc1339640 1 --2- 172.21.15.50:0/1306295979 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5641d616d740 0x5641d616fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:04.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.295+0000 7f6da57fa640 10 client.26461 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:37:04.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.295+0000 7f6dc1339640 1 --2- 172.21.15.50:0/1306295979 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5641d616d740 0x5641d616fb60 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=baa87ccfac9550c8 server_cookie=a1680301e19d55af in_seq=0 out_seq=0 2024-06-06T03:37:04.298 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.299+0000 7f6da57fa640 1 -- 172.21.15.50:0/1306295979 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5641d6035f70 con 0x5641d616d740 2024-06-06T03:37:04.298 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.299+0000 7f6da57fa640 10 client.26461 handle_command_reply: tid=0 2024-06-06T03:37:04.298 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.300+0000 7f6dc6b87740 1 client.26461 shutdown 2024-06-06T03:37:04.310 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.308+0000 7f6dc6b87740 1 -- 172.21.15.50:0/1306295979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5641d60cb1e0 msgr2=0x5641d60d9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:04.310 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.308+0000 7f6dc6b87740 1 --2- 172.21.15.50:0/1306295979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5641d60cb1e0 0x5641d60d9600 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0cd360 tx=0x7f6dac09ba50 comp rx=0 tx=0).stop 2024-06-06T03:37:04.312 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.313+0000 7f6dc6b87740 1 -- 172.21.15.50:0/1306295979 shutdown_connections 2024-06-06T03:37:04.312 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.313+0000 7f6dc6b87740 1 --2- 172.21.15.50:0/1306295979 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5641d616d740 0x5641d616fb60 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.312 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.313+0000 7f6dc6b87740 1 --2- 172.21.15.50:0/1306295979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641d60cbbd0 0x5641d60d9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.312 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.313+0000 7f6dc6b87740 1 --2- 172.21.15.50:0/1306295979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5641d60d0d40 0x5641d61499b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.312 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.313+0000 7f6dc6b87740 1 --2- 172.21.15.50:0/1306295979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5641d60cb1e0 0x5641d60d9600 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.312 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.313+0000 7f6dc6b87740 1 -- 172.21.15.50:0/1306295979 >> 172.21.15.50:0/1306295979 conn(0x5641d60c6850 msgr2=0x5641d60d5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:04.312 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.313+0000 7f6da57fa640 0 client.26461 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:37:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.316+0000 7f6dc6b87740 1 -- 172.21.15.50:0/1306295979 shutdown_connections 2024-06-06T03:37:04.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.317+0000 7f6dc6b87740 1 -- 172.21.15.50:0/1306295979 wait complete. 2024-06-06T03:37:04.341 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.342+0000 7f6dc6b87740 20 client.26461 trim_cache size 0 max 16384 2024-06-06T03:37:04.342 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:37:04.342 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:37:04.342 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:37:04.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.350+0000 7f6dc3d9e640 1 -- 172.21.15.50:0/3330038985 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6da80a2d90 msgr2=0x7f6da80a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:04.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.350+0000 7f6dc3d9e640 1 --2- 172.21.15.50:0/3330038985 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6da80a2d90 0x7f6da80a5250 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6db4006010 tx=0x7f6db4009780 comp rx=0 tx=0).stop 2024-06-06T03:37:04.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.350+0000 7f6dc3d9e640 1 -- 172.21.15.50:0/3330038985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dbc073740 msgr2=0x7f6dbc1a68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:04.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.350+0000 7f6dc3d9e640 1 --2- 172.21.15.50:0/3330038985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dbc073740 0x7f6dbc1a68f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f6dac00e9f0 tx=0x7f6dac00eeb0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.356+0000 7f6dc3d9e640 1 -- 172.21.15.50:0/3330038985 shutdown_connections 2024-06-06T03:37:04.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.356+0000 7f6dc3d9e640 1 --2- 172.21.15.50:0/3330038985 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f6da80a2d90 0x7f6da80a5250 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.356+0000 7f6dc3d9e640 1 --2- 172.21.15.50:0/3330038985 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6dbc1120e0 0x7f6dbc1adea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.356+0000 7f6dc3d9e640 1 --2- 172.21.15.50:0/3330038985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dbc108ee0 0x7f6dbc1a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.356+0000 7f6dc3d9e640 1 --2- 172.21.15.50:0/3330038985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dbc073740 0x7f6dbc1a68f0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:04.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.356+0000 7f6dc3d9e640 1 -- 172.21.15.50:0/3330038985 >> 172.21.15.50:0/3330038985 conn(0x7f6dbc06e840 msgr2=0x7f6dbc111210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:04.359 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.358+0000 7f6dc3d9e640 1 -- 172.21.15.50:0/3330038985 shutdown_connections 2024-06-06T03:37:04.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:04.360+0000 7f6dc3d9e640 1 -- 172.21.15.50:0/3330038985 wait complete. 2024-06-06T03:37:05.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:04 smithi079 ceph-mon[35478]: pgmap v744: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 29 MiB/s wr, 577 op/s 2024-06-06T03:37:05.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:04 smithi122 ceph-mon[35759]: pgmap v744: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 29 MiB/s wr, 577 op/s 2024-06-06T03:37:05.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:04 smithi050 ceph-mon[32421]: pgmap v744: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 29 MiB/s wr, 577 op/s 2024-06-06T03:37:07.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:06 smithi079 ceph-mon[35478]: pgmap v745: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 34 MiB/s wr, 667 op/s 2024-06-06T03:37:07.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:06 smithi122 ceph-mon[35759]: pgmap v745: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 34 MiB/s wr, 667 op/s 2024-06-06T03:37:07.254 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:06 smithi050 ceph-mon[32421]: pgmap v745: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 34 MiB/s wr, 667 op/s 2024-06-06T03:37:09.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:08 smithi079 ceph-mon[35478]: pgmap v746: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 28 MiB/s wr, 549 op/s 2024-06-06T03:37:09.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:08 smithi122 ceph-mon[35759]: pgmap v746: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 28 MiB/s wr, 549 op/s 2024-06-06T03:37:09.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:08 smithi050 ceph-mon[32421]: pgmap v746: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 28 MiB/s wr, 549 op/s 2024-06-06T03:37:11.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:10 smithi079 ceph-mon[35478]: pgmap v747: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 36 MiB/s wr, 705 op/s 2024-06-06T03:37:11.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:10 smithi122 ceph-mon[35759]: pgmap v747: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 36 MiB/s wr, 705 op/s 2024-06-06T03:37:11.253 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:10 smithi050 ceph-mon[32421]: pgmap v747: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 36 MiB/s wr, 705 op/s 2024-06-06T03:37:13.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:12 smithi079 ceph-mon[35478]: pgmap v748: 129 pgs: 129 active+clean; 10 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 30 MiB/s wr, 581 op/s 2024-06-06T03:37:13.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:12 smithi122 ceph-mon[35759]: pgmap v748: 129 pgs: 129 active+clean; 10 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 30 MiB/s wr, 581 op/s 2024-06-06T03:37:13.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:12 smithi050 ceph-mon[32421]: pgmap v748: 129 pgs: 129 active+clean; 10 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 30 MiB/s wr, 581 op/s 2024-06-06T03:37:15.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:14 smithi079 ceph-mon[35478]: pgmap v749: 129 pgs: 129 active+clean; 10 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 29 MiB/s wr, 581 op/s 2024-06-06T03:37:15.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:14 smithi122 ceph-mon[35759]: pgmap v749: 129 pgs: 129 active+clean; 10 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 29 MiB/s wr, 581 op/s 2024-06-06T03:37:15.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:14 smithi050 ceph-mon[32421]: pgmap v749: 129 pgs: 129 active+clean; 10 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 29 MiB/s wr, 581 op/s 2024-06-06T03:37:16.007 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-06T03:37:16.835 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:37:17.099 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:16 smithi079 ceph-mon[35478]: pgmap v750: 129 pgs: 129 active+clean; 10 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 35 MiB/s wr, 681 op/s 2024-06-06T03:37:17.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:16 smithi122 ceph-mon[35759]: pgmap v750: 129 pgs: 129 active+clean; 10 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 35 MiB/s wr, 681 op/s 2024-06-06T03:37:17.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:16 smithi050 ceph-mon[32421]: pgmap v750: 129 pgs: 129 active+clean; 10 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 35 MiB/s wr, 681 op/s 2024-06-06T03:37:17.486 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.484+0000 7f9ca9e8c640 1 -- 172.21.15.50:0/2707191824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ca4101af0 msgr2=0x7f9ca4101f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:17.486 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.484+0000 7f9ca9e8c640 1 --2- 172.21.15.50:0/2707191824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ca4101af0 0x7f9ca4101f70 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f9c98009900 tx=0x7f9c9802a410 comp rx=0 tx=0).stop 2024-06-06T03:37:17.486 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.484+0000 7f9ca9e8c640 1 -- 172.21.15.50:0/2707191824 shutdown_connections 2024-06-06T03:37:17.487 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.484+0000 7f9ca9e8c640 1 --2- 172.21.15.50:0/2707191824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ca4101af0 0x7f9ca4101f70 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.487 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.484+0000 7f9ca9e8c640 1 --2- 172.21.15.50:0/2707191824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ca41024b0 0x7f9ca4108d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.487 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.484+0000 7f9ca9e8c640 1 --2- 172.21.15.50:0/2707191824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ca4100900 0x7f9ca4100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.487 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.484+0000 7f9ca9e8c640 1 -- 172.21.15.50:0/2707191824 >> 172.21.15.50:0/2707191824 conn(0x7f9ca40fbe90 msgr2=0x7f9ca40fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:17.487 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.484+0000 7f9ca9e8c640 1 -- 172.21.15.50:0/2707191824 shutdown_connections 2024-06-06T03:37:17.487 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.484+0000 7f9ca9e8c640 1 -- 172.21.15.50:0/2707191824 wait complete. 2024-06-06T03:37:17.487 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.485+0000 7f9ca9e8c640 1 Processor -- start 2024-06-06T03:37:17.487 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.485+0000 7f9ca9e8c640 1 -- start start 2024-06-06T03:37:17.487 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.485+0000 7f9ca9e8c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ca4100900 0x7f9ca4196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:17.487 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.485+0000 7f9ca9e8c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ca4101af0 0x7f9ca4196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:17.487 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.485+0000 7f9ca9e8c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ca41024b0 0x7f9ca419dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:17.487 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.485+0000 7f9ca9e8c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca410c430 con 0x7f9ca4101af0 2024-06-06T03:37:17.487 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.485+0000 7f9ca9e8c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca410c2b0 con 0x7f9ca4100900 2024-06-06T03:37:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.485+0000 7f9ca9e8c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca410c5b0 con 0x7f9ca41024b0 2024-06-06T03:37:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.485+0000 7f9ca2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ca4101af0 0x7f9ca4196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.485+0000 7f9ca2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ca4101af0 0x7f9ca4196f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56980/0 (socket says 172.21.15.50:56980) 2024-06-06T03:37:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.485+0000 7f9ca2ffd640 1 -- 172.21.15.50:0/1945768452 learned_addr learned my addr 172.21.15.50:0/1945768452 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.485+0000 7f9ca3fff640 1 --2- 172.21.15.50:0/1945768452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ca41024b0 0x7f9ca419dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.485+0000 7f9ca37fe640 1 --2- 172.21.15.50:0/1945768452 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ca4100900 0x7f9ca4196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.485+0000 7f9ca2ffd640 1 -- 172.21.15.50:0/1945768452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ca41024b0 msgr2=0x7f9ca419dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.485+0000 7f9ca2ffd640 1 --2- 172.21.15.50:0/1945768452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ca41024b0 0x7f9ca419dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.485+0000 7f9ca2ffd640 1 -- 172.21.15.50:0/1945768452 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ca4100900 msgr2=0x7f9ca4196a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.485+0000 7f9ca2ffd640 1 --2- 172.21.15.50:0/1945768452 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ca4100900 0x7f9ca4196a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.485+0000 7f9ca2ffd640 1 -- 172.21.15.50:0/1945768452 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca419e660 con 0x7f9ca4101af0 2024-06-06T03:37:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.485+0000 7f9ca37fe640 1 --2- 172.21.15.50:0/1945768452 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ca4100900 0x7f9ca4196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:37:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.486+0000 7f9ca2ffd640 1 --2- 172.21.15.50:0/1945768452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ca4101af0 0x7f9ca4196f80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f9c98005940 tx=0x7f9c980042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.486+0000 7f9ca0ff9640 1 -- 172.21.15.50:0/1945768452 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9803f030 con 0x7f9ca4101af0 2024-06-06T03:37:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.486+0000 7f9ca0ff9640 1 -- 172.21.15.50:0/1945768452 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9c98003cb0 con 0x7f9ca4101af0 2024-06-06T03:37:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.486+0000 7f9ca9e8c640 1 -- 172.21.15.50:0/1945768452 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ca419e8f0 con 0x7f9ca4101af0 2024-06-06T03:37:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.486+0000 7f9ca0ff9640 1 -- 172.21.15.50:0/1945768452 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c98035070 con 0x7f9ca4101af0 2024-06-06T03:37:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.486+0000 7f9ca9e8c640 1 -- 172.21.15.50:0/1945768452 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ca419ee30 con 0x7f9ca4101af0 2024-06-06T03:37:17.496 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.488+0000 7f9ca0ff9640 1 -- 172.21.15.50:0/1945768452 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9c98042030 con 0x7f9ca4101af0 2024-06-06T03:37:17.496 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.488+0000 7f9cacb98740 1 Processor -- start 2024-06-06T03:37:17.496 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.488+0000 7f9cacb98740 1 -- start start 2024-06-06T03:37:17.496 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.489+0000 7f9cacb98740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f274b4220 0x564f274b4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:17.496 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.489+0000 7f9cacb98740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f274b4c10 0x564f274b9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:17.496 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.489+0000 7f9cacb98740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f274b9d80 0x564f274bc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:17.496 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.489+0000 7f9cacb98740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564f274154f0 con 0x564f274b4c10 2024-06-06T03:37:17.496 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.489+0000 7f9cacb98740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564f273b3870 con 0x564f274b9d80 2024-06-06T03:37:17.496 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.489+0000 7f9cacb98740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564f274114b0 con 0x564f274b4220 2024-06-06T03:37:17.496 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.489+0000 7f9ca37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f274b4c10 0x564f274b9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:17.496 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.489+0000 7f9ca0ff9640 1 --2- 172.21.15.50:0/1945768452 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9c8c0a2cb0 0x7f9c8c0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:17.497 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.489+0000 7f9ca37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f274b4c10 0x564f274b9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56994/0 (socket says 172.21.15.50:56994) 2024-06-06T03:37:17.497 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.489+0000 7f9ca37fe640 1 -- 172.21.15.50:0/3193918368 learned_addr learned my addr 172.21.15.50:0/3193918368 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:17.497 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.489+0000 7f9ca3fff640 1 --2- 172.21.15.50:0/1945768452 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9c8c0a2cb0 0x7f9c8c0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:17.497 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.489+0000 7f9ca0ff9640 1 -- 172.21.15.50:0/1945768452 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f9c980efa60 con 0x7f9ca4101af0 2024-06-06T03:37:17.497 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.489+0000 7f9ca2ffd640 1 --2- 172.21.15.50:0/3193918368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f274b9d80 0x564f274bc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:17.497 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.489+0000 7f9ca3fff640 1 --2- 172.21.15.50:0/3193918368 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f274b4220 0x564f274b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:17.497 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.489+0000 7f9ca37fe640 1 -- 172.21.15.50:0/3193918368 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f274b4220 msgr2=0x564f274b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:17.497 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.489+0000 7f9ca37fe640 1 --2- 172.21.15.50:0/3193918368 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f274b4220 0x564f274b4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.497 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.489+0000 7f9ca37fe640 1 -- 172.21.15.50:0/3193918368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f274b9d80 msgr2=0x564f274bc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:17.497 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.489+0000 7f9ca37fe640 1 --2- 172.21.15.50:0/3193918368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f274b9d80 0x564f274bc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.497 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.489+0000 7f9ca37fe640 1 -- 172.21.15.50:0/3193918368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f273cf9b0 con 0x564f274b4c10 2024-06-06T03:37:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.489+0000 7f9ca2ffd640 1 --2- 172.21.15.50:0/3193918368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f274b9d80 0x564f274bc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:37:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.489+0000 7f9ca3fff640 1 --2- 172.21.15.50:0/3193918368 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f274b4220 0x564f274b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:37:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.489+0000 7f9ca37fe640 1 --2- 172.21.15.50:0/3193918368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f274b4c10 0x564f274b9710 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009c30 tx=0x7f9c9400e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9385303ccc318b7f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.489+0000 7f9ca3fff640 1 --2- 172.21.15.50:0/1945768452 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9c8c0a2cb0 0x7f9c8c0a5170 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x564f274b5470 tx=0x7f9c9c009200 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.489+0000 7f9c89ffb640 1 -- 172.21.15.50:0/3193918368 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c94016070 con 0x564f274b4c10 2024-06-06T03:37:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.490+0000 7f9c89ffb640 1 -- 172.21.15.50:0/3193918368 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9c940054d0 con 0x564f274b4c10 2024-06-06T03:37:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.490+0000 7f9c89ffb640 1 -- 172.21.15.50:0/3193918368 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c94011470 con 0x564f274b4c10 2024-06-06T03:37:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.490+0000 7f9cacb98740 1 -- 172.21.15.50:0/3193918368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f274b4c10 msgr2=0x564f274b9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.490+0000 7f9cacb98740 1 --2- 172.21.15.50:0/3193918368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f274b4c10 0x564f274b9710 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009c30 tx=0x7f9c9400e6c0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.490+0000 7f9cacb98740 1 -- 172.21.15.50:0/3193918368 shutdown_connections 2024-06-06T03:37:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.490+0000 7f9cacb98740 1 --2- 172.21.15.50:0/3193918368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f274b4c10 0x564f274b9710 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.490+0000 7f9cacb98740 1 --2- 172.21.15.50:0/3193918368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f274b9d80 0x564f274bc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.490+0000 7f9cacb98740 1 --2- 172.21.15.50:0/3193918368 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f274b4220 0x564f274b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.490+0000 7f9cacb98740 1 -- 172.21.15.50:0/3193918368 >> 172.21.15.50:0/3193918368 conn(0x564f274ad680 msgr2=0x564f274ada80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.490+0000 7f9cacb98740 1 -- 172.21.15.50:0/3193918368 shutdown_connections 2024-06-06T03:37:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.490+0000 7f9cacb98740 1 -- 172.21.15.50:0/3193918368 wait complete. 2024-06-06T03:37:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.491+0000 7f9cacb98740 1 -- start start 2024-06-06T03:37:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.491+0000 7f9cacb98740 1 Processor -- start 2024-06-06T03:37:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.491+0000 7f9cacb98740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f274b4220 0x564f274be3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.491+0000 7f9cacb98740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f274b4c10 0x564f274be8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.491+0000 7f9cacb98740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f274b9d80 0x564f274c5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.491+0000 7f9cacb98740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564f274bcd30 con 0x564f274b4220 2024-06-06T03:37:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.491+0000 7f9cacb98740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564f2739eae0 con 0x564f274b9d80 2024-06-06T03:37:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.491+0000 7f9cacb98740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564f274bceb0 con 0x564f274b4c10 2024-06-06T03:37:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.491+0000 7f9ca37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f274b4220 0x564f274be3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.491+0000 7f9cacb98740 10 client.0 _ll_register_callbacks cb 0x564f273d79b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:37:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.491+0000 7f9ca37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f274b4220 0x564f274be3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57002/0 (socket says 172.21.15.50:57002) 2024-06-06T03:37:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.491+0000 7f9ca37fe640 1 -- 172.21.15.50:0/2589040995 learned_addr learned my addr 172.21.15.50:0/2589040995 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.491+0000 7f9ca2ffd640 1 --2- 172.21.15.50:0/2589040995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f274b4c10 0x564f274be8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.491+0000 7f9ca3fff640 1 --2- 172.21.15.50:0/2589040995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f274b9d80 0x564f274c5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.491+0000 7f9ca37fe640 1 -- 172.21.15.50:0/2589040995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f274b4c10 msgr2=0x564f274be8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.491+0000 7f9ca37fe640 1 --2- 172.21.15.50:0/2589040995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f274b4c10 0x564f274be8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.491+0000 7f9ca37fe640 1 -- 172.21.15.50:0/2589040995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f274b9d80 msgr2=0x564f274c5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.491+0000 7f9ca37fe640 1 --2- 172.21.15.50:0/2589040995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f274b9d80 0x564f274c5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.491+0000 7f9ca37fe640 1 -- 172.21.15.50:0/2589040995 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f27129210 con 0x564f274b4220 2024-06-06T03:37:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.491+0000 7f9ca2ffd640 1 --2- 172.21.15.50:0/2589040995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f274b4c10 0x564f274be8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:37:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.491+0000 7f9ca3fff640 1 --2- 172.21.15.50:0/2589040995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f274b9d80 0x564f274c5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:37:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.492+0000 7f9ca37fe640 1 --2- 172.21.15.50:0/2589040995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f274b4220 0x564f274be3a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f9c94000c00 tx=0x7f9c94009970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b018b5418d1166 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.492+0000 7f9c82ffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:37:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.492+0000 7f9c82ffd640 1 -- 172.21.15.50:0/2589040995 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c94028060 con 0x564f274b4220 2024-06-06T03:37:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.492+0000 7f9c82ffd640 1 -- 172.21.15.50:0/2589040995 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f9c94004f80 con 0x564f274b4220 2024-06-06T03:37:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.492+0000 7f9cacb98740 1 -- 172.21.15.50:0/2589040995 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c940054d0 con 0x564f274b4220 2024-06-06T03:37:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.492+0000 7f9c82ffd640 1 -- 172.21.15.50:0/2589040995 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f9c94016040 con 0x564f274b4220 2024-06-06T03:37:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.492+0000 7f9cacb98740 10 client.16770 fetch_fsmap learned FSMap version 36 2024-06-06T03:37:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.492+0000 7f9cacb98740 1 -- 172.21.15.50:0/2589040995 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x564f271f5620 con 0x564f274b4220 2024-06-06T03:37:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.492+0000 7f9c82ffd640 1 -- 172.21.15.50:0/2589040995 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9c940054d0 con 0x564f274b4220 2024-06-06T03:37:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.492+0000 7f9c82ffd640 1 -- 172.21.15.50:0/2589040995 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7f9c9400f040 con 0x564f274b4220 2024-06-06T03:37:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.492+0000 7f9cacb98740 10 client.16770 fetch_fsmap finished waiting for FSMap version 36 2024-06-06T03:37:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.492+0000 7f9cacb98740 10 client.16770 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:37:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.492+0000 7f9cacb98740 20 client.16770 populate_metadata read hostname 'smithi050' 2024-06-06T03:37:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.492+0000 7f9cacb98740 1 --2- 172.21.15.50:0/2589040995 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564f274c9e30 0x564f274cc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.492+0000 7f9cacb98740 4 client.16770 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:37:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.492+0000 7f9cacb98740 1 -- 172.21.15.50:0/2589040995 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f27428f10 con 0x564f274c9e30 2024-06-06T03:37:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.493+0000 7f9ca2ffd640 1 --2- 172.21.15.50:0/2589040995 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564f274c9e30 0x564f274cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.493+0000 7f9ca2ffd640 1 --2- 172.21.15.50:0/2589040995 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564f274c9e30 0x564f274cc220 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1109072c0b47e9d8 server_cookie=3105ea1d328338f7 in_seq=0 out_seq=0 2024-06-06T03:37:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.493+0000 7f9c82ffd640 10 client.16770 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:37:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.494+0000 7f9c82ffd640 1 -- 172.21.15.50:0/2589040995 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x564f27428f10 con 0x564f274c9e30 2024-06-06T03:37:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.494+0000 7f9c82ffd640 10 client.16770 handle_command_reply: tid=0 2024-06-06T03:37:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.494+0000 7f9cacb98740 1 client.16770 shutdown 2024-06-06T03:37:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.494+0000 7f9cacb98740 1 -- 172.21.15.50:0/2589040995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f274b4220 msgr2=0x564f274be3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.494+0000 7f9cacb98740 1 --2- 172.21.15.50:0/2589040995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f274b4220 0x564f274be3a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f9c94000c00 tx=0x7f9c94009970 comp rx=0 tx=0).stop 2024-06-06T03:37:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.494+0000 7f9cacb98740 1 -- 172.21.15.50:0/2589040995 shutdown_connections 2024-06-06T03:37:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.494+0000 7f9cacb98740 1 --2- 172.21.15.50:0/2589040995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f274b9d80 0x564f274c5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.494+0000 7f9cacb98740 1 --2- 172.21.15.50:0/2589040995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f274b4c10 0x564f274be8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.494+0000 7f9cacb98740 1 --2- 172.21.15.50:0/2589040995 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564f274c9e30 0x564f274cc220 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.494+0000 7f9cacb98740 1 --2- 172.21.15.50:0/2589040995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f274b4220 0x564f274be3a0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.504 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.494+0000 7f9c82ffd640 0 client.16770 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:37:17.504 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.494+0000 7f9cacb98740 1 -- 172.21.15.50:0/2589040995 >> 172.21.15.50:0/2589040995 conn(0x564f274ad680 msgr2=0x564f274ac7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:17.504 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.494+0000 7f9cacb98740 1 -- 172.21.15.50:0/2589040995 shutdown_connections 2024-06-06T03:37:17.504 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.494+0000 7f9cacb98740 1 -- 172.21.15.50:0/2589040995 wait complete. 2024-06-06T03:37:17.504 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.494+0000 7f9cacb98740 20 client.16770 trim_cache size 0 max 16384 2024-06-06T03:37:17.515 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.513+0000 7f9cacb98740 1 Processor -- start 2024-06-06T03:37:17.522 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.521+0000 7f9cacb98740 1 -- start start 2024-06-06T03:37:17.522 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.521+0000 7f9cacb98740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f274b4220 0x564f274abf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:17.522 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.521+0000 7f9cacb98740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f274b4c10 0x564f274ac490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:17.523 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.521+0000 7f9cacb98740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f274b9d80 0x564f274c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:17.523 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.521+0000 7f9cacb98740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca41aaac0 con 0x564f274b4c10 2024-06-06T03:37:17.523 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.521+0000 7f9cacb98740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca41a8390 con 0x564f274b4220 2024-06-06T03:37:17.523 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.521+0000 7f9cacb98740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca41a61e0 con 0x564f274b9d80 2024-06-06T03:37:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.524+0000 7f9ca3fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f274b9d80 0x564f274c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.524+0000 7f9ca3fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f274b9d80 0x564f274c58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:59968/0 (socket says 172.21.15.50:59968) 2024-06-06T03:37:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.524+0000 7f9ca3fff640 1 -- 172.21.15.50:0/1389574802 learned_addr learned my addr 172.21.15.50:0/1389574802 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.525+0000 7f9ca2ffd640 1 --2- 172.21.15.50:0/1389574802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f274b4c10 0x564f274ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.525+0000 7f9ca37fe640 1 --2- 172.21.15.50:0/1389574802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f274b4220 0x564f274abf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:17.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.527+0000 7f9ca37fe640 1 -- 172.21.15.50:0/1389574802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f274b9d80 msgr2=0x564f274c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:17.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.527+0000 7f9ca37fe640 1 --2- 172.21.15.50:0/1389574802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f274b9d80 0x564f274c58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.527+0000 7f9ca37fe640 1 -- 172.21.15.50:0/1389574802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f274b4c10 msgr2=0x564f274ac490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:17.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.527+0000 7f9ca37fe640 1 --2- 172.21.15.50:0/1389574802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f274b4c10 0x564f274ac490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.527+0000 7f9ca37fe640 1 -- 172.21.15.50:0/1389574802 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f274a7ae0 con 0x564f274b4220 2024-06-06T03:37:17.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.527+0000 7f9ca37fe640 1 --2- 172.21.15.50:0/1389574802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f274b4220 0x564f274abf50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009b50 tx=0x7f9c9400ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2b65bd4d9bb177 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:17.531 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.531+0000 7f9c897fa640 1 -- 172.21.15.50:0/1389574802 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c94028030 con 0x564f274b4220 2024-06-06T03:37:17.531 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.531+0000 7f9c897fa640 1 -- 172.21.15.50:0/1389574802 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9c94005430 con 0x564f274b4220 2024-06-06T03:37:17.532 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.532+0000 7f9cacb98740 1 -- 172.21.15.50:0/1389574802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f274b4220 msgr2=0x564f274abf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:17.532 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.532+0000 7f9cacb98740 1 --2- 172.21.15.50:0/1389574802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f274b4220 0x564f274abf50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009b50 tx=0x7f9c9400ec70 comp rx=0 tx=0).stop 2024-06-06T03:37:17.549 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.548+0000 7f9cacb98740 1 -- 172.21.15.50:0/1389574802 shutdown_connections 2024-06-06T03:37:17.549 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.548+0000 7f9cacb98740 1 --2- 172.21.15.50:0/1389574802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f274b4c10 0x564f274ac490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.549 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.548+0000 7f9cacb98740 1 --2- 172.21.15.50:0/1389574802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f274b9d80 0x564f274c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.549 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.548+0000 7f9cacb98740 1 --2- 172.21.15.50:0/1389574802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f274b4220 0x564f274abf50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.549 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.548+0000 7f9cacb98740 1 -- 172.21.15.50:0/1389574802 >> 172.21.15.50:0/1389574802 conn(0x564f274ad680 msgr2=0x564f274b5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:17.549 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.549+0000 7f9cacb98740 1 -- 172.21.15.50:0/1389574802 shutdown_connections 2024-06-06T03:37:17.549 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.549+0000 7f9cacb98740 1 -- 172.21.15.50:0/1389574802 wait complete. 2024-06-06T03:37:17.550 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.549+0000 7f9cacb98740 1 -- start start 2024-06-06T03:37:17.550 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.550+0000 7f9cacb98740 1 Processor -- start 2024-06-06T03:37:17.550 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.550+0000 7f9cacb98740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f274b4220 0x564f274bfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:17.550 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.551+0000 7f9cacb98740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f274b4c10 0x564f274bffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:17.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.551+0000 7f9cacb98740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f274b9d80 0x564f274c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:17.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.551+0000 7f9cacb98740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca41a6850 con 0x564f274b9d80 2024-06-06T03:37:17.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.551+0000 7f9cacb98740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca41a7cc0 con 0x564f274b4c10 2024-06-06T03:37:17.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.551+0000 7f9cacb98740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca41a6f20 con 0x564f274b4220 2024-06-06T03:37:17.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.551+0000 7f9cacb98740 10 client.0 _ll_register_callbacks cb 0x7f9c94009a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:37:17.554 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.555+0000 7f9ca3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f274b9d80 0x564f274c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:17.554 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.555+0000 7f9ca3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f274b9d80 0x564f274c4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57016/0 (socket says 172.21.15.50:57016) 2024-06-06T03:37:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.555+0000 7f9ca3fff640 1 -- 172.21.15.50:0/3104568948 learned_addr learned my addr 172.21.15.50:0/3104568948 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.555+0000 7f9ca3fff640 1 -- 172.21.15.50:0/3104568948 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f274b4220 msgr2=0x564f274bfa60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:37:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.555+0000 7f9ca3fff640 1 --2- 172.21.15.50:0/3104568948 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f274b4220 0x564f274bfa60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.555+0000 7f9ca3fff640 1 -- 172.21.15.50:0/3104568948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f274b4c10 msgr2=0x564f274bffa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:37:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.555+0000 7f9ca3fff640 1 --2- 172.21.15.50:0/3104568948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f274b4c10 0x564f274bffa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.555+0000 7f9ca3fff640 1 -- 172.21.15.50:0/3104568948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f274c55c0 con 0x564f274b9d80 2024-06-06T03:37:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.556+0000 7f9ca3fff640 1 --2- 172.21.15.50:0/3104568948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f274b9d80 0x564f274c4fd0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c010cf0 tx=0x7f9c9c009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7522429163f972f4 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.556+0000 7f9c82ffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:37:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.556+0000 7f9c82ffd640 1 -- 172.21.15.50:0/3104568948 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c003970 con 0x564f274b9d80 2024-06-06T03:37:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.557+0000 7f9cacb98740 1 -- 172.21.15.50:0/3104568948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c94005430 con 0x564f274b9d80 2024-06-06T03:37:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.557+0000 7f9c82ffd640 1 -- 172.21.15.50:0/3104568948 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f9c9c017070 con 0x564f274b9d80 2024-06-06T03:37:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.557+0000 7f9c82ffd640 1 -- 172.21.15.50:0/3104568948 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f9c9c032050 con 0x564f274b9d80 2024-06-06T03:37:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.557+0000 7f9cacb98740 10 client.16776 fetch_fsmap learned FSMap version 36 2024-06-06T03:37:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.557+0000 7f9cacb98740 1 -- 172.21.15.50:0/3104568948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x564f27531560 con 0x564f274b9d80 2024-06-06T03:37:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.558+0000 7f9c82ffd640 1 -- 172.21.15.50:0/3104568948 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9c9c004020 con 0x564f274b9d80 2024-06-06T03:37:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.558+0000 7f9c82ffd640 1 -- 172.21.15.50:0/3104568948 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7f9c9c025410 con 0x564f274b9d80 2024-06-06T03:37:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.558+0000 7f9cacb98740 10 client.16776 fetch_fsmap finished waiting for FSMap version 36 2024-06-06T03:37:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.558+0000 7f9cacb98740 10 client.16776 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:37:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.559+0000 7f9cacb98740 20 client.16776 populate_metadata read hostname 'smithi050' 2024-06-06T03:37:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.559+0000 7f9cacb98740 1 --2- 172.21.15.50:0/3104568948 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564f27531fd0 0x564f275343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.559+0000 7f9cacb98740 4 client.16776 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:37:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.559+0000 7f9cacb98740 1 -- 172.21.15.50:0/3104568948 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f9c94005430 con 0x564f27531fd0 2024-06-06T03:37:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.559+0000 7f9ca37fe640 1 --2- 172.21.15.50:0/3104568948 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564f27531fd0 0x564f275343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:17.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.571+0000 7f9ca37fe640 1 --2- 172.21.15.50:0/3104568948 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564f27531fd0 0x564f275343f0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0abc784f8c37ddb server_cookie=47cc63aa58161d62 in_seq=0 out_seq=0 2024-06-06T03:37:17.574 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.571+0000 7f9c82ffd640 10 client.16776 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:37:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.624+0000 7f9c82ffd640 1 -- 172.21.15.50:0/3104568948 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x7f9c94005430 con 0x564f27531fd0 2024-06-06T03:37:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.624+0000 7f9c82ffd640 10 client.16776 handle_command_reply: tid=0 2024-06-06T03:37:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.624+0000 7f9cacb98740 1 client.16776 shutdown 2024-06-06T03:37:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.624+0000 7f9cacb98740 1 -- 172.21.15.50:0/3104568948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f274b9d80 msgr2=0x564f274c4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.624+0000 7f9cacb98740 1 --2- 172.21.15.50:0/3104568948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f274b9d80 0x564f274c4fd0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c010cf0 tx=0x7f9c9c009500 comp rx=0 tx=0).stop 2024-06-06T03:37:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.624+0000 7f9cacb98740 1 -- 172.21.15.50:0/3104568948 shutdown_connections 2024-06-06T03:37:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.624+0000 7f9cacb98740 1 --2- 172.21.15.50:0/3104568948 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x564f27531fd0 0x564f275343f0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.624+0000 7f9cacb98740 1 --2- 172.21.15.50:0/3104568948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f274b9d80 0x564f274c4fd0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.624+0000 7f9cacb98740 1 --2- 172.21.15.50:0/3104568948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f274b4c10 0x564f274bffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.624+0000 7f9cacb98740 1 --2- 172.21.15.50:0/3104568948 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f274b4220 0x564f274bfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.624+0000 7f9cacb98740 1 -- 172.21.15.50:0/3104568948 >> 172.21.15.50:0/3104568948 conn(0x564f274ad680 msgr2=0x564f274b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.625+0000 7f9c82ffd640 0 client.16776 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:37:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.625+0000 7f9cacb98740 1 -- 172.21.15.50:0/3104568948 shutdown_connections 2024-06-06T03:37:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.625+0000 7f9cacb98740 1 -- 172.21.15.50:0/3104568948 wait complete. 2024-06-06T03:37:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.625+0000 7f9cacb98740 20 client.16776 trim_cache size 0 max 16384 2024-06-06T03:37:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:37:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:37:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:37:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.626+0000 7f9ca9e8c640 1 -- 172.21.15.50:0/1945768452 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9c8c0a2cb0 msgr2=0x7f9c8c0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.626+0000 7f9ca9e8c640 1 --2- 172.21.15.50:0/1945768452 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9c8c0a2cb0 0x7f9c8c0a5170 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x564f274b5470 tx=0x7f9c9c009200 comp rx=0 tx=0).stop 2024-06-06T03:37:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.626+0000 7f9ca9e8c640 1 -- 172.21.15.50:0/1945768452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ca4101af0 msgr2=0x7f9ca4196f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.626+0000 7f9ca9e8c640 1 --2- 172.21.15.50:0/1945768452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ca4101af0 0x7f9ca4196f80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f9c98005940 tx=0x7f9c980042f0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.626+0000 7f9ca9e8c640 1 -- 172.21.15.50:0/1945768452 shutdown_connections 2024-06-06T03:37:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.626+0000 7f9ca9e8c640 1 --2- 172.21.15.50:0/1945768452 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f9c8c0a2cb0 0x7f9c8c0a5170 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.626+0000 7f9ca9e8c640 1 --2- 172.21.15.50:0/1945768452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ca4101af0 0x7f9ca4196f80 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.626+0000 7f9ca9e8c640 1 --2- 172.21.15.50:0/1945768452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ca41024b0 0x7f9ca419dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.626+0000 7f9ca9e8c640 1 --2- 172.21.15.50:0/1945768452 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ca4100900 0x7f9ca4196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.626+0000 7f9ca9e8c640 1 -- 172.21.15.50:0/1945768452 >> 172.21.15.50:0/1945768452 conn(0x7f9ca40fbe90 msgr2=0x7f9ca4104d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.626+0000 7f9ca9e8c640 1 -- 172.21.15.50:0/1945768452 shutdown_connections 2024-06-06T03:37:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:17.626+0000 7f9ca9e8c640 1 -- 172.21.15.50:0/1945768452 wait complete. 2024-06-06T03:37:19.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:18 smithi122 ceph-mon[35759]: pgmap v751: 129 pgs: 129 active+clean; 10 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 29 MiB/s wr, 559 op/s 2024-06-06T03:37:19.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:18 smithi050 ceph-mon[32421]: pgmap v751: 129 pgs: 129 active+clean; 10 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 29 MiB/s wr, 559 op/s 2024-06-06T03:37:19.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:18 smithi079 ceph-mon[35478]: pgmap v751: 129 pgs: 129 active+clean; 10 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 29 MiB/s wr, 559 op/s 2024-06-06T03:37:19.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.843+0000 7f697aeee700 1 -- 172.21.15.50:0/2460888796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6974111060 msgr2=0x7f69741099d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:19.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.843+0000 7f697aeee700 1 --2- 172.21.15.50:0/2460888796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6974111060 0x7f69741099d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f69680098f0 tx=0x7f6968009c00 comp rx=0 tx=0).stop 2024-06-06T03:37:19.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.843+0000 7f697aeee700 1 -- 172.21.15.50:0/2460888796 shutdown_connections 2024-06-06T03:37:19.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.843+0000 7f697aeee700 1 --2- 172.21.15.50:0/2460888796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f697411bc70 0x7f697411e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:19.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.843+0000 7f697aeee700 1 --2- 172.21.15.50:0/2460888796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6974110bf0 0x7f6974109490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:19.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.843+0000 7f697aeee700 1 --2- 172.21.15.50:0/2460888796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6974111060 0x7f69741099d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:19.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.843+0000 7f697aeee700 1 -- 172.21.15.50:0/2460888796 >> 172.21.15.50:0/2460888796 conn(0x7f697406d600 msgr2=0x7f697406da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:19.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.845+0000 7f697aeee700 1 -- 172.21.15.50:0/2460888796 shutdown_connections 2024-06-06T03:37:19.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.845+0000 7f697aeee700 1 -- 172.21.15.50:0/2460888796 wait complete. 2024-06-06T03:37:19.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.846+0000 7f697aeee700 1 Processor -- start 2024-06-06T03:37:19.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.850+0000 7f697aeee700 1 -- start start 2024-06-06T03:37:19.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.850+0000 7f697aeee700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6974110bf0 0x7f697411b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:19.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.850+0000 7f697aeee700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f697411bc70 0x7f6974114330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:19.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.850+0000 7f697aeee700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6974114870 0x7f6974114cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:19.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.850+0000 7f697aeee700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f69741214d0 con 0x7f6974110bf0 2024-06-06T03:37:19.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.850+0000 7f697aeee700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6974121350 con 0x7f6974114870 2024-06-06T03:37:19.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.850+0000 7f697aeee700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6974121650 con 0x7f697411bc70 2024-06-06T03:37:19.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.850+0000 7f6973fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f697411bc70 0x7f6974114330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:19.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.851+0000 7f6973fff700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f697411bc70 0x7f6974114330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:51176/0 (socket says 172.21.15.50:51176) 2024-06-06T03:37:19.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.851+0000 7f6973fff700 1 -- 172.21.15.50:0/116169123 learned_addr learned my addr 172.21.15.50:0/116169123 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:19.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.851+0000 7f697948b700 1 --2- 172.21.15.50:0/116169123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6974114870 0x7f6974114cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:19.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.851+0000 7f6978c8a700 1 --2- 172.21.15.50:0/116169123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6974110bf0 0x7f697411b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:19.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.851+0000 7f697948b700 1 -- 172.21.15.50:0/116169123 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f697411bc70 msgr2=0x7f6974114330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:19.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.851+0000 7f697948b700 1 --2- 172.21.15.50:0/116169123 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f697411bc70 0x7f6974114330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:19.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.851+0000 7f697948b700 1 -- 172.21.15.50:0/116169123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6974110bf0 msgr2=0x7f697411b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:19.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.851+0000 7f697948b700 1 --2- 172.21.15.50:0/116169123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6974110bf0 0x7f697411b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:19.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.851+0000 7f697948b700 1 -- 172.21.15.50:0/116169123 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6974118dd0 con 0x7f6974114870 2024-06-06T03:37:19.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.853+0000 7f697948b700 1 --2- 172.21.15.50:0/116169123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6974114870 0x7f6974114cf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f696400e970 tx=0x7f696400ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:19.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.856+0000 7f6971ffb700 1 -- 172.21.15.50:0/116169123 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6964004220 con 0x7f6974114870 2024-06-06T03:37:19.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.856+0000 7f697aeee700 1 -- 172.21.15.50:0/116169123 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6974119060 con 0x7f6974114870 2024-06-06T03:37:19.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.856+0000 7f697aeee700 1 -- 172.21.15.50:0/116169123 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69741195a0 con 0x7f6974114870 2024-06-06T03:37:19.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.858+0000 7f6971ffb700 1 -- 172.21.15.50:0/116169123 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f69640043c0 con 0x7f6974114870 2024-06-06T03:37:19.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.859+0000 7f6971ffb700 1 -- 172.21.15.50:0/116169123 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6964010700 con 0x7f6974114870 2024-06-06T03:37:19.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.863+0000 7f6971ffb700 1 -- 172.21.15.50:0/116169123 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6964010960 con 0x7f6974114870 2024-06-06T03:37:19.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.864+0000 7f6971ffb700 1 --2- 172.21.15.50:0/116169123 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f695c0a2d70 0x7f695c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:19.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.864+0000 7f6971ffb700 1 -- 172.21.15.50:0/116169123 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f69640cfff0 con 0x7f6974114870 2024-06-06T03:37:19.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.871+0000 7f6978c8a700 1 --2- 172.21.15.50:0/116169123 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f695c0a2d70 0x7f695c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:19.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.871+0000 7f6978c8a700 1 --2- 172.21.15.50:0/116169123 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f695c0a2d70 0x7f695c0a5230 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f696c009e60 tx=0x7f696c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:19.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.876+0000 7f6985771b80 1 Processor -- start 2024-06-06T03:37:19.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.876+0000 7f6985771b80 1 -- start start 2024-06-06T03:37:19.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.876+0000 7f6985771b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e65494af60 0x55e65494b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:19.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.876+0000 7f6985771b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e65494b880 0x55e654945260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:19.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.876+0000 7f6985771b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6549457a0 0x55e654945bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:19.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.876+0000 7f6985771b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e654837f60 con 0x55e65494b880 2024-06-06T03:37:19.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.876+0000 7f6985771b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e654896850 con 0x55e65494af60 2024-06-06T03:37:19.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.876+0000 7f6985771b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e6547fe460 con 0x55e6549457a0 2024-06-06T03:37:19.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.879+0000 7f6973fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e65494b880 0x55e654945260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:19.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.879+0000 7f6973fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e65494b880 0x55e654945260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47112/0 (socket says 172.21.15.50:47112) 2024-06-06T03:37:19.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.879+0000 7f6973fff700 1 -- 172.21.15.50:0/2540930085 learned_addr learned my addr 172.21.15.50:0/2540930085 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:19.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.879+0000 7f6978c8a700 1 --2- 172.21.15.50:0/2540930085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e65494af60 0x55e65494b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:19.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.881+0000 7f697948b700 1 --2- 172.21.15.50:0/2540930085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6549457a0 0x55e654945bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:19.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.881+0000 7f6973fff700 1 -- 172.21.15.50:0/2540930085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6549457a0 msgr2=0x55e654945bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:19.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.881+0000 7f6973fff700 1 --2- 172.21.15.50:0/2540930085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6549457a0 0x55e654945bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:19.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.882+0000 7f6973fff700 1 -- 172.21.15.50:0/2540930085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e65494af60 msgr2=0x55e65494b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:19.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.882+0000 7f6973fff700 1 --2- 172.21.15.50:0/2540930085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e65494af60 0x55e65494b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:19.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.882+0000 7f6973fff700 1 -- 172.21.15.50:0/2540930085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6547e58d0 con 0x55e65494b880 2024-06-06T03:37:19.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.882+0000 7f6973fff700 1 --2- 172.21.15.50:0/2540930085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e65494b880 0x55e654945260 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6968009610 tx=0x7f6968009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47698e4428513b81 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:19.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.883+0000 7f695affd700 1 -- 172.21.15.50:0/2540930085 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6968026070 con 0x55e65494b880 2024-06-06T03:37:19.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.883+0000 7f695affd700 1 -- 172.21.15.50:0/2540930085 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f696800f910 con 0x55e65494b880 2024-06-06T03:37:19.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.883+0000 7f695affd700 1 -- 172.21.15.50:0/2540930085 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69680038e0 con 0x55e65494b880 2024-06-06T03:37:19.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.884+0000 7f6985771b80 1 -- 172.21.15.50:0/2540930085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e65494b880 msgr2=0x55e654945260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:19.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.884+0000 7f6985771b80 1 --2- 172.21.15.50:0/2540930085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e65494b880 0x55e654945260 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6968009610 tx=0x7f6968009f70 comp rx=0 tx=0).stop 2024-06-06T03:37:19.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.884+0000 7f6985771b80 1 -- 172.21.15.50:0/2540930085 shutdown_connections 2024-06-06T03:37:19.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.884+0000 7f6985771b80 1 --2- 172.21.15.50:0/2540930085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6549457a0 0x55e654945bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:19.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.884+0000 7f6985771b80 1 --2- 172.21.15.50:0/2540930085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e65494af60 0x55e65494b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:19.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.884+0000 7f6985771b80 1 --2- 172.21.15.50:0/2540930085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e65494b880 0x55e654945260 secure :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6968009610 tx=0x7f6968009f70 comp rx=0 tx=0).stop 2024-06-06T03:37:19.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.885+0000 7f6985771b80 1 -- 172.21.15.50:0/2540930085 >> 172.21.15.50:0/2540930085 conn(0x55e654872080 msgr2=0x55e654940220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:19.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.885+0000 7f6985771b80 1 -- 172.21.15.50:0/2540930085 shutdown_connections 2024-06-06T03:37:19.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.885+0000 7f6985771b80 1 -- 172.21.15.50:0/2540930085 wait complete. 2024-06-06T03:37:19.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.886+0000 7f6985771b80 1 -- start start 2024-06-06T03:37:19.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.886+0000 7f6985771b80 1 Processor -- start 2024-06-06T03:37:19.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.907+0000 7f6985771b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6549457a0 0x55e6549517b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:19.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.907+0000 7f6985771b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e65494af60 0x55e65494eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:19.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.907+0000 7f6985771b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e65494eff0 0x55e65494f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:19.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.907+0000 7f6985771b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e654836fc0 con 0x55e6549457a0 2024-06-06T03:37:19.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.907+0000 7f6985771b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e654892810 con 0x55e65494eff0 2024-06-06T03:37:19.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.907+0000 7f6985771b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e654952200 con 0x55e65494af60 2024-06-06T03:37:19.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.907+0000 7f6985771b80 10 client.0 _ll_register_callbacks cb 0x55e65482c5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:37:19.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.909+0000 7f6978c8a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6549457a0 0x55e6549517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:19.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.909+0000 7f6978c8a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6549457a0 0x55e6549517b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47122/0 (socket says 172.21.15.50:47122) 2024-06-06T03:37:19.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.909+0000 7f6978c8a700 1 -- 172.21.15.50:0/1136140995 learned_addr learned my addr 172.21.15.50:0/1136140995 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:19.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.909+0000 7f6973fff700 1 --2- 172.21.15.50:0/1136140995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e65494af60 0x55e65494eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:19.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.909+0000 7f697948b700 1 --2- 172.21.15.50:0/1136140995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e65494eff0 0x55e65494f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:19.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.913+0000 7f697948b700 1 -- 172.21.15.50:0/1136140995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e65494af60 msgr2=0x55e65494eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:19.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.913+0000 7f697948b700 1 --2- 172.21.15.50:0/1136140995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e65494af60 0x55e65494eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:19.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.913+0000 7f697948b700 1 -- 172.21.15.50:0/1136140995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6549457a0 msgr2=0x55e6549517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:19.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.913+0000 7f697948b700 1 --2- 172.21.15.50:0/1136140995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6549457a0 0x55e6549517b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:19.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.913+0000 7f697948b700 1 -- 172.21.15.50:0/1136140995 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e65485c750 con 0x55e65494eff0 2024-06-06T03:37:19.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.913+0000 7f6978c8a700 1 --2- 172.21.15.50:0/1136140995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6549457a0 0x55e6549517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:37:19.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.921+0000 7f697948b700 1 --2- 172.21.15.50:0/1136140995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e65494eff0 0x55e65494f470 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f696409c170 tx=0x7f696409c9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f47d8c8ceb5f407 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:19.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.921+0000 7f6953fff700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:37:19.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.921+0000 7f6953fff700 1 -- 172.21.15.50:0/1136140995 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69640b4020 con 0x55e65494eff0 2024-06-06T03:37:19.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.921+0000 7f6953fff700 1 -- 172.21.15.50:0/1136140995 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f69640b5250 con 0x55e65494eff0 2024-06-06T03:37:19.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.923+0000 7f6985771b80 1 -- 172.21.15.50:0/1136140995 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f696800f910 con 0x55e65494eff0 2024-06-06T03:37:19.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.927+0000 7f6953fff700 1 -- 172.21.15.50:0/1136140995 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f69640ba050 con 0x55e65494eff0 2024-06-06T03:37:19.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.928+0000 7f6985771b80 10 client.26453 fetch_fsmap learned FSMap version 36 2024-06-06T03:37:19.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.928+0000 7f6985771b80 1 -- 172.21.15.50:0/1136140995 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55e65495cfb0 con 0x55e65494eff0 2024-06-06T03:37:19.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.932+0000 7f6953fff700 1 -- 172.21.15.50:0/1136140995 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f696800f910 con 0x55e65494eff0 2024-06-06T03:37:19.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.932+0000 7f6953fff700 1 -- 172.21.15.50:0/1136140995 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7f69640cdbd0 con 0x55e65494eff0 2024-06-06T03:37:19.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.932+0000 7f6985771b80 10 client.26453 fetch_fsmap finished waiting for FSMap version 36 2024-06-06T03:37:19.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.932+0000 7f6985771b80 10 client.26453 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:37:19.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.932+0000 7f6985771b80 20 client.26453 populate_metadata read hostname 'smithi050' 2024-06-06T03:37:19.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.932+0000 7f6985771b80 1 --2- 172.21.15.50:0/1136140995 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55e65495fa90 0x55e654961eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:19.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.932+0000 7f6985771b80 4 client.26453 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:37:19.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.932+0000 7f6985771b80 1 -- 172.21.15.50:0/1136140995 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6548a3d50 con 0x55e65495fa90 2024-06-06T03:37:19.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.933+0000 7f6978c8a700 1 --2- 172.21.15.50:0/1136140995 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55e65495fa90 0x55e654961eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:19.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.934+0000 7f6978c8a700 1 --2- 172.21.15.50:0/1136140995 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55e65495fa90 0x55e654961eb0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e58c77e6bbf959b9 server_cookie=256c5eb745cbaf95 in_seq=0 out_seq=0 2024-06-06T03:37:19.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.934+0000 7f6953fff700 10 client.26453 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:37:19.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.935+0000 7f6953fff700 1 -- 172.21.15.50:0/1136140995 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55e6548a3d50 con 0x55e65495fa90 2024-06-06T03:37:19.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.935+0000 7f6953fff700 10 client.26453 handle_command_reply: tid=0 2024-06-06T03:37:19.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.935+0000 7f6985771b80 1 client.26453 shutdown 2024-06-06T03:37:19.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.939+0000 7f6985771b80 1 -- 172.21.15.50:0/1136140995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e65494eff0 msgr2=0x55e65494f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:19.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.939+0000 7f6985771b80 1 --2- 172.21.15.50:0/1136140995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e65494eff0 0x55e65494f470 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f696409c170 tx=0x7f696409c9b0 comp rx=0 tx=0).stop 2024-06-06T03:37:19.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.939+0000 7f6985771b80 1 -- 172.21.15.50:0/1136140995 shutdown_connections 2024-06-06T03:37:19.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.939+0000 7f6985771b80 1 --2- 172.21.15.50:0/1136140995 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55e65495fa90 0x55e654961eb0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:19.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.939+0000 7f6985771b80 1 --2- 172.21.15.50:0/1136140995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e65494eff0 0x55e65494f470 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:19.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.939+0000 7f6985771b80 1 --2- 172.21.15.50:0/1136140995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6549457a0 0x55e6549517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:19.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.939+0000 7f6985771b80 1 --2- 172.21.15.50:0/1136140995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e65494af60 0x55e65494eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:19.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.939+0000 7f6985771b80 1 -- 172.21.15.50:0/1136140995 >> 172.21.15.50:0/1136140995 conn(0x55e654872080 msgr2=0x55e65493f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:19.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.939+0000 7f6953fff700 0 client.26453 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:37:19.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.940+0000 7f6985771b80 1 -- 172.21.15.50:0/1136140995 shutdown_connections 2024-06-06T03:37:19.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.940+0000 7f6985771b80 1 -- 172.21.15.50:0/1136140995 wait complete. 2024-06-06T03:37:19.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.940+0000 7f6985771b80 20 client.26453 trim_cache size 0 max 16384 2024-06-06T03:37:19.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.987+0000 7f6985771b80 1 Processor -- start 2024-06-06T03:37:19.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.987+0000 7f6985771b80 1 -- start start 2024-06-06T03:37:19.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.988+0000 7f6985771b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6549457a0 0x55e6549491c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:19.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.988+0000 7f6985771b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e65494af60 0x55e6549677c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:19.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.988+0000 7f6978c8a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6549457a0 0x55e6549491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:19.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.988+0000 7f6978c8a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6549457a0 0x55e6549491c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47132/0 (socket says 172.21.15.50:47132) 2024-06-06T03:37:19.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.988+0000 7f6978c8a700 1 -- 172.21.15.50:0/112375041 learned_addr learned my addr 172.21.15.50:0/112375041 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:19.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.989+0000 7f6985771b80 1 --2- 172.21.15.50:0/112375041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e65494eff0 0x55e654967d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:19.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.989+0000 7f6973fff700 1 --2- 172.21.15.50:0/112375041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e65494af60 0x55e6549677c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:19.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.989+0000 7f6985771b80 1 -- 172.21.15.50:0/112375041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6960011360 con 0x55e6549457a0 2024-06-06T03:37:19.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.989+0000 7f697948b700 1 --2- 172.21.15.50:0/112375041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e65494eff0 0x55e654967d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:19.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.989+0000 7f6985771b80 1 -- 172.21.15.50:0/112375041 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f696000ebf0 con 0x55e65494eff0 2024-06-06T03:37:19.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.989+0000 7f6985771b80 1 -- 172.21.15.50:0/112375041 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f696000ca40 con 0x55e65494af60 2024-06-06T03:37:19.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.998+0000 7f6973fff700 1 -- 172.21.15.50:0/112375041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e65494eff0 msgr2=0x55e654967d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:19.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.998+0000 7f6973fff700 1 --2- 172.21.15.50:0/112375041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e65494eff0 0x55e654967d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:19.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.998+0000 7f6973fff700 1 -- 172.21.15.50:0/112375041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6549457a0 msgr2=0x55e6549491c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:19.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.998+0000 7f6973fff700 1 --2- 172.21.15.50:0/112375041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6549457a0 0x55e6549491c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:19.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.998+0000 7f6973fff700 1 -- 172.21.15.50:0/112375041 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e654962530 con 0x55e65494af60 2024-06-06T03:37:19.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:19.998+0000 7f6973fff700 1 --2- 172.21.15.50:0/112375041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e65494af60 0x55e6549677c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6968004000 tx=0x7f6968010d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e646282876e983b server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:20.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.001+0000 7f695a7fc700 1 -- 172.21.15.50:0/112375041 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6968026040 con 0x55e65494af60 2024-06-06T03:37:20.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.001+0000 7f695a7fc700 1 -- 172.21.15.50:0/112375041 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6968030070 con 0x55e65494af60 2024-06-06T03:37:20.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.001+0000 7f695a7fc700 1 -- 172.21.15.50:0/112375041 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6968003680 con 0x55e65494af60 2024-06-06T03:37:20.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.005+0000 7f6985771b80 1 -- 172.21.15.50:0/112375041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e65494af60 msgr2=0x55e6549677c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:20.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.005+0000 7f6985771b80 1 --2- 172.21.15.50:0/112375041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e65494af60 0x55e6549677c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6968004000 tx=0x7f6968010d10 comp rx=0 tx=0).stop 2024-06-06T03:37:20.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.007+0000 7f6985771b80 1 -- 172.21.15.50:0/112375041 shutdown_connections 2024-06-06T03:37:20.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.007+0000 7f6985771b80 1 --2- 172.21.15.50:0/112375041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e65494eff0 0x55e654967d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:20.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.007+0000 7f6985771b80 1 --2- 172.21.15.50:0/112375041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6549457a0 0x55e6549491c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:20.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.007+0000 7f6985771b80 1 --2- 172.21.15.50:0/112375041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e65494af60 0x55e6549677c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:20.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.007+0000 7f6985771b80 1 -- 172.21.15.50:0/112375041 >> 172.21.15.50:0/112375041 conn(0x55e654872080 msgr2=0x55e654948ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:20.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.008+0000 7f6985771b80 1 -- 172.21.15.50:0/112375041 shutdown_connections 2024-06-06T03:37:20.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.008+0000 7f6985771b80 1 -- 172.21.15.50:0/112375041 wait complete. 2024-06-06T03:37:20.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.009+0000 7f6985771b80 1 -- start start 2024-06-06T03:37:20.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.009+0000 7f6985771b80 1 Processor -- start 2024-06-06T03:37:20.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.010+0000 7f6985771b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6549457a0 0x55e654957cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:20.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.010+0000 7f6985771b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e65494af60 0x55e654967160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:20.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.010+0000 7f6978c8a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6549457a0 0x55e654957cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:20.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.010+0000 7f6978c8a700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6549457a0 0x55e654957cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:51208/0 (socket says 172.21.15.50:51208) 2024-06-06T03:37:20.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.010+0000 7f6978c8a700 1 -- 172.21.15.50:0/3232890288 learned_addr learned my addr 172.21.15.50:0/3232890288 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:20.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.011+0000 7f6985771b80 1 --2- 172.21.15.50:0/3232890288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e65494eff0 0x55e6549676a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:20.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.011+0000 7f6973fff700 1 --2- 172.21.15.50:0/3232890288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e65494af60 0x55e654967160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:20.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.011+0000 7f6985771b80 1 -- 172.21.15.50:0/3232890288 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f696000d0b0 con 0x55e65494eff0 2024-06-06T03:37:20.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.011+0000 7f6985771b80 1 -- 172.21.15.50:0/3232890288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f696000e520 con 0x55e65494af60 2024-06-06T03:37:20.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.011+0000 7f6985771b80 1 -- 172.21.15.50:0/3232890288 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f696000d780 con 0x55e6549457a0 2024-06-06T03:37:20.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.011+0000 7f6985771b80 10 client.0 _ll_register_callbacks cb 0x55e65482c5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:37:20.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.012+0000 7f697948b700 1 --2- 172.21.15.50:0/3232890288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e65494eff0 0x55e6549676a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:20.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.012+0000 7f697948b700 1 -- 172.21.15.50:0/3232890288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6549457a0 msgr2=0x55e654957cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:20.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.012+0000 7f697948b700 1 --2- 172.21.15.50:0/3232890288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6549457a0 0x55e654957cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:20.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.012+0000 7f697948b700 1 -- 172.21.15.50:0/3232890288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e65494af60 msgr2=0x55e654967160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:20.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.012+0000 7f697948b700 1 --2- 172.21.15.50:0/3232890288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e65494af60 0x55e654967160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:20.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.012+0000 7f697948b700 1 -- 172.21.15.50:0/3232890288 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e654940760 con 0x55e65494eff0 2024-06-06T03:37:20.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.012+0000 7f6978c8a700 1 --2- 172.21.15.50:0/3232890288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6549457a0 0x55e654957cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:37:20.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.012+0000 7f6973fff700 1 --2- 172.21.15.50:0/3232890288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e65494af60 0x55e654967160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:37:20.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.013+0000 7f697948b700 1 --2- 172.21.15.50:0/3232890288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e65494eff0 0x55e6549676a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6964098e40 tx=0x7f6964098300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ebabe07715e969 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:20.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.017+0000 7f6953fff700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:37:20.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.017+0000 7f6953fff700 1 -- 172.21.15.50:0/3232890288 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69640b4040 con 0x55e65494eff0 2024-06-06T03:37:20.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.017+0000 7f6953fff700 1 -- 172.21.15.50:0/3232890288 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f69640b5250 con 0x55e65494eff0 2024-06-06T03:37:20.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.017+0000 7f6985771b80 1 -- 172.21.15.50:0/3232890288 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6968030070 con 0x55e65494eff0 2024-06-06T03:37:20.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.020+0000 7f6953fff700 1 -- 172.21.15.50:0/3232890288 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f696401c040 con 0x55e65494eff0 2024-06-06T03:37:20.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.020+0000 7f6985771b80 10 client.16794 fetch_fsmap learned FSMap version 36 2024-06-06T03:37:20.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.020+0000 7f6985771b80 1 -- 172.21.15.50:0/3232890288 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55e6549ca5f0 con 0x55e65494eff0 2024-06-06T03:37:20.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.021+0000 7f6953fff700 1 -- 172.21.15.50:0/3232890288 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6964083070 con 0x55e65494eff0 2024-06-06T03:37:20.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.022+0000 7f6953fff700 1 -- 172.21.15.50:0/3232890288 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7f696409b330 con 0x55e65494eff0 2024-06-06T03:37:20.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.022+0000 7f6985771b80 10 client.16794 fetch_fsmap finished waiting for FSMap version 36 2024-06-06T03:37:20.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.022+0000 7f6985771b80 10 client.16794 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:37:20.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.022+0000 7f6985771b80 20 client.16794 populate_metadata read hostname 'smithi050' 2024-06-06T03:37:20.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.023+0000 7f6985771b80 1 --2- 172.21.15.50:0/3232890288 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55e6549cab10 0x55e6549ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:20.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.023+0000 7f6985771b80 4 client.16794 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-06T03:37:20.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.023+0000 7f6985771b80 1 -- 172.21.15.50:0/3232890288 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f6968030070 con 0x55e6549cab10 2024-06-06T03:37:20.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.024+0000 7f6978c8a700 1 --2- 172.21.15.50:0/3232890288 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55e6549cab10 0x55e6549ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:20.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.028+0000 7f6978c8a700 1 --2- 172.21.15.50:0/3232890288 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55e6549cab10 0x55e6549ccf30 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45a7ad88f04692a6 server_cookie=cde5bcde9411d781 in_seq=0 out_seq=0 2024-06-06T03:37:20.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.030+0000 7f6953fff700 10 client.16794 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:37:20.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.030+0000 7f6953fff700 1 -- 172.21.15.50:0/3232890288 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f6968030070 con 0x55e6549cab10 2024-06-06T03:37:20.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.030+0000 7f6953fff700 10 client.16794 handle_command_reply: tid=0 2024-06-06T03:37:20.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.030+0000 7f6985771b80 1 client.16794 shutdown 2024-06-06T03:37:20.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.031+0000 7f6985771b80 1 -- 172.21.15.50:0/3232890288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e65494eff0 msgr2=0x55e6549676a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:20.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.031+0000 7f6985771b80 1 --2- 172.21.15.50:0/3232890288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e65494eff0 0x55e6549676a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6964098e40 tx=0x7f6964098300 comp rx=0 tx=0).stop 2024-06-06T03:37:20.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.032+0000 7f6985771b80 1 -- 172.21.15.50:0/3232890288 shutdown_connections 2024-06-06T03:37:20.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.032+0000 7f6985771b80 1 --2- 172.21.15.50:0/3232890288 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55e6549cab10 0x55e6549ccf30 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:20.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.032+0000 7f6985771b80 1 --2- 172.21.15.50:0/3232890288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e65494eff0 0x55e6549676a0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:20.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.032+0000 7f6985771b80 1 --2- 172.21.15.50:0/3232890288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6549457a0 0x55e654957cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:20.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.032+0000 7f6985771b80 1 --2- 172.21.15.50:0/3232890288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e65494af60 0x55e654967160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:20.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.032+0000 7f6985771b80 1 -- 172.21.15.50:0/3232890288 >> 172.21.15.50:0/3232890288 conn(0x55e654872080 msgr2=0x55e65493ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:20.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.034+0000 7f6953fff700 0 client.16794 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:37:20.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.034+0000 7f6985771b80 1 -- 172.21.15.50:0/3232890288 shutdown_connections 2024-06-06T03:37:20.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.034+0000 7f6985771b80 1 -- 172.21.15.50:0/3232890288 wait complete. 2024-06-06T03:37:20.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.034+0000 7f6985771b80 20 client.16794 trim_cache size 0 max 16384 2024-06-06T03:37:20.034 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:37:20.035 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2024-06-06T03:37:20.035 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-06-06T03:37:20.035 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:37:20.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.038+0000 7f697aeee700 1 -- 172.21.15.50:0/116169123 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f695c0a2d70 msgr2=0x7f695c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:20.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.039+0000 7f697aeee700 1 --2- 172.21.15.50:0/116169123 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f695c0a2d70 0x7f695c0a5230 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f696c009e60 tx=0x7f696c00b040 comp rx=0 tx=0).stop 2024-06-06T03:37:20.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.039+0000 7f697aeee700 1 -- 172.21.15.50:0/116169123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6974114870 msgr2=0x7f6974114cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:20.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.039+0000 7f697aeee700 1 --2- 172.21.15.50:0/116169123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6974114870 0x7f6974114cf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f696400e970 tx=0x7f696400ec80 comp rx=0 tx=0).stop 2024-06-06T03:37:20.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.039+0000 7f697aeee700 1 -- 172.21.15.50:0/116169123 shutdown_connections 2024-06-06T03:37:20.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.039+0000 7f697aeee700 1 --2- 172.21.15.50:0/116169123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6974114870 0x7f6974114cf0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:20.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.039+0000 7f697aeee700 1 --2- 172.21.15.50:0/116169123 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f695c0a2d70 0x7f695c0a5230 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:20.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.039+0000 7f697aeee700 1 --2- 172.21.15.50:0/116169123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6974110bf0 0x7f697411b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:20.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.039+0000 7f697aeee700 1 --2- 172.21.15.50:0/116169123 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f697411bc70 0x7f6974114330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:20.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.039+0000 7f697aeee700 1 -- 172.21.15.50:0/116169123 >> 172.21.15.50:0/116169123 conn(0x7f697406d600 msgr2=0x7f6974073040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:20.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.040+0000 7f697aeee700 1 -- 172.21.15.50:0/116169123 shutdown_connections 2024-06-06T03:37:20.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:20.040+0000 7f697aeee700 1 -- 172.21.15.50:0/116169123 wait complete. 2024-06-06T03:37:20.986 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-06T03:37:20.987 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T03:37:21.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:20 smithi122 ceph-mon[35759]: pgmap v752: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 37 MiB/s wr, 715 op/s 2024-06-06T03:37:21.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:20 smithi050 ceph-mon[32421]: pgmap v752: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 37 MiB/s wr, 715 op/s 2024-06-06T03:37:21.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:20 smithi079 ceph-mon[35478]: pgmap v752: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 37 MiB/s wr, 715 op/s 2024-06-06T03:37:21.732 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:37:23.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:22 smithi122 ceph-mon[35759]: pgmap v753: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 30 MiB/s wr, 577 op/s 2024-06-06T03:37:23.224 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:22 smithi050 ceph-mon[32421]: pgmap v753: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 30 MiB/s wr, 577 op/s 2024-06-06T03:37:23.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:22 smithi079 ceph-mon[35478]: pgmap v753: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 30 MiB/s wr, 577 op/s 2024-06-06T03:37:25.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:24 smithi122 ceph-mon[35759]: pgmap v754: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 29 MiB/s wr, 568 op/s 2024-06-06T03:37:25.255 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:24 smithi050 ceph-mon[32421]: pgmap v754: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 29 MiB/s wr, 568 op/s 2024-06-06T03:37:25.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:24 smithi079 ceph-mon[35478]: pgmap v754: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 29 MiB/s wr, 568 op/s 2024-06-06T03:37:26.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.306+0000 7fe48c2e2700 1 -- 172.21.15.50:0/3223885190 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe48410a0a0 msgr2=0x7fe48410db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:26.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.306+0000 7fe48c2e2700 1 --2- 172.21.15.50:0/3223885190 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe48410a0a0 0x7fe48410db40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe4740098f0 tx=0x7fe474009c00 comp rx=0 tx=0).stop 2024-06-06T03:37:26.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.307+0000 7fe48c2e2700 1 -- 172.21.15.50:0/3223885190 shutdown_connections 2024-06-06T03:37:26.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.307+0000 7fe48c2e2700 1 --2- 172.21.15.50:0/3223885190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe48410e220 0x7fe484115df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:26.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.307+0000 7fe48c2e2700 1 --2- 172.21.15.50:0/3223885190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe4841096f0 0x7fe484109ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:26.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.307+0000 7fe48c2e2700 1 --2- 172.21.15.50:0/3223885190 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe48410a0a0 0x7fe48410db40 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:26.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.307+0000 7fe48c2e2700 1 -- 172.21.15.50:0/3223885190 >> 172.21.15.50:0/3223885190 conn(0x7fe48406d600 msgr2=0x7fe48406da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:26.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.310+0000 7fe48c2e2700 1 -- 172.21.15.50:0/3223885190 shutdown_connections 2024-06-06T03:37:26.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.310+0000 7fe48c2e2700 1 -- 172.21.15.50:0/3223885190 wait complete. 2024-06-06T03:37:26.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.311+0000 7fe48c2e2700 1 Processor -- start 2024-06-06T03:37:26.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.311+0000 7fe48c2e2700 1 -- start start 2024-06-06T03:37:26.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.311+0000 7fe48c2e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4841096f0 0x7fe48419ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:26.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.312+0000 7fe48c2e2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe48410a0a0 0x7fe48419f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:26.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.312+0000 7fe48c2e2700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe48410e220 0x7fe4841a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:26.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.312+0000 7fe48a07e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4841096f0 0x7fe48419ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:26.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.312+0000 7fe48a07e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4841096f0 0x7fe48419ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47168/0 (socket says 172.21.15.50:47168) 2024-06-06T03:37:26.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.312+0000 7fe48a07e700 1 -- 172.21.15.50:0/2429386846 learned_addr learned my addr 172.21.15.50:0/2429386846 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:26.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.312+0000 7fe48c2e2700 1 -- 172.21.15.50:0/2429386846 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe484118ca0 con 0x7fe4841096f0 2024-06-06T03:37:26.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.312+0000 7fe48c2e2700 1 -- 172.21.15.50:0/2429386846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe484118b20 con 0x7fe48410a0a0 2024-06-06T03:37:26.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.312+0000 7fe48c2e2700 1 -- 172.21.15.50:0/2429386846 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe484118e20 con 0x7fe48410e220 2024-06-06T03:37:26.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.312+0000 7fe48987d700 1 --2- 172.21.15.50:0/2429386846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe48410a0a0 0x7fe48419f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:26.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.316+0000 7fe48a87f700 1 --2- 172.21.15.50:0/2429386846 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe48410e220 0x7fe4841a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:26.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.316+0000 7fe48987d700 1 -- 172.21.15.50:0/2429386846 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe48410e220 msgr2=0x7fe4841a3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:26.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.316+0000 7fe48987d700 1 --2- 172.21.15.50:0/2429386846 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe48410e220 0x7fe4841a3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:26.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.316+0000 7fe48987d700 1 -- 172.21.15.50:0/2429386846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4841096f0 msgr2=0x7fe48419ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:26.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.316+0000 7fe48987d700 1 --2- 172.21.15.50:0/2429386846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4841096f0 0x7fe48419ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:26.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.316+0000 7fe48987d700 1 -- 172.21.15.50:0/2429386846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4841a3e00 con 0x7fe48410a0a0 2024-06-06T03:37:26.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.316+0000 7fe48a87f700 1 --2- 172.21.15.50:0/2429386846 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe48410e220 0x7fe4841a3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:37:26.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.316+0000 7fe48a07e700 1 --2- 172.21.15.50:0/2429386846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4841096f0 0x7fe48419ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:37:26.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.316+0000 7fe48987d700 1 --2- 172.21.15.50:0/2429386846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe48410a0a0 0x7fe48419f380 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe474009fd0 tx=0x7fe47400b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:26.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.316+0000 7fe47b7fe700 1 -- 172.21.15.50:0/2429386846 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe474025070 con 0x7fe48410a0a0 2024-06-06T03:37:26.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.318+0000 7fe48c2e2700 1 -- 172.21.15.50:0/2429386846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4841a4090 con 0x7fe48410a0a0 2024-06-06T03:37:26.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.318+0000 7fe48c2e2700 1 -- 172.21.15.50:0/2429386846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4841a4570 con 0x7fe48410a0a0 2024-06-06T03:37:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.318+0000 7fe47b7fe700 1 -- 172.21.15.50:0/2429386846 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe474005500 con 0x7fe48410a0a0 2024-06-06T03:37:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.318+0000 7fe47b7fe700 1 -- 172.21.15.50:0/2429386846 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe474020410 con 0x7fe48410a0a0 2024-06-06T03:37:26.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.322+0000 7fe48c2e2700 1 -- 172.21.15.50:0/2429386846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe468005330 con 0x7fe48410a0a0 2024-06-06T03:37:26.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.322+0000 7fe47b7fe700 1 -- 172.21.15.50:0/2429386846 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe474028070 con 0x7fe48410a0a0 2024-06-06T03:37:26.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.323+0000 7fe47b7fe700 1 --2- 172.21.15.50:0/2429386846 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe4700a2ca0 0x7fe4700a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:26.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.323+0000 7fe47b7fe700 1 -- 172.21.15.50:0/2429386846 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fe4740cff90 con 0x7fe48410a0a0 2024-06-06T03:37:26.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.343+0000 7fe48a07e700 1 --2- 172.21.15.50:0/2429386846 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe4700a2ca0 0x7fe4700a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:26.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.344+0000 7fe47b7fe700 1 -- 172.21.15.50:0/2429386846 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe474013030 con 0x7fe48410a0a0 2024-06-06T03:37:26.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.344+0000 7fe48a07e700 1 --2- 172.21.15.50:0/2429386846 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe4700a2ca0 0x7fe4700a5160 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe48000a8b0 tx=0x7fe48000c040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:26.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.839+0000 7fe48c2e2700 1 -- 172.21.15.50:0/2429386846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe468005620 con 0x7fe48410a0a0 2024-06-06T03:37:26.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.844+0000 7fe47b7fe700 1 -- 172.21.15.50:0/2429386846 <== mon.2 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11859 (secure 0 0 0) 0x7fe47409cba0 con 0x7fe48410a0a0 2024-06-06T03:37:26.844 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:37:26.844 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1667847852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1667847852},{"type":"v1","addr":"172.21.15.50:6835","nonce":1667847852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/239971838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":239971838},{"type":"v1","addr":"172.21.15.50:6837","nonce":239971838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/2188134216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2188134216},{"type":"v1","addr":"172.21.15.50:6839","nonce":2188134216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/632572420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":632572420},{"type":"v1","addr":"172.21.15.50:6841","nonce":632572420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/864537078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":864537078},{"type":"v1","addr":"172.21.15.79:6833","nonce":864537078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/279268898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":279268898},{"type":"v1","addr":"172.21.15.79:6835","nonce":279268898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T03:22:36.202061+0000","modified":"2024-06-06T03:36:43.639162+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24490,"mds_1":24472,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/57533154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":57533154},{"type":"v1","addr":"172.21.15.122:6833","nonce":57533154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/3286722213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":3286722213},{"type":"v1","addr":"172.21.15.79:6837","nonce":3286722213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/768067336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":768067336},{"type":"v1","addr":"172.21.15.79:6839","nonce":768067336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.122:6835/2987597320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2987597320},{"type":"v1","addr":"172.21.15.122:6835","nonce":2987597320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":221,"addr":"172.21.15.122:6837/1604366318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":1604366318},{"type":"v1","addr":"172.21.15.122:6837","nonce":1604366318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6839/4129732900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":4129732900},{"type":"v1","addr":"172.21.15.122:6839","nonce":4129732900}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24466,24472,24490]},"id":1}]} 2024-06-06T03:37:26.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.850+0000 7fe47973a700 1 -- 172.21.15.50:0/2429386846 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe4700a2ca0 msgr2=0x7fe4700a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:26.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.850+0000 7fe47973a700 1 --2- 172.21.15.50:0/2429386846 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe4700a2ca0 0x7fe4700a5160 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe48000a8b0 tx=0x7fe48000c040 comp rx=0 tx=0).stop 2024-06-06T03:37:26.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.850+0000 7fe47973a700 1 -- 172.21.15.50:0/2429386846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe48410a0a0 msgr2=0x7fe48419f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:26.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.850+0000 7fe47973a700 1 --2- 172.21.15.50:0/2429386846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe48410a0a0 0x7fe48419f380 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe474009fd0 tx=0x7fe47400b840 comp rx=0 tx=0).stop 2024-06-06T03:37:26.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.851+0000 7fe47973a700 1 -- 172.21.15.50:0/2429386846 shutdown_connections 2024-06-06T03:37:26.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.851+0000 7fe47973a700 1 --2- 172.21.15.50:0/2429386846 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe48410e220 0x7fe4841a3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:26.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.851+0000 7fe47973a700 1 --2- 172.21.15.50:0/2429386846 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe4700a2ca0 0x7fe4700a5160 secure :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe48000a8b0 tx=0x7fe48000c040 comp rx=0 tx=0).stop 2024-06-06T03:37:26.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.851+0000 7fe47973a700 1 --2- 172.21.15.50:0/2429386846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4841096f0 0x7fe48419ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:26.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.851+0000 7fe47973a700 1 --2- 172.21.15.50:0/2429386846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe48410a0a0 0x7fe48419f380 secure :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe474009fd0 tx=0x7fe47400b840 comp rx=0 tx=0).stop 2024-06-06T03:37:26.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.851+0000 7fe47973a700 1 -- 172.21.15.50:0/2429386846 >> 172.21.15.50:0/2429386846 conn(0x7fe48406d600 msgr2=0x7fe484072400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:26.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.853+0000 7fe47973a700 1 -- 172.21.15.50:0/2429386846 shutdown_connections 2024-06-06T03:37:26.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:26.853+0000 7fe47973a700 1 -- 172.21.15.50:0/2429386846 wait complete. 2024-06-06T03:37:26.859 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 36 2024-06-06T03:37:27.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:26 smithi122 ceph-mon[35759]: pgmap v755: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 33 MiB/s wr, 647 op/s 2024-06-06T03:37:27.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:26 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/2429386846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:37:27.254 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:26 smithi050 ceph-mon[32421]: pgmap v755: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 33 MiB/s wr, 647 op/s 2024-06-06T03:37:27.255 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:26 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/2429386846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:37:27.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:26 smithi079 ceph-mon[35478]: pgmap v755: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 33 MiB/s wr, 647 op/s 2024-06-06T03:37:27.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:26 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/2429386846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T03:37:29.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:28 smithi122 ceph-mon[35759]: pgmap v756: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 27 MiB/s wr, 523 op/s 2024-06-06T03:37:29.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:28 smithi050 ceph-mon[32421]: pgmap v756: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 27 MiB/s wr, 523 op/s 2024-06-06T03:37:29.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:28 smithi079 ceph-mon[35478]: pgmap v756: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 27 MiB/s wr, 523 op/s 2024-06-06T03:37:30.359 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-06-06T03:37:30.937 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.936+0000 7fc5910d2640 1 -- 172.21.15.50:0/2517387035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc58c109970 msgr2=0x7fc58c10e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:30.937 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.936+0000 7fc5910d2640 1 --2- 172.21.15.50:0/2517387035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc58c109970 0x7fc58c10e2e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc58401acb0 tx=0x7fc58403b920 comp rx=0 tx=0).stop 2024-06-06T03:37:30.937 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.936+0000 7fc5910d2640 1 -- 172.21.15.50:0/2517387035 shutdown_connections 2024-06-06T03:37:30.937 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.936+0000 7fc5910d2640 1 --2- 172.21.15.50:0/2517387035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc58c109970 0x7fc58c10e2e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:30.937 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.936+0000 7fc5910d2640 1 --2- 172.21.15.50:0/2517387035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc58c108fb0 0x7fc58c109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:30.937 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.936+0000 7fc5910d2640 1 --2- 172.21.15.50:0/2517387035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc58c072cd0 0x7fc58c0730f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:30.937 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.936+0000 7fc5910d2640 1 -- 172.21.15.50:0/2517387035 >> 172.21.15.50:0/2517387035 conn(0x7fc58c06e840 msgr2=0x7fc58c070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:30.937 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.936+0000 7fc5910d2640 1 -- 172.21.15.50:0/2517387035 shutdown_connections 2024-06-06T03:37:30.937 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.936+0000 7fc5910d2640 1 -- 172.21.15.50:0/2517387035 wait complete. 2024-06-06T03:37:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.938+0000 7fc5910d2640 1 Processor -- start 2024-06-06T03:37:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.938+0000 7fc5910d2640 1 -- start start 2024-06-06T03:37:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.938+0000 7fc5910d2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc58c072cd0 0x7fc58c19e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.938+0000 7fc5910d2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc58c108fb0 0x7fc58c19e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.938+0000 7fc5910d2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc58c109970 0x7fc58c1a5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.938+0000 7fc5910d2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc58c1119c0 con 0x7fc58c108fb0 2024-06-06T03:37:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.938+0000 7fc5910d2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc58c111840 con 0x7fc58c072cd0 2024-06-06T03:37:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.938+0000 7fc5910d2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc58c111b40 con 0x7fc58c109970 2024-06-06T03:37:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.939+0000 7fc58bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc58c072cd0 0x7fc58c19e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.939+0000 7fc58bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc58c072cd0 0x7fc58c19e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:59770/0 (socket says 172.21.15.50:59770) 2024-06-06T03:37:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.939+0000 7fc58bfff640 1 -- 172.21.15.50:0/2918679058 learned_addr learned my addr 172.21.15.50:0/2918679058 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.939+0000 7fc5908d1640 1 --2- 172.21.15.50:0/2918679058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc58c109970 0x7fc58c1a5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.939+0000 7fc58bfff640 1 -- 172.21.15.50:0/2918679058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc58c109970 msgr2=0x7fc58c1a5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.939+0000 7fc58bfff640 1 --2- 172.21.15.50:0/2918679058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc58c109970 0x7fc58c1a5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.939+0000 7fc58bfff640 1 -- 172.21.15.50:0/2918679058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc58c108fb0 msgr2=0x7fc58c19e590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T03:37:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.939+0000 7fc58bfff640 1 --2- 172.21.15.50:0/2918679058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc58c108fb0 0x7fc58c19e590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.939+0000 7fc58bfff640 1 -- 172.21.15.50:0/2918679058 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc58c1a5c70 con 0x7fc58c072cd0 2024-06-06T03:37:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.939+0000 7fc58bfff640 1 --2- 172.21.15.50:0/2918679058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc58c072cd0 0x7fc58c19e050 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc57c030a00 tx=0x7fc57c030ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:30.947 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.943+0000 7fc5897fa640 1 -- 172.21.15.50:0/2918679058 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57c02ed90 con 0x7fc58c072cd0 2024-06-06T03:37:30.947 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.943+0000 7fc5897fa640 1 -- 172.21.15.50:0/2918679058 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc57c0328f0 con 0x7fc58c072cd0 2024-06-06T03:37:30.947 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.943+0000 7fc5897fa640 1 -- 172.21.15.50:0/2918679058 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57c031860 con 0x7fc58c072cd0 2024-06-06T03:37:30.947 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.943+0000 7fc5910d2640 1 -- 172.21.15.50:0/2918679058 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc58c1a5f60 con 0x7fc58c072cd0 2024-06-06T03:37:30.947 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.943+0000 7fc5910d2640 1 -- 172.21.15.50:0/2918679058 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc58c1a63f0 con 0x7fc58c072cd0 2024-06-06T03:37:30.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.947+0000 7fc595043740 1 Processor -- start 2024-06-06T03:37:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.951+0000 7fc5897fa640 1 -- 172.21.15.50:0/2918679058 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc57c032440 con 0x7fc58c072cd0 2024-06-06T03:37:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.952+0000 7fc5897fa640 1 --2- 172.21.15.50:0/2918679058 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc5740a2d90 0x7fc5740a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.952+0000 7fc5897fa640 1 -- 172.21.15.50:0/2918679058 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fc57c0f1ab0 con 0x7fc58c072cd0 2024-06-06T03:37:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.953+0000 7fc595043740 1 -- start start 2024-06-06T03:37:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.953+0000 7fc595043740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c78b964200 0x55c78b964620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.953+0000 7fc595043740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c78b964bf0 0x55c78b9696f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.953+0000 7fc595043740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c78b969d60 0x55c78b96c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.953+0000 7fc595043740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c78b8c74f0 con 0x55c78b964bf0 2024-06-06T03:37:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.953+0000 7fc595043740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c78b865870 con 0x55c78b969d60 2024-06-06T03:37:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.953+0000 7fc595043740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c78b8c34b0 con 0x55c78b964200 2024-06-06T03:37:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.954+0000 7fc58b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c78b964bf0 0x55c78b9696f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.954+0000 7fc58b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c78b964bf0 0x55c78b9696f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49882/0 (socket says 172.21.15.50:49882) 2024-06-06T03:37:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.954+0000 7fc58b7fe640 1 -- 172.21.15.50:0/1324431627 learned_addr learned my addr 172.21.15.50:0/1324431627 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.961+0000 7fc5908d1640 1 --2- 172.21.15.50:0/1324431627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c78b969d60 0x55c78b96c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.961+0000 7fc5908d1640 1 --2- 172.21.15.50:0/2918679058 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc5740a2d90 0x7fc5740a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.961+0000 7fc58bfff640 1 --2- 172.21.15.50:0/1324431627 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c78b964200 0x55c78b964620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.961+0000 7fc5908d1640 1 -- 172.21.15.50:0/1324431627 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c78b964200 msgr2=0x55c78b964620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.961+0000 7fc5908d1640 1 --2- 172.21.15.50:0/1324431627 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c78b964200 0x55c78b964620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.961+0000 7fc5908d1640 1 -- 172.21.15.50:0/1324431627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c78b964bf0 msgr2=0x55c78b9696f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:30.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.961+0000 7fc5908d1640 1 --2- 172.21.15.50:0/1324431627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c78b964bf0 0x55c78b9696f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:30.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.961+0000 7fc5908d1640 1 -- 172.21.15.50:0/1324431627 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c78b8819b0 con 0x55c78b969d60 2024-06-06T03:37:30.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.961+0000 7fc58b7fe640 1 --2- 172.21.15.50:0/1324431627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c78b964bf0 0x55c78b9696f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:37:30.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.961+0000 7fc5908d1640 1 --2- 172.21.15.50:0/2918679058 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc5740a2d90 0x7fc5740a5250 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc584006010 tx=0x7fc58401a8f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:30.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.961+0000 7fc5908d1640 1 --2- 172.21.15.50:0/1324431627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c78b969d60 0x55c78b96c1f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc58401ac00 tx=0x7fc584018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82ac02c14b23e05e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.965+0000 7fc5727fc640 1 -- 172.21.15.50:0/1324431627 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc58404e070 con 0x55c78b969d60 2024-06-06T03:37:30.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.965+0000 7fc5727fc640 1 -- 172.21.15.50:0/1324431627 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc584003e20 con 0x55c78b969d60 2024-06-06T03:37:30.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.965+0000 7fc5727fc640 1 -- 172.21.15.50:0/1324431627 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc584045040 con 0x55c78b969d60 2024-06-06T03:37:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.966+0000 7fc595043740 1 -- 172.21.15.50:0/1324431627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c78b969d60 msgr2=0x55c78b96c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.966+0000 7fc595043740 1 --2- 172.21.15.50:0/1324431627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c78b969d60 0x55c78b96c1f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc58401ac00 tx=0x7fc584018000 comp rx=0 tx=0).stop 2024-06-06T03:37:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.969+0000 7fc595043740 1 -- 172.21.15.50:0/1324431627 shutdown_connections 2024-06-06T03:37:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.969+0000 7fc595043740 1 --2- 172.21.15.50:0/1324431627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c78b964bf0 0x55c78b9696f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.969+0000 7fc595043740 1 --2- 172.21.15.50:0/1324431627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c78b969d60 0x55c78b96c1f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.969+0000 7fc595043740 1 --2- 172.21.15.50:0/1324431627 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c78b964200 0x55c78b964620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.969+0000 7fc595043740 1 -- 172.21.15.50:0/1324431627 >> 172.21.15.50:0/1324431627 conn(0x55c78b95f870 msgr2=0x55c78b95fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.974+0000 7fc595043740 1 -- 172.21.15.50:0/1324431627 shutdown_connections 2024-06-06T03:37:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.980+0000 7fc595043740 1 -- 172.21.15.50:0/1324431627 wait complete. 2024-06-06T03:37:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.980+0000 7fc595043740 1 -- start start 2024-06-06T03:37:30.981 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.980+0000 7fc595043740 1 Processor -- start 2024-06-06T03:37:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.981+0000 7fc595043740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c78b964200 0x55c78b96e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.981+0000 7fc595043740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c78b964bf0 0x55c78b96e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.981+0000 7fc595043740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c78b969d60 0x55c78b9759c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.981+0000 7fc595043740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c78b96ccb0 con 0x55c78b964bf0 2024-06-06T03:37:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.981+0000 7fc595043740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c78b850ae0 con 0x55c78b969d60 2024-06-06T03:37:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.981+0000 7fc595043740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c78b96ce30 con 0x55c78b964200 2024-06-06T03:37:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.981+0000 7fc595043740 10 client.0 _ll_register_callbacks cb 0x55c78b8899b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:37:30.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.985+0000 7fc5908d1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c78b969d60 0x55c78b9759c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:30.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.985+0000 7fc5908d1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c78b969d60 0x55c78b9759c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:59786/0 (socket says 172.21.15.50:59786) 2024-06-06T03:37:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.985+0000 7fc5908d1640 1 -- 172.21.15.50:0/1574999790 learned_addr learned my addr 172.21.15.50:0/1574999790 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:30.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.987+0000 7fc58bfff640 1 --2- 172.21.15.50:0/1574999790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c78b964200 0x55c78b96e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:30.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.988+0000 7fc5908d1640 1 -- 172.21.15.50:0/1574999790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c78b964200 msgr2=0x55c78b96e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:30.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.988+0000 7fc5908d1640 1 --2- 172.21.15.50:0/1574999790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c78b964200 0x55c78b96e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:30.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.988+0000 7fc5908d1640 1 -- 172.21.15.50:0/1574999790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c78b964bf0 msgr2=0x55c78b96e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:30.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.988+0000 7fc5908d1640 1 --2- 172.21.15.50:0/1574999790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c78b964bf0 0x55c78b96e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:30.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.988+0000 7fc5908d1640 1 -- 172.21.15.50:0/1574999790 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c78b5db210 con 0x55c78b969d60 2024-06-06T03:37:30.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.989+0000 7fc5908d1640 1 --2- 172.21.15.50:0/1574999790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c78b969d60 0x55c78b9759c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc584003c20 tx=0x7fc584003c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bf51e84c37aa8d7 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:30.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.989+0000 7fc56fff7640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:37:30.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.991+0000 7fc56fff7640 1 -- 172.21.15.50:0/1574999790 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc58404e040 con 0x55c78b969d60 2024-06-06T03:37:30.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.991+0000 7fc595043740 1 -- 172.21.15.50:0/1574999790 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc584003e20 con 0x55c78b969d60 2024-06-06T03:37:30.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.991+0000 7fc56fff7640 1 -- 172.21.15.50:0/1574999790 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fc584004000 con 0x55c78b969d60 2024-06-06T03:37:30.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.991+0000 7fc56fff7640 1 -- 172.21.15.50:0/1574999790 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fc584067050 con 0x55c78b969d60 2024-06-06T03:37:30.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.995+0000 7fc595043740 10 client.26474 fetch_fsmap learned FSMap version 36 2024-06-06T03:37:30.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:30.995+0000 7fc595043740 1 -- 172.21.15.50:0/1574999790 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55c78b6a7620 con 0x55c78b969d60 2024-06-06T03:37:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.000+0000 7fc56fff7640 1 -- 172.21.15.50:0/1574999790 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc584003e20 con 0x55c78b969d60 2024-06-06T03:37:31.001 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.001+0000 7fc56fff7640 1 -- 172.21.15.50:0/1574999790 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7fc584062030 con 0x55c78b969d60 2024-06-06T03:37:31.001 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.001+0000 7fc595043740 10 client.26474 fetch_fsmap finished waiting for FSMap version 36 2024-06-06T03:37:31.001 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.001+0000 7fc595043740 10 client.26474 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:37:31.001 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.001+0000 7fc595043740 20 client.26474 populate_metadata read hostname 'smithi050' 2024-06-06T03:37:31.001 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.001+0000 7fc595043740 1 --2- 172.21.15.50:0/1574999790 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55c78b97a4c0 0x55c78b97c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:31.002 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.001+0000 7fc595043740 4 client.26474 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:37:31.002 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.001+0000 7fc595043740 1 -- 172.21.15.50:0/1574999790 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c78b8daf10 con 0x55c78b97a4c0 2024-06-06T03:37:31.020 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.019+0000 7fc58bfff640 1 --2- 172.21.15.50:0/1574999790 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55c78b97a4c0 0x55c78b97c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:31.041 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.038+0000 7fc58bfff640 1 --2- 172.21.15.50:0/1574999790 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55c78b97a4c0 0x55c78b97c940 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cb6b0fd696192f1 server_cookie=94da38fc324012b8 in_seq=0 out_seq=0 2024-06-06T03:37:31.041 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.041+0000 7fc56fff7640 10 client.26474 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:37:31.044 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.044+0000 7fc56fff7640 1 -- 172.21.15.50:0/1574999790 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55c78b8daf10 con 0x55c78b97a4c0 2024-06-06T03:37:31.044 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.044+0000 7fc56fff7640 10 client.26474 handle_command_reply: tid=0 2024-06-06T03:37:31.045 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.045+0000 7fc595043740 1 client.26474 shutdown 2024-06-06T03:37:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.055+0000 7fc595043740 1 -- 172.21.15.50:0/1574999790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c78b969d60 msgr2=0x55c78b9759c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:31.055 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.055+0000 7fc595043740 1 --2- 172.21.15.50:0/1574999790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c78b969d60 0x55c78b9759c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc584003c20 tx=0x7fc584003c50 comp rx=0 tx=0).stop 2024-06-06T03:37:31.059 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.059+0000 7fc595043740 1 -- 172.21.15.50:0/1574999790 shutdown_connections 2024-06-06T03:37:31.060 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.059+0000 7fc595043740 1 --2- 172.21.15.50:0/1574999790 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55c78b97a4c0 0x55c78b97c940 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:31.060 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.059+0000 7fc595043740 1 --2- 172.21.15.50:0/1574999790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c78b964bf0 0x55c78b96e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:31.060 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.059+0000 7fc595043740 1 --2- 172.21.15.50:0/1574999790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c78b969d60 0x55c78b9759c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:31.060 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.059+0000 7fc595043740 1 --2- 172.21.15.50:0/1574999790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c78b964200 0x55c78b96e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:31.060 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.059+0000 7fc595043740 1 -- 172.21.15.50:0/1574999790 >> 172.21.15.50:0/1574999790 conn(0x55c78b95f870 msgr2=0x55c78b95e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:31.060 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.060+0000 7fc56fff7640 0 client.26474 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:37:31.063 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.064+0000 7fc595043740 1 -- 172.21.15.50:0/1574999790 shutdown_connections 2024-06-06T03:37:31.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.065+0000 7fc595043740 1 -- 172.21.15.50:0/1574999790 wait complete. 2024-06-06T03:37:31.076 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.075+0000 7fc595043740 20 client.26474 trim_cache size 0 max 16384 2024-06-06T03:37:31.093 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:37:31.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.121+0000 7fc595043740 1 Processor -- start 2024-06-06T03:37:31.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.126+0000 7fc595043740 1 -- start start 2024-06-06T03:37:31.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.126+0000 7fc595043740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c78b964200 0x55c78b969470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:31.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.126+0000 7fc595043740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c78b964bf0 0x55c78b975980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:31.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.126+0000 7fc595043740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c78b969d60 0x55c78b965dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.127+0000 7fc595043740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc578012300 con 0x55c78b969d60 2024-06-06T03:37:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.127+0000 7fc595043740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc57800fbd0 con 0x55c78b964bf0 2024-06-06T03:37:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.127+0000 7fc595043740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc57800dad0 con 0x55c78b964200 2024-06-06T03:37:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.127+0000 7fc5908d1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c78b969d60 0x55c78b965dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.127+0000 7fc5908d1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c78b969d60 0x55c78b965dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49898/0 (socket says 172.21.15.50:49898) 2024-06-06T03:37:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.127+0000 7fc5908d1640 1 -- 172.21.15.50:0/2055550912 learned_addr learned my addr 172.21.15.50:0/2055550912 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.127+0000 7fc5908d1640 1 -- 172.21.15.50:0/2055550912 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c78b964200 msgr2=0x55c78b969470 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:37:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.127+0000 7fc5908d1640 1 --2- 172.21.15.50:0/2055550912 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c78b964200 0x55c78b969470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.127+0000 7fc5908d1640 1 -- 172.21.15.50:0/2055550912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c78b964bf0 msgr2=0x55c78b975980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:37:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.127+0000 7fc5908d1640 1 --2- 172.21.15.50:0/2055550912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c78b964bf0 0x55c78b975980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.127+0000 7fc5908d1640 1 -- 172.21.15.50:0/2055550912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c78b9658c0 con 0x55c78b969d60 2024-06-06T03:37:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.128+0000 7fc5908d1640 1 --2- 172.21.15.50:0/2055550912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c78b969d60 0x55c78b965dd0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fc58401acb0 tx=0x7fc58401ab30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d07ee4d33499bf server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.128+0000 7fc571ffb640 1 -- 172.21.15.50:0/2055550912 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc58404e040 con 0x55c78b969d60 2024-06-06T03:37:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.128+0000 7fc571ffb640 1 -- 172.21.15.50:0/2055550912 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc584040970 con 0x55c78b969d60 2024-06-06T03:37:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.129+0000 7fc595043740 1 -- 172.21.15.50:0/2055550912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c78b969d60 msgr2=0x55c78b965dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.129+0000 7fc595043740 1 --2- 172.21.15.50:0/2055550912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c78b969d60 0x55c78b965dd0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fc58401acb0 tx=0x7fc58401ab30 comp rx=0 tx=0).stop 2024-06-06T03:37:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.135+0000 7fc595043740 1 -- 172.21.15.50:0/2055550912 shutdown_connections 2024-06-06T03:37:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.135+0000 7fc595043740 1 --2- 172.21.15.50:0/2055550912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c78b969d60 0x55c78b965dd0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.135+0000 7fc595043740 1 --2- 172.21.15.50:0/2055550912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c78b964bf0 0x55c78b975980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.135+0000 7fc595043740 1 --2- 172.21.15.50:0/2055550912 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c78b964200 0x55c78b969470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:31.136 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.135+0000 7fc595043740 1 -- 172.21.15.50:0/2055550912 >> 172.21.15.50:0/2055550912 conn(0x55c78b95f870 msgr2=0x55c78b95fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:31.151 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.151+0000 7fc595043740 1 -- 172.21.15.50:0/2055550912 shutdown_connections 2024-06-06T03:37:31.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.153+0000 7fc595043740 1 -- 172.21.15.50:0/2055550912 wait complete. 2024-06-06T03:37:31.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.153+0000 7fc595043740 1 -- start start 2024-06-06T03:37:31.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.153+0000 7fc595043740 1 Processor -- start 2024-06-06T03:37:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.158+0000 7fc595043740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c78b964200 0x55c78b971ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.158+0000 7fc595043740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c78b964bf0 0x55c78b972420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.158+0000 7fc595043740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c78b969d60 0x55c78b975030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.158+0000 7fc595043740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc57800e090 con 0x55c78b964bf0 2024-06-06T03:37:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.158+0000 7fc595043740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc57800f500 con 0x55c78b964200 2024-06-06T03:37:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.158+0000 7fc595043740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc57800e760 con 0x55c78b969d60 2024-06-06T03:37:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.158+0000 7fc595043740 10 client.0 _ll_register_callbacks cb 0x7fc580006ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:37:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.159+0000 7fc58b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c78b964bf0 0x55c78b972420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.159+0000 7fc58b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c78b964bf0 0x55c78b972420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49902/0 (socket says 172.21.15.50:49902) 2024-06-06T03:37:31.160 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.159+0000 7fc58b7fe640 1 -- 172.21.15.50:0/3519390156 learned_addr learned my addr 172.21.15.50:0/3519390156 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:31.160 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.160+0000 7fc5908d1640 1 --2- 172.21.15.50:0/3519390156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c78b969d60 0x55c78b975030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:31.163 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.163+0000 7fc58bfff640 1 --2- 172.21.15.50:0/3519390156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c78b964200 0x55c78b971ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:31.163 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.163+0000 7fc5908d1640 1 -- 172.21.15.50:0/3519390156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c78b964200 msgr2=0x55c78b971ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:31.163 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.163+0000 7fc5908d1640 1 --2- 172.21.15.50:0/3519390156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c78b964200 0x55c78b971ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:31.163 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.163+0000 7fc5908d1640 1 -- 172.21.15.50:0/3519390156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c78b964bf0 msgr2=0x55c78b972420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:31.163 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.163+0000 7fc5908d1640 1 --2- 172.21.15.50:0/3519390156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c78b964bf0 0x55c78b972420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:31.163 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.163+0000 7fc5908d1640 1 -- 172.21.15.50:0/3519390156 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c78b975620 con 0x55c78b969d60 2024-06-06T03:37:31.164 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.165+0000 7fc5908d1640 1 --2- 172.21.15.50:0/3519390156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c78b969d60 0x55c78b975030 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc584041b80 tx=0x7fc584005eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=948f9899ec9b4e72 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.165+0000 7fc56fff7640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-06-06T03:37:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.168+0000 7fc56fff7640 1 -- 172.21.15.50:0/3519390156 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc58404e040 con 0x55c78b969d60 2024-06-06T03:37:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.168+0000 7fc56fff7640 1 -- 172.21.15.50:0/3519390156 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fc584011450 con 0x55c78b969d60 2024-06-06T03:37:31.168 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.168+0000 7fc595043740 1 -- 172.21.15.50:0/3519390156 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc584040970 con 0x55c78b969d60 2024-06-06T03:37:31.168 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.168+0000 7fc56fff7640 1 -- 172.21.15.50:0/3519390156 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fc584013d50 con 0x55c78b969d60 2024-06-06T03:37:31.168 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.168+0000 7fc595043740 10 client.26500 fetch_fsmap learned FSMap version 36 2024-06-06T03:37:31.168 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.168+0000 7fc595043740 1 -- 172.21.15.50:0/3519390156 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55c78b9e3ba0 con 0x55c78b969d60 2024-06-06T03:37:31.169 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.169+0000 7fc56fff7640 1 -- 172.21.15.50:0/3519390156 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc584040970 con 0x55c78b969d60 2024-06-06T03:37:31.169 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.169+0000 7fc56fff7640 1 -- 172.21.15.50:0/3519390156 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7fc584062070 con 0x55c78b969d60 2024-06-06T03:37:31.169 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.170+0000 7fc595043740 10 client.26500 fetch_fsmap finished waiting for FSMap version 36 2024-06-06T03:37:31.170 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.170+0000 7fc595043740 10 client.26500 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:37:31.170 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.170+0000 7fc595043740 20 client.26500 populate_metadata read hostname 'smithi050' 2024-06-06T03:37:31.170 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.170+0000 7fc595043740 1 --2- 172.21.15.50:0/3519390156 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55c78b9e4240 0x55c78b9e6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:31.170 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.170+0000 7fc595043740 4 client.26500 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:37:31.170 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.170+0000 7fc595043740 1 -- 172.21.15.50:0/3519390156 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c78b8d4c20 con 0x55c78b9e4240 2024-06-06T03:37:31.178 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.175+0000 7fc58bfff640 1 --2- 172.21.15.50:0/3519390156 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55c78b9e4240 0x55c78b9e6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:31.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:30 smithi122 ceph-mon[35759]: pgmap v757: 129 pgs: 129 active+clean; 10 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 34 MiB/s wr, 667 op/s 2024-06-06T03:37:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.180+0000 7fc58bfff640 1 --2- 172.21.15.50:0/3519390156 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55c78b9e4240 0x55c78b9e6660 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd7db40619782cf1 server_cookie=3abf94be847f3a20 in_seq=0 out_seq=0 2024-06-06T03:37:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.180+0000 7fc56fff7640 10 client.26500 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:37:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.188+0000 7fc56fff7640 1 -- 172.21.15.50:0/3519390156 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55c78b8d4c20 con 0x55c78b9e4240 2024-06-06T03:37:31.192 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.188+0000 7fc56fff7640 10 client.26500 handle_command_reply: tid=0 2024-06-06T03:37:31.192 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.188+0000 7fc595043740 1 client.26500 shutdown 2024-06-06T03:37:31.192 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.190+0000 7fc595043740 1 -- 172.21.15.50:0/3519390156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c78b969d60 msgr2=0x55c78b975030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:31.192 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.190+0000 7fc595043740 1 --2- 172.21.15.50:0/3519390156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c78b969d60 0x55c78b975030 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc584041b80 tx=0x7fc584005eb0 comp rx=0 tx=0).stop 2024-06-06T03:37:31.192 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.193+0000 7fc595043740 1 -- 172.21.15.50:0/3519390156 shutdown_connections 2024-06-06T03:37:31.192 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.193+0000 7fc595043740 1 --2- 172.21.15.50:0/3519390156 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55c78b9e4240 0x55c78b9e6660 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:31.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.193+0000 7fc595043740 1 --2- 172.21.15.50:0/3519390156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c78b964bf0 0x55c78b972420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:31.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.193+0000 7fc595043740 1 --2- 172.21.15.50:0/3519390156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c78b969d60 0x55c78b975030 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:31.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.193+0000 7fc595043740 1 --2- 172.21.15.50:0/3519390156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c78b964200 0x55c78b971ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:31.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.193+0000 7fc595043740 1 -- 172.21.15.50:0/3519390156 >> 172.21.15.50:0/3519390156 conn(0x55c78b95f870 msgr2=0x55c78b96e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.193+0000 7fc56fff7640 0 client.26500 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:37:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.197+0000 7fc595043740 1 -- 172.21.15.50:0/3519390156 shutdown_connections 2024-06-06T03:37:31.198 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.199+0000 7fc595043740 1 -- 172.21.15.50:0/3519390156 wait complete. 2024-06-06T03:37:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.199+0000 7fc595043740 20 client.26500 trim_cache size 0 max 16384 2024-06-06T03:37:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:37:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:37:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:37:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.214+0000 7fc5910d2640 1 -- 172.21.15.50:0/2918679058 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc5740a2d90 msgr2=0x7fc5740a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.214+0000 7fc5910d2640 1 --2- 172.21.15.50:0/2918679058 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc5740a2d90 0x7fc5740a5250 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc584006010 tx=0x7fc58401a8f0 comp rx=0 tx=0).stop 2024-06-06T03:37:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.215+0000 7fc5910d2640 1 -- 172.21.15.50:0/2918679058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc58c072cd0 msgr2=0x7fc58c19e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.215+0000 7fc5910d2640 1 --2- 172.21.15.50:0/2918679058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc58c072cd0 0x7fc58c19e050 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc57c030a00 tx=0x7fc57c030ec0 comp rx=0 tx=0).stop 2024-06-06T03:37:31.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.217+0000 7fc5910d2640 1 -- 172.21.15.50:0/2918679058 shutdown_connections 2024-06-06T03:37:31.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.217+0000 7fc5910d2640 1 --2- 172.21.15.50:0/2918679058 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc5740a2d90 0x7fc5740a5250 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:31.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.217+0000 7fc5910d2640 1 --2- 172.21.15.50:0/2918679058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc58c108fb0 0x7fc58c19e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:31.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.217+0000 7fc5910d2640 1 --2- 172.21.15.50:0/2918679058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc58c109970 0x7fc58c1a5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:31.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.218+0000 7fc5910d2640 1 --2- 172.21.15.50:0/2918679058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc58c072cd0 0x7fc58c19e050 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:31.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.218+0000 7fc5910d2640 1 -- 172.21.15.50:0/2918679058 >> 172.21.15.50:0/2918679058 conn(0x7fc58c06e840 msgr2=0x7fc58c10c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:31.224 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.223+0000 7fc5910d2640 1 -- 172.21.15.50:0/2918679058 shutdown_connections 2024-06-06T03:37:31.225 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:31.225+0000 7fc5910d2640 1 -- 172.21.15.50:0/2918679058 wait complete. 2024-06-06T03:37:31.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:30 smithi050 ceph-mon[32421]: pgmap v757: 129 pgs: 129 active+clean; 10 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 34 MiB/s wr, 667 op/s 2024-06-06T03:37:31.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:30 smithi079 ceph-mon[35478]: pgmap v757: 129 pgs: 129 active+clean; 10 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 34 MiB/s wr, 667 op/s 2024-06-06T03:37:33.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:32 smithi122 ceph-mon[35759]: pgmap v758: 129 pgs: 129 active+clean; 10 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 27 MiB/s wr, 529 op/s 2024-06-06T03:37:33.222 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:32 smithi050 ceph-mon[32421]: pgmap v758: 129 pgs: 129 active+clean; 10 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 27 MiB/s wr, 529 op/s 2024-06-06T03:37:33.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:32 smithi079 ceph-mon[35478]: pgmap v758: 129 pgs: 129 active+clean; 10 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 27 MiB/s wr, 529 op/s 2024-06-06T03:37:34.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.076+0000 7fe3e321b700 1 -- 172.21.15.50:0/72060724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3dc0772e0 msgr2=0x7fe3dc112e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:34.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.076+0000 7fe3e321b700 1 --2- 172.21.15.50:0/72060724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3dc0772e0 0x7fe3dc112e00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe3d401c0d0 tx=0x7fe3d401c3e0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.076+0000 7fe3e321b700 1 -- 172.21.15.50:0/72060724 shutdown_connections 2024-06-06T03:37:34.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.076+0000 7fe3e321b700 1 --2- 172.21.15.50:0/72060724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe3dc113340 0x7fe3dc115730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.076+0000 7fe3e321b700 1 --2- 172.21.15.50:0/72060724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3dc0769c0 0x7fe3dc076da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.076+0000 7fe3e321b700 1 --2- 172.21.15.50:0/72060724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3dc0772e0 0x7fe3dc112e00 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.076+0000 7fe3e321b700 1 -- 172.21.15.50:0/72060724 >> 172.21.15.50:0/72060724 conn(0x7fe3dc100170 msgr2=0x7fe3dc102590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:34.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.077+0000 7fe3e321b700 1 -- 172.21.15.50:0/72060724 shutdown_connections 2024-06-06T03:37:34.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.078+0000 7fe3e321b700 1 -- 172.21.15.50:0/72060724 wait complete. 2024-06-06T03:37:34.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.079+0000 7fe3e321b700 1 Processor -- start 2024-06-06T03:37:34.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.079+0000 7fe3e321b700 1 -- start start 2024-06-06T03:37:34.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.079+0000 7fe3e321b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3dc0769c0 0x7fe3dc073360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:34.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.079+0000 7fe3e321b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3dc0772e0 0x7fe3dc0738a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:34.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.079+0000 7fe3e321b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe3dc113340 0x7fe3dc10abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:34.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.079+0000 7fe3e321b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe3dc106e90 con 0x7fe3dc0769c0 2024-06-06T03:37:34.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.079+0000 7fe3e321b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe3dc106d10 con 0x7fe3dc0772e0 2024-06-06T03:37:34.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.079+0000 7fe3e321b700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe3dc107010 con 0x7fe3dc113340 2024-06-06T03:37:34.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.080+0000 7fe3e0fb7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3dc0769c0 0x7fe3dc073360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:34.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.080+0000 7fe3e0fb7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3dc0769c0 0x7fe3dc073360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49914/0 (socket says 172.21.15.50:49914) 2024-06-06T03:37:34.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.080+0000 7fe3e0fb7700 1 -- 172.21.15.50:0/2285817500 learned_addr learned my addr 172.21.15.50:0/2285817500 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:34.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.080+0000 7fe3dbfff700 1 --2- 172.21.15.50:0/2285817500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3dc0772e0 0x7fe3dc0738a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:34.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.080+0000 7fe3e17b8700 1 --2- 172.21.15.50:0/2285817500 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe3dc113340 0x7fe3dc10abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:34.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.080+0000 7fe3e0fb7700 1 -- 172.21.15.50:0/2285817500 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe3dc113340 msgr2=0x7fe3dc10abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:34.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.080+0000 7fe3e0fb7700 1 --2- 172.21.15.50:0/2285817500 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe3dc113340 0x7fe3dc10abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.080+0000 7fe3e0fb7700 1 -- 172.21.15.50:0/2285817500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3dc0772e0 msgr2=0x7fe3dc0738a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:34.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.080+0000 7fe3e0fb7700 1 --2- 172.21.15.50:0/2285817500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3dc0772e0 0x7fe3dc0738a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.080+0000 7fe3e0fb7700 1 -- 172.21.15.50:0/2285817500 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3dc113040 con 0x7fe3dc0769c0 2024-06-06T03:37:34.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.080+0000 7fe3e17b8700 1 --2- 172.21.15.50:0/2285817500 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe3dc113340 0x7fe3dc10abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:37:34.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.081+0000 7fe3e0fb7700 1 --2- 172.21.15.50:0/2285817500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3dc0769c0 0x7fe3dc073360 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc00b550 tx=0x7fe3cc00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:34.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.082+0000 7fe3d9ffb700 1 -- 172.21.15.50:0/2285817500 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc015020 con 0x7fe3dc0769c0 2024-06-06T03:37:34.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.082+0000 7fe3e321b700 1 -- 172.21.15.50:0/2285817500 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3dc10b100 con 0x7fe3dc0769c0 2024-06-06T03:37:34.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.082+0000 7fe3e321b700 1 -- 172.21.15.50:0/2285817500 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3dc10b640 con 0x7fe3dc0769c0 2024-06-06T03:37:34.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.082+0000 7fe3d9ffb700 1 -- 172.21.15.50:0/2285817500 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe3cc011ce0 con 0x7fe3dc0769c0 2024-06-06T03:37:34.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.082+0000 7fe3d9ffb700 1 -- 172.21.15.50:0/2285817500 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc010db0 con 0x7fe3dc0769c0 2024-06-06T03:37:34.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.087+0000 7fe3eda9eb80 1 Processor -- start 2024-06-06T03:37:34.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.087+0000 7fe3eda9eb80 1 -- start start 2024-06-06T03:37:34.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.087+0000 7fe3eda9eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593fd904640 0x5593fd904a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:34.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.088+0000 7fe3eda9eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593fd904f60 0x5593fd8fe9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:34.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.088+0000 7fe3eda9eb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593fd8fef20 0x5593fd8ff340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:34.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.088+0000 7fe3e17b8700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593fd904640 0x5593fd904a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:34.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.088+0000 7fe3e17b8700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593fd904640 0x5593fd904a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:53844/0 (socket says 172.21.15.50:53844) 2024-06-06T03:37:34.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.088+0000 7fe3eda9eb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5593fd850810 con 0x5593fd8fef20 2024-06-06T03:37:34.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.088+0000 7fe3eda9eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5593fd7f8720 con 0x5593fd904f60 2024-06-06T03:37:34.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.088+0000 7fe3eda9eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5593fd84c7d0 con 0x5593fd904640 2024-06-06T03:37:34.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.088+0000 7fe3e17b8700 1 -- 172.21.15.50:0/4156573252 learned_addr learned my addr 172.21.15.50:0/4156573252 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:34.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.088+0000 7fe3dbfff700 1 --2- 172.21.15.50:0/4156573252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593fd8fef20 0x5593fd8ff340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:34.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.088+0000 7fe3dbfff700 1 -- 172.21.15.50:0/4156573252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593fd904640 msgr2=0x5593fd904a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:34.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.088+0000 7fe3dbfff700 1 --2- 172.21.15.50:0/4156573252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593fd904640 0x5593fd904a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.088+0000 7fe3dbfff700 1 -- 172.21.15.50:0/4156573252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593fd904f60 msgr2=0x5593fd8fe9e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:37:34.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.088+0000 7fe3dbfff700 1 --2- 172.21.15.50:0/4156573252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593fd904f60 0x5593fd8fe9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.088+0000 7fe3dbfff700 1 -- 172.21.15.50:0/4156573252 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593fd7eef50 con 0x5593fd8fef20 2024-06-06T03:37:34.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.089+0000 7fe3dbfff700 1 --2- 172.21.15.50:0/4156573252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593fd8fef20 0x5593fd8ff340 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fe3d401a760 tx=0x7fe3d401cfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca8eb95f9620d45e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:34.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.091+0000 7fe3d2ffd700 1 -- 172.21.15.50:0/4156573252 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d401a2d0 con 0x5593fd8fef20 2024-06-06T03:37:34.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.097+0000 7fe3d2ffd700 1 -- 172.21.15.50:0/4156573252 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe3d4023620 con 0x5593fd8fef20 2024-06-06T03:37:34.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.097+0000 7fe3d2ffd700 1 -- 172.21.15.50:0/4156573252 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d40184f0 con 0x5593fd8fef20 2024-06-06T03:37:34.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.098+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/4156573252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593fd8fef20 msgr2=0x5593fd8ff340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:34.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.098+0000 7fe3eda9eb80 1 --2- 172.21.15.50:0/4156573252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593fd8fef20 0x5593fd8ff340 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fe3d401a760 tx=0x7fe3d401cfd0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.100+0000 7fe3d9ffb700 1 -- 172.21.15.50:0/2285817500 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe3cc018020 con 0x7fe3dc0769c0 2024-06-06T03:37:34.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.101+0000 7fe3d9ffb700 1 --2- 172.21.15.50:0/2285817500 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe3c80a2e30 0x7fe3c80a52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:34.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.101+0000 7fe3d9ffb700 1 -- 172.21.15.50:0/2285817500 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fe3cc0cea50 con 0x7fe3dc0769c0 2024-06-06T03:37:34.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.102+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/4156573252 shutdown_connections 2024-06-06T03:37:34.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.102+0000 7fe3eda9eb80 1 --2- 172.21.15.50:0/4156573252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593fd8fef20 0x5593fd8ff340 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.102+0000 7fe3eda9eb80 1 --2- 172.21.15.50:0/4156573252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593fd904640 0x5593fd904a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.102+0000 7fe3eda9eb80 1 --2- 172.21.15.50:0/4156573252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593fd904f60 0x5593fd8fe9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.102+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/4156573252 >> 172.21.15.50:0/4156573252 conn(0x5593fd829cc0 msgr2=0x5593fd8f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.102+0000 7fe3e17b8700 1 --2- 172.21.15.50:0/2285817500 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe3c80a2e30 0x7fe3c80a52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.102+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/4156573252 shutdown_connections 2024-06-06T03:37:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.102+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/4156573252 wait complete. 2024-06-06T03:37:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.103+0000 7fe3eda9eb80 1 -- start start 2024-06-06T03:37:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.103+0000 7fe3eda9eb80 1 Processor -- start 2024-06-06T03:37:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.104+0000 7fe3eda9eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593fd8fef20 0x5593fd90ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.104+0000 7fe3eda9eb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593fd904640 0x5593fd9080a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.104+0000 7fe3eda9eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593fd904f60 0x5593fd9085e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.104+0000 7fe3eda9eb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5593fd90b970 con 0x5593fd904640 2024-06-06T03:37:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.104+0000 7fe3eda9eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5593fd7f0bf0 con 0x5593fd904f60 2024-06-06T03:37:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.104+0000 7fe3eda9eb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5593fd90baf0 con 0x5593fd8fef20 2024-06-06T03:37:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.104+0000 7fe3dbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593fd904640 0x5593fd9080a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.104+0000 7fe3dbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593fd904640 0x5593fd9080a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49936/0 (socket says 172.21.15.50:49936) 2024-06-06T03:37:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.104+0000 7fe3dbfff700 1 -- 172.21.15.50:0/81391936 learned_addr learned my addr 172.21.15.50:0/81391936 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.104+0000 7fe3eda9eb80 10 client.0 _ll_register_callbacks cb 0x5593fd7ea920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:37:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.104+0000 7fe3e17b8700 1 --2- 172.21.15.50:0/81391936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593fd904f60 0x5593fd9085e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.104+0000 7fe3dbfff700 1 -- 172.21.15.50:0/81391936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593fd8fef20 msgr2=0x5593fd90ada0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T03:37:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.104+0000 7fe3dbfff700 1 --2- 172.21.15.50:0/81391936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593fd8fef20 0x5593fd90ada0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.104+0000 7fe3dbfff700 1 -- 172.21.15.50:0/81391936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593fd904f60 msgr2=0x5593fd9085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.104+0000 7fe3dbfff700 1 --2- 172.21.15.50:0/81391936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593fd904f60 0x5593fd9085e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.104+0000 7fe3dbfff700 1 -- 172.21.15.50:0/81391936 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593fd79f8d0 con 0x5593fd904640 2024-06-06T03:37:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.105+0000 7fe3e17b8700 1 --2- 172.21.15.50:0/81391936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593fd904f60 0x5593fd9085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:37:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.105+0000 7fe3dbfff700 1 --2- 172.21.15.50:0/81391936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593fd904640 0x5593fd9080a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe3d401c9e0 tx=0x7fe3d4023ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=618951ec769f1e82 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.105+0000 7fe3bbfff700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:37:34.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.106+0000 7fe3e17b8700 1 --2- 172.21.15.50:0/2285817500 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe3c80a2e30 0x7fe3c80a52f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009da0 tx=0x7fe3c4009730 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:34.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.106+0000 7fe3bbfff700 1 -- 172.21.15.50:0/81391936 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d40184f0 con 0x5593fd904640 2024-06-06T03:37:34.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.106+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/81391936 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3d4023620 con 0x5593fd904640 2024-06-06T03:37:34.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.106+0000 7fe3bbfff700 1 -- 172.21.15.50:0/81391936 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fe3d4018690 con 0x5593fd904640 2024-06-06T03:37:34.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.112+0000 7fe3bbfff700 1 -- 172.21.15.50:0/81391936 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fe3d4018890 con 0x5593fd904640 2024-06-06T03:37:34.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.112+0000 7fe3eda9eb80 10 client.16818 fetch_fsmap learned FSMap version 36 2024-06-06T03:37:34.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.112+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/81391936 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5593fd916150 con 0x5593fd904640 2024-06-06T03:37:34.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.117+0000 7fe3bbfff700 1 -- 172.21.15.50:0/81391936 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe3d4023620 con 0x5593fd904640 2024-06-06T03:37:34.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.117+0000 7fe3bbfff700 1 -- 172.21.15.50:0/81391936 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7fe3d4022070 con 0x5593fd904640 2024-06-06T03:37:34.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.117+0000 7fe3eda9eb80 10 client.16818 fetch_fsmap finished waiting for FSMap version 36 2024-06-06T03:37:34.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.117+0000 7fe3eda9eb80 10 client.16818 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-06-06T03:37:34.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.117+0000 7fe3eda9eb80 20 client.16818 populate_metadata read hostname 'smithi050' 2024-06-06T03:37:34.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.117+0000 7fe3eda9eb80 1 --2- 172.21.15.50:0/81391936 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x5593fd918710 0x5593fd91ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:34.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.117+0000 7fe3eda9eb80 4 client.16818 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:37:34.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.117+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/81391936 --> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593fd85dd10 con 0x5593fd918710 2024-06-06T03:37:34.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.117+0000 7fe3e0fb7700 1 --2- 172.21.15.50:0/81391936 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x5593fd918710 0x5593fd91ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:34.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.118+0000 7fe3e0fb7700 1 --2- 172.21.15.50:0/81391936 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x5593fd918710 0x5593fd91ab70 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3a082d3cf5840975 server_cookie=506fa0b0df805f45 in_seq=0 out_seq=0 2024-06-06T03:37:34.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.118+0000 7fe3bbfff700 10 client.16818 ms_handle_connect on v2:172.21.15.122:6834/2987597320 2024-06-06T03:37:34.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.119+0000 7fe3bbfff700 1 -- 172.21.15.50:0/81391936 <== mds.2 v2:172.21.15.122:6834/2987597320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5593fd85dd10 con 0x5593fd918710 2024-06-06T03:37:34.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.119+0000 7fe3bbfff700 10 client.16818 handle_command_reply: tid=0 2024-06-06T03:37:34.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.119+0000 7fe3eda9eb80 1 client.16818 shutdown 2024-06-06T03:37:34.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.126+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/81391936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593fd904640 msgr2=0x5593fd9080a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:34.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.126+0000 7fe3eda9eb80 1 --2- 172.21.15.50:0/81391936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593fd904640 0x5593fd9080a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe3d401c9e0 tx=0x7fe3d4023ae0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.126+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/81391936 shutdown_connections 2024-06-06T03:37:34.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.126+0000 7fe3eda9eb80 1 --2- 172.21.15.50:0/81391936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593fd904f60 0x5593fd9085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.126+0000 7fe3eda9eb80 1 --2- 172.21.15.50:0/81391936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593fd8fef20 0x5593fd90ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.126+0000 7fe3eda9eb80 1 --2- 172.21.15.50:0/81391936 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x5593fd918710 0x5593fd91ab70 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.126+0000 7fe3eda9eb80 1 --2- 172.21.15.50:0/81391936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593fd904640 0x5593fd9080a0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.126+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/81391936 >> 172.21.15.50:0/81391936 conn(0x5593fd829cc0 msgr2=0x5593fd8fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:34.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.126+0000 7fe3bbfff700 0 client.16818 ms_handle_reset on v2:172.21.15.122:6834/2987597320 2024-06-06T03:37:34.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.127+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/81391936 shutdown_connections 2024-06-06T03:37:34.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.127+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/81391936 wait complete. 2024-06-06T03:37:34.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.127+0000 7fe3eda9eb80 20 client.16818 trim_cache size 0 max 16384 2024-06-06T03:37:34.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.159+0000 7fe3eda9eb80 1 Processor -- start 2024-06-06T03:37:34.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.160+0000 7fe3eda9eb80 1 -- start start 2024-06-06T03:37:34.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.160+0000 7fe3eda9eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593fd8fef20 0x5593fd914c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:34.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.161+0000 7fe3eda9eb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593fd904640 0x5593fd8fe9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:34.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.161+0000 7fe3e0fb7700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593fd8fef20 0x5593fd914c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:34.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.161+0000 7fe3e0fb7700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593fd8fef20 0x5593fd914c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:53854/0 (socket says 172.21.15.50:53854) 2024-06-06T03:37:34.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.161+0000 7fe3dbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593fd904640 0x5593fd8fe9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:34.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.161+0000 7fe3e0fb7700 1 -- 172.21.15.50:0/3251605666 learned_addr learned my addr 172.21.15.50:0/3251605666 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:34.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.161+0000 7fe3eda9eb80 1 --2- 172.21.15.50:0/3251605666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593fd904f60 0x5593fd907a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:34.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.161+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/3251605666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc011430 con 0x5593fd904640 2024-06-06T03:37:34.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.161+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/3251605666 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc00ecc0 con 0x5593fd904f60 2024-06-06T03:37:34.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.161+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/3251605666 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc00cb10 con 0x5593fd8fef20 2024-06-06T03:37:34.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.162+0000 7fe3e17b8700 1 --2- 172.21.15.50:0/3251605666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593fd904f60 0x5593fd907a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:34.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.164+0000 7fe3e17b8700 1 -- 172.21.15.50:0/3251605666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593fd8fef20 msgr2=0x5593fd914c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:34.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.164+0000 7fe3e17b8700 1 --2- 172.21.15.50:0/3251605666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593fd8fef20 0x5593fd914c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.164+0000 7fe3e17b8700 1 -- 172.21.15.50:0/3251605666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593fd904640 msgr2=0x5593fd8fe9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:34.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.164+0000 7fe3e17b8700 1 --2- 172.21.15.50:0/3251605666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593fd904640 0x5593fd8fe9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.164+0000 7fe3e17b8700 1 -- 172.21.15.50:0/3251605666 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593fd9066b0 con 0x5593fd904f60 2024-06-06T03:37:34.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.164+0000 7fe3e17b8700 1 --2- 172.21.15.50:0/3251605666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593fd904f60 0x5593fd907a10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe3c40098b0 tx=0x7fe3c4011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a234199d8c48a0b server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:34.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.168+0000 7fe3dbfff700 1 --2- 172.21.15.50:0/3251605666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593fd904640 0x5593fd8fe9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:37:34.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.168+0000 7fe3e0fb7700 1 --2- 172.21.15.50:0/3251605666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593fd8fef20 0x5593fd914c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:37:34.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.169+0000 7fe3d27fc700 1 -- 172.21.15.50:0/3251605666 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c401e050 con 0x5593fd904f60 2024-06-06T03:37:34.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.169+0000 7fe3d27fc700 1 -- 172.21.15.50:0/3251605666 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe3c4028070 con 0x5593fd904f60 2024-06-06T03:37:34.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.169+0000 7fe3d27fc700 1 -- 172.21.15.50:0/3251605666 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c4023bc0 con 0x5593fd904f60 2024-06-06T03:37:34.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.170+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/3251605666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593fd904f60 msgr2=0x5593fd907a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:34.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.170+0000 7fe3eda9eb80 1 --2- 172.21.15.50:0/3251605666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593fd904f60 0x5593fd907a10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe3c40098b0 tx=0x7fe3c4011000 comp rx=0 tx=0).stop 2024-06-06T03:37:34.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.180+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/3251605666 shutdown_connections 2024-06-06T03:37:34.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.180+0000 7fe3eda9eb80 1 --2- 172.21.15.50:0/3251605666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593fd904f60 0x5593fd907a10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.180+0000 7fe3eda9eb80 1 --2- 172.21.15.50:0/3251605666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593fd8fef20 0x5593fd914c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.180+0000 7fe3eda9eb80 1 --2- 172.21.15.50:0/3251605666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593fd904640 0x5593fd8fe9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.180+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/3251605666 >> 172.21.15.50:0/3251605666 conn(0x5593fd829cc0 msgr2=0x5593fd906a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:34.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.185+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/3251605666 shutdown_connections 2024-06-06T03:37:34.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.185+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/3251605666 wait complete. 2024-06-06T03:37:34.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.185+0000 7fe3eda9eb80 1 -- start start 2024-06-06T03:37:34.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.185+0000 7fe3eda9eb80 1 Processor -- start 2024-06-06T03:37:34.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.186+0000 7fe3eda9eb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593fd8fef20 0x5593fd920c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:34.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.186+0000 7fe3eda9eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593fd904640 0x5593fd910de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:34.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.186+0000 7fe3e0fb7700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593fd8fef20 0x5593fd920c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:34.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.186+0000 7fe3e0fb7700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593fd8fef20 0x5593fd920c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:53860/0 (socket says 172.21.15.50:53860) 2024-06-06T03:37:34.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.186+0000 7fe3dbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593fd904640 0x5593fd910de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:34.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.186+0000 7fe3dbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593fd904640 0x5593fd910de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:59842/0 (socket says 172.21.15.50:59842) 2024-06-06T03:37:34.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.187+0000 7fe3e0fb7700 1 -- 172.21.15.50:0/1379349437 learned_addr learned my addr 172.21.15.50:0/1379349437 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:34.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.187+0000 7fe3eda9eb80 1 --2- 172.21.15.50:0/1379349437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593fd904f60 0x5593fd911320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:34.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.187+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/1379349437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc00d180 con 0x5593fd904f60 2024-06-06T03:37:34.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.187+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/1379349437 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc00e5f0 con 0x5593fd904640 2024-06-06T03:37:34.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.187+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/1379349437 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc00d850 con 0x5593fd8fef20 2024-06-06T03:37:34.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.187+0000 7fe3e17b8700 1 --2- 172.21.15.50:0/1379349437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593fd904f60 0x5593fd911320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:34.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.187+0000 7fe3eda9eb80 10 client.0 _ll_register_callbacks cb 0x5593fd7ea920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:37:34.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.188+0000 7fe3e17b8700 1 -- 172.21.15.50:0/1379349437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593fd8fef20 msgr2=0x5593fd920c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:34.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.188+0000 7fe3e17b8700 1 --2- 172.21.15.50:0/1379349437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593fd8fef20 0x5593fd920c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.188+0000 7fe3e17b8700 1 -- 172.21.15.50:0/1379349437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593fd904640 msgr2=0x5593fd910de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:34.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.188+0000 7fe3e17b8700 1 --2- 172.21.15.50:0/1379349437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593fd904640 0x5593fd910de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.188+0000 7fe3e17b8700 1 -- 172.21.15.50:0/1379349437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593fd91f470 con 0x5593fd904f60 2024-06-06T03:37:34.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.188+0000 7fe3e0fb7700 1 --2- 172.21.15.50:0/1379349437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593fd8fef20 0x5593fd920c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:37:34.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.188+0000 7fe3dbfff700 1 --2- 172.21.15.50:0/1379349437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593fd904640 0x5593fd910de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T03:37:34.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.188+0000 7fe3e17b8700 1 --2- 172.21.15.50:0/1379349437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593fd904f60 0x5593fd911320 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe3c40098b0 tx=0x7fe3c4018a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d3c802da941f84 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:34.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.189+0000 7fe3bbfff700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:37:34.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.189+0000 7fe3bbfff700 1 -- 172.21.15.50:0/1379349437 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c4030020 con 0x5593fd904f60 2024-06-06T03:37:34.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.189+0000 7fe3bbfff700 1 -- 172.21.15.50:0/1379349437 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fe3c4005a20 con 0x5593fd904f60 2024-06-06T03:37:34.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.189+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/1379349437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3c4028070 con 0x5593fd904f60 2024-06-06T03:37:34.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.190+0000 7fe3bbfff700 1 -- 172.21.15.50:0/1379349437 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fe3c4005c20 con 0x5593fd904f60 2024-06-06T03:37:34.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.190+0000 7fe3eda9eb80 10 client.16821 fetch_fsmap learned FSMap version 36 2024-06-06T03:37:34.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.190+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/1379349437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5593fd9825a0 con 0x5593fd904f60 2024-06-06T03:37:34.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.192+0000 7fe3bbfff700 1 -- 172.21.15.50:0/1379349437 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe3c401f040 con 0x5593fd904f60 2024-06-06T03:37:34.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.192+0000 7fe3bbfff700 1 -- 172.21.15.50:0/1379349437 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7fe3c403d020 con 0x5593fd904f60 2024-06-06T03:37:34.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.193+0000 7fe3eda9eb80 10 client.16821 fetch_fsmap finished waiting for FSMap version 36 2024-06-06T03:37:34.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.193+0000 7fe3eda9eb80 10 client.16821 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-06-06T03:37:34.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.193+0000 7fe3eda9eb80 20 client.16821 populate_metadata read hostname 'smithi050' 2024-06-06T03:37:34.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.193+0000 7fe3eda9eb80 1 --2- 172.21.15.50:0/1379349437 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x5593fd982b30 0x5593fd984f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:34.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.193+0000 7fe3eda9eb80 4 client.16821 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:37:34.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.193+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/1379349437 --> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fe3c4028070 con 0x5593fd982b30 2024-06-06T03:37:34.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.194+0000 7fe3e0fb7700 1 --2- 172.21.15.50:0/1379349437 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x5593fd982b30 0x5593fd984f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:34.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.195+0000 7fe3e0fb7700 1 --2- 172.21.15.50:0/1379349437 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x5593fd982b30 0x5593fd984f50 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=10472dd8a1095c6e server_cookie=6b53a074d149b582 in_seq=0 out_seq=0 2024-06-06T03:37:34.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.195+0000 7fe3bbfff700 10 client.16821 ms_handle_connect on v2:172.21.15.122:6834/2987597320 2024-06-06T03:37:34.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.195+0000 7fe3bbfff700 1 -- 172.21.15.50:0/1379349437 <== mds.2 v2:172.21.15.122:6834/2987597320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fe3cc0092a0 con 0x5593fd982b30 2024-06-06T03:37:34.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.195+0000 7fe3bbfff700 10 client.16821 handle_command_reply: tid=0 2024-06-06T03:37:34.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.195+0000 7fe3eda9eb80 1 client.16821 shutdown 2024-06-06T03:37:34.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.195+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/1379349437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593fd904f60 msgr2=0x5593fd911320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:34.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.195+0000 7fe3eda9eb80 1 --2- 172.21.15.50:0/1379349437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593fd904f60 0x5593fd911320 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe3c40098b0 tx=0x7fe3c4018a60 comp rx=0 tx=0).stop 2024-06-06T03:37:34.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.195+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/1379349437 shutdown_connections 2024-06-06T03:37:34.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.195+0000 7fe3eda9eb80 1 --2- 172.21.15.50:0/1379349437 >> [v2:172.21.15.122:6834/2987597320,v1:172.21.15.122:6835/2987597320] conn(0x5593fd982b30 0x5593fd984f50 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.195+0000 7fe3eda9eb80 1 --2- 172.21.15.50:0/1379349437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593fd904f60 0x5593fd911320 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.195+0000 7fe3eda9eb80 1 --2- 172.21.15.50:0/1379349437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5593fd8fef20 0x5593fd920c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.195+0000 7fe3eda9eb80 1 --2- 172.21.15.50:0/1379349437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593fd904640 0x5593fd910de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.195+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/1379349437 >> 172.21.15.50:0/1379349437 conn(0x5593fd829cc0 msgr2=0x5593fd9020c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:34.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.195+0000 7fe3bbfff700 0 client.16821 ms_handle_reset on v2:172.21.15.122:6834/2987597320 2024-06-06T03:37:34.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.196+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/1379349437 shutdown_connections 2024-06-06T03:37:34.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.196+0000 7fe3eda9eb80 1 -- 172.21.15.50:0/1379349437 wait complete. 2024-06-06T03:37:34.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.196+0000 7fe3eda9eb80 20 client.16821 trim_cache size 0 max 16384 2024-06-06T03:37:34.200 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:37:34.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.200+0000 7fe3e321b700 1 -- 172.21.15.50:0/2285817500 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe3c80a2e30 msgr2=0x7fe3c80a52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:34.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.201+0000 7fe3e321b700 1 --2- 172.21.15.50:0/2285817500 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe3c80a2e30 0x7fe3c80a52f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009da0 tx=0x7fe3c4009730 comp rx=0 tx=0).stop 2024-06-06T03:37:34.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.201+0000 7fe3e321b700 1 -- 172.21.15.50:0/2285817500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3dc0769c0 msgr2=0x7fe3dc073360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:34.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.201+0000 7fe3e321b700 1 --2- 172.21.15.50:0/2285817500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3dc0769c0 0x7fe3dc073360 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc00b550 tx=0x7fe3cc00b860 comp rx=0 tx=0).stop 2024-06-06T03:37:34.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.201+0000 7fe3e321b700 1 -- 172.21.15.50:0/2285817500 shutdown_connections 2024-06-06T03:37:34.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.201+0000 7fe3e321b700 1 --2- 172.21.15.50:0/2285817500 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe3dc113340 0x7fe3dc10abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.201+0000 7fe3e321b700 1 --2- 172.21.15.50:0/2285817500 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fe3c80a2e30 0x7fe3c80a52f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.201+0000 7fe3e321b700 1 --2- 172.21.15.50:0/2285817500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3dc0769c0 0x7fe3dc073360 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.201+0000 7fe3e321b700 1 --2- 172.21.15.50:0/2285817500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3dc0772e0 0x7fe3dc0738a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:34.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.201+0000 7fe3e321b700 1 -- 172.21.15.50:0/2285817500 >> 172.21.15.50:0/2285817500 conn(0x7fe3dc100170 msgr2=0x7fe3dc102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:34.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.201+0000 7fe3e321b700 1 -- 172.21.15.50:0/2285817500 shutdown_connections 2024-06-06T03:37:34.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:34.205+0000 7fe3e321b700 1 -- 172.21.15.50:0/2285817500 wait complete. 2024-06-06T03:37:35.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:34 smithi122 ceph-mon[35759]: pgmap v759: 129 pgs: 129 active+clean; 10 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 28 MiB/s wr, 532 op/s 2024-06-06T03:37:35.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:34 smithi050 ceph-mon[32421]: pgmap v759: 129 pgs: 129 active+clean; 10 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 28 MiB/s wr, 532 op/s 2024-06-06T03:37:35.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:34 smithi079 ceph-mon[35478]: pgmap v759: 129 pgs: 129 active+clean; 10 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 28 MiB/s wr, 532 op/s 2024-06-06T03:37:35.908 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-06-06T03:37:36.736 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:37:37.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:36 smithi122 ceph-mon[35759]: pgmap v760: 129 pgs: 129 active+clean; 10 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 32 MiB/s wr, 622 op/s 2024-06-06T03:37:37.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:36 smithi050 ceph-mon[32421]: pgmap v760: 129 pgs: 129 active+clean; 10 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 32 MiB/s wr, 622 op/s 2024-06-06T03:37:37.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:36 smithi079 ceph-mon[35478]: pgmap v760: 129 pgs: 129 active+clean; 10 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 32 MiB/s wr, 622 op/s 2024-06-06T03:37:39.052 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:38 smithi050 ceph-mon[32421]: pgmap v761: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 27 MiB/s wr, 520 op/s 2024-06-06T03:37:39.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:38 smithi122 ceph-mon[35759]: pgmap v761: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 27 MiB/s wr, 520 op/s 2024-06-06T03:37:39.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.252+0000 7fd63c982700 1 -- 172.21.15.50:0/1222391849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd638108ac0 msgr2=0x7fd638108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:39.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.252+0000 7fd63c982700 1 --2- 172.21.15.50:0/1222391849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd638108ac0 0x7fd638108f40 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd62c009990 tx=0x7fd62c009ca0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.254+0000 7fd63c982700 1 -- 172.21.15.50:0/1222391849 shutdown_connections 2024-06-06T03:37:39.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.254+0000 7fd63c982700 1 --2- 172.21.15.50:0/1222391849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd638109480 0x7fd638115990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.254+0000 7fd63c982700 1 --2- 172.21.15.50:0/1222391849 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd63810eac0 0x7fd63810eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.254+0000 7fd63c982700 1 --2- 172.21.15.50:0/1222391849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd638108ac0 0x7fd638108f40 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.254+0000 7fd63c982700 1 -- 172.21.15.50:0/1222391849 >> 172.21.15.50:0/1222391849 conn(0x7fd638075c60 msgr2=0x7fd638078080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:39.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.255+0000 7fd63c982700 1 -- 172.21.15.50:0/1222391849 shutdown_connections 2024-06-06T03:37:39.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.259+0000 7fd63c982700 1 -- 172.21.15.50:0/1222391849 wait complete. 2024-06-06T03:37:39.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.260+0000 7fd63c982700 1 Processor -- start 2024-06-06T03:37:39.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.260+0000 7fd63c982700 1 -- start start 2024-06-06T03:37:39.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.260+0000 7fd63c982700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd638108ac0 0x7fd638082a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:39.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.260+0000 7fd63c982700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd638109480 0x7fd638082f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:39.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.260+0000 7fd63c982700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd63810eac0 0x7fd63807bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:39.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.260+0000 7fd63c982700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd638118d00 con 0x7fd638109480 2024-06-06T03:37:39.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.260+0000 7fd63c982700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd638118b80 con 0x7fd63810eac0 2024-06-06T03:37:39.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.260+0000 7fd63c982700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd638118e80 con 0x7fd638108ac0 2024-06-06T03:37:39.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.263+0000 7fd636d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd63810eac0 0x7fd63807bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:39.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.266+0000 7fd63659c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd638108ac0 0x7fd638082a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:39.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.266+0000 7fd63659c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd638108ac0 0x7fd638082a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:59604/0 (socket says 172.21.15.50:59604) 2024-06-06T03:37:39.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.266+0000 7fd63659c700 1 -- 172.21.15.50:0/336343375 learned_addr learned my addr 172.21.15.50:0/336343375 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:39.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.266+0000 7fd635d9b700 1 --2- 172.21.15.50:0/336343375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd638109480 0x7fd638082f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:39.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.267+0000 7fd63659c700 1 -- 172.21.15.50:0/336343375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd63810eac0 msgr2=0x7fd63807bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:39.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.267+0000 7fd63659c700 1 --2- 172.21.15.50:0/336343375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd63810eac0 0x7fd63807bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.267+0000 7fd63659c700 1 -- 172.21.15.50:0/336343375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd638109480 msgr2=0x7fd638082f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:39.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.267+0000 7fd63659c700 1 --2- 172.21.15.50:0/336343375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd638109480 0x7fd638082f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.268+0000 7fd63659c700 1 -- 172.21.15.50:0/336343375 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd63807c5f0 con 0x7fd638108ac0 2024-06-06T03:37:39.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.268+0000 7fd63659c700 1 --2- 172.21.15.50:0/336343375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd638108ac0 0x7fd638082a40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd62800c920 tx=0x7fd62800cce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:39.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.271+0000 7fd6277fe700 1 -- 172.21.15.50:0/336343375 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd628007b00 con 0x7fd638108ac0 2024-06-06T03:37:39.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.271+0000 7fd6277fe700 1 -- 172.21.15.50:0/336343375 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd628004ce0 con 0x7fd638108ac0 2024-06-06T03:37:39.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.271+0000 7fd63c982700 1 -- 172.21.15.50:0/336343375 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd63807c8e0 con 0x7fd638108ac0 2024-06-06T03:37:39.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.271+0000 7fd6277fe700 1 -- 172.21.15.50:0/336343375 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6280055f0 con 0x7fd638108ac0 2024-06-06T03:37:39.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.271+0000 7fd63c982700 1 -- 172.21.15.50:0/336343375 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd638080880 con 0x7fd638108ac0 2024-06-06T03:37:39.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.277+0000 7fd6277fe700 1 -- 172.21.15.50:0/336343375 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd628007ca0 con 0x7fd638108ac0 2024-06-06T03:37:39.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.278+0000 7fd6277fe700 1 --2- 172.21.15.50:0/336343375 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd6200a2df0 0x7fd6200a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:39.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.279+0000 7fd6277fe700 1 -- 172.21.15.50:0/336343375 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fd6280ceeb0 con 0x7fd638108ac0 2024-06-06T03:37:39.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.280+0000 7fd635d9b700 1 --2- 172.21.15.50:0/336343375 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd6200a2df0 0x7fd6200a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:39.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.284+0000 7fd635d9b700 1 --2- 172.21.15.50:0/336343375 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd6200a2df0 0x7fd6200a52b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd63807d290 tx=0x7fd62c00b560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:39.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.288+0000 7fd647205b80 1 Processor -- start 2024-06-06T03:37:39.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.293+0000 7fd647205b80 1 -- start start 2024-06-06T03:37:39.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.293+0000 7fd647205b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f4fff5f60 0x562f4fff6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:39.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.293+0000 7fd647205b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f4fff6880 0x562f4fff0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:39.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.293+0000 7fd647205b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562f4fff07a0 0x562f4fff0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:39.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.293+0000 7fd647205b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562f4fee2f60 con 0x562f4fff5f60 2024-06-06T03:37:39.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.293+0000 7fd647205b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562f4ff41850 con 0x562f4fff6880 2024-06-06T03:37:39.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.293+0000 7fd647205b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562f4fea9460 con 0x562f4fff07a0 2024-06-06T03:37:39.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.294+0000 7fd636d9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562f4fff07a0 0x562f4fff0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:39.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.294+0000 7fd636d9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562f4fff07a0 0x562f4fff0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:59616/0 (socket says 172.21.15.50:59616) 2024-06-06T03:37:39.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.294+0000 7fd636d9d700 1 -- 172.21.15.50:0/1046467639 learned_addr learned my addr 172.21.15.50:0/1046467639 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:39.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.294+0000 7fd63659c700 1 --2- 172.21.15.50:0/1046467639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f4fff5f60 0x562f4fff6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:39.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.295+0000 7fd635d9b700 1 --2- 172.21.15.50:0/1046467639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f4fff6880 0x562f4fff0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:39.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.298+0000 7fd635d9b700 1 -- 172.21.15.50:0/1046467639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562f4fff07a0 msgr2=0x562f4fff0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:39.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.298+0000 7fd635d9b700 1 --2- 172.21.15.50:0/1046467639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562f4fff07a0 0x562f4fff0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.298+0000 7fd635d9b700 1 -- 172.21.15.50:0/1046467639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f4fff5f60 msgr2=0x562f4fff6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:39.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.298+0000 7fd635d9b700 1 --2- 172.21.15.50:0/1046467639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f4fff5f60 0x562f4fff6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.298+0000 7fd635d9b700 1 -- 172.21.15.50:0/1046467639 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f4fe908d0 con 0x562f4fff6880 2024-06-06T03:37:39.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.299+0000 7fd635d9b700 1 --2- 172.21.15.50:0/1046467639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f4fff6880 0x562f4fff0260 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0098e0 tx=0x7fd62c01f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=baa8f19a687ab2d1 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:39.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.299+0000 7fd624ff9700 1 -- 172.21.15.50:0/1046467639 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c00f660 con 0x562f4fff6880 2024-06-06T03:37:39.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.299+0000 7fd624ff9700 1 -- 172.21.15.50:0/1046467639 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd62c00fcb0 con 0x562f4fff6880 2024-06-06T03:37:39.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.299+0000 7fd624ff9700 1 -- 172.21.15.50:0/1046467639 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c024dd0 con 0x562f4fff6880 2024-06-06T03:37:39.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.300+0000 7fd636d9d700 1 --2- 172.21.15.50:0/1046467639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562f4fff07a0 0x562f4fff0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:37:39.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.301+0000 7fd647205b80 1 -- 172.21.15.50:0/1046467639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f4fff6880 msgr2=0x562f4fff0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:39.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.301+0000 7fd647205b80 1 --2- 172.21.15.50:0/1046467639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f4fff6880 0x562f4fff0260 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0098e0 tx=0x7fd62c01f000 comp rx=0 tx=0).stop 2024-06-06T03:37:39.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.303+0000 7fd647205b80 1 -- 172.21.15.50:0/1046467639 shutdown_connections 2024-06-06T03:37:39.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.303+0000 7fd647205b80 1 --2- 172.21.15.50:0/1046467639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562f4fff07a0 0x562f4fff0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.303+0000 7fd647205b80 1 --2- 172.21.15.50:0/1046467639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f4fff5f60 0x562f4fff6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.303+0000 7fd647205b80 1 --2- 172.21.15.50:0/1046467639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f4fff6880 0x562f4fff0260 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.303+0000 7fd647205b80 1 -- 172.21.15.50:0/1046467639 >> 172.21.15.50:0/1046467639 conn(0x562f4ff1d080 msgr2=0x562f4ffeb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:39.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.303+0000 7fd647205b80 1 -- 172.21.15.50:0/1046467639 shutdown_connections 2024-06-06T03:37:39.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.304+0000 7fd647205b80 1 -- 172.21.15.50:0/1046467639 wait complete. 2024-06-06T03:37:39.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.304+0000 7fd647205b80 1 -- start start 2024-06-06T03:37:39.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.305+0000 7fd647205b80 1 Processor -- start 2024-06-06T03:37:39.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.305+0000 7fd647205b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f4fff07a0 0x562f4fffc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:39.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.305+0000 7fd647205b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f4fff5f60 0x562f4fff9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:39.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.306+0000 7fd647205b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562f4fff6880 0x562f4fff9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:39.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.306+0000 7fd647205b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562f4fee1fc0 con 0x562f4fff07a0 2024-06-06T03:37:39.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.306+0000 7fd647205b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562f4ff3d810 con 0x562f4fff5f60 2024-06-06T03:37:39.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.306+0000 7fd647205b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562f4fffd200 con 0x562f4fff6880 2024-06-06T03:37:39.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.306+0000 7fd647205b80 10 client.0 _ll_register_callbacks cb 0x562f4fed75b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:37:39.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.313+0000 7fd635d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f4fff5f60 0x562f4fff9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:39.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.313+0000 7fd635d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f4fff5f60 0x562f4fff9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:59488/0 (socket says 172.21.15.50:59488) 2024-06-06T03:37:39.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.313+0000 7fd635d9b700 1 -- 172.21.15.50:0/2194857299 learned_addr learned my addr 172.21.15.50:0/2194857299 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:39.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.313+0000 7fd636d9d700 1 --2- 172.21.15.50:0/2194857299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562f4fff6880 0x562f4fff9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:39.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.314+0000 7fd635d9b700 1 -- 172.21.15.50:0/2194857299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562f4fff6880 msgr2=0x562f4fff9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:39.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.314+0000 7fd635d9b700 1 --2- 172.21.15.50:0/2194857299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562f4fff6880 0x562f4fff9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.314+0000 7fd635d9b700 1 -- 172.21.15.50:0/2194857299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f4fff07a0 msgr2=0x562f4fffc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:39.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.314+0000 7fd635d9b700 1 --2- 172.21.15.50:0/2194857299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f4fff07a0 0x562f4fffc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.314+0000 7fd635d9b700 1 -- 172.21.15.50:0/2194857299 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f4ff07750 con 0x562f4fff5f60 2024-06-06T03:37:39.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.314+0000 7fd635d9b700 1 --2- 172.21.15.50:0/2194857299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f4fff5f60 0x562f4fff9930 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd62c024670 tx=0x7fd62c00bfb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c49e50e6d92cb04c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:39.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.317+0000 7fd61dffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:37:39.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.317+0000 7fd61dffb700 1 -- 172.21.15.50:0/2194857299 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c03c060 con 0x562f4fff5f60 2024-06-06T03:37:39.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.317+0000 7fd61dffb700 1 -- 172.21.15.50:0/2194857299 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fd62c00f670 con 0x562f4fff5f60 2024-06-06T03:37:39.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.318+0000 7fd647205b80 1 -- 172.21.15.50:0/2194857299 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd62c00fcb0 con 0x562f4fff5f60 2024-06-06T03:37:39.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.321+0000 7fd61dffb700 1 -- 172.21.15.50:0/2194857299 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fd62c00f870 con 0x562f4fff5f60 2024-06-06T03:37:39.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.324+0000 7fd647205b80 10 client.26492 fetch_fsmap learned FSMap version 36 2024-06-06T03:37:39.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.324+0000 7fd647205b80 1 -- 172.21.15.50:0/2194857299 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x562f500077e0 con 0x562f4fff5f60 2024-06-06T03:37:39.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.324+0000 7fd61dffb700 1 -- 172.21.15.50:0/2194857299 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd62c00fcb0 con 0x562f4fff5f60 2024-06-06T03:37:39.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.326+0000 7fd61dffb700 1 -- 172.21.15.50:0/2194857299 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7fd62c02d070 con 0x562f4fff5f60 2024-06-06T03:37:39.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.327+0000 7fd647205b80 10 client.26492 fetch_fsmap finished waiting for FSMap version 36 2024-06-06T03:37:39.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.327+0000 7fd647205b80 10 client.26492 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-06-06T03:37:39.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.328+0000 7fd647205b80 20 client.26492 populate_metadata read hostname 'smithi050' 2024-06-06T03:37:39.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.328+0000 7fd647205b80 1 --2- 172.21.15.50:0/2194857299 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x562f50009cb0 0x562f5000c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:39.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.328+0000 7fd647205b80 4 client.26492 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:37:39.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.328+0000 7fd647205b80 1 -- 172.21.15.50:0/2194857299 --> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f4ff4ed50 con 0x562f50009cb0 2024-06-06T03:37:39.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.334+0000 7fd63659c700 1 --2- 172.21.15.50:0/2194857299 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x562f50009cb0 0x562f5000c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:39.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.343+0000 7fd63659c700 1 --2- 172.21.15.50:0/2194857299 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x562f50009cb0 0x562f5000c0a0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=19d5987244c104c0 server_cookie=37fc3f9d4378b8c1 in_seq=0 out_seq=0 2024-06-06T03:37:39.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.344+0000 7fd61dffb700 10 client.26492 ms_handle_connect on v2:172.21.15.122:6836/1604366318 2024-06-06T03:37:39.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.345+0000 7fd61dffb700 1 -- 172.21.15.50:0/2194857299 <== mds.1 v2:172.21.15.122:6836/1604366318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x562f4ff4ed50 con 0x562f50009cb0 2024-06-06T03:37:39.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.345+0000 7fd61dffb700 10 client.26492 handle_command_reply: tid=0 2024-06-06T03:37:39.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.345+0000 7fd647205b80 1 client.26492 shutdown 2024-06-06T03:37:39.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.347+0000 7fd647205b80 1 -- 172.21.15.50:0/2194857299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f4fff5f60 msgr2=0x562f4fff9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:39.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.347+0000 7fd647205b80 1 --2- 172.21.15.50:0/2194857299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f4fff5f60 0x562f4fff9930 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd62c024670 tx=0x7fd62c00bfb0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.347+0000 7fd647205b80 1 -- 172.21.15.50:0/2194857299 shutdown_connections 2024-06-06T03:37:39.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.347+0000 7fd647205b80 1 --2- 172.21.15.50:0/2194857299 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x562f50009cb0 0x562f5000c0a0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.347+0000 7fd647205b80 1 --2- 172.21.15.50:0/2194857299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562f4fff6880 0x562f4fff9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.347+0000 7fd647205b80 1 --2- 172.21.15.50:0/2194857299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f4fff07a0 0x562f4fffc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.347+0000 7fd647205b80 1 --2- 172.21.15.50:0/2194857299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f4fff5f60 0x562f4fff9930 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.347+0000 7fd647205b80 1 -- 172.21.15.50:0/2194857299 >> 172.21.15.50:0/2194857299 conn(0x562f4ff1d080 msgr2=0x562f4ffea700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:39.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.348+0000 7fd61dffb700 0 client.26492 ms_handle_reset on v2:172.21.15.122:6836/1604366318 2024-06-06T03:37:39.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:38 smithi079 ceph-mon[35478]: pgmap v761: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 27 MiB/s wr, 520 op/s 2024-06-06T03:37:39.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.352+0000 7fd647205b80 1 -- 172.21.15.50:0/2194857299 shutdown_connections 2024-06-06T03:37:39.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.353+0000 7fd647205b80 1 -- 172.21.15.50:0/2194857299 wait complete. 2024-06-06T03:37:39.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.353+0000 7fd647205b80 20 client.26492 trim_cache size 0 max 16384 2024-06-06T03:37:39.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.390+0000 7fd647205b80 1 Processor -- start 2024-06-06T03:37:39.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.390+0000 7fd647205b80 1 -- start start 2024-06-06T03:37:39.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.390+0000 7fd647205b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f4fff07a0 0x562f4fff0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:39.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.391+0000 7fd647205b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562f4fff5f60 0x562f4fff9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:39.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.391+0000 7fd647205b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f4fff6880 0x562f4fff73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:39.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.391+0000 7fd635d9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562f4fff5f60 0x562f4fff9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:39.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.391+0000 7fd635d9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562f4fff5f60 0x562f4fff9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:59632/0 (socket says 172.21.15.50:59632) 2024-06-06T03:37:39.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.391+0000 7fd635d9b700 1 -- 172.21.15.50:0/2826516719 learned_addr learned my addr 172.21.15.50:0/2826516719 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:39.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.391+0000 7fd647205b80 1 -- 172.21.15.50:0/2826516719 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd6180112a0 con 0x562f4fff07a0 2024-06-06T03:37:39.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.391+0000 7fd636d9d700 1 --2- 172.21.15.50:0/2826516719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f4fff6880 0x562f4fff73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:39.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.391+0000 7fd647205b80 1 -- 172.21.15.50:0/2826516719 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd61800eb30 con 0x562f4fff6880 2024-06-06T03:37:39.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.392+0000 7fd647205b80 1 -- 172.21.15.50:0/2826516719 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd61800ca30 con 0x562f4fff5f60 2024-06-06T03:37:39.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.392+0000 7fd635d9b700 1 -- 172.21.15.50:0/2826516719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f4fff6880 msgr2=0x562f4fff73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:39.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.392+0000 7fd635d9b700 1 --2- 172.21.15.50:0/2826516719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f4fff6880 0x562f4fff73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.392+0000 7fd635d9b700 1 -- 172.21.15.50:0/2826516719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f4fff07a0 msgr2=0x562f4fff0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:39.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.392+0000 7fd635d9b700 1 --2- 172.21.15.50:0/2826516719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f4fff07a0 0x562f4fff0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.392+0000 7fd635d9b700 1 -- 172.21.15.50:0/2826516719 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f4ffecbc0 con 0x562f4fff5f60 2024-06-06T03:37:39.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.393+0000 7fd635d9b700 1 --2- 172.21.15.50:0/2826516719 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562f4fff5f60 0x562f4fff9ea0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00bab0 tx=0x7fd62c005cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b10421b4488a2de server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:39.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.393+0000 7fd61ffff700 1 -- 172.21.15.50:0/2826516719 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c03c070 con 0x562f4fff5f60 2024-06-06T03:37:39.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.393+0000 7fd61ffff700 1 -- 172.21.15.50:0/2826516719 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd62c005da0 con 0x562f4fff5f60 2024-06-06T03:37:39.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.393+0000 7fd61ffff700 1 -- 172.21.15.50:0/2826516719 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c046080 con 0x562f4fff5f60 2024-06-06T03:37:39.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.394+0000 7fd647205b80 1 -- 172.21.15.50:0/2826516719 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562f4fff5f60 msgr2=0x562f4fff9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:39.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.394+0000 7fd647205b80 1 --2- 172.21.15.50:0/2826516719 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562f4fff5f60 0x562f4fff9ea0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00bab0 tx=0x7fd62c005cc0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.395+0000 7fd647205b80 1 -- 172.21.15.50:0/2826516719 shutdown_connections 2024-06-06T03:37:39.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.395+0000 7fd647205b80 1 --2- 172.21.15.50:0/2826516719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f4fff6880 0x562f4fff73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.395+0000 7fd647205b80 1 --2- 172.21.15.50:0/2826516719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f4fff07a0 0x562f4fff0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.395+0000 7fd647205b80 1 --2- 172.21.15.50:0/2826516719 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562f4fff5f60 0x562f4fff9ea0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.395+0000 7fd647205b80 1 -- 172.21.15.50:0/2826516719 >> 172.21.15.50:0/2826516719 conn(0x562f4ff1d080 msgr2=0x562f4fff6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:39.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.399+0000 7fd647205b80 1 -- 172.21.15.50:0/2826516719 shutdown_connections 2024-06-06T03:37:39.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.399+0000 7fd647205b80 1 -- 172.21.15.50:0/2826516719 wait complete. 2024-06-06T03:37:39.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.399+0000 7fd647205b80 1 -- start start 2024-06-06T03:37:39.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.399+0000 7fd647205b80 1 Processor -- start 2024-06-06T03:37:39.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.400+0000 7fd647205b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f4fff07a0 0x562f5000be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:39.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.400+0000 7fd647205b80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562f4fff5f60 0x562f5000c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:39.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.400+0000 7fd647205b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f4fff6880 0x562f500725e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:39.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.400+0000 7fd635d9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562f4fff5f60 0x562f5000c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:39.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.400+0000 7fd635d9b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562f4fff5f60 0x562f5000c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:59642/0 (socket says 172.21.15.50:59642) 2024-06-06T03:37:39.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.401+0000 7fd647205b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd61800cff0 con 0x562f4fff07a0 2024-06-06T03:37:39.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.401+0000 7fd647205b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd61800e460 con 0x562f4fff6880 2024-06-06T03:37:39.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.401+0000 7fd647205b80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd61800d6c0 con 0x562f4fff5f60 2024-06-06T03:37:39.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.401+0000 7fd636d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f4fff6880 0x562f500725e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:39.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.401+0000 7fd636d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f4fff6880 0x562f500725e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:59512/0 (socket says 172.21.15.50:59512) 2024-06-06T03:37:39.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.401+0000 7fd636d9d700 1 -- 172.21.15.50:0/1371023465 learned_addr learned my addr 172.21.15.50:0/1371023465 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:39.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.401+0000 7fd647205b80 10 client.0 _ll_register_callbacks cb 0x562f4fed75b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:37:39.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.401+0000 7fd636d9d700 1 -- 172.21.15.50:0/1371023465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562f4fff5f60 msgr2=0x562f5000c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:39.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.401+0000 7fd636d9d700 1 --2- 172.21.15.50:0/1371023465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562f4fff5f60 0x562f5000c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.401+0000 7fd636d9d700 1 -- 172.21.15.50:0/1371023465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f4fff07a0 msgr2=0x562f5000be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:39.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.401+0000 7fd636d9d700 1 --2- 172.21.15.50:0/1371023465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f4fff07a0 0x562f5000be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.401+0000 7fd636d9d700 1 -- 172.21.15.50:0/1371023465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f4ffe7810 con 0x562f4fff6880 2024-06-06T03:37:39.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.401+0000 7fd636d9d700 1 --2- 172.21.15.50:0/1371023465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f4fff6880 0x562f500725e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd630007920 tx=0x7fd630007ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6271207e58558ba4 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:39.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.402+0000 7fd61dffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:37:39.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.404+0000 7fd61dffb700 1 -- 172.21.15.50:0/1371023465 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63001b070 con 0x562f4fff6880 2024-06-06T03:37:39.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.404+0000 7fd647205b80 1 -- 172.21.15.50:0/1371023465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd62c005da0 con 0x562f4fff6880 2024-06-06T03:37:39.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.404+0000 7fd61dffb700 1 -- 172.21.15.50:0/1371023465 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fd630013b60 con 0x562f4fff6880 2024-06-06T03:37:39.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.404+0000 7fd61dffb700 1 -- 172.21.15.50:0/1371023465 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fd630027050 con 0x562f4fff6880 2024-06-06T03:37:39.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.405+0000 7fd647205b80 10 client.26498 fetch_fsmap learned FSMap version 36 2024-06-06T03:37:39.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.405+0000 7fd647205b80 1 -- 172.21.15.50:0/1371023465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x562f50073a80 con 0x562f4fff6880 2024-06-06T03:37:39.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.405+0000 7fd61dffb700 1 -- 172.21.15.50:0/1371023465 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd62c005da0 con 0x562f4fff6880 2024-06-06T03:37:39.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.406+0000 7fd61dffb700 1 -- 172.21.15.50:0/1371023465 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7fd6300163e0 con 0x562f4fff6880 2024-06-06T03:37:39.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.406+0000 7fd647205b80 10 client.26498 fetch_fsmap finished waiting for FSMap version 36 2024-06-06T03:37:39.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.406+0000 7fd647205b80 10 client.26498 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-06-06T03:37:39.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.406+0000 7fd647205b80 20 client.26498 populate_metadata read hostname 'smithi050' 2024-06-06T03:37:39.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.406+0000 7fd647205b80 1 --2- 172.21.15.50:0/1371023465 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x562f50074190 0x562f500765d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:39.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.406+0000 7fd647205b80 4 client.26498 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:37:39.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.406+0000 7fd647205b80 1 -- 172.21.15.50:0/1371023465 --> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562f4ff492d0 con 0x562f50074190 2024-06-06T03:37:39.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.412+0000 7fd63659c700 1 --2- 172.21.15.50:0/1371023465 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x562f50074190 0x562f500765d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:39.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.414+0000 7fd61dffb700 10 client.26498 ms_handle_connect on v2:172.21.15.122:6836/1604366318 2024-06-06T03:37:39.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.414+0000 7fd63659c700 1 --2- 172.21.15.50:0/1371023465 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x562f50074190 0x562f500765d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9635c20f6dda6c9a server_cookie=24bcdc9c437c4213 in_seq=0 out_seq=0 2024-06-06T03:37:39.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.415+0000 7fd61dffb700 1 -- 172.21.15.50:0/1371023465 <== mds.1 v2:172.21.15.122:6836/1604366318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3846 (crc 0 0 0) 0x562f4ff492d0 con 0x562f50074190 2024-06-06T03:37:39.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.415+0000 7fd61dffb700 10 client.26498 handle_command_reply: tid=0 2024-06-06T03:37:39.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.415+0000 7fd647205b80 1 client.26498 shutdown 2024-06-06T03:37:39.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.417+0000 7fd647205b80 1 -- 172.21.15.50:0/1371023465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f4fff6880 msgr2=0x562f500725e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:39.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.417+0000 7fd647205b80 1 --2- 172.21.15.50:0/1371023465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f4fff6880 0x562f500725e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd630007920 tx=0x7fd630007ce0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.421+0000 7fd647205b80 1 -- 172.21.15.50:0/1371023465 shutdown_connections 2024-06-06T03:37:39.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.421+0000 7fd647205b80 1 --2- 172.21.15.50:0/1371023465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f4fff6880 0x562f500725e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.421+0000 7fd647205b80 1 --2- 172.21.15.50:0/1371023465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f4fff07a0 0x562f5000be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.421+0000 7fd647205b80 1 --2- 172.21.15.50:0/1371023465 >> [v2:172.21.15.122:6836/1604366318,v1:172.21.15.122:6837/1604366318] conn(0x562f50074190 0x562f500765d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.421+0000 7fd647205b80 1 --2- 172.21.15.50:0/1371023465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562f4fff5f60 0x562f5000c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.421+0000 7fd61dffb700 0 client.26498 ms_handle_reset on v2:172.21.15.122:6836/1604366318 2024-06-06T03:37:39.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.421+0000 7fd647205b80 1 -- 172.21.15.50:0/1371023465 >> 172.21.15.50:0/1371023465 conn(0x562f4ff1d080 msgr2=0x562f4fffb160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:39.429 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2024-06-06T03:37:39.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:37:39.429 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2024-06-06T03:37:39.429 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 369173124, 2024-06-06T03:37:39.429 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511628302, 2024-06-06T03:37:39.429 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95184.io" 2024-06-06T03:37:39.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:37:39.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:37:39.429 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2024-06-06T03:37:39.430 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 653695372, 2024-06-06T03:37:39.430 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511627783, 2024-06-06T03:37:39.430 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0.tar" 2024-06-06T03:37:39.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:37:39.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:37:39.430 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2024-06-06T03:37:39.430 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1017727503, 2024-06-06T03:37:39.430 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511628293, 2024-06-06T03:37:39.430 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/README" 2024-06-06T03:37:39.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:37:39.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:37:39.430 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2024-06-06T03:37:39.430 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1039042855, 2024-06-06T03:37:39.430 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511628296, 2024-06-06T03:37:39.431 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen" 2024-06-06T03:37:39.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:37:39.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:37:39.431 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2024-06-06T03:37:39.431 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1180448874, 2024-06-06T03:37:39.431 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511628307, 2024-06-06T03:37:39.431 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95184.res" 2024-06-06T03:37:39.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:37:39.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:37:39.431 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2024-06-06T03:37:39.431 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1736509767, 2024-06-06T03:37:39.431 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511628306, 2024-06-06T03:37:39.431 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95182.res" 2024-06-06T03:37:39.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:37:39.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:37:39.432 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2024-06-06T03:37:39.432 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1892909590, 2024-06-06T03:37:39.432 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511628294, 2024-06-06T03:37:39.432 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/Makefile.bsd" 2024-06-06T03:37:39.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:37:39.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:37:39.432 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2024-06-06T03:37:39.432 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2219615322, 2024-06-06T03:37:39.432 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511628290, 2024-06-06T03:37:39.432 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/src" 2024-06-06T03:37:39.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:37:39.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:37:39.432 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2024-06-06T03:37:39.433 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2322006077, 2024-06-06T03:37:39.433 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511628297, 2024-06-06T03:37:39.433 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen.cat8" 2024-06-06T03:37:39.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:37:39.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:37:39.433 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2024-06-06T03:37:39.433 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2679280691, 2024-06-06T03:37:39.433 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511628304, 2024-06-06T03:37:39.433 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95181.res" 2024-06-06T03:37:39.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:37:39.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:37:39.433 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2024-06-06T03:37:39.433 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2689700715, 2024-06-06T03:37:39.433 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511628301, 2024-06-06T03:37:39.433 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95182.io" 2024-06-06T03:37:39.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:37:39.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:37:39.434 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2024-06-06T03:37:39.434 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2865347978, 2024-06-06T03:37:39.434 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511628289, 2024-06-06T03:37:39.434 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0" 2024-06-06T03:37:39.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:37:39.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:37:39.434 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2024-06-06T03:37:39.434 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3136187709, 2024-06-06T03:37:39.434 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511628295, 2024-06-06T03:37:39.434 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/Makefile" 2024-06-06T03:37:39.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:37:39.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:37:39.434 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2024-06-06T03:37:39.435 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3503216772, 2024-06-06T03:37:39.435 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511628300, 2024-06-06T03:37:39.435 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95183.io" 2024-06-06T03:37:39.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:37:39.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:37:39.435 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2024-06-06T03:37:39.435 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3769103224, 2024-06-06T03:37:39.435 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511628299, 2024-06-06T03:37:39.435 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95181.io" 2024-06-06T03:37:39.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:37:39.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:37:39.435 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2024-06-06T03:37:39.435 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3947071276, 2024-06-06T03:37:39.435 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511628303, 2024-06-06T03:37:39.436 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95180.res" 2024-06-06T03:37:39.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:37:39.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:37:39.436 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2024-06-06T03:37:39.436 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4234242386, 2024-06-06T03:37:39.436 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511628305, 2024-06-06T03:37:39.436 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95183.res" 2024-06-06T03:37:39.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:37:39.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:37:39.436 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2024-06-06T03:37:39.436 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4278625432, 2024-06-06T03:37:39.436 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511628298, 2024-06-06T03:37:39.436 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95180.io" 2024-06-06T03:37:39.436 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:37:39.437 INFO:teuthology.orchestra.run.smithi050.stdout:] 2024-06-06T03:37:39.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.426+0000 7fd647205b80 1 -- 172.21.15.50:0/1371023465 shutdown_connections 2024-06-06T03:37:39.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.426+0000 7fd647205b80 1 -- 172.21.15.50:0/1371023465 wait complete. 2024-06-06T03:37:39.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.426+0000 7fd647205b80 20 client.26498 trim_cache size 0 max 16384 2024-06-06T03:37:39.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.431+0000 7fd63c982700 1 -- 172.21.15.50:0/336343375 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd6200a2df0 msgr2=0x7fd6200a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:39.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.431+0000 7fd63c982700 1 --2- 172.21.15.50:0/336343375 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd6200a2df0 0x7fd6200a52b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd63807d290 tx=0x7fd62c00b560 comp rx=0 tx=0).stop 2024-06-06T03:37:39.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.431+0000 7fd63c982700 1 -- 172.21.15.50:0/336343375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd638108ac0 msgr2=0x7fd638082a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:39.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.431+0000 7fd63c982700 1 --2- 172.21.15.50:0/336343375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd638108ac0 0x7fd638082a40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd62800c920 tx=0x7fd62800cce0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.433+0000 7fd63c982700 1 -- 172.21.15.50:0/336343375 shutdown_connections 2024-06-06T03:37:39.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.433+0000 7fd63c982700 1 --2- 172.21.15.50:0/336343375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd63810eac0 0x7fd63807bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.433+0000 7fd63c982700 1 --2- 172.21.15.50:0/336343375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd638108ac0 0x7fd638082a40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.433+0000 7fd63c982700 1 --2- 172.21.15.50:0/336343375 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd6200a2df0 0x7fd6200a52b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.433+0000 7fd63c982700 1 --2- 172.21.15.50:0/336343375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd638109480 0x7fd638082f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:39.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.433+0000 7fd63c982700 1 -- 172.21.15.50:0/336343375 >> 172.21.15.50:0/336343375 conn(0x7fd638075c60 msgr2=0x7fd638076400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:39.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.437+0000 7fd63c982700 1 -- 172.21.15.50:0/336343375 shutdown_connections 2024-06-06T03:37:39.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:39.437+0000 7fd63c982700 1 -- 172.21.15.50:0/336343375 wait complete. 2024-06-06T03:37:40.388 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-06-06T03:37:41.194 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:37:41.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:40 smithi050 ceph-mon[32421]: pgmap v762: 129 pgs: 129 active+clean; 10 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 33 MiB/s wr, 645 op/s 2024-06-06T03:37:41.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:40 smithi079 ceph-mon[35478]: pgmap v762: 129 pgs: 129 active+clean; 10 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 33 MiB/s wr, 645 op/s 2024-06-06T03:37:41.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:40 smithi122 ceph-mon[35759]: pgmap v762: 129 pgs: 129 active+clean; 10 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 33 MiB/s wr, 645 op/s 2024-06-06T03:37:42.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:41 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:37:42.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:41 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:37:42.432 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:41 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:37:43.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:42 smithi050 ceph-mon[32421]: pgmap v763: 129 pgs: 129 active+clean; 10 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 29 MiB/s wr, 552 op/s 2024-06-06T03:37:43.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:42 smithi079 ceph-mon[35478]: pgmap v763: 129 pgs: 129 active+clean; 10 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 29 MiB/s wr, 552 op/s 2024-06-06T03:37:43.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:42 smithi122 ceph-mon[35759]: pgmap v763: 129 pgs: 129 active+clean; 10 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 29 MiB/s wr, 552 op/s 2024-06-06T03:37:43.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.645+0000 7f56fcb6b700 1 -- 172.21.15.50:0/1042073008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56f8108ac0 msgr2=0x7f56f8108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:43.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.645+0000 7f56fcb6b700 1 --2- 172.21.15.50:0/1042073008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56f8108ac0 0x7f56f8108f40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f56e8009990 tx=0x7f56e8009ca0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.647+0000 7f56fcb6b700 1 -- 172.21.15.50:0/1042073008 shutdown_connections 2024-06-06T03:37:43.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.647+0000 7f56fcb6b700 1 --2- 172.21.15.50:0/1042073008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56f8109480 0x7f56f8115990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.647+0000 7f56fcb6b700 1 --2- 172.21.15.50:0/1042073008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56f810eac0 0x7f56f810eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.647+0000 7f56fcb6b700 1 --2- 172.21.15.50:0/1042073008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56f8108ac0 0x7f56f8108f40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.647+0000 7f56fcb6b700 1 -- 172.21.15.50:0/1042073008 >> 172.21.15.50:0/1042073008 conn(0x7f56f8075c60 msgr2=0x7f56f8078080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:43.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.654+0000 7f56fcb6b700 1 -- 172.21.15.50:0/1042073008 shutdown_connections 2024-06-06T03:37:43.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.657+0000 7f56fcb6b700 1 -- 172.21.15.50:0/1042073008 wait complete. 2024-06-06T03:37:43.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.659+0000 7f56fcb6b700 1 Processor -- start 2024-06-06T03:37:43.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.663+0000 7f56fcb6b700 1 -- start start 2024-06-06T03:37:43.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.663+0000 7f56fcb6b700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56f8108ac0 0x7f56f8082aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:43.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.663+0000 7f56fcb6b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56f8109480 0x7f56f807bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:43.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.663+0000 7f56fcb6b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56f810eac0 0x7f56f807c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:43.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.663+0000 7f56fcb6b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f56f8118e40 con 0x7f56f8109480 2024-06-06T03:37:43.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.663+0000 7f56fcb6b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f56f8118cc0 con 0x7f56f810eac0 2024-06-06T03:37:43.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.663+0000 7f56fcb6b700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f56f8118fc0 con 0x7f56f8108ac0 2024-06-06T03:37:43.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.664+0000 7f56f659c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56f8108ac0 0x7f56f8082aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:43.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.664+0000 7f56f659c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56f8108ac0 0x7f56f8082aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:59660/0 (socket says 172.21.15.50:59660) 2024-06-06T03:37:43.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.664+0000 7f56f659c700 1 -- 172.21.15.50:0/1489862896 learned_addr learned my addr 172.21.15.50:0/1489862896 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:43.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.666+0000 7f56f6d9d700 1 --2- 172.21.15.50:0/1489862896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56f810eac0 0x7f56f807c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:43.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.667+0000 7f56f6d9d700 1 -- 172.21.15.50:0/1489862896 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56f8108ac0 msgr2=0x7f56f8082aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:43.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.667+0000 7f56f6d9d700 1 --2- 172.21.15.50:0/1489862896 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56f8108ac0 0x7f56f8082aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.667+0000 7f56f6d9d700 1 -- 172.21.15.50:0/1489862896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56f8109480 msgr2=0x7f56f807bbd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T03:37:43.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.667+0000 7f56f6d9d700 1 --2- 172.21.15.50:0/1489862896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56f8109480 0x7f56f807bbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.667+0000 7f56f6d9d700 1 -- 172.21.15.50:0/1489862896 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f807c700 con 0x7f56f810eac0 2024-06-06T03:37:43.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.668+0000 7f56f6d9d700 1 --2- 172.21.15.50:0/1489862896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56f810eac0 0x7f56f807c110 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f56f000bb00 tx=0x7f56f000bec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:43.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.669+0000 7f56e77fe700 1 -- 172.21.15.50:0/1489862896 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f0019070 con 0x7f56f810eac0 2024-06-06T03:37:43.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.669+0000 7f56e77fe700 1 -- 172.21.15.50:0/1489862896 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f56f0014440 con 0x7f56f810eac0 2024-06-06T03:37:43.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.669+0000 7f56e77fe700 1 -- 172.21.15.50:0/1489862896 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f00125a0 con 0x7f56f810eac0 2024-06-06T03:37:43.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.670+0000 7f56fcb6b700 1 -- 172.21.15.50:0/1489862896 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56f807c9f0 con 0x7f56f810eac0 2024-06-06T03:37:43.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.670+0000 7f56fcb6b700 1 -- 172.21.15.50:0/1489862896 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f80808f0 con 0x7f56f810eac0 2024-06-06T03:37:43.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.683+0000 7f56e77fe700 1 -- 172.21.15.50:0/1489862896 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f56f001c070 con 0x7f56f810eac0 2024-06-06T03:37:43.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.684+0000 7f57073eeb80 1 Processor -- start 2024-06-06T03:37:43.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.685+0000 7f56e77fe700 1 --2- 172.21.15.50:0/1489862896 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f56e00a2e20 0x7f56e00a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:43.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.685+0000 7f56e77fe700 1 -- 172.21.15.50:0/1489862896 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f56f00ce850 con 0x7f56f810eac0 2024-06-06T03:37:43.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.687+0000 7f57073eeb80 1 -- start start 2024-06-06T03:37:43.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.687+0000 7f57073eeb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559bb50c2f60 0x559bb50c3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:43.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.687+0000 7f57073eeb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559bb50c3880 0x559bb50bd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:43.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.687+0000 7f57073eeb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559bb50bd7a0 0x559bb50bdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:43.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.687+0000 7f57073eeb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559bb4faff60 con 0x559bb50c3880 2024-06-06T03:37:43.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.687+0000 7f57073eeb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559bb500e850 con 0x559bb50bd7a0 2024-06-06T03:37:43.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.687+0000 7f57073eeb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559bb4f76460 con 0x559bb50c2f60 2024-06-06T03:37:43.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.689+0000 7f56f659c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559bb50c2f60 0x559bb50c3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:43.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.690+0000 7f56f659c700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559bb50c2f60 0x559bb50c3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:59668/0 (socket says 172.21.15.50:59668) 2024-06-06T03:37:43.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.690+0000 7f56f659c700 1 -- 172.21.15.50:0/4214676960 learned_addr learned my addr 172.21.15.50:0/4214676960 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:43.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.691+0000 7f56f5d9b700 1 --2- 172.21.15.50:0/1489862896 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f56e00a2e20 0x7f56e00a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:43.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.691+0000 7f56f6d9d700 1 --2- 172.21.15.50:0/4214676960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559bb50bd7a0 0x559bb50bdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:43.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.691+0000 7f56f5d9b700 1 --2- 172.21.15.50:0/4214676960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559bb50c3880 0x559bb50bd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:43.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.692+0000 7f56f6d9d700 1 -- 172.21.15.50:0/4214676960 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559bb50c2f60 msgr2=0x559bb50c3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:43.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.692+0000 7f56f6d9d700 1 --2- 172.21.15.50:0/4214676960 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559bb50c2f60 0x559bb50c3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.692+0000 7f56f6d9d700 1 -- 172.21.15.50:0/4214676960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559bb50c3880 msgr2=0x559bb50bd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:43.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.692+0000 7f56f6d9d700 1 --2- 172.21.15.50:0/4214676960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559bb50c3880 0x559bb50bd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.692+0000 7f56f6d9d700 1 -- 172.21.15.50:0/4214676960 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bb4f5d8d0 con 0x559bb50bd7a0 2024-06-06T03:37:43.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.693+0000 7f56f6d9d700 1 --2- 172.21.15.50:0/4214676960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559bb50bd7a0 0x559bb50bdbc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f56f00cbf70 tx=0x7f56f0096ff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c42636e4c126253d server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:43.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.698+0000 7f56f5d9b700 1 --2- 172.21.15.50:0/1489862896 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f56e00a2e20 0x7f56e00a52e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f56e8000c00 tx=0x7f56e8005c30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:43.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.699+0000 7f56e4ff9700 1 -- 172.21.15.50:0/4214676960 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f009acd0 con 0x559bb50bd7a0 2024-06-06T03:37:43.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.699+0000 7f56e4ff9700 1 -- 172.21.15.50:0/4214676960 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f56f009f080 con 0x559bb50bd7a0 2024-06-06T03:37:43.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.699+0000 7f56e4ff9700 1 -- 172.21.15.50:0/4214676960 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f009b190 con 0x559bb50bd7a0 2024-06-06T03:37:43.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.700+0000 7f57073eeb80 1 -- 172.21.15.50:0/4214676960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559bb50bd7a0 msgr2=0x559bb50bdbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:43.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.700+0000 7f57073eeb80 1 --2- 172.21.15.50:0/4214676960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559bb50bd7a0 0x559bb50bdbc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f56f00cbf70 tx=0x7f56f0096ff0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.700+0000 7f57073eeb80 1 -- 172.21.15.50:0/4214676960 shutdown_connections 2024-06-06T03:37:43.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.700+0000 7f57073eeb80 1 --2- 172.21.15.50:0/4214676960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559bb50bd7a0 0x559bb50bdbc0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.700+0000 7f57073eeb80 1 --2- 172.21.15.50:0/4214676960 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559bb50c2f60 0x559bb50c3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.700+0000 7f57073eeb80 1 --2- 172.21.15.50:0/4214676960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559bb50c3880 0x559bb50bd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.700+0000 7f57073eeb80 1 -- 172.21.15.50:0/4214676960 >> 172.21.15.50:0/4214676960 conn(0x559bb4fea080 msgr2=0x559bb50b8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:43.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.702+0000 7f57073eeb80 1 -- 172.21.15.50:0/4214676960 shutdown_connections 2024-06-06T03:37:43.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.704+0000 7f57073eeb80 1 -- 172.21.15.50:0/4214676960 wait complete. 2024-06-06T03:37:43.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.705+0000 7f57073eeb80 1 -- start start 2024-06-06T03:37:43.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.705+0000 7f57073eeb80 1 Processor -- start 2024-06-06T03:37:43.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.707+0000 7f57073eeb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559bb50bd7a0 0x559bb50c9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:43.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.707+0000 7f57073eeb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559bb50c2f60 0x559bb50c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:43.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.707+0000 7f57073eeb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559bb50c3880 0x559bb50c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:43.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.707+0000 7f57073eeb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559bb4faefc0 con 0x559bb50c2f60 2024-06-06T03:37:43.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.707+0000 7f57073eeb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559bb500a810 con 0x559bb50c3880 2024-06-06T03:37:43.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.707+0000 7f57073eeb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559bb50ca260 con 0x559bb50bd7a0 2024-06-06T03:37:43.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.707+0000 7f57073eeb80 10 client.0 _ll_register_callbacks cb 0x559bb4fa45b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:37:43.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.708+0000 7f56f6d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559bb50c3880 0x559bb50c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:43.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.708+0000 7f56f5d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559bb50c2f60 0x559bb50c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:43.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.708+0000 7f56f5d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559bb50c2f60 0x559bb50c6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43238/0 (socket says 172.21.15.50:43238) 2024-06-06T03:37:43.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.708+0000 7f56f5d9b700 1 -- 172.21.15.50:0/2189458187 learned_addr learned my addr 172.21.15.50:0/2189458187 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:43.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.710+0000 7f56f6d9d700 1 -- 172.21.15.50:0/2189458187 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559bb50bd7a0 msgr2=0x559bb50c9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:43.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.710+0000 7f56f6d9d700 1 --2- 172.21.15.50:0/2189458187 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559bb50bd7a0 0x559bb50c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.710+0000 7f56f6d9d700 1 -- 172.21.15.50:0/2189458187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559bb50c2f60 msgr2=0x559bb50c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:43.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.710+0000 7f56f6d9d700 1 --2- 172.21.15.50:0/2189458187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559bb50c2f60 0x559bb50c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.710+0000 7f56f6d9d700 1 -- 172.21.15.50:0/2189458187 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bb4fd4750 con 0x559bb50c3880 2024-06-06T03:37:43.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.710+0000 7f56f6d9d700 1 --2- 172.21.15.50:0/2189458187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559bb50c3880 0x559bb50c6f40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x559bb50c9ea0 tx=0x7f56f00a39d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87099a78f2d4e809 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:43.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.710+0000 7f56ddffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:37:43.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.710+0000 7f56ddffb700 1 -- 172.21.15.50:0/2189458187 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f00a8060 con 0x559bb50c3880 2024-06-06T03:37:43.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.710+0000 7f56ddffb700 1 -- 172.21.15.50:0/2189458187 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f56f009b130 con 0x559bb50c3880 2024-06-06T03:37:43.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.711+0000 7f57073eeb80 1 -- 172.21.15.50:0/2189458187 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56f009f080 con 0x559bb50c3880 2024-06-06T03:37:43.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.711+0000 7f56ddffb700 1 -- 172.21.15.50:0/2189458187 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f56f00b9070 con 0x559bb50c3880 2024-06-06T03:37:43.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.714+0000 7f57073eeb80 10 client.26510 fetch_fsmap learned FSMap version 36 2024-06-06T03:37:43.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.714+0000 7f57073eeb80 1 -- 172.21.15.50:0/2189458187 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x559bb50d4a90 con 0x559bb50c3880 2024-06-06T03:37:43.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.720+0000 7f56ddffb700 1 -- 172.21.15.50:0/2189458187 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f56f00a34b0 con 0x559bb50c3880 2024-06-06T03:37:43.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.720+0000 7f56ddffb700 1 -- 172.21.15.50:0/2189458187 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7f56f00a3b90 con 0x559bb50c3880 2024-06-06T03:37:43.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.720+0000 7f57073eeb80 10 client.26510 fetch_fsmap finished waiting for FSMap version 36 2024-06-06T03:37:43.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.720+0000 7f57073eeb80 10 client.26510 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:37:43.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.720+0000 7f57073eeb80 20 client.26510 populate_metadata read hostname 'smithi050' 2024-06-06T03:37:43.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.720+0000 7f57073eeb80 1 --2- 172.21.15.50:0/2189458187 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x559bb50d6f60 0x559bb50d9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:43.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.720+0000 7f57073eeb80 4 client.26510 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:37:43.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.720+0000 7f57073eeb80 1 -- 172.21.15.50:0/2189458187 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f56f009f080 con 0x559bb50d6f60 2024-06-06T03:37:43.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.726+0000 7f56f659c700 1 --2- 172.21.15.50:0/2189458187 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x559bb50d6f60 0x559bb50d9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:43.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.734+0000 7f56f659c700 1 --2- 172.21.15.50:0/2189458187 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x559bb50d6f60 0x559bb50d9350 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=750ee075732ac2c8 server_cookie=559e3d1c39049e29 in_seq=0 out_seq=0 2024-06-06T03:37:43.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.734+0000 7f56ddffb700 10 client.26510 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:37:43.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.737+0000 7f56ddffb700 1 -- 172.21.15.50:0/2189458187 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x7f56f009f080 con 0x559bb50d6f60 2024-06-06T03:37:43.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.737+0000 7f56ddffb700 10 client.26510 handle_command_reply: tid=0 2024-06-06T03:37:43.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.737+0000 7f57073eeb80 1 client.26510 shutdown 2024-06-06T03:37:43.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.743+0000 7f57073eeb80 1 -- 172.21.15.50:0/2189458187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559bb50c3880 msgr2=0x559bb50c6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:43.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.743+0000 7f57073eeb80 1 --2- 172.21.15.50:0/2189458187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559bb50c3880 0x559bb50c6f40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x559bb50c9ea0 tx=0x7f56f00a39d0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.743+0000 7f57073eeb80 1 -- 172.21.15.50:0/2189458187 shutdown_connections 2024-06-06T03:37:43.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.743+0000 7f57073eeb80 1 --2- 172.21.15.50:0/2189458187 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x559bb50d6f60 0x559bb50d9350 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.743+0000 7f57073eeb80 1 --2- 172.21.15.50:0/2189458187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559bb50c3880 0x559bb50c6f40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.743+0000 7f57073eeb80 1 --2- 172.21.15.50:0/2189458187 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559bb50bd7a0 0x559bb50c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.743+0000 7f57073eeb80 1 --2- 172.21.15.50:0/2189458187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559bb50c2f60 0x559bb50c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.743+0000 7f57073eeb80 1 -- 172.21.15.50:0/2189458187 >> 172.21.15.50:0/2189458187 conn(0x559bb4fea080 msgr2=0x559bb50b7700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:43.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.744+0000 7f56ddffb700 0 client.26510 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:37:43.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.744+0000 7f57073eeb80 1 -- 172.21.15.50:0/2189458187 shutdown_connections 2024-06-06T03:37:43.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.746+0000 7f57073eeb80 1 -- 172.21.15.50:0/2189458187 wait complete. 2024-06-06T03:37:43.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.746+0000 7f57073eeb80 20 client.26510 trim_cache size 0 max 16384 2024-06-06T03:37:43.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.777+0000 7f57073eeb80 1 Processor -- start 2024-06-06T03:37:43.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.777+0000 7f57073eeb80 1 -- start start 2024-06-06T03:37:43.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.778+0000 7f57073eeb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559bb50bd7a0 0x559bb50c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:43.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.778+0000 7f57073eeb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559bb50c2f60 0x559bb50c1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:43.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.778+0000 7f57073eeb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559bb50c3880 0x559bb50c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:43.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.778+0000 7f57073eeb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f56f81bfb50 con 0x559bb50bd7a0 2024-06-06T03:37:43.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.778+0000 7f57073eeb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f56f81bd3e0 con 0x559bb50c3880 2024-06-06T03:37:43.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.778+0000 7f57073eeb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f56f81bb230 con 0x559bb50c2f60 2024-06-06T03:37:43.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.778+0000 7f56f659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559bb50bd7a0 0x559bb50c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:43.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.778+0000 7f56f659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559bb50bd7a0 0x559bb50c6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43242/0 (socket says 172.21.15.50:43242) 2024-06-06T03:37:43.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.778+0000 7f56f659c700 1 -- 172.21.15.50:0/2715783178 learned_addr learned my addr 172.21.15.50:0/2715783178 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:43.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.779+0000 7f56f5d9b700 1 --2- 172.21.15.50:0/2715783178 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559bb50c2f60 0x559bb50c1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:43.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.780+0000 7f56f6d9d700 1 --2- 172.21.15.50:0/2715783178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559bb50c3880 0x559bb50c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:43.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.781+0000 7f56f5d9b700 1 -- 172.21.15.50:0/2715783178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559bb50c3880 msgr2=0x559bb50c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:43.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.781+0000 7f56f5d9b700 1 --2- 172.21.15.50:0/2715783178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559bb50c3880 0x559bb50c91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.781+0000 7f56f5d9b700 1 -- 172.21.15.50:0/2715783178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559bb50bd7a0 msgr2=0x559bb50c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:43.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.781+0000 7f56f5d9b700 1 --2- 172.21.15.50:0/2715783178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559bb50bd7a0 0x559bb50c6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.781+0000 7f56f5d9b700 1 -- 172.21.15.50:0/2715783178 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bb50c7f10 con 0x559bb50c2f60 2024-06-06T03:37:43.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.790+0000 7f56f5d9b700 1 --2- 172.21.15.50:0/2715783178 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559bb50c2f60 0x559bb50c1060 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x559bb50b92b0 tx=0x7f56e8009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=769e2897b87f45db server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:43.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.790+0000 7f56dffff700 1 -- 172.21.15.50:0/2715783178 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e800b7d0 con 0x559bb50c2f60 2024-06-06T03:37:43.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.791+0000 7f56dffff700 1 -- 172.21.15.50:0/2715783178 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f56e8022040 con 0x559bb50c2f60 2024-06-06T03:37:43.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.792+0000 7f57073eeb80 1 -- 172.21.15.50:0/2715783178 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559bb50c2f60 msgr2=0x559bb50c1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:43.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.792+0000 7f57073eeb80 1 --2- 172.21.15.50:0/2715783178 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559bb50c2f60 0x559bb50c1060 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x559bb50b92b0 tx=0x7f56e8009310 comp rx=0 tx=0).stop 2024-06-06T03:37:43.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.795+0000 7f57073eeb80 1 -- 172.21.15.50:0/2715783178 shutdown_connections 2024-06-06T03:37:43.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.795+0000 7f57073eeb80 1 --2- 172.21.15.50:0/2715783178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559bb50c3880 0x559bb50c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.795+0000 7f57073eeb80 1 --2- 172.21.15.50:0/2715783178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559bb50bd7a0 0x559bb50c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.795+0000 7f57073eeb80 1 --2- 172.21.15.50:0/2715783178 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559bb50c2f60 0x559bb50c1060 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.795+0000 7f57073eeb80 1 -- 172.21.15.50:0/2715783178 >> 172.21.15.50:0/2715783178 conn(0x559bb4fea080 msgr2=0x559bb50c1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:43.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.799+0000 7f57073eeb80 1 -- 172.21.15.50:0/2715783178 shutdown_connections 2024-06-06T03:37:43.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.801+0000 7f57073eeb80 1 -- 172.21.15.50:0/2715783178 wait complete. 2024-06-06T03:37:43.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.801+0000 7f57073eeb80 1 -- start start 2024-06-06T03:37:43.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.801+0000 7f57073eeb80 1 Processor -- start 2024-06-06T03:37:43.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.806+0000 7f57073eeb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559bb50bd7a0 0x559bb50d9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:43.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.806+0000 7f57073eeb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559bb50c2f60 0x559bb50d96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:43.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.806+0000 7f57073eeb80 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559bb50c3880 0x559bb513f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:43.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.806+0000 7f57073eeb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f56f81bb8a0 con 0x559bb50bd7a0 2024-06-06T03:37:43.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.806+0000 7f57073eeb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f56f81bcd10 con 0x559bb50c2f60 2024-06-06T03:37:43.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.806+0000 7f57073eeb80 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f56f81bbf70 con 0x559bb50c3880 2024-06-06T03:37:43.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.806+0000 7f57073eeb80 10 client.0 _ll_register_callbacks cb 0x559bb4fa45b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:37:43.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.811+0000 7f56f6d9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559bb50c3880 0x559bb513f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:43.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.811+0000 7f56f5d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559bb50c2f60 0x559bb50d96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:43.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.811+0000 7f56f6d9d700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559bb50c3880 0x559bb513f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:59692/0 (socket says 172.21.15.50:59692) 2024-06-06T03:37:43.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.811+0000 7f56f6d9d700 1 -- 172.21.15.50:0/4156033739 learned_addr learned my addr 172.21.15.50:0/4156033739 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:43.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.812+0000 7f56f659c700 1 --2- 172.21.15.50:0/4156033739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559bb50bd7a0 0x559bb50d9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:43.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.817+0000 7f56f659c700 1 -- 172.21.15.50:0/4156033739 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559bb50c3880 msgr2=0x559bb513f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:43.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.817+0000 7f56f659c700 1 --2- 172.21.15.50:0/4156033739 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559bb50c3880 0x559bb513f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.817+0000 7f56f659c700 1 -- 172.21.15.50:0/4156033739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559bb50c2f60 msgr2=0x559bb50d96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:43.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.817+0000 7f56f659c700 1 --2- 172.21.15.50:0/4156033739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559bb50c2f60 0x559bb50d96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.817+0000 7f56f659c700 1 -- 172.21.15.50:0/4156033739 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bb513fdd0 con 0x559bb50bd7a0 2024-06-06T03:37:43.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.824+0000 7f56f659c700 1 --2- 172.21.15.50:0/4156033739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559bb50bd7a0 0x559bb50d9190 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0048a0 tx=0x7f56ec009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db37139a8cf72b82 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:43.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.826+0000 7f56ddffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:37:43.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.826+0000 7f56ddffb700 1 -- 172.21.15.50:0/4156033739 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ec023020 con 0x559bb50bd7a0 2024-06-06T03:37:43.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.826+0000 7f57073eeb80 1 -- 172.21.15.50:0/4156033739 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56e8022040 con 0x559bb50bd7a0 2024-06-06T03:37:43.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.826+0000 7f56ddffb700 1 -- 172.21.15.50:0/4156033739 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f56ec017c10 con 0x559bb50bd7a0 2024-06-06T03:37:43.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.826+0000 7f56ddffb700 1 -- 172.21.15.50:0/4156033739 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f56ec02e050 con 0x559bb50bd7a0 2024-06-06T03:37:43.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.830+0000 7f57073eeb80 10 client.16842 fetch_fsmap learned FSMap version 36 2024-06-06T03:37:43.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.830+0000 7f57073eeb80 1 -- 172.21.15.50:0/4156033739 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x559bb5141040 con 0x559bb50bd7a0 2024-06-06T03:37:43.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.832+0000 7f56ddffb700 1 -- 172.21.15.50:0/4156033739 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f56e8022040 con 0x559bb50bd7a0 2024-06-06T03:37:43.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.832+0000 7f56ddffb700 1 -- 172.21.15.50:0/4156033739 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7f56ec015420 con 0x559bb50bd7a0 2024-06-06T03:37:43.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.834+0000 7f57073eeb80 10 client.16842 fetch_fsmap finished waiting for FSMap version 36 2024-06-06T03:37:43.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.834+0000 7f57073eeb80 10 client.16842 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-06T03:37:43.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.834+0000 7f57073eeb80 20 client.16842 populate_metadata read hostname 'smithi050' 2024-06-06T03:37:43.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.834+0000 7f57073eeb80 1 --2- 172.21.15.50:0/4156033739 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x559bb5141730 0x559bb5143b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:43.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.834+0000 7f57073eeb80 4 client.16842 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T03:37:43.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.834+0000 7f57073eeb80 1 -- 172.21.15.50:0/4156033739 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559bb501bd50 con 0x559bb5141730 2024-06-06T03:37:43.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.835+0000 7f56f5d9b700 1 --2- 172.21.15.50:0/4156033739 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x559bb5141730 0x559bb5143b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:43.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.841+0000 7f56f5d9b700 1 --2- 172.21.15.50:0/4156033739 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x559bb5141730 0x559bb5143b50 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dbb3cba483518b0 server_cookie=f2bf1389f23f0f06 in_seq=0 out_seq=0 2024-06-06T03:37:43.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.841+0000 7f56ddffb700 10 client.16842 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:37:43.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.841+0000 7f56ddffb700 1 -- 172.21.15.50:0/4156033739 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559bb501bd50 con 0x559bb5141730 2024-06-06T03:37:43.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.841+0000 7f56ddffb700 10 client.16842 handle_command_reply: tid=0 2024-06-06T03:37:43.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.841+0000 7f57073eeb80 1 client.16842 shutdown 2024-06-06T03:37:43.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.844+0000 7f57073eeb80 1 -- 172.21.15.50:0/4156033739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559bb50bd7a0 msgr2=0x559bb50d9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:43.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.844+0000 7f57073eeb80 1 --2- 172.21.15.50:0/4156033739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559bb50bd7a0 0x559bb50d9190 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0048a0 tx=0x7f56ec009d20 comp rx=0 tx=0).stop 2024-06-06T03:37:43.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.848+0000 7f57073eeb80 1 -- 172.21.15.50:0/4156033739 shutdown_connections 2024-06-06T03:37:43.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.848+0000 7f57073eeb80 1 --2- 172.21.15.50:0/4156033739 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x559bb5141730 0x559bb5143b50 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.848+0000 7f57073eeb80 1 --2- 172.21.15.50:0/4156033739 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559bb50c3880 0x559bb513f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.848+0000 7f57073eeb80 1 --2- 172.21.15.50:0/4156033739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559bb50bd7a0 0x559bb50d9190 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.848+0000 7f57073eeb80 1 --2- 172.21.15.50:0/4156033739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559bb50c2f60 0x559bb50d96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.848+0000 7f57073eeb80 1 -- 172.21.15.50:0/4156033739 >> 172.21.15.50:0/4156033739 conn(0x559bb4fea080 msgr2=0x559bb50c23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.848+0000 7f56ddffb700 0 client.16842 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:37:43.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.851+0000 7f57073eeb80 1 -- 172.21.15.50:0/4156033739 shutdown_connections 2024-06-06T03:37:43.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.852+0000 7f57073eeb80 1 -- 172.21.15.50:0/4156033739 wait complete. 2024-06-06T03:37:43.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.852+0000 7f57073eeb80 20 client.16842 trim_cache size 0 max 16384 2024-06-06T03:37:43.851 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-06-06T03:37:43.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.852+0000 7f56fcb6b700 1 -- 172.21.15.50:0/1489862896 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f56e00a2e20 msgr2=0x7f56e00a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:43.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.853+0000 7f56fcb6b700 1 --2- 172.21.15.50:0/1489862896 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f56e00a2e20 0x7f56e00a52e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f56e8000c00 tx=0x7f56e8005c30 comp rx=0 tx=0).stop 2024-06-06T03:37:43.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.853+0000 7f56fcb6b700 1 -- 172.21.15.50:0/1489862896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56f810eac0 msgr2=0x7f56f807c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:43.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.853+0000 7f56fcb6b700 1 --2- 172.21.15.50:0/1489862896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56f810eac0 0x7f56f807c110 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f56f000bb00 tx=0x7f56f000bec0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.853+0000 7f56fcb6b700 1 -- 172.21.15.50:0/1489862896 shutdown_connections 2024-06-06T03:37:43.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.853+0000 7f56fcb6b700 1 --2- 172.21.15.50:0/1489862896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56f810eac0 0x7f56f807c110 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.853+0000 7f56fcb6b700 1 --2- 172.21.15.50:0/1489862896 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56f8108ac0 0x7f56f8082aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.853+0000 7f56fcb6b700 1 --2- 172.21.15.50:0/1489862896 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f56e00a2e20 0x7f56e00a52e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.853+0000 7f56fcb6b700 1 --2- 172.21.15.50:0/1489862896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56f8109480 0x7f56f807bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:43.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.853+0000 7f56fcb6b700 1 -- 172.21.15.50:0/1489862896 >> 172.21.15.50:0/1489862896 conn(0x7f56f8075c60 msgr2=0x7f56f8076470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:43.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.853+0000 7f56fcb6b700 1 -- 172.21.15.50:0/1489862896 shutdown_connections 2024-06-06T03:37:43.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:37:43.853+0000 7f56fcb6b700 1 -- 172.21.15.50:0/1489862896 wait complete. 2024-06-06T03:37:44.235 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:43 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:37:44.236 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:43 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:37:44.236 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:43 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:37:44.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:43 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:37:44.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:43 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:37:44.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:43 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:37:44.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:43 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:37:44.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:43 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:37:44.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:43 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:37:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.481+0000 7f98e5431640 1 -- 172.21.15.50:0/2273035244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98e0073b50 msgr2=0x7f98e00765e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.481+0000 7f98e5431640 1 --2- 172.21.15.50:0/2273035244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98e0073b50 0x7f98e00765e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f98d400d9f0 tx=0x7f98d402a210 comp rx=0 tx=0).stop 2024-06-06T03:37:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.483+0000 7f98e5431640 1 -- 172.21.15.50:0/2273035244 shutdown_connections 2024-06-06T03:37:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.483+0000 7f98e5431640 1 --2- 172.21.15.50:0/2273035244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98e0073700 0x7f98e00793c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.483+0000 7f98e5431640 1 --2- 172.21.15.50:0/2273035244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98e0079900 0x7f98e007bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.483+0000 7f98e5431640 1 --2- 172.21.15.50:0/2273035244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98e0073b50 0x7f98e00765e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.483+0000 7f98e5431640 1 -- 172.21.15.50:0/2273035244 >> 172.21.15.50:0/2273035244 conn(0x7f98e006e840 msgr2=0x7f98e0070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:44.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.497+0000 7f98e5431640 1 -- 172.21.15.50:0/2273035244 shutdown_connections 2024-06-06T03:37:44.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.498+0000 7f98e5431640 1 -- 172.21.15.50:0/2273035244 wait complete. 2024-06-06T03:37:44.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.498+0000 7f98e5431640 1 Processor -- start 2024-06-06T03:37:44.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.499+0000 7f98e5431640 1 -- start start 2024-06-06T03:37:44.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.499+0000 7f98e5431640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98e0073700 0x7f98e01b80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:44.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.499+0000 7f98e5431640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98e0073b50 0x7f98e01b8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:44.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.499+0000 7f98e5431640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98e0079900 0x7f98e01bef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:44.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.499+0000 7f98e5431640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f98e007ecb0 con 0x7f98e0073700 2024-06-06T03:37:44.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.499+0000 7f98e5431640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f98e007eb30 con 0x7f98e0073b50 2024-06-06T03:37:44.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.499+0000 7f98e5431640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f98e007ee30 con 0x7f98e0079900 2024-06-06T03:37:44.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.499+0000 7f98df7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98e0079900 0x7f98e01bef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:44.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.499+0000 7f98df7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98e0079900 0x7f98e01bef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:59712/0 (socket says 172.21.15.50:59712) 2024-06-06T03:37:44.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.499+0000 7f98df7fe640 1 -- 172.21.15.50:0/3369844528 learned_addr learned my addr 172.21.15.50:0/3369844528 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:44.500 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.501+0000 7f98de7fc640 1 --2- 172.21.15.50:0/3369844528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98e0073b50 0x7f98e01b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:44.500 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.501+0000 7f98deffd640 1 --2- 172.21.15.50:0/3369844528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98e0073700 0x7f98e01b80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.502+0000 7f98df7fe640 1 -- 172.21.15.50:0/3369844528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98e0073b50 msgr2=0x7f98e01b8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.502+0000 7f98df7fe640 1 --2- 172.21.15.50:0/3369844528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98e0073b50 0x7f98e01b8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.502+0000 7f98df7fe640 1 -- 172.21.15.50:0/3369844528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98e0073700 msgr2=0x7f98e01b80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:44.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.502+0000 7f98df7fe640 1 --2- 172.21.15.50:0/3369844528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98e0073700 0x7f98e01b80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.502+0000 7f98df7fe640 1 -- 172.21.15.50:0/3369844528 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98e01bf5c0 con 0x7f98e0079900 2024-06-06T03:37:44.513 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.512+0000 7f98df7fe640 1 --2- 172.21.15.50:0/3369844528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98e0079900 0x7f98e01bef50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f98d0009830 tx=0x7f98d0009cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:44.513 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.515+0000 7f98c7fff640 1 -- 172.21.15.50:0/3369844528 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d000ea60 con 0x7f98e0079900 2024-06-06T03:37:44.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.515+0000 7f98e5431640 1 -- 172.21.15.50:0/3369844528 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98e01bf8b0 con 0x7f98e0079900 2024-06-06T03:37:44.518 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.515+0000 7f98c7fff640 1 -- 172.21.15.50:0/3369844528 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f98d00054d0 con 0x7f98e0079900 2024-06-06T03:37:44.518 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.515+0000 7f98c7fff640 1 -- 172.21.15.50:0/3369844528 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d0004db0 con 0x7f98e0079900 2024-06-06T03:37:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.521+0000 7f98e5431640 1 -- 172.21.15.50:0/3369844528 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98e01bfe80 con 0x7f98e0079900 2024-06-06T03:37:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.531+0000 7f98c7fff640 1 -- 172.21.15.50:0/3369844528 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f98d0004f90 con 0x7f98e0079900 2024-06-06T03:37:44.533 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.534+0000 7f98e821c740 1 Processor -- start 2024-06-06T03:37:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.537+0000 7f98c7fff640 1 --2- 172.21.15.50:0/3369844528 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f98c80a2d90 0x7f98c80a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:44.538 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.538+0000 7f98c7fff640 1 -- 172.21.15.50:0/3369844528 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f98d00cf090 con 0x7f98e0079900 2024-06-06T03:37:44.539 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.540+0000 7f98de7fc640 1 --2- 172.21.15.50:0/3369844528 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f98c80a2d90 0x7f98c80a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.543+0000 7f98e821c740 1 -- start start 2024-06-06T03:37:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.543+0000 7f98e821c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce6d4b61e0 0x55ce6d4b6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.543+0000 7f98e821c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce6d4b6bd0 0x55ce6d4bb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.543+0000 7f98e821c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce6d4bbd40 0x55ce6d4be1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.543+0000 7f98e821c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ce6d4194f0 con 0x55ce6d4b6bd0 2024-06-06T03:37:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.543+0000 7f98e821c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ce6d3b7870 con 0x55ce6d4bbd40 2024-06-06T03:37:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.543+0000 7f98e821c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ce6d4154b0 con 0x55ce6d4b61e0 2024-06-06T03:37:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.545+0000 7f98de7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce6d4b6bd0 0x55ce6d4bb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.545+0000 7f98de7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce6d4b6bd0 0x55ce6d4bb6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43274/0 (socket says 172.21.15.50:43274) 2024-06-06T03:37:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.545+0000 7f98de7fc640 1 -- 172.21.15.50:0/1987962038 learned_addr learned my addr 172.21.15.50:0/1987962038 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.548+0000 7f98deffd640 1 --2- 172.21.15.50:0/1987962038 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce6d4b61e0 0x55ce6d4b6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.548+0000 7f98df7fe640 1 --2- 172.21.15.50:0/1987962038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce6d4bbd40 0x55ce6d4be1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.549+0000 7f98de7fc640 1 -- 172.21.15.50:0/1987962038 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce6d4b61e0 msgr2=0x55ce6d4b6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.549+0000 7f98de7fc640 1 --2- 172.21.15.50:0/1987962038 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce6d4b61e0 0x55ce6d4b6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.550 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.549+0000 7f98de7fc640 1 -- 172.21.15.50:0/1987962038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce6d4bbd40 msgr2=0x55ce6d4be1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:44.550 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.549+0000 7f98de7fc640 1 --2- 172.21.15.50:0/1987962038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce6d4bbd40 0x55ce6d4be1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.550 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.549+0000 7f98de7fc640 1 -- 172.21.15.50:0/1987962038 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce6d3d39b0 con 0x55ce6d4b6bd0 2024-06-06T03:37:44.550 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.549+0000 7f98de7fc640 1 --2- 172.21.15.50:0/3369844528 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f98c80a2d90 0x7f98c80a5250 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f98e0073b20 tx=0x7f98d800c7f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:44.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.556+0000 7f98de7fc640 1 --2- 172.21.15.50:0/1987962038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce6d4b6bd0 0x55ce6d4bb6d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f98d80072f0 tx=0x7f98d801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=595365997f1a4d18 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:44.564 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.563+0000 7f98c57fa640 1 -- 172.21.15.50:0/1987962038 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d801ace0 con 0x55ce6d4b6bd0 2024-06-06T03:37:44.564 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.563+0000 7f98c57fa640 1 -- 172.21.15.50:0/1987962038 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f98d8020070 con 0x55ce6d4b6bd0 2024-06-06T03:37:44.564 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.563+0000 7f98c57fa640 1 -- 172.21.15.50:0/1987962038 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d801b5f0 con 0x55ce6d4b6bd0 2024-06-06T03:37:44.564 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.565+0000 7f98e821c740 1 -- 172.21.15.50:0/1987962038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce6d4b6bd0 msgr2=0x55ce6d4bb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:44.564 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.565+0000 7f98e821c740 1 --2- 172.21.15.50:0/1987962038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce6d4b6bd0 0x55ce6d4bb6d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f98d80072f0 tx=0x7f98d801d000 comp rx=0 tx=0).stop 2024-06-06T03:37:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.570+0000 7f98e821c740 1 -- 172.21.15.50:0/1987962038 shutdown_connections 2024-06-06T03:37:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.570+0000 7f98e821c740 1 --2- 172.21.15.50:0/1987962038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce6d4b6bd0 0x55ce6d4bb6d0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.570+0000 7f98e821c740 1 --2- 172.21.15.50:0/1987962038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce6d4bbd40 0x55ce6d4be1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.570+0000 7f98e821c740 1 --2- 172.21.15.50:0/1987962038 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce6d4b61e0 0x55ce6d4b6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.570+0000 7f98e821c740 1 -- 172.21.15.50:0/1987962038 >> 172.21.15.50:0/1987962038 conn(0x55ce6d4b1850 msgr2=0x55ce6d4b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.575+0000 7f98e821c740 1 -- 172.21.15.50:0/1987962038 shutdown_connections 2024-06-06T03:37:44.574 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.575+0000 7f98e821c740 1 -- 172.21.15.50:0/1987962038 wait complete. 2024-06-06T03:37:44.574 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.575+0000 7f98e821c740 1 -- start start 2024-06-06T03:37:44.574 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.575+0000 7f98e821c740 1 Processor -- start 2024-06-06T03:37:44.575 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.576+0000 7f98e821c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce6d4b61e0 0x55ce6d4c04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:44.575 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.576+0000 7f98e821c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce6d4b6bd0 0x55ce6d4c09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:44.575 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.576+0000 7f98e821c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce6d4bbd40 0x55ce6d4c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:44.575 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.576+0000 7f98e821c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ce6d4becf0 con 0x55ce6d4b61e0 2024-06-06T03:37:44.575 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.576+0000 7f98e821c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ce6d3a2ae0 con 0x55ce6d4bbd40 2024-06-06T03:37:44.575 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.576+0000 7f98e821c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ce6d4bee70 con 0x55ce6d4b6bd0 2024-06-06T03:37:44.575 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.576+0000 7f98e821c740 10 client.0 _ll_register_callbacks cb 0x55ce6d3db9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:37:44.576 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.577+0000 7f98df7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce6d4bbd40 0x55ce6d4c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:44.576 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.577+0000 7f98de7fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce6d4b6bd0 0x55ce6d4c09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:44.576 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.577+0000 7f98df7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce6d4bbd40 0x55ce6d4c7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:59618/0 (socket says 172.21.15.50:59618) 2024-06-06T03:37:44.576 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.577+0000 7f98df7fe640 1 -- 172.21.15.50:0/3556255210 learned_addr learned my addr 172.21.15.50:0/3556255210 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:44.576 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.577+0000 7f98deffd640 1 --2- 172.21.15.50:0/3556255210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce6d4b61e0 0x55ce6d4c04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:44.576 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.577+0000 7f98df7fe640 1 -- 172.21.15.50:0/3556255210 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce6d4b6bd0 msgr2=0x55ce6d4c09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:44.576 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.577+0000 7f98df7fe640 1 --2- 172.21.15.50:0/3556255210 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce6d4b6bd0 0x55ce6d4c09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.576 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.577+0000 7f98df7fe640 1 -- 172.21.15.50:0/3556255210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce6d4b61e0 msgr2=0x55ce6d4c04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:44.576 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.577+0000 7f98df7fe640 1 --2- 172.21.15.50:0/3556255210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce6d4b61e0 0x55ce6d4c04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.576 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.577+0000 7f98df7fe640 1 -- 172.21.15.50:0/3556255210 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce6d12d210 con 0x55ce6d4bbd40 2024-06-06T03:37:44.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.577+0000 7f98df7fe640 1 --2- 172.21.15.50:0/3556255210 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce6d4bbd40 0x55ce6d4c7a30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f98d000e6c0 tx=0x7f98d00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66cf4366c768a0d4 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:44.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.578+0000 7f98c2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-06-06T03:37:44.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.578+0000 7f98c2ff5640 1 -- 172.21.15.50:0/3556255210 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d009f980 con 0x55ce6d4bbd40 2024-06-06T03:37:44.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.579+0000 7f98e821c740 1 -- 172.21.15.50:0/3556255210 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98d8020070 con 0x55ce6d4bbd40 2024-06-06T03:37:44.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.579+0000 7f98c2ff5640 1 -- 172.21.15.50:0/3556255210 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f98d00998d0 con 0x55ce6d4bbd40 2024-06-06T03:37:44.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.579+0000 7f98c2ff5640 1 -- 172.21.15.50:0/3556255210 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f98d004c050 con 0x55ce6d4bbd40 2024-06-06T03:37:44.580 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.581+0000 7f98e821c740 10 client.26528 fetch_fsmap learned FSMap version 36 2024-06-06T03:37:44.580 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.581+0000 7f98e821c740 1 -- 172.21.15.50:0/3556255210 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55ce6d1f9620 con 0x55ce6d4bbd40 2024-06-06T03:37:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.583+0000 7f98c2ff5640 1 -- 172.21.15.50:0/3556255210 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f98d8020070 con 0x55ce6d4bbd40 2024-06-06T03:37:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.583+0000 7f98c2ff5640 1 -- 172.21.15.50:0/3556255210 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7f98d000f040 con 0x55ce6d4bbd40 2024-06-06T03:37:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.583+0000 7f98e821c740 10 client.26528 fetch_fsmap finished waiting for FSMap version 36 2024-06-06T03:37:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.583+0000 7f98e821c740 10 client.26528 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:37:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.583+0000 7f98e821c740 20 client.26528 populate_metadata read hostname 'smithi050' 2024-06-06T03:37:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.583+0000 7f98e821c740 1 --2- 172.21.15.50:0/3556255210 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ce6d4cc680 0x55ce6d4ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.583+0000 7f98e821c740 4 client.26528 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:37:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.583+0000 7f98e821c740 1 -- 172.21.15.50:0/3556255210 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce6d42cf10 con 0x55ce6d4cc680 2024-06-06T03:37:44.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.585+0000 7f98deffd640 1 --2- 172.21.15.50:0/3556255210 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ce6d4cc680 0x55ce6d4ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:44.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.588+0000 7f98deffd640 1 --2- 172.21.15.50:0/3556255210 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ce6d4cc680 0x55ce6d4ceaa0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35491933cf0928f server_cookie=281c22497dae3230 in_seq=0 out_seq=0 2024-06-06T03:37:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.589+0000 7f98c2ff5640 10 client.26528 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:37:44.591 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.592+0000 7f98c2ff5640 1 -- 172.21.15.50:0/3556255210 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55ce6d42cf10 con 0x55ce6d4cc680 2024-06-06T03:37:44.591 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.592+0000 7f98c2ff5640 10 client.26528 handle_command_reply: tid=0 2024-06-06T03:37:44.591 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.593+0000 7f98e821c740 1 client.26528 shutdown 2024-06-06T03:37:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.595+0000 7f98e821c740 1 -- 172.21.15.50:0/3556255210 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce6d4bbd40 msgr2=0x55ce6d4c7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.595+0000 7f98e821c740 1 --2- 172.21.15.50:0/3556255210 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce6d4bbd40 0x55ce6d4c7a30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f98d000e6c0 tx=0x7f98d00046c0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.596+0000 7f98e821c740 1 -- 172.21.15.50:0/3556255210 shutdown_connections 2024-06-06T03:37:44.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.596+0000 7f98e821c740 1 --2- 172.21.15.50:0/3556255210 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce6d4bbd40 0x55ce6d4c7a30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.596+0000 7f98e821c740 1 --2- 172.21.15.50:0/3556255210 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce6d4b6bd0 0x55ce6d4c09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.596+0000 7f98e821c740 1 --2- 172.21.15.50:0/3556255210 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ce6d4cc680 0x55ce6d4ceaa0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.596+0000 7f98e821c740 1 --2- 172.21.15.50:0/3556255210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce6d4b61e0 0x55ce6d4c04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.596+0000 7f98e821c740 1 -- 172.21.15.50:0/3556255210 >> 172.21.15.50:0/3556255210 conn(0x55ce6d4b1850 msgr2=0x55ce6d4b09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:44.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.596+0000 7f98c2ff5640 0 client.26528 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:37:44.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.597+0000 7f98e821c740 1 -- 172.21.15.50:0/3556255210 shutdown_connections 2024-06-06T03:37:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.600+0000 7f98e821c740 1 -- 172.21.15.50:0/3556255210 wait complete. 2024-06-06T03:37:44.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.603+0000 7f98e821c740 20 client.26528 trim_cache size 0 max 16384 2024-06-06T03:37:44.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.664+0000 7f98e821c740 1 Processor -- start 2024-06-06T03:37:44.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.664+0000 7f98e821c740 1 -- start start 2024-06-06T03:37:44.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.665+0000 7f98e821c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce6d4b61e0 0x55ce6d4b7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:44.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.665+0000 7f98e821c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce6d4b6bd0 0x55ce6d4c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.665+0000 7f98deffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce6d4b61e0 0x55ce6d4b7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.665+0000 7f98deffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce6d4b61e0 0x55ce6d4b7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:59738/0 (socket says 172.21.15.50:59738) 2024-06-06T03:37:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.665+0000 7f98deffd640 1 -- 172.21.15.50:0/1219191505 learned_addr learned my addr 172.21.15.50:0/1219191505 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.665+0000 7f98de7fc640 1 --2- 172.21.15.50:0/1219191505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce6d4b6bd0 0x55ce6d4c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.665+0000 7f98e821c740 1 --2- 172.21.15.50:0/1219191505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce6d4bbd40 0x55ce6d4b8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.666+0000 7f98e821c740 1 -- 172.21.15.50:0/1219191505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f98e01ccb50 con 0x55ce6d4bbd40 2024-06-06T03:37:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.666+0000 7f98e821c740 1 -- 172.21.15.50:0/1219191505 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f98e01ca420 con 0x55ce6d4b6bd0 2024-06-06T03:37:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.666+0000 7f98e821c740 1 -- 172.21.15.50:0/1219191505 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f98e01c8270 con 0x55ce6d4b61e0 2024-06-06T03:37:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.666+0000 7f98df7fe640 1 --2- 172.21.15.50:0/1219191505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce6d4bbd40 0x55ce6d4b8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.666+0000 7f98deffd640 1 -- 172.21.15.50:0/1219191505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce6d4b6bd0 msgr2=0x55ce6d4c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.666+0000 7f98deffd640 1 --2- 172.21.15.50:0/1219191505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce6d4b6bd0 0x55ce6d4c79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.666+0000 7f98deffd640 1 -- 172.21.15.50:0/1219191505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce6d4bbd40 msgr2=0x55ce6d4b8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.666+0000 7f98deffd640 1 --2- 172.21.15.50:0/1219191505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce6d4bbd40 0x55ce6d4b8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.666+0000 7f98deffd640 1 -- 172.21.15.50:0/1219191505 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce6d4acf50 con 0x55ce6d4b61e0 2024-06-06T03:37:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.667+0000 7f98deffd640 1 --2- 172.21.15.50:0/1219191505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce6d4b61e0 0x55ce6d4b7e50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f98d402a800 tx=0x7f98d402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3ae7368b580a87 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.667+0000 7f98c4ff9640 1 -- 172.21.15.50:0/1219191505 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d4004100 con 0x55ce6d4b61e0 2024-06-06T03:37:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.667+0000 7f98c4ff9640 1 -- 172.21.15.50:0/1219191505 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f98d404b070 con 0x55ce6d4b61e0 2024-06-06T03:37:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.668+0000 7f98e821c740 1 -- 172.21.15.50:0/1219191505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce6d4b61e0 msgr2=0x55ce6d4b7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.669+0000 7f98e821c740 1 --2- 172.21.15.50:0/1219191505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce6d4b61e0 0x55ce6d4b7e50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f98d402a800 tx=0x7f98d402a210 comp rx=0 tx=0).stop 2024-06-06T03:37:44.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.672+0000 7f98e821c740 1 -- 172.21.15.50:0/1219191505 shutdown_connections 2024-06-06T03:37:44.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.672+0000 7f98e821c740 1 --2- 172.21.15.50:0/1219191505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce6d4bbd40 0x55ce6d4b8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.672+0000 7f98e821c740 1 --2- 172.21.15.50:0/1219191505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce6d4b6bd0 0x55ce6d4c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.672+0000 7f98e821c740 1 --2- 172.21.15.50:0/1219191505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce6d4b61e0 0x55ce6d4b7e50 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.672+0000 7f98e821c740 1 -- 172.21.15.50:0/1219191505 >> 172.21.15.50:0/1219191505 conn(0x55ce6d4b1850 msgr2=0x55ce6d4c04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.679+0000 7f98e821c740 1 -- 172.21.15.50:0/1219191505 shutdown_connections 2024-06-06T03:37:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.679+0000 7f98e821c740 1 -- 172.21.15.50:0/1219191505 wait complete. 2024-06-06T03:37:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.680+0000 7f98e821c740 1 -- start start 2024-06-06T03:37:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.680+0000 7f98e821c740 1 Processor -- start 2024-06-06T03:37:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.680+0000 7f98e821c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce6d4b61e0 0x55ce6d4c4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.681+0000 7f98e821c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce6d4b6bd0 0x55ce6d4c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.681+0000 7f98deffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce6d4b61e0 0x55ce6d4c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.681+0000 7f98deffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce6d4b61e0 0x55ce6d4c4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:59630/0 (socket says 172.21.15.50:59630) 2024-06-06T03:37:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.681+0000 7f98deffd640 1 -- 172.21.15.50:0/375693368 learned_addr learned my addr 172.21.15.50:0/375693368 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.681+0000 7f98de7fc640 1 --2- 172.21.15.50:0/375693368 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce6d4b6bd0 0x55ce6d4c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.681+0000 7f98e821c740 1 --2- 172.21.15.50:0/375693368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce6d4bbd40 0x55ce6d535350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.681+0000 7f98e821c740 1 -- 172.21.15.50:0/375693368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f98e01c88e0 con 0x55ce6d4bbd40 2024-06-06T03:37:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.681+0000 7f98e821c740 1 -- 172.21.15.50:0/375693368 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f98e01c9d50 con 0x55ce6d4b61e0 2024-06-06T03:37:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.681+0000 7f98e821c740 1 -- 172.21.15.50:0/375693368 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f98e01c8fb0 con 0x55ce6d4b6bd0 2024-06-06T03:37:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.682+0000 7f98e821c740 10 client.0 _ll_register_callbacks cb 0x7f98d009b3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:37:44.683 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.683+0000 7f98df7fe640 1 --2- 172.21.15.50:0/375693368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce6d4bbd40 0x55ce6d535350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:44.686 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.687+0000 7f98df7fe640 1 -- 172.21.15.50:0/375693368 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce6d4b6bd0 msgr2=0x55ce6d4c4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:44.686 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.687+0000 7f98df7fe640 1 --2- 172.21.15.50:0/375693368 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce6d4b6bd0 0x55ce6d4c4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.686 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.687+0000 7f98df7fe640 1 -- 172.21.15.50:0/375693368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce6d4b61e0 msgr2=0x55ce6d4c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:44.687 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.687+0000 7f98df7fe640 1 --2- 172.21.15.50:0/375693368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce6d4b61e0 0x55ce6d4c4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.687 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.687+0000 7f98df7fe640 1 -- 172.21.15.50:0/375693368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce6d535890 con 0x55ce6d4bbd40 2024-06-06T03:37:44.691 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.691+0000 7f98df7fe640 1 --2- 172.21.15.50:0/375693368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce6d4bbd40 0x55ce6d535350 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f98d009b560 tx=0x7f98d0005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e0a5d71dd0b20e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:44.694 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.693+0000 7f98c2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:37:44.695 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.695+0000 7f98c2ff5640 1 -- 172.21.15.50:0/375693368 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d0046030 con 0x55ce6d4bbd40 2024-06-06T03:37:44.695 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.695+0000 7f98e821c740 1 -- 172.21.15.50:0/375693368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98d404b070 con 0x55ce6d4bbd40 2024-06-06T03:37:44.695 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.695+0000 7f98c2ff5640 1 -- 172.21.15.50:0/375693368 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f98d0047070 con 0x55ce6d4bbd40 2024-06-06T03:37:44.698 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.700+0000 7f98c2ff5640 1 -- 172.21.15.50:0/375693368 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f98d009b110 con 0x55ce6d4bbd40 2024-06-06T03:37:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.700+0000 7f98e821c740 10 client.16857 fetch_fsmap learned FSMap version 36 2024-06-06T03:37:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.700+0000 7f98e821c740 1 -- 172.21.15.50:0/375693368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55ce6d536b50 con 0x55ce6d4bbd40 2024-06-06T03:37:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.701+0000 7f98c2ff5640 1 -- 172.21.15.50:0/375693368 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f98d404b070 con 0x55ce6d4bbd40 2024-06-06T03:37:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.701+0000 7f98c2ff5640 1 -- 172.21.15.50:0/375693368 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7f98d004f030 con 0x55ce6d4bbd40 2024-06-06T03:37:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.701+0000 7f98e821c740 10 client.16857 fetch_fsmap finished waiting for FSMap version 36 2024-06-06T03:37:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.702+0000 7f98e821c740 10 client.16857 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:37:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.702+0000 7f98e821c740 20 client.16857 populate_metadata read hostname 'smithi050' 2024-06-06T03:37:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.702+0000 7f98e821c740 1 --2- 172.21.15.50:0/375693368 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ce6d5373f0 0x55ce6d539810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.702+0000 7f98e821c740 4 client.16857 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:37:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.702+0000 7f98e821c740 1 -- 172.21.15.50:0/375693368 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ce6d426c20 con 0x55ce6d5373f0 2024-06-06T03:37:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.703+0000 7f98deffd640 1 --2- 172.21.15.50:0/375693368 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ce6d5373f0 0x55ce6d539810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:44.706 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.705+0000 7f98deffd640 1 --2- 172.21.15.50:0/375693368 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ce6d5373f0 0x55ce6d539810 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=471c2b7a78659073 server_cookie=6a6db1cf65b449e5 in_seq=0 out_seq=0 2024-06-06T03:37:44.707 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.708+0000 7f98c2ff5640 10 client.16857 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:37:44.707 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.708+0000 7f98c2ff5640 1 -- 172.21.15.50:0/375693368 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55ce6d426c20 con 0x55ce6d5373f0 2024-06-06T03:37:44.707 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.709+0000 7f98c2ff5640 10 client.16857 handle_command_reply: tid=0 2024-06-06T03:37:44.708 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.709+0000 7f98e821c740 1 client.16857 shutdown 2024-06-06T03:37:44.709 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.710+0000 7f98e821c740 1 -- 172.21.15.50:0/375693368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce6d4bbd40 msgr2=0x55ce6d535350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:44.709 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.710+0000 7f98e821c740 1 --2- 172.21.15.50:0/375693368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce6d4bbd40 0x55ce6d535350 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f98d009b560 tx=0x7f98d0005770 comp rx=0 tx=0).stop 2024-06-06T03:37:44.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.714+0000 7f98e821c740 1 -- 172.21.15.50:0/375693368 shutdown_connections 2024-06-06T03:37:44.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.714+0000 7f98e821c740 1 --2- 172.21.15.50:0/375693368 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x55ce6d5373f0 0x55ce6d539810 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.714+0000 7f98e821c740 1 --2- 172.21.15.50:0/375693368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce6d4bbd40 0x55ce6d535350 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.714+0000 7f98e821c740 1 --2- 172.21.15.50:0/375693368 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce6d4b6bd0 0x55ce6d4c4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.714+0000 7f98e821c740 1 --2- 172.21.15.50:0/375693368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce6d4b61e0 0x55ce6d4c4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.714+0000 7f98e821c740 1 -- 172.21.15.50:0/375693368 >> 172.21.15.50:0/375693368 conn(0x55ce6d4b1850 msgr2=0x55ce6d4c04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:44.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.714+0000 7f98c2ff5640 0 client.16857 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:37:44.719 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.720+0000 7f98e821c740 1 -- 172.21.15.50:0/375693368 shutdown_connections 2024-06-06T03:37:44.719 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.720+0000 7f98e821c740 1 -- 172.21.15.50:0/375693368 wait complete. 2024-06-06T03:37:44.726 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.727+0000 7f98e821c740 20 client.16857 trim_cache size 0 max 16384 2024-06-06T03:37:44.728 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:37:44.728 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:37:44.729 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:37:44.733 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.734+0000 7f98e5431640 1 -- 172.21.15.50:0/3369844528 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f98c80a2d90 msgr2=0x7f98c80a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:44.733 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.734+0000 7f98e5431640 1 --2- 172.21.15.50:0/3369844528 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f98c80a2d90 0x7f98c80a5250 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f98e0073b20 tx=0x7f98d800c7f0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.733 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.734+0000 7f98e5431640 1 -- 172.21.15.50:0/3369844528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98e0079900 msgr2=0x7f98e01bef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:44.733 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.734+0000 7f98e5431640 1 --2- 172.21.15.50:0/3369844528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98e0079900 0x7f98e01bef50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f98d0009830 tx=0x7f98d0009cf0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.739 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.740+0000 7f98e5431640 1 -- 172.21.15.50:0/3369844528 shutdown_connections 2024-06-06T03:37:44.739 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.740+0000 7f98e5431640 1 --2- 172.21.15.50:0/3369844528 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f98c80a2d90 0x7f98c80a5250 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.739 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.740+0000 7f98e5431640 1 --2- 172.21.15.50:0/3369844528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98e0079900 0x7f98e01bef50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.739 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.740+0000 7f98e5431640 1 --2- 172.21.15.50:0/3369844528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98e0073b50 0x7f98e01b8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.739 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.740+0000 7f98e5431640 1 --2- 172.21.15.50:0/3369844528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98e0073700 0x7f98e01b80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:44.740 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.740+0000 7f98e5431640 1 -- 172.21.15.50:0/3369844528 >> 172.21.15.50:0/3369844528 conn(0x7f98e006e840 msgr2=0x7f98e00773b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:44.741 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.742+0000 7f98e5431640 1 -- 172.21.15.50:0/3369844528 shutdown_connections 2024-06-06T03:37:44.742 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:44.743+0000 7f98e5431640 1 -- 172.21.15.50:0/3369844528 wait complete. 2024-06-06T03:37:44.778 ERROR:tasks.fwd_scrub:rank 1 damaged: [{'damage_type': 'backtrace', 'id': 369173124, 'ino': 1099511628302, 'path': '/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95184.io'}, {'damage_type': 'backtrace', 'id': 653695372, 'ino': 1099511627783, 'path': '/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0.tar'}, {'damage_type': 'backtrace', 'id': 1017727503, 'ino': 1099511628293, 'path': '/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/README'}, {'damage_type': 'backtrace', 'id': 1039042855, 'ino': 1099511628296, 'path': '/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen'}, {'damage_type': 'backtrace', 'id': 1180448874, 'ino': 1099511628307, 'path': '/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95184.res'}, {'damage_type': 'backtrace', 'id': 1736509767, 'ino': 1099511628306, 'path': '/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95182.res'}, {'damage_type': 'backtrace', 'id': 1892909590, 'ino': 1099511628294, 'path': '/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/Makefile.bsd'}, {'damage_type': 'backtrace', 'id': 2219615322, 'ino': 1099511628290, 'path': '/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/src'}, {'damage_type': 'backtrace', 'id': 2322006077, 'ino': 1099511628297, 'path': '/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen.cat8'}, {'damage_type': 'backtrace', 'id': 2679280691, 'ino': 1099511628304, 'path': '/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95181.res'}, {'damage_type': 'backtrace', 'id': 2689700715, 'ino': 1099511628301, 'path': '/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95182.io'}, {'damage_type': 'backtrace', 'id': 2865347978, 'ino': 1099511628289, 'path': '/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0'}, {'damage_type': 'backtrace', 'id': 3136187709, 'ino': 1099511628295, 'path': '/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/Makefile'}, {'damage_type': 'backtrace', 'id': 3503216772, 'ino': 1099511628300, 'path': '/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95183.io'}, {'damage_type': 'backtrace', 'id': 3769103224, 'ino': 1099511628299, 'path': '/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95181.io'}, {'damage_type': 'backtrace', 'id': 3947071276, 'ino': 1099511628303, 'path': '/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95180.res'}, {'damage_type': 'backtrace', 'id': 4234242386, 'ino': 1099511628305, 'path': '/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95183.res'}, {'damage_type': 'backtrace', 'id': 4278625432, 'ino': 1099511628298, 'path': '/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0/iogen_95180.io'}] 2024-06-06T03:37:44.778 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_3d746ca5346f34eef7e826a1eb71e59e02b682ae/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_3d746ca5346f34eef7e826a1eb71e59e02b682ae/qa/tasks/fwd_scrub.py", line 48, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph_3d746ca5346f34eef7e826a1eb71e59e02b682ae/qa/tasks/fwd_scrub.py", line 70, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph_3d746ca5346f34eef7e826a1eb71e59e02b682ae/qa/tasks/fwd_scrub.py", line 81, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2024-06-06T03:37:44.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:44 smithi050 ceph-mon[32421]: pgmap v764: 129 pgs: 129 active+clean; 10 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 29 MiB/s wr, 553 op/s 2024-06-06T03:37:45.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:44 smithi079 ceph-mon[35478]: pgmap v764: 129 pgs: 129 active+clean; 10 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 29 MiB/s wr, 553 op/s 2024-06-06T03:37:45.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:44 smithi122 ceph-mon[35759]: pgmap v764: 129 pgs: 129 active+clean; 10 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 29 MiB/s wr, 553 op/s 2024-06-06T03:37:47.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:46 smithi050 ceph-mon[32421]: pgmap v765: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 33 MiB/s wr, 640 op/s 2024-06-06T03:37:47.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:46 smithi079 ceph-mon[35478]: pgmap v765: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 33 MiB/s wr, 640 op/s 2024-06-06T03:37:47.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:46 smithi122 ceph-mon[35759]: pgmap v765: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 33 MiB/s wr, 640 op/s 2024-06-06T03:37:49.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:48 smithi050 ceph-mon[32421]: pgmap v766: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 28 MiB/s wr, 530 op/s 2024-06-06T03:37:49.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:48 smithi079 ceph-mon[35478]: pgmap v766: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 28 MiB/s wr, 530 op/s 2024-06-06T03:37:49.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:48 smithi122 ceph-mon[35759]: pgmap v766: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 28 MiB/s wr, 530 op/s 2024-06-06T03:37:51.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:50 smithi050 ceph-mon[32421]: pgmap v767: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 34 MiB/s wr, 653 op/s 2024-06-06T03:37:51.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:50 smithi079 ceph-mon[35478]: pgmap v767: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 34 MiB/s wr, 653 op/s 2024-06-06T03:37:51.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:50 smithi122 ceph-mon[35759]: pgmap v767: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 34 MiB/s wr, 653 op/s 2024-06-06T03:37:53.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:52 smithi050 ceph-mon[32421]: pgmap v768: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 30 MiB/s wr, 579 op/s 2024-06-06T03:37:53.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:52 smithi079 ceph-mon[35478]: pgmap v768: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 30 MiB/s wr, 579 op/s 2024-06-06T03:37:53.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:52 smithi122 ceph-mon[35759]: pgmap v768: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 30 MiB/s wr, 579 op/s 2024-06-06T03:37:55.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:54 smithi050 ceph-mon[32421]: pgmap v769: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 29 MiB/s wr, 553 op/s 2024-06-06T03:37:55.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:54 smithi079 ceph-mon[35478]: pgmap v769: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 29 MiB/s wr, 553 op/s 2024-06-06T03:37:55.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:54 smithi122 ceph-mon[35759]: pgmap v769: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 29 MiB/s wr, 553 op/s 2024-06-06T03:37:57.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:56 smithi050 ceph-mon[32421]: pgmap v770: 129 pgs: 129 active+clean; 10 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 34 MiB/s wr, 648 op/s 2024-06-06T03:37:57.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:56 smithi079 ceph-mon[35478]: pgmap v770: 129 pgs: 129 active+clean; 10 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 34 MiB/s wr, 648 op/s 2024-06-06T03:37:57.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:56 smithi122 ceph-mon[35759]: pgmap v770: 129 pgs: 129 active+clean; 10 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 34 MiB/s wr, 648 op/s 2024-06-06T03:37:58.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.047+0000 7fead6ae0640 1 -- 172.21.15.50:0/127157473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fead0107e50 msgr2=0x7fead0108270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:58.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.047+0000 7fead6ae0640 1 --2- 172.21.15.50:0/127157473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fead0107e50 0x7fead0108270 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7feac401a910 tx=0x7feac403b450 comp rx=0 tx=0).stop 2024-06-06T03:37:58.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.047+0000 7fead6ae0640 1 -- 172.21.15.50:0/127157473 shutdown_connections 2024-06-06T03:37:58.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.047+0000 7fead6ae0640 1 --2- 172.21.15.50:0/127157473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fead0109960 0x7fead0110280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:58.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.047+0000 7fead6ae0640 1 --2- 172.21.15.50:0/127157473 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fead0108fa0 0x7fead0109420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:58.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.047+0000 7fead6ae0640 1 --2- 172.21.15.50:0/127157473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fead0107e50 0x7fead0108270 secure :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7feac401a910 tx=0x7feac403b450 comp rx=0 tx=0).stop 2024-06-06T03:37:58.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.047+0000 7fead6ae0640 1 -- 172.21.15.50:0/127157473 >> 172.21.15.50:0/127157473 conn(0x7fead0076e30 msgr2=0x7fead0079250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:58.063 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.054+0000 7fead6ae0640 1 -- 172.21.15.50:0/127157473 shutdown_connections 2024-06-06T03:37:58.063 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.058+0000 7fead6ae0640 1 -- 172.21.15.50:0/127157473 wait complete. 2024-06-06T03:37:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.058+0000 7fead6ae0640 1 Processor -- start 2024-06-06T03:37:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.058+0000 7fead6ae0640 1 -- start start 2024-06-06T03:37:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.059+0000 7fead6ae0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fead0108fa0 0x7fead007a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.059+0000 7fead6ae0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fead0109960 0x7fead007a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.059+0000 7fead6ae0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fead007f610 0x7fead0081ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.059+0000 7fead6ae0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fead006df10 con 0x7fead0109960 2024-06-06T03:37:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.059+0000 7fead6ae0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fead006dd90 con 0x7fead0108fa0 2024-06-06T03:37:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.059+0000 7fead6ae0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fead006e090 con 0x7fead007f610 2024-06-06T03:37:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.059+0000 7fead62df640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fead007f610 0x7fead0081ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.059+0000 7fead62df640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fead007f610 0x7fead0081ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.50:47958/0 (socket says 172.21.15.50:47958) 2024-06-06T03:37:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.059+0000 7fead62df640 1 -- 172.21.15.50:0/3291667343 learned_addr learned my addr 172.21.15.50:0/3291667343 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.059+0000 7fead5ade640 1 --2- 172.21.15.50:0/3291667343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fead0108fa0 0x7fead007a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.059+0000 7fead62df640 1 -- 172.21.15.50:0/3291667343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fead0108fa0 msgr2=0x7fead007a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.059+0000 7fead62df640 1 --2- 172.21.15.50:0/3291667343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fead0108fa0 0x7fead007a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.059+0000 7fead62df640 1 -- 172.21.15.50:0/3291667343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fead0109960 msgr2=0x7fead007a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.059+0000 7fead62df640 1 --2- 172.21.15.50:0/3291667343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fead0109960 0x7fead007a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.059+0000 7fead62df640 1 -- 172.21.15.50:0/3291667343 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead0082090 con 0x7fead007f610 2024-06-06T03:37:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.060+0000 7fead62df640 1 --2- 172.21.15.50:0/3291667343 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fead007f610 0x7fead0081ad0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7feac800b970 tx=0x7feac800be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.062+0000 7feac2ffd640 1 -- 172.21.15.50:0/3291667343 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac8019070 con 0x7fead007f610 2024-06-06T03:37:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.063+0000 7feac2ffd640 1 -- 172.21.15.50:0/3291667343 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feac8014440 con 0x7fead007f610 2024-06-06T03:37:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.063+0000 7feac2ffd640 1 -- 172.21.15.50:0/3291667343 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac80075b0 con 0x7fead007f610 2024-06-06T03:37:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.066+0000 7fead6ae0640 1 -- 172.21.15.50:0/3291667343 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fead0082320 con 0x7fead007f610 2024-06-06T03:37:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.066+0000 7fead6ae0640 1 -- 172.21.15.50:0/3291667343 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fead01b7c20 con 0x7fead007f610 2024-06-06T03:37:58.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.078+0000 7feadaa54740 1 Processor -- start 2024-06-06T03:37:58.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.080+0000 7feac2ffd640 1 -- 172.21.15.50:0/3291667343 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7feac801c070 con 0x7fead007f610 2024-06-06T03:37:58.081 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.081+0000 7feac2ffd640 1 --2- 172.21.15.50:0/3291667343 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7feabc0a2d90 0x7feabc0a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:58.081 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.081+0000 7feac2ffd640 1 -- 172.21.15.50:0/3291667343 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7feac80cf880 con 0x7fead007f610 2024-06-06T03:37:58.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.083+0000 7fead52dd640 1 --2- 172.21.15.50:0/3291667343 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7feabc0a2d90 0x7feabc0a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:58.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.083+0000 7feadaa54740 1 -- start start 2024-06-06T03:37:58.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.083+0000 7feadaa54740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620511ab1e0 0x5620511ab600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:58.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.083+0000 7feadaa54740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620511abbd0 0x5620511b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:58.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.083+0000 7feadaa54740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620511b0d40 0x5620511b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:58.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.083+0000 7feadaa54740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56205110e4f0 con 0x5620511ab1e0 2024-06-06T03:37:58.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.083+0000 7feadaa54740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5620510ac870 con 0x5620511abbd0 2024-06-06T03:37:58.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.083+0000 7feadaa54740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56205110a4b0 con 0x5620511b0d40 2024-06-06T03:37:58.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.084+0000 7fead5ade640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620511ab1e0 0x5620511ab600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:58.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.084+0000 7fead5ade640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620511ab1e0 0x5620511ab600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38578/0 (socket says 172.21.15.50:38578) 2024-06-06T03:37:58.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.084+0000 7fead5ade640 1 -- 172.21.15.50:0/1055038700 learned_addr learned my addr 172.21.15.50:0/1055038700 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:58.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.084+0000 7fead5ade640 1 -- 172.21.15.50:0/1055038700 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620511b0d40 msgr2=0x5620511b31d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:37:58.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.084+0000 7fead5ade640 1 --2- 172.21.15.50:0/1055038700 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620511b0d40 0x5620511b31d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:58.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.084+0000 7fead5ade640 1 -- 172.21.15.50:0/1055038700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620511abbd0 msgr2=0x5620511b06d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:37:58.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.084+0000 7fead5ade640 1 --2- 172.21.15.50:0/1055038700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620511abbd0 0x5620511b06d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:58.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.084+0000 7fead5ade640 1 -- 172.21.15.50:0/1055038700 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620510c89b0 con 0x5620511ab1e0 2024-06-06T03:37:58.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.085+0000 7fead5ade640 1 --2- 172.21.15.50:0/1055038700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620511ab1e0 0x5620511ab600 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fead007a1c0 tx=0x7feac4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d0d4998b294f15 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:58.089 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.089+0000 7fead52dd640 1 --2- 172.21.15.50:0/3291667343 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7feabc0a2d90 0x7feabc0a5250 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7feacc005fd0 tx=0x7feacc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:58.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.091+0000 7feabbfff640 1 -- 172.21.15.50:0/1055038700 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac4046030 con 0x5620511ab1e0 2024-06-06T03:37:58.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.091+0000 7feabbfff640 1 -- 172.21.15.50:0/1055038700 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feac4004a70 con 0x5620511ab1e0 2024-06-06T03:37:58.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.091+0000 7feabbfff640 1 -- 172.21.15.50:0/1055038700 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac4040aa0 con 0x5620511ab1e0 2024-06-06T03:37:58.095 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.095+0000 7feadaa54740 1 -- 172.21.15.50:0/1055038700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620511ab1e0 msgr2=0x5620511ab600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:58.095 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.095+0000 7feadaa54740 1 --2- 172.21.15.50:0/1055038700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620511ab1e0 0x5620511ab600 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fead007a1c0 tx=0x7feac4000bc0 comp rx=0 tx=0).stop 2024-06-06T03:37:58.102 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.102+0000 7feadaa54740 1 -- 172.21.15.50:0/1055038700 shutdown_connections 2024-06-06T03:37:58.102 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.102+0000 7feadaa54740 1 --2- 172.21.15.50:0/1055038700 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620511b0d40 0x5620511b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:58.102 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.102+0000 7feadaa54740 1 --2- 172.21.15.50:0/1055038700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620511abbd0 0x5620511b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:58.102 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.102+0000 7feadaa54740 1 --2- 172.21.15.50:0/1055038700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620511ab1e0 0x5620511ab600 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:58.102 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.102+0000 7feadaa54740 1 -- 172.21.15.50:0/1055038700 >> 172.21.15.50:0/1055038700 conn(0x5620511a6850 msgr2=0x5620511a6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:58.104 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.105+0000 7feadaa54740 1 -- 172.21.15.50:0/1055038700 shutdown_connections 2024-06-06T03:37:58.107 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.106+0000 7feadaa54740 1 -- 172.21.15.50:0/1055038700 wait complete. 2024-06-06T03:37:58.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.107+0000 7feadaa54740 1 -- start start 2024-06-06T03:37:58.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.107+0000 7feadaa54740 1 Processor -- start 2024-06-06T03:37:58.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.107+0000 7feadaa54740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620511ab1e0 0x5620511b5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:58.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.107+0000 7feadaa54740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620511abbd0 0x5620511b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:58.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.107+0000 7feadaa54740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620511b0d40 0x5620511bca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:58.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.107+0000 7feadaa54740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5620511b3c90 con 0x5620511b0d40 2024-06-06T03:37:58.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.107+0000 7feadaa54740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562051097ae0 con 0x5620511abbd0 2024-06-06T03:37:58.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.107+0000 7feadaa54740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5620511b3e10 con 0x5620511ab1e0 2024-06-06T03:37:58.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.107+0000 7feadaa54740 10 client.0 _ll_register_callbacks cb 0x5620510d09b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:37:58.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.108+0000 7fead62df640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620511b0d40 0x5620511bca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:58.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.108+0000 7fead62df640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620511b0d40 0x5620511bca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38582/0 (socket says 172.21.15.50:38582) 2024-06-06T03:37:58.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.108+0000 7fead62df640 1 -- 172.21.15.50:0/2284283494 learned_addr learned my addr 172.21.15.50:0/2284283494 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:58.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.108+0000 7fead5ade640 1 --2- 172.21.15.50:0/2284283494 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620511ab1e0 0x5620511b5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:58.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.108+0000 7fead52dd640 1 --2- 172.21.15.50:0/2284283494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620511abbd0 0x5620511b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:58.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.108+0000 7fead62df640 1 -- 172.21.15.50:0/2284283494 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620511ab1e0 msgr2=0x5620511b5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:58.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.108+0000 7fead62df640 1 --2- 172.21.15.50:0/2284283494 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620511ab1e0 0x5620511b5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:58.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.108+0000 7fead62df640 1 -- 172.21.15.50:0/2284283494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620511abbd0 msgr2=0x5620511b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:58.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.108+0000 7fead62df640 1 --2- 172.21.15.50:0/2284283494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620511abbd0 0x5620511b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:58.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.108+0000 7fead62df640 1 -- 172.21.15.50:0/2284283494 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562050e22210 con 0x5620511b0d40 2024-06-06T03:37:58.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.109+0000 7fead62df640 1 --2- 172.21.15.50:0/2284283494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620511b0d40 0x5620511bca10 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7feac8014e10 tx=0x7feac809be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8aef6758ae9d21 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:58.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.110+0000 7feab97fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:37:58.113 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.110+0000 7feab97fa640 1 -- 172.21.15.50:0/2284283494 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac80a46e0 con 0x5620511b0d40 2024-06-06T03:37:58.113 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.110+0000 7feab97fa640 1 -- 172.21.15.50:0/2284283494 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7feac800cb90 con 0x5620511b0d40 2024-06-06T03:37:58.113 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.113+0000 7feadaa54740 1 -- 172.21.15.50:0/2284283494 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feac4004a70 con 0x5620511b0d40 2024-06-06T03:37:58.116 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.116+0000 7feab97fa640 1 -- 172.21.15.50:0/2284283494 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7feac800cd90 con 0x5620511b0d40 2024-06-06T03:37:58.116 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.116+0000 7feadaa54740 10 client.16863 fetch_fsmap learned FSMap version 36 2024-06-06T03:37:58.116 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.116+0000 7feadaa54740 1 -- 172.21.15.50:0/2284283494 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x562050eee620 con 0x5620511b0d40 2024-06-06T03:37:58.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.127+0000 7feab97fa640 1 -- 172.21.15.50:0/2284283494 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feac4004a70 con 0x5620511b0d40 2024-06-06T03:37:58.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.127+0000 7feab97fa640 1 -- 172.21.15.50:0/2284283494 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7feac809ac70 con 0x5620511b0d40 2024-06-06T03:37:58.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.127+0000 7feadaa54740 10 client.16863 fetch_fsmap finished waiting for FSMap version 36 2024-06-06T03:37:58.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.127+0000 7feadaa54740 10 client.16863 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:37:58.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.127+0000 7feadaa54740 20 client.16863 populate_metadata read hostname 'smithi050' 2024-06-06T03:37:58.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.127+0000 7feadaa54740 1 --2- 172.21.15.50:0/2284283494 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5620511c1860 0x5620511c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:58.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.127+0000 7feadaa54740 4 client.16863 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T03:37:58.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.127+0000 7feadaa54740 1 -- 172.21.15.50:0/2284283494 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562051121f10 con 0x5620511c1860 2024-06-06T03:37:58.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.128+0000 7fead5ade640 1 --2- 172.21.15.50:0/2284283494 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5620511c1860 0x5620511c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:58.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.128+0000 7feab97fa640 10 client.16863 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:37:58.129 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.129+0000 7fead5ade640 1 --2- 172.21.15.50:0/2284283494 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5620511c1860 0x5620511c3ca0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cc60019e34a1727 server_cookie=97fdd0e7514740de in_seq=0 out_seq=0 2024-06-06T03:37:58.134 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.135+0000 7feab97fa640 1 -- 172.21.15.50:0/2284283494 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x562051121f10 con 0x5620511c1860 2024-06-06T03:37:58.135 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.135+0000 7feab97fa640 10 client.16863 handle_command_reply: tid=0 2024-06-06T03:37:58.135 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.135+0000 7feadaa54740 1 client.16863 shutdown 2024-06-06T03:37:58.139 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.139+0000 7feadaa54740 1 -- 172.21.15.50:0/2284283494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620511b0d40 msgr2=0x5620511bca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:58.139 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.139+0000 7feadaa54740 1 --2- 172.21.15.50:0/2284283494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620511b0d40 0x5620511bca10 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7feac8014e10 tx=0x7feac809be70 comp rx=0 tx=0).stop 2024-06-06T03:37:58.143 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.144+0000 7feadaa54740 1 -- 172.21.15.50:0/2284283494 shutdown_connections 2024-06-06T03:37:58.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.144+0000 7feadaa54740 1 --2- 172.21.15.50:0/2284283494 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x5620511c1860 0x5620511c3ca0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:58.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.144+0000 7feadaa54740 1 --2- 172.21.15.50:0/2284283494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620511b0d40 0x5620511bca10 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:58.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.144+0000 7feadaa54740 1 --2- 172.21.15.50:0/2284283494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620511abbd0 0x5620511b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:58.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.144+0000 7feadaa54740 1 --2- 172.21.15.50:0/2284283494 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620511ab1e0 0x5620511b5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:58.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.144+0000 7feadaa54740 1 -- 172.21.15.50:0/2284283494 >> 172.21.15.50:0/2284283494 conn(0x5620511a6850 msgr2=0x5620511a59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:58.146 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.147+0000 7feab97fa640 0 client.16863 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:37:58.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.152+0000 7feadaa54740 1 -- 172.21.15.50:0/2284283494 shutdown_connections 2024-06-06T03:37:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.156+0000 7feadaa54740 1 -- 172.21.15.50:0/2284283494 wait complete. 2024-06-06T03:37:58.157 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.157+0000 7feadaa54740 20 client.16863 trim_cache size 0 max 16384 2024-06-06T03:37:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.225+0000 7feadaa54740 1 Processor -- start 2024-06-06T03:37:58.226 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.225+0000 7feadaa54740 1 -- start start 2024-06-06T03:37:58.226 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.225+0000 7feadaa54740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620511ab1e0 0x5620511b5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:58.226 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.225+0000 7feadaa54740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620511abbd0 0x5620511b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:58.226 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.225+0000 7feadaa54740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620511b0d40 0x5620511bc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:58.228 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.225+0000 7feadaa54740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7feab40124e0 con 0x5620511b0d40 2024-06-06T03:37:58.228 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.225+0000 7feadaa54740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7feab400fdb0 con 0x5620511abbd0 2024-06-06T03:37:58.228 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.225+0000 7feadaa54740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7feab400dc00 con 0x5620511ab1e0 2024-06-06T03:37:58.229 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.225+0000 7fead52dd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620511abbd0 0x5620511b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:58.229 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.225+0000 7fead52dd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620511abbd0 0x5620511b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.50:50834/0 (socket says 172.21.15.50:50834) 2024-06-06T03:37:58.229 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.225+0000 7fead52dd640 1 -- 172.21.15.50:0/2075104253 learned_addr learned my addr 172.21.15.50:0/2075104253 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:58.229 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.226+0000 7fead5ade640 1 --2- 172.21.15.50:0/2075104253 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620511ab1e0 0x5620511b5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:58.229 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.229+0000 7fead62df640 1 --2- 172.21.15.50:0/2075104253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620511b0d40 0x5620511bc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:58.232 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.229+0000 7fead52dd640 1 -- 172.21.15.50:0/2075104253 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620511ab1e0 msgr2=0x5620511b5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:58.232 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.229+0000 7fead52dd640 1 --2- 172.21.15.50:0/2075104253 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620511ab1e0 0x5620511b5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:58.233 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.229+0000 7fead52dd640 1 -- 172.21.15.50:0/2075104253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620511b0d40 msgr2=0x5620511bc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T03:37:58.233 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.229+0000 7fead52dd640 1 --2- 172.21.15.50:0/2075104253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620511b0d40 0x5620511bc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:58.233 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.229+0000 7fead52dd640 1 -- 172.21.15.50:0/2075104253 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620511a6680 con 0x5620511abbd0 2024-06-06T03:37:58.233 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.230+0000 7fead52dd640 1 --2- 172.21.15.50:0/2075104253 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620511abbd0 0x5620511b59d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fead007b580 tx=0x7feacc010000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8acc2f131b1eae68 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:58.236 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.236+0000 7feabb7fe640 1 -- 172.21.15.50:0/2075104253 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feacc023030 con 0x5620511abbd0 2024-06-06T03:37:58.236 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.236+0000 7feabb7fe640 1 -- 172.21.15.50:0/2075104253 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feacc017070 con 0x5620511abbd0 2024-06-06T03:37:58.236 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.236+0000 7feabb7fe640 1 -- 172.21.15.50:0/2075104253 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feacc01e640 con 0x5620511abbd0 2024-06-06T03:37:58.238 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.238+0000 7feadaa54740 1 -- 172.21.15.50:0/2075104253 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620511abbd0 msgr2=0x5620511b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:58.238 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.238+0000 7feadaa54740 1 --2- 172.21.15.50:0/2075104253 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620511abbd0 0x5620511b59d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fead007b580 tx=0x7feacc010000 comp rx=0 tx=0).stop 2024-06-06T03:37:58.243 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.243+0000 7feadaa54740 1 -- 172.21.15.50:0/2075104253 shutdown_connections 2024-06-06T03:37:58.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.243+0000 7feadaa54740 1 --2- 172.21.15.50:0/2075104253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620511b0d40 0x5620511bc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:58.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.244+0000 7feadaa54740 1 --2- 172.21.15.50:0/2075104253 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620511abbd0 0x5620511b59d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:58.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.244+0000 7feadaa54740 1 --2- 172.21.15.50:0/2075104253 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620511ab1e0 0x5620511b5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:58.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.244+0000 7feadaa54740 1 -- 172.21.15.50:0/2075104253 >> 172.21.15.50:0/2075104253 conn(0x5620511a6850 msgr2=0x5620511b0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:58.247 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.247+0000 7feadaa54740 1 -- 172.21.15.50:0/2075104253 shutdown_connections 2024-06-06T03:37:58.247 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.247+0000 7feadaa54740 1 -- 172.21.15.50:0/2075104253 wait complete. 2024-06-06T03:37:58.248 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.248+0000 7feadaa54740 1 -- start start 2024-06-06T03:37:58.248 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.248+0000 7feadaa54740 1 Processor -- start 2024-06-06T03:37:58.249 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.249+0000 7feadaa54740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620511ab1e0 0x5620511b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.249+0000 7feadaa54740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620511abbd0 0x5620511b8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.249+0000 7feadaa54740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620511b0d40 0x5620511bbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.250+0000 7feadaa54740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7feab400e270 con 0x5620511ab1e0 2024-06-06T03:37:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.250+0000 7feadaa54740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7feab400f6e0 con 0x5620511abbd0 2024-06-06T03:37:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.250+0000 7feadaa54740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7feab400e940 con 0x5620511b0d40 2024-06-06T03:37:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.250+0000 7feadaa54740 10 client.0 _ll_register_callbacks cb 0x7feac8098050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T03:37:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.250+0000 7fead5ade640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620511ab1e0 0x5620511b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:58.251 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.250+0000 7fead5ade640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620511ab1e0 0x5620511b8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38596/0 (socket says 172.21.15.50:38596) 2024-06-06T03:37:58.251 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.250+0000 7fead5ade640 1 -- 172.21.15.50:0/2930649905 learned_addr learned my addr 172.21.15.50:0/2930649905 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:37:58.251 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.251+0000 7fead5ade640 1 -- 172.21.15.50:0/2930649905 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620511b0d40 msgr2=0x5620511bbff0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:37:58.251 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.251+0000 7fead5ade640 1 --2- 172.21.15.50:0/2930649905 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620511b0d40 0x5620511bbff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:58.251 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.251+0000 7fead5ade640 1 -- 172.21.15.50:0/2930649905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620511abbd0 msgr2=0x5620511b8fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T03:37:58.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.251+0000 7fead5ade640 1 --2- 172.21.15.50:0/2930649905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620511abbd0 0x5620511b8fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:58.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.251+0000 7fead5ade640 1 -- 172.21.15.50:0/2930649905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620511bc5e0 con 0x5620511ab1e0 2024-06-06T03:37:58.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.251+0000 7fead5ade640 1 --2- 172.21.15.50:0/2930649905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620511ab1e0 0x5620511b8a90 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x5620511ac430 tx=0x7feac4005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ddd4d65609a196 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:37:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.259+0000 7feab97fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-06-06T03:37:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.259+0000 7feab97fa640 1 -- 172.21.15.50:0/2930649905 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac4046040 con 0x5620511ab1e0 2024-06-06T03:37:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.259+0000 7feab97fa640 1 -- 172.21.15.50:0/2930649905 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7feac4004450 con 0x5620511ab1e0 2024-06-06T03:37:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.261+0000 7feadaa54740 1 -- 172.21.15.50:0/2930649905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feacc017070 con 0x5620511ab1e0 2024-06-06T03:37:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.262+0000 7feab97fa640 1 -- 172.21.15.50:0/2930649905 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7feac405b050 con 0x5620511ab1e0 2024-06-06T03:37:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.262+0000 7feadaa54740 10 client.16869 fetch_fsmap learned FSMap version 36 2024-06-06T03:37:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.263+0000 7feadaa54740 1 -- 172.21.15.50:0/2930649905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x56205122b000 con 0x5620511ab1e0 2024-06-06T03:37:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.267+0000 7feab97fa640 1 -- 172.21.15.50:0/2930649905 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feacc017070 con 0x5620511ab1e0 2024-06-06T03:37:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.267+0000 7feab97fa640 1 -- 172.21.15.50:0/2930649905 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7feac4003930 con 0x5620511ab1e0 2024-06-06T03:37:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.267+0000 7feadaa54740 10 client.16869 fetch_fsmap finished waiting for FSMap version 36 2024-06-06T03:37:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.267+0000 7feadaa54740 10 client.16869 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-06T03:37:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.267+0000 7feadaa54740 20 client.16869 populate_metadata read hostname 'smithi050' 2024-06-06T03:37:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.267+0000 7feadaa54740 1 --2- 172.21.15.50:0/2930649905 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56205122ba40 0x56205122de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:37:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.267+0000 7feadaa54740 4 client.16869 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T03:37:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.267+0000 7feadaa54740 1 -- 172.21.15.50:0/2930649905 --> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56205111bc20 con 0x56205122ba40 2024-06-06T03:37:58.269 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.269+0000 7fead52dd640 1 --2- 172.21.15.50:0/2930649905 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56205122ba40 0x56205122de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:37:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.290+0000 7fead52dd640 1 --2- 172.21.15.50:0/2930649905 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56205122ba40 0x56205122de60 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18acd6bc93d8e2f3 server_cookie=5930f461d5362c6a in_seq=0 out_seq=0 2024-06-06T03:37:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.290+0000 7feab97fa640 10 client.16869 ms_handle_connect on v2:172.21.15.122:6838/4129732900 2024-06-06T03:37:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.296+0000 7feab97fa640 1 -- 172.21.15.50:0/2930649905 <== mds.0 v2:172.21.15.122:6838/4129732900 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x56205111bc20 con 0x56205122ba40 2024-06-06T03:37:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.296+0000 7feab97fa640 10 client.16869 handle_command_reply: tid=0 2024-06-06T03:37:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.296+0000 7feadaa54740 1 client.16869 shutdown 2024-06-06T03:37:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.300+0000 7feadaa54740 1 -- 172.21.15.50:0/2930649905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620511ab1e0 msgr2=0x5620511b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.300+0000 7feadaa54740 1 --2- 172.21.15.50:0/2930649905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620511ab1e0 0x5620511b8a90 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x5620511ac430 tx=0x7feac4005870 comp rx=0 tx=0).stop 2024-06-06T03:37:58.305 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.305+0000 7feadaa54740 1 -- 172.21.15.50:0/2930649905 shutdown_connections 2024-06-06T03:37:58.305 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.305+0000 7feadaa54740 1 --2- 172.21.15.50:0/2930649905 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5620511b0d40 0x5620511bbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:58.305 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.305+0000 7feadaa54740 1 --2- 172.21.15.50:0/2930649905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620511abbd0 0x5620511b8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:58.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.305+0000 7feadaa54740 1 --2- 172.21.15.50:0/2930649905 >> [v2:172.21.15.122:6838/4129732900,v1:172.21.15.122:6839/4129732900] conn(0x56205122ba40 0x56205122de60 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:58.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.305+0000 7feadaa54740 1 --2- 172.21.15.50:0/2930649905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620511ab1e0 0x5620511b8a90 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:58.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.305+0000 7feadaa54740 1 -- 172.21.15.50:0/2930649905 >> 172.21.15.50:0/2930649905 conn(0x5620511a6850 msgr2=0x5620511ace50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:58.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.305+0000 7feab97fa640 0 client.16869 ms_handle_reset on v2:172.21.15.122:6838/4129732900 2024-06-06T03:37:58.310 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.310+0000 7feadaa54740 1 -- 172.21.15.50:0/2930649905 shutdown_connections 2024-06-06T03:37:58.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.312+0000 7feadaa54740 1 -- 172.21.15.50:0/2930649905 wait complete. 2024-06-06T03:37:58.314 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.314+0000 7feadaa54740 20 client.16869 trim_cache size 0 max 16384 2024-06-06T03:37:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-06-06T03:37:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-06-06T03:37:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-06-06T03:37:58.325 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.325+0000 7fead6ae0640 1 -- 172.21.15.50:0/3291667343 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7feabc0a2d90 msgr2=0x7feabc0a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:58.325 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.325+0000 7fead6ae0640 1 --2- 172.21.15.50:0/3291667343 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7feabc0a2d90 0x7feabc0a5250 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7feacc005fd0 tx=0x7feacc00b410 comp rx=0 tx=0).stop 2024-06-06T03:37:58.325 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.325+0000 7fead6ae0640 1 -- 172.21.15.50:0/3291667343 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fead007f610 msgr2=0x7fead0081ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:37:58.325 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.325+0000 7fead6ae0640 1 --2- 172.21.15.50:0/3291667343 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fead007f610 0x7fead0081ad0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7feac800b970 tx=0x7feac800be30 comp rx=0 tx=0).stop 2024-06-06T03:37:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.328+0000 7fead6ae0640 1 -- 172.21.15.50:0/3291667343 shutdown_connections 2024-06-06T03:37:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.328+0000 7fead6ae0640 1 --2- 172.21.15.50:0/3291667343 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7feabc0a2d90 0x7feabc0a5250 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.328+0000 7fead6ae0640 1 --2- 172.21.15.50:0/3291667343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fead0109960 0x7fead007a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.328+0000 7fead6ae0640 1 --2- 172.21.15.50:0/3291667343 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fead007f610 0x7fead0081ad0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.328+0000 7fead6ae0640 1 --2- 172.21.15.50:0/3291667343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fead0108fa0 0x7fead007a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:37:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.328+0000 7fead6ae0640 1 -- 172.21.15.50:0/3291667343 >> 172.21.15.50:0/3291667343 conn(0x7fead0076e30 msgr2=0x7fead0070a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:37:58.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.336+0000 7fead6ae0640 1 -- 172.21.15.50:0/3291667343 shutdown_connections 2024-06-06T03:37:58.339 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-06-06T03:37:58.340+0000 7fead6ae0640 1 -- 172.21.15.50:0/3291667343 wait complete. 2024-06-06T03:37:58.987 INFO:tasks.workunit.client.0.smithi050.stdout:stopping iogen 2024-06-06T03:37:58.987 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'stopping iogen' 2024-06-06T03:37:58.987 INFO:tasks.workunit.client.0.smithi050.stderr:+ ./iogen -k 2024-06-06T03:37:58.995 INFO:tasks.workunit.client.0.smithi050.stdout:OK 2024-06-06T03:37:58.995 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo OK 2024-06-06T03:37:59.254 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:37:58 smithi050 ceph-mon[32421]: pgmap v771: 129 pgs: 129 active+clean; 10 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 28 MiB/s wr, 537 op/s 2024-06-06T03:37:59.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:37:58 smithi079 ceph-mon[35478]: pgmap v771: 129 pgs: 129 active+clean; 10 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 28 MiB/s wr, 537 op/s 2024-06-06T03:37:59.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:37:58 smithi122 ceph-mon[35759]: pgmap v771: 129 pgs: 129 active+clean; 10 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 28 MiB/s wr, 537 op/s 2024-06-06T03:38:01.259 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-06-06T03:38:01.259 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-06-06T03:38:01.334 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:01 smithi050 ceph-mon[32421]: pgmap v772: 129 pgs: 129 active+clean; 10 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 35 MiB/s wr, 663 op/s 2024-06-06T03:38:01.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:01 smithi079 ceph-mon[35478]: pgmap v772: 129 pgs: 129 active+clean; 10 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 35 MiB/s wr, 663 op/s 2024-06-06T03:38:01.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:01 smithi122 ceph-mon[35759]: pgmap v772: 129 pgs: 129 active+clean; 10 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 35 MiB/s wr, 663 op/s 2024-06-06T03:38:02.089 INFO:tasks.workunit:Stopping ['suites/iogen.sh'] on client.0... 2024-06-06T03:38:02.090 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-06-06T03:38:02.534 DEBUG:teuthology.parallel:result is None 2024-06-06T03:38:02.535 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-06-06T03:38:02.570 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-06-06T03:38:02.570 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-06-06T03:38:02.580 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi050.front.sepia.ceph.com 2024-06-06T03:38:02.619 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-06-06T03:38:02.628 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-06-06T03:38:02.628 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_3d746ca5346f34eef7e826a1eb71e59e02b682ae/qa/tasks/fwd_scrub.py", line 155, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph_3d746ca5346f34eef7e826a1eb71e59e02b682ae/qa/tasks/fwd_scrub.py", line 90, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-06-06T03:38:02.629 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-06-06T03:38:02.644 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-06T03:38:02.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.765+0000 7fc53046b640 1 -- 172.21.15.50:0/2781271977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc528101af0 msgr2=0x7fc528101f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:02.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.765+0000 7fc53046b640 1 --2- 172.21.15.50:0/2781271977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc528101af0 0x7fc528101f70 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc518009900 tx=0x7fc51802a410 comp rx=0 tx=0).stop 2024-06-06T03:38:02.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.765+0000 7fc53046b640 1 -- 172.21.15.50:0/2781271977 shutdown_connections 2024-06-06T03:38:02.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.765+0000 7fc53046b640 1 --2- 172.21.15.50:0/2781271977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc528101af0 0x7fc528101f70 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:02.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.765+0000 7fc53046b640 1 --2- 172.21.15.50:0/2781271977 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5281024b0 0x7fc528108d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:02.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.765+0000 7fc53046b640 1 --2- 172.21.15.50:0/2781271977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc528100900 0x7fc528100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:02.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.765+0000 7fc53046b640 1 -- 172.21.15.50:0/2781271977 >> 172.21.15.50:0/2781271977 conn(0x7fc5280fbe90 msgr2=0x7fc5280fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:38:02.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.765+0000 7fc53046b640 1 -- 172.21.15.50:0/2781271977 shutdown_connections 2024-06-06T03:38:02.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.765+0000 7fc53046b640 1 -- 172.21.15.50:0/2781271977 wait complete. 2024-06-06T03:38:02.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.766+0000 7fc53046b640 1 Processor -- start 2024-06-06T03:38:02.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.766+0000 7fc53046b640 1 -- start start 2024-06-06T03:38:02.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.766+0000 7fc53046b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc528100900 0x7fc528104890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:02.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.766+0000 7fc53046b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc528101af0 0x7fc528102ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:02.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.766+0000 7fc53046b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5281024b0 0x7fc528103410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:02.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.766+0000 7fc53046b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc52810c430 con 0x7fc5281024b0 2024-06-06T03:38:02.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.766+0000 7fc53046b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc52810c2b0 con 0x7fc528100900 2024-06-06T03:38:02.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.766+0000 7fc53046b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc52810c5b0 con 0x7fc528101af0 2024-06-06T03:38:02.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.766+0000 7fc52ea08640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5281024b0 0x7fc528103410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:02.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.766+0000 7fc52ea08640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5281024b0 0x7fc528103410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38614/0 (socket says 172.21.15.50:38614) 2024-06-06T03:38:02.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.766+0000 7fc52ea08640 1 -- 172.21.15.50:0/2059484516 learned_addr learned my addr 172.21.15.50:0/2059484516 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:38:02.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.766+0000 7fc52e207640 1 --2- 172.21.15.50:0/2059484516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc528100900 0x7fc528104890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:02.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.766+0000 7fc52da06640 1 --2- 172.21.15.50:0/2059484516 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc528101af0 0x7fc528102ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:02.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.767+0000 7fc52ea08640 1 -- 172.21.15.50:0/2059484516 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc528101af0 msgr2=0x7fc528102ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:02.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.767+0000 7fc52ea08640 1 --2- 172.21.15.50:0/2059484516 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc528101af0 0x7fc528102ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:02.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.767+0000 7fc52ea08640 1 -- 172.21.15.50:0/2059484516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc528100900 msgr2=0x7fc528104890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:02.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.767+0000 7fc52ea08640 1 --2- 172.21.15.50:0/2059484516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc528100900 0x7fc528104890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:02.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.767+0000 7fc52ea08640 1 -- 172.21.15.50:0/2059484516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc528103ca0 con 0x7fc5281024b0 2024-06-06T03:38:02.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.767+0000 7fc52ea08640 1 --2- 172.21.15.50:0/2059484516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5281024b0 0x7fc528103410 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fc52000cad0 tx=0x7fc52000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:38:02.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.767+0000 7fc51f7fe640 1 -- 172.21.15.50:0/2059484516 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc52000ae20 con 0x7fc5281024b0 2024-06-06T03:38:02.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.767+0000 7fc51f7fe640 1 -- 172.21.15.50:0/2059484516 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc520005020 con 0x7fc5281024b0 2024-06-06T03:38:02.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.767+0000 7fc53046b640 1 -- 172.21.15.50:0/2059484516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5281a1e00 con 0x7fc5281024b0 2024-06-06T03:38:02.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.767+0000 7fc51f7fe640 1 -- 172.21.15.50:0/2059484516 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc52000f6b0 con 0x7fc5281024b0 2024-06-06T03:38:02.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.767+0000 7fc53046b640 1 -- 172.21.15.50:0/2059484516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5281a22c0 con 0x7fc5281024b0 2024-06-06T03:38:02.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.768+0000 7fc53046b640 1 -- 172.21.15.50:0/2059484516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5281a25b0 con 0x7fc5281024b0 2024-06-06T03:38:02.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.769+0000 7fc51f7fe640 1 -- 172.21.15.50:0/2059484516 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc5200051d0 con 0x7fc5281024b0 2024-06-06T03:38:02.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.770+0000 7fc51f7fe640 1 --2- 172.21.15.50:0/2059484516 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc5140a2c10 0x7fc5140a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:02.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.770+0000 7fc51f7fe640 1 -- 172.21.15.50:0/2059484516 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fc5200cf680 con 0x7fc5281024b0 2024-06-06T03:38:02.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.770+0000 7fc52e207640 1 --2- 172.21.15.50:0/2059484516 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc5140a2c10 0x7fc5140a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:02.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.771+0000 7fc52e207640 1 --2- 172.21.15.50:0/2059484516 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc5140a2c10 0x7fc5140a50d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc528101950 tx=0x7fc52400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:38:02.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.774+0000 7fc51f7fe640 1 -- 172.21.15.50:0/2059484516 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc520014030 con 0x7fc5281024b0 2024-06-06T03:38:02.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.959+0000 7fc53046b640 1 -- 172.21.15.50:0/2059484516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc5281a2940 con 0x7fc5281024b0 2024-06-06T03:38:02.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.961+0000 7fc51f7fe640 1 -- 172.21.15.50:0/2059484516 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+24653 (secure 0 0 0) 0x7fc52009bc90 con 0x7fc5281024b0 2024-06-06T03:38:02.961 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:38:02.961 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":99,"fsid":"b6263b26-23b2-11ef-bc9b-c7b262605968","created":"2024-06-06T03:14:19.062632+0000","modified":"2024-06-06T03:24:14.691472+0000","last_up_change":"2024-06-06T03:21:30.287918+0000","last_in_change":"2024-06-06T03:21:09.550417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T03:17:37.777608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T03:22:29.496859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T03:22:33.221878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-06T03:22:42.829873+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"eed8040f-a7b7-4d3b-8345-2022918097d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6803","nonce":2379528827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6805","nonce":2379528827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6809","nonce":2379528827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2379528827},{"type":"v1","addr":"172.21.15.50:6807","nonce":2379528827}]},"public_addr":"172.21.15.50:6803/2379528827","cluster_addr":"172.21.15.50:6805/2379528827","heartbeat_back_addr":"172.21.15.50:6809/2379528827","heartbeat_front_addr":"172.21.15.50:6807/2379528827","state":["exists","up"]},{"osd":1,"uuid":"089ecb78-5e1e-4cdb-8fe0-5c1731ec9dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6801","nonce":3498354151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6803","nonce":3498354151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6807","nonce":3498354151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3498354151},{"type":"v1","addr":"172.21.15.79:6805","nonce":3498354151}]},"public_addr":"172.21.15.79:6801/3498354151","cluster_addr":"172.21.15.79:6803/3498354151","heartbeat_back_addr":"172.21.15.79:6807/3498354151","heartbeat_front_addr":"172.21.15.79:6805/3498354151","state":["exists","up"]},{"osd":2,"uuid":"90599e3b-bf86-4a56-b03b-b051528a5b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6801","nonce":566397008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6803","nonce":566397008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6807","nonce":566397008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":566397008},{"type":"v1","addr":"172.21.15.122:6805","nonce":566397008}]},"public_addr":"172.21.15.122:6801/566397008","cluster_addr":"172.21.15.122:6803/566397008","heartbeat_back_addr":"172.21.15.122:6807/566397008","heartbeat_front_addr":"172.21.15.122:6805/566397008","state":["exists","up"]},{"osd":3,"uuid":"fd295e6c-64cd-4164-83dc-4d32c2ae103a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6811","nonce":820123083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6813","nonce":820123083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6817","nonce":820123083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":820123083},{"type":"v1","addr":"172.21.15.50:6815","nonce":820123083}]},"public_addr":"172.21.15.50:6811/820123083","cluster_addr":"172.21.15.50:6813/820123083","heartbeat_back_addr":"172.21.15.50:6817/820123083","heartbeat_front_addr":"172.21.15.50:6815/820123083","state":["exists","up"]},{"osd":4,"uuid":"4c854d90-5353-4f7c-b2f3-2af6216d799b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6809","nonce":1784117997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6811","nonce":1784117997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6815","nonce":1784117997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1784117997},{"type":"v1","addr":"172.21.15.79:6813","nonce":1784117997}]},"public_addr":"172.21.15.79:6809/1784117997","cluster_addr":"172.21.15.79:6811/1784117997","heartbeat_back_addr":"172.21.15.79:6815/1784117997","heartbeat_front_addr":"172.21.15.79:6813/1784117997","state":["exists","up"]},{"osd":5,"uuid":"80041e10-a643-4338-b621-f882c7bc48b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6809","nonce":2755878218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6811","nonce":2755878218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6815","nonce":2755878218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2755878218},{"type":"v1","addr":"172.21.15.122:6813","nonce":2755878218}]},"public_addr":"172.21.15.122:6809/2755878218","cluster_addr":"172.21.15.122:6811/2755878218","heartbeat_back_addr":"172.21.15.122:6815/2755878218","heartbeat_front_addr":"172.21.15.122:6813/2755878218","state":["exists","up"]},{"osd":6,"uuid":"9e15c6c3-bb4b-4c2b-bb7e-4653b10874d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6819","nonce":474595612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6821","nonce":474595612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6825","nonce":474595612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":474595612},{"type":"v1","addr":"172.21.15.50:6823","nonce":474595612}]},"public_addr":"172.21.15.50:6819/474595612","cluster_addr":"172.21.15.50:6821/474595612","heartbeat_back_addr":"172.21.15.50:6825/474595612","heartbeat_front_addr":"172.21.15.50:6823/474595612","state":["exists","up"]},{"osd":7,"uuid":"62585bba-c540-4498-8768-b84183e19abd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6817","nonce":3504864579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6819","nonce":3504864579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6823","nonce":3504864579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3504864579},{"type":"v1","addr":"172.21.15.79:6821","nonce":3504864579}]},"public_addr":"172.21.15.79:6817/3504864579","cluster_addr":"172.21.15.79:6819/3504864579","heartbeat_back_addr":"172.21.15.79:6823/3504864579","heartbeat_front_addr":"172.21.15.79:6821/3504864579","state":["exists","up"]},{"osd":8,"uuid":"7a272157-460a-4d4a-a63e-30436022ac7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6817","nonce":3484833116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6819","nonce":3484833116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6823","nonce":3484833116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3484833116},{"type":"v1","addr":"172.21.15.122:6821","nonce":3484833116}]},"public_addr":"172.21.15.122:6817/3484833116","cluster_addr":"172.21.15.122:6819/3484833116","heartbeat_back_addr":"172.21.15.122:6823/3484833116","heartbeat_front_addr":"172.21.15.122:6821/3484833116","state":["exists","up"]},{"osd":9,"uuid":"7e768ff7-f78d-4a12-b863-4b692e0f4a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6827","nonce":2600273670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6829","nonce":2600273670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6833","nonce":2600273670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2600273670},{"type":"v1","addr":"172.21.15.50:6831","nonce":2600273670}]},"public_addr":"172.21.15.50:6827/2600273670","cluster_addr":"172.21.15.50:6829/2600273670","heartbeat_back_addr":"172.21.15.50:6833/2600273670","heartbeat_front_addr":"172.21.15.50:6831/2600273670","state":["exists","up"]},{"osd":10,"uuid":"a42df29a-d88d-4401-878d-6c8f75f3f604","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6825","nonce":2740366543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6827","nonce":2740366543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6831","nonce":2740366543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2740366543},{"type":"v1","addr":"172.21.15.79:6829","nonce":2740366543}]},"public_addr":"172.21.15.79:6825/2740366543","cluster_addr":"172.21.15.79:6827/2740366543","heartbeat_back_addr":"172.21.15.79:6831/2740366543","heartbeat_front_addr":"172.21.15.79:6829/2740366543","state":["exists","up"]},{"osd":11,"uuid":"35bcde30-49e4-49b9-a348-98d21a0d3cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6825","nonce":4160854238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6827","nonce":4160854238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6831","nonce":4160854238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":4160854238},{"type":"v1","addr":"172.21.15.122:6829","nonce":4160854238}]},"public_addr":"172.21.15.122:6825/4160854238","cluster_addr":"172.21.15.122:6827/4160854238","heartbeat_back_addr":"172.21.15.122:6831/4160854238","heartbeat_front_addr":"172.21.15.122:6829/4160854238","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:16:46.989554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:17:11.269759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:17:35.105846+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:00.940943+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:26.284520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:18:51.064143+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:19:16.254750+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:19:42.841380+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:20:08.185133+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:20:34.700082+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:21:01.485278+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T03:21:27.938715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1311987652":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/1149897118":"2024-06-07T03:15:13.252241+0000","172.21.15.50:6800/2617801068":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/1068038293":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/4038080419":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/149912088":"2024-06-07T03:14:46.388744+0000","172.21.15.50:6801/2617801068":"2024-06-07T03:14:46.388744+0000","172.21.15.50:0/2963887224":"2024-06-07T03:14:46.388744+0000","172.21.15.50:6801/1311987652":"2024-06-07T03:15:13.252241+0000","172.21.15.50:0/2554563139":"2024-06-07T03:15:13.252241+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T03:38:02.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.963+0000 7fc53046b640 1 -- 172.21.15.50:0/2059484516 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc5140a2c10 msgr2=0x7fc5140a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:02.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.963+0000 7fc53046b640 1 --2- 172.21.15.50:0/2059484516 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc5140a2c10 0x7fc5140a50d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc528101950 tx=0x7fc52400b390 comp rx=0 tx=0).stop 2024-06-06T03:38:02.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.963+0000 7fc53046b640 1 -- 172.21.15.50:0/2059484516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5281024b0 msgr2=0x7fc528103410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:02.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.963+0000 7fc53046b640 1 --2- 172.21.15.50:0/2059484516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5281024b0 0x7fc528103410 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fc52000cad0 tx=0x7fc52000cf90 comp rx=0 tx=0).stop 2024-06-06T03:38:02.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.963+0000 7fc53046b640 1 -- 172.21.15.50:0/2059484516 shutdown_connections 2024-06-06T03:38:02.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.963+0000 7fc53046b640 1 --2- 172.21.15.50:0/2059484516 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fc5140a2c10 0x7fc5140a50d0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:02.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.963+0000 7fc53046b640 1 --2- 172.21.15.50:0/2059484516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5281024b0 0x7fc528103410 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:02.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.963+0000 7fc53046b640 1 --2- 172.21.15.50:0/2059484516 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc528101af0 0x7fc528102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:02.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.963+0000 7fc53046b640 1 --2- 172.21.15.50:0/2059484516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc528100900 0x7fc528104890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:02.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.963+0000 7fc53046b640 1 -- 172.21.15.50:0/2059484516 >> 172.21.15.50:0/2059484516 conn(0x7fc5280fbe90 msgr2=0x7fc52806a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:38:02.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.963+0000 7fc53046b640 1 -- 172.21.15.50:0/2059484516 shutdown_connections 2024-06-06T03:38:02.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:02.963+0000 7fc53046b640 1 -- 172.21.15.50:0/2059484516 wait complete. 2024-06-06T03:38:02.975 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-06T03:17:37.777608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-06T03:22:29.496859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-06T03:22:33.221878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-06-06T03:22:42.829873+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-06-06T03:38:02.975 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-06T03:38:03.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.084+0000 7fec5e39e640 1 -- 172.21.15.50:0/2482529155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec581076e0 msgr2=0x7fec58109b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:03.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.084+0000 7fec5e39e640 1 --2- 172.21.15.50:0/2482529155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec581076e0 0x7fec58109b30 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fec50009ca0 tx=0x7fec5002a8c0 comp rx=0 tx=0).stop 2024-06-06T03:38:03.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.084+0000 7fec5e39e640 1 -- 172.21.15.50:0/2482529155 shutdown_connections 2024-06-06T03:38:03.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.084+0000 7fec5e39e640 1 --2- 172.21.15.50:0/2482529155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec581076e0 0x7fec58109b30 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:03.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.084+0000 7fec5e39e640 1 --2- 172.21.15.50:0/2482529155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec58104db0 0x7fec581071a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:03.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.084+0000 7fec5e39e640 1 --2- 172.21.15.50:0/2482529155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec58102480 0x7fec58104870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:03.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.084+0000 7fec5e39e640 1 -- 172.21.15.50:0/2482529155 >> 172.21.15.50:0/2482529155 conn(0x7fec580fbe90 msgr2=0x7fec580fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:38:03.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.084+0000 7fec5e39e640 1 -- 172.21.15.50:0/2482529155 shutdown_connections 2024-06-06T03:38:03.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.084+0000 7fec5e39e640 1 -- 172.21.15.50:0/2482529155 wait complete. 2024-06-06T03:38:03.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.085+0000 7fec5e39e640 1 Processor -- start 2024-06-06T03:38:03.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.085+0000 7fec5e39e640 1 -- start start 2024-06-06T03:38:03.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.085+0000 7fec5e39e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec58102480 0x7fec58197bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:03.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.085+0000 7fec5e39e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec58104db0 0x7fec58198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:03.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.085+0000 7fec5e39e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec581076e0 0x7fec5819f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:03.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.085+0000 7fec5e39e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fec5810d550 con 0x7fec58104db0 2024-06-06T03:38:03.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.085+0000 7fec5e39e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fec5810d3d0 con 0x7fec581076e0 2024-06-06T03:38:03.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.085+0000 7fec5e39e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fec5810d6d0 con 0x7fec58102480 2024-06-06T03:38:03.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.085+0000 7fec577fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec58104db0 0x7fec58198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:03.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.085+0000 7fec577fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec58104db0 0x7fec58198130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38644/0 (socket says 172.21.15.50:38644) 2024-06-06T03:38:03.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.085+0000 7fec577fe640 1 -- 172.21.15.50:0/2675282565 learned_addr learned my addr 172.21.15.50:0/2675282565 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:38:03.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.086+0000 7fec5c93b640 1 --2- 172.21.15.50:0/2675282565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec581076e0 0x7fec5819f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:03.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.086+0000 7fec57fff640 1 --2- 172.21.15.50:0/2675282565 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec58102480 0x7fec58197bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:03.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.086+0000 7fec577fe640 1 -- 172.21.15.50:0/2675282565 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec58102480 msgr2=0x7fec58197bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:03.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.086+0000 7fec577fe640 1 --2- 172.21.15.50:0/2675282565 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec58102480 0x7fec58197bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:03.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.086+0000 7fec577fe640 1 -- 172.21.15.50:0/2675282565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec581076e0 msgr2=0x7fec5819f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:03.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.086+0000 7fec577fe640 1 --2- 172.21.15.50:0/2675282565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec581076e0 0x7fec5819f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:03.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.086+0000 7fec577fe640 1 -- 172.21.15.50:0/2675282565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5819f810 con 0x7fec58104db0 2024-06-06T03:38:03.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.086+0000 7fec577fe640 1 --2- 172.21.15.50:0/2675282565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec58104db0 0x7fec58198130 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00e9f0 tx=0x7fec4c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:38:03.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.086+0000 7fec557fa640 1 -- 172.21.15.50:0/2675282565 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4c00ccc0 con 0x7fec58104db0 2024-06-06T03:38:03.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.086+0000 7fec557fa640 1 -- 172.21.15.50:0/2675282565 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fec4c0054d0 con 0x7fec58104db0 2024-06-06T03:38:03.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.086+0000 7fec557fa640 1 -- 172.21.15.50:0/2675282565 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4c010430 con 0x7fec58104db0 2024-06-06T03:38:03.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.086+0000 7fec5e39e640 1 -- 172.21.15.50:0/2675282565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec5819fb00 con 0x7fec58104db0 2024-06-06T03:38:03.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.086+0000 7fec5e39e640 1 -- 172.21.15.50:0/2675282565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec581a0000 con 0x7fec58104db0 2024-06-06T03:38:03.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.088+0000 7fec5e39e640 1 -- 172.21.15.50:0/2675282565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec580fd980 con 0x7fec58104db0 2024-06-06T03:38:03.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.089+0000 7fec557fa640 1 -- 172.21.15.50:0/2675282565 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fec4c005020 con 0x7fec58104db0 2024-06-06T03:38:03.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.090+0000 7fec557fa640 1 --2- 172.21.15.50:0/2675282565 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fec400a2b90 0x7fec400a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:03.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.090+0000 7fec57fff640 1 --2- 172.21.15.50:0/2675282565 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fec400a2b90 0x7fec400a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:03.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.090+0000 7fec557fa640 1 -- 172.21.15.50:0/2675282565 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fec4c0cf740 con 0x7fec58104db0 2024-06-06T03:38:03.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.090+0000 7fec57fff640 1 --2- 172.21.15.50:0/2675282565 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fec400a2b90 0x7fec400a5050 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fec48009bd0 tx=0x7fec48005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:38:03.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.094+0000 7fec557fa640 1 -- 172.21.15.50:0/2675282565 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fec4c09c320 con 0x7fec58104db0 2024-06-06T03:38:03.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:03 smithi050 ceph-mon[32421]: pgmap v773: 129 pgs: 129 active+clean; 10 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 31 MiB/s wr, 583 op/s 2024-06-06T03:38:03.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:03 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/2059484516' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:38:03.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.278+0000 7fec5e39e640 1 -- 172.21.15.50:0/2675282565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fec580625d0 con 0x7fec58104db0 2024-06-06T03:38:03.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.279+0000 7fec557fa640 1 -- 172.21.15.50:0/2675282565 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v99) ==== 93+0+10 (secure 0 0 0) 0x7fec4c086020 con 0x7fec58104db0 2024-06-06T03:38:03.279 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-06-06T03:38:03.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.281+0000 7fec5e39e640 1 -- 172.21.15.50:0/2675282565 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fec400a2b90 msgr2=0x7fec400a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:03.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.281+0000 7fec5e39e640 1 --2- 172.21.15.50:0/2675282565 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fec400a2b90 0x7fec400a5050 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fec48009bd0 tx=0x7fec48005f90 comp rx=0 tx=0).stop 2024-06-06T03:38:03.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.281+0000 7fec5e39e640 1 -- 172.21.15.50:0/2675282565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec58104db0 msgr2=0x7fec58198130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:03.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.281+0000 7fec5e39e640 1 --2- 172.21.15.50:0/2675282565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec58104db0 0x7fec58198130 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00e9f0 tx=0x7fec4c00eeb0 comp rx=0 tx=0).stop 2024-06-06T03:38:03.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.281+0000 7fec5e39e640 1 -- 172.21.15.50:0/2675282565 shutdown_connections 2024-06-06T03:38:03.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.281+0000 7fec5e39e640 1 --2- 172.21.15.50:0/2675282565 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fec400a2b90 0x7fec400a5050 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:03.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.281+0000 7fec5e39e640 1 --2- 172.21.15.50:0/2675282565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec58104db0 0x7fec58198130 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:03.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.281+0000 7fec5e39e640 1 --2- 172.21.15.50:0/2675282565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec581076e0 0x7fec5819f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:03.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.281+0000 7fec5e39e640 1 --2- 172.21.15.50:0/2675282565 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec58102480 0x7fec58197bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:03.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.281+0000 7fec5e39e640 1 -- 172.21.15.50:0/2675282565 >> 172.21.15.50:0/2675282565 conn(0x7fec580fbe90 msgr2=0x7fec58102dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:38:03.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.281+0000 7fec5e39e640 1 -- 172.21.15.50:0/2675282565 shutdown_connections 2024-06-06T03:38:03.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.281+0000 7fec5e39e640 1 -- 172.21.15.50:0/2675282565 wait complete. 2024-06-06T03:38:03.292 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-06T03:38:03.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:03 smithi079 ceph-mon[35478]: pgmap v773: 129 pgs: 129 active+clean; 10 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 31 MiB/s wr, 583 op/s 2024-06-06T03:38:03.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:03 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/2059484516' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:38:03.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.401+0000 7f020f7dc640 1 -- 172.21.15.50:0/3079045036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0208100900 msgr2=0x7f0208100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:03.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.401+0000 7f020f7dc640 1 --2- 172.21.15.50:0/3079045036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0208100900 0x7f0208100d20 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f0204009900 tx=0x7f020402a410 comp rx=0 tx=0).stop 2024-06-06T03:38:03.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.401+0000 7f020f7dc640 1 -- 172.21.15.50:0/3079045036 shutdown_connections 2024-06-06T03:38:03.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.401+0000 7f020f7dc640 1 --2- 172.21.15.50:0/3079045036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02081024b0 0x7f0208108d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:03.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.401+0000 7f020f7dc640 1 --2- 172.21.15.50:0/3079045036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0208101af0 0x7f0208101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:03.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.401+0000 7f020f7dc640 1 --2- 172.21.15.50:0/3079045036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0208100900 0x7f0208100d20 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:03.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.401+0000 7f020f7dc640 1 -- 172.21.15.50:0/3079045036 >> 172.21.15.50:0/3079045036 conn(0x7f02080fbe90 msgr2=0x7f02080fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:38:03.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.401+0000 7f020f7dc640 1 -- 172.21.15.50:0/3079045036 shutdown_connections 2024-06-06T03:38:03.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.401+0000 7f020f7dc640 1 -- 172.21.15.50:0/3079045036 wait complete. 2024-06-06T03:38:03.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.402+0000 7f020f7dc640 1 Processor -- start 2024-06-06T03:38:03.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.402+0000 7f020f7dc640 1 -- start start 2024-06-06T03:38:03.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.402+0000 7f020f7dc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0208100900 0x7f0208197c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:03.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.402+0000 7f020f7dc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0208101af0 0x7f0208198160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:03.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.402+0000 7f020f7dc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02081024b0 0x7f020819f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:03.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.402+0000 7f020f7dc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f020810d5b0 con 0x7f02081024b0 2024-06-06T03:38:03.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.402+0000 7f020f7dc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f020810d430 con 0x7f0208101af0 2024-06-06T03:38:03.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.402+0000 7f020f7dc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f020810d730 con 0x7f0208100900 2024-06-06T03:38:03.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.402+0000 7f020dd79640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02081024b0 0x7f020819f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:03.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.402+0000 7f020dd79640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02081024b0 0x7f020819f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38648/0 (socket says 172.21.15.50:38648) 2024-06-06T03:38:03.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.402+0000 7f020dd79640 1 -- 172.21.15.50:0/2508559706 learned_addr learned my addr 172.21.15.50:0/2508559706 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:38:03.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.402+0000 7f020cd77640 1 --2- 172.21.15.50:0/2508559706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0208101af0 0x7f0208198160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:03.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.402+0000 7f020d578640 1 --2- 172.21.15.50:0/2508559706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0208100900 0x7f0208197c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:03.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.403+0000 7f020dd79640 1 -- 172.21.15.50:0/2508559706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0208100900 msgr2=0x7f0208197c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:03.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.403+0000 7f020dd79640 1 --2- 172.21.15.50:0/2508559706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0208100900 0x7f0208197c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:03.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.403+0000 7f020dd79640 1 -- 172.21.15.50:0/2508559706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0208101af0 msgr2=0x7f0208198160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:03.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.403+0000 7f020dd79640 1 --2- 172.21.15.50:0/2508559706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0208101af0 0x7f0208198160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:03.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.403+0000 7f020dd79640 1 -- 172.21.15.50:0/2508559706 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f020819f830 con 0x7f02081024b0 2024-06-06T03:38:03.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.403+0000 7f020d578640 1 --2- 172.21.15.50:0/2508559706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0208100900 0x7f0208197c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:38:03.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.403+0000 7f020dd79640 1 --2- 172.21.15.50:0/2508559706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02081024b0 0x7f020819f190 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f020000cce0 tx=0x7f020000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:38:03.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.403+0000 7f01fe7fc640 1 -- 172.21.15.50:0/2508559706 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f020000f450 con 0x7f02081024b0 2024-06-06T03:38:03.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.403+0000 7f01fe7fc640 1 -- 172.21.15.50:0/2508559706 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f020000faa0 con 0x7f02081024b0 2024-06-06T03:38:03.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.403+0000 7f020f7dc640 1 -- 172.21.15.50:0/2508559706 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f020819fb20 con 0x7f02081024b0 2024-06-06T03:38:03.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.403+0000 7f01fe7fc640 1 -- 172.21.15.50:0/2508559706 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0200018b70 con 0x7f02081024b0 2024-06-06T03:38:03.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.403+0000 7f020f7dc640 1 -- 172.21.15.50:0/2508559706 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02081a0020 con 0x7f02081024b0 2024-06-06T03:38:03.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.404+0000 7f020f7dc640 1 -- 172.21.15.50:0/2508559706 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0208107c40 con 0x7f02081024b0 2024-06-06T03:38:03.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.405+0000 7f01fe7fc640 1 -- 172.21.15.50:0/2508559706 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0200018d10 con 0x7f02081024b0 2024-06-06T03:38:03.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.406+0000 7f01fe7fc640 1 --2- 172.21.15.50:0/2508559706 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f01f40a2b90 0x7f01f40a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:03.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.406+0000 7f01fe7fc640 1 -- 172.21.15.50:0/2508559706 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f02000cf880 con 0x7f02081024b0 2024-06-06T03:38:03.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.406+0000 7f020d578640 1 --2- 172.21.15.50:0/2508559706 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f01f40a2b90 0x7f01f40a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:03.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.406+0000 7f020d578640 1 --2- 172.21.15.50:0/2508559706 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f01f40a2b90 0x7f01f40a5050 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f02081990f0 tx=0x7f0204000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:38:03.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.410+0000 7f01fe7fc640 1 -- 172.21.15.50:0/2508559706 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0200014030 con 0x7f02081024b0 2024-06-06T03:38:03.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:03 smithi122 ceph-mon[35759]: pgmap v773: 129 pgs: 129 active+clean; 10 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 31 MiB/s wr, 583 op/s 2024-06-06T03:38:03.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:03 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/2059484516' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T03:38:03.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.597+0000 7f020f7dc640 1 -- 172.21.15.50:0/2508559706 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f02080625a0 con 0x7f02081024b0 2024-06-06T03:38:03.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.597+0000 7f01fe7fc640 1 -- 172.21.15.50:0/2508559706 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v99) ==== 104+0+11 (secure 0 0 0) 0x7f020009c400 con 0x7f02081024b0 2024-06-06T03:38:03.598 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-06-06T03:38:03.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.600+0000 7f020f7dc640 1 -- 172.21.15.50:0/2508559706 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f01f40a2b90 msgr2=0x7f01f40a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:03.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.600+0000 7f020f7dc640 1 --2- 172.21.15.50:0/2508559706 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f01f40a2b90 0x7f01f40a5050 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f02081990f0 tx=0x7f0204000bc0 comp rx=0 tx=0).stop 2024-06-06T03:38:03.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.600+0000 7f020f7dc640 1 -- 172.21.15.50:0/2508559706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02081024b0 msgr2=0x7f020819f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:03.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.600+0000 7f020f7dc640 1 --2- 172.21.15.50:0/2508559706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02081024b0 0x7f020819f190 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f020000cce0 tx=0x7f020000a620 comp rx=0 tx=0).stop 2024-06-06T03:38:03.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.600+0000 7f020f7dc640 1 -- 172.21.15.50:0/2508559706 shutdown_connections 2024-06-06T03:38:03.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.600+0000 7f020f7dc640 1 --2- 172.21.15.50:0/2508559706 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f01f40a2b90 0x7f01f40a5050 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:03.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.600+0000 7f020f7dc640 1 --2- 172.21.15.50:0/2508559706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02081024b0 0x7f020819f190 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:03.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.600+0000 7f020f7dc640 1 --2- 172.21.15.50:0/2508559706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0208101af0 0x7f0208198160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:03.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.600+0000 7f020f7dc640 1 --2- 172.21.15.50:0/2508559706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0208100900 0x7f0208197c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:03.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.600+0000 7f020f7dc640 1 -- 172.21.15.50:0/2508559706 >> 172.21.15.50:0/2508559706 conn(0x7f02080fbe90 msgr2=0x7f0208104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:38:03.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.600+0000 7f020f7dc640 1 -- 172.21.15.50:0/2508559706 shutdown_connections 2024-06-06T03:38:03.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.600+0000 7f020f7dc640 1 -- 172.21.15.50:0/2508559706 wait complete. 2024-06-06T03:38:03.611 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-06T03:38:03.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.719+0000 7fce20de2640 1 -- 172.21.15.50:0/4133605469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce1c102be0 msgr2=0x7fce1c103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:03.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.719+0000 7fce20de2640 1 --2- 172.21.15.50:0/4133605469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce1c102be0 0x7fce1c103060 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fce04009900 tx=0x7fce0402a410 comp rx=0 tx=0).stop 2024-06-06T03:38:03.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.719+0000 7fce20de2640 1 -- 172.21.15.50:0/4133605469 shutdown_connections 2024-06-06T03:38:03.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.719+0000 7fce20de2640 1 --2- 172.21.15.50:0/4133605469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce1c102be0 0x7fce1c103060 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:03.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.719+0000 7fce20de2640 1 --2- 172.21.15.50:0/4133605469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce1c1035a0 0x7fce1c109e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:03.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.719+0000 7fce20de2640 1 --2- 172.21.15.50:0/4133605469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce1c1019f0 0x7fce1c101e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:03.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.719+0000 7fce20de2640 1 -- 172.21.15.50:0/4133605469 >> 172.21.15.50:0/4133605469 conn(0x7fce1c0fcf80 msgr2=0x7fce1c0ff3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:38:03.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.719+0000 7fce20de2640 1 -- 172.21.15.50:0/4133605469 shutdown_connections 2024-06-06T03:38:03.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.719+0000 7fce20de2640 1 -- 172.21.15.50:0/4133605469 wait complete. 2024-06-06T03:38:03.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.719+0000 7fce20de2640 1 Processor -- start 2024-06-06T03:38:03.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.720+0000 7fce20de2640 1 -- start start 2024-06-06T03:38:03.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.720+0000 7fce20de2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce1c1019f0 0x7fce1c075750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:03.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.720+0000 7fce20de2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce1c102be0 0x7fce1c073d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:03.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.720+0000 7fce20de2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce1c1035a0 0x7fce1c0742d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:03.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.720+0000 7fce20de2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fce1c10d610 con 0x7fce1c1035a0 2024-06-06T03:38:03.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.720+0000 7fce20de2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fce1c10d490 con 0x7fce1c102be0 2024-06-06T03:38:03.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.720+0000 7fce20de2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fce1c10d790 con 0x7fce1c1019f0 2024-06-06T03:38:03.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.720+0000 7fce1ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce1c1035a0 0x7fce1c0742d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:03.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.720+0000 7fce1ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce1c1035a0 0x7fce1c0742d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38672/0 (socket says 172.21.15.50:38672) 2024-06-06T03:38:03.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.720+0000 7fce1ad9d640 1 -- 172.21.15.50:0/3644847761 learned_addr learned my addr 172.21.15.50:0/3644847761 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:38:03.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.720+0000 7fce1a59c640 1 --2- 172.21.15.50:0/3644847761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce1c1019f0 0x7fce1c075750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:03.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.720+0000 7fce13fff640 1 --2- 172.21.15.50:0/3644847761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce1c102be0 0x7fce1c073d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:03.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.720+0000 7fce1ad9d640 1 -- 172.21.15.50:0/3644847761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce1c1019f0 msgr2=0x7fce1c075750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:03.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.720+0000 7fce1ad9d640 1 --2- 172.21.15.50:0/3644847761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce1c1019f0 0x7fce1c075750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:03.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.720+0000 7fce1ad9d640 1 -- 172.21.15.50:0/3644847761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce1c102be0 msgr2=0x7fce1c073d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:03.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.720+0000 7fce1ad9d640 1 --2- 172.21.15.50:0/3644847761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce1c102be0 0x7fce1c073d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:03.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.720+0000 7fce1ad9d640 1 -- 172.21.15.50:0/3644847761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce1c074b60 con 0x7fce1c1035a0 2024-06-06T03:38:03.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.720+0000 7fce1ad9d640 1 --2- 172.21.15.50:0/3644847761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce1c1035a0 0x7fce1c0742d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fce1400b970 tx=0x7fce1400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:38:03.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.720+0000 7fce137fe640 1 -- 172.21.15.50:0/3644847761 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce14019070 con 0x7fce1c1035a0 2024-06-06T03:38:03.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.721+0000 7fce137fe640 1 -- 172.21.15.50:0/3644847761 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fce14014440 con 0x7fce1c1035a0 2024-06-06T03:38:03.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.721+0000 7fce20de2640 1 -- 172.21.15.50:0/3644847761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce1c1a1ef0 con 0x7fce1c1035a0 2024-06-06T03:38:03.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.721+0000 7fce137fe640 1 -- 172.21.15.50:0/3644847761 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce140075d0 con 0x7fce1c1035a0 2024-06-06T03:38:03.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.721+0000 7fce20de2640 1 -- 172.21.15.50:0/3644847761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce1c1a2380 con 0x7fce1c1035a0 2024-06-06T03:38:03.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.722+0000 7fce20de2640 1 -- 172.21.15.50:0/3644847761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce1c108e20 con 0x7fce1c1035a0 2024-06-06T03:38:03.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.723+0000 7fce137fe640 1 -- 172.21.15.50:0/3644847761 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fce1401c070 con 0x7fce1c1035a0 2024-06-06T03:38:03.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.723+0000 7fce137fe640 1 --2- 172.21.15.50:0/3644847761 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fce080a2b90 0x7fce080a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:03.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.724+0000 7fce1a59c640 1 --2- 172.21.15.50:0/3644847761 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fce080a2b90 0x7fce080a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:03.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.724+0000 7fce137fe640 1 -- 172.21.15.50:0/3644847761 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fce140cee50 con 0x7fce1c1035a0 2024-06-06T03:38:03.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.724+0000 7fce1a59c640 1 --2- 172.21.15.50:0/3644847761 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fce080a2b90 0x7fce080a5050 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fce1c102a40 tx=0x7fce0c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:38:03.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.727+0000 7fce137fe640 1 -- 172.21.15.50:0/3644847761 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fce1409ba30 con 0x7fce1c1035a0 2024-06-06T03:38:03.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.912+0000 7fce20de2640 1 -- 172.21.15.50:0/3644847761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fce1c062640 con 0x7fce1c1035a0 2024-06-06T03:38:03.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.913+0000 7fce137fe640 1 -- 172.21.15.50:0/3644847761 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v99) ==== 100+0+11 (secure 0 0 0) 0x7fce1409b330 con 0x7fce1c1035a0 2024-06-06T03:38:03.913 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-06-06T03:38:03.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.915+0000 7fce20de2640 1 -- 172.21.15.50:0/3644847761 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fce080a2b90 msgr2=0x7fce080a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:03.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.915+0000 7fce20de2640 1 --2- 172.21.15.50:0/3644847761 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fce080a2b90 0x7fce080a5050 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fce1c102a40 tx=0x7fce0c008040 comp rx=0 tx=0).stop 2024-06-06T03:38:03.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.915+0000 7fce20de2640 1 -- 172.21.15.50:0/3644847761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce1c1035a0 msgr2=0x7fce1c0742d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:03.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.915+0000 7fce20de2640 1 --2- 172.21.15.50:0/3644847761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce1c1035a0 0x7fce1c0742d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fce1400b970 tx=0x7fce1400be30 comp rx=0 tx=0).stop 2024-06-06T03:38:03.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.915+0000 7fce20de2640 1 -- 172.21.15.50:0/3644847761 shutdown_connections 2024-06-06T03:38:03.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.915+0000 7fce20de2640 1 --2- 172.21.15.50:0/3644847761 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fce080a2b90 0x7fce080a5050 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:03.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.915+0000 7fce20de2640 1 --2- 172.21.15.50:0/3644847761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce1c1035a0 0x7fce1c0742d0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:03.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.915+0000 7fce20de2640 1 --2- 172.21.15.50:0/3644847761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce1c102be0 0x7fce1c073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:03.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.915+0000 7fce20de2640 1 --2- 172.21.15.50:0/3644847761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce1c1019f0 0x7fce1c075750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:03.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.915+0000 7fce20de2640 1 -- 172.21.15.50:0/3644847761 >> 172.21.15.50:0/3644847761 conn(0x7fce1c0fcf80 msgr2=0x7fce1c105ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:38:03.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.915+0000 7fce20de2640 1 -- 172.21.15.50:0/3644847761 shutdown_connections 2024-06-06T03:38:03.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:03.915+0000 7fce20de2640 1 -- 172.21.15.50:0/3644847761 wait complete. 2024-06-06T03:38:03.926 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-06-06T03:38:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.086+0000 7fd612b85640 1 -- 172.21.15.50:0/1333759389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd60c101910 msgr2=0x7fd60c101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.086+0000 7fd612b85640 1 --2- 172.21.15.50:0/1333759389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd60c101910 0x7fd60c101d90 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009900 tx=0x7fd5fc02a410 comp rx=0 tx=0).stop 2024-06-06T03:38:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.086+0000 7fd612b85640 1 -- 172.21.15.50:0/1333759389 shutdown_connections 2024-06-06T03:38:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.086+0000 7fd612b85640 1 --2- 172.21.15.50:0/1333759389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd60c101910 0x7fd60c101d90 secure :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009900 tx=0x7fd5fc02a410 comp rx=0 tx=0).stop 2024-06-06T03:38:04.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.086+0000 7fd612b85640 1 --2- 172.21.15.50:0/1333759389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd60c1022d0 0x7fd60c108b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:04.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.086+0000 7fd612b85640 1 --2- 172.21.15.50:0/1333759389 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd60c100720 0x7fd60c100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:04.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.086+0000 7fd612b85640 1 -- 172.21.15.50:0/1333759389 >> 172.21.15.50:0/1333759389 conn(0x7fd60c0fbc90 msgr2=0x7fd60c0fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:38:04.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.086+0000 7fd612b85640 1 -- 172.21.15.50:0/1333759389 shutdown_connections 2024-06-06T03:38:04.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.086+0000 7fd612b85640 1 -- 172.21.15.50:0/1333759389 wait complete. 2024-06-06T03:38:04.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.087+0000 7fd612b85640 1 Processor -- start 2024-06-06T03:38:04.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.087+0000 7fd612b85640 1 -- start start 2024-06-06T03:38:04.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.087+0000 7fd612b85640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd60c100720 0x7fd60c110f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:04.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.087+0000 7fd612b85640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd60c1022d0 0x7fd60c111440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.087+0000 7fd612b85640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd60c114440 0x7fd60c1148f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.087+0000 7fd612b85640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c10b1c0 con 0x7fd60c114440 2024-06-06T03:38:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.087+0000 7fd612b85640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c10b040 con 0x7fd60c100720 2024-06-06T03:38:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.087+0000 7fd612b85640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c10b340 con 0x7fd60c1022d0 2024-06-06T03:38:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.087+0000 7fd612384640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd60c114440 0x7fd60c1148f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.087+0000 7fd612384640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd60c114440 0x7fd60c1148f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38700/0 (socket says 172.21.15.50:38700) 2024-06-06T03:38:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.087+0000 7fd612384640 1 -- 172.21.15.50:0/2743455778 learned_addr learned my addr 172.21.15.50:0/2743455778 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:38:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.088+0000 7fd611b83640 1 --2- 172.21.15.50:0/2743455778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd60c100720 0x7fd60c110f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.088+0000 7fd611382640 1 --2- 172.21.15.50:0/2743455778 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd60c1022d0 0x7fd60c111440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.088+0000 7fd611b83640 1 -- 172.21.15.50:0/2743455778 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd60c1022d0 msgr2=0x7fd60c111440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.088+0000 7fd611b83640 1 --2- 172.21.15.50:0/2743455778 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd60c1022d0 0x7fd60c111440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.088+0000 7fd611b83640 1 -- 172.21.15.50:0/2743455778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd60c114440 msgr2=0x7fd60c1148f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.088+0000 7fd611b83640 1 --2- 172.21.15.50:0/2743455778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd60c114440 0x7fd60c1148f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.088+0000 7fd611b83640 1 -- 172.21.15.50:0/2743455778 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60c114f30 con 0x7fd60c100720 2024-06-06T03:38:04.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.088+0000 7fd612384640 1 --2- 172.21.15.50:0/2743455778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd60c114440 0x7fd60c1148f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T03:38:04.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.088+0000 7fd611b83640 1 --2- 172.21.15.50:0/2743455778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd60c100720 0x7fd60c110f00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd60400be20 tx=0x7fd604009f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:38:04.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.091+0000 7fd602ffd640 1 -- 172.21.15.50:0/2743455778 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd604019070 con 0x7fd60c100720 2024-06-06T03:38:04.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.091+0000 7fd602ffd640 1 -- 172.21.15.50:0/2743455778 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd6040148f0 con 0x7fd60c100720 2024-06-06T03:38:04.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.091+0000 7fd602ffd640 1 -- 172.21.15.50:0/2743455778 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd604012910 con 0x7fd60c100720 2024-06-06T03:38:04.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.091+0000 7fd612b85640 1 -- 172.21.15.50:0/2743455778 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd60c115220 con 0x7fd60c100720 2024-06-06T03:38:04.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.092+0000 7fd612b85640 1 -- 172.21.15.50:0/2743455778 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd60c1156f0 con 0x7fd60c100720 2024-06-06T03:38:04.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.098+0000 7fd602ffd640 1 -- 172.21.15.50:0/2743455778 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd60401c070 con 0x7fd60c100720 2024-06-06T03:38:04.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.099+0000 7fd602ffd640 1 --2- 172.21.15.50:0/2743455778 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd5f80a2da0 0x7fd5f80a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:04.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.099+0000 7fd611382640 1 --2- 172.21.15.50:0/2743455778 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd5f80a2da0 0x7fd5f80a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:04.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.100+0000 7fd602ffd640 1 -- 172.21.15.50:0/2743455778 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fd6040cebd0 con 0x7fd60c100720 2024-06-06T03:38:04.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.100+0000 7fd611382640 1 --2- 172.21.15.50:0/2743455778 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd5f80a2da0 0x7fd5f80a5260 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009850 tx=0x7fd5fc005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:38:04.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.102+0000 7fd612b85640 1 -- 172.21.15.50:0/2743455778 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd60c067e50 con 0x7fd60c100720 2024-06-06T03:38:04.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.115+0000 7fd602ffd640 1 -- 172.21.15.50:0/2743455778 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd60409b100 con 0x7fd60c100720 2024-06-06T03:38:04.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:04 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/2675282565' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-06T03:38:04.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:04 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/2508559706' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-06T03:38:04.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:04 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3644847761' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-06T03:38:04.332 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:04 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/2675282565' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-06T03:38:04.333 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:04 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/2508559706' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-06T03:38:04.333 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:04 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/3644847761' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-06T03:38:04.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:04 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/2675282565' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-06T03:38:04.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:04 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/2508559706' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-06T03:38:04.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:04 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/3644847761' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-06T03:38:04.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.479+0000 7fd612b85640 1 -- 172.21.15.50:0/2743455778 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fd60c107aa0 con 0x7fd60c100720 2024-06-06T03:38:04.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.479+0000 7fd602ffd640 1 -- 172.21.15.50:0/2743455778 <== mon.2 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v99) ==== 103+0+11 (secure 0 0 0) 0x7fd60409f400 con 0x7fd60c100720 2024-06-06T03:38:04.482 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-06-06T03:38:04.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.488+0000 7fd612b85640 1 -- 172.21.15.50:0/2743455778 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd5f80a2da0 msgr2=0x7fd5f80a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:04.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.488+0000 7fd612b85640 1 --2- 172.21.15.50:0/2743455778 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd5f80a2da0 0x7fd5f80a5260 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009850 tx=0x7fd5fc005fd0 comp rx=0 tx=0).stop 2024-06-06T03:38:04.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.488+0000 7fd612b85640 1 -- 172.21.15.50:0/2743455778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd60c100720 msgr2=0x7fd60c110f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:04.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.488+0000 7fd612b85640 1 --2- 172.21.15.50:0/2743455778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd60c100720 0x7fd60c110f00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd60400be20 tx=0x7fd604009f70 comp rx=0 tx=0).stop 2024-06-06T03:38:04.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.488+0000 7fd612b85640 1 -- 172.21.15.50:0/2743455778 shutdown_connections 2024-06-06T03:38:04.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.488+0000 7fd612b85640 1 --2- 172.21.15.50:0/2743455778 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fd5f80a2da0 0x7fd5f80a5260 secure :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009850 tx=0x7fd5fc005fd0 comp rx=0 tx=0).stop 2024-06-06T03:38:04.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.488+0000 7fd612b85640 1 --2- 172.21.15.50:0/2743455778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd60c114440 0x7fd60c1148f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:04.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.488+0000 7fd612b85640 1 --2- 172.21.15.50:0/2743455778 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd60c1022d0 0x7fd60c111440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:04.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.488+0000 7fd612b85640 1 --2- 172.21.15.50:0/2743455778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd60c100720 0x7fd60c110f00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:04.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.488+0000 7fd612b85640 1 -- 172.21.15.50:0/2743455778 >> 172.21.15.50:0/2743455778 conn(0x7fd60c0fbc90 msgr2=0x7fd60c104ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:38:04.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.488+0000 7fd612b85640 1 -- 172.21.15.50:0/2743455778 shutdown_connections 2024-06-06T03:38:04.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.489+0000 7fd612b85640 1 -- 172.21.15.50:0/2743455778 wait complete. 2024-06-06T03:38:04.509 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-06-06T03:38:04.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.703+0000 7f8e9db34640 1 -- 172.21.15.50:0/1706526512 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e9810dce0 msgr2=0x7f8e9810e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:04.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.703+0000 7f8e9db34640 1 --2- 172.21.15.50:0/1706526512 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e9810dce0 0x7f8e9810e190 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c009900 tx=0x7f8e8c02a440 comp rx=0 tx=0).stop 2024-06-06T03:38:04.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.705+0000 7f8e9db34640 1 -- 172.21.15.50:0/1706526512 shutdown_connections 2024-06-06T03:38:04.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.705+0000 7f8e9db34640 1 --2- 172.21.15.50:0/1706526512 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e9810dce0 0x7f8e9810e190 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:04.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.706+0000 7f8e9db34640 1 --2- 172.21.15.50:0/1706526512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e9810b310 0x7f8e9810d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:04.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.706+0000 7f8e9db34640 1 --2- 172.21.15.50:0/1706526512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e981089a0 0x7f8e9810add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:04.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.706+0000 7f8e9db34640 1 -- 172.21.15.50:0/1706526512 >> 172.21.15.50:0/1706526512 conn(0x7f8e9806e840 msgr2=0x7f8e98070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:38:04.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.711+0000 7f8e9db34640 1 -- 172.21.15.50:0/1706526512 shutdown_connections 2024-06-06T03:38:04.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.712+0000 7f8e9db34640 1 -- 172.21.15.50:0/1706526512 wait complete. 2024-06-06T03:38:04.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.713+0000 7f8e9db34640 1 Processor -- start 2024-06-06T03:38:04.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.718+0000 7f8e9db34640 1 -- start start 2024-06-06T03:38:04.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.718+0000 7f8e9db34640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e981089a0 0x7f8e981a6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:04.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.718+0000 7f8e9db34640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e9810b310 0x7f8e981a6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:04.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.718+0000 7f8e9db34640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e9810dce0 0x7f8e981ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:04.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.718+0000 7f8e9db34640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8e9811c3a0 con 0x7f8e9810b310 2024-06-06T03:38:04.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.718+0000 7f8e9db34640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8e9811c220 con 0x7f8e981089a0 2024-06-06T03:38:04.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.718+0000 7f8e9db34640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8e9811c520 con 0x7f8e9810dce0 2024-06-06T03:38:04.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.719+0000 7f8e96ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e9810b310 0x7f8e981a6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:04.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.719+0000 7f8e96ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e9810b310 0x7f8e981a6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38712/0 (socket says 172.21.15.50:38712) 2024-06-06T03:38:04.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.719+0000 7f8e96ffd640 1 -- 172.21.15.50:0/763756267 learned_addr learned my addr 172.21.15.50:0/763756267 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:38:04.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.719+0000 7f8e97fff640 1 --2- 172.21.15.50:0/763756267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e9810dce0 0x7f8e981ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:04.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.720+0000 7f8e977fe640 1 --2- 172.21.15.50:0/763756267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e981089a0 0x7f8e981a6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:04.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.720+0000 7f8e96ffd640 1 -- 172.21.15.50:0/763756267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e9810dce0 msgr2=0x7f8e981ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:04.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.720+0000 7f8e96ffd640 1 --2- 172.21.15.50:0/763756267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e9810dce0 0x7f8e981ae030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:04.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.720+0000 7f8e96ffd640 1 -- 172.21.15.50:0/763756267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e981089a0 msgr2=0x7f8e981a6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:04.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.720+0000 7f8e96ffd640 1 --2- 172.21.15.50:0/763756267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e981089a0 0x7f8e981a6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:04.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.720+0000 7f8e96ffd640 1 -- 172.21.15.50:0/763756267 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e981ae6a0 con 0x7f8e9810b310 2024-06-06T03:38:04.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.721+0000 7f8e96ffd640 1 --2- 172.21.15.50:0/763756267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e9810b310 0x7f8e981a6fc0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f8e8800b470 tx=0x7f8e8800b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:38:04.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.722+0000 7f8e94ff9640 1 -- 172.21.15.50:0/763756267 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e88015020 con 0x7f8e9810b310 2024-06-06T03:38:04.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.722+0000 7f8e9db34640 1 -- 172.21.15.50:0/763756267 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e981ae990 con 0x7f8e9810b310 2024-06-06T03:38:04.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.722+0000 7f8e9db34640 1 -- 172.21.15.50:0/763756267 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e981aef60 con 0x7f8e9810b310 2024-06-06T03:38:04.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.722+0000 7f8e94ff9640 1 -- 172.21.15.50:0/763756267 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8e88011d40 con 0x7f8e9810b310 2024-06-06T03:38:04.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.722+0000 7f8e94ff9640 1 -- 172.21.15.50:0/763756267 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8800f340 con 0x7f8e9810b310 2024-06-06T03:38:04.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.725+0000 7f8e9db34640 1 -- 172.21.15.50:0/763756267 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e840052c0 con 0x7f8e9810b310 2024-06-06T03:38:04.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.726+0000 7f8e94ff9640 1 -- 172.21.15.50:0/763756267 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8e88018020 con 0x7f8e9810b310 2024-06-06T03:38:04.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.727+0000 7f8e94ff9640 1 --2- 172.21.15.50:0/763756267 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8e800a2d90 0x7f8e800a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:04.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.728+0000 7f8e94ff9640 1 -- 172.21.15.50:0/763756267 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f8e880cedc0 con 0x7f8e9810b310 2024-06-06T03:38:04.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.736+0000 7f8e94ff9640 1 -- 172.21.15.50:0/763756267 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8e8801f020 con 0x7f8e9810b310 2024-06-06T03:38:04.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.738+0000 7f8e977fe640 1 --2- 172.21.15.50:0/763756267 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8e800a2d90 0x7f8e800a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:04.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:04.740+0000 7f8e977fe640 1 --2- 172.21.15.50:0/763756267 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8e800a2d90 0x7f8e800a5250 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8e90005c40 tx=0x7f8e90005bd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:38:05.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:05.199+0000 7f8e9db34640 1 -- 172.21.15.50:0/763756267 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f8e840055b0 con 0x7f8e9810b310 2024-06-06T03:38:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:05.220+0000 7f8e94ff9640 1 -- 172.21.15.50:0/763756267 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+740371 (secure 0 0 0) 0x7f8e8800d040 con 0x7f8e9810b310 2024-06-06T03:38:05.231 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-06-06T03:38:05.231 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:38:05.231 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 18, 2024-06-06T03:38:05.231 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.231 INFO:teuthology.orchestra.run.smithi050.stdout: "active_gid": 14152, 2024-06-06T03:38:05.231 INFO:teuthology.orchestra.run.smithi050.stdout: "active_name": "x", 2024-06-06T03:38:05.231 INFO:teuthology.orchestra.run.smithi050.stdout: "active_addrs": { 2024-06-06T03:38:05.232 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-06-06T03:38:05.232 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.232 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-06-06T03:38:05.232 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2024-06-06T03:38:05.232 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1779941165 2024-06-06T03:38:05.232 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.232 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.232 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-06-06T03:38:05.232 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2024-06-06T03:38:05.232 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1779941165 2024-06-06T03:38:05.232 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.232 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-06-06T03:38:05.233 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.233 INFO:teuthology.orchestra.run.smithi050.stdout: "active_addr": "172.21.15.50:6801/1779941165", 2024-06-06T03:38:05.233 INFO:teuthology.orchestra.run.smithi050.stdout: "active_change": "2024-06-06T03:15:13.252355+0000", 2024-06-06T03:38:05.233 INFO:teuthology.orchestra.run.smithi050.stdout: "active_mgr_features": 4540701547738038271, 2024-06-06T03:38:05.233 INFO:teuthology.orchestra.run.smithi050.stdout: "available": true, 2024-06-06T03:38:05.233 INFO:teuthology.orchestra.run.smithi050.stdout: "standbys": [ 2024-06-06T03:38:05.233 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.233 INFO:teuthology.orchestra.run.smithi050.stdout: "gid": 24109, 2024-06-06T03:38:05.233 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "z", 2024-06-06T03:38:05.233 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_features": 4540701547738038271, 2024-06-06T03:38:05.233 INFO:teuthology.orchestra.run.smithi050.stdout: "available_modules": [ 2024-06-06T03:38:05.233 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.233 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "alerts", 2024-06-06T03:38:05.234 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.234 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.234 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.234 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-06-06T03:38:05.234 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-06-06T03:38:05.234 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.234 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.234 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.234 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-06-06T03:38:05.234 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.234 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.234 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.234 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How frequently to reexamine health status", 2024-06-06T03:38:05.235 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.235 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.235 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.235 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.235 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.235 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.235 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.235 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.235 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.235 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.235 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.235 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.235 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.236 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.236 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.236 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.236 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.236 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.236 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.236 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.236 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.236 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.236 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.236 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.236 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.236 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.236 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.236 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.237 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.237 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.237 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.237 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.237 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.237 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.237 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.237 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.237 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.237 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.237 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.237 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.237 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.237 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.238 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.238 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.238 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.238 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.238 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.238 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.238 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.238 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.238 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.238 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.238 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.238 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.238 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.239 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.239 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.239 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.239 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.239 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.239 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.239 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.239 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.239 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.239 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.239 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.239 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.239 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.239 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.240 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.240 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_destination": { 2024-06-06T03:38:05.240 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_destination", 2024-06-06T03:38:05.240 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.240 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.240 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.240 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.240 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.240 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.240 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.240 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Email address to send alerts to", 2024-06-06T03:38:05.240 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.240 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.240 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.241 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_from_name": { 2024-06-06T03:38:05.241 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_from_name", 2024-06-06T03:38:05.241 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.241 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.241 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.241 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "Ceph", 2024-06-06T03:38:05.241 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.241 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.241 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.241 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Email From: name", 2024-06-06T03:38:05.241 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.241 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.241 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.241 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_host": { 2024-06-06T03:38:05.242 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_host", 2024-06-06T03:38:05.242 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.242 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.242 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.242 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.242 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.242 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.242 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.242 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP server", 2024-06-06T03:38:05.242 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.242 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.242 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.242 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.242 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_password": { 2024-06-06T03:38:05.243 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_password", 2024-06-06T03:38:05.243 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.243 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.243 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.243 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.243 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.243 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.243 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.243 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Password to authenticate with", 2024-06-06T03:38:05.243 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.243 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.243 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.243 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.243 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_port": { 2024-06-06T03:38:05.243 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_port", 2024-06-06T03:38:05.243 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.243 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.244 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.244 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "465", 2024-06-06T03:38:05.244 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.244 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.244 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.244 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP port", 2024-06-06T03:38:05.244 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.244 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.244 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.244 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_sender": { 2024-06-06T03:38:05.244 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_sender", 2024-06-06T03:38:05.244 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.244 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.244 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.244 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.245 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.245 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.245 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.245 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP envelope sender", 2024-06-06T03:38:05.245 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.245 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.245 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.245 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_ssl": { 2024-06-06T03:38:05.245 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_ssl", 2024-06-06T03:38:05.245 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.245 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.245 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.246 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.246 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.246 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.246 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.246 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use SSL to connect to SMTP server", 2024-06-06T03:38:05.246 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.246 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.246 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.246 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.246 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_user": { 2024-06-06T03:38:05.246 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_user", 2024-06-06T03:38:05.246 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.246 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.246 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.247 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.247 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.247 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.247 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.247 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "User to authenticate as", 2024-06-06T03:38:05.247 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.247 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.247 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.247 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.247 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.247 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.247 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "balancer", 2024-06-06T03:38:05.247 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.247 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.248 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.248 INFO:teuthology.orchestra.run.smithi050.stdout: "active": { 2024-06-06T03:38:05.248 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "active", 2024-06-06T03:38:05.248 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.248 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.248 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.248 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.248 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.248 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.248 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.248 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "automatically balance PGs across cluster", 2024-06-06T03:38:05.248 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.248 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.248 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.248 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.248 INFO:teuthology.orchestra.run.smithi050.stdout: "begin_time": { 2024-06-06T03:38:05.248 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "begin_time", 2024-06-06T03:38:05.249 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.249 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.249 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.249 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0000", 2024-06-06T03:38:05.249 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.249 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.249 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.249 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "beginning time of day to automatically balance", 2024-06-06T03:38:05.249 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-06T03:38:05.249 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.249 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.249 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.249 INFO:teuthology.orchestra.run.smithi050.stdout: "begin_weekday": { 2024-06-06T03:38:05.249 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "begin_weekday", 2024-06-06T03:38:05.249 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-06-06T03:38:05.250 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.250 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.250 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-06-06T03:38:05.250 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0", 2024-06-06T03:38:05.250 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "6", 2024-06-06T03:38:05.250 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.250 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-06-06T03:38:05.250 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-06T03:38:05.250 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.250 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.250 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.250 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_max_iterations": { 2024-06-06T03:38:05.250 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_max_iterations", 2024-06-06T03:38:05.250 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-06-06T03:38:05.250 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.251 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.251 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "25", 2024-06-06T03:38:05.251 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-06-06T03:38:05.251 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "250", 2024-06-06T03:38:05.251 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.251 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-06-06T03:38:05.251 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.251 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.251 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.251 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.251 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_metrics": { 2024-06-06T03:38:05.251 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_metrics", 2024-06-06T03:38:05.251 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.251 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.251 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.251 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "pgs,objects,bytes", 2024-06-06T03:38:05.252 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.252 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.252 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.252 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-06-06T03:38:05.252 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-06-06T03:38:05.252 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.252 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.252 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.252 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_step": { 2024-06-06T03:38:05.252 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_step", 2024-06-06T03:38:05.252 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-06-06T03:38:05.252 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.252 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.252 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0.5", 2024-06-06T03:38:05.253 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0.001", 2024-06-06T03:38:05.253 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "0.999", 2024-06-06T03:38:05.253 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.253 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "aggressiveness of optimization", 2024-06-06T03:38:05.253 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-06-06T03:38:05.253 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.253 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.253 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.253 INFO:teuthology.orchestra.run.smithi050.stdout: "end_time": { 2024-06-06T03:38:05.253 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "end_time", 2024-06-06T03:38:05.253 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.253 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.253 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.253 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "2359", 2024-06-06T03:38:05.253 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.254 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.254 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.254 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "ending time of day to automatically balance", 2024-06-06T03:38:05.254 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-06T03:38:05.254 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.254 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.254 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.254 INFO:teuthology.orchestra.run.smithi050.stdout: "end_weekday": { 2024-06-06T03:38:05.254 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "end_weekday", 2024-06-06T03:38:05.254 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-06-06T03:38:05.254 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.254 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.254 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-06-06T03:38:05.254 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0", 2024-06-06T03:38:05.255 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "6", 2024-06-06T03:38:05.255 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.255 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-06-06T03:38:05.255 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-06T03:38:05.255 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.255 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.255 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.255 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.255 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.255 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.255 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.255 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.255 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.255 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.256 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.256 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.256 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.256 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.256 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.256 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.256 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.256 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.256 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.256 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.256 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.256 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.256 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.256 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.256 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.256 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.257 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.257 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.257 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.257 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.257 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.257 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.257 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.257 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.257 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.257 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.257 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.257 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.258 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.258 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.258 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.258 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.258 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.258 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.258 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.258 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.258 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.258 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.259 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.259 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.259 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.259 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.259 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.259 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.259 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.259 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.259 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.259 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.259 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.260 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.260 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.260 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.260 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.260 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.260 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.260 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.260 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.260 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.260 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.260 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.260 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.260 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.261 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.261 INFO:teuthology.orchestra.run.smithi050.stdout: "min_score": { 2024-06-06T03:38:05.261 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "min_score", 2024-06-06T03:38:05.261 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-06-06T03:38:05.261 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.261 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.261 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-06-06T03:38:05.261 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.261 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.261 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.261 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-06-06T03:38:05.262 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.262 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.262 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.262 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": { 2024-06-06T03:38:05.262 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mode", 2024-06-06T03:38:05.262 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.262 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.262 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.262 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "upmap", 2024-06-06T03:38:05.262 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.262 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.262 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.263 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-compat", 2024-06-06T03:38:05.263 INFO:teuthology.orchestra.run.smithi050.stdout: "none", 2024-06-06T03:38:05.263 INFO:teuthology.orchestra.run.smithi050.stdout: "read", 2024-06-06T03:38:05.263 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap", 2024-06-06T03:38:05.263 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap-read" 2024-06-06T03:38:05.263 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.263 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Balancer mode", 2024-06-06T03:38:05.263 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.263 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.263 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.263 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.263 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_ids": { 2024-06-06T03:38:05.263 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pool_ids", 2024-06-06T03:38:05.263 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.263 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.264 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.264 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.264 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.264 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.264 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.264 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-06-06T03:38:05.264 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.264 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.264 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.264 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-06-06T03:38:05.264 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-06-06T03:38:05.264 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.264 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.264 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.265 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-06-06T03:38:05.265 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.265 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.265 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.265 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-06-06T03:38:05.265 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.265 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.265 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.265 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.265 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap_max_deviation": { 2024-06-06T03:38:05.265 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "upmap_max_deviation", 2024-06-06T03:38:05.265 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.265 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.265 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.265 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-06-06T03:38:05.265 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-06-06T03:38:05.266 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.266 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.266 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "deviation below which no optimization is attempted", 2024-06-06T03:38:05.266 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-06-06T03:38:05.266 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.266 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.266 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.266 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap_max_optimizations": { 2024-06-06T03:38:05.266 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "upmap_max_optimizations", 2024-06-06T03:38:05.266 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-06-06T03:38:05.266 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.266 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.266 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-06-06T03:38:05.266 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.267 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.267 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.267 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-06-06T03:38:05.267 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.267 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.267 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.267 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.267 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.267 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.267 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.267 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephadm", 2024-06-06T03:38:05.267 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.268 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.268 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.268 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_down_multiplier": { 2024-06-06T03:38:05.268 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_down_multiplier", 2024-06-06T03:38:05.268 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-06-06T03:38:05.268 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.268 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.268 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3.0", 2024-06-06T03:38:05.268 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.268 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.268 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.268 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-06-06T03:38:05.268 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.268 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.268 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.269 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.269 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_refresh_rate": { 2024-06-06T03:38:05.269 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_refresh_rate", 2024-06-06T03:38:05.269 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.269 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.269 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.269 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "20", 2024-06-06T03:38:05.269 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.269 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.269 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.269 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-06-06T03:38:05.269 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.269 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.269 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.270 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.270 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_starting_port": { 2024-06-06T03:38:05.270 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_starting_port", 2024-06-06T03:38:05.270 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.270 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.270 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.270 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "4721", 2024-06-06T03:38:05.270 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.270 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.270 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.270 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-06-06T03:38:05.270 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.271 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.271 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.271 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.271 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_ptrace": { 2024-06-06T03:38:05.271 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_ptrace", 2024-06-06T03:38:05.271 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.271 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.271 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.271 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.271 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.271 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.271 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.271 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-06-06T03:38:05.272 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-06-06T03:38:05.272 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.272 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.272 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.272 INFO:teuthology.orchestra.run.smithi050.stdout: "autotune_interval": { 2024-06-06T03:38:05.272 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "autotune_interval", 2024-06-06T03:38:05.272 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.272 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.272 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.272 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-06-06T03:38:05.272 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.272 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.273 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.273 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to autotune daemon memory", 2024-06-06T03:38:05.273 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.273 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.273 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.273 INFO:teuthology.orchestra.run.smithi050.stdout: "autotune_memory_target_ratio": { 2024-06-06T03:38:05.273 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "autotune_memory_target_ratio", 2024-06-06T03:38:05.273 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-06-06T03:38:05.273 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.273 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.273 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0.7", 2024-06-06T03:38:05.273 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.273 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.274 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.274 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-06-06T03:38:05.274 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.274 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.274 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.274 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.274 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm_log_destination": { 2024-06-06T03:38:05.274 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephadm_log_destination", 2024-06-06T03:38:05.274 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.274 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.274 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.274 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.274 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.275 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.275 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.275 INFO:teuthology.orchestra.run.smithi050.stdout: "file", 2024-06-06T03:38:05.275 INFO:teuthology.orchestra.run.smithi050.stdout: "file,syslog", 2024-06-06T03:38:05.275 INFO:teuthology.orchestra.run.smithi050.stdout: "syslog" 2024-06-06T03:38:05.275 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.275 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-06-06T03:38:05.275 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.275 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.275 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.275 INFO:teuthology.orchestra.run.smithi050.stdout: "cgroups_split": { 2024-06-06T03:38:05.275 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cgroups_split", 2024-06-06T03:38:05.275 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.275 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.275 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.276 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.276 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.276 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.276 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.276 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-06-06T03:38:05.276 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.276 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.276 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.276 INFO:teuthology.orchestra.run.smithi050.stdout: "config_checks_enabled": { 2024-06-06T03:38:05.276 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_checks_enabled", 2024-06-06T03:38:05.277 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.277 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.277 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.277 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.277 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.277 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.277 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.277 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-06-06T03:38:05.277 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.277 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.277 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.277 INFO:teuthology.orchestra.run.smithi050.stdout: "config_dashboard": { 2024-06-06T03:38:05.277 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_dashboard", 2024-06-06T03:38:05.277 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.277 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.278 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.278 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.278 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.278 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.278 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.278 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-06-06T03:38:05.278 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.278 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.278 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.278 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_alertmanager": { 2024-06-06T03:38:05.278 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_alertmanager", 2024-06-06T03:38:05.278 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.278 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.278 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.279 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-06-06T03:38:05.279 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.279 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.279 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.279 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-06-06T03:38:05.279 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.279 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.279 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.279 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_base": { 2024-06-06T03:38:05.279 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_base", 2024-06-06T03:38:05.279 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.279 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.279 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.279 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/ceph", 2024-06-06T03:38:05.279 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.280 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.280 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.280 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Container image name, without the tag", 2024-06-06T03:38:05.280 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.280 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.280 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.280 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_elasticsearch": { 2024-06-06T03:38:05.280 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_elasticsearch", 2024-06-06T03:38:05.280 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.280 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.280 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.280 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-06-06T03:38:05.280 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.280 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.281 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.281 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "elasticsearch container image", 2024-06-06T03:38:05.281 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.281 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.281 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.281 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.281 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_grafana": { 2024-06-06T03:38:05.281 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_grafana", 2024-06-06T03:38:05.281 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.281 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.281 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.281 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-06-06T03:38:05.281 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.281 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.281 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.282 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-06-06T03:38:05.282 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.282 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.282 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.282 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.282 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_haproxy": { 2024-06-06T03:38:05.282 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_haproxy", 2024-06-06T03:38:05.282 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.282 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.282 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.282 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-06-06T03:38:05.282 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.282 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.283 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.283 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "HAproxy container image", 2024-06-06T03:38:05.283 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.283 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.283 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.283 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_agent": { 2024-06-06T03:38:05.283 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_agent", 2024-06-06T03:38:05.283 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.283 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.283 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.283 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-06-06T03:38:05.283 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.284 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.284 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.284 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger agent container image", 2024-06-06T03:38:05.284 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.284 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.284 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.284 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_collector": { 2024-06-06T03:38:05.284 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_collector", 2024-06-06T03:38:05.284 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.284 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.284 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.284 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-06-06T03:38:05.285 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.285 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.285 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.285 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger collector container image", 2024-06-06T03:38:05.285 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.285 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.285 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.285 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.285 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_query": { 2024-06-06T03:38:05.285 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_query", 2024-06-06T03:38:05.285 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.285 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.285 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.285 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-06-06T03:38:05.286 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.286 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.286 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.286 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger query container image", 2024-06-06T03:38:05.286 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.286 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.286 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.286 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.286 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_keepalived": { 2024-06-06T03:38:05.286 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_keepalived", 2024-06-06T03:38:05.286 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.286 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.286 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.287 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-06-06T03:38:05.287 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.287 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.287 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.287 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Keepalived container image", 2024-06-06T03:38:05.287 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.287 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.287 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.287 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.287 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_loki": { 2024-06-06T03:38:05.287 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_loki", 2024-06-06T03:38:05.287 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.287 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.287 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.287 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-06-06T03:38:05.288 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.288 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.288 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.288 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Loki container image", 2024-06-06T03:38:05.288 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.288 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.288 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.288 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.288 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_node_exporter": { 2024-06-06T03:38:05.288 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_node_exporter", 2024-06-06T03:38:05.288 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.288 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.288 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.288 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-06-06T03:38:05.288 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.289 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.289 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.289 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-06-06T03:38:05.289 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.289 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.289 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.289 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.289 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_nvmeof": { 2024-06-06T03:38:05.289 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_nvmeof", 2024-06-06T03:38:05.289 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.289 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.289 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.289 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-06-06T03:38:05.289 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.290 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.290 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.290 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Nvme-of container image", 2024-06-06T03:38:05.290 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.290 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.290 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.290 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.290 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_prometheus": { 2024-06-06T03:38:05.290 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_prometheus", 2024-06-06T03:38:05.290 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.290 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.290 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.290 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-06-06T03:38:05.290 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.291 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.291 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.291 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-06-06T03:38:05.291 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.291 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.291 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.291 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.291 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_promtail": { 2024-06-06T03:38:05.291 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_promtail", 2024-06-06T03:38:05.291 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.291 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.291 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.291 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-06-06T03:38:05.292 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.292 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.292 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.292 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Promtail container image", 2024-06-06T03:38:05.292 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.292 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.292 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.292 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.292 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_samba": { 2024-06-06T03:38:05.292 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_samba", 2024-06-06T03:38:05.292 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.292 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.292 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.292 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-06-06T03:38:05.293 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.293 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.293 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.293 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Samba/SMB container image", 2024-06-06T03:38:05.293 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.293 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.293 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.293 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_snmp_gateway": { 2024-06-06T03:38:05.293 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_snmp_gateway", 2024-06-06T03:38:05.293 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.293 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.293 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.294 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-06-06T03:38:05.294 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.294 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.294 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.294 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SNMP Gateway container image", 2024-06-06T03:38:05.294 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.294 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.294 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.294 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.294 INFO:teuthology.orchestra.run.smithi050.stdout: "container_init": { 2024-06-06T03:38:05.294 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_init", 2024-06-06T03:38:05.294 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.294 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.294 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.295 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.295 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.295 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.295 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.295 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Run podman/docker with `--init`", 2024-06-06T03:38:05.295 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.295 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.295 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.295 INFO:teuthology.orchestra.run.smithi050.stdout: "daemon_cache_timeout": { 2024-06-06T03:38:05.295 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "daemon_cache_timeout", 2024-06-06T03:38:05.295 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.295 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.296 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.296 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-06-06T03:38:05.296 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.296 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.296 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.296 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-06-06T03:38:05.296 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.296 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.296 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.296 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.296 INFO:teuthology.orchestra.run.smithi050.stdout: "default_cephadm_command_timeout": { 2024-06-06T03:38:05.296 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "default_cephadm_command_timeout", 2024-06-06T03:38:05.296 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.297 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.297 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.297 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "900", 2024-06-06T03:38:05.297 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.297 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.297 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.297 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-06-06T03:38:05.297 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.297 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.297 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.297 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.297 INFO:teuthology.orchestra.run.smithi050.stdout: "default_registry": { 2024-06-06T03:38:05.297 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "default_registry", 2024-06-06T03:38:05.297 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.298 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.298 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.298 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io", 2024-06-06T03:38:05.298 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.298 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.298 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.298 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-06-06T03:38:05.298 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.298 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.298 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.298 INFO:teuthology.orchestra.run.smithi050.stdout: "device_cache_timeout": { 2024-06-06T03:38:05.298 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_cache_timeout", 2024-06-06T03:38:05.298 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.299 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.299 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.299 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1800", 2024-06-06T03:38:05.299 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.299 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.299 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.299 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache device inventory", 2024-06-06T03:38:05.299 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.299 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.299 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.299 INFO:teuthology.orchestra.run.smithi050.stdout: "device_enhanced_scan": { 2024-06-06T03:38:05.299 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_enhanced_scan", 2024-06-06T03:38:05.299 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.300 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.300 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.300 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.300 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.300 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.300 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.300 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use libstoragemgmt during device scans", 2024-06-06T03:38:05.300 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.300 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.300 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.300 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.300 INFO:teuthology.orchestra.run.smithi050.stdout: "facts_cache_timeout": { 2024-06-06T03:38:05.300 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "facts_cache_timeout", 2024-06-06T03:38:05.300 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.300 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.300 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.301 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-06-06T03:38:05.301 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.301 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.301 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.301 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache host facts data", 2024-06-06T03:38:05.301 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.301 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.301 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.301 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.301 INFO:teuthology.orchestra.run.smithi050.stdout: "grafana_dashboards_path": { 2024-06-06T03:38:05.301 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "grafana_dashboards_path", 2024-06-06T03:38:05.301 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.301 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.301 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.302 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-06-06T03:38:05.302 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.302 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.302 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.302 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-06-06T03:38:05.302 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.302 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.302 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.302 INFO:teuthology.orchestra.run.smithi050.stdout: "host_check_interval": { 2024-06-06T03:38:05.302 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "host_check_interval", 2024-06-06T03:38:05.302 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.302 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.302 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.303 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-06-06T03:38:05.303 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.303 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.303 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.303 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to perform a host check", 2024-06-06T03:38:05.303 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.303 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.303 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.303 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.303 INFO:teuthology.orchestra.run.smithi050.stdout: "hw_monitoring": { 2024-06-06T03:38:05.303 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "hw_monitoring", 2024-06-06T03:38:05.303 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.303 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.303 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.303 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.304 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.304 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.304 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.304 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-06-06T03:38:05.304 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.304 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.304 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.304 INFO:teuthology.orchestra.run.smithi050.stdout: "inventory_list_all": { 2024-06-06T03:38:05.304 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "inventory_list_all", 2024-06-06T03:38:05.304 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.304 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.304 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.304 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.304 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.304 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.305 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.305 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-06-06T03:38:05.305 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.305 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.305 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.305 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.305 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.305 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.305 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.305 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.305 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.305 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.305 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.305 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.306 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.306 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.306 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.306 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.306 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.306 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.306 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.306 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.306 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.306 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.306 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.306 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.306 INFO:teuthology.orchestra.run.smithi050.stdout: "log_refresh_metadata": { 2024-06-06T03:38:05.306 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_refresh_metadata", 2024-06-06T03:38:05.307 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.307 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.307 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.307 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.307 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.307 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.307 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.307 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-06-06T03:38:05.307 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.307 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.307 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.307 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.307 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.308 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.308 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.308 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.308 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.308 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.308 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.308 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.308 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-06-06T03:38:05.308 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.308 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.308 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.308 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.308 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.308 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.308 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.308 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.308 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.309 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.309 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.309 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.309 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.309 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.309 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.309 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.309 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.309 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.309 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.309 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.309 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.309 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.309 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.309 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.310 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.310 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.310 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.310 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.310 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.310 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.310 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.310 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.310 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.310 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.310 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.310 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.310 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.310 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.311 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.311 INFO:teuthology.orchestra.run.smithi050.stdout: "manage_etc_ceph_ceph_conf": { 2024-06-06T03:38:05.311 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-06-06T03:38:05.311 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.311 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.311 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.311 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.311 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.311 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.311 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.311 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-06-06T03:38:05.311 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.311 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.311 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.311 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.311 INFO:teuthology.orchestra.run.smithi050.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-06-06T03:38:05.312 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-06-06T03:38:05.312 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.312 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.312 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.312 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "*", 2024-06-06T03:38:05.312 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.312 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.312 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.312 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-06-06T03:38:05.312 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.312 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.312 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.312 INFO:teuthology.orchestra.run.smithi050.stdout: "max_count_per_host": { 2024-06-06T03:38:05.313 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_count_per_host", 2024-06-06T03:38:05.313 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.313 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.313 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.313 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-06-06T03:38:05.313 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.313 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.313 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.313 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "max number of daemons per service per host", 2024-06-06T03:38:05.313 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.313 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.313 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.313 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd_draining_count": { 2024-06-06T03:38:05.313 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_osd_draining_count", 2024-06-06T03:38:05.313 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.314 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.314 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.314 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-06-06T03:38:05.314 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.314 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.314 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.314 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-06-06T03:38:05.314 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.314 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.314 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.314 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.314 INFO:teuthology.orchestra.run.smithi050.stdout: "migration_current": { 2024-06-06T03:38:05.314 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "migration_current", 2024-06-06T03:38:05.315 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.315 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.315 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.315 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.315 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.315 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.315 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.315 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "internal - do not modify", 2024-06-06T03:38:05.315 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.315 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.315 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.315 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.315 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": { 2024-06-06T03:38:05.315 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mode", 2024-06-06T03:38:05.315 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.316 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.316 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.316 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "root", 2024-06-06T03:38:05.316 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.316 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.316 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.316 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm-package", 2024-06-06T03:38:05.316 INFO:teuthology.orchestra.run.smithi050.stdout: "root" 2024-06-06T03:38:05.316 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.316 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "mode for remote execution of cephadm", 2024-06-06T03:38:05.316 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.316 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.316 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.316 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.317 INFO:teuthology.orchestra.run.smithi050.stdout: "oob_default_addr": { 2024-06-06T03:38:05.317 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "oob_default_addr", 2024-06-06T03:38:05.317 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.317 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.317 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.317 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "169.254.1.1", 2024-06-06T03:38:05.317 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.317 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.317 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.317 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Default address for RedFish API (oob management).", 2024-06-06T03:38:05.317 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.317 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.317 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.317 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.317 INFO:teuthology.orchestra.run.smithi050.stdout: "prometheus_alerts_path": { 2024-06-06T03:38:05.318 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prometheus_alerts_path", 2024-06-06T03:38:05.318 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.318 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.318 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.318 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-06-06T03:38:05.318 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.318 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.318 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.318 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-06-06T03:38:05.318 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.318 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.318 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.318 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.318 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_insecure": { 2024-06-06T03:38:05.319 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_insecure", 2024-06-06T03:38:05.319 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.319 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.319 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.319 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.319 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.319 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.319 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.319 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-06-06T03:38:05.319 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.319 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.319 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.319 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_password": { 2024-06-06T03:38:05.320 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_password", 2024-06-06T03:38:05.320 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.320 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.320 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.320 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.320 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.320 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.320 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.320 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-06-06T03:38:05.320 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.320 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.320 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.320 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_url": { 2024-06-06T03:38:05.320 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_url", 2024-06-06T03:38:05.321 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.321 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.321 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.321 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.321 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.321 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.321 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.321 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-06-06T03:38:05.321 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.321 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.321 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.322 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_username": { 2024-06-06T03:38:05.322 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_username", 2024-06-06T03:38:05.322 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.322 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.322 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.322 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.322 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.322 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.322 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.322 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-06-06T03:38:05.322 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.322 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.322 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.322 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.323 INFO:teuthology.orchestra.run.smithi050.stdout: "secure_monitoring_stack": { 2024-06-06T03:38:05.323 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "secure_monitoring_stack", 2024-06-06T03:38:05.323 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.323 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.323 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.323 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.323 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.323 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.323 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.323 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-06-06T03:38:05.323 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.323 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.323 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.323 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.324 INFO:teuthology.orchestra.run.smithi050.stdout: "service_discovery_port": { 2024-06-06T03:38:05.324 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "service_discovery_port", 2024-06-06T03:38:05.324 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.324 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.324 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.324 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8765", 2024-06-06T03:38:05.324 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.324 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.324 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.324 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "cephadm service discovery port", 2024-06-06T03:38:05.324 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.324 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.324 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.325 INFO:teuthology.orchestra.run.smithi050.stdout: "ssh_config_file": { 2024-06-06T03:38:05.325 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssh_config_file", 2024-06-06T03:38:05.325 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.325 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.325 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.325 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.325 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.325 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.325 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.325 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-06-06T03:38:05.325 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.325 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.325 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.326 INFO:teuthology.orchestra.run.smithi050.stdout: "use_agent": { 2024-06-06T03:38:05.326 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "use_agent", 2024-06-06T03:38:05.326 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.326 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.326 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.326 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.326 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.326 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.326 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.326 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-06-06T03:38:05.326 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.326 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.326 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.327 INFO:teuthology.orchestra.run.smithi050.stdout: "use_repo_digest": { 2024-06-06T03:38:05.327 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "use_repo_digest", 2024-06-06T03:38:05.327 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.327 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.327 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.327 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.327 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.327 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.327 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.327 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-06-06T03:38:05.327 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.327 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.327 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.327 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_failed_host_check": { 2024-06-06T03:38:05.328 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_failed_host_check", 2024-06-06T03:38:05.328 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.328 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.328 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.328 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.328 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.328 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.328 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.328 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if the host check fails", 2024-06-06T03:38:05.328 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.328 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.328 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.328 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_stray_daemons": { 2024-06-06T03:38:05.328 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_stray_daemons", 2024-06-06T03:38:05.328 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.329 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.329 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.329 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.329 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.329 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.329 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.329 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-06-06T03:38:05.329 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.329 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.329 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.329 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_stray_hosts": { 2024-06-06T03:38:05.329 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_stray_hosts", 2024-06-06T03:38:05.329 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.329 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.329 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.330 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.330 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.330 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.330 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.330 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-06-06T03:38:05.330 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.330 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.330 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.330 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.330 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.330 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crash", 2024-06-06T03:38:05.330 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.331 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.331 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.331 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.331 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.331 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.331 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.331 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.331 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.331 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.331 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.331 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.331 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.331 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.331 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.332 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.332 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.332 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.332 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.332 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.332 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.332 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.332 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.332 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.332 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.332 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.332 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.332 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.332 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.332 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.332 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.333 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.333 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.333 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.333 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.333 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.333 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.333 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.333 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.333 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.333 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.333 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.333 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.333 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.333 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.333 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.334 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.334 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.334 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.334 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.334 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.334 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.334 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.334 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.334 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.334 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.334 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.334 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.334 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.334 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.335 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.335 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.335 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.335 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.335 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.335 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.335 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.335 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.335 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.335 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.335 INFO:teuthology.orchestra.run.smithi050.stdout: "retain_interval": { 2024-06-06T03:38:05.335 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "retain_interval", 2024-06-06T03:38:05.335 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.335 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.335 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.336 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "31536000", 2024-06-06T03:38:05.336 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.336 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.336 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.336 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long to retain crashes before pruning them", 2024-06-06T03:38:05.336 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.336 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.336 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.336 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_recent_interval": { 2024-06-06T03:38:05.336 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_recent_interval", 2024-06-06T03:38:05.336 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.336 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.336 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.336 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1209600", 2024-06-06T03:38:05.336 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.337 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.337 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.337 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "time interval in which to warn about recent crashes", 2024-06-06T03:38:05.337 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.337 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.337 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.337 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.337 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.337 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.337 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "dashboard", 2024-06-06T03:38:05.337 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.337 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.337 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.337 INFO:teuthology.orchestra.run.smithi050.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-06-06T03:38:05.337 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-06-06T03:38:05.337 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.338 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.338 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.338 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-06-06T03:38:05.338 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.338 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.338 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.338 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.338 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.338 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.338 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.338 INFO:teuthology.orchestra.run.smithi050.stdout: "ALERTMANAGER_API_HOST": { 2024-06-06T03:38:05.338 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ALERTMANAGER_API_HOST", 2024-06-06T03:38:05.339 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.339 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.339 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.339 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.339 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.339 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.339 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.339 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.339 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.339 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.339 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.339 INFO:teuthology.orchestra.run.smithi050.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-06-06T03:38:05.339 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-06-06T03:38:05.339 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.339 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.340 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.340 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.340 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.340 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.340 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.340 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.340 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.340 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.340 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.340 INFO:teuthology.orchestra.run.smithi050.stdout: "AUDIT_API_ENABLED": { 2024-06-06T03:38:05.340 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "AUDIT_API_ENABLED", 2024-06-06T03:38:05.340 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.340 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.340 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.341 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.341 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.341 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.341 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.341 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.341 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.341 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.341 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.341 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.341 INFO:teuthology.orchestra.run.smithi050.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-06-06T03:38:05.341 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-06-06T03:38:05.341 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.341 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.341 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.341 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.341 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.342 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.342 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.342 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.342 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.342 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.342 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.342 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.342 INFO:teuthology.orchestra.run.smithi050.stdout: "ENABLE_BROWSABLE_API": { 2024-06-06T03:38:05.342 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ENABLE_BROWSABLE_API", 2024-06-06T03:38:05.342 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.342 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.342 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.342 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.342 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.342 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.343 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.343 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.343 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.343 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.343 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.343 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-06-06T03:38:05.343 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-06-06T03:38:05.343 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.343 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.343 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.343 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.343 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.343 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.344 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.344 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.344 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.344 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.344 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.344 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-06-06T03:38:05.344 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-06-06T03:38:05.344 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.344 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.344 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.344 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.344 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.344 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.344 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.344 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.345 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.345 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.345 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.345 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-06-06T03:38:05.345 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-06-06T03:38:05.345 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.345 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.345 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.345 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.345 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.345 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.345 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.346 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.346 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.346 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.346 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.346 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-06-06T03:38:05.346 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-06-06T03:38:05.346 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.346 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.346 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.346 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.346 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.346 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.346 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.347 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.347 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.347 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.347 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.347 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_NFS": { 2024-06-06T03:38:05.347 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-06-06T03:38:05.347 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.347 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.347 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.347 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.347 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.347 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.347 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.347 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.348 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.348 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.348 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.348 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_RBD": { 2024-06-06T03:38:05.348 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-06-06T03:38:05.348 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.348 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.348 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.348 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.348 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.348 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.349 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.349 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.349 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.349 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.349 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.349 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_RGW": { 2024-06-06T03:38:05.349 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-06-06T03:38:05.349 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.349 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.349 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.349 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.349 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.349 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.350 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.350 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.350 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.350 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.350 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.350 INFO:teuthology.orchestra.run.smithi050.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-06-06T03:38:05.350 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-06-06T03:38:05.350 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.350 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.350 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.350 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.350 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.351 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.351 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.351 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.351 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.351 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.351 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.351 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_PASSWORD": { 2024-06-06T03:38:05.351 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_PASSWORD", 2024-06-06T03:38:05.351 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.351 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.351 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.351 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2024-06-06T03:38:05.351 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.351 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.352 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.352 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.352 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.352 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.352 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.352 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-06-06T03:38:05.352 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-06-06T03:38:05.352 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.352 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.352 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.352 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.352 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.352 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.352 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.353 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.353 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.353 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.353 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.353 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_URL": { 2024-06-06T03:38:05.353 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_URL", 2024-06-06T03:38:05.353 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.353 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.353 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.353 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.353 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.353 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.353 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.354 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.354 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.354 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.354 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.354 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_USERNAME": { 2024-06-06T03:38:05.354 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_USERNAME", 2024-06-06T03:38:05.354 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.354 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.354 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.354 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2024-06-06T03:38:05.354 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.355 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.355 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.355 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.355 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.355 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.355 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.355 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-06-06T03:38:05.355 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-06-06T03:38:05.355 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.355 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.355 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.355 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.355 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.355 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.356 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.356 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.356 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.356 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.356 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.356 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-06-06T03:38:05.356 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-06-06T03:38:05.356 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.356 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.356 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.356 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.356 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.356 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.356 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.357 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.357 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.357 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.357 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.357 INFO:teuthology.orchestra.run.smithi050.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-06-06T03:38:05.357 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-06-06T03:38:05.357 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.357 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.357 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.357 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.357 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.357 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.357 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.357 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.358 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.358 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.358 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.358 INFO:teuthology.orchestra.run.smithi050.stdout: "ISSUE_TRACKER_API_KEY": { 2024-06-06T03:38:05.358 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-06-06T03:38:05.358 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.358 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.358 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.358 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.358 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.358 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.358 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.358 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.358 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.359 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.359 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.359 INFO:teuthology.orchestra.run.smithi050.stdout: "PROMETHEUS_API_HOST": { 2024-06-06T03:38:05.359 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PROMETHEUS_API_HOST", 2024-06-06T03:38:05.359 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.359 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.359 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.359 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.359 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.359 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.359 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.359 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.359 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.359 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.360 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.360 INFO:teuthology.orchestra.run.smithi050.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-06-06T03:38:05.360 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-06-06T03:38:05.360 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.360 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.360 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.360 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.360 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.360 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.360 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.360 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.360 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.360 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.360 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.361 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-06-06T03:38:05.361 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-06-06T03:38:05.361 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.361 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.361 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.361 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.361 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.361 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.361 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.361 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.361 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.361 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.361 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.362 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-06-06T03:38:05.362 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-06-06T03:38:05.362 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.362 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.362 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.362 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.362 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.362 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.362 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.362 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.362 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.362 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.362 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.363 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-06-06T03:38:05.363 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-06-06T03:38:05.363 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.363 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.363 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.363 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.363 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.363 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.363 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.363 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.363 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.363 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.363 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.363 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-06-06T03:38:05.364 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-06-06T03:38:05.364 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.364 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.364 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.364 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.364 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.364 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.364 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.364 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.364 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.364 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.364 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.364 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-06-06T03:38:05.365 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-06-06T03:38:05.365 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.365 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.365 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.365 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.365 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.365 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.365 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.365 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.365 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.365 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.365 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.365 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-06-06T03:38:05.365 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-06-06T03:38:05.366 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.366 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.366 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.366 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.366 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.366 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.366 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.366 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.366 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.366 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.366 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.367 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-06-06T03:38:05.367 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-06-06T03:38:05.367 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.367 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.367 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.367 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.367 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.367 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.367 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.367 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.367 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.367 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.367 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.368 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_ENABLED": { 2024-06-06T03:38:05.368 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_ENABLED", 2024-06-06T03:38:05.368 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.368 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.368 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.368 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.368 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.368 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.368 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.368 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.368 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.368 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.369 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.369 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-06-06T03:38:05.369 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-06-06T03:38:05.369 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.369 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.369 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.369 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-06-06T03:38:05.369 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.369 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.369 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.369 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.369 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.370 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.370 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.370 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-06-06T03:38:05.370 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-06-06T03:38:05.370 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.370 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.370 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.370 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-06-06T03:38:05.370 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.370 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.370 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.370 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.370 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.371 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.371 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.371 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-06-06T03:38:05.371 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-06-06T03:38:05.371 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.371 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.371 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.371 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8", 2024-06-06T03:38:05.371 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.371 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.371 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.371 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.371 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.372 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.372 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.372 INFO:teuthology.orchestra.run.smithi050.stdout: "REST_REQUESTS_TIMEOUT": { 2024-06-06T03:38:05.372 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-06-06T03:38:05.372 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.372 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.372 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.372 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "45", 2024-06-06T03:38:05.372 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.372 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.372 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.372 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.372 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.372 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.373 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.373 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_ACCESS_KEY": { 2024-06-06T03:38:05.373 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_ACCESS_KEY", 2024-06-06T03:38:05.373 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.373 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.373 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.373 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.373 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.373 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.373 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.373 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.373 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.373 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.374 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.374 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-06-06T03:38:05.374 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-06-06T03:38:05.374 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.374 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.374 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.374 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2024-06-06T03:38:05.374 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.374 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.374 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.374 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.374 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.374 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.375 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.375 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_SECRET_KEY": { 2024-06-06T03:38:05.375 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_SECRET_KEY", 2024-06-06T03:38:05.375 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.375 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.375 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.375 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.375 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.375 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.375 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.375 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.375 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.375 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.375 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.376 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_SSL_VERIFY": { 2024-06-06T03:38:05.376 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_SSL_VERIFY", 2024-06-06T03:38:05.376 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.376 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.376 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.376 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.376 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.376 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.376 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.376 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.376 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.376 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.376 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.377 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-06-06T03:38:05.377 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-06-06T03:38:05.377 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.377 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.377 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.377 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-06-06T03:38:05.377 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.377 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.377 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.377 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.377 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.377 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.377 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.377 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-06-06T03:38:05.378 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-06-06T03:38:05.378 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.378 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.378 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.378 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-06-06T03:38:05.378 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.378 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.378 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.378 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.378 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.378 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.378 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.379 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-06-06T03:38:05.379 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-06-06T03:38:05.379 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.379 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.379 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.379 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-06-06T03:38:05.379 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.379 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.379 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.379 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.379 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.379 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.379 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.379 INFO:teuthology.orchestra.run.smithi050.stdout: "cross_origin_url": { 2024-06-06T03:38:05.380 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cross_origin_url", 2024-06-06T03:38:05.380 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.380 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.380 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.380 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.380 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.380 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.380 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.380 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.380 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.380 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.380 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.380 INFO:teuthology.orchestra.run.smithi050.stdout: "crt_file": { 2024-06-06T03:38:05.380 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crt_file", 2024-06-06T03:38:05.381 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.381 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.381 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.381 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.381 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.381 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.381 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.381 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.381 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.381 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.381 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.381 INFO:teuthology.orchestra.run.smithi050.stdout: "debug": { 2024-06-06T03:38:05.382 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "debug", 2024-06-06T03:38:05.382 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.382 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.382 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.382 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.382 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.382 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.382 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.382 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable/disable debug options", 2024-06-06T03:38:05.382 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.382 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.382 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.382 INFO:teuthology.orchestra.run.smithi050.stdout: "jwt_token_ttl": { 2024-06-06T03:38:05.383 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "jwt_token_ttl", 2024-06-06T03:38:05.383 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.383 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.383 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.383 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "28800", 2024-06-06T03:38:05.383 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.383 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.383 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.383 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.383 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.383 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.383 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.383 INFO:teuthology.orchestra.run.smithi050.stdout: "key_file": { 2024-06-06T03:38:05.383 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "key_file", 2024-06-06T03:38:05.384 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.384 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.384 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.384 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.384 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.384 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.384 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.384 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.384 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.384 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.384 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.385 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.385 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.385 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.385 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.385 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.385 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.385 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.385 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.385 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.385 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.385 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.385 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.385 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.386 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.386 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.386 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.386 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.386 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.386 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.386 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.386 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.386 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.386 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.386 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.386 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.386 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.387 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.387 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.387 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.387 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.387 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.387 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.387 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.387 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.387 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.387 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.387 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.387 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.388 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.388 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.388 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.388 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.388 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.388 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.388 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.388 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.388 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.388 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.388 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.388 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.389 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.389 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.389 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.389 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.389 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.389 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.389 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.389 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.389 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.389 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.389 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.389 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.389 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.390 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.390 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.390 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.390 INFO:teuthology.orchestra.run.smithi050.stdout: "motd": { 2024-06-06T03:38:05.390 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "motd", 2024-06-06T03:38:05.390 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.390 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.390 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.390 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.390 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.390 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.390 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.391 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "The message of the day", 2024-06-06T03:38:05.391 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.391 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.391 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.391 INFO:teuthology.orchestra.run.smithi050.stdout: "redirect_resolve_ip_addr": { 2024-06-06T03:38:05.391 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "redirect_resolve_ip_addr", 2024-06-06T03:38:05.391 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.391 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.391 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.391 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.391 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.391 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.392 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.392 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.392 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.392 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.392 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.392 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2024-06-06T03:38:05.392 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2024-06-06T03:38:05.392 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.392 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.392 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.392 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "::", 2024-06-06T03:38:05.393 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.393 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.393 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.393 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.393 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.393 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.393 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.393 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2024-06-06T03:38:05.393 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2024-06-06T03:38:05.393 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.393 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.393 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.394 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8080", 2024-06-06T03:38:05.394 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.394 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.394 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.394 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.394 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.394 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.394 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.394 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl": { 2024-06-06T03:38:05.394 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl", 2024-06-06T03:38:05.394 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.394 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.395 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.395 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.395 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.395 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.395 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.395 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.395 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.395 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.395 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.395 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl_server_port": { 2024-06-06T03:38:05.395 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl_server_port", 2024-06-06T03:38:05.395 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.396 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.396 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.396 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8443", 2024-06-06T03:38:05.396 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.396 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.396 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.396 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.396 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.396 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.396 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.397 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_behaviour": { 2024-06-06T03:38:05.397 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_behaviour", 2024-06-06T03:38:05.397 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.397 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.397 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.397 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "redirect", 2024-06-06T03:38:05.397 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.397 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.397 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.397 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.397 INFO:teuthology.orchestra.run.smithi050.stdout: "redirect" 2024-06-06T03:38:05.397 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.397 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.397 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.398 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.398 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.398 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_error_status_code": { 2024-06-06T03:38:05.398 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_error_status_code", 2024-06-06T03:38:05.398 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.398 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.398 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.398 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "500", 2024-06-06T03:38:05.398 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "400", 2024-06-06T03:38:05.398 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "599", 2024-06-06T03:38:05.398 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.399 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.399 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.399 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.399 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.399 INFO:teuthology.orchestra.run.smithi050.stdout: "url_prefix": { 2024-06-06T03:38:05.399 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "url_prefix", 2024-06-06T03:38:05.399 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.399 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.399 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.399 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.399 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.399 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.400 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.400 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.400 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.400 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.400 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.400 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.400 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.400 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "devicehealth", 2024-06-06T03:38:05.400 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.400 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.400 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.400 INFO:teuthology.orchestra.run.smithi050.stdout: "enable_monitoring": { 2024-06-06T03:38:05.401 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enable_monitoring", 2024-06-06T03:38:05.401 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.401 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.401 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.401 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.401 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.401 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.401 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.401 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "monitor device health metrics", 2024-06-06T03:38:05.401 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.401 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.401 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.402 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.402 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.402 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.402 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.402 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.402 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.402 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.402 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.407 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.407 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.407 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.407 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.407 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.407 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.407 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.407 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.407 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.407 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.408 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.408 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.408 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.408 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.408 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.408 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.408 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.408 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.408 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.408 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.408 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.408 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.408 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.409 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.409 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.409 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.409 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.409 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.409 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.409 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.409 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.409 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.409 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.409 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.409 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.409 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.410 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.410 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.410 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.410 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.410 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.410 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.410 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.410 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.410 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.410 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.410 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.410 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.411 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.411 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.411 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.411 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.411 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.411 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.411 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.411 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.411 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.411 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.411 INFO:teuthology.orchestra.run.smithi050.stdout: "mark_out_threshold": { 2024-06-06T03:38:05.411 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mark_out_threshold", 2024-06-06T03:38:05.411 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.411 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.412 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.412 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "2419200", 2024-06-06T03:38:05.412 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.412 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.412 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.412 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-06-06T03:38:05.412 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.412 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.412 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.412 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": { 2024-06-06T03:38:05.412 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pool_name", 2024-06-06T03:38:05.412 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.412 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.413 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.413 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "device_health_metrics", 2024-06-06T03:38:05.413 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.413 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.413 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.413 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "name of pool in which to store device health metrics", 2024-06-06T03:38:05.413 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.413 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.413 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.413 INFO:teuthology.orchestra.run.smithi050.stdout: "retention_period": { 2024-06-06T03:38:05.413 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "retention_period", 2024-06-06T03:38:05.413 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.413 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.413 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.414 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15552000", 2024-06-06T03:38:05.414 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.414 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.414 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.414 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long to retain device health metrics", 2024-06-06T03:38:05.414 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.414 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.414 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.414 INFO:teuthology.orchestra.run.smithi050.stdout: "scrape_frequency": { 2024-06-06T03:38:05.414 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "scrape_frequency", 2024-06-06T03:38:05.414 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.414 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.414 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.414 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "86400", 2024-06-06T03:38:05.415 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.415 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.415 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.415 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to scrape device health metrics", 2024-06-06T03:38:05.415 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.415 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.415 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.415 INFO:teuthology.orchestra.run.smithi050.stdout: "self_heal": { 2024-06-06T03:38:05.415 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "self_heal", 2024-06-06T03:38:05.415 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.415 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.415 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.416 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.416 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.416 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.416 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.416 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-06-06T03:38:05.416 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.416 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.416 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.416 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-06-06T03:38:05.416 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-06-06T03:38:05.416 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.416 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.417 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.417 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-06-06T03:38:05.417 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.417 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.417 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.417 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to wake up and check device health", 2024-06-06T03:38:05.417 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.417 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.417 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.417 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_threshold": { 2024-06-06T03:38:05.417 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_threshold", 2024-06-06T03:38:05.417 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.417 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.418 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.418 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "7257600", 2024-06-06T03:38:05.418 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.418 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.418 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.418 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-06-06T03:38:05.418 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.418 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.418 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.418 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.418 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.419 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "diskprediction_local", 2024-06-06T03:38:05.419 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.419 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.419 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.419 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.419 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.419 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.419 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.419 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.419 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.419 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.419 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.419 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.419 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.420 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.420 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.420 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.420 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.420 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.420 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.420 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.420 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.420 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.420 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.420 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.420 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.420 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.421 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.421 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.421 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.421 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.421 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.421 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.421 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.421 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.421 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.421 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.421 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.421 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.421 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.422 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.422 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.422 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.422 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.422 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.422 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.422 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.422 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.422 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.422 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.422 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.422 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.423 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.423 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.423 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.423 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.423 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.423 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.423 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.423 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.423 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.423 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.423 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.423 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.423 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.423 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.424 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.424 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.424 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.424 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.424 INFO:teuthology.orchestra.run.smithi050.stdout: "predict_interval": { 2024-06-06T03:38:05.424 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "predict_interval", 2024-06-06T03:38:05.424 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.424 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.424 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.424 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "86400", 2024-06-06T03:38:05.424 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.424 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.424 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.425 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.425 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.425 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.425 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.425 INFO:teuthology.orchestra.run.smithi050.stdout: "predictor_model": { 2024-06-06T03:38:05.425 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "predictor_model", 2024-06-06T03:38:05.425 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.425 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.425 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.425 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "prophetstor", 2024-06-06T03:38:05.425 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.425 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.425 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.426 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.426 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.426 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.426 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.426 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-06-06T03:38:05.426 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-06-06T03:38:05.426 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.426 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.426 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.426 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-06-06T03:38:05.426 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.426 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.426 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.427 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.427 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.427 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.427 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.427 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.427 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.427 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "influx", 2024-06-06T03:38:05.427 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": false, 2024-06-06T03:38:05.427 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "influxdb python module not found", 2024-06-06T03:38:05.427 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.427 INFO:teuthology.orchestra.run.smithi050.stdout: "batch_size": { 2024-06-06T03:38:05.427 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "batch_size", 2024-06-06T03:38:05.428 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.428 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.428 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.428 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5000", 2024-06-06T03:38:05.428 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.428 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.428 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.428 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-06-06T03:38:05.428 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.428 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.428 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.428 INFO:teuthology.orchestra.run.smithi050.stdout: "database": { 2024-06-06T03:38:05.429 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "database", 2024-06-06T03:38:05.429 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.429 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.429 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.429 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "ceph", 2024-06-06T03:38:05.429 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.429 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.429 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.429 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-06-06T03:38:05.429 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.429 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.429 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.429 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": { 2024-06-06T03:38:05.430 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "hostname", 2024-06-06T03:38:05.430 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.430 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.430 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.430 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.430 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.430 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.430 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.430 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB server hostname", 2024-06-06T03:38:05.430 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.430 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.430 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.431 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-06-06T03:38:05.431 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-06-06T03:38:05.431 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.431 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.431 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.431 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "30", 2024-06-06T03:38:05.431 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "5", 2024-06-06T03:38:05.431 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.431 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.431 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-06-06T03:38:05.431 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.431 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.432 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.432 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.432 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.432 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.432 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.432 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.432 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.432 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.432 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.432 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.432 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.433 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.433 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.433 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.433 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.433 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.433 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.433 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.433 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.433 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.433 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.434 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.434 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.434 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.434 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.434 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.434 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.434 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.434 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.434 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.434 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.434 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.434 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.434 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.435 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.435 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.435 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.435 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.435 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.435 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.435 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.435 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.435 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.435 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.435 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.435 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.435 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.436 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.436 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.436 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.436 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.436 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.436 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.436 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.436 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.436 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.436 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.436 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.436 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.436 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.437 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.437 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.437 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.437 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.437 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.437 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.437 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.437 INFO:teuthology.orchestra.run.smithi050.stdout: "password": { 2024-06-06T03:38:05.437 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "password", 2024-06-06T03:38:05.437 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.437 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.437 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.438 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.438 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.438 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.438 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.438 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "password of InfluxDB server user", 2024-06-06T03:38:05.438 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.438 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.438 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.438 INFO:teuthology.orchestra.run.smithi050.stdout: "port": { 2024-06-06T03:38:05.438 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "port", 2024-06-06T03:38:05.438 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.438 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.439 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.439 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8086", 2024-06-06T03:38:05.439 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.439 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.439 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.439 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB server port", 2024-06-06T03:38:05.439 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.439 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.439 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.439 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl": { 2024-06-06T03:38:05.439 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl", 2024-06-06T03:38:05.439 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.439 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.439 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.440 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "false", 2024-06-06T03:38:05.440 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.440 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.440 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.440 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-06-06T03:38:05.440 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.440 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.440 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.440 INFO:teuthology.orchestra.run.smithi050.stdout: "threads": { 2024-06-06T03:38:05.440 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "threads", 2024-06-06T03:38:05.440 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.440 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.440 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.441 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-06-06T03:38:05.441 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-06-06T03:38:05.441 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "32", 2024-06-06T03:38:05.441 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.441 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-06-06T03:38:05.441 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.441 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.441 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.441 INFO:teuthology.orchestra.run.smithi050.stdout: "username": { 2024-06-06T03:38:05.441 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "username", 2024-06-06T03:38:05.441 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.441 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.442 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.442 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.442 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.442 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.442 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.442 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "username of InfluxDB server user", 2024-06-06T03:38:05.442 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.442 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.442 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.442 INFO:teuthology.orchestra.run.smithi050.stdout: "verify_ssl": { 2024-06-06T03:38:05.442 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "verify_ssl", 2024-06-06T03:38:05.442 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.443 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.443 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.443 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "true", 2024-06-06T03:38:05.443 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.443 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.443 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.443 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-06-06T03:38:05.443 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.443 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.443 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.443 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.443 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.443 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "insights", 2024-06-06T03:38:05.444 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.444 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.444 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.444 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.444 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.444 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.444 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.444 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.444 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.444 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.444 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.444 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.444 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.444 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.445 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.445 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.445 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.445 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.445 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.445 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.445 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.445 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.445 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.445 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.445 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.445 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.445 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.446 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.446 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.446 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.446 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.446 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.446 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.446 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.446 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.446 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.446 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.446 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.446 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.446 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.447 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.447 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.447 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.447 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.447 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.447 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.447 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.447 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.447 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.447 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.447 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.447 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.447 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.447 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.447 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.448 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.448 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.448 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.448 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.448 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.448 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.448 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.448 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.448 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.448 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.448 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.448 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.448 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.448 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.449 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.449 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.449 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "iostat", 2024-06-06T03:38:05.449 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.449 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.449 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.449 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.449 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.449 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.449 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.449 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.449 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.449 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.450 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.450 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.450 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.450 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.450 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.450 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.450 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.450 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.450 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.450 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.450 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.450 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.450 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.451 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.451 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.451 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.451 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.451 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.451 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.451 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.451 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.451 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.451 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.451 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.451 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.451 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.452 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.452 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.452 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.452 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.452 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.452 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.452 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.452 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.452 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.452 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.452 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.452 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.452 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.452 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.452 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.453 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.453 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.453 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.453 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.453 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.453 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.453 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.453 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.453 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.453 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.453 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.453 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.453 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.453 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.453 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.454 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.454 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.454 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.454 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.454 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.454 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "k8sevents", 2024-06-06T03:38:05.454 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.454 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.454 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.454 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_event_retention_days": { 2024-06-06T03:38:05.454 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ceph_event_retention_days", 2024-06-06T03:38:05.454 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.454 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.455 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.455 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "7", 2024-06-06T03:38:05.455 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.455 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.455 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.455 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Days to hold ceph event information within local cache", 2024-06-06T03:38:05.455 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.455 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.455 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.455 INFO:teuthology.orchestra.run.smithi050.stdout: "config_check_secs": { 2024-06-06T03:38:05.455 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_check_secs", 2024-06-06T03:38:05.455 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.455 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.455 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.456 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-06-06T03:38:05.456 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "10", 2024-06-06T03:38:05.456 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.456 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.456 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-06-06T03:38:05.456 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.456 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.456 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.456 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.456 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.456 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.456 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.456 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.457 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.457 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.457 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.457 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.457 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.457 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.457 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.457 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.457 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.457 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.457 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.457 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.457 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.457 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.457 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.458 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.458 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.458 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.458 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.458 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.458 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.458 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.458 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.458 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.458 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.458 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.458 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.458 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.458 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.458 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.459 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.459 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.459 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.459 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.459 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.459 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.459 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.459 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.459 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.459 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.459 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.459 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.459 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.459 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.459 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.460 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.460 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.460 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.460 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.460 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.460 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.460 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.460 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.460 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.460 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.460 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.460 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.460 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.461 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.461 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.461 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.461 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.461 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.461 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "localpool", 2024-06-06T03:38:05.461 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.461 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.461 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.461 INFO:teuthology.orchestra.run.smithi050.stdout: "failure_domain": { 2024-06-06T03:38:05.462 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "failure_domain", 2024-06-06T03:38:05.462 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.462 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.462 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.462 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "host", 2024-06-06T03:38:05.462 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.462 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.462 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.462 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "failure domain for any created local pool", 2024-06-06T03:38:05.462 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-06-06T03:38:05.462 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.462 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.463 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.463 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.463 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.463 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.463 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.463 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.463 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.463 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.463 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.463 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.463 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.464 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.464 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.464 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.464 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.464 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.464 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.464 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.464 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.464 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.464 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.464 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.465 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.465 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.465 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.465 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.465 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.465 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.465 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.465 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.465 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.465 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.465 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.466 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.466 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.466 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.466 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.466 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.466 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.466 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.466 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.466 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.466 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.466 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.466 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.466 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.466 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.467 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.467 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.467 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.467 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.467 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.467 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.467 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.467 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.467 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.467 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.467 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.467 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.468 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.468 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.468 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.468 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.468 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.468 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.468 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.468 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": { 2024-06-06T03:38:05.468 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "min_size", 2024-06-06T03:38:05.468 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.468 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.468 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.468 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.468 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.469 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.469 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.469 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default min_size for any created local pool", 2024-06-06T03:38:05.469 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-06-06T03:38:05.469 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.469 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.469 INFO:teuthology.orchestra.run.smithi050.stdout: "num_rep": { 2024-06-06T03:38:05.469 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "num_rep", 2024-06-06T03:38:05.469 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.469 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.469 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.470 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3", 2024-06-06T03:38:05.470 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.470 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.470 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.470 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default replica count for any created local pool", 2024-06-06T03:38:05.470 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.470 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.470 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.470 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": { 2024-06-06T03:38:05.470 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pg_num", 2024-06-06T03:38:05.470 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.470 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.471 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.471 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "128", 2024-06-06T03:38:05.471 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.471 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.471 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.471 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default pg_num for any created local pool", 2024-06-06T03:38:05.471 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.471 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.471 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.471 INFO:teuthology.orchestra.run.smithi050.stdout: "prefix": { 2024-06-06T03:38:05.471 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prefix", 2024-06-06T03:38:05.471 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.471 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.472 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.472 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.472 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.472 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.472 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.472 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "name prefix for any created local pool", 2024-06-06T03:38:05.472 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.472 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.472 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.472 INFO:teuthology.orchestra.run.smithi050.stdout: "subtree": { 2024-06-06T03:38:05.472 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "subtree", 2024-06-06T03:38:05.472 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.473 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.473 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.473 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "rack", 2024-06-06T03:38:05.473 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.473 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.473 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.473 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "CRUSH level for which to create a local pool", 2024-06-06T03:38:05.473 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-06-06T03:38:05.473 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.473 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.473 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.473 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.474 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mds_autoscaler", 2024-06-06T03:38:05.474 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.474 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.474 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.474 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.474 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.474 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.474 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.474 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.474 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.474 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.474 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.475 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.475 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.475 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.475 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.475 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.475 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.475 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.475 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.475 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.475 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.475 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.475 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.475 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.476 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.476 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.476 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.476 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.476 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.476 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.476 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.476 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.476 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.476 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.476 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.476 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.477 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.477 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.477 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.477 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.477 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.477 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.477 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.477 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.477 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.477 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.477 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.477 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.477 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.477 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.478 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.478 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.478 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.478 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.478 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.478 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.478 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.478 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.478 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.478 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.478 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.478 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.478 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.479 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.479 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.479 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.479 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.479 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.479 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.479 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.479 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.479 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mirroring", 2024-06-06T03:38:05.479 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.479 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.479 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.480 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.480 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.480 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.480 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.480 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.480 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.480 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.480 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.480 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.480 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.480 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.480 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.480 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.480 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.480 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.481 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.481 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.481 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.481 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.481 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.481 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.481 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.481 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.481 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.481 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.481 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.481 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.481 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.482 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.482 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.482 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.482 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.482 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.482 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.482 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.482 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.482 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.482 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.482 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.482 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.482 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.483 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.483 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.483 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.483 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.483 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.483 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.483 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.483 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.483 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.483 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.483 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.483 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.484 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.484 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.484 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.484 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.484 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.484 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.484 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.484 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.484 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.484 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.484 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.484 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.484 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.484 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.485 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.485 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "nfs", 2024-06-06T03:38:05.485 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.485 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.485 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.485 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.485 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.485 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.485 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.485 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.485 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.485 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.486 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.486 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.486 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.486 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.486 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.486 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.486 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.486 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.486 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.486 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.486 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.486 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.486 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.487 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.487 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.487 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.487 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.487 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.487 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.487 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.487 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.487 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.487 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.487 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.487 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.487 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.488 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.488 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.488 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.488 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.488 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.488 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.488 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.488 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.488 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.488 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.488 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.488 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.488 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.488 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.488 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.488 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.489 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.489 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.489 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.489 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.489 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.489 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.489 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.489 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.489 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.489 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.489 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.490 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.490 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.490 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.490 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.490 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.490 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.490 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.490 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.490 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "orchestrator", 2024-06-06T03:38:05.490 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.490 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.490 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.491 INFO:teuthology.orchestra.run.smithi050.stdout: "fail_fs": { 2024-06-06T03:38:05.491 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "fail_fs", 2024-06-06T03:38:05.491 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.491 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.491 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.491 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.491 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.491 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.491 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.491 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-06-06T03:38:05.491 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.491 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.492 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.492 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.492 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.492 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.492 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.492 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.492 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.492 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.492 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.492 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.492 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.492 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.492 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.492 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.493 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.493 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.493 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.493 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.493 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.493 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.493 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.493 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.493 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.493 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.493 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.494 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.494 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.494 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.494 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.494 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.494 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.494 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.494 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.494 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.494 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.494 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.494 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.495 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.495 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.495 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.495 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.495 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.495 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.495 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.495 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.495 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.495 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.495 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.495 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.495 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.495 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.495 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.495 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.496 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.496 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.496 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.496 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.496 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.496 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.496 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.496 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.496 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.496 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.496 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.496 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.496 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.496 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.497 INFO:teuthology.orchestra.run.smithi050.stdout: "orchestrator": { 2024-06-06T03:38:05.497 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "orchestrator", 2024-06-06T03:38:05.497 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.497 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.497 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.497 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.497 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.497 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.497 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.497 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm", 2024-06-06T03:38:05.497 INFO:teuthology.orchestra.run.smithi050.stdout: "rook", 2024-06-06T03:38:05.497 INFO:teuthology.orchestra.run.smithi050.stdout: "test_orchestrator" 2024-06-06T03:38:05.497 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.497 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Orchestrator backend", 2024-06-06T03:38:05.497 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.498 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.498 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.498 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.498 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.498 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "osd_perf_query", 2024-06-06T03:38:05.498 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.498 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.498 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.498 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.498 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.499 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.499 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.499 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.499 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.499 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.499 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.499 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.499 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.499 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.499 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.499 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.499 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.499 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.500 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.500 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.500 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.500 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.500 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.500 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.500 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.500 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.500 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.500 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.500 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.500 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.500 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.501 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.501 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.501 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.501 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.501 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.501 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.501 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.501 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.501 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.501 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.501 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.501 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.502 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.502 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.502 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.502 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.502 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.502 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.502 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.502 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.502 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.502 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.502 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.502 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.502 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.503 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.503 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.503 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.503 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.503 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.503 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.503 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.503 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.503 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.503 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.503 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.503 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.503 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.503 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.504 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.504 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "osd_support", 2024-06-06T03:38:05.504 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.504 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.504 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.504 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.504 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.504 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.504 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.504 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.504 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.504 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.505 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.505 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.505 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.505 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.505 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.505 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.505 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.505 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.505 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.505 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.505 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.505 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.505 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.506 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.506 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.506 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.506 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.506 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.506 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.506 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.506 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.506 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.506 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.506 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.506 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.506 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.507 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.507 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.507 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.507 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.507 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.507 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.507 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.507 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.507 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.507 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.507 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.508 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.508 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.508 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.508 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.508 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.508 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.508 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.508 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.508 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.508 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.508 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.508 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.508 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.508 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.509 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.509 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.509 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.509 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.509 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.509 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.509 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.509 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.509 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.509 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.509 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pg_autoscaler", 2024-06-06T03:38:05.509 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.509 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.510 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.510 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.510 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.510 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.510 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.510 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.510 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.510 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.510 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.510 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.510 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.510 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.510 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.510 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.511 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.511 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.511 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.511 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.511 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.511 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.511 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.511 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.511 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.511 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.511 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.511 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.511 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.511 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.512 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.512 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.512 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.512 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.512 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.512 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.512 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.512 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.512 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.512 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.512 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.512 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.512 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.513 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.513 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.513 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.513 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.513 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.513 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.513 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.513 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.513 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.513 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.513 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.513 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.513 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.513 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.513 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.514 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.514 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.514 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.514 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.514 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.514 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.514 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.514 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.514 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.514 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.514 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.514 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-06-06T03:38:05.515 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-06-06T03:38:05.515 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.515 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.515 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.515 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-06-06T03:38:05.515 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.515 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.515 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.515 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.515 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.515 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.515 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.515 INFO:teuthology.orchestra.run.smithi050.stdout: "threshold": { 2024-06-06T03:38:05.515 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "threshold", 2024-06-06T03:38:05.516 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-06-06T03:38:05.516 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.516 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.516 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3.0", 2024-06-06T03:38:05.516 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1.0", 2024-06-06T03:38:05.516 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.516 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.516 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "scaling threshold", 2024-06-06T03:38:05.516 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-06-06T03:38:05.516 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.516 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.516 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.516 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.516 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "progress", 2024-06-06T03:38:05.517 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.517 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.517 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.517 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_pg_recovery_event": { 2024-06-06T03:38:05.517 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_pg_recovery_event", 2024-06-06T03:38:05.517 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.517 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.517 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.517 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.517 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.517 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.517 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.517 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow the module to show pg recovery progress", 2024-06-06T03:38:05.517 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.517 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.517 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.518 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": { 2024-06-06T03:38:05.518 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enabled", 2024-06-06T03:38:05.518 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.518 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.518 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.518 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.518 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.518 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.518 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.518 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.518 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.518 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.518 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.519 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.519 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.519 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.519 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.519 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.519 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.519 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.519 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.519 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.519 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.519 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.519 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.519 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.519 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.520 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.520 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.520 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.520 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.520 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.520 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.520 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.520 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.520 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.520 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.520 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.520 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.520 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.520 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.521 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.521 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.521 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.521 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.521 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.521 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.521 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.521 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.521 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.521 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.521 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.521 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.522 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.522 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.522 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.522 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.522 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.522 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.522 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.522 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.522 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.522 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.522 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.522 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.522 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.523 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.523 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.523 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.523 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.523 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.523 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.523 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.523 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.523 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.523 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.523 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.523 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.523 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.524 INFO:teuthology.orchestra.run.smithi050.stdout: "max_completed_events": { 2024-06-06T03:38:05.524 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_completed_events", 2024-06-06T03:38:05.524 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.524 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.524 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.524 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "50", 2024-06-06T03:38:05.524 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.524 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.524 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.524 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "number of past completed events to remember", 2024-06-06T03:38:05.524 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.524 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.524 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.524 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-06-06T03:38:05.525 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-06-06T03:38:05.525 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.525 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.525 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.525 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-06-06T03:38:05.525 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.525 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.525 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.525 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long the module is going to sleep", 2024-06-06T03:38:05.525 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.525 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.525 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.526 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.526 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.526 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prometheus", 2024-06-06T03:38:05.526 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.526 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.526 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.526 INFO:teuthology.orchestra.run.smithi050.stdout: "cache": { 2024-06-06T03:38:05.526 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cache", 2024-06-06T03:38:05.526 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.526 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.526 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.526 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.526 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.527 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.527 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.527 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.527 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.527 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.527 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.527 INFO:teuthology.orchestra.run.smithi050.stdout: "exclude_perf_counters": { 2024-06-06T03:38:05.527 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "exclude_perf_counters", 2024-06-06T03:38:05.527 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.527 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.527 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.527 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.527 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.528 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.528 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.528 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-06-06T03:38:05.528 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-06-06T03:38:05.528 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.528 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.528 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.528 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.528 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.528 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.528 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.528 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.528 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.528 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.529 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.529 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.529 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.529 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.529 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.529 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.529 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.529 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.529 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.529 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.529 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.529 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.529 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.529 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.530 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.530 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.530 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.530 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.530 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.530 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.530 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.530 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.530 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.530 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.530 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.530 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.531 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.531 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.531 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.531 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.531 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.531 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.531 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.531 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.531 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.531 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.531 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.531 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.531 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.532 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.532 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.532 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.532 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.532 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.532 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.532 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.532 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.532 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.532 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.532 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.532 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.533 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.533 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.533 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.533 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.533 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.533 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.533 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.533 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_stats_pools": { 2024-06-06T03:38:05.533 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_stats_pools", 2024-06-06T03:38:05.533 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.533 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.533 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.533 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.534 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.534 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.534 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.534 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.534 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.534 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.534 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.534 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_stats_pools_refresh_interval": { 2024-06-06T03:38:05.534 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-06-06T03:38:05.534 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.534 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.535 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.535 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "300", 2024-06-06T03:38:05.535 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.535 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.535 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.535 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.535 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.535 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.535 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.535 INFO:teuthology.orchestra.run.smithi050.stdout: "scrape_interval": { 2024-06-06T03:38:05.535 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "scrape_interval", 2024-06-06T03:38:05.535 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-06-06T03:38:05.535 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.535 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.536 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15.0", 2024-06-06T03:38:05.536 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.536 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.536 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.536 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.536 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.536 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.536 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.536 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2024-06-06T03:38:05.536 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2024-06-06T03:38:05.536 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.536 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.536 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.537 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "::", 2024-06-06T03:38:05.537 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.537 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.537 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.537 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-06-06T03:38:05.537 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.537 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.537 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.537 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2024-06-06T03:38:05.537 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2024-06-06T03:38:05.537 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.537 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.538 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.538 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "9283", 2024-06-06T03:38:05.538 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.538 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.538 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.538 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-06-06T03:38:05.538 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.538 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.538 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.538 INFO:teuthology.orchestra.run.smithi050.stdout: "stale_cache_strategy": { 2024-06-06T03:38:05.538 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "stale_cache_strategy", 2024-06-06T03:38:05.538 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.539 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.539 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.539 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "log", 2024-06-06T03:38:05.539 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.539 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.539 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.539 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.539 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.539 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.539 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.539 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_behaviour": { 2024-06-06T03:38:05.539 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_behaviour", 2024-06-06T03:38:05.540 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.540 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.540 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.540 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "default", 2024-06-06T03:38:05.540 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.540 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.540 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.540 INFO:teuthology.orchestra.run.smithi050.stdout: "default", 2024-06-06T03:38:05.540 INFO:teuthology.orchestra.run.smithi050.stdout: "error" 2024-06-06T03:38:05.540 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.540 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.540 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.540 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.540 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.541 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_error_status_code": { 2024-06-06T03:38:05.541 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_error_status_code", 2024-06-06T03:38:05.541 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.541 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.541 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.541 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "500", 2024-06-06T03:38:05.541 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "400", 2024-06-06T03:38:05.541 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "599", 2024-06-06T03:38:05.541 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.541 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.541 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.541 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.542 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.542 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.542 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.542 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_support", 2024-06-06T03:38:05.542 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.542 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.542 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.542 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.542 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.542 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.542 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.543 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.543 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.543 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.543 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.543 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.543 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.543 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.543 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.543 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.543 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.543 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.543 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.543 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.543 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.543 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.544 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.544 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.544 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.544 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.544 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.544 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.544 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.544 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.544 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.544 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.544 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.544 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.545 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.545 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.545 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.545 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.545 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.545 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.545 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.545 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.545 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.545 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.545 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.545 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.545 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.546 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.546 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.546 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.546 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.546 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.546 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.546 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.546 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.546 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.546 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.546 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.546 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.546 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.547 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.547 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.547 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.547 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.547 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.547 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.547 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.547 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.547 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.547 INFO:teuthology.orchestra.run.smithi050.stdout: "max_concurrent_snap_create": { 2024-06-06T03:38:05.547 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_concurrent_snap_create", 2024-06-06T03:38:05.547 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.547 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.547 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.548 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-06-06T03:38:05.548 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.548 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.548 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.548 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.548 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.548 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.548 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.548 INFO:teuthology.orchestra.run.smithi050.stdout: "mirror_snapshot_schedule": { 2024-06-06T03:38:05.548 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mirror_snapshot_schedule", 2024-06-06T03:38:05.548 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.548 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.548 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.548 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.548 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.549 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.549 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.549 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.549 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.549 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.549 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.549 INFO:teuthology.orchestra.run.smithi050.stdout: "trash_purge_schedule": { 2024-06-06T03:38:05.549 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "trash_purge_schedule", 2024-06-06T03:38:05.549 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.549 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.549 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.549 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.549 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.549 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.549 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.550 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.550 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.550 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.550 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.550 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.550 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.550 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "restful", 2024-06-06T03:38:05.550 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.550 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.550 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.550 INFO:teuthology.orchestra.run.smithi050.stdout: "enable_auth": { 2024-06-06T03:38:05.550 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enable_auth", 2024-06-06T03:38:05.551 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.551 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.551 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.551 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.551 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.551 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.551 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.551 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.551 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.551 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.551 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.551 INFO:teuthology.orchestra.run.smithi050.stdout: "key_file": { 2024-06-06T03:38:05.551 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "key_file", 2024-06-06T03:38:05.552 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.552 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.552 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.552 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.552 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.552 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.552 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.552 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.552 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.552 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.553 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.553 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.553 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.553 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.553 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.553 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.553 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.553 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.553 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.553 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.553 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.553 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.553 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.554 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.554 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.554 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.554 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.554 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.554 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.554 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.554 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.554 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.554 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.554 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.554 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.555 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.555 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.555 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.555 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.555 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.555 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.555 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.555 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.555 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.555 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.555 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.555 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.556 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.556 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.556 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.556 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.556 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.556 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.556 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.556 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.556 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.556 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.556 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.556 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.556 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.556 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.556 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.557 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.557 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.557 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.557 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.557 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.557 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.557 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.557 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.557 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.557 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.557 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.557 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.557 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.558 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.558 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.558 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2024-06-06T03:38:05.558 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2024-06-06T03:38:05.558 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.558 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.558 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.558 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.558 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.558 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.558 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.558 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.558 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.559 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.559 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.559 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2024-06-06T03:38:05.559 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2024-06-06T03:38:05.559 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.559 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.559 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.559 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.559 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.559 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.559 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.559 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.559 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.559 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.560 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.560 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.560 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.560 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.560 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rgw", 2024-06-06T03:38:05.560 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.560 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.560 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.560 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.560 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.560 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.560 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.560 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.561 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.561 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.561 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.561 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.561 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.561 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.561 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.561 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.561 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.561 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.561 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.561 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.562 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.562 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.562 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.562 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.562 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.562 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.562 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.562 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.562 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.562 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.562 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.562 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.563 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.563 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.563 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.563 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.563 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.563 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.563 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.563 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.563 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.563 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.563 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.563 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.563 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.564 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.564 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.564 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.564 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.564 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.564 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.564 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.564 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.564 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.564 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.564 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.564 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.564 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.564 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.565 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.565 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.565 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.565 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.565 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.565 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.565 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.565 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.565 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.565 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.565 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.565 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.565 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.565 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rook", 2024-06-06T03:38:05.565 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.566 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.566 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.566 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.566 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.566 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.566 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.566 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.566 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.566 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.566 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.566 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.566 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.566 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.567 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.567 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.567 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.567 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.567 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.567 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.567 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.567 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.567 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.567 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.567 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.567 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.568 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.568 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.568 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.568 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.568 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.568 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.568 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.568 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.568 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.568 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.568 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.568 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.569 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.569 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.569 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.569 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.569 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.569 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.569 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.569 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.569 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.569 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.569 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.569 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.569 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.569 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.570 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.570 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.570 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.570 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.570 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.570 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.570 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.570 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.570 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.570 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.570 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.570 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.570 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.571 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.571 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.571 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.571 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.571 INFO:teuthology.orchestra.run.smithi050.stdout: "storage_class": { 2024-06-06T03:38:05.571 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "storage_class", 2024-06-06T03:38:05.571 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.571 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.571 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.571 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "local", 2024-06-06T03:38:05.571 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.571 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.572 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.572 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-06-06T03:38:05.572 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.572 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.572 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.572 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.572 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.572 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "selftest", 2024-06-06T03:38:05.572 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.572 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.572 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.572 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.572 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.573 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.573 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.573 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.573 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.573 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.573 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.573 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.573 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.573 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.573 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.573 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.573 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.573 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.573 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.574 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.574 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.574 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.574 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.574 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.574 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.574 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.574 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.574 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.574 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.574 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.575 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.575 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.575 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.575 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.575 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.575 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.575 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.575 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.575 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.575 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.575 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.575 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.575 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.576 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.576 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.576 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.576 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.576 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.576 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.576 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.576 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.576 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.576 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.576 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.576 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.576 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.576 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.577 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.577 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.577 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.577 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.577 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.577 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.577 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.577 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.577 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.577 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.577 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.577 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.577 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.578 INFO:teuthology.orchestra.run.smithi050.stdout: "roption1": { 2024-06-06T03:38:05.578 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "roption1", 2024-06-06T03:38:05.578 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.578 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.578 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.578 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.578 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.578 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.578 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.578 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.578 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.578 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.578 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.579 INFO:teuthology.orchestra.run.smithi050.stdout: "roption2": { 2024-06-06T03:38:05.579 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "roption2", 2024-06-06T03:38:05.579 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.579 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.579 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.579 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "xyz", 2024-06-06T03:38:05.579 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.579 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.579 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.579 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.579 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.579 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.580 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.580 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.580 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption1": { 2024-06-06T03:38:05.580 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption1", 2024-06-06T03:38:05.580 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.580 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.580 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.580 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.580 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.580 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.580 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.580 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.581 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.581 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.581 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.581 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.581 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption2": { 2024-06-06T03:38:05.581 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption2", 2024-06-06T03:38:05.581 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.581 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.581 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.581 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.581 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.581 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.581 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.582 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.582 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.582 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.582 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.582 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption3": { 2024-06-06T03:38:05.582 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption3", 2024-06-06T03:38:05.582 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-06-06T03:38:05.582 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.582 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.582 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.582 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.583 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.583 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.583 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.583 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.583 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.583 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.583 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption4": { 2024-06-06T03:38:05.583 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption4", 2024-06-06T03:38:05.583 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.583 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.583 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.583 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.583 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.584 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.584 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.584 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.584 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.584 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.584 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.584 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.584 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption5": { 2024-06-06T03:38:05.584 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption5", 2024-06-06T03:38:05.584 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.584 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.584 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.584 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.584 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.585 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.585 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.585 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.585 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.585 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.585 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.585 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.585 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption6": { 2024-06-06T03:38:05.585 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption6", 2024-06-06T03:38:05.585 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.585 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.585 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.585 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.585 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.585 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.586 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.586 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.586 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.586 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.586 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.586 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.586 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption7": { 2024-06-06T03:38:05.586 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption7", 2024-06-06T03:38:05.586 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.586 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.586 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.586 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.586 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-06-06T03:38:05.587 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "42", 2024-06-06T03:38:05.587 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.587 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.587 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.587 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.587 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.587 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.587 INFO:teuthology.orchestra.run.smithi050.stdout: "testkey": { 2024-06-06T03:38:05.587 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testkey", 2024-06-06T03:38:05.587 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.588 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.588 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.588 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.588 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.588 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.588 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.588 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.588 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.588 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.588 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.588 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.588 INFO:teuthology.orchestra.run.smithi050.stdout: "testlkey": { 2024-06-06T03:38:05.588 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testlkey", 2024-06-06T03:38:05.588 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.588 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.589 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.589 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.589 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.589 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.589 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.589 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.589 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.589 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.589 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.589 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.589 INFO:teuthology.orchestra.run.smithi050.stdout: "testnewline": { 2024-06-06T03:38:05.589 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testnewline", 2024-06-06T03:38:05.589 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.589 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.590 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.590 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.590 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.590 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.590 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.590 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.590 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.590 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.590 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.590 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.590 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.590 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.590 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.590 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snap_schedule", 2024-06-06T03:38:05.591 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.591 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.591 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.591 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_m_granularity": { 2024-06-06T03:38:05.591 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_m_granularity", 2024-06-06T03:38:05.591 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.591 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.591 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.591 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.591 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.591 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.591 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.591 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow minute scheduled snapshots", 2024-06-06T03:38:05.591 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.592 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.592 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.592 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.592 INFO:teuthology.orchestra.run.smithi050.stdout: "dump_on_update": { 2024-06-06T03:38:05.592 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "dump_on_update", 2024-06-06T03:38:05.592 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.592 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.592 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.592 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.592 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.592 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.592 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.592 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "dump database to debug log on update", 2024-06-06T03:38:05.593 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.593 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.593 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.593 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.593 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.593 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.593 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.593 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.593 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.593 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.593 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.593 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.593 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.594 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.594 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.594 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.594 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.594 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.594 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.594 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.594 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.594 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.594 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.594 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.594 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.594 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.594 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.595 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.595 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.595 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.595 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.595 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.595 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.595 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.595 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.595 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.595 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.595 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.595 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.596 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.596 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.596 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.596 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.596 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.596 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.596 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.596 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.596 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.596 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.596 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.596 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.596 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.597 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.597 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.597 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.597 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.597 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.597 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.597 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.597 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.597 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.597 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.597 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.597 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.597 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.597 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.598 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.598 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.598 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.598 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.598 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.598 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.598 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.598 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.598 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.598 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.598 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "stats", 2024-06-06T03:38:05.598 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.598 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.599 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.599 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.599 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.599 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.599 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.599 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.599 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.599 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.599 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.599 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.599 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.599 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.599 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.599 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.600 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.600 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.600 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.600 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.600 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.600 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.600 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.600 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.600 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.600 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.600 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.600 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.600 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.600 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.601 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.601 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.601 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.601 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.601 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.601 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.601 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.601 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.601 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.601 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.601 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.601 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.601 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.602 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.602 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.602 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.602 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.602 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.602 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.602 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.602 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.602 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.602 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.602 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.602 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.602 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.603 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.603 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.603 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.603 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.603 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.603 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.603 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.603 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.603 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.603 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.603 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.603 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.604 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.604 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.604 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.604 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.604 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.604 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.604 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.604 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.604 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "status", 2024-06-06T03:38:05.604 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.604 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.604 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.604 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.605 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.605 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.605 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.605 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.605 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.605 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.605 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.605 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.605 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.605 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.605 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.605 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.605 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.605 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.606 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.606 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.606 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.606 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.606 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.606 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.606 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.606 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.606 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.606 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.606 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.606 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.606 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.607 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.607 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.607 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.607 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.607 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.607 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.607 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.607 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.607 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.607 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.607 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.607 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.607 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.607 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.608 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.608 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.608 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.608 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.608 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.608 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.608 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.608 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.608 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.608 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.608 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.608 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.608 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.608 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.608 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.608 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.609 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.609 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.609 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.609 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.609 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.609 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.609 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.609 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.609 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.609 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.609 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.609 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.609 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.609 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.609 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "telegraf", 2024-06-06T03:38:05.610 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.610 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.610 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.610 INFO:teuthology.orchestra.run.smithi050.stdout: "address": { 2024-06-06T03:38:05.610 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "address", 2024-06-06T03:38:05.610 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.610 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.610 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.610 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-06-06T03:38:05.610 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.610 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.610 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.610 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.611 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.611 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.611 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.611 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.611 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-06-06T03:38:05.611 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-06-06T03:38:05.611 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.611 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.611 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.611 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15", 2024-06-06T03:38:05.611 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.611 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.611 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.612 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.612 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.612 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.612 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.612 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.612 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.612 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.612 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.612 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.612 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.612 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.612 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.612 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.612 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.613 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.613 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.613 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.613 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.613 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.613 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.613 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.613 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.613 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.613 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.613 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.613 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.613 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.613 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.613 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.613 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.614 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.614 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.614 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.614 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.614 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.614 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.614 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.614 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.614 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.614 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.614 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.614 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.614 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.614 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.614 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.615 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.615 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.615 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.615 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.615 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.615 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.615 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.615 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.615 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.615 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.615 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.615 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.615 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.615 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.615 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.616 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.616 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.616 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.616 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.616 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.616 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.616 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.616 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.616 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.616 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.616 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.616 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.616 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.616 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.616 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.616 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.617 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.617 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.617 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "telemetry", 2024-06-06T03:38:05.617 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.617 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.617 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.617 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_basic": { 2024-06-06T03:38:05.617 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_basic", 2024-06-06T03:38:05.617 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.617 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.617 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.617 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.617 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.617 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.617 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.617 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share basic cluster information (size, version)", 2024-06-06T03:38:05.618 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.618 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.618 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.618 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.618 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_crash": { 2024-06-06T03:38:05.618 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_crash", 2024-06-06T03:38:05.618 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.618 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.618 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.618 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.618 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.618 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.618 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.618 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-06-06T03:38:05.619 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.619 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.619 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.619 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_device": { 2024-06-06T03:38:05.619 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_device", 2024-06-06T03:38:05.619 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.619 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.619 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.619 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.619 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.619 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.619 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.619 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-06-06T03:38:05.619 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.620 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.620 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.620 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.620 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_ident": { 2024-06-06T03:38:05.620 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_ident", 2024-06-06T03:38:05.620 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.620 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.620 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.620 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.620 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.620 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.620 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.620 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-06-06T03:38:05.620 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.620 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.620 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.621 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.621 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_perf": { 2024-06-06T03:38:05.621 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_perf", 2024-06-06T03:38:05.621 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.621 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.621 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.621 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.621 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.621 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.621 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.621 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share various performance metrics of a cluster", 2024-06-06T03:38:05.621 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.621 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.621 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.621 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.622 INFO:teuthology.orchestra.run.smithi050.stdout: "contact": { 2024-06-06T03:38:05.622 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "contact", 2024-06-06T03:38:05.622 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.622 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.622 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.622 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.622 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.622 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.622 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.622 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.622 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.622 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.622 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.623 INFO:teuthology.orchestra.run.smithi050.stdout: "description": { 2024-06-06T03:38:05.623 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "description", 2024-06-06T03:38:05.623 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.623 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.623 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.623 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.623 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.623 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.623 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.623 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.623 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.623 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.623 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.623 INFO:teuthology.orchestra.run.smithi050.stdout: "device_url": { 2024-06-06T03:38:05.624 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_url", 2024-06-06T03:38:05.624 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.624 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.624 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.624 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-06-06T03:38:05.624 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.624 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.624 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.624 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.624 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.624 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.624 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.624 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.624 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": { 2024-06-06T03:38:05.624 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enabled", 2024-06-06T03:38:05.625 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.625 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.625 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.625 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.625 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.625 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.625 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.625 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.625 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.625 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.625 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.625 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-06-06T03:38:05.625 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-06-06T03:38:05.626 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.626 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.626 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.626 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "24", 2024-06-06T03:38:05.626 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "8", 2024-06-06T03:38:05.626 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.626 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.626 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.626 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.626 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.626 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.626 INFO:teuthology.orchestra.run.smithi050.stdout: "last_opt_revision": { 2024-06-06T03:38:05.626 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "last_opt_revision", 2024-06-06T03:38:05.627 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.627 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.627 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.627 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1", 2024-06-06T03:38:05.627 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.627 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.627 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.627 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.627 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.627 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.627 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.627 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.627 INFO:teuthology.orchestra.run.smithi050.stdout: "leaderboard": { 2024-06-06T03:38:05.627 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "leaderboard", 2024-06-06T03:38:05.627 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.628 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.628 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.628 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.628 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.628 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.628 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.628 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.628 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.628 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.628 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.628 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.628 INFO:teuthology.orchestra.run.smithi050.stdout: "leaderboard_description": { 2024-06-06T03:38:05.628 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "leaderboard_description", 2024-06-06T03:38:05.628 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.628 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.628 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.631 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.631 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.631 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.631 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.631 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.631 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.631 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.631 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.631 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.631 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.631 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.632 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.632 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.632 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.632 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.632 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.632 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.632 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.632 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.632 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.632 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.632 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.632 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.632 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.632 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: "organization": { 2024-06-06T03:38:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "organization", 2024-06-06T03:38:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: "proxy": { 2024-06-06T03:38:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "proxy", 2024-06-06T03:38:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: "url": { 2024-06-06T03:38:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "url", 2024-06-06T03:38:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-06-06T03:38:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "test_orchestrator", 2024-06-06T03:38:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.638 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.638 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.638 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.638 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.638 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.638 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.638 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.638 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.638 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.638 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.638 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.638 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.638 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.638 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.638 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.640 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.640 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.640 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.640 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.640 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.640 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.640 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.640 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.640 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.640 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.640 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.640 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.640 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.640 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.640 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.641 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.641 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.641 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.641 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.641 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.641 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.641 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.641 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.641 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.641 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.641 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.641 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.642 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.642 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.642 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.642 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.642 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.642 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.642 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.642 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.642 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.642 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.642 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.642 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "volumes", 2024-06-06T03:38:05.643 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.643 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.643 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.643 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.643 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.643 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.643 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.643 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.643 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.643 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.643 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.643 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.643 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.643 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.643 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.643 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.645 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.645 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.645 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.645 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.645 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.645 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.645 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.645 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.645 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.645 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.645 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.645 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.645 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.645 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.647 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.647 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.647 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.647 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.647 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.647 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.647 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.647 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.647 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.647 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.647 INFO:teuthology.orchestra.run.smithi050.stdout: "max_concurrent_clones": { 2024-06-06T03:38:05.647 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_concurrent_clones", 2024-06-06T03:38:05.647 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.648 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.648 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.648 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "4", 2024-06-06T03:38:05.648 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.648 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.648 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.648 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Number of asynchronous cloner threads", 2024-06-06T03:38:05.648 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.648 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.648 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.648 INFO:teuthology.orchestra.run.smithi050.stdout: "periodic_async_work": { 2024-06-06T03:38:05.648 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "periodic_async_work", 2024-06-06T03:38:05.648 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.648 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.649 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.649 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.649 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.649 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.649 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.649 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Periodically check for async work", 2024-06-06T03:38:05.649 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.649 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.649 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.649 INFO:teuthology.orchestra.run.smithi050.stdout: "snapshot_clone_delay": { 2024-06-06T03:38:05.649 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snapshot_clone_delay", 2024-06-06T03:38:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-06-06T03:38:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-06-06T03:38:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: "snapshot_clone_no_wait": { 2024-06-06T03:38:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snapshot_clone_no_wait", 2024-06-06T03:38:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-06-06T03:38:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix", 2024-06-06T03:38:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: "discovery_interval": { 2024-06-06T03:38:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "discovery_interval", 2024-06-06T03:38:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-06-06T03:38:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "100", 2024-06-06T03:38:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: "identifier": { 2024-06-06T03:38:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "identifier", 2024-06-06T03:38:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-06-06T03:38:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-06-06T03:38:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-06-06T03:38:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_host": { 2024-06-06T03:38:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_host", 2024-06-06T03:38:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_port": { 2024-06-06T03:38:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_port", 2024-06-06T03:38:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10051", 2024-06-06T03:38:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_sender": { 2024-06-06T03:38:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_sender", 2024-06-06T03:38:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-06-06T03:38:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-06-06T03:38:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: "gid": 24113, 2024-06-06T03:38:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "y", 2024-06-06T03:38:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_features": 4540701547738038271, 2024-06-06T03:38:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: "available_modules": [ 2024-06-06T03:38:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "alerts", 2024-06-06T03:38:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-06-06T03:38:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-06-06T03:38:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-06-06T03:38:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How frequently to reexamine health status", 2024-06-06T03:38:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.666 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.666 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.666 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.666 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.666 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.666 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.666 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.666 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.666 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.666 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.666 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.666 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.666 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_destination": { 2024-06-06T03:38:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_destination", 2024-06-06T03:38:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.670 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.670 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.670 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.670 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Email address to send alerts to", 2024-06-06T03:38:05.670 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.670 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.670 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.670 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_from_name": { 2024-06-06T03:38:05.670 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_from_name", 2024-06-06T03:38:05.670 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.670 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.670 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.671 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "Ceph", 2024-06-06T03:38:05.671 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.671 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.671 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.671 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Email From: name", 2024-06-06T03:38:05.671 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.671 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.671 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.671 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_host": { 2024-06-06T03:38:05.671 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_host", 2024-06-06T03:38:05.671 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.671 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.671 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.672 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.672 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.672 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.672 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.672 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP server", 2024-06-06T03:38:05.672 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.672 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.672 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.672 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_password": { 2024-06-06T03:38:05.672 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_password", 2024-06-06T03:38:05.672 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.672 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.673 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.673 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.673 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.673 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.673 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.673 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Password to authenticate with", 2024-06-06T03:38:05.673 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.673 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.673 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.673 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_port": { 2024-06-06T03:38:05.673 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_port", 2024-06-06T03:38:05.673 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.674 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.674 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.674 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "465", 2024-06-06T03:38:05.674 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.674 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.674 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.674 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP port", 2024-06-06T03:38:05.674 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.674 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.674 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.674 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_sender": { 2024-06-06T03:38:05.674 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_sender", 2024-06-06T03:38:05.674 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP envelope sender", 2024-06-06T03:38:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_ssl": { 2024-06-06T03:38:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_ssl", 2024-06-06T03:38:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.676 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.676 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.676 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.676 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.676 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.676 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.676 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use SSL to connect to SMTP server", 2024-06-06T03:38:05.676 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.676 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.676 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.676 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_user": { 2024-06-06T03:38:05.676 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_user", 2024-06-06T03:38:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "User to authenticate as", 2024-06-06T03:38:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.678 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "balancer", 2024-06-06T03:38:05.678 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.678 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.678 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.678 INFO:teuthology.orchestra.run.smithi050.stdout: "active": { 2024-06-06T03:38:05.678 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "active", 2024-06-06T03:38:05.678 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.678 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.678 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.678 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.678 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.678 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "automatically balance PGs across cluster", 2024-06-06T03:38:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: "begin_time": { 2024-06-06T03:38:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "begin_time", 2024-06-06T03:38:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0000", 2024-06-06T03:38:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "beginning time of day to automatically balance", 2024-06-06T03:38:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-06T03:38:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: "begin_weekday": { 2024-06-06T03:38:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "begin_weekday", 2024-06-06T03:38:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-06-06T03:38:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-06-06T03:38:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0", 2024-06-06T03:38:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "6", 2024-06-06T03:38:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-06-06T03:38:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-06T03:38:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_max_iterations": { 2024-06-06T03:38:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_max_iterations", 2024-06-06T03:38:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-06-06T03:38:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "25", 2024-06-06T03:38:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-06-06T03:38:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "250", 2024-06-06T03:38:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-06-06T03:38:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_metrics": { 2024-06-06T03:38:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_metrics", 2024-06-06T03:38:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "pgs,objects,bytes", 2024-06-06T03:38:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-06-06T03:38:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-06-06T03:38:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.683 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.683 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.683 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_step": { 2024-06-06T03:38:05.683 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_step", 2024-06-06T03:38:05.683 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-06-06T03:38:05.683 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.683 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.683 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0.5", 2024-06-06T03:38:05.683 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0.001", 2024-06-06T03:38:05.683 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "0.999", 2024-06-06T03:38:05.683 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.683 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "aggressiveness of optimization", 2024-06-06T03:38:05.683 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-06-06T03:38:05.683 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: "end_time": { 2024-06-06T03:38:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "end_time", 2024-06-06T03:38:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "2359", 2024-06-06T03:38:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "ending time of day to automatically balance", 2024-06-06T03:38:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-06T03:38:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.685 INFO:teuthology.orchestra.run.smithi050.stdout: "end_weekday": { 2024-06-06T03:38:05.685 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "end_weekday", 2024-06-06T03:38:05.685 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-06-06T03:38:05.685 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.685 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.685 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-06-06T03:38:05.685 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0", 2024-06-06T03:38:05.685 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "6", 2024-06-06T03:38:05.685 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.685 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-06-06T03:38:05.685 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-06T03:38:05.685 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.685 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.686 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.686 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.686 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.686 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.686 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.686 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.686 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.686 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.686 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.686 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.686 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.686 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.686 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.687 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.687 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.687 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.687 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.687 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.687 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.687 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.687 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.687 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.687 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.687 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.687 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.687 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.687 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.688 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.688 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.688 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.688 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.688 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.688 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.688 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.688 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.688 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.688 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.688 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.688 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.688 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.689 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.689 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.689 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.689 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.689 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.689 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.689 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.689 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.689 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.689 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.689 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.689 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.689 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.689 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: "min_score": { 2024-06-06T03:38:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "min_score", 2024-06-06T03:38:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-06-06T03:38:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-06-06T03:38:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-06-06T03:38:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": { 2024-06-06T03:38:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mode", 2024-06-06T03:38:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "upmap", 2024-06-06T03:38:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-compat", 2024-06-06T03:38:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: "none", 2024-06-06T03:38:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: "read", 2024-06-06T03:38:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap", 2024-06-06T03:38:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap-read" 2024-06-06T03:38:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Balancer mode", 2024-06-06T03:38:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_ids": { 2024-06-06T03:38:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pool_ids", 2024-06-06T03:38:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-06-06T03:38:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-06-06T03:38:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-06-06T03:38:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-06-06T03:38:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-06-06T03:38:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap_max_deviation": { 2024-06-06T03:38:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "upmap_max_deviation", 2024-06-06T03:38:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-06-06T03:38:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-06-06T03:38:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "deviation below which no optimization is attempted", 2024-06-06T03:38:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-06-06T03:38:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap_max_optimizations": { 2024-06-06T03:38:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "upmap_max_optimizations", 2024-06-06T03:38:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-06-06T03:38:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-06-06T03:38:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-06-06T03:38:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephadm", 2024-06-06T03:38:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_down_multiplier": { 2024-06-06T03:38:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_down_multiplier", 2024-06-06T03:38:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-06-06T03:38:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3.0", 2024-06-06T03:38:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-06-06T03:38:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_refresh_rate": { 2024-06-06T03:38:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_refresh_rate", 2024-06-06T03:38:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "20", 2024-06-06T03:38:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-06-06T03:38:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_starting_port": { 2024-06-06T03:38:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_starting_port", 2024-06-06T03:38:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "4721", 2024-06-06T03:38:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-06-06T03:38:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_ptrace": { 2024-06-06T03:38:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_ptrace", 2024-06-06T03:38:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-06-06T03:38:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-06-06T03:38:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: "autotune_interval": { 2024-06-06T03:38:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "autotune_interval", 2024-06-06T03:38:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-06-06T03:38:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to autotune daemon memory", 2024-06-06T03:38:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: "autotune_memory_target_ratio": { 2024-06-06T03:38:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "autotune_memory_target_ratio", 2024-06-06T03:38:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-06-06T03:38:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0.7", 2024-06-06T03:38:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-06-06T03:38:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm_log_destination": { 2024-06-06T03:38:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephadm_log_destination", 2024-06-06T03:38:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: "file", 2024-06-06T03:38:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: "file,syslog", 2024-06-06T03:38:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: "syslog" 2024-06-06T03:38:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-06-06T03:38:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: "cgroups_split": { 2024-06-06T03:38:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cgroups_split", 2024-06-06T03:38:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-06-06T03:38:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: "config_checks_enabled": { 2024-06-06T03:38:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_checks_enabled", 2024-06-06T03:38:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-06-06T03:38:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.707 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.707 INFO:teuthology.orchestra.run.smithi050.stdout: "config_dashboard": { 2024-06-06T03:38:05.707 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_dashboard", 2024-06-06T03:38:05.707 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.707 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.707 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.707 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.707 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.707 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.707 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.707 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-06-06T03:38:05.707 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.707 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.708 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.708 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_alertmanager": { 2024-06-06T03:38:05.708 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_alertmanager", 2024-06-06T03:38:05.708 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.708 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.708 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.708 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-06-06T03:38:05.708 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.708 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.708 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.708 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-06-06T03:38:05.708 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.708 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_base": { 2024-06-06T03:38:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_base", 2024-06-06T03:38:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/ceph", 2024-06-06T03:38:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Container image name, without the tag", 2024-06-06T03:38:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_elasticsearch": { 2024-06-06T03:38:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_elasticsearch", 2024-06-06T03:38:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-06-06T03:38:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "elasticsearch container image", 2024-06-06T03:38:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.711 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.711 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_grafana": { 2024-06-06T03:38:05.711 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_grafana", 2024-06-06T03:38:05.711 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.711 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.711 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.711 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-06-06T03:38:05.711 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.711 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.711 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.711 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-06-06T03:38:05.711 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.711 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_haproxy": { 2024-06-06T03:38:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_haproxy", 2024-06-06T03:38:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-06-06T03:38:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "HAproxy container image", 2024-06-06T03:38:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_agent": { 2024-06-06T03:38:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_agent", 2024-06-06T03:38:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-06-06T03:38:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger agent container image", 2024-06-06T03:38:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_collector": { 2024-06-06T03:38:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_collector", 2024-06-06T03:38:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-06-06T03:38:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger collector container image", 2024-06-06T03:38:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_query": { 2024-06-06T03:38:05.715 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_query", 2024-06-06T03:38:05.715 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.715 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.715 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.715 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-06-06T03:38:05.715 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.715 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.715 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.715 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger query container image", 2024-06-06T03:38:05.715 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.715 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.715 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.715 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_keepalived": { 2024-06-06T03:38:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_keepalived", 2024-06-06T03:38:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-06-06T03:38:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Keepalived container image", 2024-06-06T03:38:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_loki": { 2024-06-06T03:38:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_loki", 2024-06-06T03:38:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.717 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.717 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.717 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-06-06T03:38:05.717 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.717 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.717 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.717 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Loki container image", 2024-06-06T03:38:05.717 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.717 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.717 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.717 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_node_exporter": { 2024-06-06T03:38:05.717 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_node_exporter", 2024-06-06T03:38:05.717 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.718 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.718 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.718 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-06-06T03:38:05.718 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.718 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.718 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.718 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-06-06T03:38:05.718 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.718 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.718 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.718 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_nvmeof": { 2024-06-06T03:38:05.718 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_nvmeof", 2024-06-06T03:38:05.718 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-06-06T03:38:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Nvme-of container image", 2024-06-06T03:38:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_prometheus": { 2024-06-06T03:38:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_prometheus", 2024-06-06T03:38:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.720 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.720 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.720 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-06-06T03:38:05.720 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.720 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.720 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.720 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-06-06T03:38:05.720 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.720 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.720 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.720 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_promtail": { 2024-06-06T03:38:05.720 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_promtail", 2024-06-06T03:38:05.721 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.721 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.721 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.721 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-06-06T03:38:05.721 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.721 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.721 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.721 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Promtail container image", 2024-06-06T03:38:05.721 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.721 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.721 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.721 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_samba": { 2024-06-06T03:38:05.721 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_samba", 2024-06-06T03:38:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-06-06T03:38:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Samba/SMB container image", 2024-06-06T03:38:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_snmp_gateway": { 2024-06-06T03:38:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_snmp_gateway", 2024-06-06T03:38:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-06-06T03:38:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SNMP Gateway container image", 2024-06-06T03:38:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: "container_init": { 2024-06-06T03:38:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_init", 2024-06-06T03:38:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Run podman/docker with `--init`", 2024-06-06T03:38:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: "daemon_cache_timeout": { 2024-06-06T03:38:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "daemon_cache_timeout", 2024-06-06T03:38:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-06-06T03:38:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-06-06T03:38:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: "default_cephadm_command_timeout": { 2024-06-06T03:38:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "default_cephadm_command_timeout", 2024-06-06T03:38:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "900", 2024-06-06T03:38:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-06-06T03:38:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.727 INFO:teuthology.orchestra.run.smithi050.stdout: "default_registry": { 2024-06-06T03:38:05.727 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "default_registry", 2024-06-06T03:38:05.727 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.727 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.727 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.727 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io", 2024-06-06T03:38:05.727 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.727 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.727 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.727 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-06-06T03:38:05.727 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.727 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.727 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.728 INFO:teuthology.orchestra.run.smithi050.stdout: "device_cache_timeout": { 2024-06-06T03:38:05.728 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_cache_timeout", 2024-06-06T03:38:05.728 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.728 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.728 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.728 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1800", 2024-06-06T03:38:05.728 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.728 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.728 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.728 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache device inventory", 2024-06-06T03:38:05.728 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.728 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.728 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.729 INFO:teuthology.orchestra.run.smithi050.stdout: "device_enhanced_scan": { 2024-06-06T03:38:05.729 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_enhanced_scan", 2024-06-06T03:38:05.729 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.729 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.729 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.729 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.729 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.729 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.729 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.729 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use libstoragemgmt during device scans", 2024-06-06T03:38:05.729 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.729 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.729 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.730 INFO:teuthology.orchestra.run.smithi050.stdout: "facts_cache_timeout": { 2024-06-06T03:38:05.730 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "facts_cache_timeout", 2024-06-06T03:38:05.730 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.730 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.730 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.730 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-06-06T03:38:05.730 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.730 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.730 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.730 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache host facts data", 2024-06-06T03:38:05.730 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.730 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.730 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.730 INFO:teuthology.orchestra.run.smithi050.stdout: "grafana_dashboards_path": { 2024-06-06T03:38:05.731 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "grafana_dashboards_path", 2024-06-06T03:38:05.731 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.731 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.731 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.731 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-06-06T03:38:05.731 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.731 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.731 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.731 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-06-06T03:38:05.731 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.731 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.731 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.731 INFO:teuthology.orchestra.run.smithi050.stdout: "host_check_interval": { 2024-06-06T03:38:05.731 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "host_check_interval", 2024-06-06T03:38:05.732 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.732 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.732 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.732 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-06-06T03:38:05.732 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.732 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.732 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.732 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to perform a host check", 2024-06-06T03:38:05.732 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.732 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.732 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.732 INFO:teuthology.orchestra.run.smithi050.stdout: "hw_monitoring": { 2024-06-06T03:38:05.732 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "hw_monitoring", 2024-06-06T03:38:05.732 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.733 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.733 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.733 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.733 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.733 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.733 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.733 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-06-06T03:38:05.733 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.733 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.733 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.733 INFO:teuthology.orchestra.run.smithi050.stdout: "inventory_list_all": { 2024-06-06T03:38:05.733 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "inventory_list_all", 2024-06-06T03:38:05.733 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.733 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.734 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.734 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.734 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.734 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.734 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.734 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-06-06T03:38:05.734 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.734 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.734 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.734 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.734 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.734 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.735 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.735 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.735 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.735 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.735 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.735 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.735 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.735 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.735 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.735 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.735 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.735 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.735 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.736 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.736 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.736 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.736 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.736 INFO:teuthology.orchestra.run.smithi050.stdout: "log_refresh_metadata": { 2024-06-06T03:38:05.736 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_refresh_metadata", 2024-06-06T03:38:05.736 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.736 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.736 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.736 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.736 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.736 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.736 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.737 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-06-06T03:38:05.737 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.737 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.737 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.737 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.737 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.737 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.737 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.737 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.737 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.737 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.737 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.737 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.738 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-06-06T03:38:05.738 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.738 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.738 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.738 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.738 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.738 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.738 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.738 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.738 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.738 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.738 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.738 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.739 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.739 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.739 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.739 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.739 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.739 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.739 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.739 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.739 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.739 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.739 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.739 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.739 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.739 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.740 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.740 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.740 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.740 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.740 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.740 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.740 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.740 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.740 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.740 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.740 INFO:teuthology.orchestra.run.smithi050.stdout: "manage_etc_ceph_ceph_conf": { 2024-06-06T03:38:05.740 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-06-06T03:38:05.740 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.740 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.741 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.741 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.741 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.741 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.741 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.741 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-06-06T03:38:05.741 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.741 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.741 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.741 INFO:teuthology.orchestra.run.smithi050.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-06-06T03:38:05.741 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-06-06T03:38:05.741 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.741 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.742 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.742 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "*", 2024-06-06T03:38:05.742 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.742 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.742 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.742 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-06-06T03:38:05.742 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.742 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.742 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.742 INFO:teuthology.orchestra.run.smithi050.stdout: "max_count_per_host": { 2024-06-06T03:38:05.742 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_count_per_host", 2024-06-06T03:38:05.742 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.743 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.743 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.743 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-06-06T03:38:05.743 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.743 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.743 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.743 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "max number of daemons per service per host", 2024-06-06T03:38:05.743 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.743 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.743 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.743 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd_draining_count": { 2024-06-06T03:38:05.743 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_osd_draining_count", 2024-06-06T03:38:05.744 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.744 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.744 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.744 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-06-06T03:38:05.744 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.744 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.744 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.744 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-06-06T03:38:05.744 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.744 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.744 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.744 INFO:teuthology.orchestra.run.smithi050.stdout: "migration_current": { 2024-06-06T03:38:05.745 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "migration_current", 2024-06-06T03:38:05.745 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.745 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.745 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.745 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.745 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.745 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.745 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.745 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "internal - do not modify", 2024-06-06T03:38:05.745 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.745 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.745 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.745 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": { 2024-06-06T03:38:05.745 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mode", 2024-06-06T03:38:05.746 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.746 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.746 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.746 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "root", 2024-06-06T03:38:05.746 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.746 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.746 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.746 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm-package", 2024-06-06T03:38:05.746 INFO:teuthology.orchestra.run.smithi050.stdout: "root" 2024-06-06T03:38:05.746 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.746 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "mode for remote execution of cephadm", 2024-06-06T03:38:05.746 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.746 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.747 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.747 INFO:teuthology.orchestra.run.smithi050.stdout: "oob_default_addr": { 2024-06-06T03:38:05.747 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "oob_default_addr", 2024-06-06T03:38:05.747 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.747 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.747 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.747 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "169.254.1.1", 2024-06-06T03:38:05.747 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.747 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.747 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.747 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Default address for RedFish API (oob management).", 2024-06-06T03:38:05.747 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.747 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.747 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: "prometheus_alerts_path": { 2024-06-06T03:38:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prometheus_alerts_path", 2024-06-06T03:38:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-06-06T03:38:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-06-06T03:38:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_insecure": { 2024-06-06T03:38:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_insecure", 2024-06-06T03:38:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-06-06T03:38:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_password": { 2024-06-06T03:38:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_password", 2024-06-06T03:38:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-06-06T03:38:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_url": { 2024-06-06T03:38:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_url", 2024-06-06T03:38:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-06-06T03:38:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.752 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.752 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.752 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_username": { 2024-06-06T03:38:05.752 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_username", 2024-06-06T03:38:05.752 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.752 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.752 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.752 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.752 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.752 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.752 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.752 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-06-06T03:38:05.753 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.753 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.753 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.753 INFO:teuthology.orchestra.run.smithi050.stdout: "secure_monitoring_stack": { 2024-06-06T03:38:05.753 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "secure_monitoring_stack", 2024-06-06T03:38:05.753 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.753 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.753 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.753 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.753 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.753 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.753 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.753 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-06-06T03:38:05.754 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.754 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.754 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.754 INFO:teuthology.orchestra.run.smithi050.stdout: "service_discovery_port": { 2024-06-06T03:38:05.754 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "service_discovery_port", 2024-06-06T03:38:05.754 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.754 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.754 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.754 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8765", 2024-06-06T03:38:05.754 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.754 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.754 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.754 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "cephadm service discovery port", 2024-06-06T03:38:05.755 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.755 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.755 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.755 INFO:teuthology.orchestra.run.smithi050.stdout: "ssh_config_file": { 2024-06-06T03:38:05.755 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssh_config_file", 2024-06-06T03:38:05.755 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.755 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.755 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.755 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.755 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.755 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.755 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.755 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-06-06T03:38:05.756 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.756 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.756 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.756 INFO:teuthology.orchestra.run.smithi050.stdout: "use_agent": { 2024-06-06T03:38:05.756 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "use_agent", 2024-06-06T03:38:05.756 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.756 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.756 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.756 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.756 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.756 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.756 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.756 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-06-06T03:38:05.757 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.757 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.757 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.757 INFO:teuthology.orchestra.run.smithi050.stdout: "use_repo_digest": { 2024-06-06T03:38:05.757 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "use_repo_digest", 2024-06-06T03:38:05.757 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.757 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.757 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.757 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.757 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.757 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.757 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.757 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-06-06T03:38:05.757 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.758 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.758 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.758 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_failed_host_check": { 2024-06-06T03:38:05.758 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_failed_host_check", 2024-06-06T03:38:05.758 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.758 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.758 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.758 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.758 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.758 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.758 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.758 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if the host check fails", 2024-06-06T03:38:05.759 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.759 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.759 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.759 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_stray_daemons": { 2024-06-06T03:38:05.759 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_stray_daemons", 2024-06-06T03:38:05.759 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.759 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.759 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.759 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.759 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.759 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.759 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.759 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-06-06T03:38:05.760 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.760 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.760 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.760 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_stray_hosts": { 2024-06-06T03:38:05.760 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_stray_hosts", 2024-06-06T03:38:05.760 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.760 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.760 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.760 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.760 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.760 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.760 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.760 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-06-06T03:38:05.761 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.761 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.761 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.761 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.761 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.761 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crash", 2024-06-06T03:38:05.761 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.761 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.761 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.761 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.761 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.762 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.762 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.762 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.762 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.762 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.762 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.762 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.762 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.762 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.762 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.762 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.762 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.763 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.763 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.763 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.763 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.763 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.763 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.763 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.763 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.763 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.763 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.763 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.763 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.763 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.764 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.764 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.764 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.764 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.764 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.764 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.764 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.764 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.764 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.764 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.764 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.764 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.764 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.765 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.765 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.765 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.765 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.765 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.765 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.765 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.765 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.765 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.765 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.765 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.765 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.765 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.766 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.766 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.766 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.766 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.766 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.766 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.766 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.766 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.766 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.766 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.766 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.766 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.767 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.767 INFO:teuthology.orchestra.run.smithi050.stdout: "retain_interval": { 2024-06-06T03:38:05.767 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "retain_interval", 2024-06-06T03:38:05.767 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.767 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.767 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.767 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "31536000", 2024-06-06T03:38:05.767 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.767 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.767 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.767 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long to retain crashes before pruning them", 2024-06-06T03:38:05.767 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.768 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.768 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.768 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_recent_interval": { 2024-06-06T03:38:05.768 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_recent_interval", 2024-06-06T03:38:05.768 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.768 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.768 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.768 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1209600", 2024-06-06T03:38:05.768 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.768 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.768 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.768 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "time interval in which to warn about recent crashes", 2024-06-06T03:38:05.768 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.769 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.769 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.769 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.769 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.769 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "dashboard", 2024-06-06T03:38:05.769 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.769 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.769 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.769 INFO:teuthology.orchestra.run.smithi050.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-06-06T03:38:05.769 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-06-06T03:38:05.769 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.769 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.770 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.770 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-06-06T03:38:05.770 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.770 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.770 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.770 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.770 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.770 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.770 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.770 INFO:teuthology.orchestra.run.smithi050.stdout: "ALERTMANAGER_API_HOST": { 2024-06-06T03:38:05.770 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ALERTMANAGER_API_HOST", 2024-06-06T03:38:05.770 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.770 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.771 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.771 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.771 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.771 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.771 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.771 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.771 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.771 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.771 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.771 INFO:teuthology.orchestra.run.smithi050.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-06-06T03:38:05.771 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-06-06T03:38:05.771 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.772 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.772 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.772 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.772 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.772 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.772 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.772 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.772 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.772 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.772 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.772 INFO:teuthology.orchestra.run.smithi050.stdout: "AUDIT_API_ENABLED": { 2024-06-06T03:38:05.772 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "AUDIT_API_ENABLED", 2024-06-06T03:38:05.772 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.772 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.773 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.773 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.773 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.773 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.773 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.773 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.773 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.773 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.773 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.773 INFO:teuthology.orchestra.run.smithi050.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-06-06T03:38:05.773 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-06-06T03:38:05.773 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.773 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.773 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.773 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.774 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.774 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.774 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.774 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.774 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.774 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.774 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.774 INFO:teuthology.orchestra.run.smithi050.stdout: "ENABLE_BROWSABLE_API": { 2024-06-06T03:38:05.774 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ENABLE_BROWSABLE_API", 2024-06-06T03:38:05.774 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.774 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.774 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.774 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.774 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.775 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.775 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.775 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.775 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.775 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.775 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.775 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-06-06T03:38:05.775 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-06-06T03:38:05.775 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.775 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.775 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.775 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.775 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.775 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.776 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.776 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.776 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.776 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.776 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.776 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-06-06T03:38:05.776 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-06-06T03:38:05.776 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.776 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.776 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.776 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.776 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.776 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.777 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.777 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.777 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.777 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.777 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.777 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-06-06T03:38:05.777 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-06-06T03:38:05.777 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.777 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.777 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.777 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.777 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.777 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.778 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.778 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.778 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.778 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.778 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.778 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-06-06T03:38:05.778 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-06-06T03:38:05.778 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.778 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.778 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.778 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.778 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.778 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.778 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.779 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.779 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.779 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.779 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.779 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_NFS": { 2024-06-06T03:38:05.779 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-06-06T03:38:05.779 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.779 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.779 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.779 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.779 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.779 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.779 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.779 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.780 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.780 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.780 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.780 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_RBD": { 2024-06-06T03:38:05.780 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-06-06T03:38:05.780 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.780 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.780 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.780 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.780 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.780 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.780 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.780 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.781 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.781 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.781 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.781 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_RGW": { 2024-06-06T03:38:05.781 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-06-06T03:38:05.781 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.781 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.781 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.781 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.781 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.781 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.781 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.782 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.782 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.782 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.782 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.782 INFO:teuthology.orchestra.run.smithi050.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-06-06T03:38:05.782 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-06-06T03:38:05.782 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.782 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.782 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.782 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.782 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.782 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.782 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.783 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.783 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.783 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.783 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.783 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_PASSWORD": { 2024-06-06T03:38:05.783 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_PASSWORD", 2024-06-06T03:38:05.783 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.783 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.783 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.783 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2024-06-06T03:38:05.783 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.783 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.783 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.783 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.783 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.783 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.784 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.784 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-06-06T03:38:05.784 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-06-06T03:38:05.784 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.784 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.784 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.784 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.784 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.784 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.784 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.784 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.784 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.784 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.784 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.785 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_URL": { 2024-06-06T03:38:05.785 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_URL", 2024-06-06T03:38:05.785 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.785 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.785 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.785 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.785 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.785 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.785 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.785 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.785 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.785 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.785 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.785 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_USERNAME": { 2024-06-06T03:38:05.785 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_USERNAME", 2024-06-06T03:38:05.786 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.786 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.786 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.786 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2024-06-06T03:38:05.786 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.786 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.786 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.786 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.786 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.786 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.786 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.786 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-06-06T03:38:05.787 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-06-06T03:38:05.787 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.787 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.787 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.787 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.787 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.787 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.787 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.787 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.787 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.787 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.787 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.787 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-06-06T03:38:05.787 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-06-06T03:38:05.788 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.788 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.788 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.788 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.788 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.788 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.788 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.788 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.788 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.788 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.788 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.788 INFO:teuthology.orchestra.run.smithi050.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-06-06T03:38:05.789 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-06-06T03:38:05.789 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.789 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.789 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.789 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.789 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.789 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.789 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.789 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.789 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.789 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.789 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.789 INFO:teuthology.orchestra.run.smithi050.stdout: "ISSUE_TRACKER_API_KEY": { 2024-06-06T03:38:05.790 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-06-06T03:38:05.790 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.790 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.790 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.790 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.790 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.790 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.790 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.790 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.790 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.790 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.790 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.791 INFO:teuthology.orchestra.run.smithi050.stdout: "PROMETHEUS_API_HOST": { 2024-06-06T03:38:05.791 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PROMETHEUS_API_HOST", 2024-06-06T03:38:05.791 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.791 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.791 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.791 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.791 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.791 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.791 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.791 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.791 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.791 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.791 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.792 INFO:teuthology.orchestra.run.smithi050.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-06-06T03:38:05.792 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-06-06T03:38:05.792 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.792 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.792 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.792 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.792 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.792 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.792 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.792 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.792 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.792 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.792 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.792 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-06-06T03:38:05.793 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-06-06T03:38:05.793 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.793 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.793 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.793 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.793 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.793 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.793 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.793 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.793 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.793 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.793 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.793 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-06-06T03:38:05.794 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-06-06T03:38:05.794 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.794 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.794 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.794 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.794 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.794 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.794 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.794 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.794 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.794 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.794 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.794 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-06-06T03:38:05.795 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-06-06T03:38:05.795 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.795 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.795 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.795 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.795 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.795 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.795 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.795 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.795 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.795 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.795 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.795 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-06-06T03:38:05.796 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-06-06T03:38:05.796 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.796 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.796 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.796 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.796 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.796 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.796 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.796 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.796 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.796 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.796 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.796 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-06-06T03:38:05.797 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-06-06T03:38:05.797 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.797 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.797 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.797 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.797 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.797 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.797 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.797 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.797 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.797 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.797 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.797 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-06-06T03:38:05.798 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-06-06T03:38:05.798 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.798 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.798 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.798 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.798 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.798 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.798 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.798 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.798 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.798 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.798 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.799 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-06-06T03:38:05.799 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-06-06T03:38:05.799 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.799 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.799 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.799 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.799 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.799 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.799 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.799 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.799 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.799 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.799 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.800 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_ENABLED": { 2024-06-06T03:38:05.800 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_ENABLED", 2024-06-06T03:38:05.800 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.800 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.800 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.800 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.800 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.800 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.800 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.800 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.800 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.800 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.800 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.800 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-06-06T03:38:05.800 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-06-06T03:38:05.801 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.801 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.801 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.801 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-06-06T03:38:05.801 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.801 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.801 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.801 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.801 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.801 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.801 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.801 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-06-06T03:38:05.801 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-06-06T03:38:05.802 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.802 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.802 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.802 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-06-06T03:38:05.802 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.802 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.802 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.802 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.802 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.802 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.802 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.802 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-06-06T03:38:05.803 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-06-06T03:38:05.803 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.803 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.803 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.803 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8", 2024-06-06T03:38:05.803 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.803 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.803 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.803 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.803 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.803 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.803 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.803 INFO:teuthology.orchestra.run.smithi050.stdout: "REST_REQUESTS_TIMEOUT": { 2024-06-06T03:38:05.804 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-06-06T03:38:05.804 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.804 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.804 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.804 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "45", 2024-06-06T03:38:05.804 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.804 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.804 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.804 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.804 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.804 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.804 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.804 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_ACCESS_KEY": { 2024-06-06T03:38:05.804 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_ACCESS_KEY", 2024-06-06T03:38:05.805 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.805 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.805 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.805 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.805 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.805 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.805 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.805 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.805 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.805 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.805 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.805 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-06-06T03:38:05.806 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-06-06T03:38:05.806 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.806 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.806 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.806 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2024-06-06T03:38:05.806 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.806 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.806 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.806 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.806 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.806 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.806 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.806 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_SECRET_KEY": { 2024-06-06T03:38:05.807 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_SECRET_KEY", 2024-06-06T03:38:05.807 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.807 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.807 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.807 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.807 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.807 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.807 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.807 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.807 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.807 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.807 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.808 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_SSL_VERIFY": { 2024-06-06T03:38:05.808 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_SSL_VERIFY", 2024-06-06T03:38:05.808 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.808 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.808 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.808 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.808 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.808 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.808 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.808 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.808 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.808 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.809 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.809 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-06-06T03:38:05.809 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-06-06T03:38:05.809 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.809 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.809 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.809 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-06-06T03:38:05.809 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.809 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.809 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.809 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.809 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.809 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.810 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.810 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-06-06T03:38:05.810 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-06-06T03:38:05.810 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.810 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.810 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.810 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-06-06T03:38:05.810 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.810 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.810 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.810 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.810 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.811 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.811 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.811 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-06-06T03:38:05.811 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-06-06T03:38:05.811 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.811 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.811 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.811 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-06-06T03:38:05.811 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.811 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.811 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.811 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.812 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.812 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.814 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.814 INFO:teuthology.orchestra.run.smithi050.stdout: "cross_origin_url": { 2024-06-06T03:38:05.814 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cross_origin_url", 2024-06-06T03:38:05.814 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.814 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.814 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.814 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.814 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.815 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.815 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.815 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.815 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.815 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.815 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.815 INFO:teuthology.orchestra.run.smithi050.stdout: "crt_file": { 2024-06-06T03:38:05.815 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crt_file", 2024-06-06T03:38:05.815 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.815 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.815 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.816 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.816 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.816 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.816 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.816 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.816 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.816 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.816 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.816 INFO:teuthology.orchestra.run.smithi050.stdout: "debug": { 2024-06-06T03:38:05.816 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "debug", 2024-06-06T03:38:05.816 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.816 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.817 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.817 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.817 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.817 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.817 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.817 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable/disable debug options", 2024-06-06T03:38:05.817 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.817 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.817 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.817 INFO:teuthology.orchestra.run.smithi050.stdout: "jwt_token_ttl": { 2024-06-06T03:38:05.817 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "jwt_token_ttl", 2024-06-06T03:38:05.818 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.818 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.818 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.818 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "28800", 2024-06-06T03:38:05.818 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.818 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.818 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.818 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.818 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.818 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.818 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.818 INFO:teuthology.orchestra.run.smithi050.stdout: "key_file": { 2024-06-06T03:38:05.819 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "key_file", 2024-06-06T03:38:05.819 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.819 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.819 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.819 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.819 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.819 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.819 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.819 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.819 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.819 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.819 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.820 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.820 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.820 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.820 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.820 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.820 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.820 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.820 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.820 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.820 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.820 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.820 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.820 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.820 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.821 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.821 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.821 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.821 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.821 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.821 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.821 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.821 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.821 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.821 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.821 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.821 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.821 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.822 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.822 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.822 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.822 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.822 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.822 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.822 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.822 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.823 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.823 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.823 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.823 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.823 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.823 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.823 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.823 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.823 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.823 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.824 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.824 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.824 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.824 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.824 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.824 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.824 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.824 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.824 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.824 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.824 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.824 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.824 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.825 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.825 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.825 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.825 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.825 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.825 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.825 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.825 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.825 INFO:teuthology.orchestra.run.smithi050.stdout: "motd": { 2024-06-06T03:38:05.825 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "motd", 2024-06-06T03:38:05.825 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.825 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.825 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.826 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.826 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.826 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.826 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.826 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "The message of the day", 2024-06-06T03:38:05.826 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.826 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.826 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.826 INFO:teuthology.orchestra.run.smithi050.stdout: "redirect_resolve_ip_addr": { 2024-06-06T03:38:05.826 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "redirect_resolve_ip_addr", 2024-06-06T03:38:05.826 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.826 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.826 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.827 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.827 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.827 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.827 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.827 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.827 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.827 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.827 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.827 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2024-06-06T03:38:05.827 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2024-06-06T03:38:05.827 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.827 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.827 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.827 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "::", 2024-06-06T03:38:05.827 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.828 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.828 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.828 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.828 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.828 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.828 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.828 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2024-06-06T03:38:05.828 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2024-06-06T03:38:05.828 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.828 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.828 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.828 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8080", 2024-06-06T03:38:05.828 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.828 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.828 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.829 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.829 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.829 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.829 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.829 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl": { 2024-06-06T03:38:05.829 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl", 2024-06-06T03:38:05.829 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.829 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.829 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.829 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.829 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.829 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.829 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.829 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.830 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.830 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.830 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.830 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl_server_port": { 2024-06-06T03:38:05.830 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl_server_port", 2024-06-06T03:38:05.830 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.830 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.830 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.830 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8443", 2024-06-06T03:38:05.830 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.830 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.830 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.830 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.830 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.831 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.831 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.831 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_behaviour": { 2024-06-06T03:38:05.831 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_behaviour", 2024-06-06T03:38:05.831 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.831 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.831 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.831 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "redirect", 2024-06-06T03:38:05.831 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.831 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.831 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.831 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.832 INFO:teuthology.orchestra.run.smithi050.stdout: "redirect" 2024-06-06T03:38:05.832 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.832 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.832 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.832 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.832 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.832 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_error_status_code": { 2024-06-06T03:38:05.832 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_error_status_code", 2024-06-06T03:38:05.832 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.832 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.832 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.832 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "500", 2024-06-06T03:38:05.832 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "400", 2024-06-06T03:38:05.832 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "599", 2024-06-06T03:38:05.833 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.833 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.833 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.833 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.833 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.833 INFO:teuthology.orchestra.run.smithi050.stdout: "url_prefix": { 2024-06-06T03:38:05.833 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "url_prefix", 2024-06-06T03:38:05.833 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.833 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.833 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.833 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.833 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.833 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.834 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.834 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.834 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.834 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.834 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.834 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.834 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.834 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.834 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "devicehealth", 2024-06-06T03:38:05.834 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.834 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.834 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.835 INFO:teuthology.orchestra.run.smithi050.stdout: "enable_monitoring": { 2024-06-06T03:38:05.835 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enable_monitoring", 2024-06-06T03:38:05.835 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.835 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.835 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.835 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.835 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.835 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.835 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.835 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "monitor device health metrics", 2024-06-06T03:38:05.835 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.835 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.835 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.836 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.836 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.836 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.836 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.836 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.836 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.836 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.836 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.836 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.836 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.836 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.836 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.836 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.836 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.837 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.837 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.837 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.837 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.837 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.837 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.837 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.837 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.837 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.837 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.837 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.837 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.837 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.838 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.838 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.838 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.838 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.838 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.838 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.838 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.838 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.838 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.838 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.838 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.838 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.838 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.839 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.839 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.839 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.839 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.839 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.839 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.839 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.839 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.839 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.839 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.839 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.839 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.839 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.839 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.840 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.840 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.840 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.840 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.840 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.840 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.840 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.840 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.840 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.840 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.840 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.840 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.840 INFO:teuthology.orchestra.run.smithi050.stdout: "mark_out_threshold": { 2024-06-06T03:38:05.841 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mark_out_threshold", 2024-06-06T03:38:05.841 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.841 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.841 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.841 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "2419200", 2024-06-06T03:38:05.841 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.841 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.841 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.841 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-06-06T03:38:05.841 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.841 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.841 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.841 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": { 2024-06-06T03:38:05.841 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pool_name", 2024-06-06T03:38:05.841 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.842 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.842 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.842 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "device_health_metrics", 2024-06-06T03:38:05.842 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.842 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.842 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.842 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "name of pool in which to store device health metrics", 2024-06-06T03:38:05.842 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.842 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.842 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.842 INFO:teuthology.orchestra.run.smithi050.stdout: "retention_period": { 2024-06-06T03:38:05.842 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "retention_period", 2024-06-06T03:38:05.843 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.843 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.843 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.843 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15552000", 2024-06-06T03:38:05.843 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.843 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.843 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.843 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long to retain device health metrics", 2024-06-06T03:38:05.843 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.843 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.843 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.843 INFO:teuthology.orchestra.run.smithi050.stdout: "scrape_frequency": { 2024-06-06T03:38:05.843 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "scrape_frequency", 2024-06-06T03:38:05.843 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.844 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.844 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.844 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "86400", 2024-06-06T03:38:05.844 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.844 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.844 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.844 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to scrape device health metrics", 2024-06-06T03:38:05.844 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.844 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.844 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.844 INFO:teuthology.orchestra.run.smithi050.stdout: "self_heal": { 2024-06-06T03:38:05.844 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "self_heal", 2024-06-06T03:38:05.844 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.844 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.844 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.845 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.845 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.845 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.845 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.845 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-06-06T03:38:05.845 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.845 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.845 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.845 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-06-06T03:38:05.845 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-06-06T03:38:05.845 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.845 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.845 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.845 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-06-06T03:38:05.846 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.846 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.846 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.846 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to wake up and check device health", 2024-06-06T03:38:05.846 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.846 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.846 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.846 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_threshold": { 2024-06-06T03:38:05.846 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_threshold", 2024-06-06T03:38:05.846 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.846 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.846 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.846 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "7257600", 2024-06-06T03:38:05.846 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.847 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.847 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.847 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-06-06T03:38:05.847 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.847 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.847 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.847 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.847 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.847 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "diskprediction_local", 2024-06-06T03:38:05.847 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.847 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.847 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.847 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.848 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.848 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.848 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.848 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.848 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.848 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.848 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.848 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.848 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.848 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.848 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.848 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.848 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.848 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.848 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.849 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.849 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.849 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.849 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.849 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.849 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.849 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.849 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.849 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.849 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.849 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.849 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.849 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.850 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.850 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.850 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.850 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.850 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.850 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.850 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.850 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.850 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.850 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.850 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.850 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.851 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.851 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.851 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.851 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.851 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.851 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.851 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.851 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.851 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.851 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.851 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.851 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.851 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.852 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.852 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.852 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.852 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.852 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.852 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.852 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.852 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.852 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.852 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.852 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.852 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.852 INFO:teuthology.orchestra.run.smithi050.stdout: "predict_interval": { 2024-06-06T03:38:05.853 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "predict_interval", 2024-06-06T03:38:05.853 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.853 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.853 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.853 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "86400", 2024-06-06T03:38:05.853 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.853 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.853 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.853 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.853 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.853 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.853 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.854 INFO:teuthology.orchestra.run.smithi050.stdout: "predictor_model": { 2024-06-06T03:38:05.854 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "predictor_model", 2024-06-06T03:38:05.854 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.854 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.854 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.854 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "prophetstor", 2024-06-06T03:38:05.854 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.854 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.854 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.854 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.854 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.854 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.854 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.855 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-06-06T03:38:05.855 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-06-06T03:38:05.855 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.855 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.855 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.855 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-06-06T03:38:05.855 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.855 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.855 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.855 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.855 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.855 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.855 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.855 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.856 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.856 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "influx", 2024-06-06T03:38:05.856 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": false, 2024-06-06T03:38:05.856 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "influxdb python module not found", 2024-06-06T03:38:05.856 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.856 INFO:teuthology.orchestra.run.smithi050.stdout: "batch_size": { 2024-06-06T03:38:05.856 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "batch_size", 2024-06-06T03:38:05.856 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.856 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.856 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.856 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5000", 2024-06-06T03:38:05.856 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.857 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.857 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.857 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-06-06T03:38:05.857 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.857 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.857 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.857 INFO:teuthology.orchestra.run.smithi050.stdout: "database": { 2024-06-06T03:38:05.857 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "database", 2024-06-06T03:38:05.857 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.857 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.857 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.857 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "ceph", 2024-06-06T03:38:05.857 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.857 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.857 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.858 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-06-06T03:38:05.858 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.858 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.858 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.858 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": { 2024-06-06T03:38:05.858 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "hostname", 2024-06-06T03:38:05.858 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.858 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.858 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.858 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.858 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.858 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.859 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.859 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB server hostname", 2024-06-06T03:38:05.859 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.859 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.859 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.859 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-06-06T03:38:05.859 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-06-06T03:38:05.859 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.859 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.859 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.859 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "30", 2024-06-06T03:38:05.860 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "5", 2024-06-06T03:38:05.860 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.860 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.860 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-06-06T03:38:05.860 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.860 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.860 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.860 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.860 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.860 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.860 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.860 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.861 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.861 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.861 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.861 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.861 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.861 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.861 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.861 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.861 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.861 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.861 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.861 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.861 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.862 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.862 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.862 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.862 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.862 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.862 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.862 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.862 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.862 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.862 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.862 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.862 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.863 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.863 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.863 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.863 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.863 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.863 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.863 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.863 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.863 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.863 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.863 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.864 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.864 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.864 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.864 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.864 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.864 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.864 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.864 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.864 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.864 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.864 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.864 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.865 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.865 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.865 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.865 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.865 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.865 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.865 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.865 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.865 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.865 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.865 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.865 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.865 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.866 INFO:teuthology.orchestra.run.smithi050.stdout: "password": { 2024-06-06T03:38:05.866 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "password", 2024-06-06T03:38:05.866 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.866 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.866 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.866 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.866 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.866 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.866 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.866 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "password of InfluxDB server user", 2024-06-06T03:38:05.866 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.866 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.866 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.867 INFO:teuthology.orchestra.run.smithi050.stdout: "port": { 2024-06-06T03:38:05.867 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "port", 2024-06-06T03:38:05.867 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.867 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.867 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.867 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8086", 2024-06-06T03:38:05.867 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.867 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.867 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.867 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB server port", 2024-06-06T03:38:05.867 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.867 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.867 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.867 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl": { 2024-06-06T03:38:05.868 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl", 2024-06-06T03:38:05.868 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.868 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.868 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.868 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "false", 2024-06-06T03:38:05.868 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.868 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.868 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.868 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-06-06T03:38:05.868 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.868 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.868 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.869 INFO:teuthology.orchestra.run.smithi050.stdout: "threads": { 2024-06-06T03:38:05.869 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "threads", 2024-06-06T03:38:05.869 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.869 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.869 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.869 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-06-06T03:38:05.869 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-06-06T03:38:05.869 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "32", 2024-06-06T03:38:05.869 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.869 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-06-06T03:38:05.869 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.869 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.869 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.870 INFO:teuthology.orchestra.run.smithi050.stdout: "username": { 2024-06-06T03:38:05.870 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "username", 2024-06-06T03:38:05.870 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.870 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.870 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.870 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.870 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.870 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.870 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.870 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "username of InfluxDB server user", 2024-06-06T03:38:05.870 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.870 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.870 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.871 INFO:teuthology.orchestra.run.smithi050.stdout: "verify_ssl": { 2024-06-06T03:38:05.871 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "verify_ssl", 2024-06-06T03:38:05.871 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.871 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.871 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.871 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "true", 2024-06-06T03:38:05.871 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.871 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.871 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.871 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-06-06T03:38:05.871 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.871 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.872 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.872 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.872 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.872 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.872 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "insights", 2024-06-06T03:38:05.872 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.872 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.872 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.872 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.872 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.872 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.873 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.873 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.873 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.873 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.873 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.873 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.873 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.873 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.873 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.873 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.873 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.873 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.873 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.873 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.873 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.874 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.874 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.874 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.874 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.874 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.874 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.874 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.874 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.874 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.874 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.874 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.875 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.875 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.875 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.875 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.875 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.875 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.875 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.875 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.875 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.875 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.875 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.875 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.875 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.875 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.876 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.876 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.876 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.876 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.876 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.876 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.876 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.876 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.876 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.876 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.876 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.876 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.876 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.876 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.877 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.877 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.877 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.877 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.877 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.877 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.877 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.877 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.877 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.877 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.877 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.877 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.877 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.877 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "iostat", 2024-06-06T03:38:05.878 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.878 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.878 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.878 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.878 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.878 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.878 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.878 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.878 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.878 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.878 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.878 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.878 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.878 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.878 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.879 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.879 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.879 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.879 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.879 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.879 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.879 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.879 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.879 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.879 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.879 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.879 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.879 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.879 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.879 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.880 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.880 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.880 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.880 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.880 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.880 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.880 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.880 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.880 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.880 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.880 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.880 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.880 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.880 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.880 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.881 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.881 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.881 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.881 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.881 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.881 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.881 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.881 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.881 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.881 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.881 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.881 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.881 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.881 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.882 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.882 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.882 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.882 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.882 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.882 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.882 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.882 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.882 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.882 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.882 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.882 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.882 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.882 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.883 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "k8sevents", 2024-06-06T03:38:05.883 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.883 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.883 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.883 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_event_retention_days": { 2024-06-06T03:38:05.883 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ceph_event_retention_days", 2024-06-06T03:38:05.883 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.883 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.883 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.883 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "7", 2024-06-06T03:38:05.883 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.883 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.883 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.883 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Days to hold ceph event information within local cache", 2024-06-06T03:38:05.884 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.884 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.884 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.884 INFO:teuthology.orchestra.run.smithi050.stdout: "config_check_secs": { 2024-06-06T03:38:05.884 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_check_secs", 2024-06-06T03:38:05.884 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.884 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.884 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.884 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-06-06T03:38:05.884 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "10", 2024-06-06T03:38:05.884 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.884 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.884 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-06-06T03:38:05.884 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.885 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.885 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.885 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.885 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.885 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.885 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.885 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.885 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.885 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.885 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.885 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.885 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.885 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.885 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.886 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.886 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.886 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.886 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.886 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.886 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.886 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.886 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.886 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.886 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.886 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.886 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.886 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.886 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.887 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.887 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.887 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.887 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.887 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.887 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.887 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.887 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.887 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.887 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.887 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.887 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.887 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.888 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.888 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.888 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.888 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.888 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.888 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.888 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.888 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.888 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.888 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.888 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.888 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.888 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.888 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.888 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.889 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.889 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.889 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.889 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.889 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.889 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.889 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.889 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.889 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.889 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.889 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.889 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.889 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.889 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.889 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.890 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "localpool", 2024-06-06T03:38:05.890 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.890 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.890 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.890 INFO:teuthology.orchestra.run.smithi050.stdout: "failure_domain": { 2024-06-06T03:38:05.890 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "failure_domain", 2024-06-06T03:38:05.890 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.890 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.890 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.890 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "host", 2024-06-06T03:38:05.890 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.890 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.890 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.891 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "failure domain for any created local pool", 2024-06-06T03:38:05.891 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-06-06T03:38:05.891 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.891 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.891 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.891 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.891 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.891 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.891 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.891 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.891 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.891 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.891 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.891 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.892 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.892 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.892 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.892 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.892 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.892 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.892 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.892 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.892 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.892 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.892 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.892 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.893 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.893 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.893 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.893 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.893 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.893 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.893 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.893 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.893 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.893 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.893 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.893 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.893 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.893 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.894 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.894 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.894 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.894 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.894 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.894 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.894 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.894 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.894 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.894 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.894 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.894 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.894 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.894 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.894 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.895 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.895 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.895 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.895 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.895 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.895 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.895 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.895 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.895 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.895 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.895 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.895 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.895 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.895 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.895 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.896 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": { 2024-06-06T03:38:05.896 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "min_size", 2024-06-06T03:38:05.896 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.896 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.896 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.896 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.896 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.896 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.896 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.896 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default min_size for any created local pool", 2024-06-06T03:38:05.896 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-06-06T03:38:05.896 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.896 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.897 INFO:teuthology.orchestra.run.smithi050.stdout: "num_rep": { 2024-06-06T03:38:05.897 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "num_rep", 2024-06-06T03:38:05.897 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.897 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.897 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.897 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3", 2024-06-06T03:38:05.897 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.897 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.897 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.897 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default replica count for any created local pool", 2024-06-06T03:38:05.897 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.897 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.897 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.898 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": { 2024-06-06T03:38:05.898 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pg_num", 2024-06-06T03:38:05.898 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.898 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.898 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.898 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "128", 2024-06-06T03:38:05.898 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.898 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.898 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.898 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default pg_num for any created local pool", 2024-06-06T03:38:05.899 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.899 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.899 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.899 INFO:teuthology.orchestra.run.smithi050.stdout: "prefix": { 2024-06-06T03:38:05.899 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prefix", 2024-06-06T03:38:05.899 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.899 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.899 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.899 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.899 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.899 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.899 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.899 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "name prefix for any created local pool", 2024-06-06T03:38:05.900 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.900 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.900 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.900 INFO:teuthology.orchestra.run.smithi050.stdout: "subtree": { 2024-06-06T03:38:05.900 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "subtree", 2024-06-06T03:38:05.900 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.900 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.900 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.900 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "rack", 2024-06-06T03:38:05.900 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.900 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.900 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.900 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "CRUSH level for which to create a local pool", 2024-06-06T03:38:05.900 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-06-06T03:38:05.901 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.901 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.901 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.901 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.901 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.901 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mds_autoscaler", 2024-06-06T03:38:05.901 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.901 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.901 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.901 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.901 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.901 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.901 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.902 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.902 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.902 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.902 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.902 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.902 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.902 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.902 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.902 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.902 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.902 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.902 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.902 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.902 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.903 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.903 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.903 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.903 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.903 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.903 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.903 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.903 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.903 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.903 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.903 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.903 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.903 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.904 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.904 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.904 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.904 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.904 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.904 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.904 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.904 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.904 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.904 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.904 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.904 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.904 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.905 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.905 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.905 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.905 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.905 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.905 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.905 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.905 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.905 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.905 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.905 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.905 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.905 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.906 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.906 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.906 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.906 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.906 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.906 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.906 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.906 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.906 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.906 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.906 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.906 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.906 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.907 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mirroring", 2024-06-06T03:38:05.907 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.907 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.907 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.907 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.907 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.907 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.907 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.907 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.907 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.907 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.907 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.907 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.907 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.907 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.908 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.908 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.908 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.908 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.908 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.908 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.908 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.908 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.908 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.908 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.908 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.908 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.908 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.908 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.909 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.909 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.909 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.909 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.909 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.909 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.909 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.909 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.909 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.909 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.909 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.909 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.909 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.909 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.910 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.910 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.910 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.910 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.910 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.910 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.910 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.910 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.910 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.910 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.910 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.910 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.910 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.910 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.911 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.911 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.911 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.911 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.911 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.911 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.911 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.911 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.911 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.911 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.911 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.911 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.911 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.911 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.912 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.912 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "nfs", 2024-06-06T03:38:05.912 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.912 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.912 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.912 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.912 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.912 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.912 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.912 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.912 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.912 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.913 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.913 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.913 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.913 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.913 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.913 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.913 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.913 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.913 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.913 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.913 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.913 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.913 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.914 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.914 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.914 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.914 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.914 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.914 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.914 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.914 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.914 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.914 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.914 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.914 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.914 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.915 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.915 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.915 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.915 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.915 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.915 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.915 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.915 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.915 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.915 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.915 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.915 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.915 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.915 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.916 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.916 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.916 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.916 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.916 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.916 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.916 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.916 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.916 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.916 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.916 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.916 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.916 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.917 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.917 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.917 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.917 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.917 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.917 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.917 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.917 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.917 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "orchestrator", 2024-06-06T03:38:05.917 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.917 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.917 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.918 INFO:teuthology.orchestra.run.smithi050.stdout: "fail_fs": { 2024-06-06T03:38:05.918 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "fail_fs", 2024-06-06T03:38:05.918 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.918 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.918 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.918 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.918 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.918 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.918 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.918 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-06-06T03:38:05.918 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.918 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.918 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.919 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.919 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.919 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.919 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.919 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.919 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.919 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.919 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.919 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.919 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.919 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.919 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.920 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.920 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.920 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.920 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.920 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.920 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.920 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.920 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.920 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.920 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.920 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.920 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.920 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.921 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.921 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.921 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.921 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.921 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.921 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.921 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.921 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.921 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.921 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.921 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.921 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.922 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.922 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.922 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.922 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.922 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.922 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.922 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.922 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.922 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.922 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.922 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.922 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.923 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.923 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.923 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.923 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.923 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.923 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.923 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.923 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.923 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.923 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.923 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.923 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.923 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.923 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.923 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.924 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.924 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.924 INFO:teuthology.orchestra.run.smithi050.stdout: "orchestrator": { 2024-06-06T03:38:05.924 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "orchestrator", 2024-06-06T03:38:05.924 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.924 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.924 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.924 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.924 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.924 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.924 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.924 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm", 2024-06-06T03:38:05.924 INFO:teuthology.orchestra.run.smithi050.stdout: "rook", 2024-06-06T03:38:05.924 INFO:teuthology.orchestra.run.smithi050.stdout: "test_orchestrator" 2024-06-06T03:38:05.925 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.925 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Orchestrator backend", 2024-06-06T03:38:05.925 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.925 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.925 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.925 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.925 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.925 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "osd_perf_query", 2024-06-06T03:38:05.925 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.925 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.925 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.925 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.925 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.926 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.926 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.926 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.926 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.926 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.926 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.926 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.926 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.926 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.926 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.926 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.926 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.927 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.927 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.927 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.927 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.927 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.927 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.927 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.927 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.927 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.927 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.927 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.927 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.927 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.927 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.928 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.928 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.928 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.928 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.928 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.928 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.928 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.928 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.928 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.928 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.928 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.928 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.929 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.929 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.929 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.929 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.929 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.929 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.929 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.929 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.929 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.929 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.929 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.929 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.929 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.930 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.930 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.930 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.930 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.930 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.930 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.930 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.930 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.930 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.930 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.930 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.930 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.930 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.931 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.931 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.931 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "osd_support", 2024-06-06T03:38:05.931 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.931 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.931 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.931 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.931 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.931 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.932 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.932 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.932 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.932 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.932 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.932 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.932 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.932 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.932 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.932 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.932 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.932 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.932 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.932 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.933 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.933 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.933 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.933 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.933 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.933 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.933 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.933 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.933 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.933 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.933 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.933 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.933 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.934 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.934 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.934 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.934 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.934 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.934 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.934 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.934 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.934 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.934 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.934 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.934 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.934 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.935 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.935 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.935 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.935 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.935 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.935 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.935 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.935 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.935 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.935 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.935 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.936 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.936 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.936 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.936 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.936 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.936 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.936 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.936 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.936 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.936 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.936 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.936 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.936 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.937 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.937 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.937 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.937 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pg_autoscaler", 2024-06-06T03:38:05.937 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.937 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.937 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.937 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.937 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.937 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.937 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.937 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.937 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.937 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.938 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.938 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.938 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.938 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.938 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.938 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.938 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.938 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.938 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.938 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.938 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.938 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.938 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.939 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.939 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.939 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.939 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.939 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.939 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.939 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.939 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.939 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.939 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.939 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.939 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.939 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.940 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.940 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.940 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.940 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.940 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.940 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.940 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.940 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.940 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.940 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.940 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.940 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.940 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.941 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.941 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.941 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.941 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.941 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.941 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.941 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.941 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.941 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.941 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.941 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.942 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.942 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.942 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.942 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.942 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.942 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.942 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.942 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.942 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.942 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-06-06T03:38:05.942 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-06-06T03:38:05.942 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.942 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.943 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.943 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-06-06T03:38:05.943 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.943 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.943 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.943 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.943 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.943 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.943 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.943 INFO:teuthology.orchestra.run.smithi050.stdout: "threshold": { 2024-06-06T03:38:05.943 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "threshold", 2024-06-06T03:38:05.943 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-06-06T03:38:05.943 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.944 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.944 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3.0", 2024-06-06T03:38:05.944 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1.0", 2024-06-06T03:38:05.944 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.944 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.944 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "scaling threshold", 2024-06-06T03:38:05.944 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-06-06T03:38:05.944 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.944 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.944 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.944 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.944 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "progress", 2024-06-06T03:38:05.944 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.945 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.945 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.945 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_pg_recovery_event": { 2024-06-06T03:38:05.945 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_pg_recovery_event", 2024-06-06T03:38:05.945 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.945 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.945 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.945 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.945 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.945 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.945 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.945 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow the module to show pg recovery progress", 2024-06-06T03:38:05.945 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.945 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.945 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.946 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": { 2024-06-06T03:38:05.946 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enabled", 2024-06-06T03:38:05.946 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.946 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.946 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.946 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.946 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.946 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.946 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.946 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.946 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.946 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.946 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.947 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.947 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.947 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.947 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.947 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.947 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.947 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.947 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.947 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.947 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.947 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.947 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.947 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.947 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.947 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.948 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.948 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.948 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.948 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.948 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.948 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.948 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.948 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.948 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.948 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.948 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.948 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.948 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.949 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.949 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.949 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.949 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.949 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.949 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.949 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.949 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.949 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.949 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.949 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.950 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.950 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.950 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.950 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.950 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.950 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.950 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.950 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.950 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.950 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.950 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.950 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.950 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.951 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.951 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.951 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.951 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.951 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.951 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.951 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.951 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.951 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.951 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.951 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.951 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.951 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.952 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.952 INFO:teuthology.orchestra.run.smithi050.stdout: "max_completed_events": { 2024-06-06T03:38:05.952 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_completed_events", 2024-06-06T03:38:05.952 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.952 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.952 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.952 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "50", 2024-06-06T03:38:05.952 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.952 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.952 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.952 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "number of past completed events to remember", 2024-06-06T03:38:05.952 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.953 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.953 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.953 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-06-06T03:38:05.953 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-06-06T03:38:05.953 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:05.953 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.953 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.953 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-06-06T03:38:05.953 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.953 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.953 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.953 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long the module is going to sleep", 2024-06-06T03:38:05.953 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.954 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.954 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.954 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.954 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.954 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prometheus", 2024-06-06T03:38:05.954 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.954 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.954 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.954 INFO:teuthology.orchestra.run.smithi050.stdout: "cache": { 2024-06-06T03:38:05.954 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cache", 2024-06-06T03:38:05.954 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.955 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.955 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.955 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.955 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.955 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.955 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.955 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.955 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.955 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.955 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.955 INFO:teuthology.orchestra.run.smithi050.stdout: "exclude_perf_counters": { 2024-06-06T03:38:05.955 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "exclude_perf_counters", 2024-06-06T03:38:05.955 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.956 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.956 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.956 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.956 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.956 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.956 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.956 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-06-06T03:38:05.956 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-06-06T03:38:05.956 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.956 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.956 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.956 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.956 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.956 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.957 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.957 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.957 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.957 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.957 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.957 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.957 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.957 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.957 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.957 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.957 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.957 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.957 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.957 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.957 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.957 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.958 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.958 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.958 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.958 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.958 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.958 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.958 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.958 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.958 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.958 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.958 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.958 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.958 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.959 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.959 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.959 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.959 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.959 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.959 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.959 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.959 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.959 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.959 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.959 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.959 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.959 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.960 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.960 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.960 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.960 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.960 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.960 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.960 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.960 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.960 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.960 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.960 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.960 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.960 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.960 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.961 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.961 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.961 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.961 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.961 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.961 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.961 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_stats_pools": { 2024-06-06T03:38:05.961 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_stats_pools", 2024-06-06T03:38:05.961 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.961 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.961 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.961 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.961 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.961 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.962 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.962 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.962 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.962 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.962 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.962 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_stats_pools_refresh_interval": { 2024-06-06T03:38:05.962 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-06-06T03:38:05.962 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.962 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.962 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.962 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "300", 2024-06-06T03:38:05.962 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.963 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.963 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.963 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.963 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.963 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.963 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.963 INFO:teuthology.orchestra.run.smithi050.stdout: "scrape_interval": { 2024-06-06T03:38:05.963 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "scrape_interval", 2024-06-06T03:38:05.963 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-06-06T03:38:05.963 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.963 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.963 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15.0", 2024-06-06T03:38:05.964 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.964 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.964 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.964 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.964 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.964 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.964 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.964 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2024-06-06T03:38:05.964 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2024-06-06T03:38:05.964 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.964 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.964 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.964 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "::", 2024-06-06T03:38:05.964 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.965 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.965 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.965 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-06-06T03:38:05.965 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.965 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.965 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.965 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2024-06-06T03:38:05.965 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2024-06-06T03:38:05.965 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.965 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.965 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.965 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "9283", 2024-06-06T03:38:05.965 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.965 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.965 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.966 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-06-06T03:38:05.966 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.966 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.966 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.966 INFO:teuthology.orchestra.run.smithi050.stdout: "stale_cache_strategy": { 2024-06-06T03:38:05.966 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "stale_cache_strategy", 2024-06-06T03:38:05.966 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.966 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.966 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.966 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "log", 2024-06-06T03:38:05.966 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.966 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.966 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.967 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.967 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.967 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.967 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.967 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_behaviour": { 2024-06-06T03:38:05.967 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_behaviour", 2024-06-06T03:38:05.967 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.967 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.967 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.967 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "default", 2024-06-06T03:38:05.967 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.967 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.967 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.968 INFO:teuthology.orchestra.run.smithi050.stdout: "default", 2024-06-06T03:38:05.968 INFO:teuthology.orchestra.run.smithi050.stdout: "error" 2024-06-06T03:38:05.968 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.968 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.968 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.968 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.968 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.968 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_error_status_code": { 2024-06-06T03:38:05.968 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_error_status_code", 2024-06-06T03:38:05.968 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.968 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.968 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.968 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "500", 2024-06-06T03:38:05.969 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "400", 2024-06-06T03:38:05.969 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "599", 2024-06-06T03:38:05.969 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.969 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.969 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.969 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.969 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.969 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.969 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.969 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_support", 2024-06-06T03:38:05.969 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.969 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.970 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.970 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.970 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.970 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.970 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.970 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.970 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.970 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.970 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.970 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.970 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.970 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.970 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.971 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.971 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.971 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.971 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.971 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.971 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.971 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.971 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.971 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.971 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.971 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.971 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.971 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.971 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.972 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.972 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.972 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.972 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.972 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.972 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.972 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.972 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.972 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.972 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.972 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.972 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.973 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.973 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.973 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.973 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.973 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.973 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.973 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.973 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.973 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.973 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.973 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.973 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.973 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.973 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.973 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.974 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.974 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.974 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.974 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.974 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.974 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.974 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.974 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.974 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.974 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.974 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.974 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.974 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: "max_concurrent_snap_create": { 2024-06-06T03:38:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_concurrent_snap_create", 2024-06-06T03:38:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-06-06T03:38:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: "mirror_snapshot_schedule": { 2024-06-06T03:38:05.976 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mirror_snapshot_schedule", 2024-06-06T03:38:05.976 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.976 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.976 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.976 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.976 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.976 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.976 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.976 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.976 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.976 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.976 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.976 INFO:teuthology.orchestra.run.smithi050.stdout: "trash_purge_schedule": { 2024-06-06T03:38:05.977 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "trash_purge_schedule", 2024-06-06T03:38:05.977 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.977 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.977 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.977 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.977 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.977 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.977 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.977 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.977 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.977 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.977 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.977 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.977 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.978 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "restful", 2024-06-06T03:38:05.978 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.978 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.978 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.978 INFO:teuthology.orchestra.run.smithi050.stdout: "enable_auth": { 2024-06-06T03:38:05.978 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enable_auth", 2024-06-06T03:38:05.978 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.978 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.978 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.978 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:05.978 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.978 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.978 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.978 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.979 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.979 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.979 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.979 INFO:teuthology.orchestra.run.smithi050.stdout: "key_file": { 2024-06-06T03:38:05.979 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "key_file", 2024-06-06T03:38:05.979 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.979 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.979 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.979 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.979 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.979 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.979 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.979 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.979 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.980 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.980 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.980 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.980 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.980 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.980 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.980 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.980 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.980 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.980 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.980 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.980 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.980 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.981 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.981 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.981 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.981 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.981 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.981 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.981 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.981 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.981 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.981 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.981 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.981 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.982 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.982 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.982 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.982 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.982 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.982 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.982 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.982 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.982 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.982 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.982 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.983 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.983 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.983 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.983 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.983 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.983 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.983 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.983 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.983 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.983 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.983 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.983 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.983 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.983 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.983 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.983 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.984 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.984 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.984 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.984 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.984 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.984 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.984 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.984 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.984 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.984 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.984 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.985 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.985 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.985 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.985 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.985 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.985 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2024-06-06T03:38:05.985 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2024-06-06T03:38:05.985 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.985 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.985 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.985 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.985 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.985 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.985 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.986 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.986 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.986 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.986 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.986 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2024-06-06T03:38:05.986 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2024-06-06T03:38:05.986 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.986 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.986 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.986 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.986 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.986 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.986 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.987 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.987 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.987 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.987 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.987 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.987 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.987 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rgw", 2024-06-06T03:38:05.987 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.987 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.987 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.987 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.987 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.987 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.987 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.988 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.988 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.988 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.988 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.988 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.988 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.988 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.988 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.988 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.988 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.988 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.988 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.988 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.988 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.988 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.989 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.989 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.989 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.989 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.989 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.989 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.989 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.989 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.989 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.989 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.989 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.989 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.989 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.990 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.990 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.990 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.990 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.990 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.990 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.990 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.990 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.990 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.990 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.990 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.990 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.990 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.990 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.991 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.991 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.991 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.991 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.991 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.991 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.991 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.991 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.991 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.991 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.991 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.991 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.991 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.991 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.991 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.992 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.992 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.992 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.992 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.992 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.992 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.992 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.992 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rook", 2024-06-06T03:38:05.992 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.992 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.992 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.992 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.992 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.993 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.993 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.993 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.993 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.993 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.993 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.993 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.993 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.993 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.993 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.993 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.993 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.993 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.993 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.994 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.994 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.994 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.994 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.994 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:05.994 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:05.994 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.994 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.994 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.994 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.994 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.994 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.995 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.995 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.995 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.995 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.995 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.995 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:05.995 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:05.995 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.995 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.995 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.995 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:05.995 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.995 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.995 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.996 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:05.996 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:05.996 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:05.996 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:05.996 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:05.996 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:05.996 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:05.996 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.996 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.996 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.996 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.996 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:05.996 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:05.997 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:05.997 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.997 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.997 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:05.997 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.997 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.997 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.997 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:05.997 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.997 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.997 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.997 INFO:teuthology.orchestra.run.smithi050.stdout: "storage_class": { 2024-06-06T03:38:05.997 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "storage_class", 2024-06-06T03:38:05.998 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.998 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.998 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:05.998 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "local", 2024-06-06T03:38:05.998 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.998 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.998 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:05.998 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-06-06T03:38:05.998 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:05.998 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:05.998 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:05.998 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.998 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:05.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:05.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:05.999 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "selftest", 2024-06-06T03:38:05.999 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:05.999 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:05.999 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:05.999 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:05.999 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:05.999 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:05.999 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:05.999 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:05.999 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:05.999 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:05.999 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:05.999 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:05.999 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.000 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.000 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.000 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.000 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.000 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.000 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.000 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.000 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.000 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.000 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.000 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.000 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.000 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.001 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.001 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.001 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.001 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.001 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.001 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.001 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.001 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.001 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.001 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.001 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.001 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.001 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.001 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.002 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.002 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.002 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.002 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.002 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.002 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.002 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.002 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.002 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.002 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.002 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.002 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.003 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.003 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.003 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.003 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.003 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.003 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.003 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.003 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.003 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.003 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.003 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.003 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.003 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.004 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.004 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.004 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.004 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.004 INFO:teuthology.orchestra.run.smithi050.stdout: "roption1": { 2024-06-06T03:38:06.004 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "roption1", 2024-06-06T03:38:06.004 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.004 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.004 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.004 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.004 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.004 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.004 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.005 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.005 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.005 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.005 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.005 INFO:teuthology.orchestra.run.smithi050.stdout: "roption2": { 2024-06-06T03:38:06.005 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "roption2", 2024-06-06T03:38:06.005 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.005 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.005 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.005 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "xyz", 2024-06-06T03:38:06.005 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.005 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.005 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.006 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.006 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.006 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.006 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.006 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption1": { 2024-06-06T03:38:06.006 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption1", 2024-06-06T03:38:06.006 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.006 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.006 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.006 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.006 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.006 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.006 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.006 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.007 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.007 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.007 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.007 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption2": { 2024-06-06T03:38:06.007 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption2", 2024-06-06T03:38:06.007 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.007 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.007 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.007 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.007 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.007 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.007 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.007 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.007 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.007 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.008 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.008 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption3": { 2024-06-06T03:38:06.008 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption3", 2024-06-06T03:38:06.008 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-06-06T03:38:06.008 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.008 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.008 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.008 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.008 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.008 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.008 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.008 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.009 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.009 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.009 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption4": { 2024-06-06T03:38:06.009 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption4", 2024-06-06T03:38:06.009 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.009 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.009 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.009 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.009 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.009 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.009 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.009 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.009 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.010 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.010 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.010 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption5": { 2024-06-06T03:38:06.010 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption5", 2024-06-06T03:38:06.010 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.010 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.010 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.010 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.010 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.010 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.010 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.010 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.011 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.011 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.011 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.011 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption6": { 2024-06-06T03:38:06.011 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption6", 2024-06-06T03:38:06.011 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.011 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.011 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.011 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.011 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.011 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.011 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.012 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.012 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.012 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.012 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.012 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption7": { 2024-06-06T03:38:06.012 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption7", 2024-06-06T03:38:06.012 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.012 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.012 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.012 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.012 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-06-06T03:38:06.012 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "42", 2024-06-06T03:38:06.013 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.013 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.013 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.013 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.013 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.013 INFO:teuthology.orchestra.run.smithi050.stdout: "testkey": { 2024-06-06T03:38:06.013 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testkey", 2024-06-06T03:38:06.013 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.013 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.013 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.013 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.013 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.014 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.014 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.014 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.014 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.014 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.014 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.014 INFO:teuthology.orchestra.run.smithi050.stdout: "testlkey": { 2024-06-06T03:38:06.014 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testlkey", 2024-06-06T03:38:06.014 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.014 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.014 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.014 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.014 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.015 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.015 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.015 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.019 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.019 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.019 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.019 INFO:teuthology.orchestra.run.smithi050.stdout: "testnewline": { 2024-06-06T03:38:06.019 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testnewline", 2024-06-06T03:38:06.019 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.019 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.019 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.020 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.020 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.020 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.020 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.020 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.020 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.020 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.020 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.020 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.020 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.020 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snap_schedule", 2024-06-06T03:38:06.020 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.021 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.021 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.021 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_m_granularity": { 2024-06-06T03:38:06.021 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_m_granularity", 2024-06-06T03:38:06.021 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.021 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.021 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.021 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.021 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.021 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.021 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.021 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow minute scheduled snapshots", 2024-06-06T03:38:06.021 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.021 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.022 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.022 INFO:teuthology.orchestra.run.smithi050.stdout: "dump_on_update": { 2024-06-06T03:38:06.022 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "dump_on_update", 2024-06-06T03:38:06.022 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.022 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.022 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.022 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.022 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.022 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.022 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.022 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "dump database to debug log on update", 2024-06-06T03:38:06.022 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.023 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.023 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.023 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.023 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.023 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.023 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.023 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.023 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.023 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.023 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.023 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.023 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.023 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.024 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.024 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.024 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.024 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.024 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.024 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.024 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.024 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.024 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.024 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.024 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.024 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.024 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.024 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.024 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.025 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.025 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.025 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.025 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.025 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.025 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.025 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.025 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.025 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.025 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.025 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.025 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.025 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.025 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.025 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.026 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.026 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.026 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.026 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.026 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.026 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.026 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.026 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.026 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.026 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.026 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.026 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.027 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.027 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.027 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.027 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.027 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.027 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.027 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.027 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.027 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.027 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.027 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.027 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.027 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.027 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.027 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.028 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "stats", 2024-06-06T03:38:06.028 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.028 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.028 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.028 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.028 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.028 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.028 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.028 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.028 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.028 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.028 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.028 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.029 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.029 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.029 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.029 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.029 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.029 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.029 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.029 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.029 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.029 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.029 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.029 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.029 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.030 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.030 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.030 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.030 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.030 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.030 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.030 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.030 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.030 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.030 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.030 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.030 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.030 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.030 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.031 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.031 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.031 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.031 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.031 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.031 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.031 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.031 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.031 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.031 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.031 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.031 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.031 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.031 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.031 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.032 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.032 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.032 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.032 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.032 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.032 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.032 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.032 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.032 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.032 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.032 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.032 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.032 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.032 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.033 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.033 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.033 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.033 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "status", 2024-06-06T03:38:06.033 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.033 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.033 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.033 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.033 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.033 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.033 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.033 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.033 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.034 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.034 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.034 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.034 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.034 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.034 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.034 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.034 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.034 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.034 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.034 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.034 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.034 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.034 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.035 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.035 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.035 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.035 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.035 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.035 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.035 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.035 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.035 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.035 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.035 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.035 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.035 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.036 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.036 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.036 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.036 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.036 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.036 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.036 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.036 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.036 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.036 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.036 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.036 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.037 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.037 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.037 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.037 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.037 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.037 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.037 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.037 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.037 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.037 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.037 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.037 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.037 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.038 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.038 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.038 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.038 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.038 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.038 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.038 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.038 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.038 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.038 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.038 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "telegraf", 2024-06-06T03:38:06.039 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.039 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.039 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.039 INFO:teuthology.orchestra.run.smithi050.stdout: "address": { 2024-06-06T03:38:06.039 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "address", 2024-06-06T03:38:06.039 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.039 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.039 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.039 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-06-06T03:38:06.039 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.039 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.039 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.039 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.039 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.040 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.040 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.040 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-06-06T03:38:06.040 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-06-06T03:38:06.040 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:06.040 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.040 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.040 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15", 2024-06-06T03:38:06.040 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.040 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.040 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.040 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.041 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.041 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.041 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.041 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.041 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.041 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.041 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.041 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.041 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.041 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.041 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.041 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.041 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.042 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.042 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.042 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.042 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.042 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.042 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.042 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.042 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.042 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.042 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.042 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.043 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.043 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.043 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.043 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.043 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.043 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.043 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.043 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.043 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.043 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.043 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.043 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.044 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.044 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.044 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.044 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.044 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.044 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.044 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.044 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.044 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.044 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.044 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.044 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.044 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.044 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.045 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.045 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.045 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.045 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.045 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.045 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.045 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.045 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.045 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.045 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.045 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.045 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.045 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.045 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.045 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.046 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.046 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.046 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.046 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.046 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.046 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.046 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "telemetry", 2024-06-06T03:38:06.046 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.046 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.046 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.046 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_basic": { 2024-06-06T03:38:06.046 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_basic", 2024-06-06T03:38:06.047 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.047 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.047 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.047 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.047 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.047 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.047 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.047 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share basic cluster information (size, version)", 2024-06-06T03:38:06.047 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.047 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.047 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.047 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_crash": { 2024-06-06T03:38:06.047 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_crash", 2024-06-06T03:38:06.047 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.047 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.048 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.048 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.048 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.048 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.048 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.048 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-06-06T03:38:06.048 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.048 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.048 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.048 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_device": { 2024-06-06T03:38:06.048 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_device", 2024-06-06T03:38:06.048 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.048 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.048 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.049 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.049 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.049 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.049 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.049 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-06-06T03:38:06.049 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.049 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.049 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.049 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_ident": { 2024-06-06T03:38:06.049 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_ident", 2024-06-06T03:38:06.049 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.049 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.049 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.049 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.049 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.050 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.050 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.050 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-06-06T03:38:06.050 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.050 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.050 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.050 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_perf": { 2024-06-06T03:38:06.050 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_perf", 2024-06-06T03:38:06.050 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.050 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.050 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.050 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.050 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.051 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.051 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.051 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share various performance metrics of a cluster", 2024-06-06T03:38:06.051 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.051 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.051 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.051 INFO:teuthology.orchestra.run.smithi050.stdout: "contact": { 2024-06-06T03:38:06.051 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "contact", 2024-06-06T03:38:06.051 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.051 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.051 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.051 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.051 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.052 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.052 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.052 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.052 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.052 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.052 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.052 INFO:teuthology.orchestra.run.smithi050.stdout: "description": { 2024-06-06T03:38:06.052 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "description", 2024-06-06T03:38:06.052 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.052 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.052 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.052 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.052 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.052 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.052 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.053 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.053 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.053 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.053 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.053 INFO:teuthology.orchestra.run.smithi050.stdout: "device_url": { 2024-06-06T03:38:06.053 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_url", 2024-06-06T03:38:06.053 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.053 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.053 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.053 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-06-06T03:38:06.053 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.053 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.054 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.054 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.054 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.054 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.054 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.054 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": { 2024-06-06T03:38:06.054 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enabled", 2024-06-06T03:38:06.054 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.054 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.054 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.054 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.054 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.055 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.055 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.055 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.055 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.055 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.055 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.055 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-06-06T03:38:06.055 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-06-06T03:38:06.055 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.055 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.055 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.055 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "24", 2024-06-06T03:38:06.056 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "8", 2024-06-06T03:38:06.056 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.056 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.056 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.056 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.056 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.056 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.056 INFO:teuthology.orchestra.run.smithi050.stdout: "last_opt_revision": { 2024-06-06T03:38:06.056 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "last_opt_revision", 2024-06-06T03:38:06.056 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.056 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.056 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.056 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1", 2024-06-06T03:38:06.056 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.057 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.057 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.057 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.057 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.057 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.057 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.057 INFO:teuthology.orchestra.run.smithi050.stdout: "leaderboard": { 2024-06-06T03:38:06.057 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "leaderboard", 2024-06-06T03:38:06.057 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.057 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.057 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.057 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.057 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.058 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.058 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.058 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.058 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.058 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.058 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.058 INFO:teuthology.orchestra.run.smithi050.stdout: "leaderboard_description": { 2024-06-06T03:38:06.058 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "leaderboard_description", 2024-06-06T03:38:06.058 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.058 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.058 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.058 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.058 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.058 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.059 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.059 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.059 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.059 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.059 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.059 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.059 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.059 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.059 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.059 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.059 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.059 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.059 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.059 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.060 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.060 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.060 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.060 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.060 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.060 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.060 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.060 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.060 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.060 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.060 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.060 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.060 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.061 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.061 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.061 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.061 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.061 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.061 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.061 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.061 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.061 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.061 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.061 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.061 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.062 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.062 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.062 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.062 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.062 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.062 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.062 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.062 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.062 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.062 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.062 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.062 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.062 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.062 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.063 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.063 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.063 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.063 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.063 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.063 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.063 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.063 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.063 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.063 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.063 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.063 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.063 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.063 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.064 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.064 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.064 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.064 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.064 INFO:teuthology.orchestra.run.smithi050.stdout: "organization": { 2024-06-06T03:38:06.064 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "organization", 2024-06-06T03:38:06.064 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.064 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.064 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.064 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.064 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.064 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.064 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.065 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.065 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.065 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.065 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.065 INFO:teuthology.orchestra.run.smithi050.stdout: "proxy": { 2024-06-06T03:38:06.065 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "proxy", 2024-06-06T03:38:06.065 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.065 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.065 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.065 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.065 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.065 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.065 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.066 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.066 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.066 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.066 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.066 INFO:teuthology.orchestra.run.smithi050.stdout: "url": { 2024-06-06T03:38:06.066 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "url", 2024-06-06T03:38:06.066 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.066 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.066 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.066 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-06-06T03:38:06.066 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.066 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.066 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.067 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.067 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.067 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.067 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.067 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.067 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.067 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "test_orchestrator", 2024-06-06T03:38:06.067 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.067 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.067 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.067 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.067 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.068 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.068 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.068 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.068 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.068 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.068 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.068 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.068 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.068 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.068 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.068 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.068 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.068 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.068 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.069 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.069 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.069 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.069 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.069 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.069 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.069 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.069 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.069 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.069 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.069 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.069 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.069 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.070 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.070 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.070 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.070 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.070 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.070 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.070 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.070 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.070 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.070 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.070 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.070 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.070 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.071 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.071 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.071 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.071 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.071 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.071 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.071 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.071 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.071 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.071 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.071 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.071 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.071 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.071 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.072 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.072 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.072 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.072 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.072 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.072 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.072 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.072 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.072 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.072 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.072 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.072 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.072 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "volumes", 2024-06-06T03:38:06.073 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.073 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.073 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.073 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.073 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.073 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.073 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.073 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.073 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.073 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.073 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.073 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.073 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.074 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.074 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.074 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.074 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.074 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.074 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.074 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.074 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.074 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.074 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.074 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.074 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.074 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.074 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.075 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.075 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.075 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.075 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.075 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.075 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.075 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.075 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.075 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.075 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.075 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.075 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.075 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.075 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.075 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.076 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.076 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.076 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.076 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.076 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.076 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.076 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.076 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.076 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.076 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.076 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.076 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.076 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.076 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.077 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.077 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.077 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.077 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.077 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.077 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.077 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.077 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.077 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.077 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.077 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.077 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.077 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.078 INFO:teuthology.orchestra.run.smithi050.stdout: "max_concurrent_clones": { 2024-06-06T03:38:06.078 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_concurrent_clones", 2024-06-06T03:38:06.078 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.078 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.078 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.078 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "4", 2024-06-06T03:38:06.078 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.078 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.078 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.078 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Number of asynchronous cloner threads", 2024-06-06T03:38:06.078 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.078 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.078 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.079 INFO:teuthology.orchestra.run.smithi050.stdout: "periodic_async_work": { 2024-06-06T03:38:06.079 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "periodic_async_work", 2024-06-06T03:38:06.079 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.079 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.079 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.079 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.079 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.079 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.079 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.079 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Periodically check for async work", 2024-06-06T03:38:06.079 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.079 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.079 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.080 INFO:teuthology.orchestra.run.smithi050.stdout: "snapshot_clone_delay": { 2024-06-06T03:38:06.080 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snapshot_clone_delay", 2024-06-06T03:38:06.080 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.080 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.080 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.080 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-06-06T03:38:06.080 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.080 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.080 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.080 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-06-06T03:38:06.080 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.080 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.080 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.081 INFO:teuthology.orchestra.run.smithi050.stdout: "snapshot_clone_no_wait": { 2024-06-06T03:38:06.081 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snapshot_clone_no_wait", 2024-06-06T03:38:06.081 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.081 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.081 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.081 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.081 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.081 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.081 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.081 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-06-06T03:38:06.081 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.081 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.081 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.081 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.082 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.082 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix", 2024-06-06T03:38:06.082 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.082 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.082 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.082 INFO:teuthology.orchestra.run.smithi050.stdout: "discovery_interval": { 2024-06-06T03:38:06.082 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "discovery_interval", 2024-06-06T03:38:06.082 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-06-06T03:38:06.082 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.082 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.082 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "100", 2024-06-06T03:38:06.082 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.083 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.083 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.083 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.083 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.083 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.083 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.083 INFO:teuthology.orchestra.run.smithi050.stdout: "identifier": { 2024-06-06T03:38:06.083 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "identifier", 2024-06-06T03:38:06.083 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.083 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.083 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.083 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.083 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.083 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.084 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.084 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.084 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.084 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.084 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.084 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-06-06T03:38:06.084 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-06-06T03:38:06.084 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:06.084 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.084 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.084 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-06-06T03:38:06.084 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.084 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.084 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.084 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.085 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.085 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.085 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.085 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.085 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.085 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.085 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.085 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.085 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.085 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.085 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.085 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.085 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.085 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.086 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.086 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.086 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.086 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.086 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.086 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.086 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.086 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.086 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.086 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.086 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.086 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.086 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.087 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.087 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.087 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.087 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.087 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.087 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.087 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.087 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.087 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.087 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.087 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.087 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.087 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.087 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.088 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.088 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.088 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.088 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.088 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.088 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.088 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.088 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.088 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.088 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.088 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.088 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.088 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.088 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.088 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.089 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.089 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.089 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.089 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.089 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.089 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.089 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.089 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.089 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.089 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.089 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.089 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.090 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.090 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_host": { 2024-06-06T03:38:06.090 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_host", 2024-06-06T03:38:06.090 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.090 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.090 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.090 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.090 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.090 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.090 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.090 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.090 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.090 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.091 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.091 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_port": { 2024-06-06T03:38:06.091 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_port", 2024-06-06T03:38:06.091 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.091 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.091 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.091 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10051", 2024-06-06T03:38:06.091 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.091 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.091 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.091 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.091 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.091 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.092 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.092 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_sender": { 2024-06-06T03:38:06.092 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_sender", 2024-06-06T03:38:06.092 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.092 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.092 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.092 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-06-06T03:38:06.092 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.092 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.092 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.092 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.092 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.092 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.093 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.093 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.093 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.093 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.093 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-06-06T03:38:06.093 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.093 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.093 INFO:teuthology.orchestra.run.smithi050.stdout: "modules": [ 2024-06-06T03:38:06.093 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm", 2024-06-06T03:38:06.093 INFO:teuthology.orchestra.run.smithi050.stdout: "dashboard", 2024-06-06T03:38:06.093 INFO:teuthology.orchestra.run.smithi050.stdout: "iostat", 2024-06-06T03:38:06.093 INFO:teuthology.orchestra.run.smithi050.stdout: "nfs", 2024-06-06T03:38:06.093 INFO:teuthology.orchestra.run.smithi050.stdout: "restful" 2024-06-06T03:38:06.093 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.094 INFO:teuthology.orchestra.run.smithi050.stdout: "available_modules": [ 2024-06-06T03:38:06.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.094 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "alerts", 2024-06-06T03:38:06.094 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.094 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.094 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.094 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-06-06T03:38:06.094 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-06-06T03:38:06.094 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:06.094 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.094 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.094 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-06-06T03:38:06.095 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.095 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.095 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.095 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How frequently to reexamine health status", 2024-06-06T03:38:06.095 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.095 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.095 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.095 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.095 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.095 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.095 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.095 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.096 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.096 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.096 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.096 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.096 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.096 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.096 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.096 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.096 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.096 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.096 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.096 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.096 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.096 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.096 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.097 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.097 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.097 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.097 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.097 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.097 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.097 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.097 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.097 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.097 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.097 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.097 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.097 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.098 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.098 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.098 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.098 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.098 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.098 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.098 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.098 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.098 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.098 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.098 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.098 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.099 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.099 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.099 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.099 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.099 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.099 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.099 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.099 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.099 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.099 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.099 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.099 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.099 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.100 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.100 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.100 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.100 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.100 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.100 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.100 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.100 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.100 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_destination": { 2024-06-06T03:38:06.100 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_destination", 2024-06-06T03:38:06.100 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.100 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.100 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.101 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.101 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.101 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.101 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.101 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Email address to send alerts to", 2024-06-06T03:38:06.101 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.101 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.101 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.101 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_from_name": { 2024-06-06T03:38:06.101 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_from_name", 2024-06-06T03:38:06.101 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.101 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.101 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.102 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "Ceph", 2024-06-06T03:38:06.102 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.102 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.102 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.102 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Email From: name", 2024-06-06T03:38:06.102 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.102 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.102 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.102 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_host": { 2024-06-06T03:38:06.102 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_host", 2024-06-06T03:38:06.102 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.102 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.102 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.103 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.103 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.103 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.103 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.103 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP server", 2024-06-06T03:38:06.103 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.103 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.103 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.103 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_password": { 2024-06-06T03:38:06.103 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_password", 2024-06-06T03:38:06.103 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.103 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.103 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.103 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.104 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.104 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.104 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.104 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Password to authenticate with", 2024-06-06T03:38:06.104 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.104 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.104 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.104 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_port": { 2024-06-06T03:38:06.104 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_port", 2024-06-06T03:38:06.104 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.104 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.104 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.104 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "465", 2024-06-06T03:38:06.105 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.105 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.105 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.105 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP port", 2024-06-06T03:38:06.105 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.105 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.105 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.105 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_sender": { 2024-06-06T03:38:06.105 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_sender", 2024-06-06T03:38:06.105 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.105 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.105 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.105 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.105 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.106 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.106 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.106 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP envelope sender", 2024-06-06T03:38:06.106 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.106 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.106 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.106 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_ssl": { 2024-06-06T03:38:06.106 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_ssl", 2024-06-06T03:38:06.106 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.106 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.106 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.106 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.106 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.107 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.107 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.107 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use SSL to connect to SMTP server", 2024-06-06T03:38:06.107 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.107 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.107 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.107 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_user": { 2024-06-06T03:38:06.107 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_user", 2024-06-06T03:38:06.107 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.107 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.107 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.107 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.107 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.108 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.108 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.108 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "User to authenticate as", 2024-06-06T03:38:06.108 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.108 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.108 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.108 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.108 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.108 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "balancer", 2024-06-06T03:38:06.108 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.108 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.108 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.109 INFO:teuthology.orchestra.run.smithi050.stdout: "active": { 2024-06-06T03:38:06.109 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "active", 2024-06-06T03:38:06.109 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.109 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.109 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.109 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.109 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.109 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.109 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.109 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "automatically balance PGs across cluster", 2024-06-06T03:38:06.109 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.109 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.109 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.110 INFO:teuthology.orchestra.run.smithi050.stdout: "begin_time": { 2024-06-06T03:38:06.110 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "begin_time", 2024-06-06T03:38:06.110 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.110 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.110 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.110 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0000", 2024-06-06T03:38:06.110 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.110 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.110 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.110 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "beginning time of day to automatically balance", 2024-06-06T03:38:06.110 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-06T03:38:06.110 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.110 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.111 INFO:teuthology.orchestra.run.smithi050.stdout: "begin_weekday": { 2024-06-06T03:38:06.111 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "begin_weekday", 2024-06-06T03:38:06.111 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-06-06T03:38:06.111 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.111 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.111 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-06-06T03:38:06.111 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0", 2024-06-06T03:38:06.111 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "6", 2024-06-06T03:38:06.111 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.111 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-06-06T03:38:06.111 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-06T03:38:06.111 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.112 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.112 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_max_iterations": { 2024-06-06T03:38:06.112 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_max_iterations", 2024-06-06T03:38:06.112 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-06-06T03:38:06.112 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.112 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.112 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "25", 2024-06-06T03:38:06.112 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-06-06T03:38:06.112 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "250", 2024-06-06T03:38:06.112 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.112 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-06-06T03:38:06.112 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.113 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.113 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.113 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_metrics": { 2024-06-06T03:38:06.113 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_metrics", 2024-06-06T03:38:06.113 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.113 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.113 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.113 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "pgs,objects,bytes", 2024-06-06T03:38:06.113 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.113 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.113 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.113 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-06-06T03:38:06.113 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-06-06T03:38:06.114 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.114 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.114 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_step": { 2024-06-06T03:38:06.114 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_step", 2024-06-06T03:38:06.114 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-06-06T03:38:06.114 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.114 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.114 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0.5", 2024-06-06T03:38:06.114 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0.001", 2024-06-06T03:38:06.114 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "0.999", 2024-06-06T03:38:06.114 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.114 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "aggressiveness of optimization", 2024-06-06T03:38:06.114 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-06-06T03:38:06.114 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.115 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.115 INFO:teuthology.orchestra.run.smithi050.stdout: "end_time": { 2024-06-06T03:38:06.115 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "end_time", 2024-06-06T03:38:06.115 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.115 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.115 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.115 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "2359", 2024-06-06T03:38:06.115 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.115 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.115 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.115 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "ending time of day to automatically balance", 2024-06-06T03:38:06.115 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-06T03:38:06.115 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.115 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.116 INFO:teuthology.orchestra.run.smithi050.stdout: "end_weekday": { 2024-06-06T03:38:06.116 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "end_weekday", 2024-06-06T03:38:06.116 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-06-06T03:38:06.116 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.116 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.116 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-06-06T03:38:06.116 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0", 2024-06-06T03:38:06.116 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "6", 2024-06-06T03:38:06.116 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.116 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-06-06T03:38:06.116 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-06T03:38:06.116 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.116 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.117 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.117 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.117 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.117 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.117 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.117 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.117 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.117 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.117 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.117 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.117 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.117 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.117 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.117 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.117 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.117 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.118 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.118 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.118 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.118 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.118 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.118 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.118 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.118 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.118 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.118 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.118 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.118 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.118 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.118 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.119 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.119 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.119 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.119 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.119 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.119 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.119 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.119 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.119 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.119 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.119 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.119 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.119 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.119 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.119 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.120 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.120 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.120 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.120 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.120 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.120 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.120 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.120 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.120 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.120 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.120 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.120 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.120 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.120 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.120 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.121 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.121 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.121 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.121 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.121 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.121 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.121 INFO:teuthology.orchestra.run.smithi050.stdout: "min_score": { 2024-06-06T03:38:06.121 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "min_score", 2024-06-06T03:38:06.121 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-06-06T03:38:06.121 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.121 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.121 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-06-06T03:38:06.121 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.121 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.121 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.122 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-06-06T03:38:06.122 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.122 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.122 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.122 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": { 2024-06-06T03:38:06.122 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mode", 2024-06-06T03:38:06.122 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.122 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.122 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.122 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "upmap", 2024-06-06T03:38:06.122 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.122 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.122 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.122 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-compat", 2024-06-06T03:38:06.123 INFO:teuthology.orchestra.run.smithi050.stdout: "none", 2024-06-06T03:38:06.123 INFO:teuthology.orchestra.run.smithi050.stdout: "read", 2024-06-06T03:38:06.123 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap", 2024-06-06T03:38:06.123 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap-read" 2024-06-06T03:38:06.123 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.123 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Balancer mode", 2024-06-06T03:38:06.123 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.123 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.123 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.123 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_ids": { 2024-06-06T03:38:06.123 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pool_ids", 2024-06-06T03:38:06.123 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.123 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.123 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.123 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.124 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.124 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.124 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.124 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-06-06T03:38:06.124 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.124 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.124 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.124 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-06-06T03:38:06.124 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-06-06T03:38:06.124 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:06.124 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.124 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.124 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-06-06T03:38:06.124 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.125 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.125 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.125 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-06-06T03:38:06.125 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.125 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.125 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.125 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap_max_deviation": { 2024-06-06T03:38:06.125 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "upmap_max_deviation", 2024-06-06T03:38:06.125 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.125 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.125 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.125 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-06-06T03:38:06.125 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-06-06T03:38:06.125 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.125 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.126 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "deviation below which no optimization is attempted", 2024-06-06T03:38:06.126 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-06-06T03:38:06.126 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.126 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.126 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap_max_optimizations": { 2024-06-06T03:38:06.126 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "upmap_max_optimizations", 2024-06-06T03:38:06.126 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-06-06T03:38:06.126 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.126 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.126 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-06-06T03:38:06.126 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.126 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.126 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.127 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-06-06T03:38:06.127 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.127 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.127 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.127 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.127 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.127 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephadm", 2024-06-06T03:38:06.127 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.127 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.127 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.127 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_down_multiplier": { 2024-06-06T03:38:06.127 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_down_multiplier", 2024-06-06T03:38:06.127 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-06-06T03:38:06.128 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.128 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.128 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3.0", 2024-06-06T03:38:06.128 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.128 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.128 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.128 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-06-06T03:38:06.128 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.128 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.128 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.128 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_refresh_rate": { 2024-06-06T03:38:06.128 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_refresh_rate", 2024-06-06T03:38:06.128 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:06.128 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.128 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.129 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "20", 2024-06-06T03:38:06.129 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.129 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.129 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.129 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-06-06T03:38:06.129 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.129 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.129 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.129 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_starting_port": { 2024-06-06T03:38:06.129 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_starting_port", 2024-06-06T03:38:06.129 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.129 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.129 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.129 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "4721", 2024-06-06T03:38:06.130 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.130 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.130 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.130 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-06-06T03:38:06.130 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.130 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.130 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.130 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_ptrace": { 2024-06-06T03:38:06.130 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_ptrace", 2024-06-06T03:38:06.130 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.130 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.130 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.130 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.130 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.131 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.131 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.131 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-06-06T03:38:06.131 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-06-06T03:38:06.131 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.131 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.131 INFO:teuthology.orchestra.run.smithi050.stdout: "autotune_interval": { 2024-06-06T03:38:06.131 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "autotune_interval", 2024-06-06T03:38:06.131 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:06.131 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.131 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.131 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-06-06T03:38:06.131 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.131 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.132 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.132 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to autotune daemon memory", 2024-06-06T03:38:06.132 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.132 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.132 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.132 INFO:teuthology.orchestra.run.smithi050.stdout: "autotune_memory_target_ratio": { 2024-06-06T03:38:06.132 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "autotune_memory_target_ratio", 2024-06-06T03:38:06.132 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-06-06T03:38:06.132 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.132 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.132 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0.7", 2024-06-06T03:38:06.132 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.132 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.133 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.133 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-06-06T03:38:06.133 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.133 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.133 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.133 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm_log_destination": { 2024-06-06T03:38:06.133 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephadm_log_destination", 2024-06-06T03:38:06.133 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.133 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.133 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.133 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.133 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.134 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.134 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.134 INFO:teuthology.orchestra.run.smithi050.stdout: "file", 2024-06-06T03:38:06.134 INFO:teuthology.orchestra.run.smithi050.stdout: "file,syslog", 2024-06-06T03:38:06.134 INFO:teuthology.orchestra.run.smithi050.stdout: "syslog" 2024-06-06T03:38:06.134 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.134 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-06-06T03:38:06.134 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.134 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.134 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.134 INFO:teuthology.orchestra.run.smithi050.stdout: "cgroups_split": { 2024-06-06T03:38:06.134 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cgroups_split", 2024-06-06T03:38:06.134 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.135 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.135 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.135 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.135 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.135 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.135 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.135 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-06-06T03:38:06.135 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.135 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.135 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.135 INFO:teuthology.orchestra.run.smithi050.stdout: "config_checks_enabled": { 2024-06-06T03:38:06.135 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_checks_enabled", 2024-06-06T03:38:06.135 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.135 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.136 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.136 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.136 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.136 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.136 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.136 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-06-06T03:38:06.136 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.136 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.136 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.136 INFO:teuthology.orchestra.run.smithi050.stdout: "config_dashboard": { 2024-06-06T03:38:06.136 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_dashboard", 2024-06-06T03:38:06.136 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.136 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.136 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.136 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.136 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.137 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.137 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.137 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-06-06T03:38:06.137 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.137 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.137 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.137 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_alertmanager": { 2024-06-06T03:38:06.137 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_alertmanager", 2024-06-06T03:38:06.137 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.137 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.137 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.137 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-06-06T03:38:06.137 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.138 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.138 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.138 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-06-06T03:38:06.138 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.138 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.138 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.138 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_base": { 2024-06-06T03:38:06.138 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_base", 2024-06-06T03:38:06.138 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.138 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.138 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.138 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/ceph", 2024-06-06T03:38:06.138 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.138 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.139 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.139 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Container image name, without the tag", 2024-06-06T03:38:06.139 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.139 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.139 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.139 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_elasticsearch": { 2024-06-06T03:38:06.139 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_elasticsearch", 2024-06-06T03:38:06.139 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.139 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.139 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.139 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-06-06T03:38:06.139 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.139 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.139 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.140 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "elasticsearch container image", 2024-06-06T03:38:06.140 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.140 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.140 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.140 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_grafana": { 2024-06-06T03:38:06.140 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_grafana", 2024-06-06T03:38:06.140 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.140 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.140 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.140 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-06-06T03:38:06.140 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.140 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.140 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.140 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-06-06T03:38:06.141 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.141 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.141 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.141 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_haproxy": { 2024-06-06T03:38:06.141 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_haproxy", 2024-06-06T03:38:06.141 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.141 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.141 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.141 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-06-06T03:38:06.141 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.141 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.141 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.141 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "HAproxy container image", 2024-06-06T03:38:06.141 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.142 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.142 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.142 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_agent": { 2024-06-06T03:38:06.142 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_agent", 2024-06-06T03:38:06.142 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.142 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.142 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.142 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-06-06T03:38:06.142 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.142 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.142 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.142 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger agent container image", 2024-06-06T03:38:06.142 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.143 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.143 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.143 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_collector": { 2024-06-06T03:38:06.143 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_collector", 2024-06-06T03:38:06.143 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.143 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.143 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.143 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-06-06T03:38:06.143 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.143 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.143 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.143 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger collector container image", 2024-06-06T03:38:06.143 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.143 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.143 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.144 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_query": { 2024-06-06T03:38:06.144 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_query", 2024-06-06T03:38:06.144 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.144 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.144 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.144 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-06-06T03:38:06.144 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.144 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.144 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.144 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger query container image", 2024-06-06T03:38:06.144 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.144 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.144 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.145 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.145 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_keepalived": { 2024-06-06T03:38:06.145 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_keepalived", 2024-06-06T03:38:06.145 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.145 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.145 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.145 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-06-06T03:38:06.145 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.145 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.145 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.145 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Keepalived container image", 2024-06-06T03:38:06.145 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.145 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.145 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.145 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.145 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_loki": { 2024-06-06T03:38:06.146 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_loki", 2024-06-06T03:38:06.146 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.146 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.146 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.146 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-06-06T03:38:06.146 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.146 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.146 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.146 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Loki container image", 2024-06-06T03:38:06.146 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.146 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.146 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.146 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_node_exporter": { 2024-06-06T03:38:06.147 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_node_exporter", 2024-06-06T03:38:06.147 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.147 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.147 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.147 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-06-06T03:38:06.147 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.147 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.147 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.147 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-06-06T03:38:06.147 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.147 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.147 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.147 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_nvmeof": { 2024-06-06T03:38:06.147 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_nvmeof", 2024-06-06T03:38:06.148 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.148 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.148 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.148 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-06-06T03:38:06.148 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.148 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.148 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.148 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Nvme-of container image", 2024-06-06T03:38:06.148 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.148 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.148 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.148 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.148 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_prometheus": { 2024-06-06T03:38:06.149 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_prometheus", 2024-06-06T03:38:06.149 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.149 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.149 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.149 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-06-06T03:38:06.149 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.149 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.149 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.149 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-06-06T03:38:06.149 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.149 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.149 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.149 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_promtail": { 2024-06-06T03:38:06.150 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_promtail", 2024-06-06T03:38:06.150 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.150 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.150 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.150 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-06-06T03:38:06.150 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.150 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.150 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.150 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Promtail container image", 2024-06-06T03:38:06.150 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.150 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.150 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.151 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_samba": { 2024-06-06T03:38:06.151 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_samba", 2024-06-06T03:38:06.151 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.151 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.151 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.151 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-06-06T03:38:06.151 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.151 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.151 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.151 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Samba/SMB container image", 2024-06-06T03:38:06.151 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.151 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.151 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.152 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_snmp_gateway": { 2024-06-06T03:38:06.152 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_snmp_gateway", 2024-06-06T03:38:06.152 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.152 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.152 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.152 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-06-06T03:38:06.152 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.152 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.152 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.152 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SNMP Gateway container image", 2024-06-06T03:38:06.152 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.152 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.152 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.153 INFO:teuthology.orchestra.run.smithi050.stdout: "container_init": { 2024-06-06T03:38:06.153 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_init", 2024-06-06T03:38:06.153 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.153 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.153 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.153 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.153 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.153 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.153 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.153 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Run podman/docker with `--init`", 2024-06-06T03:38:06.153 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.153 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.153 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.154 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.154 INFO:teuthology.orchestra.run.smithi050.stdout: "daemon_cache_timeout": { 2024-06-06T03:38:06.154 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "daemon_cache_timeout", 2024-06-06T03:38:06.154 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:06.154 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.154 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.154 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-06-06T03:38:06.154 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.154 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.154 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.154 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-06-06T03:38:06.154 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.154 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.154 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.155 INFO:teuthology.orchestra.run.smithi050.stdout: "default_cephadm_command_timeout": { 2024-06-06T03:38:06.155 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "default_cephadm_command_timeout", 2024-06-06T03:38:06.155 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.155 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.155 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.155 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "900", 2024-06-06T03:38:06.155 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.155 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.155 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.155 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-06-06T03:38:06.155 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.155 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.155 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.156 INFO:teuthology.orchestra.run.smithi050.stdout: "default_registry": { 2024-06-06T03:38:06.156 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "default_registry", 2024-06-06T03:38:06.156 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.156 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.156 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.156 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io", 2024-06-06T03:38:06.156 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.156 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.156 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.156 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-06-06T03:38:06.156 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.156 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.156 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.157 INFO:teuthology.orchestra.run.smithi050.stdout: "device_cache_timeout": { 2024-06-06T03:38:06.157 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_cache_timeout", 2024-06-06T03:38:06.157 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:06.157 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.157 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.157 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1800", 2024-06-06T03:38:06.157 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.157 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.157 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.157 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache device inventory", 2024-06-06T03:38:06.157 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.157 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.157 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.158 INFO:teuthology.orchestra.run.smithi050.stdout: "device_enhanced_scan": { 2024-06-06T03:38:06.158 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_enhanced_scan", 2024-06-06T03:38:06.158 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.158 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.158 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.158 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.158 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.158 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.158 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.158 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use libstoragemgmt during device scans", 2024-06-06T03:38:06.158 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.158 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.158 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.159 INFO:teuthology.orchestra.run.smithi050.stdout: "facts_cache_timeout": { 2024-06-06T03:38:06.159 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "facts_cache_timeout", 2024-06-06T03:38:06.159 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:06.159 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.159 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.159 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-06-06T03:38:06.159 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.159 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.159 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.159 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache host facts data", 2024-06-06T03:38:06.159 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.159 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.159 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.159 INFO:teuthology.orchestra.run.smithi050.stdout: "grafana_dashboards_path": { 2024-06-06T03:38:06.160 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "grafana_dashboards_path", 2024-06-06T03:38:06.160 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.160 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.160 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.160 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-06-06T03:38:06.160 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.160 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.160 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.160 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-06-06T03:38:06.160 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.160 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.160 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.160 INFO:teuthology.orchestra.run.smithi050.stdout: "host_check_interval": { 2024-06-06T03:38:06.160 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "host_check_interval", 2024-06-06T03:38:06.160 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:06.161 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.161 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.161 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-06-06T03:38:06.161 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.161 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.161 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.161 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to perform a host check", 2024-06-06T03:38:06.161 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.161 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.161 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.161 INFO:teuthology.orchestra.run.smithi050.stdout: "hw_monitoring": { 2024-06-06T03:38:06.161 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "hw_monitoring", 2024-06-06T03:38:06.161 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.162 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.162 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.162 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.162 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.162 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.162 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.162 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-06-06T03:38:06.162 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.162 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.162 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.162 INFO:teuthology.orchestra.run.smithi050.stdout: "inventory_list_all": { 2024-06-06T03:38:06.162 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "inventory_list_all", 2024-06-06T03:38:06.163 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.163 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.163 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.163 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.163 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.163 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.163 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.163 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-06-06T03:38:06.163 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.163 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.163 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.164 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.164 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.164 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.164 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.164 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.164 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.164 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.164 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.164 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.164 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.164 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.164 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.164 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.164 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.165 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.165 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.165 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.165 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.165 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.165 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.165 INFO:teuthology.orchestra.run.smithi050.stdout: "log_refresh_metadata": { 2024-06-06T03:38:06.165 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_refresh_metadata", 2024-06-06T03:38:06.165 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.165 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.165 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.165 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.165 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.166 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.166 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.166 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-06-06T03:38:06.166 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.166 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.166 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.166 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.166 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.166 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.166 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.166 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.166 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.166 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.166 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.167 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.167 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-06-06T03:38:06.167 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.167 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.167 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.167 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.167 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.167 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.167 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.167 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.167 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.167 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.168 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.168 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.168 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.168 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.168 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.168 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.168 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.168 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.168 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.168 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.168 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.168 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.168 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.169 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.169 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.169 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.169 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.169 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.169 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.169 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.169 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.169 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.169 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.169 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.169 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.169 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.169 INFO:teuthology.orchestra.run.smithi050.stdout: "manage_etc_ceph_ceph_conf": { 2024-06-06T03:38:06.170 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-06-06T03:38:06.170 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.170 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.170 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.170 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.170 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.170 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.170 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.170 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-06-06T03:38:06.170 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.170 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.170 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.171 INFO:teuthology.orchestra.run.smithi050.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-06-06T03:38:06.171 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-06-06T03:38:06.171 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.171 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.171 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.171 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "*", 2024-06-06T03:38:06.171 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.171 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.171 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.171 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-06-06T03:38:06.171 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.171 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.171 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.171 INFO:teuthology.orchestra.run.smithi050.stdout: "max_count_per_host": { 2024-06-06T03:38:06.172 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_count_per_host", 2024-06-06T03:38:06.172 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.172 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.172 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.172 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-06-06T03:38:06.172 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.172 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.172 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.172 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "max number of daemons per service per host", 2024-06-06T03:38:06.172 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.172 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.172 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.172 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd_draining_count": { 2024-06-06T03:38:06.173 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_osd_draining_count", 2024-06-06T03:38:06.173 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.173 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.173 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.173 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-06-06T03:38:06.173 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.173 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.173 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.173 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-06-06T03:38:06.173 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.173 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.173 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.173 INFO:teuthology.orchestra.run.smithi050.stdout: "migration_current": { 2024-06-06T03:38:06.173 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "migration_current", 2024-06-06T03:38:06.174 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.174 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.174 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.174 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.174 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.174 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.174 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.174 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "internal - do not modify", 2024-06-06T03:38:06.174 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.174 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.174 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.175 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": { 2024-06-06T03:38:06.175 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mode", 2024-06-06T03:38:06.175 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.175 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.175 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.175 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "root", 2024-06-06T03:38:06.175 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.175 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.175 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.175 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm-package", 2024-06-06T03:38:06.175 INFO:teuthology.orchestra.run.smithi050.stdout: "root" 2024-06-06T03:38:06.175 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.175 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "mode for remote execution of cephadm", 2024-06-06T03:38:06.175 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.175 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.176 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.176 INFO:teuthology.orchestra.run.smithi050.stdout: "oob_default_addr": { 2024-06-06T03:38:06.176 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "oob_default_addr", 2024-06-06T03:38:06.176 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.176 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.176 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.176 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "169.254.1.1", 2024-06-06T03:38:06.176 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.176 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.176 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.176 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Default address for RedFish API (oob management).", 2024-06-06T03:38:06.176 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.177 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.177 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.177 INFO:teuthology.orchestra.run.smithi050.stdout: "prometheus_alerts_path": { 2024-06-06T03:38:06.177 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prometheus_alerts_path", 2024-06-06T03:38:06.177 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.177 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.177 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.177 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-06-06T03:38:06.177 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.177 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.177 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.177 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-06-06T03:38:06.177 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.177 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.178 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.178 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_insecure": { 2024-06-06T03:38:06.178 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_insecure", 2024-06-06T03:38:06.178 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.178 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.178 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.178 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.178 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.178 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.178 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.178 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-06-06T03:38:06.178 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.178 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.179 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.179 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_password": { 2024-06-06T03:38:06.179 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_password", 2024-06-06T03:38:06.179 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.179 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.179 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.179 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.179 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.179 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.179 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.179 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-06-06T03:38:06.179 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.179 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.179 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.180 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_url": { 2024-06-06T03:38:06.180 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_url", 2024-06-06T03:38:06.180 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.180 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.180 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.180 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.180 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.180 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.180 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.180 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-06-06T03:38:06.180 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.180 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.180 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.180 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.180 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_username": { 2024-06-06T03:38:06.180 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_username", 2024-06-06T03:38:06.181 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.181 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.181 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.181 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.181 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.181 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.181 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.181 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-06-06T03:38:06.181 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.181 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.181 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.181 INFO:teuthology.orchestra.run.smithi050.stdout: "secure_monitoring_stack": { 2024-06-06T03:38:06.181 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "secure_monitoring_stack", 2024-06-06T03:38:06.181 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.181 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.182 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.182 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.182 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.182 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.182 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.182 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-06-06T03:38:06.182 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.182 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.182 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.182 INFO:teuthology.orchestra.run.smithi050.stdout: "service_discovery_port": { 2024-06-06T03:38:06.182 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "service_discovery_port", 2024-06-06T03:38:06.182 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.182 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.183 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.183 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8765", 2024-06-06T03:38:06.183 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.183 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.183 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.183 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "cephadm service discovery port", 2024-06-06T03:38:06.183 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.183 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.183 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.183 INFO:teuthology.orchestra.run.smithi050.stdout: "ssh_config_file": { 2024-06-06T03:38:06.183 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssh_config_file", 2024-06-06T03:38:06.183 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.183 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.183 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.183 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.184 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.184 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.184 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.184 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-06-06T03:38:06.184 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.184 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.184 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.184 INFO:teuthology.orchestra.run.smithi050.stdout: "use_agent": { 2024-06-06T03:38:06.184 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "use_agent", 2024-06-06T03:38:06.184 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.184 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.184 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.184 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.185 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.185 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.185 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.185 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-06-06T03:38:06.185 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.185 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.185 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.185 INFO:teuthology.orchestra.run.smithi050.stdout: "use_repo_digest": { 2024-06-06T03:38:06.185 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "use_repo_digest", 2024-06-06T03:38:06.185 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.185 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.185 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.185 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.186 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.186 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.186 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.186 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-06-06T03:38:06.186 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.186 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.186 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.186 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_failed_host_check": { 2024-06-06T03:38:06.186 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_failed_host_check", 2024-06-06T03:38:06.186 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.186 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.186 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.186 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.187 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.187 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.187 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.187 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if the host check fails", 2024-06-06T03:38:06.187 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.187 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.187 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.187 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_stray_daemons": { 2024-06-06T03:38:06.187 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_stray_daemons", 2024-06-06T03:38:06.187 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.187 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.187 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.187 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.187 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.188 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.188 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.188 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-06-06T03:38:06.188 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.188 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.188 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.188 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_stray_hosts": { 2024-06-06T03:38:06.188 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_stray_hosts", 2024-06-06T03:38:06.188 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.188 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.188 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.188 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.188 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.188 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.189 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.189 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-06-06T03:38:06.189 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.189 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.189 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.189 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.189 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.189 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.189 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crash", 2024-06-06T03:38:06.189 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.189 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.189 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.189 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.189 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.190 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.190 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.190 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.190 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.190 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.190 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.190 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.190 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.190 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.190 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.190 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.190 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.190 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.190 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: "retain_interval": { 2024-06-06T03:38:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "retain_interval", 2024-06-06T03:38:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "31536000", 2024-06-06T03:38:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long to retain crashes before pruning them", 2024-06-06T03:38:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_recent_interval": { 2024-06-06T03:38:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_recent_interval", 2024-06-06T03:38:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1209600", 2024-06-06T03:38:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "time interval in which to warn about recent crashes", 2024-06-06T03:38:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "dashboard", 2024-06-06T03:38:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-06-06T03:38:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-06-06T03:38:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-06-06T03:38:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: "ALERTMANAGER_API_HOST": { 2024-06-06T03:38:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ALERTMANAGER_API_HOST", 2024-06-06T03:38:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-06-06T03:38:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-06-06T03:38:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: "AUDIT_API_ENABLED": { 2024-06-06T03:38:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "AUDIT_API_ENABLED", 2024-06-06T03:38:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-06-06T03:38:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-06-06T03:38:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: "ENABLE_BROWSABLE_API": { 2024-06-06T03:38:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ENABLE_BROWSABLE_API", 2024-06-06T03:38:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-06-06T03:38:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-06-06T03:38:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-06-06T03:38:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-06-06T03:38:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.205 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.205 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-06-06T03:38:06.205 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-06-06T03:38:06.205 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.205 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.205 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.205 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.205 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.205 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.205 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.205 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.205 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.205 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.206 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.206 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.206 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-06-06T03:38:06.206 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-06-06T03:38:06.206 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.206 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.206 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.206 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.206 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.206 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.206 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.206 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_NFS": { 2024-06-06T03:38:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-06-06T03:38:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_RBD": { 2024-06-06T03:38:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-06-06T03:38:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.209 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.209 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.209 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_RGW": { 2024-06-06T03:38:06.209 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-06-06T03:38:06.209 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.209 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.209 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.209 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.209 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.209 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.209 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.209 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.209 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.209 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.210 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.210 INFO:teuthology.orchestra.run.smithi050.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-06-06T03:38:06.210 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-06-06T03:38:06.210 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.210 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.210 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.210 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.210 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.210 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.210 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.210 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_PASSWORD": { 2024-06-06T03:38:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_PASSWORD", 2024-06-06T03:38:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2024-06-06T03:38:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-06-06T03:38:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-06-06T03:38:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.213 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.213 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.213 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.213 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_URL": { 2024-06-06T03:38:06.213 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_URL", 2024-06-06T03:38:06.213 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.213 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.213 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.213 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.213 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.213 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.213 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.213 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_USERNAME": { 2024-06-06T03:38:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_USERNAME", 2024-06-06T03:38:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2024-06-06T03:38:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-06-06T03:38:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-06-06T03:38:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-06-06T03:38:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-06-06T03:38:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-06-06T03:38:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-06-06T03:38:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: "ISSUE_TRACKER_API_KEY": { 2024-06-06T03:38:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-06-06T03:38:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: "PROMETHEUS_API_HOST": { 2024-06-06T03:38:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PROMETHEUS_API_HOST", 2024-06-06T03:38:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-06-06T03:38:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-06-06T03:38:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-06-06T03:38:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-06-06T03:38:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-06-06T03:38:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-06-06T03:38:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-06-06T03:38:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-06-06T03:38:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-06-06T03:38:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-06-06T03:38:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-06-06T03:38:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-06-06T03:38:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-06-06T03:38:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-06-06T03:38:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-06-06T03:38:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-06-06T03:38:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_ENABLED": { 2024-06-06T03:38:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_ENABLED", 2024-06-06T03:38:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-06-06T03:38:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-06-06T03:38:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-06-06T03:38:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.230 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.230 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.230 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.230 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-06-06T03:38:06.230 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-06-06T03:38:06.230 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.230 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.230 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.230 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-06-06T03:38:06.230 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.230 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.230 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.231 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.231 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.231 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.231 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.231 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.231 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-06-06T03:38:06.231 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-06-06T03:38:06.231 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.231 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.231 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.231 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8", 2024-06-06T03:38:06.231 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.232 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.232 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.232 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.232 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.232 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.232 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.232 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.232 INFO:teuthology.orchestra.run.smithi050.stdout: "REST_REQUESTS_TIMEOUT": { 2024-06-06T03:38:06.232 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-06-06T03:38:06.232 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.232 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.232 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "45", 2024-06-06T03:38:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_ACCESS_KEY": { 2024-06-06T03:38:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_ACCESS_KEY", 2024-06-06T03:38:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.234 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.234 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.234 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.234 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.234 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.234 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.234 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.234 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.234 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.234 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-06-06T03:38:06.234 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-06-06T03:38:06.234 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.234 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.234 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.235 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2024-06-06T03:38:06.235 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.235 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.235 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.235 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.235 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.235 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.235 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.235 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_SECRET_KEY": { 2024-06-06T03:38:06.235 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_SECRET_KEY", 2024-06-06T03:38:06.235 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.235 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.236 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.236 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.236 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.236 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.236 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.236 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.236 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.236 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.236 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.236 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_SSL_VERIFY": { 2024-06-06T03:38:06.236 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_SSL_VERIFY", 2024-06-06T03:38:06.236 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.237 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.237 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.237 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.237 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.237 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.237 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.237 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.237 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.237 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.237 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.237 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.237 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-06-06T03:38:06.237 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-06-06T03:38:06.237 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.238 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.238 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.238 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-06-06T03:38:06.238 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.238 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.238 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.238 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.238 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.238 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.238 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.238 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-06-06T03:38:06.238 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-06-06T03:38:06.239 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.239 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.239 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.242 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-06-06T03:38:06.242 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.242 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.242 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.242 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.242 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.242 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.242 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-06-06T03:38:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-06-06T03:38:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-06-06T03:38:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: "cross_origin_url": { 2024-06-06T03:38:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cross_origin_url", 2024-06-06T03:38:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: "crt_file": { 2024-06-06T03:38:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crt_file", 2024-06-06T03:38:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: "debug": { 2024-06-06T03:38:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "debug", 2024-06-06T03:38:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable/disable debug options", 2024-06-06T03:38:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: "jwt_token_ttl": { 2024-06-06T03:38:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "jwt_token_ttl", 2024-06-06T03:38:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "28800", 2024-06-06T03:38:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: "key_file": { 2024-06-06T03:38:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "key_file", 2024-06-06T03:38:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.249 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.249 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.249 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.249 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.249 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.249 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.249 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.249 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.249 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.249 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.249 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.249 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.249 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.249 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.249 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.252 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.252 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.252 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.252 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.252 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.252 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.252 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.252 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.252 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.252 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.252 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.252 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.252 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.253 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.253 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.253 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.253 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.253 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.253 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.253 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.253 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.253 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.253 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.253 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.253 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.253 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.253 INFO:teuthology.orchestra.run.smithi050.stdout: "motd": { 2024-06-06T03:38:06.253 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "motd", 2024-06-06T03:38:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "The message of the day", 2024-06-06T03:38:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: "redirect_resolve_ip_addr": { 2024-06-06T03:38:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "redirect_resolve_ip_addr", 2024-06-06T03:38:06.255 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.255 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.255 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.255 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.255 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.255 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.255 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.255 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.255 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.255 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.255 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.255 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.255 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2024-06-06T03:38:06.256 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2024-06-06T03:38:06.256 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.256 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.256 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.256 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "::", 2024-06-06T03:38:06.256 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.256 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.256 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.256 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.256 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.256 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.256 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.256 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.256 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2024-06-06T03:38:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2024-06-06T03:38:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8080", 2024-06-06T03:38:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl": { 2024-06-06T03:38:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl", 2024-06-06T03:38:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl_server_port": { 2024-06-06T03:38:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl_server_port", 2024-06-06T03:38:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8443", 2024-06-06T03:38:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_behaviour": { 2024-06-06T03:38:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_behaviour", 2024-06-06T03:38:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "redirect", 2024-06-06T03:38:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: "redirect" 2024-06-06T03:38:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_error_status_code": { 2024-06-06T03:38:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_error_status_code", 2024-06-06T03:38:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "500", 2024-06-06T03:38:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "400", 2024-06-06T03:38:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "599", 2024-06-06T03:38:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: "url_prefix": { 2024-06-06T03:38:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "url_prefix", 2024-06-06T03:38:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "devicehealth", 2024-06-06T03:38:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: "enable_monitoring": { 2024-06-06T03:38:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enable_monitoring", 2024-06-06T03:38:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "monitor device health metrics", 2024-06-06T03:38:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: "mark_out_threshold": { 2024-06-06T03:38:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mark_out_threshold", 2024-06-06T03:38:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "2419200", 2024-06-06T03:38:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-06-06T03:38:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": { 2024-06-06T03:38:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pool_name", 2024-06-06T03:38:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "device_health_metrics", 2024-06-06T03:38:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "name of pool in which to store device health metrics", 2024-06-06T03:38:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: "retention_period": { 2024-06-06T03:38:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "retention_period", 2024-06-06T03:38:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15552000", 2024-06-06T03:38:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long to retain device health metrics", 2024-06-06T03:38:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: "scrape_frequency": { 2024-06-06T03:38:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "scrape_frequency", 2024-06-06T03:38:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "86400", 2024-06-06T03:38:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to scrape device health metrics", 2024-06-06T03:38:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: "self_heal": { 2024-06-06T03:38:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "self_heal", 2024-06-06T03:38:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-06-06T03:38:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-06-06T03:38:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-06-06T03:38:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-06-06T03:38:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to wake up and check device health", 2024-06-06T03:38:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_threshold": { 2024-06-06T03:38:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_threshold", 2024-06-06T03:38:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "7257600", 2024-06-06T03:38:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-06-06T03:38:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "diskprediction_local", 2024-06-06T03:38:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: "predict_interval": { 2024-06-06T03:38:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "predict_interval", 2024-06-06T03:38:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "86400", 2024-06-06T03:38:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: "predictor_model": { 2024-06-06T03:38:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "predictor_model", 2024-06-06T03:38:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "prophetstor", 2024-06-06T03:38:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-06-06T03:38:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-06-06T03:38:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-06-06T03:38:06.285 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.285 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.285 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.285 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.285 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.285 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.285 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.285 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.285 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.285 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.285 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.285 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "influx", 2024-06-06T03:38:06.285 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": false, 2024-06-06T03:38:06.286 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "influxdb python module not found", 2024-06-06T03:38:06.286 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.286 INFO:teuthology.orchestra.run.smithi050.stdout: "batch_size": { 2024-06-06T03:38:06.286 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "batch_size", 2024-06-06T03:38:06.286 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.286 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.286 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.286 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5000", 2024-06-06T03:38:06.286 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.286 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.286 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.286 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-06-06T03:38:06.286 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.286 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.287 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.287 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.287 INFO:teuthology.orchestra.run.smithi050.stdout: "database": { 2024-06-06T03:38:06.287 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "database", 2024-06-06T03:38:06.287 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.287 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.287 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.287 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "ceph", 2024-06-06T03:38:06.287 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.287 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.287 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.287 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-06-06T03:38:06.287 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.288 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.288 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.288 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.288 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": { 2024-06-06T03:38:06.288 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "hostname", 2024-06-06T03:38:06.288 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.288 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.288 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.288 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.288 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.288 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.288 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.288 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB server hostname", 2024-06-06T03:38:06.288 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.289 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.289 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.289 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.289 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-06-06T03:38:06.289 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-06-06T03:38:06.289 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:06.289 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.289 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.289 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "30", 2024-06-06T03:38:06.289 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "5", 2024-06-06T03:38:06.289 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.289 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.289 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-06-06T03:38:06.289 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.290 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.290 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.290 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.290 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.290 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.290 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.290 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.290 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.290 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.290 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.290 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.290 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.290 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.291 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.291 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.291 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.291 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.291 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.291 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.291 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.291 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.291 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.291 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.291 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.291 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.291 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.291 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.292 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.292 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.292 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.292 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.292 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.292 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.292 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.292 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.292 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.292 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.292 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.292 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.292 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.292 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.292 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.293 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.293 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.293 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.293 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.293 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.293 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.293 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.293 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.293 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.293 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.293 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.293 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.293 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.294 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.294 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.294 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.294 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.294 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.294 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.294 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.294 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.294 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.294 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.294 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.294 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.294 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.295 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.295 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.295 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.295 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.295 INFO:teuthology.orchestra.run.smithi050.stdout: "password": { 2024-06-06T03:38:06.295 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "password", 2024-06-06T03:38:06.295 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.295 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.295 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.295 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.295 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.295 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.295 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.296 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "password of InfluxDB server user", 2024-06-06T03:38:06.296 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.296 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.296 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.296 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.296 INFO:teuthology.orchestra.run.smithi050.stdout: "port": { 2024-06-06T03:38:06.296 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "port", 2024-06-06T03:38:06.296 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.296 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.296 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.296 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8086", 2024-06-06T03:38:06.296 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.296 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.297 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.297 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB server port", 2024-06-06T03:38:06.297 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.297 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.297 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.297 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.297 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl": { 2024-06-06T03:38:06.297 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl", 2024-06-06T03:38:06.297 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.297 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.297 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.297 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "false", 2024-06-06T03:38:06.297 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.297 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.298 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.298 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-06-06T03:38:06.298 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.298 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.298 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.298 INFO:teuthology.orchestra.run.smithi050.stdout: "threads": { 2024-06-06T03:38:06.298 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "threads", 2024-06-06T03:38:06.298 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.298 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.298 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.298 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-06-06T03:38:06.298 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-06-06T03:38:06.298 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "32", 2024-06-06T03:38:06.299 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.299 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-06-06T03:38:06.299 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.299 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.299 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.299 INFO:teuthology.orchestra.run.smithi050.stdout: "username": { 2024-06-06T03:38:06.299 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "username", 2024-06-06T03:38:06.299 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.299 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.299 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.299 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.299 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.300 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.300 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.300 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "username of InfluxDB server user", 2024-06-06T03:38:06.300 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.300 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.300 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.300 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.300 INFO:teuthology.orchestra.run.smithi050.stdout: "verify_ssl": { 2024-06-06T03:38:06.300 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "verify_ssl", 2024-06-06T03:38:06.300 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.300 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.300 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.300 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "true", 2024-06-06T03:38:06.300 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.300 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.301 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.301 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-06-06T03:38:06.301 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.301 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.301 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.301 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.301 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.301 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.301 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.301 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "insights", 2024-06-06T03:38:06.301 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.301 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.301 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.301 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.302 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.302 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.302 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.302 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.302 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.302 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.302 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.302 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.302 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.302 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.302 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.302 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.302 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.303 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.303 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.303 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.303 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.303 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.303 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.303 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.303 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.303 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.303 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.303 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.303 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.303 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.303 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.304 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.304 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.304 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.304 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.304 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.304 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.304 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.304 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.304 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.304 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.304 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.304 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.304 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.305 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.305 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.305 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.305 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.305 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.305 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.305 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.305 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.305 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.305 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.305 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.305 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.305 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.306 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.306 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.306 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.306 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.306 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.306 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.306 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.306 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.306 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.306 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.306 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.306 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.306 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.307 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.307 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.307 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.307 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "iostat", 2024-06-06T03:38:06.307 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.307 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.307 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.307 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.307 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.307 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.307 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.307 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.307 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.308 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.308 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.308 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.308 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.308 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.308 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.308 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.308 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.308 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.308 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.308 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.308 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.308 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.308 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.309 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.309 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.309 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.309 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.309 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.309 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.309 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.309 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.309 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.309 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.309 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.309 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.309 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.309 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.310 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.310 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.310 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.310 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.310 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.310 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.310 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.310 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.310 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.310 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.310 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.310 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.310 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.310 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.311 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.311 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.311 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.311 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.311 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.311 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.311 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.311 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.311 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.311 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.311 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.311 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.311 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.311 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.311 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.312 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.312 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.312 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.312 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.312 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.312 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.312 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.312 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.312 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.312 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "k8sevents", 2024-06-06T03:38:06.312 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.312 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.312 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.312 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_event_retention_days": { 2024-06-06T03:38:06.313 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ceph_event_retention_days", 2024-06-06T03:38:06.313 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.313 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.313 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.313 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "7", 2024-06-06T03:38:06.313 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.313 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.313 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.313 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Days to hold ceph event information within local cache", 2024-06-06T03:38:06.313 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.313 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.313 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.313 INFO:teuthology.orchestra.run.smithi050.stdout: "config_check_secs": { 2024-06-06T03:38:06.313 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_check_secs", 2024-06-06T03:38:06.314 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.314 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.314 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.314 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-06-06T03:38:06.314 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "10", 2024-06-06T03:38:06.314 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.314 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.314 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-06-06T03:38:06.314 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.314 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.314 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.314 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.314 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.315 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.315 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.315 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.315 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.315 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.315 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.315 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.315 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.315 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.315 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.315 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.315 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.315 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.315 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.316 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.316 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.316 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.316 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.316 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.316 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.316 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.316 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.316 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.316 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.316 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.316 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.316 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.317 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.317 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.317 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.317 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.317 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.317 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.317 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.317 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.317 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.317 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.317 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.317 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.317 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.317 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.318 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.318 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.318 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.318 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.318 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.318 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.318 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.318 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.318 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.318 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.318 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.318 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.318 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.318 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.319 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.319 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.319 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.319 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.319 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.319 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.319 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.319 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.319 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.319 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.319 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.319 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.319 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.319 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.319 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.320 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.320 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "localpool", 2024-06-06T03:38:06.320 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.320 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.320 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.320 INFO:teuthology.orchestra.run.smithi050.stdout: "failure_domain": { 2024-06-06T03:38:06.320 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "failure_domain", 2024-06-06T03:38:06.320 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.320 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.320 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.320 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "host", 2024-06-06T03:38:06.320 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.321 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.321 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.321 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "failure domain for any created local pool", 2024-06-06T03:38:06.321 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-06-06T03:38:06.321 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.321 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.321 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.321 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.321 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.321 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.321 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.321 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.321 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.322 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.322 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.322 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.322 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.322 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.322 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.322 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.322 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.322 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.322 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.322 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.322 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.322 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.322 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.323 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.323 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.323 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.323 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.323 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.323 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.323 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.323 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.323 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.323 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.323 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.323 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.323 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.323 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.324 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.324 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.324 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.324 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.324 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.324 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.324 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.324 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.324 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.324 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.324 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.324 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.324 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.325 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.325 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.325 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.325 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.325 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.325 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.325 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.325 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.325 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.325 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.325 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.325 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.325 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.325 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.326 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.326 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.326 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.326 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.326 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.326 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.326 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": { 2024-06-06T03:38:06.326 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "min_size", 2024-06-06T03:38:06.326 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.326 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.326 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.326 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.326 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.327 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.327 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.327 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default min_size for any created local pool", 2024-06-06T03:38:06.327 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-06-06T03:38:06.327 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.327 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.327 INFO:teuthology.orchestra.run.smithi050.stdout: "num_rep": { 2024-06-06T03:38:06.327 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "num_rep", 2024-06-06T03:38:06.327 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.327 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.327 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.327 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3", 2024-06-06T03:38:06.327 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.328 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.328 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.328 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default replica count for any created local pool", 2024-06-06T03:38:06.328 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.328 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.328 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.328 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": { 2024-06-06T03:38:06.328 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pg_num", 2024-06-06T03:38:06.328 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.328 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.328 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.328 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "128", 2024-06-06T03:38:06.328 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.329 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.329 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.329 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default pg_num for any created local pool", 2024-06-06T03:38:06.329 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.329 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.329 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.329 INFO:teuthology.orchestra.run.smithi050.stdout: "prefix": { 2024-06-06T03:38:06.329 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prefix", 2024-06-06T03:38:06.329 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.329 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.329 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.329 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.329 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.329 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.329 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.330 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "name prefix for any created local pool", 2024-06-06T03:38:06.330 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.330 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.330 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.330 INFO:teuthology.orchestra.run.smithi050.stdout: "subtree": { 2024-06-06T03:38:06.330 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "subtree", 2024-06-06T03:38:06.330 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.330 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.330 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.330 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "rack", 2024-06-06T03:38:06.330 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.330 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.330 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.331 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "CRUSH level for which to create a local pool", 2024-06-06T03:38:06.331 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-06-06T03:38:06.331 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.331 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.331 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.331 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.331 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.331 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mds_autoscaler", 2024-06-06T03:38:06.331 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.331 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.331 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.331 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.331 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.331 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.332 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.332 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.332 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.332 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.332 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.332 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.332 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.332 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.332 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.332 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.332 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.332 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.332 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.332 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.333 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.333 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.333 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.333 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.333 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.333 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.333 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.333 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.333 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.333 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.333 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.333 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.333 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.334 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.334 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.334 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.334 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.334 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.334 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.334 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.334 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.334 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.334 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.334 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.334 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.334 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.336 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.336 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.336 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.336 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.336 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.336 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.336 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.336 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.336 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.336 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.336 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.336 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.336 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.336 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mirroring", 2024-06-06T03:38:06.337 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.337 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.337 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.337 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.337 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.337 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.337 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.337 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.337 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.337 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.337 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.337 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.337 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.337 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.338 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.338 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.338 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.338 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.338 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.338 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.338 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.338 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.338 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.338 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.338 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.338 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.338 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.339 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.339 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.339 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.339 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.339 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.339 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.339 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.339 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.339 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.339 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.339 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.339 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.339 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.340 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.340 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.340 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.340 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.340 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.340 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.340 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.340 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.340 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.340 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.340 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.340 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.340 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.341 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.341 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.341 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.341 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.341 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.341 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.341 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.341 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.341 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.341 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.341 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.341 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.341 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.341 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.341 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.342 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.342 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.342 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.342 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.342 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.342 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.342 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "nfs", 2024-06-06T03:38:06.342 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.342 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.342 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.342 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.342 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.342 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.343 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.343 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.343 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.343 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.343 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.343 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.343 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.343 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.343 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.343 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.343 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.343 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.343 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.343 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.344 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.344 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.344 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.344 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.344 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.344 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.344 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.344 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.344 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.344 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.344 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.344 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.344 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.344 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.345 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.345 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.345 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.345 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.345 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.345 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.345 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.345 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.345 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.345 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.345 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.345 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.345 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.345 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.346 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.346 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.346 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.346 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.346 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.346 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.346 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.346 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.346 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.346 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.346 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.346 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.346 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.346 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.347 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.347 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.347 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.347 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.347 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.347 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.347 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.347 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.347 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.347 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "orchestrator", 2024-06-06T03:38:06.347 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.347 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.347 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.348 INFO:teuthology.orchestra.run.smithi050.stdout: "fail_fs": { 2024-06-06T03:38:06.348 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "fail_fs", 2024-06-06T03:38:06.348 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.348 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.348 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.348 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.348 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.348 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.348 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.348 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-06-06T03:38:06.348 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.348 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.348 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.349 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.349 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.349 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.349 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.349 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.349 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.349 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.349 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.349 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.349 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.349 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.349 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.349 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.350 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.350 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.350 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.350 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.350 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.350 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.350 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.350 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.350 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.350 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.350 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.350 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.350 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.351 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.351 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.351 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.351 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.351 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.351 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.351 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.351 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.351 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.351 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.351 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.351 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.351 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.351 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.352 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.352 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.352 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.352 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.352 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.352 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.352 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.352 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.352 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.352 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.352 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.352 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.352 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.353 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.353 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.353 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.353 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.353 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.353 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.353 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.353 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.353 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.353 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.353 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.353 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.353 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.353 INFO:teuthology.orchestra.run.smithi050.stdout: "orchestrator": { 2024-06-06T03:38:06.353 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "orchestrator", 2024-06-06T03:38:06.354 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.354 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.354 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.354 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.354 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.354 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.354 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.354 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm", 2024-06-06T03:38:06.354 INFO:teuthology.orchestra.run.smithi050.stdout: "rook", 2024-06-06T03:38:06.354 INFO:teuthology.orchestra.run.smithi050.stdout: "test_orchestrator" 2024-06-06T03:38:06.354 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.354 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Orchestrator backend", 2024-06-06T03:38:06.354 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.354 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.355 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.355 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.355 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.355 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "osd_perf_query", 2024-06-06T03:38:06.355 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.355 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.355 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.355 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.355 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.355 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.355 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.355 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.355 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.355 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.356 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.356 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.356 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.356 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.356 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.356 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.356 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.356 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.356 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.356 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.356 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.356 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.356 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.356 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.356 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.357 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.357 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.357 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.357 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.357 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.357 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.357 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.357 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.357 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.357 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.357 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.357 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.357 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.358 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.358 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.358 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.358 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.358 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.358 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.358 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.358 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.358 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.358 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.358 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.358 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.358 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.358 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.359 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.359 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.359 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.359 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.359 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.359 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.359 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.359 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.359 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.359 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.359 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.359 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.359 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.360 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.360 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.360 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.360 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.360 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.360 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.360 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "osd_support", 2024-06-06T03:38:06.360 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.360 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.360 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.361 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.361 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.361 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.361 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.361 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.361 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.361 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.361 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.361 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.361 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.361 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.361 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.361 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.362 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.362 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.362 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.362 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.362 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.362 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.362 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.362 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.362 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.362 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.362 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.362 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.362 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.363 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.363 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.363 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.363 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.363 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.363 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.363 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.363 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.363 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.363 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.363 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.363 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.363 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.363 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.363 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.364 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.364 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.364 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.364 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.364 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.364 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.364 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.364 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.364 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.364 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.364 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.364 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.364 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.365 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.365 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.365 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.365 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.365 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.365 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.365 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.365 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.365 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.365 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.365 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.365 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.365 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.365 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.366 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pg_autoscaler", 2024-06-06T03:38:06.366 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.366 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.366 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.366 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.366 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.366 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.366 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.366 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.366 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.366 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.366 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.366 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.366 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.367 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.367 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.367 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.367 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.367 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.367 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.367 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.367 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.367 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.367 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.367 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.367 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.368 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.368 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.368 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.368 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.368 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.368 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.368 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.368 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.368 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.368 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.368 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.368 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.368 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.369 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.369 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.369 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.369 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.369 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.369 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.369 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.369 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.369 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.369 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.369 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.369 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.369 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.369 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.370 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.370 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.370 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.370 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.370 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.370 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.370 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.370 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.370 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.370 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.370 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.370 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.370 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.371 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.371 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.371 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.371 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.371 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-06-06T03:38:06.371 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-06-06T03:38:06.371 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:06.371 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.371 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.371 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-06-06T03:38:06.371 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.371 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.371 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.372 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.372 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.372 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.372 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.372 INFO:teuthology.orchestra.run.smithi050.stdout: "threshold": { 2024-06-06T03:38:06.372 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "threshold", 2024-06-06T03:38:06.372 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-06-06T03:38:06.372 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.372 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.372 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3.0", 2024-06-06T03:38:06.372 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1.0", 2024-06-06T03:38:06.372 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.372 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.373 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "scaling threshold", 2024-06-06T03:38:06.373 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-06-06T03:38:06.373 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.373 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.373 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.373 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.373 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "progress", 2024-06-06T03:38:06.373 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.373 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.373 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.373 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_pg_recovery_event": { 2024-06-06T03:38:06.374 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_pg_recovery_event", 2024-06-06T03:38:06.374 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.374 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.374 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.374 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.374 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.374 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.374 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.374 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow the module to show pg recovery progress", 2024-06-06T03:38:06.374 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.374 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.374 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.375 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": { 2024-06-06T03:38:06.375 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enabled", 2024-06-06T03:38:06.375 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.375 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.375 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.375 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.375 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.375 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.375 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.375 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.375 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.375 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.375 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.376 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.376 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.376 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.376 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.376 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.376 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.376 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.376 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.376 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.376 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.376 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.376 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.376 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.376 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.377 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.377 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.377 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.377 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.377 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.377 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.377 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.377 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.377 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.377 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.377 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.377 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.377 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.378 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.378 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.378 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.378 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.378 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.378 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.378 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.378 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.378 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.378 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.378 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.378 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.378 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.379 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.379 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.379 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.379 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.379 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.379 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.379 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.379 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.379 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.379 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.379 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.379 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.379 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.380 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.380 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.380 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.380 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.380 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.380 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.380 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.380 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.380 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.380 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.380 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.380 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.380 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.380 INFO:teuthology.orchestra.run.smithi050.stdout: "max_completed_events": { 2024-06-06T03:38:06.381 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_completed_events", 2024-06-06T03:38:06.381 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.381 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.381 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.381 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "50", 2024-06-06T03:38:06.381 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.381 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.381 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.381 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "number of past completed events to remember", 2024-06-06T03:38:06.381 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.381 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.381 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.381 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-06-06T03:38:06.382 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-06-06T03:38:06.382 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:06.382 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.382 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.382 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-06-06T03:38:06.382 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.382 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.382 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.382 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long the module is going to sleep", 2024-06-06T03:38:06.382 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.382 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.382 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.382 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.382 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.383 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prometheus", 2024-06-06T03:38:06.383 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.383 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.383 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.383 INFO:teuthology.orchestra.run.smithi050.stdout: "cache": { 2024-06-06T03:38:06.383 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cache", 2024-06-06T03:38:06.383 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.383 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.383 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.383 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.383 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.383 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.384 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.384 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.384 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.384 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.384 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.384 INFO:teuthology.orchestra.run.smithi050.stdout: "exclude_perf_counters": { 2024-06-06T03:38:06.384 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "exclude_perf_counters", 2024-06-06T03:38:06.384 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.384 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.384 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.384 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.384 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.385 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.385 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.385 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-06-06T03:38:06.385 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-06-06T03:38:06.385 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.385 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.385 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.385 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.385 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.385 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.385 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.385 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.385 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.386 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.386 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.386 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.386 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.386 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.386 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.386 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.386 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.386 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.386 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.386 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.386 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.386 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.387 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.387 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.387 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.387 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.387 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.387 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.387 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.387 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.387 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.387 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.387 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.387 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.387 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.388 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.388 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.388 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.388 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.388 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.388 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.388 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.388 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.388 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.388 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.388 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.388 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.388 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.388 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.389 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.389 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.389 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.389 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.389 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.389 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.389 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.389 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.389 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.389 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.389 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.389 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.389 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.390 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.390 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.390 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.390 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.390 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.390 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.390 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_stats_pools": { 2024-06-06T03:38:06.390 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_stats_pools", 2024-06-06T03:38:06.390 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.390 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.390 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.390 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.391 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.391 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.391 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.391 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.391 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.391 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.391 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.391 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_stats_pools_refresh_interval": { 2024-06-06T03:38:06.391 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-06-06T03:38:06.391 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.391 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.391 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.391 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "300", 2024-06-06T03:38:06.392 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.392 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.392 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.392 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.392 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.392 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.392 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.392 INFO:teuthology.orchestra.run.smithi050.stdout: "scrape_interval": { 2024-06-06T03:38:06.392 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "scrape_interval", 2024-06-06T03:38:06.392 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-06-06T03:38:06.392 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.393 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.393 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15.0", 2024-06-06T03:38:06.393 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.393 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.393 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.393 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.393 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.393 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.393 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.393 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2024-06-06T03:38:06.393 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2024-06-06T03:38:06.393 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.393 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.394 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.394 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "::", 2024-06-06T03:38:06.394 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.394 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.394 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.394 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-06-06T03:38:06.394 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.394 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.394 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.394 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2024-06-06T03:38:06.394 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2024-06-06T03:38:06.394 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.394 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.395 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.395 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "9283", 2024-06-06T03:38:06.395 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.395 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.395 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.395 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-06-06T03:38:06.395 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.395 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.395 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.395 INFO:teuthology.orchestra.run.smithi050.stdout: "stale_cache_strategy": { 2024-06-06T03:38:06.395 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "stale_cache_strategy", 2024-06-06T03:38:06.395 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.395 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.396 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.396 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "log", 2024-06-06T03:38:06.396 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.396 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.396 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.396 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.396 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.396 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.396 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.396 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_behaviour": { 2024-06-06T03:38:06.396 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_behaviour", 2024-06-06T03:38:06.396 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.396 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.396 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.396 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "default", 2024-06-06T03:38:06.397 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.397 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.397 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.397 INFO:teuthology.orchestra.run.smithi050.stdout: "default", 2024-06-06T03:38:06.397 INFO:teuthology.orchestra.run.smithi050.stdout: "error" 2024-06-06T03:38:06.397 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.397 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.397 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.397 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.397 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.397 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_error_status_code": { 2024-06-06T03:38:06.397 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_error_status_code", 2024-06-06T03:38:06.397 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.397 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.397 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.398 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "500", 2024-06-06T03:38:06.398 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "400", 2024-06-06T03:38:06.398 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "599", 2024-06-06T03:38:06.398 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.398 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.398 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.398 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.398 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.398 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.398 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.398 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_support", 2024-06-06T03:38:06.398 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.398 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.399 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.399 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.399 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.399 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.399 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.399 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.399 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.399 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.399 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.399 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.399 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.399 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.399 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.399 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.400 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.400 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.400 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.400 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.400 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.400 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.400 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.400 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.400 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.400 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.400 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.400 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.400 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.401 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.401 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.401 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.401 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.401 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.401 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.401 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.401 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.401 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.401 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.401 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.401 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.402 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.402 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.402 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.402 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.402 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.402 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.402 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.402 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.402 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.402 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.402 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.402 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.402 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.403 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.403 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.403 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.403 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.403 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.403 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.403 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.403 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.403 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.403 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.403 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.403 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.403 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.403 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.404 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.404 INFO:teuthology.orchestra.run.smithi050.stdout: "max_concurrent_snap_create": { 2024-06-06T03:38:06.404 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_concurrent_snap_create", 2024-06-06T03:38:06.404 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.404 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.404 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.404 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-06-06T03:38:06.404 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.404 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.404 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.404 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.404 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.404 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.405 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.405 INFO:teuthology.orchestra.run.smithi050.stdout: "mirror_snapshot_schedule": { 2024-06-06T03:38:06.405 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mirror_snapshot_schedule", 2024-06-06T03:38:06.405 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.405 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.405 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.405 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.405 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.405 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.405 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.405 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.405 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.405 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.405 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.406 INFO:teuthology.orchestra.run.smithi050.stdout: "trash_purge_schedule": { 2024-06-06T03:38:06.406 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "trash_purge_schedule", 2024-06-06T03:38:06.406 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.406 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.406 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.406 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.406 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.406 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.406 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.406 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.406 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.406 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.407 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.407 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.407 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.407 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "restful", 2024-06-06T03:38:06.407 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.407 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.407 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.407 INFO:teuthology.orchestra.run.smithi050.stdout: "enable_auth": { 2024-06-06T03:38:06.407 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enable_auth", 2024-06-06T03:38:06.407 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.407 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.407 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.407 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.408 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.408 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.408 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.408 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.408 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.408 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.408 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.408 INFO:teuthology.orchestra.run.smithi050.stdout: "key_file": { 2024-06-06T03:38:06.408 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "key_file", 2024-06-06T03:38:06.408 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.408 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.408 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.408 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.409 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.409 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.409 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.409 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.409 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.409 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.409 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.409 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.409 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.409 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.409 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.409 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.409 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.409 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.409 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.410 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.410 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.410 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.410 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.410 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.410 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.410 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.410 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.410 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.410 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.410 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.410 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.410 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.411 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.411 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.411 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.411 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.411 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.411 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.411 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.411 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.411 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.411 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.411 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.411 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.411 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.411 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.412 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.412 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.412 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.412 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.412 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.412 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.412 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.412 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.412 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.412 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.412 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.412 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.412 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.413 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.413 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.413 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.413 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.413 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.413 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.413 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.413 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.413 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.413 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.413 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.413 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.413 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.413 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.414 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.414 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.414 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.414 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.414 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2024-06-06T03:38:06.414 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2024-06-06T03:38:06.414 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.414 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.414 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.414 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.414 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.414 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.414 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.415 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.415 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.415 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.415 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.415 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2024-06-06T03:38:06.415 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2024-06-06T03:38:06.415 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.415 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.415 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.415 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.415 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.415 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.415 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.415 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.416 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.416 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.416 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.416 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.416 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.416 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rgw", 2024-06-06T03:38:06.416 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.416 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.416 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.416 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.416 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.416 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.416 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.417 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.417 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.417 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.417 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.417 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.417 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.417 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.417 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.417 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.417 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.417 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.417 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.417 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.417 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.418 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.418 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.418 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.418 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.418 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.418 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.418 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.418 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.418 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.418 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.418 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.418 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.418 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.419 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.419 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.419 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.419 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.419 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.419 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.419 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.419 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.419 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.419 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.419 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.419 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.419 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.419 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.420 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.420 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.420 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.420 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.420 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.420 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.420 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.420 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.420 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.420 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.420 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.420 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.420 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.420 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.421 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.421 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.421 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.421 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.421 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.421 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.421 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.421 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.421 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.421 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rook", 2024-06-06T03:38:06.421 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.421 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.422 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.422 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.422 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.422 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.422 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.422 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.422 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.422 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.422 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.422 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.422 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.422 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.422 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.422 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.423 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.423 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.423 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.423 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.423 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.423 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.423 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.423 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.423 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.423 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.423 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.423 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.423 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.423 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.424 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.424 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.424 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.424 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.424 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.424 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.424 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.424 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.424 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.424 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.424 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.424 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.424 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.425 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.425 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.425 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.425 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.425 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.425 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.425 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.425 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.425 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.425 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.425 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.425 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.426 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.426 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.426 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.426 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.426 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.426 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.426 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.426 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.426 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.426 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.426 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.427 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.427 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.427 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.427 INFO:teuthology.orchestra.run.smithi050.stdout: "storage_class": { 2024-06-06T03:38:06.427 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "storage_class", 2024-06-06T03:38:06.427 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.427 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.427 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.427 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "local", 2024-06-06T03:38:06.427 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.427 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.427 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.427 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-06-06T03:38:06.428 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.428 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.428 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.428 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.428 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.428 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "selftest", 2024-06-06T03:38:06.428 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.428 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.428 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.428 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.428 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.428 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.429 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.429 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.429 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.429 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.429 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.429 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.429 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.429 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.429 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.429 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.429 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.429 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.429 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.429 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.429 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.430 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.430 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.430 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.430 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.430 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.430 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.430 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.430 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.430 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.430 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.430 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.430 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.431 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.431 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.431 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.431 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.431 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.431 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.431 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.431 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.431 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.431 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.431 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.431 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.431 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.431 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.432 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.432 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.432 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.432 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.432 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.432 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.432 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.432 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.432 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.432 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.432 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.432 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.432 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.433 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.433 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.433 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.433 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.433 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.433 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.433 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.433 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.433 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.433 INFO:teuthology.orchestra.run.smithi050.stdout: "roption1": { 2024-06-06T03:38:06.433 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "roption1", 2024-06-06T03:38:06.433 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.433 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.434 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.434 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.434 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.434 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.434 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.434 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.434 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.434 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.434 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.434 INFO:teuthology.orchestra.run.smithi050.stdout: "roption2": { 2024-06-06T03:38:06.434 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "roption2", 2024-06-06T03:38:06.434 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.435 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.435 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.435 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "xyz", 2024-06-06T03:38:06.435 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.435 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.435 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.435 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.435 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.435 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.435 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.435 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption1": { 2024-06-06T03:38:06.435 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption1", 2024-06-06T03:38:06.435 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.435 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.436 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.436 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.436 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.436 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.436 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.436 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.436 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.436 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.436 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.436 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption2": { 2024-06-06T03:38:06.436 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption2", 2024-06-06T03:38:06.436 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.436 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.437 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.437 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.437 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.437 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.437 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.437 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.437 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.437 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.437 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.437 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption3": { 2024-06-06T03:38:06.437 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption3", 2024-06-06T03:38:06.437 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-06-06T03:38:06.437 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.438 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.438 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.438 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.438 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.438 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.438 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.438 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.438 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.438 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.438 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption4": { 2024-06-06T03:38:06.438 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption4", 2024-06-06T03:38:06.438 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.439 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.439 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.439 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.439 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.439 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.439 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.439 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.439 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.439 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.439 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.439 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption5": { 2024-06-06T03:38:06.439 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption5", 2024-06-06T03:38:06.439 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.439 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.440 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.440 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.440 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.440 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.440 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.440 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.440 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.440 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.440 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.440 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption6": { 2024-06-06T03:38:06.440 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption6", 2024-06-06T03:38:06.440 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.440 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.441 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.441 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.441 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.441 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.441 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.441 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.441 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.441 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.441 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.441 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption7": { 2024-06-06T03:38:06.441 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption7", 2024-06-06T03:38:06.441 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.441 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.442 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.442 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.442 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-06-06T03:38:06.442 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "42", 2024-06-06T03:38:06.442 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.442 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.442 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.442 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.442 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.442 INFO:teuthology.orchestra.run.smithi050.stdout: "testkey": { 2024-06-06T03:38:06.442 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testkey", 2024-06-06T03:38:06.442 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.442 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.443 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.443 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.443 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.443 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.443 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.443 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.443 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.443 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.443 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.443 INFO:teuthology.orchestra.run.smithi050.stdout: "testlkey": { 2024-06-06T03:38:06.443 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testlkey", 2024-06-06T03:38:06.443 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.443 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.444 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.444 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.444 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.444 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.444 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.444 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.444 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.444 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.444 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.444 INFO:teuthology.orchestra.run.smithi050.stdout: "testnewline": { 2024-06-06T03:38:06.444 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testnewline", 2024-06-06T03:38:06.444 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.445 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.445 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.445 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.445 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.445 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.445 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.445 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.445 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.445 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.445 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.445 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.445 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.445 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snap_schedule", 2024-06-06T03:38:06.446 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.446 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.446 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.446 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_m_granularity": { 2024-06-06T03:38:06.446 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_m_granularity", 2024-06-06T03:38:06.446 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.446 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.446 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.446 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.446 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.446 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.446 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.446 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow minute scheduled snapshots", 2024-06-06T03:38:06.446 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.447 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.447 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.447 INFO:teuthology.orchestra.run.smithi050.stdout: "dump_on_update": { 2024-06-06T03:38:06.447 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "dump_on_update", 2024-06-06T03:38:06.447 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.447 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.447 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.447 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.447 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.447 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.447 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.447 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "dump database to debug log on update", 2024-06-06T03:38:06.447 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.448 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.448 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.448 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.448 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.448 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.448 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.448 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.448 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.448 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.448 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.448 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.448 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.448 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.448 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.449 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.449 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.449 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.449 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.449 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.449 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.449 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.449 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.449 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.449 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.449 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.450 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.450 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.450 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.450 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.450 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.450 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.450 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.450 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.450 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.450 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.450 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.450 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.450 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.451 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.451 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.451 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.451 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.451 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.451 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.451 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.451 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.451 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.451 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.451 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.451 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.451 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.451 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.452 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.452 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.452 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.452 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.452 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.452 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.452 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.452 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.452 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.452 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.452 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.452 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.452 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.453 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.453 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.453 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.453 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.453 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.453 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "stats", 2024-06-06T03:38:06.453 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.453 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.453 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.453 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.453 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.453 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.454 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.454 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.454 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.454 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.454 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.454 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.454 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.454 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.454 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.454 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.454 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.454 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.454 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.454 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.454 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.455 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.455 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.455 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.455 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.455 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.455 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.455 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.455 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.455 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.455 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.455 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.455 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.455 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.455 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.456 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.456 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.456 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.456 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.456 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.456 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.456 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.456 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.456 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.456 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.456 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.456 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.456 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.456 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.457 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.457 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.457 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.457 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.457 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.457 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.457 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.457 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.457 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.457 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.457 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.457 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.457 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.458 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.458 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.458 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.458 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.458 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.458 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.458 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.458 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.458 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.458 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "status", 2024-06-06T03:38:06.458 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.459 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.459 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.459 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.459 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.459 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.459 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.459 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.459 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.459 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.459 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.459 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.459 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.459 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.459 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.460 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.460 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.460 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.460 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.460 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.460 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.460 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.460 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.460 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.460 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.460 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.460 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.460 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.461 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.461 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.461 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.461 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.461 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.461 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.461 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.461 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.461 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.461 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.461 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.461 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.461 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.462 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.462 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.462 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.462 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.462 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.462 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.462 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.462 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.462 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.462 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.462 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.462 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.462 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.463 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.463 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.463 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.463 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.463 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.463 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.463 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.463 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.463 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.463 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.463 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.463 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.464 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.464 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.464 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.464 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.464 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.464 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "telegraf", 2024-06-06T03:38:06.464 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.464 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.464 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.464 INFO:teuthology.orchestra.run.smithi050.stdout: "address": { 2024-06-06T03:38:06.464 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "address", 2024-06-06T03:38:06.464 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.465 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.465 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.465 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-06-06T03:38:06.465 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.465 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.465 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.465 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.465 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.465 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.465 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.465 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-06-06T03:38:06.465 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-06-06T03:38:06.465 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:06.466 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.466 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.466 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15", 2024-06-06T03:38:06.466 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.466 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.466 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.466 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.466 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.466 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.466 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.466 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.466 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.467 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.467 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.467 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.467 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.467 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.467 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.467 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.467 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.467 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.467 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.467 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.467 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.467 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.467 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.467 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.468 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.468 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.468 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.468 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.468 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.468 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.468 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.468 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.468 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.468 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.468 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.468 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.468 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.469 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.469 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.469 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.469 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.469 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.469 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.469 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.469 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.469 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.469 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.469 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.469 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.469 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.469 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.470 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.470 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.470 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.470 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.470 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.470 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.470 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.470 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.470 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.470 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.470 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.470 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.471 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.471 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.471 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.471 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.471 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.471 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.471 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.471 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.471 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.471 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.471 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.471 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.471 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "telemetry", 2024-06-06T03:38:06.472 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.472 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.472 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.472 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_basic": { 2024-06-06T03:38:06.472 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_basic", 2024-06-06T03:38:06.472 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.472 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.472 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.472 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.472 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.472 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.472 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.472 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share basic cluster information (size, version)", 2024-06-06T03:38:06.472 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.473 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.473 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.473 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_crash": { 2024-06-06T03:38:06.473 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_crash", 2024-06-06T03:38:06.473 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.473 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.473 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.473 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.473 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.473 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.473 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.473 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-06-06T03:38:06.473 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.474 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.474 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.474 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_device": { 2024-06-06T03:38:06.474 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_device", 2024-06-06T03:38:06.474 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.474 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.474 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.474 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.474 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.474 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.474 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.474 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-06-06T03:38:06.474 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.475 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.475 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.475 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_ident": { 2024-06-06T03:38:06.475 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_ident", 2024-06-06T03:38:06.475 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.475 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.475 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.475 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.475 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.475 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.475 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.475 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-06-06T03:38:06.475 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.476 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.476 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.476 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_perf": { 2024-06-06T03:38:06.476 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_perf", 2024-06-06T03:38:06.476 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.476 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.476 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.476 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.476 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.476 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.476 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.476 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share various performance metrics of a cluster", 2024-06-06T03:38:06.476 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.477 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.477 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.477 INFO:teuthology.orchestra.run.smithi050.stdout: "contact": { 2024-06-06T03:38:06.477 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "contact", 2024-06-06T03:38:06.477 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.477 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.477 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.477 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.477 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.477 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.477 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.477 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.477 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.478 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.478 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.478 INFO:teuthology.orchestra.run.smithi050.stdout: "description": { 2024-06-06T03:38:06.478 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "description", 2024-06-06T03:38:06.478 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.478 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.478 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.478 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.478 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.478 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.478 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.478 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.478 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.479 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.479 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.479 INFO:teuthology.orchestra.run.smithi050.stdout: "device_url": { 2024-06-06T03:38:06.479 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_url", 2024-06-06T03:38:06.479 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.479 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.479 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.479 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-06-06T03:38:06.479 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.479 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.479 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.479 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.479 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.479 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.480 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.480 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": { 2024-06-06T03:38:06.480 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enabled", 2024-06-06T03:38:06.480 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.480 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.480 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.480 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.480 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.480 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.480 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.480 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.480 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.480 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.481 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.481 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-06-06T03:38:06.481 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-06-06T03:38:06.481 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.481 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.481 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.481 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "24", 2024-06-06T03:38:06.481 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "8", 2024-06-06T03:38:06.481 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.481 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.481 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.481 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.481 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.482 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.482 INFO:teuthology.orchestra.run.smithi050.stdout: "last_opt_revision": { 2024-06-06T03:38:06.482 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "last_opt_revision", 2024-06-06T03:38:06.482 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.482 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.482 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.482 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1", 2024-06-06T03:38:06.482 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.482 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.482 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.482 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.482 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.482 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.482 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.483 INFO:teuthology.orchestra.run.smithi050.stdout: "leaderboard": { 2024-06-06T03:38:06.483 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "leaderboard", 2024-06-06T03:38:06.483 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.483 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.483 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.483 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.483 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.483 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.483 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.483 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.483 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.483 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.483 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.484 INFO:teuthology.orchestra.run.smithi050.stdout: "leaderboard_description": { 2024-06-06T03:38:06.484 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "leaderboard_description", 2024-06-06T03:38:06.484 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.484 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.484 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.484 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.484 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.484 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.484 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.484 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.484 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.484 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.484 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.485 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.485 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.485 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.485 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.485 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.485 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.485 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.485 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.485 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.485 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.485 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.485 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.485 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.485 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.486 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.486 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.486 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.486 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.486 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.486 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.486 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.486 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.486 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.486 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.486 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.486 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.486 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.487 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.487 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.487 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.487 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.487 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.487 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.487 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.487 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.487 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.487 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.487 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.487 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.488 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.488 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.488 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.488 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.488 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.488 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.488 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.488 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.488 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.488 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.488 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.488 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.488 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.488 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.489 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.489 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.489 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.489 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.489 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.489 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.489 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.489 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.489 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.489 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.489 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.489 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.489 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.490 INFO:teuthology.orchestra.run.smithi050.stdout: "organization": { 2024-06-06T03:38:06.490 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "organization", 2024-06-06T03:38:06.490 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.490 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.490 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.490 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.490 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.490 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.490 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.490 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.490 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.490 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.490 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.491 INFO:teuthology.orchestra.run.smithi050.stdout: "proxy": { 2024-06-06T03:38:06.491 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "proxy", 2024-06-06T03:38:06.491 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.491 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.491 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.491 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.491 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.491 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.491 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.491 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.491 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.491 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.491 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.492 INFO:teuthology.orchestra.run.smithi050.stdout: "url": { 2024-06-06T03:38:06.492 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "url", 2024-06-06T03:38:06.492 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.492 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.492 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.492 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-06-06T03:38:06.492 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.492 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.492 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.492 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.492 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.492 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.492 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.492 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.493 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.493 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "test_orchestrator", 2024-06-06T03:38:06.493 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.493 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.493 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.493 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.493 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.493 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.493 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.493 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.493 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.494 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.494 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.494 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.494 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.494 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.494 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.494 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.494 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.494 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.494 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.494 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.494 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.494 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.495 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.495 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.495 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.495 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.495 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.495 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.495 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.495 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.495 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.495 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.495 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.495 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.495 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.495 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.496 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.496 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.496 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.496 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.496 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.496 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.496 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.496 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.496 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.496 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.496 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.496 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.496 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.496 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.497 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.497 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.497 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.497 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.497 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.497 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.497 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.497 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.497 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.497 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.497 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.497 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.497 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.498 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.498 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.498 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.498 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.498 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.498 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.498 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.498 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.498 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "volumes", 2024-06-06T03:38:06.498 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.498 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.498 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.499 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.499 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.499 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.499 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.499 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.499 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.499 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.499 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.499 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.499 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.499 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.499 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.499 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.499 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.500 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.500 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.500 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.500 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.500 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.500 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.500 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.500 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.500 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.500 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.500 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.500 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.500 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.501 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.501 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.501 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.501 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.501 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.501 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.501 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.501 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.501 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.501 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.501 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.501 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.501 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.502 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.502 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.502 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.502 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.502 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.502 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.502 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.502 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.502 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.502 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.502 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.502 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.503 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.503 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.503 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.503 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.503 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.503 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.503 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.503 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.503 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.503 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.503 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.503 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.503 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.504 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.504 INFO:teuthology.orchestra.run.smithi050.stdout: "max_concurrent_clones": { 2024-06-06T03:38:06.504 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_concurrent_clones", 2024-06-06T03:38:06.504 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.504 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.504 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.504 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "4", 2024-06-06T03:38:06.504 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.504 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.504 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.504 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Number of asynchronous cloner threads", 2024-06-06T03:38:06.504 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.505 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.505 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.505 INFO:teuthology.orchestra.run.smithi050.stdout: "periodic_async_work": { 2024-06-06T03:38:06.505 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "periodic_async_work", 2024-06-06T03:38:06.505 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.505 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.505 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.505 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.505 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.505 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.505 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.505 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Periodically check for async work", 2024-06-06T03:38:06.506 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.506 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.506 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.506 INFO:teuthology.orchestra.run.smithi050.stdout: "snapshot_clone_delay": { 2024-06-06T03:38:06.506 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snapshot_clone_delay", 2024-06-06T03:38:06.506 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.506 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.506 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.506 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-06-06T03:38:06.506 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.506 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.506 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.507 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-06-06T03:38:06.507 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.507 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.507 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.507 INFO:teuthology.orchestra.run.smithi050.stdout: "snapshot_clone_no_wait": { 2024-06-06T03:38:06.507 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snapshot_clone_no_wait", 2024-06-06T03:38:06.507 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.507 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.507 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.507 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-06-06T03:38:06.507 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.507 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.507 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.508 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-06-06T03:38:06.508 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.508 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.508 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.508 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.508 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.508 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix", 2024-06-06T03:38:06.508 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-06-06T03:38:06.508 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-06-06T03:38:06.508 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-06-06T03:38:06.508 INFO:teuthology.orchestra.run.smithi050.stdout: "discovery_interval": { 2024-06-06T03:38:06.509 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "discovery_interval", 2024-06-06T03:38:06.509 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-06-06T03:38:06.509 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.509 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.509 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "100", 2024-06-06T03:38:06.509 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.509 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.509 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.509 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.509 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.509 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.509 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.509 INFO:teuthology.orchestra.run.smithi050.stdout: "identifier": { 2024-06-06T03:38:06.510 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "identifier", 2024-06-06T03:38:06.510 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.510 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.510 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.510 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.510 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.510 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.510 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.510 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.510 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.510 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.510 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.511 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-06-06T03:38:06.511 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-06-06T03:38:06.511 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-06-06T03:38:06.511 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.511 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.511 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-06-06T03:38:06.511 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.511 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.511 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.511 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.511 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.511 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.511 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.512 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-06-06T03:38:06.512 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-06-06T03:38:06.512 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.512 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.512 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.512 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.512 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.512 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.512 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.512 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.512 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.512 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.512 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.512 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.513 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.513 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.513 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.513 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.513 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.513 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.513 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-06-06T03:38:06.513 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-06-06T03:38:06.513 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.513 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.513 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.513 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.513 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.513 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.514 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.514 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.514 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.514 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.514 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.514 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-06-06T03:38:06.514 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-06-06T03:38:06.514 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.514 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.514 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.514 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-06-06T03:38:06.514 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.514 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.515 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-06-06T03:38:06.515 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-06-06T03:38:06.515 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-06-06T03:38:06.515 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-06-06T03:38:06.515 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-06-06T03:38:06.515 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-06-06T03:38:06.515 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-06-06T03:38:06.515 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.515 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.515 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.515 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.515 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.515 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-06-06T03:38:06.515 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-06-06T03:38:06.516 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-06-06T03:38:06.516 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.516 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-06-06T03:38:06.516 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-06-06T03:38:06.516 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.516 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.516 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.516 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.516 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.516 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.516 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.516 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_host": { 2024-06-06T03:38:06.516 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_host", 2024-06-06T03:38:06.516 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.517 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.517 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.517 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-06-06T03:38:06.517 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.517 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.517 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.517 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.517 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.517 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.517 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.517 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_port": { 2024-06-06T03:38:06.517 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_port", 2024-06-06T03:38:06.517 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-06-06T03:38:06.517 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.518 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.518 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10051", 2024-06-06T03:38:06.518 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.518 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.518 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.518 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.518 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.518 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.518 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.518 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_sender": { 2024-06-06T03:38:06.518 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_sender", 2024-06-06T03:38:06.518 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-06-06T03:38:06.518 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-06-06T03:38:06.519 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-06-06T03:38:06.519 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-06-06T03:38:06.519 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-06-06T03:38:06.519 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-06-06T03:38:06.519 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-06-06T03:38:06.519 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-06-06T03:38:06.519 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-06-06T03:38:06.519 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-06-06T03:38:06.519 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-06-06T03:38:06.519 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.519 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.519 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.519 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.519 INFO:teuthology.orchestra.run.smithi050.stdout: "services": { 2024-06-06T03:38:06.519 INFO:teuthology.orchestra.run.smithi050.stdout: "dashboard": "https://172.21.15.50:8443/" 2024-06-06T03:38:06.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.520 INFO:teuthology.orchestra.run.smithi050.stdout: "always_on_modules": { 2024-06-06T03:38:06.520 INFO:teuthology.orchestra.run.smithi050.stdout: "octopus": [ 2024-06-06T03:38:06.520 INFO:teuthology.orchestra.run.smithi050.stdout: "balancer", 2024-06-06T03:38:06.520 INFO:teuthology.orchestra.run.smithi050.stdout: "crash", 2024-06-06T03:38:06.520 INFO:teuthology.orchestra.run.smithi050.stdout: "devicehealth", 2024-06-06T03:38:06.520 INFO:teuthology.orchestra.run.smithi050.stdout: "orchestrator", 2024-06-06T03:38:06.520 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscaler", 2024-06-06T03:38:06.520 INFO:teuthology.orchestra.run.smithi050.stdout: "progress", 2024-06-06T03:38:06.520 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_support", 2024-06-06T03:38:06.520 INFO:teuthology.orchestra.run.smithi050.stdout: "status", 2024-06-06T03:38:06.520 INFO:teuthology.orchestra.run.smithi050.stdout: "telemetry", 2024-06-06T03:38:06.520 INFO:teuthology.orchestra.run.smithi050.stdout: "volumes" 2024-06-06T03:38:06.520 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.520 INFO:teuthology.orchestra.run.smithi050.stdout: "pacific": [ 2024-06-06T03:38:06.520 INFO:teuthology.orchestra.run.smithi050.stdout: "balancer", 2024-06-06T03:38:06.521 INFO:teuthology.orchestra.run.smithi050.stdout: "crash", 2024-06-06T03:38:06.521 INFO:teuthology.orchestra.run.smithi050.stdout: "devicehealth", 2024-06-06T03:38:06.521 INFO:teuthology.orchestra.run.smithi050.stdout: "orchestrator", 2024-06-06T03:38:06.521 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscaler", 2024-06-06T03:38:06.521 INFO:teuthology.orchestra.run.smithi050.stdout: "progress", 2024-06-06T03:38:06.521 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_support", 2024-06-06T03:38:06.521 INFO:teuthology.orchestra.run.smithi050.stdout: "status", 2024-06-06T03:38:06.521 INFO:teuthology.orchestra.run.smithi050.stdout: "telemetry", 2024-06-06T03:38:06.521 INFO:teuthology.orchestra.run.smithi050.stdout: "volumes" 2024-06-06T03:38:06.521 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.521 INFO:teuthology.orchestra.run.smithi050.stdout: "quincy": [ 2024-06-06T03:38:06.521 INFO:teuthology.orchestra.run.smithi050.stdout: "balancer", 2024-06-06T03:38:06.521 INFO:teuthology.orchestra.run.smithi050.stdout: "crash", 2024-06-06T03:38:06.521 INFO:teuthology.orchestra.run.smithi050.stdout: "devicehealth", 2024-06-06T03:38:06.522 INFO:teuthology.orchestra.run.smithi050.stdout: "orchestrator", 2024-06-06T03:38:06.522 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscaler", 2024-06-06T03:38:06.522 INFO:teuthology.orchestra.run.smithi050.stdout: "progress", 2024-06-06T03:38:06.522 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_support", 2024-06-06T03:38:06.522 INFO:teuthology.orchestra.run.smithi050.stdout: "status", 2024-06-06T03:38:06.522 INFO:teuthology.orchestra.run.smithi050.stdout: "telemetry", 2024-06-06T03:38:06.522 INFO:teuthology.orchestra.run.smithi050.stdout: "volumes" 2024-06-06T03:38:06.522 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.522 INFO:teuthology.orchestra.run.smithi050.stdout: "reef": [ 2024-06-06T03:38:06.522 INFO:teuthology.orchestra.run.smithi050.stdout: "balancer", 2024-06-06T03:38:06.522 INFO:teuthology.orchestra.run.smithi050.stdout: "crash", 2024-06-06T03:38:06.522 INFO:teuthology.orchestra.run.smithi050.stdout: "devicehealth", 2024-06-06T03:38:06.522 INFO:teuthology.orchestra.run.smithi050.stdout: "orchestrator", 2024-06-06T03:38:06.522 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscaler", 2024-06-06T03:38:06.523 INFO:teuthology.orchestra.run.smithi050.stdout: "progress", 2024-06-06T03:38:06.523 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_support", 2024-06-06T03:38:06.523 INFO:teuthology.orchestra.run.smithi050.stdout: "status", 2024-06-06T03:38:06.523 INFO:teuthology.orchestra.run.smithi050.stdout: "telemetry", 2024-06-06T03:38:06.523 INFO:teuthology.orchestra.run.smithi050.stdout: "volumes" 2024-06-06T03:38:06.523 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-06-06T03:38:06.523 INFO:teuthology.orchestra.run.smithi050.stdout: "squid": [ 2024-06-06T03:38:06.523 INFO:teuthology.orchestra.run.smithi050.stdout: "balancer", 2024-06-06T03:38:06.523 INFO:teuthology.orchestra.run.smithi050.stdout: "crash", 2024-06-06T03:38:06.523 INFO:teuthology.orchestra.run.smithi050.stdout: "devicehealth", 2024-06-06T03:38:06.523 INFO:teuthology.orchestra.run.smithi050.stdout: "orchestrator", 2024-06-06T03:38:06.523 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscaler", 2024-06-06T03:38:06.523 INFO:teuthology.orchestra.run.smithi050.stdout: "progress", 2024-06-06T03:38:06.523 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_support", 2024-06-06T03:38:06.523 INFO:teuthology.orchestra.run.smithi050.stdout: "status", 2024-06-06T03:38:06.524 INFO:teuthology.orchestra.run.smithi050.stdout: "telemetry", 2024-06-06T03:38:06.524 INFO:teuthology.orchestra.run.smithi050.stdout: "volumes" 2024-06-06T03:38:06.524 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-06-06T03:38:06.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.524 INFO:teuthology.orchestra.run.smithi050.stdout: "last_failure_osd_epoch": 3, 2024-06-06T03:38:06.524 INFO:teuthology.orchestra.run.smithi050.stdout: "active_clients": [ 2024-06-06T03:38:06.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.524 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "devicehealth", 2024-06-06T03:38:06.524 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-06-06T03:38:06.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.524 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-06-06T03:38:06.524 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:0", 2024-06-06T03:38:06.524 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4170664250 2024-06-06T03:38:06.524 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.524 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-06-06T03:38:06.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.525 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "libcephsqlite", 2024-06-06T03:38:06.525 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-06-06T03:38:06.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.525 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-06-06T03:38:06.525 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:0", 2024-06-06T03:38:06.525 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4254839466 2024-06-06T03:38:06.525 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.525 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-06-06T03:38:06.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.525 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_support", 2024-06-06T03:38:06.525 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-06-06T03:38:06.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.526 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-06-06T03:38:06.526 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:0", 2024-06-06T03:38:06.526 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4078698808 2024-06-06T03:38:06.526 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.526 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-06-06T03:38:06.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:06.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.526 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "volumes", 2024-06-06T03:38:06.526 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-06-06T03:38:06.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-06-06T03:38:06.526 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-06-06T03:38:06.526 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:0", 2024-06-06T03:38:06.526 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2261627271 2024-06-06T03:38:06.527 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.527 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-06-06T03:38:06.527 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:06.527 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-06-06T03:38:06.527 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:38:06.529 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:05 smithi122 ceph-mon[35759]: pgmap v774: 129 pgs: 129 active+clean; 10 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 28 MiB/s wr, 534 op/s 2024-06-06T03:38:06.529 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:05 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/2743455778' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-06T03:38:06.529 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:06 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/763756267' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-06-06T03:38:06.529 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:05 smithi079 ceph-mon[35478]: pgmap v774: 129 pgs: 129 active+clean; 10 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 28 MiB/s wr, 534 op/s 2024-06-06T03:38:06.529 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:05 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/2743455778' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-06T03:38:06.529 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:06 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/763756267' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-06-06T03:38:06.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:05.228+0000 7f8e9db34640 1 -- 172.21.15.50:0/763756267 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8e800a2d90 msgr2=0x7f8e800a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:05.228+0000 7f8e9db34640 1 --2- 172.21.15.50:0/763756267 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8e800a2d90 0x7f8e800a5250 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8e90005c40 tx=0x7f8e90005bd0 comp rx=0 tx=0).stop 2024-06-06T03:38:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:05.228+0000 7f8e9db34640 1 -- 172.21.15.50:0/763756267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e9810b310 msgr2=0x7f8e981a6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:05.228+0000 7f8e9db34640 1 --2- 172.21.15.50:0/763756267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e9810b310 0x7f8e981a6fc0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f8e8800b470 tx=0x7f8e8800b930 comp rx=0 tx=0).stop 2024-06-06T03:38:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:05.229+0000 7f8e9db34640 1 -- 172.21.15.50:0/763756267 shutdown_connections 2024-06-06T03:38:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:05.229+0000 7f8e9db34640 1 --2- 172.21.15.50:0/763756267 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f8e800a2d90 0x7f8e800a5250 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:05.229+0000 7f8e9db34640 1 --2- 172.21.15.50:0/763756267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e9810b310 0x7f8e981a6fc0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:05.229+0000 7f8e9db34640 1 --2- 172.21.15.50:0/763756267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e9810dce0 0x7f8e981ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:05.229+0000 7f8e9db34640 1 --2- 172.21.15.50:0/763756267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e981089a0 0x7f8e981a6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:05.229+0000 7f8e9db34640 1 -- 172.21.15.50:0/763756267 >> 172.21.15.50:0/763756267 conn(0x7f8e9806e840 msgr2=0x7f8e9810c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:38:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:05.229+0000 7f8e9db34640 1 -- 172.21.15.50:0/763756267 shutdown_connections 2024-06-06T03:38:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:05.229+0000 7f8e9db34640 1 -- 172.21.15.50:0/763756267 wait complete. 2024-06-06T03:38:06.537 DEBUG:tasks.check_counter:Getting stats from a 2024-06-06T03:38:06.537 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph daemon mds.a perf dump 2024-06-06T03:38:06.537 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:05 smithi050 ceph-mon[32421]: pgmap v774: 129 pgs: 129 active+clean; 10 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 28 MiB/s wr, 534 op/s 2024-06-06T03:38:06.537 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:05 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/2743455778' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-06T03:38:06.538 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:06 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/763756267' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-06-06T03:38:07.063 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:38:07.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:07 smithi079 ceph-mon[35478]: pgmap v775: 129 pgs: 129 active+clean; 9.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 28 MiB/s wr, 543 op/s 2024-06-06T03:38:07.383 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:07 smithi050 ceph-mon[32421]: pgmap v775: 129 pgs: 129 active+clean; 9.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 28 MiB/s wr, 543 op/s 2024-06-06T03:38:07.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:07 smithi122 ceph-mon[35759]: pgmap v775: 129 pgs: 129 active+clean; 9.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 28 MiB/s wr, 543 op/s 2024-06-06T03:38:08.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:08 smithi050 ceph-mon[32421]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:38:08.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:08 smithi079 ceph-mon[35478]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:38:08.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:08 smithi122 ceph-mon[35759]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:38:09.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:09 smithi079 ceph-mon[35478]: pgmap v776: 129 pgs: 129 active+clean; 8.8 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 20 MiB/s wr, 404 op/s 2024-06-06T03:38:09.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:09 smithi122 ceph-mon[35759]: pgmap v776: 129 pgs: 129 active+clean; 8.8 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 20 MiB/s wr, 404 op/s 2024-06-06T03:38:09.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:09 smithi050 ceph-mon[32421]: pgmap v776: 129 pgs: 129 active+clean; 8.8 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 20 MiB/s wr, 404 op/s 2024-06-06T03:38:11.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:11 smithi050 ceph-mon[32421]: pgmap v777: 129 pgs: 129 active+clean; 4.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 18 MiB/s wr, 474 op/s 2024-06-06T03:38:11.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:11 smithi079 ceph-mon[35478]: pgmap v777: 129 pgs: 129 active+clean; 4.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 18 MiB/s wr, 474 op/s 2024-06-06T03:38:11.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:11 smithi122 ceph-mon[35759]: pgmap v777: 129 pgs: 129 active+clean; 4.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 18 MiB/s wr, 474 op/s 2024-06-06T03:38:11.856 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:38:11.856 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T03:38:11.856 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 0, 2024-06-06T03:38:11.856 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 2, 2024-06-06T03:38:11.856 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 0, 2024-06-06T03:38:11.856 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 0, 2024-06-06T03:38:11.856 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 4, 2024-06-06T03:38:11.856 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 0, 2024-06-06T03:38:11.857 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.001515540, 2024-06-06T03:38:11.857 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.000000000, 2024-06-06T03:38:11.857 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.000359687, 2024-06-06T03:38:11.857 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T03:38:11.857 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:11.857 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-06-06T03:38:11.857 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-06-06T03:38:11.857 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-06-06T03:38:11.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:11.857 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:11.857 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-06-06T03:38:11.857 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-06-06T03:38:11.857 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-06-06T03:38:11.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:11.858 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-06T03:38:11.858 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 0 2024-06-06T03:38:11.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:11.858 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T03:38:11.858 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 258, 2024-06-06T03:38:11.858 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 255, 2024-06-06T03:38:11.858 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 489472, 2024-06-06T03:38:11.858 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 157200, 2024-06-06T03:38:11.858 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 2, 2024-06-06T03:38:11.858 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 1, 2024-06-06T03:38:11.858 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.038546178, 2024-06-06T03:38:11.858 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.016589884, 2024-06-06T03:38:11.858 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.015212573, 2024-06-06T03:38:11.859 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.005784727, 2024-06-06T03:38:11.859 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:11.859 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 254, 2024-06-06T03:38:11.859 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.014991214, 2024-06-06T03:38:11.859 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000059020 2024-06-06T03:38:11.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:11.859 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:11.859 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-06-06T03:38:11.859 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-06-06T03:38:11.859 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-06-06T03:38:11.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:11.859 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 489472, 2024-06-06T03:38:11.859 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 157200 2024-06-06T03:38:11.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:11.860 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T03:38:11.860 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 6, 2024-06-06T03:38:11.860 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 197, 2024-06-06T03:38:11.860 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 3312, 2024-06-06T03:38:11.860 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 190672, 2024-06-06T03:38:11.860 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 4, 2024-06-06T03:38:11.860 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 2, 2024-06-06T03:38:11.860 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.016730742, 2024-06-06T03:38:11.860 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.011923556, 2024-06-06T03:38:11.860 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.002234145, 2024-06-06T03:38:11.860 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T03:38:11.860 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:11.860 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 196, 2024-06-06T03:38:11.861 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.011854428, 2024-06-06T03:38:11.861 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000060481 2024-06-06T03:38:11.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:11.861 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:11.861 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-06-06T03:38:11.861 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-06-06T03:38:11.861 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-06-06T03:38:11.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:11.861 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-06-06T03:38:11.861 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 190672 2024-06-06T03:38:11.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:11.861 INFO:teuthology.orchestra.run.smithi050.stdout: "cct": { 2024-06-06T03:38:11.861 INFO:teuthology.orchestra.run.smithi050.stdout: "total_workers": 0, 2024-06-06T03:38:11.861 INFO:teuthology.orchestra.run.smithi050.stdout: "unhealthy_workers": 0 2024-06-06T03:38:11.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:11.862 INFO:teuthology.orchestra.run.smithi050.stdout: "mempool": { 2024-06-06T03:38:11.862 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_bytes": 0, 2024-06-06T03:38:11.862 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_items": 0, 2024-06-06T03:38:11.862 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T03:38:11.862 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_items": 0, 2024-06-06T03:38:11.862 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T03:38:11.862 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_items": 0, 2024-06-06T03:38:11.862 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T03:38:11.862 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T03:38:11.862 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T03:38:11.862 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T03:38:11.862 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T03:38:11.862 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_items": 0, 2024-06-06T03:38:11.863 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T03:38:11.863 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T03:38:11.863 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_bytes": 0, 2024-06-06T03:38:11.863 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_items": 0, 2024-06-06T03:38:11.863 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_bytes": 0, 2024-06-06T03:38:11.863 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_items": 0, 2024-06-06T03:38:11.863 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T03:38:11.863 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T03:38:11.863 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T03:38:11.863 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T03:38:11.863 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T03:38:11.863 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_items": 0, 2024-06-06T03:38:11.863 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_bytes": 0, 2024-06-06T03:38:11.864 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_items": 0, 2024-06-06T03:38:11.864 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T03:38:11.864 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T03:38:11.864 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_bytes": 0, 2024-06-06T03:38:11.864 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_items": 0, 2024-06-06T03:38:11.864 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_bytes": 0, 2024-06-06T03:38:11.864 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_items": 0, 2024-06-06T03:38:11.864 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T03:38:11.865 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_items": 0, 2024-06-06T03:38:11.865 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T03:38:11.865 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_items": 0, 2024-06-06T03:38:11.865 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_bytes": 148704, 2024-06-06T03:38:11.865 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_items": 29, 2024-06-06T03:38:11.865 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_bytes": 0, 2024-06-06T03:38:11.865 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_items": 0, 2024-06-06T03:38:11.865 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bytes": 0, 2024-06-06T03:38:11.865 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_items": 0, 2024-06-06T03:38:11.865 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_bytes": 0, 2024-06-06T03:38:11.865 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_items": 0, 2024-06-06T03:38:11.865 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_bytes": 0, 2024-06-06T03:38:11.865 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_items": 0, 2024-06-06T03:38:11.865 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_bytes": 0, 2024-06-06T03:38:11.866 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_items": 0, 2024-06-06T03:38:11.866 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T03:38:11.866 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_items": 0, 2024-06-06T03:38:11.866 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_bytes": 0, 2024-06-06T03:38:11.866 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_items": 0, 2024-06-06T03:38:11.866 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_bytes": 928, 2024-06-06T03:38:11.866 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_items": 2, 2024-06-06T03:38:11.866 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_bytes": 0, 2024-06-06T03:38:11.866 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_items": 0, 2024-06-06T03:38:11.866 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_bytes": 0, 2024-06-06T03:38:11.866 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_items": 0 2024-06-06T03:38:11.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:11.866 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T03:38:11.866 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-06-06T03:38:11.867 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-06-06T03:38:11.867 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-06-06T03:38:11.867 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 260, 2024-06-06T03:38:11.867 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 453027, 2024-06-06T03:38:11.867 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:11.867 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 260, 2024-06-06T03:38:11.867 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-06-06T03:38:11.867 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-06-06T03:38:11.867 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 260, 2024-06-06T03:38:11.867 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 453027, 2024-06-06T03:38:11.867 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-06-06T03:38:11.867 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-06-06T03:38:11.867 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-06-06T03:38:11.867 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-06-06T03:38:11.868 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:11.868 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:11.868 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:38:12.567 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-06-06T03:38:12.567 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-06-06T03:38:12.567 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-06-06T03:38:12.567 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-06-06T03:38:12.567 DEBUG:tasks.check_counter:Getting stats from d 2024-06-06T03:38:12.568 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph daemon mds.d perf dump 2024-06-06T03:38:12.825 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:38:13.226 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:13 smithi050 ceph-mon[32421]: pgmap v778: 129 pgs: 129 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 9.3 MiB/s wr, 365 op/s 2024-06-06T03:38:13.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:13 smithi079 ceph-mon[35478]: pgmap v778: 129 pgs: 129 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 9.3 MiB/s wr, 365 op/s 2024-06-06T03:38:13.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:13 smithi122 ceph-mon[35759]: pgmap v778: 129 pgs: 129 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 9.3 MiB/s wr, 365 op/s 2024-06-06T03:38:14.605 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:38:14.605 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T03:38:14.605 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 264, 2024-06-06T03:38:14.605 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 261, 2024-06-06T03:38:14.605 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 491104, 2024-06-06T03:38:14.605 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 161040, 2024-06-06T03:38:14.605 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 4, 2024-06-06T03:38:14.606 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 0, 2024-06-06T03:38:14.606 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.038762833, 2024-06-06T03:38:14.606 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.015441522, 2024-06-06T03:38:14.606 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.016093159, 2024-06-06T03:38:14.606 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.005803618, 2024-06-06T03:38:14.606 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:14.606 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 260, 2024-06-06T03:38:14.607 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.012684148, 2024-06-06T03:38:14.607 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000048785 2024-06-06T03:38:14.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:14.607 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:14.607 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-06-06T03:38:14.607 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-06-06T03:38:14.607 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-06-06T03:38:14.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:14.607 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 491104, 2024-06-06T03:38:14.608 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 161040 2024-06-06T03:38:14.608 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:14.608 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T03:38:14.608 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 6, 2024-06-06T03:38:14.608 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 202, 2024-06-06T03:38:14.610 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 3312, 2024-06-06T03:38:14.610 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 191552, 2024-06-06T03:38:14.610 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 4, 2024-06-06T03:38:14.610 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 2, 2024-06-06T03:38:14.610 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.015906174, 2024-06-06T03:38:14.610 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.011705196, 2024-06-06T03:38:14.611 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.001896664, 2024-06-06T03:38:14.611 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T03:38:14.611 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:14.611 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 201, 2024-06-06T03:38:14.611 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.011861540, 2024-06-06T03:38:14.611 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000059012 2024-06-06T03:38:14.611 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:14.611 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:14.611 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-06-06T03:38:14.611 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-06-06T03:38:14.611 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-06-06T03:38:14.612 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:14.612 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-06-06T03:38:14.612 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 191552 2024-06-06T03:38:14.612 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:14.612 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T03:38:14.612 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 0, 2024-06-06T03:38:14.612 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 2, 2024-06-06T03:38:14.612 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 0, 2024-06-06T03:38:14.612 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 0, 2024-06-06T03:38:14.612 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 2, 2024-06-06T03:38:14.612 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 1, 2024-06-06T03:38:14.613 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.000257538, 2024-06-06T03:38:14.613 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.000000000, 2024-06-06T03:38:14.613 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.000189635, 2024-06-06T03:38:14.613 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T03:38:14.613 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:14.613 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-06-06T03:38:14.613 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-06-06T03:38:14.613 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-06-06T03:38:14.614 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:14.614 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:14.614 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-06-06T03:38:14.614 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-06-06T03:38:14.614 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-06-06T03:38:14.614 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:14.614 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-06T03:38:14.614 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 0 2024-06-06T03:38:14.614 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:14.614 INFO:teuthology.orchestra.run.smithi050.stdout: "cct": { 2024-06-06T03:38:14.614 INFO:teuthology.orchestra.run.smithi050.stdout: "total_workers": 0, 2024-06-06T03:38:14.615 INFO:teuthology.orchestra.run.smithi050.stdout: "unhealthy_workers": 0 2024-06-06T03:38:14.615 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:14.615 INFO:teuthology.orchestra.run.smithi050.stdout: "mempool": { 2024-06-06T03:38:14.615 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_bytes": 0, 2024-06-06T03:38:14.615 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_items": 0, 2024-06-06T03:38:14.615 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T03:38:14.615 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_items": 0, 2024-06-06T03:38:14.615 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T03:38:14.615 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_items": 0, 2024-06-06T03:38:14.615 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T03:38:14.616 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T03:38:14.616 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T03:38:14.616 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T03:38:14.616 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T03:38:14.616 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_items": 0, 2024-06-06T03:38:14.616 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T03:38:14.616 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T03:38:14.616 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_bytes": 0, 2024-06-06T03:38:14.616 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_items": 0, 2024-06-06T03:38:14.616 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_bytes": 0, 2024-06-06T03:38:14.616 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_items": 0, 2024-06-06T03:38:14.616 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T03:38:14.616 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T03:38:14.616 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T03:38:14.617 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T03:38:14.617 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T03:38:14.617 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_items": 0, 2024-06-06T03:38:14.617 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_bytes": 0, 2024-06-06T03:38:14.617 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_items": 0, 2024-06-06T03:38:14.617 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T03:38:14.617 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T03:38:14.617 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_bytes": 0, 2024-06-06T03:38:14.617 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_items": 0, 2024-06-06T03:38:14.617 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_bytes": 0, 2024-06-06T03:38:14.617 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_items": 0, 2024-06-06T03:38:14.617 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T03:38:14.617 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_items": 0, 2024-06-06T03:38:14.617 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T03:38:14.618 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_items": 0, 2024-06-06T03:38:14.618 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_bytes": 148704, 2024-06-06T03:38:14.618 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_items": 29, 2024-06-06T03:38:14.618 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_bytes": 0, 2024-06-06T03:38:14.618 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_items": 0, 2024-06-06T03:38:14.618 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bytes": 0, 2024-06-06T03:38:14.618 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_items": 0, 2024-06-06T03:38:14.618 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_bytes": 0, 2024-06-06T03:38:14.618 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_items": 0, 2024-06-06T03:38:14.618 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_bytes": 0, 2024-06-06T03:38:14.618 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_items": 0, 2024-06-06T03:38:14.618 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_bytes": 0, 2024-06-06T03:38:14.618 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_items": 0, 2024-06-06T03:38:14.619 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T03:38:14.619 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_items": 0, 2024-06-06T03:38:14.619 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_bytes": 0, 2024-06-06T03:38:14.619 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_items": 0, 2024-06-06T03:38:14.619 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_bytes": 928, 2024-06-06T03:38:14.619 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_items": 2, 2024-06-06T03:38:14.619 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_bytes": 0, 2024-06-06T03:38:14.619 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_items": 0, 2024-06-06T03:38:14.619 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_bytes": 0, 2024-06-06T03:38:14.619 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_items": 0 2024-06-06T03:38:14.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:14.619 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T03:38:14.619 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-06-06T03:38:14.619 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-06-06T03:38:14.619 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-06-06T03:38:14.620 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 266, 2024-06-06T03:38:14.620 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 453807, 2024-06-06T03:38:14.620 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:14.620 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 266, 2024-06-06T03:38:14.620 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-06-06T03:38:14.620 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-06-06T03:38:14.620 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 266, 2024-06-06T03:38:14.620 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 453807, 2024-06-06T03:38:14.620 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-06-06T03:38:14.620 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-06-06T03:38:14.620 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-06-06T03:38:14.620 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-06-06T03:38:14.620 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:14.621 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:14.621 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:38:15.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:15 smithi050 ceph-mon[32421]: pgmap v779: 129 pgs: 129 active+clean; 698 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 5.0 MiB/s wr, 301 op/s 2024-06-06T03:38:15.347 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-06-06T03:38:15.347 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-06-06T03:38:15.347 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-06-06T03:38:15.348 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-06-06T03:38:15.348 DEBUG:tasks.check_counter:Getting stats from g 2024-06-06T03:38:15.348 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph daemon mds.g perf dump 2024-06-06T03:38:15.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:15 smithi079 ceph-mon[35478]: pgmap v779: 129 pgs: 129 active+clean; 698 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 5.0 MiB/s wr, 301 op/s 2024-06-06T03:38:15.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:15 smithi122 ceph-mon[35759]: pgmap v779: 129 pgs: 129 active+clean; 698 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 5.0 MiB/s wr, 301 op/s 2024-06-06T03:38:15.603 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:38:17.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:17 smithi079 ceph-mon[35478]: pgmap v780: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 2.8 MiB/s wr, 279 op/s 2024-06-06T03:38:17.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:17 smithi122 ceph-mon[35759]: pgmap v780: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 2.8 MiB/s wr, 279 op/s 2024-06-06T03:38:17.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:17 smithi050 ceph-mon[32421]: pgmap v780: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 2.8 MiB/s wr, 279 op/s 2024-06-06T03:38:19.074 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:38:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T03:38:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 261, 2024-06-06T03:38:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 258, 2024-06-06T03:38:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 490288, 2024-06-06T03:38:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 159120, 2024-06-06T03:38:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 4, 2024-06-06T03:38:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 0, 2024-06-06T03:38:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.041977669, 2024-06-06T03:38:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.016742945, 2024-06-06T03:38:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.015142932, 2024-06-06T03:38:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.006167308, 2024-06-06T03:38:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 257, 2024-06-06T03:38:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.013086808, 2024-06-06T03:38:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000050921 2024-06-06T03:38:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-06-06T03:38:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-06-06T03:38:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-06-06T03:38:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 490288, 2024-06-06T03:38:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 159120 2024-06-06T03:38:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T03:38:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 2, 2024-06-06T03:38:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 197, 2024-06-06T03:38:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 320, 2024-06-06T03:38:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 190576, 2024-06-06T03:38:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 4, 2024-06-06T03:38:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 2, 2024-06-06T03:38:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.015549726, 2024-06-06T03:38:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.010974745, 2024-06-06T03:38:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.001656942, 2024-06-06T03:38:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T03:38:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 195, 2024-06-06T03:38:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.020743064, 2024-06-06T03:38:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000106374 2024-06-06T03:38:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-06-06T03:38:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-06-06T03:38:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-06-06T03:38:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-06T03:38:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 190576 2024-06-06T03:38:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T03:38:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 4, 2024-06-06T03:38:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 4, 2024-06-06T03:38:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 2992, 2024-06-06T03:38:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 448, 2024-06-06T03:38:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 2, 2024-06-06T03:38:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 1, 2024-06-06T03:38:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.000864401, 2024-06-06T03:38:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.000038562, 2024-06-06T03:38:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.000809337, 2024-06-06T03:38:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T03:38:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 3, 2024-06-06T03:38:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000769474, 2024-06-06T03:38:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000256491 2024-06-06T03:38:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-06-06T03:38:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-06-06T03:38:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-06-06T03:38:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-06-06T03:38:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 448 2024-06-06T03:38:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: "cct": { 2024-06-06T03:38:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: "total_workers": 0, 2024-06-06T03:38:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "unhealthy_workers": 0 2024-06-06T03:38:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "mempool": { 2024-06-06T03:38:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_bytes": 0, 2024-06-06T03:38:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_items": 0, 2024-06-06T03:38:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T03:38:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_items": 0, 2024-06-06T03:38:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T03:38:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_items": 0, 2024-06-06T03:38:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T03:38:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T03:38:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T03:38:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T03:38:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T03:38:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_items": 0, 2024-06-06T03:38:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T03:38:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T03:38:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_bytes": 0, 2024-06-06T03:38:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_items": 0, 2024-06-06T03:38:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_bytes": 0, 2024-06-06T03:38:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_items": 0, 2024-06-06T03:38:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T03:38:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T03:38:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T03:38:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T03:38:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T03:38:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_items": 0, 2024-06-06T03:38:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_bytes": 0, 2024-06-06T03:38:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_items": 0, 2024-06-06T03:38:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T03:38:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T03:38:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_bytes": 0, 2024-06-06T03:38:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_items": 0, 2024-06-06T03:38:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_bytes": 0, 2024-06-06T03:38:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_items": 0, 2024-06-06T03:38:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T03:38:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_items": 0, 2024-06-06T03:38:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T03:38:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_items": 0, 2024-06-06T03:38:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_bytes": 147920, 2024-06-06T03:38:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_items": 27, 2024-06-06T03:38:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_bytes": 0, 2024-06-06T03:38:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_items": 0, 2024-06-06T03:38:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bytes": 0, 2024-06-06T03:38:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_items": 0, 2024-06-06T03:38:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_bytes": 0, 2024-06-06T03:38:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_items": 0, 2024-06-06T03:38:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_bytes": 0, 2024-06-06T03:38:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_items": 0, 2024-06-06T03:38:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_bytes": 0, 2024-06-06T03:38:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_items": 0, 2024-06-06T03:38:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T03:38:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_items": 0, 2024-06-06T03:38:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_bytes": 0, 2024-06-06T03:38:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_items": 0, 2024-06-06T03:38:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_bytes": 928, 2024-06-06T03:38:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_items": 2, 2024-06-06T03:38:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_bytes": 0, 2024-06-06T03:38:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_items": 0, 2024-06-06T03:38:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_bytes": 0, 2024-06-06T03:38:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_items": 0 2024-06-06T03:38:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T03:38:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-06-06T03:38:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-06-06T03:38:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-06-06T03:38:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 263, 2024-06-06T03:38:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 453417, 2024-06-06T03:38:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 263, 2024-06-06T03:38:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-06-06T03:38:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-06-06T03:38:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 263, 2024-06-06T03:38:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 453417, 2024-06-06T03:38:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-06-06T03:38:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-06-06T03:38:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-06-06T03:38:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-06-06T03:38:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:19.087 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:38:19.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:19 smithi079 ceph-mon[35478]: pgmap v781: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 110 KiB/s wr, 209 op/s 2024-06-06T03:38:19.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:19 smithi122 ceph-mon[35759]: pgmap v781: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 110 KiB/s wr, 209 op/s 2024-06-06T03:38:19.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:19 smithi050 ceph-mon[32421]: pgmap v781: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 110 KiB/s wr, 209 op/s 2024-06-06T03:38:20.173 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-06-06T03:38:20.173 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-06-06T03:38:20.173 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-06-06T03:38:20.173 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-06-06T03:38:20.173 DEBUG:tasks.check_counter:Getting stats from j 2024-06-06T03:38:20.173 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph daemon mds.j perf dump 2024-06-06T03:38:20.432 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:38:21.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:21 smithi079 ceph-mon[35478]: pgmap v782: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.3 KiB/s wr, 198 op/s 2024-06-06T03:38:21.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:21 smithi122 ceph-mon[35759]: pgmap v782: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.3 KiB/s wr, 198 op/s 2024-06-06T03:38:21.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:21 smithi050 ceph-mon[32421]: pgmap v782: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.3 KiB/s wr, 198 op/s 2024-06-06T03:38:22.181 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-06-06T03:38:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T03:38:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 0, 2024-06-06T03:38:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 2, 2024-06-06T03:38:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 0, 2024-06-06T03:38:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 0, 2024-06-06T03:38:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 4, 2024-06-06T03:38:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 0, 2024-06-06T03:38:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.001551128, 2024-06-06T03:38:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.000000000, 2024-06-06T03:38:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.000428116, 2024-06-06T03:38:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T03:38:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-06-06T03:38:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-06-06T03:38:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-06-06T03:38:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-06-06T03:38:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-06-06T03:38:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-06-06T03:38:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-06T03:38:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 0 2024-06-06T03:38:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T03:38:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 2, 2024-06-06T03:38:22.184 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 202, 2024-06-06T03:38:22.184 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 320, 2024-06-06T03:38:22.184 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 191456, 2024-06-06T03:38:22.184 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 4, 2024-06-06T03:38:22.184 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 2, 2024-06-06T03:38:22.184 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.017064438, 2024-06-06T03:38:22.184 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.012701451, 2024-06-06T03:38:22.184 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.001592604, 2024-06-06T03:38:22.184 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T03:38:22.184 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:22.184 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 200, 2024-06-06T03:38:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.011865894, 2024-06-06T03:38:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000059329 2024-06-06T03:38:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-06-06T03:38:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-06-06T03:38:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-06-06T03:38:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-06T03:38:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 191456 2024-06-06T03:38:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T03:38:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 271, 2024-06-06T03:38:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 266, 2024-06-06T03:38:22.186 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 494912, 2024-06-06T03:38:22.186 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 163408, 2024-06-06T03:38:22.186 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 2, 2024-06-06T03:38:22.186 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 1, 2024-06-06T03:38:22.186 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.045047503, 2024-06-06T03:38:22.186 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.015710452, 2024-06-06T03:38:22.186 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.018437895, 2024-06-06T03:38:22.186 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.010989448, 2024-06-06T03:38:22.186 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:22.186 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 266, 2024-06-06T03:38:22.186 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.018175663, 2024-06-06T03:38:22.186 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000068329 2024-06-06T03:38:22.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-06-06T03:38:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-06-06T03:38:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-06-06T03:38:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 494912, 2024-06-06T03:38:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 163408 2024-06-06T03:38:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: "cct": { 2024-06-06T03:38:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: "total_workers": 0, 2024-06-06T03:38:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: "unhealthy_workers": 0 2024-06-06T03:38:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: "mempool": { 2024-06-06T03:38:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_bytes": 0, 2024-06-06T03:38:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_items": 0, 2024-06-06T03:38:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T03:38:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_items": 0, 2024-06-06T03:38:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T03:38:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_items": 0, 2024-06-06T03:38:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T03:38:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T03:38:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T03:38:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T03:38:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T03:38:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_items": 0, 2024-06-06T03:38:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T03:38:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T03:38:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_bytes": 0, 2024-06-06T03:38:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_items": 0, 2024-06-06T03:38:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_bytes": 0, 2024-06-06T03:38:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_items": 0, 2024-06-06T03:38:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T03:38:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T03:38:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T03:38:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T03:38:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T03:38:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_items": 0, 2024-06-06T03:38:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_bytes": 0, 2024-06-06T03:38:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_items": 0, 2024-06-06T03:38:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T03:38:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T03:38:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_bytes": 0, 2024-06-06T03:38:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_items": 0, 2024-06-06T03:38:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_bytes": 0, 2024-06-06T03:38:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_items": 0, 2024-06-06T03:38:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T03:38:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_items": 0, 2024-06-06T03:38:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T03:38:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_items": 0, 2024-06-06T03:38:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_bytes": 148951, 2024-06-06T03:38:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_items": 28, 2024-06-06T03:38:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_bytes": 0, 2024-06-06T03:38:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_items": 0, 2024-06-06T03:38:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bytes": 0, 2024-06-06T03:38:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_items": 0, 2024-06-06T03:38:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_bytes": 0, 2024-06-06T03:38:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_items": 0, 2024-06-06T03:38:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_bytes": 0, 2024-06-06T03:38:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_items": 0, 2024-06-06T03:38:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_bytes": 0, 2024-06-06T03:38:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_items": 0, 2024-06-06T03:38:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T03:38:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_items": 0, 2024-06-06T03:38:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_bytes": 0, 2024-06-06T03:38:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_items": 0, 2024-06-06T03:38:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_bytes": 928, 2024-06-06T03:38:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_items": 2, 2024-06-06T03:38:22.192 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_bytes": 0, 2024-06-06T03:38:22.192 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_items": 0, 2024-06-06T03:38:22.192 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_bytes": 0, 2024-06-06T03:38:22.192 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_items": 0 2024-06-06T03:38:22.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-06-06T03:38:22.192 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T03:38:22.192 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-06-06T03:38:22.192 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-06-06T03:38:22.192 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-06-06T03:38:22.192 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 269, 2024-06-06T03:38:22.192 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 454197, 2024-06-06T03:38:22.193 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:22.193 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 269, 2024-06-06T03:38:22.193 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-06-06T03:38:22.193 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-06-06T03:38:22.193 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 269, 2024-06-06T03:38:22.193 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 454197, 2024-06-06T03:38:22.193 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-06-06T03:38:22.193 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-06-06T03:38:22.193 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-06-06T03:38:22.193 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-06-06T03:38:22.193 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:22.193 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-06-06T03:38:22.193 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-06-06T03:38:22.887 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-06-06T03:38:22.888 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-06-06T03:38:22.888 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-06-06T03:38:22.888 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-06-06T03:38:22.888 DEBUG:tasks.check_counter:Getting stats from b 2024-06-06T03:38:22.888 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph daemon mds.b perf dump 2024-06-06T03:38:23.141 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T03:38:23.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:23 smithi050 ceph-mon[32421]: pgmap v783: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.3 KiB/s wr, 91 op/s 2024-06-06T03:38:23.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:23 smithi050 ceph-mon[32421]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:38:23.262 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:23 smithi079 ceph-mon[35478]: pgmap v783: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.3 KiB/s wr, 91 op/s 2024-06-06T03:38:23.262 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:23 smithi079 ceph-mon[35478]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:38:23.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:23 smithi122 ceph-mon[35759]: pgmap v783: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.3 KiB/s wr, 91 op/s 2024-06-06T03:38:23.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:23 smithi122 ceph-mon[35759]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T03:38:25.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:25 smithi079 ceph-mon[35478]: pgmap v784: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 37 op/s 2024-06-06T03:38:25.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:25 smithi122 ceph-mon[35759]: pgmap v784: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 37 op/s 2024-06-06T03:38:25.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:25 smithi050 ceph-mon[32421]: pgmap v784: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 37 op/s 2024-06-06T03:38:25.846 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-06T03:38:25.847 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T03:38:25.847 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 1879, 2024-06-06T03:38:25.847 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 1881, 2024-06-06T03:38:25.847 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 1524025, 2024-06-06T03:38:25.847 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 597532, 2024-06-06T03:38:25.847 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 6, 2024-06-06T03:38:25.847 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 2, 2024-06-06T03:38:25.847 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.156375358, 2024-06-06T03:38:25.847 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.054356493, 2024-06-06T03:38:25.847 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.036548287, 2024-06-06T03:38:25.847 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.053563786, 2024-06-06T03:38:25.847 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:25.847 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 1879, 2024-06-06T03:38:25.848 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.067415038, 2024-06-06T03:38:25.848 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000035878 2024-06-06T03:38:25.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.848 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:25.848 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.848 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.848 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.848 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-06T03:38:25.848 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 0 2024-06-06T03:38:25.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.848 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T03:38:25.848 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 6, 2024-06-06T03:38:25.848 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 201, 2024-06-06T03:38:25.848 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 1976, 2024-06-06T03:38:25.849 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 498122, 2024-06-06T03:38:25.849 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 6, 2024-06-06T03:38:25.849 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 4, 2024-06-06T03:38:25.849 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.010931760, 2024-06-06T03:38:25.849 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.007497651, 2024-06-06T03:38:25.849 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.001668043, 2024-06-06T03:38:25.849 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.000083854, 2024-06-06T03:38:25.849 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:25.849 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 199, 2024-06-06T03:38:25.849 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.013355317, 2024-06-06T03:38:25.849 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000067112 2024-06-06T03:38:25.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.849 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:25.849 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.850 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.850 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.850 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-06T03:38:25.850 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 496784 2024-06-06T03:38:25.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.850 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T03:38:25.850 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 1174, 2024-06-06T03:38:25.850 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 1156, 2024-06-06T03:38:25.850 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 783427, 2024-06-06T03:38:25.850 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 443133, 2024-06-06T03:38:25.850 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 3, 2024-06-06T03:38:25.850 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 2, 2024-06-06T03:38:25.851 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.103523701, 2024-06-06T03:38:25.851 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.031779527, 2024-06-06T03:38:25.851 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.032252513, 2024-06-06T03:38:25.851 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.034568467, 2024-06-06T03:38:25.851 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:25.851 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 1156, 2024-06-06T03:38:25.851 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.039557802, 2024-06-06T03:38:25.851 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000034219 2024-06-06T03:38:25.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.851 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:25.851 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.851 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.851 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.852 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 564416, 2024-06-06T03:38:25.852 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 160112 2024-06-06T03:38:25.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.852 INFO:teuthology.orchestra.run.smithi079.stdout: "cct": { 2024-06-06T03:38:25.852 INFO:teuthology.orchestra.run.smithi079.stdout: "total_workers": 1, 2024-06-06T03:38:25.852 INFO:teuthology.orchestra.run.smithi079.stdout: "unhealthy_workers": 0 2024-06-06T03:38:25.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.852 INFO:teuthology.orchestra.run.smithi079.stdout: "finisher-MDSRank": { 2024-06-06T03:38:25.852 INFO:teuthology.orchestra.run.smithi079.stdout: "queue_len": 0, 2024-06-06T03:38:25.852 INFO:teuthology.orchestra.run.smithi079.stdout: "complete_latency": { 2024-06-06T03:38:25.852 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 4597, 2024-06-06T03:38:25.852 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.109029796, 2024-06-06T03:38:25.852 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000023717 2024-06-06T03:38:25.852 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-06T03:38:25.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.853 INFO:teuthology.orchestra.run.smithi079.stdout: "finisher-PurgeQueue": { 2024-06-06T03:38:25.853 INFO:teuthology.orchestra.run.smithi079.stdout: "queue_len": 0, 2024-06-06T03:38:25.853 INFO:teuthology.orchestra.run.smithi079.stdout: "complete_latency": { 2024-06-06T03:38:25.853 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.853 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.853 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.853 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-06T03:38:25.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.853 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2024-06-06T03:38:25.853 INFO:teuthology.orchestra.run.smithi079.stdout: "request": 0, 2024-06-06T03:38:25.853 INFO:teuthology.orchestra.run.smithi079.stdout: "reply": 0, 2024-06-06T03:38:25.853 INFO:teuthology.orchestra.run.smithi079.stdout: "reply_latency": { 2024-06-06T03:38:25.853 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.853 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.854 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.854 INFO:teuthology.orchestra.run.smithi079.stdout: "slow_reply": 0, 2024-06-06T03:38:25.854 INFO:teuthology.orchestra.run.smithi079.stdout: "forward": 0, 2024-06-06T03:38:25.854 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_fetch_complete": 0, 2024-06-06T03:38:25.854 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_fetch_keys": 0, 2024-06-06T03:38:25.854 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_commit": 0, 2024-06-06T03:38:25.854 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_split": 0, 2024-06-06T03:38:25.854 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_merge": 0, 2024-06-06T03:38:25.854 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes": 16, 2024-06-06T03:38:25.854 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_top": 4, 2024-06-06T03:38:25.854 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_bottom": 12, 2024-06-06T03:38:25.855 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_pin_tail": 0, 2024-06-06T03:38:25.855 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_pinned": 9, 2024-06-06T03:38:25.855 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_expired": 0, 2024-06-06T03:38:25.855 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_with_caps": 0, 2024-06-06T03:38:25.855 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": 0, 2024-06-06T03:38:25.855 INFO:teuthology.orchestra.run.smithi079.stdout: "subtrees": 2, 2024-06-06T03:38:25.855 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse": 0, 2024-06-06T03:38:25.855 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_hit": 0, 2024-06-06T03:38:25.855 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_forward": 0, 2024-06-06T03:38:25.855 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_discover": 0, 2024-06-06T03:38:25.855 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_dir_fetch": 0, 2024-06-06T03:38:25.855 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_remote_ino": 0, 2024-06-06T03:38:25.855 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_lock": 0, 2024-06-06T03:38:25.855 INFO:teuthology.orchestra.run.smithi079.stdout: "load_cent": 0, 2024-06-06T03:38:25.855 INFO:teuthology.orchestra.run.smithi079.stdout: "q": 0, 2024-06-06T03:38:25.856 INFO:teuthology.orchestra.run.smithi079.stdout: "exported": 0, 2024-06-06T03:38:25.856 INFO:teuthology.orchestra.run.smithi079.stdout: "exported_inodes": 0, 2024-06-06T03:38:25.856 INFO:teuthology.orchestra.run.smithi079.stdout: "imported": 0, 2024-06-06T03:38:25.856 INFO:teuthology.orchestra.run.smithi079.stdout: "imported_inodes": 0, 2024-06-06T03:38:25.856 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_dir_fetch": 0, 2024-06-06T03:38:25.856 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_backtrace_fetch": 0, 2024-06-06T03:38:25.856 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_peer_discover": 0, 2024-06-06T03:38:25.856 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rfiles": 4, 2024-06-06T03:38:25.856 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rbytes": 234, 2024-06-06T03:38:25.856 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rsnaps": 0, 2024-06-06T03:38:25.856 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_backtrace_fetch": 0, 2024-06-06T03:38:25.856 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_set_tag": 0, 2024-06-06T03:38:25.857 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_backtrace_repaired": 0, 2024-06-06T03:38:25.857 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_inotable_repaired": 0, 2024-06-06T03:38:25.857 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dir_inodes": 0, 2024-06-06T03:38:25.857 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dir_base_inodes": 0, 2024-06-06T03:38:25.857 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dirfrag_rstats": 0, 2024-06-06T03:38:25.857 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_file_inodes": 0, 2024-06-06T03:38:25.857 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_inode_file_caps": 0, 2024-06-06T03:38:25.857 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_revoke": 0, 2024-06-06T03:38:25.857 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_grant": 0, 2024-06-06T03:38:25.857 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_trunc": 0, 2024-06-06T03:38:25.857 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-06T03:38:25.857 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-06T03:38:25.857 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_caps": 0, 2024-06-06T03:38:25.858 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_caps_dirty": 0, 2024-06-06T03:38:25.858 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_cap_release": 0, 2024-06-06T03:38:25.858 INFO:teuthology.orchestra.run.smithi079.stdout: "process_request_cap_release": 0 2024-06-06T03:38:25.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.858 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cache": { 2024-06-06T03:38:25.858 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_update": 0, 2024-06-06T03:38:25.858 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_update_receipt": 0, 2024-06-06T03:38:25.858 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_try_discover": 0, 2024-06-06T03:38:25.858 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_send_discover": 0, 2024-06-06T03:38:25.858 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_handle_discover": 0, 2024-06-06T03:38:25.858 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays": 0, 2024-06-06T03:38:25.858 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays_delayed": 0, 2024-06-06T03:38:25.858 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays_enqueuing": 0, 2024-06-06T03:38:25.858 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_created": 0, 2024-06-06T03:38:25.859 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_enqueued": 0, 2024-06-06T03:38:25.859 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_reintegrated": 0, 2024-06-06T03:38:25.859 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_migrated": 0, 2024-06-06T03:38:25.859 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_processing": 0, 2024-06-06T03:38:25.859 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_enqueued": 0, 2024-06-06T03:38:25.859 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_prioritized": 0, 2024-06-06T03:38:25.859 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_started": 0, 2024-06-06T03:38:25.859 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_completed": 0, 2024-06-06T03:38:25.859 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_quiesce_path": 0, 2024-06-06T03:38:25.859 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_quiesce_inode": 0, 2024-06-06T03:38:25.859 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_enqueue_scrub": 0, 2024-06-06T03:38:25.859 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_exportdir": 0, 2024-06-06T03:38:25.859 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_flush": 0, 2024-06-06T03:38:25.860 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_fragmentdir": 0, 2024-06-06T03:38:25.860 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_fragstats": 0, 2024-06-06T03:38:25.860 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_inodestats": 0 2024-06-06T03:38:25.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.860 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_log": { 2024-06-06T03:38:25.860 INFO:teuthology.orchestra.run.smithi079.stdout: "evlrg": 0, 2024-06-06T03:38:25.860 INFO:teuthology.orchestra.run.smithi079.stdout: "evadd": 0, 2024-06-06T03:38:25.860 INFO:teuthology.orchestra.run.smithi079.stdout: "evex": 0, 2024-06-06T03:38:25.860 INFO:teuthology.orchestra.run.smithi079.stdout: "evtrm": 0, 2024-06-06T03:38:25.860 INFO:teuthology.orchestra.run.smithi079.stdout: "ev": 274, 2024-06-06T03:38:25.860 INFO:teuthology.orchestra.run.smithi079.stdout: "evexg": 0, 2024-06-06T03:38:25.860 INFO:teuthology.orchestra.run.smithi079.stdout: "evexd": 0, 2024-06-06T03:38:25.860 INFO:teuthology.orchestra.run.smithi079.stdout: "segadd": 0, 2024-06-06T03:38:25.860 INFO:teuthology.orchestra.run.smithi079.stdout: "segex": 0, 2024-06-06T03:38:25.860 INFO:teuthology.orchestra.run.smithi079.stdout: "segtrm": 0, 2024-06-06T03:38:25.861 INFO:teuthology.orchestra.run.smithi079.stdout: "seg": 2, 2024-06-06T03:38:25.861 INFO:teuthology.orchestra.run.smithi079.stdout: "segmjr": 53, 2024-06-06T03:38:25.861 INFO:teuthology.orchestra.run.smithi079.stdout: "segexg": 0, 2024-06-06T03:38:25.861 INFO:teuthology.orchestra.run.smithi079.stdout: "segexd": 0, 2024-06-06T03:38:25.861 INFO:teuthology.orchestra.run.smithi079.stdout: "expos": 5133361, 2024-06-06T03:38:25.861 INFO:teuthology.orchestra.run.smithi079.stdout: "wrpos": 5161240, 2024-06-06T03:38:25.861 INFO:teuthology.orchestra.run.smithi079.stdout: "rdpos": 5156939, 2024-06-06T03:38:25.861 INFO:teuthology.orchestra.run.smithi079.stdout: "jlat": { 2024-06-06T03:38:25.861 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.861 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.861 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.861 INFO:teuthology.orchestra.run.smithi079.stdout: "replayed": 274 2024-06-06T03:38:25.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.862 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_mem": { 2024-06-06T03:38:25.862 INFO:teuthology.orchestra.run.smithi079.stdout: "ino": 14, 2024-06-06T03:38:25.862 INFO:teuthology.orchestra.run.smithi079.stdout: "ino+": 36, 2024-06-06T03:38:25.862 INFO:teuthology.orchestra.run.smithi079.stdout: "ino-": 22, 2024-06-06T03:38:25.862 INFO:teuthology.orchestra.run.smithi079.stdout: "dir": 9, 2024-06-06T03:38:25.862 INFO:teuthology.orchestra.run.smithi079.stdout: "dir+": 13, 2024-06-06T03:38:25.862 INFO:teuthology.orchestra.run.smithi079.stdout: "dir-": 4, 2024-06-06T03:38:25.862 INFO:teuthology.orchestra.run.smithi079.stdout: "dn": 16, 2024-06-06T03:38:25.862 INFO:teuthology.orchestra.run.smithi079.stdout: "dn+": 38, 2024-06-06T03:38:25.862 INFO:teuthology.orchestra.run.smithi079.stdout: "dn-": 22, 2024-06-06T03:38:25.862 INFO:teuthology.orchestra.run.smithi079.stdout: "cap": 0, 2024-06-06T03:38:25.862 INFO:teuthology.orchestra.run.smithi079.stdout: "cap+": 0, 2024-06-06T03:38:25.862 INFO:teuthology.orchestra.run.smithi079.stdout: "cap-": 0, 2024-06-06T03:38:25.863 INFO:teuthology.orchestra.run.smithi079.stdout: "rss": 51700, 2024-06-06T03:38:25.863 INFO:teuthology.orchestra.run.smithi079.stdout: "heap": 215420 2024-06-06T03:38:25.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.863 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_server": { 2024-06-06T03:38:25.863 INFO:teuthology.orchestra.run.smithi079.stdout: "dispatch_client_request": 0, 2024-06-06T03:38:25.863 INFO:teuthology.orchestra.run.smithi079.stdout: "dispatch_server_request": 0, 2024-06-06T03:38:25.863 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_request": 0, 2024-06-06T03:38:25.863 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_session": 0, 2024-06-06T03:38:25.863 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_peer_request": 0, 2024-06-06T03:38:25.863 INFO:teuthology.orchestra.run.smithi079.stdout: "req_create_latency": { 2024-06-06T03:38:25.863 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.863 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.863 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.863 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getattr_latency": { 2024-06-06T03:38:25.864 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.864 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.864 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.864 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getfilelock_latency": { 2024-06-06T03:38:25.864 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.864 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.864 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.864 INFO:teuthology.orchestra.run.smithi079.stdout: "req_link_latency": { 2024-06-06T03:38:25.864 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.864 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.864 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.864 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookup_latency": { 2024-06-06T03:38:25.865 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.865 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.865 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.865 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookuphash_latency": { 2024-06-06T03:38:25.865 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.865 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.865 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.865 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupino_latency": { 2024-06-06T03:38:25.865 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.865 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.865 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.866 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupname_latency": { 2024-06-06T03:38:25.866 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.866 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.866 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.866 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupparent_latency": { 2024-06-06T03:38:25.866 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.866 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.866 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.866 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupsnap_latency": { 2024-06-06T03:38:25.866 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.866 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.867 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.867 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lssnap_latency": { 2024-06-06T03:38:25.867 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.867 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.867 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.867 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mkdir_latency": { 2024-06-06T03:38:25.867 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.867 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.867 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.867 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mknod_latency": { 2024-06-06T03:38:25.868 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.868 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.868 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.868 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mksnap_latency": { 2024-06-06T03:38:25.868 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.868 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.868 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.868 INFO:teuthology.orchestra.run.smithi079.stdout: "req_open_latency": { 2024-06-06T03:38:25.868 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.868 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.868 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "req_readdir_latency": { 2024-06-06T03:38:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rename_latency": { 2024-06-06T03:38:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "req_renamesnap_latency": { 2024-06-06T03:38:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: "req_snapdiff_latency": { 2024-06-06T03:38:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmdir_latency": { 2024-06-06T03:38:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmsnap_latency": { 2024-06-06T03:38:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmxattr_latency": { 2024-06-06T03:38:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setattr_latency": { 2024-06-06T03:38:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setdirlayout_latency": { 2024-06-06T03:38:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setfilelock_latency": { 2024-06-06T03:38:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setlayout_latency": { 2024-06-06T03:38:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setxattr_latency": { 2024-06-06T03:38:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: "req_symlink_latency": { 2024-06-06T03:38:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: "req_unlink_latency": { 2024-06-06T03:38:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: "cap_revoke_eviction": 0, 2024-06-06T03:38:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: "cap_acquisition_throttle": 0, 2024-06-06T03:38:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getvxattr_latency": { 2024-06-06T03:38:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-06T03:38:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_sessions": { 2024-06-06T03:38:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: "session_count": 1, 2024-06-06T03:38:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: "session_add": 3, 2024-06-06T03:38:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: "session_remove": 2, 2024-06-06T03:38:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: "sessions_open": 1, 2024-06-06T03:38:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: "sessions_stale": 0, 2024-06-06T03:38:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: "total_load": 0, 2024-06-06T03:38:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: "average_load": 0, 2024-06-06T03:38:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: "avg_session_uptime": 1947, 2024-06-06T03:38:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: "mdthresh_evicted": 0 2024-06-06T03:38:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: "mempool": { 2024-06-06T03:38:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_bytes": 0, 2024-06-06T03:38:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_items": 0, 2024-06-06T03:38:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T03:38:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_items": 0, 2024-06-06T03:38:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T03:38:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_items": 0, 2024-06-06T03:38:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T03:38:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T03:38:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T03:38:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T03:38:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T03:38:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_items": 0, 2024-06-06T03:38:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T03:38:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T03:38:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_bytes": 0, 2024-06-06T03:38:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_items": 0, 2024-06-06T03:38:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_bytes": 0, 2024-06-06T03:38:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_items": 0, 2024-06-06T03:38:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T03:38:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T03:38:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T03:38:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T03:38:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T03:38:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_items": 0, 2024-06-06T03:38:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_bytes": 0, 2024-06-06T03:38:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_items": 0, 2024-06-06T03:38:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T03:38:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T03:38:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_bytes": 0, 2024-06-06T03:38:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_items": 0, 2024-06-06T03:38:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_bytes": 0, 2024-06-06T03:38:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_items": 0, 2024-06-06T03:38:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T03:38:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_items": 0, 2024-06-06T03:38:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T03:38:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_items": 0, 2024-06-06T03:38:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_bytes": 189424, 2024-06-06T03:38:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_items": 51, 2024-06-06T03:38:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_bytes": 0, 2024-06-06T03:38:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_items": 0, 2024-06-06T03:38:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_bytes": 0, 2024-06-06T03:38:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_items": 0, 2024-06-06T03:38:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_bytes": 0, 2024-06-06T03:38:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_items": 0, 2024-06-06T03:38:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_bytes": 0, 2024-06-06T03:38:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_items": 0, 2024-06-06T03:38:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_bytes": 8792, 2024-06-06T03:38:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_items": 168, 2024-06-06T03:38:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T03:38:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_items": 0, 2024-06-06T03:38:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_bytes": 0, 2024-06-06T03:38:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_items": 0, 2024-06-06T03:38:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_bytes": 54050, 2024-06-06T03:38:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_items": 257, 2024-06-06T03:38:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_bytes": 0, 2024-06-06T03:38:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_items": 0, 2024-06-06T03:38:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_bytes": 0, 2024-06-06T03:38:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_items": 0 2024-06-06T03:38:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "objecter": { 2024-06-06T03:38:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: "op_active": 0, 2024-06-06T03:38:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: "op_laggy": 0, 2024-06-06T03:38:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: "op_send": 2773, 2024-06-06T03:38:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: "op_send_bytes": 26, 2024-06-06T03:38:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: "op_resend": 4, 2024-06-06T03:38:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: "op_reply": 2773, 2024-06-06T03:38:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: "op_latency": { 2024-06-06T03:38:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 2773, 2024-06-06T03:38:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 1.341969268, 2024-06-06T03:38:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000483941 2024-06-06T03:38:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: "op_inflight": 0, 2024-06-06T03:38:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: "oplen_avg": { 2024-06-06T03:38:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 2773, 2024-06-06T03:38:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 2774 2024-06-06T03:38:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "op": 2773, 2024-06-06T03:38:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "op_r": 2773, 2024-06-06T03:38:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "op_w": 0, 2024-06-06T03:38:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "op_rmw": 0, 2024-06-06T03:38:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "op_pg": 0, 2024-06-06T03:38:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_stat": 1778, 2024-06-06T03:38:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_create": 0, 2024-06-06T03:38:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_read": 992, 2024-06-06T03:38:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_write": 0, 2024-06-06T03:38:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_writefull": 0, 2024-06-06T03:38:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_writesame": 0, 2024-06-06T03:38:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_append": 0, 2024-06-06T03:38:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_zero": 0, 2024-06-06T03:38:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_truncate": 0, 2024-06-06T03:38:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_delete": 0, 2024-06-06T03:38:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_mapext": 0, 2024-06-06T03:38:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_sparse_read": 0, 2024-06-06T03:38:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_clonerange": 0, 2024-06-06T03:38:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_getxattr": 2, 2024-06-06T03:38:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_setxattr": 0, 2024-06-06T03:38:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_cmpxattr": 0, 2024-06-06T03:38:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_rmxattr": 0, 2024-06-06T03:38:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_resetxattrs": 0, 2024-06-06T03:38:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_call": 0, 2024-06-06T03:38:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_watch": 0, 2024-06-06T03:38:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_notify": 0, 2024-06-06T03:38:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_src_cmpxattr": 0, 2024-06-06T03:38:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_pgls": 0, 2024-06-06T03:38:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_pgls_filter": 0, 2024-06-06T03:38:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_other": 0, 2024-06-06T03:38:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_active": 0, 2024-06-06T03:38:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_send": 0, 2024-06-06T03:38:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_resend": 0, 2024-06-06T03:38:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_ping": 0, 2024-06-06T03:38:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_active": 0, 2024-06-06T03:38:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_send": 0, 2024-06-06T03:38:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_resend": 0, 2024-06-06T03:38:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_active": 0, 2024-06-06T03:38:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_send": 0, 2024-06-06T03:38:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_resend": 0, 2024-06-06T03:38:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_active": 0, 2024-06-06T03:38:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_send": 0, 2024-06-06T03:38:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_resend": 0, 2024-06-06T03:38:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "command_active": 0, 2024-06-06T03:38:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "command_send": 0, 2024-06-06T03:38:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "command_resend": 0, 2024-06-06T03:38:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "map_epoch": 99, 2024-06-06T03:38:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "map_full": 0, 2024-06-06T03:38:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "map_inc": 2, 2024-06-06T03:38:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_sessions": 5, 2024-06-06T03:38:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_session_open": 5, 2024-06-06T03:38:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_session_close": 0, 2024-06-06T03:38:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_laggy": 0, 2024-06-06T03:38:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_wr": 0, 2024-06-06T03:38:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_rd": 2, 2024-06-06T03:38:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_del": 0 2024-06-06T03:38:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: "oft": { 2024-06-06T03:38:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_objs": 0, 2024-06-06T03:38:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_kv_pairs": 0, 2024-06-06T03:38:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_updates": 0, 2024-06-06T03:38:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_removes": 0 2024-06-06T03:38:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: "osd-slow-ops": { 2024-06-06T03:38:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: "slow_ops_count": 0 2024-06-06T03:38:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: "purge_queue": { 2024-06-06T03:38:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_ops": 0, 2024-06-06T03:38:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_ops_high_water": 0, 2024-06-06T03:38:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing": 0, 2024-06-06T03:38:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_high_water": 0, 2024-06-06T03:38:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executed_ops": 0, 2024-06-06T03:38:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executed": 0, 2024-06-06T03:38:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_item_in_journal": 0 2024-06-06T03:38:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T03:38:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-06-06T03:38:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 104857600, 2024-06-06T03:38:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-06-06T03:38:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 3055, 2024-06-06T03:38:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 2017106, 2024-06-06T03:38:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 3055, 2024-06-06T03:38:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2024-06-06T03:38:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2024-06-06T03:38:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 3055, 2024-06-06T03:38:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 2017106, 2024-06-06T03:38:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-06-06T03:38:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-06T03:38:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-objecter_bytes": { 2024-06-06T03:38:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-06-06T03:38:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 104857600, 2024-06-06T03:38:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-06-06T03:38:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2024-06-06T03:38:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2024-06-06T03:38:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2024-06-06T03:38:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 2773, 2024-06-06T03:38:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 966946, 2024-06-06T03:38:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 2773, 2024-06-06T03:38:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 966946, 2024-06-06T03:38:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-06-06T03:38:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-06T03:38:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-objecter_ops": { 2024-06-06T03:38:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-06-06T03:38:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 1024, 2024-06-06T03:38:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-06-06T03:38:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2024-06-06T03:38:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2024-06-06T03:38:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2024-06-06T03:38:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 2773, 2024-06-06T03:38:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 2773, 2024-06-06T03:38:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 2773, 2024-06-06T03:38:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 2773, 2024-06-06T03:38:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-06-06T03:38:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-06T03:38:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-write_buf_throttle": { 2024-06-06T03:38:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-06-06T03:38:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 3758096384, 2024-06-06T03:38:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-06-06T03:38:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2024-06-06T03:38:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2024-06-06T03:38:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2024-06-06T03:38:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2024-06-06T03:38:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2024-06-06T03:38:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 0, 2024-06-06T03:38:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 0, 2024-06-06T03:38:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-06-06T03:38:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-06T03:38:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-write_buf_throttle-0x55c10d8826e0": { 2024-06-06T03:38:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-06-06T03:38:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 3758096384, 2024-06-06T03:38:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-06-06T03:38:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2024-06-06T03:38:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2024-06-06T03:38:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2024-06-06T03:38:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2024-06-06T03:38:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2024-06-06T03:38:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 0, 2024-06-06T03:38:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 0, 2024-06-06T03:38:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-06-06T03:38:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:25.893 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-06T03:38:25.893 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-06T03:38:25.893 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-06T03:38:26.732 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-06-06T03:38:26.732 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-06-06T03:38:26.732 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=0 2024-06-06T03:38:26.732 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2024-06-06T03:38:26.732 DEBUG:tasks.check_counter:Getting stats from e 2024-06-06T03:38:26.732 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph daemon mds.e perf dump 2024-06-06T03:38:26.973 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T03:38:27.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:27 smithi079 ceph-mon[35478]: pgmap v785: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 22 op/s 2024-06-06T03:38:27.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:27 smithi122 ceph-mon[35759]: pgmap v785: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 22 op/s 2024-06-06T03:38:27.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:27 smithi050 ceph-mon[32421]: pgmap v785: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 22 op/s 2024-06-06T03:38:28.823 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-06T03:38:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T03:38:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 267, 2024-06-06T03:38:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 264, 2024-06-06T03:38:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 491920, 2024-06-06T03:38:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 162960, 2024-06-06T03:38:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 4, 2024-06-06T03:38:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 0, 2024-06-06T03:38:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.036275753, 2024-06-06T03:38:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.013528141, 2024-06-06T03:38:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.015379659, 2024-06-06T03:38:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.006079987, 2024-06-06T03:38:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 263, 2024-06-06T03:38:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.014983727, 2024-06-06T03:38:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000056972 2024-06-06T03:38:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 491920, 2024-06-06T03:38:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 162960 2024-06-06T03:38:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T03:38:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 6, 2024-06-06T03:38:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 204, 2024-06-06T03:38:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 3312, 2024-06-06T03:38:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 191904, 2024-06-06T03:38:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 4, 2024-06-06T03:38:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 2, 2024-06-06T03:38:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.010956560, 2024-06-06T03:38:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.007679819, 2024-06-06T03:38:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.001367738, 2024-06-06T03:38:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T03:38:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 203, 2024-06-06T03:38:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.014228251, 2024-06-06T03:38:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000070089 2024-06-06T03:38:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-06-06T03:38:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 191904 2024-06-06T03:38:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T03:38:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 0, 2024-06-06T03:38:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 2, 2024-06-06T03:38:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 0, 2024-06-06T03:38:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 0, 2024-06-06T03:38:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 2, 2024-06-06T03:38:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 1, 2024-06-06T03:38:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.000305754, 2024-06-06T03:38:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.000000000, 2024-06-06T03:38:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.000244236, 2024-06-06T03:38:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T03:38:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-06T03:38:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 0 2024-06-06T03:38:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: "cct": { 2024-06-06T03:38:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: "total_workers": 0, 2024-06-06T03:38:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: "unhealthy_workers": 0 2024-06-06T03:38:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: "mempool": { 2024-06-06T03:38:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_bytes": 0, 2024-06-06T03:38:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_items": 0, 2024-06-06T03:38:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T03:38:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_items": 0, 2024-06-06T03:38:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T03:38:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_items": 0, 2024-06-06T03:38:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T03:38:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T03:38:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T03:38:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T03:38:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T03:38:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_items": 0, 2024-06-06T03:38:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T03:38:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T03:38:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_bytes": 0, 2024-06-06T03:38:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_items": 0, 2024-06-06T03:38:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_bytes": 0, 2024-06-06T03:38:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_items": 0, 2024-06-06T03:38:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T03:38:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T03:38:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T03:38:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T03:38:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T03:38:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_items": 0, 2024-06-06T03:38:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_bytes": 0, 2024-06-06T03:38:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_items": 0, 2024-06-06T03:38:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T03:38:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T03:38:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_bytes": 0, 2024-06-06T03:38:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_items": 0, 2024-06-06T03:38:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_bytes": 0, 2024-06-06T03:38:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_items": 0, 2024-06-06T03:38:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T03:38:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_items": 0, 2024-06-06T03:38:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T03:38:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_items": 0, 2024-06-06T03:38:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_bytes": 147937, 2024-06-06T03:38:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_items": 28, 2024-06-06T03:38:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_bytes": 0, 2024-06-06T03:38:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_items": 0, 2024-06-06T03:38:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_bytes": 0, 2024-06-06T03:38:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_items": 0, 2024-06-06T03:38:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_bytes": 0, 2024-06-06T03:38:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_items": 0, 2024-06-06T03:38:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_bytes": 0, 2024-06-06T03:38:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_items": 0, 2024-06-06T03:38:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_bytes": 0, 2024-06-06T03:38:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_items": 0, 2024-06-06T03:38:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T03:38:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_items": 0, 2024-06-06T03:38:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_bytes": 0, 2024-06-06T03:38:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_items": 0, 2024-06-06T03:38:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_bytes": 928, 2024-06-06T03:38:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_items": 2, 2024-06-06T03:38:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_bytes": 0, 2024-06-06T03:38:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_items": 0, 2024-06-06T03:38:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_bytes": 0, 2024-06-06T03:38:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_items": 0 2024-06-06T03:38:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T03:38:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-06-06T03:38:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 104857600, 2024-06-06T03:38:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-06-06T03:38:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 269, 2024-06-06T03:38:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 454197, 2024-06-06T03:38:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 269, 2024-06-06T03:38:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2024-06-06T03:38:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2024-06-06T03:38:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 269, 2024-06-06T03:38:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 454197, 2024-06-06T03:38:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-06-06T03:38:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-06T03:38:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-06T03:38:28.835 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-06T03:38:29.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:29 smithi079 ceph-mon[35478]: pgmap v786: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:38:29.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:29 smithi122 ceph-mon[35759]: pgmap v786: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:38:29.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:29 smithi050 ceph-mon[32421]: pgmap v786: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:38:29.627 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.e 2024-06-06T03:38:29.627 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.e 2024-06-06T03:38:29.627 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.e 2024-06-06T03:38:29.627 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.e 2024-06-06T03:38:29.628 DEBUG:tasks.check_counter:Getting stats from h 2024-06-06T03:38:29.628 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph daemon mds.h perf dump 2024-06-06T03:38:29.871 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T03:38:31.305 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:31 smithi079 ceph-mon[35478]: pgmap v787: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-06-06T03:38:31.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:31 smithi122 ceph-mon[35759]: pgmap v787: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-06-06T03:38:31.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:31 smithi050 ceph-mon[32421]: pgmap v787: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-06-06T03:38:31.569 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-06T03:38:31.569 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T03:38:31.569 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 1180, 2024-06-06T03:38:31.570 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 1164, 2024-06-06T03:38:31.570 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 863680, 2024-06-06T03:38:31.570 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 447474, 2024-06-06T03:38:31.570 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 5, 2024-06-06T03:38:31.570 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 1, 2024-06-06T03:38:31.570 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.126870225, 2024-06-06T03:38:31.570 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.047739647, 2024-06-06T03:38:31.570 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.038096842, 2024-06-06T03:38:31.570 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.032697773, 2024-06-06T03:38:31.570 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:31.570 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 1163, 2024-06-06T03:38:31.570 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.052658514, 2024-06-06T03:38:31.570 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000045278 2024-06-06T03:38:31.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.571 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:31.571 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.571 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.571 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.571 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 562960, 2024-06-06T03:38:31.571 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 162864 2024-06-06T03:38:31.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.571 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T03:38:31.571 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 8, 2024-06-06T03:38:31.571 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 205, 2024-06-06T03:38:31.571 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 3868, 2024-06-06T03:38:31.572 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 500250, 2024-06-06T03:38:31.572 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 5, 2024-06-06T03:38:31.572 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 3, 2024-06-06T03:38:31.572 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.011433521, 2024-06-06T03:38:31.572 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.007826339, 2024-06-06T03:38:31.572 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.001897339, 2024-06-06T03:38:31.572 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.000062203, 2024-06-06T03:38:31.572 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:31.572 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 204, 2024-06-06T03:38:31.572 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.012827180, 2024-06-06T03:38:31.572 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000062878 2024-06-06T03:38:31.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.572 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:31.573 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.573 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.573 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.573 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-06-06T03:38:31.573 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 499552 2024-06-06T03:38:31.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.573 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T03:38:31.573 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 1637, 2024-06-06T03:38:31.573 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 1639, 2024-06-06T03:38:31.573 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 558243, 2024-06-06T03:38:31.573 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 520573, 2024-06-06T03:38:31.573 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 4, 2024-06-06T03:38:31.574 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 3, 2024-06-06T03:38:31.574 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.092565982, 2024-06-06T03:38:31.574 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.021702960, 2024-06-06T03:38:31.574 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.024692955, 2024-06-06T03:38:31.574 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.040735343, 2024-06-06T03:38:31.574 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:31.574 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 1637, 2024-06-06T03:38:31.574 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.049703268, 2024-06-06T03:38:31.574 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000030362 2024-06-06T03:38:31.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.574 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:31.574 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.575 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.575 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.575 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-06T03:38:31.575 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 0 2024-06-06T03:38:31.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.575 INFO:teuthology.orchestra.run.smithi079.stdout: "cct": { 2024-06-06T03:38:31.575 INFO:teuthology.orchestra.run.smithi079.stdout: "total_workers": 1, 2024-06-06T03:38:31.575 INFO:teuthology.orchestra.run.smithi079.stdout: "unhealthy_workers": 0 2024-06-06T03:38:31.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.575 INFO:teuthology.orchestra.run.smithi079.stdout: "finisher-MDSRank": { 2024-06-06T03:38:31.575 INFO:teuthology.orchestra.run.smithi079.stdout: "queue_len": 0, 2024-06-06T03:38:31.575 INFO:teuthology.orchestra.run.smithi079.stdout: "complete_latency": { 2024-06-06T03:38:31.575 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 4310, 2024-06-06T03:38:31.576 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.100220624, 2024-06-06T03:38:31.576 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000023253 2024-06-06T03:38:31.576 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-06T03:38:31.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.576 INFO:teuthology.orchestra.run.smithi079.stdout: "finisher-PurgeQueue": { 2024-06-06T03:38:31.576 INFO:teuthology.orchestra.run.smithi079.stdout: "queue_len": 0, 2024-06-06T03:38:31.576 INFO:teuthology.orchestra.run.smithi079.stdout: "complete_latency": { 2024-06-06T03:38:31.576 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.576 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.576 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.576 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-06T03:38:31.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.576 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2024-06-06T03:38:31.577 INFO:teuthology.orchestra.run.smithi079.stdout: "request": 0, 2024-06-06T03:38:31.577 INFO:teuthology.orchestra.run.smithi079.stdout: "reply": 0, 2024-06-06T03:38:31.577 INFO:teuthology.orchestra.run.smithi079.stdout: "reply_latency": { 2024-06-06T03:38:31.577 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.577 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.577 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.577 INFO:teuthology.orchestra.run.smithi079.stdout: "slow_reply": 0, 2024-06-06T03:38:31.577 INFO:teuthology.orchestra.run.smithi079.stdout: "forward": 0, 2024-06-06T03:38:31.577 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_fetch_complete": 0, 2024-06-06T03:38:31.577 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_fetch_keys": 0, 2024-06-06T03:38:31.577 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_commit": 0, 2024-06-06T03:38:31.577 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_split": 0, 2024-06-06T03:38:31.578 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_merge": 0, 2024-06-06T03:38:31.578 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes": 37, 2024-06-06T03:38:31.578 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_top": 0, 2024-06-06T03:38:31.578 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_bottom": 37, 2024-06-06T03:38:31.578 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_pin_tail": 0, 2024-06-06T03:38:31.578 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_pinned": 37, 2024-06-06T03:38:31.578 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_expired": 0, 2024-06-06T03:38:31.578 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_with_caps": 0, 2024-06-06T03:38:31.578 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": 0, 2024-06-06T03:38:31.578 INFO:teuthology.orchestra.run.smithi079.stdout: "subtrees": 1, 2024-06-06T03:38:31.578 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse": 0, 2024-06-06T03:38:31.578 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_hit": 0, 2024-06-06T03:38:31.578 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_forward": 0, 2024-06-06T03:38:31.579 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_discover": 0, 2024-06-06T03:38:31.579 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_dir_fetch": 0, 2024-06-06T03:38:31.579 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_remote_ino": 0, 2024-06-06T03:38:31.579 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_lock": 0, 2024-06-06T03:38:31.579 INFO:teuthology.orchestra.run.smithi079.stdout: "load_cent": 0, 2024-06-06T03:38:31.579 INFO:teuthology.orchestra.run.smithi079.stdout: "q": 0, 2024-06-06T03:38:31.579 INFO:teuthology.orchestra.run.smithi079.stdout: "exported": 0, 2024-06-06T03:38:31.579 INFO:teuthology.orchestra.run.smithi079.stdout: "exported_inodes": 0, 2024-06-06T03:38:31.579 INFO:teuthology.orchestra.run.smithi079.stdout: "imported": 0, 2024-06-06T03:38:31.579 INFO:teuthology.orchestra.run.smithi079.stdout: "imported_inodes": 0, 2024-06-06T03:38:31.579 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_dir_fetch": 0, 2024-06-06T03:38:31.579 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_backtrace_fetch": 0, 2024-06-06T03:38:31.579 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_peer_discover": 0, 2024-06-06T03:38:31.579 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rfiles": 0, 2024-06-06T03:38:31.579 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rbytes": 0, 2024-06-06T03:38:31.580 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rsnaps": 0, 2024-06-06T03:38:31.580 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_backtrace_fetch": 0, 2024-06-06T03:38:31.580 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_set_tag": 0, 2024-06-06T03:38:31.580 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_backtrace_repaired": 0, 2024-06-06T03:38:31.580 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_inotable_repaired": 0, 2024-06-06T03:38:31.580 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dir_inodes": 0, 2024-06-06T03:38:31.580 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dir_base_inodes": 0, 2024-06-06T03:38:31.580 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dirfrag_rstats": 0, 2024-06-06T03:38:31.580 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_file_inodes": 0, 2024-06-06T03:38:31.580 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_inode_file_caps": 0, 2024-06-06T03:38:31.580 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_revoke": 0, 2024-06-06T03:38:31.581 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_grant": 0, 2024-06-06T03:38:31.581 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_trunc": 0, 2024-06-06T03:38:31.581 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-06T03:38:31.581 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-06T03:38:31.581 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_caps": 0, 2024-06-06T03:38:31.581 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_caps_dirty": 0, 2024-06-06T03:38:31.581 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_cap_release": 0, 2024-06-06T03:38:31.581 INFO:teuthology.orchestra.run.smithi079.stdout: "process_request_cap_release": 0 2024-06-06T03:38:31.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.581 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cache": { 2024-06-06T03:38:31.581 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_update": 0, 2024-06-06T03:38:31.581 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_update_receipt": 0, 2024-06-06T03:38:31.581 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_try_discover": 0, 2024-06-06T03:38:31.582 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_send_discover": 0, 2024-06-06T03:38:31.582 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_handle_discover": 0, 2024-06-06T03:38:31.582 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays": 0, 2024-06-06T03:38:31.582 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays_delayed": 0, 2024-06-06T03:38:31.582 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays_enqueuing": 0, 2024-06-06T03:38:31.582 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_created": 0, 2024-06-06T03:38:31.582 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_enqueued": 0, 2024-06-06T03:38:31.582 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_reintegrated": 0, 2024-06-06T03:38:31.582 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_migrated": 0, 2024-06-06T03:38:31.582 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_processing": 0, 2024-06-06T03:38:31.582 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_enqueued": 0, 2024-06-06T03:38:31.583 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_prioritized": 0, 2024-06-06T03:38:31.583 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_started": 0, 2024-06-06T03:38:31.583 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_completed": 0, 2024-06-06T03:38:31.583 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_quiesce_path": 0, 2024-06-06T03:38:31.583 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_quiesce_inode": 0, 2024-06-06T03:38:31.583 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_enqueue_scrub": 0, 2024-06-06T03:38:31.583 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_exportdir": 0, 2024-06-06T03:38:31.583 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_flush": 0, 2024-06-06T03:38:31.583 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_fragmentdir": 0, 2024-06-06T03:38:31.583 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_fragstats": 0, 2024-06-06T03:38:31.583 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_inodestats": 0 2024-06-06T03:38:31.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.583 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_log": { 2024-06-06T03:38:31.583 INFO:teuthology.orchestra.run.smithi079.stdout: "evlrg": 0, 2024-06-06T03:38:31.584 INFO:teuthology.orchestra.run.smithi079.stdout: "evadd": 0, 2024-06-06T03:38:31.584 INFO:teuthology.orchestra.run.smithi079.stdout: "evex": 0, 2024-06-06T03:38:31.584 INFO:teuthology.orchestra.run.smithi079.stdout: "evtrm": 0, 2024-06-06T03:38:31.584 INFO:teuthology.orchestra.run.smithi079.stdout: "ev": 69, 2024-06-06T03:38:31.584 INFO:teuthology.orchestra.run.smithi079.stdout: "evexg": 0, 2024-06-06T03:38:31.584 INFO:teuthology.orchestra.run.smithi079.stdout: "evexd": 0, 2024-06-06T03:38:31.584 INFO:teuthology.orchestra.run.smithi079.stdout: "segadd": 0, 2024-06-06T03:38:31.584 INFO:teuthology.orchestra.run.smithi079.stdout: "segex": 0, 2024-06-06T03:38:31.584 INFO:teuthology.orchestra.run.smithi079.stdout: "segtrm": 0, 2024-06-06T03:38:31.584 INFO:teuthology.orchestra.run.smithi079.stdout: "seg": 2, 2024-06-06T03:38:31.584 INFO:teuthology.orchestra.run.smithi079.stdout: "segmjr": 2, 2024-06-06T03:38:31.584 INFO:teuthology.orchestra.run.smithi079.stdout: "segexg": 0, 2024-06-06T03:38:31.584 INFO:teuthology.orchestra.run.smithi079.stdout: "segexd": 0, 2024-06-06T03:38:31.584 INFO:teuthology.orchestra.run.smithi079.stdout: "expos": 4194304, 2024-06-06T03:38:31.585 INFO:teuthology.orchestra.run.smithi079.stdout: "wrpos": 4334880, 2024-06-06T03:38:31.585 INFO:teuthology.orchestra.run.smithi079.stdout: "rdpos": 4333229, 2024-06-06T03:38:31.585 INFO:teuthology.orchestra.run.smithi079.stdout: "jlat": { 2024-06-06T03:38:31.585 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.585 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.585 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.585 INFO:teuthology.orchestra.run.smithi079.stdout: "replayed": 69 2024-06-06T03:38:31.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.585 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_mem": { 2024-06-06T03:38:31.585 INFO:teuthology.orchestra.run.smithi079.stdout: "ino": 5, 2024-06-06T03:38:31.585 INFO:teuthology.orchestra.run.smithi079.stdout: "ino+": 32, 2024-06-06T03:38:31.585 INFO:teuthology.orchestra.run.smithi079.stdout: "ino-": 27, 2024-06-06T03:38:31.586 INFO:teuthology.orchestra.run.smithi079.stdout: "dir": 3, 2024-06-06T03:38:31.586 INFO:teuthology.orchestra.run.smithi079.stdout: "dir+": 13, 2024-06-06T03:38:31.586 INFO:teuthology.orchestra.run.smithi079.stdout: "dir-": 10, 2024-06-06T03:38:31.586 INFO:teuthology.orchestra.run.smithi079.stdout: "dn": 37, 2024-06-06T03:38:31.586 INFO:teuthology.orchestra.run.smithi079.stdout: "dn+": 49, 2024-06-06T03:38:31.586 INFO:teuthology.orchestra.run.smithi079.stdout: "dn-": 12, 2024-06-06T03:38:31.586 INFO:teuthology.orchestra.run.smithi079.stdout: "cap": 0, 2024-06-06T03:38:31.586 INFO:teuthology.orchestra.run.smithi079.stdout: "cap+": 0, 2024-06-06T03:38:31.586 INFO:teuthology.orchestra.run.smithi079.stdout: "cap-": 0, 2024-06-06T03:38:31.586 INFO:teuthology.orchestra.run.smithi079.stdout: "rss": 50712, 2024-06-06T03:38:31.586 INFO:teuthology.orchestra.run.smithi079.stdout: "heap": 215420 2024-06-06T03:38:31.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.586 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_server": { 2024-06-06T03:38:31.586 INFO:teuthology.orchestra.run.smithi079.stdout: "dispatch_client_request": 0, 2024-06-06T03:38:31.587 INFO:teuthology.orchestra.run.smithi079.stdout: "dispatch_server_request": 0, 2024-06-06T03:38:31.587 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_request": 0, 2024-06-06T03:38:31.587 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_session": 0, 2024-06-06T03:38:31.587 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_peer_request": 0, 2024-06-06T03:38:31.587 INFO:teuthology.orchestra.run.smithi079.stdout: "req_create_latency": { 2024-06-06T03:38:31.587 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.587 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.587 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.587 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getattr_latency": { 2024-06-06T03:38:31.587 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.587 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.587 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.587 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getfilelock_latency": { 2024-06-06T03:38:31.588 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.588 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.588 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.588 INFO:teuthology.orchestra.run.smithi079.stdout: "req_link_latency": { 2024-06-06T03:38:31.588 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.588 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.588 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.588 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookup_latency": { 2024-06-06T03:38:31.588 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.589 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.589 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.589 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookuphash_latency": { 2024-06-06T03:38:31.589 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.589 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.589 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.590 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupino_latency": { 2024-06-06T03:38:31.590 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.590 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.590 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.590 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupname_latency": { 2024-06-06T03:38:31.590 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.590 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.590 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.591 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupparent_latency": { 2024-06-06T03:38:31.591 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.591 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.591 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.591 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupsnap_latency": { 2024-06-06T03:38:31.591 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.591 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.591 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.591 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lssnap_latency": { 2024-06-06T03:38:31.591 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.591 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.592 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.592 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mkdir_latency": { 2024-06-06T03:38:31.592 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.592 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.592 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.593 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mknod_latency": { 2024-06-06T03:38:31.593 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.593 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.593 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.593 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mksnap_latency": { 2024-06-06T03:38:31.593 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.593 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.593 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.593 INFO:teuthology.orchestra.run.smithi079.stdout: "req_open_latency": { 2024-06-06T03:38:31.593 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.593 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.594 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.594 INFO:teuthology.orchestra.run.smithi079.stdout: "req_readdir_latency": { 2024-06-06T03:38:31.594 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.594 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.594 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.594 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rename_latency": { 2024-06-06T03:38:31.594 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.594 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.594 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.594 INFO:teuthology.orchestra.run.smithi079.stdout: "req_renamesnap_latency": { 2024-06-06T03:38:31.595 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.595 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.595 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.595 INFO:teuthology.orchestra.run.smithi079.stdout: "req_snapdiff_latency": { 2024-06-06T03:38:31.595 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.595 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.595 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.595 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmdir_latency": { 2024-06-06T03:38:31.595 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.595 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.595 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.596 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmsnap_latency": { 2024-06-06T03:38:31.596 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.596 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.596 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.596 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmxattr_latency": { 2024-06-06T03:38:31.596 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.596 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.596 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.596 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setattr_latency": { 2024-06-06T03:38:31.596 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.596 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.596 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.597 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setdirlayout_latency": { 2024-06-06T03:38:31.597 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.597 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.597 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.597 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setfilelock_latency": { 2024-06-06T03:38:31.597 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.597 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.597 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.597 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setlayout_latency": { 2024-06-06T03:38:31.597 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.597 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.598 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.598 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setxattr_latency": { 2024-06-06T03:38:31.598 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.598 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.598 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.598 INFO:teuthology.orchestra.run.smithi079.stdout: "req_symlink_latency": { 2024-06-06T03:38:31.598 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.598 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.598 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.598 INFO:teuthology.orchestra.run.smithi079.stdout: "req_unlink_latency": { 2024-06-06T03:38:31.599 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.599 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.599 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.599 INFO:teuthology.orchestra.run.smithi079.stdout: "cap_revoke_eviction": 0, 2024-06-06T03:38:31.599 INFO:teuthology.orchestra.run.smithi079.stdout: "cap_acquisition_throttle": 0, 2024-06-06T03:38:31.599 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getvxattr_latency": { 2024-06-06T03:38:31.599 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.599 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.599 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.599 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-06T03:38:31.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.599 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_sessions": { 2024-06-06T03:38:31.599 INFO:teuthology.orchestra.run.smithi079.stdout: "session_count": 1, 2024-06-06T03:38:31.599 INFO:teuthology.orchestra.run.smithi079.stdout: "session_add": 1, 2024-06-06T03:38:31.599 INFO:teuthology.orchestra.run.smithi079.stdout: "session_remove": 0, 2024-06-06T03:38:31.600 INFO:teuthology.orchestra.run.smithi079.stdout: "sessions_open": 1, 2024-06-06T03:38:31.600 INFO:teuthology.orchestra.run.smithi079.stdout: "sessions_stale": 0, 2024-06-06T03:38:31.600 INFO:teuthology.orchestra.run.smithi079.stdout: "total_load": 0, 2024-06-06T03:38:31.600 INFO:teuthology.orchestra.run.smithi079.stdout: "average_load": 0, 2024-06-06T03:38:31.600 INFO:teuthology.orchestra.run.smithi079.stdout: "avg_session_uptime": 1954, 2024-06-06T03:38:31.600 INFO:teuthology.orchestra.run.smithi079.stdout: "mdthresh_evicted": 0 2024-06-06T03:38:31.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.600 INFO:teuthology.orchestra.run.smithi079.stdout: "mempool": { 2024-06-06T03:38:31.600 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_bytes": 0, 2024-06-06T03:38:31.600 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_items": 0, 2024-06-06T03:38:31.600 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T03:38:31.600 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_items": 0, 2024-06-06T03:38:31.600 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T03:38:31.600 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_items": 0, 2024-06-06T03:38:31.601 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T03:38:31.601 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T03:38:31.601 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T03:38:31.601 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T03:38:31.601 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T03:38:31.601 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_items": 0, 2024-06-06T03:38:31.601 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T03:38:31.601 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T03:38:31.601 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_bytes": 0, 2024-06-06T03:38:31.601 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_items": 0, 2024-06-06T03:38:31.601 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_bytes": 0, 2024-06-06T03:38:31.601 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_items": 0, 2024-06-06T03:38:31.601 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T03:38:31.601 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T03:38:31.602 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T03:38:31.602 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T03:38:31.602 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T03:38:31.602 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_items": 0, 2024-06-06T03:38:31.602 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_bytes": 0, 2024-06-06T03:38:31.602 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_items": 0, 2024-06-06T03:38:31.602 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T03:38:31.602 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T03:38:31.602 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_bytes": 0, 2024-06-06T03:38:31.602 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_items": 0, 2024-06-06T03:38:31.602 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_bytes": 0, 2024-06-06T03:38:31.602 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_items": 0, 2024-06-06T03:38:31.603 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T03:38:31.603 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_items": 0, 2024-06-06T03:38:31.603 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T03:38:31.603 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_items": 0, 2024-06-06T03:38:31.603 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_bytes": 181304, 2024-06-06T03:38:31.603 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_items": 46, 2024-06-06T03:38:31.603 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_bytes": 0, 2024-06-06T03:38:31.603 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_items": 0, 2024-06-06T03:38:31.603 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_bytes": 0, 2024-06-06T03:38:31.603 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_items": 0, 2024-06-06T03:38:31.603 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_bytes": 0, 2024-06-06T03:38:31.603 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_items": 0, 2024-06-06T03:38:31.603 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_bytes": 0, 2024-06-06T03:38:31.603 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_items": 0, 2024-06-06T03:38:31.604 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_bytes": 8792, 2024-06-06T03:38:31.604 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_items": 168, 2024-06-06T03:38:31.604 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T03:38:31.604 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_items": 0, 2024-06-06T03:38:31.604 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_bytes": 0, 2024-06-06T03:38:31.604 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_items": 0, 2024-06-06T03:38:31.604 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_bytes": 41519, 2024-06-06T03:38:31.604 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_items": 256, 2024-06-06T03:38:31.604 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_bytes": 0, 2024-06-06T03:38:31.604 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_items": 0, 2024-06-06T03:38:31.604 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_bytes": 0, 2024-06-06T03:38:31.604 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_items": 0 2024-06-06T03:38:31.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.605 INFO:teuthology.orchestra.run.smithi079.stdout: "objecter": { 2024-06-06T03:38:31.605 INFO:teuthology.orchestra.run.smithi079.stdout: "op_active": 0, 2024-06-06T03:38:31.605 INFO:teuthology.orchestra.run.smithi079.stdout: "op_laggy": 0, 2024-06-06T03:38:31.605 INFO:teuthology.orchestra.run.smithi079.stdout: "op_send": 2534, 2024-06-06T03:38:31.605 INFO:teuthology.orchestra.run.smithi079.stdout: "op_send_bytes": 21, 2024-06-06T03:38:31.605 INFO:teuthology.orchestra.run.smithi079.stdout: "op_resend": 3, 2024-06-06T03:38:31.605 INFO:teuthology.orchestra.run.smithi079.stdout: "op_reply": 2534, 2024-06-06T03:38:31.605 INFO:teuthology.orchestra.run.smithi079.stdout: "op_latency": { 2024-06-06T03:38:31.605 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 2534, 2024-06-06T03:38:31.605 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 1.754959865, 2024-06-06T03:38:31.605 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000692565 2024-06-06T03:38:31.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.605 INFO:teuthology.orchestra.run.smithi079.stdout: "op_inflight": 0, 2024-06-06T03:38:31.606 INFO:teuthology.orchestra.run.smithi079.stdout: "oplen_avg": { 2024-06-06T03:38:31.606 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 2534, 2024-06-06T03:38:31.606 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 2535 2024-06-06T03:38:31.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.606 INFO:teuthology.orchestra.run.smithi079.stdout: "op": 2534, 2024-06-06T03:38:31.606 INFO:teuthology.orchestra.run.smithi079.stdout: "op_r": 2534, 2024-06-06T03:38:31.606 INFO:teuthology.orchestra.run.smithi079.stdout: "op_w": 0, 2024-06-06T03:38:31.606 INFO:teuthology.orchestra.run.smithi079.stdout: "op_rmw": 0, 2024-06-06T03:38:31.606 INFO:teuthology.orchestra.run.smithi079.stdout: "op_pg": 0, 2024-06-06T03:38:31.606 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_stat": 1621, 2024-06-06T03:38:31.606 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_create": 0, 2024-06-06T03:38:31.606 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_read": 911, 2024-06-06T03:38:31.606 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_write": 0, 2024-06-06T03:38:31.607 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_writefull": 0, 2024-06-06T03:38:31.607 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_writesame": 0, 2024-06-06T03:38:31.607 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_append": 0, 2024-06-06T03:38:31.607 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_zero": 0, 2024-06-06T03:38:31.607 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_truncate": 0, 2024-06-06T03:38:31.607 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_delete": 0, 2024-06-06T03:38:31.607 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_mapext": 0, 2024-06-06T03:38:31.607 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_sparse_read": 0, 2024-06-06T03:38:31.607 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_clonerange": 0, 2024-06-06T03:38:31.607 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_getxattr": 1, 2024-06-06T03:38:31.607 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_setxattr": 0, 2024-06-06T03:38:31.607 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_cmpxattr": 0, 2024-06-06T03:38:31.607 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_rmxattr": 0, 2024-06-06T03:38:31.608 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_resetxattrs": 0, 2024-06-06T03:38:31.608 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_call": 0, 2024-06-06T03:38:31.608 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_watch": 0, 2024-06-06T03:38:31.608 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_notify": 0, 2024-06-06T03:38:31.608 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_src_cmpxattr": 0, 2024-06-06T03:38:31.608 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_pgls": 0, 2024-06-06T03:38:31.608 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_pgls_filter": 0, 2024-06-06T03:38:31.608 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_other": 0, 2024-06-06T03:38:31.608 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_active": 0, 2024-06-06T03:38:31.608 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_send": 0, 2024-06-06T03:38:31.608 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_resend": 0, 2024-06-06T03:38:31.608 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_ping": 0, 2024-06-06T03:38:31.608 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_active": 0, 2024-06-06T03:38:31.609 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_send": 0, 2024-06-06T03:38:31.609 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_resend": 0, 2024-06-06T03:38:31.609 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_active": 0, 2024-06-06T03:38:31.609 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_send": 0, 2024-06-06T03:38:31.609 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_resend": 0, 2024-06-06T03:38:31.609 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_active": 0, 2024-06-06T03:38:31.609 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_send": 0, 2024-06-06T03:38:31.609 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_resend": 0, 2024-06-06T03:38:31.609 INFO:teuthology.orchestra.run.smithi079.stdout: "command_active": 0, 2024-06-06T03:38:31.609 INFO:teuthology.orchestra.run.smithi079.stdout: "command_send": 0, 2024-06-06T03:38:31.609 INFO:teuthology.orchestra.run.smithi079.stdout: "command_resend": 0, 2024-06-06T03:38:31.609 INFO:teuthology.orchestra.run.smithi079.stdout: "map_epoch": 99, 2024-06-06T03:38:31.609 INFO:teuthology.orchestra.run.smithi079.stdout: "map_full": 0, 2024-06-06T03:38:31.609 INFO:teuthology.orchestra.run.smithi079.stdout: "map_inc": 2, 2024-06-06T03:38:31.609 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_sessions": 4, 2024-06-06T03:38:31.610 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_session_open": 4, 2024-06-06T03:38:31.610 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_session_close": 0, 2024-06-06T03:38:31.610 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_laggy": 0, 2024-06-06T03:38:31.610 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_wr": 0, 2024-06-06T03:38:31.610 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_rd": 2, 2024-06-06T03:38:31.610 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_del": 0 2024-06-06T03:38:31.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.610 INFO:teuthology.orchestra.run.smithi079.stdout: "oft": { 2024-06-06T03:38:31.610 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_objs": 0, 2024-06-06T03:38:31.610 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_kv_pairs": 0, 2024-06-06T03:38:31.610 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_updates": 0, 2024-06-06T03:38:31.610 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_removes": 0 2024-06-06T03:38:31.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.611 INFO:teuthology.orchestra.run.smithi079.stdout: "osd-slow-ops": { 2024-06-06T03:38:31.611 INFO:teuthology.orchestra.run.smithi079.stdout: "slow_ops_count": 0 2024-06-06T03:38:31.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.611 INFO:teuthology.orchestra.run.smithi079.stdout: "purge_queue": { 2024-06-06T03:38:31.611 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_ops": 0, 2024-06-06T03:38:31.611 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_ops_high_water": 0, 2024-06-06T03:38:31.611 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing": 0, 2024-06-06T03:38:31.611 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_high_water": 0, 2024-06-06T03:38:31.611 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executed_ops": 0, 2024-06-06T03:38:31.611 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executed": 0, 2024-06-06T03:38:31.611 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_item_in_journal": 0 2024-06-06T03:38:31.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.611 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T03:38:31.611 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-06-06T03:38:31.612 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 104857600, 2024-06-06T03:38:31.612 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-06-06T03:38:31.612 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 2821, 2024-06-06T03:38:31.612 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 1154263, 2024-06-06T03:38:31.612 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:31.612 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 2821, 2024-06-06T03:38:31.612 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2024-06-06T03:38:31.612 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2024-06-06T03:38:31.612 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 2821, 2024-06-06T03:38:31.612 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 1154263, 2024-06-06T03:38:31.612 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-06-06T03:38:31.612 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.612 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.612 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.613 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-06T03:38:31.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.613 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-objecter_bytes": { 2024-06-06T03:38:31.613 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-06-06T03:38:31.613 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 104857600, 2024-06-06T03:38:31.613 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-06-06T03:38:31.613 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2024-06-06T03:38:31.613 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2024-06-06T03:38:31.613 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:31.613 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2024-06-06T03:38:31.613 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 2534, 2024-06-06T03:38:31.613 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 140581, 2024-06-06T03:38:31.613 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 2534, 2024-06-06T03:38:31.613 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 140581, 2024-06-06T03:38:31.613 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-06-06T03:38:31.614 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.614 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.614 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.614 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-06T03:38:31.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.614 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-objecter_ops": { 2024-06-06T03:38:31.614 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-06-06T03:38:31.614 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 1024, 2024-06-06T03:38:31.614 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-06-06T03:38:31.614 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2024-06-06T03:38:31.614 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2024-06-06T03:38:31.614 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:31.614 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2024-06-06T03:38:31.615 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 2534, 2024-06-06T03:38:31.615 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 2534, 2024-06-06T03:38:31.615 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 2534, 2024-06-06T03:38:31.615 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 2534, 2024-06-06T03:38:31.615 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-06-06T03:38:31.615 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.615 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.615 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.615 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-06T03:38:31.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.615 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-write_buf_throttle": { 2024-06-06T03:38:31.615 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-06-06T03:38:31.615 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 3758096384, 2024-06-06T03:38:31.615 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-06-06T03:38:31.615 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2024-06-06T03:38:31.615 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2024-06-06T03:38:31.616 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:31.616 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2024-06-06T03:38:31.616 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2024-06-06T03:38:31.616 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2024-06-06T03:38:31.616 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 0, 2024-06-06T03:38:31.616 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 0, 2024-06-06T03:38:31.616 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-06-06T03:38:31.616 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.616 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.616 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.616 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-06T03:38:31.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:31.616 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-write_buf_throttle-0x560da78e46e0": { 2024-06-06T03:38:31.616 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-06-06T03:38:31.616 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 3758096384, 2024-06-06T03:38:31.617 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-06-06T03:38:31.617 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2024-06-06T03:38:31.617 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2024-06-06T03:38:31.617 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:31.617 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2024-06-06T03:38:31.617 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2024-06-06T03:38:31.617 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2024-06-06T03:38:31.617 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 0, 2024-06-06T03:38:31.617 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 0, 2024-06-06T03:38:31.617 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-06-06T03:38:31.617 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:31.617 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:31.617 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:31.617 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-06T03:38:31.617 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-06T03:38:31.618 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-06T03:38:32.371 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-06-06T03:38:32.372 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-06-06T03:38:32.372 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-06-06T03:38:32.372 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-06-06T03:38:32.372 DEBUG:tasks.check_counter:Getting stats from k 2024-06-06T03:38:32.372 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph daemon mds.k perf dump 2024-06-06T03:38:32.613 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T03:38:33.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:33 smithi079 ceph-mon[35478]: pgmap v788: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T03:38:33.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:33 smithi122 ceph-mon[35759]: pgmap v788: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T03:38:33.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:33 smithi050 ceph-mon[32421]: pgmap v788: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T03:38:34.496 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-06-06T03:38:34.496 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T03:38:34.496 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 4, 2024-06-06T03:38:34.496 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 4, 2024-06-06T03:38:34.497 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 2992, 2024-06-06T03:38:34.497 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 448, 2024-06-06T03:38:34.497 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 4, 2024-06-06T03:38:34.497 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 0, 2024-06-06T03:38:34.497 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.001269320, 2024-06-06T03:38:34.497 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.000032083, 2024-06-06T03:38:34.497 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.000519505, 2024-06-06T03:38:34.497 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T03:38:34.497 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:34.497 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 3, 2024-06-06T03:38:34.497 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000697536, 2024-06-06T03:38:34.497 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000232512 2024-06-06T03:38:34.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:34.498 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:34.498 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:34.498 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:34.498 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:34.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:34.498 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-06-06T03:38:34.498 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 448 2024-06-06T03:38:34.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:34.498 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T03:38:34.498 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 2, 2024-06-06T03:38:34.498 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 205, 2024-06-06T03:38:34.498 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 320, 2024-06-06T03:38:34.498 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 191984, 2024-06-06T03:38:34.499 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 4, 2024-06-06T03:38:34.499 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 2, 2024-06-06T03:38:34.499 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.011196339, 2024-06-06T03:38:34.499 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.007954816, 2024-06-06T03:38:34.499 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.001277829, 2024-06-06T03:38:34.499 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T03:38:34.499 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:34.499 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 203, 2024-06-06T03:38:34.499 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.011821543, 2024-06-06T03:38:34.499 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000058234 2024-06-06T03:38:34.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:34.499 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:34.499 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:34.499 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:34.499 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:34.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:34.500 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-06T03:38:34.500 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 191984 2024-06-06T03:38:34.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:34.500 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T03:38:34.500 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 272, 2024-06-06T03:38:34.500 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 269, 2024-06-06T03:38:34.500 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 493376, 2024-06-06T03:38:34.500 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 165824, 2024-06-06T03:38:34.500 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 2, 2024-06-06T03:38:34.500 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 1, 2024-06-06T03:38:34.500 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.038603645, 2024-06-06T03:38:34.500 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.014974214, 2024-06-06T03:38:34.500 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.016497620, 2024-06-06T03:38:34.501 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.006303362, 2024-06-06T03:38:34.501 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:34.501 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 268, 2024-06-06T03:38:34.501 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.010504874, 2024-06-06T03:38:34.501 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000039197 2024-06-06T03:38:34.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:34.501 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:34.501 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:34.501 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:34.501 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:34.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:34.501 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 493376, 2024-06-06T03:38:34.501 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 165824 2024-06-06T03:38:34.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:34.502 INFO:teuthology.orchestra.run.smithi079.stdout: "cct": { 2024-06-06T03:38:34.502 INFO:teuthology.orchestra.run.smithi079.stdout: "total_workers": 0, 2024-06-06T03:38:34.502 INFO:teuthology.orchestra.run.smithi079.stdout: "unhealthy_workers": 0 2024-06-06T03:38:34.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:34.502 INFO:teuthology.orchestra.run.smithi079.stdout: "mempool": { 2024-06-06T03:38:34.502 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_bytes": 0, 2024-06-06T03:38:34.502 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_items": 0, 2024-06-06T03:38:34.502 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T03:38:34.502 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_items": 0, 2024-06-06T03:38:34.502 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T03:38:34.502 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_items": 0, 2024-06-06T03:38:34.502 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T03:38:34.502 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T03:38:34.502 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T03:38:34.503 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T03:38:34.503 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T03:38:34.503 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_items": 0, 2024-06-06T03:38:34.503 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T03:38:34.503 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T03:38:34.503 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_bytes": 0, 2024-06-06T03:38:34.503 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_items": 0, 2024-06-06T03:38:34.503 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_bytes": 0, 2024-06-06T03:38:34.503 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_items": 0, 2024-06-06T03:38:34.503 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T03:38:34.503 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T03:38:34.503 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T03:38:34.503 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T03:38:34.503 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T03:38:34.504 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_items": 0, 2024-06-06T03:38:34.504 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_bytes": 0, 2024-06-06T03:38:34.504 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_items": 0, 2024-06-06T03:38:34.504 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T03:38:34.504 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T03:38:34.504 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_bytes": 0, 2024-06-06T03:38:34.504 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_items": 0, 2024-06-06T03:38:34.504 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_bytes": 0, 2024-06-06T03:38:34.504 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_items": 0, 2024-06-06T03:38:34.504 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T03:38:34.504 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_items": 0, 2024-06-06T03:38:34.504 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T03:38:34.504 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_items": 0, 2024-06-06T03:38:34.504 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_bytes": 147920, 2024-06-06T03:38:34.505 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_items": 27, 2024-06-06T03:38:34.505 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_bytes": 0, 2024-06-06T03:38:34.505 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_items": 0, 2024-06-06T03:38:34.505 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_bytes": 0, 2024-06-06T03:38:34.505 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_items": 0, 2024-06-06T03:38:34.505 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_bytes": 0, 2024-06-06T03:38:34.505 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_items": 0, 2024-06-06T03:38:34.505 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_bytes": 0, 2024-06-06T03:38:34.505 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_items": 0, 2024-06-06T03:38:34.505 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_bytes": 0, 2024-06-06T03:38:34.505 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_items": 0, 2024-06-06T03:38:34.505 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T03:38:34.505 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_items": 0, 2024-06-06T03:38:34.505 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_bytes": 0, 2024-06-06T03:38:34.506 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_items": 0, 2024-06-06T03:38:34.506 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_bytes": 928, 2024-06-06T03:38:34.506 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_items": 2, 2024-06-06T03:38:34.506 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_bytes": 0, 2024-06-06T03:38:34.506 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_items": 0, 2024-06-06T03:38:34.506 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_bytes": 0, 2024-06-06T03:38:34.506 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_items": 0 2024-06-06T03:38:34.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-06-06T03:38:34.506 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T03:38:34.506 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-06-06T03:38:34.506 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 104857600, 2024-06-06T03:38:34.506 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-06-06T03:38:34.506 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 274, 2024-06-06T03:38:34.507 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 454950, 2024-06-06T03:38:34.507 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:34.507 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 274, 2024-06-06T03:38:34.507 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2024-06-06T03:38:34.507 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2024-06-06T03:38:34.507 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 274, 2024-06-06T03:38:34.507 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 454950, 2024-06-06T03:38:34.507 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-06-06T03:38:34.507 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-06-06T03:38:34.507 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-06-06T03:38:34.507 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-06-06T03:38:34.507 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-06T03:38:34.507 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-06-06T03:38:34.507 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-06-06T03:38:35.232 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-06-06T03:38:35.233 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-06-06T03:38:35.233 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-06-06T03:38:35.233 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-06-06T03:38:35.233 DEBUG:tasks.check_counter:Getting stats from c 2024-06-06T03:38:35.233 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph daemon mds.c perf dump 2024-06-06T03:38:35.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:35 smithi122 ceph-mon[35759]: pgmap v789: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:38:35.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:35 smithi050 ceph-mon[32421]: pgmap v789: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:38:35.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:35 smithi079 ceph-mon[35478]: pgmap v789: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:38:35.781 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T03:38:37.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:37 smithi122 ceph-mon[35759]: pgmap v790: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:38:37.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:37 smithi050 ceph-mon[32421]: pgmap v790: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:38:37.553 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-06-06T03:38:37.553 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T03:38:37.553 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 1325, 2024-06-06T03:38:37.554 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 1329, 2024-06-06T03:38:37.554 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 341080, 2024-06-06T03:38:37.554 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 512978, 2024-06-06T03:38:37.554 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 16, 2024-06-06T03:38:37.554 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 5, 2024-06-06T03:38:37.554 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.102220793, 2024-06-06T03:38:37.554 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.024499162, 2024-06-06T03:38:37.554 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.031010457, 2024-06-06T03:38:37.554 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.037202596, 2024-06-06T03:38:37.554 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:37.554 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1325, 2024-06-06T03:38:37.554 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.074082107, 2024-06-06T03:38:37.554 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000055911 2024-06-06T03:38:37.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.555 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:37.555 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 6, 2024-06-06T03:38:37.555 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000488, 2024-06-06T03:38:37.555 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000081 2024-06-06T03:38:37.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.555 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-06T03:38:37.555 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 0 2024-06-06T03:38:37.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.555 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T03:38:37.555 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 956, 2024-06-06T03:38:37.555 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 1264, 2024-06-06T03:38:37.556 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 298719, 2024-06-06T03:38:37.556 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 1031045, 2024-06-06T03:38:37.556 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 13, 2024-06-06T03:38:37.556 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 6, 2024-06-06T03:38:37.556 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.088456756, 2024-06-06T03:38:37.556 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.032112638, 2024-06-06T03:38:37.556 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.029585038, 2024-06-06T03:38:37.556 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.022671671, 2024-06-06T03:38:37.556 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:37.556 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1263, 2024-06-06T03:38:37.556 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.078735736, 2024-06-06T03:38:37.556 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000062340 2024-06-06T03:38:37.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.557 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:37.557 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 398, 2024-06-06T03:38:37.557 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000107702, 2024-06-06T03:38:37.557 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000270 2024-06-06T03:38:37.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.557 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-06-06T03:38:37.557 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 415968 2024-06-06T03:38:37.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.557 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T03:38:37.557 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 1596, 2024-06-06T03:38:37.557 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 1731, 2024-06-06T03:38:37.557 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 957196, 2024-06-06T03:38:37.558 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 892848, 2024-06-06T03:38:37.558 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 23, 2024-06-06T03:38:37.558 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 5, 2024-06-06T03:38:37.558 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.167650766, 2024-06-06T03:38:37.558 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.060865225, 2024-06-06T03:38:37.558 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.077699089, 2024-06-06T03:38:37.558 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.029813857, 2024-06-06T03:38:37.558 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:37.558 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1732, 2024-06-06T03:38:37.558 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.123505762, 2024-06-06T03:38:37.558 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000071308 2024-06-06T03:38:37.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.558 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:37.558 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1392, 2024-06-06T03:38:37.559 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000296302, 2024-06-06T03:38:37.559 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000212 2024-06-06T03:38:37.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.559 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 583312, 2024-06-06T03:38:37.559 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 183648 2024-06-06T03:38:37.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.559 INFO:teuthology.orchestra.run.smithi122.stdout: "cct": { 2024-06-06T03:38:37.559 INFO:teuthology.orchestra.run.smithi122.stdout: "total_workers": 1, 2024-06-06T03:38:37.559 INFO:teuthology.orchestra.run.smithi122.stdout: "unhealthy_workers": 0 2024-06-06T03:38:37.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.559 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-MDSRank": { 2024-06-06T03:38:37.559 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-06-06T03:38:37.559 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-06-06T03:38:37.560 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 114, 2024-06-06T03:38:37.560 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.029628583, 2024-06-06T03:38:37.560 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000259899 2024-06-06T03:38:37.560 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:37.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.560 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-PurgeQueue": { 2024-06-06T03:38:37.561 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-06-06T03:38:37.561 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-06-06T03:38:37.561 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 2460, 2024-06-06T03:38:37.561 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.089619377, 2024-06-06T03:38:37.561 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000036430 2024-06-06T03:38:37.561 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:37.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.562 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": { 2024-06-06T03:38:37.562 INFO:teuthology.orchestra.run.smithi122.stdout: "request": 51, 2024-06-06T03:38:37.562 INFO:teuthology.orchestra.run.smithi122.stdout: "reply": 50, 2024-06-06T03:38:37.562 INFO:teuthology.orchestra.run.smithi122.stdout: "reply_latency": { 2024-06-06T03:38:37.562 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 50, 2024-06-06T03:38:37.562 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.062389347, 2024-06-06T03:38:37.562 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.001247786 2024-06-06T03:38:37.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.562 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_reply": 0, 2024-06-06T03:38:37.562 INFO:teuthology.orchestra.run.smithi122.stdout: "forward": 1, 2024-06-06T03:38:37.562 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_complete": 0, 2024-06-06T03:38:37.562 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_keys": 0, 2024-06-06T03:38:37.563 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_commit": 11, 2024-06-06T03:38:37.563 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_split": 0, 2024-06-06T03:38:37.563 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_merge": 0, 2024-06-06T03:38:37.563 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes": 17, 2024-06-06T03:38:37.563 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_top": 1, 2024-06-06T03:38:37.563 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_bottom": 5, 2024-06-06T03:38:37.563 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pin_tail": 11, 2024-06-06T03:38:37.563 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pinned": 14, 2024-06-06T03:38:37.563 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_expired": 6, 2024-06-06T03:38:37.563 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_with_caps": 3, 2024-06-06T03:38:37.563 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": 3, 2024-06-06T03:38:37.563 INFO:teuthology.orchestra.run.smithi122.stdout: "subtrees": 3, 2024-06-06T03:38:37.563 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse": 91, 2024-06-06T03:38:37.563 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_hit": 78, 2024-06-06T03:38:37.564 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_forward": 1, 2024-06-06T03:38:37.564 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_discover": 4, 2024-06-06T03:38:37.564 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_dir_fetch": 0, 2024-06-06T03:38:37.564 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_remote_ino": 0, 2024-06-06T03:38:37.564 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_lock": 0, 2024-06-06T03:38:37.564 INFO:teuthology.orchestra.run.smithi122.stdout: "load_cent": 0, 2024-06-06T03:38:37.564 INFO:teuthology.orchestra.run.smithi122.stdout: "q": 0, 2024-06-06T03:38:37.564 INFO:teuthology.orchestra.run.smithi122.stdout: "exported": 1, 2024-06-06T03:38:37.564 INFO:teuthology.orchestra.run.smithi122.stdout: "exported_inodes": 1, 2024-06-06T03:38:37.564 INFO:teuthology.orchestra.run.smithi122.stdout: "imported": 2, 2024-06-06T03:38:37.564 INFO:teuthology.orchestra.run.smithi122.stdout: "imported_inodes": 20, 2024-06-06T03:38:37.564 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_dir_fetch": 0, 2024-06-06T03:38:37.564 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_backtrace_fetch": 34, 2024-06-06T03:38:37.564 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_peer_discover": 0, 2024-06-06T03:38:37.565 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rfiles": 22, 2024-06-06T03:38:37.565 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rbytes": 7436767516, 2024-06-06T03:38:37.565 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rsnaps": 0, 2024-06-06T03:38:37.565 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_fetch": 34, 2024-06-06T03:38:37.565 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_set_tag": 0, 2024-06-06T03:38:37.565 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_repaired": 0, 2024-06-06T03:38:37.565 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_inotable_repaired": 0, 2024-06-06T03:38:37.565 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_inodes": 2, 2024-06-06T03:38:37.565 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_base_inodes": 0, 2024-06-06T03:38:37.565 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dirfrag_rstats": 2, 2024-06-06T03:38:37.565 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_file_inodes": 32, 2024-06-06T03:38:37.565 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_inode_file_caps": 0, 2024-06-06T03:38:37.565 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_revoke": 15, 2024-06-06T03:38:37.566 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_grant": 30, 2024-06-06T03:38:37.566 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_trunc": 0, 2024-06-06T03:38:37.566 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-06T03:38:37.566 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-06T03:38:37.566 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps": 20, 2024-06-06T03:38:37.566 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps_dirty": 15, 2024-06-06T03:38:37.566 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_cap_release": 1, 2024-06-06T03:38:37.566 INFO:teuthology.orchestra.run.smithi122.stdout: "process_request_cap_release": 40 2024-06-06T03:38:37.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.566 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cache": { 2024-06-06T03:38:37.566 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update": 1, 2024-06-06T03:38:37.566 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update_receipt": 14, 2024-06-06T03:38:37.566 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_try_discover": 9, 2024-06-06T03:38:37.566 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_send_discover": 10, 2024-06-06T03:38:37.567 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_handle_discover": 1, 2024-06-06T03:38:37.567 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays": 1, 2024-06-06T03:38:37.567 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_delayed": 0, 2024-06-06T03:38:37.567 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_enqueuing": 0, 2024-06-06T03:38:37.567 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_created": 20, 2024-06-06T03:38:37.567 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_enqueued": 19, 2024-06-06T03:38:37.567 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_reintegrated": 0, 2024-06-06T03:38:37.567 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_migrated": 0, 2024-06-06T03:38:37.567 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_processing": 0, 2024-06-06T03:38:37.567 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_enqueued": 0, 2024-06-06T03:38:37.567 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_prioritized": 0, 2024-06-06T03:38:37.567 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_started": 0, 2024-06-06T03:38:37.567 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_completed": 0, 2024-06-06T03:38:37.567 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_quiesce_path": 0, 2024-06-06T03:38:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_quiesce_inode": 0, 2024-06-06T03:38:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_enqueue_scrub": 0, 2024-06-06T03:38:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_exportdir": 1, 2024-06-06T03:38:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_flush": 0, 2024-06-06T03:38:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragmentdir": 0, 2024-06-06T03:38:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragstats": 0, 2024-06-06T03:38:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_inodestats": 0 2024-06-06T03:38:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_log": { 2024-06-06T03:38:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: "evlrg": 0, 2024-06-06T03:38:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: "evadd": 69, 2024-06-06T03:38:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: "evex": 0, 2024-06-06T03:38:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: "evtrm": 0, 2024-06-06T03:38:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: "ev": 69, 2024-06-06T03:38:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "evexg": 0, 2024-06-06T03:38:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "evexd": 0, 2024-06-06T03:38:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "segadd": 2, 2024-06-06T03:38:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "segex": 0, 2024-06-06T03:38:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "segtrm": 0, 2024-06-06T03:38:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "seg": 2, 2024-06-06T03:38:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "segmjr": 2, 2024-06-06T03:38:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "segexg": 0, 2024-06-06T03:38:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "segexd": 0, 2024-06-06T03:38:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "expos": 4194304, 2024-06-06T03:38:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "wrpos": 4334880, 2024-06-06T03:38:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "rdpos": 0, 2024-06-06T03:38:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "jlat": { 2024-06-06T03:38:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 18, 2024-06-06T03:38:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.308578396, 2024-06-06T03:38:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.017143244 2024-06-06T03:38:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: "replayed": 0 2024-06-06T03:38:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_mem": { 2024-06-06T03:38:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: "ino": 20, 2024-06-06T03:38:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: "ino+": 42, 2024-06-06T03:38:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: "ino-": 22, 2024-06-06T03:38:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: "dir": 19, 2024-06-06T03:38:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: "dir+": 25, 2024-06-06T03:38:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: "dir-": 6, 2024-06-06T03:38:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: "dn": 17, 2024-06-06T03:38:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "dn+": 60, 2024-06-06T03:38:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "dn-": 43, 2024-06-06T03:38:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "cap": 3, 2024-06-06T03:38:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "cap+": 24, 2024-06-06T03:38:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "cap-": 21, 2024-06-06T03:38:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "rss": 54936, 2024-06-06T03:38:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "heap": 223612 2024-06-06T03:38:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_server": { 2024-06-06T03:38:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_client_request": 68, 2024-06-06T03:38:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_server_request": 3, 2024-06-06T03:38:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_request": 51, 2024-06-06T03:38:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_session": 10, 2024-06-06T03:38:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_peer_request": 9, 2024-06-06T03:38:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "req_create_latency": { 2024-06-06T03:38:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getattr_latency": { 2024-06-06T03:38:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 10, 2024-06-06T03:38:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.002135307, 2024-06-06T03:38:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000213530 2024-06-06T03:38:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getfilelock_latency": { 2024-06-06T03:38:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: "req_link_latency": { 2024-06-06T03:38:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookup_latency": { 2024-06-06T03:38:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 15, 2024-06-06T03:38:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.004204546, 2024-06-06T03:38:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000280303 2024-06-06T03:38:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookuphash_latency": { 2024-06-06T03:38:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupino_latency": { 2024-06-06T03:38:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupname_latency": { 2024-06-06T03:38:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupparent_latency": { 2024-06-06T03:38:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupsnap_latency": { 2024-06-06T03:38:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lssnap_latency": { 2024-06-06T03:38:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.576 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:37 smithi079 ceph-mon[35478]: pgmap v790: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:38:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mkdir_latency": { 2024-06-06T03:38:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mknod_latency": { 2024-06-06T03:38:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mksnap_latency": { 2024-06-06T03:38:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "req_open_latency": { 2024-06-06T03:38:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "req_readdir_latency": { 2024-06-06T03:38:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 5, 2024-06-06T03:38:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.002272705, 2024-06-06T03:38:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000454541 2024-06-06T03:38:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rename_latency": { 2024-06-06T03:38:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "req_renamesnap_latency": { 2024-06-06T03:38:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "req_snapdiff_latency": { 2024-06-06T03:38:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmdir_latency": { 2024-06-06T03:38:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 2, 2024-06-06T03:38:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.028395103, 2024-06-06T03:38:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.014197551 2024-06-06T03:38:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmsnap_latency": { 2024-06-06T03:38:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmxattr_latency": { 2024-06-06T03:38:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setattr_latency": { 2024-06-06T03:38:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setdirlayout_latency": { 2024-06-06T03:38:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setfilelock_latency": { 2024-06-06T03:38:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setlayout_latency": { 2024-06-06T03:38:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setxattr_latency": { 2024-06-06T03:38:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "req_symlink_latency": { 2024-06-06T03:38:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "req_unlink_latency": { 2024-06-06T03:38:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 18, 2024-06-06T03:38:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.025381686, 2024-06-06T03:38:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.001410093 2024-06-06T03:38:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_revoke_eviction": 0, 2024-06-06T03:38:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_acquisition_throttle": 0, 2024-06-06T03:38:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getvxattr_latency": { 2024-06-06T03:38:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_sessions": { 2024-06-06T03:38:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "session_count": 1, 2024-06-06T03:38:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "session_add": 1, 2024-06-06T03:38:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "session_remove": 0, 2024-06-06T03:38:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_open": 1, 2024-06-06T03:38:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_stale": 0, 2024-06-06T03:38:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "total_load": 46, 2024-06-06T03:38:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "average_load": 46, 2024-06-06T03:38:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "avg_session_uptime": 732, 2024-06-06T03:38:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "mdthresh_evicted": 0 2024-06-06T03:38:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "mempool": { 2024-06-06T03:38:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_bytes": 0, 2024-06-06T03:38:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_items": 0, 2024-06-06T03:38:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T03:38:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_items": 0, 2024-06-06T03:38:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T03:38:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_items": 0, 2024-06-06T03:38:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T03:38:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T03:38:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T03:38:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T03:38:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T03:38:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_items": 0, 2024-06-06T03:38:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T03:38:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T03:38:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_bytes": 0, 2024-06-06T03:38:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_items": 0, 2024-06-06T03:38:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_bytes": 0, 2024-06-06T03:38:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_items": 0, 2024-06-06T03:38:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T03:38:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T03:38:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T03:38:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T03:38:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T03:38:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_items": 0, 2024-06-06T03:38:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_bytes": 0, 2024-06-06T03:38:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_items": 0, 2024-06-06T03:38:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T03:38:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T03:38:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_bytes": 0, 2024-06-06T03:38:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_items": 0, 2024-06-06T03:38:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_bytes": 0, 2024-06-06T03:38:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_items": 0, 2024-06-06T03:38:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T03:38:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_items": 0, 2024-06-06T03:38:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T03:38:37.588 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_items": 0, 2024-06-06T03:38:37.588 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_bytes": 284189, 2024-06-06T03:38:37.588 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_items": 110, 2024-06-06T03:38:37.588 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_bytes": 0, 2024-06-06T03:38:37.588 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_items": 0, 2024-06-06T03:38:37.588 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_bytes": 0, 2024-06-06T03:38:37.588 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_items": 0, 2024-06-06T03:38:37.588 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_bytes": 0, 2024-06-06T03:38:37.588 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_items": 0, 2024-06-06T03:38:37.588 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_bytes": 0, 2024-06-06T03:38:37.588 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_items": 0, 2024-06-06T03:38:37.588 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_bytes": 8792, 2024-06-06T03:38:37.588 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_items": 168, 2024-06-06T03:38:37.588 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T03:38:37.589 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_items": 0, 2024-06-06T03:38:37.589 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_bytes": 0, 2024-06-06T03:38:37.589 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_items": 0, 2024-06-06T03:38:37.589 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_bytes": 83356, 2024-06-06T03:38:37.589 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_items": 479, 2024-06-06T03:38:37.589 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_bytes": 0, 2024-06-06T03:38:37.589 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_items": 0, 2024-06-06T03:38:37.589 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_bytes": 0, 2024-06-06T03:38:37.589 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_items": 0 2024-06-06T03:38:37.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.589 INFO:teuthology.orchestra.run.smithi122.stdout: "objecter": { 2024-06-06T03:38:37.589 INFO:teuthology.orchestra.run.smithi122.stdout: "op_active": 0, 2024-06-06T03:38:37.589 INFO:teuthology.orchestra.run.smithi122.stdout: "op_laggy": 0, 2024-06-06T03:38:37.589 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send": 2705, 2024-06-06T03:38:37.590 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send_bytes": 156039, 2024-06-06T03:38:37.590 INFO:teuthology.orchestra.run.smithi122.stdout: "op_resend": 33, 2024-06-06T03:38:37.590 INFO:teuthology.orchestra.run.smithi122.stdout: "op_reply": 2705, 2024-06-06T03:38:37.590 INFO:teuthology.orchestra.run.smithi122.stdout: "op_latency": { 2024-06-06T03:38:37.590 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 2705, 2024-06-06T03:38:37.590 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 64.737581065, 2024-06-06T03:38:37.590 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.023932562 2024-06-06T03:38:37.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.590 INFO:teuthology.orchestra.run.smithi122.stdout: "op_inflight": 0, 2024-06-06T03:38:37.590 INFO:teuthology.orchestra.run.smithi122.stdout: "oplen_avg": { 2024-06-06T03:38:37.590 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 2705, 2024-06-06T03:38:37.590 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 2737 2024-06-06T03:38:37.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.590 INFO:teuthology.orchestra.run.smithi122.stdout: "op": 2705, 2024-06-06T03:38:37.591 INFO:teuthology.orchestra.run.smithi122.stdout: "op_r": 35, 2024-06-06T03:38:37.591 INFO:teuthology.orchestra.run.smithi122.stdout: "op_w": 2670, 2024-06-06T03:38:37.591 INFO:teuthology.orchestra.run.smithi122.stdout: "op_rmw": 0, 2024-06-06T03:38:37.591 INFO:teuthology.orchestra.run.smithi122.stdout: "op_pg": 0, 2024-06-06T03:38:37.591 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_stat": 0, 2024-06-06T03:38:37.591 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_create": 10, 2024-06-06T03:38:37.591 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_read": 1, 2024-06-06T03:38:37.591 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_write": 19, 2024-06-06T03:38:37.591 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writefull": 12, 2024-06-06T03:38:37.591 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writesame": 0, 2024-06-06T03:38:37.591 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_append": 0, 2024-06-06T03:38:37.591 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_zero": 0, 2024-06-06T03:38:37.591 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_truncate": 0, 2024-06-06T03:38:37.591 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_delete": 2609, 2024-06-06T03:38:37.591 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_mapext": 0, 2024-06-06T03:38:37.592 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_sparse_read": 0, 2024-06-06T03:38:37.592 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_clonerange": 0, 2024-06-06T03:38:37.592 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_getxattr": 34, 2024-06-06T03:38:37.592 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_setxattr": 20, 2024-06-06T03:38:37.592 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_cmpxattr": 0, 2024-06-06T03:38:37.592 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_rmxattr": 0, 2024-06-06T03:38:37.592 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_resetxattrs": 0, 2024-06-06T03:38:37.592 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_call": 0, 2024-06-06T03:38:37.592 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_watch": 0, 2024-06-06T03:38:37.592 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_notify": 0, 2024-06-06T03:38:37.592 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_src_cmpxattr": 0, 2024-06-06T03:38:37.592 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls": 0, 2024-06-06T03:38:37.592 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls_filter": 0, 2024-06-06T03:38:37.592 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_other": 0, 2024-06-06T03:38:37.593 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_active": 0, 2024-06-06T03:38:37.593 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_send": 0, 2024-06-06T03:38:37.593 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_resend": 0, 2024-06-06T03:38:37.593 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_ping": 0, 2024-06-06T03:38:37.593 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_active": 0, 2024-06-06T03:38:37.593 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_send": 0, 2024-06-06T03:38:37.593 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_resend": 0, 2024-06-06T03:38:37.593 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_active": 0, 2024-06-06T03:38:37.593 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_send": 0, 2024-06-06T03:38:37.593 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_resend": 0, 2024-06-06T03:38:37.593 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_active": 0, 2024-06-06T03:38:37.593 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_send": 0, 2024-06-06T03:38:37.593 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_resend": 0, 2024-06-06T03:38:37.593 INFO:teuthology.orchestra.run.smithi122.stdout: "command_active": 0, 2024-06-06T03:38:37.594 INFO:teuthology.orchestra.run.smithi122.stdout: "command_send": 0, 2024-06-06T03:38:37.594 INFO:teuthology.orchestra.run.smithi122.stdout: "command_resend": 0, 2024-06-06T03:38:37.594 INFO:teuthology.orchestra.run.smithi122.stdout: "map_epoch": 99, 2024-06-06T03:38:37.594 INFO:teuthology.orchestra.run.smithi122.stdout: "map_full": 0, 2024-06-06T03:38:37.594 INFO:teuthology.orchestra.run.smithi122.stdout: "map_inc": 2, 2024-06-06T03:38:37.594 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_sessions": 12, 2024-06-06T03:38:37.594 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_open": 12, 2024-06-06T03:38:37.594 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_close": 0, 2024-06-06T03:38:37.594 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_laggy": 0, 2024-06-06T03:38:37.594 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_wr": 27, 2024-06-06T03:38:37.594 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_rd": 0, 2024-06-06T03:38:37.594 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_del": 5 2024-06-06T03:38:37.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.595 INFO:teuthology.orchestra.run.smithi122.stdout: "oft": { 2024-06-06T03:38:37.595 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_objs": 1, 2024-06-06T03:38:37.595 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_kv_pairs": 0, 2024-06-06T03:38:37.595 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_updates": 0, 2024-06-06T03:38:37.595 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_removes": 0 2024-06-06T03:38:37.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.595 INFO:teuthology.orchestra.run.smithi122.stdout: "osd-slow-ops": { 2024-06-06T03:38:37.595 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_ops_count": 0 2024-06-06T03:38:37.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.595 INFO:teuthology.orchestra.run.smithi122.stdout: "purge_queue": { 2024-06-06T03:38:37.595 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops": 0, 2024-06-06T03:38:37.595 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops_high_water": 528, 2024-06-06T03:38:37.595 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing": 0, 2024-06-06T03:38:37.596 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_high_water": 9, 2024-06-06T03:38:37.596 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed_ops": 2597, 2024-06-06T03:38:37.596 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed": 19, 2024-06-06T03:38:37.596 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_item_in_journal": 0 2024-06-06T03:38:37.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.596 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T03:38:37.596 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-06-06T03:38:37.596 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-06-06T03:38:37.596 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-06-06T03:38:37.596 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 3873, 2024-06-06T03:38:37.596 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 1228347, 2024-06-06T03:38:37.596 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:37.596 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 3873, 2024-06-06T03:38:37.596 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-06-06T03:38:37.597 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-06-06T03:38:37.597 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 3873, 2024-06-06T03:38:37.597 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 1228347, 2024-06-06T03:38:37.597 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-06-06T03:38:37.597 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:37.597 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:37.597 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:37.597 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:37.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.597 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_bytes": { 2024-06-06T03:38:37.597 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-06-06T03:38:37.597 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-06-06T03:38:37.597 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-06-06T03:38:37.597 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-06-06T03:38:37.598 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-06-06T03:38:37.598 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:37.598 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-06-06T03:38:37.598 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 2705, 2024-06-06T03:38:37.598 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 158102, 2024-06-06T03:38:37.598 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 2705, 2024-06-06T03:38:37.598 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 158102, 2024-06-06T03:38:37.598 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-06-06T03:38:37.598 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:37.598 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:37.598 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:37.598 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:37.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.599 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_ops": { 2024-06-06T03:38:37.599 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-06-06T03:38:37.599 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1024, 2024-06-06T03:38:37.599 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-06-06T03:38:37.599 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-06-06T03:38:37.599 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-06-06T03:38:37.599 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:37.599 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-06-06T03:38:37.599 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 2705, 2024-06-06T03:38:37.599 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 2705, 2024-06-06T03:38:37.599 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 2705, 2024-06-06T03:38:37.599 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 2705, 2024-06-06T03:38:37.599 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-06-06T03:38:37.600 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:37.600 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:37.600 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:37.600 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:37.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.600 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle": { 2024-06-06T03:38:37.600 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-06-06T03:38:37.600 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-06-06T03:38:37.600 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-06-06T03:38:37.600 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 19, 2024-06-06T03:38:37.600 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 2063, 2024-06-06T03:38:37.600 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:37.600 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 19, 2024-06-06T03:38:37.600 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-06-06T03:38:37.600 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-06-06T03:38:37.601 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 1, 2024-06-06T03:38:37.601 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 2063, 2024-06-06T03:38:37.601 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-06-06T03:38:37.601 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:37.601 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:37.601 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:37.601 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:37.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:37.601 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle-0x562af3a8c500": { 2024-06-06T03:38:37.601 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-06-06T03:38:37.601 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-06-06T03:38:37.601 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-06-06T03:38:37.601 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 69, 2024-06-06T03:38:37.601 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 140576, 2024-06-06T03:38:37.602 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:37.602 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 69, 2024-06-06T03:38:37.602 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-06-06T03:38:37.602 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-06-06T03:38:37.602 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 18, 2024-06-06T03:38:37.602 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 140576, 2024-06-06T03:38:37.602 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-06-06T03:38:37.602 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:37.602 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:37.602 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:37.602 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:37.602 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:37.602 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-06-06T03:38:38.309 INFO:tasks.check_counter:Daemon mds.c mds.exported=1 2024-06-06T03:38:38.309 INFO:tasks.check_counter:Daemon mds.c mds.imported=2 2024-06-06T03:38:38.309 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=1 2024-06-06T03:38:38.309 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=14 2024-06-06T03:38:38.309 DEBUG:tasks.check_counter:Getting stats from f 2024-06-06T03:38:38.309 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph daemon mds.f perf dump 2024-06-06T03:38:38.562 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T03:38:39.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:39 smithi122 ceph-mon[35759]: pgmap v791: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:38:39.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:39 smithi050 ceph-mon[32421]: pgmap v791: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:38:39.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:39 smithi079 ceph-mon[35478]: pgmap v791: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:38:40.553 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-06-06T03:38:40.554 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T03:38:40.554 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 43, 2024-06-06T03:38:40.554 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 43, 2024-06-06T03:38:40.554 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 11647, 2024-06-06T03:38:40.554 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 62727, 2024-06-06T03:38:40.554 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 15, 2024-06-06T03:38:40.554 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 2, 2024-06-06T03:38:40.554 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.008598868, 2024-06-06T03:38:40.554 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.000780788, 2024-06-06T03:38:40.554 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.004499313, 2024-06-06T03:38:40.555 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.000454942, 2024-06-06T03:38:40.555 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:40.555 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 42, 2024-06-06T03:38:40.555 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.011160969, 2024-06-06T03:38:40.555 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000265737 2024-06-06T03:38:40.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.555 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:40.555 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 31, 2024-06-06T03:38:40.555 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000005966, 2024-06-06T03:38:40.555 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000192 2024-06-06T03:38:40.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.555 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 3920, 2024-06-06T03:38:40.555 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 1184 2024-06-06T03:38:40.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.556 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T03:38:40.556 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 460, 2024-06-06T03:38:40.556 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 413, 2024-06-06T03:38:40.556 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 663974, 2024-06-06T03:38:40.556 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 255100, 2024-06-06T03:38:40.556 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 8, 2024-06-06T03:38:40.556 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 5, 2024-06-06T03:38:40.556 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.048211619, 2024-06-06T03:38:40.556 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.018014462, 2024-06-06T03:38:40.556 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.024882456, 2024-06-06T03:38:40.556 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.006814477, 2024-06-06T03:38:40.556 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:40.556 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 412, 2024-06-06T03:38:40.557 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.032821665, 2024-06-06T03:38:40.557 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000079664 2024-06-06T03:38:40.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.557 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:40.557 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 195, 2024-06-06T03:38:40.557 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000032792, 2024-06-06T03:38:40.557 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000168 2024-06-06T03:38:40.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.557 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 577040, 2024-06-06T03:38:40.557 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 170528 2024-06-06T03:38:40.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.557 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T03:38:40.557 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 591, 2024-06-06T03:38:40.557 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 922, 2024-06-06T03:38:40.557 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 184075, 2024-06-06T03:38:40.558 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 1067532, 2024-06-06T03:38:40.558 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 32, 2024-06-06T03:38:40.558 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 5, 2024-06-06T03:38:40.558 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.090862563, 2024-06-06T03:38:40.558 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.040448608, 2024-06-06T03:38:40.558 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.044872777, 2024-06-06T03:38:40.558 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.004200298, 2024-06-06T03:38:40.558 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:40.558 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 920, 2024-06-06T03:38:40.558 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.047790367, 2024-06-06T03:38:40.558 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000051946 2024-06-06T03:38:40.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.559 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:40.559 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1250, 2024-06-06T03:38:40.559 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000288229, 2024-06-06T03:38:40.559 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000230 2024-06-06T03:38:40.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.559 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-06T03:38:40.559 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 504480 2024-06-06T03:38:40.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.559 INFO:teuthology.orchestra.run.smithi122.stdout: "cct": { 2024-06-06T03:38:40.559 INFO:teuthology.orchestra.run.smithi122.stdout: "total_workers": 1, 2024-06-06T03:38:40.559 INFO:teuthology.orchestra.run.smithi122.stdout: "unhealthy_workers": 0 2024-06-06T03:38:40.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.559 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-MDSRank": { 2024-06-06T03:38:40.559 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-06-06T03:38:40.560 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-06-06T03:38:40.560 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 35, 2024-06-06T03:38:40.560 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000975281, 2024-06-06T03:38:40.560 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000027865 2024-06-06T03:38:40.560 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:40.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.560 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-PurgeQueue": { 2024-06-06T03:38:40.560 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-06-06T03:38:40.560 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-06-06T03:38:40.560 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 2, 2024-06-06T03:38:40.560 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000004715, 2024-06-06T03:38:40.560 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000002357 2024-06-06T03:38:40.560 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:40.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.561 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": { 2024-06-06T03:38:40.561 INFO:teuthology.orchestra.run.smithi122.stdout: "request": 0, 2024-06-06T03:38:40.561 INFO:teuthology.orchestra.run.smithi122.stdout: "reply": 0, 2024-06-06T03:38:40.561 INFO:teuthology.orchestra.run.smithi122.stdout: "reply_latency": { 2024-06-06T03:38:40.562 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.562 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.562 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.562 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_reply": 0, 2024-06-06T03:38:40.562 INFO:teuthology.orchestra.run.smithi122.stdout: "forward": 0, 2024-06-06T03:38:40.562 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_complete": 0, 2024-06-06T03:38:40.562 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_keys": 0, 2024-06-06T03:38:40.562 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_commit": 11, 2024-06-06T03:38:40.562 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_split": 0, 2024-06-06T03:38:40.562 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_merge": 0, 2024-06-06T03:38:40.563 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes": 17, 2024-06-06T03:38:40.563 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_top": 1, 2024-06-06T03:38:40.563 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_bottom": 16, 2024-06-06T03:38:40.563 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pin_tail": 0, 2024-06-06T03:38:40.563 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pinned": 13, 2024-06-06T03:38:40.563 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_expired": 8, 2024-06-06T03:38:40.563 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_with_caps": 0, 2024-06-06T03:38:40.563 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": 0, 2024-06-06T03:38:40.563 INFO:teuthology.orchestra.run.smithi122.stdout: "subtrees": 4, 2024-06-06T03:38:40.563 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse": 11, 2024-06-06T03:38:40.563 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_hit": 7, 2024-06-06T03:38:40.563 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_forward": 0, 2024-06-06T03:38:40.563 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_discover": 4, 2024-06-06T03:38:40.564 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_dir_fetch": 0, 2024-06-06T03:38:40.564 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_remote_ino": 0, 2024-06-06T03:38:40.564 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_lock": 0, 2024-06-06T03:38:40.564 INFO:teuthology.orchestra.run.smithi122.stdout: "load_cent": 0, 2024-06-06T03:38:40.564 INFO:teuthology.orchestra.run.smithi122.stdout: "q": 0, 2024-06-06T03:38:40.564 INFO:teuthology.orchestra.run.smithi122.stdout: "exported": 0, 2024-06-06T03:38:40.564 INFO:teuthology.orchestra.run.smithi122.stdout: "exported_inodes": 0, 2024-06-06T03:38:40.564 INFO:teuthology.orchestra.run.smithi122.stdout: "imported": 0, 2024-06-06T03:38:40.564 INFO:teuthology.orchestra.run.smithi122.stdout: "imported_inodes": 0, 2024-06-06T03:38:40.564 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_dir_fetch": 0, 2024-06-06T03:38:40.564 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_backtrace_fetch": 0, 2024-06-06T03:38:40.564 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_peer_discover": 0, 2024-06-06T03:38:40.564 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rfiles": 22, 2024-06-06T03:38:40.564 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rbytes": 7436767516, 2024-06-06T03:38:40.565 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rsnaps": 0, 2024-06-06T03:38:40.565 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_fetch": 0, 2024-06-06T03:38:40.565 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_set_tag": 0, 2024-06-06T03:38:40.565 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_repaired": 0, 2024-06-06T03:38:40.565 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_inotable_repaired": 0, 2024-06-06T03:38:40.565 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_inodes": 0, 2024-06-06T03:38:40.565 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_base_inodes": 0, 2024-06-06T03:38:40.565 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dirfrag_rstats": 0, 2024-06-06T03:38:40.565 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_file_inodes": 0, 2024-06-06T03:38:40.565 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_inode_file_caps": 0, 2024-06-06T03:38:40.565 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_revoke": 0, 2024-06-06T03:38:40.565 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_grant": 0, 2024-06-06T03:38:40.565 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_trunc": 0, 2024-06-06T03:38:40.565 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-06T03:38:40.565 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-06T03:38:40.566 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps": 0, 2024-06-06T03:38:40.566 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps_dirty": 0, 2024-06-06T03:38:40.566 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_cap_release": 0, 2024-06-06T03:38:40.566 INFO:teuthology.orchestra.run.smithi122.stdout: "process_request_cap_release": 0 2024-06-06T03:38:40.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.566 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cache": { 2024-06-06T03:38:40.566 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update": 0, 2024-06-06T03:38:40.566 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update_receipt": 16, 2024-06-06T03:38:40.566 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_try_discover": 10, 2024-06-06T03:38:40.566 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_send_discover": 11, 2024-06-06T03:38:40.566 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_handle_discover": 0, 2024-06-06T03:38:40.566 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays": 0, 2024-06-06T03:38:40.567 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_delayed": 0, 2024-06-06T03:38:40.567 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_enqueuing": 0, 2024-06-06T03:38:40.567 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_created": 0, 2024-06-06T03:38:40.567 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_enqueued": 0, 2024-06-06T03:38:40.567 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_reintegrated": 0, 2024-06-06T03:38:40.567 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_migrated": 0, 2024-06-06T03:38:40.567 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_processing": 0, 2024-06-06T03:38:40.567 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_enqueued": 0, 2024-06-06T03:38:40.567 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_prioritized": 0, 2024-06-06T03:38:40.567 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_started": 0, 2024-06-06T03:38:40.567 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_completed": 0, 2024-06-06T03:38:40.567 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_quiesce_path": 0, 2024-06-06T03:38:40.567 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_quiesce_inode": 0, 2024-06-06T03:38:40.567 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_enqueue_scrub": 0, 2024-06-06T03:38:40.567 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_exportdir": 0, 2024-06-06T03:38:40.568 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_flush": 0, 2024-06-06T03:38:40.568 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragmentdir": 0, 2024-06-06T03:38:40.568 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragstats": 0, 2024-06-06T03:38:40.568 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_inodestats": 0 2024-06-06T03:38:40.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.568 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_log": { 2024-06-06T03:38:40.568 INFO:teuthology.orchestra.run.smithi122.stdout: "evlrg": 0, 2024-06-06T03:38:40.568 INFO:teuthology.orchestra.run.smithi122.stdout: "evadd": 5, 2024-06-06T03:38:40.568 INFO:teuthology.orchestra.run.smithi122.stdout: "evex": 0, 2024-06-06T03:38:40.568 INFO:teuthology.orchestra.run.smithi122.stdout: "evtrm": 0, 2024-06-06T03:38:40.568 INFO:teuthology.orchestra.run.smithi122.stdout: "ev": 5, 2024-06-06T03:38:40.568 INFO:teuthology.orchestra.run.smithi122.stdout: "evexg": 0, 2024-06-06T03:38:40.568 INFO:teuthology.orchestra.run.smithi122.stdout: "evexd": 0, 2024-06-06T03:38:40.568 INFO:teuthology.orchestra.run.smithi122.stdout: "segadd": 2, 2024-06-06T03:38:40.569 INFO:teuthology.orchestra.run.smithi122.stdout: "segex": 0, 2024-06-06T03:38:40.569 INFO:teuthology.orchestra.run.smithi122.stdout: "segtrm": 0, 2024-06-06T03:38:40.569 INFO:teuthology.orchestra.run.smithi122.stdout: "seg": 2, 2024-06-06T03:38:40.569 INFO:teuthology.orchestra.run.smithi122.stdout: "segmjr": 2, 2024-06-06T03:38:40.569 INFO:teuthology.orchestra.run.smithi122.stdout: "segexg": 0, 2024-06-06T03:38:40.569 INFO:teuthology.orchestra.run.smithi122.stdout: "segexd": 0, 2024-06-06T03:38:40.569 INFO:teuthology.orchestra.run.smithi122.stdout: "expos": 4194304, 2024-06-06T03:38:40.569 INFO:teuthology.orchestra.run.smithi122.stdout: "wrpos": 4195915, 2024-06-06T03:38:40.569 INFO:teuthology.orchestra.run.smithi122.stdout: "rdpos": 0, 2024-06-06T03:38:40.569 INFO:teuthology.orchestra.run.smithi122.stdout: "jlat": { 2024-06-06T03:38:40.569 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 4, 2024-06-06T03:38:40.569 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.006759056, 2024-06-06T03:38:40.569 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.001689764 2024-06-06T03:38:40.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.569 INFO:teuthology.orchestra.run.smithi122.stdout: "replayed": 0 2024-06-06T03:38:40.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.570 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_mem": { 2024-06-06T03:38:40.570 INFO:teuthology.orchestra.run.smithi122.stdout: "ino": 22, 2024-06-06T03:38:40.570 INFO:teuthology.orchestra.run.smithi122.stdout: "ino+": 26, 2024-06-06T03:38:40.570 INFO:teuthology.orchestra.run.smithi122.stdout: "ino-": 4, 2024-06-06T03:38:40.570 INFO:teuthology.orchestra.run.smithi122.stdout: "dir": 21, 2024-06-06T03:38:40.570 INFO:teuthology.orchestra.run.smithi122.stdout: "dir+": 28, 2024-06-06T03:38:40.570 INFO:teuthology.orchestra.run.smithi122.stdout: "dir-": 7, 2024-06-06T03:38:40.570 INFO:teuthology.orchestra.run.smithi122.stdout: "dn": 17, 2024-06-06T03:38:40.570 INFO:teuthology.orchestra.run.smithi122.stdout: "dn+": 25, 2024-06-06T03:38:40.570 INFO:teuthology.orchestra.run.smithi122.stdout: "dn-": 8, 2024-06-06T03:38:40.570 INFO:teuthology.orchestra.run.smithi122.stdout: "cap": 0, 2024-06-06T03:38:40.570 INFO:teuthology.orchestra.run.smithi122.stdout: "cap+": 0, 2024-06-06T03:38:40.571 INFO:teuthology.orchestra.run.smithi122.stdout: "cap-": 0, 2024-06-06T03:38:40.571 INFO:teuthology.orchestra.run.smithi122.stdout: "rss": 52084, 2024-06-06T03:38:40.571 INFO:teuthology.orchestra.run.smithi122.stdout: "heap": 223612 2024-06-06T03:38:40.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.571 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_server": { 2024-06-06T03:38:40.571 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_client_request": 0, 2024-06-06T03:38:40.571 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_server_request": 1, 2024-06-06T03:38:40.571 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_request": 0, 2024-06-06T03:38:40.571 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_session": 14, 2024-06-06T03:38:40.571 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_peer_request": 2, 2024-06-06T03:38:40.571 INFO:teuthology.orchestra.run.smithi122.stdout: "req_create_latency": { 2024-06-06T03:38:40.571 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.571 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.571 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.572 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getattr_latency": { 2024-06-06T03:38:40.572 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.572 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.572 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.572 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getfilelock_latency": { 2024-06-06T03:38:40.572 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.572 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.572 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.572 INFO:teuthology.orchestra.run.smithi122.stdout: "req_link_latency": { 2024-06-06T03:38:40.572 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.572 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.572 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.573 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookup_latency": { 2024-06-06T03:38:40.573 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.573 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.573 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.573 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookuphash_latency": { 2024-06-06T03:38:40.573 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.573 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.573 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.573 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupino_latency": { 2024-06-06T03:38:40.573 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.573 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.574 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.574 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupname_latency": { 2024-06-06T03:38:40.574 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.574 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.574 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.574 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupparent_latency": { 2024-06-06T03:38:40.574 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.574 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.574 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.574 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupsnap_latency": { 2024-06-06T03:38:40.574 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.575 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.575 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.575 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lssnap_latency": { 2024-06-06T03:38:40.575 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.575 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.575 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.575 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mkdir_latency": { 2024-06-06T03:38:40.576 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.576 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.576 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.576 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mknod_latency": { 2024-06-06T03:38:40.576 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.576 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.576 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.576 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mksnap_latency": { 2024-06-06T03:38:40.576 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.577 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.577 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.577 INFO:teuthology.orchestra.run.smithi122.stdout: "req_open_latency": { 2024-06-06T03:38:40.577 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.577 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.577 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.577 INFO:teuthology.orchestra.run.smithi122.stdout: "req_readdir_latency": { 2024-06-06T03:38:40.577 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.577 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.577 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.577 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rename_latency": { 2024-06-06T03:38:40.577 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.578 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.578 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.578 INFO:teuthology.orchestra.run.smithi122.stdout: "req_renamesnap_latency": { 2024-06-06T03:38:40.578 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.578 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.578 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.578 INFO:teuthology.orchestra.run.smithi122.stdout: "req_snapdiff_latency": { 2024-06-06T03:38:40.578 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.578 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.578 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.578 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmdir_latency": { 2024-06-06T03:38:40.579 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.579 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.579 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.579 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmsnap_latency": { 2024-06-06T03:38:40.579 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.579 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.579 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.579 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmxattr_latency": { 2024-06-06T03:38:40.579 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.579 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.579 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.579 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setattr_latency": { 2024-06-06T03:38:40.580 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.580 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.580 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.580 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setdirlayout_latency": { 2024-06-06T03:38:40.580 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.580 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.580 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.580 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setfilelock_latency": { 2024-06-06T03:38:40.580 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.580 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.580 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.581 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setlayout_latency": { 2024-06-06T03:38:40.581 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.581 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.581 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.581 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setxattr_latency": { 2024-06-06T03:38:40.581 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.581 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.581 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.581 INFO:teuthology.orchestra.run.smithi122.stdout: "req_symlink_latency": { 2024-06-06T03:38:40.581 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.581 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.581 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.582 INFO:teuthology.orchestra.run.smithi122.stdout: "req_unlink_latency": { 2024-06-06T03:38:40.582 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.582 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.582 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.582 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_revoke_eviction": 0, 2024-06-06T03:38:40.582 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_acquisition_throttle": 0, 2024-06-06T03:38:40.582 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getvxattr_latency": { 2024-06-06T03:38:40.582 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.582 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.582 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.582 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:40.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.583 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_sessions": { 2024-06-06T03:38:40.583 INFO:teuthology.orchestra.run.smithi122.stdout: "session_count": 1, 2024-06-06T03:38:40.583 INFO:teuthology.orchestra.run.smithi122.stdout: "session_add": 2, 2024-06-06T03:38:40.583 INFO:teuthology.orchestra.run.smithi122.stdout: "session_remove": 1, 2024-06-06T03:38:40.583 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_open": 1, 2024-06-06T03:38:40.583 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_stale": 0, 2024-06-06T03:38:40.583 INFO:teuthology.orchestra.run.smithi122.stdout: "total_load": 0, 2024-06-06T03:38:40.583 INFO:teuthology.orchestra.run.smithi122.stdout: "average_load": 0, 2024-06-06T03:38:40.583 INFO:teuthology.orchestra.run.smithi122.stdout: "avg_session_uptime": 734, 2024-06-06T03:38:40.583 INFO:teuthology.orchestra.run.smithi122.stdout: "mdthresh_evicted": 0 2024-06-06T03:38:40.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.583 INFO:teuthology.orchestra.run.smithi122.stdout: "mempool": { 2024-06-06T03:38:40.583 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_bytes": 0, 2024-06-06T03:38:40.583 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_items": 0, 2024-06-06T03:38:40.584 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T03:38:40.584 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_items": 0, 2024-06-06T03:38:40.584 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T03:38:40.584 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_items": 0, 2024-06-06T03:38:40.584 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T03:38:40.584 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T03:38:40.584 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T03:38:40.584 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T03:38:40.584 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T03:38:40.584 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_items": 0, 2024-06-06T03:38:40.584 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T03:38:40.584 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T03:38:40.584 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_bytes": 0, 2024-06-06T03:38:40.584 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_items": 0, 2024-06-06T03:38:40.584 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_bytes": 0, 2024-06-06T03:38:40.585 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_items": 0, 2024-06-06T03:38:40.585 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T03:38:40.585 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T03:38:40.585 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T03:38:40.585 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T03:38:40.585 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T03:38:40.585 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_items": 0, 2024-06-06T03:38:40.585 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_bytes": 0, 2024-06-06T03:38:40.585 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_items": 0, 2024-06-06T03:38:40.585 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T03:38:40.585 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T03:38:40.585 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_bytes": 0, 2024-06-06T03:38:40.585 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_items": 0, 2024-06-06T03:38:40.585 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_bytes": 0, 2024-06-06T03:38:40.586 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_items": 0, 2024-06-06T03:38:40.586 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T03:38:40.586 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_items": 0, 2024-06-06T03:38:40.586 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T03:38:40.586 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_items": 0, 2024-06-06T03:38:40.586 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_bytes": 242975, 2024-06-06T03:38:40.586 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_items": 80, 2024-06-06T03:38:40.586 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_bytes": 0, 2024-06-06T03:38:40.586 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_items": 0, 2024-06-06T03:38:40.586 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_bytes": 0, 2024-06-06T03:38:40.586 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_items": 0, 2024-06-06T03:38:40.586 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_bytes": 0, 2024-06-06T03:38:40.586 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_items": 0, 2024-06-06T03:38:40.587 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_bytes": 0, 2024-06-06T03:38:40.587 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_items": 0, 2024-06-06T03:38:40.587 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_bytes": 8792, 2024-06-06T03:38:40.587 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_items": 168, 2024-06-06T03:38:40.587 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T03:38:40.587 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_items": 0, 2024-06-06T03:38:40.587 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_bytes": 0, 2024-06-06T03:38:40.587 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_items": 0, 2024-06-06T03:38:40.587 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_bytes": 88213, 2024-06-06T03:38:40.587 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_items": 339, 2024-06-06T03:38:40.587 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_bytes": 0, 2024-06-06T03:38:40.587 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_items": 0, 2024-06-06T03:38:40.587 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_bytes": 0, 2024-06-06T03:38:40.587 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_items": 0 2024-06-06T03:38:40.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.588 INFO:teuthology.orchestra.run.smithi122.stdout: "objecter": { 2024-06-06T03:38:40.588 INFO:teuthology.orchestra.run.smithi122.stdout: "op_active": 0, 2024-06-06T03:38:40.588 INFO:teuthology.orchestra.run.smithi122.stdout: "op_laggy": 0, 2024-06-06T03:38:40.588 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send": 40, 2024-06-06T03:38:40.588 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send_bytes": 11913, 2024-06-06T03:38:40.588 INFO:teuthology.orchestra.run.smithi122.stdout: "op_resend": 33, 2024-06-06T03:38:40.588 INFO:teuthology.orchestra.run.smithi122.stdout: "op_reply": 40, 2024-06-06T03:38:40.588 INFO:teuthology.orchestra.run.smithi122.stdout: "op_latency": { 2024-06-06T03:38:40.588 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 40, 2024-06-06T03:38:40.588 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.187995801, 2024-06-06T03:38:40.588 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.004699895 2024-06-06T03:38:40.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.588 INFO:teuthology.orchestra.run.smithi122.stdout: "op_inflight": 0, 2024-06-06T03:38:40.589 INFO:teuthology.orchestra.run.smithi122.stdout: "oplen_avg": { 2024-06-06T03:38:40.589 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 40, 2024-06-06T03:38:40.589 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 62 2024-06-06T03:38:40.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.589 INFO:teuthology.orchestra.run.smithi122.stdout: "op": 40, 2024-06-06T03:38:40.589 INFO:teuthology.orchestra.run.smithi122.stdout: "op_r": 0, 2024-06-06T03:38:40.589 INFO:teuthology.orchestra.run.smithi122.stdout: "op_w": 40, 2024-06-06T03:38:40.589 INFO:teuthology.orchestra.run.smithi122.stdout: "op_rmw": 0, 2024-06-06T03:38:40.589 INFO:teuthology.orchestra.run.smithi122.stdout: "op_pg": 0, 2024-06-06T03:38:40.589 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_stat": 0, 2024-06-06T03:38:40.589 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_create": 10, 2024-06-06T03:38:40.589 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_read": 0, 2024-06-06T03:38:40.589 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_write": 4, 2024-06-06T03:38:40.589 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writefull": 7, 2024-06-06T03:38:40.590 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writesame": 0, 2024-06-06T03:38:40.590 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_append": 0, 2024-06-06T03:38:40.590 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_zero": 0, 2024-06-06T03:38:40.590 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_truncate": 0, 2024-06-06T03:38:40.590 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_delete": 6, 2024-06-06T03:38:40.590 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_mapext": 0, 2024-06-06T03:38:40.590 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_sparse_read": 0, 2024-06-06T03:38:40.590 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_clonerange": 0, 2024-06-06T03:38:40.590 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_getxattr": 0, 2024-06-06T03:38:40.590 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_setxattr": 20, 2024-06-06T03:38:40.590 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_cmpxattr": 0, 2024-06-06T03:38:40.590 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_rmxattr": 0, 2024-06-06T03:38:40.590 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_resetxattrs": 0, 2024-06-06T03:38:40.590 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_call": 0, 2024-06-06T03:38:40.591 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_watch": 0, 2024-06-06T03:38:40.591 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_notify": 0, 2024-06-06T03:38:40.591 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_src_cmpxattr": 0, 2024-06-06T03:38:40.591 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls": 0, 2024-06-06T03:38:40.591 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls_filter": 0, 2024-06-06T03:38:40.591 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_other": 0, 2024-06-06T03:38:40.591 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_active": 0, 2024-06-06T03:38:40.591 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_send": 0, 2024-06-06T03:38:40.591 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_resend": 0, 2024-06-06T03:38:40.591 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_ping": 0, 2024-06-06T03:38:40.591 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_active": 0, 2024-06-06T03:38:40.591 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_send": 0, 2024-06-06T03:38:40.591 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_resend": 0, 2024-06-06T03:38:40.591 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_active": 0, 2024-06-06T03:38:40.592 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_send": 0, 2024-06-06T03:38:40.592 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_resend": 0, 2024-06-06T03:38:40.592 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_active": 0, 2024-06-06T03:38:40.592 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_send": 0, 2024-06-06T03:38:40.592 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_resend": 0, 2024-06-06T03:38:40.592 INFO:teuthology.orchestra.run.smithi122.stdout: "command_active": 0, 2024-06-06T03:38:40.592 INFO:teuthology.orchestra.run.smithi122.stdout: "command_send": 0, 2024-06-06T03:38:40.592 INFO:teuthology.orchestra.run.smithi122.stdout: "command_resend": 0, 2024-06-06T03:38:40.592 INFO:teuthology.orchestra.run.smithi122.stdout: "map_epoch": 99, 2024-06-06T03:38:40.592 INFO:teuthology.orchestra.run.smithi122.stdout: "map_full": 0, 2024-06-06T03:38:40.592 INFO:teuthology.orchestra.run.smithi122.stdout: "map_inc": 2, 2024-06-06T03:38:40.592 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_sessions": 8, 2024-06-06T03:38:40.592 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_open": 13, 2024-06-06T03:38:40.592 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_close": 5, 2024-06-06T03:38:40.593 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_laggy": 0, 2024-06-06T03:38:40.593 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_wr": 14, 2024-06-06T03:38:40.593 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_rd": 0, 2024-06-06T03:38:40.593 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_del": 1 2024-06-06T03:38:40.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.593 INFO:teuthology.orchestra.run.smithi122.stdout: "oft": { 2024-06-06T03:38:40.593 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_objs": 1, 2024-06-06T03:38:40.593 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_kv_pairs": 0, 2024-06-06T03:38:40.593 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_updates": 0, 2024-06-06T03:38:40.593 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_removes": 0 2024-06-06T03:38:40.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.593 INFO:teuthology.orchestra.run.smithi122.stdout: "osd-slow-ops": { 2024-06-06T03:38:40.593 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_ops_count": 0 2024-06-06T03:38:40.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.594 INFO:teuthology.orchestra.run.smithi122.stdout: "purge_queue": { 2024-06-06T03:38:40.594 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops": 0, 2024-06-06T03:38:40.594 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops_high_water": 0, 2024-06-06T03:38:40.594 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing": 0, 2024-06-06T03:38:40.594 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_high_water": 0, 2024-06-06T03:38:40.594 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed_ops": 0, 2024-06-06T03:38:40.594 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed": 0, 2024-06-06T03:38:40.594 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_item_in_journal": 0 2024-06-06T03:38:40.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.594 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T03:38:40.594 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-06-06T03:38:40.594 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-06-06T03:38:40.594 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-06-06T03:38:40.594 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 1090, 2024-06-06T03:38:40.595 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 742012, 2024-06-06T03:38:40.595 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:40.595 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 1090, 2024-06-06T03:38:40.595 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-06-06T03:38:40.595 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-06-06T03:38:40.595 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 1090, 2024-06-06T03:38:40.595 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 742012, 2024-06-06T03:38:40.595 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-06-06T03:38:40.595 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.595 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.595 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.595 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:40.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.595 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_bytes": { 2024-06-06T03:38:40.595 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-06-06T03:38:40.596 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-06-06T03:38:40.596 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-06-06T03:38:40.596 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-06-06T03:38:40.596 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-06-06T03:38:40.596 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:40.596 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-06-06T03:38:40.596 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 40, 2024-06-06T03:38:40.596 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 11913, 2024-06-06T03:38:40.596 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 40, 2024-06-06T03:38:40.596 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 11913, 2024-06-06T03:38:40.596 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-06-06T03:38:40.596 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.596 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.596 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.597 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:40.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.597 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_ops": { 2024-06-06T03:38:40.597 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-06-06T03:38:40.597 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1024, 2024-06-06T03:38:40.597 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-06-06T03:38:40.597 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-06-06T03:38:40.597 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-06-06T03:38:40.597 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:40.597 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-06-06T03:38:40.597 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 40, 2024-06-06T03:38:40.597 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 40, 2024-06-06T03:38:40.597 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 40, 2024-06-06T03:38:40.597 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 40, 2024-06-06T03:38:40.597 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-06-06T03:38:40.597 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.598 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.598 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.598 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:40.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.598 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle": { 2024-06-06T03:38:40.598 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-06-06T03:38:40.598 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-06-06T03:38:40.598 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-06-06T03:38:40.598 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-06-06T03:38:40.598 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-06-06T03:38:40.598 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:40.598 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-06-06T03:38:40.598 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-06-06T03:38:40.598 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-06-06T03:38:40.598 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 0, 2024-06-06T03:38:40.599 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 0, 2024-06-06T03:38:40.599 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-06-06T03:38:40.599 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.599 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.599 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.599 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:40.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:40.599 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle-0x557b53844500": { 2024-06-06T03:38:40.599 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-06-06T03:38:40.599 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-06-06T03:38:40.599 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-06-06T03:38:40.599 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 5, 2024-06-06T03:38:40.599 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 1611, 2024-06-06T03:38:40.599 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:40.599 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 5, 2024-06-06T03:38:40.600 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-06-06T03:38:40.600 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-06-06T03:38:40.600 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 4, 2024-06-06T03:38:40.600 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 1611, 2024-06-06T03:38:40.600 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-06-06T03:38:40.600 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:40.600 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:40.600 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:40.600 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:40.600 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:40.600 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-06-06T03:38:41.367 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:41 smithi122 ceph-mon[35759]: pgmap v792: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-06-06T03:38:41.368 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-06-06T03:38:41.369 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-06-06T03:38:41.369 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-06-06T03:38:41.369 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=16 2024-06-06T03:38:41.369 DEBUG:tasks.check_counter:Getting stats from i 2024-06-06T03:38:41.369 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph daemon mds.i perf dump 2024-06-06T03:38:41.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:41 smithi050 ceph-mon[32421]: pgmap v792: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-06-06T03:38:41.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:41 smithi079 ceph-mon[35478]: pgmap v792: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-06-06T03:38:41.756 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T03:38:43.266 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:43 smithi122 ceph-mon[35759]: pgmap v793: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T03:38:43.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:43 smithi050 ceph-mon[32421]: pgmap v793: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T03:38:43.542 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-06-06T03:38:43.542 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T03:38:43.542 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 1974, 2024-06-06T03:38:43.542 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 1297, 2024-06-06T03:38:43.542 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 667030, 2024-06-06T03:38:43.542 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 3734937, 2024-06-06T03:38:43.542 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 199, 2024-06-06T03:38:43.542 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 5, 2024-06-06T03:38:43.542 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.244340875, 2024-06-06T03:38:43.542 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.041640945, 2024-06-06T03:38:43.543 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.121861027, 2024-06-06T03:38:43.543 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.063185599, 2024-06-06T03:38:43.543 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:43.543 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1293, 2024-06-06T03:38:43.543 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.510261207, 2024-06-06T03:38:43.543 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000394633 2024-06-06T03:38:43.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.543 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:43.543 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1693, 2024-06-06T03:38:43.543 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000293475, 2024-06-06T03:38:43.543 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000173 2024-06-06T03:38:43.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.543 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 61968, 2024-06-06T03:38:43.544 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 30784 2024-06-06T03:38:43.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.544 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T03:38:43.544 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 1047, 2024-06-06T03:38:43.544 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 1116, 2024-06-06T03:38:43.544 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 407856, 2024-06-06T03:38:43.544 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 788570, 2024-06-06T03:38:43.544 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 9, 2024-06-06T03:38:43.544 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 5, 2024-06-06T03:38:43.544 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.112713199, 2024-06-06T03:38:43.544 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.042884836, 2024-06-06T03:38:43.544 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.039862400, 2024-06-06T03:38:43.544 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.025344097, 2024-06-06T03:38:43.544 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:43.545 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1117, 2024-06-06T03:38:43.545 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.105041075, 2024-06-06T03:38:43.545 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000094038 2024-06-06T03:38:43.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.545 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:43.545 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1202, 2024-06-06T03:38:43.545 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000284864, 2024-06-06T03:38:43.545 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000236 2024-06-06T03:38:43.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.545 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-06T03:38:43.545 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 440048 2024-06-06T03:38:43.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.545 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T03:38:43.546 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 1626, 2024-06-06T03:38:43.546 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 1446, 2024-06-06T03:38:43.546 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 1062381, 2024-06-06T03:38:43.546 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 692443, 2024-06-06T03:38:43.546 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 10, 2024-06-06T03:38:43.546 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 6, 2024-06-06T03:38:43.546 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.163341085, 2024-06-06T03:38:43.546 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.063306615, 2024-06-06T03:38:43.546 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.066726955, 2024-06-06T03:38:43.546 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.035629931, 2024-06-06T03:38:43.546 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:43.546 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1445, 2024-06-06T03:38:43.546 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.196713124, 2024-06-06T03:38:43.547 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000136133 2024-06-06T03:38:43.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.547 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:43.547 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1388, 2024-06-06T03:38:43.547 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000333835, 2024-06-06T03:38:43.547 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000240 2024-06-06T03:38:43.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.547 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 598048, 2024-06-06T03:38:43.547 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 186480 2024-06-06T03:38:43.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.547 INFO:teuthology.orchestra.run.smithi122.stdout: "cct": { 2024-06-06T03:38:43.547 INFO:teuthology.orchestra.run.smithi122.stdout: "total_workers": 1, 2024-06-06T03:38:43.547 INFO:teuthology.orchestra.run.smithi122.stdout: "unhealthy_workers": 0 2024-06-06T03:38:43.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.548 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-MDSRank": { 2024-06-06T03:38:43.548 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-06-06T03:38:43.548 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-06-06T03:38:43.548 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1232, 2024-06-06T03:38:43.548 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.232784048, 2024-06-06T03:38:43.548 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000188948 2024-06-06T03:38:43.548 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:43.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.548 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-PurgeQueue": { 2024-06-06T03:38:43.548 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-06-06T03:38:43.548 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-06-06T03:38:43.548 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 23, 2024-06-06T03:38:43.548 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000607100, 2024-06-06T03:38:43.548 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000026395 2024-06-06T03:38:43.549 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:43.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.549 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": { 2024-06-06T03:38:43.549 INFO:teuthology.orchestra.run.smithi122.stdout: "request": 127, 2024-06-06T03:38:43.549 INFO:teuthology.orchestra.run.smithi122.stdout: "reply": 111, 2024-06-06T03:38:43.549 INFO:teuthology.orchestra.run.smithi122.stdout: "reply_latency": { 2024-06-06T03:38:43.549 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 111, 2024-06-06T03:38:43.549 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.169849581, 2024-06-06T03:38:43.549 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.001530176 2024-06-06T03:38:43.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.549 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_reply": 0, 2024-06-06T03:38:43.549 INFO:teuthology.orchestra.run.smithi122.stdout: "forward": 16, 2024-06-06T03:38:43.549 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_complete": 1, 2024-06-06T03:38:43.550 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_keys": 0, 2024-06-06T03:38:43.550 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_commit": 162, 2024-06-06T03:38:43.550 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_split": 0, 2024-06-06T03:38:43.550 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_merge": 0, 2024-06-06T03:38:43.550 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes": 23, 2024-06-06T03:38:43.550 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_top": 4, 2024-06-06T03:38:43.550 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_bottom": 9, 2024-06-06T03:38:43.550 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pin_tail": 10, 2024-06-06T03:38:43.550 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pinned": 16, 2024-06-06T03:38:43.550 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_expired": 24, 2024-06-06T03:38:43.550 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_with_caps": 2, 2024-06-06T03:38:43.550 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": 2, 2024-06-06T03:38:43.551 INFO:teuthology.orchestra.run.smithi122.stdout: "subtrees": 3, 2024-06-06T03:38:43.551 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse": 201, 2024-06-06T03:38:43.551 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_hit": 173, 2024-06-06T03:38:43.551 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_forward": 15, 2024-06-06T03:38:43.551 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_discover": 0, 2024-06-06T03:38:43.551 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_dir_fetch": 0, 2024-06-06T03:38:43.551 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_remote_ino": 0, 2024-06-06T03:38:43.551 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_lock": 0, 2024-06-06T03:38:43.551 INFO:teuthology.orchestra.run.smithi122.stdout: "load_cent": 6, 2024-06-06T03:38:43.551 INFO:teuthology.orchestra.run.smithi122.stdout: "q": 0, 2024-06-06T03:38:43.551 INFO:teuthology.orchestra.run.smithi122.stdout: "exported": 2, 2024-06-06T03:38:43.551 INFO:teuthology.orchestra.run.smithi122.stdout: "exported_inodes": 20, 2024-06-06T03:38:43.551 INFO:teuthology.orchestra.run.smithi122.stdout: "imported": 1, 2024-06-06T03:38:43.551 INFO:teuthology.orchestra.run.smithi122.stdout: "imported_inodes": 1, 2024-06-06T03:38:43.552 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_dir_fetch": 0, 2024-06-06T03:38:43.552 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_backtrace_fetch": 266, 2024-06-06T03:38:43.552 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_peer_discover": 0, 2024-06-06T03:38:43.552 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rfiles": 4, 2024-06-06T03:38:43.552 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rbytes": 234, 2024-06-06T03:38:43.552 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rsnaps": 0, 2024-06-06T03:38:43.552 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_fetch": 266, 2024-06-06T03:38:43.552 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_set_tag": 0, 2024-06-06T03:38:43.552 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_repaired": 0, 2024-06-06T03:38:43.552 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_inotable_repaired": 0, 2024-06-06T03:38:43.552 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_inodes": 110, 2024-06-06T03:38:43.552 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_base_inodes": 11, 2024-06-06T03:38:43.552 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dirfrag_rstats": 99, 2024-06-06T03:38:43.553 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_file_inodes": 156, 2024-06-06T03:38:43.553 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_inode_file_caps": 0, 2024-06-06T03:38:43.553 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_revoke": 31, 2024-06-06T03:38:43.553 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_grant": 102, 2024-06-06T03:38:43.553 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_trunc": 0, 2024-06-06T03:38:43.553 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-06T03:38:43.553 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-06T03:38:43.553 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps": 163, 2024-06-06T03:38:43.553 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps_dirty": 128, 2024-06-06T03:38:43.553 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_cap_release": 4, 2024-06-06T03:38:43.553 INFO:teuthology.orchestra.run.smithi122.stdout: "process_request_cap_release": 44 2024-06-06T03:38:43.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.553 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cache": { 2024-06-06T03:38:43.553 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update": 10, 2024-06-06T03:38:43.554 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update_receipt": 0, 2024-06-06T03:38:43.554 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_try_discover": 0, 2024-06-06T03:38:43.554 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_send_discover": 0, 2024-06-06T03:38:43.554 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_handle_discover": 20, 2024-06-06T03:38:43.554 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays": 0, 2024-06-06T03:38:43.554 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_delayed": 0, 2024-06-06T03:38:43.554 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_enqueuing": 0, 2024-06-06T03:38:43.554 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_created": 2, 2024-06-06T03:38:43.554 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_enqueued": 2, 2024-06-06T03:38:43.554 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_reintegrated": 0, 2024-06-06T03:38:43.554 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_migrated": 0, 2024-06-06T03:38:43.554 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_processing": 0, 2024-06-06T03:38:43.554 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_enqueued": 0, 2024-06-06T03:38:43.555 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_prioritized": 0, 2024-06-06T03:38:43.555 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_started": 0, 2024-06-06T03:38:43.555 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_completed": 0, 2024-06-06T03:38:43.555 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_quiesce_path": 0, 2024-06-06T03:38:43.555 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_quiesce_inode": 0, 2024-06-06T03:38:43.555 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_enqueue_scrub": 11, 2024-06-06T03:38:43.555 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_exportdir": 3, 2024-06-06T03:38:43.555 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_flush": 0, 2024-06-06T03:38:43.555 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragmentdir": 0, 2024-06-06T03:38:43.555 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragstats": 0, 2024-06-06T03:38:43.555 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_inodestats": 0 2024-06-06T03:38:43.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.555 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_log": { 2024-06-06T03:38:43.555 INFO:teuthology.orchestra.run.smithi122.stdout: "evlrg": 0, 2024-06-06T03:38:43.555 INFO:teuthology.orchestra.run.smithi122.stdout: "evadd": 274, 2024-06-06T03:38:43.556 INFO:teuthology.orchestra.run.smithi122.stdout: "evex": 262, 2024-06-06T03:38:43.556 INFO:teuthology.orchestra.run.smithi122.stdout: "evtrm": 262, 2024-06-06T03:38:43.556 INFO:teuthology.orchestra.run.smithi122.stdout: "ev": 12, 2024-06-06T03:38:43.556 INFO:teuthology.orchestra.run.smithi122.stdout: "evexg": 0, 2024-06-06T03:38:43.556 INFO:teuthology.orchestra.run.smithi122.stdout: "evexd": 1, 2024-06-06T03:38:43.556 INFO:teuthology.orchestra.run.smithi122.stdout: "segadd": 53, 2024-06-06T03:38:43.556 INFO:teuthology.orchestra.run.smithi122.stdout: "segex": 52, 2024-06-06T03:38:43.556 INFO:teuthology.orchestra.run.smithi122.stdout: "segtrm": 52, 2024-06-06T03:38:43.556 INFO:teuthology.orchestra.run.smithi122.stdout: "seg": 1, 2024-06-06T03:38:43.556 INFO:teuthology.orchestra.run.smithi122.stdout: "segmjr": 1, 2024-06-06T03:38:43.556 INFO:teuthology.orchestra.run.smithi122.stdout: "segexg": 0, 2024-06-06T03:38:43.556 INFO:teuthology.orchestra.run.smithi122.stdout: "segexd": 1, 2024-06-06T03:38:43.556 INFO:teuthology.orchestra.run.smithi122.stdout: "expos": 5133361, 2024-06-06T03:38:43.556 INFO:teuthology.orchestra.run.smithi122.stdout: "wrpos": 5161240, 2024-06-06T03:38:43.556 INFO:teuthology.orchestra.run.smithi122.stdout: "rdpos": 0, 2024-06-06T03:38:43.557 INFO:teuthology.orchestra.run.smithi122.stdout: "jlat": { 2024-06-06T03:38:43.557 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 197, 2024-06-06T03:38:43.557 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.431179668, 2024-06-06T03:38:43.557 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.002188729 2024-06-06T03:38:43.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.557 INFO:teuthology.orchestra.run.smithi122.stdout: "replayed": 0 2024-06-06T03:38:43.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.557 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_mem": { 2024-06-06T03:38:43.557 INFO:teuthology.orchestra.run.smithi122.stdout: "ino": 25, 2024-06-06T03:38:43.557 INFO:teuthology.orchestra.run.smithi122.stdout: "ino+": 59, 2024-06-06T03:38:43.557 INFO:teuthology.orchestra.run.smithi122.stdout: "ino-": 34, 2024-06-06T03:38:43.557 INFO:teuthology.orchestra.run.smithi122.stdout: "dir": 20, 2024-06-06T03:38:43.557 INFO:teuthology.orchestra.run.smithi122.stdout: "dir+": 24, 2024-06-06T03:38:43.557 INFO:teuthology.orchestra.run.smithi122.stdout: "dir-": 4, 2024-06-06T03:38:43.557 INFO:teuthology.orchestra.run.smithi122.stdout: "dn": 23, 2024-06-06T03:38:43.557 INFO:teuthology.orchestra.run.smithi122.stdout: "dn+": 51, 2024-06-06T03:38:43.558 INFO:teuthology.orchestra.run.smithi122.stdout: "dn-": 28, 2024-06-06T03:38:43.558 INFO:teuthology.orchestra.run.smithi122.stdout: "cap": 2, 2024-06-06T03:38:43.558 INFO:teuthology.orchestra.run.smithi122.stdout: "cap+": 38, 2024-06-06T03:38:43.558 INFO:teuthology.orchestra.run.smithi122.stdout: "cap-": 36, 2024-06-06T03:38:43.558 INFO:teuthology.orchestra.run.smithi122.stdout: "rss": 57208, 2024-06-06T03:38:43.558 INFO:teuthology.orchestra.run.smithi122.stdout: "heap": 231804 2024-06-06T03:38:43.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.558 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_server": { 2024-06-06T03:38:43.558 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_client_request": 161, 2024-06-06T03:38:43.558 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_server_request": 3, 2024-06-06T03:38:43.558 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_request": 127, 2024-06-06T03:38:43.558 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_session": 22, 2024-06-06T03:38:43.558 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_peer_request": 12, 2024-06-06T03:38:43.559 INFO:teuthology.orchestra.run.smithi122.stdout: "req_create_latency": { 2024-06-06T03:38:43.559 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 22, 2024-06-06T03:38:43.559 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.020092783, 2024-06-06T03:38:43.559 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000913308 2024-06-06T03:38:43.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.559 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getattr_latency": { 2024-06-06T03:38:43.559 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 34, 2024-06-06T03:38:43.559 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.009794656, 2024-06-06T03:38:43.559 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000288078 2024-06-06T03:38:43.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.559 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getfilelock_latency": { 2024-06-06T03:38:43.559 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:43.559 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:43.559 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:43.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.560 INFO:teuthology.orchestra.run.smithi122.stdout: "req_link_latency": { 2024-06-06T03:38:43.560 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:43.560 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:43.560 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:43.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.560 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookup_latency": { 2024-06-06T03:38:43.560 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 29, 2024-06-06T03:38:43.560 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.076683385, 2024-06-06T03:38:43.560 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.002644254 2024-06-06T03:38:43.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.560 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookuphash_latency": { 2024-06-06T03:38:43.560 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:43.560 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:43.560 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:43.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.561 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupino_latency": { 2024-06-06T03:38:43.561 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:43.561 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:43.561 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:43.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.561 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupname_latency": { 2024-06-06T03:38:43.561 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:43.561 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:43.561 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:43.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.561 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupparent_latency": { 2024-06-06T03:38:43.561 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:43.561 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:43.562 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:43.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.562 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupsnap_latency": { 2024-06-06T03:38:43.562 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:43.562 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:43.562 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:43.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.562 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lssnap_latency": { 2024-06-06T03:38:43.562 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:43.562 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:43.563 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:43.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.563 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mkdir_latency": { 2024-06-06T03:38:43.563 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 10, 2024-06-06T03:38:43.563 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.016056421, 2024-06-06T03:38:43.563 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.001605642 2024-06-06T03:38:43.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.563 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mknod_latency": { 2024-06-06T03:38:43.563 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:43.563 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:43.564 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:43.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.564 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mksnap_latency": { 2024-06-06T03:38:43.564 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:43.564 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:43.564 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:43.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.564 INFO:teuthology.orchestra.run.smithi122.stdout: "req_open_latency": { 2024-06-06T03:38:43.564 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1, 2024-06-06T03:38:43.564 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000486946, 2024-06-06T03:38:43.564 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000486946 2024-06-06T03:38:43.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.564 INFO:teuthology.orchestra.run.smithi122.stdout: "req_readdir_latency": { 2024-06-06T03:38:43.565 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1, 2024-06-06T03:38:43.565 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.007433611, 2024-06-06T03:38:43.565 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.007433611 2024-06-06T03:38:43.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.565 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rename_latency": { 2024-06-06T03:38:43.565 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 2, 2024-06-06T03:38:43.565 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.002371918, 2024-06-06T03:38:43.565 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.001185959 2024-06-06T03:38:43.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.565 INFO:teuthology.orchestra.run.smithi122.stdout: "req_renamesnap_latency": { 2024-06-06T03:38:43.565 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:43.565 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:43.565 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:43.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.566 INFO:teuthology.orchestra.run.smithi122.stdout: "req_snapdiff_latency": { 2024-06-06T03:38:43.566 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:43.566 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:43.566 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:43.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.566 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmdir_latency": { 2024-06-06T03:38:43.566 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 2, 2024-06-06T03:38:43.566 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.010492725, 2024-06-06T03:38:43.566 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.005246362 2024-06-06T03:38:43.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.566 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmsnap_latency": { 2024-06-06T03:38:43.566 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:43.567 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:43.567 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:43.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.567 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmxattr_latency": { 2024-06-06T03:38:43.567 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:43.567 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:43.567 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:43.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.567 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setattr_latency": { 2024-06-06T03:38:43.567 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 2, 2024-06-06T03:38:43.567 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.001439463, 2024-06-06T03:38:43.567 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000719731 2024-06-06T03:38:43.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.568 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setdirlayout_latency": { 2024-06-06T03:38:43.568 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:43.568 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:43.568 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:43.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.568 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setfilelock_latency": { 2024-06-06T03:38:43.568 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:43.568 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:43.568 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:43.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.568 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setlayout_latency": { 2024-06-06T03:38:43.568 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:43.568 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:43.568 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:43.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.569 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setxattr_latency": { 2024-06-06T03:38:43.569 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 8, 2024-06-06T03:38:43.569 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.024997673, 2024-06-06T03:38:43.569 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.003124709 2024-06-06T03:38:43.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.569 INFO:teuthology.orchestra.run.smithi122.stdout: "req_symlink_latency": { 2024-06-06T03:38:43.569 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:43.569 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:43.569 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:43.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.569 INFO:teuthology.orchestra.run.smithi122.stdout: "req_unlink_latency": { 2024-06-06T03:38:43.569 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:43.569 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:43.570 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:43.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.570 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_revoke_eviction": 0, 2024-06-06T03:38:43.570 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_acquisition_throttle": 0, 2024-06-06T03:38:43.570 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getvxattr_latency": { 2024-06-06T03:38:43.570 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:43.570 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:43.570 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:43.570 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:43.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.570 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_sessions": { 2024-06-06T03:38:43.570 INFO:teuthology.orchestra.run.smithi122.stdout: "session_count": 1, 2024-06-06T03:38:43.570 INFO:teuthology.orchestra.run.smithi122.stdout: "session_add": 3, 2024-06-06T03:38:43.571 INFO:teuthology.orchestra.run.smithi122.stdout: "session_remove": 2, 2024-06-06T03:38:43.571 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_open": 1, 2024-06-06T03:38:43.571 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_stale": 0, 2024-06-06T03:38:43.571 INFO:teuthology.orchestra.run.smithi122.stdout: "total_load": 17, 2024-06-06T03:38:43.571 INFO:teuthology.orchestra.run.smithi122.stdout: "average_load": 17, 2024-06-06T03:38:43.571 INFO:teuthology.orchestra.run.smithi122.stdout: "avg_session_uptime": 737, 2024-06-06T03:38:43.571 INFO:teuthology.orchestra.run.smithi122.stdout: "mdthresh_evicted": 0 2024-06-06T03:38:43.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.571 INFO:teuthology.orchestra.run.smithi122.stdout: "mempool": { 2024-06-06T03:38:43.571 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_bytes": 0, 2024-06-06T03:38:43.571 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_items": 0, 2024-06-06T03:38:43.571 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T03:38:43.571 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_items": 0, 2024-06-06T03:38:43.571 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T03:38:43.571 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_items": 0, 2024-06-06T03:38:43.572 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T03:38:43.572 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T03:38:43.572 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T03:38:43.572 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T03:38:43.572 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T03:38:43.572 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_items": 0, 2024-06-06T03:38:43.572 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T03:38:43.572 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T03:38:43.572 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_bytes": 0, 2024-06-06T03:38:43.572 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_items": 0, 2024-06-06T03:38:43.572 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_bytes": 0, 2024-06-06T03:38:43.572 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_items": 0, 2024-06-06T03:38:43.572 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T03:38:43.573 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T03:38:43.573 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T03:38:43.573 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T03:38:43.573 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T03:38:43.573 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_items": 0, 2024-06-06T03:38:43.573 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_bytes": 0, 2024-06-06T03:38:43.573 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_items": 0, 2024-06-06T03:38:43.573 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T03:38:43.573 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T03:38:43.573 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_bytes": 0, 2024-06-06T03:38:43.573 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_items": 0, 2024-06-06T03:38:43.573 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_bytes": 0, 2024-06-06T03:38:43.573 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_items": 0, 2024-06-06T03:38:43.574 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T03:38:43.574 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_items": 0, 2024-06-06T03:38:43.574 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T03:38:43.574 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_items": 0, 2024-06-06T03:38:43.574 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_bytes": 298165, 2024-06-06T03:38:43.574 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_items": 114, 2024-06-06T03:38:43.574 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_bytes": 0, 2024-06-06T03:38:43.574 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_items": 0, 2024-06-06T03:38:43.574 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_bytes": 0, 2024-06-06T03:38:43.574 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_items": 0, 2024-06-06T03:38:43.574 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_bytes": 0, 2024-06-06T03:38:43.574 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_items": 0, 2024-06-06T03:38:43.574 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_bytes": 0, 2024-06-06T03:38:43.575 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_items": 0, 2024-06-06T03:38:43.575 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_bytes": 8792, 2024-06-06T03:38:43.575 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_items": 168, 2024-06-06T03:38:43.575 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T03:38:43.575 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_items": 0, 2024-06-06T03:38:43.575 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_bytes": 0, 2024-06-06T03:38:43.575 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_items": 0, 2024-06-06T03:38:43.575 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_bytes": 101434, 2024-06-06T03:38:43.575 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_items": 653, 2024-06-06T03:38:43.575 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_bytes": 0, 2024-06-06T03:38:43.575 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_items": 0, 2024-06-06T03:38:43.575 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_bytes": 0, 2024-06-06T03:38:43.575 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_items": 0 2024-06-06T03:38:43.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.576 INFO:teuthology.orchestra.run.smithi122.stdout: "objecter": { 2024-06-06T03:38:43.576 INFO:teuthology.orchestra.run.smithi122.stdout: "op_active": 0, 2024-06-06T03:38:43.576 INFO:teuthology.orchestra.run.smithi122.stdout: "op_laggy": 0, 2024-06-06T03:38:43.576 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send": 1460, 2024-06-06T03:38:43.576 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send_bytes": 1187234, 2024-06-06T03:38:43.576 INFO:teuthology.orchestra.run.smithi122.stdout: "op_resend": 37, 2024-06-06T03:38:43.576 INFO:teuthology.orchestra.run.smithi122.stdout: "op_reply": 1460, 2024-06-06T03:38:43.576 INFO:teuthology.orchestra.run.smithi122.stdout: "op_latency": { 2024-06-06T03:38:43.576 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1460, 2024-06-06T03:38:43.576 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 22.927490906, 2024-06-06T03:38:43.576 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.015703760 2024-06-06T03:38:43.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.576 INFO:teuthology.orchestra.run.smithi122.stdout: "op_inflight": 0, 2024-06-06T03:38:43.576 INFO:teuthology.orchestra.run.smithi122.stdout: "oplen_avg": { 2024-06-06T03:38:43.577 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1460, 2024-06-06T03:38:43.577 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 1883 2024-06-06T03:38:43.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.577 INFO:teuthology.orchestra.run.smithi122.stdout: "op": 1460, 2024-06-06T03:38:43.577 INFO:teuthology.orchestra.run.smithi122.stdout: "op_r": 291, 2024-06-06T03:38:43.577 INFO:teuthology.orchestra.run.smithi122.stdout: "op_w": 1169, 2024-06-06T03:38:43.577 INFO:teuthology.orchestra.run.smithi122.stdout: "op_rmw": 0, 2024-06-06T03:38:43.577 INFO:teuthology.orchestra.run.smithi122.stdout: "op_pg": 0, 2024-06-06T03:38:43.577 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_stat": 141, 2024-06-06T03:38:43.577 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_create": 62, 2024-06-06T03:38:43.577 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_read": 13, 2024-06-06T03:38:43.577 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_write": 199, 2024-06-06T03:38:43.577 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writefull": 142, 2024-06-06T03:38:43.577 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writesame": 0, 2024-06-06T03:38:43.577 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_append": 0, 2024-06-06T03:38:43.578 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_zero": 0, 2024-06-06T03:38:43.578 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_truncate": 0, 2024-06-06T03:38:43.578 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_delete": 514, 2024-06-06T03:38:43.578 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_mapext": 0, 2024-06-06T03:38:43.578 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_sparse_read": 0, 2024-06-06T03:38:43.578 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_clonerange": 0, 2024-06-06T03:38:43.578 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_getxattr": 278, 2024-06-06T03:38:43.578 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_setxattr": 104, 2024-06-06T03:38:43.578 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_cmpxattr": 0, 2024-06-06T03:38:43.578 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_rmxattr": 0, 2024-06-06T03:38:43.578 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_resetxattrs": 0, 2024-06-06T03:38:43.578 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_call": 0, 2024-06-06T03:38:43.578 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_watch": 0, 2024-06-06T03:38:43.578 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_notify": 0, 2024-06-06T03:38:43.579 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_src_cmpxattr": 0, 2024-06-06T03:38:43.579 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls": 0, 2024-06-06T03:38:43.579 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls_filter": 0, 2024-06-06T03:38:43.579 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_other": 0, 2024-06-06T03:38:43.579 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_active": 0, 2024-06-06T03:38:43.579 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_send": 0, 2024-06-06T03:38:43.579 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_resend": 0, 2024-06-06T03:38:43.579 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_ping": 0, 2024-06-06T03:38:43.579 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_active": 0, 2024-06-06T03:38:43.579 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_send": 0, 2024-06-06T03:38:43.579 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_resend": 0, 2024-06-06T03:38:43.579 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_active": 0, 2024-06-06T03:38:43.579 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_send": 0, 2024-06-06T03:38:43.579 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_resend": 0, 2024-06-06T03:38:43.579 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_active": 0, 2024-06-06T03:38:43.580 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_send": 0, 2024-06-06T03:38:43.580 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_resend": 0, 2024-06-06T03:38:43.580 INFO:teuthology.orchestra.run.smithi122.stdout: "command_active": 0, 2024-06-06T03:38:43.580 INFO:teuthology.orchestra.run.smithi122.stdout: "command_send": 0, 2024-06-06T03:38:43.580 INFO:teuthology.orchestra.run.smithi122.stdout: "command_resend": 0, 2024-06-06T03:38:43.580 INFO:teuthology.orchestra.run.smithi122.stdout: "map_epoch": 99, 2024-06-06T03:38:43.580 INFO:teuthology.orchestra.run.smithi122.stdout: "map_full": 0, 2024-06-06T03:38:43.580 INFO:teuthology.orchestra.run.smithi122.stdout: "map_inc": 11, 2024-06-06T03:38:43.580 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_sessions": 12, 2024-06-06T03:38:43.580 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_open": 12, 2024-06-06T03:38:43.581 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_close": 0, 2024-06-06T03:38:43.581 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_laggy": 0, 2024-06-06T03:38:43.581 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_wr": 411, 2024-06-06T03:38:43.581 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_rd": 2, 2024-06-06T03:38:43.581 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_del": 17 2024-06-06T03:38:43.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.581 INFO:teuthology.orchestra.run.smithi122.stdout: "oft": { 2024-06-06T03:38:43.581 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_objs": 1, 2024-06-06T03:38:43.581 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_kv_pairs": 0, 2024-06-06T03:38:43.581 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_updates": 0, 2024-06-06T03:38:43.581 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_removes": 0 2024-06-06T03:38:43.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.581 INFO:teuthology.orchestra.run.smithi122.stdout: "osd-slow-ops": { 2024-06-06T03:38:43.581 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_ops_count": 0 2024-06-06T03:38:43.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.582 INFO:teuthology.orchestra.run.smithi122.stdout: "purge_queue": { 2024-06-06T03:38:43.582 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops": 0, 2024-06-06T03:38:43.582 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops_high_water": 1, 2024-06-06T03:38:43.582 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing": 0, 2024-06-06T03:38:43.582 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_high_water": 1, 2024-06-06T03:38:43.582 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed_ops": 2, 2024-06-06T03:38:43.582 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed": 2, 2024-06-06T03:38:43.582 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_item_in_journal": 0 2024-06-06T03:38:43.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.582 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T03:38:43.582 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-06-06T03:38:43.582 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-06-06T03:38:43.582 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-06-06T03:38:43.583 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 4643, 2024-06-06T03:38:43.583 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 1691754, 2024-06-06T03:38:43.583 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:43.583 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 4643, 2024-06-06T03:38:43.583 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-06-06T03:38:43.583 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-06-06T03:38:43.583 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 4643, 2024-06-06T03:38:43.583 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 1691754, 2024-06-06T03:38:43.583 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-06-06T03:38:43.583 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:43.583 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:43.583 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:43.583 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:43.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.583 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_bytes": { 2024-06-06T03:38:43.584 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-06-06T03:38:43.584 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-06-06T03:38:43.584 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-06-06T03:38:43.584 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-06-06T03:38:43.584 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-06-06T03:38:43.584 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:43.584 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-06-06T03:38:43.584 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 1460, 2024-06-06T03:38:43.584 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 1187420, 2024-06-06T03:38:43.584 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 1460, 2024-06-06T03:38:43.584 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 1187420, 2024-06-06T03:38:43.584 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-06-06T03:38:43.584 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:43.585 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:43.585 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:43.585 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:43.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.585 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_ops": { 2024-06-06T03:38:43.585 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-06-06T03:38:43.585 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1024, 2024-06-06T03:38:43.585 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-06-06T03:38:43.585 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-06-06T03:38:43.585 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-06-06T03:38:43.585 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:43.585 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-06-06T03:38:43.585 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 1460, 2024-06-06T03:38:43.586 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 1460, 2024-06-06T03:38:43.586 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 1460, 2024-06-06T03:38:43.586 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 1460, 2024-06-06T03:38:43.586 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-06-06T03:38:43.586 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:43.586 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:43.586 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:43.586 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:43.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.586 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle": { 2024-06-06T03:38:43.586 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-06-06T03:38:43.586 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-06-06T03:38:43.587 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-06-06T03:38:43.587 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 2, 2024-06-06T03:38:43.587 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 202, 2024-06-06T03:38:43.587 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:43.587 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 2, 2024-06-06T03:38:43.587 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-06-06T03:38:43.587 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-06-06T03:38:43.587 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 2, 2024-06-06T03:38:43.587 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 202, 2024-06-06T03:38:43.587 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-06-06T03:38:43.587 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:43.587 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:43.587 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:43.587 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:43.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:43.588 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle-0x55b4a8c70500": { 2024-06-06T03:38:43.588 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-06-06T03:38:43.588 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-06-06T03:38:43.588 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-06-06T03:38:43.588 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 274, 2024-06-06T03:38:43.588 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 966936, 2024-06-06T03:38:43.588 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:43.588 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 274, 2024-06-06T03:38:43.588 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-06-06T03:38:43.588 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-06-06T03:38:43.588 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 197, 2024-06-06T03:38:43.588 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 966936, 2024-06-06T03:38:43.588 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-06-06T03:38:43.588 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:43.589 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:43.589 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:43.589 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:43.589 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:43.589 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-06-06T03:38:43.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:43 smithi079 ceph-mon[35478]: pgmap v793: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T03:38:44.252 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:44 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:38:44.282 INFO:tasks.check_counter:Daemon mds.i mds.exported=2 2024-06-06T03:38:44.282 INFO:tasks.check_counter:Daemon mds.i mds.imported=1 2024-06-06T03:38:44.282 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=10 2024-06-06T03:38:44.282 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=0 2024-06-06T03:38:44.282 DEBUG:tasks.check_counter:Getting stats from l 2024-06-06T03:38:44.282 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph daemon mds.l perf dump 2024-06-06T03:38:44.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:44 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:38:44.546 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T03:38:44.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:44 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T03:38:45.418 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:45 smithi122 ceph-mon[35759]: pgmap v794: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:38:45.418 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:45 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:38:45.419 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:45 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:38:45.419 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:45 smithi122 ceph-mon[35759]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:38:45.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:45 smithi050 ceph-mon[32421]: pgmap v794: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:38:45.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:45 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:38:45.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:45 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:38:45.502 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:45 smithi050 ceph-mon[32421]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:38:45.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:45 smithi079 ceph-mon[35478]: pgmap v794: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:38:45.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:45 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T03:38:45.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:45 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T03:38:45.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:45 smithi079 ceph-mon[35478]: from='mgr.14152 172.21.15.50:0/1442622759' entity='mgr.x' 2024-06-06T03:38:46.346 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-06-06T03:38:46.346 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T03:38:46.346 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 297, 2024-06-06T03:38:46.346 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 281, 2024-06-06T03:38:46.347 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 566882, 2024-06-06T03:38:46.347 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 169892, 2024-06-06T03:38:46.347 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 6, 2024-06-06T03:38:46.347 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 1, 2024-06-06T03:38:46.347 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.040664267, 2024-06-06T03:38:46.347 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.015088739, 2024-06-06T03:38:46.347 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.018400317, 2024-06-06T03:38:46.347 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.006396174, 2024-06-06T03:38:46.347 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:46.347 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 280, 2024-06-06T03:38:46.347 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.012490496, 2024-06-06T03:38:46.347 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000044608 2024-06-06T03:38:46.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.348 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:46.348 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.348 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.348 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.348 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 566048, 2024-06-06T03:38:46.348 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 169568 2024-06-06T03:38:46.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.348 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T03:38:46.348 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 811, 2024-06-06T03:38:46.348 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 1018, 2024-06-06T03:38:46.348 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 199442, 2024-06-06T03:38:46.348 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 676977, 2024-06-06T03:38:46.348 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 5, 2024-06-06T03:38:46.349 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 4, 2024-06-06T03:38:46.349 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.079919131, 2024-06-06T03:38:46.349 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.025014577, 2024-06-06T03:38:46.349 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.017856851, 2024-06-06T03:38:46.349 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.029948078, 2024-06-06T03:38:46.349 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:46.349 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1016, 2024-06-06T03:38:46.349 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.043865138, 2024-06-06T03:38:46.349 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000043174 2024-06-06T03:38:46.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.349 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:46.349 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.349 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.349 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.350 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-06T03:38:46.350 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 419392 2024-06-06T03:38:46.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.350 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T03:38:46.350 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 1822, 2024-06-06T03:38:46.350 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 1822, 2024-06-06T03:38:46.350 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 547966, 2024-06-06T03:38:46.350 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 578630, 2024-06-06T03:38:46.350 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 4, 2024-06-06T03:38:46.350 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 3, 2024-06-06T03:38:46.350 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.157305120, 2024-06-06T03:38:46.350 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.046073185, 2024-06-06T03:38:46.351 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.043182438, 2024-06-06T03:38:46.351 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.055178186, 2024-06-06T03:38:46.351 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T03:38:46.351 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1821, 2024-06-06T03:38:46.351 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.073141376, 2024-06-06T03:38:46.351 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000040165 2024-06-06T03:38:46.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.351 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-06-06T03:38:46.351 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.351 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.351 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.351 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-06-06T03:38:46.351 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 448 2024-06-06T03:38:46.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.352 INFO:teuthology.orchestra.run.smithi122.stdout: "cct": { 2024-06-06T03:38:46.352 INFO:teuthology.orchestra.run.smithi122.stdout: "total_workers": 1, 2024-06-06T03:38:46.352 INFO:teuthology.orchestra.run.smithi122.stdout: "unhealthy_workers": 0 2024-06-06T03:38:46.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.352 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-MDSRank": { 2024-06-06T03:38:46.352 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-06-06T03:38:46.352 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-06-06T03:38:46.352 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 4396, 2024-06-06T03:38:46.352 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.119181521, 2024-06-06T03:38:46.352 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000027111 2024-06-06T03:38:46.352 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:46.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.352 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-PurgeQueue": { 2024-06-06T03:38:46.352 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-06-06T03:38:46.352 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-06-06T03:38:46.353 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.353 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.353 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.353 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:46.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.353 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": { 2024-06-06T03:38:46.353 INFO:teuthology.orchestra.run.smithi122.stdout: "request": 0, 2024-06-06T03:38:46.353 INFO:teuthology.orchestra.run.smithi122.stdout: "reply": 0, 2024-06-06T03:38:46.353 INFO:teuthology.orchestra.run.smithi122.stdout: "reply_latency": { 2024-06-06T03:38:46.353 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.353 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.353 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.353 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_reply": 0, 2024-06-06T03:38:46.353 INFO:teuthology.orchestra.run.smithi122.stdout: "forward": 0, 2024-06-06T03:38:46.353 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_complete": 0, 2024-06-06T03:38:46.354 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_keys": 0, 2024-06-06T03:38:46.354 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_commit": 0, 2024-06-06T03:38:46.354 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_split": 0, 2024-06-06T03:38:46.354 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_merge": 0, 2024-06-06T03:38:46.354 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes": 0, 2024-06-06T03:38:46.354 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_top": 0, 2024-06-06T03:38:46.354 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_bottom": 0, 2024-06-06T03:38:46.354 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pin_tail": 0, 2024-06-06T03:38:46.354 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pinned": 0, 2024-06-06T03:38:46.354 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_expired": 0, 2024-06-06T03:38:46.354 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_with_caps": 0, 2024-06-06T03:38:46.354 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": 0, 2024-06-06T03:38:46.354 INFO:teuthology.orchestra.run.smithi122.stdout: "subtrees": 1, 2024-06-06T03:38:46.355 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse": 0, 2024-06-06T03:38:46.355 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_hit": 0, 2024-06-06T03:38:46.355 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_forward": 0, 2024-06-06T03:38:46.355 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_discover": 0, 2024-06-06T03:38:46.355 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_dir_fetch": 0, 2024-06-06T03:38:46.355 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_remote_ino": 0, 2024-06-06T03:38:46.355 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_lock": 0, 2024-06-06T03:38:46.355 INFO:teuthology.orchestra.run.smithi122.stdout: "load_cent": 0, 2024-06-06T03:38:46.355 INFO:teuthology.orchestra.run.smithi122.stdout: "q": 0, 2024-06-06T03:38:46.355 INFO:teuthology.orchestra.run.smithi122.stdout: "exported": 0, 2024-06-06T03:38:46.355 INFO:teuthology.orchestra.run.smithi122.stdout: "exported_inodes": 0, 2024-06-06T03:38:46.355 INFO:teuthology.orchestra.run.smithi122.stdout: "imported": 0, 2024-06-06T03:38:46.355 INFO:teuthology.orchestra.run.smithi122.stdout: "imported_inodes": 0, 2024-06-06T03:38:46.355 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_dir_fetch": 0, 2024-06-06T03:38:46.355 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_backtrace_fetch": 0, 2024-06-06T03:38:46.356 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_peer_discover": 0, 2024-06-06T03:38:46.356 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rfiles": 0, 2024-06-06T03:38:46.356 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rbytes": 0, 2024-06-06T03:38:46.356 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rsnaps": 0, 2024-06-06T03:38:46.356 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_fetch": 0, 2024-06-06T03:38:46.356 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_set_tag": 0, 2024-06-06T03:38:46.356 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_repaired": 0, 2024-06-06T03:38:46.356 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_inotable_repaired": 0, 2024-06-06T03:38:46.356 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_inodes": 0, 2024-06-06T03:38:46.356 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_base_inodes": 0, 2024-06-06T03:38:46.356 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dirfrag_rstats": 0, 2024-06-06T03:38:46.356 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_file_inodes": 0, 2024-06-06T03:38:46.356 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_inode_file_caps": 0, 2024-06-06T03:38:46.356 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_revoke": 0, 2024-06-06T03:38:46.356 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_grant": 0, 2024-06-06T03:38:46.357 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_trunc": 0, 2024-06-06T03:38:46.357 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-06T03:38:46.357 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-06T03:38:46.357 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps": 0, 2024-06-06T03:38:46.357 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps_dirty": 0, 2024-06-06T03:38:46.357 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_cap_release": 0, 2024-06-06T03:38:46.357 INFO:teuthology.orchestra.run.smithi122.stdout: "process_request_cap_release": 0 2024-06-06T03:38:46.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.357 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cache": { 2024-06-06T03:38:46.357 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update": 0, 2024-06-06T03:38:46.357 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update_receipt": 0, 2024-06-06T03:38:46.357 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_try_discover": 0, 2024-06-06T03:38:46.357 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_send_discover": 0, 2024-06-06T03:38:46.357 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_handle_discover": 0, 2024-06-06T03:38:46.357 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays": 0, 2024-06-06T03:38:46.358 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_delayed": 0, 2024-06-06T03:38:46.358 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_enqueuing": 0, 2024-06-06T03:38:46.358 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_created": 0, 2024-06-06T03:38:46.358 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_enqueued": 0, 2024-06-06T03:38:46.358 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_reintegrated": 0, 2024-06-06T03:38:46.358 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_migrated": 0, 2024-06-06T03:38:46.358 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_processing": 0, 2024-06-06T03:38:46.358 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_enqueued": 0, 2024-06-06T03:38:46.358 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_prioritized": 0, 2024-06-06T03:38:46.358 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_started": 0, 2024-06-06T03:38:46.358 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_completed": 0, 2024-06-06T03:38:46.358 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_quiesce_path": 0, 2024-06-06T03:38:46.358 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_quiesce_inode": 0, 2024-06-06T03:38:46.358 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_enqueue_scrub": 0, 2024-06-06T03:38:46.359 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_exportdir": 0, 2024-06-06T03:38:46.359 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_flush": 0, 2024-06-06T03:38:46.359 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragmentdir": 0, 2024-06-06T03:38:46.359 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragstats": 0, 2024-06-06T03:38:46.359 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_inodestats": 0 2024-06-06T03:38:46.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.359 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_log": { 2024-06-06T03:38:46.359 INFO:teuthology.orchestra.run.smithi122.stdout: "evlrg": 0, 2024-06-06T03:38:46.359 INFO:teuthology.orchestra.run.smithi122.stdout: "evadd": 0, 2024-06-06T03:38:46.359 INFO:teuthology.orchestra.run.smithi122.stdout: "evex": 0, 2024-06-06T03:38:46.359 INFO:teuthology.orchestra.run.smithi122.stdout: "evtrm": 0, 2024-06-06T03:38:46.359 INFO:teuthology.orchestra.run.smithi122.stdout: "ev": 5, 2024-06-06T03:38:46.359 INFO:teuthology.orchestra.run.smithi122.stdout: "evexg": 0, 2024-06-06T03:38:46.359 INFO:teuthology.orchestra.run.smithi122.stdout: "evexd": 0, 2024-06-06T03:38:46.360 INFO:teuthology.orchestra.run.smithi122.stdout: "segadd": 0, 2024-06-06T03:38:46.360 INFO:teuthology.orchestra.run.smithi122.stdout: "segex": 0, 2024-06-06T03:38:46.360 INFO:teuthology.orchestra.run.smithi122.stdout: "segtrm": 0, 2024-06-06T03:38:46.360 INFO:teuthology.orchestra.run.smithi122.stdout: "seg": 2, 2024-06-06T03:38:46.360 INFO:teuthology.orchestra.run.smithi122.stdout: "segmjr": 2, 2024-06-06T03:38:46.360 INFO:teuthology.orchestra.run.smithi122.stdout: "segexg": 0, 2024-06-06T03:38:46.360 INFO:teuthology.orchestra.run.smithi122.stdout: "segexd": 0, 2024-06-06T03:38:46.360 INFO:teuthology.orchestra.run.smithi122.stdout: "expos": 4194304, 2024-06-06T03:38:46.360 INFO:teuthology.orchestra.run.smithi122.stdout: "wrpos": 4195915, 2024-06-06T03:38:46.360 INFO:teuthology.orchestra.run.smithi122.stdout: "rdpos": 4195423, 2024-06-06T03:38:46.360 INFO:teuthology.orchestra.run.smithi122.stdout: "jlat": { 2024-06-06T03:38:46.360 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.360 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.360 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.361 INFO:teuthology.orchestra.run.smithi122.stdout: "replayed": 5 2024-06-06T03:38:46.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.361 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_mem": { 2024-06-06T03:38:46.361 INFO:teuthology.orchestra.run.smithi122.stdout: "ino": 3, 2024-06-06T03:38:46.361 INFO:teuthology.orchestra.run.smithi122.stdout: "ino+": 3, 2024-06-06T03:38:46.361 INFO:teuthology.orchestra.run.smithi122.stdout: "ino-": 0, 2024-06-06T03:38:46.361 INFO:teuthology.orchestra.run.smithi122.stdout: "dir": 1, 2024-06-06T03:38:46.361 INFO:teuthology.orchestra.run.smithi122.stdout: "dir+": 1, 2024-06-06T03:38:46.361 INFO:teuthology.orchestra.run.smithi122.stdout: "dir-": 0, 2024-06-06T03:38:46.361 INFO:teuthology.orchestra.run.smithi122.stdout: "dn": 0, 2024-06-06T03:38:46.361 INFO:teuthology.orchestra.run.smithi122.stdout: "dn+": 0, 2024-06-06T03:38:46.361 INFO:teuthology.orchestra.run.smithi122.stdout: "dn-": 0, 2024-06-06T03:38:46.361 INFO:teuthology.orchestra.run.smithi122.stdout: "cap": 0, 2024-06-06T03:38:46.362 INFO:teuthology.orchestra.run.smithi122.stdout: "cap+": 0, 2024-06-06T03:38:46.362 INFO:teuthology.orchestra.run.smithi122.stdout: "cap-": 0, 2024-06-06T03:38:46.362 INFO:teuthology.orchestra.run.smithi122.stdout: "rss": 52288, 2024-06-06T03:38:46.362 INFO:teuthology.orchestra.run.smithi122.stdout: "heap": 215420 2024-06-06T03:38:46.362 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.362 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_server": { 2024-06-06T03:38:46.362 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_client_request": 0, 2024-06-06T03:38:46.362 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_server_request": 0, 2024-06-06T03:38:46.362 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_request": 0, 2024-06-06T03:38:46.362 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_session": 0, 2024-06-06T03:38:46.362 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_peer_request": 0, 2024-06-06T03:38:46.362 INFO:teuthology.orchestra.run.smithi122.stdout: "req_create_latency": { 2024-06-06T03:38:46.362 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.363 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.363 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.363 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getattr_latency": { 2024-06-06T03:38:46.363 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.363 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.363 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.363 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getfilelock_latency": { 2024-06-06T03:38:46.363 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.363 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.363 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.364 INFO:teuthology.orchestra.run.smithi122.stdout: "req_link_latency": { 2024-06-06T03:38:46.364 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.364 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.364 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.364 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookup_latency": { 2024-06-06T03:38:46.364 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.364 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.364 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.364 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookuphash_latency": { 2024-06-06T03:38:46.364 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.364 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.365 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.365 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupino_latency": { 2024-06-06T03:38:46.365 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.365 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.365 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.365 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupname_latency": { 2024-06-06T03:38:46.365 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.365 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.365 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.365 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupparent_latency": { 2024-06-06T03:38:46.365 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.366 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.366 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.366 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupsnap_latency": { 2024-06-06T03:38:46.366 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.366 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.366 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.366 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lssnap_latency": { 2024-06-06T03:38:46.366 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.366 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.366 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.367 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mkdir_latency": { 2024-06-06T03:38:46.367 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.367 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.367 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.367 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mknod_latency": { 2024-06-06T03:38:46.367 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.367 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.368 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.368 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mksnap_latency": { 2024-06-06T03:38:46.368 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.368 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.368 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.368 INFO:teuthology.orchestra.run.smithi122.stdout: "req_open_latency": { 2024-06-06T03:38:46.368 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.368 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.368 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.368 INFO:teuthology.orchestra.run.smithi122.stdout: "req_readdir_latency": { 2024-06-06T03:38:46.368 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.369 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.369 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.369 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rename_latency": { 2024-06-06T03:38:46.369 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.369 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.369 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.369 INFO:teuthology.orchestra.run.smithi122.stdout: "req_renamesnap_latency": { 2024-06-06T03:38:46.369 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.369 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.369 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.369 INFO:teuthology.orchestra.run.smithi122.stdout: "req_snapdiff_latency": { 2024-06-06T03:38:46.370 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.370 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.370 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.370 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmdir_latency": { 2024-06-06T03:38:46.370 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.370 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.370 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.370 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmsnap_latency": { 2024-06-06T03:38:46.370 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.370 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.370 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.371 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmxattr_latency": { 2024-06-06T03:38:46.371 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.371 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.371 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.371 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setattr_latency": { 2024-06-06T03:38:46.371 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.371 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.371 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.371 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setdirlayout_latency": { 2024-06-06T03:38:46.371 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.371 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.372 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.372 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setfilelock_latency": { 2024-06-06T03:38:46.372 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.372 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.372 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.372 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setlayout_latency": { 2024-06-06T03:38:46.372 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.372 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.372 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.372 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setxattr_latency": { 2024-06-06T03:38:46.372 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.373 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.373 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.373 INFO:teuthology.orchestra.run.smithi122.stdout: "req_symlink_latency": { 2024-06-06T03:38:46.373 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.373 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.373 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.373 INFO:teuthology.orchestra.run.smithi122.stdout: "req_unlink_latency": { 2024-06-06T03:38:46.373 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.373 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.373 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.373 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_revoke_eviction": 0, 2024-06-06T03:38:46.373 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_acquisition_throttle": 0, 2024-06-06T03:38:46.373 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getvxattr_latency": { 2024-06-06T03:38:46.374 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.374 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.374 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.374 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:46.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.374 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_sessions": { 2024-06-06T03:38:46.374 INFO:teuthology.orchestra.run.smithi122.stdout: "session_count": 1, 2024-06-06T03:38:46.374 INFO:teuthology.orchestra.run.smithi122.stdout: "session_add": 2, 2024-06-06T03:38:46.374 INFO:teuthology.orchestra.run.smithi122.stdout: "session_remove": 1, 2024-06-06T03:38:46.374 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_open": 1, 2024-06-06T03:38:46.374 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_stale": 0, 2024-06-06T03:38:46.374 INFO:teuthology.orchestra.run.smithi122.stdout: "total_load": 0, 2024-06-06T03:38:46.374 INFO:teuthology.orchestra.run.smithi122.stdout: "average_load": 0, 2024-06-06T03:38:46.374 INFO:teuthology.orchestra.run.smithi122.stdout: "avg_session_uptime": 1973, 2024-06-06T03:38:46.375 INFO:teuthology.orchestra.run.smithi122.stdout: "mdthresh_evicted": 0 2024-06-06T03:38:46.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.375 INFO:teuthology.orchestra.run.smithi122.stdout: "mempool": { 2024-06-06T03:38:46.375 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_bytes": 0, 2024-06-06T03:38:46.375 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_items": 0, 2024-06-06T03:38:46.375 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T03:38:46.375 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_items": 0, 2024-06-06T03:38:46.375 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T03:38:46.375 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_items": 0, 2024-06-06T03:38:46.375 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T03:38:46.375 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T03:38:46.375 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T03:38:46.375 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T03:38:46.375 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T03:38:46.375 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_items": 0, 2024-06-06T03:38:46.375 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T03:38:46.376 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T03:38:46.377 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_bytes": 0, 2024-06-06T03:38:46.377 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_items": 0, 2024-06-06T03:38:46.377 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_bytes": 0, 2024-06-06T03:38:46.377 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_items": 0, 2024-06-06T03:38:46.377 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T03:38:46.377 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T03:38:46.377 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T03:38:46.377 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T03:38:46.377 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T03:38:46.377 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_items": 0, 2024-06-06T03:38:46.378 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_bytes": 0, 2024-06-06T03:38:46.378 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_items": 0, 2024-06-06T03:38:46.378 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T03:38:46.378 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T03:38:46.378 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_bytes": 0, 2024-06-06T03:38:46.378 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_items": 0, 2024-06-06T03:38:46.378 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_bytes": 0, 2024-06-06T03:38:46.378 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_items": 0, 2024-06-06T03:38:46.378 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T03:38:46.378 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_items": 0, 2024-06-06T03:38:46.378 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T03:38:46.378 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_items": 0, 2024-06-06T03:38:46.378 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_bytes": 190184, 2024-06-06T03:38:46.378 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_items": 53, 2024-06-06T03:38:46.379 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_bytes": 0, 2024-06-06T03:38:46.379 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_items": 0, 2024-06-06T03:38:46.379 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_bytes": 0, 2024-06-06T03:38:46.379 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_items": 0, 2024-06-06T03:38:46.379 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_bytes": 0, 2024-06-06T03:38:46.379 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_items": 0, 2024-06-06T03:38:46.379 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_bytes": 0, 2024-06-06T03:38:46.379 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_items": 0, 2024-06-06T03:38:46.379 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_bytes": 8792, 2024-06-06T03:38:46.379 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_items": 168, 2024-06-06T03:38:46.379 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T03:38:46.379 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_items": 0, 2024-06-06T03:38:46.379 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_bytes": 0, 2024-06-06T03:38:46.379 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_items": 0, 2024-06-06T03:38:46.379 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_bytes": 8464, 2024-06-06T03:38:46.379 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_items": 13, 2024-06-06T03:38:46.380 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_bytes": 0, 2024-06-06T03:38:46.380 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_items": 0, 2024-06-06T03:38:46.380 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_bytes": 0, 2024-06-06T03:38:46.380 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_items": 0 2024-06-06T03:38:46.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.380 INFO:teuthology.orchestra.run.smithi122.stdout: "objecter": { 2024-06-06T03:38:46.380 INFO:teuthology.orchestra.run.smithi122.stdout: "op_active": 0, 2024-06-06T03:38:46.380 INFO:teuthology.orchestra.run.smithi122.stdout: "op_laggy": 0, 2024-06-06T03:38:46.380 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send": 2629, 2024-06-06T03:38:46.380 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send_bytes": 21, 2024-06-06T03:38:46.380 INFO:teuthology.orchestra.run.smithi122.stdout: "op_resend": 3, 2024-06-06T03:38:46.380 INFO:teuthology.orchestra.run.smithi122.stdout: "op_reply": 2629, 2024-06-06T03:38:46.380 INFO:teuthology.orchestra.run.smithi122.stdout: "op_latency": { 2024-06-06T03:38:46.380 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 2629, 2024-06-06T03:38:46.380 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 5.097887747, 2024-06-06T03:38:46.380 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.001939097 2024-06-06T03:38:46.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.381 INFO:teuthology.orchestra.run.smithi122.stdout: "op_inflight": 0, 2024-06-06T03:38:46.381 INFO:teuthology.orchestra.run.smithi122.stdout: "oplen_avg": { 2024-06-06T03:38:46.381 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 2629, 2024-06-06T03:38:46.381 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 2630 2024-06-06T03:38:46.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.381 INFO:teuthology.orchestra.run.smithi122.stdout: "op": 2629, 2024-06-06T03:38:46.381 INFO:teuthology.orchestra.run.smithi122.stdout: "op_r": 2629, 2024-06-06T03:38:46.381 INFO:teuthology.orchestra.run.smithi122.stdout: "op_w": 0, 2024-06-06T03:38:46.381 INFO:teuthology.orchestra.run.smithi122.stdout: "op_rmw": 0, 2024-06-06T03:38:46.381 INFO:teuthology.orchestra.run.smithi122.stdout: "op_pg": 0, 2024-06-06T03:38:46.381 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_stat": 1714, 2024-06-06T03:38:46.381 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_create": 0, 2024-06-06T03:38:46.381 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_read": 913, 2024-06-06T03:38:46.381 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_write": 0, 2024-06-06T03:38:46.382 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writefull": 0, 2024-06-06T03:38:46.382 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writesame": 0, 2024-06-06T03:38:46.382 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_append": 0, 2024-06-06T03:38:46.382 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_zero": 0, 2024-06-06T03:38:46.382 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_truncate": 0, 2024-06-06T03:38:46.382 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_delete": 0, 2024-06-06T03:38:46.382 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_mapext": 0, 2024-06-06T03:38:46.382 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_sparse_read": 0, 2024-06-06T03:38:46.382 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_clonerange": 0, 2024-06-06T03:38:46.382 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_getxattr": 1, 2024-06-06T03:38:46.382 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_setxattr": 0, 2024-06-06T03:38:46.382 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_cmpxattr": 0, 2024-06-06T03:38:46.383 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_rmxattr": 0, 2024-06-06T03:38:46.383 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_resetxattrs": 0, 2024-06-06T03:38:46.383 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_call": 0, 2024-06-06T03:38:46.383 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_watch": 0, 2024-06-06T03:38:46.383 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_notify": 0, 2024-06-06T03:38:46.383 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_src_cmpxattr": 0, 2024-06-06T03:38:46.383 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls": 0, 2024-06-06T03:38:46.383 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls_filter": 0, 2024-06-06T03:38:46.383 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_other": 0, 2024-06-06T03:38:46.383 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_active": 0, 2024-06-06T03:38:46.383 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_send": 0, 2024-06-06T03:38:46.383 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_resend": 0, 2024-06-06T03:38:46.383 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_ping": 0, 2024-06-06T03:38:46.383 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_active": 0, 2024-06-06T03:38:46.384 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_send": 0, 2024-06-06T03:38:46.384 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_resend": 0, 2024-06-06T03:38:46.384 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_active": 0, 2024-06-06T03:38:46.384 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_send": 0, 2024-06-06T03:38:46.384 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_resend": 0, 2024-06-06T03:38:46.384 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_active": 0, 2024-06-06T03:38:46.384 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_send": 0, 2024-06-06T03:38:46.384 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_resend": 0, 2024-06-06T03:38:46.384 INFO:teuthology.orchestra.run.smithi122.stdout: "command_active": 0, 2024-06-06T03:38:46.384 INFO:teuthology.orchestra.run.smithi122.stdout: "command_send": 0, 2024-06-06T03:38:46.384 INFO:teuthology.orchestra.run.smithi122.stdout: "command_resend": 0, 2024-06-06T03:38:46.384 INFO:teuthology.orchestra.run.smithi122.stdout: "map_epoch": 99, 2024-06-06T03:38:46.384 INFO:teuthology.orchestra.run.smithi122.stdout: "map_full": 0, 2024-06-06T03:38:46.384 INFO:teuthology.orchestra.run.smithi122.stdout: "map_inc": 2, 2024-06-06T03:38:46.385 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_sessions": 5, 2024-06-06T03:38:46.385 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_open": 6, 2024-06-06T03:38:46.385 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_close": 1, 2024-06-06T03:38:46.385 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_laggy": 0, 2024-06-06T03:38:46.385 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_wr": 0, 2024-06-06T03:38:46.385 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_rd": 2, 2024-06-06T03:38:46.385 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_del": 0 2024-06-06T03:38:46.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.385 INFO:teuthology.orchestra.run.smithi122.stdout: "oft": { 2024-06-06T03:38:46.385 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_objs": 0, 2024-06-06T03:38:46.385 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_kv_pairs": 0, 2024-06-06T03:38:46.385 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_updates": 0, 2024-06-06T03:38:46.385 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_removes": 0 2024-06-06T03:38:46.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.385 INFO:teuthology.orchestra.run.smithi122.stdout: "osd-slow-ops": { 2024-06-06T03:38:46.386 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_ops_count": 0 2024-06-06T03:38:46.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.386 INFO:teuthology.orchestra.run.smithi122.stdout: "purge_queue": { 2024-06-06T03:38:46.386 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops": 0, 2024-06-06T03:38:46.386 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops_high_water": 0, 2024-06-06T03:38:46.386 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing": 0, 2024-06-06T03:38:46.386 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_high_water": 0, 2024-06-06T03:38:46.386 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed_ops": 0, 2024-06-06T03:38:46.386 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed": 0, 2024-06-06T03:38:46.386 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_item_in_journal": 0 2024-06-06T03:38:46.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.386 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T03:38:46.386 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-06-06T03:38:46.386 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-06-06T03:38:46.386 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-06-06T03:38:46.387 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 2926, 2024-06-06T03:38:46.387 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 1032790, 2024-06-06T03:38:46.387 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:46.387 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 2926, 2024-06-06T03:38:46.387 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-06-06T03:38:46.387 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-06-06T03:38:46.387 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 2926, 2024-06-06T03:38:46.387 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 1032790, 2024-06-06T03:38:46.387 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-06-06T03:38:46.387 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.387 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.387 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.387 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:46.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.388 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_bytes": { 2024-06-06T03:38:46.388 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-06-06T03:38:46.388 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-06-06T03:38:46.388 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-06-06T03:38:46.388 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-06-06T03:38:46.388 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-06-06T03:38:46.388 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:46.388 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-06-06T03:38:46.388 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 2629, 2024-06-06T03:38:46.388 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 1616, 2024-06-06T03:38:46.388 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 2629, 2024-06-06T03:38:46.388 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 1616, 2024-06-06T03:38:46.388 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-06-06T03:38:46.388 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.389 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.389 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.389 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:46.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.389 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_ops": { 2024-06-06T03:38:46.389 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-06-06T03:38:46.389 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1024, 2024-06-06T03:38:46.389 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-06-06T03:38:46.389 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-06-06T03:38:46.389 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-06-06T03:38:46.389 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:46.389 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-06-06T03:38:46.389 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 2629, 2024-06-06T03:38:46.389 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 2629, 2024-06-06T03:38:46.390 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 2629, 2024-06-06T03:38:46.390 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 2629, 2024-06-06T03:38:46.390 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-06-06T03:38:46.390 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.390 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.390 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.390 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:46.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.390 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle": { 2024-06-06T03:38:46.390 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-06-06T03:38:46.390 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-06-06T03:38:46.390 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-06-06T03:38:46.390 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-06-06T03:38:46.390 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-06-06T03:38:46.391 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:46.391 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-06-06T03:38:46.391 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-06-06T03:38:46.391 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-06-06T03:38:46.391 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 0, 2024-06-06T03:38:46.391 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 0, 2024-06-06T03:38:46.391 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-06-06T03:38:46.391 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.391 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.391 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.391 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:46.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-06-06T03:38:46.391 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle-0x55c1011406e0": { 2024-06-06T03:38:46.391 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-06-06T03:38:46.392 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-06-06T03:38:46.392 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-06-06T03:38:46.392 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-06-06T03:38:46.392 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-06-06T03:38:46.392 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-06-06T03:38:46.392 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-06-06T03:38:46.392 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-06-06T03:38:46.392 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-06-06T03:38:46.392 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 0, 2024-06-06T03:38:46.392 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 0, 2024-06-06T03:38:46.392 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-06-06T03:38:46.392 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-06-06T03:38:46.392 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-06-06T03:38:46.392 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-06-06T03:38:46.392 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:46.393 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-06-06T03:38:46.393 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-06-06T03:38:47.173 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-06-06T03:38:47.173 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-06-06T03:38:47.173 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-06-06T03:38:47.173 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-06-06T03:38:47.174 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-06-06T03:38:47.185 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-06-06T03:38:47.185 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-06-06T03:38:47.185 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-06T03:38:47.186 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:47 smithi122 ceph-mon[35759]: pgmap v795: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:38:47.213 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-06-06T03:38:47.213 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-06T03:38:47.274 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd blocklist ls 2024-06-06T03:38:47.349 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:47 smithi079 ceph-mon[35478]: pgmap v795: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:38:47.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:47 smithi050 ceph-mon[32421]: pgmap v795: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-06T03:38:47.579 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:38:49.385 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:49 smithi050 ceph-mon[32421]: pgmap v796: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:38:49.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.385+0000 7f538d0a0700 1 -- 172.21.15.50:0/4154309963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5388102740 msgr2=0x7f5388102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:49.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.385+0000 7f538d0a0700 1 --2- 172.21.15.50:0/4154309963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5388102740 0x7f5388102b20 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f53780099c0 tx=0x7f5378009cd0 comp rx=0 tx=0).stop 2024-06-06T03:38:49.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.385+0000 7f538d0a0700 1 -- 172.21.15.50:0/4154309963 shutdown_connections 2024-06-06T03:38:49.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.385+0000 7f538d0a0700 1 --2- 172.21.15.50:0/4154309963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5388107840 0x7f538810f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:49.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.385+0000 7f538d0a0700 1 --2- 172.21.15.50:0/4154309963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5388102740 0x7f5388102b20 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:49.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.385+0000 7f538d0a0700 1 --2- 172.21.15.50:0/4154309963 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53881030f0 0x7f5388107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:49.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.385+0000 7f538d0a0700 1 -- 172.21.15.50:0/4154309963 >> 172.21.15.50:0/4154309963 conn(0x7f53880795f0 msgr2=0x7f5388079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:38:49.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.385+0000 7f538d0a0700 1 -- 172.21.15.50:0/4154309963 shutdown_connections 2024-06-06T03:38:49.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.385+0000 7f538d0a0700 1 -- 172.21.15.50:0/4154309963 wait complete. 2024-06-06T03:38:49.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.385+0000 7f538d0a0700 1 Processor -- start 2024-06-06T03:38:49.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.386+0000 7f538d0a0700 1 -- start start 2024-06-06T03:38:49.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.386+0000 7f538d0a0700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5388102740 0x7f538819e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:49.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.386+0000 7f538d0a0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53881030f0 0x7f538819ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:49.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.386+0000 7f538d0a0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5388107840 0x7f53881988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:49.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.386+0000 7f538d0a0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5388112610 con 0x7f5388107840 2024-06-06T03:38:49.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.386+0000 7f538d0a0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5388112490 con 0x7f53881030f0 2024-06-06T03:38:49.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.386+0000 7f538d0a0700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5388112790 con 0x7f5388102740 2024-06-06T03:38:49.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.386+0000 7f538759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5388107840 0x7f53881988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:49.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.386+0000 7f538759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5388107840 0x7f53881988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60204/0 (socket says 172.21.15.50:60204) 2024-06-06T03:38:49.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.386+0000 7f538759e700 1 -- 172.21.15.50:0/98374064 learned_addr learned my addr 172.21.15.50:0/98374064 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:38:49.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.386+0000 7f538659c700 1 --2- 172.21.15.50:0/98374064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53881030f0 0x7f538819ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:49.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.386+0000 7f5386d9d700 1 --2- 172.21.15.50:0/98374064 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5388102740 0x7f538819e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:49.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.387+0000 7f538759e700 1 -- 172.21.15.50:0/98374064 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5388102740 msgr2=0x7f538819e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:49.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.387+0000 7f538759e700 1 --2- 172.21.15.50:0/98374064 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5388102740 0x7f538819e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:49.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.387+0000 7f538759e700 1 -- 172.21.15.50:0/98374064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53881030f0 msgr2=0x7f538819ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:49.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.387+0000 7f538759e700 1 --2- 172.21.15.50:0/98374064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53881030f0 0x7f538819ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:49.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.387+0000 7f538759e700 1 -- 172.21.15.50:0/98374064 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5388199030 con 0x7f5388107840 2024-06-06T03:38:49.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.387+0000 7f538659c700 1 --2- 172.21.15.50:0/98374064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53881030f0 0x7f538819ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:38:49.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.387+0000 7f538759e700 1 --2- 172.21.15.50:0/98374064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5388107840 0x7f53881988d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f538000ada0 tx=0x7f538000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:38:49.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.387+0000 7f536ffff700 1 -- 172.21.15.50:0/98374064 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5380017020 con 0x7f5388107840 2024-06-06T03:38:49.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.387+0000 7f538d0a0700 1 -- 172.21.15.50:0/98374064 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5388199320 con 0x7f5388107840 2024-06-06T03:38:49.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.387+0000 7f536ffff700 1 -- 172.21.15.50:0/98374064 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f538000cd80 con 0x7f5388107840 2024-06-06T03:38:49.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.387+0000 7f536ffff700 1 -- 172.21.15.50:0/98374064 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5380005260 con 0x7f5388107840 2024-06-06T03:38:49.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.387+0000 7f538d0a0700 1 -- 172.21.15.50:0/98374064 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53881a5590 con 0x7f5388107840 2024-06-06T03:38:49.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.388+0000 7f538d0a0700 1 -- 172.21.15.50:0/98374064 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f538810aa80 con 0x7f5388107840 2024-06-06T03:38:49.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.389+0000 7f536ffff700 1 -- 172.21.15.50:0/98374064 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f538000c8d0 con 0x7f5388107840 2024-06-06T03:38:49.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.390+0000 7f536ffff700 1 --2- 172.21.15.50:0/98374064 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f53700a2c20 0x7f53700a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:49.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.390+0000 7f5386d9d700 1 --2- 172.21.15.50:0/98374064 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f53700a2c20 0x7f53700a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:49.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.390+0000 7f536ffff700 1 -- 172.21.15.50:0/98374064 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7f53800cf090 con 0x7f5388107840 2024-06-06T03:38:49.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.391+0000 7f5386d9d700 1 --2- 172.21.15.50:0/98374064 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f53700a2c20 0x7f53700a50e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5378000c00 tx=0x7f5378005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:38:49.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.394+0000 7f536ffff700 1 -- 172.21.15.50:0/98374064 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5380021020 con 0x7f5388107840 2024-06-06T03:38:49.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:49 smithi122 ceph-mon[35759]: pgmap v796: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:38:49.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:49 smithi079 ceph-mon[35478]: pgmap v796: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:38:49.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.616+0000 7f538d0a0700 1 -- 172.21.15.50:0/98374064 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5388199db0 con 0x7f5388107840 2024-06-06T03:38:49.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.616+0000 7f536ffff700 1 -- 172.21.15.50:0/98374064 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v99) ==== 81+0+591 (secure 0 0 0) 0x7f538009bca0 con 0x7f5388107840 2024-06-06T03:38:49.617 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6800/1311987652 2024-06-07T03:15:13.252241+0000 2024-06-06T03:38:49.617 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/1149897118 2024-06-07T03:15:13.252241+0000 2024-06-06T03:38:49.617 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6800/2617801068 2024-06-07T03:14:46.388744+0000 2024-06-06T03:38:49.617 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/1068038293 2024-06-07T03:14:46.388744+0000 2024-06-06T03:38:49.617 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/4038080419 2024-06-07T03:15:13.252241+0000 2024-06-06T03:38:49.617 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/149912088 2024-06-07T03:14:46.388744+0000 2024-06-06T03:38:49.617 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6801/2617801068 2024-06-07T03:14:46.388744+0000 2024-06-06T03:38:49.617 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/2963887224 2024-06-07T03:14:46.388744+0000 2024-06-06T03:38:49.617 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6801/1311987652 2024-06-07T03:15:13.252241+0000 2024-06-06T03:38:49.617 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/2554563139 2024-06-07T03:15:13.252241+0000 2024-06-06T03:38:49.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.619+0000 7f538d0a0700 1 -- 172.21.15.50:0/98374064 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f53700a2c20 msgr2=0x7f53700a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:49.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.619+0000 7f538d0a0700 1 --2- 172.21.15.50:0/98374064 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f53700a2c20 0x7f53700a50e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5378000c00 tx=0x7f5378005fb0 comp rx=0 tx=0).stop 2024-06-06T03:38:49.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.619+0000 7f538d0a0700 1 -- 172.21.15.50:0/98374064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5388107840 msgr2=0x7f53881988d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:49.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.619+0000 7f538d0a0700 1 --2- 172.21.15.50:0/98374064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5388107840 0x7f53881988d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f538000ada0 tx=0x7f538000c330 comp rx=0 tx=0).stop 2024-06-06T03:38:49.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.619+0000 7f538d0a0700 1 -- 172.21.15.50:0/98374064 shutdown_connections 2024-06-06T03:38:49.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.619+0000 7f538d0a0700 1 --2- 172.21.15.50:0/98374064 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7f53700a2c20 0x7f53700a50e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:49.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.619+0000 7f538d0a0700 1 --2- 172.21.15.50:0/98374064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5388107840 0x7f53881988d0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:49.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.619+0000 7f538d0a0700 1 --2- 172.21.15.50:0/98374064 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5388102740 0x7f538819e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:49.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.619+0000 7f538d0a0700 1 --2- 172.21.15.50:0/98374064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53881030f0 0x7f538819ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:49.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.619+0000 7f538d0a0700 1 -- 172.21.15.50:0/98374064 >> 172.21.15.50:0/98374064 conn(0x7f53880795f0 msgr2=0x7f5388101ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:38:49.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.619+0000 7f538d0a0700 1 -- 172.21.15.50:0/98374064 shutdown_connections 2024-06-06T03:38:49.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:49.619+0000 7f538d0a0700 1 -- 172.21.15.50:0/98374064 wait complete. 2024-06-06T03:38:49.620 INFO:teuthology.orchestra.run.smithi050.stderr:listed 10 entries 2024-06-06T03:38:50.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:50 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/98374064' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-06T03:38:50.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:50 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/98374064' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-06T03:38:50.433 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-06-06T03:38:50.433 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-06T03:38:50.452 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 -- ceph osd blocklist ls 2024-06-06T03:38:50.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:50 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/98374064' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-06T03:38:50.756 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T03:38:51.181 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:51 smithi050 ceph-mon[32421]: pgmap v797: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-06-06T03:38:51.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:51 smithi122 ceph-mon[35759]: pgmap v797: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-06-06T03:38:51.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:51 smithi079 ceph-mon[35478]: pgmap v797: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-06-06T03:38:52.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.575+0000 7fed62c0e700 1 -- 172.21.15.50:0/3461255199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed5c107550 msgr2=0x7fed5c107930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:52.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.575+0000 7fed62c0e700 1 --2- 172.21.15.50:0/3461255199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed5c107550 0x7fed5c107930 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fed50009990 tx=0x7fed50009ca0 comp rx=0 tx=0).stop 2024-06-06T03:38:52.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.575+0000 7fed62c0e700 1 -- 172.21.15.50:0/3461255199 shutdown_connections 2024-06-06T03:38:52.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.575+0000 7fed62c0e700 1 --2- 172.21.15.50:0/3461255199 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed5c1017f0 0x7fed5c10f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:52.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.575+0000 7fed62c0e700 1 --2- 172.21.15.50:0/3461255199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed5c107550 0x7fed5c107930 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:52.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.575+0000 7fed62c0e700 1 --2- 172.21.15.50:0/3461255199 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed5c100e30 0x7fed5c1012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:52.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.575+0000 7fed62c0e700 1 -- 172.21.15.50:0/3461255199 >> 172.21.15.50:0/3461255199 conn(0x7fed5c0766b0 msgr2=0x7fed5c076ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:38:52.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.575+0000 7fed62c0e700 1 -- 172.21.15.50:0/3461255199 shutdown_connections 2024-06-06T03:38:52.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.575+0000 7fed62c0e700 1 -- 172.21.15.50:0/3461255199 wait complete. 2024-06-06T03:38:52.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.575+0000 7fed62c0e700 1 Processor -- start 2024-06-06T03:38:52.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.576+0000 7fed62c0e700 1 -- start start 2024-06-06T03:38:52.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.576+0000 7fed62c0e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed5c100e30 0x7fed5c19f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:52.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.576+0000 7fed62c0e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed5c1017f0 0x7fed5c19fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:52.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.576+0000 7fed62c0e700 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed5c107550 0x7fed5c10e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:52.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.576+0000 7fed62c0e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fed5c1126c0 con 0x7fed5c1017f0 2024-06-06T03:38:52.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.576+0000 7fed62c0e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fed5c112540 con 0x7fed5c100e30 2024-06-06T03:38:52.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.576+0000 7fed62c0e700 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fed5c112840 con 0x7fed5c107550 2024-06-06T03:38:52.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.576+0000 7fed5bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed5c1017f0 0x7fed5c19fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:52.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.576+0000 7fed609aa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed5c100e30 0x7fed5c19f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:52.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.576+0000 7fed5bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed5c1017f0 0x7fed5c19fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60228/0 (socket says 172.21.15.50:60228) 2024-06-06T03:38:52.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.576+0000 7fed5bfff700 1 -- 172.21.15.50:0/3761180842 learned_addr learned my addr 172.21.15.50:0/3761180842 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-06-06T03:38:52.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.576+0000 7fed611ab700 1 --2- 172.21.15.50:0/3761180842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed5c107550 0x7fed5c10e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:52.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.576+0000 7fed5bfff700 1 -- 172.21.15.50:0/3761180842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed5c107550 msgr2=0x7fed5c10e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:52.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.576+0000 7fed5bfff700 1 --2- 172.21.15.50:0/3761180842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed5c107550 0x7fed5c10e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:52.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.576+0000 7fed5bfff700 1 -- 172.21.15.50:0/3761180842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed5c100e30 msgr2=0x7fed5c19f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:52.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.576+0000 7fed5bfff700 1 --2- 172.21.15.50:0/3761180842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed5c100e30 0x7fed5c19f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:52.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.576+0000 7fed5bfff700 1 -- 172.21.15.50:0/3761180842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed5c10eee0 con 0x7fed5c1017f0 2024-06-06T03:38:52.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.576+0000 7fed609aa700 1 --2- 172.21.15.50:0/3761180842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed5c100e30 0x7fed5c19f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T03:38:52.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.577+0000 7fed5bfff700 1 --2- 172.21.15.50:0/3761180842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed5c1017f0 0x7fed5c19fdf0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fed4800b530 tx=0x7fed4800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:38:52.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.577+0000 7fed59ffb700 1 -- 172.21.15.50:0/3761180842 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed48015020 con 0x7fed5c1017f0 2024-06-06T03:38:52.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.577+0000 7fed62c0e700 1 -- 172.21.15.50:0/3761180842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed5c10f1d0 con 0x7fed5c1017f0 2024-06-06T03:38:52.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.577+0000 7fed59ffb700 1 -- 172.21.15.50:0/3761180842 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fed48011ce0 con 0x7fed5c1017f0 2024-06-06T03:38:52.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.577+0000 7fed59ffb700 1 -- 172.21.15.50:0/3761180842 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed48010e40 con 0x7fed5c1017f0 2024-06-06T03:38:52.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.577+0000 7fed62c0e700 1 -- 172.21.15.50:0/3761180842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed5c19b460 con 0x7fed5c1017f0 2024-06-06T03:38:52.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.578+0000 7fed62c0e700 1 -- 172.21.15.50:0/3761180842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed5c069180 con 0x7fed5c1017f0 2024-06-06T03:38:52.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.579+0000 7fed59ffb700 1 -- 172.21.15.50:0/3761180842 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fed48018020 con 0x7fed5c1017f0 2024-06-06T03:38:52.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.580+0000 7fed59ffb700 1 --2- 172.21.15.50:0/3761180842 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fed4c0a2ca0 0x7fed4c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T03:38:52.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.580+0000 7fed609aa700 1 --2- 172.21.15.50:0/3761180842 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fed4c0a2ca0 0x7fed4c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T03:38:52.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.580+0000 7fed59ffb700 1 -- 172.21.15.50:0/3761180842 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9121+0+0 (secure 0 0 0) 0x7fed480ceb90 con 0x7fed5c1017f0 2024-06-06T03:38:52.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.581+0000 7fed609aa700 1 --2- 172.21.15.50:0/3761180842 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fed4c0a2ca0 0x7fed4c0a5160 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fed50006010 tx=0x7fed50005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T03:38:52.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.585+0000 7fed59ffb700 1 -- 172.21.15.50:0/3761180842 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fed4801f020 con 0x7fed5c1017f0 2024-06-06T03:38:52.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.806+0000 7fed62c0e700 1 -- 172.21.15.50:0/3761180842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fed5c19b780 con 0x7fed5c1017f0 2024-06-06T03:38:52.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.807+0000 7fed59ffb700 1 -- 172.21.15.50:0/3761180842 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v99) ==== 81+0+591 (secure 0 0 0) 0x7fed48010380 con 0x7fed5c1017f0 2024-06-06T03:38:52.807 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6800/1311987652 2024-06-07T03:15:13.252241+0000 2024-06-06T03:38:52.807 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/1149897118 2024-06-07T03:15:13.252241+0000 2024-06-06T03:38:52.807 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6800/2617801068 2024-06-07T03:14:46.388744+0000 2024-06-06T03:38:52.808 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/1068038293 2024-06-07T03:14:46.388744+0000 2024-06-06T03:38:52.808 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/4038080419 2024-06-07T03:15:13.252241+0000 2024-06-06T03:38:52.808 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/149912088 2024-06-07T03:14:46.388744+0000 2024-06-06T03:38:52.808 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6801/2617801068 2024-06-07T03:14:46.388744+0000 2024-06-06T03:38:52.808 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/2963887224 2024-06-07T03:14:46.388744+0000 2024-06-06T03:38:52.808 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6801/1311987652 2024-06-07T03:15:13.252241+0000 2024-06-06T03:38:52.808 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/2554563139 2024-06-07T03:15:13.252241+0000 2024-06-06T03:38:52.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.809+0000 7fed62c0e700 1 -- 172.21.15.50:0/3761180842 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fed4c0a2ca0 msgr2=0x7fed4c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:52.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.809+0000 7fed62c0e700 1 --2- 172.21.15.50:0/3761180842 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fed4c0a2ca0 0x7fed4c0a5160 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fed50006010 tx=0x7fed50005960 comp rx=0 tx=0).stop 2024-06-06T03:38:52.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.809+0000 7fed62c0e700 1 -- 172.21.15.50:0/3761180842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed5c1017f0 msgr2=0x7fed5c19fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T03:38:52.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.809+0000 7fed62c0e700 1 --2- 172.21.15.50:0/3761180842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed5c1017f0 0x7fed5c19fdf0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fed4800b530 tx=0x7fed4800b840 comp rx=0 tx=0).stop 2024-06-06T03:38:52.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.809+0000 7fed62c0e700 1 -- 172.21.15.50:0/3761180842 shutdown_connections 2024-06-06T03:38:52.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.809+0000 7fed62c0e700 1 --2- 172.21.15.50:0/3761180842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed5c107550 0x7fed5c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:52.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.809+0000 7fed62c0e700 1 --2- 172.21.15.50:0/3761180842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed5c100e30 0x7fed5c19f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:52.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.809+0000 7fed62c0e700 1 --2- 172.21.15.50:0/3761180842 >> [v2:172.21.15.50:6800/1779941165,v1:172.21.15.50:6801/1779941165] conn(0x7fed4c0a2ca0 0x7fed4c0a5160 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:52.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.809+0000 7fed62c0e700 1 --2- 172.21.15.50:0/3761180842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed5c1017f0 0x7fed5c19fdf0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T03:38:52.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.809+0000 7fed62c0e700 1 -- 172.21.15.50:0/3761180842 >> 172.21.15.50:0/3761180842 conn(0x7fed5c0766b0 msgr2=0x7fed5c0ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T03:38:52.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.809+0000 7fed62c0e700 1 -- 172.21.15.50:0/3761180842 shutdown_connections 2024-06-06T03:38:52.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-06-06T03:38:52.809+0000 7fed62c0e700 1 -- 172.21.15.50:0/3761180842 wait complete. 2024-06-06T03:38:52.811 INFO:teuthology.orchestra.run.smithi050.stderr:listed 10 entries 2024-06-06T03:38:53.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:53 smithi122 ceph-mon[35759]: pgmap v798: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T03:38:53.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:53 smithi122 ceph-mon[35759]: from='client.? 172.21.15.50:0/3761180842' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-06T03:38:53.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:53 smithi050 ceph-mon[32421]: pgmap v798: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T03:38:53.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:53 smithi050 ceph-mon[32421]: from='client.? 172.21.15.50:0/3761180842' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-06T03:38:53.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:53 smithi079 ceph-mon[35478]: pgmap v798: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T03:38:53.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:53 smithi079 ceph-mon[35478]: from='client.? 172.21.15.50:0/3761180842' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-06T03:38:53.601 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi050.front.sepia.ceph.com... 2024-06-06T03:38:53.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T03:38:53.601 DEBUG:teuthology.orchestra.run.smithi050:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-06-06T03:38:53.657 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[90997]: fuse finished with error 0 and tester_r 0 2024-06-06T03:38:53.658 INFO:teuthology.orchestra.run:waiting for 300 2024-06-06T03:38:55.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:55 smithi122 ceph-mon[35759]: pgmap v799: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:38:55.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:55 smithi050 ceph-mon[32421]: pgmap v799: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:38:55.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:55 smithi079 ceph-mon[35478]: pgmap v799: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-06T03:38:57.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:57 smithi122 ceph-mon[35759]: pgmap v800: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-06-06T03:38:57.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:57 smithi050 ceph-mon[32421]: pgmap v800: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-06-06T03:38:57.600 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:57 smithi079 ceph-mon[35478]: pgmap v800: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-06-06T03:38:59.431 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:38:59 smithi122 ceph-mon[35759]: pgmap v801: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2024-06-06T03:38:59.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:38:59 smithi050 ceph-mon[32421]: pgmap v801: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2024-06-06T03:38:59.599 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:38:59 smithi079 ceph-mon[35478]: pgmap v801: 129 pgs: 129 active+clean; 1.6 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2024-06-06T03:38:59.760 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-06-06T03:38:59.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T03:38:59.761 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-06T03:38:59.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T03:38:59.800 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-06-06T03:38:59.887 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-06T03:38:59.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T03:38:59.888 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-06T03:38:59.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T03:38:59.919 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2024-06-06T03:39:00.027 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-06-06T03:39:00.040 INFO:tasks.cephadm:Teardown begin 2024-06-06T03:39:00.040 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph_3d746ca5346f34eef7e826a1eb71e59e02b682ae/qa/tasks/cephadm.py", line 2240, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_3d746ca5346f34eef7e826a1eb71e59e02b682ae/qa/tasks/fwd_scrub.py", line 155, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph_3d746ca5346f34eef7e826a1eb71e59e02b682ae/qa/tasks/fwd_scrub.py", line 90, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-06-06T03:39:00.042 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-06T03:39:00.104 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-06T03:39:00.138 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-06T03:39:00.172 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-06-06T03:39:00.172 DEBUG:teuthology.orchestra.run.smithi050:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-06-06T03:39:00.196 DEBUG:teuthology.orchestra.run.smithi079:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-06-06T03:39:00.214 DEBUG:teuthology.orchestra.run.smithi122:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-06-06T03:39:00.231 INFO:tasks.cephadm:Stopping all daemons... 2024-06-06T03:39:00.231 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-06-06T03:39:00.231 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mon.a 2024-06-06T03:39:00.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:39:00 smithi050 systemd[1]: Stopping Ceph mon.a for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:39:00.912 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:39:00 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mon-a[32417]: 2024-06-06T03:39:00.585+0000 7fd8a0fc2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T03:39:00.912 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:39:00 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mon-a[32417]: 2024-06-06T03:39:00.585+0000 7fd8a0fc2700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-06-06T03:39:00.912 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:39:00 smithi050 podman[117221]: 2024-06-06 03:39:00.62777737 +0000 UTC m=+0.190188117 container died b4c44489782c836189abc33dbe7c8393ea4dec329aaec4e9e8b59e7a381bb9b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mon-a, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux ) 2024-06-06T03:39:01.164 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:39:01 smithi050 podman[117221]: 2024-06-06 03:39:01.16309282 +0000 UTC m=+0.725503561 container cleanup b4c44489782c836189abc33dbe7c8393ea4dec329aaec4e9e8b59e7a381bb9b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mon-a, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, ceph=True) 2024-06-06T03:39:01.164 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:39:01 smithi050 bash[117221]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mon-a 2024-06-06T03:39:01.626 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mon.a.service' 2024-06-06T03:39:01.649 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:39:01 smithi050 podman[117233]: 2024-06-06 03:39:01.398558532 +0000 UTC m=+0.763822627 container remove b4c44489782c836189abc33dbe7c8393ea4dec329aaec4e9e8b59e7a381bb9b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mon-a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-06-06T03:39:01.650 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:39:01 smithi050 systemd[1]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mon.a.service: Deactivated successfully. 2024-06-06T03:39:01.650 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:39:01 smithi050 systemd[1]: Stopped Ceph mon.a for b6263b26-23b2-11ef-bc9b-c7b262605968. 2024-06-06T03:39:01.650 INFO:journalctl@ceph.mon.a.smithi050.stdout:Jun 06 03:39:01 smithi050 systemd[1]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mon.a.service: Consumed 25.090s CPU time. 2024-06-06T03:39:01.666 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T03:39:01.666 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-06-06T03:39:01.666 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-06-06T03:39:01.666 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mon.b 2024-06-06T03:39:01.992 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:39:01 smithi079 systemd[1]: Stopping Ceph mon.b for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:39:02.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:39:01 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mon-b[35474]: 2024-06-06T03:39:01.992+0000 7fe6e39d1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T03:39:02.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:39:01 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mon-b[35474]: 2024-06-06T03:39:01.992+0000 7fe6e39d1700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-06-06T03:39:02.350 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:39:02 smithi079 podman[70167]: 2024-06-06 03:39:02.156243979 +0000 UTC m=+0.284845285 container died 186ca630d87817f046bcb3a84cd52b0301f2003a9991330c5735c8405168be51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mon-b, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True) 2024-06-06T03:39:02.803 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:39:02 smithi079 podman[70167]: 2024-06-06 03:39:02.560529215 +0000 UTC m=+0.689130522 container cleanup 186ca630d87817f046bcb3a84cd52b0301f2003a9991330c5735c8405168be51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mon-b, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T03:39:02.803 INFO:journalctl@ceph.mon.b.smithi079.stdout:Jun 06 03:39:02 smithi079 bash[70167]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mon-b 2024-06-06T03:39:02.932 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mon.b.service' 2024-06-06T03:39:02.978 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T03:39:02.978 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-06-06T03:39:02.979 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-06-06T03:39:02.979 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mon.c 2024-06-06T03:39:03.310 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:39:03 smithi122 systemd[1]: Stopping Ceph mon.c for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:39:03.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:39:03 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mon-c[35755]: 2024-06-06T03:39:03.309+0000 7ff246321700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T03:39:03.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:39:03 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mon-c[35755]: 2024-06-06T03:39:03.309+0000 7ff246321700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-06-06T03:39:03.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:39:03 smithi122 podman[71242]: 2024-06-06 03:39:03.525266657 +0000 UTC m=+0.330753835 container died ef50acc7ae0464499a80d90f1c89ab1a2d0eed3838948dc960becef95c58cf6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mon-c, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2) 2024-06-06T03:39:04.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:39:03 smithi122 podman[71242]: 2024-06-06 03:39:03.919273869 +0000 UTC m=+0.724761049 container cleanup ef50acc7ae0464499a80d90f1c89ab1a2d0eed3838948dc960becef95c58cf6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mon-c, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, ceph=True) 2024-06-06T03:39:04.181 INFO:journalctl@ceph.mon.c.smithi122.stdout:Jun 06 03:39:03 smithi122 bash[71242]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mon-c 2024-06-06T03:39:04.332 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mon.c.service' 2024-06-06T03:39:04.377 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T03:39:04.377 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-06-06T03:39:04.377 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-06-06T03:39:04.377 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mgr.x 2024-06-06T03:39:04.739 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:39:04 smithi050 systemd[1]: Stopping Ceph mgr.x for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:39:05.001 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:39:04 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:39:04.739+0000 7f222a85e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T03:39:05.002 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:39:04 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x[32650]: 2024-06-06T03:39:04.739+0000 7f222a85e700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-06-06T03:39:05.002 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:39:04 smithi050 podman[117345]: 2024-06-06 03:39:04.770513643 +0000 UTC m=+0.187236775 container died aec415784ccd6096453ee33ed3facb6b31c2086e42bcdb4a78d0d46cd9727098 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-06T03:39:05.501 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:39:05 smithi050 podman[117345]: 2024-06-06 03:39:05.33675373 +0000 UTC m=+0.753476851 container cleanup aec415784ccd6096453ee33ed3facb6b31c2086e42bcdb4a78d0d46cd9727098 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc) 2024-06-06T03:39:05.501 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:39:05 smithi050 bash[117345]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x 2024-06-06T03:39:05.836 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Jun 06 03:39:05 smithi050 podman[117358]: 2024-06-06 03:39:05.580868555 +0000 UTC m=+0.779912908 container remove aec415784ccd6096453ee33ed3facb6b31c2086e42bcdb4a78d0d46cd9727098 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=) 2024-06-06T03:39:05.841 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mgr.x.service' 2024-06-06T03:39:05.877 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T03:39:05.877 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-06-06T03:39:05.878 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-06-06T03:39:05.878 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mgr.y 2024-06-06T03:39:06.212 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:39:05 smithi079 systemd[1]: Stopping Ceph mgr.y for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:39:06.534 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:39:06 smithi079 podman[70291]: 2024-06-06 03:39:06.212342916 +0000 UTC m=+0.127642775 container died 512ba03023aede39db4a9fe9d95e49220bdd55c09ab6864f36893d59248c9293 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T03:39:06.849 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:39:06 smithi079 podman[70291]: 2024-06-06 03:39:06.634459544 +0000 UTC m=+0.549759397 container cleanup 512ba03023aede39db4a9fe9d95e49220bdd55c09ab6864f36893d59248c9293 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-3d89acc) 2024-06-06T03:39:06.850 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:39:06 smithi079 bash[70291]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y 2024-06-06T03:39:07.102 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:39:06 smithi079 podman[70303]: 2024-06-06 03:39:06.853088155 +0000 UTC m=+0.634935737 container remove 512ba03023aede39db4a9fe9d95e49220bdd55c09ab6864f36893d59248c9293 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-y, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux ) 2024-06-06T03:39:07.102 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Jun 06 03:39:06 smithi079 systemd[1]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-06-06T03:39:07.105 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mgr.y.service' 2024-06-06T03:39:07.141 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T03:39:07.142 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-06-06T03:39:07.142 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-06-06T03:39:07.142 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mgr.z 2024-06-06T03:39:07.427 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:39:07 smithi122 systemd[1]: Stopping Ceph mgr.z for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:39:07.681 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:39:07 smithi122 podman[71376]: 2024-06-06 03:39:07.495847113 +0000 UTC m=+0.140990632 container died 192ca4dae59643abc82c46c69f1a2cf590e51282d0d8ee5747ec2e0d96fa4921 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-z, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-06T03:39:08.167 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:39:07 smithi122 podman[71376]: 2024-06-06 03:39:07.884442994 +0000 UTC m=+0.529586468 container cleanup 192ca4dae59643abc82c46c69f1a2cf590e51282d0d8ee5747ec2e0d96fa4921 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-z, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-06-06T03:39:08.168 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Jun 06 03:39:07 smithi122 bash[71376]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mgr-z 2024-06-06T03:39:08.316 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mgr.z.service' 2024-06-06T03:39:08.353 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T03:39:08.353 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-06-06T03:39:08.353 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-06-06T03:39:08.353 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.0 2024-06-06T03:39:08.675 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jun 06 03:39:08 smithi050 systemd[1]: Stopping Ceph osd.0 for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:39:09.001 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jun 06 03:39:08 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-0[47092]: 2024-06-06T03:39:08.675+0000 7f12ee4bd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T03:39:09.001 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jun 06 03:39:08 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-0[47092]: 2024-06-06T03:39:08.675+0000 7f12ee4bd700 -1 osd.0 99 *** Got signal Terminated *** 2024-06-06T03:39:09.001 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jun 06 03:39:08 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-0[47092]: 2024-06-06T03:39:08.675+0000 7f12ee4bd700 -1 osd.0 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T03:39:14.411 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jun 06 03:39:14 smithi050 podman[117468]: 2024-06-06 03:39:14.110313609 +0000 UTC m=+5.556153605 container died 07b05038d3539268a5a96df9ef1cb743dd571201612c290e2dcce4b2a7da4582 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-0, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-06-06T03:39:14.751 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jun 06 03:39:14 smithi050 podman[117468]: 2024-06-06 03:39:14.609898291 +0000 UTC m=+6.055738280 container cleanup 07b05038d3539268a5a96df9ef1cb743dd571201612c290e2dcce4b2a7da4582 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528) 2024-06-06T03:39:14.751 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jun 06 03:39:14 smithi050 bash[117468]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-0 2024-06-06T03:39:15.251 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jun 06 03:39:14 smithi050 podman[117485]: 2024-06-06 03:39:14.886931771 +0000 UTC m=+0.774122994 container remove 07b05038d3539268a5a96df9ef1cb743dd571201612c290e2dcce4b2a7da4582 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-06-06T03:39:15.574 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jun 06 03:39:15 smithi050 podman[117575]: 2024-06-06 03:39:15.159869183 +0000 UTC m=+0.017792820 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T03:39:15.574 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jun 06 03:39:15 smithi050 podman[117575]: 2024-06-06 03:39:15.279786824 +0000 UTC m=+0.137710433 container create dc5239d82898046bf670a92e03a1293addd924cfe4292124f21d56ac9c30313a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc) 2024-06-06T03:39:16.001 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jun 06 03:39:15 smithi050 podman[117575]: 2024-06-06 03:39:15.574699612 +0000 UTC m=+0.432623230 container init dc5239d82898046bf670a92e03a1293addd924cfe4292124f21d56ac9c30313a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240528, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-06-06T03:39:16.001 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jun 06 03:39:15 smithi050 podman[117575]: 2024-06-06 03:39:15.578517317 +0000 UTC m=+0.436440938 container start dc5239d82898046bf670a92e03a1293addd924cfe4292124f21d56ac9c30313a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528) 2024-06-06T03:39:16.001 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jun 06 03:39:15 smithi050 podman[117575]: 2024-06-06 03:39:15.699869113 +0000 UTC m=+0.557792750 container attach dc5239d82898046bf670a92e03a1293addd924cfe4292124f21d56ac9c30313a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc) 2024-06-06T03:39:16.452 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jun 06 03:39:16 smithi050 podman[117575]: 2024-06-06 03:39:16.149917313 +0000 UTC m=+1.007840933 container died dc5239d82898046bf670a92e03a1293addd924cfe4292124f21d56ac9c30313a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-0-deactivate, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-06-06T03:39:16.785 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.0.service' 2024-06-06T03:39:16.828 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T03:39:16.828 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-06-06T03:39:16.829 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-06-06T03:39:16.829 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.1 2024-06-06T03:39:17.099 INFO:journalctl@ceph.osd.1.smithi079.stdout:Jun 06 03:39:16 smithi079 systemd[1]: Stopping Ceph osd.1 for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:39:17.600 INFO:journalctl@ceph.osd.1.smithi079.stdout:Jun 06 03:39:17 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-1[40039]: 2024-06-06T03:39:17.122+0000 7f68d8030700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T03:39:17.600 INFO:journalctl@ceph.osd.1.smithi079.stdout:Jun 06 03:39:17 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-1[40039]: 2024-06-06T03:39:17.122+0000 7f68d8030700 -1 osd.1 99 *** Got signal Terminated *** 2024-06-06T03:39:17.600 INFO:journalctl@ceph.osd.1.smithi079.stdout:Jun 06 03:39:17 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-1[40039]: 2024-06-06T03:39:17.122+0000 7f68d8030700 -1 osd.1 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T03:39:22.849 INFO:journalctl@ceph.osd.1.smithi079.stdout:Jun 06 03:39:22 smithi079 podman[70425]: 2024-06-06 03:39:22.562821805 +0000 UTC m=+5.541260302 container died 8179071c39bca108047545d50290c805893be7811364b67cdeaabbd6205286f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-1, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-06-06T03:39:23.241 INFO:journalctl@ceph.osd.1.smithi079.stdout:Jun 06 03:39:22 smithi079 podman[70425]: 2024-06-06 03:39:22.973464081 +0000 UTC m=+5.951902565 container cleanup 8179071c39bca108047545d50290c805893be7811364b67cdeaabbd6205286f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240528, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-06-06T03:39:23.241 INFO:journalctl@ceph.osd.1.smithi079.stdout:Jun 06 03:39:22 smithi079 bash[70425]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-1 2024-06-06T03:39:23.570 INFO:journalctl@ceph.osd.1.smithi079.stdout:Jun 06 03:39:23 smithi079 podman[70444]: 2024-06-06 03:39:23.241969604 +0000 UTC m=+0.680862432 container remove 8179071c39bca108047545d50290c805893be7811364b67cdeaabbd6205286f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-1, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True) 2024-06-06T03:39:23.849 INFO:journalctl@ceph.osd.1.smithi079.stdout:Jun 06 03:39:23 smithi079 podman[70531]: 2024-06-06 03:39:23.474199857 +0000 UTC m=+0.017406356 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T03:39:23.850 INFO:journalctl@ceph.osd.1.smithi079.stdout:Jun 06 03:39:23 smithi079 podman[70531]: 2024-06-06 03:39:23.584628095 +0000 UTC m=+0.127834600 container create 405d8ed01e2780aede7dccf3a581e0989138b8e9b4e263a5aead64220439933e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc) 2024-06-06T03:39:23.850 INFO:journalctl@ceph.osd.1.smithi079.stdout:Jun 06 03:39:23 smithi079 podman[70531]: 2024-06-06 03:39:23.804419845 +0000 UTC m=+0.347626344 container init 405d8ed01e2780aede7dccf3a581e0989138b8e9b4e263a5aead64220439933e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=) 2024-06-06T03:39:23.850 INFO:journalctl@ceph.osd.1.smithi079.stdout:Jun 06 03:39:23 smithi079 podman[70531]: 2024-06-06 03:39:23.807906367 +0000 UTC m=+0.351112866 container start 405d8ed01e2780aede7dccf3a581e0989138b8e9b4e263a5aead64220439933e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-06T03:39:24.100 INFO:journalctl@ceph.osd.1.smithi079.stdout:Jun 06 03:39:23 smithi079 podman[70531]: 2024-06-06 03:39:23.921708258 +0000 UTC m=+0.464914774 container attach 405d8ed01e2780aede7dccf3a581e0989138b8e9b4e263a5aead64220439933e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-06-06T03:39:24.372 INFO:journalctl@ceph.osd.1.smithi079.stdout:Jun 06 03:39:24 smithi079 podman[70531]: 2024-06-06 03:39:24.102009285 +0000 UTC m=+0.645215805 container died 405d8ed01e2780aede7dccf3a581e0989138b8e9b4e263a5aead64220439933e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-06-06T03:39:24.774 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.1.service' 2024-06-06T03:39:24.812 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T03:39:24.812 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-06-06T03:39:24.812 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-06-06T03:39:24.812 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.2 2024-06-06T03:39:25.129 INFO:journalctl@ceph.osd.2.smithi122.stdout:Jun 06 03:39:24 smithi122 systemd[1]: Stopping Ceph osd.2 for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:39:25.431 INFO:journalctl@ceph.osd.2.smithi122.stdout:Jun 06 03:39:25 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-2[40843]: 2024-06-06T03:39:25.129+0000 7f9c87afc700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T03:39:25.431 INFO:journalctl@ceph.osd.2.smithi122.stdout:Jun 06 03:39:25 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-2[40843]: 2024-06-06T03:39:25.129+0000 7f9c87afc700 -1 osd.2 99 *** Got signal Terminated *** 2024-06-06T03:39:25.431 INFO:journalctl@ceph.osd.2.smithi122.stdout:Jun 06 03:39:25 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-2[40843]: 2024-06-06T03:39:25.129+0000 7f9c87afc700 -1 osd.2 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T03:39:30.931 INFO:journalctl@ceph.osd.2.smithi122.stdout:Jun 06 03:39:30 smithi122 podman[71504]: 2024-06-06 03:39:30.648876164 +0000 UTC m=+5.634644642 container died 03cdbf692bdf23d6334f9a0ac463e8f1f4906ab41b535accbe1cdc9eacfa90c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-2, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T03:39:31.306 INFO:journalctl@ceph.osd.2.smithi122.stdout:Jun 06 03:39:31 smithi122 podman[71504]: 2024-06-06 03:39:31.030921938 +0000 UTC m=+6.016690413 container cleanup 03cdbf692bdf23d6334f9a0ac463e8f1f4906ab41b535accbe1cdc9eacfa90c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528) 2024-06-06T03:39:31.306 INFO:journalctl@ceph.osd.2.smithi122.stdout:Jun 06 03:39:31 smithi122 bash[71504]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-2 2024-06-06T03:39:31.621 INFO:journalctl@ceph.osd.2.smithi122.stdout:Jun 06 03:39:31 smithi122 podman[71523]: 2024-06-06 03:39:31.307516986 +0000 UTC m=+0.651152990 container remove 03cdbf692bdf23d6334f9a0ac463e8f1f4906ab41b535accbe1cdc9eacfa90c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True) 2024-06-06T03:39:31.931 INFO:journalctl@ceph.osd.2.smithi122.stdout:Jun 06 03:39:31 smithi122 podman[71611]: 2024-06-06 03:39:31.525443294 +0000 UTC m=+0.017590826 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T03:39:31.932 INFO:journalctl@ceph.osd.2.smithi122.stdout:Jun 06 03:39:31 smithi122 podman[71611]: 2024-06-06 03:39:31.658640779 +0000 UTC m=+0.150788362 container create ef1095f2b44fa75a080b17a9092b8746944eeb022697368e1f189bc364d72bf4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-06-06T03:39:32.269 INFO:journalctl@ceph.osd.2.smithi122.stdout:Jun 06 03:39:31 smithi122 podman[71611]: 2024-06-06 03:39:31.961914693 +0000 UTC m=+0.454062210 container init ef1095f2b44fa75a080b17a9092b8746944eeb022697368e1f189bc364d72bf4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-2-deactivate, RELEASE=squid-3d89acc, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-06-06T03:39:32.270 INFO:journalctl@ceph.osd.2.smithi122.stdout:Jun 06 03:39:31 smithi122 podman[71611]: 2024-06-06 03:39:31.96534419 +0000 UTC m=+0.457491717 container start ef1095f2b44fa75a080b17a9092b8746944eeb022697368e1f189bc364d72bf4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-06-06T03:39:32.270 INFO:journalctl@ceph.osd.2.smithi122.stdout:Jun 06 03:39:32 smithi122 podman[71611]: 2024-06-06 03:39:32.062351059 +0000 UTC m=+0.554498599 container attach ef1095f2b44fa75a080b17a9092b8746944eeb022697368e1f189bc364d72bf4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-2-deactivate, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True) 2024-06-06T03:39:32.553 INFO:journalctl@ceph.osd.2.smithi122.stdout:Jun 06 03:39:32 smithi122 podman[71611]: 2024-06-06 03:39:32.271369649 +0000 UTC m=+0.763517177 container died ef1095f2b44fa75a080b17a9092b8746944eeb022697368e1f189bc364d72bf4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240528, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc) 2024-06-06T03:39:32.917 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.2.service' 2024-06-06T03:39:32.957 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T03:39:32.957 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-06-06T03:39:32.957 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-06-06T03:39:32.958 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.3 2024-06-06T03:39:33.251 INFO:journalctl@ceph.osd.3.smithi050.stdout:Jun 06 03:39:33 smithi050 systemd[1]: Stopping Ceph osd.3 for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:39:33.537 INFO:journalctl@ceph.osd.3.smithi050.stdout:Jun 06 03:39:33 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-3[53586]: 2024-06-06T03:39:33.298+0000 7fc36d0f7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T03:39:33.537 INFO:journalctl@ceph.osd.3.smithi050.stdout:Jun 06 03:39:33 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-3[53586]: 2024-06-06T03:39:33.298+0000 7fc36d0f7700 -1 osd.3 99 *** Got signal Terminated *** 2024-06-06T03:39:33.537 INFO:journalctl@ceph.osd.3.smithi050.stdout:Jun 06 03:39:33 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-3[53586]: 2024-06-06T03:39:33.298+0000 7fc36d0f7700 -1 osd.3 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T03:39:35.626 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:35 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:35.269+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:39:35.931 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:35 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:35.627+0000 7f2a0b102700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.707162+0000 front 2024-06-06T03:39:11.707247+0000 (oldest deadline 2024-06-06T03:39:34.607295+0000) 2024-06-06T03:39:36.002 INFO:journalctl@ceph.osd.3.smithi050.stdout:Jun 06 03:39:35 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-3[53586]: 2024-06-06T03:39:35.509+0000 7fc3696eb700 -1 osd.3 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.702756+0000 front 2024-06-06T03:39:11.702813+0000 (oldest deadline 2024-06-06T03:39:35.202950+0000) 2024-06-06T03:39:36.590 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:36 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:36.255+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:39:36.591 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:36 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:36.301+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:39:36.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:36 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:36.194+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:39:36.931 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:36 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:36.591+0000 7f2a0b102700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.707162+0000 front 2024-06-06T03:39:11.707247+0000 (oldest deadline 2024-06-06T03:39:34.607295+0000) 2024-06-06T03:39:37.001 INFO:journalctl@ceph.osd.3.smithi050.stdout:Jun 06 03:39:36 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-3[53586]: 2024-06-06T03:39:36.539+0000 7fc3696eb700 -1 osd.3 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.702756+0000 front 2024-06-06T03:39:11.702813+0000 (oldest deadline 2024-06-06T03:39:35.202950+0000) 2024-06-06T03:39:37.001 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:36 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:36.723+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:39:37.599 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:37 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:37.166+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:39:37.621 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:37 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:37.302+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:39:37.622 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:37 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:37.343+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:39:37.931 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:37 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:37.622+0000 7f2a0b102700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.707162+0000 front 2024-06-06T03:39:11.707247+0000 (oldest deadline 2024-06-06T03:39:34.607295+0000) 2024-06-06T03:39:38.001 INFO:journalctl@ceph.osd.3.smithi050.stdout:Jun 06 03:39:37 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-3[53586]: 2024-06-06T03:39:37.519+0000 7fc3696eb700 -1 osd.3 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.702756+0000 front 2024-06-06T03:39:11.702813+0000 (oldest deadline 2024-06-06T03:39:35.202950+0000) 2024-06-06T03:39:38.001 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:37 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:37.768+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:39:38.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:38 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:38.187+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:39:38.642 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:38 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:38.322+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:39:38.643 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:38 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:38.391+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:39:38.931 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:38 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:38.643+0000 7f2a0b102700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.707162+0000 front 2024-06-06T03:39:11.707247+0000 (oldest deadline 2024-06-06T03:39:34.607295+0000) 2024-06-06T03:39:39.042 INFO:journalctl@ceph.osd.3.smithi050.stdout:Jun 06 03:39:38 smithi050 podman[117680]: 2024-06-06 03:39:38.7530809 +0000 UTC m=+5.583503046 container died b8fdc02d8d35e3434bb515edb5b98f8ec7098d7acf159e7a14a1724476865f93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, ceph=True) 2024-06-06T03:39:39.042 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:38 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:38.780+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:39:39.501 INFO:journalctl@ceph.osd.3.smithi050.stdout:Jun 06 03:39:39 smithi050 podman[117680]: 2024-06-06 03:39:39.241232614 +0000 UTC m=+6.071654781 container cleanup b8fdc02d8d35e3434bb515edb5b98f8ec7098d7acf159e7a14a1724476865f93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-3, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-06-06T03:39:39.501 INFO:journalctl@ceph.osd.3.smithi050.stdout:Jun 06 03:39:39 smithi050 bash[117680]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-3 2024-06-06T03:39:39.599 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:39 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:39.190+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:39:39.606 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:39 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:39.333+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:39:39.606 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:39 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:39.435+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:39:39.606 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:39 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:39.606+0000 7f2a0b102700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.707162+0000 front 2024-06-06T03:39:11.707247+0000 (oldest deadline 2024-06-06T03:39:34.607295+0000) 2024-06-06T03:39:39.797 INFO:journalctl@ceph.osd.3.smithi050.stdout:Jun 06 03:39:39 smithi050 podman[117706]: 2024-06-06 03:39:39.535307213 +0000 UTC m=+0.775635876 container remove b8fdc02d8d35e3434bb515edb5b98f8ec7098d7acf159e7a14a1724476865f93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0) 2024-06-06T03:39:40.050 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:39 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:39.797+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:39:40.050 INFO:journalctl@ceph.osd.3.smithi050.stdout:Jun 06 03:39:39 smithi050 podman[117796]: 2024-06-06 03:39:39.785097501 +0000 UTC m=+0.017569119 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T03:39:40.050 INFO:journalctl@ceph.osd.3.smithi050.stdout:Jun 06 03:39:39 smithi050 podman[117796]: 2024-06-06 03:39:39.910893709 +0000 UTC m=+0.143365382 container create 1470d7c5dfcdef834165c140b1b23b2748b12508fd04602b3f80ef2da3c4f712 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T03:39:40.409 INFO:journalctl@ceph.osd.3.smithi050.stdout:Jun 06 03:39:40 smithi050 podman[117796]: 2024-06-06 03:39:40.180452931 +0000 UTC m=+0.412924542 container init 1470d7c5dfcdef834165c140b1b23b2748b12508fd04602b3f80ef2da3c4f712 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T03:39:40.409 INFO:journalctl@ceph.osd.3.smithi050.stdout:Jun 06 03:39:40 smithi050 podman[117796]: 2024-06-06 03:39:40.18450825 +0000 UTC m=+0.416979864 container start 1470d7c5dfcdef834165c140b1b23b2748b12508fd04602b3f80ef2da3c4f712 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-06-06T03:39:40.409 INFO:journalctl@ceph.osd.3.smithi050.stdout:Jun 06 03:39:40 smithi050 podman[117796]: 2024-06-06 03:39:40.288728898 +0000 UTC m=+0.521200547 container attach 1470d7c5dfcdef834165c140b1b23b2748b12508fd04602b3f80ef2da3c4f712 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-06-06T03:39:40.599 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:40 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:40.173+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:39:40.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:40 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:40.350+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:39:40.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:40 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:40.396+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:39:40.682 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:40 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:40.559+0000 7f2a0b102700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.707162+0000 front 2024-06-06T03:39:11.707247+0000 (oldest deadline 2024-06-06T03:39:34.607295+0000) 2024-06-06T03:39:40.751 INFO:journalctl@ceph.osd.3.smithi050.stdout:Jun 06 03:39:40 smithi050 podman[117796]: 2024-06-06 03:39:40.486905449 +0000 UTC m=+0.719377064 container died 1470d7c5dfcdef834165c140b1b23b2748b12508fd04602b3f80ef2da3c4f712 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-3-deactivate, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528) 2024-06-06T03:39:40.752 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:40 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:40.408+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.983190+0000 front 2024-06-06T03:39:10.983223+0000 (oldest deadline 2024-06-06T03:39:39.784169+0000) 2024-06-06T03:39:41.175 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:40 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:40.804+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:39:41.195 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.3.service' 2024-06-06T03:39:41.243 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T03:39:41.244 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-06-06T03:39:41.244 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-06-06T03:39:41.244 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.4 2024-06-06T03:39:41.501 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:41 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:41.390+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.983190+0000 front 2024-06-06T03:39:10.983223+0000 (oldest deadline 2024-06-06T03:39:39.784169+0000) 2024-06-06T03:39:41.599 INFO:journalctl@ceph.osd.4.smithi079.stdout:Jun 06 03:39:41 smithi079 systemd[1]: Stopping Ceph osd.4 for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:39:41.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:41 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:41.207+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:39:41.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:41 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:41.307+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:39:41.681 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:41 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:41.431+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:39:41.682 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:41 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:41.529+0000 7f2a0b102700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.707162+0000 front 2024-06-06T03:39:11.707247+0000 (oldest deadline 2024-06-06T03:39:34.607295+0000) 2024-06-06T03:39:42.099 INFO:journalctl@ceph.osd.4.smithi079.stdout:Jun 06 03:39:41 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-4[46512]: 2024-06-06T03:39:41.686+0000 7f12a7306700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T03:39:42.099 INFO:journalctl@ceph.osd.4.smithi079.stdout:Jun 06 03:39:41 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-4[46512]: 2024-06-06T03:39:41.686+0000 7f12a7306700 -1 osd.4 99 *** Got signal Terminated *** 2024-06-06T03:39:42.100 INFO:journalctl@ceph.osd.4.smithi079.stdout:Jun 06 03:39:41 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-4[46512]: 2024-06-06T03:39:41.686+0000 7f12a7306700 -1 osd.4 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T03:39:42.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:41 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:41.836+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:39:42.599 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:42 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:42.225+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:39:42.681 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:42 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:42.546+0000 7f2a0b102700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.707162+0000 front 2024-06-06T03:39:11.707247+0000 (oldest deadline 2024-06-06T03:39:34.607295+0000) 2024-06-06T03:39:42.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:42 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:42.350+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:39:42.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:42 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:42.393+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:39:42.751 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:42 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:42.394+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.983190+0000 front 2024-06-06T03:39:10.983223+0000 (oldest deadline 2024-06-06T03:39:39.784169+0000) 2024-06-06T03:39:43.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:42 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:42.852+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:39:43.599 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:39:43 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:39:43.337+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.063106+0000 front 2024-06-06T03:39:20.063140+0000 (oldest deadline 2024-06-06T03:39:42.963275+0000) 2024-06-06T03:39:43.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:43 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:43.223+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:39:43.681 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:43 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:43.583+0000 7f2a0b102700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.707162+0000 front 2024-06-06T03:39:11.707247+0000 (oldest deadline 2024-06-06T03:39:34.607295+0000) 2024-06-06T03:39:43.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:43 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:43.382+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:39:43.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:43 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:43.382+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:39:43.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:43 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:43.371+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:39:43.751 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:43 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:43.443+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.983190+0000 front 2024-06-06T03:39:10.983223+0000 (oldest deadline 2024-06-06T03:39:39.784169+0000) 2024-06-06T03:39:43.751 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:43 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:43.443+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.784591+0000 front 2024-06-06T03:39:19.784799+0000 (oldest deadline 2024-06-06T03:39:43.284804+0000) 2024-06-06T03:39:44.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:43 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:43.823+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:39:44.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:43 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:43.823+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:39:44.599 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:39:44 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:39:44.306+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.063106+0000 front 2024-06-06T03:39:20.063140+0000 (oldest deadline 2024-06-06T03:39:42.963275+0000) 2024-06-06T03:39:44.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:44 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:44.241+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:39:44.681 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:44 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:44.608+0000 7f2a0b102700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.707162+0000 front 2024-06-06T03:39:11.707247+0000 (oldest deadline 2024-06-06T03:39:34.607295+0000) 2024-06-06T03:39:44.681 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:44 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:44.608+0000 7f2a0b102700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:18.009040+0000 front 2024-06-06T03:39:18.009127+0000 (oldest deadline 2024-06-06T03:39:43.909102+0000) 2024-06-06T03:39:44.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:44 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:44.421+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:39:44.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:44 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:44.421+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:39:44.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:44 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:44.381+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:39:44.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:44 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:44.381+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:39:44.751 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:44 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:44.445+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.983190+0000 front 2024-06-06T03:39:10.983223+0000 (oldest deadline 2024-06-06T03:39:39.784169+0000) 2024-06-06T03:39:44.751 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:44 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:44.445+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.784591+0000 front 2024-06-06T03:39:19.784799+0000 (oldest deadline 2024-06-06T03:39:43.284804+0000) 2024-06-06T03:39:45.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:44 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:44.854+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:39:45.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:44 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:44.854+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:39:45.599 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:39:45 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:39:45.270+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.063106+0000 front 2024-06-06T03:39:20.063140+0000 (oldest deadline 2024-06-06T03:39:42.963275+0000) 2024-06-06T03:39:45.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:45 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:45.192+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:39:45.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:45 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:45.192+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:39:45.629 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:45 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:45.379+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:39:45.630 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:45 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:45.379+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:39:45.630 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:45 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:45.379+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:39:45.630 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:45 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:45.379+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:39:45.751 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:45 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:45.469+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.983190+0000 front 2024-06-06T03:39:10.983223+0000 (oldest deadline 2024-06-06T03:39:39.784169+0000) 2024-06-06T03:39:45.751 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:45 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:45.469+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.784591+0000 front 2024-06-06T03:39:19.784799+0000 (oldest deadline 2024-06-06T03:39:43.284804+0000) 2024-06-06T03:39:45.931 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:45 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:45.630+0000 7f2a0b102700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.707162+0000 front 2024-06-06T03:39:11.707247+0000 (oldest deadline 2024-06-06T03:39:34.607295+0000) 2024-06-06T03:39:45.931 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:45 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:45.630+0000 7f2a0b102700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:18.009040+0000 front 2024-06-06T03:39:18.009127+0000 (oldest deadline 2024-06-06T03:39:43.909102+0000) 2024-06-06T03:39:46.169 INFO:journalctl@ceph.osd.4.smithi079.stdout:Jun 06 03:39:45 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-4[46512]: 2024-06-06T03:39:45.896+0000 7f129f8f2700 -1 osd.4 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.829242+0000 front 2024-06-06T03:39:20.829213+0000 (oldest deadline 2024-06-06T03:39:44.929345+0000) 2024-06-06T03:39:46.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:45 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:45.842+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:39:46.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:45 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:45.842+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:39:46.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:39:46 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:39:46.290+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.063106+0000 front 2024-06-06T03:39:20.063140+0000 (oldest deadline 2024-06-06T03:39:42.963275+0000) 2024-06-06T03:39:46.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:46 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:46.170+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:39:46.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:46 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:46.170+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:39:46.619 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:46 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:46.381+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:39:46.620 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:46 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:46.381+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:39:46.620 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:46 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:46.346+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:39:46.620 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:46 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:46.346+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:39:46.751 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:46 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:46.429+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.983190+0000 front 2024-06-06T03:39:10.983223+0000 (oldest deadline 2024-06-06T03:39:39.784169+0000) 2024-06-06T03:39:46.751 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:46 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:46.429+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.784591+0000 front 2024-06-06T03:39:19.784799+0000 (oldest deadline 2024-06-06T03:39:43.284804+0000) 2024-06-06T03:39:46.931 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:46 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:46.619+0000 7f2a0b102700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.707162+0000 front 2024-06-06T03:39:11.707247+0000 (oldest deadline 2024-06-06T03:39:34.607295+0000) 2024-06-06T03:39:46.931 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:46 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:46.619+0000 7f2a0b102700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:18.009040+0000 front 2024-06-06T03:39:18.009127+0000 (oldest deadline 2024-06-06T03:39:43.909102+0000) 2024-06-06T03:39:47.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:46 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:46.833+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:39:47.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:46 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:46.833+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:39:47.487 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:39:47 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:39:47.324+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.063106+0000 front 2024-06-06T03:39:20.063140+0000 (oldest deadline 2024-06-06T03:39:42.963275+0000) 2024-06-06T03:39:47.488 INFO:journalctl@ceph.osd.4.smithi079.stdout:Jun 06 03:39:47 smithi079 podman[70650]: 2024-06-06 03:39:47.167347493 +0000 UTC m=+5.725233327 container died 47695248837ae4c4f6ab85b4a9af56eb4cdc3ec951d0c04d1f2467c1507abb12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-06-06T03:39:47.488 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:47 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:47.154+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:39:47.488 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:47 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:47.154+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:39:47.630 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:47 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:47.383+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:39:47.631 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:47 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:47.383+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:39:47.631 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:47 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:47.313+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:39:47.631 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:47 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:47.314+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:39:47.751 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:47 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:47.451+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.983190+0000 front 2024-06-06T03:39:10.983223+0000 (oldest deadline 2024-06-06T03:39:39.784169+0000) 2024-06-06T03:39:47.751 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:47 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:47.451+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.784591+0000 front 2024-06-06T03:39:19.784799+0000 (oldest deadline 2024-06-06T03:39:43.284804+0000) 2024-06-06T03:39:47.830 INFO:journalctl@ceph.osd.4.smithi079.stdout:Jun 06 03:39:47 smithi079 podman[70650]: 2024-06-06 03:39:47.579228335 +0000 UTC m=+6.137114162 container cleanup 47695248837ae4c4f6ab85b4a9af56eb4cdc3ec951d0c04d1f2467c1507abb12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-4, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-06-06T03:39:47.830 INFO:journalctl@ceph.osd.4.smithi079.stdout:Jun 06 03:39:47 smithi079 bash[70650]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-4 2024-06-06T03:39:47.931 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:47 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:47.631+0000 7f2a0b102700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.707162+0000 front 2024-06-06T03:39:11.707247+0000 (oldest deadline 2024-06-06T03:39:34.607295+0000) 2024-06-06T03:39:47.931 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:47 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:47.631+0000 7f2a0b102700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:18.009040+0000 front 2024-06-06T03:39:18.009127+0000 (oldest deadline 2024-06-06T03:39:43.909102+0000) 2024-06-06T03:39:48.099 INFO:journalctl@ceph.osd.4.smithi079.stdout:Jun 06 03:39:47 smithi079 podman[70665]: 2024-06-06 03:39:47.831045995 +0000 UTC m=+0.662815805 container remove 47695248837ae4c4f6ab85b4a9af56eb4cdc3ec951d0c04d1f2467c1507abb12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-06-06T03:39:48.253 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:47 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:47.850+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:39:48.253 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:47 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:47.850+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:39:48.442 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:39:48 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:39:48.287+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.063106+0000 front 2024-06-06T03:39:20.063140+0000 (oldest deadline 2024-06-06T03:39:42.963275+0000) 2024-06-06T03:39:48.442 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:48 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:48.143+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:39:48.443 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:48 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:48.143+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:39:48.443 INFO:journalctl@ceph.osd.4.smithi079.stdout:Jun 06 03:39:48 smithi079 podman[70753]: 2024-06-06 03:39:48.049744141 +0000 UTC m=+0.016905285 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T03:39:48.443 INFO:journalctl@ceph.osd.4.smithi079.stdout:Jun 06 03:39:48 smithi079 podman[70753]: 2024-06-06 03:39:48.191013478 +0000 UTC m=+0.158174658 container create 8df10fa43769a443d6e1ffc0cba44e12fd37373bbcef45c79561bf283a3dff52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-4-deactivate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-06T03:39:48.443 INFO:journalctl@ceph.osd.4.smithi079.stdout:Jun 06 03:39:48 smithi079 podman[70753]: 2024-06-06 03:39:48.443725686 +0000 UTC m=+0.410886820 container init 8df10fa43769a443d6e1ffc0cba44e12fd37373bbcef45c79561bf283a3dff52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, ceph=True) 2024-06-06T03:39:48.646 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:48 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:48.338+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:39:48.646 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:48 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:48.338+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:39:48.647 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:48 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:48.354+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:39:48.647 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:48 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:48.354+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:39:48.749 INFO:journalctl@ceph.osd.4.smithi079.stdout:Jun 06 03:39:48 smithi079 podman[70753]: 2024-06-06 03:39:48.446971661 +0000 UTC m=+0.414132804 container start 8df10fa43769a443d6e1ffc0cba44e12fd37373bbcef45c79561bf283a3dff52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-06-06T03:39:48.749 INFO:journalctl@ceph.osd.4.smithi079.stdout:Jun 06 03:39:48 smithi079 podman[70753]: 2024-06-06 03:39:48.552431826 +0000 UTC m=+0.519592969 container attach 8df10fa43769a443d6e1ffc0cba44e12fd37373bbcef45c79561bf283a3dff52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-06-06T03:39:48.751 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:48 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:48.492+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.983190+0000 front 2024-06-06T03:39:10.983223+0000 (oldest deadline 2024-06-06T03:39:39.784169+0000) 2024-06-06T03:39:48.751 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:48 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:48.492+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.784591+0000 front 2024-06-06T03:39:19.784799+0000 (oldest deadline 2024-06-06T03:39:43.284804+0000) 2024-06-06T03:39:48.931 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:48 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:48.647+0000 7f2a0b102700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.707162+0000 front 2024-06-06T03:39:11.707247+0000 (oldest deadline 2024-06-06T03:39:34.607295+0000) 2024-06-06T03:39:48.931 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:48 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:48.647+0000 7f2a0b102700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:18.009040+0000 front 2024-06-06T03:39:18.009127+0000 (oldest deadline 2024-06-06T03:39:43.909102+0000) 2024-06-06T03:39:49.079 INFO:journalctl@ceph.osd.4.smithi079.stdout:Jun 06 03:39:48 smithi079 podman[70753]: 2024-06-06 03:39:48.750434463 +0000 UTC m=+0.717595604 container died 8df10fa43769a443d6e1ffc0cba44e12fd37373bbcef45c79561bf283a3dff52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528) 2024-06-06T03:39:49.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:48 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:48.828+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:39:49.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:48 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:48.828+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:39:49.349 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:39:49 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:39:49.289+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.063106+0000 front 2024-06-06T03:39:20.063140+0000 (oldest deadline 2024-06-06T03:39:42.963275+0000) 2024-06-06T03:39:49.350 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:49 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:49.177+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:39:49.350 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:49 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:49.177+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:39:49.427 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.4.service' 2024-06-06T03:39:49.469 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T03:39:49.469 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-06-06T03:39:49.470 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-06-06T03:39:49.470 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.5 2024-06-06T03:39:49.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:49 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:49.402+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:39:49.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:49 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:49.402+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:39:49.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:49 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:49.372+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:39:49.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:49 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:49.372+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:39:49.682 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:49 smithi122 systemd[1]: Stopping Ceph osd.5 for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:39:49.682 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:49 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:49.609+0000 7f2a0b102700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.707162+0000 front 2024-06-06T03:39:11.707247+0000 (oldest deadline 2024-06-06T03:39:34.607295+0000) 2024-06-06T03:39:49.682 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:49 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:49.609+0000 7f2a0b102700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:18.009040+0000 front 2024-06-06T03:39:18.009127+0000 (oldest deadline 2024-06-06T03:39:43.909102+0000) 2024-06-06T03:39:49.751 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:49 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:49.493+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.983190+0000 front 2024-06-06T03:39:10.983223+0000 (oldest deadline 2024-06-06T03:39:39.784169+0000) 2024-06-06T03:39:49.751 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:49 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:49.493+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.784591+0000 front 2024-06-06T03:39:19.784799+0000 (oldest deadline 2024-06-06T03:39:43.284804+0000) 2024-06-06T03:39:50.181 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:49 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:49.795+0000 7f2a12b16700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T03:39:50.181 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:49 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:49.795+0000 7f2a12b16700 -1 osd.5 99 *** Got signal Terminated *** 2024-06-06T03:39:50.181 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:49 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:49.795+0000 7f2a12b16700 -1 osd.5 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T03:39:50.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:49 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:49.857+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:39:50.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:49 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:49.857+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:39:50.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:39:50 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:39:50.245+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.063106+0000 front 2024-06-06T03:39:20.063140+0000 (oldest deadline 2024-06-06T03:39:42.963275+0000) 2024-06-06T03:39:50.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:50 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:50.182+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:39:50.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:50 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:50.182+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:39:50.681 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:50 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:50.600+0000 7f2a0b102700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.707162+0000 front 2024-06-06T03:39:11.707247+0000 (oldest deadline 2024-06-06T03:39:34.607295+0000) 2024-06-06T03:39:50.682 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:50 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:50.600+0000 7f2a0b102700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:18.009040+0000 front 2024-06-06T03:39:18.009127+0000 (oldest deadline 2024-06-06T03:39:43.909102+0000) 2024-06-06T03:39:50.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:50 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:50.352+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:39:50.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:50 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:50.352+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:39:50.683 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:50 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:50.393+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:39:50.683 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:50 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:50.393+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:39:50.827 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:50 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:50.530+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.983190+0000 front 2024-06-06T03:39:10.983223+0000 (oldest deadline 2024-06-06T03:39:39.784169+0000) 2024-06-06T03:39:50.827 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:50 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:50.530+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.784591+0000 front 2024-06-06T03:39:19.784799+0000 (oldest deadline 2024-06-06T03:39:43.284804+0000) 2024-06-06T03:39:51.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:50 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:50.827+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:39:51.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:50 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:50.827+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:39:51.599 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:39:51 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:39:51.240+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.063106+0000 front 2024-06-06T03:39:20.063140+0000 (oldest deadline 2024-06-06T03:39:42.963275+0000) 2024-06-06T03:39:51.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:51 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:51.228+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:39:51.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:51 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:51.228+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:39:51.649 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:51 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:51.335+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:39:51.649 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:51 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:51.335+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:39:51.649 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:51 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:51.360+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:39:51.649 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:51 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:51.360+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:39:51.649 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:51 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:51.360+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:39:51.858 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:51 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:51.548+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.983190+0000 front 2024-06-06T03:39:10.983223+0000 (oldest deadline 2024-06-06T03:39:39.784169+0000) 2024-06-06T03:39:51.858 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:51 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:51.548+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.784591+0000 front 2024-06-06T03:39:19.784799+0000 (oldest deadline 2024-06-06T03:39:43.284804+0000) 2024-06-06T03:39:51.858 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:51 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:51.548+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.185949+0000 front 2024-06-06T03:39:29.186001+0000 (oldest deadline 2024-06-06T03:39:50.885993+0000) 2024-06-06T03:39:51.931 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:51 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:51.649+0000 7f2a0b102700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.707162+0000 front 2024-06-06T03:39:11.707247+0000 (oldest deadline 2024-06-06T03:39:34.607295+0000) 2024-06-06T03:39:51.931 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:51 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:51.649+0000 7f2a0b102700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:18.009040+0000 front 2024-06-06T03:39:18.009127+0000 (oldest deadline 2024-06-06T03:39:43.909102+0000) 2024-06-06T03:39:52.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:51 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:51.858+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:39:52.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:51 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:51.858+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:39:52.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:39:52 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:39:52.221+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.063106+0000 front 2024-06-06T03:39:20.063140+0000 (oldest deadline 2024-06-06T03:39:42.963275+0000) 2024-06-06T03:39:52.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:52 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:52.215+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:39:52.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:52 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:52.215+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:39:52.681 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:52 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:52.620+0000 7f2a0b102700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.707162+0000 front 2024-06-06T03:39:11.707247+0000 (oldest deadline 2024-06-06T03:39:34.607295+0000) 2024-06-06T03:39:52.682 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:52 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:52.620+0000 7f2a0b102700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:18.009040+0000 front 2024-06-06T03:39:18.009127+0000 (oldest deadline 2024-06-06T03:39:43.909102+0000) 2024-06-06T03:39:52.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:52 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:52.409+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:39:52.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:52 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:52.409+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:39:52.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:52 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:52.409+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:39:52.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:52 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:52.371+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:39:52.683 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:52 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:52.371+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:39:52.683 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:52 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:52.371+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.387793+0000 front 2024-06-06T03:39:27.387812+0000 (oldest deadline 2024-06-06T03:39:52.087903+0000) 2024-06-06T03:39:52.850 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:52 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:52.518+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.983190+0000 front 2024-06-06T03:39:10.983223+0000 (oldest deadline 2024-06-06T03:39:39.784169+0000) 2024-06-06T03:39:52.850 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:52 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:52.518+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.784591+0000 front 2024-06-06T03:39:19.784799+0000 (oldest deadline 2024-06-06T03:39:43.284804+0000) 2024-06-06T03:39:52.850 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:52 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:52.518+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.185949+0000 front 2024-06-06T03:39:29.186001+0000 (oldest deadline 2024-06-06T03:39:50.885993+0000) 2024-06-06T03:39:53.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:52 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:52.851+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:39:53.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:52 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:52.851+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:39:53.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:52 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:52.851+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:39:53.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:39:53 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:39:53.271+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.063106+0000 front 2024-06-06T03:39:20.063140+0000 (oldest deadline 2024-06-06T03:39:42.963275+0000) 2024-06-06T03:39:53.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:39:53 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:39:53.271+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:28.864278+0000 front 2024-06-06T03:39:28.864198+0000 (oldest deadline 2024-06-06T03:39:52.964230+0000) 2024-06-06T03:39:53.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:53 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:53.222+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:39:53.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:53 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:53.222+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:39:53.601 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:53 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:53.222+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:39:53.681 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:53 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:53.624+0000 7f2a0b102700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.707162+0000 front 2024-06-06T03:39:11.707247+0000 (oldest deadline 2024-06-06T03:39:34.607295+0000) 2024-06-06T03:39:53.681 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:53 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:53.624+0000 7f2a0b102700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:18.009040+0000 front 2024-06-06T03:39:18.009127+0000 (oldest deadline 2024-06-06T03:39:43.909102+0000) 2024-06-06T03:39:53.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:53 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:53.400+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:39:53.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:53 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:53.400+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:39:53.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:53 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:53.400+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:39:53.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:53 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:53.379+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:39:53.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:53 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:53.379+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:39:53.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:53 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:53.379+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.387793+0000 front 2024-06-06T03:39:27.387812+0000 (oldest deadline 2024-06-06T03:39:52.087903+0000) 2024-06-06T03:39:53.893 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:53 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:53.522+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.983190+0000 front 2024-06-06T03:39:10.983223+0000 (oldest deadline 2024-06-06T03:39:39.784169+0000) 2024-06-06T03:39:53.893 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:53 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:53.522+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.784591+0000 front 2024-06-06T03:39:19.784799+0000 (oldest deadline 2024-06-06T03:39:43.284804+0000) 2024-06-06T03:39:53.893 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:53 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:53.522+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.185949+0000 front 2024-06-06T03:39:29.186001+0000 (oldest deadline 2024-06-06T03:39:50.885993+0000) 2024-06-06T03:39:54.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:53 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:53.894+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:39:54.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:53 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:53.894+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:39:54.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:53 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:53.894+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:39:54.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:39:54 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:39:54.300+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.063106+0000 front 2024-06-06T03:39:20.063140+0000 (oldest deadline 2024-06-06T03:39:42.963275+0000) 2024-06-06T03:39:54.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:39:54 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:39:54.300+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:28.864278+0000 front 2024-06-06T03:39:28.864198+0000 (oldest deadline 2024-06-06T03:39:52.964230+0000) 2024-06-06T03:39:54.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:54 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:54.239+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:39:54.601 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:54 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:54.239+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:39:54.601 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:54 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:54.239+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:39:54.681 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:54 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:54.597+0000 7f2a0b102700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.707162+0000 front 2024-06-06T03:39:11.707247+0000 (oldest deadline 2024-06-06T03:39:34.607295+0000) 2024-06-06T03:39:54.681 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:54 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5[47726]: 2024-06-06T03:39:54.597+0000 7f2a0b102700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:18.009040+0000 front 2024-06-06T03:39:18.009127+0000 (oldest deadline 2024-06-06T03:39:43.909102+0000) 2024-06-06T03:39:54.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:54 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:54.358+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:39:54.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:54 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:54.358+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:39:54.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:54 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:54.358+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:39:54.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:54 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:54.359+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:39:54.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:54 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:54.359+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:39:54.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:54 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:54.359+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.387793+0000 front 2024-06-06T03:39:27.387812+0000 (oldest deadline 2024-06-06T03:39:52.087903+0000) 2024-06-06T03:39:54.846 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:54 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:54.570+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.983190+0000 front 2024-06-06T03:39:10.983223+0000 (oldest deadline 2024-06-06T03:39:39.784169+0000) 2024-06-06T03:39:54.846 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:54 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:54.570+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.784591+0000 front 2024-06-06T03:39:19.784799+0000 (oldest deadline 2024-06-06T03:39:43.284804+0000) 2024-06-06T03:39:54.846 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:54 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:54.570+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.185949+0000 front 2024-06-06T03:39:29.186001+0000 (oldest deadline 2024-06-06T03:39:50.885993+0000) 2024-06-06T03:39:55.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:54 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:54.846+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:39:55.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:54 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:54.846+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:39:55.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:54 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:54.846+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:39:55.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:39:55 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:39:55.349+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.063106+0000 front 2024-06-06T03:39:20.063140+0000 (oldest deadline 2024-06-06T03:39:42.963275+0000) 2024-06-06T03:39:55.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:39:55 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:39:55.349+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:28.864278+0000 front 2024-06-06T03:39:28.864198+0000 (oldest deadline 2024-06-06T03:39:52.964230+0000) 2024-06-06T03:39:55.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:55 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:55.267+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:39:55.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:55 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:55.267+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:39:55.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:55 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:55.267+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:39:55.681 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:55 smithi122 podman[71728]: 2024-06-06 03:39:55.517867671 +0000 UTC m=+5.844755363 container died 378ee619c73f9aa83e9abd06e35fc3ec92a7926aa1c76a256f83e360fb316494 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240528, GIT_CLEAN=True, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-06-06T03:39:55.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:55 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:55.404+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:39:55.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:55 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:55.404+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:39:55.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:55 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:55.404+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:39:55.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:55 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:55.332+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:39:55.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:55 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:55.332+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:39:55.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:55 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:55.332+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.387793+0000 front 2024-06-06T03:39:27.387812+0000 (oldest deadline 2024-06-06T03:39:52.087903+0000) 2024-06-06T03:39:55.872 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:55 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:55.554+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.983190+0000 front 2024-06-06T03:39:10.983223+0000 (oldest deadline 2024-06-06T03:39:39.784169+0000) 2024-06-06T03:39:55.872 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:55 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:55.554+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.784591+0000 front 2024-06-06T03:39:19.784799+0000 (oldest deadline 2024-06-06T03:39:43.284804+0000) 2024-06-06T03:39:55.872 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:55 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:55.554+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.185949+0000 front 2024-06-06T03:39:29.186001+0000 (oldest deadline 2024-06-06T03:39:50.885993+0000) 2024-06-06T03:39:56.146 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:55 smithi122 podman[71728]: 2024-06-06 03:39:55.937373878 +0000 UTC m=+6.264261569 container cleanup 378ee619c73f9aa83e9abd06e35fc3ec92a7926aa1c76a256f83e360fb316494 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-06-06T03:39:56.146 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:55 smithi122 bash[71728]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5 2024-06-06T03:39:56.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:55 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:55.873+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:39:56.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:55 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:55.873+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:39:56.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:55 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:55.873+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:39:56.431 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:56 smithi122 podman[71746]: 2024-06-06 03:39:56.147116692 +0000 UTC m=+0.632925509 container remove 378ee619c73f9aa83e9abd06e35fc3ec92a7926aa1c76a256f83e360fb316494 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-06-06T03:39:56.431 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:56 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:56.300+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:39:56.432 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:56 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:56.300+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:39:56.432 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:56 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:56.300+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.387793+0000 front 2024-06-06T03:39:27.387812+0000 (oldest deadline 2024-06-06T03:39:52.087903+0000) 2024-06-06T03:39:56.432 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:56 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:56.381+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:39:56.432 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:56 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:56.381+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:39:56.432 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:56 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:56.381+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:39:56.599 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:39:56 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:39:56.398+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.063106+0000 front 2024-06-06T03:39:20.063140+0000 (oldest deadline 2024-06-06T03:39:42.963275+0000) 2024-06-06T03:39:56.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:39:56 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:39:56.398+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:28.864278+0000 front 2024-06-06T03:39:28.864198+0000 (oldest deadline 2024-06-06T03:39:52.964230+0000) 2024-06-06T03:39:56.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:56 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:56.288+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:39:56.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:56 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:56.288+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:39:56.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:56 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:56.288+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:39:56.846 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:56 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:56.542+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.983190+0000 front 2024-06-06T03:39:10.983223+0000 (oldest deadline 2024-06-06T03:39:39.784169+0000) 2024-06-06T03:39:56.846 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:56 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:56.542+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.784591+0000 front 2024-06-06T03:39:19.784799+0000 (oldest deadline 2024-06-06T03:39:43.284804+0000) 2024-06-06T03:39:56.846 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:56 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:56.542+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.185949+0000 front 2024-06-06T03:39:29.186001+0000 (oldest deadline 2024-06-06T03:39:50.885993+0000) 2024-06-06T03:39:56.858 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:56 smithi122 podman[71832]: 2024-06-06 03:39:56.467363241 +0000 UTC m=+0.022932772 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T03:39:56.858 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:56 smithi122 podman[71832]: 2024-06-06 03:39:56.589880856 +0000 UTC m=+0.145450391 container create 521a847adafd4f3d9768ff18f709363643d22ea86c32555fe5e271e0f879f9e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5-deactivate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-06-06T03:39:56.858 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:56 smithi122 podman[71832]: 2024-06-06 03:39:56.859183391 +0000 UTC m=+0.414752918 container init 521a847adafd4f3d9768ff18f709363643d22ea86c32555fe5e271e0f879f9e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc) 2024-06-06T03:39:57.154 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:56 smithi122 podman[71832]: 2024-06-06 03:39:56.862535154 +0000 UTC m=+0.418104675 container start 521a847adafd4f3d9768ff18f709363643d22ea86c32555fe5e271e0f879f9e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5-deactivate, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc) 2024-06-06T03:39:57.154 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:56 smithi122 podman[71832]: 2024-06-06 03:39:56.942805782 +0000 UTC m=+0.498375308 container attach 521a847adafd4f3d9768ff18f709363643d22ea86c32555fe5e271e0f879f9e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, RELEASE=squid-3d89acc, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=) 2024-06-06T03:39:57.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:56 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:56.846+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:39:57.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:56 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:56.846+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:39:57.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:56 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:56.846+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:39:57.431 INFO:journalctl@ceph.osd.5.smithi122.stdout:Jun 06 03:39:57 smithi122 podman[71832]: 2024-06-06 03:39:57.15605228 +0000 UTC m=+0.711621795 container died 521a847adafd4f3d9768ff18f709363643d22ea86c32555fe5e271e0f879f9e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True) 2024-06-06T03:39:57.431 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:57 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:57.287+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:39:57.432 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:57 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:57.287+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:39:57.432 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:57 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:57.287+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.387793+0000 front 2024-06-06T03:39:27.387812+0000 (oldest deadline 2024-06-06T03:39:52.087903+0000) 2024-06-06T03:39:57.432 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:57 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:57.402+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:39:57.432 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:57 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:57.402+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:39:57.432 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:57 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:57.402+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:39:57.599 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:39:57 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:39:57.374+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.063106+0000 front 2024-06-06T03:39:20.063140+0000 (oldest deadline 2024-06-06T03:39:42.963275+0000) 2024-06-06T03:39:57.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:39:57 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:39:57.374+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:28.864278+0000 front 2024-06-06T03:39:28.864198+0000 (oldest deadline 2024-06-06T03:39:52.964230+0000) 2024-06-06T03:39:57.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:57 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:57.282+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:39:57.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:57 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:57.282+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:39:57.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:57 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:57.282+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:39:57.822 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.5.service' 2024-06-06T03:39:57.860 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T03:39:57.860 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-06-06T03:39:57.860 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-06-06T03:39:57.860 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.6 2024-06-06T03:39:57.874 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:57 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:57.507+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.983190+0000 front 2024-06-06T03:39:10.983223+0000 (oldest deadline 2024-06-06T03:39:39.784169+0000) 2024-06-06T03:39:57.874 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:57 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:57.507+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.784591+0000 front 2024-06-06T03:39:19.784799+0000 (oldest deadline 2024-06-06T03:39:43.284804+0000) 2024-06-06T03:39:57.874 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:57 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:57.507+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.185949+0000 front 2024-06-06T03:39:29.186001+0000 (oldest deadline 2024-06-06T03:39:50.885993+0000) 2024-06-06T03:39:58.204 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:57 smithi050 systemd[1]: Stopping Ceph osd.6 for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:39:58.204 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:57 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:57.873+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:39:58.204 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:57 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:57.873+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:39:58.204 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:57 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:57.873+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:39:58.498 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:58 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:58.203+0000 7fc91303b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T03:39:58.499 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:58 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:58.203+0000 7fc91303b700 -1 osd.6 99 *** Got signal Terminated *** 2024-06-06T03:39:58.499 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:58 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:58.203+0000 7fc91303b700 -1 osd.6 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T03:39:58.499 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:58 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:58.498+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.983190+0000 front 2024-06-06T03:39:10.983223+0000 (oldest deadline 2024-06-06T03:39:39.784169+0000) 2024-06-06T03:39:58.499 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:58 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:58.498+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.784591+0000 front 2024-06-06T03:39:19.784799+0000 (oldest deadline 2024-06-06T03:39:43.284804+0000) 2024-06-06T03:39:58.499 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:58 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:58.498+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.185949+0000 front 2024-06-06T03:39:29.186001+0000 (oldest deadline 2024-06-06T03:39:50.885993+0000) 2024-06-06T03:39:58.599 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:39:58 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:39:58.419+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.063106+0000 front 2024-06-06T03:39:20.063140+0000 (oldest deadline 2024-06-06T03:39:42.963275+0000) 2024-06-06T03:39:58.599 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:39:58 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:39:58.419+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:28.864278+0000 front 2024-06-06T03:39:28.864198+0000 (oldest deadline 2024-06-06T03:39:52.964230+0000) 2024-06-06T03:39:58.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:58 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:58.242+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:39:58.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:58 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:58.242+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:39:58.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:58 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:58.242+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:39:58.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:58 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:58.317+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:39:58.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:58 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:58.317+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:39:58.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:58 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:58.317+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.387793+0000 front 2024-06-06T03:39:27.387812+0000 (oldest deadline 2024-06-06T03:39:52.087903+0000) 2024-06-06T03:39:58.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:58 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:58.417+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:39:58.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:58 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:58.417+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:39:58.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:58 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:58.417+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:39:59.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:58 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:58.869+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:39:59.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:58 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:58.869+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:39:59.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:58 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:58.869+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:39:59.599 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:39:59 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:39:59.438+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.063106+0000 front 2024-06-06T03:39:20.063140+0000 (oldest deadline 2024-06-06T03:39:42.963275+0000) 2024-06-06T03:39:59.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:39:59 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:39:59.438+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:28.864278+0000 front 2024-06-06T03:39:28.864198+0000 (oldest deadline 2024-06-06T03:39:52.964230+0000) 2024-06-06T03:39:59.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:59 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:59.242+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:39:59.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:59 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:59.242+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:39:59.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:39:59 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:39:59.242+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:39:59.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:59 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:59.365+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:39:59.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:59 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:59.365+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:39:59.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:39:59 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:39:59.365+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.387793+0000 front 2024-06-06T03:39:27.387812+0000 (oldest deadline 2024-06-06T03:39:52.087903+0000) 2024-06-06T03:39:59.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:59 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:59.398+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:39:59.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:59 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:59.398+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:39:59.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:39:59 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:39:59.398+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:39:59.751 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:59 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:59.489+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.983190+0000 front 2024-06-06T03:39:10.983223+0000 (oldest deadline 2024-06-06T03:39:39.784169+0000) 2024-06-06T03:39:59.751 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:59 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:59.489+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.784591+0000 front 2024-06-06T03:39:19.784799+0000 (oldest deadline 2024-06-06T03:39:43.284804+0000) 2024-06-06T03:39:59.752 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:59 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:59.489+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.185949+0000 front 2024-06-06T03:39:29.186001+0000 (oldest deadline 2024-06-06T03:39:50.885993+0000) 2024-06-06T03:39:59.752 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:39:59 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:39:59.489+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.587814+0000 front 2024-06-06T03:39:36.587862+0000 (oldest deadline 2024-06-06T03:39:59.487993+0000) 2024-06-06T03:40:00.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:59 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:59.915+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:40:00.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:59 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:59.915+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:40:00.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:59 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:59.915+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:40:00.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:39:59 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:39:59.915+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.609257+0000 front 2024-06-06T03:39:37.609295+0000 (oldest deadline 2024-06-06T03:39:59.309401+0000) 2024-06-06T03:40:00.599 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:00 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:00.419+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.063106+0000 front 2024-06-06T03:39:20.063140+0000 (oldest deadline 2024-06-06T03:39:42.963275+0000) 2024-06-06T03:40:00.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:00 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:00.419+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:28.864278+0000 front 2024-06-06T03:39:28.864198+0000 (oldest deadline 2024-06-06T03:39:52.964230+0000) 2024-06-06T03:40:00.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:00 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:00.260+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:00.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:00 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:00.260+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:00.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:00 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:00.260+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:00.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:00 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:00.400+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:40:00.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:00 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:00.400+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:40:00.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:00 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:00.400+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.387793+0000 front 2024-06-06T03:39:27.387812+0000 (oldest deadline 2024-06-06T03:39:52.087903+0000) 2024-06-06T03:40:00.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:00 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:00.388+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:00.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:00 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:00.388+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:00.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:00 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:00.388+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:00.893 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:40:00 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:40:00.504+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.983190+0000 front 2024-06-06T03:39:10.983223+0000 (oldest deadline 2024-06-06T03:39:39.784169+0000) 2024-06-06T03:40:00.893 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:40:00 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:40:00.504+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.784591+0000 front 2024-06-06T03:39:19.784799+0000 (oldest deadline 2024-06-06T03:39:43.284804+0000) 2024-06-06T03:40:00.893 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:40:00 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:40:00.504+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.185949+0000 front 2024-06-06T03:39:29.186001+0000 (oldest deadline 2024-06-06T03:39:50.885993+0000) 2024-06-06T03:40:00.893 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:40:00 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:40:00.504+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.587814+0000 front 2024-06-06T03:39:36.587862+0000 (oldest deadline 2024-06-06T03:39:59.487993+0000) 2024-06-06T03:40:01.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:00 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:00.893+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:40:01.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:00 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:00.893+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:40:01.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:00 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:00.893+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:40:01.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:00 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:00.893+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.609257+0000 front 2024-06-06T03:39:37.609295+0000 (oldest deadline 2024-06-06T03:39:59.309401+0000) 2024-06-06T03:40:01.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:01 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:01.387+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.063106+0000 front 2024-06-06T03:39:20.063140+0000 (oldest deadline 2024-06-06T03:39:42.963275+0000) 2024-06-06T03:40:01.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:01 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:01.387+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:28.864278+0000 front 2024-06-06T03:39:28.864198+0000 (oldest deadline 2024-06-06T03:39:52.964230+0000) 2024-06-06T03:40:01.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:01 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:01.387+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.665131+0000 front 2024-06-06T03:39:37.665097+0000 (oldest deadline 2024-06-06T03:40:00.565204+0000) 2024-06-06T03:40:01.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:01 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:01.282+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:01.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:01 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:01.282+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:01.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:01 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:01.282+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:01.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:01 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:01.282+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:01.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:01 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:01.404+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:40:01.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:01 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:01.404+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:40:01.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:01 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:01.404+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.387793+0000 front 2024-06-06T03:39:27.387812+0000 (oldest deadline 2024-06-06T03:39:52.087903+0000) 2024-06-06T03:40:01.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:01 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:01.373+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:01.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:01 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:01.373+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:01.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:01 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:01.373+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:01.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:01 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:01.373+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:01.883 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:40:01 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:40:01.550+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.983190+0000 front 2024-06-06T03:39:10.983223+0000 (oldest deadline 2024-06-06T03:39:39.784169+0000) 2024-06-06T03:40:01.883 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:40:01 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:40:01.550+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.784591+0000 front 2024-06-06T03:39:19.784799+0000 (oldest deadline 2024-06-06T03:39:43.284804+0000) 2024-06-06T03:40:01.883 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:40:01 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:40:01.550+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.185949+0000 front 2024-06-06T03:39:29.186001+0000 (oldest deadline 2024-06-06T03:39:50.885993+0000) 2024-06-06T03:40:01.884 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:40:01 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:40:01.550+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.587814+0000 front 2024-06-06T03:39:36.587862+0000 (oldest deadline 2024-06-06T03:39:59.487993+0000) 2024-06-06T03:40:02.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:01 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:01.883+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:40:02.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:01 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:01.883+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:40:02.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:01 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:01.883+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:40:02.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:01 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:01.883+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.609257+0000 front 2024-06-06T03:39:37.609295+0000 (oldest deadline 2024-06-06T03:39:59.309401+0000) 2024-06-06T03:40:02.599 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:02 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:02.429+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.063106+0000 front 2024-06-06T03:39:20.063140+0000 (oldest deadline 2024-06-06T03:39:42.963275+0000) 2024-06-06T03:40:02.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:02 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:02.429+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:28.864278+0000 front 2024-06-06T03:39:28.864198+0000 (oldest deadline 2024-06-06T03:39:52.964230+0000) 2024-06-06T03:40:02.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:02 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:02.429+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.665131+0000 front 2024-06-06T03:39:37.665097+0000 (oldest deadline 2024-06-06T03:40:00.565204+0000) 2024-06-06T03:40:02.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:02 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:02.291+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:02.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:02 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:02.291+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:02.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:02 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:02.291+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:02.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:02 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:02.291+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:02.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:02 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:02.398+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:40:02.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:02 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:02.398+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:40:02.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:02 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:02.398+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.387793+0000 front 2024-06-06T03:39:27.387812+0000 (oldest deadline 2024-06-06T03:39:52.087903+0000) 2024-06-06T03:40:02.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:02 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:02.339+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:02.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:02 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:02.339+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:02.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:02 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:02.339+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:02.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:02 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:02.339+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:02.840 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:40:02 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:40:02.532+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.983190+0000 front 2024-06-06T03:39:10.983223+0000 (oldest deadline 2024-06-06T03:39:39.784169+0000) 2024-06-06T03:40:02.840 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:40:02 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:40:02.532+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.784591+0000 front 2024-06-06T03:39:19.784799+0000 (oldest deadline 2024-06-06T03:39:43.284804+0000) 2024-06-06T03:40:02.840 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:40:02 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:40:02.532+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.185949+0000 front 2024-06-06T03:39:29.186001+0000 (oldest deadline 2024-06-06T03:39:50.885993+0000) 2024-06-06T03:40:02.840 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:40:02 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6[60502]: 2024-06-06T03:40:02.532+0000 7fc90b627700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.587814+0000 front 2024-06-06T03:39:36.587862+0000 (oldest deadline 2024-06-06T03:39:59.487993+0000) 2024-06-06T03:40:03.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:02 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:02.840+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:40:03.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:02 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:02.840+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:40:03.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:02 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:02.840+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:40:03.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:02 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:02.840+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.609257+0000 front 2024-06-06T03:39:37.609295+0000 (oldest deadline 2024-06-06T03:39:59.309401+0000) 2024-06-06T03:40:03.599 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:03 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:03.446+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.063106+0000 front 2024-06-06T03:39:20.063140+0000 (oldest deadline 2024-06-06T03:39:42.963275+0000) 2024-06-06T03:40:03.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:03 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:03.446+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:28.864278+0000 front 2024-06-06T03:39:28.864198+0000 (oldest deadline 2024-06-06T03:39:52.964230+0000) 2024-06-06T03:40:03.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:03 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:03.446+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.665131+0000 front 2024-06-06T03:39:37.665097+0000 (oldest deadline 2024-06-06T03:40:00.565204+0000) 2024-06-06T03:40:03.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:03 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:03.273+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:03.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:03 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:03.273+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:03.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:03 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:03.273+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:03.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:03 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:03.273+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:03.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:03 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:03.361+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:40:03.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:03 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:03.361+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:40:03.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:03 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:03.361+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.387793+0000 front 2024-06-06T03:39:27.387812+0000 (oldest deadline 2024-06-06T03:39:52.087903+0000) 2024-06-06T03:40:03.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:03 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:03.361+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.689267+0000 front 2024-06-06T03:39:36.689201+0000 (oldest deadline 2024-06-06T03:40:02.589146+0000) 2024-06-06T03:40:03.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:03 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:03.383+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:03.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:03 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:03.383+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:03.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:03 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:03.383+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:03.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:03 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:03.383+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:04.153 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:40:03 smithi050 podman[117903]: 2024-06-06 03:40:03.805606509 +0000 UTC m=+5.727456460 container died e081103a6ae65fa4a2db9d98515140054b31e483102e1512199fc3e60626948e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240528) 2024-06-06T03:40:04.153 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:03 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:03.811+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:40:04.153 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:03 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:03.811+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:40:04.153 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:03 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:03.811+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:40:04.153 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:03 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:03.811+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.609257+0000 front 2024-06-06T03:39:37.609295+0000 (oldest deadline 2024-06-06T03:39:59.309401+0000) 2024-06-06T03:40:04.501 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:40:04 smithi050 podman[117903]: 2024-06-06 03:40:04.254585253 +0000 UTC m=+6.176435217 container cleanup e081103a6ae65fa4a2db9d98515140054b31e483102e1512199fc3e60626948e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T03:40:04.501 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:40:04 smithi050 bash[117903]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6 2024-06-06T03:40:04.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:04 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:04.478+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.063106+0000 front 2024-06-06T03:39:20.063140+0000 (oldest deadline 2024-06-06T03:39:42.963275+0000) 2024-06-06T03:40:04.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:04 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:04.478+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:28.864278+0000 front 2024-06-06T03:39:28.864198+0000 (oldest deadline 2024-06-06T03:39:52.964230+0000) 2024-06-06T03:40:04.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:04 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:04.478+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.665131+0000 front 2024-06-06T03:39:37.665097+0000 (oldest deadline 2024-06-06T03:40:00.565204+0000) 2024-06-06T03:40:04.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:04 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:04.273+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:04.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:04 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:04.273+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:04.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:04 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:04.273+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:04.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:04 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:04.273+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:04.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:04 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:04.403+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:40:04.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:04 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:04.403+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:40:04.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:04 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:04.403+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.387793+0000 front 2024-06-06T03:39:27.387812+0000 (oldest deadline 2024-06-06T03:39:52.087903+0000) 2024-06-06T03:40:04.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:04 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:04.403+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.689267+0000 front 2024-06-06T03:39:36.689201+0000 (oldest deadline 2024-06-06T03:40:02.589146+0000) 2024-06-06T03:40:04.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:04 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:04.419+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:04.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:04 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:04.419+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:04.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:04 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:04.419+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:04.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:04 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:04.419+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:04.859 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:40:04 smithi050 podman[117919]: 2024-06-06 03:40:04.573073097 +0000 UTC m=+0.768664951 container remove e081103a6ae65fa4a2db9d98515140054b31e483102e1512199fc3e60626948e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux ) 2024-06-06T03:40:05.168 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:40:04 smithi050 podman[118007]: 2024-06-06 03:40:04.802042622 +0000 UTC m=+0.017862370 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T03:40:05.168 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:40:04 smithi050 podman[118007]: 2024-06-06 03:40:04.924300813 +0000 UTC m=+0.140120543 container create 42861e0fce97147ec697e98dd134ffee0ae39ea26e3729dedcf4a16bf59ea070 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528) 2024-06-06T03:40:05.168 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:04 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:04.859+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:40:05.169 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:04 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:04.859+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:40:05.169 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:04 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:04.859+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:40:05.169 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:04 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:04.859+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.609257+0000 front 2024-06-06T03:39:37.609295+0000 (oldest deadline 2024-06-06T03:39:59.309401+0000) 2024-06-06T03:40:05.485 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:40:05 smithi050 podman[118007]: 2024-06-06 03:40:05.169293714 +0000 UTC m=+0.385113460 container init 42861e0fce97147ec697e98dd134ffee0ae39ea26e3729dedcf4a16bf59ea070 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T03:40:05.486 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:40:05 smithi050 podman[118007]: 2024-06-06 03:40:05.173724213 +0000 UTC m=+0.389543943 container start 42861e0fce97147ec697e98dd134ffee0ae39ea26e3729dedcf4a16bf59ea070 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-06-06T03:40:05.486 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:40:05 smithi050 podman[118007]: 2024-06-06 03:40:05.260655743 +0000 UTC m=+0.476475498 container attach 42861e0fce97147ec697e98dd134ffee0ae39ea26e3729dedcf4a16bf59ea070 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-06-06T03:40:05.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:05 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:05.521+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.063106+0000 front 2024-06-06T03:39:20.063140+0000 (oldest deadline 2024-06-06T03:39:42.963275+0000) 2024-06-06T03:40:05.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:05 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:05.521+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:28.864278+0000 front 2024-06-06T03:39:28.864198+0000 (oldest deadline 2024-06-06T03:39:52.964230+0000) 2024-06-06T03:40:05.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:05 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:05.521+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.665131+0000 front 2024-06-06T03:39:37.665097+0000 (oldest deadline 2024-06-06T03:40:00.565204+0000) 2024-06-06T03:40:05.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:05 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:05.321+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:05.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:05 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:05.321+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:05.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:05 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:05.321+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:05.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:05 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:05.321+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:05.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:05 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:05.420+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:40:05.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:05 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:05.420+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:40:05.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:05 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:05.420+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.387793+0000 front 2024-06-06T03:39:27.387812+0000 (oldest deadline 2024-06-06T03:39:52.087903+0000) 2024-06-06T03:40:05.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:05 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:05.420+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.689267+0000 front 2024-06-06T03:39:36.689201+0000 (oldest deadline 2024-06-06T03:40:02.589146+0000) 2024-06-06T03:40:05.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:05 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:05.415+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:05.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:05 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:05.415+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:05.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:05 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:05.415+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:05.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:05 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:05.415+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:05.751 INFO:journalctl@ceph.osd.6.smithi050.stdout:Jun 06 03:40:05 smithi050 podman[118007]: 2024-06-06 03:40:05.486764397 +0000 UTC m=+0.702584146 container died 42861e0fce97147ec697e98dd134ffee0ae39ea26e3729dedcf4a16bf59ea070 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-3d89acc, io.buildah.version=1.33.5) 2024-06-06T03:40:06.038 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:05 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:05.894+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:40:06.038 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:05 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:05.894+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:40:06.038 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:05 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:05.894+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:40:06.038 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:05 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:05.894+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.609257+0000 front 2024-06-06T03:39:37.609295+0000 (oldest deadline 2024-06-06T03:39:59.309401+0000) 2024-06-06T03:40:06.054 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.6.service' 2024-06-06T03:40:06.135 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T03:40:06.135 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-06-06T03:40:06.136 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-06-06T03:40:06.136 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.7 2024-06-06T03:40:06.501 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:06 smithi079 systemd[1]: Stopping Ceph osd.7 for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:40:06.502 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:06 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:06.327+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:06.502 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:06 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:06.327+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:06.502 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:06 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:06.327+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:06.502 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:06 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:06.327+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:06.681 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:06 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:06.382+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:06.681 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:06 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:06.382+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:06.681 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:06 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:06.382+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:06.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:06 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:06.382+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:06.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:06 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:06.466+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:40:06.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:06 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:06.466+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:40:06.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:06 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:06.466+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.387793+0000 front 2024-06-06T03:39:27.387812+0000 (oldest deadline 2024-06-06T03:39:52.087903+0000) 2024-06-06T03:40:06.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:06 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:06.466+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.689267+0000 front 2024-06-06T03:39:36.689201+0000 (oldest deadline 2024-06-06T03:40:02.589146+0000) 2024-06-06T03:40:06.763 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:06 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:06.550+0000 7fb14de91700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T03:40:06.763 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:06 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:06.550+0000 7fb14de91700 -1 osd.7 99 *** Got signal Terminated *** 2024-06-06T03:40:06.764 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:06 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:06.550+0000 7fb14de91700 -1 osd.7 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T03:40:06.764 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:06 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:06.562+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.063106+0000 front 2024-06-06T03:39:20.063140+0000 (oldest deadline 2024-06-06T03:39:42.963275+0000) 2024-06-06T03:40:06.764 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:06 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:06.563+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:28.864278+0000 front 2024-06-06T03:39:28.864198+0000 (oldest deadline 2024-06-06T03:39:52.964230+0000) 2024-06-06T03:40:06.764 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:06 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:06.563+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.665131+0000 front 2024-06-06T03:39:37.665097+0000 (oldest deadline 2024-06-06T03:40:00.565204+0000) 2024-06-06T03:40:07.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:06 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:06.894+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:40:07.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:06 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:06.894+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:40:07.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:06 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:06.894+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:40:07.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:06 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:06.894+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.609257+0000 front 2024-06-06T03:39:37.609295+0000 (oldest deadline 2024-06-06T03:39:59.309401+0000) 2024-06-06T03:40:07.599 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:07 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:07.539+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.063106+0000 front 2024-06-06T03:39:20.063140+0000 (oldest deadline 2024-06-06T03:39:42.963275+0000) 2024-06-06T03:40:07.599 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:07 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:07.539+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:28.864278+0000 front 2024-06-06T03:39:28.864198+0000 (oldest deadline 2024-06-06T03:39:52.964230+0000) 2024-06-06T03:40:07.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:07 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:07.539+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.665131+0000 front 2024-06-06T03:39:37.665097+0000 (oldest deadline 2024-06-06T03:40:00.565204+0000) 2024-06-06T03:40:07.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:07 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:07.323+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:07.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:07 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:07.323+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:07.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:07 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:07.323+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:07.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:07 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:07.323+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:07.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:07 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:07.430+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:40:07.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:07 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:07.430+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:40:07.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:07 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:07.430+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.387793+0000 front 2024-06-06T03:39:27.387812+0000 (oldest deadline 2024-06-06T03:39:52.087903+0000) 2024-06-06T03:40:07.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:07 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:07.430+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.689267+0000 front 2024-06-06T03:39:36.689201+0000 (oldest deadline 2024-06-06T03:40:02.589146+0000) 2024-06-06T03:40:07.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:07 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:07.336+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:07.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:07 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:07.336+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:07.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:07 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:07.336+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:07.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:07 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:07.336+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:08.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:07 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:07.864+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:40:08.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:07 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:07.864+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:40:08.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:07 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:07.864+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:40:08.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:07 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:07.864+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.609257+0000 front 2024-06-06T03:39:37.609295+0000 (oldest deadline 2024-06-06T03:39:59.309401+0000) 2024-06-06T03:40:08.534 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:08 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:08.279+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:08.534 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:08 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:08.279+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:08.534 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:08 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:08.279+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:08.534 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:08 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:08.279+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:08.681 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:08 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:08.367+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:08.681 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:08 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:08.367+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:08.681 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:08 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:08.367+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:08.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:08 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:08.367+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:08.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:08 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:08.397+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:40:08.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:08 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:08.397+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:40:08.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:08 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:08.397+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.387793+0000 front 2024-06-06T03:39:27.387812+0000 (oldest deadline 2024-06-06T03:39:52.087903+0000) 2024-06-06T03:40:08.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:08 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:08.397+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.689267+0000 front 2024-06-06T03:39:36.689201+0000 (oldest deadline 2024-06-06T03:40:02.589146+0000) 2024-06-06T03:40:08.850 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:08 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:08.533+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.063106+0000 front 2024-06-06T03:39:20.063140+0000 (oldest deadline 2024-06-06T03:39:42.963275+0000) 2024-06-06T03:40:08.850 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:08 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:08.533+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:28.864278+0000 front 2024-06-06T03:39:28.864198+0000 (oldest deadline 2024-06-06T03:39:52.964230+0000) 2024-06-06T03:40:08.850 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:08 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:08.533+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.665131+0000 front 2024-06-06T03:39:37.665097+0000 (oldest deadline 2024-06-06T03:40:00.565204+0000) 2024-06-06T03:40:09.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:08 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:08.875+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:40:09.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:08 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:08.875+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:40:09.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:08 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:08.875+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:40:09.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:08 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:08.875+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.609257+0000 front 2024-06-06T03:39:37.609295+0000 (oldest deadline 2024-06-06T03:39:59.309401+0000) 2024-06-06T03:40:09.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:08 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:08.875+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:46.311046+0000 front 2024-06-06T03:39:46.311163+0000 (oldest deadline 2024-06-06T03:40:08.611029+0000) 2024-06-06T03:40:09.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:09 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:09.520+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.063106+0000 front 2024-06-06T03:39:20.063140+0000 (oldest deadline 2024-06-06T03:39:42.963275+0000) 2024-06-06T03:40:09.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:09 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:09.520+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:28.864278+0000 front 2024-06-06T03:39:28.864198+0000 (oldest deadline 2024-06-06T03:39:52.964230+0000) 2024-06-06T03:40:09.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:09 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:09.520+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.665131+0000 front 2024-06-06T03:39:37.665097+0000 (oldest deadline 2024-06-06T03:40:00.565204+0000) 2024-06-06T03:40:09.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:09 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:09.287+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:09.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:09 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:09.287+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:09.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:09 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:09.287+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:09.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:09 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:09.287+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:09.681 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:09 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:09.346+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:09.681 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:09 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:09.346+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:09.681 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:09 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:09.346+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:09.681 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:09 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:09.346+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:09.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:09 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:09.432+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:40:09.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:09 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:09.432+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:40:09.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:09 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:09.432+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.387793+0000 front 2024-06-06T03:39:27.387812+0000 (oldest deadline 2024-06-06T03:39:52.087903+0000) 2024-06-06T03:40:09.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:09 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:09.432+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.689267+0000 front 2024-06-06T03:39:36.689201+0000 (oldest deadline 2024-06-06T03:40:02.589146+0000) 2024-06-06T03:40:09.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:09 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:09.432+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:42.589673+0000 front 2024-06-06T03:39:42.589728+0000 (oldest deadline 2024-06-06T03:40:08.489540+0000) 2024-06-06T03:40:10.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:09 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:09.852+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:40:10.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:09 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:09.852+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:40:10.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:09 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:09.852+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:40:10.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:09 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:09.852+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.609257+0000 front 2024-06-06T03:39:37.609295+0000 (oldest deadline 2024-06-06T03:39:59.309401+0000) 2024-06-06T03:40:10.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:09 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:09.852+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:46.311046+0000 front 2024-06-06T03:39:46.311163+0000 (oldest deadline 2024-06-06T03:40:08.611029+0000) 2024-06-06T03:40:10.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:10 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:10.479+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.063106+0000 front 2024-06-06T03:39:20.063140+0000 (oldest deadline 2024-06-06T03:39:42.963275+0000) 2024-06-06T03:40:10.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:10 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:10.479+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:28.864278+0000 front 2024-06-06T03:39:28.864198+0000 (oldest deadline 2024-06-06T03:39:52.964230+0000) 2024-06-06T03:40:10.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:10 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:10.479+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.665131+0000 front 2024-06-06T03:39:37.665097+0000 (oldest deadline 2024-06-06T03:40:00.565204+0000) 2024-06-06T03:40:10.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:10 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:10.321+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:10.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:10 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:10.321+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:10.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:10 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:10.321+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:10.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:10 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:10.321+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:10.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:10 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:10.321+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:44.039147+0000 front 2024-06-06T03:39:44.039165+0000 (oldest deadline 2024-06-06T03:40:09.939369+0000) 2024-06-06T03:40:10.681 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:10 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:10.342+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:10.681 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:10 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:10.342+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:10.681 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:10 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:10.342+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:10.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:10 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:10.342+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:10.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:10 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:10.342+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:10.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:10 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:10.440+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:40:10.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:10 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:10.440+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:40:10.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:10 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:10.440+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.387793+0000 front 2024-06-06T03:39:27.387812+0000 (oldest deadline 2024-06-06T03:39:52.087903+0000) 2024-06-06T03:40:10.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:10 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:10.440+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.689267+0000 front 2024-06-06T03:39:36.689201+0000 (oldest deadline 2024-06-06T03:40:02.589146+0000) 2024-06-06T03:40:10.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:10 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:10.440+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:42.589673+0000 front 2024-06-06T03:39:42.589728+0000 (oldest deadline 2024-06-06T03:40:08.489540+0000) 2024-06-06T03:40:11.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:10 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:10.874+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:40:11.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:10 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:10.874+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:40:11.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:10 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:10.874+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:40:11.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:10 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:10.874+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.609257+0000 front 2024-06-06T03:39:37.609295+0000 (oldest deadline 2024-06-06T03:39:59.309401+0000) 2024-06-06T03:40:11.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:10 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:10.874+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:46.311046+0000 front 2024-06-06T03:39:46.311163+0000 (oldest deadline 2024-06-06T03:40:08.611029+0000) 2024-06-06T03:40:11.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:11 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:11.462+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.063106+0000 front 2024-06-06T03:39:20.063140+0000 (oldest deadline 2024-06-06T03:39:42.963275+0000) 2024-06-06T03:40:11.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:11 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:11.462+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:28.864278+0000 front 2024-06-06T03:39:28.864198+0000 (oldest deadline 2024-06-06T03:39:52.964230+0000) 2024-06-06T03:40:11.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:11 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:11.462+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.665131+0000 front 2024-06-06T03:39:37.665097+0000 (oldest deadline 2024-06-06T03:40:00.565204+0000) 2024-06-06T03:40:11.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:11 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7[53033]: 2024-06-06T03:40:11.462+0000 7fb14647d700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.866193+0000 front 2024-06-06T03:39:45.866323+0000 (oldest deadline 2024-06-06T03:40:11.166305+0000) 2024-06-06T03:40:11.601 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:11 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:11.349+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:11.601 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:11 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:11.349+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:11.601 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:11 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:11.349+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:11.601 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:11 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:11.349+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:11.601 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:11 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:11.349+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:44.039147+0000 front 2024-06-06T03:39:44.039165+0000 (oldest deadline 2024-06-06T03:40:09.939369+0000) 2024-06-06T03:40:11.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:11 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:11.471+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:40:11.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:11 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:11.471+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:40:11.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:11 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:11.471+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.387793+0000 front 2024-06-06T03:39:27.387812+0000 (oldest deadline 2024-06-06T03:39:52.087903+0000) 2024-06-06T03:40:11.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:11 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:11.471+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.689267+0000 front 2024-06-06T03:39:36.689201+0000 (oldest deadline 2024-06-06T03:40:02.589146+0000) 2024-06-06T03:40:11.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:11 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:11.471+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:42.589673+0000 front 2024-06-06T03:39:42.589728+0000 (oldest deadline 2024-06-06T03:40:08.489540+0000) 2024-06-06T03:40:11.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:11 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:11.294+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:11.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:11 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:11.294+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:11.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:11 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:11.294+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:11.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:11 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:11.294+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:11.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:11 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:11.294+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:12.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:11 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:11.842+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:40:12.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:11 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:11.842+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:40:12.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:11 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:11.842+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:40:12.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:11 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:11.842+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.609257+0000 front 2024-06-06T03:39:37.609295+0000 (oldest deadline 2024-06-06T03:39:59.309401+0000) 2024-06-06T03:40:12.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:11 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:11.842+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:46.311046+0000 front 2024-06-06T03:39:46.311163+0000 (oldest deadline 2024-06-06T03:40:08.611029+0000) 2024-06-06T03:40:12.300 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:12 smithi079 podman[70858]: 2024-06-06 03:40:12.047274214 +0000 UTC m=+5.721934816 container died 14abe7e808e07263b887e57606dd4d926c6ae94dc01195adc153a50d832b31ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-06T03:40:12.602 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:12 smithi079 podman[70858]: 2024-06-06 03:40:12.400712406 +0000 UTC m=+6.075372997 container cleanup 14abe7e808e07263b887e57606dd4d926c6ae94dc01195adc153a50d832b31ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528) 2024-06-06T03:40:12.602 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:12 smithi079 bash[70858]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7 2024-06-06T03:40:12.602 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:12 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:12.381+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:12.602 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:12 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:12.381+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:12.603 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:12 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:12.381+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:12.603 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:12 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:12.381+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:12.603 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:12 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:12.381+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:44.039147+0000 front 2024-06-06T03:39:44.039165+0000 (oldest deadline 2024-06-06T03:40:09.939369+0000) 2024-06-06T03:40:12.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:12 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:12.487+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:40:12.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:12 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:12.487+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:40:12.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:12 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:12.487+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.387793+0000 front 2024-06-06T03:39:27.387812+0000 (oldest deadline 2024-06-06T03:39:52.087903+0000) 2024-06-06T03:40:12.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:12 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:12.487+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.689267+0000 front 2024-06-06T03:39:36.689201+0000 (oldest deadline 2024-06-06T03:40:02.589146+0000) 2024-06-06T03:40:12.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:12 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:12.487+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:42.589673+0000 front 2024-06-06T03:39:42.589728+0000 (oldest deadline 2024-06-06T03:40:08.489540+0000) 2024-06-06T03:40:12.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:12 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:12.304+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:12.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:12 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:12.304+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:12.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:12 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:12.304+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:12.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:12 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:12.304+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:12.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:12 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:12.304+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:13.061 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:12 smithi079 podman[70886]: 2024-06-06 03:40:12.727486249 +0000 UTC m=+0.683090798 container remove 14abe7e808e07263b887e57606dd4d926c6ae94dc01195adc153a50d832b31ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T03:40:13.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:12 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:12.836+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:40:13.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:12 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:12.836+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:40:13.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:12 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:12.836+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:40:13.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:12 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:12.836+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.609257+0000 front 2024-06-06T03:39:37.609295+0000 (oldest deadline 2024-06-06T03:39:59.309401+0000) 2024-06-06T03:40:13.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:12 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:12.836+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:46.311046+0000 front 2024-06-06T03:39:46.311163+0000 (oldest deadline 2024-06-06T03:40:08.611029+0000) 2024-06-06T03:40:13.338 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:13 smithi079 podman[70976]: 2024-06-06 03:40:12.96528572 +0000 UTC m=+0.016779113 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T03:40:13.338 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:13 smithi079 podman[70976]: 2024-06-06 03:40:13.112172618 +0000 UTC m=+0.163665999 container create 3b7e48ab20775e14d5f54fc3b65314b925cf89ba4ab4e0242c2d44241d23210f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T03:40:13.339 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:13 smithi079 podman[70976]: 2024-06-06 03:40:13.339818986 +0000 UTC m=+0.391312377 container init 3b7e48ab20775e14d5f54fc3b65314b925cf89ba4ab4e0242c2d44241d23210f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7-deactivate, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-06-06T03:40:13.523 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:13 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:13.266+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:13.523 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:13 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:13.266+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:13.523 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:13 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:13.266+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:13.523 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:13 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:13.266+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:13.523 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:13 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:13.266+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:13.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:13 smithi079 podman[70976]: 2024-06-06 03:40:13.343241008 +0000 UTC m=+0.394734394 container start 3b7e48ab20775e14d5f54fc3b65314b925cf89ba4ab4e0242c2d44241d23210f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T03:40:13.600 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:13 smithi079 podman[70976]: 2024-06-06 03:40:13.423322225 +0000 UTC m=+0.474815610 container attach 3b7e48ab20775e14d5f54fc3b65314b925cf89ba4ab4e0242c2d44241d23210f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7-deactivate, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, ceph=True, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-06-06T03:40:13.601 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:13 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:13.389+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:13.601 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:13 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:13.390+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:13.601 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:13 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:13.390+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:13.601 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:13 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:13.390+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:13.601 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:13 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:13.390+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:44.039147+0000 front 2024-06-06T03:39:44.039165+0000 (oldest deadline 2024-06-06T03:40:09.939369+0000) 2024-06-06T03:40:13.926 INFO:journalctl@ceph.osd.7.smithi079.stdout:Jun 06 03:40:13 smithi079 podman[70976]: 2024-06-06 03:40:13.631396329 +0000 UTC m=+0.682889721 container died 3b7e48ab20775e14d5f54fc3b65314b925cf89ba4ab4e0242c2d44241d23210f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-7-deactivate, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T03:40:13.931 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:13 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:13.523+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:40:13.931 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:13 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:13.523+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:40:13.931 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:13 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:13.523+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.387793+0000 front 2024-06-06T03:39:27.387812+0000 (oldest deadline 2024-06-06T03:39:52.087903+0000) 2024-06-06T03:40:13.931 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:13 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:13.523+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.689267+0000 front 2024-06-06T03:39:36.689201+0000 (oldest deadline 2024-06-06T03:40:02.589146+0000) 2024-06-06T03:40:13.931 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:13 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:13.523+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:42.589673+0000 front 2024-06-06T03:39:42.589728+0000 (oldest deadline 2024-06-06T03:40:08.489540+0000) 2024-06-06T03:40:14.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:13 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:13.820+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:40:14.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:13 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:13.820+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:40:14.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:13 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:13.820+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:40:14.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:13 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:13.820+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.609257+0000 front 2024-06-06T03:39:37.609295+0000 (oldest deadline 2024-06-06T03:39:59.309401+0000) 2024-06-06T03:40:14.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:13 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:13.820+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:46.311046+0000 front 2024-06-06T03:39:46.311163+0000 (oldest deadline 2024-06-06T03:40:08.611029+0000) 2024-06-06T03:40:14.254 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.7.service' 2024-06-06T03:40:14.296 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T03:40:14.296 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-06-06T03:40:14.296 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-06-06T03:40:14.297 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.8 2024-06-06T03:40:14.567 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:14 smithi122 systemd[1]: Stopping Ceph osd.8 for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:40:14.567 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:14 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:14.239+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:14.567 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:14 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:14.239+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:14.567 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:14 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:14.239+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:14.567 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:14 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:14.239+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:14.567 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:14 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:14.239+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:14.599 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:14 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:14.409+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:14.599 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:14 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:14.409+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:14.599 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:14 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:14.409+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:14.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:14 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:14.409+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:14.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:14 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:14.409+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:44.039147+0000 front 2024-06-06T03:39:44.039165+0000 (oldest deadline 2024-06-06T03:40:09.939369+0000) 2024-06-06T03:40:14.931 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:14 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:14.567+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:40:14.931 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:14 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:14.567+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:40:14.931 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:14 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:14.567+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.387793+0000 front 2024-06-06T03:39:27.387812+0000 (oldest deadline 2024-06-06T03:39:52.087903+0000) 2024-06-06T03:40:14.932 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:14 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:14.567+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.689267+0000 front 2024-06-06T03:39:36.689201+0000 (oldest deadline 2024-06-06T03:40:02.589146+0000) 2024-06-06T03:40:14.932 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:14 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:14.567+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:42.589673+0000 front 2024-06-06T03:39:42.589728+0000 (oldest deadline 2024-06-06T03:40:08.489540+0000) 2024-06-06T03:40:14.932 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:14 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:14.624+0000 7fd028c55700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T03:40:14.932 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:14 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:14.624+0000 7fd028c55700 -1 osd.8 99 *** Got signal Terminated *** 2024-06-06T03:40:14.932 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:14 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:14.624+0000 7fd028c55700 -1 osd.8 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T03:40:15.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:14 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:14.842+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:40:15.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:14 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:14.842+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:40:15.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:14 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:14.842+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:40:15.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:14 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:14.842+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.609257+0000 front 2024-06-06T03:39:37.609295+0000 (oldest deadline 2024-06-06T03:39:59.309401+0000) 2024-06-06T03:40:15.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:14 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:14.842+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:46.311046+0000 front 2024-06-06T03:39:46.311163+0000 (oldest deadline 2024-06-06T03:40:08.611029+0000) 2024-06-06T03:40:15.535 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:15 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:15.253+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:15.536 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:15 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:15.253+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:15.536 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:15 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:15.253+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:15.536 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:15 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:15.253+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:15.536 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:15 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:15.253+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:15.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:15 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:15.388+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:15.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:15 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:15.388+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:15.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:15 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:15.388+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:15.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:15 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:15.388+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:15.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:15 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:15.388+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:44.039147+0000 front 2024-06-06T03:39:44.039165+0000 (oldest deadline 2024-06-06T03:40:09.939369+0000) 2024-06-06T03:40:15.931 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:15 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:15.536+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:40:15.931 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:15 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:15.536+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:40:15.931 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:15 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:15.536+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.387793+0000 front 2024-06-06T03:39:27.387812+0000 (oldest deadline 2024-06-06T03:39:52.087903+0000) 2024-06-06T03:40:15.932 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:15 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:15.536+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.689267+0000 front 2024-06-06T03:39:36.689201+0000 (oldest deadline 2024-06-06T03:40:02.589146+0000) 2024-06-06T03:40:15.932 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:15 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:15.536+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:42.589673+0000 front 2024-06-06T03:39:42.589728+0000 (oldest deadline 2024-06-06T03:40:08.489540+0000) 2024-06-06T03:40:16.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:15 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:15.796+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:40:16.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:15 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:15.796+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:40:16.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:15 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:15.796+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:40:16.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:15 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:15.796+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.609257+0000 front 2024-06-06T03:39:37.609295+0000 (oldest deadline 2024-06-06T03:39:59.309401+0000) 2024-06-06T03:40:16.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:15 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:15.796+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:46.311046+0000 front 2024-06-06T03:39:46.311163+0000 (oldest deadline 2024-06-06T03:40:08.611029+0000) 2024-06-06T03:40:16.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:15 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:15.796+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.712161+0000 front 2024-06-06T03:39:49.712182+0000 (oldest deadline 2024-06-06T03:40:15.612012+0000) 2024-06-06T03:40:16.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:16 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:16.500+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:40:16.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:16 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:16.500+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:40:16.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:16 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:16.500+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.387793+0000 front 2024-06-06T03:39:27.387812+0000 (oldest deadline 2024-06-06T03:39:52.087903+0000) 2024-06-06T03:40:16.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:16 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:16.500+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.689267+0000 front 2024-06-06T03:39:36.689201+0000 (oldest deadline 2024-06-06T03:40:02.589146+0000) 2024-06-06T03:40:16.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:16 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:16.500+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:42.589673+0000 front 2024-06-06T03:39:42.589728+0000 (oldest deadline 2024-06-06T03:40:08.489540+0000) 2024-06-06T03:40:16.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:16 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:16.296+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:16.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:16 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:16.296+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:16.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:16 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:16.296+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:16.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:16 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:16.296+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:16.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:16 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:16.296+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:16.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:16 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:16.296+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:52.661649+0000 front 2024-06-06T03:39:52.661688+0000 (oldest deadline 2024-06-06T03:40:16.161802+0000) 2024-06-06T03:40:16.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:16 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:16.351+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:16.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:16 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:16.351+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:16.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:16 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:16.351+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:16.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:16 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:16.351+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:16.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:16 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:16.351+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:44.039147+0000 front 2024-06-06T03:39:44.039165+0000 (oldest deadline 2024-06-06T03:40:09.939369+0000) 2024-06-06T03:40:16.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:16 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:16.351+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.939873+0000 front 2024-06-06T03:39:49.939797+0000 (oldest deadline 2024-06-06T03:40:15.839818+0000) 2024-06-06T03:40:17.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:16 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:16.766+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:40:17.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:16 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:16.766+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:40:17.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:16 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:16.766+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:40:17.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:16 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:16.766+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.609257+0000 front 2024-06-06T03:39:37.609295+0000 (oldest deadline 2024-06-06T03:39:59.309401+0000) 2024-06-06T03:40:17.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:16 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:16.766+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:46.311046+0000 front 2024-06-06T03:39:46.311163+0000 (oldest deadline 2024-06-06T03:40:08.611029+0000) 2024-06-06T03:40:17.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:16 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:16.766+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.712161+0000 front 2024-06-06T03:39:49.712182+0000 (oldest deadline 2024-06-06T03:40:15.612012+0000) 2024-06-06T03:40:17.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:17 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:17.457+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:40:17.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:17 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:17.457+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:40:17.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:17 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:17.457+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.387793+0000 front 2024-06-06T03:39:27.387812+0000 (oldest deadline 2024-06-06T03:39:52.087903+0000) 2024-06-06T03:40:17.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:17 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:17.457+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.689267+0000 front 2024-06-06T03:39:36.689201+0000 (oldest deadline 2024-06-06T03:40:02.589146+0000) 2024-06-06T03:40:17.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:17 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:17.457+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:42.589673+0000 front 2024-06-06T03:39:42.589728+0000 (oldest deadline 2024-06-06T03:40:08.489540+0000) 2024-06-06T03:40:17.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:17 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:17.457+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:54.390471+0000 front 2024-06-06T03:39:54.390527+0000 (oldest deadline 2024-06-06T03:40:16.590980+0000) 2024-06-06T03:40:17.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:17 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:17.294+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:17.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:17 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:17.294+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:17.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:17 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:17.294+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:17.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:17 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:17.294+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:17.683 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:17 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:17.294+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:17.683 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:17 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:17.294+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:52.661649+0000 front 2024-06-06T03:39:52.661688+0000 (oldest deadline 2024-06-06T03:40:16.161802+0000) 2024-06-06T03:40:17.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:17 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:17.357+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:17.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:17 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:17.357+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:17.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:17 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:17.357+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:17.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:17 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:17.357+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:17.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:17 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:17.357+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:44.039147+0000 front 2024-06-06T03:39:44.039165+0000 (oldest deadline 2024-06-06T03:40:09.939369+0000) 2024-06-06T03:40:17.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:17 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:17.357+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.939873+0000 front 2024-06-06T03:39:49.939797+0000 (oldest deadline 2024-06-06T03:40:15.839818+0000) 2024-06-06T03:40:18.001 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:17 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:17.744+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:40:18.001 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:17 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:17.744+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:40:18.001 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:17 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:17.744+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:40:18.002 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:17 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:17.744+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.609257+0000 front 2024-06-06T03:39:37.609295+0000 (oldest deadline 2024-06-06T03:39:59.309401+0000) 2024-06-06T03:40:18.002 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:17 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:17.744+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:46.311046+0000 front 2024-06-06T03:39:46.311163+0000 (oldest deadline 2024-06-06T03:40:08.611029+0000) 2024-06-06T03:40:18.002 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:17 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:17.744+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.712161+0000 front 2024-06-06T03:39:49.712182+0000 (oldest deadline 2024-06-06T03:40:15.612012+0000) 2024-06-06T03:40:18.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:18 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:18.315+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:18.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:18 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:18.315+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:18.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:18 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:18.315+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:18.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:18 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:18.315+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:18.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:18 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:18.315+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:44.039147+0000 front 2024-06-06T03:39:44.039165+0000 (oldest deadline 2024-06-06T03:40:09.939369+0000) 2024-06-06T03:40:18.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:18 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:18.315+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.939873+0000 front 2024-06-06T03:39:49.939797+0000 (oldest deadline 2024-06-06T03:40:15.839818+0000) 2024-06-06T03:40:18.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:18 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:18.477+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:40:18.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:18 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:18.477+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:40:18.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:18 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:18.477+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.387793+0000 front 2024-06-06T03:39:27.387812+0000 (oldest deadline 2024-06-06T03:39:52.087903+0000) 2024-06-06T03:40:18.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:18 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:18.477+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.689267+0000 front 2024-06-06T03:39:36.689201+0000 (oldest deadline 2024-06-06T03:40:02.589146+0000) 2024-06-06T03:40:18.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:18 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:18.477+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:42.589673+0000 front 2024-06-06T03:39:42.589728+0000 (oldest deadline 2024-06-06T03:40:08.489540+0000) 2024-06-06T03:40:18.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:18 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:18.477+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:54.390471+0000 front 2024-06-06T03:39:54.390527+0000 (oldest deadline 2024-06-06T03:40:16.590980+0000) 2024-06-06T03:40:18.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:18 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:18.307+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:18.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:18 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:18.307+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:18.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:18 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:18.307+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:18.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:18 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:18.307+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:18.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:18 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:18.307+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:18.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:18 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:18.307+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:52.661649+0000 front 2024-06-06T03:39:52.661688+0000 (oldest deadline 2024-06-06T03:40:16.161802+0000) 2024-06-06T03:40:19.001 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:18 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:18.714+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:40:19.002 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:18 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:18.714+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:40:19.002 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:18 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:18.714+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:40:19.002 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:18 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:18.714+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.609257+0000 front 2024-06-06T03:39:37.609295+0000 (oldest deadline 2024-06-06T03:39:59.309401+0000) 2024-06-06T03:40:19.002 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:18 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:18.714+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:46.311046+0000 front 2024-06-06T03:39:46.311163+0000 (oldest deadline 2024-06-06T03:40:08.611029+0000) 2024-06-06T03:40:19.002 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:18 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:18.714+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.712161+0000 front 2024-06-06T03:39:49.712182+0000 (oldest deadline 2024-06-06T03:40:15.612012+0000) 2024-06-06T03:40:19.599 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:19 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:19.328+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:19.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:19 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:19.328+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:19.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:19 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:19.328+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:19.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:19 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:19.328+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:19.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:19 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:19.328+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:44.039147+0000 front 2024-06-06T03:39:44.039165+0000 (oldest deadline 2024-06-06T03:40:09.939369+0000) 2024-06-06T03:40:19.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:19 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:19.328+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.939873+0000 front 2024-06-06T03:39:49.939797+0000 (oldest deadline 2024-06-06T03:40:15.839818+0000) 2024-06-06T03:40:19.681 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:19 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:19.524+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.485299+0000 front 2024-06-06T03:39:10.485138+0000 (oldest deadline 2024-06-06T03:39:35.184986+0000) 2024-06-06T03:40:19.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:19 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:19.524+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:20.986946+0000 front 2024-06-06T03:39:20.987061+0000 (oldest deadline 2024-06-06T03:39:43.286801+0000) 2024-06-06T03:40:19.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:19 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:19.524+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.387793+0000 front 2024-06-06T03:39:27.387812+0000 (oldest deadline 2024-06-06T03:39:52.087903+0000) 2024-06-06T03:40:19.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:19 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:19.524+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.689267+0000 front 2024-06-06T03:39:36.689201+0000 (oldest deadline 2024-06-06T03:40:02.589146+0000) 2024-06-06T03:40:19.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:19 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:19.524+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:42.589673+0000 front 2024-06-06T03:39:42.589728+0000 (oldest deadline 2024-06-06T03:40:08.489540+0000) 2024-06-06T03:40:19.682 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:19 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8[54405]: 2024-06-06T03:40:19.524+0000 7fd025249700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:54.390471+0000 front 2024-06-06T03:39:54.390527+0000 (oldest deadline 2024-06-06T03:40:16.590980+0000) 2024-06-06T03:40:19.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:19 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:19.353+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:19.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:19 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:19.353+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:19.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:19 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:19.353+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:19.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:19 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:19.353+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:19.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:19 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:19.353+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:19.683 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:19 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:19.353+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:52.661649+0000 front 2024-06-06T03:39:52.661688+0000 (oldest deadline 2024-06-06T03:40:16.161802+0000) 2024-06-06T03:40:20.001 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:19 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:19.716+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:40:20.001 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:19 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:19.716+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:40:20.001 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:19 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:19.716+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:40:20.002 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:19 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:19.716+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.609257+0000 front 2024-06-06T03:39:37.609295+0000 (oldest deadline 2024-06-06T03:39:59.309401+0000) 2024-06-06T03:40:20.002 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:19 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:19.716+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:46.311046+0000 front 2024-06-06T03:39:46.311163+0000 (oldest deadline 2024-06-06T03:40:08.611029+0000) 2024-06-06T03:40:20.002 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:19 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:19.716+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.712161+0000 front 2024-06-06T03:39:49.712182+0000 (oldest deadline 2024-06-06T03:40:15.612012+0000) 2024-06-06T03:40:20.508 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:20 smithi122 podman[71950]: 2024-06-06 03:40:20.246948109 +0000 UTC m=+5.732771717 container died 365868d1b89bbd7b2b86f5dab0e35ed6a0165bd90f356f81af38bb9af2ae05a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-06-06T03:40:20.508 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:20 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:20.395+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:20.509 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:20 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:20.395+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:20.509 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:20 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:20.395+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:20.509 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:20 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:20.395+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:20.509 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:20 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:20.395+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:20.509 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:20 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:20.395+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:52.661649+0000 front 2024-06-06T03:39:52.661688+0000 (oldest deadline 2024-06-06T03:40:16.161802+0000) 2024-06-06T03:40:20.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:20 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:20.351+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:20.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:20 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:20.351+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:20.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:20 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:20.351+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:20.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:20 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:20.351+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:20.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:20 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:20.351+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:44.039147+0000 front 2024-06-06T03:39:44.039165+0000 (oldest deadline 2024-06-06T03:40:09.939369+0000) 2024-06-06T03:40:20.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:20 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:20.351+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.939873+0000 front 2024-06-06T03:39:49.939797+0000 (oldest deadline 2024-06-06T03:40:15.839818+0000) 2024-06-06T03:40:20.931 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:20 smithi122 podman[71950]: 2024-06-06 03:40:20.600424995 +0000 UTC m=+6.086248603 container cleanup 365868d1b89bbd7b2b86f5dab0e35ed6a0165bd90f356f81af38bb9af2ae05a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-06-06T03:40:20.931 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:20 smithi122 bash[71950]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8 2024-06-06T03:40:21.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:20 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:20.758+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:40:21.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:20 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:20.758+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:40:21.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:20 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:20.758+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:40:21.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:20 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:20.758+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.609257+0000 front 2024-06-06T03:39:37.609295+0000 (oldest deadline 2024-06-06T03:39:59.309401+0000) 2024-06-06T03:40:21.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:20 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:20.758+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:46.311046+0000 front 2024-06-06T03:39:46.311163+0000 (oldest deadline 2024-06-06T03:40:08.611029+0000) 2024-06-06T03:40:21.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:20 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:20.758+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.712161+0000 front 2024-06-06T03:39:49.712182+0000 (oldest deadline 2024-06-06T03:40:15.612012+0000) 2024-06-06T03:40:21.284 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:20 smithi122 podman[71965]: 2024-06-06 03:40:20.968533834 +0000 UTC m=+0.722521686 container remove 365868d1b89bbd7b2b86f5dab0e35ed6a0165bd90f356f81af38bb9af2ae05a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T03:40:21.571 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:21 smithi122 podman[72058]: 2024-06-06 03:40:21.187930416 +0000 UTC m=+0.017309512 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T03:40:21.571 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:21 smithi122 podman[72058]: 2024-06-06 03:40:21.30321437 +0000 UTC m=+0.132593471 container create a49acdb5dc9f6df90c5cece437bbaa83943888cd3b8f8f3de40035629c807324 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T03:40:21.572 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:21 smithi122 podman[72058]: 2024-06-06 03:40:21.572531173 +0000 UTC m=+0.401910263 container init a49acdb5dc9f6df90c5cece437bbaa83943888cd3b8f8f3de40035629c807324 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc) 2024-06-06T03:40:21.572 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:21 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:21.404+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:21.572 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:21 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:21.404+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:21.572 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:21 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:21.404+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:21.572 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:21 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:21.404+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:21.572 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:21 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:21.404+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:21.572 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:21 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:21.404+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:52.661649+0000 front 2024-06-06T03:39:52.661688+0000 (oldest deadline 2024-06-06T03:40:16.161802+0000) 2024-06-06T03:40:21.599 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:21 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:21.330+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:21.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:21 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:21.330+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:21.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:21 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:21.330+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:21.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:21 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:21.330+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:21.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:21 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:21.330+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:44.039147+0000 front 2024-06-06T03:39:44.039165+0000 (oldest deadline 2024-06-06T03:40:09.939369+0000) 2024-06-06T03:40:21.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:21 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:21.330+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.939873+0000 front 2024-06-06T03:39:49.939797+0000 (oldest deadline 2024-06-06T03:40:15.839818+0000) 2024-06-06T03:40:21.866 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:21 smithi122 podman[72058]: 2024-06-06 03:40:21.576116832 +0000 UTC m=+0.405495911 container start a49acdb5dc9f6df90c5cece437bbaa83943888cd3b8f8f3de40035629c807324 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True) 2024-06-06T03:40:21.866 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:21 smithi122 podman[72058]: 2024-06-06 03:40:21.664199396 +0000 UTC m=+0.493578485 container attach a49acdb5dc9f6df90c5cece437bbaa83943888cd3b8f8f3de40035629c807324 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc) 2024-06-06T03:40:22.149 INFO:journalctl@ceph.osd.8.smithi122.stdout:Jun 06 03:40:21 smithi122 podman[72058]: 2024-06-06 03:40:21.867340512 +0000 UTC m=+0.696719591 container died a49acdb5dc9f6df90c5cece437bbaa83943888cd3b8f8f3de40035629c807324 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-06T03:40:22.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:21 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:21.802+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:40:22.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:21 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:21.802+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:40:22.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:21 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:21.802+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:40:22.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:21 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:21.802+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.609257+0000 front 2024-06-06T03:39:37.609295+0000 (oldest deadline 2024-06-06T03:39:59.309401+0000) 2024-06-06T03:40:22.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:21 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:21.802+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:46.311046+0000 front 2024-06-06T03:39:46.311163+0000 (oldest deadline 2024-06-06T03:40:08.611029+0000) 2024-06-06T03:40:22.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:21 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:21.802+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.712161+0000 front 2024-06-06T03:39:49.712182+0000 (oldest deadline 2024-06-06T03:40:15.612012+0000) 2024-06-06T03:40:22.431 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:22 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:22.385+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:22.432 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:22 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:22.385+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:22.432 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:22 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:22.385+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:22.432 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:22 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:22.385+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:22.432 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:22 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:22.385+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:22.432 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:22 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:22.385+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:52.661649+0000 front 2024-06-06T03:39:52.661688+0000 (oldest deadline 2024-06-06T03:40:16.161802+0000) 2024-06-06T03:40:22.455 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.8.service' 2024-06-06T03:40:22.494 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T03:40:22.495 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-06-06T03:40:22.495 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-06-06T03:40:22.495 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.9 2024-06-06T03:40:22.599 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:22 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:22.288+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:22.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:22 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:22.288+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:22.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:22 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:22.288+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:22.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:22 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:22.288+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:22.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:22 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:22.288+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:44.039147+0000 front 2024-06-06T03:39:44.039165+0000 (oldest deadline 2024-06-06T03:40:09.939369+0000) 2024-06-06T03:40:22.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:22 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:22.288+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.939873+0000 front 2024-06-06T03:39:49.939797+0000 (oldest deadline 2024-06-06T03:40:15.839818+0000) 2024-06-06T03:40:22.809 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:22 smithi050 systemd[1]: Stopping Ceph osd.9 for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:40:23.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:22 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:22.810+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:40:23.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:22 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:22.810+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:40:23.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:22 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:22.810+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:40:23.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:22 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:22.810+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.609257+0000 front 2024-06-06T03:39:37.609295+0000 (oldest deadline 2024-06-06T03:39:59.309401+0000) 2024-06-06T03:40:23.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:22 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:22.810+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:46.311046+0000 front 2024-06-06T03:39:46.311163+0000 (oldest deadline 2024-06-06T03:40:08.611029+0000) 2024-06-06T03:40:23.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:22 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:22.810+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.712161+0000 front 2024-06-06T03:39:49.712182+0000 (oldest deadline 2024-06-06T03:40:15.612012+0000) 2024-06-06T03:40:23.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:22 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:22.833+0000 7f4425974700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T03:40:23.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:22 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:22.833+0000 7f4425974700 -1 osd.9 99 *** Got signal Terminated *** 2024-06-06T03:40:23.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:22 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:22.833+0000 7f4425974700 -1 osd.9 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T03:40:23.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:23 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:23.307+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:23.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:23 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:23.307+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:23.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:23 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:23.307+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:23.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:23 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:23.307+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:23.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:23 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:23.307+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:44.039147+0000 front 2024-06-06T03:39:44.039165+0000 (oldest deadline 2024-06-06T03:40:09.939369+0000) 2024-06-06T03:40:23.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:23 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:23.307+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.939873+0000 front 2024-06-06T03:39:49.939797+0000 (oldest deadline 2024-06-06T03:40:15.839818+0000) 2024-06-06T03:40:23.641 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:23 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:23.386+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:23.641 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:23 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:23.387+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:23.641 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:23 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:23.387+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:23.642 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:23 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:23.387+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:23.642 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:23 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:23.387+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:23.642 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:23 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:23.387+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:52.661649+0000 front 2024-06-06T03:39:52.661688+0000 (oldest deadline 2024-06-06T03:40:16.161802+0000) 2024-06-06T03:40:24.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:23 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:23.788+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:40:24.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:23 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:23.788+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:40:24.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:23 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:23.788+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:40:24.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:23 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:23.788+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.609257+0000 front 2024-06-06T03:39:37.609295+0000 (oldest deadline 2024-06-06T03:39:59.309401+0000) 2024-06-06T03:40:24.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:23 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:23.788+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:46.311046+0000 front 2024-06-06T03:39:46.311163+0000 (oldest deadline 2024-06-06T03:40:08.611029+0000) 2024-06-06T03:40:24.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:23 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:23.788+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.712161+0000 front 2024-06-06T03:39:49.712182+0000 (oldest deadline 2024-06-06T03:40:15.612012+0000) 2024-06-06T03:40:24.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:24 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:24.337+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:24.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:24 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:24.337+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:24.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:24 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:24.337+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:24.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:24 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:24.337+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:24.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:24 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:24.337+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:44.039147+0000 front 2024-06-06T03:39:44.039165+0000 (oldest deadline 2024-06-06T03:40:09.939369+0000) 2024-06-06T03:40:24.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:24 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:24.337+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.939873+0000 front 2024-06-06T03:39:49.939797+0000 (oldest deadline 2024-06-06T03:40:15.839818+0000) 2024-06-06T03:40:24.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:24 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:24.337+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-06-06T03:40:01.740975+0000 front 2024-06-06T03:40:01.741064+0000 (oldest deadline 2024-06-06T03:40:24.040934+0000) 2024-06-06T03:40:24.681 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:24 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:24.408+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:24.681 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:24 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:24.408+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:24.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:24 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:24.408+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:24.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:24 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:24.408+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:24.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:24 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:24.408+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:24.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:24 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:24.408+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:52.661649+0000 front 2024-06-06T03:39:52.661688+0000 (oldest deadline 2024-06-06T03:40:16.161802+0000) 2024-06-06T03:40:25.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:24 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:24.809+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:40:25.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:24 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:24.809+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:40:25.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:24 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:24.809+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:40:25.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:24 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:24.809+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.609257+0000 front 2024-06-06T03:39:37.609295+0000 (oldest deadline 2024-06-06T03:39:59.309401+0000) 2024-06-06T03:40:25.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:24 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:24.809+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:46.311046+0000 front 2024-06-06T03:39:46.311163+0000 (oldest deadline 2024-06-06T03:40:08.611029+0000) 2024-06-06T03:40:25.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:24 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:24.809+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.712161+0000 front 2024-06-06T03:39:49.712182+0000 (oldest deadline 2024-06-06T03:40:15.612012+0000) 2024-06-06T03:40:25.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:25 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:25.298+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:25.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:25 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:25.298+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:25.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:25 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:25.298+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:25.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:25 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:25.298+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:25.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:25 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:25.298+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:44.039147+0000 front 2024-06-06T03:39:44.039165+0000 (oldest deadline 2024-06-06T03:40:09.939369+0000) 2024-06-06T03:40:25.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:25 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:25.298+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.939873+0000 front 2024-06-06T03:39:49.939797+0000 (oldest deadline 2024-06-06T03:40:15.839818+0000) 2024-06-06T03:40:25.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:25 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:25.298+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-06-06T03:40:01.740975+0000 front 2024-06-06T03:40:01.741064+0000 (oldest deadline 2024-06-06T03:40:24.040934+0000) 2024-06-06T03:40:25.681 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:25 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:25.423+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:25.681 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:25 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:25.423+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:25.681 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:25 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:25.423+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:25.681 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:25 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:25.423+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:25.681 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:25 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:25.423+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:25.681 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:25 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:25.423+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:52.661649+0000 front 2024-06-06T03:39:52.661688+0000 (oldest deadline 2024-06-06T03:40:16.161802+0000) 2024-06-06T03:40:26.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:25 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:25.830+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:40:26.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:25 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:25.830+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:40:26.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:25 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:25.830+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:40:26.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:25 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:25.830+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.609257+0000 front 2024-06-06T03:39:37.609295+0000 (oldest deadline 2024-06-06T03:39:59.309401+0000) 2024-06-06T03:40:26.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:25 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:25.830+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:46.311046+0000 front 2024-06-06T03:39:46.311163+0000 (oldest deadline 2024-06-06T03:40:08.611029+0000) 2024-06-06T03:40:26.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:25 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:25.830+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.712161+0000 front 2024-06-06T03:39:49.712182+0000 (oldest deadline 2024-06-06T03:40:15.612012+0000) 2024-06-06T03:40:26.599 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:26 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:26.294+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:26.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:26 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:26.294+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:26.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:26 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:26.294+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:26.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:26 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:26.294+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:26.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:26 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:26.294+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:44.039147+0000 front 2024-06-06T03:39:44.039165+0000 (oldest deadline 2024-06-06T03:40:09.939369+0000) 2024-06-06T03:40:26.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:26 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:26.294+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.939873+0000 front 2024-06-06T03:39:49.939797+0000 (oldest deadline 2024-06-06T03:40:15.839818+0000) 2024-06-06T03:40:26.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:26 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:26.294+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-06-06T03:40:01.740975+0000 front 2024-06-06T03:40:01.741064+0000 (oldest deadline 2024-06-06T03:40:24.040934+0000) 2024-06-06T03:40:26.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:26 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:26.439+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:26.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:26 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:26.439+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:26.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:26 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:26.439+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:26.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:26 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:26.439+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:26.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:26 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:26.439+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:26.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:26 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:26.439+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:52.661649+0000 front 2024-06-06T03:39:52.661688+0000 (oldest deadline 2024-06-06T03:40:16.161802+0000) 2024-06-06T03:40:27.251 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:26 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:26.865+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:12.803835+0000 front 2024-06-06T03:39:12.803998+0000 (oldest deadline 2024-06-06T03:39:36.304074+0000) 2024-06-06T03:40:27.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:26 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:26.865+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.105664+0000 front 2024-06-06T03:39:19.105858+0000 (oldest deadline 2024-06-06T03:39:43.205883+0000) 2024-06-06T03:40:27.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:26 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:26.865+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.007362+0000 front 2024-06-06T03:39:29.007450+0000 (oldest deadline 2024-06-06T03:39:51.907495+0000) 2024-06-06T03:40:27.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:26 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:26.865+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.609257+0000 front 2024-06-06T03:39:37.609295+0000 (oldest deadline 2024-06-06T03:39:59.309401+0000) 2024-06-06T03:40:27.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:26 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:26.865+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:46.311046+0000 front 2024-06-06T03:39:46.311163+0000 (oldest deadline 2024-06-06T03:40:08.611029+0000) 2024-06-06T03:40:27.252 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:26 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9[67057]: 2024-06-06T03:40:26.865+0000 7f4421f68700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.712161+0000 front 2024-06-06T03:39:49.712182+0000 (oldest deadline 2024-06-06T03:40:15.612012+0000) 2024-06-06T03:40:27.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:27 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:27.334+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:27.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:27 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:27.334+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:27.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:27 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:27.334+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:27.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:27 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:27.334+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:27.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:27 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:27.334+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:44.039147+0000 front 2024-06-06T03:39:44.039165+0000 (oldest deadline 2024-06-06T03:40:09.939369+0000) 2024-06-06T03:40:27.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:27 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:27.334+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.939873+0000 front 2024-06-06T03:39:49.939797+0000 (oldest deadline 2024-06-06T03:40:15.839818+0000) 2024-06-06T03:40:27.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:27 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:27.334+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-06-06T03:40:01.740975+0000 front 2024-06-06T03:40:01.741064+0000 (oldest deadline 2024-06-06T03:40:24.040934+0000) 2024-06-06T03:40:27.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:27 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:27.443+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:27.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:27 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:27.443+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:27.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:27 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:27.443+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:27.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:27 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:27.443+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:27.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:27 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:27.443+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:27.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:27 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:27.443+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:52.661649+0000 front 2024-06-06T03:39:52.661688+0000 (oldest deadline 2024-06-06T03:40:16.161802+0000) 2024-06-06T03:40:28.599 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:28 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:28.346+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:28.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:28 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:28.346+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:28.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:28 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:28.346+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:28.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:28 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:28.346+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:28.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:28 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:28.346+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:44.039147+0000 front 2024-06-06T03:39:44.039165+0000 (oldest deadline 2024-06-06T03:40:09.939369+0000) 2024-06-06T03:40:28.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:28 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:28.346+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.939873+0000 front 2024-06-06T03:39:49.939797+0000 (oldest deadline 2024-06-06T03:40:15.839818+0000) 2024-06-06T03:40:28.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:28 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:28.346+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-06-06T03:40:01.740975+0000 front 2024-06-06T03:40:01.741064+0000 (oldest deadline 2024-06-06T03:40:24.040934+0000) 2024-06-06T03:40:28.675 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:28 smithi050 podman[118124]: 2024-06-06 03:40:28.391438389 +0000 UTC m=+5.683311137 container died 6227cb3a6be4c60cc739fb2647bc6b7ee5cecbc90a7d3a02b6ca5ca114bede77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc) 2024-06-06T03:40:28.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:28 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:28.489+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:28.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:28 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:28.489+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:28.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:28 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:28.489+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:28.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:28 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:28.489+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:28.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:28 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:28.489+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:28.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:28 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:28.489+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:52.661649+0000 front 2024-06-06T03:39:52.661688+0000 (oldest deadline 2024-06-06T03:40:16.161802+0000) 2024-06-06T03:40:28.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:28 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:28.489+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-06-06T03:39:59.062815+0000 front 2024-06-06T03:39:59.062847+0000 (oldest deadline 2024-06-06T03:40:28.463085+0000) 2024-06-06T03:40:29.001 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:28 smithi050 podman[118124]: 2024-06-06 03:40:28.850337303 +0000 UTC m=+6.142210073 container cleanup 6227cb3a6be4c60cc739fb2647bc6b7ee5cecbc90a7d3a02b6ca5ca114bede77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2) 2024-06-06T03:40:29.001 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:28 smithi050 bash[118124]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9 2024-06-06T03:40:29.483 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:29 smithi050 podman[118139]: 2024-06-06 03:40:29.126764125 +0000 UTC m=+0.731622864 container remove 6227cb3a6be4c60cc739fb2647bc6b7ee5cecbc90a7d3a02b6ca5ca114bede77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-06T03:40:29.601 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:29 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:29.323+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:29.601 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:29 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:29.323+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:29.601 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:29 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:29.323+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:29.601 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:29 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:29.323+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:29.601 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:29 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:29.323+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:44.039147+0000 front 2024-06-06T03:39:44.039165+0000 (oldest deadline 2024-06-06T03:40:09.939369+0000) 2024-06-06T03:40:29.601 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:29 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:29.323+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.939873+0000 front 2024-06-06T03:39:49.939797+0000 (oldest deadline 2024-06-06T03:40:15.839818+0000) 2024-06-06T03:40:29.601 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:29 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:29.323+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-06-06T03:40:01.740975+0000 front 2024-06-06T03:40:01.741064+0000 (oldest deadline 2024-06-06T03:40:24.040934+0000) 2024-06-06T03:40:29.751 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:29 smithi050 podman[118231]: 2024-06-06 03:40:29.386975918 +0000 UTC m=+0.017966818 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T03:40:29.752 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:29 smithi050 podman[118231]: 2024-06-06 03:40:29.494309162 +0000 UTC m=+0.125300032 container create 3bd087640678eea5dbc2ea33fb7ab819ea16761f29a646d9a754f2a35e8c80e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2) 2024-06-06T03:40:29.752 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:29 smithi050 podman[118231]: 2024-06-06 03:40:29.696766904 +0000 UTC m=+0.327757783 container init 3bd087640678eea5dbc2ea33fb7ab819ea16761f29a646d9a754f2a35e8c80e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T03:40:29.752 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:29 smithi050 podman[118231]: 2024-06-06 03:40:29.700308154 +0000 UTC m=+0.331299032 container start 3bd087640678eea5dbc2ea33fb7ab819ea16761f29a646d9a754f2a35e8c80e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-06-06T03:40:29.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:29 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:29.446+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:29.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:29 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:29.446+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:29.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:29 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:29.446+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:29.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:29 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:29.446+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:29.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:29 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:29.446+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:29.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:29 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:29.446+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:52.661649+0000 front 2024-06-06T03:39:52.661688+0000 (oldest deadline 2024-06-06T03:40:16.161802+0000) 2024-06-06T03:40:29.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:29 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:29.446+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-06-06T03:39:59.062815+0000 front 2024-06-06T03:39:59.062847+0000 (oldest deadline 2024-06-06T03:40:28.463085+0000) 2024-06-06T03:40:30.021 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:29 smithi050 podman[118231]: 2024-06-06 03:40:29.783235962 +0000 UTC m=+0.414226856 container attach 3bd087640678eea5dbc2ea33fb7ab819ea16761f29a646d9a754f2a35e8c80e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9-deactivate, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS) 2024-06-06T03:40:30.021 INFO:journalctl@ceph.osd.9.smithi050.stdout:Jun 06 03:40:30 smithi050 podman[118231]: 2024-06-06 03:40:30.002374712 +0000 UTC m=+0.633365601 container died 3bd087640678eea5dbc2ea33fb7ab819ea16761f29a646d9a754f2a35e8c80e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-9-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T03:40:30.668 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.9.service' 2024-06-06T03:40:30.681 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:30 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:30.401+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:30.681 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:30 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:30.401+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:30.681 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:30 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:30.401+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:30.681 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:30 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:30.401+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:30.681 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:30 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:30.401+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:30.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:30 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:30.401+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:52.661649+0000 front 2024-06-06T03:39:52.661688+0000 (oldest deadline 2024-06-06T03:40:16.161802+0000) 2024-06-06T03:40:30.682 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:30 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:30.401+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-06-06T03:39:59.062815+0000 front 2024-06-06T03:39:59.062847+0000 (oldest deadline 2024-06-06T03:40:28.463085+0000) 2024-06-06T03:40:30.708 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T03:40:30.709 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-06-06T03:40:30.709 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-06-06T03:40:30.709 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.10 2024-06-06T03:40:30.736 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:30 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:30.368+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:30.736 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:30 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:30.368+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:30.736 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:30 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:30.368+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:30.736 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:30 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:30.368+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:30.736 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:30 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:30.368+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:44.039147+0000 front 2024-06-06T03:39:44.039165+0000 (oldest deadline 2024-06-06T03:40:09.939369+0000) 2024-06-06T03:40:30.736 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:30 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:30.368+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.939873+0000 front 2024-06-06T03:39:49.939797+0000 (oldest deadline 2024-06-06T03:40:15.839818+0000) 2024-06-06T03:40:30.736 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:30 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:30.368+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-06-06T03:40:01.740975+0000 front 2024-06-06T03:40:01.741064+0000 (oldest deadline 2024-06-06T03:40:24.040934+0000) 2024-06-06T03:40:31.029 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:30 smithi079 systemd[1]: Stopping Ceph osd.10 for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:40:31.349 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:31 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:31.029+0000 7f167612f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T03:40:31.350 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:31 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:31.029+0000 7f167612f700 -1 osd.10 99 *** Got signal Terminated *** 2024-06-06T03:40:31.350 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:31 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:31.029+0000 7f167612f700 -1 osd.10 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T03:40:31.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:31 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:31.367+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:31.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:31 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:31.367+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:31.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:31 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:31.367+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:31.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:31 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:31.367+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:31.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:31 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:31.367+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:44.039147+0000 front 2024-06-06T03:39:44.039165+0000 (oldest deadline 2024-06-06T03:40:09.939369+0000) 2024-06-06T03:40:31.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:31 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:31.367+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.939873+0000 front 2024-06-06T03:39:49.939797+0000 (oldest deadline 2024-06-06T03:40:15.839818+0000) 2024-06-06T03:40:31.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:31 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:31.367+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-06-06T03:40:01.740975+0000 front 2024-06-06T03:40:01.741064+0000 (oldest deadline 2024-06-06T03:40:24.040934+0000) 2024-06-06T03:40:31.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:31 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:31.448+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:31.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:31 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:31.448+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:31.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:31 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:31.448+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:31.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:31 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:31.448+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:31.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:31 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:31.448+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:31.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:31 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:31.448+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:52.661649+0000 front 2024-06-06T03:39:52.661688+0000 (oldest deadline 2024-06-06T03:40:16.161802+0000) 2024-06-06T03:40:31.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:31 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:31.448+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-06-06T03:39:59.062815+0000 front 2024-06-06T03:39:59.062847+0000 (oldest deadline 2024-06-06T03:40:28.463085+0000) 2024-06-06T03:40:32.849 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:32 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:32.350+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:32.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:32 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:32.350+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:32.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:32 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:32.350+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:32.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:32 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:32.350+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:32.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:32 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:32.350+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:44.039147+0000 front 2024-06-06T03:39:44.039165+0000 (oldest deadline 2024-06-06T03:40:09.939369+0000) 2024-06-06T03:40:32.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:32 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:32.350+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.939873+0000 front 2024-06-06T03:39:49.939797+0000 (oldest deadline 2024-06-06T03:40:15.839818+0000) 2024-06-06T03:40:32.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:32 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:32.350+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-06-06T03:40:01.740975+0000 front 2024-06-06T03:40:01.741064+0000 (oldest deadline 2024-06-06T03:40:24.040934+0000) 2024-06-06T03:40:32.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:32 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:32.479+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:32.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:32 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:32.479+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:32.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:32 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:32.479+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:32.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:32 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:32.479+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:32.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:32 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:32.479+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:32.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:32 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:32.479+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:52.661649+0000 front 2024-06-06T03:39:52.661688+0000 (oldest deadline 2024-06-06T03:40:16.161802+0000) 2024-06-06T03:40:32.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:32 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:32.479+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-06-06T03:39:59.062815+0000 front 2024-06-06T03:39:59.062847+0000 (oldest deadline 2024-06-06T03:40:28.463085+0000) 2024-06-06T03:40:33.849 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:33 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:33.371+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:33.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:33 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:33.371+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:33.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:33 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:33.371+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:33.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:33 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:33.371+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:33.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:33 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:33.371+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:44.039147+0000 front 2024-06-06T03:39:44.039165+0000 (oldest deadline 2024-06-06T03:40:09.939369+0000) 2024-06-06T03:40:33.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:33 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:33.371+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.939873+0000 front 2024-06-06T03:39:49.939797+0000 (oldest deadline 2024-06-06T03:40:15.839818+0000) 2024-06-06T03:40:33.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:33 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:33.371+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-06-06T03:40:01.740975+0000 front 2024-06-06T03:40:01.741064+0000 (oldest deadline 2024-06-06T03:40:24.040934+0000) 2024-06-06T03:40:33.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:33 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:33.525+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:33.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:33 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:33.525+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:33.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:33 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:33.525+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:33.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:33 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:33.525+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:33.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:33 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:33.525+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:33.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:33 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:33.525+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:52.661649+0000 front 2024-06-06T03:39:52.661688+0000 (oldest deadline 2024-06-06T03:40:16.161802+0000) 2024-06-06T03:40:33.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:33 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:33.525+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-06-06T03:39:59.062815+0000 front 2024-06-06T03:39:59.062847+0000 (oldest deadline 2024-06-06T03:40:28.463085+0000) 2024-06-06T03:40:33.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:33 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:33.525+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2024-06-06T03:40:08.463669+0000 front 2024-06-06T03:40:08.463727+0000 (oldest deadline 2024-06-06T03:40:32.563642+0000) 2024-06-06T03:40:34.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:34 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:34.348+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:34.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:34 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:34.348+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:34.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:34 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:34.348+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:34.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:34 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:34.348+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:34.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:34 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:34.348+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:44.039147+0000 front 2024-06-06T03:39:44.039165+0000 (oldest deadline 2024-06-06T03:40:09.939369+0000) 2024-06-06T03:40:34.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:34 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:34.348+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.939873+0000 front 2024-06-06T03:39:49.939797+0000 (oldest deadline 2024-06-06T03:40:15.839818+0000) 2024-06-06T03:40:34.600 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:34 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:34.348+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-06-06T03:40:01.740975+0000 front 2024-06-06T03:40:01.741064+0000 (oldest deadline 2024-06-06T03:40:24.040934+0000) 2024-06-06T03:40:34.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:34 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:34.486+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:34.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:34 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:34.486+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:34.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:34 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:34.486+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:34.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:34 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:34.486+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:34.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:34 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:34.486+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:34.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:34 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:34.486+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:52.661649+0000 front 2024-06-06T03:39:52.661688+0000 (oldest deadline 2024-06-06T03:40:16.161802+0000) 2024-06-06T03:40:34.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:34 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:34.486+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-06-06T03:39:59.062815+0000 front 2024-06-06T03:39:59.062847+0000 (oldest deadline 2024-06-06T03:40:28.463085+0000) 2024-06-06T03:40:34.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:34 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:34.486+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2024-06-06T03:40:08.463669+0000 front 2024-06-06T03:40:08.463727+0000 (oldest deadline 2024-06-06T03:40:32.563642+0000) 2024-06-06T03:40:35.833 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:35 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:35.534+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:35.833 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:35 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:35.534+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:35.833 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:35 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:35.534+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:35.833 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:35 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:35.534+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:35.833 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:35 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:35.534+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:35.833 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:35 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:35.534+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:52.661649+0000 front 2024-06-06T03:39:52.661688+0000 (oldest deadline 2024-06-06T03:40:16.161802+0000) 2024-06-06T03:40:35.833 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:35 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:35.534+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-06-06T03:39:59.062815+0000 front 2024-06-06T03:39:59.062847+0000 (oldest deadline 2024-06-06T03:40:28.463085+0000) 2024-06-06T03:40:35.833 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:35 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:35.534+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2024-06-06T03:40:08.463669+0000 front 2024-06-06T03:40:08.463727+0000 (oldest deadline 2024-06-06T03:40:32.563642+0000) 2024-06-06T03:40:35.849 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:35 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:35.364+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:11.933985+0000 front 2024-06-06T03:39:11.933933+0000 (oldest deadline 2024-06-06T03:39:35.434081+0000) 2024-06-06T03:40:35.849 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:35 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:35.364+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.535223+0000 front 2024-06-06T03:39:19.535276+0000 (oldest deadline 2024-06-06T03:39:44.835406+0000) 2024-06-06T03:40:35.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:35 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:35.364+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:27.736277+0000 front 2024-06-06T03:39:27.736410+0000 (oldest deadline 2024-06-06T03:39:53.036276+0000) 2024-06-06T03:40:35.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:35 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:35.364+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:37.737566+0000 front 2024-06-06T03:39:37.737670+0000 (oldest deadline 2024-06-06T03:40:01.237440+0000) 2024-06-06T03:40:35.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:35 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:35.364+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:44.039147+0000 front 2024-06-06T03:39:44.039165+0000 (oldest deadline 2024-06-06T03:40:09.939369+0000) 2024-06-06T03:40:35.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:35 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:35.364+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:49.939873+0000 front 2024-06-06T03:39:49.939797+0000 (oldest deadline 2024-06-06T03:40:15.839818+0000) 2024-06-06T03:40:35.850 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:35 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10[59854]: 2024-06-06T03:40:35.364+0000 7f1672723700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-06-06T03:40:01.740975+0000 front 2024-06-06T03:40:01.741064+0000 (oldest deadline 2024-06-06T03:40:24.040934+0000) 2024-06-06T03:40:36.797 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:36 smithi079 podman[71084]: 2024-06-06 03:40:36.545463718 +0000 UTC m=+5.638673143 container died d43231e5bd63f5db8e4b5da44a956ada746fe65774684ee7a5f5682ce062be15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True) 2024-06-06T03:40:36.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:36 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:36.513+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:36.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:36 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:36.513+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:36.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:36 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:36.513+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:36.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:36 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:36.513+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:36.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:36 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:36.513+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:36.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:36 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:36.513+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:52.661649+0000 front 2024-06-06T03:39:52.661688+0000 (oldest deadline 2024-06-06T03:40:16.161802+0000) 2024-06-06T03:40:36.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:36 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:36.513+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-06-06T03:39:59.062815+0000 front 2024-06-06T03:39:59.062847+0000 (oldest deadline 2024-06-06T03:40:28.463085+0000) 2024-06-06T03:40:36.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:36 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:36.513+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2024-06-06T03:40:08.463669+0000 front 2024-06-06T03:40:08.463727+0000 (oldest deadline 2024-06-06T03:40:32.563642+0000) 2024-06-06T03:40:37.099 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:36 smithi079 podman[71084]: 2024-06-06 03:40:36.912995643 +0000 UTC m=+6.006205068 container cleanup d43231e5bd63f5db8e4b5da44a956ada746fe65774684ee7a5f5682ce062be15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-06-06T03:40:37.099 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:36 smithi079 bash[71084]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10 2024-06-06T03:40:37.682 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:37 smithi079 podman[71099]: 2024-06-06 03:40:37.356386561 +0000 UTC m=+0.810399497 container remove d43231e5bd63f5db8e4b5da44a956ada746fe65774684ee7a5f5682ce062be15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-06-06T03:40:37.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:37 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:37.523+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:37.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:37 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:37.523+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:37.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:37 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:37.523+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:37.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:37 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:37.523+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:37.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:37 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:37.523+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:37.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:37 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:37.523+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:52.661649+0000 front 2024-06-06T03:39:52.661688+0000 (oldest deadline 2024-06-06T03:40:16.161802+0000) 2024-06-06T03:40:37.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:37 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:37.523+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-06-06T03:39:59.062815+0000 front 2024-06-06T03:39:59.062847+0000 (oldest deadline 2024-06-06T03:40:28.463085+0000) 2024-06-06T03:40:37.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:37 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:37.523+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2024-06-06T03:40:08.463669+0000 front 2024-06-06T03:40:08.463727+0000 (oldest deadline 2024-06-06T03:40:32.563642+0000) 2024-06-06T03:40:37.992 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:37 smithi079 podman[71188]: 2024-06-06 03:40:37.586166235 +0000 UTC m=+0.017576294 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T03:40:37.992 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:37 smithi079 podman[71188]: 2024-06-06 03:40:37.707343563 +0000 UTC m=+0.138753633 container create d8173d9802514046b7813b1d915742efce2010ab7ebf9fecefc8342045ba9d3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10-deactivate, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=squid-3d89acc) 2024-06-06T03:40:37.992 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:37 smithi079 podman[71188]: 2024-06-06 03:40:37.910035127 +0000 UTC m=+0.341445168 container init d8173d9802514046b7813b1d915742efce2010ab7ebf9fecefc8342045ba9d3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-06-06T03:40:37.992 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:37 smithi079 podman[71188]: 2024-06-06 03:40:37.913267583 +0000 UTC m=+0.344677648 container start d8173d9802514046b7813b1d915742efce2010ab7ebf9fecefc8342045ba9d3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10-deactivate, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=) 2024-06-06T03:40:37.993 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:37 smithi079 podman[71188]: 2024-06-06 03:40:37.993312323 +0000 UTC m=+0.424722371 container attach d8173d9802514046b7813b1d915742efce2010ab7ebf9fecefc8342045ba9d3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-06-06T03:40:38.350 INFO:journalctl@ceph.osd.10.smithi079.stdout:Jun 06 03:40:38 smithi079 podman[71188]: 2024-06-06 03:40:38.200795587 +0000 UTC m=+0.632205639 container died d8173d9802514046b7813b1d915742efce2010ab7ebf9fecefc8342045ba9d3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-10-deactivate, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-06T03:40:38.725 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.10.service' 2024-06-06T03:40:38.805 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T03:40:38.805 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-06-06T03:40:38.805 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-06-06T03:40:38.805 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.11 2024-06-06T03:40:38.833 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:38 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:38.528+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:38.833 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:38 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:38.528+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:38.833 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:38 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:38.528+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:38.833 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:38 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:38.528+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:38.833 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:38 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:38.528+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:38.833 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:38 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:38.528+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:52.661649+0000 front 2024-06-06T03:39:52.661688+0000 (oldest deadline 2024-06-06T03:40:16.161802+0000) 2024-06-06T03:40:38.833 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:38 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:38.528+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-06-06T03:39:59.062815+0000 front 2024-06-06T03:39:59.062847+0000 (oldest deadline 2024-06-06T03:40:28.463085+0000) 2024-06-06T03:40:38.833 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:38 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:38.528+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2024-06-06T03:40:08.463669+0000 front 2024-06-06T03:40:08.463727+0000 (oldest deadline 2024-06-06T03:40:32.563642+0000) 2024-06-06T03:40:39.120 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:38 smithi122 systemd[1]: Stopping Ceph osd.11 for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:40:39.431 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:39 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:39.120+0000 7f095d80e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T03:40:39.432 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:39 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:39.120+0000 7f095d80e700 -1 osd.11 99 *** Got signal Terminated *** 2024-06-06T03:40:39.432 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:39 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:39.120+0000 7f095d80e700 -1 osd.11 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T03:40:39.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:39 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:39.560+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:39.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:39 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:39.560+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:39.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:39 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:39.560+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:39.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:39 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:39.560+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:39.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:39 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:39.560+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:39.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:39 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:39.560+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:52.661649+0000 front 2024-06-06T03:39:52.661688+0000 (oldest deadline 2024-06-06T03:40:16.161802+0000) 2024-06-06T03:40:39.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:39 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:39.560+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-06-06T03:39:59.062815+0000 front 2024-06-06T03:39:59.062847+0000 (oldest deadline 2024-06-06T03:40:28.463085+0000) 2024-06-06T03:40:39.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:39 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:39.560+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2024-06-06T03:40:08.463669+0000 front 2024-06-06T03:40:08.463727+0000 (oldest deadline 2024-06-06T03:40:32.563642+0000) 2024-06-06T03:40:40.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:40 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:40.548+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:40.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:40 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:40.548+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:40.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:40 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:40.548+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:40.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:40 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:40.548+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:40.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:40 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:40.548+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:40.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:40 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:40.548+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:52.661649+0000 front 2024-06-06T03:39:52.661688+0000 (oldest deadline 2024-06-06T03:40:16.161802+0000) 2024-06-06T03:40:40.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:40 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:40.548+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-06-06T03:39:59.062815+0000 front 2024-06-06T03:39:59.062847+0000 (oldest deadline 2024-06-06T03:40:28.463085+0000) 2024-06-06T03:40:40.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:40 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:40.548+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2024-06-06T03:40:08.463669+0000 front 2024-06-06T03:40:08.463727+0000 (oldest deadline 2024-06-06T03:40:32.563642+0000) 2024-06-06T03:40:41.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:41 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:41.518+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:41.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:41 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:41.518+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:41.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:41 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:41.518+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:41.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:41 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:41.518+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:41.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:41 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:41.518+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:41.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:41 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:41.518+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:52.661649+0000 front 2024-06-06T03:39:52.661688+0000 (oldest deadline 2024-06-06T03:40:16.161802+0000) 2024-06-06T03:40:41.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:41 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:41.518+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-06-06T03:39:59.062815+0000 front 2024-06-06T03:39:59.062847+0000 (oldest deadline 2024-06-06T03:40:28.463085+0000) 2024-06-06T03:40:41.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:41 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:41.518+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2024-06-06T03:40:08.463669+0000 front 2024-06-06T03:40:08.463727+0000 (oldest deadline 2024-06-06T03:40:32.563642+0000) 2024-06-06T03:40:42.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:42 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:42.501+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:42.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:42 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:42.501+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:42.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:42 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:42.501+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:42.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:42 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:42.501+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:42.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:42 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:42.501+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:42.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:42 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:42.501+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:52.661649+0000 front 2024-06-06T03:39:52.661688+0000 (oldest deadline 2024-06-06T03:40:16.161802+0000) 2024-06-06T03:40:42.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:42 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:42.501+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-06-06T03:39:59.062815+0000 front 2024-06-06T03:39:59.062847+0000 (oldest deadline 2024-06-06T03:40:28.463085+0000) 2024-06-06T03:40:42.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:42 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:42.501+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2024-06-06T03:40:08.463669+0000 front 2024-06-06T03:40:08.463727+0000 (oldest deadline 2024-06-06T03:40:32.563642+0000) 2024-06-06T03:40:43.931 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:43 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:43.494+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-06-06T03:39:10.154630+0000 front 2024-06-06T03:39:10.154666+0000 (oldest deadline 2024-06-06T03:39:35.454669+0000) 2024-06-06T03:40:43.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:43 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:43.494+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-06-06T03:39:19.555760+0000 front 2024-06-06T03:39:19.555669+0000 (oldest deadline 2024-06-06T03:39:43.655699+0000) 2024-06-06T03:40:43.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:43 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:43.494+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-06-06T03:39:29.457221+0000 front 2024-06-06T03:39:29.457267+0000 (oldest deadline 2024-06-06T03:39:51.157403+0000) 2024-06-06T03:40:43.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:43 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:43.494+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-06-06T03:39:36.959145+0000 front 2024-06-06T03:39:36.959217+0000 (oldest deadline 2024-06-06T03:40:01.059289+0000) 2024-06-06T03:40:43.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:43 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:43.494+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-06-06T03:39:45.760205+0000 front 2024-06-06T03:39:45.760243+0000 (oldest deadline 2024-06-06T03:40:09.860188+0000) 2024-06-06T03:40:43.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:43 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:43.494+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-06-06T03:39:52.661649+0000 front 2024-06-06T03:39:52.661688+0000 (oldest deadline 2024-06-06T03:40:16.161802+0000) 2024-06-06T03:40:43.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:43 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:43.494+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-06-06T03:39:59.062815+0000 front 2024-06-06T03:39:59.062847+0000 (oldest deadline 2024-06-06T03:40:28.463085+0000) 2024-06-06T03:40:43.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:43 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:43.494+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2024-06-06T03:40:08.463669+0000 front 2024-06-06T03:40:08.463727+0000 (oldest deadline 2024-06-06T03:40:32.563642+0000) 2024-06-06T03:40:43.932 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:43 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11[60938]: 2024-06-06T03:40:43.494+0000 7f0955dfa700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.122:6820 osd.8 since back 2024-06-06T03:40:17.566120+0000 front 2024-06-06T03:40:17.566070+0000 (oldest deadline 2024-06-06T03:40:42.866036+0000) 2024-06-06T03:40:45.078 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:44 smithi122 podman[72175]: 2024-06-06 03:40:44.75327002 +0000 UTC m=+5.750223946 container died ab61ba7365317ac1c5127a472ce95efa634f9403e126967b14efbe02bc1cd25b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-06-06T03:40:45.078 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:45 smithi122 podman[72175]: 2024-06-06 03:40:45.079479338 +0000 UTC m=+6.076433251 container cleanup ab61ba7365317ac1c5127a472ce95efa634f9403e126967b14efbe02bc1cd25b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD) 2024-06-06T03:40:45.431 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:45 smithi122 bash[72175]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11 2024-06-06T03:40:45.432 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:45 smithi122 podman[72191]: 2024-06-06 03:40:45.273834917 +0000 UTC m=+0.524130845 container remove ab61ba7365317ac1c5127a472ce95efa634f9403e126967b14efbe02bc1cd25b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True) 2024-06-06T03:40:45.946 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:45 smithi122 podman[72279]: 2024-06-06 03:40:45.597802828 +0000 UTC m=+0.016963323 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T03:40:45.946 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:45 smithi122 podman[72279]: 2024-06-06 03:40:45.699753796 +0000 UTC m=+0.118914336 container create f0ee5f068d84ef73c53bca004d6c15040ea947b52ada25b34dbe9c0bfc9bb857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-06-06T03:40:45.946 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:45 smithi122 podman[72279]: 2024-06-06 03:40:45.943783684 +0000 UTC m=+0.362944183 container init f0ee5f068d84ef73c53bca004d6c15040ea947b52ada25b34dbe9c0bfc9bb857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, io.buildah.version=1.33.5) 2024-06-06T03:40:45.946 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:45 smithi122 podman[72279]: 2024-06-06 03:40:45.9471237 +0000 UTC m=+0.366284195 container start f0ee5f068d84ef73c53bca004d6c15040ea947b52ada25b34dbe9c0bfc9bb857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-06-06T03:40:46.242 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:46 smithi122 podman[72279]: 2024-06-06 03:40:46.035547411 +0000 UTC m=+0.454707906 container attach f0ee5f068d84ef73c53bca004d6c15040ea947b52ada25b34dbe9c0bfc9bb857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T03:40:46.579 INFO:journalctl@ceph.osd.11.smithi122.stdout:Jun 06 03:40:46 smithi122 podman[72279]: 2024-06-06 03:40:46.243957454 +0000 UTC m=+0.663117957 container died f0ee5f068d84ef73c53bca004d6c15040ea947b52ada25b34dbe9c0bfc9bb857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, ceph=True) 2024-06-06T03:40:46.882 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@osd.11.service' 2024-06-06T03:40:46.960 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T03:40:46.960 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-06-06T03:40:46.960 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-06-06T03:40:46.960 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.a 2024-06-06T03:40:47.251 INFO:journalctl@ceph.mds.a.smithi050.stdout:Jun 06 03:40:47 smithi050 systemd[1]: Stopping Ceph mds.a for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:40:47.751 INFO:journalctl@ceph.mds.a.smithi050.stdout:Jun 06 03:40:47 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-a[74280]: 2024-06-06T03:40:47.261+0000 7f2918bfe700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T03:40:47.751 INFO:journalctl@ceph.mds.a.smithi050.stdout:Jun 06 03:40:47 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-a[74280]: 2024-06-06T03:40:47.261+0000 7f2918bfe700 -1 mds.a *** got signal Terminated *** 2024-06-06T03:40:51.546 INFO:journalctl@ceph.mds.a.smithi050.stdout:Jun 06 03:40:51 smithi050 podman[118348]: 2024-06-06 03:40:51.275987331 +0000 UTC m=+4.106463725 container died 624c20db84eeb5a928619fe1e63bb015aa5505f33b33b9b1b2dfedba75b082a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-a, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-06-06T03:40:51.904 INFO:journalctl@ceph.mds.a.smithi050.stdout:Jun 06 03:40:51 smithi050 podman[118348]: 2024-06-06 03:40:51.694786634 +0000 UTC m=+4.525263029 container cleanup 624c20db84eeb5a928619fe1e63bb015aa5505f33b33b9b1b2dfedba75b082a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-a, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD) 2024-06-06T03:40:51.919 INFO:journalctl@ceph.mds.a.smithi050.stdout:Jun 06 03:40:51 smithi050 bash[118348]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-a 2024-06-06T03:40:52.138 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.a.service' 2024-06-06T03:40:52.161 INFO:journalctl@ceph.mds.a.smithi050.stdout:Jun 06 03:40:51 smithi050 podman[118360]: 2024-06-06 03:40:51.904584486 +0000 UTC m=+0.616249080 container remove 624c20db84eeb5a928619fe1e63bb015aa5505f33b33b9b1b2dfedba75b082a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-a, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-06-06T03:40:52.161 INFO:journalctl@ceph.mds.a.smithi050.stdout:Jun 06 03:40:52 smithi050 systemd[1]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.a.service: Deactivated successfully. 2024-06-06T03:40:52.162 INFO:journalctl@ceph.mds.a.smithi050.stdout:Jun 06 03:40:52 smithi050 systemd[1]: Stopped Ceph mds.a for b6263b26-23b2-11ef-bc9b-c7b262605968. 2024-06-06T03:40:52.162 INFO:journalctl@ceph.mds.a.smithi050.stdout:Jun 06 03:40:52 smithi050 systemd[1]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.a.service: Consumed 1.138s CPU time. 2024-06-06T03:40:52.174 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T03:40:52.175 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-06-06T03:40:52.175 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-06-06T03:40:52.175 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.d 2024-06-06T03:40:52.501 INFO:journalctl@ceph.mds.d.smithi050.stdout:Jun 06 03:40:52 smithi050 systemd[1]: Stopping Ceph mds.d for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:40:53.001 INFO:journalctl@ceph.mds.d.smithi050.stdout:Jun 06 03:40:52 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-d[73038]: 2024-06-06T03:40:52.506+0000 7fac0de85700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T03:40:53.002 INFO:journalctl@ceph.mds.d.smithi050.stdout:Jun 06 03:40:52 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-d[73038]: 2024-06-06T03:40:52.506+0000 7fac0de85700 -1 mds.d *** got signal Terminated *** 2024-06-06T03:40:53.858 INFO:journalctl@ceph.mds.d.smithi050.stdout:Jun 06 03:40:53 smithi050 podman[118468]: 2024-06-06 03:40:53.574122812 +0000 UTC m=+1.166019010 container died af5d27ce8633628d30c0a0b6b84f67d46ee6ccbd7ab3c0152fd759771f114047 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-d, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T03:40:54.207 INFO:journalctl@ceph.mds.d.smithi050.stdout:Jun 06 03:40:53 smithi050 podman[118468]: 2024-06-06 03:40:53.95724558 +0000 UTC m=+1.549141768 container cleanup af5d27ce8633628d30c0a0b6b84f67d46ee6ccbd7ab3c0152fd759771f114047 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-d, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T03:40:54.207 INFO:journalctl@ceph.mds.d.smithi050.stdout:Jun 06 03:40:53 smithi050 bash[118468]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-d 2024-06-06T03:40:54.354 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.d.service' 2024-06-06T03:40:54.388 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T03:40:54.389 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-06-06T03:40:54.389 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-06-06T03:40:54.389 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.g 2024-06-06T03:40:54.751 INFO:journalctl@ceph.mds.g.smithi050.stdout:Jun 06 03:40:54 smithi050 systemd[1]: Stopping Ceph mds.g for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:40:54.752 INFO:journalctl@ceph.mds.g.smithi050.stdout:Jun 06 03:40:54 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-g[73840]: 2024-06-06T03:40:54.702+0000 7fddd91ab700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T03:40:54.752 INFO:journalctl@ceph.mds.g.smithi050.stdout:Jun 06 03:40:54 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-g[73840]: 2024-06-06T03:40:54.702+0000 7fddd91ab700 -1 mds.g *** got signal Terminated *** 2024-06-06T03:40:59.001 INFO:journalctl@ceph.mds.g.smithi050.stdout:Jun 06 03:40:58 smithi050 podman[118589]: 2024-06-06 03:40:58.717548243 +0000 UTC m=+4.106934704 container died 8a7835e5a2ab7232c325397223f5c3138fdf3197d225f060a30e4558686205f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-06-06T03:40:59.369 INFO:journalctl@ceph.mds.g.smithi050.stdout:Jun 06 03:40:59 smithi050 podman[118589]: 2024-06-06 03:40:59.021560315 +0000 UTC m=+4.410946768 container cleanup 8a7835e5a2ab7232c325397223f5c3138fdf3197d225f060a30e4558686205f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-g, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-06-06T03:40:59.369 INFO:journalctl@ceph.mds.g.smithi050.stdout:Jun 06 03:40:59 smithi050 bash[118589]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-g 2024-06-06T03:40:59.369 INFO:journalctl@ceph.mds.g.smithi050.stdout:Jun 06 03:40:59 smithi050 podman[118600]: 2024-06-06 03:40:59.231164388 +0000 UTC m=+0.511202025 container remove 8a7835e5a2ab7232c325397223f5c3138fdf3197d225f060a30e4558686205f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-g, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T03:40:59.385 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.g.service' 2024-06-06T03:40:59.418 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T03:40:59.419 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-06-06T03:40:59.419 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-06-06T03:40:59.419 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.j 2024-06-06T03:40:59.750 INFO:journalctl@ceph.mds.j.smithi050.stdout:Jun 06 03:40:59 smithi050 systemd[1]: Stopping Ceph mds.j for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:41:00.001 INFO:journalctl@ceph.mds.j.smithi050.stdout:Jun 06 03:40:59 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-j[72591]: 2024-06-06T03:40:59.749+0000 7fbcad1c4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T03:41:00.001 INFO:journalctl@ceph.mds.j.smithi050.stdout:Jun 06 03:40:59 smithi050 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-j[72591]: 2024-06-06T03:40:59.749+0000 7fbcad1c4700 -1 mds.j *** got signal Terminated *** 2024-06-06T03:41:01.889 INFO:journalctl@ceph.mds.j.smithi050.stdout:Jun 06 03:41:01 smithi050 podman[118710]: 2024-06-06 03:41:01.618508187 +0000 UTC m=+1.975366056 container died 29b68f57afbb962cefc68dc29087bf5561fc1274361060d2e95c9ade7f4654fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-j, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-06-06T03:41:02.167 INFO:journalctl@ceph.mds.j.smithi050.stdout:Jun 06 03:41:01 smithi050 podman[118710]: 2024-06-06 03:41:01.966801985 +0000 UTC m=+2.323659854 container cleanup 29b68f57afbb962cefc68dc29087bf5561fc1274361060d2e95c9ade7f4654fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-06T03:41:02.167 INFO:journalctl@ceph.mds.j.smithi050.stdout:Jun 06 03:41:01 smithi050 bash[118710]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-j 2024-06-06T03:41:02.379 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.j.service' 2024-06-06T03:41:02.412 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T03:41:02.412 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-06-06T03:41:02.412 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-06-06T03:41:02.412 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.b 2024-06-06T03:41:02.721 INFO:journalctl@ceph.mds.b.smithi079.stdout:Jun 06 03:41:02 smithi079 systemd[1]: Stopping Ceph mds.b for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:41:03.099 INFO:journalctl@ceph.mds.b.smithi079.stdout:Jun 06 03:41:02 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-b[65442]: 2024-06-06T03:41:02.721+0000 7f49ba984700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T03:41:03.100 INFO:journalctl@ceph.mds.b.smithi079.stdout:Jun 06 03:41:02 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-b[65442]: 2024-06-06T03:41:02.721+0000 7f49ba984700 -1 mds.b *** got signal Terminated *** 2024-06-06T03:41:06.495 INFO:journalctl@ceph.mds.b.smithi079.stdout:Jun 06 03:41:06 smithi079 podman[71292]: 2024-06-06 03:41:06.225030582 +0000 UTC m=+3.607044179 container died 4aa3980a15ca2957cf652f7be8af447ce54e9723bb0f00c3dad1e29cab0e9042 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-b, GIT_CLEAN=True, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-06-06T03:41:06.849 INFO:journalctl@ceph.mds.b.smithi079.stdout:Jun 06 03:41:06 smithi079 podman[71292]: 2024-06-06 03:41:06.596259067 +0000 UTC m=+3.978272658 container cleanup 4aa3980a15ca2957cf652f7be8af447ce54e9723bb0f00c3dad1e29cab0e9042 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-06-06T03:41:06.849 INFO:journalctl@ceph.mds.b.smithi079.stdout:Jun 06 03:41:06 smithi079 bash[71292]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-b 2024-06-06T03:41:06.998 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.b.service' 2024-06-06T03:41:07.032 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T03:41:07.032 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-06-06T03:41:07.032 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-06-06T03:41:07.032 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.e 2024-06-06T03:41:07.599 INFO:journalctl@ceph.mds.e.smithi079.stdout:Jun 06 03:41:07 smithi079 systemd[1]: Stopping Ceph mds.e for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:41:07.600 INFO:journalctl@ceph.mds.e.smithi079.stdout:Jun 06 03:41:07 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-e[64835]: 2024-06-06T03:41:07.366+0000 7f6f1e56e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T03:41:07.600 INFO:journalctl@ceph.mds.e.smithi079.stdout:Jun 06 03:41:07 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-e[64835]: 2024-06-06T03:41:07.366+0000 7f6f1e56e700 -1 mds.e *** got signal Terminated *** 2024-06-06T03:41:08.800 INFO:journalctl@ceph.mds.e.smithi079.stdout:Jun 06 03:41:08 smithi079 podman[71410]: 2024-06-06 03:41:08.573696749 +0000 UTC m=+1.313558157 container died 099ff07748198793a62b89bb8fcd8631e6c3ce5bf1be9589561e73809827b96c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-e, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-06T03:41:09.100 INFO:journalctl@ceph.mds.e.smithi079.stdout:Jun 06 03:41:08 smithi079 podman[71410]: 2024-06-06 03:41:08.90121836 +0000 UTC m=+1.641079759 container cleanup 099ff07748198793a62b89bb8fcd8631e6c3ce5bf1be9589561e73809827b96c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-e, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, ceph=True) 2024-06-06T03:41:09.100 INFO:journalctl@ceph.mds.e.smithi079.stdout:Jun 06 03:41:08 smithi079 bash[71410]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-e 2024-06-06T03:41:09.328 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.e.service' 2024-06-06T03:41:09.361 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T03:41:09.361 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-06-06T03:41:09.362 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-06-06T03:41:09.362 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.h 2024-06-06T03:41:09.705 INFO:journalctl@ceph.mds.h.smithi079.stdout:Jun 06 03:41:09 smithi079 systemd[1]: Stopping Ceph mds.h for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:41:10.100 INFO:journalctl@ceph.mds.h.smithi079.stdout:Jun 06 03:41:09 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-h[65139]: 2024-06-06T03:41:09.704+0000 7f88eb5a9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T03:41:10.100 INFO:journalctl@ceph.mds.h.smithi079.stdout:Jun 06 03:41:09 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-h[65139]: 2024-06-06T03:41:09.704+0000 7f88eb5a9700 -1 mds.h *** got signal Terminated *** 2024-06-06T03:41:13.697 INFO:journalctl@ceph.mds.h.smithi079.stdout:Jun 06 03:41:13 smithi079 podman[71543]: 2024-06-06 03:41:13.392417867 +0000 UTC m=+3.803877364 container died ad37c9a33c0d8fed3d12a926673f0e3ca870ffc222bd43d7d6490eb0a85c1b34 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-h, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T03:41:14.014 INFO:journalctl@ceph.mds.h.smithi079.stdout:Jun 06 03:41:13 smithi079 podman[71543]: 2024-06-06 03:41:13.796967629 +0000 UTC m=+4.208427127 container cleanup ad37c9a33c0d8fed3d12a926673f0e3ca870ffc222bd43d7d6490eb0a85c1b34 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-h, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-06-06T03:41:14.014 INFO:journalctl@ceph.mds.h.smithi079.stdout:Jun 06 03:41:13 smithi079 bash[71543]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-h 2024-06-06T03:41:14.147 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.h.service' 2024-06-06T03:41:14.181 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T03:41:14.181 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-06-06T03:41:14.181 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-06-06T03:41:14.181 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.k 2024-06-06T03:41:14.349 INFO:journalctl@ceph.mds.k.smithi079.stdout:Jun 06 03:41:14 smithi079 systemd[1]: Stopping Ceph mds.k for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:41:14.849 INFO:journalctl@ceph.mds.k.smithi079.stdout:Jun 06 03:41:14 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-k[64522]: 2024-06-06T03:41:14.527+0000 7f350a8d3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T03:41:14.850 INFO:journalctl@ceph.mds.k.smithi079.stdout:Jun 06 03:41:14 smithi079 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-k[64522]: 2024-06-06T03:41:14.527+0000 7f350a8d3700 -1 mds.k *** got signal Terminated *** 2024-06-06T03:41:17.327 INFO:journalctl@ceph.mds.k.smithi079.stdout:Jun 06 03:41:17 smithi079 podman[71666]: 2024-06-06 03:41:17.008146603 +0000 UTC m=+2.610584716 container died ffda9cce81842fc51da2b42c2f62db4ff758fdd5b05a8bf9914e4fabb2b36922 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T03:41:17.327 INFO:journalctl@ceph.mds.k.smithi079.stdout:Jun 06 03:41:17 smithi079 podman[71666]: 2024-06-06 03:41:17.328351966 +0000 UTC m=+2.930790068 container cleanup ffda9cce81842fc51da2b42c2f62db4ff758fdd5b05a8bf9914e4fabb2b36922 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-k, RELEASE=squid-3d89acc, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-06-06T03:41:17.599 INFO:journalctl@ceph.mds.k.smithi079.stdout:Jun 06 03:41:17 smithi079 bash[71666]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-k 2024-06-06T03:41:17.600 INFO:journalctl@ceph.mds.k.smithi079.stdout:Jun 06 03:41:17 smithi079 podman[71680]: 2024-06-06 03:41:17.52119149 +0000 UTC m=+0.510889056 container remove ffda9cce81842fc51da2b42c2f62db4ff758fdd5b05a8bf9914e4fabb2b36922 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-k, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T03:41:17.758 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.k.service' 2024-06-06T03:41:17.790 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T03:41:17.790 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-06-06T03:41:17.791 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-06-06T03:41:17.791 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.c 2024-06-06T03:41:18.090 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:41:17 smithi122 systemd[1]: Stopping Ceph mds.c for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:41:18.431 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:41:18 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-c[66218]: 2024-06-06T03:41:18.090+0000 7f494fd2d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T03:41:18.431 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:41:18 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-c[66218]: 2024-06-06T03:41:18.090+0000 7f494fd2d700 -1 mds.c *** got signal Terminated *** 2024-06-06T03:41:21.098 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:41:20 smithi122 podman[72384]: 2024-06-06 03:41:20.824162904 +0000 UTC m=+2.823344927 container died ebf5370b21a841a2c71bbc07406675ff53d4adbbcce0527890b1230e64ffd84f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-c, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-06-06T03:41:21.431 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:41:21 smithi122 podman[72384]: 2024-06-06 03:41:21.198228536 +0000 UTC m=+3.197410561 container cleanup ebf5370b21a841a2c71bbc07406675ff53d4adbbcce0527890b1230e64ffd84f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-c, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-06-06T03:41:21.431 INFO:journalctl@ceph.mds.c.smithi122.stdout:Jun 06 03:41:21 smithi122 bash[72384]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-c 2024-06-06T03:41:21.625 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.c.service' 2024-06-06T03:41:21.661 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T03:41:21.662 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-06-06T03:41:21.662 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-06-06T03:41:21.662 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.f 2024-06-06T03:41:21.977 INFO:journalctl@ceph.mds.f.smithi122.stdout:Jun 06 03:41:21 smithi122 systemd[1]: Stopping Ceph mds.f for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:41:22.431 INFO:journalctl@ceph.mds.f.smithi122.stdout:Jun 06 03:41:21 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-f[65920]: 2024-06-06T03:41:21.976+0000 7f72e16e1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T03:41:22.431 INFO:journalctl@ceph.mds.f.smithi122.stdout:Jun 06 03:41:21 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-f[65920]: 2024-06-06T03:41:21.976+0000 7f72e16e1700 -1 mds.f *** got signal Terminated *** 2024-06-06T03:41:26.113 INFO:journalctl@ceph.mds.f.smithi122.stdout:Jun 06 03:41:25 smithi122 podman[72518]: 2024-06-06 03:41:25.83781069 +0000 UTC m=+3.954435677 container died 7166a28c57a19faabfc3c4628fe646b3d2e460b9d21540c282f199e676a15fd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-f, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-06-06T03:41:26.431 INFO:journalctl@ceph.mds.f.smithi122.stdout:Jun 06 03:41:26 smithi122 podman[72518]: 2024-06-06 03:41:26.187818119 +0000 UTC m=+4.304443108 container cleanup 7166a28c57a19faabfc3c4628fe646b3d2e460b9d21540c282f199e676a15fd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-f, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-06T03:41:26.431 INFO:journalctl@ceph.mds.f.smithi122.stdout:Jun 06 03:41:26 smithi122 bash[72518]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-f 2024-06-06T03:41:26.431 INFO:journalctl@ceph.mds.f.smithi122.stdout:Jun 06 03:41:26 smithi122 podman[72531]: 2024-06-06 03:41:26.338788008 +0000 UTC m=+0.494962853 container remove 7166a28c57a19faabfc3c4628fe646b3d2e460b9d21540c282f199e676a15fd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-f, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528) 2024-06-06T03:41:26.560 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.f.service' 2024-06-06T03:41:26.593 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T03:41:26.594 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-06-06T03:41:26.594 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-06-06T03:41:26.594 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.i 2024-06-06T03:41:26.907 INFO:journalctl@ceph.mds.i.smithi122.stdout:Jun 06 03:41:26 smithi122 systemd[1]: Stopping Ceph mds.i for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:41:27.181 INFO:journalctl@ceph.mds.i.smithi122.stdout:Jun 06 03:41:26 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-i[66519]: 2024-06-06T03:41:26.907+0000 7fe6d0348700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T03:41:27.181 INFO:journalctl@ceph.mds.i.smithi122.stdout:Jun 06 03:41:26 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-i[66519]: 2024-06-06T03:41:26.907+0000 7fe6d0348700 -1 mds.i *** got signal Terminated *** 2024-06-06T03:41:32.883 INFO:journalctl@ceph.mds.i.smithi122.stdout:Jun 06 03:41:32 smithi122 podman[72638]: 2024-06-06 03:41:32.556116595 +0000 UTC m=+5.744640447 container died fdbaaaa092f715b3840e616517f99eebe791515c6dfd921f2e2bc78d39e47fb9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T03:41:32.883 INFO:journalctl@ceph.mds.i.smithi122.stdout:Jun 06 03:41:32 smithi122 podman[72638]: 2024-06-06 03:41:32.882703235 +0000 UTC m=+6.071227077 container cleanup fdbaaaa092f715b3840e616517f99eebe791515c6dfd921f2e2bc78d39e47fb9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-i, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-06-06T03:41:33.181 INFO:journalctl@ceph.mds.i.smithi122.stdout:Jun 06 03:41:32 smithi122 bash[72638]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-i 2024-06-06T03:41:33.181 INFO:journalctl@ceph.mds.i.smithi122.stdout:Jun 06 03:41:33 smithi122 podman[72649]: 2024-06-06 03:41:33.092283027 +0000 UTC m=+0.534835396 container remove fdbaaaa092f715b3840e616517f99eebe791515c6dfd921f2e2bc78d39e47fb9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-i, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T03:41:33.321 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.i.service' 2024-06-06T03:41:33.353 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T03:41:33.354 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-06-06T03:41:33.354 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-06-06T03:41:33.354 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.l 2024-06-06T03:41:33.677 INFO:journalctl@ceph.mds.l.smithi122.stdout:Jun 06 03:41:33 smithi122 systemd[1]: Stopping Ceph mds.l for b6263b26-23b2-11ef-bc9b-c7b262605968... 2024-06-06T03:41:33.931 INFO:journalctl@ceph.mds.l.smithi122.stdout:Jun 06 03:41:33 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-l[65602]: 2024-06-06T03:41:33.677+0000 7f17c3ac3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T03:41:33.931 INFO:journalctl@ceph.mds.l.smithi122.stdout:Jun 06 03:41:33 smithi122 ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-l[65602]: 2024-06-06T03:41:33.677+0000 7f17c3ac3700 -1 mds.l *** got signal Terminated *** 2024-06-06T03:41:38.128 INFO:journalctl@ceph.mds.l.smithi122.stdout:Jun 06 03:41:37 smithi122 podman[72756]: 2024-06-06 03:41:37.856305009 +0000 UTC m=+4.281402407 container died 12f963a3dbd1d1231a6565052fb934780ed880839f26d9847382547ecfc773d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-l, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-06T03:41:38.431 INFO:journalctl@ceph.mds.l.smithi122.stdout:Jun 06 03:41:38 smithi122 podman[72756]: 2024-06-06 03:41:38.228335212 +0000 UTC m=+4.653432599 container cleanup 12f963a3dbd1d1231a6565052fb934780ed880839f26d9847382547ecfc773d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-06-06T03:41:38.431 INFO:journalctl@ceph.mds.l.smithi122.stdout:Jun 06 03:41:38 smithi122 bash[72756]: ceph-b6263b26-23b2-11ef-bc9b-c7b262605968-mds-l 2024-06-06T03:41:38.632 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b6263b26-23b2-11ef-bc9b-c7b262605968@mds.l.service' 2024-06-06T03:41:38.663 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T03:41:38.663 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-06-06T03:41:38.663 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 --force --keep-logs 2024-06-06T03:41:38.865 INFO:teuthology.orchestra.run.smithi050.stdout:Deleting cluster with fsid: b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:41:41.416 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 --force --keep-logs 2024-06-06T03:41:41.613 INFO:teuthology.orchestra.run.smithi079.stdout:Deleting cluster with fsid: b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:41:43.999 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 --force --keep-logs 2024-06-06T03:41:44.187 INFO:teuthology.orchestra.run.smithi122.stdout:Deleting cluster with fsid: b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:41:46.587 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-06T03:41:46.621 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-06T03:41:46.653 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-06T03:41:46.679 INFO:tasks.cephadm:Archiving crash dumps... 2024-06-06T03:41:46.681 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi/7743011/remote/smithi050/crash 2024-06-06T03:41:46.682 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/crash -- . 2024-06-06T03:41:46.714 INFO:teuthology.orchestra.run.smithi050.stderr:tar: /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/crash: Cannot open: No such file or directory 2024-06-06T03:41:46.714 INFO:teuthology.orchestra.run.smithi050.stderr:tar: Error is not recoverable: exiting now 2024-06-06T03:41:46.716 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi/7743011/remote/smithi079/crash 2024-06-06T03:41:46.717 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/crash -- . 2024-06-06T03:41:46.789 INFO:teuthology.orchestra.run.smithi079.stderr:tar: /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/crash: Cannot open: No such file or directory 2024-06-06T03:41:46.789 INFO:teuthology.orchestra.run.smithi079.stderr:tar: Error is not recoverable: exiting now 2024-06-06T03:41:46.791 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi/7743011/remote/smithi122/crash 2024-06-06T03:41:46.792 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/crash -- . 2024-06-06T03:41:46.827 INFO:teuthology.orchestra.run.smithi122.stderr:tar: /var/lib/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/crash: Cannot open: No such file or directory 2024-06-06T03:41:46.827 INFO:teuthology.orchestra.run.smithi122.stderr:tar: Error is not recoverable: exiting now 2024-06-06T03:41:46.828 INFO:tasks.cephadm:Checking cluster log for badness... 2024-06-06T03:41:46.828 DEBUG:teuthology.orchestra.run.smithi050:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-06-06T03:41:46.921 INFO:teuthology.orchestra.run.smithi050.stdout:2024-06-06T03:36:40.145195+0000 mds.c (mds.1) 23 : cluster [WRN] Scrub error on inode 0x10000000201 (/volumes/qa/sv_0/e20c3842-0277-4a93-ad2b-9ee2fe9f11df/client.0/tmp/iogen_3.1p0) see mds.c log and `damage ls` output for details 2024-06-06T03:41:46.922 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-06-06T03:41:46.922 INFO:tasks.cephadm:Compressing logs... 2024-06-06T03:41:46.922 DEBUG:teuthology.orchestra.run.smithi050:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-06T03:41:46.925 DEBUG:teuthology.orchestra.run.smithi079:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-06T03:41:46.927 DEBUG:teuthology.orchestra.run.smithi122:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-06T03:41:46.951 INFO:teuthology.orchestra.run.smithi122.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose --: No such file or directory /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph.log 2024-06-06T03:41:46.951 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-06-06T03:41:46.951 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.2.log 2024-06-06T03:41:46.956 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.f.log 2024-06-06T03:41:46.956 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph.audit.log 2024-06-06T03:41:46.956 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.5.log 2024-06-06T03:41:46.956 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.c.log 2024-06-06T03:41:46.956 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mon.c.log 2024-06-06T03:41:46.956 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mgr.z.log 2024-06-06T03:41:46.956 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.i.log 2024-06-06T03:41:46.956 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph.cephadm.log 2024-06-06T03:41:46.956 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.11.log 2024-06-06T03:41:46.956 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.8.log 2024-06-06T03:41:46.956 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-volume.log 2024-06-06T03:41:46.956 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.l.log 2024-06-06T03:41:46.956 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-06-06T03:41:46.959 INFO:teuthology.orchestra.run.smithi079.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose: No such file or directory -- 2024-06-06T03:41:46.959 INFO:teuthology.orchestra.run.smithi079.stderr: /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph.log 2024-06-06T03:41:46.959 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph.audit.log 2024-06-06T03:41:46.959 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.7.log 2024-06-06T03:41:46.959 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.b.log 2024-06-06T03:41:46.959 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.4.log 2024-06-06T03:41:46.959 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.1.log 2024-06-06T03:41:46.959 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.b.log: /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mgr.y.log 2024-06-06T03:41:46.959 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.h.log 2024-06-06T03:41:46.959 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mgr.y.log: 90.4% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph.audit.log.gz 2024-06-06T03:41:46.960 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.h.log: 87.2% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph.log.gz 2024-06-06T03:41:46.960 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.10.log 2024-06-06T03:41:46.960 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph.cephadm.log 2024-06-06T03:41:46.960 INFO:teuthology.orchestra.run.smithi050.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-06-06T03:41:46.960 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.e.log 2024-06-06T03:41:46.960 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph.cephadm.log: 82.4% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph.cephadm.log.gz 2024-06-06T03:41:46.961 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-volume.log 2024-06-06T03:41:46.961 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-06-06T03:41:46.962 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph.log 2024-06-06T03:41:46.962 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph.audit.log 2024-06-06T03:41:46.962 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.g.log 2024-06-06T03:41:46.963 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.e.log: 93.0% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mgr.y.log.gz 2024-06-06T03:41:46.964 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph.log: /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.j.log 2024-06-06T03:41:46.964 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.3.log 2024-06-06T03:41:46.964 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.0.log 2024-06-06T03:41:46.964 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mgr.x.log 2024-06-06T03:41:46.965 INFO:teuthology.orchestra.run.smithi079.stderr: 94.5% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.e.log.gz 2024-06-06T03:41:46.965 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mon.b.log 2024-06-06T03:41:46.970 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mon.a.log 2024-06-06T03:41:46.970 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.0.log: /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.6.log 2024-06-06T03:41:46.970 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph.cephadm.log 2024-06-06T03:41:46.970 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.a.log 2024-06-06T03:41:46.971 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.6.log: 87.2% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph.log.gz 2024-06-06T03:41:46.971 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-volume.log 2024-06-06T03:41:46.971 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.d.log 2024-06-06T03:41:46.971 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.a.log: /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.9.log 2024-06-06T03:41:46.971 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-06-06T03:41:46.971 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-06-06T03:41:46.972 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/cephadm.log: 94.6% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.j.log.gz 2024-06-06T03:41:46.972 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.log: 94.6% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.g.log.gz 2024-06-06T03:41:46.972 INFO:teuthology.orchestra.run.smithi050.stderr: 94.5% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.a.log.gz 2024-06-06T03:41:46.972 INFO:teuthology.orchestra.run.smithi050.stderr: 94.6% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.d.log.gz 2024-06-06T03:41:46.973 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.k.log 2024-06-06T03:41:46.977 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-06-06T03:41:46.978 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.k.log: 91.0% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-volume.log.gz 2024-06-06T03:41:46.982 INFO:teuthology.orchestra.run.smithi079.stderr: 94.4% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.k.log.gz 2024-06-06T03:41:46.985 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/cephadm.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-06-06T03:41:46.989 INFO:teuthology.orchestra.run.smithi050.stderr: 90.2% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph.audit.log.gz 2024-06-06T03:41:47.007 INFO:teuthology.orchestra.run.smithi050.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-06-06T03:41:47.022 INFO:teuthology.orchestra.run.smithi079.stderr: 94.8% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.h.log.gz 2024-06-06T03:41:47.025 INFO:teuthology.orchestra.run.smithi050.stderr: 82.3% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph.cephadm.log.gz 2024-06-06T03:41:47.041 INFO:teuthology.orchestra.run.smithi079.stderr: 93.8% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.b.log.gz 2024-06-06T03:41:47.055 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.l.log: /var/log/ceph/cephadm.log: 82.4% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph.cephadm.log.gz 2024-06-06T03:41:47.065 INFO:teuthology.orchestra.run.smithi122.stderr: 90.5% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph.audit.log.gz 2024-06-06T03:41:47.065 INFO:teuthology.orchestra.run.smithi122.stderr: 87.3% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph.log.gz 2024-06-06T03:41:47.109 INFO:teuthology.orchestra.run.smithi122.stderr: 93.2% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mgr.z.log.gz 2024-06-06T03:41:47.134 INFO:teuthology.orchestra.run.smithi122.stderr: 94.9% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.l.log.gz 2024-06-06T03:41:47.138 INFO:teuthology.orchestra.run.smithi122.stderr: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-06-06T03:41:47.150 INFO:teuthology.orchestra.run.smithi050.stderr: 94.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-06-06T03:41:47.155 INFO:teuthology.orchestra.run.smithi050.stderr: 91.1% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-volume.log.gz 2024-06-06T03:41:47.194 INFO:teuthology.orchestra.run.smithi122.stderr: 93.4% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.c.log.gz 2024-06-06T03:41:47.227 INFO:teuthology.orchestra.run.smithi122.stderr: 91.0% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-volume.log.gz 2024-06-06T03:41:47.231 INFO:teuthology.orchestra.run.smithi122.stderr: 93.5% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.f.log.gz 2024-06-06T03:41:47.330 INFO:teuthology.orchestra.run.smithi079.stderr: 91.8% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mon.b.log.gz 2024-06-06T03:41:47.536 INFO:teuthology.orchestra.run.smithi122.stderr: 92.7% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mds.i.log.gz 2024-06-06T03:41:47.558 INFO:teuthology.orchestra.run.smithi122.stderr: 91.7% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mon.c.log.gz 2024-06-06T03:41:53.729 INFO:teuthology.orchestra.run.smithi050.stderr: 90.3% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mgr.x.log.gz 2024-06-06T03:41:56.301 INFO:teuthology.orchestra.run.smithi050.stderr: 90.3% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-mon.a.log.gz 2024-06-06T03:42:16.668 INFO:teuthology.orchestra.run.smithi079.stderr: 91.1% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.10.log.gz 2024-06-06T03:42:28.161 INFO:teuthology.orchestra.run.smithi122.stderr: 90.7% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.8.log.gz 2024-06-06T03:42:35.758 INFO:teuthology.orchestra.run.smithi079.stderr: 90.6% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.1.log.gz 2024-06-06T03:42:44.091 INFO:teuthology.orchestra.run.smithi122.stderr: 90.6% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.11.log.gz 2024-06-06T03:42:46.370 INFO:teuthology.orchestra.run.smithi079.stderr: 90.7% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.7.log.gz 2024-06-06T03:42:50.229 INFO:teuthology.orchestra.run.smithi122.stderr: 90.6% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.2.log.gz 2024-06-06T03:43:09.621 INFO:teuthology.orchestra.run.smithi079.stderr: 90.7% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.4.log.gz 2024-06-06T03:43:09.623 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-06-06T03:43:09.623 INFO:teuthology.orchestra.run.smithi079.stderr:real 1m22.682s 2024-06-06T03:43:09.623 INFO:teuthology.orchestra.run.smithi079.stderr:user 3m33.994s 2024-06-06T03:43:09.623 INFO:teuthology.orchestra.run.smithi079.stderr:sys 0m6.614s 2024-06-06T03:43:19.273 INFO:teuthology.orchestra.run.smithi122.stderr: 90.5% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.5.log.gz 2024-06-06T03:43:19.275 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-06-06T03:43:19.275 INFO:teuthology.orchestra.run.smithi122.stderr:real 1m32.333s 2024-06-06T03:43:19.275 INFO:teuthology.orchestra.run.smithi122.stderr:user 3m50.280s 2024-06-06T03:43:19.275 INFO:teuthology.orchestra.run.smithi122.stderr:sys 0m7.239s 2024-06-06T03:45:54.695 INFO:teuthology.orchestra.run.smithi050.stderr: 90.4% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.6.log.gz 2024-06-06T03:48:23.434 INFO:teuthology.orchestra.run.smithi050.stderr: 90.4% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.3.log.gz 2024-06-06T03:48:44.957 INFO:teuthology.orchestra.run.smithi050.stderr: 90.4% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.0.log.gz 2024-06-06T03:50:23.948 INFO:teuthology.orchestra.run.smithi050.stderr: 90.4% -- replaced with /var/log/ceph/b6263b26-23b2-11ef-bc9b-c7b262605968/ceph-osd.9.log.gz 2024-06-06T03:50:54.133 INFO:teuthology.orchestra.run.smithi050.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-06-06T03:50:54.135 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-06-06T03:50:54.135 INFO:teuthology.orchestra.run.smithi050.stderr:real 9m7.196s 2024-06-06T03:50:54.135 INFO:teuthology.orchestra.run.smithi050.stderr:user 6m7.153s 2024-06-06T03:50:54.135 INFO:teuthology.orchestra.run.smithi050.stderr:sys 0m14.492s 2024-06-06T03:50:54.136 INFO:tasks.cephadm:Archiving logs... 2024-06-06T03:50:54.136 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi/7743011/remote/smithi050/log 2024-06-06T03:50:54.137 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-06T03:51:52.981 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi/7743011/remote/smithi079/log 2024-06-06T03:51:52.982 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-06T03:52:31.007 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi/7743011/remote/smithi122/log 2024-06-06T03:52:31.008 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-06T03:53:12.456 INFO:tasks.cephadm:Removing cluster... 2024-06-06T03:53:12.456 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 --force 2024-06-06T03:53:12.659 INFO:teuthology.orchestra.run.smithi050.stdout:Deleting cluster with fsid: b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:53:13.267 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 --force 2024-06-06T03:53:13.461 INFO:teuthology.orchestra.run.smithi079.stdout:Deleting cluster with fsid: b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:53:14.064 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b6263b26-23b2-11ef-bc9b-c7b262605968 --force 2024-06-06T03:53:14.266 INFO:teuthology.orchestra.run.smithi122.stdout:Deleting cluster with fsid: b6263b26-23b2-11ef-bc9b-c7b262605968 2024-06-06T03:53:14.883 INFO:tasks.cephadm:Removing cephadm ... 2024-06-06T03:53:14.884 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf /home/ubuntu/cephtest/cephadm 2024-06-06T03:53:14.902 DEBUG:teuthology.orchestra.run.smithi079:> rm -rf /home/ubuntu/cephtest/cephadm 2024-06-06T03:53:14.919 DEBUG:teuthology.orchestra.run.smithi122:> rm -rf /home/ubuntu/cephtest/cephadm 2024-06-06T03:53:14.935 INFO:tasks.cephadm:Teardown complete 2024-06-06T03:53:14.935 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-06-06T03:53:14.947 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_3d746ca5346f34eef7e826a1eb71e59e02b682ae/qa/tasks/fwd_scrub.py", line 155, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph_3d746ca5346f34eef7e826a1eb71e59e02b682ae/qa/tasks/fwd_scrub.py", line 90, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-06-06T03:53:14.948 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-06-06T03:53:14.948 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-06T03:53:14.951 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-06T03:53:14.961 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-06T03:53:15.079 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-06-06T03:53:15.089 INFO:teuthology.task.clock:Checking final clock skew... 2024-06-06T03:53:15.089 DEBUG:teuthology.orchestra.run.smithi050:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-06T03:53:15.092 DEBUG:teuthology.orchestra.run.smithi079:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-06T03:53:15.094 DEBUG:teuthology.orchestra.run.smithi122:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-06T03:53:15.105 INFO:teuthology.orchestra.run.smithi050.stderr:bash: line 1: ntpq: command not found 2024-06-06T03:53:15.106 INFO:teuthology.orchestra.run.smithi079.stderr:bash: line 1: ntpq: command not found 2024-06-06T03:53:15.109 INFO:teuthology.orchestra.run.smithi122.stderr:bash: line 1: ntpq: command not found 2024-06-06T03:53:15.109 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-06T03:53:15.110 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2024-06-06T03:53:15.110 INFO:teuthology.orchestra.run.smithi050.stdout:^* hv01.front.sepia.ceph.com 3 6 377 41 +669us[ +662us] +/- 65ms 2024-06-06T03:53:15.110 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 40 -665us[ -665us] +/- 76ms 2024-06-06T03:53:15.110 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 42 -130us[ -136us] +/- 66ms 2024-06-06T03:53:15.110 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T03:53:15.112 INFO:teuthology.orchestra.run.smithi079.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-06T03:53:15.112 INFO:teuthology.orchestra.run.smithi079.stdout:=============================================================================== 2024-06-06T03:53:15.112 INFO:teuthology.orchestra.run.smithi079.stdout:^* hv01.front.sepia.ceph.com 3 6 377 45 +710us[ +721us] +/- 65ms 2024-06-06T03:53:15.112 INFO:teuthology.orchestra.run.smithi079.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 41 -641us[ -641us] +/- 76ms 2024-06-06T03:53:15.112 INFO:teuthology.orchestra.run.smithi079.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 41 -101us[ -101us] +/- 66ms 2024-06-06T03:53:15.112 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T03:53:15.114 INFO:teuthology.orchestra.run.smithi122.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-06T03:53:15.114 INFO:teuthology.orchestra.run.smithi122.stdout:=============================================================================== 2024-06-06T03:53:15.114 INFO:teuthology.orchestra.run.smithi122.stdout:^* hv01.front.sepia.ceph.com 3 6 377 41 +689us[ +696us] +/- 65ms 2024-06-06T03:53:15.114 INFO:teuthology.orchestra.run.smithi122.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 43 -653us[ -646us] +/- 76ms 2024-06-06T03:53:15.114 INFO:teuthology.orchestra.run.smithi122.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 41 -102us[ -102us] +/- 66ms 2024-06-06T03:53:15.114 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T03:53:15.115 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-06-06T03:53:15.125 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-06-06T03:53:15.125 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-06-06T03:53:15.143 DEBUG:teuthology.orchestra.run.smithi050:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-06T03:53:15.288 DEBUG:teuthology.orchestra.run.smithi079:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-06T03:53:15.354 DEBUG:teuthology.orchestra.run.smithi122:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-06T03:53:15.465 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-06T03:53:15.495 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T03:53:15.495 DEBUG:teuthology.orchestra.run.smithi079:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-06T03:53:15.523 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T03:53:15.523 DEBUG:teuthology.orchestra.run.smithi122:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-06T03:53:15.550 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T03:53:15.551 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-06-06T03:53:15.562 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-06-06T03:53:15.589 INFO:teuthology.task.internal:Duration was 2769.856718 seconds 2024-06-06T03:53:15.590 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-06-06T03:53:15.606 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-06-06T03:53:15.606 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-06T03:53:15.609 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-06T03:53:15.612 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-06T03:53:15.647 INFO:teuthology.orchestra.run.smithi079.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-06T03:53:15.661 INFO:teuthology.orchestra.run.smithi122.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-06T03:53:15.699 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-06T03:53:16.134 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-06-06T03:53:16.135 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi050.front.sepia.ceph.com 2024-06-06T03:53:16.135 DEBUG:teuthology.orchestra.run.smithi050:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-06T03:53:16.156 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi079.front.sepia.ceph.com 2024-06-06T03:53:16.156 DEBUG:teuthology.orchestra.run.smithi079:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-06T03:53:16.201 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi122.front.sepia.ceph.com 2024-06-06T03:53:16.201 DEBUG:teuthology.orchestra.run.smithi122:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-06T03:53:16.228 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-06-06T03:53:16.228 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-06T03:53:16.231 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-06T03:53:16.243 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-06T03:53:16.295 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-06-06T03:53:16.295 DEBUG:teuthology.orchestra.run.smithi050:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-06T03:53:16.299 DEBUG:teuthology.orchestra.run.smithi079:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-06T03:53:16.309 DEBUG:teuthology.orchestra.run.smithi122:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-06T03:53:17.208 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-06-06T03:53:17.220 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-06-06T03:53:17.220 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-06T03:53:17.262 DEBUG:teuthology.orchestra.run.smithi079:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-06T03:53:17.288 DEBUG:teuthology.orchestra.run.smithi122:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-06T03:53:17.316 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-06-06T03:53:17.327 DEBUG:teuthology.orchestra.run.smithi050:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-06T03:53:17.329 DEBUG:teuthology.orchestra.run.smithi079:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-06T03:53:17.332 DEBUG:teuthology.orchestra.run.smithi122:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-06T03:53:17.353 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = core 2024-06-06T03:53:17.356 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = core 2024-06-06T03:53:17.402 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = core 2024-06-06T03:53:17.422 DEBUG:teuthology.orchestra.run.smithi050:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-06T03:53:17.437 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T03:53:17.437 DEBUG:teuthology.orchestra.run.smithi079:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-06T03:53:17.454 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T03:53:17.455 DEBUG:teuthology.orchestra.run.smithi122:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-06T03:53:17.470 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T03:53:17.471 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-06-06T03:53:17.482 INFO:teuthology.task.internal:Transferring archived files... 2024-06-06T03:53:17.483 DEBUG:teuthology.misc:Transferring archived files from smithi050:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi/7743011/remote/smithi050 2024-06-06T03:53:17.483 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-06T03:53:17.540 DEBUG:teuthology.misc:Transferring archived files from smithi079:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi/7743011/remote/smithi079 2024-06-06T03:53:17.541 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-06T03:53:17.577 DEBUG:teuthology.misc:Transferring archived files from smithi122:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi/7743011/remote/smithi122 2024-06-06T03:53:17.577 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-06T03:53:17.615 INFO:teuthology.task.internal:Removing archive directory... 2024-06-06T03:53:17.615 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-06T03:53:17.617 DEBUG:teuthology.orchestra.run.smithi079:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-06T03:53:17.620 DEBUG:teuthology.orchestra.run.smithi122:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-06T03:53:17.665 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-06-06T03:53:17.678 INFO:teuthology.task.internal:Not uploading archives. 2024-06-06T03:53:17.678 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-06-06T03:53:17.722 INFO:teuthology.task.internal:Tidying up after the test... 2024-06-06T03:53:17.722 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-06T03:53:17.725 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-06T03:53:17.727 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-06T03:53:17.738 INFO:teuthology.orchestra.run.smithi050.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 6 03:53 /home/ubuntu/cephtest 2024-06-06T03:53:17.739 INFO:teuthology.orchestra.run.smithi079.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 6 03:53 /home/ubuntu/cephtest 2024-06-06T03:53:17.742 INFO:teuthology.orchestra.run.smithi122.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 6 03:53 /home/ubuntu/cephtest 2024-06-06T03:53:17.743 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-06-06T03:53:17.755 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-06-06T03:53:17.774 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-06-06T03:53:17.777 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/iogen}} duration: 2769.8567175865173 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-06-06T03:53:17.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-06T03:53:17.847 INFO:teuthology.run:FAIL